2024-04-19T02:03:04.419 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-19T02:03:04.419 DEBUG:teuthology.run:Teuthology command: teuthology --description powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-stupid powercycle/default supported-all-distro/centos_8 tasks/admin_socket_objecter_requests thrashosds-health} --archive /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662845 --owner scheduled_teuthology@teuthology --verbose --name teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi -- /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662845/orig.config.yaml 2024-04-19T02:03:04.454 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-19T02:03:04.531 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662845 branch: reef description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-stupid powercycle/default supported-all-distro/centos_8 tasks/admin_socket_objecter_requests thrashosds-health} email: ceph-qa@ceph.com first_in_suite: false job_id: '7662845' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 8.stream overrides: admin_socket: branch: reef ceph: conf: client.0: admin socket: /var/run/ceph/ceph-$name.asok mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: stupid bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MDS_TRIM\) - \(MDS_SLOW_REQUEST\) - MDS_SLOW_METADATA_IO - Behind on trimming - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from sha1: 646b8c7d293d8ec31a40c69f7b3237b19c1be24d ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 646b8c7d293d8ec31a40c69f7b3237b19c1be24d selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: reef sha1: 646b8c7d293d8ec31a40c69f7b3237b19c1be24d owner: scheduled_teuthology@teuthology priority: 930 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - client.0 - - osd.0 - - osd.1 - - osd.2 seed: 2879 sha1: 646b8c7d293d8ec31a40c69f7b3237b19c1be24d sleep_before_teardown: 0 subset: 2/4 suite: powercycle suite_branch: reef suite_path: /home/teuthworker/src/git.ceph.com_ceph_646b8c7d293d8ec31a40c69f7b3237b19c1be24d/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 646b8c7d293d8ec31a40c69f7b3237b19c1be24d targets: smithi121.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLEAN8P2ENYKn08Dp1X5HdIFUD4fYZA1EvzZ4RzsK8E5knWiOV6Sq4vcfh+rhJ+4K7vy6TmLdzNJyiro+1tTqyw= smithi153.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBImLo8VPPUYtpeizb/SWI/4v5lwGoDr3GgXvIgGNYRC0e/s5cjxTlmzexK9Et6mhClGt57AHCDveAmgY7c8J77Y= smithi174.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOSS8+BMUmAlHkyK+dU5PNmKCF/3jzZ74wzK5sAbqeAplHkfBHZPo0eDDR2kx7IirS89AO90CHhLFeFEliqPxZA= smithi177.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLGv+3JVcBijYquHWRnz7x7Ye89HAUZAOFrH5xb9XXVQoeJjxtiqbssDxRxDjx6dDrAXnQbGKemoTjS2Jb/I6q4= tasks: - install: extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - thrashosds: chance_down: 1.0 powercycle: true timeout: 600 - radosbench: clients: - client.0 time: 60 - admin_socket: client.0: objecter_requests: test: http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch} teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-18_22:32:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-19T02:03:04.531 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_646b8c7d293d8ec31a40c69f7b3237b19c1be24d/qa; will attempt to use it 2024-04-19T02:03:04.531 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_646b8c7d293d8ec31a40c69f7b3237b19c1be24d/qa/tasks 2024-04-19T02:03:04.532 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-19T02:03:04.533 INFO:teuthology.task.internal:Checking packages... 2024-04-19T02:03:04.556 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '646b8c7d293d8ec31a40c69f7b3237b19c1be24d' 2024-04-19T02:03:04.556 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-19T02:03:04.556 INFO:teuthology.packaging:ref: None 2024-04-19T02:03:04.556 INFO:teuthology.packaging:tag: None 2024-04-19T02:03:04.556 INFO:teuthology.packaging:branch: reef 2024-04-19T02:03:04.557 INFO:teuthology.packaging:sha1: 646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T02:03:04.557 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=reef 2024-04-19T02:03:04.809 INFO:teuthology.task.internal:Found packages for ceph version 18.2.2-1237.g646b8c7d 2024-04-19T02:03:04.811 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-19T02:03:04.817 INFO:teuthology.task.internal:no buildpackages task found 2024-04-19T02:03:04.817 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-19T02:03:04.828 INFO:teuthology.task.internal:Saving configuration 2024-04-19T02:03:04.842 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-19T02:03:04.848 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-19T02:03:04.872 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi121.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662845', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-19 01:55:05.435158', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLEAN8P2ENYKn08Dp1X5HdIFUD4fYZA1EvzZ4RzsK8E5knWiOV6Sq4vcfh+rhJ+4K7vy6TmLdzNJyiro+1tTqyw='} 2024-04-19T02:03:04.893 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662845', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-19 01:55:05.436489', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBImLo8VPPUYtpeizb/SWI/4v5lwGoDr3GgXvIgGNYRC0e/s5cjxTlmzexK9Et6mhClGt57AHCDveAmgY7c8J77Y='} 2024-04-19T02:03:04.912 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi174.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662845', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-19 01:55:05.432215', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOSS8+BMUmAlHkyK+dU5PNmKCF/3jzZ74wzK5sAbqeAplHkfBHZPo0eDDR2kx7IirS89AO90CHhLFeFEliqPxZA='} 2024-04-19T02:03:04.936 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi177.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662845', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-19 01:55:05.433936', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLGv+3JVcBijYquHWRnz7x7Ye89HAUZAOFrH5xb9XXVQoeJjxtiqbssDxRxDjx6dDrAXnQbGKemoTjS2Jb/I6q4='} 2024-04-19T02:03:04.936 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-19T02:03:04.943 INFO:teuthology.task.internal:roles: ubuntu@smithi121.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'] 2024-04-19T02:03:04.943 INFO:teuthology.task.internal:roles: ubuntu@smithi153.front.sepia.ceph.com - ['osd.0'] 2024-04-19T02:03:04.943 INFO:teuthology.task.internal:roles: ubuntu@smithi174.front.sepia.ceph.com - ['osd.1'] 2024-04-19T02:03:04.943 INFO:teuthology.task.internal:roles: ubuntu@smithi177.front.sepia.ceph.com - ['osd.2'] 2024-04-19T02:03:04.943 INFO:teuthology.run_tasks:Running task console_log... 2024-04-19T02:03:05.145 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f079aaf20d0>, signals=[15]) 2024-04-19T02:03:05.145 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-19T02:03:05.158 INFO:teuthology.task.internal:Opening connections... 2024-04-19T02:03:05.158 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi121.front.sepia.ceph.com 2024-04-19T02:03:05.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:03:05.235 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi153.front.sepia.ceph.com 2024-04-19T02:03:05.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:03:05.306 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi174.front.sepia.ceph.com 2024-04-19T02:03:05.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:03:05.377 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi177.front.sepia.ceph.com 2024-04-19T02:03:05.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:03:05.450 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-19T02:03:05.458 DEBUG:teuthology.orchestra.run.smithi121:> uname -m 2024-04-19T02:03:05.479 INFO:teuthology.orchestra.run.smithi121.stdout:x86_64 2024-04-19T02:03:05.480 DEBUG:teuthology.orchestra.run.smithi121:> cat /etc/os-release 2024-04-19T02:03:05.541 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="CentOS Stream" 2024-04-19T02:03:05.541 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="8" 2024-04-19T02:03:05.541 INFO:teuthology.orchestra.run.smithi121.stdout:ID="centos" 2024-04-19T02:03:05.541 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE="rhel fedora" 2024-04-19T02:03:05.541 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="8" 2024-04-19T02:03:05.541 INFO:teuthology.orchestra.run.smithi121.stdout:PLATFORM_ID="platform:el8" 2024-04-19T02:03:05.541 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-19T02:03:05.541 INFO:teuthology.orchestra.run.smithi121.stdout:ANSI_COLOR="0;31" 2024-04-19T02:03:05.541 INFO:teuthology.orchestra.run.smithi121.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-19T02:03:05.541 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://centos.org/" 2024-04-19T02:03:05.541 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-19T02:03:05.541 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-19T02:03:05.541 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-19T02:03:05.542 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server 2024-04-19T02:03:05.566 DEBUG:teuthology.orchestra.run.smithi153:> uname -m 2024-04-19T02:03:05.589 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64 2024-04-19T02:03:05.589 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2024-04-19T02:03:05.650 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="CentOS Stream" 2024-04-19T02:03:05.650 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="8" 2024-04-19T02:03:05.650 INFO:teuthology.orchestra.run.smithi153.stdout:ID="centos" 2024-04-19T02:03:05.650 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="rhel fedora" 2024-04-19T02:03:05.650 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="8" 2024-04-19T02:03:05.650 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el8" 2024-04-19T02:03:05.650 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-19T02:03:05.650 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31" 2024-04-19T02:03:05.650 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-19T02:03:05.651 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://centos.org/" 2024-04-19T02:03:05.651 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-19T02:03:05.651 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-19T02:03:05.651 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-19T02:03:05.651 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2024-04-19T02:03:05.666 DEBUG:teuthology.orchestra.run.smithi174:> uname -m 2024-04-19T02:03:05.687 INFO:teuthology.orchestra.run.smithi174.stdout:x86_64 2024-04-19T02:03:05.688 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2024-04-19T02:03:05.748 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="CentOS Stream" 2024-04-19T02:03:05.748 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="8" 2024-04-19T02:03:05.748 INFO:teuthology.orchestra.run.smithi174.stdout:ID="centos" 2024-04-19T02:03:05.748 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="rhel fedora" 2024-04-19T02:03:05.748 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="8" 2024-04-19T02:03:05.748 INFO:teuthology.orchestra.run.smithi174.stdout:PLATFORM_ID="platform:el8" 2024-04-19T02:03:05.749 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-19T02:03:05.749 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31" 2024-04-19T02:03:05.749 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-19T02:03:05.749 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://centos.org/" 2024-04-19T02:03:05.749 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-19T02:03:05.749 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-19T02:03:05.749 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-19T02:03:05.749 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2024-04-19T02:03:05.774 DEBUG:teuthology.orchestra.run.smithi177:> uname -m 2024-04-19T02:03:05.797 INFO:teuthology.orchestra.run.smithi177.stdout:x86_64 2024-04-19T02:03:05.797 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release 2024-04-19T02:03:05.859 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="CentOS Stream" 2024-04-19T02:03:05.859 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="8" 2024-04-19T02:03:05.859 INFO:teuthology.orchestra.run.smithi177.stdout:ID="centos" 2024-04-19T02:03:05.859 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="rhel fedora" 2024-04-19T02:03:05.859 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="8" 2024-04-19T02:03:05.859 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el8" 2024-04-19T02:03:05.859 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-19T02:03:05.859 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31" 2024-04-19T02:03:05.859 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-19T02:03:05.860 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://centos.org/" 2024-04-19T02:03:05.860 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-19T02:03:05.860 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-19T02:03:05.860 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-19T02:03:05.860 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server 2024-04-19T02:03:05.882 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-19T02:03:05.891 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-19T02:03:05.897 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-19T02:03:05.897 DEBUG:teuthology.orchestra.run.smithi121:> test '!' -e /home/ubuntu/cephtest 2024-04-19T02:03:05.899 DEBUG:teuthology.orchestra.run.smithi153:> test '!' -e /home/ubuntu/cephtest 2024-04-19T02:03:05.901 DEBUG:teuthology.orchestra.run.smithi174:> test '!' -e /home/ubuntu/cephtest 2024-04-19T02:03:05.904 DEBUG:teuthology.orchestra.run.smithi177:> test '!' -e /home/ubuntu/cephtest 2024-04-19T02:03:05.924 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-19T02:03:05.930 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-19T02:03:05.931 DEBUG:teuthology.orchestra.run.smithi121:> test -z $(ls -A /var/lib/ceph) 2024-04-19T02:03:05.959 DEBUG:teuthology.orchestra.run.smithi153:> test -z $(ls -A /var/lib/ceph) 2024-04-19T02:03:05.962 DEBUG:teuthology.orchestra.run.smithi174:> test -z $(ls -A /var/lib/ceph) 2024-04-19T02:03:05.964 DEBUG:teuthology.orchestra.run.smithi177:> test -z $(ls -A /var/lib/ceph) 2024-04-19T02:03:05.994 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-19T02:03:06.083 INFO:teuthology.run_tasks:Running task kernel... 2024-04-19T02:03:06.097 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-19T02:03:06.097 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'osd.0': {'kdb': 1, 'sha1': 'distro'}, 'osd.1': {'kdb': 1, 'sha1': 'distro'}, 'osd.2': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-19T02:03:06.097 DEBUG:teuthology.orchestra.run.smithi121:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-19T02:03:06.098 DEBUG:teuthology.orchestra.run.smithi153:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-19T02:03:06.098 DEBUG:teuthology.orchestra.run.smithi174:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-19T02:03:06.099 DEBUG:teuthology.orchestra.run.smithi177:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-19T02:03:06.118 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T02:03:06.119 DEBUG:teuthology.orchestra.run.smithi174:> uname -r 2024-04-19T02:03:06.119 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T02:03:06.120 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T02:03:06.120 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T02:03:06.121 DEBUG:teuthology.orchestra.run.smithi177:> uname -r 2024-04-19T02:03:06.121 DEBUG:teuthology.orchestra.run.smithi153:> uname -r 2024-04-19T02:03:06.122 DEBUG:teuthology.orchestra.run.smithi121:> uname -r 2024-04-19T02:03:06.178 INFO:teuthology.orchestra.run.smithi174.stdout:4.18.0-489.el8.x86_64 2024-04-19T02:03:06.179 INFO:teuthology.task.kernel:Running kernel on smithi174: 4.18.0-489.el8.x86_64 2024-04-19T02:03:06.179 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum install -y kernel 2024-04-19T02:03:06.182 INFO:teuthology.orchestra.run.smithi153.stdout:4.18.0-489.el8.x86_64 2024-04-19T02:03:06.182 INFO:teuthology.orchestra.run.smithi121.stdout:4.18.0-489.el8.x86_64 2024-04-19T02:03:06.182 INFO:teuthology.task.kernel:Running kernel on smithi153: 4.18.0-489.el8.x86_64 2024-04-19T02:03:06.182 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum install -y kernel 2024-04-19T02:03:06.183 INFO:teuthology.task.kernel:Running kernel on smithi121: 4.18.0-489.el8.x86_64 2024-04-19T02:03:06.183 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum install -y kernel 2024-04-19T02:03:06.184 INFO:teuthology.orchestra.run.smithi177.stdout:4.18.0-489.el8.x86_64 2024-04-19T02:03:06.184 INFO:teuthology.task.kernel:Running kernel on smithi177: 4.18.0-489.el8.x86_64 2024-04-19T02:03:06.184 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum install -y kernel 2024-04-19T02:03:11.500 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 8 - AppStream 9.5 MB/s | 28 MB 00:02 2024-04-19T02:03:11.553 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 8 - AppStream 9.5 MB/s | 28 MB 00:02 2024-04-19T02:03:11.809 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 8 - AppStream 9.3 MB/s | 28 MB 00:03 2024-04-19T02:03:12.075 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 8 - AppStream 8.8 MB/s | 28 MB 00:03 2024-04-19T02:03:17.235 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 8 - BaseOS 16 MB/s | 10 MB 00:00 2024-04-19T02:03:17.242 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 8 - BaseOS 15 MB/s | 10 MB 00:00 2024-04-19T02:03:17.600 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 8 - BaseOS 13 MB/s | 10 MB 00:00 2024-04-19T02:03:18.766 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 8 - BaseOS 6.2 MB/s | 10 MB 00:01 2024-04-19T02:03:19.202 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 8 - Extras 53 kB/s | 18 kB 00:00 2024-04-19T02:03:19.417 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 8 - Extras 33 kB/s | 18 kB 00:00 2024-04-19T02:03:19.601 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 8 - Extras 44 kB/s | 18 kB 00:00 2024-04-19T02:03:19.828 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 8 - Extras common packages 15 kB/s | 7.7 kB 00:00 2024-04-19T02:03:20.051 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 8 - Extras common packages 15 kB/s | 7.7 kB 00:00 2024-04-19T02:03:20.163 INFO:teuthology.orchestra.run.smithi174.stdout:Copr repo for python3-asyncssh owned by ceph 14 kB/s | 3.5 kB 00:00 2024-04-19T02:03:20.176 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 8 - Extras common packages 17 kB/s | 7.7 kB 00:00 2024-04-19T02:03:20.286 INFO:teuthology.orchestra.run.smithi153.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2024-04-19T02:03:20.412 INFO:teuthology.orchestra.run.smithi177.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2024-04-19T02:03:20.617 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 8 - Extras 80 kB/s | 18 kB 00:00 2024-04-19T02:03:20.942 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 8 - Extras common packages 36 kB/s | 7.7 kB 00:00 2024-04-19T02:03:21.185 INFO:teuthology.orchestra.run.smithi121.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2024-04-19T02:03:23.396 INFO:teuthology.orchestra.run.smithi121.stdout:Extra Packages for Enterprise Linux 7.7 MB/s | 16 MB 00:02 2024-04-19T02:03:23.799 INFO:teuthology.orchestra.run.smithi174.stdout:Extra Packages for Enterprise Linux 4.6 MB/s | 16 MB 00:03 2024-04-19T02:03:23.895 INFO:teuthology.orchestra.run.smithi177.stdout:Extra Packages for Enterprise Linux 4.8 MB/s | 16 MB 00:03 2024-04-19T02:03:24.703 INFO:teuthology.orchestra.run.smithi153.stdout:Extra Packages for Enterprise Linux 3.8 MB/s | 16 MB 00:04 2024-04-19T02:03:27.203 INFO:teuthology.orchestra.run.smithi121.stdout:lab-extras 400 kB/s | 24 kB 00:00 2024-04-19T02:03:27.548 INFO:teuthology.orchestra.run.smithi174.stdout:lab-extras 450 kB/s | 24 kB 00:00 2024-04-19T02:03:27.697 INFO:teuthology.orchestra.run.smithi177.stdout:lab-extras 494 kB/s | 24 kB 00:00 2024-04-19T02:03:28.511 INFO:teuthology.orchestra.run.smithi153.stdout:lab-extras 398 kB/s | 24 kB 00:00 2024-04-19T02:03:30.258 INFO:teuthology.orchestra.run.smithi121.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-04-19T02:03:30.258 INFO:teuthology.orchestra.run.smithi121.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-04-19T02:03:30.386 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-04-19T02:03:30.387 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-04-19T02:03:30.387 INFO:teuthology.orchestra.run.smithi121.stdout: Package Architecture Version Repository Size 2024-04-19T02:03:30.387 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-04-19T02:03:30.387 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2024-04-19T02:03:30.387 INFO:teuthology.orchestra.run.smithi121.stdout: kernel x86_64 4.18.0-552.el8 baseos 10 M 2024-04-19T02:03:30.387 INFO:teuthology.orchestra.run.smithi121.stdout:Installing dependencies: 2024-04-19T02:03:30.387 INFO:teuthology.orchestra.run.smithi121.stdout: kernel-core x86_64 4.18.0-552.el8 baseos 44 M 2024-04-19T02:03:30.387 INFO:teuthology.orchestra.run.smithi121.stdout: kernel-modules x86_64 4.18.0-552.el8 baseos 36 M 2024-04-19T02:03:30.387 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:03:30.387 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2024-04-19T02:03:30.387 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-04-19T02:03:30.387 INFO:teuthology.orchestra.run.smithi121.stdout:Install 3 Packages 2024-04-19T02:03:30.387 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:03:30.388 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 90 M 2024-04-19T02:03:30.388 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 96 M 2024-04-19T02:03:30.388 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2024-04-19T02:03:30.590 INFO:teuthology.orchestra.run.smithi174.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-04-19T02:03:30.590 INFO:teuthology.orchestra.run.smithi174.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-04-19T02:03:30.703 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies resolved. 2024-04-19T02:03:30.704 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-04-19T02:03:30.704 INFO:teuthology.orchestra.run.smithi174.stdout: Package Architecture Version Repository Size 2024-04-19T02:03:30.704 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-04-19T02:03:30.704 INFO:teuthology.orchestra.run.smithi174.stdout:Installing: 2024-04-19T02:03:30.704 INFO:teuthology.orchestra.run.smithi174.stdout: kernel x86_64 4.18.0-552.el8 baseos 10 M 2024-04-19T02:03:30.704 INFO:teuthology.orchestra.run.smithi174.stdout:Installing dependencies: 2024-04-19T02:03:30.704 INFO:teuthology.orchestra.run.smithi174.stdout: kernel-core x86_64 4.18.0-552.el8 baseos 44 M 2024-04-19T02:03:30.704 INFO:teuthology.orchestra.run.smithi174.stdout: kernel-modules x86_64 4.18.0-552.el8 baseos 36 M 2024-04-19T02:03:30.704 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-19T02:03:30.704 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2024-04-19T02:03:30.704 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-04-19T02:03:30.705 INFO:teuthology.orchestra.run.smithi174.stdout:Install 3 Packages 2024-04-19T02:03:30.705 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-19T02:03:30.705 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 90 M 2024-04-19T02:03:30.705 INFO:teuthology.orchestra.run.smithi174.stdout:Installed size: 96 M 2024-04-19T02:03:30.705 INFO:teuthology.orchestra.run.smithi174.stdout:Downloading Packages: 2024-04-19T02:03:30.743 INFO:teuthology.orchestra.run.smithi177.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-04-19T02:03:30.744 INFO:teuthology.orchestra.run.smithi177.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-04-19T02:03:30.853 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-04-19T02:03:30.854 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-04-19T02:03:30.854 INFO:teuthology.orchestra.run.smithi177.stdout: Package Architecture Version Repository Size 2024-04-19T02:03:30.854 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-04-19T02:03:30.854 INFO:teuthology.orchestra.run.smithi177.stdout:Installing: 2024-04-19T02:03:30.854 INFO:teuthology.orchestra.run.smithi177.stdout: kernel x86_64 4.18.0-552.el8 baseos 10 M 2024-04-19T02:03:30.854 INFO:teuthology.orchestra.run.smithi177.stdout:Installing dependencies: 2024-04-19T02:03:30.854 INFO:teuthology.orchestra.run.smithi177.stdout: kernel-core x86_64 4.18.0-552.el8 baseos 44 M 2024-04-19T02:03:30.855 INFO:teuthology.orchestra.run.smithi177.stdout: kernel-modules x86_64 4.18.0-552.el8 baseos 36 M 2024-04-19T02:03:30.855 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-19T02:03:30.855 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction Summary 2024-04-19T02:03:30.855 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-04-19T02:03:30.855 INFO:teuthology.orchestra.run.smithi177.stdout:Install 3 Packages 2024-04-19T02:03:30.855 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-19T02:03:30.855 INFO:teuthology.orchestra.run.smithi177.stdout:Total download size: 90 M 2024-04-19T02:03:30.855 INFO:teuthology.orchestra.run.smithi177.stdout:Installed size: 96 M 2024-04-19T02:03:30.855 INFO:teuthology.orchestra.run.smithi177.stdout:Downloading Packages: 2024-04-19T02:03:31.508 INFO:teuthology.orchestra.run.smithi153.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-04-19T02:03:31.508 INFO:teuthology.orchestra.run.smithi153.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-04-19T02:03:31.634 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-04-19T02:03:31.635 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-04-19T02:03:31.635 INFO:teuthology.orchestra.run.smithi153.stdout: Package Architecture Version Repository Size 2024-04-19T02:03:31.635 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-04-19T02:03:31.635 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-04-19T02:03:31.635 INFO:teuthology.orchestra.run.smithi153.stdout: kernel x86_64 4.18.0-552.el8 baseos 10 M 2024-04-19T02:03:31.635 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2024-04-19T02:03:31.636 INFO:teuthology.orchestra.run.smithi153.stdout: kernel-core x86_64 4.18.0-552.el8 baseos 44 M 2024-04-19T02:03:31.636 INFO:teuthology.orchestra.run.smithi153.stdout: kernel-modules x86_64 4.18.0-552.el8 baseos 36 M 2024-04-19T02:03:31.636 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-19T02:03:31.636 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-04-19T02:03:31.636 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-04-19T02:03:31.636 INFO:teuthology.orchestra.run.smithi153.stdout:Install 3 Packages 2024-04-19T02:03:31.636 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-19T02:03:31.636 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 90 M 2024-04-19T02:03:31.637 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 96 M 2024-04-19T02:03:31.637 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-04-19T02:03:31.973 INFO:teuthology.orchestra.run.smithi177.stdout:(1/3): kernel-4.18.0-552.el8.x86_64.rpm 11 MB/s | 10 MB 00:00 2024-04-19T02:03:32.304 INFO:teuthology.orchestra.run.smithi121.stdout:(1/3): kernel-4.18.0-552.el8.x86_64.rpm 5.6 MB/s | 10 MB 00:01 2024-04-19T02:03:32.658 INFO:teuthology.orchestra.run.smithi174.stdout:(1/3): kernel-4.18.0-552.el8.x86_64.rpm 5.5 MB/s | 10 MB 00:01 2024-04-19T02:03:33.148 INFO:teuthology.orchestra.run.smithi177.stdout:(2/3): kernel-modules-4.18.0-552.el8.x86_64.rpm 18 MB/s | 36 MB 00:02 2024-04-19T02:03:33.720 INFO:teuthology.orchestra.run.smithi121.stdout:(2/3): kernel-modules-4.18.0-552.el8.x86_64.rpm 11 MB/s | 36 MB 00:03 2024-04-19T02:03:33.940 INFO:teuthology.orchestra.run.smithi177.stdout:(3/3): kernel-core-4.18.0-552.el8.x86_64.rpm 15 MB/s | 44 MB 00:02 2024-04-19T02:03:33.940 INFO:teuthology.orchestra.run.smithi177.stdout:-------------------------------------------------------------------------------- 2024-04-19T02:03:33.940 INFO:teuthology.orchestra.run.smithi177.stdout:Total 29 MB/s | 90 MB 00:03 2024-04-19T02:03:34.062 INFO:teuthology.orchestra.run.smithi153.stdout:(1/3): kernel-4.18.0-552.el8.x86_64.rpm 4.4 MB/s | 10 MB 00:02 2024-04-19T02:03:34.299 INFO:teuthology.orchestra.run.smithi174.stdout:(2/3): kernel-modules-4.18.0-552.el8.x86_64.rpm 10 MB/s | 36 MB 00:03 2024-04-19T02:03:34.346 INFO:teuthology.orchestra.run.smithi121.stdout:(3/3): kernel-core-4.18.0-552.el8.x86_64.rpm 11 MB/s | 44 MB 00:03 2024-04-19T02:03:34.346 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2024-04-19T02:03:34.346 INFO:teuthology.orchestra.run.smithi121.stdout:Total 23 MB/s | 90 MB 00:03 2024-04-19T02:03:34.628 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction check 2024-04-19T02:03:34.857 INFO:teuthology.orchestra.run.smithi174.stdout:(3/3): kernel-core-4.18.0-552.el8.x86_64.rpm 11 MB/s | 44 MB 00:04 2024-04-19T02:03:34.858 INFO:teuthology.orchestra.run.smithi174.stdout:-------------------------------------------------------------------------------- 2024-04-19T02:03:34.858 INFO:teuthology.orchestra.run.smithi174.stdout:Total 22 MB/s | 90 MB 00:04 2024-04-19T02:03:35.030 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2024-04-19T02:03:35.058 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction check succeeded. 2024-04-19T02:03:35.058 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction test 2024-04-19T02:03:35.154 INFO:teuthology.orchestra.run.smithi153.stdout:(2/3): kernel-modules-4.18.0-552.el8.x86_64.rpm 11 MB/s | 36 MB 00:03 2024-04-19T02:03:35.455 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2024-04-19T02:03:35.455 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2024-04-19T02:03:35.540 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction check 2024-04-19T02:03:35.955 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction check succeeded. 2024-04-19T02:03:35.955 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction test 2024-04-19T02:03:36.330 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction test succeeded. 2024-04-19T02:03:36.353 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction 2024-04-19T02:03:36.710 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2024-04-19T02:03:36.741 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2024-04-19T02:03:37.179 INFO:teuthology.orchestra.run.smithi153.stdout:(3/3): kernel-core-4.18.0-552.el8.x86_64.rpm 8.0 MB/s | 44 MB 00:05 2024-04-19T02:03:37.180 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-04-19T02:03:37.180 INFO:teuthology.orchestra.run.smithi153.stdout:Total 16 MB/s | 90 MB 00:05 2024-04-19T02:03:37.187 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction test succeeded. 2024-04-19T02:03:37.207 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction 2024-04-19T02:03:37.862 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-04-19T02:03:38.299 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-04-19T02:03:38.299 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-04-19T02:03:39.123 INFO:teuthology.orchestra.run.smithi177.stdout: Preparing : 1/1 2024-04-19T02:03:39.534 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-04-19T02:03:39.555 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-04-19T02:03:39.588 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2024-04-19T02:03:39.684 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-19T02:03:39.994 INFO:teuthology.orchestra.run.smithi174.stdout: Preparing : 1/1 2024-04-19T02:03:40.161 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-19T02:03:40.486 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-19T02:03:42.327 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-04-19T02:03:42.938 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-19T02:03:43.264 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-19T02:03:43.647 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-19T02:03:43.697 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-19T02:03:44.048 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-19T02:03:44.118 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-19T02:03:44.427 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-19T02:03:46.526 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-19T02:03:46.971 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-19T02:03:47.085 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-19T02:03:47.378 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : kernel-4.18.0-552.el8.x86_64 3/3 2024-04-19T02:03:47.553 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-19T02:03:47.817 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : kernel-4.18.0-552.el8.x86_64 3/3 2024-04-19T02:03:47.870 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-19T02:03:48.183 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : kernel-4.18.0-552.el8.x86_64 3/3 2024-04-19T02:03:50.412 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-19T02:03:50.694 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : kernel-4.18.0-552.el8.x86_64 3/3 2024-04-19T02:04:09.198 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 3/3 2024-04-19T02:04:09.222 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-19T02:04:09.579 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: kernel-4.18.0-552.el8.x86_64 3/3 2024-04-19T02:04:09.579 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : kernel-4.18.0-552.el8.x86_64 1/3 2024-04-19T02:04:09.579 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : kernel-core-4.18.0-552.el8.x86_64 2/3 2024-04-19T02:04:09.751 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 3/3 2024-04-19T02:04:09.775 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-19T02:04:10.080 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 3/3 2024-04-19T02:04:10.104 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-19T02:04:10.142 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: kernel-4.18.0-552.el8.x86_64 3/3 2024-04-19T02:04:10.142 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : kernel-4.18.0-552.el8.x86_64 1/3 2024-04-19T02:04:10.143 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : kernel-core-4.18.0-552.el8.x86_64 2/3 2024-04-19T02:04:10.287 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-19T02:04:10.288 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-19T02:04:10.288 INFO:teuthology.orchestra.run.smithi177.stdout:Installed: 2024-04-19T02:04:10.288 INFO:teuthology.orchestra.run.smithi177.stdout: kernel-4.18.0-552.el8.x86_64 kernel-core-4.18.0-552.el8.x86_64 2024-04-19T02:04:10.288 INFO:teuthology.orchestra.run.smithi177.stdout: kernel-modules-4.18.0-552.el8.x86_64 2024-04-19T02:04:10.288 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-19T02:04:10.288 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-04-19T02:04:10.459 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: kernel-4.18.0-552.el8.x86_64 3/3 2024-04-19T02:04:10.459 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : kernel-4.18.0-552.el8.x86_64 1/3 2024-04-19T02:04:10.459 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : kernel-core-4.18.0-552.el8.x86_64 2/3 2024-04-19T02:04:10.598 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-19T02:04:10.598 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:04:10.598 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2024-04-19T02:04:10.598 INFO:teuthology.orchestra.run.smithi121.stdout: kernel-4.18.0-552.el8.x86_64 kernel-core-4.18.0-552.el8.x86_64 2024-04-19T02:04:10.599 INFO:teuthology.orchestra.run.smithi121.stdout: kernel-modules-4.18.0-552.el8.x86_64 2024-04-19T02:04:10.599 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:04:10.599 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-04-19T02:04:10.633 DEBUG:teuthology.orchestra.run.smithi177:> rpm -q kernel | sort -rV | head -n 1 2024-04-19T02:04:10.730 DEBUG:teuthology.orchestra.run.smithi121:> rpm -q kernel | sort -rV | head -n 1 2024-04-19T02:04:10.853 INFO:teuthology.orchestra.run.smithi177.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-19T02:04:10.854 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-19T02:04:10.854 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-552.el8.x86_64 2024-04-19T02:04:10.854 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-19T02:04:10.854 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-19T02:04:10.854 INFO:teuthology.task.kernel:Installing distro kernel on osd.2... 2024-04-19T02:04:10.855 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi177.front.sepia.ceph.com, path=None, version=distro) 2024-04-19T02:04:10.855 DEBUG:teuthology.orchestra.run.smithi177:> rpm -q kernel | sort -rV | head -n 1 2024-04-19T02:04:10.945 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-19T02:04:10.945 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-19T02:04:10.945 INFO:teuthology.orchestra.run.smithi174.stdout:Installed: 2024-04-19T02:04:10.945 INFO:teuthology.orchestra.run.smithi174.stdout: kernel-4.18.0-552.el8.x86_64 kernel-core-4.18.0-552.el8.x86_64 2024-04-19T02:04:10.945 INFO:teuthology.orchestra.run.smithi174.stdout: kernel-modules-4.18.0-552.el8.x86_64 2024-04-19T02:04:10.945 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-19T02:04:10.946 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2024-04-19T02:04:10.946 INFO:teuthology.orchestra.run.smithi121.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-19T02:04:10.947 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-19T02:04:10.947 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-552.el8.x86_64 2024-04-19T02:04:10.947 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-19T02:04:10.947 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-19T02:04:10.947 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-19T02:04:10.947 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi121.front.sepia.ceph.com, path=None, version=distro) 2024-04-19T02:04:10.947 DEBUG:teuthology.orchestra.run.smithi121:> rpm -q kernel | sort -rV | head -n 1 2024-04-19T02:04:11.067 INFO:teuthology.orchestra.run.smithi177.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-19T02:04:11.067 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-19T02:04:11.067 DEBUG:teuthology.orchestra.run.smithi177:> sudo rpm -qi grub2-tools 2024-04-19T02:04:11.100 INFO:teuthology.orchestra.run.smithi177.stdout:Name : grub2-tools 2024-04-19T02:04:11.100 INFO:teuthology.orchestra.run.smithi177.stdout:Epoch : 1 2024-04-19T02:04:11.100 INFO:teuthology.orchestra.run.smithi177.stdout:Version : 2.02 2024-04-19T02:04:11.100 INFO:teuthology.orchestra.run.smithi177.stdout:Release : 129.el8 2024-04-19T02:04:11.100 INFO:teuthology.orchestra.run.smithi177.stdout:Architecture: x86_64 2024-04-19T02:04:11.100 INFO:teuthology.orchestra.run.smithi177.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-04-19T02:04:11.100 INFO:teuthology.orchestra.run.smithi177.stdout:Group : System Environment/Base 2024-04-19T02:04:11.101 INFO:teuthology.orchestra.run.smithi177.stdout:Size : 9265586 2024-04-19T02:04:11.101 INFO:teuthology.orchestra.run.smithi177.stdout:License : GPLv3+ 2024-04-19T02:04:11.101 INFO:teuthology.orchestra.run.smithi177.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-04-19T02:04:11.101 INFO:teuthology.orchestra.run.smithi177.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-04-19T02:04:11.101 INFO:teuthology.orchestra.run.smithi177.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-04-19T02:04:11.101 INFO:teuthology.orchestra.run.smithi177.stdout:Build Host : kbuilder.bsys.centos.org 2024-04-19T02:04:11.101 INFO:teuthology.orchestra.run.smithi177.stdout:Relocations : (not relocatable) 2024-04-19T02:04:11.101 INFO:teuthology.orchestra.run.smithi177.stdout:Packager : CentOS BuildSystem 2024-04-19T02:04:11.101 INFO:teuthology.orchestra.run.smithi177.stdout:Vendor : CentOS 2024-04-19T02:04:11.101 INFO:teuthology.orchestra.run.smithi177.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-19T02:04:11.101 INFO:teuthology.orchestra.run.smithi177.stdout:Summary : Support tools for GRUB. 2024-04-19T02:04:11.101 INFO:teuthology.orchestra.run.smithi177.stdout:Description : 2024-04-19T02:04:11.101 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-19T02:04:11.101 INFO:teuthology.orchestra.run.smithi177.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-19T02:04:11.102 INFO:teuthology.orchestra.run.smithi177.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-19T02:04:11.102 INFO:teuthology.orchestra.run.smithi177.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-19T02:04:11.102 INFO:teuthology.orchestra.run.smithi177.stdout:hardware devices. 2024-04-19T02:04:11.102 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-19T02:04:11.102 INFO:teuthology.orchestra.run.smithi177.stdout:This subpackage provides tools for support of all platforms. 2024-04-19T02:04:11.103 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-19T02:04:11.103 INFO:teuthology.task.kernel:Updating grub on smithi177 to boot 4.18.0-552.el8.x86_64 2024-04-19T02:04:11.103 DEBUG:teuthology.orchestra.run.smithi177:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-19T02:04:11.106 DEBUG:teuthology.orchestra.run.smithi174:> rpm -q kernel | sort -rV | head -n 1 2024-04-19T02:04:11.156 INFO:teuthology.orchestra.run.smithi121.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-19T02:04:11.157 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-19T02:04:11.157 DEBUG:teuthology.orchestra.run.smithi121:> sudo rpm -qi grub2-tools 2024-04-19T02:04:11.191 INFO:teuthology.orchestra.run.smithi121.stdout:Name : grub2-tools 2024-04-19T02:04:11.191 INFO:teuthology.orchestra.run.smithi121.stdout:Epoch : 1 2024-04-19T02:04:11.191 INFO:teuthology.orchestra.run.smithi121.stdout:Version : 2.02 2024-04-19T02:04:11.191 INFO:teuthology.orchestra.run.smithi121.stdout:Release : 129.el8 2024-04-19T02:04:11.191 INFO:teuthology.orchestra.run.smithi121.stdout:Architecture: x86_64 2024-04-19T02:04:11.191 INFO:teuthology.orchestra.run.smithi121.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-04-19T02:04:11.191 INFO:teuthology.orchestra.run.smithi121.stdout:Group : System Environment/Base 2024-04-19T02:04:11.191 INFO:teuthology.orchestra.run.smithi121.stdout:Size : 9265586 2024-04-19T02:04:11.192 INFO:teuthology.orchestra.run.smithi121.stdout:License : GPLv3+ 2024-04-19T02:04:11.192 INFO:teuthology.orchestra.run.smithi121.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-04-19T02:04:11.192 INFO:teuthology.orchestra.run.smithi121.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-04-19T02:04:11.192 INFO:teuthology.orchestra.run.smithi121.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-04-19T02:04:11.192 INFO:teuthology.orchestra.run.smithi121.stdout:Build Host : kbuilder.bsys.centos.org 2024-04-19T02:04:11.192 INFO:teuthology.orchestra.run.smithi121.stdout:Relocations : (not relocatable) 2024-04-19T02:04:11.192 INFO:teuthology.orchestra.run.smithi121.stdout:Packager : CentOS BuildSystem 2024-04-19T02:04:11.192 INFO:teuthology.orchestra.run.smithi121.stdout:Vendor : CentOS 2024-04-19T02:04:11.192 INFO:teuthology.orchestra.run.smithi121.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-19T02:04:11.192 INFO:teuthology.orchestra.run.smithi121.stdout:Summary : Support tools for GRUB. 2024-04-19T02:04:11.192 INFO:teuthology.orchestra.run.smithi121.stdout:Description : 2024-04-19T02:04:11.192 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:04:11.193 INFO:teuthology.orchestra.run.smithi121.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-19T02:04:11.193 INFO:teuthology.orchestra.run.smithi121.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-19T02:04:11.193 INFO:teuthology.orchestra.run.smithi121.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-19T02:04:11.193 INFO:teuthology.orchestra.run.smithi121.stdout:hardware devices. 2024-04-19T02:04:11.193 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:04:11.193 INFO:teuthology.orchestra.run.smithi121.stdout:This subpackage provides tools for support of all platforms. 2024-04-19T02:04:11.194 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-19T02:04:11.194 INFO:teuthology.task.kernel:Updating grub on smithi121 to boot 4.18.0-552.el8.x86_64 2024-04-19T02:04:11.194 DEBUG:teuthology.orchestra.run.smithi121:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-19T02:04:11.342 INFO:teuthology.orchestra.run.smithi174.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-19T02:04:11.342 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-19T02:04:11.342 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-552.el8.x86_64 2024-04-19T02:04:11.342 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-19T02:04:11.342 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-19T02:04:11.342 INFO:teuthology.task.kernel:Installing distro kernel on osd.1... 2024-04-19T02:04:11.342 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi174.front.sepia.ceph.com, path=None, version=distro) 2024-04-19T02:04:11.343 DEBUG:teuthology.orchestra.run.smithi174:> rpm -q kernel | sort -rV | head -n 1 2024-04-19T02:04:11.553 INFO:teuthology.orchestra.run.smithi174.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-19T02:04:11.553 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-19T02:04:11.553 DEBUG:teuthology.orchestra.run.smithi174:> sudo rpm -qi grub2-tools 2024-04-19T02:04:11.586 INFO:teuthology.orchestra.run.smithi174.stdout:Name : grub2-tools 2024-04-19T02:04:11.587 INFO:teuthology.orchestra.run.smithi174.stdout:Epoch : 1 2024-04-19T02:04:11.587 INFO:teuthology.orchestra.run.smithi174.stdout:Version : 2.02 2024-04-19T02:04:11.587 INFO:teuthology.orchestra.run.smithi174.stdout:Release : 129.el8 2024-04-19T02:04:11.587 INFO:teuthology.orchestra.run.smithi174.stdout:Architecture: x86_64 2024-04-19T02:04:11.587 INFO:teuthology.orchestra.run.smithi174.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-04-19T02:04:11.587 INFO:teuthology.orchestra.run.smithi174.stdout:Group : System Environment/Base 2024-04-19T02:04:11.587 INFO:teuthology.orchestra.run.smithi174.stdout:Size : 9265586 2024-04-19T02:04:11.587 INFO:teuthology.orchestra.run.smithi174.stdout:License : GPLv3+ 2024-04-19T02:04:11.587 INFO:teuthology.orchestra.run.smithi174.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-04-19T02:04:11.587 INFO:teuthology.orchestra.run.smithi174.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-04-19T02:04:11.587 INFO:teuthology.orchestra.run.smithi174.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-04-19T02:04:11.588 INFO:teuthology.orchestra.run.smithi174.stdout:Build Host : kbuilder.bsys.centos.org 2024-04-19T02:04:11.588 INFO:teuthology.orchestra.run.smithi174.stdout:Relocations : (not relocatable) 2024-04-19T02:04:11.588 INFO:teuthology.orchestra.run.smithi174.stdout:Packager : CentOS BuildSystem 2024-04-19T02:04:11.588 INFO:teuthology.orchestra.run.smithi174.stdout:Vendor : CentOS 2024-04-19T02:04:11.588 INFO:teuthology.orchestra.run.smithi174.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-19T02:04:11.588 INFO:teuthology.orchestra.run.smithi174.stdout:Summary : Support tools for GRUB. 2024-04-19T02:04:11.588 INFO:teuthology.orchestra.run.smithi174.stdout:Description : 2024-04-19T02:04:11.588 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-19T02:04:11.588 INFO:teuthology.orchestra.run.smithi174.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-19T02:04:11.588 INFO:teuthology.orchestra.run.smithi174.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-19T02:04:11.588 INFO:teuthology.orchestra.run.smithi174.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-19T02:04:11.588 INFO:teuthology.orchestra.run.smithi174.stdout:hardware devices. 2024-04-19T02:04:11.588 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-19T02:04:11.588 INFO:teuthology.orchestra.run.smithi174.stdout:This subpackage provides tools for support of all platforms. 2024-04-19T02:04:11.589 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-19T02:04:11.589 INFO:teuthology.task.kernel:Updating grub on smithi174 to boot 4.18.0-552.el8.x86_64 2024-04-19T02:04:11.590 DEBUG:teuthology.orchestra.run.smithi174:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-19T02:04:12.502 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 3/3 2024-04-19T02:04:12.527 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-19T02:04:12.610 INFO:teuthology.orchestra.run.smithi177.stderr:Generating grub configuration file ... 2024-04-19T02:04:12.882 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: kernel-4.18.0-552.el8.x86_64 3/3 2024-04-19T02:04:12.882 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : kernel-4.18.0-552.el8.x86_64 1/3 2024-04-19T02:04:12.882 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : kernel-core-4.18.0-552.el8.x86_64 2/3 2024-04-19T02:04:12.923 INFO:teuthology.orchestra.run.smithi121.stderr:Generating grub configuration file ... 2024-04-19T02:04:13.265 INFO:teuthology.orchestra.run.smithi174.stderr:Generating grub configuration file ... 2024-04-19T02:04:13.364 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-19T02:04:13.364 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-19T02:04:13.364 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-04-19T02:04:13.364 INFO:teuthology.orchestra.run.smithi153.stdout: kernel-4.18.0-552.el8.x86_64 kernel-core-4.18.0-552.el8.x86_64 2024-04-19T02:04:13.364 INFO:teuthology.orchestra.run.smithi153.stdout: kernel-modules-4.18.0-552.el8.x86_64 2024-04-19T02:04:13.364 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-19T02:04:13.364 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-04-19T02:04:13.505 DEBUG:teuthology.orchestra.run.smithi153:> rpm -q kernel | sort -rV | head -n 1 2024-04-19T02:04:13.722 INFO:teuthology.orchestra.run.smithi153.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-19T02:04:13.722 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-19T02:04:13.722 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-552.el8.x86_64 2024-04-19T02:04:13.722 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-19T02:04:13.722 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-19T02:04:13.723 INFO:teuthology.task.kernel:Installing distro kernel on osd.0... 2024-04-19T02:04:13.723 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi153.front.sepia.ceph.com, path=None, version=distro) 2024-04-19T02:04:13.723 DEBUG:teuthology.orchestra.run.smithi153:> rpm -q kernel | sort -rV | head -n 1 2024-04-19T02:04:13.935 INFO:teuthology.orchestra.run.smithi153.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-19T02:04:13.935 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-19T02:04:13.935 DEBUG:teuthology.orchestra.run.smithi153:> sudo rpm -qi grub2-tools 2024-04-19T02:04:13.969 INFO:teuthology.orchestra.run.smithi153.stdout:Name : grub2-tools 2024-04-19T02:04:13.969 INFO:teuthology.orchestra.run.smithi153.stdout:Epoch : 1 2024-04-19T02:04:13.969 INFO:teuthology.orchestra.run.smithi153.stdout:Version : 2.02 2024-04-19T02:04:13.969 INFO:teuthology.orchestra.run.smithi153.stdout:Release : 129.el8 2024-04-19T02:04:13.969 INFO:teuthology.orchestra.run.smithi153.stdout:Architecture: x86_64 2024-04-19T02:04:13.969 INFO:teuthology.orchestra.run.smithi153.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-04-19T02:04:13.969 INFO:teuthology.orchestra.run.smithi153.stdout:Group : System Environment/Base 2024-04-19T02:04:13.969 INFO:teuthology.orchestra.run.smithi153.stdout:Size : 9265586 2024-04-19T02:04:13.969 INFO:teuthology.orchestra.run.smithi153.stdout:License : GPLv3+ 2024-04-19T02:04:13.970 INFO:teuthology.orchestra.run.smithi153.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-04-19T02:04:13.970 INFO:teuthology.orchestra.run.smithi153.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-04-19T02:04:13.970 INFO:teuthology.orchestra.run.smithi153.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-04-19T02:04:13.970 INFO:teuthology.orchestra.run.smithi153.stdout:Build Host : kbuilder.bsys.centos.org 2024-04-19T02:04:13.970 INFO:teuthology.orchestra.run.smithi153.stdout:Relocations : (not relocatable) 2024-04-19T02:04:13.970 INFO:teuthology.orchestra.run.smithi153.stdout:Packager : CentOS BuildSystem 2024-04-19T02:04:13.970 INFO:teuthology.orchestra.run.smithi153.stdout:Vendor : CentOS 2024-04-19T02:04:13.970 INFO:teuthology.orchestra.run.smithi153.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-19T02:04:13.970 INFO:teuthology.orchestra.run.smithi153.stdout:Summary : Support tools for GRUB. 2024-04-19T02:04:13.970 INFO:teuthology.orchestra.run.smithi153.stdout:Description : 2024-04-19T02:04:13.970 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-19T02:04:13.970 INFO:teuthology.orchestra.run.smithi153.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-19T02:04:13.970 INFO:teuthology.orchestra.run.smithi153.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-19T02:04:13.971 INFO:teuthology.orchestra.run.smithi153.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-19T02:04:13.971 INFO:teuthology.orchestra.run.smithi153.stdout:hardware devices. 2024-04-19T02:04:13.971 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-19T02:04:13.971 INFO:teuthology.orchestra.run.smithi153.stdout:This subpackage provides tools for support of all platforms. 2024-04-19T02:04:13.972 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-19T02:04:13.972 INFO:teuthology.task.kernel:Updating grub on smithi153 to boot 4.18.0-552.el8.x86_64 2024-04-19T02:04:13.972 DEBUG:teuthology.orchestra.run.smithi153:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-19T02:04:14.518 INFO:teuthology.orchestra.run.smithi177.stderr:done 2024-04-19T02:04:14.520 DEBUG:teuthology.orchestra.run.smithi177:> mktemp 2024-04-19T02:04:14.548 INFO:teuthology.orchestra.run.smithi177.stdout:/tmp/tmp.IE769bhB9f 2024-04-19T02:04:14.549 DEBUG:teuthology.orchestra.run.smithi177:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.IE769bhB9f 2024-04-19T02:04:14.624 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 0666 /tmp/tmp.IE769bhB9f 2024-04-19T02:04:14.771 DEBUG:teuthology.orchestra.remote:smithi177:/tmp/tmp.IE769bhB9f is 6KB 2024-04-19T02:04:14.819 DEBUG:teuthology.orchestra.run.smithi177:> rm -fr /tmp/tmp.IE769bhB9f 2024-04-19T02:04:14.837 DEBUG:teuthology.orchestra.run.smithi177:> sudo /bin/ls /boot/loader/entries || true 2024-04-19T02:04:14.911 INFO:teuthology.orchestra.run.smithi177.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-04-19T02:04:14.912 INFO:teuthology.orchestra.run.smithi177.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-04-19T02:04:14.912 INFO:teuthology.orchestra.run.smithi177.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-04-19T02:04:14.912 INFO:teuthology.orchestra.run.smithi177.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64.conf 2024-04-19T02:04:14.913 DEBUG:teuthology.orchestra.run.smithi177:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64 2024-04-19T02:04:14.936 INFO:teuthology.orchestra.run.smithi121.stderr:done 2024-04-19T02:04:14.938 DEBUG:teuthology.orchestra.run.smithi121:> mktemp 2024-04-19T02:04:14.969 INFO:teuthology.orchestra.run.smithi121.stdout:/tmp/tmp.JpnKBMJRgP 2024-04-19T02:04:14.969 DEBUG:teuthology.orchestra.run.smithi121:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.JpnKBMJRgP 2024-04-19T02:04:15.060 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 0666 /tmp/tmp.JpnKBMJRgP 2024-04-19T02:04:15.070 DEBUG:teuthology.orchestra.run.smithi177:> sudo shutdown -r now 2024-04-19T02:04:15.107 INFO:teuthology.orchestra.run.smithi174.stderr:done 2024-04-19T02:04:15.108 DEBUG:teuthology.orchestra.run.smithi174:> mktemp 2024-04-19T02:04:15.143 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.vMr7XGkEpb 2024-04-19T02:04:15.143 DEBUG:teuthology.orchestra.run.smithi174:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.vMr7XGkEpb 2024-04-19T02:04:15.161 DEBUG:teuthology.orchestra.remote:smithi121:/tmp/tmp.JpnKBMJRgP is 6KB 2024-04-19T02:04:15.209 DEBUG:teuthology.orchestra.run.smithi121:> rm -fr /tmp/tmp.JpnKBMJRgP 2024-04-19T02:04:15.221 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 0666 /tmp/tmp.vMr7XGkEpb 2024-04-19T02:04:15.226 DEBUG:teuthology.orchestra.run.smithi121:> sudo /bin/ls /boot/loader/entries || true 2024-04-19T02:04:15.291 INFO:teuthology.orchestra.run.smithi121.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-04-19T02:04:15.291 INFO:teuthology.orchestra.run.smithi121.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-04-19T02:04:15.291 INFO:teuthology.orchestra.run.smithi121.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-04-19T02:04:15.291 INFO:teuthology.orchestra.run.smithi121.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64.conf 2024-04-19T02:04:15.292 DEBUG:teuthology.orchestra.run.smithi121:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64 2024-04-19T02:04:15.372 DEBUG:teuthology.orchestra.remote:smithi174:/tmp/tmp.vMr7XGkEpb is 6KB 2024-04-19T02:04:15.419 DEBUG:teuthology.orchestra.run.smithi174:> rm -fr /tmp/tmp.vMr7XGkEpb 2024-04-19T02:04:15.437 DEBUG:teuthology.orchestra.run.smithi174:> sudo /bin/ls /boot/loader/entries || true 2024-04-19T02:04:15.478 DEBUG:teuthology.orchestra.run.smithi121:> sudo shutdown -r now 2024-04-19T02:04:15.524 INFO:teuthology.orchestra.run.smithi174.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-04-19T02:04:15.524 INFO:teuthology.orchestra.run.smithi174.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-04-19T02:04:15.524 INFO:teuthology.orchestra.run.smithi174.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-04-19T02:04:15.524 INFO:teuthology.orchestra.run.smithi174.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64.conf 2024-04-19T02:04:15.525 DEBUG:teuthology.orchestra.run.smithi174:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64 2024-04-19T02:04:15.641 DEBUG:teuthology.orchestra.run.smithi174:> sudo shutdown -r now 2024-04-19T02:04:15.647 INFO:teuthology.orchestra.run.smithi153.stderr:Generating grub configuration file ... 2024-04-19T02:04:17.503 INFO:teuthology.orchestra.run.smithi153.stderr:done 2024-04-19T02:04:17.504 DEBUG:teuthology.orchestra.run.smithi153:> mktemp 2024-04-19T02:04:17.532 INFO:teuthology.orchestra.run.smithi153.stdout:/tmp/tmp.bzztcdSUoJ 2024-04-19T02:04:17.532 DEBUG:teuthology.orchestra.run.smithi153:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.bzztcdSUoJ 2024-04-19T02:04:17.606 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0666 /tmp/tmp.bzztcdSUoJ 2024-04-19T02:04:17.750 DEBUG:teuthology.orchestra.remote:smithi153:/tmp/tmp.bzztcdSUoJ is 6KB 2024-04-19T02:04:17.799 DEBUG:teuthology.orchestra.run.smithi153:> rm -fr /tmp/tmp.bzztcdSUoJ 2024-04-19T02:04:17.816 DEBUG:teuthology.orchestra.run.smithi153:> sudo /bin/ls /boot/loader/entries || true 2024-04-19T02:04:17.890 INFO:teuthology.orchestra.run.smithi153.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-04-19T02:04:17.890 INFO:teuthology.orchestra.run.smithi153.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-04-19T02:04:17.890 INFO:teuthology.orchestra.run.smithi153.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-04-19T02:04:17.890 INFO:teuthology.orchestra.run.smithi153.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64.conf 2024-04-19T02:04:17.891 DEBUG:teuthology.orchestra.run.smithi153:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64 2024-04-19T02:04:18.061 DEBUG:teuthology.orchestra.run.smithi153:> sudo shutdown -r now 2024-04-19T02:04:45.098 INFO:teuthology.task.kernel:Checking client osd.2 for new kernel version... 2024-04-19T02:04:45.099 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-04-19T02:04:45.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:04:45.482 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-19T02:04:45.482 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-04-19T02:04:45.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:04:45.644 INFO:teuthology.task.kernel:Checking client osd.1 for new kernel version... 2024-04-19T02:04:45.645 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-04-19T02:04:45.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:04:48.066 INFO:teuthology.task.kernel:Checking client osd.0 for new kernel version... 2024-04-19T02:04:48.067 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-04-19T02:04:48.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:05:19.775 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.177 2024-04-19T02:05:22.598 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2024-04-19T02:05:28.782 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-04-19T02:05:28.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:05:31.602 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-04-19T02:05:31.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:05:45.498 DEBUG:teuthology.orchestra.remote:timed out 2024-04-19T02:05:45.647 DEBUG:teuthology.orchestra.remote:timed out 2024-04-19T02:05:47.173 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.177 2024-04-19T02:05:49.986 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2024-04-19T02:05:54.504 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-04-19T02:05:54.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:05:54.649 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-04-19T02:05:54.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:05:54.854 DEBUG:teuthology.orchestra.run.smithi121:> true 2024-04-19T02:05:55.176 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-04-19T02:05:55.176 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-552.el8.x86_64"... 2024-04-19T02:05:55.176 DEBUG:teuthology.orchestra.run.smithi121:> uname -r 2024-04-19T02:05:55.193 INFO:teuthology.orchestra.run.smithi121.stdout:4.18.0-552.el8.x86_64 2024-04-19T02:05:55.193 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-552.el8.x86_64 vs 4.18.0-552.el8.x86_64 2024-04-19T02:05:55.193 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-19T02:05:55.193 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-19T02:05:55.279 DEBUG:teuthology.orchestra.run.smithi174:> true 2024-04-19T02:05:55.648 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-04-19T02:05:55.648 INFO:teuthology.task.kernel:Checking kernel version of osd.1, want "4.18.0-552.el8.x86_64"... 2024-04-19T02:05:55.649 DEBUG:teuthology.orchestra.run.smithi174:> uname -r 2024-04-19T02:05:55.665 INFO:teuthology.orchestra.run.smithi174.stdout:4.18.0-552.el8.x86_64 2024-04-19T02:05:55.665 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-552.el8.x86_64 vs 4.18.0-552.el8.x86_64 2024-04-19T02:05:55.665 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-19T02:05:55.666 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-19T02:05:56.197 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-19T02:05:56.198 DEBUG:teuthology.orchestra.run.smithi121:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-19T02:05:56.253 INFO:teuthology.orchestra.run.smithi121.stdout:ttyS1 2024-04-19T02:05:56.266 DEBUG:teuthology.parallel:result is None 2024-04-19T02:05:56.666 INFO:teuthology.task.kernel:Enabling kdb on osd.1... 2024-04-19T02:05:56.666 DEBUG:teuthology.orchestra.run.smithi174:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-19T02:05:56.744 INFO:teuthology.orchestra.run.smithi174.stdout:ttyS1 2024-04-19T02:05:56.761 DEBUG:teuthology.parallel:result is None 2024-04-19T02:05:59.175 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-04-19T02:05:59.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:05:59.543 DEBUG:teuthology.orchestra.run.smithi177:> true 2024-04-19T02:05:59.773 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-04-19T02:05:59.774 INFO:teuthology.task.kernel:Checking kernel version of osd.2, want "4.18.0-552.el8.x86_64"... 2024-04-19T02:05:59.774 DEBUG:teuthology.orchestra.run.smithi177:> uname -r 2024-04-19T02:05:59.791 INFO:teuthology.orchestra.run.smithi177.stdout:4.18.0-552.el8.x86_64 2024-04-19T02:05:59.791 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-552.el8.x86_64 vs 4.18.0-552.el8.x86_64 2024-04-19T02:05:59.791 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-19T02:05:59.791 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-19T02:06:00.792 INFO:teuthology.task.kernel:Enabling kdb on osd.2... 2024-04-19T02:06:00.793 DEBUG:teuthology.orchestra.run.smithi177:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-19T02:06:01.481 INFO:teuthology.orchestra.run.smithi177.stdout:ttyS1 2024-04-19T02:06:01.511 DEBUG:teuthology.parallel:result is None 2024-04-19T02:06:01.987 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-04-19T02:06:01.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:06:02.442 DEBUG:teuthology.orchestra.run.smithi153:> true 2024-04-19T02:06:02.869 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-04-19T02:06:02.869 INFO:teuthology.task.kernel:Checking kernel version of osd.0, want "4.18.0-552.el8.x86_64"... 2024-04-19T02:06:02.869 DEBUG:teuthology.orchestra.run.smithi153:> uname -r 2024-04-19T02:06:02.887 INFO:teuthology.orchestra.run.smithi153.stdout:4.18.0-552.el8.x86_64 2024-04-19T02:06:02.887 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-552.el8.x86_64 vs 4.18.0-552.el8.x86_64 2024-04-19T02:06:02.888 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-19T02:06:02.888 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-19T02:06:03.889 INFO:teuthology.task.kernel:Enabling kdb on osd.0... 2024-04-19T02:06:03.889 DEBUG:teuthology.orchestra.run.smithi153:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-19T02:06:03.984 INFO:teuthology.orchestra.run.smithi153.stdout:ttyS1 2024-04-19T02:06:03.995 DEBUG:teuthology.parallel:result is None 2024-04-19T02:06:03.996 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-19T02:06:04.007 INFO:teuthology.task.internal:Creating test directory... 2024-04-19T02:06:04.007 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-19T02:06:04.010 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-19T02:06:04.012 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-19T02:06:04.015 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-19T02:06:04.038 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-19T02:06:04.045 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-19T02:06:04.052 INFO:teuthology.task.internal:Creating archive directory... 2024-04-19T02:06:04.052 DEBUG:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-19T02:06:04.074 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-19T02:06:04.076 DEBUG:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-19T02:06:04.078 DEBUG:teuthology.orchestra.run.smithi177:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-19T02:06:04.122 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-19T02:06:04.128 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-19T02:06:04.129 DEBUG:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-19T02:06:04.146 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-19T02:06:04.148 DEBUG:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-19T02:06:04.150 DEBUG:teuthology.orchestra.run.smithi177:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-19T02:06:04.179 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-19T02:06:04.180 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-19T02:06:04.188 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-19T02:06:04.191 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-19T02:06:04.193 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-19T02:06:04.203 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-19T02:06:04.206 INFO:teuthology.orchestra.run.smithi177.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-19T02:06:04.217 INFO:teuthology.orchestra.run.smithi177.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-19T02:06:04.219 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-19T02:06:04.226 INFO:teuthology.task.internal:Configuring sudo... 2024-04-19T02:06:04.227 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-19T02:06:04.235 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-19T02:06:04.237 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-19T02:06:04.239 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-19T02:06:04.270 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-19T02:06:04.279 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-19T02:06:04.280 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-19T02:06:04.307 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-19T02:06:04.309 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-19T02:06:04.311 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-19T02:06:04.330 DEBUG:teuthology.orchestra.run.smithi121:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-19T02:06:04.411 DEBUG:teuthology.orchestra.run.smithi121:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-19T02:06:04.470 DEBUG:teuthology.orchestra.run.smithi121:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-19T02:06:04.515 DEBUG:teuthology.orchestra.run.smithi121:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-19T02:06:04.557 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-04-19T02:06:04.557 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-19T02:06:04.624 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-19T02:06:04.664 DEBUG:teuthology.orchestra.run.smithi153:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-19T02:06:04.716 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-19T02:06:04.797 DEBUG:teuthology.orchestra.run.smithi153:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-19T02:06:04.842 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-04-19T02:06:04.842 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-19T02:06:04.909 DEBUG:teuthology.orchestra.run.smithi174:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-19T02:06:04.953 DEBUG:teuthology.orchestra.run.smithi174:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-19T02:06:05.028 DEBUG:teuthology.orchestra.run.smithi174:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-19T02:06:05.071 DEBUG:teuthology.orchestra.run.smithi174:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-19T02:06:05.116 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-19T02:06:05.116 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-19T02:06:05.183 DEBUG:teuthology.orchestra.run.smithi177:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-19T02:06:05.235 DEBUG:teuthology.orchestra.run.smithi177:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-19T02:06:05.284 DEBUG:teuthology.orchestra.run.smithi177:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-19T02:06:05.366 DEBUG:teuthology.orchestra.run.smithi177:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-19T02:06:05.414 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-19T02:06:05.414 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-19T02:06:05.482 DEBUG:teuthology.orchestra.run.smithi121:> sudo service rsyslog restart 2024-04-19T02:06:05.484 DEBUG:teuthology.orchestra.run.smithi153:> sudo service rsyslog restart 2024-04-19T02:06:05.486 DEBUG:teuthology.orchestra.run.smithi174:> sudo service rsyslog restart 2024-04-19T02:06:05.488 DEBUG:teuthology.orchestra.run.smithi177:> sudo service rsyslog restart 2024-04-19T02:06:05.545 INFO:teuthology.orchestra.run.smithi121.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-19T02:06:05.548 INFO:teuthology.orchestra.run.smithi153.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-19T02:06:05.555 INFO:teuthology.orchestra.run.smithi174.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-19T02:06:05.580 INFO:teuthology.orchestra.run.smithi177.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-19T02:06:06.029 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-19T02:06:06.037 INFO:teuthology.task.internal:Starting timer... 2024-04-19T02:06:06.037 INFO:teuthology.run_tasks:Running task pcp... 2024-04-19T02:06:06.048 INFO:teuthology.run_tasks:Running task selinux... 2024-04-19T02:06:06.057 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-04-19T02:06:06.057 DEBUG:teuthology.orchestra.run.smithi121:> sudo service auditd rotate 2024-04-19T02:06:06.134 INFO:teuthology.orchestra.run.smithi121.stdout:Rotating logs: 2024-04-19T02:06:06.136 DEBUG:teuthology.orchestra.run.smithi153:> sudo service auditd rotate 2024-04-19T02:06:06.230 INFO:teuthology.orchestra.run.smithi153.stdout:Rotating logs: 2024-04-19T02:06:06.231 DEBUG:teuthology.orchestra.run.smithi174:> sudo service auditd rotate 2024-04-19T02:06:06.323 INFO:teuthology.orchestra.run.smithi174.stdout:Rotating logs: 2024-04-19T02:06:06.324 DEBUG:teuthology.orchestra.run.smithi177:> sudo service auditd rotate 2024-04-19T02:06:06.386 INFO:teuthology.orchestra.run.smithi177.stdout:Rotating logs: 2024-04-19T02:06:06.387 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-19T02:06:06.387 DEBUG:teuthology.orchestra.run.smithi121:> /usr/sbin/getenforce 2024-04-19T02:06:06.417 INFO:teuthology.orchestra.run.smithi121.stdout:Permissive 2024-04-19T02:06:06.418 DEBUG:teuthology.orchestra.run.smithi153:> /usr/sbin/getenforce 2024-04-19T02:06:06.440 INFO:teuthology.orchestra.run.smithi153.stdout:Permissive 2024-04-19T02:06:06.440 DEBUG:teuthology.orchestra.run.smithi174:> /usr/sbin/getenforce 2024-04-19T02:06:06.464 INFO:teuthology.orchestra.run.smithi174.stdout:Permissive 2024-04-19T02:06:06.464 DEBUG:teuthology.orchestra.run.smithi177:> /usr/sbin/getenforce 2024-04-19T02:06:06.526 INFO:teuthology.orchestra.run.smithi177.stdout:Permissive 2024-04-19T02:06:06.527 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi121.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi153.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi174.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi177.front.sepia.ceph.com': 'permissive'} 2024-04-19T02:06:06.527 DEBUG:teuthology.orchestra.run.smithi121:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-19T02:06:06.556 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T02:06:06.557 DEBUG:teuthology.orchestra.run.smithi153:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-19T02:06:06.583 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T02:06:06.583 DEBUG:teuthology.orchestra.run.smithi174:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-19T02:06:06.610 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T02:06:06.611 DEBUG:teuthology.orchestra.run.smithi177:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-19T02:06:06.637 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T02:06:06.638 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-19T02:06:06.638 DEBUG:teuthology.orchestra.run.smithi121:> sudo /usr/sbin/setenforce permissive 2024-04-19T02:06:06.665 DEBUG:teuthology.orchestra.run.smithi153:> sudo /usr/sbin/setenforce permissive 2024-04-19T02:06:06.692 DEBUG:teuthology.orchestra.run.smithi174:> sudo /usr/sbin/setenforce permissive 2024-04-19T02:06:06.718 DEBUG:teuthology.orchestra.run.smithi177:> sudo /usr/sbin/setenforce permissive 2024-04-19T02:06:06.744 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-19T02:06:06.754 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-19T02:06:06.769 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-19T02:06:06.771 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi121.front.sepia.ceph.com,smithi153.front.sepia.ceph.com,smithi174.front.sepia.ceph.com,smithi177.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-19T02:12:22.519 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi121.front.sepia.ceph.com'), Remote(name='ubuntu@smithi153.front.sepia.ceph.com'), Remote(name='ubuntu@smithi174.front.sepia.ceph.com'), Remote(name='ubuntu@smithi177.front.sepia.ceph.com')] 2024-04-19T02:12:22.520 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-04-19T02:12:22.521 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:12:22.596 DEBUG:teuthology.orchestra.run.smithi121:> true 2024-04-19T02:12:22.665 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-04-19T02:12:22.665 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-04-19T02:12:22.666 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:12:22.737 DEBUG:teuthology.orchestra.run.smithi153:> true 2024-04-19T02:12:22.804 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-04-19T02:12:22.804 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-04-19T02:12:22.805 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:12:22.921 DEBUG:teuthology.orchestra.run.smithi174:> true 2024-04-19T02:12:22.993 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-04-19T02:12:22.994 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-04-19T02:12:22.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:12:23.070 DEBUG:teuthology.orchestra.run.smithi177:> true 2024-04-19T02:12:23.099 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-04-19T02:12:23.100 INFO:teuthology.run_tasks:Running task clock... 2024-04-19T02:12:23.111 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-19T02:12:23.112 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-19T02:12:23.112 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-19T02:12:23.114 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-19T02:12:23.115 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-19T02:12:23.117 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-19T02:12:23.117 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-19T02:12:23.119 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-19T02:12:23.119 DEBUG:teuthology.orchestra.run.smithi177:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-19T02:12:23.145 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-19T02:12:23.146 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-19T02:12:23.151 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-19T02:12:23.159 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-19T02:12:23.159 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-19T02:12:23.165 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-19T02:12:23.173 INFO:teuthology.orchestra.run.smithi177.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-19T02:12:23.187 INFO:teuthology.orchestra.run.smithi177.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-19T02:12:23.225 INFO:teuthology.orchestra.run.smithi153.stderr:sudo: ntpd: command not found 2024-04-19T02:12:23.235 INFO:teuthology.orchestra.run.smithi121.stderr:sudo: ntpd: command not found 2024-04-19T02:12:23.236 INFO:teuthology.orchestra.run.smithi153.stdout:506 Cannot talk to daemon 2024-04-19T02:12:23.240 INFO:teuthology.orchestra.run.smithi174.stderr:sudo: ntpd: command not found 2024-04-19T02:12:23.246 INFO:teuthology.orchestra.run.smithi121.stdout:506 Cannot talk to daemon 2024-04-19T02:12:23.250 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-19T02:12:23.251 INFO:teuthology.orchestra.run.smithi174.stdout:506 Cannot talk to daemon 2024-04-19T02:12:23.260 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-19T02:12:23.261 INFO:teuthology.orchestra.run.smithi177.stderr:sudo: ntpd: command not found 2024-04-19T02:12:23.263 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-19T02:12:23.266 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-19T02:12:23.272 INFO:teuthology.orchestra.run.smithi177.stdout:506 Cannot talk to daemon 2024-04-19T02:12:23.273 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-19T02:12:23.279 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-19T02:12:23.286 INFO:teuthology.orchestra.run.smithi177.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-19T02:12:23.299 INFO:teuthology.orchestra.run.smithi177.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-19T02:12:23.330 INFO:teuthology.orchestra.run.smithi153.stderr:bash: ntpq: command not found 2024-04-19T02:12:23.334 INFO:teuthology.orchestra.run.smithi153.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-19T02:12:23.334 INFO:teuthology.orchestra.run.smithi153.stdout:=============================================================================== 2024-04-19T02:12:23.334 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-19T02:12:23.334 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-19T02:12:23.335 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-19T02:12:23.335 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-19T02:12:23.337 INFO:teuthology.orchestra.run.smithi121.stderr:bash: ntpq: command not found 2024-04-19T02:12:23.340 INFO:teuthology.orchestra.run.smithi121.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-19T02:12:23.340 INFO:teuthology.orchestra.run.smithi121.stdout:=============================================================================== 2024-04-19T02:12:23.341 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-19T02:12:23.341 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-19T02:12:23.341 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-19T02:12:23.341 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-19T02:12:23.353 INFO:teuthology.orchestra.run.smithi174.stderr:bash: ntpq: command not found 2024-04-19T02:12:23.357 INFO:teuthology.orchestra.run.smithi174.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-19T02:12:23.357 INFO:teuthology.orchestra.run.smithi174.stdout:=============================================================================== 2024-04-19T02:12:23.357 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-19T02:12:23.357 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-19T02:12:23.357 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-19T02:12:23.357 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-19T02:12:23.360 INFO:teuthology.orchestra.run.smithi177.stderr:bash: ntpq: command not found 2024-04-19T02:12:23.363 INFO:teuthology.orchestra.run.smithi177.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-19T02:12:23.363 INFO:teuthology.orchestra.run.smithi177.stdout:=============================================================================== 2024-04-19T02:12:23.364 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-19T02:12:23.364 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-19T02:12:23.364 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-19T02:12:23.364 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-19T02:12:23.365 INFO:teuthology.run_tasks:Running task install... 2024-04-19T02:12:23.373 DEBUG:teuthology.task.install:project ceph 2024-04-19T02:12:23.373 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'}} 2024-04-19T02:12:23.373 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'} 2024-04-19T02:12:23.373 INFO:teuthology.task.install:Using flavor: default 2024-04-19T02:12:23.379 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-19T02:12:23.379 INFO:teuthology.task.install:extra packages: [] 2024-04-19T02:12:23.380 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d', 'tag': None, 'wait_for_package': False} 2024-04-19T02:12:23.380 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T02:12:23.382 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d', 'tag': None, 'wait_for_package': False} 2024-04-19T02:12:23.382 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T02:12:23.383 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d', 'tag': None, 'wait_for_package': False} 2024-04-19T02:12:23.384 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T02:12:23.384 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d', 'tag': None, 'wait_for_package': False} 2024-04-19T02:12:23.385 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T02:12:23.538 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/centos/8/flavors/default/ 2024-04-19T02:12:23.539 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1237.g646b8c7d 2024-04-19T02:12:23.606 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/centos/8/flavors/default/ 2024-04-19T02:12:23.606 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1237.g646b8c7d 2024-04-19T02:12:23.620 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/centos/8/flavors/default/ 2024-04-19T02:12:23.620 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1237.g646b8c7d 2024-04-19T02:12:23.625 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/centos/8/flavors/default/ 2024-04-19T02:12:23.626 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1237.g646b8c7d 2024-04-19T02:12:23.933 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-19T02:12:23.933 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-04-19T02:12:23.933 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-19T02:12:23.950 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-19T02:12:23.950 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-19T02:12:23.950 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-19T02:12:23.962 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-04-19T02:12:23.962 DEBUG:teuthology.orchestra.run.smithi121:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-19T02:12:23.980 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-04-19T02:12:23.980 DEBUG:teuthology.orchestra.run.smithi174:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-19T02:12:24.005 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-19T02:12:24.006 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-04-19T02:12:24.006 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-19T02:12:24.021 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-19T02:12:24.021 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-19T02:12:24.021 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-19T02:12:24.030 DEBUG:teuthology.orchestra.run.smithi121:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-19T02:12:24.035 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-04-19T02:12:24.035 DEBUG:teuthology.orchestra.run.smithi153:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-19T02:12:24.050 DEBUG:teuthology.orchestra.run.smithi174:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-19T02:12:24.051 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-04-19T02:12:24.051 DEBUG:teuthology.orchestra.run.smithi177:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-19T02:12:24.105 DEBUG:teuthology.orchestra.run.smithi153:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-19T02:12:24.107 DEBUG:teuthology.orchestra.run.smithi121:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-19T02:12:24.119 DEBUG:teuthology.orchestra.run.smithi177:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-19T02:12:24.128 DEBUG:teuthology.orchestra.run.smithi174:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-19T02:12:24.173 INFO:teuthology.orchestra.run.smithi121.stdout:check_obsoletes = 1 2024-04-19T02:12:24.174 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum clean all 2024-04-19T02:12:24.182 DEBUG:teuthology.orchestra.run.smithi153:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-19T02:12:24.195 INFO:teuthology.orchestra.run.smithi174.stdout:check_obsoletes = 1 2024-04-19T02:12:24.197 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum clean all 2024-04-19T02:12:24.198 DEBUG:teuthology.orchestra.run.smithi177:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-19T02:12:24.248 INFO:teuthology.orchestra.run.smithi153.stdout:check_obsoletes = 1 2024-04-19T02:12:24.249 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum clean all 2024-04-19T02:12:24.266 INFO:teuthology.orchestra.run.smithi177.stdout:check_obsoletes = 1 2024-04-19T02:12:24.267 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum clean all 2024-04-19T02:12:24.437 INFO:teuthology.orchestra.run.smithi121.stdout:78 files removed 2024-04-19T02:12:24.458 INFO:teuthology.orchestra.run.smithi174.stdout:78 files removed 2024-04-19T02:12:24.465 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-04-19T02:12:24.485 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-04-19T02:12:24.512 INFO:teuthology.orchestra.run.smithi153.stdout:78 files removed 2024-04-19T02:12:24.527 INFO:teuthology.orchestra.run.smithi177.stdout:78 files removed 2024-04-19T02:12:24.540 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-04-19T02:12:24.555 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-04-19T02:12:25.570 INFO:teuthology.orchestra.run.smithi153.stdout:ceph packages for x86_64 129 kB/s | 80 kB 00:00 2024-04-19T02:12:25.592 INFO:teuthology.orchestra.run.smithi177.stdout:ceph packages for x86_64 127 kB/s | 80 kB 00:00 2024-04-19T02:12:25.867 INFO:teuthology.orchestra.run.smithi174.stdout:ceph packages for x86_64 82 kB/s | 80 kB 00:00 2024-04-19T02:12:25.983 INFO:teuthology.orchestra.run.smithi121.stdout:ceph packages for x86_64 72 kB/s | 80 kB 00:01 2024-04-19T02:12:26.001 INFO:teuthology.orchestra.run.smithi177.stdout:ceph noarch packages 31 kB/s | 11 kB 00:00 2024-04-19T02:12:26.104 INFO:teuthology.orchestra.run.smithi153.stdout:ceph noarch packages 23 kB/s | 11 kB 00:00 2024-04-19T02:12:26.526 INFO:teuthology.orchestra.run.smithi174.stdout:ceph noarch packages 18 kB/s | 11 kB 00:00 2024-04-19T02:12:26.651 INFO:teuthology.orchestra.run.smithi121.stdout:ceph noarch packages 18 kB/s | 11 kB 00:00 2024-04-19T02:12:26.760 INFO:teuthology.orchestra.run.smithi177.stdout:ceph source packages 2.0 kB/s | 1.5 kB 00:00 2024-04-19T02:12:26.780 INFO:teuthology.orchestra.run.smithi153.stdout:ceph source packages 2.3 kB/s | 1.5 kB 00:00 2024-04-19T02:12:27.135 INFO:teuthology.orchestra.run.smithi121.stdout:ceph source packages 3.3 kB/s | 1.5 kB 00:00 2024-04-19T02:12:27.535 INFO:teuthology.orchestra.run.smithi174.stdout:ceph source packages 1.5 kB/s | 1.5 kB 00:00 2024-04-19T02:12:34.134 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 8 - AppStream 3.8 MB/s | 28 MB 00:07 2024-04-19T02:12:34.921 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 8 - AppStream 3.5 MB/s | 28 MB 00:08 2024-04-19T02:12:36.491 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 8 - AppStream 3.0 MB/s | 28 MB 00:09 2024-04-19T02:12:38.542 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 8 - AppStream 2.5 MB/s | 28 MB 00:10 2024-04-19T02:12:39.777 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 8 - BaseOS 15 MB/s | 10 MB 00:00 2024-04-19T02:12:40.562 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 8 - BaseOS 16 MB/s | 10 MB 00:00 2024-04-19T02:12:41.752 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 8 - Extras 43 kB/s | 18 kB 00:00 2024-04-19T02:12:42.075 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 8 - BaseOS 16 MB/s | 10 MB 00:00 2024-04-19T02:12:42.077 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 8 - Extras common packages 35 kB/s | 7.7 kB 00:00 2024-04-19T02:12:42.664 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 8 - Extras 34 kB/s | 18 kB 00:00 2024-04-19T02:12:43.140 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 8 - Extras common packages 21 kB/s | 7.7 kB 00:00 2024-04-19T02:12:43.901 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 8 - Extras 73 kB/s | 18 kB 00:00 2024-04-19T02:12:44.260 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 8 - Extras common packages 30 kB/s | 7.7 kB 00:00 2024-04-19T02:12:44.304 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 8 - BaseOS 14 MB/s | 10 MB 00:00 2024-04-19T02:12:44.780 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 8 - PowerTools 1.9 MB/s | 5.0 MB 00:02 2024-04-19T02:12:45.491 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 8 - PowerTools 2.2 MB/s | 5.0 MB 00:02 2024-04-19T02:12:45.930 INFO:teuthology.orchestra.run.smithi177.stdout:Copr repo for python3-asyncssh owned by ceph 15 kB/s | 3.5 kB 00:00 2024-04-19T02:12:46.129 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 8 - Extras 74 kB/s | 18 kB 00:00 2024-04-19T02:12:46.463 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 8 - Extras common packages 34 kB/s | 7.7 kB 00:00 2024-04-19T02:12:46.594 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 8 - PowerTools 2.2 MB/s | 5.0 MB 00:02 2024-04-19T02:12:46.600 INFO:teuthology.orchestra.run.smithi153.stdout:Copr repo for python3-asyncssh owned by ceph 19 kB/s | 3.5 kB 00:00 2024-04-19T02:12:47.646 INFO:teuthology.orchestra.run.smithi121.stdout:Copr repo for python3-asyncssh owned by ceph 28 kB/s | 3.5 kB 00:00 2024-04-19T02:12:47.834 INFO:teuthology.orchestra.run.smithi177.stdout:Extra Packages for Enterprise Linux 9.0 MB/s | 16 MB 00:01 2024-04-19T02:12:47.845 INFO:teuthology.orchestra.run.smithi153.stdout:Extra Packages for Enterprise Linux 14 MB/s | 16 MB 00:01 2024-04-19T02:12:48.506 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 8 - PowerTools 2.5 MB/s | 5.0 MB 00:01 2024-04-19T02:12:49.574 INFO:teuthology.orchestra.run.smithi174.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2024-04-19T02:12:51.668 INFO:teuthology.orchestra.run.smithi153.stdout:lab-extras 436 kB/s | 24 kB 00:00 2024-04-19T02:12:51.673 INFO:teuthology.orchestra.run.smithi177.stdout:lab-extras 403 kB/s | 24 kB 00:00 2024-04-19T02:12:51.811 INFO:teuthology.orchestra.run.smithi121.stdout:Extra Packages for Enterprise Linux 4.0 MB/s | 16 MB 00:04 2024-04-19T02:12:53.623 INFO:teuthology.orchestra.run.smithi174.stdout:Extra Packages for Enterprise Linux 4.1 MB/s | 16 MB 00:03 2024-04-19T02:12:55.282 INFO:teuthology.orchestra.run.smithi177.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-19T02:12:55.282 INFO:teuthology.orchestra.run.smithi177.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-19T02:12:55.284 INFO:teuthology.orchestra.run.smithi153.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-19T02:12:55.285 INFO:teuthology.orchestra.run.smithi153.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-19T02:12:55.359 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-04-19T02:12:55.364 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-04-19T02:12:55.372 INFO:teuthology.orchestra.run.smithi177.stdout:============================================================================================ 2024-04-19T02:12:55.372 INFO:teuthology.orchestra.run.smithi177.stdout: Package Arch Version Repository Size 2024-04-19T02:12:55.372 INFO:teuthology.orchestra.run.smithi177.stdout:============================================================================================ 2024-04-19T02:12:55.373 INFO:teuthology.orchestra.run.smithi177.stdout:Installing: 2024-04-19T02:12:55.373 INFO:teuthology.orchestra.run.smithi177.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2024-04-19T02:12:55.373 INFO:teuthology.orchestra.run.smithi177.stdout: ceph x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 6.4 k 2024-04-19T02:12:55.373 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-base x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 5.5 M 2024-04-19T02:12:55.373 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-fuse x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 859 k 2024-04-19T02:12:55.373 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 166 k 2024-04-19T02:12:55.373 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 1.6 M 2024-04-19T02:12:55.373 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 138 k 2024-04-19T02:12:55.373 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 3.5 M 2024-04-19T02:12:55.373 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 7.4 M 2024-04-19T02:12:55.373 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-rook noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 49 k 2024-04-19T02:12:55.373 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-radosgw x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 13 M 2024-04-19T02:12:55.374 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-test x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 47 M 2024-04-19T02:12:55.374 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-volume noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 263 k 2024-04-19T02:12:55.374 INFO:teuthology.orchestra.run.smithi177.stdout: cephadm noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 170 k 2024-04-19T02:12:55.374 INFO:teuthology.orchestra.run.smithi177.stdout: elfutils-libelf-devel x86_64 0.190-2.el8 baseos 62 k 2024-04-19T02:12:55.374 INFO:teuthology.orchestra.run.smithi177.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2024-04-19T02:12:55.374 INFO:teuthology.orchestra.run.smithi177.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2024-04-19T02:12:55.374 INFO:teuthology.orchestra.run.smithi177.stdout: libcephfs-devel x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 31 k 2024-04-19T02:12:55.374 INFO:teuthology.orchestra.run.smithi177.stdout: libcephfs2 x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 780 k 2024-04-19T02:12:55.374 INFO:teuthology.orchestra.run.smithi177.stdout: librados-devel x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 139 k 2024-04-19T02:12:55.374 INFO:teuthology.orchestra.run.smithi177.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2024-04-19T02:12:55.374 INFO:teuthology.orchestra.run.smithi177.stdout: libuuid-devel x86_64 2.32.1-46.el8 baseos 100 k 2024-04-19T02:12:55.374 INFO:teuthology.orchestra.run.smithi177.stdout: openssl-devel x86_64 1:1.1.1k-12.el8 baseos 3.2 M 2024-04-19T02:12:55.374 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cephfs x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 197 k 2024-04-19T02:12:55.375 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rados x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 371 k 2024-04-19T02:12:55.375 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rbd x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 364 k 2024-04-19T02:12:55.375 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rgw x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 106 k 2024-04-19T02:12:55.375 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-fuse x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 95 k 2024-04-19T02:12:55.375 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-mirror x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 3.5 M 2024-04-19T02:12:55.375 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-nbd x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 181 k 2024-04-19T02:12:55.375 INFO:teuthology.orchestra.run.smithi177.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2024-04-19T02:12:55.375 INFO:teuthology.orchestra.run.smithi177.stdout:Upgrading: 2024-04-19T02:12:55.375 INFO:teuthology.orchestra.run.smithi177.stdout: elfutils-debuginfod-client x86_64 0.190-2.el8 baseos 77 k 2024-04-19T02:12:55.375 INFO:teuthology.orchestra.run.smithi177.stdout: elfutils-libelf x86_64 0.190-2.el8 baseos 233 k 2024-04-19T02:12:55.375 INFO:teuthology.orchestra.run.smithi177.stdout: elfutils-libs x86_64 0.190-2.el8 baseos 305 k 2024-04-19T02:12:55.375 INFO:teuthology.orchestra.run.smithi177.stdout: libblkid x86_64 2.32.1-46.el8 baseos 221 k 2024-04-19T02:12:55.375 INFO:teuthology.orchestra.run.smithi177.stdout: libfdisk x86_64 2.32.1-46.el8 baseos 254 k 2024-04-19T02:12:55.375 INFO:teuthology.orchestra.run.smithi177.stdout: libmount x86_64 2.32.1-46.el8 baseos 237 k 2024-04-19T02:12:55.376 INFO:teuthology.orchestra.run.smithi177.stdout: librados2 x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 3.7 M 2024-04-19T02:12:55.376 INFO:teuthology.orchestra.run.smithi177.stdout: librbd1 x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 3.6 M 2024-04-19T02:12:55.376 INFO:teuthology.orchestra.run.smithi177.stdout: libsmartcols x86_64 2.32.1-46.el8 baseos 180 k 2024-04-19T02:12:55.376 INFO:teuthology.orchestra.run.smithi177.stdout: libuuid x86_64 2.32.1-46.el8 baseos 99 k 2024-04-19T02:12:55.376 INFO:teuthology.orchestra.run.smithi177.stdout: openssl x86_64 1:1.1.1k-12.el8 baseos 738 k 2024-04-19T02:12:55.376 INFO:teuthology.orchestra.run.smithi177.stdout: openssl-libs x86_64 1:1.1.1k-12.el8 baseos 1.5 M 2024-04-19T02:12:55.376 INFO:teuthology.orchestra.run.smithi177.stdout: util-linux x86_64 2.32.1-46.el8 baseos 2.6 M 2024-04-19T02:12:55.376 INFO:teuthology.orchestra.run.smithi177.stdout: util-linux-user x86_64 2.32.1-46.el8 baseos 103 k 2024-04-19T02:12:55.376 INFO:teuthology.orchestra.run.smithi177.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2024-04-19T02:12:55.376 INFO:teuthology.orchestra.run.smithi177.stdout:Installing dependencies: 2024-04-19T02:12:55.376 INFO:teuthology.orchestra.run.smithi177.stdout: automake noarch 1.16.1-8.el8 appstream 740 k 2024-04-19T02:12:55.376 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-common x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 22 M 2024-04-19T02:12:55.377 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 24 k 2024-04-19T02:12:55.377 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mds x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 2.3 M 2024-04-19T02:12:55.377 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 245 k 2024-04-19T02:12:55.377 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mon x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 4.8 M 2024-04-19T02:12:55.377 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-osd x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 18 M 2024-04-19T02:12:55.377 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 15 k 2024-04-19T02:12:55.377 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-selinux x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 24 k 2024-04-19T02:12:55.377 INFO:teuthology.orchestra.run.smithi177.stdout: fuse x86_64 2.9.7-19.el8 baseos 83 k 2024-04-19T02:12:55.377 INFO:teuthology.orchestra.run.smithi177.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-19T02:12:55.377 INFO:teuthology.orchestra.run.smithi177.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-04-19T02:12:55.377 INFO:teuthology.orchestra.run.smithi177.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2024-04-19T02:12:55.377 INFO:teuthology.orchestra.run.smithi177.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2024-04-19T02:12:55.377 INFO:teuthology.orchestra.run.smithi177.stdout: libcephsqlite x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 142 k 2024-04-19T02:12:55.378 INFO:teuthology.orchestra.run.smithi177.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2024-04-19T02:12:55.378 INFO:teuthology.orchestra.run.smithi177.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2024-04-19T02:12:55.378 INFO:teuthology.orchestra.run.smithi177.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-19T02:12:55.378 INFO:teuthology.orchestra.run.smithi177.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2024-04-19T02:12:55.378 INFO:teuthology.orchestra.run.smithi177.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-04-19T02:12:55.378 INFO:teuthology.orchestra.run.smithi177.stdout: libradosstriper1 x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 474 k 2024-04-19T02:12:55.378 INFO:teuthology.orchestra.run.smithi177.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-04-19T02:12:55.378 INFO:teuthology.orchestra.run.smithi177.stdout: librgw2 x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 6.6 M 2024-04-19T02:12:55.378 INFO:teuthology.orchestra.run.smithi177.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2024-04-19T02:12:55.378 INFO:teuthology.orchestra.run.smithi177.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2024-04-19T02:12:55.378 INFO:teuthology.orchestra.run.smithi177.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-19T02:12:55.378 INFO:teuthology.orchestra.run.smithi177.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2024-04-19T02:12:55.378 INFO:teuthology.orchestra.run.smithi177.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2024-04-19T02:12:55.379 INFO:teuthology.orchestra.run.smithi177.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-04-19T02:12:55.379 INFO:teuthology.orchestra.run.smithi177.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-04-19T02:12:55.379 INFO:teuthology.orchestra.run.smithi177.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-04-19T02:12:55.379 INFO:teuthology.orchestra.run.smithi177.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-04-19T02:12:55.379 INFO:teuthology.orchestra.run.smithi177.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2024-04-19T02:12:55.379 INFO:teuthology.orchestra.run.smithi177.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2024-04-19T02:12:55.379 INFO:teuthology.orchestra.run.smithi177.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2024-04-19T02:12:55.379 INFO:teuthology.orchestra.run.smithi177.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-04-19T02:12:55.379 INFO:teuthology.orchestra.run.smithi177.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2024-04-19T02:12:55.379 INFO:teuthology.orchestra.run.smithi177.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-19T02:12:55.379 INFO:teuthology.orchestra.run.smithi177.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-19T02:12:55.379 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-04-19T02:12:55.379 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-argparse x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 45 k 2024-04-19T02:12:55.380 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-common x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 129 k 2024-04-19T02:12:55.380 INFO:teuthology.orchestra.run.smithi177.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-04-19T02:12:55.380 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-04-19T02:12:55.380 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-19T02:12:55.380 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-19T02:12:55.380 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-04-19T02:12:55.380 INFO:teuthology.orchestra.run.smithi177.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-04-19T02:12:55.380 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-19T02:12:55.380 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-19T02:12:55.380 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jinja2 noarch 2.10.1-4.el8 appstream 578 k 2024-04-19T02:12:55.380 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2024-04-19T02:12:55.380 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2024-04-19T02:12:55.380 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-04-19T02:12:55.381 INFO:teuthology.orchestra.run.smithi177.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-04-19T02:12:55.381 INFO:teuthology.orchestra.run.smithi177.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-19T02:12:55.381 INFO:teuthology.orchestra.run.smithi177.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-04-19T02:12:55.381 INFO:teuthology.orchestra.run.smithi177.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-04-19T02:12:55.381 INFO:teuthology.orchestra.run.smithi177.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-19T02:12:55.381 INFO:teuthology.orchestra.run.smithi177.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-04-19T02:12:55.381 INFO:teuthology.orchestra.run.smithi177.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-04-19T02:12:55.381 INFO:teuthology.orchestra.run.smithi177.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-04-19T02:12:55.381 INFO:teuthology.orchestra.run.smithi177.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-04-19T02:12:55.381 INFO:teuthology.orchestra.run.smithi177.stdout: python3-packaging noarch 16.8-9.el8 powertools 48 k 2024-04-19T02:12:55.381 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-19T02:12:55.381 INFO:teuthology.orchestra.run.smithi177.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-19T02:12:55.381 INFO:teuthology.orchestra.run.smithi177.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-04-19T02:12:55.381 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-04-19T02:12:55.382 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-04-19T02:12:55.382 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-04-19T02:12:55.382 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-04-19T02:12:55.382 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-04-19T02:12:55.382 INFO:teuthology.orchestra.run.smithi177.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-04-19T02:12:55.382 INFO:teuthology.orchestra.run.smithi177.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-04-19T02:12:55.382 INFO:teuthology.orchestra.run.smithi177.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-04-19T02:12:55.382 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-04-19T02:12:55.382 INFO:teuthology.orchestra.run.smithi177.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-04-19T02:12:55.382 INFO:teuthology.orchestra.run.smithi177.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-19T02:12:55.382 INFO:teuthology.orchestra.run.smithi177.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-19T02:12:55.382 INFO:teuthology.orchestra.run.smithi177.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-19T02:12:55.382 INFO:teuthology.orchestra.run.smithi177.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-19T02:12:55.382 INFO:teuthology.orchestra.run.smithi177.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-19T02:12:55.383 INFO:teuthology.orchestra.run.smithi177.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-19T02:12:55.383 INFO:teuthology.orchestra.run.smithi177.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-04-19T02:12:55.383 INFO:teuthology.orchestra.run.smithi177.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-19T02:12:55.383 INFO:teuthology.orchestra.run.smithi177.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-04-19T02:12:55.383 INFO:teuthology.orchestra.run.smithi177.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-19T02:12:55.383 INFO:teuthology.orchestra.run.smithi177.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-04-19T02:12:55.383 INFO:teuthology.orchestra.run.smithi177.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-04-19T02:12:55.383 INFO:teuthology.orchestra.run.smithi177.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-04-19T02:12:55.383 INFO:teuthology.orchestra.run.smithi177.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2024-04-19T02:12:55.383 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-19T02:12:55.383 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction Summary 2024-04-19T02:12:55.383 INFO:teuthology.orchestra.run.smithi177.stdout:============================================================================================ 2024-04-19T02:12:55.383 INFO:teuthology.orchestra.run.smithi177.stdout:Install 122 Packages 2024-04-19T02:12:55.384 INFO:teuthology.orchestra.run.smithi177.stdout:Upgrade 15 Packages 2024-04-19T02:12:55.384 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-19T02:12:55.385 INFO:teuthology.orchestra.run.smithi177.stdout:Total download size: 207 M 2024-04-19T02:12:55.385 INFO:teuthology.orchestra.run.smithi177.stdout:Downloading Packages: 2024-04-19T02:12:55.385 INFO:teuthology.orchestra.run.smithi153.stdout:============================================================================================ 2024-04-19T02:12:55.385 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2024-04-19T02:12:55.385 INFO:teuthology.orchestra.run.smithi153.stdout:============================================================================================ 2024-04-19T02:12:55.385 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-04-19T02:12:55.385 INFO:teuthology.orchestra.run.smithi153.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2024-04-19T02:12:55.385 INFO:teuthology.orchestra.run.smithi153.stdout: ceph x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 6.4 k 2024-04-19T02:12:55.386 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-base x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 5.5 M 2024-04-19T02:12:55.386 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-fuse x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 859 k 2024-04-19T02:12:55.386 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 166 k 2024-04-19T02:12:55.386 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 1.6 M 2024-04-19T02:12:55.386 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 138 k 2024-04-19T02:12:55.386 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 3.5 M 2024-04-19T02:12:55.386 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 7.4 M 2024-04-19T02:12:55.386 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-rook noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 49 k 2024-04-19T02:12:55.386 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-radosgw x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 13 M 2024-04-19T02:12:55.386 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-test x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 47 M 2024-04-19T02:12:55.386 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-volume noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 263 k 2024-04-19T02:12:55.386 INFO:teuthology.orchestra.run.smithi153.stdout: cephadm noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 170 k 2024-04-19T02:12:55.387 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libelf-devel x86_64 0.190-2.el8 baseos 62 k 2024-04-19T02:12:55.387 INFO:teuthology.orchestra.run.smithi153.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2024-04-19T02:12:55.387 INFO:teuthology.orchestra.run.smithi153.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2024-04-19T02:12:55.387 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs-devel x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 31 k 2024-04-19T02:12:55.387 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs2 x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 780 k 2024-04-19T02:12:55.387 INFO:teuthology.orchestra.run.smithi153.stdout: librados-devel x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 139 k 2024-04-19T02:12:55.387 INFO:teuthology.orchestra.run.smithi153.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2024-04-19T02:12:55.387 INFO:teuthology.orchestra.run.smithi153.stdout: libuuid-devel x86_64 2.32.1-46.el8 baseos 100 k 2024-04-19T02:12:55.387 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-devel x86_64 1:1.1.1k-12.el8 baseos 3.2 M 2024-04-19T02:12:55.387 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cephfs x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 197 k 2024-04-19T02:12:55.387 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rados x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 371 k 2024-04-19T02:12:55.387 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rbd x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 364 k 2024-04-19T02:12:55.387 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rgw x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 106 k 2024-04-19T02:12:55.387 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-fuse x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 95 k 2024-04-19T02:12:55.388 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-mirror x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 3.5 M 2024-04-19T02:12:55.388 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-nbd x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 181 k 2024-04-19T02:12:55.388 INFO:teuthology.orchestra.run.smithi153.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2024-04-19T02:12:55.388 INFO:teuthology.orchestra.run.smithi153.stdout:Upgrading: 2024-04-19T02:12:55.388 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-debuginfod-client x86_64 0.190-2.el8 baseos 77 k 2024-04-19T02:12:55.388 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libelf x86_64 0.190-2.el8 baseos 233 k 2024-04-19T02:12:55.388 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libs x86_64 0.190-2.el8 baseos 305 k 2024-04-19T02:12:55.388 INFO:teuthology.orchestra.run.smithi153.stdout: libblkid x86_64 2.32.1-46.el8 baseos 221 k 2024-04-19T02:12:55.388 INFO:teuthology.orchestra.run.smithi153.stdout: libfdisk x86_64 2.32.1-46.el8 baseos 254 k 2024-04-19T02:12:55.388 INFO:teuthology.orchestra.run.smithi153.stdout: libmount x86_64 2.32.1-46.el8 baseos 237 k 2024-04-19T02:12:55.388 INFO:teuthology.orchestra.run.smithi153.stdout: librados2 x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 3.7 M 2024-04-19T02:12:55.388 INFO:teuthology.orchestra.run.smithi153.stdout: librbd1 x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 3.6 M 2024-04-19T02:12:55.388 INFO:teuthology.orchestra.run.smithi153.stdout: libsmartcols x86_64 2.32.1-46.el8 baseos 180 k 2024-04-19T02:12:55.388 INFO:teuthology.orchestra.run.smithi153.stdout: libuuid x86_64 2.32.1-46.el8 baseos 99 k 2024-04-19T02:12:55.389 INFO:teuthology.orchestra.run.smithi153.stdout: openssl x86_64 1:1.1.1k-12.el8 baseos 738 k 2024-04-19T02:12:55.389 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-libs x86_64 1:1.1.1k-12.el8 baseos 1.5 M 2024-04-19T02:12:55.389 INFO:teuthology.orchestra.run.smithi153.stdout: util-linux x86_64 2.32.1-46.el8 baseos 2.6 M 2024-04-19T02:12:55.389 INFO:teuthology.orchestra.run.smithi153.stdout: util-linux-user x86_64 2.32.1-46.el8 baseos 103 k 2024-04-19T02:12:55.389 INFO:teuthology.orchestra.run.smithi153.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2024-04-19T02:12:55.389 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2024-04-19T02:12:55.389 INFO:teuthology.orchestra.run.smithi153.stdout: automake noarch 1.16.1-8.el8 appstream 740 k 2024-04-19T02:12:55.389 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-common x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 22 M 2024-04-19T02:12:55.389 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 24 k 2024-04-19T02:12:55.389 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mds x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 2.3 M 2024-04-19T02:12:55.389 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 245 k 2024-04-19T02:12:55.389 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mon x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 4.8 M 2024-04-19T02:12:55.389 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-osd x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 18 M 2024-04-19T02:12:55.390 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 15 k 2024-04-19T02:12:55.390 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-selinux x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 24 k 2024-04-19T02:12:55.390 INFO:teuthology.orchestra.run.smithi153.stdout: fuse x86_64 2.9.7-19.el8 baseos 83 k 2024-04-19T02:12:55.390 INFO:teuthology.orchestra.run.smithi153.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-19T02:12:55.390 INFO:teuthology.orchestra.run.smithi153.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-04-19T02:12:55.390 INFO:teuthology.orchestra.run.smithi153.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2024-04-19T02:12:55.390 INFO:teuthology.orchestra.run.smithi153.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2024-04-19T02:12:55.390 INFO:teuthology.orchestra.run.smithi153.stdout: libcephsqlite x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 142 k 2024-04-19T02:12:55.390 INFO:teuthology.orchestra.run.smithi153.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2024-04-19T02:12:55.390 INFO:teuthology.orchestra.run.smithi153.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2024-04-19T02:12:55.390 INFO:teuthology.orchestra.run.smithi153.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-19T02:12:55.390 INFO:teuthology.orchestra.run.smithi153.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2024-04-19T02:12:55.390 INFO:teuthology.orchestra.run.smithi153.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-04-19T02:12:55.390 INFO:teuthology.orchestra.run.smithi153.stdout: libradosstriper1 x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 474 k 2024-04-19T02:12:55.391 INFO:teuthology.orchestra.run.smithi153.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-04-19T02:12:55.391 INFO:teuthology.orchestra.run.smithi153.stdout: librgw2 x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 6.6 M 2024-04-19T02:12:55.391 INFO:teuthology.orchestra.run.smithi153.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2024-04-19T02:12:55.391 INFO:teuthology.orchestra.run.smithi153.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2024-04-19T02:12:55.391 INFO:teuthology.orchestra.run.smithi153.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-19T02:12:55.391 INFO:teuthology.orchestra.run.smithi153.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2024-04-19T02:12:55.391 INFO:teuthology.orchestra.run.smithi153.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2024-04-19T02:12:55.391 INFO:teuthology.orchestra.run.smithi153.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-04-19T02:12:55.391 INFO:teuthology.orchestra.run.smithi153.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-04-19T02:12:55.391 INFO:teuthology.orchestra.run.smithi153.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-04-19T02:12:55.391 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-04-19T02:12:55.391 INFO:teuthology.orchestra.run.smithi153.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2024-04-19T02:12:55.391 INFO:teuthology.orchestra.run.smithi153.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2024-04-19T02:12:55.391 INFO:teuthology.orchestra.run.smithi153.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2024-04-19T02:12:55.392 INFO:teuthology.orchestra.run.smithi153.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-04-19T02:12:55.392 INFO:teuthology.orchestra.run.smithi153.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2024-04-19T02:12:55.392 INFO:teuthology.orchestra.run.smithi153.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-19T02:12:55.392 INFO:teuthology.orchestra.run.smithi153.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-19T02:12:55.392 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-04-19T02:12:55.392 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-argparse x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 45 k 2024-04-19T02:12:55.392 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-common x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 129 k 2024-04-19T02:12:55.392 INFO:teuthology.orchestra.run.smithi153.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-04-19T02:12:55.392 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-04-19T02:12:55.392 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-19T02:12:55.392 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-19T02:12:55.392 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-04-19T02:12:55.392 INFO:teuthology.orchestra.run.smithi153.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-04-19T02:12:55.392 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-19T02:12:55.393 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-19T02:12:55.393 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jinja2 noarch 2.10.1-4.el8 appstream 578 k 2024-04-19T02:12:55.393 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2024-04-19T02:12:55.393 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2024-04-19T02:12:55.393 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-04-19T02:12:55.393 INFO:teuthology.orchestra.run.smithi153.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-04-19T02:12:55.393 INFO:teuthology.orchestra.run.smithi153.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-19T02:12:55.393 INFO:teuthology.orchestra.run.smithi153.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-04-19T02:12:55.393 INFO:teuthology.orchestra.run.smithi153.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-04-19T02:12:55.393 INFO:teuthology.orchestra.run.smithi153.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-19T02:12:55.393 INFO:teuthology.orchestra.run.smithi153.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-04-19T02:12:55.393 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-04-19T02:12:55.393 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-04-19T02:12:55.394 INFO:teuthology.orchestra.run.smithi153.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-04-19T02:12:55.394 INFO:teuthology.orchestra.run.smithi153.stdout: python3-packaging noarch 16.8-9.el8 powertools 48 k 2024-04-19T02:12:55.394 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-19T02:12:55.394 INFO:teuthology.orchestra.run.smithi153.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-19T02:12:55.394 INFO:teuthology.orchestra.run.smithi153.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-04-19T02:12:55.394 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-04-19T02:12:55.394 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-04-19T02:12:55.394 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-04-19T02:12:55.394 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-04-19T02:12:55.394 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-04-19T02:12:55.394 INFO:teuthology.orchestra.run.smithi153.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-04-19T02:12:55.394 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-04-19T02:12:55.394 INFO:teuthology.orchestra.run.smithi153.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-04-19T02:12:55.395 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-04-19T02:12:55.395 INFO:teuthology.orchestra.run.smithi153.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-04-19T02:12:55.395 INFO:teuthology.orchestra.run.smithi153.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-19T02:12:55.395 INFO:teuthology.orchestra.run.smithi153.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-19T02:12:55.395 INFO:teuthology.orchestra.run.smithi153.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-19T02:12:55.395 INFO:teuthology.orchestra.run.smithi153.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-19T02:12:55.395 INFO:teuthology.orchestra.run.smithi153.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-19T02:12:55.395 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-19T02:12:55.395 INFO:teuthology.orchestra.run.smithi153.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-04-19T02:12:55.395 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-19T02:12:55.395 INFO:teuthology.orchestra.run.smithi153.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-04-19T02:12:55.395 INFO:teuthology.orchestra.run.smithi153.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-19T02:12:55.395 INFO:teuthology.orchestra.run.smithi153.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-04-19T02:12:55.395 INFO:teuthology.orchestra.run.smithi153.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-04-19T02:12:55.396 INFO:teuthology.orchestra.run.smithi153.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-04-19T02:12:55.396 INFO:teuthology.orchestra.run.smithi153.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2024-04-19T02:12:55.396 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-19T02:12:55.396 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-04-19T02:12:55.396 INFO:teuthology.orchestra.run.smithi153.stdout:============================================================================================ 2024-04-19T02:12:55.396 INFO:teuthology.orchestra.run.smithi153.stdout:Install 122 Packages 2024-04-19T02:12:55.396 INFO:teuthology.orchestra.run.smithi153.stdout:Upgrade 15 Packages 2024-04-19T02:12:55.396 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-19T02:12:55.396 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 207 M 2024-04-19T02:12:55.396 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-04-19T02:12:55.665 INFO:teuthology.orchestra.run.smithi121.stdout:lab-extras 404 kB/s | 24 kB 00:00 2024-04-19T02:12:55.895 INFO:teuthology.orchestra.run.smithi153.stdout:(1/137): ceph-18.2.2-1237.g646b8c7d.el8.x86_64. 50 kB/s | 6.4 kB 00:00 2024-04-19T02:12:56.050 INFO:teuthology.orchestra.run.smithi177.stdout:(1/137): ceph-18.2.2-1237.g646b8c7d.el8.x86_64. 47 kB/s | 6.4 kB 00:00 2024-04-19T02:12:56.112 INFO:teuthology.orchestra.run.smithi153.stdout:(2/137): ceph-fuse-18.2.2-1237.g646b8c7d.el8.x8 3.9 MB/s | 859 kB 00:00 2024-04-19T02:12:56.179 INFO:teuthology.orchestra.run.smithi153.stdout:(3/137): ceph-immutable-object-cache-18.2.2-123 2.4 MB/s | 166 kB 00:00 2024-04-19T02:12:56.479 INFO:teuthology.orchestra.run.smithi153.stdout:(4/137): ceph-mds-18.2.2-1237.g646b8c7d.el8.x86 7.6 MB/s | 2.3 MB 00:00 2024-04-19T02:12:56.483 INFO:teuthology.orchestra.run.smithi177.stdout:(2/137): ceph-fuse-18.2.2-1237.g646b8c7d.el8.x8 1.9 MB/s | 859 kB 00:00 2024-04-19T02:12:56.575 INFO:teuthology.orchestra.run.smithi177.stdout:(3/137): ceph-immutable-object-cache-18.2.2-123 1.8 MB/s | 166 kB 00:00 2024-04-19T02:12:56.738 INFO:teuthology.orchestra.run.smithi153.stdout:(5/137): ceph-mgr-18.2.2-1237.g646b8c7d.el8.x86 6.0 MB/s | 1.6 MB 00:00 2024-04-19T02:12:57.342 INFO:teuthology.orchestra.run.smithi177.stdout:(4/137): ceph-mds-18.2.2-1237.g646b8c7d.el8.x86 3.0 MB/s | 2.3 MB 00:00 2024-04-19T02:12:57.421 INFO:teuthology.orchestra.run.smithi153.stdout:(6/137): ceph-mon-18.2.2-1237.g646b8c7d.el8.x86 7.1 MB/s | 4.8 MB 00:00 2024-04-19T02:12:57.526 INFO:teuthology.orchestra.run.smithi174.stdout:lab-extras 373 kB/s | 24 kB 00:00 2024-04-19T02:12:57.659 INFO:teuthology.orchestra.run.smithi177.stdout:(5/137): ceph-mgr-18.2.2-1237.g646b8c7d.el8.x86 4.9 MB/s | 1.6 MB 00:00 2024-04-19T02:12:57.747 INFO:teuthology.orchestra.run.smithi153.stdout:(7/137): ceph-common-18.2.2-1237.g646b8c7d.el8. 11 MB/s | 22 MB 00:01 2024-04-19T02:12:58.651 INFO:teuthology.orchestra.run.smithi177.stdout:(6/137): ceph-mon-18.2.2-1237.g646b8c7d.el8.x86 4.9 MB/s | 4.8 MB 00:00 2024-04-19T02:12:58.894 INFO:teuthology.orchestra.run.smithi177.stdout:(7/137): ceph-base-18.2.2-1237.g646b8c7d.el8.x8 1.9 MB/s | 5.5 MB 00:02 2024-04-19T02:12:59.247 INFO:teuthology.orchestra.run.smithi153.stdout:(8/137): ceph-radosgw-18.2.2-1237.g646b8c7d.el8 8.7 MB/s | 13 MB 00:01 2024-04-19T02:12:59.247 INFO:teuthology.orchestra.run.smithi121.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-19T02:12:59.248 INFO:teuthology.orchestra.run.smithi121.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-19T02:12:59.297 INFO:teuthology.orchestra.run.smithi153.stdout:(9/137): ceph-selinux-18.2.2-1237.g646b8c7d.el8 488 kB/s | 24 kB 00:00 2024-04-19T02:12:59.329 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-04-19T02:12:59.342 INFO:teuthology.orchestra.run.smithi121.stdout:============================================================================================ 2024-04-19T02:12:59.342 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository Size 2024-04-19T02:12:59.342 INFO:teuthology.orchestra.run.smithi121.stdout:============================================================================================ 2024-04-19T02:12:59.342 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2024-04-19T02:12:59.343 INFO:teuthology.orchestra.run.smithi121.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2024-04-19T02:12:59.343 INFO:teuthology.orchestra.run.smithi121.stdout: ceph x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 6.4 k 2024-04-19T02:12:59.343 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-base x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 5.5 M 2024-04-19T02:12:59.343 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-fuse x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 859 k 2024-04-19T02:12:59.343 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 166 k 2024-04-19T02:12:59.343 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 1.6 M 2024-04-19T02:12:59.343 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 138 k 2024-04-19T02:12:59.343 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 3.5 M 2024-04-19T02:12:59.343 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 7.4 M 2024-04-19T02:12:59.343 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-rook noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 49 k 2024-04-19T02:12:59.343 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-radosgw x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 13 M 2024-04-19T02:12:59.343 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-test x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 47 M 2024-04-19T02:12:59.343 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-volume noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 263 k 2024-04-19T02:12:59.344 INFO:teuthology.orchestra.run.smithi121.stdout: cephadm noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 170 k 2024-04-19T02:12:59.344 INFO:teuthology.orchestra.run.smithi121.stdout: elfutils-libelf-devel x86_64 0.190-2.el8 baseos 62 k 2024-04-19T02:12:59.344 INFO:teuthology.orchestra.run.smithi121.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2024-04-19T02:12:59.344 INFO:teuthology.orchestra.run.smithi121.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2024-04-19T02:12:59.344 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs-devel x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 31 k 2024-04-19T02:12:59.344 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs2 x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 780 k 2024-04-19T02:12:59.344 INFO:teuthology.orchestra.run.smithi121.stdout: librados-devel x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 139 k 2024-04-19T02:12:59.344 INFO:teuthology.orchestra.run.smithi121.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2024-04-19T02:12:59.344 INFO:teuthology.orchestra.run.smithi121.stdout: libuuid-devel x86_64 2.32.1-46.el8 baseos 100 k 2024-04-19T02:12:59.344 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-devel x86_64 1:1.1.1k-12.el8 baseos 3.2 M 2024-04-19T02:12:59.344 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cephfs x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 197 k 2024-04-19T02:12:59.344 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rados x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 371 k 2024-04-19T02:12:59.344 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rbd x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 364 k 2024-04-19T02:12:59.345 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rgw x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 106 k 2024-04-19T02:12:59.345 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-fuse x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 95 k 2024-04-19T02:12:59.345 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-mirror x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 3.5 M 2024-04-19T02:12:59.345 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-nbd x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 181 k 2024-04-19T02:12:59.345 INFO:teuthology.orchestra.run.smithi121.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2024-04-19T02:12:59.345 INFO:teuthology.orchestra.run.smithi121.stdout:Upgrading: 2024-04-19T02:12:59.345 INFO:teuthology.orchestra.run.smithi121.stdout: elfutils-debuginfod-client x86_64 0.190-2.el8 baseos 77 k 2024-04-19T02:12:59.345 INFO:teuthology.orchestra.run.smithi121.stdout: elfutils-libelf x86_64 0.190-2.el8 baseos 233 k 2024-04-19T02:12:59.345 INFO:teuthology.orchestra.run.smithi121.stdout: elfutils-libs x86_64 0.190-2.el8 baseos 305 k 2024-04-19T02:12:59.345 INFO:teuthology.orchestra.run.smithi121.stdout: libblkid x86_64 2.32.1-46.el8 baseos 221 k 2024-04-19T02:12:59.345 INFO:teuthology.orchestra.run.smithi121.stdout: libfdisk x86_64 2.32.1-46.el8 baseos 254 k 2024-04-19T02:12:59.345 INFO:teuthology.orchestra.run.smithi121.stdout: libmount x86_64 2.32.1-46.el8 baseos 237 k 2024-04-19T02:12:59.345 INFO:teuthology.orchestra.run.smithi121.stdout: librados2 x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 3.7 M 2024-04-19T02:12:59.346 INFO:teuthology.orchestra.run.smithi121.stdout: librbd1 x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 3.6 M 2024-04-19T02:12:59.346 INFO:teuthology.orchestra.run.smithi121.stdout: libsmartcols x86_64 2.32.1-46.el8 baseos 180 k 2024-04-19T02:12:59.346 INFO:teuthology.orchestra.run.smithi121.stdout: libuuid x86_64 2.32.1-46.el8 baseos 99 k 2024-04-19T02:12:59.346 INFO:teuthology.orchestra.run.smithi121.stdout: openssl x86_64 1:1.1.1k-12.el8 baseos 738 k 2024-04-19T02:12:59.346 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-libs x86_64 1:1.1.1k-12.el8 baseos 1.5 M 2024-04-19T02:12:59.346 INFO:teuthology.orchestra.run.smithi121.stdout: util-linux x86_64 2.32.1-46.el8 baseos 2.6 M 2024-04-19T02:12:59.346 INFO:teuthology.orchestra.run.smithi121.stdout: util-linux-user x86_64 2.32.1-46.el8 baseos 103 k 2024-04-19T02:12:59.346 INFO:teuthology.orchestra.run.smithi121.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2024-04-19T02:12:59.346 INFO:teuthology.orchestra.run.smithi121.stdout:Installing dependencies: 2024-04-19T02:12:59.346 INFO:teuthology.orchestra.run.smithi121.stdout: automake noarch 1.16.1-8.el8 appstream 740 k 2024-04-19T02:12:59.346 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-common x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 22 M 2024-04-19T02:12:59.346 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 24 k 2024-04-19T02:12:59.346 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mds x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 2.3 M 2024-04-19T02:12:59.347 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 245 k 2024-04-19T02:12:59.347 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mon x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 4.8 M 2024-04-19T02:12:59.347 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-osd x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 18 M 2024-04-19T02:12:59.347 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 15 k 2024-04-19T02:12:59.347 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-selinux x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 24 k 2024-04-19T02:12:59.347 INFO:teuthology.orchestra.run.smithi121.stdout: fuse x86_64 2.9.7-19.el8 baseos 83 k 2024-04-19T02:12:59.347 INFO:teuthology.orchestra.run.smithi121.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-19T02:12:59.347 INFO:teuthology.orchestra.run.smithi121.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-04-19T02:12:59.347 INFO:teuthology.orchestra.run.smithi121.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2024-04-19T02:12:59.347 INFO:teuthology.orchestra.run.smithi121.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2024-04-19T02:12:59.347 INFO:teuthology.orchestra.run.smithi121.stdout: libcephsqlite x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 142 k 2024-04-19T02:12:59.347 INFO:teuthology.orchestra.run.smithi121.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2024-04-19T02:12:59.347 INFO:teuthology.orchestra.run.smithi121.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2024-04-19T02:12:59.348 INFO:teuthology.orchestra.run.smithi121.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-19T02:12:59.348 INFO:teuthology.orchestra.run.smithi121.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2024-04-19T02:12:59.348 INFO:teuthology.orchestra.run.smithi121.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-04-19T02:12:59.348 INFO:teuthology.orchestra.run.smithi121.stdout: libradosstriper1 x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 474 k 2024-04-19T02:12:59.348 INFO:teuthology.orchestra.run.smithi121.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-04-19T02:12:59.348 INFO:teuthology.orchestra.run.smithi121.stdout: librgw2 x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 6.6 M 2024-04-19T02:12:59.348 INFO:teuthology.orchestra.run.smithi121.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2024-04-19T02:12:59.348 INFO:teuthology.orchestra.run.smithi121.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2024-04-19T02:12:59.348 INFO:teuthology.orchestra.run.smithi121.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-19T02:12:59.348 INFO:teuthology.orchestra.run.smithi121.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2024-04-19T02:12:59.348 INFO:teuthology.orchestra.run.smithi121.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2024-04-19T02:12:59.348 INFO:teuthology.orchestra.run.smithi121.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-04-19T02:12:59.348 INFO:teuthology.orchestra.run.smithi121.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-04-19T02:12:59.348 INFO:teuthology.orchestra.run.smithi121.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-04-19T02:12:59.349 INFO:teuthology.orchestra.run.smithi121.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-04-19T02:12:59.349 INFO:teuthology.orchestra.run.smithi121.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2024-04-19T02:12:59.349 INFO:teuthology.orchestra.run.smithi121.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2024-04-19T02:12:59.349 INFO:teuthology.orchestra.run.smithi121.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2024-04-19T02:12:59.349 INFO:teuthology.orchestra.run.smithi121.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-04-19T02:12:59.349 INFO:teuthology.orchestra.run.smithi121.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2024-04-19T02:12:59.349 INFO:teuthology.orchestra.run.smithi121.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-19T02:12:59.349 INFO:teuthology.orchestra.run.smithi121.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-19T02:12:59.349 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-04-19T02:12:59.349 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-argparse x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 45 k 2024-04-19T02:12:59.349 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-common x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 129 k 2024-04-19T02:12:59.349 INFO:teuthology.orchestra.run.smithi121.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-04-19T02:12:59.349 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-04-19T02:12:59.350 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-19T02:12:59.350 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-19T02:12:59.350 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-04-19T02:12:59.350 INFO:teuthology.orchestra.run.smithi121.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-04-19T02:12:59.350 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-19T02:12:59.350 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-19T02:12:59.350 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jinja2 noarch 2.10.1-4.el8 appstream 578 k 2024-04-19T02:12:59.350 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2024-04-19T02:12:59.350 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2024-04-19T02:12:59.350 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-04-19T02:12:59.350 INFO:teuthology.orchestra.run.smithi121.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-04-19T02:12:59.350 INFO:teuthology.orchestra.run.smithi121.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-19T02:12:59.350 INFO:teuthology.orchestra.run.smithi121.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-04-19T02:12:59.350 INFO:teuthology.orchestra.run.smithi121.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-04-19T02:12:59.351 INFO:teuthology.orchestra.run.smithi121.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-19T02:12:59.351 INFO:teuthology.orchestra.run.smithi121.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-04-19T02:12:59.351 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-04-19T02:12:59.351 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-04-19T02:12:59.351 INFO:teuthology.orchestra.run.smithi121.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-04-19T02:12:59.351 INFO:teuthology.orchestra.run.smithi121.stdout: python3-packaging noarch 16.8-9.el8 powertools 48 k 2024-04-19T02:12:59.351 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-19T02:12:59.351 INFO:teuthology.orchestra.run.smithi121.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-19T02:12:59.351 INFO:teuthology.orchestra.run.smithi121.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-04-19T02:12:59.351 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-04-19T02:12:59.351 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-04-19T02:12:59.351 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-04-19T02:12:59.351 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-04-19T02:12:59.351 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-04-19T02:12:59.352 INFO:teuthology.orchestra.run.smithi121.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-04-19T02:12:59.352 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-04-19T02:12:59.352 INFO:teuthology.orchestra.run.smithi121.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-04-19T02:12:59.352 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-04-19T02:12:59.352 INFO:teuthology.orchestra.run.smithi121.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-04-19T02:12:59.352 INFO:teuthology.orchestra.run.smithi121.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-19T02:12:59.352 INFO:teuthology.orchestra.run.smithi121.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-19T02:12:59.352 INFO:teuthology.orchestra.run.smithi121.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-19T02:12:59.352 INFO:teuthology.orchestra.run.smithi121.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-19T02:12:59.352 INFO:teuthology.orchestra.run.smithi121.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-19T02:12:59.352 INFO:teuthology.orchestra.run.smithi121.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-19T02:12:59.352 INFO:teuthology.orchestra.run.smithi121.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-04-19T02:12:59.352 INFO:teuthology.orchestra.run.smithi121.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-19T02:12:59.352 INFO:teuthology.orchestra.run.smithi121.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-04-19T02:12:59.352 INFO:teuthology.orchestra.run.smithi121.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-19T02:12:59.353 INFO:teuthology.orchestra.run.smithi121.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-04-19T02:12:59.353 INFO:teuthology.orchestra.run.smithi121.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-04-19T02:12:59.353 INFO:teuthology.orchestra.run.smithi121.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-04-19T02:12:59.353 INFO:teuthology.orchestra.run.smithi121.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2024-04-19T02:12:59.353 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:12:59.353 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2024-04-19T02:12:59.353 INFO:teuthology.orchestra.run.smithi121.stdout:============================================================================================ 2024-04-19T02:12:59.353 INFO:teuthology.orchestra.run.smithi121.stdout:Install 122 Packages 2024-04-19T02:12:59.353 INFO:teuthology.orchestra.run.smithi121.stdout:Upgrade 15 Packages 2024-04-19T02:12:59.353 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:12:59.354 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 207 M 2024-04-19T02:12:59.354 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2024-04-19T02:12:59.996 INFO:teuthology.orchestra.run.smithi153.stdout:(10/137): ceph-osd-18.2.2-1237.g646b8c7d.el8.x8 7.2 MB/s | 18 MB 00:02 2024-04-19T02:13:00.073 INFO:teuthology.orchestra.run.smithi153.stdout:(11/137): ceph-base-18.2.2-1237.g646b8c7d.el8.x 1.3 MB/s | 5.5 MB 00:04 2024-04-19T02:13:00.098 INFO:teuthology.orchestra.run.smithi153.stdout:(12/137): libcephfs-devel-18.2.2-1237.g646b8c7d 304 kB/s | 31 kB 00:00 2024-04-19T02:13:00.190 INFO:teuthology.orchestra.run.smithi153.stdout:(13/137): libcephsqlite-18.2.2-1237.g646b8c7d.e 1.5 MB/s | 142 kB 00:00 2024-04-19T02:13:00.290 INFO:teuthology.orchestra.run.smithi153.stdout:(14/137): librados-devel-18.2.2-1237.g646b8c7d. 1.4 MB/s | 139 kB 00:00 2024-04-19T02:13:00.441 INFO:teuthology.orchestra.run.smithi121.stdout:(1/137): ceph-18.2.2-1237.g646b8c7d.el8.x86_64. 19 kB/s | 6.4 kB 00:00 2024-04-19T02:13:00.682 INFO:teuthology.orchestra.run.smithi153.stdout:(15/137): libcephfs2-18.2.2-1237.g646b8c7d.el8. 1.3 MB/s | 780 kB 00:00 2024-04-19T02:13:00.874 INFO:teuthology.orchestra.run.smithi153.stdout:(16/137): libradosstriper1-18.2.2-1237.g646b8c7 813 kB/s | 474 kB 00:00 2024-04-19T02:13:00.983 INFO:teuthology.orchestra.run.smithi153.stdout:(17/137): python3-ceph-argparse-18.2.2-1237.g64 411 kB/s | 45 kB 00:00 2024-04-19T02:13:01.091 INFO:teuthology.orchestra.run.smithi153.stdout:(18/137): python3-ceph-common-18.2.2-1237.g646b 1.2 MB/s | 129 kB 00:00 2024-04-19T02:13:01.167 INFO:teuthology.orchestra.run.smithi174.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-19T02:13:01.168 INFO:teuthology.orchestra.run.smithi174.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-19T02:13:01.191 INFO:teuthology.orchestra.run.smithi153.stdout:(19/137): python3-cephfs-18.2.2-1237.g646b8c7d. 1.9 MB/s | 197 kB 00:00 2024-04-19T02:13:01.246 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies resolved. 2024-04-19T02:13:01.257 INFO:teuthology.orchestra.run.smithi121.stdout:(2/137): ceph-fuse-18.2.2-1237.g646b8c7d.el8.x8 1.0 MB/s | 859 kB 00:00 2024-04-19T02:13:01.259 INFO:teuthology.orchestra.run.smithi174.stdout:============================================================================================ 2024-04-19T02:13:01.259 INFO:teuthology.orchestra.run.smithi174.stdout: Package Arch Version Repository Size 2024-04-19T02:13:01.259 INFO:teuthology.orchestra.run.smithi174.stdout:============================================================================================ 2024-04-19T02:13:01.259 INFO:teuthology.orchestra.run.smithi174.stdout:Installing: 2024-04-19T02:13:01.259 INFO:teuthology.orchestra.run.smithi174.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2024-04-19T02:13:01.260 INFO:teuthology.orchestra.run.smithi174.stdout: ceph x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 6.4 k 2024-04-19T02:13:01.260 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-base x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 5.5 M 2024-04-19T02:13:01.260 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-fuse x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 859 k 2024-04-19T02:13:01.260 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 166 k 2024-04-19T02:13:01.260 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 1.6 M 2024-04-19T02:13:01.260 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 138 k 2024-04-19T02:13:01.260 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 3.5 M 2024-04-19T02:13:01.260 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 7.4 M 2024-04-19T02:13:01.260 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-rook noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 49 k 2024-04-19T02:13:01.260 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-radosgw x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 13 M 2024-04-19T02:13:01.260 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-test x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 47 M 2024-04-19T02:13:01.260 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-volume noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 263 k 2024-04-19T02:13:01.260 INFO:teuthology.orchestra.run.smithi174.stdout: cephadm noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 170 k 2024-04-19T02:13:01.261 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-libelf-devel x86_64 0.190-2.el8 baseos 62 k 2024-04-19T02:13:01.261 INFO:teuthology.orchestra.run.smithi174.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2024-04-19T02:13:01.261 INFO:teuthology.orchestra.run.smithi174.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2024-04-19T02:13:01.261 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs-devel x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 31 k 2024-04-19T02:13:01.261 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs2 x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 780 k 2024-04-19T02:13:01.261 INFO:teuthology.orchestra.run.smithi174.stdout: librados-devel x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 139 k 2024-04-19T02:13:01.261 INFO:teuthology.orchestra.run.smithi174.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2024-04-19T02:13:01.261 INFO:teuthology.orchestra.run.smithi174.stdout: libuuid-devel x86_64 2.32.1-46.el8 baseos 100 k 2024-04-19T02:13:01.261 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-devel x86_64 1:1.1.1k-12.el8 baseos 3.2 M 2024-04-19T02:13:01.261 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cephfs x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 197 k 2024-04-19T02:13:01.261 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rados x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 371 k 2024-04-19T02:13:01.261 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rbd x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 364 k 2024-04-19T02:13:01.261 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rgw x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 106 k 2024-04-19T02:13:01.261 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-fuse x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 95 k 2024-04-19T02:13:01.261 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-mirror x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 3.5 M 2024-04-19T02:13:01.261 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-nbd x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 181 k 2024-04-19T02:13:01.262 INFO:teuthology.orchestra.run.smithi174.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2024-04-19T02:13:01.262 INFO:teuthology.orchestra.run.smithi174.stdout:Upgrading: 2024-04-19T02:13:01.262 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-debuginfod-client x86_64 0.190-2.el8 baseos 77 k 2024-04-19T02:13:01.262 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-libelf x86_64 0.190-2.el8 baseos 233 k 2024-04-19T02:13:01.262 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-libs x86_64 0.190-2.el8 baseos 305 k 2024-04-19T02:13:01.262 INFO:teuthology.orchestra.run.smithi174.stdout: libblkid x86_64 2.32.1-46.el8 baseos 221 k 2024-04-19T02:13:01.262 INFO:teuthology.orchestra.run.smithi174.stdout: libfdisk x86_64 2.32.1-46.el8 baseos 254 k 2024-04-19T02:13:01.262 INFO:teuthology.orchestra.run.smithi174.stdout: libmount x86_64 2.32.1-46.el8 baseos 237 k 2024-04-19T02:13:01.262 INFO:teuthology.orchestra.run.smithi174.stdout: librados2 x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 3.7 M 2024-04-19T02:13:01.262 INFO:teuthology.orchestra.run.smithi174.stdout: librbd1 x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 3.6 M 2024-04-19T02:13:01.262 INFO:teuthology.orchestra.run.smithi174.stdout: libsmartcols x86_64 2.32.1-46.el8 baseos 180 k 2024-04-19T02:13:01.262 INFO:teuthology.orchestra.run.smithi174.stdout: libuuid x86_64 2.32.1-46.el8 baseos 99 k 2024-04-19T02:13:01.262 INFO:teuthology.orchestra.run.smithi174.stdout: openssl x86_64 1:1.1.1k-12.el8 baseos 738 k 2024-04-19T02:13:01.263 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-libs x86_64 1:1.1.1k-12.el8 baseos 1.5 M 2024-04-19T02:13:01.263 INFO:teuthology.orchestra.run.smithi174.stdout: util-linux x86_64 2.32.1-46.el8 baseos 2.6 M 2024-04-19T02:13:01.263 INFO:teuthology.orchestra.run.smithi174.stdout: util-linux-user x86_64 2.32.1-46.el8 baseos 103 k 2024-04-19T02:13:01.263 INFO:teuthology.orchestra.run.smithi174.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2024-04-19T02:13:01.263 INFO:teuthology.orchestra.run.smithi174.stdout:Installing dependencies: 2024-04-19T02:13:01.263 INFO:teuthology.orchestra.run.smithi174.stdout: automake noarch 1.16.1-8.el8 appstream 740 k 2024-04-19T02:13:01.263 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-common x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 22 M 2024-04-19T02:13:01.263 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 24 k 2024-04-19T02:13:01.263 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mds x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 2.3 M 2024-04-19T02:13:01.263 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 245 k 2024-04-19T02:13:01.263 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mon x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 4.8 M 2024-04-19T02:13:01.263 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-osd x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 18 M 2024-04-19T02:13:01.263 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 15 k 2024-04-19T02:13:01.263 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-selinux x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 24 k 2024-04-19T02:13:01.264 INFO:teuthology.orchestra.run.smithi174.stdout: fuse x86_64 2.9.7-19.el8 baseos 83 k 2024-04-19T02:13:01.264 INFO:teuthology.orchestra.run.smithi174.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-19T02:13:01.264 INFO:teuthology.orchestra.run.smithi174.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-04-19T02:13:01.264 INFO:teuthology.orchestra.run.smithi174.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2024-04-19T02:13:01.264 INFO:teuthology.orchestra.run.smithi174.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2024-04-19T02:13:01.264 INFO:teuthology.orchestra.run.smithi174.stdout: libcephsqlite x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 142 k 2024-04-19T02:13:01.264 INFO:teuthology.orchestra.run.smithi174.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2024-04-19T02:13:01.264 INFO:teuthology.orchestra.run.smithi174.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2024-04-19T02:13:01.264 INFO:teuthology.orchestra.run.smithi174.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-19T02:13:01.264 INFO:teuthology.orchestra.run.smithi174.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2024-04-19T02:13:01.264 INFO:teuthology.orchestra.run.smithi174.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-04-19T02:13:01.264 INFO:teuthology.orchestra.run.smithi174.stdout: libradosstriper1 x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 474 k 2024-04-19T02:13:01.264 INFO:teuthology.orchestra.run.smithi174.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-04-19T02:13:01.265 INFO:teuthology.orchestra.run.smithi174.stdout: librgw2 x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 6.6 M 2024-04-19T02:13:01.265 INFO:teuthology.orchestra.run.smithi174.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2024-04-19T02:13:01.265 INFO:teuthology.orchestra.run.smithi174.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2024-04-19T02:13:01.265 INFO:teuthology.orchestra.run.smithi174.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-19T02:13:01.265 INFO:teuthology.orchestra.run.smithi174.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2024-04-19T02:13:01.265 INFO:teuthology.orchestra.run.smithi174.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2024-04-19T02:13:01.265 INFO:teuthology.orchestra.run.smithi174.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-04-19T02:13:01.265 INFO:teuthology.orchestra.run.smithi174.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-04-19T02:13:01.265 INFO:teuthology.orchestra.run.smithi174.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-04-19T02:13:01.265 INFO:teuthology.orchestra.run.smithi174.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-04-19T02:13:01.265 INFO:teuthology.orchestra.run.smithi174.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2024-04-19T02:13:01.265 INFO:teuthology.orchestra.run.smithi174.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2024-04-19T02:13:01.265 INFO:teuthology.orchestra.run.smithi174.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2024-04-19T02:13:01.265 INFO:teuthology.orchestra.run.smithi174.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-04-19T02:13:01.265 INFO:teuthology.orchestra.run.smithi174.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2024-04-19T02:13:01.265 INFO:teuthology.orchestra.run.smithi174.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-19T02:13:01.266 INFO:teuthology.orchestra.run.smithi174.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-19T02:13:01.266 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-04-19T02:13:01.266 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-argparse x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 45 k 2024-04-19T02:13:01.266 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-common x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 129 k 2024-04-19T02:13:01.266 INFO:teuthology.orchestra.run.smithi174.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-04-19T02:13:01.266 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-04-19T02:13:01.266 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-19T02:13:01.266 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-19T02:13:01.266 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-04-19T02:13:01.266 INFO:teuthology.orchestra.run.smithi174.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-04-19T02:13:01.266 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-19T02:13:01.266 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-19T02:13:01.266 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jinja2 noarch 2.10.1-4.el8 appstream 578 k 2024-04-19T02:13:01.266 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2024-04-19T02:13:01.267 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2024-04-19T02:13:01.267 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-04-19T02:13:01.267 INFO:teuthology.orchestra.run.smithi174.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-04-19T02:13:01.267 INFO:teuthology.orchestra.run.smithi174.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-19T02:13:01.267 INFO:teuthology.orchestra.run.smithi174.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-04-19T02:13:01.267 INFO:teuthology.orchestra.run.smithi174.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-04-19T02:13:01.267 INFO:teuthology.orchestra.run.smithi174.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-19T02:13:01.267 INFO:teuthology.orchestra.run.smithi174.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-04-19T02:13:01.267 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-04-19T02:13:01.267 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-04-19T02:13:01.267 INFO:teuthology.orchestra.run.smithi174.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-04-19T02:13:01.267 INFO:teuthology.orchestra.run.smithi174.stdout: python3-packaging noarch 16.8-9.el8 powertools 48 k 2024-04-19T02:13:01.267 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-19T02:13:01.267 INFO:teuthology.orchestra.run.smithi174.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-19T02:13:01.267 INFO:teuthology.orchestra.run.smithi174.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-04-19T02:13:01.268 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-04-19T02:13:01.268 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-04-19T02:13:01.268 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-04-19T02:13:01.268 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-04-19T02:13:01.268 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-04-19T02:13:01.268 INFO:teuthology.orchestra.run.smithi174.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-04-19T02:13:01.268 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-04-19T02:13:01.268 INFO:teuthology.orchestra.run.smithi174.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-04-19T02:13:01.268 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-04-19T02:13:01.268 INFO:teuthology.orchestra.run.smithi174.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-04-19T02:13:01.268 INFO:teuthology.orchestra.run.smithi174.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-19T02:13:01.268 INFO:teuthology.orchestra.run.smithi174.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-19T02:13:01.268 INFO:teuthology.orchestra.run.smithi174.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-19T02:13:01.269 INFO:teuthology.orchestra.run.smithi174.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-19T02:13:01.269 INFO:teuthology.orchestra.run.smithi174.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-19T02:13:01.269 INFO:teuthology.orchestra.run.smithi174.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-19T02:13:01.269 INFO:teuthology.orchestra.run.smithi174.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-04-19T02:13:01.269 INFO:teuthology.orchestra.run.smithi174.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-19T02:13:01.269 INFO:teuthology.orchestra.run.smithi174.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-04-19T02:13:01.269 INFO:teuthology.orchestra.run.smithi174.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-19T02:13:01.269 INFO:teuthology.orchestra.run.smithi174.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-04-19T02:13:01.269 INFO:teuthology.orchestra.run.smithi174.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-04-19T02:13:01.269 INFO:teuthology.orchestra.run.smithi174.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-04-19T02:13:01.269 INFO:teuthology.orchestra.run.smithi174.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2024-04-19T02:13:01.269 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-19T02:13:01.269 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2024-04-19T02:13:01.269 INFO:teuthology.orchestra.run.smithi174.stdout:============================================================================================ 2024-04-19T02:13:01.269 INFO:teuthology.orchestra.run.smithi174.stdout:Install 122 Packages 2024-04-19T02:13:01.270 INFO:teuthology.orchestra.run.smithi174.stdout:Upgrade 15 Packages 2024-04-19T02:13:01.270 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-19T02:13:01.270 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 207 M 2024-04-19T02:13:01.270 INFO:teuthology.orchestra.run.smithi174.stdout:Downloading Packages: 2024-04-19T02:13:01.325 INFO:teuthology.orchestra.run.smithi153.stdout:(20/137): python3-rados-18.2.2-1237.g646b8c7d.e 2.7 MB/s | 371 kB 00:00 2024-04-19T02:13:01.383 INFO:teuthology.orchestra.run.smithi121.stdout:(3/137): ceph-immutable-object-cache-18.2.2-123 1.3 MB/s | 166 kB 00:00 2024-04-19T02:13:01.467 INFO:teuthology.orchestra.run.smithi153.stdout:(21/137): python3-rbd-18.2.2-1237.g646b8c7d.el8 2.5 MB/s | 364 kB 00:00 2024-04-19T02:13:01.543 INFO:teuthology.orchestra.run.smithi153.stdout:(22/137): python3-rgw-18.2.2-1237.g646b8c7d.el8 1.4 MB/s | 106 kB 00:00 2024-04-19T02:13:01.618 INFO:teuthology.orchestra.run.smithi153.stdout:(23/137): rbd-fuse-18.2.2-1237.g646b8c7d.el8.x8 1.2 MB/s | 95 kB 00:00 2024-04-19T02:13:01.651 INFO:teuthology.orchestra.run.smithi177.stdout:(8/137): ceph-osd-18.2.2-1237.g646b8c7d.el8.x86 6.1 MB/s | 18 MB 00:02 2024-04-19T02:13:01.734 INFO:teuthology.orchestra.run.smithi177.stdout:(9/137): ceph-selinux-18.2.2-1237.g646b8c7d.el8 293 kB/s | 24 kB 00:00 2024-04-19T02:13:02.027 INFO:teuthology.orchestra.run.smithi174.stdout:(1/137): ceph-18.2.2-1237.g646b8c7d.el8.x86_64. 18 kB/s | 6.4 kB 00:00 2024-04-19T02:13:02.184 INFO:teuthology.orchestra.run.smithi121.stdout:(4/137): ceph-mds-18.2.2-1237.g646b8c7d.el8.x86 2.8 MB/s | 2.3 MB 00:00 2024-04-19T02:13:02.368 INFO:teuthology.orchestra.run.smithi153.stdout:(24/137): rbd-mirror-18.2.2-1237.g646b8c7d.el8. 4.6 MB/s | 3.5 MB 00:00 2024-04-19T02:13:02.468 INFO:teuthology.orchestra.run.smithi153.stdout:(25/137): rbd-nbd-18.2.2-1237.g646b8c7d.el8.x86 1.8 MB/s | 181 kB 00:00 2024-04-19T02:13:02.577 INFO:teuthology.orchestra.run.smithi153.stdout:(26/137): ceph-grafana-dashboards-18.2.2-1237.g 225 kB/s | 24 kB 00:00 2024-04-19T02:13:02.677 INFO:teuthology.orchestra.run.smithi153.stdout:(27/137): ceph-mgr-cephadm-18.2.2-1237.g646b8c7 1.3 MB/s | 138 kB 00:00 2024-04-19T02:13:03.117 INFO:teuthology.orchestra.run.smithi121.stdout:(5/137): ceph-mgr-18.2.2-1237.g646b8c7d.el8.x86 1.7 MB/s | 1.6 MB 00:00 2024-04-19T02:13:03.628 INFO:teuthology.orchestra.run.smithi153.stdout:(28/137): ceph-mgr-dashboard-18.2.2-1237.g646b8 3.7 MB/s | 3.5 MB 00:00 2024-04-19T02:13:03.802 INFO:teuthology.orchestra.run.smithi174.stdout:(2/137): ceph-fuse-18.2.2-1237.g646b8c7d.el8.x8 484 kB/s | 859 kB 00:01 2024-04-19T02:13:04.078 INFO:teuthology.orchestra.run.smithi174.stdout:(3/137): ceph-base-18.2.2-1237.g646b8c7d.el8.x8 2.3 MB/s | 5.5 MB 00:02 2024-04-19T02:13:04.186 INFO:teuthology.orchestra.run.smithi174.stdout:(4/137): ceph-immutable-object-cache-18.2.2-123 433 kB/s | 166 kB 00:00 2024-04-19T02:13:04.995 INFO:teuthology.orchestra.run.smithi174.stdout:(5/137): ceph-mds-18.2.2-1237.g646b8c7d.el8.x86 2.5 MB/s | 2.3 MB 00:00 2024-04-19T02:13:05.161 INFO:teuthology.orchestra.run.smithi153.stdout:(29/137): librgw2-18.2.2-1237.g646b8c7d.el8.x86 1.5 MB/s | 6.6 MB 00:04 2024-04-19T02:13:05.370 INFO:teuthology.orchestra.run.smithi153.stdout:(30/137): ceph-mgr-modules-core-18.2.2-1237.g64 1.2 MB/s | 245 kB 00:00 2024-04-19T02:13:05.377 INFO:teuthology.orchestra.run.smithi121.stdout:(6/137): ceph-mon-18.2.2-1237.g646b8c7d.el8.x86 2.1 MB/s | 4.8 MB 00:02 2024-04-19T02:13:05.462 INFO:teuthology.orchestra.run.smithi153.stdout:(31/137): ceph-mgr-rook-18.2.2-1237.g646b8c7d.e 537 kB/s | 49 kB 00:00 2024-04-19T02:13:05.612 INFO:teuthology.orchestra.run.smithi153.stdout:(32/137): ceph-mgr-diskprediction-local-18.2.2- 3.7 MB/s | 7.4 MB 00:01 2024-04-19T02:13:05.625 INFO:teuthology.orchestra.run.smithi121.stdout:(7/137): ceph-common-18.2.2-1237.g646b8c7d.el8. 3.9 MB/s | 22 MB 00:05 2024-04-19T02:13:05.629 INFO:teuthology.orchestra.run.smithi153.stdout:(33/137): ceph-prometheus-alerts-18.2.2-1237.g6 91 kB/s | 15 kB 00:00 2024-04-19T02:13:05.687 INFO:teuthology.orchestra.run.smithi153.stdout:(34/137): ceph-volume-18.2.2-1237.g646b8c7d.el8 3.4 MB/s | 263 kB 00:00 2024-04-19T02:13:05.821 INFO:teuthology.orchestra.run.smithi153.stdout:(35/137): cephadm-18.2.2-1237.g646b8c7d.el8.noa 886 kB/s | 170 kB 00:00 2024-04-19T02:13:06.317 INFO:teuthology.orchestra.run.smithi121.stdout:(8/137): ceph-base-18.2.2-1237.g646b8c7d.el8.x8 910 kB/s | 5.5 MB 00:06 2024-04-19T02:13:06.363 INFO:teuthology.orchestra.run.smithi153.stdout:(36/137): automake-1.16.1-8.el8.noarch.rpm 1.1 MB/s | 740 kB 00:00 2024-04-19T02:13:06.434 INFO:teuthology.orchestra.run.smithi121.stdout:(9/137): ceph-selinux-18.2.2-1237.g646b8c7d.el8 209 kB/s | 24 kB 00:00 2024-04-19T02:13:06.470 INFO:teuthology.orchestra.run.smithi174.stdout:(6/137): ceph-mgr-18.2.2-1237.g646b8c7d.el8.x86 699 kB/s | 1.6 MB 00:02 2024-04-19T02:13:06.537 INFO:teuthology.orchestra.run.smithi174.stdout:(7/137): ceph-mon-18.2.2-1237.g646b8c7d.el8.x86 3.1 MB/s | 4.8 MB 00:01 2024-04-19T02:13:06.547 INFO:teuthology.orchestra.run.smithi153.stdout:(37/137): bison-3.0.4-10.el8.x86_64.rpm 949 kB/s | 688 kB 00:00 2024-04-19T02:13:06.572 INFO:teuthology.orchestra.run.smithi153.stdout:(38/137): flex-2.6.1-9.el8.x86_64.rpm 1.5 MB/s | 320 kB 00:00 2024-04-19T02:13:06.772 INFO:teuthology.orchestra.run.smithi153.stdout:(39/137): jq-1.6-8.el8.x86_64.rpm 902 kB/s | 203 kB 00:00 2024-04-19T02:13:07.023 INFO:teuthology.orchestra.run.smithi153.stdout:(40/137): librdkafka-1.6.1-1.el8.x86_64.rpm 1.5 MB/s | 677 kB 00:00 2024-04-19T02:13:07.209 INFO:teuthology.orchestra.run.smithi177.stdout:(10/137): ceph-radosgw-18.2.2-1237.g646b8c7d.el 1.6 MB/s | 13 MB 00:08 2024-04-19T02:13:07.248 INFO:teuthology.orchestra.run.smithi153.stdout:(41/137): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.1 MB/s | 259 kB 00:00 2024-04-19T02:13:07.309 INFO:teuthology.orchestra.run.smithi177.stdout:(11/137): libcephfs-devel-18.2.2-1237.g646b8c7d 311 kB/s | 31 kB 00:00 2024-04-19T02:13:07.626 INFO:teuthology.orchestra.run.smithi121.stdout:(10/137): ceph-radosgw-18.2.2-1237.g646b8c7d.el 6.5 MB/s | 13 MB 00:01 2024-04-19T02:13:07.690 INFO:teuthology.orchestra.run.smithi153.stdout:(42/137): ceph-test-18.2.2-1237.g646b8c7d.el8.x 5.6 MB/s | 47 MB 00:08 2024-04-19T02:13:07.693 INFO:teuthology.orchestra.run.smithi177.stdout:(12/137): libcephfs2-18.2.2-1237.g646b8c7d.el8. 2.0 MB/s | 780 kB 00:00 2024-04-19T02:13:07.715 INFO:teuthology.orchestra.run.smithi153.stdout:(43/137): libtool-2.4.6-25.el8.x86_64.rpm 752 kB/s | 709 kB 00:00 2024-04-19T02:13:07.724 INFO:teuthology.orchestra.run.smithi121.stdout:(11/137): libcephfs-devel-18.2.2-1237.g646b8c7d 315 kB/s | 31 kB 00:00 2024-04-19T02:13:07.740 INFO:teuthology.orchestra.run.smithi153.stdout:(44/137): oniguruma-6.8.2-3.el8.x86_64.rpm 382 kB/s | 188 kB 00:00 2024-04-19T02:13:07.835 INFO:teuthology.orchestra.run.smithi177.stdout:(13/137): libcephsqlite-18.2.2-1237.g646b8c7d.e 1.0 MB/s | 142 kB 00:00 2024-04-19T02:13:07.894 INFO:teuthology.orchestra.run.smithi121.stdout:(12/137): libcephfs2-18.2.2-1237.g646b8c7d.el8. 4.5 MB/s | 780 kB 00:00 2024-04-19T02:13:07.919 INFO:teuthology.orchestra.run.smithi177.stdout:(14/137): librados-devel-18.2.2-1237.g646b8c7d. 1.6 MB/s | 139 kB 00:00 2024-04-19T02:13:07.960 INFO:teuthology.orchestra.run.smithi121.stdout:(13/137): libcephsqlite-18.2.2-1237.g646b8c7d.e 2.1 MB/s | 142 kB 00:00 2024-04-19T02:13:08.027 INFO:teuthology.orchestra.run.smithi121.stdout:(14/137): librados-devel-18.2.2-1237.g646b8c7d. 2.0 MB/s | 139 kB 00:00 2024-04-19T02:13:08.172 INFO:teuthology.orchestra.run.smithi121.stdout:(15/137): libradosstriper1-18.2.2-1237.g646b8c7 3.2 MB/s | 474 kB 00:00 2024-04-19T02:13:08.194 INFO:teuthology.orchestra.run.smithi177.stdout:(15/137): libradosstriper1-18.2.2-1237.g646b8c7 1.7 MB/s | 474 kB 00:00 2024-04-19T02:13:08.545 INFO:teuthology.orchestra.run.smithi174.stdout:(8/137): ceph-common-18.2.2-1237.g646b8c7d.el8. 3.2 MB/s | 22 MB 00:06 2024-04-19T02:13:08.612 INFO:teuthology.orchestra.run.smithi174.stdout:(9/137): ceph-selinux-18.2.2-1237.g646b8c7d.el8 367 kB/s | 24 kB 00:00 2024-04-19T02:13:09.027 INFO:teuthology.orchestra.run.smithi121.stdout:(16/137): librgw2-18.2.2-1237.g646b8c7d.el8.x86 7.7 MB/s | 6.6 MB 00:00 2024-04-19T02:13:09.094 INFO:teuthology.orchestra.run.smithi121.stdout:(17/137): python3-ceph-argparse-18.2.2-1237.g64 672 kB/s | 45 kB 00:00 2024-04-19T02:13:09.161 INFO:teuthology.orchestra.run.smithi121.stdout:(18/137): python3-ceph-common-18.2.2-1237.g646b 1.9 MB/s | 129 kB 00:00 2024-04-19T02:13:09.236 INFO:teuthology.orchestra.run.smithi121.stdout:(19/137): python3-cephfs-18.2.2-1237.g646b8c7d. 2.6 MB/s | 197 kB 00:00 2024-04-19T02:13:09.330 INFO:teuthology.orchestra.run.smithi121.stdout:(20/137): python3-rados-18.2.2-1237.g646b8c7d.e 4.0 MB/s | 371 kB 00:00 2024-04-19T02:13:09.391 INFO:teuthology.orchestra.run.smithi153.stdout:(45/137): python3-babel-2.5.1-7.el8.noarch.rpm 2.9 MB/s | 4.8 MB 00:01 2024-04-19T02:13:09.412 INFO:teuthology.orchestra.run.smithi121.stdout:(21/137): python3-rbd-18.2.2-1237.g646b8c7d.el8 4.3 MB/s | 364 kB 00:00 2024-04-19T02:13:09.466 INFO:teuthology.orchestra.run.smithi153.stdout:(46/137): openblas-threads-0.3.15-4.el8.x86_64. 2.8 MB/s | 4.9 MB 00:01 2024-04-19T02:13:09.511 INFO:teuthology.orchestra.run.smithi121.stdout:(22/137): python3-rgw-18.2.2-1237.g646b8c7d.el8 1.1 MB/s | 106 kB 00:00 2024-04-19T02:13:09.566 INFO:teuthology.orchestra.run.smithi153.stdout:(47/137): python3-jsonpatch-1.21-2.el8.noarch.r 266 kB/s | 27 kB 00:00 2024-04-19T02:13:09.571 INFO:teuthology.orchestra.run.smithi121.stdout:(23/137): rbd-fuse-18.2.2-1237.g646b8c7d.el8.x8 1.6 MB/s | 95 kB 00:00 2024-04-19T02:13:09.600 INFO:teuthology.orchestra.run.smithi153.stdout:(48/137): python3-jinja2-2.10.1-4.el8.noarch.rp 2.7 MB/s | 578 kB 00:00 2024-04-19T02:13:09.601 INFO:teuthology.orchestra.run.smithi174.stdout:(10/137): ceph-radosgw-18.2.2-1237.g646b8c7d.el 4.3 MB/s | 13 MB 00:03 2024-04-19T02:13:09.667 INFO:teuthology.orchestra.run.smithi153.stdout:(49/137): python3-jsonpointer-1.10-11.el8.noarc 199 kB/s | 20 kB 00:00 2024-04-19T02:13:09.670 INFO:teuthology.orchestra.run.smithi174.stdout:(11/137): libcephfs-devel-18.2.2-1237.g646b8c7d 450 kB/s | 31 kB 00:00 2024-04-19T02:13:09.701 INFO:teuthology.orchestra.run.smithi153.stdout:(50/137): python3-mako-1.0.6-14.el8.noarch.rpm 1.5 MB/s | 157 kB 00:00 2024-04-19T02:13:09.759 INFO:teuthology.orchestra.run.smithi153.stdout:(51/137): python3-markupsafe-0.23-19.el8.x86_64 422 kB/s | 39 kB 00:00 2024-04-19T02:13:09.859 INFO:teuthology.orchestra.run.smithi153.stdout:(52/137): openblas-0.3.15-4.el8.x86_64.rpm 2.2 MB/s | 4.7 MB 00:02 2024-04-19T02:13:09.893 INFO:teuthology.orchestra.run.smithi153.stdout:(53/137): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.6 MB/s | 225 kB 00:00 2024-04-19T02:13:09.937 INFO:teuthology.orchestra.run.smithi174.stdout:(12/137): libcephfs2-18.2.2-1237.g646b8c7d.el8. 2.9 MB/s | 780 kB 00:00 2024-04-19T02:13:09.977 INFO:teuthology.orchestra.run.smithi153.stdout:(54/137): python3-prettytable-0.7.2-14.el8.noar 375 kB/s | 44 kB 00:00 2024-04-19T02:13:10.002 INFO:teuthology.orchestra.run.smithi153.stdout:(55/137): python3-pyOpenSSL-19.0.0-1.el8.noarch 953 kB/s | 103 kB 00:00 2024-04-19T02:13:10.021 INFO:teuthology.orchestra.run.smithi174.stdout:(13/137): libcephsqlite-18.2.2-1237.g646b8c7d.e 1.7 MB/s | 142 kB 00:00 2024-04-19T02:13:10.071 INFO:teuthology.orchestra.run.smithi121.stdout:(24/137): rbd-mirror-18.2.2-1237.g646b8c7d.el8. 6.9 MB/s | 3.5 MB 00:00 2024-04-19T02:13:10.077 INFO:teuthology.orchestra.run.smithi153.stdout:(56/137): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.2 MB/s | 126 kB 00:00 2024-04-19T02:13:10.089 INFO:teuthology.orchestra.run.smithi174.stdout:(14/137): librados-devel-18.2.2-1237.g646b8c7d. 2.0 MB/s | 139 kB 00:00 2024-04-19T02:13:10.094 INFO:teuthology.orchestra.run.smithi153.stdout:(57/137): python3-pyasn1-modules-0.3.7-6.el8.no 1.2 MB/s | 110 kB 00:00 2024-04-19T02:13:10.163 INFO:teuthology.orchestra.run.smithi121.stdout:(25/137): rbd-nbd-18.2.2-1237.g646b8c7d.el8.x86 1.9 MB/s | 181 kB 00:00 2024-04-19T02:13:10.178 INFO:teuthology.orchestra.run.smithi153.stdout:(58/137): python3-pytz-2017.2-11.el8.noarch.rpm 569 kB/s | 57 kB 00:00 2024-04-19T02:13:10.230 INFO:teuthology.orchestra.run.smithi121.stdout:(26/137): ceph-grafana-dashboards-18.2.2-1237.g 364 kB/s | 24 kB 00:00 2024-04-19T02:13:10.272 INFO:teuthology.orchestra.run.smithi174.stdout:(15/137): libradosstriper1-18.2.2-1237.g646b8c7 2.5 MB/s | 474 kB 00:00 2024-04-19T02:13:10.289 INFO:teuthology.orchestra.run.smithi121.stdout:(27/137): ceph-mgr-cephadm-18.2.2-1237.g646b8c7 2.3 MB/s | 138 kB 00:00 2024-04-19T02:13:10.387 INFO:teuthology.orchestra.run.smithi153.stdout:(59/137): python3-numpy-1.14.3-10.el8.x86_64.rp 5.4 MB/s | 3.7 MB 00:00 2024-04-19T02:13:10.445 INFO:teuthology.orchestra.run.smithi153.stdout:(60/137): python3-werkzeug-0.12.2-4.el8.noarch. 1.7 MB/s | 457 kB 00:00 2024-04-19T02:13:10.496 INFO:teuthology.orchestra.run.smithi153.stdout:(61/137): socat-1.7.4.1-1.el8.x86_64.rpm 2.9 MB/s | 323 kB 00:00 2024-04-19T02:13:10.546 INFO:teuthology.orchestra.run.smithi153.stdout:(62/137): xmlstarlet-1.6.1-20.el8.x86_64.rpm 700 kB/s | 71 kB 00:00 2024-04-19T02:13:10.563 INFO:teuthology.orchestra.run.smithi153.stdout:(63/137): elfutils-libelf-devel-0.190-2.el8.x86 932 kB/s | 62 kB 00:00 2024-04-19T02:13:10.613 INFO:teuthology.orchestra.run.smithi153.stdout:(64/137): fuse-2.9.7-19.el8.x86_64.rpm 1.2 MB/s | 83 kB 00:00 2024-04-19T02:13:10.630 INFO:teuthology.orchestra.run.smithi153.stdout:(65/137): keyutils-libs-devel-1.5.10-9.el8.x86_ 718 kB/s | 48 kB 00:00 2024-04-19T02:13:10.672 INFO:teuthology.orchestra.run.smithi153.stdout:(66/137): libaio-devel-0.3.112-1.el8.x86_64.rpm 451 kB/s | 19 kB 00:00 2024-04-19T02:13:10.714 INFO:teuthology.orchestra.run.smithi153.stdout:(67/137): krb5-devel-1.18.2-22.el8.x86_64.rpm 5.5 MB/s | 561 kB 00:00 2024-04-19T02:13:10.731 INFO:teuthology.orchestra.run.smithi153.stdout:(68/137): libcom_err-devel-1.45.6-5.el8.x86_64. 661 kB/s | 39 kB 00:00 2024-04-19T02:13:10.790 INFO:teuthology.orchestra.run.smithi153.stdout:(69/137): libquadmath-8.5.0-21.el8.x86_64.rpm 2.9 MB/s | 172 kB 00:00 2024-04-19T02:13:10.815 INFO:teuthology.orchestra.run.smithi153.stdout:(70/137): libgfortran-8.5.0-21.el8.x86_64.rpm 6.3 MB/s | 645 kB 00:00 2024-04-19T02:13:10.857 INFO:teuthology.orchestra.run.smithi153.stdout:(71/137): librabbitmq-0.9.0-5.el8.x86_64.rpm 704 kB/s | 47 kB 00:00 2024-04-19T02:13:10.914 INFO:teuthology.orchestra.run.smithi153.stdout:(72/137): libselinux-devel-2.9-8.el8.x86_64.rpm 2.0 MB/s | 200 kB 00:00 2024-04-19T02:13:10.932 INFO:teuthology.orchestra.run.smithi153.stdout:(73/137): libsepol-devel-2.9-3.el8.x86_64.rpm 1.1 MB/s | 87 kB 00:00 2024-04-19T02:13:10.965 INFO:teuthology.orchestra.run.smithi121.stdout:(28/137): ceph-osd-18.2.2-1237.g646b8c7d.el8.x8 3.3 MB/s | 18 MB 00:05 2024-04-19T02:13:10.975 INFO:teuthology.orchestra.run.smithi153.stdout:(74/137): libverto-devel-0.3.2-2.el8.x86_64.rpm 434 kB/s | 18 kB 00:00 2024-04-19T02:13:11.000 INFO:teuthology.orchestra.run.smithi153.stdout:(75/137): libuuid-devel-2.32.1-46.el8.x86_64.rp 1.1 MB/s | 100 kB 00:00 2024-04-19T02:13:11.014 INFO:teuthology.orchestra.run.smithi121.stdout:(29/137): ceph-mgr-dashboard-18.2.2-1237.g646b8 4.9 MB/s | 3.5 MB 00:00 2024-04-19T02:13:11.041 INFO:teuthology.orchestra.run.smithi153.stdout:(76/137): libzstd-devel-1.4.4-1.el8.x86_64.rpm 657 kB/s | 44 kB 00:00 2024-04-19T02:13:11.142 INFO:teuthology.orchestra.run.smithi153.stdout:(77/137): pcre2-devel-10.32-3.el8.x86_64.rpm 5.9 MB/s | 605 kB 00:00 2024-04-19T02:13:11.148 INFO:teuthology.orchestra.run.smithi121.stdout:(30/137): ceph-mgr-modules-core-18.2.2-1237.g64 1.8 MB/s | 245 kB 00:00 2024-04-19T02:13:11.185 INFO:teuthology.orchestra.run.smithi177.stdout:(16/137): librgw2-18.2.2-1237.g646b8c7d.el8.x86 2.2 MB/s | 6.6 MB 00:02 2024-04-19T02:13:11.206 INFO:teuthology.orchestra.run.smithi121.stdout:(31/137): ceph-mgr-rook-18.2.2-1237.g646b8c7d.e 843 kB/s | 49 kB 00:00 2024-04-19T02:13:11.225 INFO:teuthology.orchestra.run.smithi153.stdout:(78/137): openssl-devel-1.1.1k-12.el8.x86_64.rp 14 MB/s | 3.2 MB 00:00 2024-04-19T02:13:11.251 INFO:teuthology.orchestra.run.smithi153.stdout:(79/137): pcre2-utf16-10.32-3.el8.x86_64.rpm 2.1 MB/s | 229 kB 00:00 2024-04-19T02:13:11.269 INFO:teuthology.orchestra.run.smithi177.stdout:(17/137): python3-ceph-argparse-18.2.2-1237.g64 537 kB/s | 45 kB 00:00 2024-04-19T02:13:11.298 INFO:teuthology.orchestra.run.smithi121.stdout:(32/137): ceph-prometheus-alerts-18.2.2-1237.g6 166 kB/s | 15 kB 00:00 2024-04-19T02:13:11.318 INFO:teuthology.orchestra.run.smithi153.stdout:(80/137): pcre2-utf32-10.32-3.el8.x86_64.rpm 2.3 MB/s | 220 kB 00:00 2024-04-19T02:13:11.361 INFO:teuthology.orchestra.run.smithi177.stdout:(18/137): python3-ceph-common-18.2.2-1237.g646b 1.4 MB/s | 129 kB 00:00 2024-04-19T02:13:11.375 INFO:teuthology.orchestra.run.smithi153.stdout:(81/137): python3-cffi-1.11.5-6.el8.x86_64.rpm 2.0 MB/s | 249 kB 00:00 2024-04-19T02:13:11.382 INFO:teuthology.orchestra.run.smithi121.stdout:(33/137): ceph-volume-18.2.2-1237.g646b8c7d.el8 3.1 MB/s | 263 kB 00:00 2024-04-19T02:13:11.437 INFO:teuthology.orchestra.run.smithi153.stdout:(82/137): python3-cryptography-3.2.1-7.el8.x86_ 5.3 MB/s | 641 kB 00:00 2024-04-19T02:13:11.462 INFO:teuthology.orchestra.run.smithi153.stdout:(83/137): python3-jwt-1.6.1-2.el8.noarch.rpm 490 kB/s | 43 kB 00:00 2024-04-19T02:13:11.482 INFO:teuthology.orchestra.run.smithi121.stdout:(34/137): cephadm-18.2.2-1237.g646b8c7d.el8.noa 1.7 MB/s | 170 kB 00:00 2024-04-19T02:13:11.520 INFO:teuthology.orchestra.run.smithi177.stdout:(19/137): python3-cephfs-18.2.2-1237.g646b8c7d. 1.2 MB/s | 197 kB 00:00 2024-04-19T02:13:11.521 INFO:teuthology.orchestra.run.smithi153.stdout:(84/137): python3-oauthlib-2.1.0-1.el8.noarch.r 1.8 MB/s | 155 kB 00:00 2024-04-19T02:13:11.546 INFO:teuthology.orchestra.run.smithi153.stdout:(85/137): python3-pycparser-2.14-14.el8.noarch. 1.3 MB/s | 109 kB 00:00 2024-04-19T02:13:11.588 INFO:teuthology.orchestra.run.smithi153.stdout:(86/137): python3-requests-oauthlib-1.0.0-1.el8 637 kB/s | 43 kB 00:00 2024-04-19T02:13:11.613 INFO:teuthology.orchestra.run.smithi153.stdout:(87/137): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 1.1 MB/s | 74 kB 00:00 2024-04-19T02:13:11.655 INFO:teuthology.orchestra.run.smithi153.stdout:(88/137): zlib-devel-1.2.11-21.el8.x86_64.rpm 869 kB/s | 58 kB 00:00 2024-04-19T02:13:11.714 INFO:teuthology.orchestra.run.smithi174.stdout:(16/137): librgw2-18.2.2-1237.g646b8c7d.el8.x86 4.5 MB/s | 6.6 MB 00:01 2024-04-19T02:13:11.720 INFO:teuthology.orchestra.run.smithi177.stdout:(20/137): python3-rados-18.2.2-1237.g646b8c7d.e 1.8 MB/s | 371 kB 00:00 2024-04-19T02:13:11.772 INFO:teuthology.orchestra.run.smithi174.stdout:(17/137): python3-ceph-argparse-18.2.2-1237.g64 769 kB/s | 45 kB 00:00 2024-04-19T02:13:11.847 INFO:teuthology.orchestra.run.smithi174.stdout:(18/137): python3-ceph-common-18.2.2-1237.g646b 1.7 MB/s | 129 kB 00:00 2024-04-19T02:13:11.920 INFO:teuthology.orchestra.run.smithi177.stdout:(21/137): python3-rbd-18.2.2-1237.g646b8c7d.el8 1.8 MB/s | 364 kB 00:00 2024-04-19T02:13:11.922 INFO:teuthology.orchestra.run.smithi174.stdout:(19/137): python3-cephfs-18.2.2-1237.g646b8c7d. 2.6 MB/s | 197 kB 00:00 2024-04-19T02:13:11.972 INFO:teuthology.orchestra.run.smithi153.stdout:(89/137): python3-scipy-1.0.0-21.module_el8+762 7.5 MB/s | 14 MB 00:01 2024-04-19T02:13:11.997 INFO:teuthology.orchestra.run.smithi153.stdout:(90/137): python3-packaging-16.8-9.el8.noarch.r 125 kB/s | 48 kB 00:00 2024-04-19T02:13:12.012 INFO:teuthology.orchestra.run.smithi177.stdout:(22/137): python3-rgw-18.2.2-1237.g646b8c7d.el8 1.1 MB/s | 106 kB 00:00 2024-04-19T02:13:12.016 INFO:teuthology.orchestra.run.smithi121.stdout:(35/137): automake-1.16.1-8.el8.noarch.rpm 1.4 MB/s | 740 kB 00:00 2024-04-19T02:13:12.056 INFO:teuthology.orchestra.run.smithi174.stdout:(20/137): python3-rados-18.2.2-1237.g646b8c7d.e 2.7 MB/s | 371 kB 00:00 2024-04-19T02:13:12.096 INFO:teuthology.orchestra.run.smithi177.stdout:(23/137): rbd-fuse-18.2.2-1237.g646b8c7d.el8.x8 1.1 MB/s | 95 kB 00:00 2024-04-19T02:13:12.190 INFO:teuthology.orchestra.run.smithi174.stdout:(21/137): python3-rbd-18.2.2-1237.g646b8c7d.el8 2.7 MB/s | 364 kB 00:00 2024-04-19T02:13:12.201 INFO:teuthology.orchestra.run.smithi121.stdout:(36/137): bison-3.0.4-10.el8.x86_64.rpm 3.7 MB/s | 688 kB 00:00 2024-04-19T02:13:12.257 INFO:teuthology.orchestra.run.smithi174.stdout:(22/137): python3-rgw-18.2.2-1237.g646b8c7d.el8 1.6 MB/s | 106 kB 00:00 2024-04-19T02:13:12.300 INFO:teuthology.orchestra.run.smithi121.stdout:(37/137): flex-2.6.1-9.el8.x86_64.rpm 3.1 MB/s | 320 kB 00:00 2024-04-19T02:13:12.332 INFO:teuthology.orchestra.run.smithi174.stdout:(23/137): rbd-fuse-18.2.2-1237.g646b8c7d.el8.x8 1.2 MB/s | 95 kB 00:00 2024-04-19T02:13:12.400 INFO:teuthology.orchestra.run.smithi121.stdout:(38/137): jq-1.6-8.el8.x86_64.rpm 2.0 MB/s | 203 kB 00:00 2024-04-19T02:13:12.439 INFO:teuthology.orchestra.run.smithi153.stdout:(91/137): gperftools-libs-2.7-9.el8.x86_64.rpm 391 kB/s | 306 kB 00:00 2024-04-19T02:13:12.465 INFO:teuthology.orchestra.run.smithi153.stdout:(92/137): liboath-2.6.2-3.el8.x86_64.rpm 120 kB/s | 59 kB 00:00 2024-04-19T02:13:12.490 INFO:teuthology.orchestra.run.smithi153.stdout:(93/137): libunwind-1.3.1-3.el8.x86_64.rpm 152 kB/s | 75 kB 00:00 2024-04-19T02:13:12.555 INFO:teuthology.orchestra.run.smithi177.stdout:(24/137): ceph-common-18.2.2-1237.g646b8c7d.el8 1.3 MB/s | 22 MB 00:16 2024-04-19T02:13:12.576 INFO:teuthology.orchestra.run.smithi121.stdout:(39/137): ceph-mgr-diskprediction-local-18.2.2- 4.6 MB/s | 7.4 MB 00:01 2024-04-19T02:13:12.601 INFO:teuthology.orchestra.run.smithi121.stdout:(40/137): librdkafka-1.6.1-1.el8.x86_64.rpm 3.3 MB/s | 677 kB 00:00 2024-04-19T02:13:12.618 INFO:teuthology.orchestra.run.smithi153.stdout:(94/137): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 290 kB/s | 44 kB 00:00 2024-04-19T02:13:12.665 INFO:teuthology.orchestra.run.smithi153.stdout:(95/137): python3-asyncssh-2.7.0-2.el8.noarch.r 2.1 MB/s | 476 kB 00:00 2024-04-19T02:13:12.713 INFO:teuthology.orchestra.run.smithi177.stdout:(25/137): rbd-nbd-18.2.2-1237.g646b8c7d.el8.x86 1.1 MB/s | 181 kB 00:00 2024-04-19T02:13:12.718 INFO:teuthology.orchestra.run.smithi121.stdout:(41/137): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.2 MB/s | 259 kB 00:00 2024-04-19T02:13:12.774 INFO:teuthology.orchestra.run.smithi153.stdout:(96/137): python3-beautifulsoup4-4.6.3-2.el8.1. 652 kB/s | 185 kB 00:00 2024-04-19T02:13:12.788 INFO:teuthology.orchestra.run.smithi177.stdout:(26/137): ceph-grafana-dashboards-18.2.2-1237.g 324 kB/s | 24 kB 00:00 2024-04-19T02:13:12.808 INFO:teuthology.orchestra.run.smithi153.stdout:(97/137): python3-certifi-2018.10.15-7.el8.noar 115 kB/s | 16 kB 00:00 2024-04-19T02:13:12.833 INFO:teuthology.orchestra.run.smithi153.stdout:(98/137): python3-cachetools-3.1.1-4.el8.noarch 152 kB/s | 33 kB 00:00 2024-04-19T02:13:12.893 INFO:teuthology.orchestra.run.smithi121.stdout:(42/137): oniguruma-6.8.2-3.el8.x86_64.rpm 1.1 MB/s | 188 kB 00:00 2024-04-19T02:13:12.924 INFO:teuthology.orchestra.run.smithi174.stdout:(24/137): rbd-mirror-18.2.2-1237.g646b8c7d.el8. 5.8 MB/s | 3.5 MB 00:00 2024-04-19T02:13:12.925 INFO:teuthology.orchestra.run.smithi153.stdout:(99/137): python3-cheroot-8.5.2-1.el8.noarch.rp 1.1 MB/s | 173 kB 00:00 2024-04-19T02:13:12.950 INFO:teuthology.orchestra.run.smithi153.stdout:(100/137): python3-cherrypy-18.4.0-1.el8.noarch 2.6 MB/s | 384 kB 00:00 2024-04-19T02:13:12.975 INFO:teuthology.orchestra.run.smithi174.stdout:(25/137): rbd-nbd-18.2.2-1237.g646b8c7d.el8.x86 3.6 MB/s | 181 kB 00:00 2024-04-19T02:13:13.025 INFO:teuthology.orchestra.run.smithi174.stdout:(26/137): ceph-grafana-dashboards-18.2.2-1237.g 487 kB/s | 24 kB 00:00 2024-04-19T02:13:13.025 INFO:teuthology.orchestra.run.smithi153.stdout:(101/137): python3-google-auth-1.1.1-10.el8.noa 422 kB/s | 81 kB 00:00 2024-04-19T02:13:13.051 INFO:teuthology.orchestra.run.smithi153.stdout:(102/137): python3-jaraco-6.2-6.el8.noarch.rpm 88 kB/s | 11 kB 00:00 2024-04-19T02:13:13.076 INFO:teuthology.orchestra.run.smithi153.stdout:(103/137): python3-jaraco-functools-2.0-4.el8.n 140 kB/s | 18 kB 00:00 2024-04-19T02:13:13.083 INFO:teuthology.orchestra.run.smithi174.stdout:(27/137): ceph-mgr-cephadm-18.2.2-1237.g646b8c7 2.3 MB/s | 138 kB 00:00 2024-04-19T02:13:13.110 INFO:teuthology.orchestra.run.smithi121.stdout:(43/137): libtool-2.4.6-25.el8.x86_64.rpm 1.3 MB/s | 709 kB 00:00 2024-04-19T02:13:13.214 INFO:teuthology.orchestra.run.smithi177.stdout:(27/137): ceph-test-18.2.2-1237.g646b8c7d.el8.x 4.1 MB/s | 47 MB 00:11 2024-04-19T02:13:13.239 INFO:teuthology.orchestra.run.smithi177.stdout:(28/137): ceph-mgr-cephadm-18.2.2-1237.g646b8c7 307 kB/s | 138 kB 00:00 2024-04-19T02:13:13.460 INFO:teuthology.orchestra.run.smithi153.stdout:(104/137): python3-more-itertools-7.2.0-3.el8.n 153 kB/s | 59 kB 00:00 2024-04-19T02:13:13.485 INFO:teuthology.orchestra.run.smithi153.stdout:(105/137): python3-logutils-0.3.5-11.el8.noarch 112 kB/s | 49 kB 00:00 2024-04-19T02:13:13.497 INFO:teuthology.orchestra.run.smithi177.stdout:(29/137): rbd-mirror-18.2.2-1237.g646b8c7d.el8. 2.5 MB/s | 3.5 MB 00:01 2024-04-19T02:13:13.569 INFO:teuthology.orchestra.run.smithi153.stdout:(106/137): python3-natsort-7.1.1-2.el8.noarch.r 555 kB/s | 60 kB 00:00 2024-04-19T02:13:13.602 INFO:teuthology.orchestra.run.smithi121.stdout:(44/137): openblas-0.3.15-4.el8.x86_64.rpm 6.7 MB/s | 4.7 MB 00:00 2024-04-19T02:13:13.652 INFO:teuthology.orchestra.run.smithi153.stdout:(107/137): python3-kubernetes-11.0.0-6.el8.noar 1.9 MB/s | 1.2 MB 00:00 2024-04-19T02:13:13.656 INFO:teuthology.orchestra.run.smithi177.stdout:(30/137): ceph-mgr-modules-core-18.2.2-1237.g64 1.5 MB/s | 245 kB 00:00 2024-04-19T02:13:13.678 INFO:teuthology.orchestra.run.smithi153.stdout:(108/137): python3-portend-2.6-1.el8.noarch.rpm 144 kB/s | 16 kB 00:00 2024-04-19T02:13:13.720 INFO:teuthology.orchestra.run.smithi153.stdout:(109/137): python3-pecan-1.3.2-9.el8.noarch.rpm 1.2 MB/s | 283 kB 00:00 2024-04-19T02:13:13.725 INFO:teuthology.orchestra.run.smithi174.stdout:(28/137): ceph-mgr-dashboard-18.2.2-1237.g646b8 5.5 MB/s | 3.5 MB 00:00 2024-04-19T02:13:13.739 INFO:teuthology.orchestra.run.smithi177.stdout:(31/137): ceph-mgr-rook-18.2.2-1237.g646b8c7d.e 591 kB/s | 49 kB 00:00 2024-04-19T02:13:13.779 INFO:teuthology.orchestra.run.smithi153.stdout:(110/137): python3-repoze-lru-0.7-6.el8.noarch. 267 kB/s | 34 kB 00:00 2024-04-19T02:13:13.796 INFO:teuthology.orchestra.run.smithi153.stdout:(111/137): python3-routes-2.4.1-12.el8.noarch.r 1.6 MB/s | 196 kB 00:00 2024-04-19T02:13:13.831 INFO:teuthology.orchestra.run.smithi177.stdout:(32/137): ceph-prometheus-alerts-18.2.2-1237.g6 166 kB/s | 15 kB 00:00 2024-04-19T02:13:13.837 INFO:teuthology.orchestra.run.smithi153.stdout:(112/137): python3-rsa-4.9-2.el8.noarch.rpm 547 kB/s | 64 kB 00:00 2024-04-19T02:13:13.861 INFO:teuthology.orchestra.run.smithi121.stdout:(45/137): openblas-threads-0.3.15-4.el8.x86_64. 6.5 MB/s | 4.9 MB 00:00 2024-04-19T02:13:13.896 INFO:teuthology.orchestra.run.smithi153.stdout:(113/137): python3-simplegeneric-0.8.1-17.el8.n 160 kB/s | 19 kB 00:00 2024-04-19T02:13:13.913 INFO:teuthology.orchestra.run.smithi153.stdout:(114/137): python3-singledispatch-3.4.0.3-18.el 204 kB/s | 24 kB 00:00 2024-04-19T02:13:13.915 INFO:teuthology.orchestra.run.smithi177.stdout:(33/137): ceph-mgr-dashboard-18.2.2-1237.g646b8 5.0 MB/s | 3.5 MB 00:00 2024-04-19T02:13:13.947 INFO:teuthology.orchestra.run.smithi153.stdout:(115/137): python3-tempora-1.14.1-5.el8.noarch. 268 kB/s | 29 kB 00:00 2024-04-19T02:13:13.990 INFO:teuthology.orchestra.run.smithi177.stdout:(34/137): cephadm-18.2.2-1237.g646b8c7d.el8.noa 2.2 MB/s | 170 kB 00:00 2024-04-19T02:13:13.999 INFO:teuthology.orchestra.run.smithi121.stdout:(46/137): python3-jinja2-2.10.1-4.el8.noarch.rp 4.1 MB/s | 578 kB 00:00 2024-04-19T02:13:14.005 INFO:teuthology.orchestra.run.smithi153.stdout:(116/137): python3-trustme-0.6.0-4.el8.noarch.r 253 kB/s | 27 kB 00:00 2024-04-19T02:13:14.016 INFO:teuthology.orchestra.run.smithi177.stdout:(35/137): ceph-volume-18.2.2-1237.g646b8c7d.el8 1.4 MB/s | 263 kB 00:00 2024-04-19T02:13:14.039 INFO:teuthology.orchestra.run.smithi153.stdout:(117/137): python3-waitress-1.4.3-1.el8.noarch. 2.0 MB/s | 255 kB 00:00 2024-04-19T02:13:14.103 INFO:teuthology.orchestra.run.smithi121.stdout:(47/137): python3-jsonpatch-1.21-2.el8.noarch.r 257 kB/s | 27 kB 00:00 2024-04-19T02:13:14.106 INFO:teuthology.orchestra.run.smithi153.stdout:(118/137): python3-webob-1.8.5-1.el8.1.noarch.r 1.5 MB/s | 251 kB 00:00 2024-04-19T02:13:14.122 INFO:teuthology.orchestra.run.smithi153.stdout:(119/137): python3-websocket-client-0.56.0-5.el 522 kB/s | 61 kB 00:00 2024-04-19T02:13:14.140 INFO:teuthology.orchestra.run.smithi153.stdout:(120/137): python3-webtest-2.0.33-1.el8.noarch. 850 kB/s | 85 kB 00:00 2024-04-19T02:13:14.170 INFO:teuthology.orchestra.run.smithi121.stdout:(48/137): python3-babel-2.5.1-7.el8.noarch.rpm 8.4 MB/s | 4.8 MB 00:00 2024-04-19T02:13:14.195 INFO:teuthology.orchestra.run.smithi121.stdout:(49/137): python3-jsonpointer-1.10-11.el8.noarc 217 kB/s | 20 kB 00:00 2024-04-19T02:13:14.223 INFO:teuthology.orchestra.run.smithi153.stdout:(121/137): python3-zc-lockfile-2.0-2.el8.noarch 196 kB/s | 23 kB 00:00 2024-04-19T02:13:14.271 INFO:teuthology.orchestra.run.smithi121.stdout:(50/137): python3-mako-1.0.6-14.el8.noarch.rpm 1.5 MB/s | 157 kB 00:00 2024-04-19T02:13:14.296 INFO:teuthology.orchestra.run.smithi121.stdout:(51/137): python3-markupsafe-0.23-19.el8.x86_64 386 kB/s | 39 kB 00:00 2024-04-19T02:13:14.396 INFO:teuthology.orchestra.run.smithi121.stdout:(52/137): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.2 MB/s | 225 kB 00:00 2024-04-19T02:13:14.407 INFO:teuthology.orchestra.run.smithi153.stdout:(122/137): thrift-0.13.0-2.el8.x86_64.rpm 6.1 MB/s | 1.7 MB 00:00 2024-04-19T02:13:14.482 INFO:teuthology.orchestra.run.smithi153.stdout:(123/137): elfutils-debuginfod-client-0.190-2.e 1.0 MB/s | 77 kB 00:00 2024-04-19T02:13:14.496 INFO:teuthology.orchestra.run.smithi121.stdout:(53/137): python3-prettytable-0.7.2-14.el8.noar 439 kB/s | 44 kB 00:00 2024-04-19T02:13:14.549 INFO:teuthology.orchestra.run.smithi177.stdout:(36/137): automake-1.16.1-8.el8.noarch.rpm 1.3 MB/s | 740 kB 00:00 2024-04-19T02:13:14.557 INFO:teuthology.orchestra.run.smithi153.stdout:(124/137): elfutils-libelf-0.190-2.el8.x86_64.r 3.0 MB/s | 233 kB 00:00 2024-04-19T02:13:14.575 INFO:teuthology.orchestra.run.smithi177.stdout:(37/137): bison-3.0.4-10.el8.x86_64.rpm 1.2 MB/s | 688 kB 00:00 2024-04-19T02:13:14.596 INFO:teuthology.orchestra.run.smithi121.stdout:(54/137): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.0 MB/s | 103 kB 00:00 2024-04-19T02:13:14.649 INFO:teuthology.orchestra.run.smithi153.stdout:(125/137): elfutils-libs-0.190-2.el8.x86_64.rpm 3.3 MB/s | 305 kB 00:00 2024-04-19T02:13:14.650 INFO:teuthology.orchestra.run.smithi177.stdout:(38/137): flex-2.6.1-9.el8.x86_64.rpm 3.1 MB/s | 320 kB 00:00 2024-04-19T02:13:14.663 INFO:teuthology.orchestra.run.smithi121.stdout:(55/137): python3-numpy-1.14.3-10.el8.x86_64.rp 9.5 MB/s | 3.7 MB 00:00 2024-04-19T02:13:14.675 INFO:teuthology.orchestra.run.smithi177.stdout:(39/137): jq-1.6-8.el8.x86_64.rpm 2.0 MB/s | 203 kB 00:00 2024-04-19T02:13:14.722 INFO:teuthology.orchestra.run.smithi121.stdout:(56/137): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.0 MB/s | 126 kB 00:00 2024-04-19T02:13:14.724 INFO:teuthology.orchestra.run.smithi153.stdout:(126/137): libblkid-2.32.1-46.el8.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-04-19T02:13:14.773 INFO:teuthology.orchestra.run.smithi121.stdout:(57/137): python3-pyasn1-modules-0.3.7-6.el8.no 1.0 MB/s | 110 kB 00:00 2024-04-19T02:13:14.817 INFO:teuthology.orchestra.run.smithi153.stdout:(127/137): libfdisk-2.32.1-46.el8.x86_64.rpm 2.7 MB/s | 254 kB 00:00 2024-04-19T02:13:14.823 INFO:teuthology.orchestra.run.smithi121.stdout:(58/137): python3-pytz-2017.2-11.el8.noarch.rpm 567 kB/s | 57 kB 00:00 2024-04-19T02:13:14.850 INFO:teuthology.orchestra.run.smithi174.stdout:(29/137): ceph-osd-18.2.2-1237.g646b8c7d.el8.x8 2.2 MB/s | 18 MB 00:08 2024-04-19T02:13:14.876 INFO:teuthology.orchestra.run.smithi177.stdout:(40/137): librdkafka-1.6.1-1.el8.x86_64.rpm 2.9 MB/s | 677 kB 00:00 2024-04-19T02:13:14.883 INFO:teuthology.orchestra.run.smithi153.stdout:(128/137): libmount-2.32.1-46.el8.x86_64.rpm 3.5 MB/s | 237 kB 00:00 2024-04-19T02:13:14.932 INFO:teuthology.orchestra.run.smithi121.stdout:(59/137): python3-werkzeug-0.12.2-4.el8.noarch. 4.1 MB/s | 457 kB 00:00 2024-04-19T02:13:14.934 INFO:teuthology.orchestra.run.smithi177.stdout:(41/137): libtool-2.4.6-25.el8.x86_64.rpm 2.7 MB/s | 709 kB 00:00 2024-04-19T02:13:14.959 INFO:teuthology.orchestra.run.smithi153.stdout:(129/137): libsmartcols-2.32.1-46.el8.x86_64.rp 2.4 MB/s | 180 kB 00:00 2024-04-19T02:13:14.967 INFO:teuthology.orchestra.run.smithi174.stdout:(30/137): ceph-mgr-modules-core-18.2.2-1237.g64 2.1 MB/s | 245 kB 00:00 2024-04-19T02:13:14.976 INFO:teuthology.orchestra.run.smithi177.stdout:(42/137): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.5 MB/s | 259 kB 00:00 2024-04-19T02:13:15.026 INFO:teuthology.orchestra.run.smithi153.stdout:(130/137): libuuid-2.32.1-46.el8.x86_64.rpm 1.5 MB/s | 99 kB 00:00 2024-04-19T02:13:15.040 INFO:teuthology.orchestra.run.smithi121.stdout:(60/137): socat-1.7.4.1-1.el8.x86_64.rpm 2.9 MB/s | 323 kB 00:00 2024-04-19T02:13:15.043 INFO:teuthology.orchestra.run.smithi177.stdout:(43/137): oniguruma-6.8.2-3.el8.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-04-19T02:13:15.059 INFO:teuthology.orchestra.run.smithi174.stdout:(31/137): ceph-mgr-rook-18.2.2-1237.g646b8c7d.e 537 kB/s | 49 kB 00:00 2024-04-19T02:13:15.141 INFO:teuthology.orchestra.run.smithi121.stdout:(61/137): xmlstarlet-1.6.1-20.el8.x86_64.rpm 707 kB/s | 71 kB 00:00 2024-04-19T02:13:15.143 INFO:teuthology.orchestra.run.smithi153.stdout:(131/137): librados2-18.2.2-1237.g646b8c7d.el8. 3.7 MB/s | 3.7 MB 00:01 2024-04-19T02:13:15.159 INFO:teuthology.orchestra.run.smithi174.stdout:(32/137): ceph-mgr-diskprediction-local-18.2.2- 5.2 MB/s | 7.4 MB 00:01 2024-04-19T02:13:15.176 INFO:teuthology.orchestra.run.smithi174.stdout:(33/137): ceph-prometheus-alerts-18.2.2-1237.g6 130 kB/s | 15 kB 00:00 2024-04-19T02:13:15.177 INFO:teuthology.orchestra.run.smithi153.stdout:(132/137): openssl-1.1.1k-12.el8.x86_64.rpm 4.8 MB/s | 738 kB 00:00 2024-04-19T02:13:15.185 INFO:teuthology.orchestra.run.smithi177.stdout:(44/137): ceph-mgr-diskprediction-local-18.2.2- 3.8 MB/s | 7.4 MB 00:01 2024-04-19T02:13:15.199 INFO:teuthology.orchestra.run.smithi121.stdout:(62/137): elfutils-libelf-devel-0.190-2.el8.x86 1.0 MB/s | 62 kB 00:00 2024-04-19T02:13:15.235 INFO:teuthology.orchestra.run.smithi174.stdout:(34/137): cephadm-18.2.2-1237.g646b8c7d.el8.noa 2.8 MB/s | 170 kB 00:00 2024-04-19T02:13:15.250 INFO:teuthology.orchestra.run.smithi121.stdout:(63/137): fuse-2.9.7-19.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2024-04-19T02:13:15.260 INFO:teuthology.orchestra.run.smithi174.stdout:(35/137): ceph-volume-18.2.2-1237.g646b8c7d.el8 2.6 MB/s | 263 kB 00:00 2024-04-19T02:13:15.310 INFO:teuthology.orchestra.run.smithi153.stdout:(133/137): openssl-libs-1.1.1k-12.el8.x86_64.rp 8.8 MB/s | 1.5 MB 00:00 2024-04-19T02:13:15.330 INFO:teuthology.orchestra.run.smithi121.stdout:(64/137): keyutils-libs-devel-1.5.10-9.el8.x86_ 601 kB/s | 48 kB 00:00 2024-04-19T02:13:15.377 INFO:teuthology.orchestra.run.smithi153.stdout:(134/137): util-linux-2.32.1-46.el8.x86_64.rpm 13 MB/s | 2.6 MB 00:00 2024-04-19T02:13:15.394 INFO:teuthology.orchestra.run.smithi153.stdout:(135/137): util-linux-user-2.32.1-46.el8.x86_64 1.2 MB/s | 103 kB 00:00 2024-04-19T02:13:15.425 INFO:teuthology.orchestra.run.smithi121.stdout:(65/137): krb5-devel-1.18.2-22.el8.x86_64.rpm 5.8 MB/s | 561 kB 00:00 2024-04-19T02:13:15.492 INFO:teuthology.orchestra.run.smithi121.stdout:(66/137): libaio-devel-0.3.112-1.el8.x86_64.rpm 280 kB/s | 19 kB 00:00 2024-04-19T02:13:15.519 INFO:teuthology.orchestra.run.smithi153.stdout:(136/137): xfsprogs-5.0.0-12.el8.x86_64.rpm 7.6 MB/s | 1.1 MB 00:00 2024-04-19T02:13:15.550 INFO:teuthology.orchestra.run.smithi121.stdout:(67/137): libcom_err-devel-1.45.6-5.el8.x86_64. 664 kB/s | 39 kB 00:00 2024-04-19T02:13:15.752 INFO:teuthology.orchestra.run.smithi177.stdout:(45/137): openblas-0.3.15-4.el8.x86_64.rpm 6.1 MB/s | 4.7 MB 00:00 2024-04-19T02:13:15.801 INFO:teuthology.orchestra.run.smithi121.stdout:(68/137): python3-scipy-1.0.0-21.module_el8+762 14 MB/s | 14 MB 00:01 2024-04-19T02:13:15.811 INFO:teuthology.orchestra.run.smithi177.stdout:(46/137): openblas-threads-0.3.15-4.el8.x86_64. 6.3 MB/s | 4.9 MB 00:00 2024-04-19T02:13:15.834 INFO:teuthology.orchestra.run.smithi121.stdout:(69/137): libgfortran-8.5.0-21.el8.x86_64.rpm 2.2 MB/s | 645 kB 00:00 2024-04-19T02:13:15.853 INFO:teuthology.orchestra.run.smithi177.stdout:(47/137): python3-jinja2-2.10.1-4.el8.noarch.rp 5.6 MB/s | 578 kB 00:00 2024-04-19T02:13:15.868 INFO:teuthology.orchestra.run.smithi121.stdout:(70/137): libquadmath-8.5.0-21.el8.x86_64.rpm 2.5 MB/s | 172 kB 00:00 2024-04-19T02:13:15.894 INFO:teuthology.orchestra.run.smithi121.stdout:(71/137): librabbitmq-0.9.0-5.el8.x86_64.rpm 801 kB/s | 47 kB 00:00 2024-04-19T02:13:15.903 INFO:teuthology.orchestra.run.smithi177.stdout:(48/137): python3-jsonpatch-1.21-2.el8.noarch.r 289 kB/s | 27 kB 00:00 2024-04-19T02:13:15.911 INFO:teuthology.orchestra.run.smithi153.stdout:(137/137): librbd1-18.2.2-1237.g646b8c7d.el8.x8 2.1 MB/s | 3.6 MB 00:01 2024-04-19T02:13:15.917 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-04-19T02:13:15.917 INFO:teuthology.orchestra.run.smithi153.stdout:Total 10 MB/s | 207 MB 00:20 2024-04-19T02:13:15.953 INFO:teuthology.orchestra.run.smithi177.stdout:(49/137): python3-jsonpointer-1.10-11.el8.noarc 199 kB/s | 20 kB 00:00 2024-04-19T02:13:15.975 INFO:teuthology.orchestra.run.smithi121.stdout:(72/137): libselinux-devel-2.9-8.el8.x86_64.rpm 1.8 MB/s | 200 kB 00:00 2024-04-19T02:13:15.994 INFO:teuthology.orchestra.run.smithi121.stdout:(73/137): libsepol-devel-2.9-3.el8.x86_64.rpm 868 kB/s | 87 kB 00:00 2024-04-19T02:13:16.003 INFO:teuthology.orchestra.run.smithi177.stdout:(50/137): python3-mako-1.0.6-14.el8.noarch.rpm 1.5 MB/s | 157 kB 00:00 2024-04-19T02:13:16.044 INFO:teuthology.orchestra.run.smithi121.stdout:(74/137): libverto-devel-0.3.2-2.el8.x86_64.rpm 361 kB/s | 18 kB 00:00 2024-04-19T02:13:16.054 INFO:teuthology.orchestra.run.smithi177.stdout:(51/137): python3-markupsafe-0.23-19.el8.x86_64 386 kB/s | 39 kB 00:00 2024-04-19T02:13:16.069 INFO:teuthology.orchestra.run.smithi121.stdout:(75/137): libuuid-devel-2.32.1-46.el8.x86_64.rp 1.0 MB/s | 100 kB 00:00 2024-04-19T02:13:16.111 INFO:teuthology.orchestra.run.smithi174.stdout:(36/137): ceph-test-18.2.2-1237.g646b8c7d.el8.x 6.3 MB/s | 47 MB 00:07 2024-04-19T02:13:16.120 INFO:teuthology.orchestra.run.smithi121.stdout:(76/137): libzstd-devel-1.4.4-1.el8.x86_64.rpm 585 kB/s | 44 kB 00:00 2024-04-19T02:13:16.171 INFO:teuthology.orchestra.run.smithi177.stdout:(52/137): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.9 MB/s | 225 kB 00:00 2024-04-19T02:13:16.212 INFO:teuthology.orchestra.run.smithi121.stdout:(77/137): pcre2-devel-10.32-3.el8.x86_64.rpm 6.4 MB/s | 605 kB 00:00 2024-04-19T02:13:16.219 INFO:teuthology.orchestra.run.smithi174.stdout:(37/137): bison-3.0.4-10.el8.x86_64.rpm 718 kB/s | 688 kB 00:00 2024-04-19T02:13:16.279 INFO:teuthology.orchestra.run.smithi177.stdout:(53/137): python3-prettytable-0.7.2-14.el8.noar 406 kB/s | 44 kB 00:00 2024-04-19T02:13:16.294 INFO:teuthology.orchestra.run.smithi174.stdout:(38/137): automake-1.16.1-8.el8.noarch.rpm 699 kB/s | 740 kB 00:01 2024-04-19T02:13:16.303 INFO:teuthology.orchestra.run.smithi121.stdout:(78/137): openssl-devel-1.1.1k-12.el8.x86_64.rp 14 MB/s | 3.2 MB 00:00 2024-04-19T02:13:16.328 INFO:teuthology.orchestra.run.smithi174.stdout:(39/137): jq-1.6-8.el8.x86_64.rpm 1.8 MB/s | 203 kB 00:00 2024-04-19T02:13:16.329 INFO:teuthology.orchestra.run.smithi121.stdout:(79/137): pcre2-utf16-10.32-3.el8.x86_64.rpm 1.9 MB/s | 229 kB 00:00 2024-04-19T02:13:16.372 INFO:teuthology.orchestra.run.smithi177.stdout:(54/137): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.1 MB/s | 103 kB 00:00 2024-04-19T02:13:16.396 INFO:teuthology.orchestra.run.smithi121.stdout:(80/137): pcre2-utf32-10.32-3.el8.x86_64.rpm 2.3 MB/s | 220 kB 00:00 2024-04-19T02:13:16.429 INFO:teuthology.orchestra.run.smithi121.stdout:(81/137): python3-cffi-1.11.5-6.el8.x86_64.rpm 2.4 MB/s | 249 kB 00:00 2024-04-19T02:13:16.480 INFO:teuthology.orchestra.run.smithi121.stdout:(82/137): python3-jwt-1.6.1-2.el8.noarch.rpm 852 kB/s | 43 kB 00:00 2024-04-19T02:13:16.497 INFO:teuthology.orchestra.run.smithi177.stdout:(55/137): python3-numpy-1.14.3-10.el8.x86_64.rp 7.6 MB/s | 3.7 MB 00:00 2024-04-19T02:13:16.513 INFO:teuthology.orchestra.run.smithi121.stdout:(83/137): python3-cryptography-3.2.1-7.el8.x86_ 5.3 MB/s | 641 kB 00:00 2024-04-19T02:13:16.514 INFO:teuthology.orchestra.run.smithi177.stdout:(56/137): python3-pyasn1-0.3.7-6.el8.noarch.rpm 891 kB/s | 126 kB 00:00 2024-04-19T02:13:16.547 INFO:teuthology.orchestra.run.smithi121.stdout:(84/137): python3-oauthlib-2.1.0-1.el8.noarch.r 2.3 MB/s | 155 kB 00:00 2024-04-19T02:13:16.578 INFO:teuthology.orchestra.run.smithi174.stdout:(40/137): flex-2.6.1-9.el8.x86_64.rpm 684 kB/s | 320 kB 00:00 2024-04-19T02:13:16.597 INFO:teuthology.orchestra.run.smithi177.stdout:(57/137): python3-pyasn1-modules-0.3.7-6.el8.no 1.1 MB/s | 110 kB 00:00 2024-04-19T02:13:16.612 INFO:teuthology.orchestra.run.smithi174.stdout:(41/137): librdkafka-1.6.1-1.el8.x86_64.rpm 2.1 MB/s | 677 kB 00:00 2024-04-19T02:13:16.622 INFO:teuthology.orchestra.run.smithi177.stdout:(58/137): python3-pytz-2017.2-11.el8.noarch.rpm 525 kB/s | 57 kB 00:00 2024-04-19T02:13:16.639 INFO:teuthology.orchestra.run.smithi121.stdout:(85/137): python3-pycparser-2.14-14.el8.noarch. 868 kB/s | 109 kB 00:00 2024-04-19T02:13:16.664 INFO:teuthology.orchestra.run.smithi121.stdout:(86/137): python3-requests-oauthlib-1.0.0-1.el8 364 kB/s | 43 kB 00:00 2024-04-19T02:13:16.670 INFO:teuthology.orchestra.run.smithi174.stdout:(42/137): libtool-2.4.6-25.el8.x86_64.rpm 2.0 MB/s | 709 kB 00:00 2024-04-19T02:13:16.696 INFO:teuthology.orchestra.run.smithi174.stdout:(43/137): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.2 MB/s | 259 kB 00:00 2024-04-19T02:13:16.706 INFO:teuthology.orchestra.run.smithi121.stdout:(87/137): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 1.1 MB/s | 74 kB 00:00 2024-04-19T02:13:16.721 INFO:teuthology.orchestra.run.smithi174.stdout:(44/137): oniguruma-6.8.2-3.el8.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-04-19T02:13:16.732 INFO:teuthology.orchestra.run.smithi121.stdout:(88/137): zlib-devel-1.2.11-21.el8.x86_64.rpm 867 kB/s | 58 kB 00:00 2024-04-19T02:13:16.739 INFO:teuthology.orchestra.run.smithi177.stdout:(59/137): python3-werkzeug-0.12.2-4.el8.noarch. 3.8 MB/s | 457 kB 00:00 2024-04-19T02:13:16.765 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-04-19T02:13:16.815 INFO:teuthology.orchestra.run.smithi177.stdout:(60/137): python3-babel-2.5.1-7.el8.noarch.rpm 2.9 MB/s | 4.8 MB 00:01 2024-04-19T02:13:16.840 INFO:teuthology.orchestra.run.smithi177.stdout:(61/137): socat-1.7.4.1-1.el8.x86_64.rpm 3.1 MB/s | 323 kB 00:00 2024-04-19T02:13:16.899 INFO:teuthology.orchestra.run.smithi177.stdout:(62/137): elfutils-libelf-devel-0.190-2.el8.x86 1.0 MB/s | 62 kB 00:00 2024-04-19T02:13:16.924 INFO:teuthology.orchestra.run.smithi177.stdout:(63/137): xmlstarlet-1.6.1-20.el8.x86_64.rpm 649 kB/s | 71 kB 00:00 2024-04-19T02:13:16.974 INFO:teuthology.orchestra.run.smithi177.stdout:(64/137): fuse-2.9.7-19.el8.x86_64.rpm 1.1 MB/s | 83 kB 00:00 2024-04-19T02:13:16.991 INFO:teuthology.orchestra.run.smithi177.stdout:(65/137): keyutils-libs-devel-1.5.10-9.el8.x86_ 721 kB/s | 48 kB 00:00 2024-04-19T02:13:17.033 INFO:teuthology.orchestra.run.smithi177.stdout:(66/137): libaio-devel-0.3.112-1.el8.x86_64.rpm 448 kB/s | 19 kB 00:00 2024-04-19T02:13:17.075 INFO:teuthology.orchestra.run.smithi177.stdout:(67/137): krb5-devel-1.18.2-22.el8.x86_64.rpm 5.5 MB/s | 561 kB 00:00 2024-04-19T02:13:17.109 INFO:teuthology.orchestra.run.smithi177.stdout:(68/137): libcom_err-devel-1.45.6-5.el8.x86_64. 515 kB/s | 39 kB 00:00 2024-04-19T02:13:17.176 INFO:teuthology.orchestra.run.smithi177.stdout:(69/137): libquadmath-8.5.0-21.el8.x86_64.rpm 2.5 MB/s | 172 kB 00:00 2024-04-19T02:13:17.182 INFO:teuthology.orchestra.run.smithi121.stdout:(89/137): gperftools-libs-2.7-9.el8.x86_64.rpm 680 kB/s | 306 kB 00:00 2024-04-19T02:13:17.201 INFO:teuthology.orchestra.run.smithi177.stdout:(70/137): libgfortran-8.5.0-21.el8.x86_64.rpm 5.0 MB/s | 645 kB 00:00 2024-04-19T02:13:17.207 INFO:teuthology.orchestra.run.smithi121.stdout:(90/137): python3-packaging-16.8-9.el8.noarch.r 96 kB/s | 48 kB 00:00 2024-04-19T02:13:17.220 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-04-19T02:13:17.220 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-04-19T02:13:17.251 INFO:teuthology.orchestra.run.smithi177.stdout:(71/137): librabbitmq-0.9.0-5.el8.x86_64.rpm 627 kB/s | 47 kB 00:00 2024-04-19T02:13:17.254 INFO:teuthology.orchestra.run.smithi174.stdout:(45/137): openblas-threads-0.3.15-4.el8.x86_64. 8.7 MB/s | 4.9 MB 00:00 2024-04-19T02:13:17.274 INFO:teuthology.orchestra.run.smithi121.stdout:(91/137): liboath-2.6.2-3.el8.x86_64.rpm 640 kB/s | 59 kB 00:00 2024-04-19T02:13:17.285 INFO:teuthology.orchestra.run.smithi177.stdout:(72/137): libselinux-devel-2.9-8.el8.x86_64.rpm 2.3 MB/s | 200 kB 00:00 2024-04-19T02:13:17.335 INFO:teuthology.orchestra.run.smithi177.stdout:(73/137): libsepol-devel-2.9-3.el8.x86_64.rpm 1.0 MB/s | 87 kB 00:00 2024-04-19T02:13:17.361 INFO:teuthology.orchestra.run.smithi177.stdout:(74/137): libuuid-devel-2.32.1-46.el8.x86_64.rp 1.3 MB/s | 100 kB 00:00 2024-04-19T02:13:17.380 INFO:teuthology.orchestra.run.smithi174.stdout:(46/137): python3-jinja2-2.10.1-4.el8.noarch.rp 4.5 MB/s | 578 kB 00:00 2024-04-19T02:13:17.411 INFO:teuthology.orchestra.run.smithi177.stdout:(75/137): libverto-devel-0.3.2-2.el8.x86_64.rpm 240 kB/s | 18 kB 00:00 2024-04-19T02:13:17.428 INFO:teuthology.orchestra.run.smithi177.stdout:(76/137): libzstd-devel-1.4.4-1.el8.x86_64.rpm 655 kB/s | 44 kB 00:00 2024-04-19T02:13:17.472 INFO:teuthology.orchestra.run.smithi174.stdout:(47/137): python3-jsonpatch-1.21-2.el8.noarch.r 291 kB/s | 27 kB 00:00 2024-04-19T02:13:17.520 INFO:teuthology.orchestra.run.smithi177.stdout:(77/137): pcre2-devel-10.32-3.el8.x86_64.rpm 6.5 MB/s | 605 kB 00:00 2024-04-19T02:13:17.572 INFO:teuthology.orchestra.run.smithi174.stdout:(48/137): python3-jsonpointer-1.10-11.el8.noarc 199 kB/s | 20 kB 00:00 2024-04-19T02:13:17.586 INFO:teuthology.orchestra.run.smithi177.stdout:(78/137): pcre2-utf16-10.32-3.el8.x86_64.rpm 3.4 MB/s | 229 kB 00:00 2024-04-19T02:13:17.645 INFO:teuthology.orchestra.run.smithi177.stdout:(79/137): openssl-devel-1.1.1k-12.el8.x86_64.rp 14 MB/s | 3.2 MB 00:00 2024-04-19T02:13:17.673 INFO:teuthology.orchestra.run.smithi174.stdout:(49/137): python3-mako-1.0.6-14.el8.noarch.rpm 1.5 MB/s | 157 kB 00:00 2024-04-19T02:13:17.679 INFO:teuthology.orchestra.run.smithi177.stdout:(80/137): pcre2-utf32-10.32-3.el8.x86_64.rpm 2.3 MB/s | 220 kB 00:00 2024-04-19T02:13:17.742 INFO:teuthology.orchestra.run.smithi121.stdout:(92/137): ceph-test-18.2.2-1237.g646b8c7d.el8.x 4.2 MB/s | 47 MB 00:11 2024-04-19T02:13:17.758 INFO:teuthology.orchestra.run.smithi121.stdout:(93/137): libunwind-1.3.1-3.el8.x86_64.rpm 136 kB/s | 75 kB 00:00 2024-04-19T02:13:17.781 INFO:teuthology.orchestra.run.smithi174.stdout:(50/137): openblas-0.3.15-4.el8.x86_64.rpm 4.3 MB/s | 4.7 MB 00:01 2024-04-19T02:13:17.783 INFO:teuthology.orchestra.run.smithi121.stdout:(94/137): python3-asyncssh-2.7.0-2.el8.noarch.r 935 kB/s | 476 kB 00:00 2024-04-19T02:13:17.806 INFO:teuthology.orchestra.run.smithi174.stdout:(51/137): python3-markupsafe-0.23-19.el8.x86_64 291 kB/s | 39 kB 00:00 2024-04-19T02:13:17.821 INFO:teuthology.orchestra.run.smithi177.stdout:(81/137): python3-scipy-1.0.0-21.module_el8+762 12 MB/s | 14 MB 00:01 2024-04-19T02:13:17.846 INFO:teuthology.orchestra.run.smithi177.stdout:(82/137): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.2 MB/s | 249 kB 00:00 2024-04-19T02:13:17.888 INFO:teuthology.orchestra.run.smithi177.stdout:(83/137): python3-jwt-1.6.1-2.el8.noarch.rpm 641 kB/s | 43 kB 00:00 2024-04-19T02:13:17.897 INFO:teuthology.orchestra.run.smithi121.stdout:(95/137): python3-cachetools-3.1.1-4.el8.noarch 291 kB/s | 33 kB 00:00 2024-04-19T02:13:17.913 INFO:teuthology.orchestra.run.smithi177.stdout:(84/137): python3-cryptography-3.2.1-7.el8.x86_ 2.7 MB/s | 641 kB 00:00 2024-04-19T02:13:17.938 INFO:teuthology.orchestra.run.smithi177.stdout:(85/137): python3-oauthlib-2.1.0-1.el8.noarch.r 1.6 MB/s | 155 kB 00:00 2024-04-19T02:13:17.940 INFO:teuthology.orchestra.run.smithi174.stdout:(52/137): python3-babel-2.5.1-7.el8.noarch.rpm 3.9 MB/s | 4.8 MB 00:01 2024-04-19T02:13:17.965 INFO:teuthology.orchestra.run.smithi174.stdout:(53/137): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.4 MB/s | 225 kB 00:00 2024-04-19T02:13:17.972 INFO:teuthology.orchestra.run.smithi177.stdout:(86/137): python3-pycparser-2.14-14.el8.noarch. 1.3 MB/s | 109 kB 00:00 2024-04-19T02:13:17.992 INFO:teuthology.orchestra.run.smithi121.stdout:(96/137): python3-certifi-2018.10.15-7.el8.noar 172 kB/s | 16 kB 00:00 2024-04-19T02:13:17.997 INFO:teuthology.orchestra.run.smithi177.stdout:(87/137): python3-requests-oauthlib-1.0.0-1.el8 509 kB/s | 43 kB 00:00 2024-04-19T02:13:18.017 INFO:teuthology.orchestra.run.smithi121.stdout:(97/137): python3-beautifulsoup4-4.6.3-2.el8.1. 715 kB/s | 185 kB 00:00 2024-04-19T02:13:18.022 INFO:teuthology.orchestra.run.smithi177.stdout:(88/137): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 888 kB/s | 74 kB 00:00 2024-04-19T02:13:18.040 INFO:teuthology.orchestra.run.smithi174.stdout:(54/137): python3-prettytable-0.7.2-14.el8.noar 439 kB/s | 44 kB 00:00 2024-04-19T02:13:18.043 INFO:teuthology.orchestra.run.smithi121.stdout:(98/137): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 145 kB/s | 44 kB 00:00 2024-04-19T02:13:18.048 INFO:teuthology.orchestra.run.smithi177.stdout:(89/137): zlib-devel-1.2.11-21.el8.x86_64.rpm 768 kB/s | 58 kB 00:00 2024-04-19T02:13:18.066 INFO:teuthology.orchestra.run.smithi174.stdout:(55/137): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.0 MB/s | 103 kB 00:00 2024-04-19T02:13:18.093 INFO:teuthology.orchestra.run.smithi121.stdout:(99/137): python3-cheroot-8.5.2-1.el8.noarch.rp 1.7 MB/s | 173 kB 00:00 2024-04-19T02:13:18.141 INFO:teuthology.orchestra.run.smithi174.stdout:(56/137): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.2 MB/s | 126 kB 00:00 2024-04-19T02:13:18.166 INFO:teuthology.orchestra.run.smithi174.stdout:(57/137): python3-pyasn1-modules-0.3.7-6.el8.no 1.1 MB/s | 110 kB 00:00 2024-04-19T02:13:18.185 INFO:teuthology.orchestra.run.smithi121.stdout:(100/137): python3-cherrypy-18.4.0-1.el8.noarch 2.2 MB/s | 384 kB 00:00 2024-04-19T02:13:18.210 INFO:teuthology.orchestra.run.smithi121.stdout:(101/137): python3-jaraco-6.2-6.el8.noarch.rpm 95 kB/s | 11 kB 00:00 2024-04-19T02:13:18.236 INFO:teuthology.orchestra.run.smithi121.stdout:(102/137): python3-google-auth-1.1.1-10.el8.noa 422 kB/s | 81 kB 00:00 2024-04-19T02:13:18.250 INFO:teuthology.orchestra.run.smithi174.stdout:(58/137): python3-pytz-2017.2-11.el8.noarch.rpm 526 kB/s | 57 kB 00:00 2024-04-19T02:13:18.278 INFO:teuthology.orchestra.run.smithi121.stdout:(103/137): python3-jaraco-functools-2.0-4.el8.n 191 kB/s | 18 kB 00:00 2024-04-19T02:13:18.328 INFO:teuthology.orchestra.run.smithi121.stdout:(104/137): python3-logutils-0.3.5-11.el8.noarch 530 kB/s | 49 kB 00:00 2024-04-19T02:13:18.367 INFO:teuthology.orchestra.run.smithi174.stdout:(59/137): python3-werkzeug-0.12.2-4.el8.noarch. 3.8 MB/s | 457 kB 00:00 2024-04-19T02:13:18.370 INFO:teuthology.orchestra.run.smithi121.stdout:(105/137): python3-more-itertools-7.2.0-3.el8.n 639 kB/s | 59 kB 00:00 2024-04-19T02:13:18.373 INFO:teuthology.orchestra.run.smithi177.stdout:(90/137): liboath-2.6.2-3.el8.x86_64.rpm 181 kB/s | 59 kB 00:00 2024-04-19T02:13:18.404 INFO:teuthology.orchestra.run.smithi121.stdout:(106/137): python3-kubernetes-11.0.0-6.el8.noar 6.0 MB/s | 1.2 MB 00:00 2024-04-19T02:13:18.429 INFO:teuthology.orchestra.run.smithi121.stdout:(107/137): python3-natsort-7.1.1-2.el8.noarch.r 598 kB/s | 60 kB 00:00 2024-04-19T02:13:18.434 INFO:teuthology.orchestra.run.smithi174.stdout:(60/137): python3-numpy-1.14.3-10.el8.x86_64.rp 5.7 MB/s | 3.7 MB 00:00 2024-04-19T02:13:18.476 INFO:teuthology.orchestra.run.smithi174.stdout:(61/137): socat-1.7.4.1-1.el8.x86_64.rpm 2.9 MB/s | 323 kB 00:00 2024-04-19T02:13:18.534 INFO:teuthology.orchestra.run.smithi174.stdout:(62/137): elfutils-libelf-devel-0.190-2.el8.x86 1.0 MB/s | 62 kB 00:00 2024-04-19T02:13:18.540 INFO:teuthology.orchestra.run.smithi177.stdout:(91/137): python3-packaging-16.8-9.el8.noarch.r 89 kB/s | 48 kB 00:00 2024-04-19T02:13:18.546 INFO:teuthology.orchestra.run.smithi121.stdout:(108/137): python3-pecan-1.3.2-9.el8.noarch.rpm 1.6 MB/s | 283 kB 00:00 2024-04-19T02:13:18.565 INFO:teuthology.orchestra.run.smithi177.stdout:(92/137): libunwind-1.3.1-3.el8.x86_64.rpm 391 kB/s | 75 kB 00:00 2024-04-19T02:13:18.571 INFO:teuthology.orchestra.run.smithi121.stdout:(109/137): python3-portend-2.6-1.el8.noarch.rpm 93 kB/s | 16 kB 00:00 2024-04-19T02:13:18.585 INFO:teuthology.orchestra.run.smithi174.stdout:(63/137): xmlstarlet-1.6.1-20.el8.x86_64.rpm 469 kB/s | 71 kB 00:00 2024-04-19T02:13:18.622 INFO:teuthology.orchestra.run.smithi121.stdout:(110/137): python3-repoze-lru-0.7-6.el8.noarch. 175 kB/s | 34 kB 00:00 2024-04-19T02:13:18.633 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-04-19T02:13:18.635 INFO:teuthology.orchestra.run.smithi174.stdout:(64/137): fuse-2.9.7-19.el8.x86_64.rpm 831 kB/s | 83 kB 00:00 2024-04-19T02:13:18.636 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-04-19T02:13:18.660 INFO:teuthology.orchestra.run.smithi174.stdout:(65/137): keyutils-libs-devel-1.5.10-9.el8.x86_ 641 kB/s | 48 kB 00:00 2024-04-19T02:13:18.672 INFO:teuthology.orchestra.run.smithi121.stdout:(111/137): python3-routes-2.4.1-12.el8.noarch.r 1.5 MB/s | 196 kB 00:00 2024-04-19T02:13:18.691 INFO:teuthology.orchestra.run.smithi177.stdout:(93/137): gperftools-libs-2.7-9.el8.x86_64.rpm 458 kB/s | 306 kB 00:00 2024-04-19T02:13:18.706 INFO:teuthology.orchestra.run.smithi121.stdout:(112/137): python3-rsa-4.9-2.el8.noarch.rpm 478 kB/s | 64 kB 00:00 2024-04-19T02:13:18.710 INFO:teuthology.orchestra.run.smithi174.stdout:(66/137): libaio-devel-0.3.112-1.el8.x86_64.rpm 374 kB/s | 19 kB 00:00 2024-04-19T02:13:18.756 INFO:teuthology.orchestra.run.smithi121.stdout:(113/137): python3-simplegeneric-0.8.1-17.el8.n 139 kB/s | 19 kB 00:00 2024-04-19T02:13:18.762 INFO:teuthology.orchestra.run.smithi174.stdout:(67/137): krb5-devel-1.18.2-22.el8.x86_64.rpm 4.4 MB/s | 561 kB 00:00 2024-04-19T02:13:18.786 INFO:teuthology.orchestra.run.smithi174.stdout:(68/137): libcom_err-devel-1.45.6-5.el8.x86_64. 516 kB/s | 39 kB 00:00 2024-04-19T02:13:18.806 INFO:teuthology.orchestra.run.smithi121.stdout:(114/137): python3-singledispatch-3.4.0.3-18.el 178 kB/s | 24 kB 00:00 2024-04-19T02:13:18.832 INFO:teuthology.orchestra.run.smithi121.stdout:(115/137): python3-tempora-1.14.1-5.el8.noarch. 233 kB/s | 29 kB 00:00 2024-04-19T02:13:18.862 INFO:teuthology.orchestra.run.smithi174.stdout:(69/137): libquadmath-8.5.0-21.el8.x86_64.rpm 2.3 MB/s | 172 kB 00:00 2024-04-19T02:13:18.865 INFO:teuthology.orchestra.run.smithi121.stdout:(116/137): python3-trustme-0.6.0-4.el8.noarch.r 253 kB/s | 27 kB 00:00 2024-04-19T02:13:18.895 INFO:teuthology.orchestra.run.smithi174.stdout:(70/137): libgfortran-8.5.0-21.el8.x86_64.rpm 4.7 MB/s | 645 kB 00:00 2024-04-19T02:13:18.933 INFO:teuthology.orchestra.run.smithi121.stdout:(117/137): python3-waitress-1.4.3-1.el8.noarch. 2.0 MB/s | 255 kB 00:00 2024-04-19T02:13:18.945 INFO:teuthology.orchestra.run.smithi174.stdout:(71/137): librabbitmq-0.9.0-5.el8.x86_64.rpm 565 kB/s | 47 kB 00:00 2024-04-19T02:13:18.971 INFO:teuthology.orchestra.run.smithi174.stdout:(72/137): libselinux-devel-2.9-8.el8.x86_64.rpm 2.6 MB/s | 200 kB 00:00 2024-04-19T02:13:18.974 INFO:teuthology.orchestra.run.smithi121.stdout:(118/137): python3-webob-1.8.5-1.el8.1.noarch.r 1.7 MB/s | 251 kB 00:00 2024-04-19T02:13:18.999 INFO:teuthology.orchestra.run.smithi121.stdout:(119/137): python3-websocket-client-0.56.0-5.el 457 kB/s | 61 kB 00:00 2024-04-19T02:13:19.021 INFO:teuthology.orchestra.run.smithi174.stdout:(73/137): libsepol-devel-2.9-3.el8.x86_64.rpm 1.1 MB/s | 87 kB 00:00 2024-04-19T02:13:19.024 INFO:teuthology.orchestra.run.smithi177.stdout:(94/137): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 95 kB/s | 44 kB 00:00 2024-04-19T02:13:19.046 INFO:teuthology.orchestra.run.smithi174.stdout:(74/137): libuuid-devel-2.32.1-46.el8.x86_64.rp 1.3 MB/s | 100 kB 00:00 2024-04-19T02:13:19.049 INFO:teuthology.orchestra.run.smithi177.stdout:(95/137): python3-beautifulsoup4-4.6.3-2.el8.1. 517 kB/s | 185 kB 00:00 2024-04-19T02:13:19.058 INFO:teuthology.orchestra.run.smithi121.stdout:(120/137): python3-webtest-2.0.33-1.el8.noarch. 680 kB/s | 85 kB 00:00 2024-04-19T02:13:19.080 INFO:teuthology.orchestra.run.smithi174.stdout:(75/137): libverto-devel-0.3.2-2.el8.x86_64.rpm 308 kB/s | 18 kB 00:00 2024-04-19T02:13:19.083 INFO:teuthology.orchestra.run.smithi121.stdout:(121/137): python3-zc-lockfile-2.0-2.el8.noarch 211 kB/s | 23 kB 00:00 2024-04-19T02:13:19.096 INFO:teuthology.orchestra.run.smithi174.stdout:(76/137): libzstd-devel-1.4.4-1.el8.x86_64.rpm 879 kB/s | 44 kB 00:00 2024-04-19T02:13:19.133 INFO:teuthology.orchestra.run.smithi177.stdout:(96/137): python3-cachetools-3.1.1-4.el8.noarch 304 kB/s | 33 kB 00:00 2024-04-19T02:13:19.158 INFO:teuthology.orchestra.run.smithi177.stdout:(97/137): python3-certifi-2018.10.15-7.el8.noar 150 kB/s | 16 kB 00:00 2024-04-19T02:13:19.184 INFO:teuthology.orchestra.run.smithi177.stdout:(98/137): python3-asyncssh-2.7.0-2.el8.noarch.r 739 kB/s | 476 kB 00:00 2024-04-19T02:13:19.205 INFO:teuthology.orchestra.run.smithi174.stdout:(77/137): pcre2-devel-10.32-3.el8.x86_64.rpm 5.5 MB/s | 605 kB 00:00 2024-04-19T02:13:19.289 INFO:teuthology.orchestra.run.smithi174.stdout:(78/137): pcre2-utf16-10.32-3.el8.x86_64.rpm 2.7 MB/s | 229 kB 00:00 2024-04-19T02:13:19.334 INFO:teuthology.orchestra.run.smithi121.stdout:(122/137): thrift-0.13.0-2.el8.x86_64.rpm 5.2 MB/s | 1.7 MB 00:00 2024-04-19T02:13:19.339 INFO:teuthology.orchestra.run.smithi174.stdout:(79/137): openssl-devel-1.1.1k-12.el8.x86_64.rp 12 MB/s | 3.2 MB 00:00 2024-04-19T02:13:19.368 INFO:teuthology.orchestra.run.smithi177.stdout:(99/137): python3-google-auth-1.1.1-10.el8.noar 443 kB/s | 81 kB 00:00 2024-04-19T02:13:19.392 INFO:teuthology.orchestra.run.smithi121.stdout:(123/137): elfutils-debuginfod-client-0.190-2.e 1.3 MB/s | 77 kB 00:00 2024-04-19T02:13:19.393 INFO:teuthology.orchestra.run.smithi177.stdout:(100/137): python3-cheroot-8.5.2-1.el8.noarch.r 666 kB/s | 173 kB 00:00 2024-04-19T02:13:19.468 INFO:teuthology.orchestra.run.smithi121.stdout:(124/137): elfutils-libelf-0.190-2.el8.x86_64.r 3.0 MB/s | 233 kB 00:00 2024-04-19T02:13:19.476 INFO:teuthology.orchestra.run.smithi177.stdout:(101/137): python3-jaraco-6.2-6.el8.noarch.rpm 102 kB/s | 11 kB 00:00 2024-04-19T02:13:19.481 INFO:teuthology.orchestra.run.smithi174.stdout:(80/137): python3-scipy-1.0.0-21.module_el8+762 11 MB/s | 14 MB 00:01 2024-04-19T02:13:19.502 INFO:teuthology.orchestra.run.smithi177.stdout:(102/137): python3-jaraco-functools-2.0-4.el8.n 162 kB/s | 18 kB 00:00 2024-04-19T02:13:19.514 INFO:teuthology.orchestra.run.smithi174.stdout:(81/137): pcre2-utf32-10.32-3.el8.x86_64.rpm 978 kB/s | 220 kB 00:00 2024-04-19T02:13:19.548 INFO:teuthology.orchestra.run.smithi174.stdout:(82/137): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.2 MB/s | 249 kB 00:00 2024-04-19T02:13:19.568 INFO:teuthology.orchestra.run.smithi121.stdout:(125/137): librados2-18.2.2-1237.g646b8c7d.el8. 7.2 MB/s | 3.7 MB 00:00 2024-04-19T02:13:19.573 INFO:teuthology.orchestra.run.smithi174.stdout:(83/137): python3-jwt-1.6.1-2.el8.noarch.rpm 727 kB/s | 43 kB 00:00 2024-04-19T02:13:19.593 INFO:teuthology.orchestra.run.smithi121.stdout:(126/137): elfutils-libs-0.190-2.el8.x86_64.rpm 2.4 MB/s | 305 kB 00:00 2024-04-19T02:13:19.610 INFO:teuthology.orchestra.run.smithi177.stdout:(103/137): python3-logutils-0.3.5-11.el8.noarch 449 kB/s | 49 kB 00:00 2024-04-19T02:13:19.632 INFO:teuthology.orchestra.run.smithi174.stdout:(84/137): python3-cryptography-3.2.1-7.el8.x86_ 4.2 MB/s | 641 kB 00:00 2024-04-19T02:13:19.652 INFO:teuthology.orchestra.run.smithi121.stdout:(127/137): librbd1-18.2.2-1237.g646b8c7d.el8.x8 6.3 MB/s | 3.6 MB 00:00 2024-04-19T02:13:19.652 INFO:teuthology.orchestra.run.smithi177.stdout:(104/137): python3-cherrypy-18.4.0-1.el8.noarch 779 kB/s | 384 kB 00:00 2024-04-19T02:13:19.657 INFO:teuthology.orchestra.run.smithi174.stdout:(85/137): python3-pycparser-2.14-14.el8.noarch. 1.3 MB/s | 109 kB 00:00 2024-04-19T02:13:19.682 INFO:teuthology.orchestra.run.smithi174.stdout:(86/137): python3-oauthlib-2.1.0-1.el8.noarch.r 1.1 MB/s | 155 kB 00:00 2024-04-19T02:13:19.693 INFO:teuthology.orchestra.run.smithi121.stdout:(128/137): libblkid-2.32.1-46.el8.x86_64.rpm 1.7 MB/s | 221 kB 00:00 2024-04-19T02:13:19.716 INFO:teuthology.orchestra.run.smithi174.stdout:(87/137): python3-requests-oauthlib-1.0.0-1.el8 509 kB/s | 43 kB 00:00 2024-04-19T02:13:19.719 INFO:teuthology.orchestra.run.smithi177.stdout:(105/137): python3-more-itertools-7.2.0-3.el8.n 541 kB/s | 59 kB 00:00 2024-04-19T02:13:19.727 INFO:teuthology.orchestra.run.smithi121.stdout:(129/137): libfdisk-2.32.1-46.el8.x86_64.rpm 1.9 MB/s | 254 kB 00:00 2024-04-19T02:13:19.741 INFO:teuthology.orchestra.run.smithi174.stdout:(88/137): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 892 kB/s | 74 kB 00:00 2024-04-19T02:13:19.761 INFO:teuthology.orchestra.run.smithi121.stdout:(130/137): libmount-2.32.1-46.el8.x86_64.rpm 2.1 MB/s | 237 kB 00:00 2024-04-19T02:13:19.761 INFO:teuthology.orchestra.run.smithi177.stdout:(106/137): python3-natsort-7.1.1-2.el8.noarch.r 554 kB/s | 60 kB 00:00 2024-04-19T02:13:19.766 INFO:teuthology.orchestra.run.smithi174.stdout:(89/137): zlib-devel-1.2.11-21.el8.x86_64.rpm 694 kB/s | 58 kB 00:00 2024-04-19T02:13:19.778 INFO:teuthology.orchestra.run.smithi121.stdout:(131/137): libsmartcols-2.32.1-46.el8.x86_64.rp 2.1 MB/s | 180 kB 00:00 2024-04-19T02:13:19.820 INFO:teuthology.orchestra.run.smithi121.stdout:(132/137): libuuid-2.32.1-46.el8.x86_64.rpm 1.1 MB/s | 99 kB 00:00 2024-04-19T02:13:19.867 INFO:teuthology.orchestra.run.smithi174.stdout:(90/137): liboath-2.6.2-3.el8.x86_64.rpm 588 kB/s | 59 kB 00:00 2024-04-19T02:13:19.870 INFO:teuthology.orchestra.run.smithi177.stdout:(107/137): python3-portend-2.6-1.el8.noarch.rpm 144 kB/s | 16 kB 00:00 2024-04-19T02:13:19.887 INFO:teuthology.orchestra.run.smithi121.stdout:(133/137): openssl-1.1.1k-12.el8.x86_64.rpm 5.7 MB/s | 738 kB 00:00 2024-04-19T02:13:19.909 INFO:teuthology.orchestra.run.smithi174.stdout:(91/137): gperftools-libs-2.7-9.el8.x86_64.rpm 1.8 MB/s | 306 kB 00:00 2024-04-19T02:13:19.926 INFO:teuthology.orchestra.run.smithi174.stdout:(92/137): libunwind-1.3.1-3.el8.x86_64.rpm 1.3 MB/s | 75 kB 00:00 2024-04-19T02:13:19.949 INFO:teuthology.orchestra.run.smithi121.stdout:(134/137): openssl-libs-1.1.1k-12.el8.x86_64.rp 8.6 MB/s | 1.5 MB 00:00 2024-04-19T02:13:19.968 INFO:teuthology.orchestra.run.smithi174.stdout:(93/137): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 1.0 MB/s | 44 kB 00:00 2024-04-19T02:13:19.994 INFO:teuthology.orchestra.run.smithi174.stdout:(94/137): python3-asyncssh-2.7.0-2.el8.noarch.r 5.5 MB/s | 476 kB 00:00 2024-04-19T02:13:20.012 INFO:teuthology.orchestra.run.smithi121.stdout:(135/137): util-linux-user-2.32.1-46.el8.x86_64 822 kB/s | 103 kB 00:00 2024-04-19T02:13:20.027 INFO:teuthology.orchestra.run.smithi174.stdout:(95/137): python3-beautifulsoup4-4.6.3-2.el8.1. 3.1 MB/s | 185 kB 00:00 2024-04-19T02:13:20.028 INFO:teuthology.orchestra.run.smithi177.stdout:(108/137): python3-repoze-lru-0.7-6.el8.noarch. 212 kB/s | 34 kB 00:00 2024-04-19T02:13:20.052 INFO:teuthology.orchestra.run.smithi174.stdout:(96/137): python3-cachetools-3.1.1-4.el8.noarch 565 kB/s | 33 kB 00:00 2024-04-19T02:13:20.077 INFO:teuthology.orchestra.run.smithi174.stdout:(97/137): python3-certifi-2018.10.15-7.el8.noar 325 kB/s | 16 kB 00:00 2024-04-19T02:13:20.096 INFO:teuthology.orchestra.run.smithi121.stdout:(136/137): util-linux-2.32.1-46.el8.x86_64.rpm 9.4 MB/s | 2.6 MB 00:00 2024-04-19T02:13:20.103 INFO:teuthology.orchestra.run.smithi174.stdout:(98/137): python3-cheroot-8.5.2-1.el8.noarch.rp 3.4 MB/s | 173 kB 00:00 2024-04-19T02:13:20.121 INFO:teuthology.orchestra.run.smithi177.stdout:(109/137): python3-pecan-1.3.2-9.el8.noarch.rpm 705 kB/s | 283 kB 00:00 2024-04-19T02:13:20.129 INFO:teuthology.orchestra.run.smithi121.stdout:(137/137): xfsprogs-5.0.0-12.el8.x86_64.rpm 6.0 MB/s | 1.1 MB 00:00 2024-04-19T02:13:20.132 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2024-04-19T02:13:20.132 INFO:teuthology.orchestra.run.smithi121.stdout:Total 10 MB/s | 207 MB 00:20 2024-04-19T02:13:20.136 INFO:teuthology.orchestra.run.smithi174.stdout:(99/137): python3-cherrypy-18.4.0-1.el8.noarch. 6.4 MB/s | 384 kB 00:00 2024-04-19T02:13:20.162 INFO:teuthology.orchestra.run.smithi174.stdout:(100/137): python3-google-auth-1.1.1-10.el8.noa 1.4 MB/s | 81 kB 00:00 2024-04-19T02:13:20.187 INFO:teuthology.orchestra.run.smithi174.stdout:(101/137): python3-jaraco-6.2-6.el8.noarch.rpm 221 kB/s | 11 kB 00:00 2024-04-19T02:13:20.212 INFO:teuthology.orchestra.run.smithi174.stdout:(102/137): python3-jaraco-functools-2.0-4.el8.n 351 kB/s | 18 kB 00:00 2024-04-19T02:13:20.237 INFO:teuthology.orchestra.run.smithi174.stdout:(103/137): python3-packaging-16.8-9.el8.noarch. 92 kB/s | 48 kB 00:00 2024-04-19T02:13:20.238 INFO:teuthology.orchestra.run.smithi177.stdout:(110/137): python3-rsa-4.9-2.el8.noarch.rpm 551 kB/s | 64 kB 00:00 2024-04-19T02:13:20.262 INFO:teuthology.orchestra.run.smithi174.stdout:(104/137): python3-logutils-0.3.5-11.el8.noarch 968 kB/s | 49 kB 00:00 2024-04-19T02:13:20.296 INFO:teuthology.orchestra.run.smithi174.stdout:(105/137): python3-kubernetes-11.0.0-6.el8.noar 11 MB/s | 1.2 MB 00:00 2024-04-19T02:13:20.297 INFO:teuthology.orchestra.run.smithi177.stdout:(111/137): python3-routes-2.4.1-12.el8.noarch.r 735 kB/s | 196 kB 00:00 2024-04-19T02:13:20.321 INFO:teuthology.orchestra.run.smithi174.stdout:(106/137): python3-natsort-7.1.1-2.el8.noarch.r 1.0 MB/s | 60 kB 00:00 2024-04-19T02:13:20.338 INFO:teuthology.orchestra.run.smithi177.stdout:(112/137): python3-simplegeneric-0.8.1-17.el8.n 187 kB/s | 19 kB 00:00 2024-04-19T02:13:20.347 INFO:teuthology.orchestra.run.smithi174.stdout:(107/137): python3-more-itertools-7.2.0-3.el8.n 538 kB/s | 59 kB 00:00 2024-04-19T02:13:20.372 INFO:teuthology.orchestra.run.smithi174.stdout:(108/137): python3-portend-2.6-1.el8.noarch.rpm 311 kB/s | 16 kB 00:00 2024-04-19T02:13:20.388 INFO:teuthology.orchestra.run.smithi177.stdout:(113/137): python3-singledispatch-3.4.0.3-18.el 260 kB/s | 24 kB 00:00 2024-04-19T02:13:20.397 INFO:teuthology.orchestra.run.smithi174.stdout:(109/137): python3-repoze-lru-0.7-6.el8.noarch. 671 kB/s | 34 kB 00:00 2024-04-19T02:13:20.431 INFO:teuthology.orchestra.run.smithi174.stdout:(110/137): python3-pecan-1.3.2-9.el8.noarch.rpm 2.1 MB/s | 283 kB 00:00 2024-04-19T02:13:20.447 INFO:teuthology.orchestra.run.smithi177.stdout:(114/137): python3-tempora-1.14.1-5.el8.noarch. 269 kB/s | 29 kB 00:00 2024-04-19T02:13:20.484 INFO:teuthology.orchestra.run.smithi174.stdout:(111/137): python3-rsa-4.9-2.el8.noarch.rpm 744 kB/s | 64 kB 00:00 2024-04-19T02:13:20.489 INFO:teuthology.orchestra.run.smithi177.stdout:(115/137): python3-trustme-0.6.0-4.el8.noarch.r 275 kB/s | 27 kB 00:00 2024-04-19T02:13:20.515 INFO:teuthology.orchestra.run.smithi174.stdout:(112/137): python3-simplegeneric-0.8.1-17.el8.n 224 kB/s | 19 kB 00:00 2024-04-19T02:13:20.523 INFO:teuthology.orchestra.run.smithi177.stdout:(116/137): python3-kubernetes-11.0.0-6.el8.noar 1.1 MB/s | 1.2 MB 00:01 2024-04-19T02:13:20.540 INFO:teuthology.orchestra.run.smithi174.stdout:(113/137): python3-routes-2.4.1-12.el8.noarch.r 1.1 MB/s | 196 kB 00:00 2024-04-19T02:13:20.565 INFO:teuthology.orchestra.run.smithi174.stdout:(114/137): python3-singledispatch-3.4.0.3-18.el 295 kB/s | 24 kB 00:00 2024-04-19T02:13:20.590 INFO:teuthology.orchestra.run.smithi174.stdout:(115/137): python3-tempora-1.14.1-5.el8.noarch. 387 kB/s | 29 kB 00:00 2024-04-19T02:13:20.616 INFO:teuthology.orchestra.run.smithi174.stdout:(116/137): python3-trustme-0.6.0-4.el8.noarch.r 550 kB/s | 27 kB 00:00 2024-04-19T02:13:20.631 INFO:teuthology.orchestra.run.smithi177.stdout:(117/137): python3-websocket-client-0.56.0-5.el 565 kB/s | 61 kB 00:00 2024-04-19T02:13:20.641 INFO:teuthology.orchestra.run.smithi174.stdout:(117/137): python3-waitress-1.4.3-1.el8.noarch. 3.3 MB/s | 255 kB 00:00 2024-04-19T02:13:20.656 INFO:teuthology.orchestra.run.smithi177.stdout:(118/137): python3-waitress-1.4.3-1.el8.noarch. 1.2 MB/s | 255 kB 00:00 2024-04-19T02:13:20.666 INFO:teuthology.orchestra.run.smithi174.stdout:(118/137): python3-webob-1.8.5-1.el8.1.noarch.r 3.3 MB/s | 251 kB 00:00 2024-04-19T02:13:20.683 INFO:teuthology.orchestra.run.smithi174.stdout:(119/137): python3-websocket-client-0.56.0-5.el 914 kB/s | 61 kB 00:00 2024-04-19T02:13:20.700 INFO:teuthology.orchestra.run.smithi174.stdout:(120/137): python3-zc-lockfile-2.0-2.el8.noarch 685 kB/s | 23 kB 00:00 2024-04-19T02:13:20.725 INFO:teuthology.orchestra.run.smithi174.stdout:(121/137): python3-webtest-2.0.33-1.el8.noarch. 1.0 MB/s | 85 kB 00:00 2024-04-19T02:13:20.740 INFO:teuthology.orchestra.run.smithi177.stdout:(119/137): python3-webtest-2.0.33-1.el8.noarch. 786 kB/s | 85 kB 00:00 2024-04-19T02:13:20.757 INFO:teuthology.orchestra.run.smithi177.stdout:(120/137): python3-zc-lockfile-2.0-2.el8.noarch 229 kB/s | 23 kB 00:00 2024-04-19T02:13:20.774 INFO:teuthology.orchestra.run.smithi177.stdout:(121/137): python3-webob-1.8.5-1.el8.1.noarch.r 882 kB/s | 251 kB 00:00 2024-04-19T02:13:20.801 INFO:teuthology.orchestra.run.smithi174.stdout:(122/137): thrift-0.13.0-2.el8.x86_64.rpm 15 MB/s | 1.7 MB 00:00 2024-04-19T02:13:20.859 INFO:teuthology.orchestra.run.smithi174.stdout:(123/137): elfutils-debuginfod-client-0.190-2.e 1.3 MB/s | 77 kB 00:00 2024-04-19T02:13:20.935 INFO:teuthology.orchestra.run.smithi174.stdout:(124/137): elfutils-libelf-0.190-2.el8.x86_64.r 3.0 MB/s | 233 kB 00:00 2024-04-19T02:13:20.966 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2024-04-19T02:13:21.077 INFO:teuthology.orchestra.run.smithi174.stdout:(125/137): elfutils-libs-0.190-2.el8.x86_64.rpm 2.1 MB/s | 305 kB 00:00 2024-04-19T02:13:21.177 INFO:teuthology.orchestra.run.smithi174.stdout:(126/137): libblkid-2.32.1-46.el8.x86_64.rpm 2.2 MB/s | 221 kB 00:00 2024-04-19T02:13:21.266 INFO:teuthology.orchestra.run.smithi177.stdout:(122/137): librados2-18.2.2-1237.g646b8c7d.el8. 7.3 MB/s | 3.7 MB 00:00 2024-04-19T02:13:21.277 INFO:teuthology.orchestra.run.smithi174.stdout:(127/137): librbd1-18.2.2-1237.g646b8c7d.el8.x8 6.5 MB/s | 3.6 MB 00:00 2024-04-19T02:13:21.302 INFO:teuthology.orchestra.run.smithi174.stdout:(128/137): libfdisk-2.32.1-46.el8.x86_64.rpm 2.0 MB/s | 254 kB 00:00 2024-04-19T02:13:21.366 INFO:teuthology.orchestra.run.smithi177.stdout:(123/137): elfutils-debuginfod-client-0.190-2.e 769 kB/s | 77 kB 00:00 2024-04-19T02:13:21.394 INFO:teuthology.orchestra.run.smithi174.stdout:(129/137): librados2-18.2.2-1237.g646b8c7d.el8. 5.3 MB/s | 3.7 MB 00:00 2024-04-19T02:13:21.419 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2024-04-19T02:13:21.419 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2024-04-19T02:13:21.420 INFO:teuthology.orchestra.run.smithi174.stdout:(130/137): libmount-2.32.1-46.el8.x86_64.rpm 1.6 MB/s | 237 kB 00:00 2024-04-19T02:13:21.445 INFO:teuthology.orchestra.run.smithi174.stdout:(131/137): libsmartcols-2.32.1-46.el8.x86_64.rp 1.2 MB/s | 180 kB 00:00 2024-04-19T02:13:21.450 INFO:teuthology.orchestra.run.smithi177.stdout:(124/137): elfutils-libelf-0.190-2.el8.x86_64.r 2.7 MB/s | 233 kB 00:00 2024-04-19T02:13:21.479 INFO:teuthology.orchestra.run.smithi174.stdout:(132/137): libuuid-2.32.1-46.el8.x86_64.rpm 1.2 MB/s | 99 kB 00:00 2024-04-19T02:13:21.492 INFO:teuthology.orchestra.run.smithi177.stdout:(125/137): thrift-0.13.0-2.el8.x86_64.rpm 2.3 MB/s | 1.7 MB 00:00 2024-04-19T02:13:21.567 INFO:teuthology.orchestra.run.smithi177.stdout:(126/137): elfutils-libs-0.190-2.el8.x86_64.rpm 2.5 MB/s | 305 kB 00:00 2024-04-19T02:13:21.570 INFO:teuthology.orchestra.run.smithi174.stdout:(133/137): openssl-1.1.1k-12.el8.x86_64.rpm 4.8 MB/s | 738 kB 00:00 2024-04-19T02:13:21.593 INFO:teuthology.orchestra.run.smithi177.stdout:(127/137): libblkid-2.32.1-46.el8.x86_64.rpm 2.2 MB/s | 221 kB 00:00 2024-04-19T02:13:21.654 INFO:teuthology.orchestra.run.smithi174.stdout:(134/137): util-linux-user-2.32.1-46.el8.x86_64 1.2 MB/s | 103 kB 00:00 2024-04-19T02:13:21.659 INFO:teuthology.orchestra.run.smithi177.stdout:(128/137): librbd1-18.2.2-1237.g646b8c7d.el8.x8 4.0 MB/s | 3.6 MB 00:00 2024-04-19T02:13:21.710 INFO:teuthology.orchestra.run.smithi177.stdout:(129/137): libfdisk-2.32.1-46.el8.x86_64.rpm 1.7 MB/s | 254 kB 00:00 2024-04-19T02:13:21.712 INFO:teuthology.orchestra.run.smithi174.stdout:(135/137): openssl-libs-1.1.1k-12.el8.x86_64.rp 5.5 MB/s | 1.5 MB 00:00 2024-04-19T02:13:21.735 INFO:teuthology.orchestra.run.smithi177.stdout:(130/137): libmount-2.32.1-46.el8.x86_64.rpm 1.6 MB/s | 237 kB 00:00 2024-04-19T02:13:21.769 INFO:teuthology.orchestra.run.smithi177.stdout:(131/137): libsmartcols-2.32.1-46.el8.x86_64.rp 1.6 MB/s | 180 kB 00:00 2024-04-19T02:13:21.794 INFO:teuthology.orchestra.run.smithi177.stdout:(132/137): libuuid-2.32.1-46.el8.x86_64.rpm 1.2 MB/s | 99 kB 00:00 2024-04-19T02:13:21.829 INFO:teuthology.orchestra.run.smithi174.stdout:(136/137): util-linux-2.32.1-46.el8.x86_64.rpm 7.4 MB/s | 2.6 MB 00:00 2024-04-19T02:13:21.878 INFO:teuthology.orchestra.run.smithi177.stdout:(133/137): openssl-1.1.1k-12.el8.x86_64.rpm 5.1 MB/s | 738 kB 00:00 2024-04-19T02:13:21.921 INFO:teuthology.orchestra.run.smithi174.stdout:(137/137): xfsprogs-5.0.0-12.el8.x86_64.rpm 4.1 MB/s | 1.1 MB 00:00 2024-04-19T02:13:21.925 INFO:teuthology.orchestra.run.smithi174.stdout:-------------------------------------------------------------------------------- 2024-04-19T02:13:21.925 INFO:teuthology.orchestra.run.smithi174.stdout:Total 10 MB/s | 207 MB 00:20 2024-04-19T02:13:21.944 INFO:teuthology.orchestra.run.smithi177.stdout:(134/137): util-linux-user-2.32.1-46.el8.x86_64 1.5 MB/s | 103 kB 00:00 2024-04-19T02:13:21.995 INFO:teuthology.orchestra.run.smithi177.stdout:(135/137): openssl-libs-1.1.1k-12.el8.x86_64.rp 6.5 MB/s | 1.5 MB 00:00 2024-04-19T02:13:22.062 INFO:teuthology.orchestra.run.smithi177.stdout:(136/137): util-linux-2.32.1-46.el8.x86_64.rpm 9.7 MB/s | 2.6 MB 00:00 2024-04-19T02:13:22.153 INFO:teuthology.orchestra.run.smithi177.stdout:(137/137): xfsprogs-5.0.0-12.el8.x86_64.rpm 5.2 MB/s | 1.1 MB 00:00 2024-04-19T02:13:22.157 INFO:teuthology.orchestra.run.smithi177.stdout:-------------------------------------------------------------------------------- 2024-04-19T02:13:22.157 INFO:teuthology.orchestra.run.smithi177.stdout:Total 7.7 MB/s | 207 MB 00:26 2024-04-19T02:13:22.772 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction check 2024-04-19T02:13:22.793 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2024-04-19T02:13:22.797 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2024-04-19T02:13:23.005 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction check 2024-04-19T02:13:23.220 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction check succeeded. 2024-04-19T02:13:23.221 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction test 2024-04-19T02:13:23.459 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction check succeeded. 2024-04-19T02:13:23.459 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction test 2024-04-19T02:13:23.883 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-04-19T02:13:24.155 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/1 2024-04-19T02:13:24.355 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8.x86_64 1/152 2024-04-19T02:13:24.601 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/152 2024-04-19T02:13:24.608 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction test succeeded. 2024-04-19T02:13:24.611 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction 2024-04-19T02:13:24.820 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/152 2024-04-19T02:13:24.850 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction test succeeded. 2024-04-19T02:13:24.853 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction 2024-04-19T02:13:25.001 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : libuuid-2.32.1-46.el8.x86_64 3/152 2024-04-19T02:13:25.068 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libuuid-2.32.1-46.el8.x86_64 3/152 2024-04-19T02:13:25.251 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : libblkid-2.32.1-46.el8.x86_64 4/152 2024-04-19T02:13:25.310 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libblkid-2.32.1-46.el8.x86_64 4/152 2024-04-19T02:13:25.568 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/152 2024-04-19T02:13:25.716 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 6/152 2024-04-19T02:13:25.945 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 7/152 2024-04-19T02:13:26.100 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/152 2024-04-19T02:13:26.503 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/152 2024-04-19T02:13:26.710 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : librados2-2:18.2.2-1237.g646b8c7d.el8.x86_64 9/152 2024-04-19T02:13:27.132 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librados2-2:18.2.2-1237.g646b8c7d.el8.x86_64 9/152 2024-04-19T02:13:27.325 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : librbd1-2:18.2.2-1237.g646b8c7d.el8.x86_64 10/152 2024-04-19T02:13:27.440 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librbd1-2:18.2.2-1237.g646b8c7d.el8.x86_64 10/152 2024-04-19T02:13:27.617 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephfs2-2:18.2.2-1237.g646b8c7d.el8.x86_64 11/152 2024-04-19T02:13:27.709 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libcephfs2-2:18.2.2-1237.g646b8c7d.el8.x86_64 11/152 2024-04-19T02:13:27.884 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2024-04-19T02:13:27.948 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rados-2:18.2.2-1237.g646b8c7d.el8.x86_64 12/152 2024-04-19T02:13:28.065 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/1 2024-04-19T02:13:28.153 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : elfutils-libelf-0.190-2.el8.x86_64 13/152 2024-04-19T02:13:28.244 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8.x86_64 1/152 2024-04-19T02:13:28.379 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/152 2024-04-19T02:13:28.477 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/152 2024-04-19T02:13:28.563 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/152 2024-04-19T02:13:28.742 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephsqlite-2:18.2.2-1237.g646b8c7d.el8.x86_64 16/152 2024-04-19T02:13:28.838 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1237.g646b8c7d.el8.x86_64 16/152 2024-04-19T02:13:28.886 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/152 2024-04-19T02:13:28.975 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libradosstriper1-2:18.2.2-1237.g646b8c7d.el8.x86 17/152 2024-04-19T02:13:29.055 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : libuuid-2.32.1-46.el8.x86_64 3/152 2024-04-19T02:13:29.148 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libuuid-2.32.1-46.el8.x86_64 3/152 2024-04-19T02:13:29.166 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1237.g646b8c7d.el8.x86 17/152 2024-04-19T02:13:29.354 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : libblkid-2.32.1-46.el8.x86_64 4/152 2024-04-19T02:13:29.433 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 18/152 2024-04-19T02:13:29.436 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libblkid-2.32.1-46.el8.x86_64 4/152 2024-04-19T02:13:29.548 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 18/152 2024-04-19T02:13:29.674 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/152 2024-04-19T02:13:29.773 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 19/152 2024-04-19T02:13:29.808 INFO:teuthology.orchestra.run.smithi174.stdout: Preparing : 1/1 2024-04-19T02:13:29.852 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 6/152 2024-04-19T02:13:29.951 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 20/152 2024-04-19T02:13:29.962 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/1 2024-04-19T02:13:30.075 INFO:teuthology.orchestra.run.smithi177.stdout: Preparing : 1/1 2024-04-19T02:13:30.076 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 7/152 2024-04-19T02:13:30.134 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 21/152 2024-04-19T02:13:30.213 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8.x86_64 1/152 2024-04-19T02:13:30.236 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/1 2024-04-19T02:13:30.238 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/152 2024-04-19T02:13:30.259 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 21/152 2024-04-19T02:13:30.417 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 22/152 2024-04-19T02:13:30.440 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8.x86_64 1/152 2024-04-19T02:13:30.450 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/152 2024-04-19T02:13:30.627 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/152 2024-04-19T02:13:30.665 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/152 2024-04-19T02:13:30.668 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/152 2024-04-19T02:13:30.821 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : libuuid-2.32.1-46.el8.x86_64 3/152 2024-04-19T02:13:30.838 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : librados2-2:18.2.2-1237.g646b8c7d.el8.x86_64 9/152 2024-04-19T02:13:30.903 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libuuid-2.32.1-46.el8.x86_64 3/152 2024-04-19T02:13:30.929 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/152 2024-04-19T02:13:31.013 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 22/152 2024-04-19T02:13:31.072 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : libuuid-2.32.1-46.el8.x86_64 3/152 2024-04-19T02:13:31.087 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : libblkid-2.32.1-46.el8.x86_64 4/152 2024-04-19T02:13:31.134 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libuuid-2.32.1-46.el8.x86_64 3/152 2024-04-19T02:13:31.168 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libblkid-2.32.1-46.el8.x86_64 4/152 2024-04-19T02:13:31.200 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : openblas-0.3.15-4.el8.x86_64 23/152 2024-04-19T02:13:31.232 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librados2-2:18.2.2-1237.g646b8c7d.el8.x86_64 9/152 2024-04-19T02:13:31.331 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : libblkid-2.32.1-46.el8.x86_64 4/152 2024-04-19T02:13:31.402 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libblkid-2.32.1-46.el8.x86_64 4/152 2024-04-19T02:13:31.445 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : librbd1-2:18.2.2-1237.g646b8c7d.el8.x86_64 10/152 2024-04-19T02:13:31.566 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/152 2024-04-19T02:13:31.568 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librbd1-2:18.2.2-1237.g646b8c7d.el8.x86_64 10/152 2024-04-19T02:13:31.623 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/152 2024-04-19T02:13:31.743 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 6/152 2024-04-19T02:13:31.754 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libcephfs2-2:18.2.2-1237.g646b8c7d.el8.x86_64 11/152 2024-04-19T02:13:31.810 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 23/152 2024-04-19T02:13:31.836 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 6/152 2024-04-19T02:13:31.838 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libcephfs2-2:18.2.2-1237.g646b8c7d.el8.x86_64 11/152 2024-04-19T02:13:31.943 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 7/152 2024-04-19T02:13:32.008 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 24/152 2024-04-19T02:13:32.058 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 7/152 2024-04-19T02:13:32.093 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rados-2:18.2.2-1237.g646b8c7d.el8.x86_64 12/152 2024-04-19T02:13:32.154 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/152 2024-04-19T02:13:32.222 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/152 2024-04-19T02:13:32.299 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : elfutils-libelf-0.190-2.el8.x86_64 13/152 2024-04-19T02:13:32.517 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/152 2024-04-19T02:13:32.561 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/152 2024-04-19T02:13:32.619 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/152 2024-04-19T02:13:32.705 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 24/152 2024-04-19T02:13:32.750 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/152 2024-04-19T02:13:32.770 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : librados2-2:18.2.2-1237.g646b8c7d.el8.x86_64 9/152 2024-04-19T02:13:32.839 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : librados2-2:18.2.2-1237.g646b8c7d.el8.x86_64 9/152 2024-04-19T02:13:32.879 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libcephsqlite-2:18.2.2-1237.g646b8c7d.el8.x86_64 16/152 2024-04-19T02:13:32.967 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1237.g646b8c7d.el8.x86_64 16/152 2024-04-19T02:13:33.033 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/152 2024-04-19T02:13:33.095 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libradosstriper1-2:18.2.2-1237.g646b8c7d.el8.x86 17/152 2024-04-19T02:13:33.163 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librados2-2:18.2.2-1237.g646b8c7d.el8.x86_64 9/152 2024-04-19T02:13:33.229 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librados2-2:18.2.2-1237.g646b8c7d.el8.x86_64 9/152 2024-04-19T02:13:33.238 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 26/152 2024-04-19T02:13:33.269 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1237.g646b8c7d.el8.x86 17/152 2024-04-19T02:13:33.370 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : librbd1-2:18.2.2-1237.g646b8c7d.el8.x86_64 10/152 2024-04-19T02:13:33.420 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 27/152 2024-04-19T02:13:33.422 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : librbd1-2:18.2.2-1237.g646b8c7d.el8.x86_64 10/152 2024-04-19T02:13:33.499 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librbd1-2:18.2.2-1237.g646b8c7d.el8.x86_64 10/152 2024-04-19T02:13:33.530 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librbd1-2:18.2.2-1237.g646b8c7d.el8.x86_64 10/152 2024-04-19T02:13:33.537 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 18/152 2024-04-19T02:13:33.618 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/152 2024-04-19T02:13:33.649 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 18/152 2024-04-19T02:13:33.662 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libcephfs2-2:18.2.2-1237.g646b8c7d.el8.x86_64 11/152 2024-04-19T02:13:33.738 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libcephfs2-2:18.2.2-1237.g646b8c7d.el8.x86_64 11/152 2024-04-19T02:13:33.761 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libcephfs2-2:18.2.2-1237.g646b8c7d.el8.x86_64 11/152 2024-04-19T02:13:33.844 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libcephfs2-2:18.2.2-1237.g646b8c7d.el8.x86_64 11/152 2024-04-19T02:13:33.847 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-ceph-common-2:18.2.2-1237.g646b8c7d.el8. 29/152 2024-04-19T02:13:33.884 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 19/152 2024-04-19T02:13:34.016 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rados-2:18.2.2-1237.g646b8c7d.el8.x86_64 12/152 2024-04-19T02:13:34.038 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-ceph-argparse-2:18.2.2-1237.g646b8c7d.el 30/152 2024-04-19T02:13:34.064 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-rados-2:18.2.2-1237.g646b8c7d.el8.x86_64 12/152 2024-04-19T02:13:34.096 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 20/152 2024-04-19T02:13:34.206 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : elfutils-libelf-0.190-2.el8.x86_64 13/152 2024-04-19T02:13:34.229 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 21/152 2024-04-19T02:13:34.280 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cephfs-2:18.2.2-1237.g646b8c7d.el8.x86_6 31/152 2024-04-19T02:13:34.283 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : elfutils-libelf-0.190-2.el8.x86_64 13/152 2024-04-19T02:13:34.357 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 21/152 2024-04-19T02:13:34.414 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/152 2024-04-19T02:13:34.500 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/152 2024-04-19T02:13:34.528 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 22/152 2024-04-19T02:13:34.650 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/152 2024-04-19T02:13:34.710 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/152 2024-04-19T02:13:34.803 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libcephsqlite-2:18.2.2-1237.g646b8c7d.el8.x86_64 16/152 2024-04-19T02:13:34.863 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libcephsqlite-2:18.2.2-1237.g646b8c7d.el8.x86_64 16/152 2024-04-19T02:13:34.890 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1237.g646b8c7d.el8.x86_64 16/152 2024-04-19T02:13:34.963 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1237.g646b8c7d.el8.x86_64 16/152 2024-04-19T02:13:35.062 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libradosstriper1-2:18.2.2-1237.g646b8c7d.el8.x86 17/152 2024-04-19T02:13:35.121 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libradosstriper1-2:18.2.2-1237.g646b8c7d.el8.x86 17/152 2024-04-19T02:13:35.124 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 22/152 2024-04-19T02:13:35.248 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 32/152 2024-04-19T02:13:35.254 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1237.g646b8c7d.el8.x86 17/152 2024-04-19T02:13:35.306 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1237.g646b8c7d.el8.x86 17/152 2024-04-19T02:13:35.345 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : openblas-0.3.15-4.el8.x86_64 23/152 2024-04-19T02:13:35.520 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 18/152 2024-04-19T02:13:35.530 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 18/152 2024-04-19T02:13:35.597 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 33/152 2024-04-19T02:13:35.639 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 18/152 2024-04-19T02:13:35.647 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 18/152 2024-04-19T02:13:35.851 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 19/152 2024-04-19T02:13:35.878 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jinja2-2.10.1-4.el8.noarch 34/152 2024-04-19T02:13:35.910 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 19/152 2024-04-19T02:13:35.961 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 23/152 2024-04-19T02:13:36.021 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 20/152 2024-04-19T02:13:36.057 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/152 2024-04-19T02:13:36.077 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 20/152 2024-04-19T02:13:36.162 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 24/152 2024-04-19T02:13:36.170 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 21/152 2024-04-19T02:13:36.221 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 21/152 2024-04-19T02:13:36.293 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 21/152 2024-04-19T02:13:36.355 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 21/152 2024-04-19T02:13:36.453 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 22/152 2024-04-19T02:13:36.505 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 22/152 2024-04-19T02:13:36.841 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 24/152 2024-04-19T02:13:37.056 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 22/152 2024-04-19T02:13:37.098 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 22/152 2024-04-19T02:13:37.144 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/152 2024-04-19T02:13:37.263 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : openblas-0.3.15-4.el8.x86_64 23/152 2024-04-19T02:13:37.286 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : openblas-0.3.15-4.el8.x86_64 23/152 2024-04-19T02:13:37.333 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 26/152 2024-04-19T02:13:37.490 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 27/152 2024-04-19T02:13:37.695 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/152 2024-04-19T02:13:37.840 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/152 2024-04-19T02:13:37.874 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 23/152 2024-04-19T02:13:37.884 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 23/152 2024-04-19T02:13:37.917 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-ceph-common-2:18.2.2-1237.g646b8c7d.el8. 29/152 2024-04-19T02:13:38.021 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 24/152 2024-04-19T02:13:38.070 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 24/152 2024-04-19T02:13:38.143 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-ceph-argparse-2:18.2.2-1237.g646b8c7d.el 30/152 2024-04-19T02:13:38.187 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 36/152 2024-04-19T02:13:38.365 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/152 2024-04-19T02:13:38.372 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cephfs-2:18.2.2-1237.g646b8c7d.el8.x86_6 31/152 2024-04-19T02:13:38.597 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rsa-4.9-2.el8.noarch 38/152 2024-04-19T02:13:38.714 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 24/152 2024-04-19T02:13:38.766 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 24/152 2024-04-19T02:13:38.775 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : elfutils-libs-0.190-2.el8.x86_64 39/152 2024-04-19T02:13:38.967 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el8.x86_64 40/152 2024-04-19T02:13:39.013 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/152 2024-04-19T02:13:39.078 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/152 2024-04-19T02:13:39.162 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 41/152 2024-04-19T02:13:39.210 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 26/152 2024-04-19T02:13:39.275 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 26/152 2024-04-19T02:13:39.323 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 32/152 2024-04-19T02:13:39.349 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librados-devel-2:18.2.2-1237.g646b8c7d.el8.x86_6 42/152 2024-04-19T02:13:39.366 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 27/152 2024-04-19T02:13:39.431 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 27/152 2024-04-19T02:13:39.564 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/152 2024-04-19T02:13:39.573 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : libfdisk-2.32.1-46.el8.x86_64 43/152 2024-04-19T02:13:39.638 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/152 2024-04-19T02:13:39.649 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libfdisk-2.32.1-46.el8.x86_64 43/152 2024-04-19T02:13:39.664 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 33/152 2024-04-19T02:13:39.777 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-ceph-common-2:18.2.2-1237.g646b8c7d.el8. 29/152 2024-04-19T02:13:39.807 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : libmount-2.32.1-46.el8.x86_64 44/152 2024-04-19T02:13:39.875 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libmount-2.32.1-46.el8.x86_64 44/152 2024-04-19T02:13:39.884 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-ceph-common-2:18.2.2-1237.g646b8c7d.el8. 29/152 2024-04-19T02:13:39.937 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jinja2-2.10.1-4.el8.noarch 34/152 2024-04-19T02:13:39.955 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-ceph-argparse-2:18.2.2-1237.g646b8c7d.el 30/152 2024-04-19T02:13:40.080 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libuuid-devel-2.32.1-46.el8.x86_64 45/152 2024-04-19T02:13:40.102 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/152 2024-04-19T02:13:40.122 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-ceph-argparse-2:18.2.2-1237.g646b8c7d.el 30/152 2024-04-19T02:13:40.165 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cephfs-2:18.2.2-1237.g646b8c7d.el8.x86_6 31/152 2024-04-19T02:13:40.252 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/152 2024-04-19T02:13:40.347 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cephfs-2:18.2.2-1237.g646b8c7d.el8.x86_6 31/152 2024-04-19T02:13:40.501 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : libsmartcols-2.32.1-46.el8.x86_64 47/152 2024-04-19T02:13:41.029 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libsmartcols-2.32.1-46.el8.x86_64 47/152 2024-04-19T02:13:41.124 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 32/152 2024-04-19T02:13:41.300 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 32/152 2024-04-19T02:13:41.315 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : util-linux-2.32.1-46.el8.x86_64 48/152 2024-04-19T02:13:41.330 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: util-linux-2.32.1-46.el8.x86_64 48/152 2024-04-19T02:13:41.459 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 33/152 2024-04-19T02:13:41.501 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/152 2024-04-19T02:13:41.733 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/152 2024-04-19T02:13:41.749 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jinja2-2.10.1-4.el8.noarch 34/152 2024-04-19T02:13:41.878 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/152 2024-04-19T02:13:41.920 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/152 2024-04-19T02:13:41.933 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 33/152 2024-04-19T02:13:41.980 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/152 2024-04-19T02:13:42.144 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/152 2024-04-19T02:13:42.181 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jinja2-2.10.1-4.el8.noarch 34/152 2024-04-19T02:13:42.210 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 36/152 2024-04-19T02:13:42.326 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/152 2024-04-19T02:13:42.386 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/152 2024-04-19T02:13:42.401 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/152 2024-04-19T02:13:42.507 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/152 2024-04-19T02:13:42.629 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rsa-4.9-2.el8.noarch 38/152 2024-04-19T02:13:42.743 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/152 2024-04-19T02:13:42.789 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : elfutils-libs-0.190-2.el8.x86_64 39/152 2024-04-19T02:13:42.918 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/152 2024-04-19T02:13:42.970 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el8.x86_64 40/152 2024-04-19T02:13:43.076 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/152 2024-04-19T02:13:43.148 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 41/152 2024-04-19T02:13:43.254 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/152 2024-04-19T02:13:43.360 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librados-devel-2:18.2.2-1237.g646b8c7d.el8.x86_6 42/152 2024-04-19T02:13:43.402 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/152 2024-04-19T02:13:43.562 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/152 2024-04-19T02:13:43.576 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : libfdisk-2.32.1-46.el8.x86_64 43/152 2024-04-19T02:13:43.663 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libfdisk-2.32.1-46.el8.x86_64 43/152 2024-04-19T02:13:43.711 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/152 2024-04-19T02:13:43.764 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/152 2024-04-19T02:13:43.868 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : libmount-2.32.1-46.el8.x86_64 44/152 2024-04-19T02:13:43.922 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/152 2024-04-19T02:13:43.939 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libmount-2.32.1-46.el8.x86_64 44/152 2024-04-19T02:13:44.022 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 36/152 2024-04-19T02:13:44.123 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libuuid-devel-2.32.1-46.el8.x86_64 45/152 2024-04-19T02:13:44.139 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/152 2024-04-19T02:13:44.184 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/152 2024-04-19T02:13:44.212 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/152 2024-04-19T02:13:44.288 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/152 2024-04-19T02:13:44.345 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/152 2024-04-19T02:13:44.443 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-rsa-4.9-2.el8.noarch 38/152 2024-04-19T02:13:44.516 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : libsmartcols-2.32.1-46.el8.x86_64 47/152 2024-04-19T02:13:44.529 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 36/152 2024-04-19T02:13:44.548 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/152 2024-04-19T02:13:44.607 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : elfutils-libs-0.190-2.el8.x86_64 39/152 2024-04-19T02:13:44.702 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/152 2024-04-19T02:13:44.780 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el8.x86_64 40/152 2024-04-19T02:13:44.913 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/152 2024-04-19T02:13:44.916 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rsa-4.9-2.el8.noarch 38/152 2024-04-19T02:13:44.950 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-rbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 41/152 2024-04-19T02:13:45.029 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libsmartcols-2.32.1-46.el8.x86_64 47/152 2024-04-19T02:13:45.089 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : elfutils-libs-0.190-2.el8.x86_64 39/152 2024-04-19T02:13:45.128 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : librados-devel-2:18.2.2-1237.g646b8c7d.el8.x86_6 42/152 2024-04-19T02:13:45.262 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el8.x86_64 40/152 2024-04-19T02:13:45.318 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : util-linux-2.32.1-46.el8.x86_64 48/152 2024-04-19T02:13:45.320 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : libfdisk-2.32.1-46.el8.x86_64 43/152 2024-04-19T02:13:45.332 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: util-linux-2.32.1-46.el8.x86_64 48/152 2024-04-19T02:13:45.416 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libfdisk-2.32.1-46.el8.x86_64 43/152 2024-04-19T02:13:45.440 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 41/152 2024-04-19T02:13:45.474 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/152 2024-04-19T02:13:45.511 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/152 2024-04-19T02:13:45.652 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librados-devel-2:18.2.2-1237.g646b8c7d.el8.x86_6 42/152 2024-04-19T02:13:45.700 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/152 2024-04-19T02:13:45.741 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/152 2024-04-19T02:13:45.835 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : libfdisk-2.32.1-46.el8.x86_64 43/152 2024-04-19T02:13:45.916 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libfdisk-2.32.1-46.el8.x86_64 43/152 2024-04-19T02:13:45.916 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : libmount-2.32.1-46.el8.x86_64 44/152 2024-04-19T02:13:45.984 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libmount-2.32.1-46.el8.x86_64 44/152 2024-04-19T02:13:45.991 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/152 2024-04-19T02:13:46.085 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : libmount-2.32.1-46.el8.x86_64 44/152 2024-04-19T02:13:46.160 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libuuid-devel-2.32.1-46.el8.x86_64 45/152 2024-04-19T02:13:46.172 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/152 2024-04-19T02:13:46.183 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libmount-2.32.1-46.el8.x86_64 44/152 2024-04-19T02:13:46.328 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/152 2024-04-19T02:13:46.356 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/152 2024-04-19T02:13:46.357 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libuuid-devel-2.32.1-46.el8.x86_64 45/152 2024-04-19T02:13:46.481 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/152 2024-04-19T02:13:46.509 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/152 2024-04-19T02:13:46.530 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/152 2024-04-19T02:13:46.577 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : libsmartcols-2.32.1-46.el8.x86_64 47/152 2024-04-19T02:13:46.681 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librgw2-2:18.2.2-1237.g646b8c7d.el8.x86_64 70/152 2024-04-19T02:13:46.721 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/152 2024-04-19T02:13:46.743 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : libsmartcols-2.32.1-46.el8.x86_64 47/152 2024-04-19T02:13:46.753 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librgw2-2:18.2.2-1237.g646b8c7d.el8.x86_64 70/152 2024-04-19T02:13:46.912 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/152 2024-04-19T02:13:46.931 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 71/152 2024-04-19T02:13:47.068 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libsmartcols-2.32.1-46.el8.x86_64 47/152 2024-04-19T02:13:47.079 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/152 2024-04-19T02:13:47.151 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-packaging-16.8-9.el8.noarch 72/152 2024-04-19T02:13:47.254 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libsmartcols-2.32.1-46.el8.x86_64 47/152 2024-04-19T02:13:47.256 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/152 2024-04-19T02:13:47.353 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : util-linux-2.32.1-46.el8.x86_64 48/152 2024-04-19T02:13:47.357 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 73/152 2024-04-19T02:13:47.367 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: util-linux-2.32.1-46.el8.x86_64 48/152 2024-04-19T02:13:47.421 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/152 2024-04-19T02:13:47.530 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/152 2024-04-19T02:13:47.543 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : util-linux-2.32.1-46.el8.x86_64 48/152 2024-04-19T02:13:47.558 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: util-linux-2.32.1-46.el8.x86_64 48/152 2024-04-19T02:13:47.589 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/152 2024-04-19T02:13:47.737 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/152 2024-04-19T02:13:47.746 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 74/152 2024-04-19T02:13:47.749 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/152 2024-04-19T02:13:47.769 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/152 2024-04-19T02:13:47.949 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/152 2024-04-19T02:13:47.967 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/152 2024-04-19T02:13:47.997 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/152 2024-04-19T02:13:48.049 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 75/152 2024-04-19T02:13:48.165 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/152 2024-04-19T02:13:48.166 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/152 2024-04-19T02:13:48.207 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/152 2024-04-19T02:13:48.223 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 76/152 2024-04-19T02:13:48.362 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/152 2024-04-19T02:13:48.372 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/152 2024-04-19T02:13:48.382 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/152 2024-04-19T02:13:48.491 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 77/152 2024-04-19T02:13:48.528 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/152 2024-04-19T02:13:48.560 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/152 2024-04-19T02:13:48.610 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/152 2024-04-19T02:13:48.701 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 78/152 2024-04-19T02:13:48.741 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/152 2024-04-19T02:13:48.771 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/152 2024-04-19T02:13:48.945 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/152 2024-04-19T02:13:48.952 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/152 2024-04-19T02:13:48.966 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/152 2024-04-19T02:13:49.119 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/152 2024-04-19T02:13:49.121 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/152 2024-04-19T02:13:49.217 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/152 2024-04-19T02:13:49.279 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/152 2024-04-19T02:13:49.299 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/152 2024-04-19T02:13:49.440 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/152 2024-04-19T02:13:49.450 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/152 2024-04-19T02:13:49.463 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/152 2024-04-19T02:13:49.587 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/152 2024-04-19T02:13:49.616 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/152 2024-04-19T02:13:49.748 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/152 2024-04-19T02:13:49.765 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 79/152 2024-04-19T02:13:49.768 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/152 2024-04-19T02:13:49.909 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/152 2024-04-19T02:13:49.944 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/152 2024-04-19T02:13:50.117 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/152 2024-04-19T02:13:50.128 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 80/152 2024-04-19T02:13:50.135 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/152 2024-04-19T02:13:50.222 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/152 2024-04-19T02:13:50.333 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/152 2024-04-19T02:13:50.368 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/152 2024-04-19T02:13:50.371 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 81/152 2024-04-19T02:13:50.391 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librgw2-2:18.2.2-1237.g646b8c7d.el8.x86_64 70/152 2024-04-19T02:13:50.461 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librgw2-2:18.2.2-1237.g646b8c7d.el8.x86_64 70/152 2024-04-19T02:13:50.571 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/152 2024-04-19T02:13:50.575 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/152 2024-04-19T02:13:50.631 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 82/152 2024-04-19T02:13:50.684 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 71/152 2024-04-19T02:13:50.845 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/152 2024-04-19T02:13:50.904 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-packaging-16.8-9.el8.noarch 72/152 2024-04-19T02:13:50.936 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/152 2024-04-19T02:13:50.954 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 83/152 2024-04-19T02:13:51.119 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 73/152 2024-04-19T02:13:51.164 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 84/152 2024-04-19T02:13:51.200 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/152 2024-04-19T02:13:51.209 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/152 2024-04-19T02:13:51.378 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/152 2024-04-19T02:13:51.416 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 85/152 2024-04-19T02:13:51.467 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/152 2024-04-19T02:13:51.498 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 74/152 2024-04-19T02:13:51.608 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 86/152 2024-04-19T02:13:51.652 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/152 2024-04-19T02:13:51.785 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 75/152 2024-04-19T02:13:51.944 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 87/152 2024-04-19T02:13:51.992 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 76/152 2024-04-19T02:13:52.138 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/152 2024-04-19T02:13:52.176 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 88/152 2024-04-19T02:13:52.235 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 77/152 2024-04-19T02:13:52.285 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : librgw2-2:18.2.2-1237.g646b8c7d.el8.x86_64 70/152 2024-04-19T02:13:52.348 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 89/152 2024-04-19T02:13:52.354 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librgw2-2:18.2.2-1237.g646b8c7d.el8.x86_64 70/152 2024-04-19T02:13:52.417 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/152 2024-04-19T02:13:52.478 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 78/152 2024-04-19T02:13:52.526 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 90/152 2024-04-19T02:13:52.544 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-rgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 71/152 2024-04-19T02:13:52.601 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librgw2-2:18.2.2-1237.g646b8c7d.el8.x86_64 70/152 2024-04-19T02:13:52.678 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librgw2-2:18.2.2-1237.g646b8c7d.el8.x86_64 70/152 2024-04-19T02:13:52.747 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-packaging-16.8-9.el8.noarch 72/152 2024-04-19T02:13:52.856 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 91/152 2024-04-19T02:13:52.867 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 71/152 2024-04-19T02:13:52.953 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 73/152 2024-04-19T02:13:53.050 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 92/152 2024-04-19T02:13:53.095 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-packaging-16.8-9.el8.noarch 72/152 2024-04-19T02:13:53.234 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 93/152 2024-04-19T02:13:53.316 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 74/152 2024-04-19T02:13:53.328 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 73/152 2024-04-19T02:13:53.447 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 94/152 2024-04-19T02:13:53.532 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 79/152 2024-04-19T02:13:53.596 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 75/152 2024-04-19T02:13:53.681 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 95/152 2024-04-19T02:13:53.688 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 74/152 2024-04-19T02:13:53.752 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 76/152 2024-04-19T02:13:53.871 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 80/152 2024-04-19T02:13:53.898 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : fuse-2.9.7-19.el8.x86_64 96/152 2024-04-19T02:13:53.970 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 75/152 2024-04-19T02:13:53.987 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 77/152 2024-04-19T02:13:54.130 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 97/152 2024-04-19T02:13:54.131 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 81/152 2024-04-19T02:13:54.135 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 76/152 2024-04-19T02:13:54.247 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 78/152 2024-04-19T02:13:54.263 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 98/152 2024-04-19T02:13:54.379 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 77/152 2024-04-19T02:13:54.399 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 82/152 2024-04-19T02:13:54.605 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 78/152 2024-04-19T02:13:54.714 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 83/152 2024-04-19T02:13:54.958 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 84/152 2024-04-19T02:13:55.255 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 79/152 2024-04-19T02:13:55.259 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 85/152 2024-04-19T02:13:55.502 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 86/152 2024-04-19T02:13:55.589 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 80/152 2024-04-19T02:13:55.603 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 79/152 2024-04-19T02:13:55.800 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 81/152 2024-04-19T02:13:55.848 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 87/152 2024-04-19T02:13:55.950 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 80/152 2024-04-19T02:13:56.046 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 82/152 2024-04-19T02:13:56.087 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 88/152 2024-04-19T02:13:56.167 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 81/152 2024-04-19T02:13:56.234 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 89/152 2024-04-19T02:13:56.348 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 83/152 2024-04-19T02:13:56.374 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 82/152 2024-04-19T02:13:56.388 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 90/152 2024-04-19T02:13:56.602 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 84/152 2024-04-19T02:13:56.689 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 83/152 2024-04-19T02:13:56.750 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 91/152 2024-04-19T02:13:56.771 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 99/152 2024-04-19T02:13:56.883 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 85/152 2024-04-19T02:13:56.901 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 84/152 2024-04-19T02:13:56.978 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 92/152 2024-04-19T02:13:57.029 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 99/152 2024-04-19T02:13:57.117 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 86/152 2024-04-19T02:13:57.120 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 93/152 2024-04-19T02:13:57.185 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 85/152 2024-04-19T02:13:57.324 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 94/152 2024-04-19T02:13:57.402 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 86/152 2024-04-19T02:13:57.444 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 87/152 2024-04-19T02:13:57.542 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 95/152 2024-04-19T02:13:57.625 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 88/152 2024-04-19T02:13:57.626 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 99/152 2024-04-19T02:13:57.713 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 87/152 2024-04-19T02:13:57.734 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : fuse-2.9.7-19.el8.x86_64 96/152 2024-04-19T02:13:57.769 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 89/152 2024-04-19T02:13:57.897 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 88/152 2024-04-19T02:13:57.924 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 97/152 2024-04-19T02:13:57.941 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-base-2:18.2.2-1237.g646b8c7d.el8.x86_64 100/152 2024-04-19T02:13:57.977 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 90/152 2024-04-19T02:13:58.038 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-base-2:18.2.2-1237.g646b8c7d.el8.x86_64 100/152 2024-04-19T02:13:58.061 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 89/152 2024-04-19T02:13:58.115 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 98/152 2024-04-19T02:13:58.238 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 90/152 2024-04-19T02:13:58.252 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-selinux-2:18.2.2-1237.g646b8c7d.el8.x86_64 101/152 2024-04-19T02:13:58.293 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 91/152 2024-04-19T02:13:58.505 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 92/152 2024-04-19T02:13:58.577 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 91/152 2024-04-19T02:13:58.638 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 93/152 2024-04-19T02:13:58.796 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 92/152 2024-04-19T02:13:58.824 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 94/152 2024-04-19T02:13:58.966 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 93/152 2024-04-19T02:13:59.060 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 95/152 2024-04-19T02:13:59.151 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 94/152 2024-04-19T02:13:59.277 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : fuse-2.9.7-19.el8.x86_64 96/152 2024-04-19T02:13:59.377 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 95/152 2024-04-19T02:13:59.484 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 97/152 2024-04-19T02:13:59.607 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : fuse-2.9.7-19.el8.x86_64 96/152 2024-04-19T02:13:59.643 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 98/152 2024-04-19T02:13:59.800 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 97/152 2024-04-19T02:13:59.950 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 98/152 2024-04-19T02:14:00.682 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 99/152 2024-04-19T02:14:00.923 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 99/152 2024-04-19T02:14:01.514 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 99/152 2024-04-19T02:14:01.796 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-base-2:18.2.2-1237.g646b8c7d.el8.x86_64 100/152 2024-04-19T02:14:01.902 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-base-2:18.2.2-1237.g646b8c7d.el8.x86_64 100/152 2024-04-19T02:14:02.139 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-selinux-2:18.2.2-1237.g646b8c7d.el8.x86_64 101/152 2024-04-19T02:14:02.185 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 99/152 2024-04-19T02:14:02.434 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 99/152 2024-04-19T02:14:02.538 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 99/152 2024-04-19T02:14:02.883 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 99/152 2024-04-19T02:14:03.025 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 99/152 2024-04-19T02:14:03.334 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-base-2:18.2.2-1237.g646b8c7d.el8.x86_64 100/152 2024-04-19T02:14:03.444 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-base-2:18.2.2-1237.g646b8c7d.el8.x86_64 100/152 2024-04-19T02:14:03.477 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 99/152 2024-04-19T02:14:03.633 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-selinux-2:18.2.2-1237.g646b8c7d.el8.x86_64 101/152 2024-04-19T02:14:03.750 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-base-2:18.2.2-1237.g646b8c7d.el8.x86_64 100/152 2024-04-19T02:14:03.857 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-base-2:18.2.2-1237.g646b8c7d.el8.x86_64 100/152 2024-04-19T02:14:04.091 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-selinux-2:18.2.2-1237.g646b8c7d.el8.x86_64 101/152 2024-04-19T02:14:17.849 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1237.g646b8c7d.el8.x86_64 101/152 2024-04-19T02:14:17.850 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /sys 2024-04-19T02:14:17.850 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /proc 2024-04-19T02:14:17.850 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /dev 2024-04-19T02:14:17.850 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /run 2024-04-19T02:14:17.850 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /mnt 2024-04-19T02:14:17.850 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /var/tmp 2024-04-19T02:14:17.850 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /home 2024-04-19T02:14:17.850 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /tmp 2024-04-19T02:14:17.850 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /dev 2024-04-19T02:14:17.850 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-19T02:14:18.217 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-volume-2:18.2.2-1237.g646b8c7d.el8.noarch 102/152 2024-04-19T02:14:19.857 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-volume-2:18.2.2-1237.g646b8c7d.el8.noarch 102/152 2024-04-19T02:14:20.079 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-osd-2:18.2.2-1237.g646b8c7d.el8.x86_64 103/152 2024-04-19T02:14:20.297 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-osd-2:18.2.2-1237.g646b8c7d.el8.x86_64 103/152 2024-04-19T02:14:20.509 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mds-2:18.2.2-1237.g646b8c7d.el8.x86_64 104/152 2024-04-19T02:14:20.985 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mds-2:18.2.2-1237.g646b8c7d.el8.x86_64 104/152 2024-04-19T02:14:21.184 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mon-2:18.2.2-1237.g646b8c7d.el8.x86_64 105/152 2024-04-19T02:14:21.208 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mon-2:18.2.2-1237.g646b8c7d.el8.x86_64 105/152 2024-04-19T02:14:21.362 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1237.g646b8c7d.el8.x86_64 101/152 2024-04-19T02:14:21.363 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /sys 2024-04-19T02:14:21.363 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /proc 2024-04-19T02:14:21.363 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /dev 2024-04-19T02:14:21.363 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /run 2024-04-19T02:14:21.363 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /mnt 2024-04-19T02:14:21.363 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /var/tmp 2024-04-19T02:14:21.363 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /home 2024-04-19T02:14:21.363 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /tmp 2024-04-19T02:14:21.363 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /dev 2024-04-19T02:14:21.363 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:14:21.482 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 106/152 2024-04-19T02:14:21.686 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 107/152 2024-04-19T02:14:21.752 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-volume-2:18.2.2-1237.g646b8c7d.el8.noarch 102/152 2024-04-19T02:14:21.825 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 108/152 2024-04-19T02:14:21.926 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 108/152 2024-04-19T02:14:22.194 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : jq-1.6-8.el8.x86_64 109/152 2024-04-19T02:14:22.625 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : automake-1.16.1-8.el8.noarch 110/152 2024-04-19T02:14:22.840 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1237.g646b8c7d.el8.x86_64 101/152 2024-04-19T02:14:22.840 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /sys 2024-04-19T02:14:22.840 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /proc 2024-04-19T02:14:22.840 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /dev 2024-04-19T02:14:22.840 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /run 2024-04-19T02:14:22.841 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /mnt 2024-04-19T02:14:22.841 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /var/tmp 2024-04-19T02:14:22.841 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /home 2024-04-19T02:14:22.841 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /tmp 2024-04-19T02:14:22.841 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /dev 2024-04-19T02:14:22.841 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-19T02:14:23.125 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 111/152 2024-04-19T02:14:23.180 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-volume-2:18.2.2-1237.g646b8c7d.el8.noarch 102/152 2024-04-19T02:14:23.323 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 111/152 2024-04-19T02:14:23.388 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1237.g646b8c7d.el8.x86_64 101/152 2024-04-19T02:14:23.388 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /sys 2024-04-19T02:14:23.388 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /proc 2024-04-19T02:14:23.388 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /dev 2024-04-19T02:14:23.388 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /run 2024-04-19T02:14:23.388 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /mnt 2024-04-19T02:14:23.388 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /var/tmp 2024-04-19T02:14:23.388 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /home 2024-04-19T02:14:23.388 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /tmp 2024-04-19T02:14:23.388 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /dev 2024-04-19T02:14:23.388 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-19T02:14:23.404 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-volume-2:18.2.2-1237.g646b8c7d.el8.noarch 102/152 2024-04-19T02:14:23.431 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1237.g646b8c7d.e 112/152 2024-04-19T02:14:23.615 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-osd-2:18.2.2-1237.g646b8c7d.el8.x86_64 103/152 2024-04-19T02:14:23.667 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1237.g646b8c7d. 113/152 2024-04-19T02:14:23.763 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-volume-2:18.2.2-1237.g646b8c7d.el8.noarch 102/152 2024-04-19T02:14:23.834 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-osd-2:18.2.2-1237.g646b8c7d.el8.x86_64 103/152 2024-04-19T02:14:23.883 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1237.g646b8c7d.el8.noa 114/152 2024-04-19T02:14:24.010 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mds-2:18.2.2-1237.g646b8c7d.el8.x86_64 104/152 2024-04-19T02:14:24.484 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mds-2:18.2.2-1237.g646b8c7d.el8.x86_64 104/152 2024-04-19T02:14:24.685 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mon-2:18.2.2-1237.g646b8c7d.el8.x86_64 105/152 2024-04-19T02:14:24.707 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mon-2:18.2.2-1237.g646b8c7d.el8.x86_64 105/152 2024-04-19T02:14:24.826 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-volume-2:18.2.2-1237.g646b8c7d.el8.noarch 102/152 2024-04-19T02:14:24.900 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1237.g646b8c7d.el8.noa 114/152 2024-04-19T02:14:24.972 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 106/152 2024-04-19T02:14:25.058 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-osd-2:18.2.2-1237.g646b8c7d.el8.x86_64 103/152 2024-04-19T02:14:25.120 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1237.g646b8c7d.el8.n 115/152 2024-04-19T02:14:25.161 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 107/152 2024-04-19T02:14:25.272 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-osd-2:18.2.2-1237.g646b8c7d.el8.x86_64 103/152 2024-04-19T02:14:25.309 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 108/152 2024-04-19T02:14:25.381 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 108/152 2024-04-19T02:14:25.402 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-volume-2:18.2.2-1237.g646b8c7d.el8.noarch 102/152 2024-04-19T02:14:25.459 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mds-2:18.2.2-1237.g646b8c7d.el8.x86_64 104/152 2024-04-19T02:14:25.622 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-osd-2:18.2.2-1237.g646b8c7d.el8.x86_64 103/152 2024-04-19T02:14:25.646 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : jq-1.6-8.el8.x86_64 109/152 2024-04-19T02:14:25.839 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-osd-2:18.2.2-1237.g646b8c7d.el8.x86_64 103/152 2024-04-19T02:14:25.893 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : automake-1.16.1-8.el8.noarch 110/152 2024-04-19T02:14:25.932 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mds-2:18.2.2-1237.g646b8c7d.el8.x86_64 104/152 2024-04-19T02:14:26.012 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mds-2:18.2.2-1237.g646b8c7d.el8.x86_64 104/152 2024-04-19T02:14:26.080 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1237.g646b8c7d.el8.n 115/152 2024-04-19T02:14:26.121 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mon-2:18.2.2-1237.g646b8c7d.el8.x86_64 105/152 2024-04-19T02:14:26.144 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mon-2:18.2.2-1237.g646b8c7d.el8.x86_64 105/152 2024-04-19T02:14:26.284 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1237.g646 116/152 2024-04-19T02:14:26.374 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 106/152 2024-04-19T02:14:26.377 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1237.g646 116/152 2024-04-19T02:14:26.410 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 111/152 2024-04-19T02:14:26.490 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mds-2:18.2.2-1237.g646b8c7d.el8.x86_64 104/152 2024-04-19T02:14:26.581 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 107/152 2024-04-19T02:14:26.584 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 111/152 2024-04-19T02:14:26.688 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mon-2:18.2.2-1237.g646b8c7d.el8.x86_64 105/152 2024-04-19T02:14:26.690 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1237.g646b8c7d.e 112/152 2024-04-19T02:14:26.711 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mon-2:18.2.2-1237.g646b8c7d.el8.x86_64 105/152 2024-04-19T02:14:26.729 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 108/152 2024-04-19T02:14:26.740 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1237.g646b8c7d.el 117/152 2024-04-19T02:14:26.829 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 108/152 2024-04-19T02:14:26.859 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1237.g646b8c7d. 113/152 2024-04-19T02:14:26.962 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-2:18.2.2-1237.g646b8c7d.el8.x86_64 118/152 2024-04-19T02:14:26.976 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 106/152 2024-04-19T02:14:26.999 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1237.g646b8c7d.el8.x86_64 118/152 2024-04-19T02:14:27.075 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1237.g646b8c7d.el8.noa 114/152 2024-04-19T02:14:27.097 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : jq-1.6-8.el8.x86_64 109/152 2024-04-19T02:14:27.181 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 107/152 2024-04-19T02:14:27.207 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-rook-2:18.2.2-1237.g646b8c7d.el8.noarch 119/152 2024-04-19T02:14:27.218 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1237.g646b8c7d.el8.noarch 119/152 2024-04-19T02:14:27.304 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : automake-1.16.1-8.el8.noarch 110/152 2024-04-19T02:14:27.337 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 108/152 2024-04-19T02:14:27.416 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 108/152 2024-04-19T02:14:27.417 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-2:18.2.2-1237.g646b8c7d.el8.x86_64 120/152 2024-04-19T02:14:27.591 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libtool-2.4.6-25.el8.x86_64 121/152 2024-04-19T02:14:27.713 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : jq-1.6-8.el8.x86_64 109/152 2024-04-19T02:14:27.834 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 111/152 2024-04-19T02:14:27.937 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : automake-1.16.1-8.el8.noarch 110/152 2024-04-19T02:14:27.999 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 111/152 2024-04-19T02:14:28.091 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1237.g646b8c7d.el8.noa 114/152 2024-04-19T02:14:28.102 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1237.g646b8c7d.e 112/152 2024-04-19T02:14:28.279 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1237.g646b8c7d. 113/152 2024-04-19T02:14:28.356 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1237.g646b8c7d.el8.n 115/152 2024-04-19T02:14:28.479 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 111/152 2024-04-19T02:14:28.487 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1237.g646b8c7d.el8.noa 114/152 2024-04-19T02:14:28.657 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 111/152 2024-04-19T02:14:28.802 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1237.g646b8c7d.e 112/152 2024-04-19T02:14:29.008 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1237.g646b8c7d. 113/152 2024-04-19T02:14:29.220 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1237.g646b8c7d.el8.noa 114/152 2024-04-19T02:14:29.318 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1237.g646b8c7d.el8.n 115/152 2024-04-19T02:14:29.500 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1237.g646b8c7d.el8.noa 114/152 2024-04-19T02:14:29.556 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1237.g646 116/152 2024-04-19T02:14:29.648 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1237.g646 116/152 2024-04-19T02:14:29.796 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1237.g646b8c7d.el8.n 115/152 2024-04-19T02:14:30.034 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1237.g646b8c7d.el 117/152 2024-04-19T02:14:30.244 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1237.g646b8c7d.el8.noa 114/152 2024-04-19T02:14:30.264 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-2:18.2.2-1237.g646b8c7d.el8.x86_64 118/152 2024-04-19T02:14:30.301 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1237.g646b8c7d.el8.x86_64 118/152 2024-04-19T02:14:30.466 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-rook-2:18.2.2-1237.g646b8c7d.el8.noarch 119/152 2024-04-19T02:14:30.477 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1237.g646b8c7d.el8.noarch 119/152 2024-04-19T02:14:30.487 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1237.g646b8c7d.el8.n 115/152 2024-04-19T02:14:30.647 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-2:18.2.2-1237.g646b8c7d.el8.x86_64 120/152 2024-04-19T02:14:30.758 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1237.g646b8c7d.el8.n 115/152 2024-04-19T02:14:30.833 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libtool-2.4.6-25.el8.x86_64 121/152 2024-04-19T02:14:30.954 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1237.g646 116/152 2024-04-19T02:14:31.046 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1237.g646 116/152 2024-04-19T02:14:31.407 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1237.g646b8c7d.el 117/152 2024-04-19T02:14:31.454 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1237.g646b8c7d.el8.n 115/152 2024-04-19T02:14:31.646 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-2:18.2.2-1237.g646b8c7d.el8.x86_64 118/152 2024-04-19T02:14:31.657 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1237.g646 116/152 2024-04-19T02:14:31.683 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1237.g646b8c7d.el8.x86_64 118/152 2024-04-19T02:14:31.750 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1237.g646 116/152 2024-04-19T02:14:31.845 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-rook-2:18.2.2-1237.g646b8c7d.el8.noarch 119/152 2024-04-19T02:14:31.856 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1237.g646b8c7d.el8.noarch 119/152 2024-04-19T02:14:32.039 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-2:18.2.2-1237.g646b8c7d.el8.x86_64 120/152 2024-04-19T02:14:32.057 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 121/152 2024-04-19T02:14:32.132 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1237.g646b8c7d.el 117/152 2024-04-19T02:14:32.186 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libtool-2.4.6-25.el8.x86_64 121/152 2024-04-19T02:14:32.337 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-2:18.2.2-1237.g646b8c7d.el8.x86_64 118/152 2024-04-19T02:14:32.374 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1237.g646b8c7d.el8.x86_64 118/152 2024-04-19T02:14:32.545 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-rook-2:18.2.2-1237.g646b8c7d.el8.noarch 119/152 2024-04-19T02:14:32.556 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1237.g646b8c7d.el8.noarch 119/152 2024-04-19T02:14:32.782 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-2:18.2.2-1237.g646b8c7d.el8.x86_64 120/152 2024-04-19T02:14:32.928 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libtool-2.4.6-25.el8.x86_64 121/152 2024-04-19T02:14:33.479 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-test-2:18.2.2-1237.g646b8c7d.el8.x86_64 122/152 2024-04-19T02:14:33.719 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-radosgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 123/152 2024-04-19T02:14:33.752 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 123/152 2024-04-19T02:14:33.948 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1237.g646b8 124/152 2024-04-19T02:14:34.296 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1237.g646b8 124/152 2024-04-19T02:14:34.481 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-mirror-2:18.2.2-1237.g646b8c7d.el8.x86_64 125/152 2024-04-19T02:14:34.574 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1237.g646b8c7d.el8.x86_64 125/152 2024-04-19T02:14:35.289 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 121/152 2024-04-19T02:14:35.478 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 126/152 2024-04-19T02:14:35.835 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : openssl-devel-1:1.1.1k-12.el8.x86_64 127/152 2024-04-19T02:14:36.003 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : elfutils-libelf-devel-0.190-2.el8.x86_64 128/152 2024-04-19T02:14:36.208 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : util-linux-user-2.32.1-46.el8.x86_64 129/152 2024-04-19T02:14:36.368 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 130/152 2024-04-19T02:14:36.581 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephfs-devel-2:18.2.2-1237.g646b8c7d.el8.x86_ 131/152 2024-04-19T02:14:36.629 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 121/152 2024-04-19T02:14:36.714 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-test-2:18.2.2-1237.g646b8c7d.el8.x86_64 122/152 2024-04-19T02:14:36.792 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 132/152 2024-04-19T02:14:36.904 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-radosgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 123/152 2024-04-19T02:14:36.938 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 123/152 2024-04-19T02:14:37.098 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1237.g646b8 124/152 2024-04-19T02:14:37.127 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-nbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 133/152 2024-04-19T02:14:37.374 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : openssl-1:1.1.1k-12.el8.x86_64 134/152 2024-04-19T02:14:37.405 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 121/152 2024-04-19T02:14:37.444 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1237.g646b8 124/152 2024-04-19T02:14:37.613 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 135/152 2024-04-19T02:14:37.623 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : rbd-mirror-2:18.2.2-1237.g646b8c7d.el8.x86_64 125/152 2024-04-19T02:14:37.726 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1237.g646b8c7d.el8.x86_64 125/152 2024-04-19T02:14:37.822 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : flex-2.6.1-9.el8.x86_64 136/152 2024-04-19T02:14:37.938 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 136/152 2024-04-19T02:14:38.019 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-test-2:18.2.2-1237.g646b8c7d.el8.x86_64 122/152 2024-04-19T02:14:38.164 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : bison-3.0.4-10.el8.x86_64 137/152 2024-04-19T02:14:38.178 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 137/152 2024-04-19T02:14:38.270 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-radosgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 123/152 2024-04-19T02:14:38.304 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 123/152 2024-04-19T02:14:38.357 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 138/152 2024-04-19T02:14:38.511 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1237.g646b8 124/152 2024-04-19T02:14:38.547 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 139/152 2024-04-19T02:14:38.579 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 126/152 2024-04-19T02:14:38.759 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : openssl-1:1.1.1k-9.el8.x86_64 140/152 2024-04-19T02:14:38.759 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 141/152 2024-04-19T02:14:38.817 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-test-2:18.2.2-1237.g646b8c7d.el8.x86_64 122/152 2024-04-19T02:14:38.857 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1237.g646b8 124/152 2024-04-19T02:14:38.902 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : openssl-devel-1:1.1.1k-12.el8.x86_64 127/152 2024-04-19T02:14:39.017 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 141/152 2024-04-19T02:14:39.017 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 142/152 2024-04-19T02:14:39.027 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : rbd-mirror-2:18.2.2-1237.g646b8c7d.el8.x86_64 125/152 2024-04-19T02:14:39.053 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-radosgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 123/152 2024-04-19T02:14:39.087 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 123/152 2024-04-19T02:14:39.095 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : elfutils-libelf-devel-0.190-2.el8.x86_64 128/152 2024-04-19T02:14:39.120 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1237.g646b8c7d.el8.x86_64 125/152 2024-04-19T02:14:39.234 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 142/152 2024-04-19T02:14:39.234 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 143/152 2024-04-19T02:14:39.261 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1237.g646b8 124/152 2024-04-19T02:14:39.319 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : util-linux-user-2.32.1-46.el8.x86_64 129/152 2024-04-19T02:14:39.503 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 130/152 2024-04-19T02:14:39.516 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 143/152 2024-04-19T02:14:39.610 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1237.g646b8 124/152 2024-04-19T02:14:39.703 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 144/152 2024-04-19T02:14:39.706 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libcephfs-devel-2:18.2.2-1237.g646b8c7d.el8.x86_ 131/152 2024-04-19T02:14:39.836 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : rbd-mirror-2:18.2.2-1237.g646b8c7d.el8.x86_64 125/152 2024-04-19T02:14:39.907 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : rbd-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 132/152 2024-04-19T02:14:39.929 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1237.g646b8c7d.el8.x86_64 125/152 2024-04-19T02:14:39.940 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 145/152 2024-04-19T02:14:39.941 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 146/152 2024-04-19T02:14:40.004 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 126/152 2024-04-19T02:14:40.158 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 146/152 2024-04-19T02:14:40.158 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 147/152 2024-04-19T02:14:40.236 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : rbd-nbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 133/152 2024-04-19T02:14:40.336 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : openssl-devel-1:1.1.1k-12.el8.x86_64 127/152 2024-04-19T02:14:40.383 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 147/152 2024-04-19T02:14:40.383 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 148/152 2024-04-19T02:14:40.500 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : openssl-1:1.1.1k-12.el8.x86_64 134/152 2024-04-19T02:14:40.517 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : elfutils-libelf-devel-0.190-2.el8.x86_64 128/152 2024-04-19T02:14:40.592 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 148/152 2024-04-19T02:14:40.592 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 149/152 2024-04-19T02:14:40.733 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 135/152 2024-04-19T02:14:40.771 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : util-linux-user-2.32.1-46.el8.x86_64 129/152 2024-04-19T02:14:40.816 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 149/152 2024-04-19T02:14:40.816 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 150/152 2024-04-19T02:14:40.817 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 126/152 2024-04-19T02:14:40.939 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 130/152 2024-04-19T02:14:40.964 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : flex-2.6.1-9.el8.x86_64 136/152 2024-04-19T02:14:41.002 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 150/152 2024-04-19T02:14:41.002 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : openssl-libs-1:1.1.1k-9.el8.x86_64 151/152 2024-04-19T02:14:41.049 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 136/152 2024-04-19T02:14:41.114 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : openssl-devel-1:1.1.1k-12.el8.x86_64 127/152 2024-04-19T02:14:41.127 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libcephfs-devel-2:18.2.2-1237.g646b8c7d.el8.x86_ 131/152 2024-04-19T02:14:41.289 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : bison-3.0.4-10.el8.x86_64 137/152 2024-04-19T02:14:41.300 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : elfutils-libelf-devel-0.190-2.el8.x86_64 128/152 2024-04-19T02:14:41.302 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 137/152 2024-04-19T02:14:41.303 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: openssl-libs-1:1.1.1k-9.el8.x86_64 151/152 2024-04-19T02:14:41.368 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : rbd-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 132/152 2024-04-19T02:14:41.472 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 152/152 2024-04-19T02:14:41.504 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : util-linux-user-2.32.1-46.el8.x86_64 129/152 2024-04-19T02:14:41.515 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 138/152 2024-04-19T02:14:41.666 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 139/152 2024-04-19T02:14:41.672 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : rbd-nbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 133/152 2024-04-19T02:14:41.689 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 130/152 2024-04-19T02:14:41.882 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : openssl-1:1.1.1k-9.el8.x86_64 140/152 2024-04-19T02:14:41.882 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 141/152 2024-04-19T02:14:41.902 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libcephfs-devel-2:18.2.2-1237.g646b8c7d.el8.x86_ 131/152 2024-04-19T02:14:41.936 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : openssl-1:1.1.1k-12.el8.x86_64 134/152 2024-04-19T02:14:42.079 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 152/152 2024-04-19T02:14:42.079 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-2:18.2.2-1237.g646b8c7d.el8.x86_64 1/152 2024-04-19T02:14:42.079 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-base-2:18.2.2-1237.g646b8c7d.el8.x86_64 2/152 2024-04-19T02:14:42.079 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 3/152 2024-04-19T02:14:42.079 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 4/152 2024-04-19T02:14:42.080 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1237.g646b8 5/152 2024-04-19T02:14:42.080 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mds-2:18.2.2-1237.g646b8c7d.el8.x86_64 6/152 2024-04-19T02:14:42.080 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-2:18.2.2-1237.g646b8c7d.el8.x86_64 7/152 2024-04-19T02:14:42.080 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mon-2:18.2.2-1237.g646b8c7d.el8.x86_64 8/152 2024-04-19T02:14:42.080 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-osd-2:18.2.2-1237.g646b8c7d.el8.x86_64 9/152 2024-04-19T02:14:42.080 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-radosgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 10/152 2024-04-19T02:14:42.080 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-selinux-2:18.2.2-1237.g646b8c7d.el8.x86_64 11/152 2024-04-19T02:14:42.080 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-test-2:18.2.2-1237.g646b8c7d.el8.x86_64 12/152 2024-04-19T02:14:42.080 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephfs-devel-2:18.2.2-1237.g646b8c7d.el8.x86_ 13/152 2024-04-19T02:14:42.080 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephfs2-2:18.2.2-1237.g646b8c7d.el8.x86_64 14/152 2024-04-19T02:14:42.080 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephsqlite-2:18.2.2-1237.g646b8c7d.el8.x86_64 15/152 2024-04-19T02:14:42.080 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados-devel-2:18.2.2-1237.g646b8c7d.el8.x86_6 16/152 2024-04-19T02:14:42.080 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libradosstriper1-2:18.2.2-1237.g646b8c7d.el8.x86 17/152 2024-04-19T02:14:42.081 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librgw2-2:18.2.2-1237.g646b8c7d.el8.x86_64 18/152 2024-04-19T02:14:42.081 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1237.g646b8c7d.el 19/152 2024-04-19T02:14:42.081 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-ceph-common-2:18.2.2-1237.g646b8c7d.el8. 20/152 2024-04-19T02:14:42.081 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cephfs-2:18.2.2-1237.g646b8c7d.el8.x86_6 21/152 2024-04-19T02:14:42.081 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rados-2:18.2.2-1237.g646b8c7d.el8.x86_64 22/152 2024-04-19T02:14:42.081 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 23/152 2024-04-19T02:14:42.081 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 24/152 2024-04-19T02:14:42.081 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 25/152 2024-04-19T02:14:42.081 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-mirror-2:18.2.2-1237.g646b8c7d.el8.x86_64 26/152 2024-04-19T02:14:42.081 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-nbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 27/152 2024-04-19T02:14:42.081 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1237.g646b8c7d. 28/152 2024-04-19T02:14:42.082 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1237.g646b8c7d.el8.noa 29/152 2024-04-19T02:14:42.082 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1237.g646b8c7d.el8.n 30/152 2024-04-19T02:14:42.082 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1237.g646 31/152 2024-04-19T02:14:42.082 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1237.g646b8c7d.el 32/152 2024-04-19T02:14:42.082 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1237.g646b8c7d.el8.noarch 33/152 2024-04-19T02:14:42.082 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1237.g646b8c7d.e 34/152 2024-04-19T02:14:42.082 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-volume-2:18.2.2-1237.g646b8c7d.el8.noarch 35/152 2024-04-19T02:14:42.082 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 36/152 2024-04-19T02:14:42.082 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : automake-1.16.1-8.el8.noarch 37/152 2024-04-19T02:14:42.082 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : bison-3.0.4-10.el8.x86_64 38/152 2024-04-19T02:14:42.082 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : flex-2.6.1-9.el8.x86_64 39/152 2024-04-19T02:14:42.082 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : jq-1.6-8.el8.x86_64 40/152 2024-04-19T02:14:42.083 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 41/152 2024-04-19T02:14:42.083 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 42/152 2024-04-19T02:14:42.083 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 43/152 2024-04-19T02:14:42.083 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 44/152 2024-04-19T02:14:42.083 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 45/152 2024-04-19T02:14:42.083 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 46/152 2024-04-19T02:14:42.083 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 47/152 2024-04-19T02:14:42.083 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jinja2-2.10.1-4.el8.noarch 48/152 2024-04-19T02:14:42.083 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 49/152 2024-04-19T02:14:42.083 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 50/152 2024-04-19T02:14:42.083 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 51/152 2024-04-19T02:14:42.083 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 52/152 2024-04-19T02:14:42.083 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 53/152 2024-04-19T02:14:42.083 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 54/152 2024-04-19T02:14:42.084 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 55/152 2024-04-19T02:14:42.084 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 56/152 2024-04-19T02:14:42.084 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 57/152 2024-04-19T02:14:42.084 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 58/152 2024-04-19T02:14:42.084 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 59/152 2024-04-19T02:14:42.084 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 60/152 2024-04-19T02:14:42.084 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 61/152 2024-04-19T02:14:42.084 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 62/152 2024-04-19T02:14:42.084 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 63/152 2024-04-19T02:14:42.084 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-libelf-devel-0.190-2.el8.x86_64 64/152 2024-04-19T02:14:42.084 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : fuse-2.9.7-19.el8.x86_64 65/152 2024-04-19T02:14:42.084 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 66/152 2024-04-19T02:14:42.084 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 67/152 2024-04-19T02:14:42.084 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 68/152 2024-04-19T02:14:42.085 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 69/152 2024-04-19T02:14:42.085 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 70/152 2024-04-19T02:14:42.085 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 71/152 2024-04-19T02:14:42.085 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 72/152 2024-04-19T02:14:42.085 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 73/152 2024-04-19T02:14:42.085 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 74/152 2024-04-19T02:14:42.085 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libuuid-devel-2.32.1-46.el8.x86_64 75/152 2024-04-19T02:14:42.085 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 76/152 2024-04-19T02:14:42.085 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 77/152 2024-04-19T02:14:42.085 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8.x86_64 78/152 2024-04-19T02:14:42.085 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 79/152 2024-04-19T02:14:42.085 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 80/152 2024-04-19T02:14:42.085 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 81/152 2024-04-19T02:14:42.085 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 82/152 2024-04-19T02:14:42.086 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 83/152 2024-04-19T02:14:42.086 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 84/152 2024-04-19T02:14:42.086 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 85/152 2024-04-19T02:14:42.086 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 86/152 2024-04-19T02:14:42.086 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 87/152 2024-04-19T02:14:42.086 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 88/152 2024-04-19T02:14:42.086 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 89/152 2024-04-19T02:14:42.086 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 90/152 2024-04-19T02:14:42.086 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 91/152 2024-04-19T02:14:42.086 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 92/152 2024-04-19T02:14:42.086 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 93/152 2024-04-19T02:14:42.086 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 94/152 2024-04-19T02:14:42.086 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 95/152 2024-04-19T02:14:42.087 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 96/152 2024-04-19T02:14:42.087 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 97/152 2024-04-19T02:14:42.087 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 98/152 2024-04-19T02:14:42.087 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 99/152 2024-04-19T02:14:42.087 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 100/152 2024-04-19T02:14:42.087 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 101/152 2024-04-19T02:14:42.087 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 102/152 2024-04-19T02:14:42.087 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 103/152 2024-04-19T02:14:42.087 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 104/152 2024-04-19T02:14:42.087 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 105/152 2024-04-19T02:14:42.087 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 106/152 2024-04-19T02:14:42.087 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 107/152 2024-04-19T02:14:42.087 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 108/152 2024-04-19T02:14:42.087 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-portend-2.6-1.el8.noarch 109/152 2024-04-19T02:14:42.088 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 110/152 2024-04-19T02:14:42.088 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 111/152 2024-04-19T02:14:42.088 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 112/152 2024-04-19T02:14:42.088 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 113/152 2024-04-19T02:14:42.088 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 114/152 2024-04-19T02:14:42.088 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 115/152 2024-04-19T02:14:42.088 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 116/152 2024-04-19T02:14:42.088 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 117/152 2024-04-19T02:14:42.088 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 118/152 2024-04-19T02:14:42.088 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 119/152 2024-04-19T02:14:42.088 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 120/152 2024-04-19T02:14:42.088 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 121/152 2024-04-19T02:14:42.088 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 122/152 2024-04-19T02:14:42.088 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados2-2:18.2.2-1237.g646b8c7d.el8.x86_64 123/152 2024-04-19T02:14:42.089 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 124/152 2024-04-19T02:14:42.089 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librbd1-2:18.2.2-1237.g646b8c7d.el8.x86_64 125/152 2024-04-19T02:14:42.089 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 126/152 2024-04-19T02:14:42.089 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el8.x86_64 127/152 2024-04-19T02:14:42.089 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 128/152 2024-04-19T02:14:42.089 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-libelf-0.190-2.el8.x86_64 129/152 2024-04-19T02:14:42.089 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 130/152 2024-04-19T02:14:42.089 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-libs-0.190-2.el8.x86_64 131/152 2024-04-19T02:14:42.089 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 132/152 2024-04-19T02:14:42.089 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libblkid-2.32.1-46.el8.x86_64 133/152 2024-04-19T02:14:42.089 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 134/152 2024-04-19T02:14:42.089 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libfdisk-2.32.1-46.el8.x86_64 135/152 2024-04-19T02:14:42.089 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 136/152 2024-04-19T02:14:42.089 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libmount-2.32.1-46.el8.x86_64 137/152 2024-04-19T02:14:42.089 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 138/152 2024-04-19T02:14:42.090 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libsmartcols-2.32.1-46.el8.x86_64 139/152 2024-04-19T02:14:42.090 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 140/152 2024-04-19T02:14:42.090 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libuuid-2.32.1-46.el8.x86_64 141/152 2024-04-19T02:14:42.090 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 142/152 2024-04-19T02:14:42.090 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openssl-1:1.1.1k-12.el8.x86_64 143/152 2024-04-19T02:14:42.090 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openssl-1:1.1.1k-9.el8.x86_64 144/152 2024-04-19T02:14:42.090 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8.x86_64 145/152 2024-04-19T02:14:42.090 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openssl-libs-1:1.1.1k-9.el8.x86_64 146/152 2024-04-19T02:14:42.090 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : util-linux-2.32.1-46.el8.x86_64 147/152 2024-04-19T02:14:42.090 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 148/152 2024-04-19T02:14:42.090 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : util-linux-user-2.32.1-46.el8.x86_64 149/152 2024-04-19T02:14:42.090 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 150/152 2024-04-19T02:14:42.090 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 151/152 2024-04-19T02:14:42.108 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 135/152 2024-04-19T02:14:42.119 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : rbd-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 132/152 2024-04-19T02:14:42.150 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 141/152 2024-04-19T02:14:42.150 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 142/152 2024-04-19T02:14:42.351 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : flex-2.6.1-9.el8.x86_64 136/152 2024-04-19T02:14:42.359 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 142/152 2024-04-19T02:14:42.359 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 143/152 2024-04-19T02:14:42.432 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : rbd-nbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 133/152 2024-04-19T02:14:42.442 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 136/152 2024-04-19T02:14:42.591 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 143/152 2024-04-19T02:14:42.695 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : openssl-1:1.1.1k-12.el8.x86_64 134/152 2024-04-19T02:14:42.706 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : bison-3.0.4-10.el8.x86_64 137/152 2024-04-19T02:14:42.719 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 137/152 2024-04-19T02:14:42.825 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 144/152 2024-04-19T02:14:42.886 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 138/152 2024-04-19T02:14:42.922 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 135/152 2024-04-19T02:14:43.048 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 139/152 2024-04-19T02:14:43.058 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 145/152 2024-04-19T02:14:43.058 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 146/152 2024-04-19T02:14:43.126 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : flex-2.6.1-9.el8.x86_64 136/152 2024-04-19T02:14:43.214 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 136/152 2024-04-19T02:14:43.266 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 146/152 2024-04-19T02:14:43.266 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 147/152 2024-04-19T02:14:43.281 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : openssl-1:1.1.1k-9.el8.x86_64 140/152 2024-04-19T02:14:43.281 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 141/152 2024-04-19T02:14:43.442 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : bison-3.0.4-10.el8.x86_64 137/152 2024-04-19T02:14:43.455 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 137/152 2024-04-19T02:14:43.508 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 147/152 2024-04-19T02:14:43.508 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 148/152 2024-04-19T02:14:43.516 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 141/152 2024-04-19T02:14:43.516 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 142/152 2024-04-19T02:14:43.653 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 138/152 2024-04-19T02:14:43.708 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 148/152 2024-04-19T02:14:43.708 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 149/152 2024-04-19T02:14:43.742 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 142/152 2024-04-19T02:14:43.742 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 143/152 2024-04-19T02:14:43.815 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 139/152 2024-04-19T02:14:43.908 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 149/152 2024-04-19T02:14:43.908 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 150/152 2024-04-19T02:14:43.970 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 143/152 2024-04-19T02:14:43.979 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 152/152 2024-04-19T02:14:43.979 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-19T02:14:43.979 INFO:teuthology.orchestra.run.smithi153.stdout:Upgraded: 2024-04-19T02:14:43.979 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-debuginfod-client-0.190-2.el8.x86_64 2024-04-19T02:14:43.979 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libelf-0.190-2.el8.x86_64 2024-04-19T02:14:43.979 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libs-0.190-2.el8.x86_64 2024-04-19T02:14:43.979 INFO:teuthology.orchestra.run.smithi153.stdout: libblkid-2.32.1-46.el8.x86_64 2024-04-19T02:14:43.979 INFO:teuthology.orchestra.run.smithi153.stdout: libfdisk-2.32.1-46.el8.x86_64 2024-04-19T02:14:43.979 INFO:teuthology.orchestra.run.smithi153.stdout: libmount-2.32.1-46.el8.x86_64 2024-04-19T02:14:43.979 INFO:teuthology.orchestra.run.smithi153.stdout: librados2-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:43.980 INFO:teuthology.orchestra.run.smithi153.stdout: librbd1-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:43.980 INFO:teuthology.orchestra.run.smithi153.stdout: libsmartcols-2.32.1-46.el8.x86_64 2024-04-19T02:14:43.980 INFO:teuthology.orchestra.run.smithi153.stdout: libuuid-2.32.1-46.el8.x86_64 2024-04-19T02:14:43.980 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-1:1.1.1k-12.el8.x86_64 2024-04-19T02:14:43.980 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-libs-1:1.1.1k-12.el8.x86_64 2024-04-19T02:14:43.980 INFO:teuthology.orchestra.run.smithi153.stdout: util-linux-2.32.1-46.el8.x86_64 2024-04-19T02:14:43.980 INFO:teuthology.orchestra.run.smithi153.stdout: util-linux-user-2.32.1-46.el8.x86_64 2024-04-19T02:14:43.980 INFO:teuthology.orchestra.run.smithi153.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-04-19T02:14:43.980 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-04-19T02:14:43.980 INFO:teuthology.orchestra.run.smithi153.stdout: automake-1.16.1-8.el8.noarch 2024-04-19T02:14:43.980 INFO:teuthology.orchestra.run.smithi153.stdout: bison-3.0.4-10.el8.x86_64 2024-04-19T02:14:43.980 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:43.980 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-base-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:43.980 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:43.981 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:43.981 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-grafana-dashboards-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T02:14:43.981 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-immutable-object-cache-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:43.981 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mds-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:43.981 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:43.981 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T02:14:43.981 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-dashboard-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T02:14:43.981 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T02:14:43.981 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-modules-core-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T02:14:43.981 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-rook-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T02:14:43.981 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mon-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:43.981 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-osd-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:43.981 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-prometheus-alerts-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T02:14:43.982 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-radosgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:43.982 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-selinux-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:43.982 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-test-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:43.982 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-volume-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T02:14:43.982 INFO:teuthology.orchestra.run.smithi153.stdout: cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T02:14:43.982 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libelf-devel-0.190-2.el8.x86_64 2024-04-19T02:14:43.982 INFO:teuthology.orchestra.run.smithi153.stdout: flex-2.6.1-9.el8.x86_64 2024-04-19T02:14:43.982 INFO:teuthology.orchestra.run.smithi153.stdout: fuse-2.9.7-19.el8.x86_64 2024-04-19T02:14:43.982 INFO:teuthology.orchestra.run.smithi153.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-19T02:14:43.982 INFO:teuthology.orchestra.run.smithi153.stdout: jq-1.6-8.el8.x86_64 2024-04-19T02:14:43.982 INFO:teuthology.orchestra.run.smithi153.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-04-19T02:14:43.982 INFO:teuthology.orchestra.run.smithi153.stdout: krb5-devel-1.18.2-22.el8.x86_64 2024-04-19T02:14:43.983 INFO:teuthology.orchestra.run.smithi153.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-04-19T02:14:43.983 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs-devel-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:43.983 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs2-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:43.983 INFO:teuthology.orchestra.run.smithi153.stdout: libcephsqlite-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:43.983 INFO:teuthology.orchestra.run.smithi153.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2024-04-19T02:14:43.983 INFO:teuthology.orchestra.run.smithi153.stdout: libgfortran-8.5.0-21.el8.x86_64 2024-04-19T02:14:43.983 INFO:teuthology.orchestra.run.smithi153.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-19T02:14:43.983 INFO:teuthology.orchestra.run.smithi153.stdout: libquadmath-8.5.0-21.el8.x86_64 2024-04-19T02:14:43.983 INFO:teuthology.orchestra.run.smithi153.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-04-19T02:14:43.983 INFO:teuthology.orchestra.run.smithi153.stdout: librados-devel-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:43.983 INFO:teuthology.orchestra.run.smithi153.stdout: libradosstriper1-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:43.983 INFO:teuthology.orchestra.run.smithi153.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-04-19T02:14:43.983 INFO:teuthology.orchestra.run.smithi153.stdout: librgw2-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:43.983 INFO:teuthology.orchestra.run.smithi153.stdout: libselinux-devel-2.9-8.el8.x86_64 2024-04-19T02:14:43.984 INFO:teuthology.orchestra.run.smithi153.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-04-19T02:14:43.984 INFO:teuthology.orchestra.run.smithi153.stdout: libtool-2.4.6-25.el8.x86_64 2024-04-19T02:14:43.984 INFO:teuthology.orchestra.run.smithi153.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-19T02:14:43.984 INFO:teuthology.orchestra.run.smithi153.stdout: libuuid-devel-2.32.1-46.el8.x86_64 2024-04-19T02:14:43.984 INFO:teuthology.orchestra.run.smithi153.stdout: libverto-devel-0.3.2-2.el8.x86_64 2024-04-19T02:14:43.984 INFO:teuthology.orchestra.run.smithi153.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-04-19T02:14:43.984 INFO:teuthology.orchestra.run.smithi153.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-19T02:14:43.984 INFO:teuthology.orchestra.run.smithi153.stdout: oniguruma-6.8.2-3.el8.x86_64 2024-04-19T02:14:43.984 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-0.3.15-4.el8.x86_64 2024-04-19T02:14:43.984 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-04-19T02:14:43.984 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-devel-1:1.1.1k-12.el8.x86_64 2024-04-19T02:14:43.984 INFO:teuthology.orchestra.run.smithi153.stdout: pcre2-devel-10.32-3.el8.x86_64 2024-04-19T02:14:43.984 INFO:teuthology.orchestra.run.smithi153.stdout: pcre2-utf16-10.32-3.el8.x86_64 2024-04-19T02:14:43.984 INFO:teuthology.orchestra.run.smithi153.stdout: pcre2-utf32-10.32-3.el8.x86_64 2024-04-19T02:14:43.985 INFO:teuthology.orchestra.run.smithi153.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-04-19T02:14:43.985 INFO:teuthology.orchestra.run.smithi153.stdout: python3-babel-2.5.1-7.el8.noarch 2024-04-19T02:14:43.985 INFO:teuthology.orchestra.run.smithi153.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-19T02:14:43.985 INFO:teuthology.orchestra.run.smithi153.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-19T02:14:43.985 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-04-19T02:14:43.985 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-argparse-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:43.985 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:43.985 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cephfs-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:43.985 INFO:teuthology.orchestra.run.smithi153.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-04-19T02:14:43.985 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-19T02:14:43.985 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-19T02:14:43.985 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-19T02:14:43.985 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-04-19T02:14:43.985 INFO:teuthology.orchestra.run.smithi153.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-04-19T02:14:43.986 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-19T02:14:43.986 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-19T02:14:43.986 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jinja2-2.10.1-4.el8.noarch 2024-04-19T02:14:43.986 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-04-19T02:14:43.986 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-04-19T02:14:43.986 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-04-19T02:14:43.986 INFO:teuthology.orchestra.run.smithi153.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-04-19T02:14:43.986 INFO:teuthology.orchestra.run.smithi153.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-19T02:14:43.986 INFO:teuthology.orchestra.run.smithi153.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-19T02:14:43.986 INFO:teuthology.orchestra.run.smithi153.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-19T02:14:43.986 INFO:teuthology.orchestra.run.smithi153.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-19T02:14:43.986 INFO:teuthology.orchestra.run.smithi153.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-04-19T02:14:43.986 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-04-19T02:14:43.987 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-04-19T02:14:43.987 INFO:teuthology.orchestra.run.smithi153.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-04-19T02:14:43.987 INFO:teuthology.orchestra.run.smithi153.stdout: python3-packaging-16.8-9.el8.noarch 2024-04-19T02:14:43.987 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-19T02:14:43.987 INFO:teuthology.orchestra.run.smithi153.stdout: python3-portend-2.6-1.el8.noarch 2024-04-19T02:14:43.987 INFO:teuthology.orchestra.run.smithi153.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-19T02:14:43.987 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-19T02:14:43.987 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-04-19T02:14:43.987 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-04-19T02:14:43.987 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-19T02:14:43.987 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-19T02:14:43.987 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rados-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:43.987 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:43.987 INFO:teuthology.orchestra.run.smithi153.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-04-19T02:14:43.987 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-04-19T02:14:43.988 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:43.988 INFO:teuthology.orchestra.run.smithi153.stdout: python3-routes-2.4.1-12.el8.noarch 2024-04-19T02:14:43.988 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rsa-4.9-2.el8.noarch 2024-04-19T02:14:43.988 INFO:teuthology.orchestra.run.smithi153.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-04-19T02:14:43.988 INFO:teuthology.orchestra.run.smithi153.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-19T02:14:43.988 INFO:teuthology.orchestra.run.smithi153.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-19T02:14:43.988 INFO:teuthology.orchestra.run.smithi153.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-19T02:14:43.988 INFO:teuthology.orchestra.run.smithi153.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-19T02:14:43.988 INFO:teuthology.orchestra.run.smithi153.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-19T02:14:43.988 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-19T02:14:43.988 INFO:teuthology.orchestra.run.smithi153.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-04-19T02:14:43.988 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-19T02:14:43.988 INFO:teuthology.orchestra.run.smithi153.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-19T02:14:43.988 INFO:teuthology.orchestra.run.smithi153.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-19T02:14:43.989 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:43.989 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-mirror-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:43.989 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-nbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:43.989 INFO:teuthology.orchestra.run.smithi153.stdout: socat-1.7.4.1-1.el8.x86_64 2024-04-19T02:14:43.989 INFO:teuthology.orchestra.run.smithi153.stdout: thrift-0.13.0-2.el8.x86_64 2024-04-19T02:14:43.989 INFO:teuthology.orchestra.run.smithi153.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-04-19T02:14:43.989 INFO:teuthology.orchestra.run.smithi153.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-04-19T02:14:43.989 INFO:teuthology.orchestra.run.smithi153.stdout: zlib-devel-1.2.11-21.el8.x86_64 2024-04-19T02:14:43.990 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-19T02:14:43.990 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-04-19T02:14:44.026 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : openssl-1:1.1.1k-9.el8.x86_64 140/152 2024-04-19T02:14:44.026 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 141/152 2024-04-19T02:14:44.143 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 150/152 2024-04-19T02:14:44.143 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : openssl-libs-1:1.1.1k-9.el8.x86_64 151/152 2024-04-19T02:14:44.168 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 144/152 2024-04-19T02:14:44.212 DEBUG:teuthology.parallel:result is None 2024-04-19T02:14:44.296 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 141/152 2024-04-19T02:14:44.296 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 142/152 2024-04-19T02:14:44.386 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 145/152 2024-04-19T02:14:44.386 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 146/152 2024-04-19T02:14:44.421 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: openssl-libs-1:1.1.1k-9.el8.x86_64 151/152 2024-04-19T02:14:44.521 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 142/152 2024-04-19T02:14:44.522 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 143/152 2024-04-19T02:14:44.595 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 146/152 2024-04-19T02:14:44.595 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 147/152 2024-04-19T02:14:44.606 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 152/152 2024-04-19T02:14:44.746 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 143/152 2024-04-19T02:14:44.795 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 147/152 2024-04-19T02:14:44.795 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 148/152 2024-04-19T02:14:44.928 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 144/152 2024-04-19T02:14:44.995 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 148/152 2024-04-19T02:14:44.995 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 149/152 2024-04-19T02:14:45.136 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 145/152 2024-04-19T02:14:45.137 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 146/152 2024-04-19T02:14:45.180 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 152/152 2024-04-19T02:14:45.181 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-2:18.2.2-1237.g646b8c7d.el8.x86_64 1/152 2024-04-19T02:14:45.181 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-base-2:18.2.2-1237.g646b8c7d.el8.x86_64 2/152 2024-04-19T02:14:45.181 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 3/152 2024-04-19T02:14:45.181 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 4/152 2024-04-19T02:14:45.181 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1237.g646b8 5/152 2024-04-19T02:14:45.181 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mds-2:18.2.2-1237.g646b8c7d.el8.x86_64 6/152 2024-04-19T02:14:45.181 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-2:18.2.2-1237.g646b8c7d.el8.x86_64 7/152 2024-04-19T02:14:45.181 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mon-2:18.2.2-1237.g646b8c7d.el8.x86_64 8/152 2024-04-19T02:14:45.182 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-osd-2:18.2.2-1237.g646b8c7d.el8.x86_64 9/152 2024-04-19T02:14:45.182 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-radosgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 10/152 2024-04-19T02:14:45.182 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-selinux-2:18.2.2-1237.g646b8c7d.el8.x86_64 11/152 2024-04-19T02:14:45.182 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-test-2:18.2.2-1237.g646b8c7d.el8.x86_64 12/152 2024-04-19T02:14:45.182 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libcephfs-devel-2:18.2.2-1237.g646b8c7d.el8.x86_ 13/152 2024-04-19T02:14:45.182 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libcephfs2-2:18.2.2-1237.g646b8c7d.el8.x86_64 14/152 2024-04-19T02:14:45.182 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libcephsqlite-2:18.2.2-1237.g646b8c7d.el8.x86_64 15/152 2024-04-19T02:14:45.182 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librados-devel-2:18.2.2-1237.g646b8c7d.el8.x86_6 16/152 2024-04-19T02:14:45.182 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libradosstriper1-2:18.2.2-1237.g646b8c7d.el8.x86 17/152 2024-04-19T02:14:45.182 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librgw2-2:18.2.2-1237.g646b8c7d.el8.x86_64 18/152 2024-04-19T02:14:45.182 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1237.g646b8c7d.el 19/152 2024-04-19T02:14:45.183 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-ceph-common-2:18.2.2-1237.g646b8c7d.el8. 20/152 2024-04-19T02:14:45.183 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cephfs-2:18.2.2-1237.g646b8c7d.el8.x86_6 21/152 2024-04-19T02:14:45.183 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rados-2:18.2.2-1237.g646b8c7d.el8.x86_64 22/152 2024-04-19T02:14:45.183 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 23/152 2024-04-19T02:14:45.183 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 24/152 2024-04-19T02:14:45.183 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : rbd-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 25/152 2024-04-19T02:14:45.183 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : rbd-mirror-2:18.2.2-1237.g646b8c7d.el8.x86_64 26/152 2024-04-19T02:14:45.183 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : rbd-nbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 27/152 2024-04-19T02:14:45.183 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1237.g646b8c7d. 28/152 2024-04-19T02:14:45.184 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1237.g646b8c7d.el8.noa 29/152 2024-04-19T02:14:45.184 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1237.g646b8c7d.el8.n 30/152 2024-04-19T02:14:45.184 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1237.g646 31/152 2024-04-19T02:14:45.184 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1237.g646b8c7d.el 32/152 2024-04-19T02:14:45.184 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1237.g646b8c7d.el8.noarch 33/152 2024-04-19T02:14:45.184 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1237.g646b8c7d.e 34/152 2024-04-19T02:14:45.184 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-volume-2:18.2.2-1237.g646b8c7d.el8.noarch 35/152 2024-04-19T02:14:45.184 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 36/152 2024-04-19T02:14:45.184 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : automake-1.16.1-8.el8.noarch 37/152 2024-04-19T02:14:45.184 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : bison-3.0.4-10.el8.x86_64 38/152 2024-04-19T02:14:45.184 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : flex-2.6.1-9.el8.x86_64 39/152 2024-04-19T02:14:45.185 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : jq-1.6-8.el8.x86_64 40/152 2024-04-19T02:14:45.185 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 41/152 2024-04-19T02:14:45.185 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 42/152 2024-04-19T02:14:45.185 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 43/152 2024-04-19T02:14:45.185 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 44/152 2024-04-19T02:14:45.185 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 45/152 2024-04-19T02:14:45.185 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 46/152 2024-04-19T02:14:45.185 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 47/152 2024-04-19T02:14:45.185 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jinja2-2.10.1-4.el8.noarch 48/152 2024-04-19T02:14:45.185 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 49/152 2024-04-19T02:14:45.185 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 50/152 2024-04-19T02:14:45.186 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 51/152 2024-04-19T02:14:45.186 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 52/152 2024-04-19T02:14:45.186 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 53/152 2024-04-19T02:14:45.186 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 54/152 2024-04-19T02:14:45.186 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 55/152 2024-04-19T02:14:45.186 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 56/152 2024-04-19T02:14:45.186 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 57/152 2024-04-19T02:14:45.186 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 58/152 2024-04-19T02:14:45.186 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 59/152 2024-04-19T02:14:45.186 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 60/152 2024-04-19T02:14:45.186 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 61/152 2024-04-19T02:14:45.187 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 62/152 2024-04-19T02:14:45.187 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 63/152 2024-04-19T02:14:45.187 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : elfutils-libelf-devel-0.190-2.el8.x86_64 64/152 2024-04-19T02:14:45.187 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : fuse-2.9.7-19.el8.x86_64 65/152 2024-04-19T02:14:45.187 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 66/152 2024-04-19T02:14:45.187 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 67/152 2024-04-19T02:14:45.187 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 68/152 2024-04-19T02:14:45.187 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 69/152 2024-04-19T02:14:45.187 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 70/152 2024-04-19T02:14:45.187 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 71/152 2024-04-19T02:14:45.187 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 72/152 2024-04-19T02:14:45.188 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 73/152 2024-04-19T02:14:45.188 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 74/152 2024-04-19T02:14:45.188 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libuuid-devel-2.32.1-46.el8.x86_64 75/152 2024-04-19T02:14:45.188 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 76/152 2024-04-19T02:14:45.188 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 77/152 2024-04-19T02:14:45.188 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8.x86_64 78/152 2024-04-19T02:14:45.188 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 79/152 2024-04-19T02:14:45.188 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 80/152 2024-04-19T02:14:45.188 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 81/152 2024-04-19T02:14:45.188 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 82/152 2024-04-19T02:14:45.188 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 83/152 2024-04-19T02:14:45.188 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 84/152 2024-04-19T02:14:45.189 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 85/152 2024-04-19T02:14:45.189 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 86/152 2024-04-19T02:14:45.189 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 87/152 2024-04-19T02:14:45.189 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 88/152 2024-04-19T02:14:45.189 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 89/152 2024-04-19T02:14:45.189 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 90/152 2024-04-19T02:14:45.189 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 91/152 2024-04-19T02:14:45.189 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 92/152 2024-04-19T02:14:45.189 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 93/152 2024-04-19T02:14:45.189 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 94/152 2024-04-19T02:14:45.189 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 95/152 2024-04-19T02:14:45.190 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 96/152 2024-04-19T02:14:45.190 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 97/152 2024-04-19T02:14:45.190 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 98/152 2024-04-19T02:14:45.190 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 99/152 2024-04-19T02:14:45.190 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 100/152 2024-04-19T02:14:45.190 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 101/152 2024-04-19T02:14:45.190 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 102/152 2024-04-19T02:14:45.190 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 103/152 2024-04-19T02:14:45.190 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 104/152 2024-04-19T02:14:45.190 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 105/152 2024-04-19T02:14:45.190 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 106/152 2024-04-19T02:14:45.191 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 107/152 2024-04-19T02:14:45.191 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 108/152 2024-04-19T02:14:45.191 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-portend-2.6-1.el8.noarch 109/152 2024-04-19T02:14:45.191 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 110/152 2024-04-19T02:14:45.191 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 111/152 2024-04-19T02:14:45.191 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 112/152 2024-04-19T02:14:45.191 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 113/152 2024-04-19T02:14:45.191 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 114/152 2024-04-19T02:14:45.191 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 115/152 2024-04-19T02:14:45.191 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 116/152 2024-04-19T02:14:45.191 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 117/152 2024-04-19T02:14:45.192 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 118/152 2024-04-19T02:14:45.192 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 119/152 2024-04-19T02:14:45.192 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 120/152 2024-04-19T02:14:45.192 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 121/152 2024-04-19T02:14:45.192 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 122/152 2024-04-19T02:14:45.192 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librados2-2:18.2.2-1237.g646b8c7d.el8.x86_64 123/152 2024-04-19T02:14:45.192 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 124/152 2024-04-19T02:14:45.192 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librbd1-2:18.2.2-1237.g646b8c7d.el8.x86_64 125/152 2024-04-19T02:14:45.192 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 126/152 2024-04-19T02:14:45.192 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el8.x86_64 127/152 2024-04-19T02:14:45.192 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 128/152 2024-04-19T02:14:45.193 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : elfutils-libelf-0.190-2.el8.x86_64 129/152 2024-04-19T02:14:45.193 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 130/152 2024-04-19T02:14:45.193 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : elfutils-libs-0.190-2.el8.x86_64 131/152 2024-04-19T02:14:45.193 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 132/152 2024-04-19T02:14:45.193 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libblkid-2.32.1-46.el8.x86_64 133/152 2024-04-19T02:14:45.193 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 134/152 2024-04-19T02:14:45.193 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libfdisk-2.32.1-46.el8.x86_64 135/152 2024-04-19T02:14:45.193 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 136/152 2024-04-19T02:14:45.193 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libmount-2.32.1-46.el8.x86_64 137/152 2024-04-19T02:14:45.193 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 138/152 2024-04-19T02:14:45.193 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libsmartcols-2.32.1-46.el8.x86_64 139/152 2024-04-19T02:14:45.193 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 140/152 2024-04-19T02:14:45.194 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libuuid-2.32.1-46.el8.x86_64 141/152 2024-04-19T02:14:45.194 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 142/152 2024-04-19T02:14:45.194 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-1:1.1.1k-12.el8.x86_64 143/152 2024-04-19T02:14:45.194 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-1:1.1.1k-9.el8.x86_64 144/152 2024-04-19T02:14:45.194 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8.x86_64 145/152 2024-04-19T02:14:45.194 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-libs-1:1.1.1k-9.el8.x86_64 146/152 2024-04-19T02:14:45.194 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : util-linux-2.32.1-46.el8.x86_64 147/152 2024-04-19T02:14:45.194 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 148/152 2024-04-19T02:14:45.194 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : util-linux-user-2.32.1-46.el8.x86_64 149/152 2024-04-19T02:14:45.194 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 150/152 2024-04-19T02:14:45.194 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 151/152 2024-04-19T02:14:45.228 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 149/152 2024-04-19T02:14:45.228 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 150/152 2024-04-19T02:14:45.354 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 146/152 2024-04-19T02:14:45.354 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 147/152 2024-04-19T02:14:45.401 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 150/152 2024-04-19T02:14:45.401 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : openssl-libs-1:1.1.1k-9.el8.x86_64 151/152 2024-04-19T02:14:45.571 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 147/152 2024-04-19T02:14:45.571 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 148/152 2024-04-19T02:14:45.645 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: openssl-libs-1:1.1.1k-9.el8.x86_64 151/152 2024-04-19T02:14:45.770 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 148/152 2024-04-19T02:14:45.770 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 149/152 2024-04-19T02:14:45.793 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 152/152 2024-04-19T02:14:45.962 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 149/152 2024-04-19T02:14:45.962 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 150/152 2024-04-19T02:14:46.197 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 150/152 2024-04-19T02:14:46.197 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : openssl-libs-1:1.1.1k-9.el8.x86_64 151/152 2024-04-19T02:14:46.394 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 152/152 2024-04-19T02:14:46.394 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-2:18.2.2-1237.g646b8c7d.el8.x86_64 1/152 2024-04-19T02:14:46.394 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-base-2:18.2.2-1237.g646b8c7d.el8.x86_64 2/152 2024-04-19T02:14:46.394 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 3/152 2024-04-19T02:14:46.394 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 4/152 2024-04-19T02:14:46.394 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1237.g646b8 5/152 2024-04-19T02:14:46.395 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mds-2:18.2.2-1237.g646b8c7d.el8.x86_64 6/152 2024-04-19T02:14:46.395 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-2:18.2.2-1237.g646b8c7d.el8.x86_64 7/152 2024-04-19T02:14:46.395 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mon-2:18.2.2-1237.g646b8c7d.el8.x86_64 8/152 2024-04-19T02:14:46.395 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-osd-2:18.2.2-1237.g646b8c7d.el8.x86_64 9/152 2024-04-19T02:14:46.395 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-radosgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 10/152 2024-04-19T02:14:46.395 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-selinux-2:18.2.2-1237.g646b8c7d.el8.x86_64 11/152 2024-04-19T02:14:46.395 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-test-2:18.2.2-1237.g646b8c7d.el8.x86_64 12/152 2024-04-19T02:14:46.395 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libcephfs-devel-2:18.2.2-1237.g646b8c7d.el8.x86_ 13/152 2024-04-19T02:14:46.395 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libcephfs2-2:18.2.2-1237.g646b8c7d.el8.x86_64 14/152 2024-04-19T02:14:46.395 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libcephsqlite-2:18.2.2-1237.g646b8c7d.el8.x86_64 15/152 2024-04-19T02:14:46.395 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librados-devel-2:18.2.2-1237.g646b8c7d.el8.x86_6 16/152 2024-04-19T02:14:46.395 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libradosstriper1-2:18.2.2-1237.g646b8c7d.el8.x86 17/152 2024-04-19T02:14:46.395 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librgw2-2:18.2.2-1237.g646b8c7d.el8.x86_64 18/152 2024-04-19T02:14:46.395 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1237.g646b8c7d.el 19/152 2024-04-19T02:14:46.396 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-ceph-common-2:18.2.2-1237.g646b8c7d.el8. 20/152 2024-04-19T02:14:46.396 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cephfs-2:18.2.2-1237.g646b8c7d.el8.x86_6 21/152 2024-04-19T02:14:46.396 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-rados-2:18.2.2-1237.g646b8c7d.el8.x86_64 22/152 2024-04-19T02:14:46.396 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-rbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 23/152 2024-04-19T02:14:46.396 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-rgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 24/152 2024-04-19T02:14:46.396 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : rbd-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 25/152 2024-04-19T02:14:46.396 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : rbd-mirror-2:18.2.2-1237.g646b8c7d.el8.x86_64 26/152 2024-04-19T02:14:46.396 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : rbd-nbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 27/152 2024-04-19T02:14:46.396 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1237.g646b8c7d. 28/152 2024-04-19T02:14:46.396 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1237.g646b8c7d.el8.noa 29/152 2024-04-19T02:14:46.396 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1237.g646b8c7d.el8.n 30/152 2024-04-19T02:14:46.396 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1237.g646 31/152 2024-04-19T02:14:46.396 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1237.g646b8c7d.el 32/152 2024-04-19T02:14:46.396 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1237.g646b8c7d.el8.noarch 33/152 2024-04-19T02:14:46.397 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1237.g646b8c7d.e 34/152 2024-04-19T02:14:46.397 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-volume-2:18.2.2-1237.g646b8c7d.el8.noarch 35/152 2024-04-19T02:14:46.397 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 36/152 2024-04-19T02:14:46.397 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : automake-1.16.1-8.el8.noarch 37/152 2024-04-19T02:14:46.397 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : bison-3.0.4-10.el8.x86_64 38/152 2024-04-19T02:14:46.397 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : flex-2.6.1-9.el8.x86_64 39/152 2024-04-19T02:14:46.397 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : jq-1.6-8.el8.x86_64 40/152 2024-04-19T02:14:46.397 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 41/152 2024-04-19T02:14:46.397 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 42/152 2024-04-19T02:14:46.397 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 43/152 2024-04-19T02:14:46.397 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 44/152 2024-04-19T02:14:46.397 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 45/152 2024-04-19T02:14:46.397 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 46/152 2024-04-19T02:14:46.397 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 47/152 2024-04-19T02:14:46.397 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jinja2-2.10.1-4.el8.noarch 48/152 2024-04-19T02:14:46.398 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 49/152 2024-04-19T02:14:46.398 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 50/152 2024-04-19T02:14:46.398 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 51/152 2024-04-19T02:14:46.398 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 52/152 2024-04-19T02:14:46.398 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 53/152 2024-04-19T02:14:46.398 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 54/152 2024-04-19T02:14:46.398 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 55/152 2024-04-19T02:14:46.398 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 56/152 2024-04-19T02:14:46.398 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 57/152 2024-04-19T02:14:46.398 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 58/152 2024-04-19T02:14:46.398 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 59/152 2024-04-19T02:14:46.398 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 60/152 2024-04-19T02:14:46.398 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 61/152 2024-04-19T02:14:46.398 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 62/152 2024-04-19T02:14:46.399 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 63/152 2024-04-19T02:14:46.399 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : elfutils-libelf-devel-0.190-2.el8.x86_64 64/152 2024-04-19T02:14:46.399 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : fuse-2.9.7-19.el8.x86_64 65/152 2024-04-19T02:14:46.399 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 66/152 2024-04-19T02:14:46.399 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 67/152 2024-04-19T02:14:46.399 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 68/152 2024-04-19T02:14:46.399 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 69/152 2024-04-19T02:14:46.399 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 70/152 2024-04-19T02:14:46.399 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 71/152 2024-04-19T02:14:46.399 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 72/152 2024-04-19T02:14:46.399 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 73/152 2024-04-19T02:14:46.399 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 74/152 2024-04-19T02:14:46.399 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libuuid-devel-2.32.1-46.el8.x86_64 75/152 2024-04-19T02:14:46.399 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 76/152 2024-04-19T02:14:46.399 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 77/152 2024-04-19T02:14:46.400 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8.x86_64 78/152 2024-04-19T02:14:46.400 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 79/152 2024-04-19T02:14:46.400 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 80/152 2024-04-19T02:14:46.400 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 81/152 2024-04-19T02:14:46.400 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 82/152 2024-04-19T02:14:46.400 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 83/152 2024-04-19T02:14:46.400 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 84/152 2024-04-19T02:14:46.400 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 85/152 2024-04-19T02:14:46.400 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 86/152 2024-04-19T02:14:46.400 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 87/152 2024-04-19T02:14:46.400 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 88/152 2024-04-19T02:14:46.400 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 89/152 2024-04-19T02:14:46.400 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 90/152 2024-04-19T02:14:46.400 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 91/152 2024-04-19T02:14:46.400 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 92/152 2024-04-19T02:14:46.401 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 93/152 2024-04-19T02:14:46.401 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 94/152 2024-04-19T02:14:46.401 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 95/152 2024-04-19T02:14:46.401 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 96/152 2024-04-19T02:14:46.401 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 97/152 2024-04-19T02:14:46.401 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 98/152 2024-04-19T02:14:46.401 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 99/152 2024-04-19T02:14:46.401 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 100/152 2024-04-19T02:14:46.401 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 101/152 2024-04-19T02:14:46.401 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 102/152 2024-04-19T02:14:46.401 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 103/152 2024-04-19T02:14:46.401 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 104/152 2024-04-19T02:14:46.401 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 105/152 2024-04-19T02:14:46.401 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 106/152 2024-04-19T02:14:46.402 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 107/152 2024-04-19T02:14:46.402 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 108/152 2024-04-19T02:14:46.402 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-portend-2.6-1.el8.noarch 109/152 2024-04-19T02:14:46.402 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 110/152 2024-04-19T02:14:46.402 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 111/152 2024-04-19T02:14:46.402 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 112/152 2024-04-19T02:14:46.402 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 113/152 2024-04-19T02:14:46.402 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 114/152 2024-04-19T02:14:46.402 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 115/152 2024-04-19T02:14:46.402 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 116/152 2024-04-19T02:14:46.402 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 117/152 2024-04-19T02:14:46.402 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 118/152 2024-04-19T02:14:46.402 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 119/152 2024-04-19T02:14:46.402 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 120/152 2024-04-19T02:14:46.403 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 121/152 2024-04-19T02:14:46.403 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 122/152 2024-04-19T02:14:46.403 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librados2-2:18.2.2-1237.g646b8c7d.el8.x86_64 123/152 2024-04-19T02:14:46.403 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 124/152 2024-04-19T02:14:46.403 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librbd1-2:18.2.2-1237.g646b8c7d.el8.x86_64 125/152 2024-04-19T02:14:46.403 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 126/152 2024-04-19T02:14:46.403 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el8.x86_64 127/152 2024-04-19T02:14:46.403 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 128/152 2024-04-19T02:14:46.403 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : elfutils-libelf-0.190-2.el8.x86_64 129/152 2024-04-19T02:14:46.403 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 130/152 2024-04-19T02:14:46.403 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : elfutils-libs-0.190-2.el8.x86_64 131/152 2024-04-19T02:14:46.403 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 132/152 2024-04-19T02:14:46.403 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libblkid-2.32.1-46.el8.x86_64 133/152 2024-04-19T02:14:46.403 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 134/152 2024-04-19T02:14:46.403 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libfdisk-2.32.1-46.el8.x86_64 135/152 2024-04-19T02:14:46.404 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 136/152 2024-04-19T02:14:46.404 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libmount-2.32.1-46.el8.x86_64 137/152 2024-04-19T02:14:46.404 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 138/152 2024-04-19T02:14:46.404 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libsmartcols-2.32.1-46.el8.x86_64 139/152 2024-04-19T02:14:46.404 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 140/152 2024-04-19T02:14:46.404 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libuuid-2.32.1-46.el8.x86_64 141/152 2024-04-19T02:14:46.404 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 142/152 2024-04-19T02:14:46.404 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openssl-1:1.1.1k-12.el8.x86_64 143/152 2024-04-19T02:14:46.404 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openssl-1:1.1.1k-9.el8.x86_64 144/152 2024-04-19T02:14:46.404 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8.x86_64 145/152 2024-04-19T02:14:46.404 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openssl-libs-1:1.1.1k-9.el8.x86_64 146/152 2024-04-19T02:14:46.404 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : util-linux-2.32.1-46.el8.x86_64 147/152 2024-04-19T02:14:46.404 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 148/152 2024-04-19T02:14:46.404 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : util-linux-user-2.32.1-46.el8.x86_64 149/152 2024-04-19T02:14:46.404 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 150/152 2024-04-19T02:14:46.405 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 151/152 2024-04-19T02:14:46.471 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: openssl-libs-1:1.1.1k-9.el8.x86_64 151/152 2024-04-19T02:14:46.635 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 152/152 2024-04-19T02:14:47.028 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 152/152 2024-04-19T02:14:47.028 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:14:47.028 INFO:teuthology.orchestra.run.smithi121.stdout:Upgraded: 2024-04-19T02:14:47.028 INFO:teuthology.orchestra.run.smithi121.stdout: elfutils-debuginfod-client-0.190-2.el8.x86_64 2024-04-19T02:14:47.029 INFO:teuthology.orchestra.run.smithi121.stdout: elfutils-libelf-0.190-2.el8.x86_64 2024-04-19T02:14:47.029 INFO:teuthology.orchestra.run.smithi121.stdout: elfutils-libs-0.190-2.el8.x86_64 2024-04-19T02:14:47.029 INFO:teuthology.orchestra.run.smithi121.stdout: libblkid-2.32.1-46.el8.x86_64 2024-04-19T02:14:47.029 INFO:teuthology.orchestra.run.smithi121.stdout: libfdisk-2.32.1-46.el8.x86_64 2024-04-19T02:14:47.029 INFO:teuthology.orchestra.run.smithi121.stdout: libmount-2.32.1-46.el8.x86_64 2024-04-19T02:14:47.029 INFO:teuthology.orchestra.run.smithi121.stdout: librados2-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:47.029 INFO:teuthology.orchestra.run.smithi121.stdout: librbd1-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:47.029 INFO:teuthology.orchestra.run.smithi121.stdout: libsmartcols-2.32.1-46.el8.x86_64 2024-04-19T02:14:47.029 INFO:teuthology.orchestra.run.smithi121.stdout: libuuid-2.32.1-46.el8.x86_64 2024-04-19T02:14:47.029 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-1:1.1.1k-12.el8.x86_64 2024-04-19T02:14:47.029 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-libs-1:1.1.1k-12.el8.x86_64 2024-04-19T02:14:47.029 INFO:teuthology.orchestra.run.smithi121.stdout: util-linux-2.32.1-46.el8.x86_64 2024-04-19T02:14:47.029 INFO:teuthology.orchestra.run.smithi121.stdout: util-linux-user-2.32.1-46.el8.x86_64 2024-04-19T02:14:47.029 INFO:teuthology.orchestra.run.smithi121.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-04-19T02:14:47.030 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2024-04-19T02:14:47.030 INFO:teuthology.orchestra.run.smithi121.stdout: automake-1.16.1-8.el8.noarch 2024-04-19T02:14:47.030 INFO:teuthology.orchestra.run.smithi121.stdout: bison-3.0.4-10.el8.x86_64 2024-04-19T02:14:47.030 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:47.030 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-base-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:47.030 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:47.030 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:47.030 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-grafana-dashboards-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T02:14:47.030 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-immutable-object-cache-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:47.030 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mds-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:47.030 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:47.030 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T02:14:47.031 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-dashboard-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T02:14:47.031 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T02:14:47.031 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-modules-core-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T02:14:47.031 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-rook-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T02:14:47.031 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mon-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:47.031 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-osd-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:47.031 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-prometheus-alerts-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T02:14:47.031 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-radosgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:47.031 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-selinux-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:47.031 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-test-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:47.031 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-volume-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T02:14:47.031 INFO:teuthology.orchestra.run.smithi121.stdout: cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T02:14:47.031 INFO:teuthology.orchestra.run.smithi121.stdout: elfutils-libelf-devel-0.190-2.el8.x86_64 2024-04-19T02:14:47.031 INFO:teuthology.orchestra.run.smithi121.stdout: flex-2.6.1-9.el8.x86_64 2024-04-19T02:14:47.032 INFO:teuthology.orchestra.run.smithi121.stdout: fuse-2.9.7-19.el8.x86_64 2024-04-19T02:14:47.032 INFO:teuthology.orchestra.run.smithi121.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-19T02:14:47.032 INFO:teuthology.orchestra.run.smithi121.stdout: jq-1.6-8.el8.x86_64 2024-04-19T02:14:47.032 INFO:teuthology.orchestra.run.smithi121.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-04-19T02:14:47.032 INFO:teuthology.orchestra.run.smithi121.stdout: krb5-devel-1.18.2-22.el8.x86_64 2024-04-19T02:14:47.032 INFO:teuthology.orchestra.run.smithi121.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-04-19T02:14:47.032 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs-devel-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:47.032 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs2-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:47.032 INFO:teuthology.orchestra.run.smithi121.stdout: libcephsqlite-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:47.032 INFO:teuthology.orchestra.run.smithi121.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2024-04-19T02:14:47.032 INFO:teuthology.orchestra.run.smithi121.stdout: libgfortran-8.5.0-21.el8.x86_64 2024-04-19T02:14:47.032 INFO:teuthology.orchestra.run.smithi121.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-19T02:14:47.032 INFO:teuthology.orchestra.run.smithi121.stdout: libquadmath-8.5.0-21.el8.x86_64 2024-04-19T02:14:47.032 INFO:teuthology.orchestra.run.smithi121.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-04-19T02:14:47.033 INFO:teuthology.orchestra.run.smithi121.stdout: librados-devel-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:47.033 INFO:teuthology.orchestra.run.smithi121.stdout: libradosstriper1-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:47.033 INFO:teuthology.orchestra.run.smithi121.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-04-19T02:14:47.033 INFO:teuthology.orchestra.run.smithi121.stdout: librgw2-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:47.033 INFO:teuthology.orchestra.run.smithi121.stdout: libselinux-devel-2.9-8.el8.x86_64 2024-04-19T02:14:47.033 INFO:teuthology.orchestra.run.smithi121.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-04-19T02:14:47.033 INFO:teuthology.orchestra.run.smithi121.stdout: libtool-2.4.6-25.el8.x86_64 2024-04-19T02:14:47.033 INFO:teuthology.orchestra.run.smithi121.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-19T02:14:47.033 INFO:teuthology.orchestra.run.smithi121.stdout: libuuid-devel-2.32.1-46.el8.x86_64 2024-04-19T02:14:47.033 INFO:teuthology.orchestra.run.smithi121.stdout: libverto-devel-0.3.2-2.el8.x86_64 2024-04-19T02:14:47.033 INFO:teuthology.orchestra.run.smithi121.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-04-19T02:14:47.033 INFO:teuthology.orchestra.run.smithi121.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-19T02:14:47.033 INFO:teuthology.orchestra.run.smithi121.stdout: oniguruma-6.8.2-3.el8.x86_64 2024-04-19T02:14:47.033 INFO:teuthology.orchestra.run.smithi121.stdout: openblas-0.3.15-4.el8.x86_64 2024-04-19T02:14:47.034 INFO:teuthology.orchestra.run.smithi121.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-04-19T02:14:47.034 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-devel-1:1.1.1k-12.el8.x86_64 2024-04-19T02:14:47.034 INFO:teuthology.orchestra.run.smithi121.stdout: pcre2-devel-10.32-3.el8.x86_64 2024-04-19T02:14:47.034 INFO:teuthology.orchestra.run.smithi121.stdout: pcre2-utf16-10.32-3.el8.x86_64 2024-04-19T02:14:47.034 INFO:teuthology.orchestra.run.smithi121.stdout: pcre2-utf32-10.32-3.el8.x86_64 2024-04-19T02:14:47.035 INFO:teuthology.orchestra.run.smithi121.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-04-19T02:14:47.035 INFO:teuthology.orchestra.run.smithi121.stdout: python3-babel-2.5.1-7.el8.noarch 2024-04-19T02:14:47.035 INFO:teuthology.orchestra.run.smithi121.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-19T02:14:47.035 INFO:teuthology.orchestra.run.smithi121.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-19T02:14:47.035 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-04-19T02:14:47.036 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-argparse-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:47.036 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:47.036 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cephfs-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:47.036 INFO:teuthology.orchestra.run.smithi121.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-04-19T02:14:47.036 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-19T02:14:47.036 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-19T02:14:47.036 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-19T02:14:47.036 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-04-19T02:14:47.036 INFO:teuthology.orchestra.run.smithi121.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-04-19T02:14:47.036 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-19T02:14:47.036 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-19T02:14:47.036 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jinja2-2.10.1-4.el8.noarch 2024-04-19T02:14:47.036 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-04-19T02:14:47.036 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-04-19T02:14:47.037 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-04-19T02:14:47.037 INFO:teuthology.orchestra.run.smithi121.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-04-19T02:14:47.037 INFO:teuthology.orchestra.run.smithi121.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-19T02:14:47.037 INFO:teuthology.orchestra.run.smithi121.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-19T02:14:47.037 INFO:teuthology.orchestra.run.smithi121.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-19T02:14:47.037 INFO:teuthology.orchestra.run.smithi121.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-19T02:14:47.037 INFO:teuthology.orchestra.run.smithi121.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-04-19T02:14:47.037 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-04-19T02:14:47.037 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-04-19T02:14:47.037 INFO:teuthology.orchestra.run.smithi121.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-04-19T02:14:47.037 INFO:teuthology.orchestra.run.smithi121.stdout: python3-packaging-16.8-9.el8.noarch 2024-04-19T02:14:47.037 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-19T02:14:47.037 INFO:teuthology.orchestra.run.smithi121.stdout: python3-portend-2.6-1.el8.noarch 2024-04-19T02:14:47.037 INFO:teuthology.orchestra.run.smithi121.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-19T02:14:47.038 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-19T02:14:47.038 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-04-19T02:14:47.038 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-04-19T02:14:47.038 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-19T02:14:47.038 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-19T02:14:47.038 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rados-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:47.038 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:47.038 INFO:teuthology.orchestra.run.smithi121.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-04-19T02:14:47.038 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-04-19T02:14:47.038 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:47.038 INFO:teuthology.orchestra.run.smithi121.stdout: python3-routes-2.4.1-12.el8.noarch 2024-04-19T02:14:47.038 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rsa-4.9-2.el8.noarch 2024-04-19T02:14:47.038 INFO:teuthology.orchestra.run.smithi121.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-04-19T02:14:47.039 INFO:teuthology.orchestra.run.smithi121.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-19T02:14:47.039 INFO:teuthology.orchestra.run.smithi121.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-19T02:14:47.039 INFO:teuthology.orchestra.run.smithi121.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-19T02:14:47.039 INFO:teuthology.orchestra.run.smithi121.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-19T02:14:47.039 INFO:teuthology.orchestra.run.smithi121.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-19T02:14:47.039 INFO:teuthology.orchestra.run.smithi121.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-19T02:14:47.039 INFO:teuthology.orchestra.run.smithi121.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-04-19T02:14:47.039 INFO:teuthology.orchestra.run.smithi121.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-19T02:14:47.039 INFO:teuthology.orchestra.run.smithi121.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-19T02:14:47.039 INFO:teuthology.orchestra.run.smithi121.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-19T02:14:47.039 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:47.039 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-mirror-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:47.039 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-nbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:47.039 INFO:teuthology.orchestra.run.smithi121.stdout: socat-1.7.4.1-1.el8.x86_64 2024-04-19T02:14:47.039 INFO:teuthology.orchestra.run.smithi121.stdout: thrift-0.13.0-2.el8.x86_64 2024-04-19T02:14:47.040 INFO:teuthology.orchestra.run.smithi121.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-04-19T02:14:47.040 INFO:teuthology.orchestra.run.smithi121.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-04-19T02:14:47.040 INFO:teuthology.orchestra.run.smithi121.stdout: zlib-devel-1.2.11-21.el8.x86_64 2024-04-19T02:14:47.040 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:14:47.040 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-04-19T02:14:47.237 DEBUG:teuthology.parallel:result is None 2024-04-19T02:14:47.246 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 152/152 2024-04-19T02:14:47.246 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-2:18.2.2-1237.g646b8c7d.el8.x86_64 1/152 2024-04-19T02:14:47.246 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-base-2:18.2.2-1237.g646b8c7d.el8.x86_64 2/152 2024-04-19T02:14:47.246 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 3/152 2024-04-19T02:14:47.246 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 4/152 2024-04-19T02:14:47.246 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1237.g646b8 5/152 2024-04-19T02:14:47.246 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mds-2:18.2.2-1237.g646b8c7d.el8.x86_64 6/152 2024-04-19T02:14:47.246 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-2:18.2.2-1237.g646b8c7d.el8.x86_64 7/152 2024-04-19T02:14:47.246 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mon-2:18.2.2-1237.g646b8c7d.el8.x86_64 8/152 2024-04-19T02:14:47.247 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-osd-2:18.2.2-1237.g646b8c7d.el8.x86_64 9/152 2024-04-19T02:14:47.247 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-radosgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 10/152 2024-04-19T02:14:47.247 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-selinux-2:18.2.2-1237.g646b8c7d.el8.x86_64 11/152 2024-04-19T02:14:47.247 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-test-2:18.2.2-1237.g646b8c7d.el8.x86_64 12/152 2024-04-19T02:14:47.247 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libcephfs-devel-2:18.2.2-1237.g646b8c7d.el8.x86_ 13/152 2024-04-19T02:14:47.247 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libcephfs2-2:18.2.2-1237.g646b8c7d.el8.x86_64 14/152 2024-04-19T02:14:47.247 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libcephsqlite-2:18.2.2-1237.g646b8c7d.el8.x86_64 15/152 2024-04-19T02:14:47.247 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librados-devel-2:18.2.2-1237.g646b8c7d.el8.x86_6 16/152 2024-04-19T02:14:47.247 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libradosstriper1-2:18.2.2-1237.g646b8c7d.el8.x86 17/152 2024-04-19T02:14:47.247 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librgw2-2:18.2.2-1237.g646b8c7d.el8.x86_64 18/152 2024-04-19T02:14:47.247 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1237.g646b8c7d.el 19/152 2024-04-19T02:14:47.247 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-ceph-common-2:18.2.2-1237.g646b8c7d.el8. 20/152 2024-04-19T02:14:47.247 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cephfs-2:18.2.2-1237.g646b8c7d.el8.x86_6 21/152 2024-04-19T02:14:47.248 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rados-2:18.2.2-1237.g646b8c7d.el8.x86_64 22/152 2024-04-19T02:14:47.248 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 23/152 2024-04-19T02:14:47.248 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 24/152 2024-04-19T02:14:47.248 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : rbd-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 25/152 2024-04-19T02:14:47.248 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : rbd-mirror-2:18.2.2-1237.g646b8c7d.el8.x86_64 26/152 2024-04-19T02:14:47.248 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : rbd-nbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 27/152 2024-04-19T02:14:47.248 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1237.g646b8c7d. 28/152 2024-04-19T02:14:47.249 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1237.g646b8c7d.el8.noa 29/152 2024-04-19T02:14:47.249 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1237.g646b8c7d.el8.n 30/152 2024-04-19T02:14:47.249 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1237.g646 31/152 2024-04-19T02:14:47.249 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1237.g646b8c7d.el 32/152 2024-04-19T02:14:47.249 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1237.g646b8c7d.el8.noarch 33/152 2024-04-19T02:14:47.249 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1237.g646b8c7d.e 34/152 2024-04-19T02:14:47.250 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-volume-2:18.2.2-1237.g646b8c7d.el8.noarch 35/152 2024-04-19T02:14:47.250 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 36/152 2024-04-19T02:14:47.250 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : automake-1.16.1-8.el8.noarch 37/152 2024-04-19T02:14:47.250 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : bison-3.0.4-10.el8.x86_64 38/152 2024-04-19T02:14:47.250 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : flex-2.6.1-9.el8.x86_64 39/152 2024-04-19T02:14:47.250 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : jq-1.6-8.el8.x86_64 40/152 2024-04-19T02:14:47.251 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 41/152 2024-04-19T02:14:47.251 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 42/152 2024-04-19T02:14:47.251 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 43/152 2024-04-19T02:14:47.251 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 44/152 2024-04-19T02:14:47.251 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 45/152 2024-04-19T02:14:47.251 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 46/152 2024-04-19T02:14:47.252 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 47/152 2024-04-19T02:14:47.252 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jinja2-2.10.1-4.el8.noarch 48/152 2024-04-19T02:14:47.252 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 49/152 2024-04-19T02:14:47.252 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 50/152 2024-04-19T02:14:47.252 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 51/152 2024-04-19T02:14:47.252 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 52/152 2024-04-19T02:14:47.252 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 53/152 2024-04-19T02:14:47.253 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 54/152 2024-04-19T02:14:47.253 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 55/152 2024-04-19T02:14:47.253 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 56/152 2024-04-19T02:14:47.253 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 57/152 2024-04-19T02:14:47.253 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 58/152 2024-04-19T02:14:47.253 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 59/152 2024-04-19T02:14:47.254 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 60/152 2024-04-19T02:14:47.254 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 61/152 2024-04-19T02:14:47.254 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 62/152 2024-04-19T02:14:47.254 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 63/152 2024-04-19T02:14:47.254 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : elfutils-libelf-devel-0.190-2.el8.x86_64 64/152 2024-04-19T02:14:47.254 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : fuse-2.9.7-19.el8.x86_64 65/152 2024-04-19T02:14:47.255 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 66/152 2024-04-19T02:14:47.255 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 67/152 2024-04-19T02:14:47.255 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 68/152 2024-04-19T02:14:47.255 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 69/152 2024-04-19T02:14:47.255 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 70/152 2024-04-19T02:14:47.255 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 71/152 2024-04-19T02:14:47.256 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 72/152 2024-04-19T02:14:47.256 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 73/152 2024-04-19T02:14:47.256 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 74/152 2024-04-19T02:14:47.256 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libuuid-devel-2.32.1-46.el8.x86_64 75/152 2024-04-19T02:14:47.256 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 76/152 2024-04-19T02:14:47.256 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 77/152 2024-04-19T02:14:47.256 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8.x86_64 78/152 2024-04-19T02:14:47.257 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 79/152 2024-04-19T02:14:47.257 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 80/152 2024-04-19T02:14:47.257 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 81/152 2024-04-19T02:14:47.257 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 82/152 2024-04-19T02:14:47.257 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 83/152 2024-04-19T02:14:47.257 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 84/152 2024-04-19T02:14:47.258 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 85/152 2024-04-19T02:14:47.258 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 86/152 2024-04-19T02:14:47.258 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 87/152 2024-04-19T02:14:47.258 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 88/152 2024-04-19T02:14:47.258 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 89/152 2024-04-19T02:14:47.258 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 90/152 2024-04-19T02:14:47.259 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 91/152 2024-04-19T02:14:47.259 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 92/152 2024-04-19T02:14:47.259 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 93/152 2024-04-19T02:14:47.259 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 94/152 2024-04-19T02:14:47.259 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 95/152 2024-04-19T02:14:47.259 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 96/152 2024-04-19T02:14:47.260 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 97/152 2024-04-19T02:14:47.260 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 98/152 2024-04-19T02:14:47.260 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 99/152 2024-04-19T02:14:47.260 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 100/152 2024-04-19T02:14:47.260 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 101/152 2024-04-19T02:14:47.260 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 102/152 2024-04-19T02:14:47.261 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 103/152 2024-04-19T02:14:47.261 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 104/152 2024-04-19T02:14:47.261 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 105/152 2024-04-19T02:14:47.261 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 106/152 2024-04-19T02:14:47.261 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 107/152 2024-04-19T02:14:47.261 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 108/152 2024-04-19T02:14:47.262 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-portend-2.6-1.el8.noarch 109/152 2024-04-19T02:14:47.262 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 110/152 2024-04-19T02:14:47.262 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 111/152 2024-04-19T02:14:47.262 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 112/152 2024-04-19T02:14:47.262 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 113/152 2024-04-19T02:14:47.263 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 114/152 2024-04-19T02:14:47.263 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 115/152 2024-04-19T02:14:47.263 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 116/152 2024-04-19T02:14:47.263 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 117/152 2024-04-19T02:14:47.263 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 118/152 2024-04-19T02:14:47.263 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 119/152 2024-04-19T02:14:47.264 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 120/152 2024-04-19T02:14:47.264 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 121/152 2024-04-19T02:14:47.264 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 122/152 2024-04-19T02:14:47.264 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librados2-2:18.2.2-1237.g646b8c7d.el8.x86_64 123/152 2024-04-19T02:14:47.264 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 124/152 2024-04-19T02:14:47.264 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librbd1-2:18.2.2-1237.g646b8c7d.el8.x86_64 125/152 2024-04-19T02:14:47.265 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 126/152 2024-04-19T02:14:47.265 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el8.x86_64 127/152 2024-04-19T02:14:47.265 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 128/152 2024-04-19T02:14:47.265 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : elfutils-libelf-0.190-2.el8.x86_64 129/152 2024-04-19T02:14:47.265 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 130/152 2024-04-19T02:14:47.266 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : elfutils-libs-0.190-2.el8.x86_64 131/152 2024-04-19T02:14:47.266 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 132/152 2024-04-19T02:14:47.266 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libblkid-2.32.1-46.el8.x86_64 133/152 2024-04-19T02:14:47.266 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 134/152 2024-04-19T02:14:47.266 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libfdisk-2.32.1-46.el8.x86_64 135/152 2024-04-19T02:14:47.267 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 136/152 2024-04-19T02:14:47.267 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libmount-2.32.1-46.el8.x86_64 137/152 2024-04-19T02:14:47.267 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 138/152 2024-04-19T02:14:47.267 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libsmartcols-2.32.1-46.el8.x86_64 139/152 2024-04-19T02:14:47.267 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 140/152 2024-04-19T02:14:47.267 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libuuid-2.32.1-46.el8.x86_64 141/152 2024-04-19T02:14:47.268 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 142/152 2024-04-19T02:14:47.268 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-1:1.1.1k-12.el8.x86_64 143/152 2024-04-19T02:14:47.268 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-1:1.1.1k-9.el8.x86_64 144/152 2024-04-19T02:14:47.268 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8.x86_64 145/152 2024-04-19T02:14:47.268 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-libs-1:1.1.1k-9.el8.x86_64 146/152 2024-04-19T02:14:47.268 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : util-linux-2.32.1-46.el8.x86_64 147/152 2024-04-19T02:14:47.269 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 148/152 2024-04-19T02:14:47.269 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : util-linux-user-2.32.1-46.el8.x86_64 149/152 2024-04-19T02:14:47.269 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 150/152 2024-04-19T02:14:47.269 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 151/152 2024-04-19T02:14:48.178 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 152/152 2024-04-19T02:14:48.179 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-19T02:14:48.179 INFO:teuthology.orchestra.run.smithi177.stdout:Upgraded: 2024-04-19T02:14:48.179 INFO:teuthology.orchestra.run.smithi177.stdout: elfutils-debuginfod-client-0.190-2.el8.x86_64 2024-04-19T02:14:48.179 INFO:teuthology.orchestra.run.smithi177.stdout: elfutils-libelf-0.190-2.el8.x86_64 2024-04-19T02:14:48.179 INFO:teuthology.orchestra.run.smithi177.stdout: elfutils-libs-0.190-2.el8.x86_64 2024-04-19T02:14:48.179 INFO:teuthology.orchestra.run.smithi177.stdout: libblkid-2.32.1-46.el8.x86_64 2024-04-19T02:14:48.179 INFO:teuthology.orchestra.run.smithi177.stdout: libfdisk-2.32.1-46.el8.x86_64 2024-04-19T02:14:48.179 INFO:teuthology.orchestra.run.smithi177.stdout: libmount-2.32.1-46.el8.x86_64 2024-04-19T02:14:48.179 INFO:teuthology.orchestra.run.smithi177.stdout: librados2-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:48.179 INFO:teuthology.orchestra.run.smithi177.stdout: librbd1-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:48.179 INFO:teuthology.orchestra.run.smithi177.stdout: libsmartcols-2.32.1-46.el8.x86_64 2024-04-19T02:14:48.179 INFO:teuthology.orchestra.run.smithi177.stdout: libuuid-2.32.1-46.el8.x86_64 2024-04-19T02:14:48.179 INFO:teuthology.orchestra.run.smithi177.stdout: openssl-1:1.1.1k-12.el8.x86_64 2024-04-19T02:14:48.180 INFO:teuthology.orchestra.run.smithi177.stdout: openssl-libs-1:1.1.1k-12.el8.x86_64 2024-04-19T02:14:48.180 INFO:teuthology.orchestra.run.smithi177.stdout: util-linux-2.32.1-46.el8.x86_64 2024-04-19T02:14:48.180 INFO:teuthology.orchestra.run.smithi177.stdout: util-linux-user-2.32.1-46.el8.x86_64 2024-04-19T02:14:48.180 INFO:teuthology.orchestra.run.smithi177.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-04-19T02:14:48.180 INFO:teuthology.orchestra.run.smithi177.stdout:Installed: 2024-04-19T02:14:48.180 INFO:teuthology.orchestra.run.smithi177.stdout: automake-1.16.1-8.el8.noarch 2024-04-19T02:14:48.180 INFO:teuthology.orchestra.run.smithi177.stdout: bison-3.0.4-10.el8.x86_64 2024-04-19T02:14:48.180 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:48.180 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-base-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:48.180 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:48.180 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:48.181 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-grafana-dashboards-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T02:14:48.181 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-immutable-object-cache-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:48.181 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mds-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:48.181 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:48.181 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T02:14:48.181 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-dashboard-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T02:14:48.181 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T02:14:48.181 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-modules-core-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T02:14:48.181 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-rook-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T02:14:48.181 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mon-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:48.181 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-osd-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:48.181 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-prometheus-alerts-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T02:14:48.181 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-radosgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:48.182 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-selinux-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:48.182 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-test-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:48.182 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-volume-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T02:14:48.182 INFO:teuthology.orchestra.run.smithi177.stdout: cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T02:14:48.182 INFO:teuthology.orchestra.run.smithi177.stdout: elfutils-libelf-devel-0.190-2.el8.x86_64 2024-04-19T02:14:48.182 INFO:teuthology.orchestra.run.smithi177.stdout: flex-2.6.1-9.el8.x86_64 2024-04-19T02:14:48.182 INFO:teuthology.orchestra.run.smithi177.stdout: fuse-2.9.7-19.el8.x86_64 2024-04-19T02:14:48.182 INFO:teuthology.orchestra.run.smithi177.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-19T02:14:48.182 INFO:teuthology.orchestra.run.smithi177.stdout: jq-1.6-8.el8.x86_64 2024-04-19T02:14:48.182 INFO:teuthology.orchestra.run.smithi177.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-04-19T02:14:48.182 INFO:teuthology.orchestra.run.smithi177.stdout: krb5-devel-1.18.2-22.el8.x86_64 2024-04-19T02:14:48.182 INFO:teuthology.orchestra.run.smithi177.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-04-19T02:14:48.183 INFO:teuthology.orchestra.run.smithi177.stdout: libcephfs-devel-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:48.183 INFO:teuthology.orchestra.run.smithi177.stdout: libcephfs2-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:48.183 INFO:teuthology.orchestra.run.smithi177.stdout: libcephsqlite-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:48.183 INFO:teuthology.orchestra.run.smithi177.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2024-04-19T02:14:48.183 INFO:teuthology.orchestra.run.smithi177.stdout: libgfortran-8.5.0-21.el8.x86_64 2024-04-19T02:14:48.183 INFO:teuthology.orchestra.run.smithi177.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-19T02:14:48.183 INFO:teuthology.orchestra.run.smithi177.stdout: libquadmath-8.5.0-21.el8.x86_64 2024-04-19T02:14:48.183 INFO:teuthology.orchestra.run.smithi177.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-04-19T02:14:48.183 INFO:teuthology.orchestra.run.smithi177.stdout: librados-devel-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:48.183 INFO:teuthology.orchestra.run.smithi177.stdout: libradosstriper1-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:48.184 INFO:teuthology.orchestra.run.smithi177.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-04-19T02:14:48.184 INFO:teuthology.orchestra.run.smithi177.stdout: librgw2-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:48.184 INFO:teuthology.orchestra.run.smithi177.stdout: libselinux-devel-2.9-8.el8.x86_64 2024-04-19T02:14:48.184 INFO:teuthology.orchestra.run.smithi177.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-04-19T02:14:48.184 INFO:teuthology.orchestra.run.smithi177.stdout: libtool-2.4.6-25.el8.x86_64 2024-04-19T02:14:48.184 INFO:teuthology.orchestra.run.smithi177.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-19T02:14:48.184 INFO:teuthology.orchestra.run.smithi177.stdout: libuuid-devel-2.32.1-46.el8.x86_64 2024-04-19T02:14:48.184 INFO:teuthology.orchestra.run.smithi177.stdout: libverto-devel-0.3.2-2.el8.x86_64 2024-04-19T02:14:48.184 INFO:teuthology.orchestra.run.smithi177.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-04-19T02:14:48.184 INFO:teuthology.orchestra.run.smithi177.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-19T02:14:48.184 INFO:teuthology.orchestra.run.smithi177.stdout: oniguruma-6.8.2-3.el8.x86_64 2024-04-19T02:14:48.185 INFO:teuthology.orchestra.run.smithi177.stdout: openblas-0.3.15-4.el8.x86_64 2024-04-19T02:14:48.185 INFO:teuthology.orchestra.run.smithi177.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-04-19T02:14:48.185 INFO:teuthology.orchestra.run.smithi177.stdout: openssl-devel-1:1.1.1k-12.el8.x86_64 2024-04-19T02:14:48.185 INFO:teuthology.orchestra.run.smithi177.stdout: pcre2-devel-10.32-3.el8.x86_64 2024-04-19T02:14:48.185 INFO:teuthology.orchestra.run.smithi177.stdout: pcre2-utf16-10.32-3.el8.x86_64 2024-04-19T02:14:48.185 INFO:teuthology.orchestra.run.smithi177.stdout: pcre2-utf32-10.32-3.el8.x86_64 2024-04-19T02:14:48.185 INFO:teuthology.orchestra.run.smithi177.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-04-19T02:14:48.185 INFO:teuthology.orchestra.run.smithi177.stdout: python3-babel-2.5.1-7.el8.noarch 2024-04-19T02:14:48.185 INFO:teuthology.orchestra.run.smithi177.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-19T02:14:48.185 INFO:teuthology.orchestra.run.smithi177.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-19T02:14:48.185 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-04-19T02:14:48.185 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-argparse-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:48.186 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:48.186 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cephfs-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:48.186 INFO:teuthology.orchestra.run.smithi177.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-04-19T02:14:48.186 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-19T02:14:48.186 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-19T02:14:48.186 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-19T02:14:48.186 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-04-19T02:14:48.186 INFO:teuthology.orchestra.run.smithi177.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-04-19T02:14:48.186 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-19T02:14:48.186 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-19T02:14:48.186 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jinja2-2.10.1-4.el8.noarch 2024-04-19T02:14:48.186 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-04-19T02:14:48.187 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-04-19T02:14:48.187 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-04-19T02:14:48.187 INFO:teuthology.orchestra.run.smithi177.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-04-19T02:14:48.187 INFO:teuthology.orchestra.run.smithi177.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-19T02:14:48.187 INFO:teuthology.orchestra.run.smithi177.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-19T02:14:48.187 INFO:teuthology.orchestra.run.smithi177.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-19T02:14:48.187 INFO:teuthology.orchestra.run.smithi177.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-19T02:14:48.187 INFO:teuthology.orchestra.run.smithi177.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-04-19T02:14:48.187 INFO:teuthology.orchestra.run.smithi177.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-04-19T02:14:48.187 INFO:teuthology.orchestra.run.smithi177.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-04-19T02:14:48.187 INFO:teuthology.orchestra.run.smithi177.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-04-19T02:14:48.188 INFO:teuthology.orchestra.run.smithi177.stdout: python3-packaging-16.8-9.el8.noarch 2024-04-19T02:14:48.188 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-19T02:14:48.188 INFO:teuthology.orchestra.run.smithi177.stdout: python3-portend-2.6-1.el8.noarch 2024-04-19T02:14:48.188 INFO:teuthology.orchestra.run.smithi177.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-19T02:14:48.188 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-19T02:14:48.188 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-04-19T02:14:48.188 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-04-19T02:14:48.188 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-19T02:14:48.188 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-19T02:14:48.188 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rados-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:48.188 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:48.188 INFO:teuthology.orchestra.run.smithi177.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-04-19T02:14:48.188 INFO:teuthology.orchestra.run.smithi177.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-04-19T02:14:48.188 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:48.189 INFO:teuthology.orchestra.run.smithi177.stdout: python3-routes-2.4.1-12.el8.noarch 2024-04-19T02:14:48.189 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rsa-4.9-2.el8.noarch 2024-04-19T02:14:48.189 INFO:teuthology.orchestra.run.smithi177.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-04-19T02:14:48.189 INFO:teuthology.orchestra.run.smithi177.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-19T02:14:48.189 INFO:teuthology.orchestra.run.smithi177.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-19T02:14:48.189 INFO:teuthology.orchestra.run.smithi177.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-19T02:14:48.189 INFO:teuthology.orchestra.run.smithi177.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-19T02:14:48.189 INFO:teuthology.orchestra.run.smithi177.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-19T02:14:48.189 INFO:teuthology.orchestra.run.smithi177.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-19T02:14:48.189 INFO:teuthology.orchestra.run.smithi177.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-04-19T02:14:48.189 INFO:teuthology.orchestra.run.smithi177.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-19T02:14:48.189 INFO:teuthology.orchestra.run.smithi177.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-19T02:14:48.189 INFO:teuthology.orchestra.run.smithi177.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-19T02:14:48.189 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:48.190 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-mirror-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:48.190 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-nbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:48.190 INFO:teuthology.orchestra.run.smithi177.stdout: socat-1.7.4.1-1.el8.x86_64 2024-04-19T02:14:48.190 INFO:teuthology.orchestra.run.smithi177.stdout: thrift-0.13.0-2.el8.x86_64 2024-04-19T02:14:48.190 INFO:teuthology.orchestra.run.smithi177.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-04-19T02:14:48.190 INFO:teuthology.orchestra.run.smithi177.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-04-19T02:14:48.190 INFO:teuthology.orchestra.run.smithi177.stdout: zlib-devel-1.2.11-21.el8.x86_64 2024-04-19T02:14:48.190 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-19T02:14:48.190 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-04-19T02:14:48.402 DEBUG:teuthology.parallel:result is None 2024-04-19T02:14:49.141 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 152/152 2024-04-19T02:14:49.141 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-19T02:14:49.141 INFO:teuthology.orchestra.run.smithi174.stdout:Upgraded: 2024-04-19T02:14:49.141 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-debuginfod-client-0.190-2.el8.x86_64 2024-04-19T02:14:49.142 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-libelf-0.190-2.el8.x86_64 2024-04-19T02:14:49.142 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-libs-0.190-2.el8.x86_64 2024-04-19T02:14:49.142 INFO:teuthology.orchestra.run.smithi174.stdout: libblkid-2.32.1-46.el8.x86_64 2024-04-19T02:14:49.142 INFO:teuthology.orchestra.run.smithi174.stdout: libfdisk-2.32.1-46.el8.x86_64 2024-04-19T02:14:49.142 INFO:teuthology.orchestra.run.smithi174.stdout: libmount-2.32.1-46.el8.x86_64 2024-04-19T02:14:49.142 INFO:teuthology.orchestra.run.smithi174.stdout: librados2-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:49.142 INFO:teuthology.orchestra.run.smithi174.stdout: librbd1-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:49.142 INFO:teuthology.orchestra.run.smithi174.stdout: libsmartcols-2.32.1-46.el8.x86_64 2024-04-19T02:14:49.142 INFO:teuthology.orchestra.run.smithi174.stdout: libuuid-2.32.1-46.el8.x86_64 2024-04-19T02:14:49.142 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-1:1.1.1k-12.el8.x86_64 2024-04-19T02:14:49.142 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-libs-1:1.1.1k-12.el8.x86_64 2024-04-19T02:14:49.142 INFO:teuthology.orchestra.run.smithi174.stdout: util-linux-2.32.1-46.el8.x86_64 2024-04-19T02:14:49.142 INFO:teuthology.orchestra.run.smithi174.stdout: util-linux-user-2.32.1-46.el8.x86_64 2024-04-19T02:14:49.143 INFO:teuthology.orchestra.run.smithi174.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-04-19T02:14:49.143 INFO:teuthology.orchestra.run.smithi174.stdout:Installed: 2024-04-19T02:14:49.143 INFO:teuthology.orchestra.run.smithi174.stdout: automake-1.16.1-8.el8.noarch 2024-04-19T02:14:49.143 INFO:teuthology.orchestra.run.smithi174.stdout: bison-3.0.4-10.el8.x86_64 2024-04-19T02:14:49.143 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:49.143 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-base-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:49.143 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:49.143 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:49.143 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-grafana-dashboards-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T02:14:49.143 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-immutable-object-cache-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:49.143 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mds-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:49.143 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:49.143 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T02:14:49.143 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-dashboard-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T02:14:49.144 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T02:14:49.144 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-modules-core-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T02:14:49.144 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-rook-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T02:14:49.144 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mon-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:49.144 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-osd-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:49.144 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-prometheus-alerts-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T02:14:49.144 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-radosgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:49.144 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-selinux-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:49.144 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-test-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:49.144 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-volume-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T02:14:49.144 INFO:teuthology.orchestra.run.smithi174.stdout: cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T02:14:49.144 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-libelf-devel-0.190-2.el8.x86_64 2024-04-19T02:14:49.144 INFO:teuthology.orchestra.run.smithi174.stdout: flex-2.6.1-9.el8.x86_64 2024-04-19T02:14:49.144 INFO:teuthology.orchestra.run.smithi174.stdout: fuse-2.9.7-19.el8.x86_64 2024-04-19T02:14:49.145 INFO:teuthology.orchestra.run.smithi174.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-19T02:14:49.145 INFO:teuthology.orchestra.run.smithi174.stdout: jq-1.6-8.el8.x86_64 2024-04-19T02:14:49.145 INFO:teuthology.orchestra.run.smithi174.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-04-19T02:14:49.145 INFO:teuthology.orchestra.run.smithi174.stdout: krb5-devel-1.18.2-22.el8.x86_64 2024-04-19T02:14:49.145 INFO:teuthology.orchestra.run.smithi174.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-04-19T02:14:49.145 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs-devel-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:49.145 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs2-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:49.145 INFO:teuthology.orchestra.run.smithi174.stdout: libcephsqlite-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:49.145 INFO:teuthology.orchestra.run.smithi174.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2024-04-19T02:14:49.145 INFO:teuthology.orchestra.run.smithi174.stdout: libgfortran-8.5.0-21.el8.x86_64 2024-04-19T02:14:49.145 INFO:teuthology.orchestra.run.smithi174.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-19T02:14:49.145 INFO:teuthology.orchestra.run.smithi174.stdout: libquadmath-8.5.0-21.el8.x86_64 2024-04-19T02:14:49.145 INFO:teuthology.orchestra.run.smithi174.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-04-19T02:14:49.145 INFO:teuthology.orchestra.run.smithi174.stdout: librados-devel-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:49.145 INFO:teuthology.orchestra.run.smithi174.stdout: libradosstriper1-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:49.146 INFO:teuthology.orchestra.run.smithi174.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-04-19T02:14:49.146 INFO:teuthology.orchestra.run.smithi174.stdout: librgw2-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:49.146 INFO:teuthology.orchestra.run.smithi174.stdout: libselinux-devel-2.9-8.el8.x86_64 2024-04-19T02:14:49.146 INFO:teuthology.orchestra.run.smithi174.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-04-19T02:14:49.146 INFO:teuthology.orchestra.run.smithi174.stdout: libtool-2.4.6-25.el8.x86_64 2024-04-19T02:14:49.146 INFO:teuthology.orchestra.run.smithi174.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-19T02:14:49.146 INFO:teuthology.orchestra.run.smithi174.stdout: libuuid-devel-2.32.1-46.el8.x86_64 2024-04-19T02:14:49.146 INFO:teuthology.orchestra.run.smithi174.stdout: libverto-devel-0.3.2-2.el8.x86_64 2024-04-19T02:14:49.146 INFO:teuthology.orchestra.run.smithi174.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-04-19T02:14:49.146 INFO:teuthology.orchestra.run.smithi174.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-19T02:14:49.146 INFO:teuthology.orchestra.run.smithi174.stdout: oniguruma-6.8.2-3.el8.x86_64 2024-04-19T02:14:49.146 INFO:teuthology.orchestra.run.smithi174.stdout: openblas-0.3.15-4.el8.x86_64 2024-04-19T02:14:49.146 INFO:teuthology.orchestra.run.smithi174.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-04-19T02:14:49.147 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-devel-1:1.1.1k-12.el8.x86_64 2024-04-19T02:14:49.147 INFO:teuthology.orchestra.run.smithi174.stdout: pcre2-devel-10.32-3.el8.x86_64 2024-04-19T02:14:49.147 INFO:teuthology.orchestra.run.smithi174.stdout: pcre2-utf16-10.32-3.el8.x86_64 2024-04-19T02:14:49.147 INFO:teuthology.orchestra.run.smithi174.stdout: pcre2-utf32-10.32-3.el8.x86_64 2024-04-19T02:14:49.147 INFO:teuthology.orchestra.run.smithi174.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-04-19T02:14:49.147 INFO:teuthology.orchestra.run.smithi174.stdout: python3-babel-2.5.1-7.el8.noarch 2024-04-19T02:14:49.147 INFO:teuthology.orchestra.run.smithi174.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-19T02:14:49.147 INFO:teuthology.orchestra.run.smithi174.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-19T02:14:49.147 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-04-19T02:14:49.147 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-argparse-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:49.147 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:49.147 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cephfs-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:49.147 INFO:teuthology.orchestra.run.smithi174.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-04-19T02:14:49.147 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-19T02:14:49.147 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-19T02:14:49.148 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-19T02:14:49.148 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-04-19T02:14:49.148 INFO:teuthology.orchestra.run.smithi174.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-04-19T02:14:49.148 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-19T02:14:49.148 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-19T02:14:49.148 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jinja2-2.10.1-4.el8.noarch 2024-04-19T02:14:49.148 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-04-19T02:14:49.148 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-04-19T02:14:49.148 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-04-19T02:14:49.148 INFO:teuthology.orchestra.run.smithi174.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-04-19T02:14:49.148 INFO:teuthology.orchestra.run.smithi174.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-19T02:14:49.148 INFO:teuthology.orchestra.run.smithi174.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-19T02:14:49.148 INFO:teuthology.orchestra.run.smithi174.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-19T02:14:49.148 INFO:teuthology.orchestra.run.smithi174.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-19T02:14:49.148 INFO:teuthology.orchestra.run.smithi174.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-04-19T02:14:49.149 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-04-19T02:14:49.149 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-04-19T02:14:49.149 INFO:teuthology.orchestra.run.smithi174.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-04-19T02:14:49.149 INFO:teuthology.orchestra.run.smithi174.stdout: python3-packaging-16.8-9.el8.noarch 2024-04-19T02:14:49.149 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-19T02:14:49.149 INFO:teuthology.orchestra.run.smithi174.stdout: python3-portend-2.6-1.el8.noarch 2024-04-19T02:14:49.149 INFO:teuthology.orchestra.run.smithi174.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-19T02:14:49.149 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-19T02:14:49.149 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-04-19T02:14:49.149 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-04-19T02:14:49.149 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-19T02:14:49.149 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-19T02:14:49.149 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rados-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:49.149 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:49.150 INFO:teuthology.orchestra.run.smithi174.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-04-19T02:14:49.150 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-04-19T02:14:49.150 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:49.150 INFO:teuthology.orchestra.run.smithi174.stdout: python3-routes-2.4.1-12.el8.noarch 2024-04-19T02:14:49.150 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rsa-4.9-2.el8.noarch 2024-04-19T02:14:49.150 INFO:teuthology.orchestra.run.smithi174.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-04-19T02:14:49.150 INFO:teuthology.orchestra.run.smithi174.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-19T02:14:49.150 INFO:teuthology.orchestra.run.smithi174.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-19T02:14:49.150 INFO:teuthology.orchestra.run.smithi174.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-19T02:14:49.150 INFO:teuthology.orchestra.run.smithi174.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-19T02:14:49.150 INFO:teuthology.orchestra.run.smithi174.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-19T02:14:49.150 INFO:teuthology.orchestra.run.smithi174.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-19T02:14:49.150 INFO:teuthology.orchestra.run.smithi174.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-04-19T02:14:49.150 INFO:teuthology.orchestra.run.smithi174.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-19T02:14:49.150 INFO:teuthology.orchestra.run.smithi174.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-19T02:14:49.151 INFO:teuthology.orchestra.run.smithi174.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-19T02:14:49.151 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:49.151 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-mirror-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:49.151 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-nbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T02:14:49.151 INFO:teuthology.orchestra.run.smithi174.stdout: socat-1.7.4.1-1.el8.x86_64 2024-04-19T02:14:49.151 INFO:teuthology.orchestra.run.smithi174.stdout: thrift-0.13.0-2.el8.x86_64 2024-04-19T02:14:49.151 INFO:teuthology.orchestra.run.smithi174.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-04-19T02:14:49.151 INFO:teuthology.orchestra.run.smithi174.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-04-19T02:14:49.151 INFO:teuthology.orchestra.run.smithi174.stdout: zlib-devel-1.2.11-21.el8.x86_64 2024-04-19T02:14:49.152 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-19T02:14:49.152 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2024-04-19T02:14:49.388 DEBUG:teuthology.parallel:result is None 2024-04-19T02:14:49.389 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T02:14:49.614 DEBUG:teuthology.orchestra.run.smithi121:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-19T02:14:49.639 INFO:teuthology.orchestra.run.smithi121.stdout:18.2.2-1237.g646b8c7d.el8 2024-04-19T02:14:49.640 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1237.g646b8c7d.el8 2024-04-19T02:14:49.640 INFO:teuthology.task.install:The correct ceph version 18.2.2-1237.g646b8c7d is installed. 2024-04-19T02:14:49.642 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T02:14:49.780 DEBUG:teuthology.orchestra.run.smithi153:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-19T02:14:49.808 INFO:teuthology.orchestra.run.smithi153.stdout:18.2.2-1237.g646b8c7d.el8 2024-04-19T02:14:49.808 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1237.g646b8c7d.el8 2024-04-19T02:14:49.808 INFO:teuthology.task.install:The correct ceph version 18.2.2-1237.g646b8c7d is installed. 2024-04-19T02:14:49.810 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T02:14:49.948 DEBUG:teuthology.orchestra.run.smithi174:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-19T02:14:49.971 INFO:teuthology.orchestra.run.smithi174.stdout:18.2.2-1237.g646b8c7d.el8 2024-04-19T02:14:49.971 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1237.g646b8c7d.el8 2024-04-19T02:14:49.972 INFO:teuthology.task.install:The correct ceph version 18.2.2-1237.g646b8c7d is installed. 2024-04-19T02:14:49.974 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T02:14:50.123 DEBUG:teuthology.orchestra.run.smithi177:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-19T02:14:50.148 INFO:teuthology.orchestra.run.smithi177.stdout:18.2.2-1237.g646b8c7d.el8 2024-04-19T02:14:50.148 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1237.g646b8c7d.el8 2024-04-19T02:14:50.148 INFO:teuthology.task.install:The correct ceph version 18.2.2-1237.g646b8c7d is installed. 2024-04-19T02:14:50.150 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-19T02:14:50.150 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-04-19T02:14:50.150 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-19T02:14:50.187 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-04-19T02:14:50.187 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-19T02:14:50.223 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-19T02:14:50.223 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-19T02:14:50.253 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-19T02:14:50.253 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-19T02:14:50.284 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-19T02:14:50.285 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-04-19T02:14:50.285 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/daemon-helper 2024-04-19T02:14:50.317 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-19T02:14:50.387 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-04-19T02:14:50.388 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/daemon-helper 2024-04-19T02:14:50.420 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-19T02:14:50.491 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-19T02:14:50.491 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/daemon-helper 2024-04-19T02:14:50.518 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-19T02:14:50.585 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-19T02:14:50.585 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/usr/bin/daemon-helper 2024-04-19T02:14:50.617 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-19T02:14:50.689 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-19T02:14:50.689 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-04-19T02:14:50.689 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-19T02:14:50.721 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-19T02:14:50.792 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-04-19T02:14:50.792 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-19T02:14:50.824 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-19T02:14:50.894 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-19T02:14:50.894 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-19T02:14:50.923 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-19T02:14:50.990 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-19T02:14:50.990 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-19T02:14:51.023 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-19T02:14:51.094 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-19T02:14:51.094 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-04-19T02:14:51.095 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/stdin-killer 2024-04-19T02:14:51.127 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-19T02:14:51.197 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-04-19T02:14:51.198 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/stdin-killer 2024-04-19T02:14:51.230 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-19T02:14:51.301 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-19T02:14:51.301 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/stdin-killer 2024-04-19T02:14:51.327 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-19T02:14:51.394 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-19T02:14:51.394 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/usr/bin/stdin-killer 2024-04-19T02:14:51.430 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-19T02:14:51.501 INFO:teuthology.run_tasks:Running task ceph... 2024-04-19T02:14:51.594 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-19T02:14:51.594 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 777 /var/log/ceph 2024-04-19T02:14:51.597 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 777 /var/log/ceph 2024-04-19T02:14:51.599 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 777 /var/log/ceph 2024-04-19T02:14:51.601 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 777 /var/log/ceph 2024-04-19T02:14:51.631 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-19T02:14:51.632 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-19T02:14:51.669 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-19T02:14:51.672 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-19T02:14:51.674 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-19T02:14:51.704 INFO:tasks.ceph:Creating extra log directories... 2024-04-19T02:14:51.705 DEBUG:teuthology.orchestra.run.smithi121:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-19T02:14:51.740 DEBUG:teuthology.orchestra.run.smithi153:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-19T02:14:51.743 DEBUG:teuthology.orchestra.run.smithi174:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-19T02:14:51.745 DEBUG:teuthology.orchestra.run.smithi177:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-19T02:14:51.787 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-19T02:14:51.787 INFO:tasks.ceph:config {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-19T02:14:51.787 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662845', 'branch': 'reef', 'description': 'powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-stupid powercycle/default supported-all-distro/centos_8 tasks/admin_socket_objecter_requests thrashosds-health}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7662845', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'reef'}, 'ceph': {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef', 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 930, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'], ['osd.0'], ['osd.1'], ['osd.2']], 'seed': 2879, 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d', 'sleep_before_teardown': 0, 'subset': '2/4', 'suite': 'powercycle', 'suite_branch': 'reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_646b8c7d293d8ec31a40c69f7b3237b19c1be24d/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d', 'targets': {'smithi121.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLEAN8P2ENYKn08Dp1X5HdIFUD4fYZA1EvzZ4RzsK8E5knWiOV6Sq4vcfh+rhJ+4K7vy6TmLdzNJyiro+1tTqyw=', 'smithi153.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBImLo8VPPUYtpeizb/SWI/4v5lwGoDr3GgXvIgGNYRC0e/s5cjxTlmzexK9Et6mhClGt57AHCDveAmgY7c8J77Y=', 'smithi174.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOSS8+BMUmAlHkyK+dU5PNmKCF/3jzZ74wzK5sAbqeAplHkfBHZPo0eDDR2kx7IirS89AO90CHhLFeFEliqPxZA=', 'smithi177.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLGv+3JVcBijYquHWRnz7x7Ye89HAUZAOFrH5xb9XXVQoeJjxtiqbssDxRxDjx6dDrAXnQbGKemoTjS2Jb/I6q4='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'}}, {'ceph': None}, {'thrashosds': {'chance_down': 1.0, 'powercycle': True, 'timeout': 600}}, {'radosbench': {'clients': ['client.0'], 'time': 60}}, {'admin_socket': {'client.0': {'objecter_requests': {'test': 'http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch}'}}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-18_22:32:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-19T02:14:51.788 DEBUG:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-19T02:14:51.812 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-19T02:14:51.814 DEBUG:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-19T02:14:51.816 DEBUG:teuthology.orchestra.run.smithi177:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-19T02:14:51.835 DEBUG:teuthology.orchestra.run.smithi121:> sudo install -d -m0777 -- /var/run/ceph 2024-04-19T02:14:51.871 DEBUG:teuthology.orchestra.run.smithi153:> sudo install -d -m0777 -- /var/run/ceph 2024-04-19T02:14:51.873 DEBUG:teuthology.orchestra.run.smithi174:> sudo install -d -m0777 -- /var/run/ceph 2024-04-19T02:14:51.875 DEBUG:teuthology.orchestra.run.smithi177:> sudo install -d -m0777 -- /var/run/ceph 2024-04-19T02:14:51.903 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-04-19T02:14:51.904 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/scratch_devs of=/dev/stdout 2024-04-19T02:14:51.959 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-19T02:14:51.959 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_1 2024-04-19T02:14:52.017 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-19T02:14:52.018 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T02:14:52.018 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 6h/6d Inode: 165280 Links: 1 2024-04-19T02:14:52.018 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T02:14:52.018 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2024-04-19T02:14:52.018 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-04-19 02:14:41.690865296 +0000 2024-04-19T02:14:52.018 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-04-19 02:11:35.861862078 +0000 2024-04-19T02:14:52.018 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-04-19 02:11:35.861862078 +0000 2024-04-19T02:14:52.018 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2024-04-19T02:14:52.019 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-19T02:14:52.084 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-04-19T02:14:52.084 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-04-19T02:14:52.085 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.00022305 s, 2.3 MB/s 2024-04-19T02:14:52.086 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-19T02:14:52.147 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_2 2024-04-19T02:14:52.205 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-19T02:14:52.205 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T02:14:52.205 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 6h/6d Inode: 170192 Links: 1 2024-04-19T02:14:52.205 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T02:14:52.205 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2024-04-19T02:14:52.205 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-04-19 02:14:41.690865296 +0000 2024-04-19T02:14:52.205 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-04-19 02:11:36.192856350 +0000 2024-04-19T02:14:52.206 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-04-19 02:11:36.192856350 +0000 2024-04-19T02:14:52.206 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2024-04-19T02:14:52.206 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-19T02:14:52.271 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-04-19T02:14:52.271 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-04-19T02:14:52.271 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000285256 s, 1.8 MB/s 2024-04-19T02:14:52.272 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-19T02:14:52.331 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_3 2024-04-19T02:14:52.390 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-19T02:14:52.390 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T02:14:52.391 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 6h/6d Inode: 170241 Links: 1 2024-04-19T02:14:52.391 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T02:14:52.391 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2024-04-19T02:14:52.391 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-04-19 02:14:41.690865296 +0000 2024-04-19T02:14:52.391 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-04-19 02:11:36.555850069 +0000 2024-04-19T02:14:52.391 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-04-19 02:11:36.555850069 +0000 2024-04-19T02:14:52.391 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2024-04-19T02:14:52.391 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-19T02:14:52.456 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-04-19T02:14:52.457 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-04-19T02:14:52.457 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000202058 s, 2.5 MB/s 2024-04-19T02:14:52.458 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-19T02:14:52.517 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_4 2024-04-19T02:14:52.575 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-19T02:14:52.575 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T02:14:52.575 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 6h/6d Inode: 163827 Links: 1 2024-04-19T02:14:52.575 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T02:14:52.576 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2024-04-19T02:14:52.576 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-04-19 02:14:41.690865296 +0000 2024-04-19T02:14:52.576 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-04-19 02:11:36.909843944 +0000 2024-04-19T02:14:52.576 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-04-19 02:11:36.909843944 +0000 2024-04-19T02:14:52.576 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2024-04-19T02:14:52.576 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-19T02:14:52.640 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-04-19T02:14:52.640 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-04-19T02:14:52.641 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000224919 s, 2.3 MB/s 2024-04-19T02:14:52.642 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-19T02:14:52.701 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-19T02:14:52.701 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-19T02:14:52.701 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/scratch_devs of=/dev/stdout 2024-04-19T02:14:52.720 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-19T02:14:52.720 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_1 2024-04-19T02:14:52.778 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-19T02:14:52.778 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T02:14:52.778 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 6h/6d Inode: 162541 Links: 1 2024-04-19T02:14:52.778 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T02:14:52.778 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2024-04-19T02:14:52.779 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2024-04-19 02:14:46.871942398 +0000 2024-04-19T02:14:52.779 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2024-04-19 02:11:37.685843643 +0000 2024-04-19T02:14:52.779 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2024-04-19 02:11:37.685843643 +0000 2024-04-19T02:14:52.779 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: - 2024-04-19T02:14:52.779 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-19T02:14:52.845 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2024-04-19T02:14:52.845 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2024-04-19T02:14:52.845 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.00025757 s, 2.0 MB/s 2024-04-19T02:14:52.847 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-19T02:14:52.906 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_2 2024-04-19T02:14:52.964 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-19T02:14:52.964 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T02:14:52.964 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 6h/6d Inode: 163726 Links: 1 2024-04-19T02:14:52.964 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T02:14:52.964 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2024-04-19T02:14:52.964 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2024-04-19 02:14:46.871942398 +0000 2024-04-19T02:14:52.964 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2024-04-19 02:11:38.034839102 +0000 2024-04-19T02:14:52.964 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2024-04-19 02:11:38.034839102 +0000 2024-04-19T02:14:52.964 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: - 2024-04-19T02:14:52.965 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-19T02:14:53.030 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2024-04-19T02:14:53.030 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2024-04-19T02:14:53.030 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000238774 s, 2.1 MB/s 2024-04-19T02:14:53.031 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-19T02:14:53.090 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_3 2024-04-19T02:14:53.148 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-19T02:14:53.149 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T02:14:53.149 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 6h/6d Inode: 172085 Links: 1 2024-04-19T02:14:53.149 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T02:14:53.149 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2024-04-19T02:14:53.149 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2024-04-19 02:14:46.871942398 +0000 2024-04-19T02:14:53.149 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2024-04-19 02:11:38.398834366 +0000 2024-04-19T02:14:53.149 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2024-04-19 02:11:38.398834366 +0000 2024-04-19T02:14:53.149 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: - 2024-04-19T02:14:53.149 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-19T02:14:53.214 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2024-04-19T02:14:53.214 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2024-04-19T02:14:53.214 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000182685 s, 2.8 MB/s 2024-04-19T02:14:53.215 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-19T02:14:53.274 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_4 2024-04-19T02:14:53.332 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-19T02:14:53.332 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T02:14:53.332 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 6h/6d Inode: 171199 Links: 1 2024-04-19T02:14:53.332 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T02:14:53.332 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2024-04-19T02:14:53.332 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2024-04-19 02:14:46.871942398 +0000 2024-04-19T02:14:53.332 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2024-04-19 02:11:38.741829903 +0000 2024-04-19T02:14:53.332 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2024-04-19 02:11:38.741829903 +0000 2024-04-19T02:14:53.333 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: - 2024-04-19T02:14:53.333 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-19T02:14:53.396 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2024-04-19T02:14:53.396 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2024-04-19T02:14:53.396 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000232649 s, 2.2 MB/s 2024-04-19T02:14:53.397 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-19T02:14:53.456 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-04-19T02:14:53.456 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-19T02:14:53.456 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/scratch_devs of=/dev/stdout 2024-04-19T02:14:53.478 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-19T02:14:53.478 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_1 2024-04-19T02:14:53.539 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-19T02:14:53.539 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T02:14:53.539 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 6h/6d Inode: 165379 Links: 1 2024-04-19T02:14:53.539 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T02:14:53.539 INFO:teuthology.orchestra.run.smithi177.stdout:Context: system_u:object_r:device_t:s0 2024-04-19T02:14:53.539 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2024-04-19 02:14:46.025623989 +0000 2024-04-19T02:14:53.539 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2024-04-19 02:11:37.365395692 +0000 2024-04-19T02:14:53.539 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2024-04-19 02:11:37.365395692 +0000 2024-04-19T02:14:53.539 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: - 2024-04-19T02:14:53.540 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-19T02:14:53.607 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2024-04-19T02:14:53.607 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2024-04-19T02:14:53.607 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000217695 s, 2.4 MB/s 2024-04-19T02:14:53.609 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-19T02:14:53.670 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_2 2024-04-19T02:14:53.729 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-19T02:14:53.729 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T02:14:53.729 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 6h/6d Inode: 158700 Links: 1 2024-04-19T02:14:53.729 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T02:14:53.729 INFO:teuthology.orchestra.run.smithi177.stdout:Context: system_u:object_r:device_t:s0 2024-04-19T02:14:53.729 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2024-04-19 02:14:46.025623989 +0000 2024-04-19T02:14:53.729 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2024-04-19 02:11:37.704386544 +0000 2024-04-19T02:14:53.729 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2024-04-19 02:11:37.704386544 +0000 2024-04-19T02:14:53.729 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: - 2024-04-19T02:14:53.729 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-19T02:14:53.795 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2024-04-19T02:14:53.796 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2024-04-19T02:14:53.796 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000238588 s, 2.1 MB/s 2024-04-19T02:14:53.797 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-19T02:14:53.856 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_3 2024-04-19T02:14:53.914 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-19T02:14:53.914 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T02:14:53.915 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 6h/6d Inode: 168596 Links: 1 2024-04-19T02:14:53.915 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T02:14:53.915 INFO:teuthology.orchestra.run.smithi177.stdout:Context: system_u:object_r:device_t:s0 2024-04-19T02:14:53.915 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2024-04-19 02:14:46.025623989 +0000 2024-04-19T02:14:53.915 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2024-04-19 02:11:38.033377667 +0000 2024-04-19T02:14:53.915 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2024-04-19 02:11:38.033377667 +0000 2024-04-19T02:14:53.915 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: - 2024-04-19T02:14:53.915 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-19T02:14:53.981 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2024-04-19T02:14:53.981 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2024-04-19T02:14:53.981 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000185844 s, 2.8 MB/s 2024-04-19T02:14:53.982 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-19T02:14:54.041 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_4 2024-04-19T02:14:54.099 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-19T02:14:54.100 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T02:14:54.100 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 6h/6d Inode: 171075 Links: 1 2024-04-19T02:14:54.100 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T02:14:54.100 INFO:teuthology.orchestra.run.smithi177.stdout:Context: system_u:object_r:device_t:s0 2024-04-19T02:14:54.100 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2024-04-19 02:14:46.025623989 +0000 2024-04-19T02:14:54.100 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2024-04-19 02:11:38.370368573 +0000 2024-04-19T02:14:54.100 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2024-04-19 02:11:38.370368573 +0000 2024-04-19T02:14:54.100 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: - 2024-04-19T02:14:54.100 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-19T02:14:54.167 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2024-04-19T02:14:54.167 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2024-04-19T02:14:54.167 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000215312 s, 2.4 MB/s 2024-04-19T02:14:54.168 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-19T02:14:54.228 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-04-19T02:14:54.228 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi153.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi174.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi177.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-04-19T02:14:54.228 INFO:tasks.ceph:Generating config... 2024-04-19T02:14:54.229 INFO:tasks.ceph:[client.0] admin socket = /var/run/ceph/ceph-$name.asok 2024-04-19T02:14:54.230 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-19T02:14:54.230 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-19T02:14:54.230 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-19T02:14:54.230 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-19T02:14:54.230 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-19T02:14:54.230 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-19T02:14:54.230 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-19T02:14:54.230 INFO:tasks.ceph:[osd] bluestore allocator = stupid 2024-04-19T02:14:54.230 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-19T02:14:54.230 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-19T02:14:54.230 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-19T02:14:54.230 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-19T02:14:54.231 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-19T02:14:54.231 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-19T02:14:54.231 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-19T02:14:54.231 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-19T02:14:54.231 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-19T02:14:54.231 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-19T02:14:54.231 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-19T02:14:54.231 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-19T02:14:54.231 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-19T02:14:54.231 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-19T02:14:54.231 INFO:tasks.ceph:Setting up mon.a... 2024-04-19T02:14:54.231 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-19T02:14:54.293 INFO:teuthology.orchestra.run.smithi121.stdout:creating /etc/ceph/ceph.keyring 2024-04-19T02:14:54.296 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-19T02:14:54.345 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-19T02:14:54.372 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.121'), ('mon.b', '[v2:172.21.15.121:3301,v1:172.21.15.121:6790]'), ('mon.c', '[v2:172.21.15.121:3302,v1:172.21.15.121:6791]')] 2024-04-19T02:14:54.373 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.121,[v2:172.21.15.121:3301,v1:172.21.15.121:6790],[v2:172.21.15.121:3302,v1:172.21.15.121:6791]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}} 2024-04-19T02:14:54.374 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-04-19T02:14:54.374 DEBUG:teuthology.orchestra.run.smithi121:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-19T02:14:54.431 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.121 --addv b '[v2:172.21.15.121:3301,v1:172.21.15.121:6790]' --addv c '[v2:172.21.15.121:3302,v1:172.21.15.121:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-19T02:14:54.519 INFO:teuthology.orchestra.run.smithi121.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-19T02:14:54.520 INFO:teuthology.orchestra.run.smithi121.stdout:monmaptool: generated fsid f6ab5dd0-bb9f-4b48-a9fc-4728c7955ca8 2024-04-19T02:14:54.520 INFO:teuthology.orchestra.run.smithi121.stdout:setting min_mon_release = pacific 2024-04-19T02:14:54.520 INFO:teuthology.orchestra.run.smithi121.stdout:epoch 0 2024-04-19T02:14:54.520 INFO:teuthology.orchestra.run.smithi121.stdout:fsid f6ab5dd0-bb9f-4b48-a9fc-4728c7955ca8 2024-04-19T02:14:54.520 INFO:teuthology.orchestra.run.smithi121.stdout:last_changed 2024-04-19T02:14:54.521207+0000 2024-04-19T02:14:54.520 INFO:teuthology.orchestra.run.smithi121.stdout:created 2024-04-19T02:14:54.521207+0000 2024-04-19T02:14:54.520 INFO:teuthology.orchestra.run.smithi121.stdout:min_mon_release 16 (pacific) 2024-04-19T02:14:54.520 INFO:teuthology.orchestra.run.smithi121.stdout:election_strategy: 1 2024-04-19T02:14:54.520 INFO:teuthology.orchestra.run.smithi121.stdout:0: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.a 2024-04-19T02:14:54.520 INFO:teuthology.orchestra.run.smithi121.stdout:1: [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] mon.b 2024-04-19T02:14:54.520 INFO:teuthology.orchestra.run.smithi121.stdout:2: [v2:172.21.15.121:3302/0,v1:172.21.15.121:6791/0] mon.c 2024-04-19T02:14:54.520 INFO:teuthology.orchestra.run.smithi121.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-19T02:14:54.521 DEBUG:teuthology.orchestra.run.smithi121:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-19T02:14:54.538 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID f6ab5dd0-bb9f-4b48-a9fc-4728c7955ca8... 2024-04-19T02:14:54.539 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-19T02:14:54.581 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-19T02:14:54.584 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-19T02:14:54.586 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-19T02:14:54.623 INFO:teuthology.orchestra.run.smithi121.stdout:[global] 2024-04-19T02:14:54.623 INFO:teuthology.orchestra.run.smithi121.stdout: chdir = "" 2024-04-19T02:14:54.623 INFO:teuthology.orchestra.run.smithi121.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-19T02:14:54.623 INFO:teuthology.orchestra.run.smithi121.stdout: auth supported = cephx 2024-04-19T02:14:54.623 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:14:54.623 INFO:teuthology.orchestra.run.smithi121.stdout: filestore xattr use omap = true 2024-04-19T02:14:54.623 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:14:54.623 INFO:teuthology.orchestra.run.smithi121.stdout: mon clock drift allowed = 1.000 2024-04-19T02:14:54.623 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:14:54.623 INFO:teuthology.orchestra.run.smithi121.stdout: osd crush chooseleaf type = 0 2024-04-19T02:14:54.623 INFO:teuthology.orchestra.run.smithi121.stdout: auth debug = true 2024-04-19T02:14:54.623 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:14:54.624 INFO:teuthology.orchestra.run.smithi121.stdout: ms die on old message = true 2024-04-19T02:14:54.624 INFO:teuthology.orchestra.run.smithi121.stdout: ms die on bug = true 2024-04-19T02:14:54.624 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:14:54.624 INFO:teuthology.orchestra.run.smithi121.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-19T02:14:54.624 INFO:teuthology.orchestra.run.smithi121.stdout: mon pg warn max object skew = 0 2024-04-19T02:14:54.624 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:14:54.624 INFO:teuthology.orchestra.run.smithi121.stdout: # disable pg_autoscaler by default for new pools 2024-04-19T02:14:54.624 INFO:teuthology.orchestra.run.smithi121.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-19T02:14:54.624 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:14:54.624 INFO:teuthology.orchestra.run.smithi121.stdout: osd pool default size = 2 2024-04-19T02:14:54.624 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:14:54.624 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd allow primary affinity = true 2024-04-19T02:14:54.624 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd allow pg remap = true 2024-04-19T02:14:54.624 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on legacy crush tunables = false 2024-04-19T02:14:54.625 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on crush straw calc version zero = false 2024-04-19T02:14:54.625 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on no sortbitwise = false 2024-04-19T02:14:54.625 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on osd down out interval zero = false 2024-04-19T02:14:54.625 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on too few osds = false 2024-04-19T02:14:54.625 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-19T02:14:54.625 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-19T02:14:54.625 INFO:teuthology.orchestra.run.smithi121.stdout: mon_allow_pool_size_one = true 2024-04-19T02:14:54.625 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:14:54.625 INFO:teuthology.orchestra.run.smithi121.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-19T02:14:54.625 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:14:54.625 INFO:teuthology.orchestra.run.smithi121.stdout: osd default data pool replay window = 5 2024-04-19T02:14:54.625 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:14:54.625 INFO:teuthology.orchestra.run.smithi121.stdout: mon allow pool delete = true 2024-04-19T02:14:54.625 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:14:54.626 INFO:teuthology.orchestra.run.smithi121.stdout: mon cluster log file level = debug 2024-04-19T02:14:54.626 INFO:teuthology.orchestra.run.smithi121.stdout: debug asserts on shutdown = true 2024-04-19T02:14:54.626 INFO:teuthology.orchestra.run.smithi121.stdout: mon health detail to clog = false 2024-04-19T02:14:54.626 INFO:teuthology.orchestra.run.smithi121.stdout: mon host = "172.21.15.121,[v2:172.21.15.121:3301,v1:172.21.15.121:6790],[v2:172.21.15.121:3302,v1:172.21.15.121:6791]" 2024-04-19T02:14:54.626 INFO:teuthology.orchestra.run.smithi121.stdout: fsid = f6ab5dd0-bb9f-4b48-a9fc-4728c7955ca8 2024-04-19T02:14:54.626 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:14:54.626 INFO:teuthology.orchestra.run.smithi121.stdout:[osd] 2024-04-19T02:14:54.626 INFO:teuthology.orchestra.run.smithi121.stdout: osd journal size = 100 2024-04-19T02:14:54.626 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:14:54.626 INFO:teuthology.orchestra.run.smithi121.stdout: osd scrub load threshold = 5.0 2024-04-19T02:14:54.626 INFO:teuthology.orchestra.run.smithi121.stdout: osd scrub max interval = 600 2024-04-19T02:14:54.626 INFO:teuthology.orchestra.run.smithi121.stdout: osd mclock profile = high_recovery_ops 2024-04-19T02:14:54.626 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:14:54.626 INFO:teuthology.orchestra.run.smithi121.stdout: osd recover clone overlap = true 2024-04-19T02:14:54.626 INFO:teuthology.orchestra.run.smithi121.stdout: osd recovery max chunk = 1048576 2024-04-19T02:14:54.627 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:14:54.627 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug shutdown = true 2024-04-19T02:14:54.627 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug op order = true 2024-04-19T02:14:54.627 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug verify stray on activate = true 2024-04-19T02:14:54.627 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:14:54.627 INFO:teuthology.orchestra.run.smithi121.stdout: osd open classes on start = true 2024-04-19T02:14:54.627 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug pg log writeout = true 2024-04-19T02:14:54.627 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:14:54.627 INFO:teuthology.orchestra.run.smithi121.stdout: osd deep scrub update digest min age = 30 2024-04-19T02:14:54.627 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:14:54.627 INFO:teuthology.orchestra.run.smithi121.stdout: osd map max advance = 10 2024-04-19T02:14:54.627 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:14:54.627 INFO:teuthology.orchestra.run.smithi121.stdout: journal zero on create = true 2024-04-19T02:14:54.627 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:14:54.627 INFO:teuthology.orchestra.run.smithi121.stdout: filestore ondisk finisher threads = 3 2024-04-19T02:14:54.628 INFO:teuthology.orchestra.run.smithi121.stdout: filestore apply finisher threads = 3 2024-04-19T02:14:54.628 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:14:54.628 INFO:teuthology.orchestra.run.smithi121.stdout: bdev debug aio = true 2024-04-19T02:14:54.628 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug misdirected ops = true 2024-04-19T02:14:54.628 INFO:teuthology.orchestra.run.smithi121.stdout: bdev async discard = True 2024-04-19T02:14:54.628 INFO:teuthology.orchestra.run.smithi121.stdout: bdev enable discard = True 2024-04-19T02:14:54.628 INFO:teuthology.orchestra.run.smithi121.stdout: bluestore allocator = stupid 2024-04-19T02:14:54.628 INFO:teuthology.orchestra.run.smithi121.stdout: bluestore block size = 96636764160 2024-04-19T02:14:54.628 INFO:teuthology.orchestra.run.smithi121.stdout: bluestore fsck on mount = True 2024-04-19T02:14:54.628 INFO:teuthology.orchestra.run.smithi121.stdout: debug bluefs = 1/20 2024-04-19T02:14:54.628 INFO:teuthology.orchestra.run.smithi121.stdout: debug bluestore = 1/20 2024-04-19T02:14:54.628 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2024-04-19T02:14:54.628 INFO:teuthology.orchestra.run.smithi121.stdout: debug osd = 20 2024-04-19T02:14:54.628 INFO:teuthology.orchestra.run.smithi121.stdout: debug rocksdb = 4/10 2024-04-19T02:14:54.628 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd backfillfull_ratio = 0.85 2024-04-19T02:14:54.629 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd full ratio = 0.9 2024-04-19T02:14:54.629 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd nearfull ratio = 0.8 2024-04-19T02:14:54.629 INFO:teuthology.orchestra.run.smithi121.stdout: osd blocked scrub grace period = 3600 2024-04-19T02:14:54.629 INFO:teuthology.orchestra.run.smithi121.stdout: osd failsafe full ratio = 0.95 2024-04-19T02:14:54.629 INFO:teuthology.orchestra.run.smithi121.stdout: osd max markdown count = 1000 2024-04-19T02:14:54.629 INFO:teuthology.orchestra.run.smithi121.stdout: osd objectstore = bluestore 2024-04-19T02:14:54.629 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:14:54.629 INFO:teuthology.orchestra.run.smithi121.stdout:[mgr] 2024-04-19T02:14:54.629 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2024-04-19T02:14:54.629 INFO:teuthology.orchestra.run.smithi121.stdout: debug mgr = 20 2024-04-19T02:14:54.629 INFO:teuthology.orchestra.run.smithi121.stdout: debug mon = 20 2024-04-19T02:14:54.629 INFO:teuthology.orchestra.run.smithi121.stdout: debug auth = 20 2024-04-19T02:14:54.629 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min pgs per osd = 4 2024-04-19T02:14:54.629 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min bytes per osd = 10 2024-04-19T02:14:54.629 INFO:teuthology.orchestra.run.smithi121.stdout: mgr/telemetry/nag = false 2024-04-19T02:14:54.630 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:14:54.630 INFO:teuthology.orchestra.run.smithi121.stdout:[mon] 2024-04-19T02:14:54.630 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2024-04-19T02:14:54.630 INFO:teuthology.orchestra.run.smithi121.stdout: debug mon = 20 2024-04-19T02:14:54.630 INFO:teuthology.orchestra.run.smithi121.stdout: debug paxos = 20 2024-04-19T02:14:54.630 INFO:teuthology.orchestra.run.smithi121.stdout: debug auth = 20 2024-04-19T02:14:54.630 INFO:teuthology.orchestra.run.smithi121.stdout: mon data avail warn = 5 2024-04-19T02:14:54.630 INFO:teuthology.orchestra.run.smithi121.stdout: mon mgr mkfs grace = 240 2024-04-19T02:14:54.630 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min pgs per osd = 4 2024-04-19T02:14:54.630 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd reporter subtree level = osd 2024-04-19T02:14:54.630 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd prime pg temp = true 2024-04-19T02:14:54.630 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min bytes per osd = 10 2024-04-19T02:14:54.630 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:14:54.630 INFO:teuthology.orchestra.run.smithi121.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-19T02:14:54.631 INFO:teuthology.orchestra.run.smithi121.stdout: auth mon ticket ttl = 660 # 11m 2024-04-19T02:14:54.631 INFO:teuthology.orchestra.run.smithi121.stdout: auth service ticket ttl = 240 # 4m 2024-04-19T02:14:54.631 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:14:54.631 INFO:teuthology.orchestra.run.smithi121.stdout: # don't complain about insecure global_id in the test suite 2024-04-19T02:14:54.631 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-19T02:14:54.631 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-19T02:14:54.631 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:14:54.631 INFO:teuthology.orchestra.run.smithi121.stdout: # 1m isn't quite enough 2024-04-19T02:14:54.631 INFO:teuthology.orchestra.run.smithi121.stdout: mon_down_mkfs_grace = 2m 2024-04-19T02:14:54.631 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:14:54.631 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_filestore_osds = false 2024-04-19T02:14:54.631 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:14:54.631 INFO:teuthology.orchestra.run.smithi121.stdout:[client] 2024-04-19T02:14:54.631 INFO:teuthology.orchestra.run.smithi121.stdout: rgw cache enabled = true 2024-04-19T02:14:54.631 INFO:teuthology.orchestra.run.smithi121.stdout: rgw enable ops log = true 2024-04-19T02:14:54.631 INFO:teuthology.orchestra.run.smithi121.stdout: rgw enable usage log = true 2024-04-19T02:14:54.632 INFO:teuthology.orchestra.run.smithi121.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-19T02:14:54.632 INFO:teuthology.orchestra.run.smithi121.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-19T02:14:54.632 INFO:teuthology.orchestra.run.smithi121.stdout:[mon.a] 2024-04-19T02:14:54.632 INFO:teuthology.orchestra.run.smithi121.stdout:[mon.b] 2024-04-19T02:14:54.632 INFO:teuthology.orchestra.run.smithi121.stdout:[mon.c] 2024-04-19T02:14:54.632 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.a] 2024-04-19T02:14:54.632 INFO:teuthology.orchestra.run.smithi121.stdout:[client.0] 2024-04-19T02:14:54.632 INFO:teuthology.orchestra.run.smithi121.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-04-19T02:14:54.634 INFO:teuthology.orchestra.run.smithi153.stdout:[global] 2024-04-19T02:14:54.635 INFO:teuthology.orchestra.run.smithi153.stdout: chdir = "" 2024-04-19T02:14:54.635 INFO:teuthology.orchestra.run.smithi153.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-19T02:14:54.635 INFO:teuthology.orchestra.run.smithi153.stdout: auth supported = cephx 2024-04-19T02:14:54.635 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-19T02:14:54.635 INFO:teuthology.orchestra.run.smithi153.stdout: filestore xattr use omap = true 2024-04-19T02:14:54.635 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-19T02:14:54.635 INFO:teuthology.orchestra.run.smithi153.stdout: mon clock drift allowed = 1.000 2024-04-19T02:14:54.635 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-19T02:14:54.635 INFO:teuthology.orchestra.run.smithi153.stdout: osd crush chooseleaf type = 0 2024-04-19T02:14:54.635 INFO:teuthology.orchestra.run.smithi153.stdout: auth debug = true 2024-04-19T02:14:54.635 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-19T02:14:54.635 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on old message = true 2024-04-19T02:14:54.635 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on bug = true 2024-04-19T02:14:54.636 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-19T02:14:54.636 INFO:teuthology.orchestra.run.smithi153.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-19T02:14:54.636 INFO:teuthology.orchestra.run.smithi153.stdout: mon pg warn max object skew = 0 2024-04-19T02:14:54.636 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-19T02:14:54.636 INFO:teuthology.orchestra.run.smithi153.stdout: # disable pg_autoscaler by default for new pools 2024-04-19T02:14:54.636 INFO:teuthology.orchestra.run.smithi153.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-19T02:14:54.636 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-19T02:14:54.636 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default size = 2 2024-04-19T02:14:54.636 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-19T02:14:54.636 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow primary affinity = true 2024-04-19T02:14:54.636 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow pg remap = true 2024-04-19T02:14:54.636 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on legacy crush tunables = false 2024-04-19T02:14:54.636 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on crush straw calc version zero = false 2024-04-19T02:14:54.636 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on no sortbitwise = false 2024-04-19T02:14:54.636 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on osd down out interval zero = false 2024-04-19T02:14:54.637 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on too few osds = false 2024-04-19T02:14:54.637 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-19T02:14:54.637 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-19T02:14:54.637 INFO:teuthology.orchestra.run.smithi153.stdout: mon_allow_pool_size_one = true 2024-04-19T02:14:54.637 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-19T02:14:54.637 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-19T02:14:54.637 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-19T02:14:54.637 INFO:teuthology.orchestra.run.smithi153.stdout: osd default data pool replay window = 5 2024-04-19T02:14:54.637 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-19T02:14:54.637 INFO:teuthology.orchestra.run.smithi153.stdout: mon allow pool delete = true 2024-04-19T02:14:54.637 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-19T02:14:54.638 INFO:teuthology.orchestra.run.smithi153.stdout: mon cluster log file level = debug 2024-04-19T02:14:54.638 INFO:teuthology.orchestra.run.smithi153.stdout: debug asserts on shutdown = true 2024-04-19T02:14:54.638 INFO:teuthology.orchestra.run.smithi153.stdout: mon health detail to clog = false 2024-04-19T02:14:54.638 INFO:teuthology.orchestra.run.smithi153.stdout: mon host = "172.21.15.121,[v2:172.21.15.121:3301,v1:172.21.15.121:6790],[v2:172.21.15.121:3302,v1:172.21.15.121:6791]" 2024-04-19T02:14:54.638 INFO:teuthology.orchestra.run.smithi153.stdout: fsid = f6ab5dd0-bb9f-4b48-a9fc-4728c7955ca8 2024-04-19T02:14:54.638 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-19T02:14:54.638 INFO:teuthology.orchestra.run.smithi153.stdout:[osd] 2024-04-19T02:14:54.638 INFO:teuthology.orchestra.run.smithi153.stdout: osd journal size = 100 2024-04-19T02:14:54.638 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-19T02:14:54.638 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub load threshold = 5.0 2024-04-19T02:14:54.638 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub max interval = 600 2024-04-19T02:14:54.638 INFO:teuthology.orchestra.run.smithi153.stdout: osd mclock profile = high_recovery_ops 2024-04-19T02:14:54.638 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-19T02:14:54.638 INFO:teuthology.orchestra.run.smithi153.stdout: osd recover clone overlap = true 2024-04-19T02:14:54.638 INFO:teuthology.orchestra.run.smithi153.stdout: osd recovery max chunk = 1048576 2024-04-19T02:14:54.639 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-19T02:14:54.639 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug shutdown = true 2024-04-19T02:14:54.639 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug op order = true 2024-04-19T02:14:54.639 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug verify stray on activate = true 2024-04-19T02:14:54.639 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-19T02:14:54.639 INFO:teuthology.orchestra.run.smithi153.stdout: osd open classes on start = true 2024-04-19T02:14:54.639 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug pg log writeout = true 2024-04-19T02:14:54.639 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-19T02:14:54.639 INFO:teuthology.orchestra.run.smithi153.stdout: osd deep scrub update digest min age = 30 2024-04-19T02:14:54.639 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-19T02:14:54.639 INFO:teuthology.orchestra.run.smithi153.stdout: osd map max advance = 10 2024-04-19T02:14:54.639 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-19T02:14:54.639 INFO:teuthology.orchestra.run.smithi153.stdout: journal zero on create = true 2024-04-19T02:14:54.640 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-19T02:14:54.640 INFO:teuthology.orchestra.run.smithi153.stdout: filestore ondisk finisher threads = 3 2024-04-19T02:14:54.640 INFO:teuthology.orchestra.run.smithi153.stdout: filestore apply finisher threads = 3 2024-04-19T02:14:54.640 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-19T02:14:54.640 INFO:teuthology.orchestra.run.smithi153.stdout: bdev debug aio = true 2024-04-19T02:14:54.640 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug misdirected ops = true 2024-04-19T02:14:54.640 INFO:teuthology.orchestra.run.smithi153.stdout: bdev async discard = True 2024-04-19T02:14:54.640 INFO:teuthology.orchestra.run.smithi153.stdout: bdev enable discard = True 2024-04-19T02:14:54.640 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore allocator = stupid 2024-04-19T02:14:54.640 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore block size = 96636764160 2024-04-19T02:14:54.640 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore fsck on mount = True 2024-04-19T02:14:54.640 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluefs = 1/20 2024-04-19T02:14:54.640 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluestore = 1/20 2024-04-19T02:14:54.640 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-04-19T02:14:54.640 INFO:teuthology.orchestra.run.smithi153.stdout: debug osd = 20 2024-04-19T02:14:54.641 INFO:teuthology.orchestra.run.smithi153.stdout: debug rocksdb = 4/10 2024-04-19T02:14:54.641 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd backfillfull_ratio = 0.85 2024-04-19T02:14:54.641 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd full ratio = 0.9 2024-04-19T02:14:54.641 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd nearfull ratio = 0.8 2024-04-19T02:14:54.641 INFO:teuthology.orchestra.run.smithi153.stdout: osd blocked scrub grace period = 3600 2024-04-19T02:14:54.641 INFO:teuthology.orchestra.run.smithi153.stdout: osd failsafe full ratio = 0.95 2024-04-19T02:14:54.641 INFO:teuthology.orchestra.run.smithi153.stdout: osd max markdown count = 1000 2024-04-19T02:14:54.641 INFO:teuthology.orchestra.run.smithi153.stdout: osd objectstore = bluestore 2024-04-19T02:14:54.641 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-19T02:14:54.641 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr] 2024-04-19T02:14:54.641 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-04-19T02:14:54.641 INFO:teuthology.orchestra.run.smithi153.stdout: debug mgr = 20 2024-04-19T02:14:54.641 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2024-04-19T02:14:54.641 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2024-04-19T02:14:54.641 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2024-04-19T02:14:54.641 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2024-04-19T02:14:54.642 INFO:teuthology.orchestra.run.smithi153.stdout: mgr/telemetry/nag = false 2024-04-19T02:14:54.642 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-19T02:14:54.642 INFO:teuthology.orchestra.run.smithi153.stdout:[mon] 2024-04-19T02:14:54.642 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-04-19T02:14:54.642 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2024-04-19T02:14:54.642 INFO:teuthology.orchestra.run.smithi153.stdout: debug paxos = 20 2024-04-19T02:14:54.642 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2024-04-19T02:14:54.642 INFO:teuthology.orchestra.run.smithi153.stdout: mon data avail warn = 5 2024-04-19T02:14:54.642 INFO:teuthology.orchestra.run.smithi153.stdout: mon mgr mkfs grace = 240 2024-04-19T02:14:54.642 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2024-04-19T02:14:54.642 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd reporter subtree level = osd 2024-04-19T02:14:54.642 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd prime pg temp = true 2024-04-19T02:14:54.642 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2024-04-19T02:14:54.642 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-19T02:14:54.642 INFO:teuthology.orchestra.run.smithi153.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-19T02:14:54.643 INFO:teuthology.orchestra.run.smithi153.stdout: auth mon ticket ttl = 660 # 11m 2024-04-19T02:14:54.643 INFO:teuthology.orchestra.run.smithi153.stdout: auth service ticket ttl = 240 # 4m 2024-04-19T02:14:54.643 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-19T02:14:54.643 INFO:teuthology.orchestra.run.smithi153.stdout: # don't complain about insecure global_id in the test suite 2024-04-19T02:14:54.643 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-19T02:14:54.643 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-19T02:14:54.643 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-19T02:14:54.643 INFO:teuthology.orchestra.run.smithi153.stdout: # 1m isn't quite enough 2024-04-19T02:14:54.643 INFO:teuthology.orchestra.run.smithi153.stdout: mon_down_mkfs_grace = 2m 2024-04-19T02:14:54.643 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-19T02:14:54.643 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_filestore_osds = false 2024-04-19T02:14:54.643 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-19T02:14:54.643 INFO:teuthology.orchestra.run.smithi153.stdout:[client] 2024-04-19T02:14:54.643 INFO:teuthology.orchestra.run.smithi153.stdout: rgw cache enabled = true 2024-04-19T02:14:54.643 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable ops log = true 2024-04-19T02:14:54.644 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable usage log = true 2024-04-19T02:14:54.644 INFO:teuthology.orchestra.run.smithi153.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-19T02:14:54.644 INFO:teuthology.orchestra.run.smithi153.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-19T02:14:54.644 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.a] 2024-04-19T02:14:54.644 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.b] 2024-04-19T02:14:54.644 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.c] 2024-04-19T02:14:54.644 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.a] 2024-04-19T02:14:54.644 INFO:teuthology.orchestra.run.smithi153.stdout:[client.0] 2024-04-19T02:14:54.644 INFO:teuthology.orchestra.run.smithi153.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-04-19T02:14:54.645 INFO:teuthology.orchestra.run.smithi177.stdout:[global] 2024-04-19T02:14:54.645 INFO:teuthology.orchestra.run.smithi177.stdout: chdir = "" 2024-04-19T02:14:54.645 INFO:teuthology.orchestra.run.smithi177.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-19T02:14:54.645 INFO:teuthology.orchestra.run.smithi177.stdout: auth supported = cephx 2024-04-19T02:14:54.645 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-19T02:14:54.645 INFO:teuthology.orchestra.run.smithi177.stdout: filestore xattr use omap = true 2024-04-19T02:14:54.645 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-19T02:14:54.645 INFO:teuthology.orchestra.run.smithi177.stdout: mon clock drift allowed = 1.000 2024-04-19T02:14:54.645 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-19T02:14:54.645 INFO:teuthology.orchestra.run.smithi177.stdout: osd crush chooseleaf type = 0 2024-04-19T02:14:54.645 INFO:teuthology.orchestra.run.smithi177.stdout: auth debug = true 2024-04-19T02:14:54.645 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-19T02:14:54.646 INFO:teuthology.orchestra.run.smithi177.stdout: ms die on old message = true 2024-04-19T02:14:54.646 INFO:teuthology.orchestra.run.smithi177.stdout: ms die on bug = true 2024-04-19T02:14:54.646 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-19T02:14:54.646 INFO:teuthology.orchestra.run.smithi177.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-19T02:14:54.646 INFO:teuthology.orchestra.run.smithi177.stdout: mon pg warn max object skew = 0 2024-04-19T02:14:54.646 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-19T02:14:54.646 INFO:teuthology.orchestra.run.smithi177.stdout: # disable pg_autoscaler by default for new pools 2024-04-19T02:14:54.646 INFO:teuthology.orchestra.run.smithi177.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-19T02:14:54.646 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-19T02:14:54.646 INFO:teuthology.orchestra.run.smithi177.stdout: osd pool default size = 2 2024-04-19T02:14:54.646 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-19T02:14:54.646 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd allow primary affinity = true 2024-04-19T02:14:54.646 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd allow pg remap = true 2024-04-19T02:14:54.646 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on legacy crush tunables = false 2024-04-19T02:14:54.646 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on crush straw calc version zero = false 2024-04-19T02:14:54.647 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on no sortbitwise = false 2024-04-19T02:14:54.647 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on osd down out interval zero = false 2024-04-19T02:14:54.647 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on too few osds = false 2024-04-19T02:14:54.647 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-19T02:14:54.647 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-19T02:14:54.647 INFO:teuthology.orchestra.run.smithi177.stdout: mon_allow_pool_size_one = true 2024-04-19T02:14:54.647 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-19T02:14:54.647 INFO:teuthology.orchestra.run.smithi177.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-19T02:14:54.647 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-19T02:14:54.647 INFO:teuthology.orchestra.run.smithi177.stdout: osd default data pool replay window = 5 2024-04-19T02:14:54.647 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-19T02:14:54.647 INFO:teuthology.orchestra.run.smithi177.stdout: mon allow pool delete = true 2024-04-19T02:14:54.647 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-19T02:14:54.647 INFO:teuthology.orchestra.run.smithi177.stdout: mon cluster log file level = debug 2024-04-19T02:14:54.647 INFO:teuthology.orchestra.run.smithi177.stdout: debug asserts on shutdown = true 2024-04-19T02:14:54.648 INFO:teuthology.orchestra.run.smithi177.stdout: mon health detail to clog = false 2024-04-19T02:14:54.648 INFO:teuthology.orchestra.run.smithi177.stdout: mon host = "172.21.15.121,[v2:172.21.15.121:3301,v1:172.21.15.121:6790],[v2:172.21.15.121:3302,v1:172.21.15.121:6791]" 2024-04-19T02:14:54.648 INFO:teuthology.orchestra.run.smithi177.stdout: fsid = f6ab5dd0-bb9f-4b48-a9fc-4728c7955ca8 2024-04-19T02:14:54.648 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-19T02:14:54.648 INFO:teuthology.orchestra.run.smithi177.stdout:[osd] 2024-04-19T02:14:54.648 INFO:teuthology.orchestra.run.smithi177.stdout: osd journal size = 100 2024-04-19T02:14:54.648 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-19T02:14:54.648 INFO:teuthology.orchestra.run.smithi177.stdout: osd scrub load threshold = 5.0 2024-04-19T02:14:54.648 INFO:teuthology.orchestra.run.smithi177.stdout: osd scrub max interval = 600 2024-04-19T02:14:54.648 INFO:teuthology.orchestra.run.smithi177.stdout: osd mclock profile = high_recovery_ops 2024-04-19T02:14:54.648 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-19T02:14:54.648 INFO:teuthology.orchestra.run.smithi177.stdout: osd recover clone overlap = true 2024-04-19T02:14:54.648 INFO:teuthology.orchestra.run.smithi177.stdout: osd recovery max chunk = 1048576 2024-04-19T02:14:54.648 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-19T02:14:54.648 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug shutdown = true 2024-04-19T02:14:54.649 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug op order = true 2024-04-19T02:14:54.649 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug verify stray on activate = true 2024-04-19T02:14:54.649 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-19T02:14:54.649 INFO:teuthology.orchestra.run.smithi177.stdout: osd open classes on start = true 2024-04-19T02:14:54.649 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug pg log writeout = true 2024-04-19T02:14:54.649 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-19T02:14:54.649 INFO:teuthology.orchestra.run.smithi177.stdout: osd deep scrub update digest min age = 30 2024-04-19T02:14:54.649 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-19T02:14:54.649 INFO:teuthology.orchestra.run.smithi177.stdout: osd map max advance = 10 2024-04-19T02:14:54.649 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-19T02:14:54.649 INFO:teuthology.orchestra.run.smithi177.stdout: journal zero on create = true 2024-04-19T02:14:54.649 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-19T02:14:54.649 INFO:teuthology.orchestra.run.smithi177.stdout: filestore ondisk finisher threads = 3 2024-04-19T02:14:54.649 INFO:teuthology.orchestra.run.smithi177.stdout: filestore apply finisher threads = 3 2024-04-19T02:14:54.649 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-19T02:14:54.650 INFO:teuthology.orchestra.run.smithi177.stdout: bdev debug aio = true 2024-04-19T02:14:54.650 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug misdirected ops = true 2024-04-19T02:14:54.650 INFO:teuthology.orchestra.run.smithi177.stdout: bdev async discard = True 2024-04-19T02:14:54.650 INFO:teuthology.orchestra.run.smithi177.stdout: bdev enable discard = True 2024-04-19T02:14:54.650 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore allocator = stupid 2024-04-19T02:14:54.650 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore block size = 96636764160 2024-04-19T02:14:54.650 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore fsck on mount = True 2024-04-19T02:14:54.650 INFO:teuthology.orchestra.run.smithi177.stdout: debug bluefs = 1/20 2024-04-19T02:14:54.650 INFO:teuthology.orchestra.run.smithi177.stdout: debug bluestore = 1/20 2024-04-19T02:14:54.650 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-04-19T02:14:54.650 INFO:teuthology.orchestra.run.smithi177.stdout: debug osd = 20 2024-04-19T02:14:54.650 INFO:teuthology.orchestra.run.smithi177.stdout: debug rocksdb = 4/10 2024-04-19T02:14:54.650 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd backfillfull_ratio = 0.85 2024-04-19T02:14:54.650 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd full ratio = 0.9 2024-04-19T02:14:54.651 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd nearfull ratio = 0.8 2024-04-19T02:14:54.651 INFO:teuthology.orchestra.run.smithi177.stdout: osd blocked scrub grace period = 3600 2024-04-19T02:14:54.651 INFO:teuthology.orchestra.run.smithi177.stdout: osd failsafe full ratio = 0.95 2024-04-19T02:14:54.651 INFO:teuthology.orchestra.run.smithi177.stdout: osd max markdown count = 1000 2024-04-19T02:14:54.651 INFO:teuthology.orchestra.run.smithi177.stdout: osd objectstore = bluestore 2024-04-19T02:14:54.651 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-19T02:14:54.651 INFO:teuthology.orchestra.run.smithi177.stdout:[mgr] 2024-04-19T02:14:54.651 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-04-19T02:14:54.651 INFO:teuthology.orchestra.run.smithi177.stdout: debug mgr = 20 2024-04-19T02:14:54.651 INFO:teuthology.orchestra.run.smithi177.stdout: debug mon = 20 2024-04-19T02:14:54.651 INFO:teuthology.orchestra.run.smithi177.stdout: debug auth = 20 2024-04-19T02:14:54.651 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min pgs per osd = 4 2024-04-19T02:14:54.651 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min bytes per osd = 10 2024-04-19T02:14:54.651 INFO:teuthology.orchestra.run.smithi177.stdout: mgr/telemetry/nag = false 2024-04-19T02:14:54.651 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-19T02:14:54.651 INFO:teuthology.orchestra.run.smithi177.stdout:[mon] 2024-04-19T02:14:54.652 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-04-19T02:14:54.652 INFO:teuthology.orchestra.run.smithi177.stdout: debug mon = 20 2024-04-19T02:14:54.652 INFO:teuthology.orchestra.run.smithi177.stdout: debug paxos = 20 2024-04-19T02:14:54.652 INFO:teuthology.orchestra.run.smithi177.stdout: debug auth = 20 2024-04-19T02:14:54.652 INFO:teuthology.orchestra.run.smithi177.stdout: mon data avail warn = 5 2024-04-19T02:14:54.652 INFO:teuthology.orchestra.run.smithi177.stdout: mon mgr mkfs grace = 240 2024-04-19T02:14:54.652 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min pgs per osd = 4 2024-04-19T02:14:54.652 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd reporter subtree level = osd 2024-04-19T02:14:54.652 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd prime pg temp = true 2024-04-19T02:14:54.652 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min bytes per osd = 10 2024-04-19T02:14:54.652 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-19T02:14:54.652 INFO:teuthology.orchestra.run.smithi177.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-19T02:14:54.652 INFO:teuthology.orchestra.run.smithi177.stdout: auth mon ticket ttl = 660 # 11m 2024-04-19T02:14:54.652 INFO:teuthology.orchestra.run.smithi177.stdout: auth service ticket ttl = 240 # 4m 2024-04-19T02:14:54.652 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-19T02:14:54.653 INFO:teuthology.orchestra.run.smithi177.stdout: # don't complain about insecure global_id in the test suite 2024-04-19T02:14:54.653 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-19T02:14:54.653 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-19T02:14:54.653 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-19T02:14:54.653 INFO:teuthology.orchestra.run.smithi177.stdout: # 1m isn't quite enough 2024-04-19T02:14:54.653 INFO:teuthology.orchestra.run.smithi177.stdout: mon_down_mkfs_grace = 2m 2024-04-19T02:14:54.653 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-19T02:14:54.653 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_filestore_osds = false 2024-04-19T02:14:54.653 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-19T02:14:54.653 INFO:teuthology.orchestra.run.smithi177.stdout:[client] 2024-04-19T02:14:54.653 INFO:teuthology.orchestra.run.smithi177.stdout: rgw cache enabled = true 2024-04-19T02:14:54.653 INFO:teuthology.orchestra.run.smithi177.stdout: rgw enable ops log = true 2024-04-19T02:14:54.653 INFO:teuthology.orchestra.run.smithi177.stdout: rgw enable usage log = true 2024-04-19T02:14:54.653 INFO:teuthology.orchestra.run.smithi177.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-19T02:14:54.653 INFO:teuthology.orchestra.run.smithi177.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-19T02:14:54.653 INFO:teuthology.orchestra.run.smithi177.stdout:[mon.a] 2024-04-19T02:14:54.654 INFO:teuthology.orchestra.run.smithi177.stdout:[mon.b] 2024-04-19T02:14:54.654 INFO:teuthology.orchestra.run.smithi177.stdout:[mon.c] 2024-04-19T02:14:54.654 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.a] 2024-04-19T02:14:54.654 INFO:teuthology.orchestra.run.smithi177.stdout:[client.0] 2024-04-19T02:14:54.654 INFO:teuthology.orchestra.run.smithi177.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-04-19T02:14:54.654 INFO:teuthology.orchestra.run.smithi174.stdout:[global] 2024-04-19T02:14:54.654 INFO:teuthology.orchestra.run.smithi174.stdout: chdir = "" 2024-04-19T02:14:54.654 INFO:teuthology.orchestra.run.smithi174.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-19T02:14:54.654 INFO:teuthology.orchestra.run.smithi174.stdout: auth supported = cephx 2024-04-19T02:14:54.654 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-19T02:14:54.654 INFO:teuthology.orchestra.run.smithi174.stdout: filestore xattr use omap = true 2024-04-19T02:14:54.654 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-19T02:14:54.654 INFO:teuthology.orchestra.run.smithi174.stdout: mon clock drift allowed = 1.000 2024-04-19T02:14:54.655 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-19T02:14:54.655 INFO:teuthology.orchestra.run.smithi174.stdout: osd crush chooseleaf type = 0 2024-04-19T02:14:54.655 INFO:teuthology.orchestra.run.smithi174.stdout: auth debug = true 2024-04-19T02:14:54.655 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-19T02:14:54.655 INFO:teuthology.orchestra.run.smithi174.stdout: ms die on old message = true 2024-04-19T02:14:54.655 INFO:teuthology.orchestra.run.smithi174.stdout: ms die on bug = true 2024-04-19T02:14:54.655 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-19T02:14:54.655 INFO:teuthology.orchestra.run.smithi174.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-19T02:14:54.655 INFO:teuthology.orchestra.run.smithi174.stdout: mon pg warn max object skew = 0 2024-04-19T02:14:54.655 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-19T02:14:54.655 INFO:teuthology.orchestra.run.smithi174.stdout: # disable pg_autoscaler by default for new pools 2024-04-19T02:14:54.655 INFO:teuthology.orchestra.run.smithi174.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-19T02:14:54.655 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-19T02:14:54.655 INFO:teuthology.orchestra.run.smithi174.stdout: osd pool default size = 2 2024-04-19T02:14:54.655 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-19T02:14:54.656 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd allow primary affinity = true 2024-04-19T02:14:54.656 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd allow pg remap = true 2024-04-19T02:14:54.656 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on legacy crush tunables = false 2024-04-19T02:14:54.656 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on crush straw calc version zero = false 2024-04-19T02:14:54.656 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on no sortbitwise = false 2024-04-19T02:14:54.656 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on osd down out interval zero = false 2024-04-19T02:14:54.656 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on too few osds = false 2024-04-19T02:14:54.656 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-19T02:14:54.656 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-19T02:14:54.656 INFO:teuthology.orchestra.run.smithi174.stdout: mon_allow_pool_size_one = true 2024-04-19T02:14:54.656 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-19T02:14:54.656 INFO:teuthology.orchestra.run.smithi174.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-19T02:14:54.656 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-19T02:14:54.656 INFO:teuthology.orchestra.run.smithi174.stdout: osd default data pool replay window = 5 2024-04-19T02:14:54.656 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-19T02:14:54.656 INFO:teuthology.orchestra.run.smithi174.stdout: mon allow pool delete = true 2024-04-19T02:14:54.657 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-19T02:14:54.657 INFO:teuthology.orchestra.run.smithi174.stdout: mon cluster log file level = debug 2024-04-19T02:14:54.657 INFO:teuthology.orchestra.run.smithi174.stdout: debug asserts on shutdown = true 2024-04-19T02:14:54.657 INFO:teuthology.orchestra.run.smithi174.stdout: mon health detail to clog = false 2024-04-19T02:14:54.657 INFO:teuthology.orchestra.run.smithi174.stdout: mon host = "172.21.15.121,[v2:172.21.15.121:3301,v1:172.21.15.121:6790],[v2:172.21.15.121:3302,v1:172.21.15.121:6791]" 2024-04-19T02:14:54.657 INFO:teuthology.orchestra.run.smithi174.stdout: fsid = f6ab5dd0-bb9f-4b48-a9fc-4728c7955ca8 2024-04-19T02:14:54.657 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-19T02:14:54.657 INFO:teuthology.orchestra.run.smithi174.stdout:[osd] 2024-04-19T02:14:54.657 INFO:teuthology.orchestra.run.smithi174.stdout: osd journal size = 100 2024-04-19T02:14:54.657 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-19T02:14:54.657 INFO:teuthology.orchestra.run.smithi174.stdout: osd scrub load threshold = 5.0 2024-04-19T02:14:54.657 INFO:teuthology.orchestra.run.smithi174.stdout: osd scrub max interval = 600 2024-04-19T02:14:54.657 INFO:teuthology.orchestra.run.smithi174.stdout: osd mclock profile = high_recovery_ops 2024-04-19T02:14:54.657 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-19T02:14:54.657 INFO:teuthology.orchestra.run.smithi174.stdout: osd recover clone overlap = true 2024-04-19T02:14:54.658 INFO:teuthology.orchestra.run.smithi174.stdout: osd recovery max chunk = 1048576 2024-04-19T02:14:54.658 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-19T02:14:54.658 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug shutdown = true 2024-04-19T02:14:54.658 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug op order = true 2024-04-19T02:14:54.658 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug verify stray on activate = true 2024-04-19T02:14:54.658 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-19T02:14:54.658 INFO:teuthology.orchestra.run.smithi174.stdout: osd open classes on start = true 2024-04-19T02:14:54.658 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug pg log writeout = true 2024-04-19T02:14:54.658 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-19T02:14:54.658 INFO:teuthology.orchestra.run.smithi174.stdout: osd deep scrub update digest min age = 30 2024-04-19T02:14:54.658 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-19T02:14:54.658 INFO:teuthology.orchestra.run.smithi174.stdout: osd map max advance = 10 2024-04-19T02:14:54.658 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-19T02:14:54.658 INFO:teuthology.orchestra.run.smithi174.stdout: journal zero on create = true 2024-04-19T02:14:54.658 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-19T02:14:54.659 INFO:teuthology.orchestra.run.smithi174.stdout: filestore ondisk finisher threads = 3 2024-04-19T02:14:54.659 INFO:teuthology.orchestra.run.smithi174.stdout: filestore apply finisher threads = 3 2024-04-19T02:14:54.659 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-19T02:14:54.659 INFO:teuthology.orchestra.run.smithi174.stdout: bdev debug aio = true 2024-04-19T02:14:54.659 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug misdirected ops = true 2024-04-19T02:14:54.659 INFO:teuthology.orchestra.run.smithi174.stdout: bdev async discard = True 2024-04-19T02:14:54.659 INFO:teuthology.orchestra.run.smithi174.stdout: bdev enable discard = True 2024-04-19T02:14:54.659 INFO:teuthology.orchestra.run.smithi174.stdout: bluestore allocator = stupid 2024-04-19T02:14:54.659 INFO:teuthology.orchestra.run.smithi174.stdout: bluestore block size = 96636764160 2024-04-19T02:14:54.659 INFO:teuthology.orchestra.run.smithi174.stdout: bluestore fsck on mount = True 2024-04-19T02:14:54.659 INFO:teuthology.orchestra.run.smithi174.stdout: debug bluefs = 1/20 2024-04-19T02:14:54.659 INFO:teuthology.orchestra.run.smithi174.stdout: debug bluestore = 1/20 2024-04-19T02:14:54.659 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2024-04-19T02:14:54.659 INFO:teuthology.orchestra.run.smithi174.stdout: debug osd = 20 2024-04-19T02:14:54.659 INFO:teuthology.orchestra.run.smithi174.stdout: debug rocksdb = 4/10 2024-04-19T02:14:54.659 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd backfillfull_ratio = 0.85 2024-04-19T02:14:54.660 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd full ratio = 0.9 2024-04-19T02:14:54.660 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd nearfull ratio = 0.8 2024-04-19T02:14:54.660 INFO:teuthology.orchestra.run.smithi174.stdout: osd blocked scrub grace period = 3600 2024-04-19T02:14:54.660 INFO:teuthology.orchestra.run.smithi174.stdout: osd failsafe full ratio = 0.95 2024-04-19T02:14:54.660 INFO:teuthology.orchestra.run.smithi174.stdout: osd max markdown count = 1000 2024-04-19T02:14:54.660 INFO:teuthology.orchestra.run.smithi174.stdout: osd objectstore = bluestore 2024-04-19T02:14:54.660 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-19T02:14:54.660 INFO:teuthology.orchestra.run.smithi174.stdout:[mgr] 2024-04-19T02:14:54.660 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2024-04-19T02:14:54.660 INFO:teuthology.orchestra.run.smithi174.stdout: debug mgr = 20 2024-04-19T02:14:54.660 INFO:teuthology.orchestra.run.smithi174.stdout: debug mon = 20 2024-04-19T02:14:54.660 INFO:teuthology.orchestra.run.smithi174.stdout: debug auth = 20 2024-04-19T02:14:54.660 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min pgs per osd = 4 2024-04-19T02:14:54.660 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min bytes per osd = 10 2024-04-19T02:14:54.660 INFO:teuthology.orchestra.run.smithi174.stdout: mgr/telemetry/nag = false 2024-04-19T02:14:54.661 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-19T02:14:54.661 INFO:teuthology.orchestra.run.smithi174.stdout:[mon] 2024-04-19T02:14:54.661 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2024-04-19T02:14:54.661 INFO:teuthology.orchestra.run.smithi174.stdout: debug mon = 20 2024-04-19T02:14:54.661 INFO:teuthology.orchestra.run.smithi174.stdout: debug paxos = 20 2024-04-19T02:14:54.661 INFO:teuthology.orchestra.run.smithi174.stdout: debug auth = 20 2024-04-19T02:14:54.661 INFO:teuthology.orchestra.run.smithi174.stdout: mon data avail warn = 5 2024-04-19T02:14:54.661 INFO:teuthology.orchestra.run.smithi174.stdout: mon mgr mkfs grace = 240 2024-04-19T02:14:54.661 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min pgs per osd = 4 2024-04-19T02:14:54.661 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd reporter subtree level = osd 2024-04-19T02:14:54.661 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd prime pg temp = true 2024-04-19T02:14:54.661 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min bytes per osd = 10 2024-04-19T02:14:54.661 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-19T02:14:54.661 INFO:teuthology.orchestra.run.smithi174.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-19T02:14:54.661 INFO:teuthology.orchestra.run.smithi174.stdout: auth mon ticket ttl = 660 # 11m 2024-04-19T02:14:54.661 INFO:teuthology.orchestra.run.smithi174.stdout: auth service ticket ttl = 240 # 4m 2024-04-19T02:14:54.662 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-19T02:14:54.662 INFO:teuthology.orchestra.run.smithi174.stdout: # don't complain about insecure global_id in the test suite 2024-04-19T02:14:54.662 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-19T02:14:54.662 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-19T02:14:54.662 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-19T02:14:54.662 INFO:teuthology.orchestra.run.smithi174.stdout: # 1m isn't quite enough 2024-04-19T02:14:54.662 INFO:teuthology.orchestra.run.smithi174.stdout: mon_down_mkfs_grace = 2m 2024-04-19T02:14:54.662 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-19T02:14:54.662 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_filestore_osds = false 2024-04-19T02:14:54.662 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-19T02:14:54.662 INFO:teuthology.orchestra.run.smithi174.stdout:[client] 2024-04-19T02:14:54.662 INFO:teuthology.orchestra.run.smithi174.stdout: rgw cache enabled = true 2024-04-19T02:14:54.662 INFO:teuthology.orchestra.run.smithi174.stdout: rgw enable ops log = true 2024-04-19T02:14:54.662 INFO:teuthology.orchestra.run.smithi174.stdout: rgw enable usage log = true 2024-04-19T02:14:54.662 INFO:teuthology.orchestra.run.smithi174.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-19T02:14:54.663 INFO:teuthology.orchestra.run.smithi174.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-19T02:14:54.663 INFO:teuthology.orchestra.run.smithi174.stdout:[mon.a] 2024-04-19T02:14:54.663 INFO:teuthology.orchestra.run.smithi174.stdout:[mon.b] 2024-04-19T02:14:54.663 INFO:teuthology.orchestra.run.smithi174.stdout:[mon.c] 2024-04-19T02:14:54.663 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.a] 2024-04-19T02:14:54.663 INFO:teuthology.orchestra.run.smithi174.stdout:[client.0] 2024-04-19T02:14:54.663 INFO:teuthology.orchestra.run.smithi174.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-04-19T02:14:54.665 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-19T02:14:54.665 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-19T02:14:54.731 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-19T02:14:54.731 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-04-19T02:14:54.731 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-19T02:14:54.748 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-04-19T02:14:54.749 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-19T02:14:54.806 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi121.front.sepia.ceph.com 2024-04-19T02:14:54.806 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-04-19T02:14:54.806 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-19T02:14:54.807 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-19T02:14:54.882 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-04-19T02:14:54.882 DEBUG:teuthology.orchestra.run.smithi121:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-19T02:14:54.940 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi153.front.sepia.ceph.com 2024-04-19T02:14:54.941 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-04-19T02:14:54.941 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-19T02:14:54.941 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-19T02:14:54.984 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-04-19T02:14:54.984 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-19T02:14:55.044 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi174.front.sepia.ceph.com 2024-04-19T02:14:55.044 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-19T02:14:55.044 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-19T02:14:55.044 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-19T02:14:55.088 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-19T02:14:55.088 DEBUG:teuthology.orchestra.run.smithi174:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-19T02:14:55.148 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi177.front.sepia.ceph.com 2024-04-19T02:14:55.148 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-19T02:14:55.148 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-19T02:14:55.148 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-19T02:14:55.191 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-19T02:14:55.191 DEBUG:teuthology.orchestra.run.smithi177:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-19T02:14:55.252 INFO:tasks.ceph:Setting up mon nodes... 2024-04-19T02:14:55.252 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-19T02:14:55.252 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-19T02:14:55.308 INFO:teuthology.orchestra.run.smithi121.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-19T02:14:55.310 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-19T02:14:55.364 INFO:teuthology.orchestra.run.smithi121.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-19T02:14:55.367 INFO:tasks.ceph:Setting up mds nodes... 2024-04-19T02:14:55.367 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-19T02:14:55.420 INFO:teuthology.orchestra.run.smithi121.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-19T02:14:55.422 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-19T02:14:55.448 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-19T02:14:55.449 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-19T02:14:55.532 INFO:teuthology.orchestra.run.smithi121.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-19T02:14:55.544 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-19T02:14:55.544 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi153.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi174.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi177.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-04-19T02:14:55.544 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-19T02:14:55.578 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-19T02:14:55.578 INFO:tasks.ceph:role: osd.0 2024-04-19T02:14:55.578 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi153.front.sepia.ceph.com 2024-04-19T02:14:55.579 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-19T02:14:55.657 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-19T02:14:55.657 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-19T02:14:55.658 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-19T02:14:55.658 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-19T02:14:55.658 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-19T02:14:55.658 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2024-04-19T02:14:55.658 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-19T02:14:55.658 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-19T02:14:55.658 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-19T02:14:55.658 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-19T02:14:56.098 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2024-04-19T02:14:56.100 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2024-04-19T02:14:56.100 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-19T02:14:56.266 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-19T02:14:56.304 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-19T02:14:56.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-19T02:14:56.414+0000 7fadd0a10800 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-19T02:14:56.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-19T02:14:56.415+0000 7fadd0a10800 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-19T02:14:56.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-19T02:14:56.415+0000 7fadd0a10800 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-19T02:14:56.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-19T02:14:56.415+0000 7fadd0a10800 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-19T02:14:56.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-19T02:14:56.415+0000 7fadd0a10800 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-19T02:14:56.422 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-19T02:14:56.423+0000 7fadd0a10800 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-19T02:14:59.275 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-19T02:14:59.306 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-19T02:14:59.339 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-04-19T02:14:59.339 INFO:tasks.ceph:role: osd.1 2024-04-19T02:14:59.339 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi174.front.sepia.ceph.com 2024-04-19T02:14:59.339 DEBUG:teuthology.orchestra.run.smithi174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-19T02:14:59.419 INFO:teuthology.orchestra.run.smithi174.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-19T02:14:59.420 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-19T02:14:59.420 INFO:teuthology.orchestra.run.smithi174.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-19T02:14:59.420 INFO:teuthology.orchestra.run.smithi174.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-19T02:14:59.420 INFO:teuthology.orchestra.run.smithi174.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-19T02:14:59.420 INFO:teuthology.orchestra.run.smithi174.stdout: = sunit=0 swidth=0 blks 2024-04-19T02:14:59.420 INFO:teuthology.orchestra.run.smithi174.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-19T02:14:59.420 INFO:teuthology.orchestra.run.smithi174.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-19T02:14:59.420 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-19T02:14:59.420 INFO:teuthology.orchestra.run.smithi174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-19T02:14:59.847 INFO:teuthology.orchestra.run.smithi174.stdout:Discarding blocks...Done. 2024-04-19T02:14:59.849 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi174.front.sepia.ceph.com -o noatime 2024-04-19T02:14:59.849 DEBUG:teuthology.orchestra.run.smithi174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-04-19T02:15:00.009 DEBUG:teuthology.orchestra.run.smithi174:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-19T02:15:00.044 DEBUG:teuthology.orchestra.run.smithi174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-19T02:15:00.158 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-19T02:15:00.158+0000 7f2be1db2800 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-19T02:15:00.160 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-19T02:15:00.160+0000 7f2be1db2800 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-19T02:15:00.160 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-19T02:15:00.160+0000 7f2be1db2800 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-19T02:15:00.160 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-19T02:15:00.160+0000 7f2be1db2800 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-19T02:15:00.160 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-19T02:15:00.160+0000 7f2be1db2800 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-19T02:15:00.166 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-19T02:15:00.166+0000 7f2be1db2800 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-19T02:15:03.031 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-19T02:15:03.063 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-19T02:15:03.096 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-04-19T02:15:03.096 INFO:tasks.ceph:role: osd.2 2024-04-19T02:15:03.096 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi177.front.sepia.ceph.com 2024-04-19T02:15:03.096 DEBUG:teuthology.orchestra.run.smithi177:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-19T02:15:03.175 INFO:teuthology.orchestra.run.smithi177.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-19T02:15:03.175 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-19T02:15:03.175 INFO:teuthology.orchestra.run.smithi177.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-19T02:15:03.175 INFO:teuthology.orchestra.run.smithi177.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-19T02:15:03.175 INFO:teuthology.orchestra.run.smithi177.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-19T02:15:03.175 INFO:teuthology.orchestra.run.smithi177.stdout: = sunit=0 swidth=0 blks 2024-04-19T02:15:03.175 INFO:teuthology.orchestra.run.smithi177.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-19T02:15:03.176 INFO:teuthology.orchestra.run.smithi177.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-19T02:15:03.176 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-19T02:15:03.176 INFO:teuthology.orchestra.run.smithi177.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-19T02:15:03.611 INFO:teuthology.orchestra.run.smithi177.stdout:Discarding blocks...Done. 2024-04-19T02:15:03.613 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi177.front.sepia.ceph.com -o noatime 2024-04-19T02:15:03.613 DEBUG:teuthology.orchestra.run.smithi177:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-04-19T02:15:03.768 DEBUG:teuthology.orchestra.run.smithi177:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-19T02:15:03.804 DEBUG:teuthology.orchestra.run.smithi177:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-19T02:15:04.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-19T02:15:04.052+0000 7f36189a8800 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-19T02:15:04.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-19T02:15:04.052+0000 7f36189a8800 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-19T02:15:04.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-19T02:15:04.052+0000 7f36189a8800 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-19T02:15:04.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-19T02:15:04.052+0000 7f36189a8800 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-19T02:15:04.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-19T02:15:04.052+0000 7f36189a8800 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-19T02:15:04.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-19T02:15:04.053+0000 7f36189a8800 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-19T02:15:06.907 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-19T02:15:06.940 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-19T02:15:06.940 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-04-19T02:15:06.940 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-19T02:15:06.974 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-04-19T02:15:06.974 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-19T02:15:07.044 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-04-19T02:15:07.045 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-19T02:15:07.114 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-04-19T02:15:07.114 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-19T02:15:07.148 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-19T02:15:07.148 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-19T02:15:07.183 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-19T02:15:07.183 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-19T02:15:07.216 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-04-19T02:15:07.216 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-19T02:15:07.235 INFO:tasks.ceph:Adding keys to all mons... 2024-04-19T02:15:07.235 DEBUG:teuthology.orchestra.run.smithi121:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-19T02:15:07.302 INFO:teuthology.orchestra.run.smithi121.stdout:[mgr.x] 2024-04-19T02:15:07.302 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQCf0yFmOEp5EhAA5TYtDmoqVhkOrVjwkf2QPg== 2024-04-19T02:15:07.302 INFO:teuthology.orchestra.run.smithi121.stdout:[mgr.y] 2024-04-19T02:15:07.302 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQCf0yFmvEHNFRAAcmi8qYcOdrVUhGBVm+MzuQ== 2024-04-19T02:15:07.302 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.a] 2024-04-19T02:15:07.302 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQCf0yFmHp8gGRAALl2bQUu4VFKb5ktavbpSew== 2024-04-19T02:15:07.303 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.0] 2024-04-19T02:15:07.303 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQCg0yFmaizQGBAAShnEYqfQJjZ8rbya7SMaGg== 2024-04-19T02:15:07.303 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.1] 2024-04-19T02:15:07.303 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQCk0yFmH8CKCRAAWePvQ5wMcRjIHnrcwNpdtw== 2024-04-19T02:15:07.303 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.2] 2024-04-19T02:15:07.303 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQCo0yFm3mQrAxAAjM1kV3PGqPPinTt1Agm0EQ== 2024-04-19T02:15:07.303 INFO:teuthology.orchestra.run.smithi121.stdout:[client.0] 2024-04-19T02:15:07.303 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQCf0yFmeY3PHxAAZWJ1G4XY1Q6pANZ12iWKaA== 2024-04-19T02:15:07.304 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-19T02:15:07.399 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-19T02:15:07.452 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-19T02:15:07.509 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-19T02:15:07.562 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-19T02:15:07.615 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-19T02:15:07.668 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-19T02:15:07.724 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-19T02:15:07.724 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-19T02:15:07.750 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-19T02:15:07.877 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-19T02:15:07.903 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-19T02:15:07.970 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-19T02:15:08.071 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-19T02:15:08.097 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-19T02:15:08.163 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-19T02:15:08.261 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-19T02:15:08.287 DEBUG:teuthology.orchestra.run.smithi121:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-19T02:15:08.347 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-19T02:15:08.348 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-19T02:15:08.348 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-19T02:15:08.390 INFO:tasks.ceph.mon.a:Started 2024-04-19T02:15:08.390 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-19T02:15:08.390 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-19T02:15:08.392 INFO:tasks.ceph.mon.b:Started 2024-04-19T02:15:08.392 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-19T02:15:08.392 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-19T02:15:08.394 INFO:tasks.ceph.mon.c:Started 2024-04-19T02:15:08.394 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-19T02:15:08.395 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-19T02:15:08.395 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-19T02:15:08.396 INFO:tasks.ceph.mgr.x:Started 2024-04-19T02:15:08.397 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-19T02:15:08.397 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-19T02:15:08.399 INFO:tasks.ceph.mgr.y:Started 2024-04-19T02:15:08.399 INFO:tasks.ceph:Setting crush tunables to default 2024-04-19T02:15:08.399 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd crush tunables default 2024-04-19T02:15:14.659 INFO:teuthology.orchestra.run.smithi121.stderr:adjusted tunables profile to default 2024-04-19T02:15:14.661 INFO:tasks.ceph.mgr.y.smithi121.stderr:2024-04-19T02:15:14.661+0000 7f09f045c240 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-19T02:15:14.661 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-04-19T02:15:14.661+0000 7f55bfe21240 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-19T02:15:14.671 INFO:tasks.ceph:check_enable_crimson: False 2024-04-19T02:15:14.671 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-19T02:15:14.671 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-04-19T02:15:14.671 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-19T02:15:14.705 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-19T02:15:14.705 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-19T02:15:14.739 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-19T02:15:14.739 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-19T02:15:14.772 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new 88cb15f3-271c-43d5-af51-1cd26b8ed13c 0 2024-04-19T02:15:14.838 INFO:tasks.ceph.mgr.y.smithi121.stderr:2024-04-19T02:15:14.837+0000 7f09f045c240 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-19T02:15:14.838 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-04-19T02:15:14.838+0000 7f55bfe21240 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-19T02:15:15.038 INFO:teuthology.orchestra.run.smithi177.stdout:0 2024-04-19T02:15:15.050 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new 2674869a-db01-4d9f-a496-9fb3851b5b21 1 2024-04-19T02:15:15.263 INFO:teuthology.orchestra.run.smithi177.stdout:1 2024-04-19T02:15:15.275 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new 712ad943-2f98-49d9-aabe-f66b509be633 2 2024-04-19T02:15:15.280 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-04-19T02:15:15.280+0000 7f55bfe21240 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-19T02:15:15.280 INFO:tasks.ceph.mgr.y.smithi121.stderr:2024-04-19T02:15:15.281+0000 7f09f045c240 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-19T02:15:15.489 INFO:teuthology.orchestra.run.smithi177.stdout:2 2024-04-19T02:15:15.501 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-19T02:15:15.501 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-19T02:15:15.503 INFO:tasks.ceph.osd.0:Started 2024-04-19T02:15:15.504 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-19T02:15:15.504 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-19T02:15:15.506 INFO:tasks.ceph.osd.1:Started 2024-04-19T02:15:15.506 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-19T02:15:15.506 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-19T02:15:15.508 INFO:tasks.ceph.osd.2:Started 2024-04-19T02:15:15.508 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T02:15:15.721 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:15:15.721 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":5,"fsid":"f6ab5dd0-bb9f-4b48-a9fc-4728c7955ca8","created":"2024-04-19T02:15:13.539846+0000","modified":"2024-04-19T02:15:15.482624+0000","last_up_change":"0.000000","last_in_change":"2024-04-19T02:15:15.482624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"88cb15f3-271c-43d5-af51-1cd26b8ed13c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2674869a-db01-4d9f-a496-9fb3851b5b21","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"712ad943-2f98-49d9-aabe-f66b509be633","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T02:15:15.733 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-19T02:15:15.733 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-19T02:15:15.794 INFO:tasks.ceph.mgr.y.smithi121.stderr:2024-04-19T02:15:15.794+0000 7f09f045c240 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-19T02:15:15.795 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-04-19T02:15:15.795+0000 7f55bfe21240 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-19T02:15:16.013 INFO:tasks.ceph.mgr.y.smithi121.stderr:2024-04-19T02:15:16.013+0000 7f09f045c240 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-19T02:15:16.013 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-04-19T02:15:16.013+0000 7f55bfe21240 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-19T02:15:16.034 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-19T02:15:16.103 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:15:16.103+0000 7f14df7df800 -1 Falling back to public interface 2024-04-19T02:15:16.103 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:15:16.103+0000 7f1d38dbe800 -1 Falling back to public interface 2024-04-19T02:15:16.107 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:15:16.108+0000 7fde3e478800 -1 Falling back to public interface 2024-04-19T02:15:16.268 INFO:teuthology.misc.health.smithi121.stdout: 2024-04-19T02:15:16.268 INFO:teuthology.misc.health.smithi121.stdout:{"epoch":5,"fsid":"f6ab5dd0-bb9f-4b48-a9fc-4728c7955ca8","created":"2024-04-19T02:15:13.539846+0000","modified":"2024-04-19T02:15:15.482624+0000","last_up_change":"0.000000","last_in_change":"2024-04-19T02:15:15.482624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"88cb15f3-271c-43d5-af51-1cd26b8ed13c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2674869a-db01-4d9f-a496-9fb3851b5b21","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"712ad943-2f98-49d9-aabe-f66b509be633","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T02:15:16.280 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-04-19T02:15:16.407 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-04-19T02:15:16.407+0000 7f55bfe21240 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-19T02:15:16.436 INFO:tasks.ceph.mgr.y.smithi121.stderr:2024-04-19T02:15:16.436+0000 7f09f045c240 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-19T02:15:17.124 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-04-19T02:15:17.124+0000 7f55bfe21240 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-19T02:15:17.124 INFO:tasks.ceph.mgr.y.smithi121.stderr:2024-04-19T02:15:17.124+0000 7f09f045c240 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-19T02:15:17.200 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-04-19T02:15:17.200+0000 7f55bfe21240 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-19T02:15:17.201 INFO:tasks.ceph.mgr.y.smithi121.stderr:2024-04-19T02:15:17.200+0000 7f09f045c240 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-19T02:15:17.341 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-04-19T02:15:17.341+0000 7f55bfe21240 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-19T02:15:17.341 INFO:tasks.ceph.mgr.y.smithi121.stderr:2024-04-19T02:15:17.341+0000 7f09f045c240 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-19T02:15:17.526 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-04-19T02:15:17.526+0000 7f55bfe21240 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-19T02:15:17.526 INFO:tasks.ceph.mgr.y.smithi121.stderr:2024-04-19T02:15:17.526+0000 7f09f045c240 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-19T02:15:17.604 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-04-19T02:15:17.604+0000 7f55bfe21240 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-19T02:15:17.604 INFO:tasks.ceph.mgr.y.smithi121.stderr:2024-04-19T02:15:17.604+0000 7f09f045c240 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-19T02:15:17.686 INFO:tasks.ceph.mgr.y.smithi121.stderr:2024-04-19T02:15:17.686+0000 7f09f045c240 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-19T02:15:17.687 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-04-19T02:15:17.686+0000 7f55bfe21240 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-19T02:15:17.767 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-04-19T02:15:17.767+0000 7f55bfe21240 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-19T02:15:17.767 INFO:tasks.ceph.mgr.y.smithi121.stderr:2024-04-19T02:15:17.767+0000 7f09f045c240 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-19T02:15:17.858 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-04-19T02:15:17.858+0000 7f55bfe21240 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-19T02:15:17.858 INFO:tasks.ceph.mgr.y.smithi121.stderr:2024-04-19T02:15:17.858+0000 7f09f045c240 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-19T02:15:18.077 INFO:tasks.ceph.mgr.y.smithi121.stderr:2024-04-19T02:15:18.077+0000 7f09f045c240 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-19T02:15:18.077 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-04-19T02:15:18.077+0000 7f55bfe21240 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-19T02:15:18.302 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-04-19T02:15:18.302+0000 7f55bfe21240 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-19T02:15:18.303 INFO:tasks.ceph.mgr.y.smithi121.stderr:2024-04-19T02:15:18.302+0000 7f09f045c240 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-19T02:15:18.466 INFO:tasks.ceph.mgr.y.smithi121.stderr:2024-04-19T02:15:18.465+0000 7f09f045c240 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-19T02:15:18.466 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-04-19T02:15:18.466+0000 7f55bfe21240 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-19T02:15:18.541 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-04-19T02:15:18.541+0000 7f55bfe21240 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-19T02:15:18.541 INFO:tasks.ceph.mgr.y.smithi121.stderr:2024-04-19T02:15:18.541+0000 7f09f045c240 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-19T02:15:19.250 INFO:tasks.ceph.mgr.y.smithi121.stderr:2024-04-19T02:15:19.250+0000 7f09f045c240 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-19T02:15:19.250 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-04-19T02:15:19.250+0000 7f55bfe21240 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-19T02:15:19.422 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-04-19T02:15:19.422+0000 7f55bfe21240 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-19T02:15:19.423 INFO:tasks.ceph.mgr.y.smithi121.stderr:2024-04-19T02:15:19.423+0000 7f09f045c240 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-19T02:15:19.539 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:15:19.539+0000 7f14df7df800 -1 osd.0 0 log_to_monitors true 2024-04-19T02:15:19.546 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:15:19.546+0000 7f1d38dbe800 -1 osd.2 0 log_to_monitors true 2024-04-19T02:15:19.551 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:15:19.552+0000 7fde3e478800 -1 osd.1 0 log_to_monitors true 2024-04-19T02:15:19.589 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-04-19T02:15:19.589+0000 7f55bfe21240 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-19T02:15:19.589 INFO:tasks.ceph.mgr.y.smithi121.stderr:2024-04-19T02:15:19.590+0000 7f09f045c240 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-19T02:15:20.007 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-04-19T02:15:20.007+0000 7f55bfe21240 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-19T02:15:20.008 INFO:tasks.ceph.mgr.y.smithi121.stderr:2024-04-19T02:15:20.008+0000 7f09f045c240 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-19T02:15:20.190 INFO:tasks.ceph.mgr.y.smithi121.stderr:2024-04-19T02:15:20.190+0000 7f09f045c240 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-19T02:15:20.191 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-04-19T02:15:20.191+0000 7f55bfe21240 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-19T02:15:20.595 INFO:tasks.ceph.mgr.y.smithi121.stderr:2024-04-19T02:15:20.595+0000 7f09f045c240 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-19T02:15:20.595 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-04-19T02:15:20.595+0000 7f55bfe21240 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-19T02:15:20.730 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-04-19T02:15:20.729+0000 7f55bfe21240 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-19T02:15:20.730 INFO:tasks.ceph.mgr.y.smithi121.stderr:2024-04-19T02:15:20.730+0000 7f09f045c240 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-19T02:15:21.509 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:15:21.509+0000 7fde32018700 -1 osd.1 0 waiting for initial osdmap 2024-04-19T02:15:21.510 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:15:21.510+0000 7f1d2c95e700 -1 osd.2 0 waiting for initial osdmap 2024-04-19T02:15:21.523 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:15:21.523+0000 7fde2a3f3700 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-19T02:15:21.533 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:15:21.534+0000 7f1d24d39700 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-19T02:15:21.562 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:15:21.563+0000 7f14d337f700 -1 osd.0 0 waiting for initial osdmap 2024-04-19T02:15:21.584 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:15:21.585+0000 7f14cb75a700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-19T02:15:21.744 INFO:tasks.ceph.mgr.y.smithi121.stderr:2024-04-19T02:15:21.744+0000 7f09b184b700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-19T02:15:21.744 INFO:tasks.ceph.mgr.y.smithi121.stderr:2024-04-19T02:15:21.744+0000 7f09b184b700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-19T02:15:22.583 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-19T02:15:22.912 INFO:teuthology.misc.health.smithi121.stdout: 2024-04-19T02:15:22.912 INFO:teuthology.misc.health.smithi121.stdout:{"epoch":8,"fsid":"f6ab5dd0-bb9f-4b48-a9fc-4728c7955ca8","created":"2024-04-19T02:15:13.539846+0000","modified":"2024-04-19T02:15:22.519568+0000","last_up_change":"2024-04-19T02:15:22.519568+0000","last_in_change":"2024-04-19T02:15:15.482624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"88cb15f3-271c-43d5-af51-1cd26b8ed13c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":41347},{"type":"v1","addr":"172.21.15.153:6801","nonce":41347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":41347},{"type":"v1","addr":"172.21.15.153:6803","nonce":41347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":41347},{"type":"v1","addr":"172.21.15.153:6807","nonce":41347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":41347},{"type":"v1","addr":"172.21.15.153:6805","nonce":41347}]},"public_addr":"172.21.15.153:6801/41347","cluster_addr":"172.21.15.153:6803/41347","heartbeat_back_addr":"172.21.15.153:6807/41347","heartbeat_front_addr":"172.21.15.153:6805/41347","state":["exists","up"]},{"osd":1,"uuid":"2674869a-db01-4d9f-a496-9fb3851b5b21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":41380},{"type":"v1","addr":"172.21.15.174:6801","nonce":41380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":41380},{"type":"v1","addr":"172.21.15.174:6803","nonce":41380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":41380},{"type":"v1","addr":"172.21.15.174:6807","nonce":41380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":41380},{"type":"v1","addr":"172.21.15.174:6805","nonce":41380}]},"public_addr":"172.21.15.174:6801/41380","cluster_addr":"172.21.15.174:6803/41380","heartbeat_back_addr":"172.21.15.174:6807/41380","heartbeat_front_addr":"172.21.15.174:6805/41380","state":["exists","up"]},{"osd":2,"uuid":"712ad943-2f98-49d9-aabe-f66b509be633","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":41508},{"type":"v1","addr":"172.21.15.177:6801","nonce":41508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":41508},{"type":"v1","addr":"172.21.15.177:6803","nonce":41508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":41508},{"type":"v1","addr":"172.21.15.177:6807","nonce":41508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":41508},{"type":"v1","addr":"172.21.15.177:6805","nonce":41508}]},"public_addr":"172.21.15.177:6801/41508","cluster_addr":"172.21.15.177:6803/41508","heartbeat_back_addr":"172.21.15.177:6807/41508","heartbeat_front_addr":"172.21.15.177:6805/41508","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T02:15:22.925 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-04-19T02:15:22.925 INFO:tasks.ceph:Creating RBD pool 2024-04-19T02:15:22.925 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-19T02:15:23.527 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'rbd' created 2024-04-19T02:15:23.538 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-19T02:15:24.528 INFO:teuthology.orchestra.run.smithi121.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-19T02:15:24.542 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-19T02:15:24.542 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-19T02:15:24.542 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-19T02:15:24.544 INFO:tasks.ceph.mds.a:Started 2024-04-19T02:15:24.545 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-19T02:15:24.545 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T02:15:24.630 INFO:tasks.ceph.mds.a.smithi121.stdout:starting mds.a at 2024-04-19T02:15:24.888 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:15:24.889 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":10,"fsid":"f6ab5dd0-bb9f-4b48-a9fc-4728c7955ca8","created":"2024-04-19T02:15:13.539846+0000","modified":"2024-04-19T02:15:24.521767+0000","last_up_change":"2024-04-19T02:15:22.519568+0000","last_in_change":"2024-04-19T02:15:15.482624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T02:15:22.776125+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T02:15:23.264005+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88cb15f3-271c-43d5-af51-1cd26b8ed13c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":41347},{"type":"v1","addr":"172.21.15.153:6801","nonce":41347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":41347},{"type":"v1","addr":"172.21.15.153:6803","nonce":41347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":41347},{"type":"v1","addr":"172.21.15.153:6807","nonce":41347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":41347},{"type":"v1","addr":"172.21.15.153:6805","nonce":41347}]},"public_addr":"172.21.15.153:6801/41347","cluster_addr":"172.21.15.153:6803/41347","heartbeat_back_addr":"172.21.15.153:6807/41347","heartbeat_front_addr":"172.21.15.153:6805/41347","state":["exists","up"]},{"osd":1,"uuid":"2674869a-db01-4d9f-a496-9fb3851b5b21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":41380},{"type":"v1","addr":"172.21.15.174:6801","nonce":41380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":41380},{"type":"v1","addr":"172.21.15.174:6803","nonce":41380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":41380},{"type":"v1","addr":"172.21.15.174:6807","nonce":41380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":41380},{"type":"v1","addr":"172.21.15.174:6805","nonce":41380}]},"public_addr":"172.21.15.174:6801/41380","cluster_addr":"172.21.15.174:6803/41380","heartbeat_back_addr":"172.21.15.174:6807/41380","heartbeat_front_addr":"172.21.15.174:6805/41380","state":["exists","up"]},{"osd":2,"uuid":"712ad943-2f98-49d9-aabe-f66b509be633","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":41508},{"type":"v1","addr":"172.21.15.177:6801","nonce":41508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":41508},{"type":"v1","addr":"172.21.15.177:6803","nonce":41508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":41508},{"type":"v1","addr":"172.21.15.177:6807","nonce":41508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":41508},{"type":"v1","addr":"172.21.15.177:6805","nonce":41508}]},"public_addr":"172.21.15.177:6801/41508","cluster_addr":"172.21.15.177:6803/41508","heartbeat_back_addr":"172.21.15.177:6807/41508","heartbeat_front_addr":"172.21.15.177:6805/41508","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:15:20.495280+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:15:20.594553+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:15:20.524253+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T02:15:24.902 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-19T02:15:22.776125+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '10', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-19T02:15:23.264005+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '10', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-19T02:15:24.902 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-19T02:15:25.246 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 1 2024-04-19T02:15:25.259 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-19T02:15:25.584 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 8 2024-04-19T02:15:25.598 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-19T02:15:25.967 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:15:25.967 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6803/1144924022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":1144924022},{"type":"v1","addr":"172.21.15.121:6803","nonce":1144924022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-04-19T02:15:25.969 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 2 2024-04-19T02:15:25.981 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T02:15:26.303 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:15:26.303 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":11,"fsid":"f6ab5dd0-bb9f-4b48-a9fc-4728c7955ca8","created":"2024-04-19T02:15:13.539846+0000","modified":"2024-04-19T02:15:25.522868+0000","last_up_change":"2024-04-19T02:15:22.519568+0000","last_in_change":"2024-04-19T02:15:15.482624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T02:15:22.776125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T02:15:23.264005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88cb15f3-271c-43d5-af51-1cd26b8ed13c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":41347},{"type":"v1","addr":"172.21.15.153:6801","nonce":41347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":41347},{"type":"v1","addr":"172.21.15.153:6803","nonce":41347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":41347},{"type":"v1","addr":"172.21.15.153:6807","nonce":41347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":41347},{"type":"v1","addr":"172.21.15.153:6805","nonce":41347}]},"public_addr":"172.21.15.153:6801/41347","cluster_addr":"172.21.15.153:6803/41347","heartbeat_back_addr":"172.21.15.153:6807/41347","heartbeat_front_addr":"172.21.15.153:6805/41347","state":["exists","up"]},{"osd":1,"uuid":"2674869a-db01-4d9f-a496-9fb3851b5b21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":41380},{"type":"v1","addr":"172.21.15.174:6801","nonce":41380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":41380},{"type":"v1","addr":"172.21.15.174:6803","nonce":41380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":41380},{"type":"v1","addr":"172.21.15.174:6807","nonce":41380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":41380},{"type":"v1","addr":"172.21.15.174:6805","nonce":41380}]},"public_addr":"172.21.15.174:6801/41380","cluster_addr":"172.21.15.174:6803/41380","heartbeat_back_addr":"172.21.15.174:6807/41380","heartbeat_front_addr":"172.21.15.174:6805/41380","state":["exists","up"]},{"osd":2,"uuid":"712ad943-2f98-49d9-aabe-f66b509be633","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":41508},{"type":"v1","addr":"172.21.15.177:6801","nonce":41508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":41508},{"type":"v1","addr":"172.21.15.177:6803","nonce":41508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":41508},{"type":"v1","addr":"172.21.15.177:6807","nonce":41508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":41508},{"type":"v1","addr":"172.21.15.177:6805","nonce":41508}]},"public_addr":"172.21.15.177:6801/41508","cluster_addr":"172.21.15.177:6803/41508","heartbeat_back_addr":"172.21.15.177:6807/41508","heartbeat_front_addr":"172.21.15.177:6805/41508","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:15:20.495280+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:15:20.594553+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:15:20.524253+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T02:15:26.316 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-19T02:15:22.776125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-19T02:15:23.264005+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-19T02:15:26.317 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-19T02:15:26.639 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 1 2024-04-19T02:15:26.653 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-19T02:15:26.982 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 8 2024-04-19T02:15:26.996 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-19T02:15:27.318 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:15:27.319 INFO:teuthology.orchestra.run.smithi121.stdout:[ 2024-04-19T02:15:27.319 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:15:27.319 INFO:teuthology.orchestra.run.smithi121.stdout: "poolnum": 1, 2024-04-19T02:15:27.319 INFO:teuthology.orchestra.run.smithi121.stdout: "poolname": ".mgr" 2024-04-19T02:15:27.319 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:27.319 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:15:27.319 INFO:teuthology.orchestra.run.smithi121.stdout: "poolnum": 2, 2024-04-19T02:15:27.319 INFO:teuthology.orchestra.run.smithi121.stdout: "poolname": "rbd" 2024-04-19T02:15:27.319 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:15:27.319 INFO:teuthology.orchestra.run.smithi121.stdout:] 2024-04-19T02:15:27.333 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-19T02:15:27.333 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-19T02:15:27.876 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_metadata' created 2024-04-19T02:15:27.887 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-19T02:15:28.882 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_data' created 2024-04-19T02:15:28.894 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-19T02:15:29.270 INFO:teuthology.orchestra.run.smithi121.stderr:new fs with metadata pool 3 and data pool 4 2024-04-19T02:15:29.282 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T02:15:29.605 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:15:29.605 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":14,"fsid":"f6ab5dd0-bb9f-4b48-a9fc-4728c7955ca8","created":"2024-04-19T02:15:13.539846+0000","modified":"2024-04-19T02:15:29.263058+0000","last_up_change":"2024-04-19T02:15:22.519568+0000","last_in_change":"2024-04-19T02:15:15.482624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T02:15:22.776125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T02:15:23.264005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T02:15:27.675087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T02:15:28.232224+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88cb15f3-271c-43d5-af51-1cd26b8ed13c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":41347},{"type":"v1","addr":"172.21.15.153:6801","nonce":41347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":41347},{"type":"v1","addr":"172.21.15.153:6803","nonce":41347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":41347},{"type":"v1","addr":"172.21.15.153:6807","nonce":41347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":41347},{"type":"v1","addr":"172.21.15.153:6805","nonce":41347}]},"public_addr":"172.21.15.153:6801/41347","cluster_addr":"172.21.15.153:6803/41347","heartbeat_back_addr":"172.21.15.153:6807/41347","heartbeat_front_addr":"172.21.15.153:6805/41347","state":["exists","up"]},{"osd":1,"uuid":"2674869a-db01-4d9f-a496-9fb3851b5b21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":41380},{"type":"v1","addr":"172.21.15.174:6801","nonce":41380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":41380},{"type":"v1","addr":"172.21.15.174:6803","nonce":41380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":41380},{"type":"v1","addr":"172.21.15.174:6807","nonce":41380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":41380},{"type":"v1","addr":"172.21.15.174:6805","nonce":41380}]},"public_addr":"172.21.15.174:6801/41380","cluster_addr":"172.21.15.174:6803/41380","heartbeat_back_addr":"172.21.15.174:6807/41380","heartbeat_front_addr":"172.21.15.174:6805/41380","state":["exists","up"]},{"osd":2,"uuid":"712ad943-2f98-49d9-aabe-f66b509be633","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":41508},{"type":"v1","addr":"172.21.15.177:6801","nonce":41508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":41508},{"type":"v1","addr":"172.21.15.177:6803","nonce":41508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":41508},{"type":"v1","addr":"172.21.15.177:6807","nonce":41508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":41508},{"type":"v1","addr":"172.21.15.177:6805","nonce":41508}]},"public_addr":"172.21.15.177:6801/41508","cluster_addr":"172.21.15.177:6803/41508","heartbeat_back_addr":"172.21.15.177:6807/41508","heartbeat_front_addr":"172.21.15.177:6805/41508","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:15:20.495280+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:15:20.594553+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:15:20.524253+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T02:15:29.619 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T02:15:29.943 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:15:29.943 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":14,"fsid":"f6ab5dd0-bb9f-4b48-a9fc-4728c7955ca8","created":"2024-04-19T02:15:13.539846+0000","modified":"2024-04-19T02:15:29.263058+0000","last_up_change":"2024-04-19T02:15:22.519568+0000","last_in_change":"2024-04-19T02:15:15.482624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T02:15:22.776125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T02:15:23.264005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T02:15:27.675087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T02:15:28.232224+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88cb15f3-271c-43d5-af51-1cd26b8ed13c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":41347},{"type":"v1","addr":"172.21.15.153:6801","nonce":41347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":41347},{"type":"v1","addr":"172.21.15.153:6803","nonce":41347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":41347},{"type":"v1","addr":"172.21.15.153:6807","nonce":41347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":41347},{"type":"v1","addr":"172.21.15.153:6805","nonce":41347}]},"public_addr":"172.21.15.153:6801/41347","cluster_addr":"172.21.15.153:6803/41347","heartbeat_back_addr":"172.21.15.153:6807/41347","heartbeat_front_addr":"172.21.15.153:6805/41347","state":["exists","up"]},{"osd":1,"uuid":"2674869a-db01-4d9f-a496-9fb3851b5b21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":41380},{"type":"v1","addr":"172.21.15.174:6801","nonce":41380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":41380},{"type":"v1","addr":"172.21.15.174:6803","nonce":41380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":41380},{"type":"v1","addr":"172.21.15.174:6807","nonce":41380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":41380},{"type":"v1","addr":"172.21.15.174:6805","nonce":41380}]},"public_addr":"172.21.15.174:6801/41380","cluster_addr":"172.21.15.174:6803/41380","heartbeat_back_addr":"172.21.15.174:6807/41380","heartbeat_front_addr":"172.21.15.174:6805/41380","state":["exists","up"]},{"osd":2,"uuid":"712ad943-2f98-49d9-aabe-f66b509be633","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":41508},{"type":"v1","addr":"172.21.15.177:6801","nonce":41508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":41508},{"type":"v1","addr":"172.21.15.177:6803","nonce":41508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":41508},{"type":"v1","addr":"172.21.15.177:6807","nonce":41508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":41508},{"type":"v1","addr":"172.21.15.177:6805","nonce":41508}]},"public_addr":"172.21.15.177:6801/41508","cluster_addr":"172.21.15.177:6803/41508","heartbeat_back_addr":"172.21.15.177:6807/41508","heartbeat_front_addr":"172.21.15.177:6805/41508","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:15:20.495280+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:15:20.594553+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:15:20.524253+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T02:15:29.957 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-19T02:15:31.292 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-19T02:15:31.292 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-19T02:15:32.294 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-19T02:15:32.295 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-19T02:15:32.667 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:15:32.667 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-19T02:15:29.263369+0000","modified":"2024-04-19T02:15:32.274461+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4230":{"gid":4230,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6803/1144924022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":1144924022},{"type":"v1","addr":"172.21.15.121:6803","nonce":1144924022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-19T02:15:32.669 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 6 2024-04-19T02:15:32.681 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T02:15:33.003 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:15:33.003 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":15,"fsid":"f6ab5dd0-bb9f-4b48-a9fc-4728c7955ca8","created":"2024-04-19T02:15:13.539846+0000","modified":"2024-04-19T02:15:30.265522+0000","last_up_change":"2024-04-19T02:15:22.519568+0000","last_in_change":"2024-04-19T02:15:15.482624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T02:15:22.776125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T02:15:23.264005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T02:15:27.675087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T02:15:28.232224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88cb15f3-271c-43d5-af51-1cd26b8ed13c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":41347},{"type":"v1","addr":"172.21.15.153:6801","nonce":41347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":41347},{"type":"v1","addr":"172.21.15.153:6803","nonce":41347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":41347},{"type":"v1","addr":"172.21.15.153:6807","nonce":41347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":41347},{"type":"v1","addr":"172.21.15.153:6805","nonce":41347}]},"public_addr":"172.21.15.153:6801/41347","cluster_addr":"172.21.15.153:6803/41347","heartbeat_back_addr":"172.21.15.153:6807/41347","heartbeat_front_addr":"172.21.15.153:6805/41347","state":["exists","up"]},{"osd":1,"uuid":"2674869a-db01-4d9f-a496-9fb3851b5b21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":41380},{"type":"v1","addr":"172.21.15.174:6801","nonce":41380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":41380},{"type":"v1","addr":"172.21.15.174:6803","nonce":41380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":41380},{"type":"v1","addr":"172.21.15.174:6807","nonce":41380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":41380},{"type":"v1","addr":"172.21.15.174:6805","nonce":41380}]},"public_addr":"172.21.15.174:6801/41380","cluster_addr":"172.21.15.174:6803/41380","heartbeat_back_addr":"172.21.15.174:6807/41380","heartbeat_front_addr":"172.21.15.174:6805/41380","state":["exists","up"]},{"osd":2,"uuid":"712ad943-2f98-49d9-aabe-f66b509be633","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":41508},{"type":"v1","addr":"172.21.15.177:6801","nonce":41508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":41508},{"type":"v1","addr":"172.21.15.177:6803","nonce":41508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":41508},{"type":"v1","addr":"172.21.15.177:6807","nonce":41508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":41508},{"type":"v1","addr":"172.21.15.177:6805","nonce":41508}]},"public_addr":"172.21.15.177:6801/41508","cluster_addr":"172.21.15.177:6803/41508","heartbeat_back_addr":"172.21.15.177:6807/41508","heartbeat_front_addr":"172.21.15.177:6805/41508","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:15:20.495280+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:15:20.594553+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:15:20.524253+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T02:15:33.017 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-19T02:15:33.017 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:15:33.346 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:15:33.348 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-04-19T02:15:33.357 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":16,"stamp":"2024-04-19T02:15:32.738281+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":83308,"kb_used_data":1440,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283032212,"statfs":{"total":289910292480,"available":289824985088,"internally_reserved":0,"allocated":1474560,"data_stored":1259912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":82963794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.865994"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-19T02:15:25.529124+0000","last_change":"2024-04-19T02:15:24.527061+0000","last_active":"2024-04-19T02:15:25.529124+0000","last_peered":"2024-04-19T02:15:25.529124+0000","last_clean":"2024-04-19T02:15:25.529124+0000","last_became_active":"2024-04-19T02:15:24.526757+0000","last_became_peered":"2024-04-19T02:15:24.526757+0000","last_unstale":"2024-04-19T02:15:25.529124+0000","last_undegraded":"2024-04-19T02:15:25.529124+0000","last_fullsized":"2024-04-19T02:15:25.529124+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:17:13.649077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-19T02:15:27.651578+0000","last_change":"2024-04-19T02:15:24.530933+0000","last_active":"2024-04-19T02:15:27.651578+0000","last_peered":"2024-04-19T02:15:27.651578+0000","last_clean":"2024-04-19T02:15:27.651578+0000","last_became_active":"2024-04-19T02:15:24.530550+0000","last_became_peered":"2024-04-19T02:15:24.530550+0000","last_unstale":"2024-04-19T02:15:27.651578+0000","last_undegraded":"2024-04-19T02:15:27.651578+0000","last_fullsized":"2024-04-19T02:15:27.651578+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:18:15.194321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-19T02:15:25.529110+0000","last_change":"2024-04-19T02:15:24.527048+0000","last_active":"2024-04-19T02:15:25.529110+0000","last_peered":"2024-04-19T02:15:25.529110+0000","last_clean":"2024-04-19T02:15:25.529110+0000","last_became_active":"2024-04-19T02:15:24.526790+0000","last_became_peered":"2024-04-19T02:15:24.526790+0000","last_unstale":"2024-04-19T02:15:25.529110+0000","last_undegraded":"2024-04-19T02:15:25.529110+0000","last_fullsized":"2024-04-19T02:15:25.529110+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-19T02:15:27.651570+0000","last_change":"2024-04-19T02:15:24.530924+0000","last_active":"2024-04-19T02:15:27.651570+0000","last_peered":"2024-04-19T02:15:27.651570+0000","last_clean":"2024-04-19T02:15:27.651570+0000","last_became_active":"2024-04-19T02:15:24.530551+0000","last_became_peered":"2024-04-19T02:15:24.530551+0000","last_unstale":"2024-04-19T02:15:27.651570+0000","last_undegraded":"2024-04-19T02:15:27.651570+0000","last_fullsized":"2024-04-19T02:15:27.651570+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:30.576946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":206,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-19T02:15:27.651549+0000","last_change":"2024-04-19T02:15:24.533634+0000","last_active":"2024-04-19T02:15:27.651549+0000","last_peered":"2024-04-19T02:15:27.651549+0000","last_clean":"2024-04-19T02:15:27.651549+0000","last_became_active":"2024-04-19T02:15:24.533420+0000","last_became_peered":"2024-04-19T02:15:24.533420+0000","last_unstale":"2024-04-19T02:15:27.651549+0000","last_undegraded":"2024-04-19T02:15:27.651549+0000","last_fullsized":"2024-04-19T02:15:27.651549+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-19T02:15:27.651559+0000","last_change":"2024-04-19T02:15:24.533912+0000","last_active":"2024-04-19T02:15:27.651559+0000","last_peered":"2024-04-19T02:15:27.651559+0000","last_clean":"2024-04-19T02:15:27.651559+0000","last_became_active":"2024-04-19T02:15:24.533580+0000","last_became_peered":"2024-04-19T02:15:24.533580+0000","last_unstale":"2024-04-19T02:15:27.651559+0000","last_undegraded":"2024-04-19T02:15:27.651559+0000","last_fullsized":"2024-04-19T02:15:27.651559+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:45.045477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-19T02:15:25.528699+0000","last_change":"2024-04-19T02:15:24.526751+0000","last_active":"2024-04-19T02:15:25.528699+0000","last_peered":"2024-04-19T02:15:25.528699+0000","last_clean":"2024-04-19T02:15:25.528699+0000","last_became_active":"2024-04-19T02:15:24.526511+0000","last_became_peered":"2024-04-19T02:15:24.526511+0000","last_unstale":"2024-04-19T02:15:25.528699+0000","last_undegraded":"2024-04-19T02:15:25.528699+0000","last_fullsized":"2024-04-19T02:15:25.528699+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:02:45.966851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-19T02:15:25.529168+0000","last_change":"2024-04-19T02:15:24.526845+0000","last_active":"2024-04-19T02:15:25.529168+0000","last_peered":"2024-04-19T02:15:25.529168+0000","last_clean":"2024-04-19T02:15:25.529168+0000","last_became_active":"2024-04-19T02:15:24.526500+0000","last_became_peered":"2024-04-19T02:15:24.526500+0000","last_unstale":"2024-04-19T02:15:25.529168+0000","last_undegraded":"2024-04-19T02:15:25.529168+0000","last_fullsized":"2024-04-19T02:15:25.529168+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:16.883355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-19T02:15:27.651609+0000","last_change":"2024-04-19T02:15:24.533777+0000","last_active":"2024-04-19T02:15:27.651609+0000","last_peered":"2024-04-19T02:15:27.651609+0000","last_clean":"2024-04-19T02:15:27.651609+0000","last_became_active":"2024-04-19T02:15:24.533436+0000","last_became_peered":"2024-04-19T02:15:24.533436+0000","last_unstale":"2024-04-19T02:15:27.651609+0000","last_undegraded":"2024-04-19T02:15:27.651609+0000","last_fullsized":"2024-04-19T02:15:27.651609+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:53:25.922418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738370,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":96,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":98304,"data_stored":27748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738371,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28248,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343592,"statfs":{"total":96636764160,"available":96607838208,"internally_reserved":0,"allocated":684032,"data_stored":614048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]}]},{"osd":1,"up_from":8,"seq":34359738370,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":692224,"data_stored":618116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:15:33.361 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:15:33.722 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:15:33.724 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-04-19T02:15:33.734 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":16,"stamp":"2024-04-19T02:15:32.738281+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":83308,"kb_used_data":1440,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283032212,"statfs":{"total":289910292480,"available":289824985088,"internally_reserved":0,"allocated":1474560,"data_stored":1259912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":82963794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.865994"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-19T02:15:25.529124+0000","last_change":"2024-04-19T02:15:24.527061+0000","last_active":"2024-04-19T02:15:25.529124+0000","last_peered":"2024-04-19T02:15:25.529124+0000","last_clean":"2024-04-19T02:15:25.529124+0000","last_became_active":"2024-04-19T02:15:24.526757+0000","last_became_peered":"2024-04-19T02:15:24.526757+0000","last_unstale":"2024-04-19T02:15:25.529124+0000","last_undegraded":"2024-04-19T02:15:25.529124+0000","last_fullsized":"2024-04-19T02:15:25.529124+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:17:13.649077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-19T02:15:27.651578+0000","last_change":"2024-04-19T02:15:24.530933+0000","last_active":"2024-04-19T02:15:27.651578+0000","last_peered":"2024-04-19T02:15:27.651578+0000","last_clean":"2024-04-19T02:15:27.651578+0000","last_became_active":"2024-04-19T02:15:24.530550+0000","last_became_peered":"2024-04-19T02:15:24.530550+0000","last_unstale":"2024-04-19T02:15:27.651578+0000","last_undegraded":"2024-04-19T02:15:27.651578+0000","last_fullsized":"2024-04-19T02:15:27.651578+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:18:15.194321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-19T02:15:25.529110+0000","last_change":"2024-04-19T02:15:24.527048+0000","last_active":"2024-04-19T02:15:25.529110+0000","last_peered":"2024-04-19T02:15:25.529110+0000","last_clean":"2024-04-19T02:15:25.529110+0000","last_became_active":"2024-04-19T02:15:24.526790+0000","last_became_peered":"2024-04-19T02:15:24.526790+0000","last_unstale":"2024-04-19T02:15:25.529110+0000","last_undegraded":"2024-04-19T02:15:25.529110+0000","last_fullsized":"2024-04-19T02:15:25.529110+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-19T02:15:27.651570+0000","last_change":"2024-04-19T02:15:24.530924+0000","last_active":"2024-04-19T02:15:27.651570+0000","last_peered":"2024-04-19T02:15:27.651570+0000","last_clean":"2024-04-19T02:15:27.651570+0000","last_became_active":"2024-04-19T02:15:24.530551+0000","last_became_peered":"2024-04-19T02:15:24.530551+0000","last_unstale":"2024-04-19T02:15:27.651570+0000","last_undegraded":"2024-04-19T02:15:27.651570+0000","last_fullsized":"2024-04-19T02:15:27.651570+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:30.576946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":206,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-19T02:15:27.651549+0000","last_change":"2024-04-19T02:15:24.533634+0000","last_active":"2024-04-19T02:15:27.651549+0000","last_peered":"2024-04-19T02:15:27.651549+0000","last_clean":"2024-04-19T02:15:27.651549+0000","last_became_active":"2024-04-19T02:15:24.533420+0000","last_became_peered":"2024-04-19T02:15:24.533420+0000","last_unstale":"2024-04-19T02:15:27.651549+0000","last_undegraded":"2024-04-19T02:15:27.651549+0000","last_fullsized":"2024-04-19T02:15:27.651549+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-19T02:15:27.651559+0000","last_change":"2024-04-19T02:15:24.533912+0000","last_active":"2024-04-19T02:15:27.651559+0000","last_peered":"2024-04-19T02:15:27.651559+0000","last_clean":"2024-04-19T02:15:27.651559+0000","last_became_active":"2024-04-19T02:15:24.533580+0000","last_became_peered":"2024-04-19T02:15:24.533580+0000","last_unstale":"2024-04-19T02:15:27.651559+0000","last_undegraded":"2024-04-19T02:15:27.651559+0000","last_fullsized":"2024-04-19T02:15:27.651559+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:45.045477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-19T02:15:25.528699+0000","last_change":"2024-04-19T02:15:24.526751+0000","last_active":"2024-04-19T02:15:25.528699+0000","last_peered":"2024-04-19T02:15:25.528699+0000","last_clean":"2024-04-19T02:15:25.528699+0000","last_became_active":"2024-04-19T02:15:24.526511+0000","last_became_peered":"2024-04-19T02:15:24.526511+0000","last_unstale":"2024-04-19T02:15:25.528699+0000","last_undegraded":"2024-04-19T02:15:25.528699+0000","last_fullsized":"2024-04-19T02:15:25.528699+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:02:45.966851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-19T02:15:25.529168+0000","last_change":"2024-04-19T02:15:24.526845+0000","last_active":"2024-04-19T02:15:25.529168+0000","last_peered":"2024-04-19T02:15:25.529168+0000","last_clean":"2024-04-19T02:15:25.529168+0000","last_became_active":"2024-04-19T02:15:24.526500+0000","last_became_peered":"2024-04-19T02:15:24.526500+0000","last_unstale":"2024-04-19T02:15:25.529168+0000","last_undegraded":"2024-04-19T02:15:25.529168+0000","last_fullsized":"2024-04-19T02:15:25.529168+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:16.883355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-19T02:15:27.651609+0000","last_change":"2024-04-19T02:15:24.533777+0000","last_active":"2024-04-19T02:15:27.651609+0000","last_peered":"2024-04-19T02:15:27.651609+0000","last_clean":"2024-04-19T02:15:27.651609+0000","last_became_active":"2024-04-19T02:15:24.533436+0000","last_became_peered":"2024-04-19T02:15:24.533436+0000","last_unstale":"2024-04-19T02:15:27.651609+0000","last_undegraded":"2024-04-19T02:15:27.651609+0000","last_fullsized":"2024-04-19T02:15:27.651609+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:53:25.922418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738370,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":96,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":98304,"data_stored":27748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738371,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28248,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343592,"statfs":{"total":96636764160,"available":96607838208,"internally_reserved":0,"allocated":684032,"data_stored":614048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]}]},{"osd":1,"up_from":8,"seq":34359738370,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":692224,"data_stored":618116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:15:33.738 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:15:34.100 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:15:34.102 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-04-19T02:15:34.111 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":16,"stamp":"2024-04-19T02:15:32.738281+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":83308,"kb_used_data":1440,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283032212,"statfs":{"total":289910292480,"available":289824985088,"internally_reserved":0,"allocated":1474560,"data_stored":1259912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":82963794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.865994"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-19T02:15:25.529124+0000","last_change":"2024-04-19T02:15:24.527061+0000","last_active":"2024-04-19T02:15:25.529124+0000","last_peered":"2024-04-19T02:15:25.529124+0000","last_clean":"2024-04-19T02:15:25.529124+0000","last_became_active":"2024-04-19T02:15:24.526757+0000","last_became_peered":"2024-04-19T02:15:24.526757+0000","last_unstale":"2024-04-19T02:15:25.529124+0000","last_undegraded":"2024-04-19T02:15:25.529124+0000","last_fullsized":"2024-04-19T02:15:25.529124+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:17:13.649077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-19T02:15:27.651578+0000","last_change":"2024-04-19T02:15:24.530933+0000","last_active":"2024-04-19T02:15:27.651578+0000","last_peered":"2024-04-19T02:15:27.651578+0000","last_clean":"2024-04-19T02:15:27.651578+0000","last_became_active":"2024-04-19T02:15:24.530550+0000","last_became_peered":"2024-04-19T02:15:24.530550+0000","last_unstale":"2024-04-19T02:15:27.651578+0000","last_undegraded":"2024-04-19T02:15:27.651578+0000","last_fullsized":"2024-04-19T02:15:27.651578+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:18:15.194321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-19T02:15:25.529110+0000","last_change":"2024-04-19T02:15:24.527048+0000","last_active":"2024-04-19T02:15:25.529110+0000","last_peered":"2024-04-19T02:15:25.529110+0000","last_clean":"2024-04-19T02:15:25.529110+0000","last_became_active":"2024-04-19T02:15:24.526790+0000","last_became_peered":"2024-04-19T02:15:24.526790+0000","last_unstale":"2024-04-19T02:15:25.529110+0000","last_undegraded":"2024-04-19T02:15:25.529110+0000","last_fullsized":"2024-04-19T02:15:25.529110+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-19T02:15:27.651570+0000","last_change":"2024-04-19T02:15:24.530924+0000","last_active":"2024-04-19T02:15:27.651570+0000","last_peered":"2024-04-19T02:15:27.651570+0000","last_clean":"2024-04-19T02:15:27.651570+0000","last_became_active":"2024-04-19T02:15:24.530551+0000","last_became_peered":"2024-04-19T02:15:24.530551+0000","last_unstale":"2024-04-19T02:15:27.651570+0000","last_undegraded":"2024-04-19T02:15:27.651570+0000","last_fullsized":"2024-04-19T02:15:27.651570+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:30.576946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":206,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-19T02:15:27.651549+0000","last_change":"2024-04-19T02:15:24.533634+0000","last_active":"2024-04-19T02:15:27.651549+0000","last_peered":"2024-04-19T02:15:27.651549+0000","last_clean":"2024-04-19T02:15:27.651549+0000","last_became_active":"2024-04-19T02:15:24.533420+0000","last_became_peered":"2024-04-19T02:15:24.533420+0000","last_unstale":"2024-04-19T02:15:27.651549+0000","last_undegraded":"2024-04-19T02:15:27.651549+0000","last_fullsized":"2024-04-19T02:15:27.651549+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-19T02:15:27.651559+0000","last_change":"2024-04-19T02:15:24.533912+0000","last_active":"2024-04-19T02:15:27.651559+0000","last_peered":"2024-04-19T02:15:27.651559+0000","last_clean":"2024-04-19T02:15:27.651559+0000","last_became_active":"2024-04-19T02:15:24.533580+0000","last_became_peered":"2024-04-19T02:15:24.533580+0000","last_unstale":"2024-04-19T02:15:27.651559+0000","last_undegraded":"2024-04-19T02:15:27.651559+0000","last_fullsized":"2024-04-19T02:15:27.651559+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:45.045477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-19T02:15:25.528699+0000","last_change":"2024-04-19T02:15:24.526751+0000","last_active":"2024-04-19T02:15:25.528699+0000","last_peered":"2024-04-19T02:15:25.528699+0000","last_clean":"2024-04-19T02:15:25.528699+0000","last_became_active":"2024-04-19T02:15:24.526511+0000","last_became_peered":"2024-04-19T02:15:24.526511+0000","last_unstale":"2024-04-19T02:15:25.528699+0000","last_undegraded":"2024-04-19T02:15:25.528699+0000","last_fullsized":"2024-04-19T02:15:25.528699+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:02:45.966851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-19T02:15:25.529168+0000","last_change":"2024-04-19T02:15:24.526845+0000","last_active":"2024-04-19T02:15:25.529168+0000","last_peered":"2024-04-19T02:15:25.529168+0000","last_clean":"2024-04-19T02:15:25.529168+0000","last_became_active":"2024-04-19T02:15:24.526500+0000","last_became_peered":"2024-04-19T02:15:24.526500+0000","last_unstale":"2024-04-19T02:15:25.529168+0000","last_undegraded":"2024-04-19T02:15:25.529168+0000","last_fullsized":"2024-04-19T02:15:25.529168+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:16.883355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-19T02:15:27.651609+0000","last_change":"2024-04-19T02:15:24.533777+0000","last_active":"2024-04-19T02:15:27.651609+0000","last_peered":"2024-04-19T02:15:27.651609+0000","last_clean":"2024-04-19T02:15:27.651609+0000","last_became_active":"2024-04-19T02:15:24.533436+0000","last_became_peered":"2024-04-19T02:15:24.533436+0000","last_unstale":"2024-04-19T02:15:27.651609+0000","last_undegraded":"2024-04-19T02:15:27.651609+0000","last_fullsized":"2024-04-19T02:15:27.651609+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:53:25.922418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:27.862187+0000","last_change":"2024-04-19T02:15:27.862187+0000","last_active":"2024-04-19T02:15:27.862187+0000","last_peered":"2024-04-19T02:15:27.862187+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:27.862187+0000","last_undegraded":"2024-04-19T02:15:27.862187+0000","last_fullsized":"2024-04-19T02:15:27.862187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T02:15:28.871717+0000","last_change":"2024-04-19T02:15:28.871717+0000","last_active":"2024-04-19T02:15:28.871717+0000","last_peered":"2024-04-19T02:15:28.871717+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T02:15:28.871717+0000","last_undegraded":"2024-04-19T02:15:28.871717+0000","last_fullsized":"2024-04-19T02:15:28.871717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738370,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":96,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":98304,"data_stored":27748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738371,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28248,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343592,"statfs":{"total":96636764160,"available":96607838208,"internally_reserved":0,"allocated":684032,"data_stored":614048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]}]},{"osd":1,"up_from":8,"seq":34359738370,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":692224,"data_stored":618116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:15:34.115 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3f is not active+clean 2024-04-19T02:15:34.115 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.115 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3e is not active+clean 2024-04-19T02:15:34.115 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.115 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3d is not active+clean 2024-04-19T02:15:34.115 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.115 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3c is not active+clean 2024-04-19T02:15:34.115 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.115 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3b is not active+clean 2024-04-19T02:15:34.116 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.116 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3a is not active+clean 2024-04-19T02:15:34.116 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.116 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.39 is not active+clean 2024-04-19T02:15:34.116 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.116 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.38 is not active+clean 2024-04-19T02:15:34.116 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.116 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.37 is not active+clean 2024-04-19T02:15:34.116 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.116 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.36 is not active+clean 2024-04-19T02:15:34.116 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.116 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.35 is not active+clean 2024-04-19T02:15:34.117 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.117 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.34 is not active+clean 2024-04-19T02:15:34.117 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.117 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.33 is not active+clean 2024-04-19T02:15:34.117 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.117 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.32 is not active+clean 2024-04-19T02:15:34.117 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.117 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.31 is not active+clean 2024-04-19T02:15:34.117 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.117 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.30 is not active+clean 2024-04-19T02:15:34.117 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.118 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2f is not active+clean 2024-04-19T02:15:34.118 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.118 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2e is not active+clean 2024-04-19T02:15:34.118 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.118 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2d is not active+clean 2024-04-19T02:15:34.118 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.118 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2c is not active+clean 2024-04-19T02:15:34.118 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.118 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2b is not active+clean 2024-04-19T02:15:34.118 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.118 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2a is not active+clean 2024-04-19T02:15:34.119 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.119 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.29 is not active+clean 2024-04-19T02:15:34.119 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.119 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.28 is not active+clean 2024-04-19T02:15:34.119 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.119 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.27 is not active+clean 2024-04-19T02:15:34.119 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.119 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.26 is not active+clean 2024-04-19T02:15:34.119 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.119 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.25 is not active+clean 2024-04-19T02:15:34.119 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.119 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2024-04-19T02:15:34.120 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:27.862187+0000', 'last_change': '2024-04-19T02:15:27.862187+0000', 'last_active': '2024-04-19T02:15:27.862187+0000', 'last_peered': '2024-04-19T02:15:27.862187+0000', 'last_clean': '2024-04-19T02:15:27.862187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:27.862187+0000', 'last_undegraded': '2024-04-19T02:15:27.862187+0000', 'last_fullsized': '2024-04-19T02:15:27.862187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.120 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2024-04-19T02:15:34.120 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.120 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2024-04-19T02:15:34.120 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:27.862187+0000', 'last_change': '2024-04-19T02:15:27.862187+0000', 'last_active': '2024-04-19T02:15:27.862187+0000', 'last_peered': '2024-04-19T02:15:27.862187+0000', 'last_clean': '2024-04-19T02:15:27.862187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:27.862187+0000', 'last_undegraded': '2024-04-19T02:15:27.862187+0000', 'last_fullsized': '2024-04-19T02:15:27.862187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.120 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2024-04-19T02:15:34.120 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.120 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2024-04-19T02:15:34.120 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:27.862187+0000', 'last_change': '2024-04-19T02:15:27.862187+0000', 'last_active': '2024-04-19T02:15:27.862187+0000', 'last_peered': '2024-04-19T02:15:27.862187+0000', 'last_clean': '2024-04-19T02:15:27.862187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:27.862187+0000', 'last_undegraded': '2024-04-19T02:15:27.862187+0000', 'last_fullsized': '2024-04-19T02:15:27.862187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.120 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2024-04-19T02:15:34.120 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.121 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2024-04-19T02:15:34.121 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:27.862187+0000', 'last_change': '2024-04-19T02:15:27.862187+0000', 'last_active': '2024-04-19T02:15:27.862187+0000', 'last_peered': '2024-04-19T02:15:27.862187+0000', 'last_clean': '2024-04-19T02:15:27.862187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:27.862187+0000', 'last_undegraded': '2024-04-19T02:15:27.862187+0000', 'last_fullsized': '2024-04-19T02:15:27.862187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.121 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2024-04-19T02:15:34.121 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.121 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2024-04-19T02:15:34.121 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:27.862187+0000', 'last_change': '2024-04-19T02:15:27.862187+0000', 'last_active': '2024-04-19T02:15:27.862187+0000', 'last_peered': '2024-04-19T02:15:27.862187+0000', 'last_clean': '2024-04-19T02:15:27.862187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:27.862187+0000', 'last_undegraded': '2024-04-19T02:15:27.862187+0000', 'last_fullsized': '2024-04-19T02:15:27.862187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.121 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2024-04-19T02:15:34.121 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.121 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2024-04-19T02:15:34.121 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:27.862187+0000', 'last_change': '2024-04-19T02:15:27.862187+0000', 'last_active': '2024-04-19T02:15:27.862187+0000', 'last_peered': '2024-04-19T02:15:27.862187+0000', 'last_clean': '2024-04-19T02:15:27.862187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:27.862187+0000', 'last_undegraded': '2024-04-19T02:15:27.862187+0000', 'last_fullsized': '2024-04-19T02:15:27.862187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.121 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2024-04-19T02:15:34.121 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.122 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2024-04-19T02:15:34.122 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:27.862187+0000', 'last_change': '2024-04-19T02:15:27.862187+0000', 'last_active': '2024-04-19T02:15:27.862187+0000', 'last_peered': '2024-04-19T02:15:27.862187+0000', 'last_clean': '2024-04-19T02:15:27.862187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:27.862187+0000', 'last_undegraded': '2024-04-19T02:15:27.862187+0000', 'last_fullsized': '2024-04-19T02:15:27.862187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.122 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2024-04-19T02:15:34.122 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.122 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2024-04-19T02:15:34.122 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:27.862187+0000', 'last_change': '2024-04-19T02:15:27.862187+0000', 'last_active': '2024-04-19T02:15:27.862187+0000', 'last_peered': '2024-04-19T02:15:27.862187+0000', 'last_clean': '2024-04-19T02:15:27.862187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:27.862187+0000', 'last_undegraded': '2024-04-19T02:15:27.862187+0000', 'last_fullsized': '2024-04-19T02:15:27.862187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.122 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2024-04-19T02:15:34.122 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.122 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2024-04-19T02:15:34.122 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:27.862187+0000', 'last_change': '2024-04-19T02:15:27.862187+0000', 'last_active': '2024-04-19T02:15:27.862187+0000', 'last_peered': '2024-04-19T02:15:27.862187+0000', 'last_clean': '2024-04-19T02:15:27.862187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:27.862187+0000', 'last_undegraded': '2024-04-19T02:15:27.862187+0000', 'last_fullsized': '2024-04-19T02:15:27.862187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.122 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2024-04-19T02:15:34.123 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.123 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2024-04-19T02:15:34.123 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:27.862187+0000', 'last_change': '2024-04-19T02:15:27.862187+0000', 'last_active': '2024-04-19T02:15:27.862187+0000', 'last_peered': '2024-04-19T02:15:27.862187+0000', 'last_clean': '2024-04-19T02:15:27.862187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:27.862187+0000', 'last_undegraded': '2024-04-19T02:15:27.862187+0000', 'last_fullsized': '2024-04-19T02:15:27.862187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.123 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2024-04-19T02:15:34.123 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.123 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2024-04-19T02:15:34.123 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:27.862187+0000', 'last_change': '2024-04-19T02:15:27.862187+0000', 'last_active': '2024-04-19T02:15:27.862187+0000', 'last_peered': '2024-04-19T02:15:27.862187+0000', 'last_clean': '2024-04-19T02:15:27.862187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:27.862187+0000', 'last_undegraded': '2024-04-19T02:15:27.862187+0000', 'last_fullsized': '2024-04-19T02:15:27.862187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.124 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2024-04-19T02:15:34.124 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.124 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2024-04-19T02:15:34.124 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:27.862187+0000', 'last_change': '2024-04-19T02:15:27.862187+0000', 'last_active': '2024-04-19T02:15:27.862187+0000', 'last_peered': '2024-04-19T02:15:27.862187+0000', 'last_clean': '2024-04-19T02:15:27.862187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:27.862187+0000', 'last_undegraded': '2024-04-19T02:15:27.862187+0000', 'last_fullsized': '2024-04-19T02:15:27.862187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.124 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2024-04-19T02:15:34.124 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.124 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2024-04-19T02:15:34.124 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:27.862187+0000', 'last_change': '2024-04-19T02:15:27.862187+0000', 'last_active': '2024-04-19T02:15:27.862187+0000', 'last_peered': '2024-04-19T02:15:27.862187+0000', 'last_clean': '2024-04-19T02:15:27.862187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:27.862187+0000', 'last_undegraded': '2024-04-19T02:15:27.862187+0000', 'last_fullsized': '2024-04-19T02:15:27.862187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.125 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2024-04-19T02:15:34.125 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.125 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2024-04-19T02:15:34.125 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:27.862187+0000', 'last_change': '2024-04-19T02:15:27.862187+0000', 'last_active': '2024-04-19T02:15:27.862187+0000', 'last_peered': '2024-04-19T02:15:27.862187+0000', 'last_clean': '2024-04-19T02:15:27.862187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:27.862187+0000', 'last_undegraded': '2024-04-19T02:15:27.862187+0000', 'last_fullsized': '2024-04-19T02:15:27.862187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.125 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2024-04-19T02:15:34.125 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.125 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2024-04-19T02:15:34.125 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:27.862187+0000', 'last_change': '2024-04-19T02:15:27.862187+0000', 'last_active': '2024-04-19T02:15:27.862187+0000', 'last_peered': '2024-04-19T02:15:27.862187+0000', 'last_clean': '2024-04-19T02:15:27.862187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:27.862187+0000', 'last_undegraded': '2024-04-19T02:15:27.862187+0000', 'last_fullsized': '2024-04-19T02:15:27.862187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.125 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2024-04-19T02:15:34.125 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.125 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2024-04-19T02:15:34.126 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:27.862187+0000', 'last_change': '2024-04-19T02:15:27.862187+0000', 'last_active': '2024-04-19T02:15:27.862187+0000', 'last_peered': '2024-04-19T02:15:27.862187+0000', 'last_clean': '2024-04-19T02:15:27.862187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:27.862187+0000', 'last_undegraded': '2024-04-19T02:15:27.862187+0000', 'last_fullsized': '2024-04-19T02:15:27.862187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.126 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2024-04-19T02:15:34.126 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.126 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2024-04-19T02:15:34.126 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:27.862187+0000', 'last_change': '2024-04-19T02:15:27.862187+0000', 'last_active': '2024-04-19T02:15:27.862187+0000', 'last_peered': '2024-04-19T02:15:27.862187+0000', 'last_clean': '2024-04-19T02:15:27.862187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:27.862187+0000', 'last_undegraded': '2024-04-19T02:15:27.862187+0000', 'last_fullsized': '2024-04-19T02:15:27.862187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.126 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2024-04-19T02:15:34.126 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.126 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2024-04-19T02:15:34.126 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:27.862187+0000', 'last_change': '2024-04-19T02:15:27.862187+0000', 'last_active': '2024-04-19T02:15:27.862187+0000', 'last_peered': '2024-04-19T02:15:27.862187+0000', 'last_clean': '2024-04-19T02:15:27.862187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:27.862187+0000', 'last_undegraded': '2024-04-19T02:15:27.862187+0000', 'last_fullsized': '2024-04-19T02:15:27.862187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.126 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2024-04-19T02:15:34.126 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.127 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2024-04-19T02:15:34.127 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:27.862187+0000', 'last_change': '2024-04-19T02:15:27.862187+0000', 'last_active': '2024-04-19T02:15:27.862187+0000', 'last_peered': '2024-04-19T02:15:27.862187+0000', 'last_clean': '2024-04-19T02:15:27.862187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:27.862187+0000', 'last_undegraded': '2024-04-19T02:15:27.862187+0000', 'last_fullsized': '2024-04-19T02:15:27.862187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.127 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2024-04-19T02:15:34.127 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.127 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2024-04-19T02:15:34.127 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:27.862187+0000', 'last_change': '2024-04-19T02:15:27.862187+0000', 'last_active': '2024-04-19T02:15:27.862187+0000', 'last_peered': '2024-04-19T02:15:27.862187+0000', 'last_clean': '2024-04-19T02:15:27.862187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:27.862187+0000', 'last_undegraded': '2024-04-19T02:15:27.862187+0000', 'last_fullsized': '2024-04-19T02:15:27.862187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.127 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2024-04-19T02:15:34.127 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.127 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2024-04-19T02:15:34.127 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:27.862187+0000', 'last_change': '2024-04-19T02:15:27.862187+0000', 'last_active': '2024-04-19T02:15:27.862187+0000', 'last_peered': '2024-04-19T02:15:27.862187+0000', 'last_clean': '2024-04-19T02:15:27.862187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:27.862187+0000', 'last_undegraded': '2024-04-19T02:15:27.862187+0000', 'last_fullsized': '2024-04-19T02:15:27.862187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.127 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2024-04-19T02:15:34.127 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.128 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2024-04-19T02:15:34.128 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:27.862187+0000', 'last_change': '2024-04-19T02:15:27.862187+0000', 'last_active': '2024-04-19T02:15:27.862187+0000', 'last_peered': '2024-04-19T02:15:27.862187+0000', 'last_clean': '2024-04-19T02:15:27.862187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:27.862187+0000', 'last_undegraded': '2024-04-19T02:15:27.862187+0000', 'last_fullsized': '2024-04-19T02:15:27.862187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.128 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2024-04-19T02:15:34.128 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.128 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2024-04-19T02:15:34.128 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:27.862187+0000', 'last_change': '2024-04-19T02:15:27.862187+0000', 'last_active': '2024-04-19T02:15:27.862187+0000', 'last_peered': '2024-04-19T02:15:27.862187+0000', 'last_clean': '2024-04-19T02:15:27.862187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:27.862187+0000', 'last_undegraded': '2024-04-19T02:15:27.862187+0000', 'last_fullsized': '2024-04-19T02:15:27.862187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.128 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2024-04-19T02:15:34.128 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.128 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2024-04-19T02:15:34.128 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:27.862187+0000', 'last_change': '2024-04-19T02:15:27.862187+0000', 'last_active': '2024-04-19T02:15:27.862187+0000', 'last_peered': '2024-04-19T02:15:27.862187+0000', 'last_clean': '2024-04-19T02:15:27.862187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:27.862187+0000', 'last_undegraded': '2024-04-19T02:15:27.862187+0000', 'last_fullsized': '2024-04-19T02:15:27.862187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.128 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2024-04-19T02:15:34.129 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.129 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2024-04-19T02:15:34.129 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:27.862187+0000', 'last_change': '2024-04-19T02:15:27.862187+0000', 'last_active': '2024-04-19T02:15:27.862187+0000', 'last_peered': '2024-04-19T02:15:27.862187+0000', 'last_clean': '2024-04-19T02:15:27.862187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:27.862187+0000', 'last_undegraded': '2024-04-19T02:15:27.862187+0000', 'last_fullsized': '2024-04-19T02:15:27.862187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.129 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2024-04-19T02:15:34.129 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.129 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2024-04-19T02:15:34.129 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:27.862187+0000', 'last_change': '2024-04-19T02:15:27.862187+0000', 'last_active': '2024-04-19T02:15:27.862187+0000', 'last_peered': '2024-04-19T02:15:27.862187+0000', 'last_clean': '2024-04-19T02:15:27.862187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:27.862187+0000', 'last_undegraded': '2024-04-19T02:15:27.862187+0000', 'last_fullsized': '2024-04-19T02:15:27.862187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.129 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2024-04-19T02:15:34.129 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.129 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2024-04-19T02:15:34.129 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:27.862187+0000', 'last_change': '2024-04-19T02:15:27.862187+0000', 'last_active': '2024-04-19T02:15:27.862187+0000', 'last_peered': '2024-04-19T02:15:27.862187+0000', 'last_clean': '2024-04-19T02:15:27.862187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:27.862187+0000', 'last_undegraded': '2024-04-19T02:15:27.862187+0000', 'last_fullsized': '2024-04-19T02:15:27.862187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.130 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2024-04-19T02:15:34.130 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.130 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2024-04-19T02:15:34.130 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:27.862187+0000', 'last_change': '2024-04-19T02:15:27.862187+0000', 'last_active': '2024-04-19T02:15:27.862187+0000', 'last_peered': '2024-04-19T02:15:27.862187+0000', 'last_clean': '2024-04-19T02:15:27.862187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:27.862187+0000', 'last_undegraded': '2024-04-19T02:15:27.862187+0000', 'last_fullsized': '2024-04-19T02:15:27.862187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.130 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2024-04-19T02:15:34.130 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.130 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2024-04-19T02:15:34.130 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:27.862187+0000', 'last_change': '2024-04-19T02:15:27.862187+0000', 'last_active': '2024-04-19T02:15:27.862187+0000', 'last_peered': '2024-04-19T02:15:27.862187+0000', 'last_clean': '2024-04-19T02:15:27.862187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:27.862187+0000', 'last_undegraded': '2024-04-19T02:15:27.862187+0000', 'last_fullsized': '2024-04-19T02:15:27.862187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.130 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2024-04-19T02:15:34.130 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.130 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2024-04-19T02:15:34.131 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:27.862187+0000', 'last_change': '2024-04-19T02:15:27.862187+0000', 'last_active': '2024-04-19T02:15:27.862187+0000', 'last_peered': '2024-04-19T02:15:27.862187+0000', 'last_clean': '2024-04-19T02:15:27.862187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:27.862187+0000', 'last_undegraded': '2024-04-19T02:15:27.862187+0000', 'last_fullsized': '2024-04-19T02:15:27.862187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.131 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2024-04-19T02:15:34.131 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.131 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2024-04-19T02:15:34.131 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:27.862187+0000', 'last_change': '2024-04-19T02:15:27.862187+0000', 'last_active': '2024-04-19T02:15:27.862187+0000', 'last_peered': '2024-04-19T02:15:27.862187+0000', 'last_clean': '2024-04-19T02:15:27.862187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:27.862187+0000', 'last_undegraded': '2024-04-19T02:15:27.862187+0000', 'last_fullsized': '2024-04-19T02:15:27.862187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.131 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2024-04-19T02:15:34.131 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.131 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2024-04-19T02:15:34.131 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:27.862187+0000', 'last_change': '2024-04-19T02:15:27.862187+0000', 'last_active': '2024-04-19T02:15:27.862187+0000', 'last_peered': '2024-04-19T02:15:27.862187+0000', 'last_clean': '2024-04-19T02:15:27.862187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:27.862187+0000', 'last_undegraded': '2024-04-19T02:15:27.862187+0000', 'last_fullsized': '2024-04-19T02:15:27.862187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:27.862187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.131 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2024-04-19T02:15:34.131 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.132 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.20 is not active+clean 2024-04-19T02:15:34.132 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.132 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.21 is not active+clean 2024-04-19T02:15:34.132 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.132 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.22 is not active+clean 2024-04-19T02:15:34.132 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.132 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.23 is not active+clean 2024-04-19T02:15:34.132 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.132 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.24 is not active+clean 2024-04-19T02:15:34.132 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T02:15:28.871717+0000', 'last_change': '2024-04-19T02:15:28.871717+0000', 'last_active': '2024-04-19T02:15:28.871717+0000', 'last_peered': '2024-04-19T02:15:28.871717+0000', 'last_clean': '2024-04-19T02:15:28.871717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T02:15:28.871717+0000', 'last_undegraded': '2024-04-19T02:15:28.871717+0000', 'last_fullsized': '2024-04-19T02:15:28.871717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'last_clean_scrub_stamp': '2024-04-19T02:15:28.871717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T02:15:34.133 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-19T02:15:34.550 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:15:34.550 INFO:teuthology.orchestra.run.smithi121.stdout:{"fsid":"f6ab5dd0-bb9f-4b48-a9fc-4728c7955ca8","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":19,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":15,"num_osds":3,"num_up_osds":3,"osd_up_since":1713492922,"num_in_osds":3,"osd_in_since":1713492915,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":96},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":85307392,"bytes_avail":289824985088,"bytes_total":289910292480,"unknown_pgs_ratio":0.91428571939468384},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4230}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-04-19T02:15:13.540864+0000","services":{}},"progress_events":{}} 2024-04-19T02:15:34.565 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-19T02:15:34.566 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:15:34.651 INFO:tasks.ceph.mds.a.smithi121.stderr:2024-04-19T02:15:34.651+0000 7fe80ba2c700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-19T02:15:34.892 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:15:34.893 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-04-19T02:15:34.904 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2024-04-19T02:15:34.738604+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":247,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":159,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":86784,"kb_used_data":1608,"kb_used_omap":4,"kb_used_meta":85115,"kb_avail":283028736,"statfs":{"total":289910292480,"available":289821425664,"internally_reserved":0,"allocated":1646592,"data_stored":1323601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":87158098},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001153"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.275255+0000","last_change":"2024-04-19T02:15:29.280412+0000","last_active":"2024-04-19T02:15:30.275255+0000","last_peered":"2024-04-19T02:15:30.275255+0000","last_clean":"2024-04-19T02:15:30.275255+0000","last_became_active":"2024-04-19T02:15:29.278762+0000","last_became_peered":"2024-04-19T02:15:29.278762+0000","last_unstale":"2024-04-19T02:15:30.275255+0000","last_undegraded":"2024-04-19T02:15:30.275255+0000","last_fullsized":"2024-04-19T02:15:30.275255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:45.301675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274720+0000","last_change":"2024-04-19T02:15:29.284695+0000","last_active":"2024-04-19T02:15:30.274720+0000","last_peered":"2024-04-19T02:15:30.274720+0000","last_clean":"2024-04-19T02:15:30.274720+0000","last_became_active":"2024-04-19T02:15:29.283468+0000","last_became_peered":"2024-04-19T02:15:29.283468+0000","last_unstale":"2024-04-19T02:15:30.274720+0000","last_undegraded":"2024-04-19T02:15:30.274720+0000","last_fullsized":"2024-04-19T02:15:30.274720+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.384881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752988+0000","last_change":"2024-04-19T02:15:29.286709+0000","last_active":"2024-04-19T02:15:31.752988+0000","last_peered":"2024-04-19T02:15:31.752988+0000","last_clean":"2024-04-19T02:15:31.752988+0000","last_became_active":"2024-04-19T02:15:29.286169+0000","last_became_peered":"2024-04-19T02:15:29.286169+0000","last_unstale":"2024-04-19T02:15:31.752988+0000","last_undegraded":"2024-04-19T02:15:31.752988+0000","last_fullsized":"2024-04-19T02:15:31.752988+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:58.741466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752842+0000","last_change":"2024-04-19T02:15:29.280131+0000","last_active":"2024-04-19T02:15:31.752842+0000","last_peered":"2024-04-19T02:15:31.752842+0000","last_clean":"2024-04-19T02:15:31.752842+0000","last_became_active":"2024-04-19T02:15:29.279388+0000","last_became_peered":"2024-04-19T02:15:29.279388+0000","last_unstale":"2024-04-19T02:15:31.752842+0000","last_undegraded":"2024-04-19T02:15:31.752842+0000","last_fullsized":"2024-04-19T02:15:31.752842+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:36:48.819486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274570+0000","last_change":"2024-04-19T02:15:29.279377+0000","last_active":"2024-04-19T02:15:30.274570+0000","last_peered":"2024-04-19T02:15:30.274570+0000","last_clean":"2024-04-19T02:15:30.274570+0000","last_became_active":"2024-04-19T02:15:29.278954+0000","last_became_peered":"2024-04-19T02:15:29.278954+0000","last_unstale":"2024-04-19T02:15:30.274570+0000","last_undegraded":"2024-04-19T02:15:30.274570+0000","last_fullsized":"2024-04-19T02:15:30.274570+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:34.883207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752217+0000","last_change":"2024-04-19T02:15:29.283908+0000","last_active":"2024-04-19T02:15:31.752217+0000","last_peered":"2024-04-19T02:15:31.752217+0000","last_clean":"2024-04-19T02:15:31.752217+0000","last_became_active":"2024-04-19T02:15:29.281729+0000","last_became_peered":"2024-04-19T02:15:29.281729+0000","last_unstale":"2024-04-19T02:15:31.752217+0000","last_undegraded":"2024-04-19T02:15:31.752217+0000","last_fullsized":"2024-04-19T02:15:31.752217+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:03:15.383476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752077+0000","last_change":"2024-04-19T02:15:29.281253+0000","last_active":"2024-04-19T02:15:31.752077+0000","last_peered":"2024-04-19T02:15:31.752077+0000","last_clean":"2024-04-19T02:15:31.752077+0000","last_became_active":"2024-04-19T02:15:29.279951+0000","last_became_peered":"2024-04-19T02:15:29.279951+0000","last_unstale":"2024-04-19T02:15:31.752077+0000","last_undegraded":"2024-04-19T02:15:31.752077+0000","last_fullsized":"2024-04-19T02:15:31.752077+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.751969+0000","last_change":"2024-04-19T02:15:29.283952+0000","last_active":"2024-04-19T02:15:31.751969+0000","last_peered":"2024-04-19T02:15:31.751969+0000","last_clean":"2024-04-19T02:15:31.751969+0000","last_became_active":"2024-04-19T02:15:29.282721+0000","last_became_peered":"2024-04-19T02:15:29.282721+0000","last_unstale":"2024-04-19T02:15:31.751969+0000","last_undegraded":"2024-04-19T02:15:31.751969+0000","last_fullsized":"2024-04-19T02:15:31.751969+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:45.301675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273597+0000","last_change":"2024-04-19T02:15:29.282150+0000","last_active":"2024-04-19T02:15:30.273597+0000","last_peered":"2024-04-19T02:15:30.273597+0000","last_clean":"2024-04-19T02:15:30.273597+0000","last_became_active":"2024-04-19T02:15:29.281538+0000","last_became_peered":"2024-04-19T02:15:29.281538+0000","last_unstale":"2024-04-19T02:15:30.273597+0000","last_undegraded":"2024-04-19T02:15:30.273597+0000","last_fullsized":"2024-04-19T02:15:30.273597+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274996+0000","last_change":"2024-04-19T02:15:29.284098+0000","last_active":"2024-04-19T02:15:30.274996+0000","last_peered":"2024-04-19T02:15:30.274996+0000","last_clean":"2024-04-19T02:15:30.274996+0000","last_became_active":"2024-04-19T02:15:29.282114+0000","last_became_peered":"2024-04-19T02:15:29.282114+0000","last_unstale":"2024-04-19T02:15:30.274996+0000","last_undegraded":"2024-04-19T02:15:30.274996+0000","last_fullsized":"2024-04-19T02:15:30.274996+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:16.568764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752773+0000","last_change":"2024-04-19T02:15:29.280606+0000","last_active":"2024-04-19T02:15:31.752773+0000","last_peered":"2024-04-19T02:15:31.752773+0000","last_clean":"2024-04-19T02:15:31.752773+0000","last_became_active":"2024-04-19T02:15:29.280151+0000","last_became_peered":"2024-04-19T02:15:29.280151+0000","last_unstale":"2024-04-19T02:15:31.752773+0000","last_undegraded":"2024-04-19T02:15:31.752773+0000","last_fullsized":"2024-04-19T02:15:31.752773+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:26:22.452488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274472+0000","last_change":"2024-04-19T02:15:29.283378+0000","last_active":"2024-04-19T02:15:30.274472+0000","last_peered":"2024-04-19T02:15:30.274472+0000","last_clean":"2024-04-19T02:15:30.274472+0000","last_became_active":"2024-04-19T02:15:29.281571+0000","last_became_peered":"2024-04-19T02:15:29.281571+0000","last_unstale":"2024-04-19T02:15:30.274472+0000","last_undegraded":"2024-04-19T02:15:30.274472+0000","last_fullsized":"2024-04-19T02:15:30.274472+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274373+0000","last_change":"2024-04-19T02:15:29.281811+0000","last_active":"2024-04-19T02:15:30.274373+0000","last_peered":"2024-04-19T02:15:30.274373+0000","last_clean":"2024-04-19T02:15:30.274373+0000","last_became_active":"2024-04-19T02:15:29.280700+0000","last_became_peered":"2024-04-19T02:15:29.280700+0000","last_unstale":"2024-04-19T02:15:30.274373+0000","last_undegraded":"2024-04-19T02:15:30.274373+0000","last_fullsized":"2024-04-19T02:15:30.274373+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752607+0000","last_change":"2024-04-19T02:15:29.284262+0000","last_active":"2024-04-19T02:15:31.752607+0000","last_peered":"2024-04-19T02:15:31.752607+0000","last_clean":"2024-04-19T02:15:31.752607+0000","last_became_active":"2024-04-19T02:15:29.283121+0000","last_became_peered":"2024-04-19T02:15:29.283121+0000","last_unstale":"2024-04-19T02:15:31.752607+0000","last_undegraded":"2024-04-19T02:15:31.752607+0000","last_fullsized":"2024-04-19T02:15:31.752607+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752216+0000","last_change":"2024-04-19T02:15:29.285139+0000","last_active":"2024-04-19T02:15:31.752216+0000","last_peered":"2024-04-19T02:15:31.752216+0000","last_clean":"2024-04-19T02:15:31.752216+0000","last_became_active":"2024-04-19T02:15:29.284649+0000","last_became_peered":"2024-04-19T02:15:29.284649+0000","last_unstale":"2024-04-19T02:15:31.752216+0000","last_undegraded":"2024-04-19T02:15:31.752216+0000","last_fullsized":"2024-04-19T02:15:31.752216+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752064+0000","last_change":"2024-04-19T02:15:29.283648+0000","last_active":"2024-04-19T02:15:31.752064+0000","last_peered":"2024-04-19T02:15:31.752064+0000","last_clean":"2024-04-19T02:15:31.752064+0000","last_became_active":"2024-04-19T02:15:29.281606+0000","last_became_peered":"2024-04-19T02:15:29.281606+0000","last_unstale":"2024-04-19T02:15:31.752064+0000","last_undegraded":"2024-04-19T02:15:31.752064+0000","last_fullsized":"2024-04-19T02:15:31.752064+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273606+0000","last_change":"2024-04-19T02:15:29.278673+0000","last_active":"2024-04-19T02:15:30.273606+0000","last_peered":"2024-04-19T02:15:30.273606+0000","last_clean":"2024-04-19T02:15:30.273606+0000","last_became_active":"2024-04-19T02:15:29.277699+0000","last_became_peered":"2024-04-19T02:15:29.277699+0000","last_unstale":"2024-04-19T02:15:30.273606+0000","last_undegraded":"2024-04-19T02:15:30.273606+0000","last_fullsized":"2024-04-19T02:15:30.273606+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.275113+0000","last_change":"2024-04-19T02:15:29.283341+0000","last_active":"2024-04-19T02:15:30.275113+0000","last_peered":"2024-04-19T02:15:30.275113+0000","last_clean":"2024-04-19T02:15:30.275113+0000","last_became_active":"2024-04-19T02:15:29.281591+0000","last_became_peered":"2024-04-19T02:15:29.281591+0000","last_unstale":"2024-04-19T02:15:30.275113+0000","last_undegraded":"2024-04-19T02:15:30.275113+0000","last_fullsized":"2024-04-19T02:15:30.275113+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:34.593754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273356+0000","last_change":"2024-04-19T02:15:29.282110+0000","last_active":"2024-04-19T02:15:30.273356+0000","last_peered":"2024-04-19T02:15:30.273356+0000","last_clean":"2024-04-19T02:15:30.273356+0000","last_became_active":"2024-04-19T02:15:29.281716+0000","last_became_peered":"2024-04-19T02:15:29.281716+0000","last_unstale":"2024-04-19T02:15:30.273356+0000","last_undegraded":"2024-04-19T02:15:30.273356+0000","last_fullsized":"2024-04-19T02:15:30.273356+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752789+0000","last_change":"2024-04-19T02:15:29.285237+0000","last_active":"2024-04-19T02:15:31.752789+0000","last_peered":"2024-04-19T02:15:31.752789+0000","last_clean":"2024-04-19T02:15:31.752789+0000","last_became_active":"2024-04-19T02:15:29.282790+0000","last_became_peered":"2024-04-19T02:15:29.282790+0000","last_unstale":"2024-04-19T02:15:31.752789+0000","last_undegraded":"2024-04-19T02:15:31.752789+0000","last_fullsized":"2024-04-19T02:15:31.752789+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752599+0000","last_change":"2024-04-19T02:15:29.282609+0000","last_active":"2024-04-19T02:15:31.752599+0000","last_peered":"2024-04-19T02:15:31.752599+0000","last_clean":"2024-04-19T02:15:31.752599+0000","last_became_active":"2024-04-19T02:15:29.281665+0000","last_became_peered":"2024-04-19T02:15:29.281665+0000","last_unstale":"2024-04-19T02:15:31.752599+0000","last_undegraded":"2024-04-19T02:15:31.752599+0000","last_fullsized":"2024-04-19T02:15:31.752599+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.384881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274303+0000","last_change":"2024-04-19T02:15:29.278890+0000","last_active":"2024-04-19T02:15:30.274303+0000","last_peered":"2024-04-19T02:15:30.274303+0000","last_clean":"2024-04-19T02:15:30.274303+0000","last_became_active":"2024-04-19T02:15:29.278074+0000","last_became_peered":"2024-04-19T02:15:29.278074+0000","last_unstale":"2024-04-19T02:15:30.274303+0000","last_undegraded":"2024-04-19T02:15:30.274303+0000","last_fullsized":"2024-04-19T02:15:30.274303+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:00.191179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.272977+0000","last_change":"2024-04-19T02:15:29.277109+0000","last_active":"2024-04-19T02:15:30.272977+0000","last_peered":"2024-04-19T02:15:30.272977+0000","last_clean":"2024-04-19T02:15:30.272977+0000","last_became_active":"2024-04-19T02:15:29.275417+0000","last_became_peered":"2024-04-19T02:15:29.275417+0000","last_unstale":"2024-04-19T02:15:30.272977+0000","last_undegraded":"2024-04-19T02:15:30.272977+0000","last_fullsized":"2024-04-19T02:15:30.272977+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274103+0000","last_change":"2024-04-19T02:15:29.283266+0000","last_active":"2024-04-19T02:15:30.274103+0000","last_peered":"2024-04-19T02:15:30.274103+0000","last_clean":"2024-04-19T02:15:30.274103+0000","last_became_active":"2024-04-19T02:15:29.281505+0000","last_became_peered":"2024-04-19T02:15:29.281505+0000","last_unstale":"2024-04-19T02:15:30.274103+0000","last_undegraded":"2024-04-19T02:15:30.274103+0000","last_fullsized":"2024-04-19T02:15:30.274103+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.275172+0000","last_change":"2024-04-19T02:15:29.278084+0000","last_active":"2024-04-19T02:15:30.275172+0000","last_peered":"2024-04-19T02:15:30.275172+0000","last_clean":"2024-04-19T02:15:30.275172+0000","last_became_active":"2024-04-19T02:15:29.276952+0000","last_became_peered":"2024-04-19T02:15:29.276952+0000","last_unstale":"2024-04-19T02:15:30.275172+0000","last_undegraded":"2024-04-19T02:15:30.275172+0000","last_fullsized":"2024-04-19T02:15:30.275172+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273711+0000","last_change":"2024-04-19T02:15:29.279904+0000","last_active":"2024-04-19T02:15:30.273711+0000","last_peered":"2024-04-19T02:15:30.273711+0000","last_clean":"2024-04-19T02:15:30.273711+0000","last_became_active":"2024-04-19T02:15:29.278938+0000","last_became_peered":"2024-04-19T02:15:29.278938+0000","last_unstale":"2024-04-19T02:15:30.273711+0000","last_undegraded":"2024-04-19T02:15:30.273711+0000","last_fullsized":"2024-04-19T02:15:30.273711+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752884+0000","last_change":"2024-04-19T02:15:29.287389+0000","last_active":"2024-04-19T02:15:31.752884+0000","last_peered":"2024-04-19T02:15:31.752884+0000","last_clean":"2024-04-19T02:15:31.752884+0000","last_became_active":"2024-04-19T02:15:29.286431+0000","last_became_peered":"2024-04-19T02:15:29.286431+0000","last_unstale":"2024-04-19T02:15:31.752884+0000","last_undegraded":"2024-04-19T02:15:31.752884+0000","last_fullsized":"2024-04-19T02:15:31.752884+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:58:30.117887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274282+0000","last_change":"2024-04-19T02:15:28.890403+0000","last_active":"2024-04-19T02:15:30.274282+0000","last_peered":"2024-04-19T02:15:30.274282+0000","last_clean":"2024-04-19T02:15:30.274282+0000","last_became_active":"2024-04-19T02:15:28.889780+0000","last_became_peered":"2024-04-19T02:15:28.889780+0000","last_unstale":"2024-04-19T02:15:30.274282+0000","last_undegraded":"2024-04-19T02:15:30.274282+0000","last_fullsized":"2024-04-19T02:15:30.274282+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:52:15.842316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.275112+0000","last_change":"2024-04-19T02:15:29.281792+0000","last_active":"2024-04-19T02:15:30.275112+0000","last_peered":"2024-04-19T02:15:30.275112+0000","last_clean":"2024-04-19T02:15:30.275112+0000","last_became_active":"2024-04-19T02:15:29.280479+0000","last_became_peered":"2024-04-19T02:15:29.280479+0000","last_unstale":"2024-04-19T02:15:30.275112+0000","last_undegraded":"2024-04-19T02:15:30.275112+0000","last_fullsized":"2024-04-19T02:15:30.275112+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273058+0000","last_change":"2024-04-19T02:15:28.888778+0000","last_active":"2024-04-19T02:15:30.273058+0000","last_peered":"2024-04-19T02:15:30.273058+0000","last_clean":"2024-04-19T02:15:30.273058+0000","last_became_active":"2024-04-19T02:15:28.888543+0000","last_became_peered":"2024-04-19T02:15:28.888543+0000","last_unstale":"2024-04-19T02:15:30.273058+0000","last_undegraded":"2024-04-19T02:15:30.273058+0000","last_fullsized":"2024-04-19T02:15:30.273058+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:43:51.221619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273526+0000","last_change":"2024-04-19T02:15:29.279986+0000","last_active":"2024-04-19T02:15:30.273526+0000","last_peered":"2024-04-19T02:15:30.273526+0000","last_clean":"2024-04-19T02:15:30.273526+0000","last_became_active":"2024-04-19T02:15:29.279690+0000","last_became_peered":"2024-04-19T02:15:29.279690+0000","last_unstale":"2024-04-19T02:15:30.273526+0000","last_undegraded":"2024-04-19T02:15:30.273526+0000","last_fullsized":"2024-04-19T02:15:30.273526+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.272885+0000","last_change":"2024-04-19T02:15:28.890463+0000","last_active":"2024-04-19T02:15:30.272885+0000","last_peered":"2024-04-19T02:15:30.272885+0000","last_clean":"2024-04-19T02:15:30.272885+0000","last_became_active":"2024-04-19T02:15:28.889777+0000","last_became_peered":"2024-04-19T02:15:28.889777+0000","last_unstale":"2024-04-19T02:15:30.272885+0000","last_undegraded":"2024-04-19T02:15:30.272885+0000","last_fullsized":"2024-04-19T02:15:30.272885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:58:21.520250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.275141+0000","last_change":"2024-04-19T02:15:29.280879+0000","last_active":"2024-04-19T02:15:30.275141+0000","last_peered":"2024-04-19T02:15:30.275141+0000","last_clean":"2024-04-19T02:15:30.275141+0000","last_became_active":"2024-04-19T02:15:29.279314+0000","last_became_peered":"2024-04-19T02:15:29.279314+0000","last_unstale":"2024-04-19T02:15:30.275141+0000","last_undegraded":"2024-04-19T02:15:30.275141+0000","last_fullsized":"2024-04-19T02:15:30.275141+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273829+0000","last_change":"2024-04-19T02:15:28.891867+0000","last_active":"2024-04-19T02:15:30.273829+0000","last_peered":"2024-04-19T02:15:30.273829+0000","last_clean":"2024-04-19T02:15:30.273829+0000","last_became_active":"2024-04-19T02:15:28.890806+0000","last_became_peered":"2024-04-19T02:15:28.890806+0000","last_unstale":"2024-04-19T02:15:30.273829+0000","last_undegraded":"2024-04-19T02:15:30.273829+0000","last_fullsized":"2024-04-19T02:15:30.273829+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:57.946581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.272758+0000","last_change":"2024-04-19T02:15:29.278148+0000","last_active":"2024-04-19T02:15:30.272758+0000","last_peered":"2024-04-19T02:15:30.272758+0000","last_clean":"2024-04-19T02:15:30.272758+0000","last_became_active":"2024-04-19T02:15:29.277402+0000","last_became_peered":"2024-04-19T02:15:29.277402+0000","last_unstale":"2024-04-19T02:15:30.272758+0000","last_undegraded":"2024-04-19T02:15:30.272758+0000","last_fullsized":"2024-04-19T02:15:30.272758+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752928+0000","last_change":"2024-04-19T02:15:28.892905+0000","last_active":"2024-04-19T02:15:31.752928+0000","last_peered":"2024-04-19T02:15:31.752928+0000","last_clean":"2024-04-19T02:15:31.752928+0000","last_became_active":"2024-04-19T02:15:28.892541+0000","last_became_peered":"2024-04-19T02:15:28.892541+0000","last_unstale":"2024-04-19T02:15:31.752928+0000","last_undegraded":"2024-04-19T02:15:31.752928+0000","last_fullsized":"2024-04-19T02:15:31.752928+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:33.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273109+0000","last_change":"2024-04-19T02:15:29.278810+0000","last_active":"2024-04-19T02:15:30.273109+0000","last_peered":"2024-04-19T02:15:30.273109+0000","last_clean":"2024-04-19T02:15:30.273109+0000","last_became_active":"2024-04-19T02:15:29.278093+0000","last_became_peered":"2024-04-19T02:15:29.278093+0000","last_unstale":"2024-04-19T02:15:30.273109+0000","last_undegraded":"2024-04-19T02:15:30.273109+0000","last_fullsized":"2024-04-19T02:15:30.273109+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:34.883207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274867+0000","last_change":"2024-04-19T02:15:28.892937+0000","last_active":"2024-04-19T02:15:30.274867+0000","last_peered":"2024-04-19T02:15:30.274867+0000","last_clean":"2024-04-19T02:15:30.274867+0000","last_became_active":"2024-04-19T02:15:28.891440+0000","last_became_peered":"2024-04-19T02:15:28.891440+0000","last_unstale":"2024-04-19T02:15:30.274867+0000","last_undegraded":"2024-04-19T02:15:30.274867+0000","last_fullsized":"2024-04-19T02:15:30.274867+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273027+0000","last_change":"2024-04-19T02:15:29.278404+0000","last_active":"2024-04-19T02:15:30.273027+0000","last_peered":"2024-04-19T02:15:30.273027+0000","last_clean":"2024-04-19T02:15:30.273027+0000","last_became_active":"2024-04-19T02:15:29.277460+0000","last_became_peered":"2024-04-19T02:15:29.277460+0000","last_unstale":"2024-04-19T02:15:30.273027+0000","last_undegraded":"2024-04-19T02:15:30.273027+0000","last_fullsized":"2024-04-19T02:15:30.273027+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752700+0000","last_change":"2024-04-19T02:15:28.891097+0000","last_active":"2024-04-19T02:15:31.752700+0000","last_peered":"2024-04-19T02:15:31.752700+0000","last_clean":"2024-04-19T02:15:31.752700+0000","last_became_active":"2024-04-19T02:15:28.890795+0000","last_became_peered":"2024-04-19T02:15:28.890795+0000","last_unstale":"2024-04-19T02:15:31.752700+0000","last_undegraded":"2024-04-19T02:15:31.752700+0000","last_fullsized":"2024-04-19T02:15:31.752700+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752913+0000","last_change":"2024-04-19T02:15:29.278546+0000","last_active":"2024-04-19T02:15:31.752913+0000","last_peered":"2024-04-19T02:15:31.752913+0000","last_clean":"2024-04-19T02:15:31.752913+0000","last_became_active":"2024-04-19T02:15:29.277547+0000","last_became_peered":"2024-04-19T02:15:29.277547+0000","last_unstale":"2024-04-19T02:15:31.752913+0000","last_undegraded":"2024-04-19T02:15:31.752913+0000","last_fullsized":"2024-04-19T02:15:31.752913+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752826+0000","last_change":"2024-04-19T02:15:28.892977+0000","last_active":"2024-04-19T02:15:31.752826+0000","last_peered":"2024-04-19T02:15:31.752826+0000","last_clean":"2024-04-19T02:15:31.752826+0000","last_became_active":"2024-04-19T02:15:28.892636+0000","last_became_peered":"2024-04-19T02:15:28.892636+0000","last_unstale":"2024-04-19T02:15:31.752826+0000","last_undegraded":"2024-04-19T02:15:31.752826+0000","last_fullsized":"2024-04-19T02:15:31.752826+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:43:51.221619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274651+0000","last_change":"2024-04-19T02:15:29.284260+0000","last_active":"2024-04-19T02:15:30.274651+0000","last_peered":"2024-04-19T02:15:30.274651+0000","last_clean":"2024-04-19T02:15:30.274651+0000","last_became_active":"2024-04-19T02:15:29.282990+0000","last_became_peered":"2024-04-19T02:15:29.282990+0000","last_unstale":"2024-04-19T02:15:30.274651+0000","last_undegraded":"2024-04-19T02:15:30.274651+0000","last_fullsized":"2024-04-19T02:15:30.274651+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:36:48.819486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273207+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:15:30.273207+0000","last_peered":"2024-04-19T02:15:30.273207+0000","last_clean":"2024-04-19T02:15:30.273207+0000","last_became_active":"2024-04-19T02:15:28.890751+0000","last_became_peered":"2024-04-19T02:15:28.890751+0000","last_unstale":"2024-04-19T02:15:30.273207+0000","last_undegraded":"2024-04-19T02:15:30.273207+0000","last_fullsized":"2024-04-19T02:15:30.273207+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.275108+0000","last_change":"2024-04-19T02:15:29.282068+0000","last_active":"2024-04-19T02:15:30.275108+0000","last_peered":"2024-04-19T02:15:30.275108+0000","last_clean":"2024-04-19T02:15:30.275108+0000","last_became_active":"2024-04-19T02:15:29.280450+0000","last_became_peered":"2024-04-19T02:15:29.280450+0000","last_unstale":"2024-04-19T02:15:30.275108+0000","last_undegraded":"2024-04-19T02:15:30.275108+0000","last_fullsized":"2024-04-19T02:15:30.275108+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274189+0000","last_change":"2024-04-19T02:15:28.892934+0000","last_active":"2024-04-19T02:15:30.274189+0000","last_peered":"2024-04-19T02:15:30.274189+0000","last_clean":"2024-04-19T02:15:30.274189+0000","last_became_active":"2024-04-19T02:15:28.891879+0000","last_became_peered":"2024-04-19T02:15:28.891879+0000","last_unstale":"2024-04-19T02:15:30.274189+0000","last_undegraded":"2024-04-19T02:15:30.274189+0000","last_fullsized":"2024-04-19T02:15:30.274189+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:10:12.514798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273640+0000","last_change":"2024-04-19T02:15:29.279685+0000","last_active":"2024-04-19T02:15:30.273640+0000","last_peered":"2024-04-19T02:15:30.273640+0000","last_clean":"2024-04-19T02:15:30.273640+0000","last_became_active":"2024-04-19T02:15:29.278810+0000","last_became_peered":"2024-04-19T02:15:29.278810+0000","last_unstale":"2024-04-19T02:15:30.273640+0000","last_undegraded":"2024-04-19T02:15:30.273640+0000","last_fullsized":"2024-04-19T02:15:30.273640+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752370+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:15:31.752370+0000","last_peered":"2024-04-19T02:15:31.752370+0000","last_clean":"2024-04-19T02:15:31.752370+0000","last_became_active":"2024-04-19T02:15:28.890882+0000","last_became_peered":"2024-04-19T02:15:28.890882+0000","last_unstale":"2024-04-19T02:15:31.752370+0000","last_undegraded":"2024-04-19T02:15:31.752370+0000","last_fullsized":"2024-04-19T02:15:31.752370+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:31.673938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274006+0000","last_change":"2024-04-19T02:15:29.284258+0000","last_active":"2024-04-19T02:15:30.274006+0000","last_peered":"2024-04-19T02:15:30.274006+0000","last_clean":"2024-04-19T02:15:30.274006+0000","last_became_active":"2024-04-19T02:15:29.283995+0000","last_became_peered":"2024-04-19T02:15:29.283995+0000","last_unstale":"2024-04-19T02:15:30.274006+0000","last_undegraded":"2024-04-19T02:15:30.274006+0000","last_fullsized":"2024-04-19T02:15:30.274006+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:35.941308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.753137+0000","last_change":"2024-04-19T02:15:28.890265+0000","last_active":"2024-04-19T02:15:31.753137+0000","last_peered":"2024-04-19T02:15:31.753137+0000","last_clean":"2024-04-19T02:15:31.753137+0000","last_became_active":"2024-04-19T02:15:28.890004+0000","last_became_peered":"2024-04-19T02:15:28.890004+0000","last_unstale":"2024-04-19T02:15:31.753137+0000","last_undegraded":"2024-04-19T02:15:31.753137+0000","last_fullsized":"2024-04-19T02:15:31.753137+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:02.517101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273866+0000","last_change":"2024-04-19T02:15:29.285529+0000","last_active":"2024-04-19T02:15:30.273866+0000","last_peered":"2024-04-19T02:15:30.273866+0000","last_clean":"2024-04-19T02:15:30.273866+0000","last_became_active":"2024-04-19T02:15:29.285197+0000","last_became_peered":"2024-04-19T02:15:29.285197+0000","last_unstale":"2024-04-19T02:15:30.273866+0000","last_undegraded":"2024-04-19T02:15:30.273866+0000","last_fullsized":"2024-04-19T02:15:30.273866+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274737+0000","last_change":"2024-04-19T02:15:28.893902+0000","last_active":"2024-04-19T02:15:30.274737+0000","last_peered":"2024-04-19T02:15:30.274737+0000","last_clean":"2024-04-19T02:15:30.274737+0000","last_became_active":"2024-04-19T02:15:28.893231+0000","last_became_peered":"2024-04-19T02:15:28.893231+0000","last_unstale":"2024-04-19T02:15:30.274737+0000","last_undegraded":"2024-04-19T02:15:30.274737+0000","last_fullsized":"2024-04-19T02:15:30.274737+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:23.658442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274341+0000","last_change":"2024-04-19T02:15:29.282874+0000","last_active":"2024-04-19T02:15:30.274341+0000","last_peered":"2024-04-19T02:15:30.274341+0000","last_clean":"2024-04-19T02:15:30.274341+0000","last_became_active":"2024-04-19T02:15:29.281675+0000","last_became_peered":"2024-04-19T02:15:29.281675+0000","last_unstale":"2024-04-19T02:15:30.274341+0000","last_undegraded":"2024-04-19T02:15:30.274341+0000","last_fullsized":"2024-04-19T02:15:30.274341+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:35.941308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752851+0000","last_change":"2024-04-19T02:15:28.891234+0000","last_active":"2024-04-19T02:15:31.752851+0000","last_peered":"2024-04-19T02:15:31.752851+0000","last_clean":"2024-04-19T02:15:31.752851+0000","last_became_active":"2024-04-19T02:15:28.890881+0000","last_became_peered":"2024-04-19T02:15:28.890881+0000","last_unstale":"2024-04-19T02:15:31.752851+0000","last_undegraded":"2024-04-19T02:15:31.752851+0000","last_fullsized":"2024-04-19T02:15:31.752851+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752380+0000","last_change":"2024-04-19T02:15:29.281937+0000","last_active":"2024-04-19T02:15:31.752380+0000","last_peered":"2024-04-19T02:15:31.752380+0000","last_clean":"2024-04-19T02:15:31.752380+0000","last_became_active":"2024-04-19T02:15:29.280727+0000","last_became_peered":"2024-04-19T02:15:29.280727+0000","last_unstale":"2024-04-19T02:15:31.752380+0000","last_undegraded":"2024-04-19T02:15:31.752380+0000","last_fullsized":"2024-04-19T02:15:31.752380+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752346+0000","last_change":"2024-04-19T02:15:28.892767+0000","last_active":"2024-04-19T02:15:31.752346+0000","last_peered":"2024-04-19T02:15:31.752346+0000","last_clean":"2024-04-19T02:15:31.752346+0000","last_became_active":"2024-04-19T02:15:28.892235+0000","last_became_peered":"2024-04-19T02:15:28.892235+0000","last_unstale":"2024-04-19T02:15:31.752346+0000","last_undegraded":"2024-04-19T02:15:31.752346+0000","last_fullsized":"2024-04-19T02:15:31.752346+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:37.690735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273357+0000","last_change":"2024-04-19T02:15:29.279857+0000","last_active":"2024-04-19T02:15:30.273357+0000","last_peered":"2024-04-19T02:15:30.273357+0000","last_clean":"2024-04-19T02:15:30.273357+0000","last_became_active":"2024-04-19T02:15:29.279536+0000","last_became_peered":"2024-04-19T02:15:29.279536+0000","last_unstale":"2024-04-19T02:15:30.273357+0000","last_undegraded":"2024-04-19T02:15:30.273357+0000","last_fullsized":"2024-04-19T02:15:30.273357+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:00.191179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273138+0000","last_change":"2024-04-19T02:15:28.891611+0000","last_active":"2024-04-19T02:15:30.273138+0000","last_peered":"2024-04-19T02:15:30.273138+0000","last_clean":"2024-04-19T02:15:30.273138+0000","last_became_active":"2024-04-19T02:15:28.890914+0000","last_became_peered":"2024-04-19T02:15:28.890914+0000","last_unstale":"2024-04-19T02:15:30.273138+0000","last_undegraded":"2024-04-19T02:15:30.273138+0000","last_fullsized":"2024-04-19T02:15:30.273138+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:37.690735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752522+0000","last_change":"2024-04-19T02:15:29.285774+0000","last_active":"2024-04-19T02:15:31.752522+0000","last_peered":"2024-04-19T02:15:31.752522+0000","last_clean":"2024-04-19T02:15:31.752522+0000","last_became_active":"2024-04-19T02:15:29.284705+0000","last_became_peered":"2024-04-19T02:15:29.284705+0000","last_unstale":"2024-04-19T02:15:31.752522+0000","last_undegraded":"2024-04-19T02:15:31.752522+0000","last_fullsized":"2024-04-19T02:15:31.752522+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752240+0000","last_change":"2024-04-19T02:15:28.892873+0000","last_active":"2024-04-19T02:15:31.752240+0000","last_peered":"2024-04-19T02:15:31.752240+0000","last_clean":"2024-04-19T02:15:31.752240+0000","last_became_active":"2024-04-19T02:15:28.892487+0000","last_became_peered":"2024-04-19T02:15:28.892487+0000","last_unstale":"2024-04-19T02:15:31.752240+0000","last_undegraded":"2024-04-19T02:15:31.752240+0000","last_fullsized":"2024-04-19T02:15:31.752240+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:35.412837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.753131+0000","last_change":"2024-04-19T02:15:29.285019+0000","last_active":"2024-04-19T02:15:31.753131+0000","last_peered":"2024-04-19T02:15:31.753131+0000","last_clean":"2024-04-19T02:15:31.753131+0000","last_became_active":"2024-04-19T02:15:29.284650+0000","last_became_peered":"2024-04-19T02:15:29.284650+0000","last_unstale":"2024-04-19T02:15:31.753131+0000","last_undegraded":"2024-04-19T02:15:31.753131+0000","last_fullsized":"2024-04-19T02:15:31.753131+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273991+0000","last_change":"2024-04-19T02:15:28.893245+0000","last_active":"2024-04-19T02:15:30.273991+0000","last_peered":"2024-04-19T02:15:30.273991+0000","last_clean":"2024-04-19T02:15:30.273991+0000","last_became_active":"2024-04-19T02:15:28.891932+0000","last_became_peered":"2024-04-19T02:15:28.891932+0000","last_unstale":"2024-04-19T02:15:30.273991+0000","last_undegraded":"2024-04-19T02:15:30.273991+0000","last_fullsized":"2024-04-19T02:15:30.273991+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:30.518182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.753047+0000","last_change":"2024-04-19T02:15:29.287190+0000","last_active":"2024-04-19T02:15:31.753047+0000","last_peered":"2024-04-19T02:15:31.753047+0000","last_clean":"2024-04-19T02:15:31.753047+0000","last_became_active":"2024-04-19T02:15:29.286606+0000","last_became_peered":"2024-04-19T02:15:29.286606+0000","last_unstale":"2024-04-19T02:15:31.753047+0000","last_undegraded":"2024-04-19T02:15:31.753047+0000","last_fullsized":"2024-04-19T02:15:31.753047+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:28.387062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274074+0000","last_change":"2024-04-19T02:15:28.894121+0000","last_active":"2024-04-19T02:15:30.274074+0000","last_peered":"2024-04-19T02:15:30.274074+0000","last_clean":"2024-04-19T02:15:30.274074+0000","last_became_active":"2024-04-19T02:15:28.893902+0000","last_became_peered":"2024-04-19T02:15:28.893902+0000","last_unstale":"2024-04-19T02:15:30.274074+0000","last_undegraded":"2024-04-19T02:15:30.274074+0000","last_fullsized":"2024-04-19T02:15:30.274074+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:10:35.146583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273739+0000","last_change":"2024-04-19T02:15:29.282870+0000","last_active":"2024-04-19T02:15:30.273739+0000","last_peered":"2024-04-19T02:15:30.273739+0000","last_clean":"2024-04-19T02:15:30.273739+0000","last_became_active":"2024-04-19T02:15:29.281873+0000","last_became_peered":"2024-04-19T02:15:29.281873+0000","last_unstale":"2024-04-19T02:15:30.273739+0000","last_undegraded":"2024-04-19T02:15:30.273739+0000","last_fullsized":"2024-04-19T02:15:30.273739+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.269354+0000","last_change":"2024-04-19T02:15:24.527061+0000","last_active":"2024-04-19T02:15:29.269354+0000","last_peered":"2024-04-19T02:15:29.269354+0000","last_clean":"2024-04-19T02:15:29.269354+0000","last_became_active":"2024-04-19T02:15:24.526757+0000","last_became_peered":"2024-04-19T02:15:24.526757+0000","last_unstale":"2024-04-19T02:15:29.269354+0000","last_undegraded":"2024-04-19T02:15:29.269354+0000","last_fullsized":"2024-04-19T02:15:29.269354+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:17:13.649077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.753003+0000","last_change":"2024-04-19T02:15:28.892766+0000","last_active":"2024-04-19T02:15:31.753003+0000","last_peered":"2024-04-19T02:15:31.753003+0000","last_clean":"2024-04-19T02:15:31.753003+0000","last_became_active":"2024-04-19T02:15:28.892396+0000","last_became_peered":"2024-04-19T02:15:28.892396+0000","last_unstale":"2024-04-19T02:15:31.753003+0000","last_undegraded":"2024-04-19T02:15:31.753003+0000","last_fullsized":"2024-04-19T02:15:31.753003+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:57.946581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274481+0000","last_change":"2024-04-19T02:15:29.277922+0000","last_active":"2024-04-19T02:15:30.274481+0000","last_peered":"2024-04-19T02:15:30.274481+0000","last_clean":"2024-04-19T02:15:30.274481+0000","last_became_active":"2024-04-19T02:15:29.276968+0000","last_became_peered":"2024-04-19T02:15:29.276968+0000","last_unstale":"2024-04-19T02:15:30.274481+0000","last_undegraded":"2024-04-19T02:15:30.274481+0000","last_fullsized":"2024-04-19T02:15:30.274481+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.276084+0000","last_change":"2024-04-19T02:15:24.530933+0000","last_active":"2024-04-19T02:15:29.276084+0000","last_peered":"2024-04-19T02:15:29.276084+0000","last_clean":"2024-04-19T02:15:29.276084+0000","last_became_active":"2024-04-19T02:15:24.530550+0000","last_became_peered":"2024-04-19T02:15:24.530550+0000","last_unstale":"2024-04-19T02:15:29.276084+0000","last_undegraded":"2024-04-19T02:15:29.276084+0000","last_fullsized":"2024-04-19T02:15:29.276084+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:18:15.194321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752725+0000","last_change":"2024-04-19T02:15:28.893062+0000","last_active":"2024-04-19T02:15:31.752725+0000","last_peered":"2024-04-19T02:15:31.752725+0000","last_clean":"2024-04-19T02:15:31.752725+0000","last_became_active":"2024-04-19T02:15:28.892798+0000","last_became_peered":"2024-04-19T02:15:28.892798+0000","last_unstale":"2024-04-19T02:15:31.752725+0000","last_undegraded":"2024-04-19T02:15:31.752725+0000","last_fullsized":"2024-04-19T02:15:31.752725+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:53.170180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273830+0000","last_change":"2024-04-19T02:15:29.278294+0000","last_active":"2024-04-19T02:15:30.273830+0000","last_peered":"2024-04-19T02:15:30.273830+0000","last_clean":"2024-04-19T02:15:30.273830+0000","last_became_active":"2024-04-19T02:15:29.277536+0000","last_became_peered":"2024-04-19T02:15:29.277536+0000","last_unstale":"2024-04-19T02:15:30.273830+0000","last_undegraded":"2024-04-19T02:15:30.273830+0000","last_fullsized":"2024-04-19T02:15:30.273830+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.268601+0000","last_change":"2024-04-19T02:15:24.527048+0000","last_active":"2024-04-19T02:15:29.268601+0000","last_peered":"2024-04-19T02:15:29.268601+0000","last_clean":"2024-04-19T02:15:29.268601+0000","last_became_active":"2024-04-19T02:15:24.526790+0000","last_became_peered":"2024-04-19T02:15:24.526790+0000","last_unstale":"2024-04-19T02:15:29.268601+0000","last_undegraded":"2024-04-19T02:15:29.268601+0000","last_fullsized":"2024-04-19T02:15:29.268601+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273986+0000","last_change":"2024-04-19T02:15:28.893858+0000","last_active":"2024-04-19T02:15:30.273986+0000","last_peered":"2024-04-19T02:15:30.273986+0000","last_clean":"2024-04-19T02:15:30.273986+0000","last_became_active":"2024-04-19T02:15:28.892497+0000","last_became_peered":"2024-04-19T02:15:28.892497+0000","last_unstale":"2024-04-19T02:15:30.273986+0000","last_undegraded":"2024-04-19T02:15:30.273986+0000","last_fullsized":"2024-04-19T02:15:30.273986+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:31.673938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273922+0000","last_change":"2024-04-19T02:15:29.282663+0000","last_active":"2024-04-19T02:15:30.273922+0000","last_peered":"2024-04-19T02:15:30.273922+0000","last_clean":"2024-04-19T02:15:30.273922+0000","last_became_active":"2024-04-19T02:15:29.282217+0000","last_became_peered":"2024-04-19T02:15:29.282217+0000","last_unstale":"2024-04-19T02:15:30.273922+0000","last_undegraded":"2024-04-19T02:15:30.273922+0000","last_fullsized":"2024-04-19T02:15:30.273922+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.276557+0000","last_change":"2024-04-19T02:15:24.530924+0000","last_active":"2024-04-19T02:15:29.276557+0000","last_peered":"2024-04-19T02:15:29.276557+0000","last_clean":"2024-04-19T02:15:29.276557+0000","last_became_active":"2024-04-19T02:15:24.530551+0000","last_became_peered":"2024-04-19T02:15:24.530551+0000","last_unstale":"2024-04-19T02:15:29.276557+0000","last_undegraded":"2024-04-19T02:15:29.276557+0000","last_fullsized":"2024-04-19T02:15:29.276557+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:30.576946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":210,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.275680+0000","last_change":"2024-04-19T02:15:24.533634+0000","last_active":"2024-04-19T02:15:29.275680+0000","last_peered":"2024-04-19T02:15:29.275680+0000","last_clean":"2024-04-19T02:15:29.275680+0000","last_became_active":"2024-04-19T02:15:24.533420+0000","last_became_peered":"2024-04-19T02:15:24.533420+0000","last_unstale":"2024-04-19T02:15:29.275680+0000","last_undegraded":"2024-04-19T02:15:29.275680+0000","last_fullsized":"2024-04-19T02:15:29.275680+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273047+0000","last_change":"2024-04-19T02:15:28.890244+0000","last_active":"2024-04-19T02:15:30.273047+0000","last_peered":"2024-04-19T02:15:30.273047+0000","last_clean":"2024-04-19T02:15:30.273047+0000","last_became_active":"2024-04-19T02:15:28.889831+0000","last_became_peered":"2024-04-19T02:15:28.889831+0000","last_unstale":"2024-04-19T02:15:30.273047+0000","last_undegraded":"2024-04-19T02:15:30.273047+0000","last_fullsized":"2024-04-19T02:15:30.273047+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.753121+0000","last_change":"2024-04-19T02:15:29.285015+0000","last_active":"2024-04-19T02:15:31.753121+0000","last_peered":"2024-04-19T02:15:31.753121+0000","last_clean":"2024-04-19T02:15:31.753121+0000","last_became_active":"2024-04-19T02:15:29.284164+0000","last_became_peered":"2024-04-19T02:15:29.284164+0000","last_unstale":"2024-04-19T02:15:31.753121+0000","last_undegraded":"2024-04-19T02:15:31.753121+0000","last_fullsized":"2024-04-19T02:15:31.753121+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:36.987844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.275722+0000","last_change":"2024-04-19T02:15:24.533912+0000","last_active":"2024-04-19T02:15:29.275722+0000","last_peered":"2024-04-19T02:15:29.275722+0000","last_clean":"2024-04-19T02:15:29.275722+0000","last_became_active":"2024-04-19T02:15:24.533580+0000","last_became_peered":"2024-04-19T02:15:24.533580+0000","last_unstale":"2024-04-19T02:15:29.275722+0000","last_undegraded":"2024-04-19T02:15:29.275722+0000","last_fullsized":"2024-04-19T02:15:29.275722+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:45.045477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.272710+0000","last_change":"2024-04-19T02:15:28.891889+0000","last_active":"2024-04-19T02:15:30.272710+0000","last_peered":"2024-04-19T02:15:30.272710+0000","last_clean":"2024-04-19T02:15:30.272710+0000","last_became_active":"2024-04-19T02:15:28.890919+0000","last_became_peered":"2024-04-19T02:15:28.890919+0000","last_unstale":"2024-04-19T02:15:30.272710+0000","last_undegraded":"2024-04-19T02:15:30.272710+0000","last_fullsized":"2024-04-19T02:15:30.272710+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:35.412837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.275017+0000","last_change":"2024-04-19T02:15:29.284266+0000","last_active":"2024-04-19T02:15:30.275017+0000","last_peered":"2024-04-19T02:15:30.275017+0000","last_clean":"2024-04-19T02:15:30.275017+0000","last_became_active":"2024-04-19T02:15:29.282994+0000","last_became_peered":"2024-04-19T02:15:29.282994+0000","last_unstale":"2024-04-19T02:15:30.275017+0000","last_undegraded":"2024-04-19T02:15:30.275017+0000","last_fullsized":"2024-04-19T02:15:30.275017+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.277544+0000","last_change":"2024-04-19T02:15:24.526751+0000","last_active":"2024-04-19T02:15:29.277544+0000","last_peered":"2024-04-19T02:15:29.277544+0000","last_clean":"2024-04-19T02:15:29.277544+0000","last_became_active":"2024-04-19T02:15:24.526511+0000","last_became_peered":"2024-04-19T02:15:24.526511+0000","last_unstale":"2024-04-19T02:15:29.277544+0000","last_undegraded":"2024-04-19T02:15:29.277544+0000","last_fullsized":"2024-04-19T02:15:29.277544+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:02:45.966851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273736+0000","last_change":"2024-04-19T02:15:28.892125+0000","last_active":"2024-04-19T02:15:30.273736+0000","last_peered":"2024-04-19T02:15:30.273736+0000","last_clean":"2024-04-19T02:15:30.273736+0000","last_became_active":"2024-04-19T02:15:28.891300+0000","last_became_peered":"2024-04-19T02:15:28.891300+0000","last_unstale":"2024-04-19T02:15:30.273736+0000","last_undegraded":"2024-04-19T02:15:30.273736+0000","last_fullsized":"2024-04-19T02:15:30.273736+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274547+0000","last_change":"2024-04-19T02:15:29.281694+0000","last_active":"2024-04-19T02:15:30.274547+0000","last_peered":"2024-04-19T02:15:30.274547+0000","last_clean":"2024-04-19T02:15:30.274547+0000","last_became_active":"2024-04-19T02:15:29.280519+0000","last_became_peered":"2024-04-19T02:15:29.280519+0000","last_unstale":"2024-04-19T02:15:30.274547+0000","last_undegraded":"2024-04-19T02:15:30.274547+0000","last_fullsized":"2024-04-19T02:15:30.274547+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:50.890545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273711+0000","last_change":"2024-04-19T02:15:28.891702+0000","last_active":"2024-04-19T02:15:30.273711+0000","last_peered":"2024-04-19T02:15:30.273711+0000","last_clean":"2024-04-19T02:15:30.273711+0000","last_became_active":"2024-04-19T02:15:28.890743+0000","last_became_peered":"2024-04-19T02:15:28.890743+0000","last_unstale":"2024-04-19T02:15:30.273711+0000","last_undegraded":"2024-04-19T02:15:30.273711+0000","last_fullsized":"2024-04-19T02:15:30.273711+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.269774+0000","last_change":"2024-04-19T02:15:24.526845+0000","last_active":"2024-04-19T02:15:29.269774+0000","last_peered":"2024-04-19T02:15:29.269774+0000","last_clean":"2024-04-19T02:15:29.269774+0000","last_became_active":"2024-04-19T02:15:24.526500+0000","last_became_peered":"2024-04-19T02:15:24.526500+0000","last_unstale":"2024-04-19T02:15:29.269774+0000","last_undegraded":"2024-04-19T02:15:29.269774+0000","last_fullsized":"2024-04-19T02:15:29.269774+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:16.883355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.272678+0000","last_change":"2024-04-19T02:15:29.278686+0000","last_active":"2024-04-19T02:15:30.272678+0000","last_peered":"2024-04-19T02:15:30.272678+0000","last_clean":"2024-04-19T02:15:30.272678+0000","last_became_active":"2024-04-19T02:15:29.278108+0000","last_became_peered":"2024-04-19T02:15:29.278108+0000","last_unstale":"2024-04-19T02:15:30.272678+0000","last_undegraded":"2024-04-19T02:15:30.272678+0000","last_fullsized":"2024-04-19T02:15:30.272678+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:34.593754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.277610+0000","last_change":"2024-04-19T02:15:24.533777+0000","last_active":"2024-04-19T02:15:29.277610+0000","last_peered":"2024-04-19T02:15:29.277610+0000","last_clean":"2024-04-19T02:15:29.277610+0000","last_became_active":"2024-04-19T02:15:24.533436+0000","last_became_peered":"2024-04-19T02:15:24.533436+0000","last_unstale":"2024-04-19T02:15:29.277610+0000","last_undegraded":"2024-04-19T02:15:29.277610+0000","last_fullsized":"2024-04-19T02:15:29.277610+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:53:25.922418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273431+0000","last_change":"2024-04-19T02:15:28.891370+0000","last_active":"2024-04-19T02:15:30.273431+0000","last_peered":"2024-04-19T02:15:30.273431+0000","last_clean":"2024-04-19T02:15:30.273431+0000","last_became_active":"2024-04-19T02:15:28.890702+0000","last_became_peered":"2024-04-19T02:15:28.890702+0000","last_unstale":"2024-04-19T02:15:30.273431+0000","last_undegraded":"2024-04-19T02:15:30.273431+0000","last_fullsized":"2024-04-19T02:15:30.273431+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:33.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274234+0000","last_change":"2024-04-19T02:15:29.282244+0000","last_active":"2024-04-19T02:15:30.274234+0000","last_peered":"2024-04-19T02:15:30.274234+0000","last_clean":"2024-04-19T02:15:30.274234+0000","last_became_active":"2024-04-19T02:15:29.280366+0000","last_became_peered":"2024-04-19T02:15:29.280366+0000","last_unstale":"2024-04-19T02:15:30.274234+0000","last_undegraded":"2024-04-19T02:15:30.274234+0000","last_fullsized":"2024-04-19T02:15:30.274234+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274392+0000","last_change":"2024-04-19T02:15:28.893027+0000","last_active":"2024-04-19T02:15:30.274392+0000","last_peered":"2024-04-19T02:15:30.274392+0000","last_clean":"2024-04-19T02:15:30.274392+0000","last_became_active":"2024-04-19T02:15:28.892695+0000","last_became_peered":"2024-04-19T02:15:28.892695+0000","last_unstale":"2024-04-19T02:15:30.274392+0000","last_undegraded":"2024-04-19T02:15:30.274392+0000","last_fullsized":"2024-04-19T02:15:30.274392+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274805+0000","last_change":"2024-04-19T02:15:29.283155+0000","last_active":"2024-04-19T02:15:30.274805+0000","last_peered":"2024-04-19T02:15:30.274805+0000","last_clean":"2024-04-19T02:15:30.274805+0000","last_became_active":"2024-04-19T02:15:29.281407+0000","last_became_peered":"2024-04-19T02:15:29.281407+0000","last_unstale":"2024-04-19T02:15:30.274805+0000","last_undegraded":"2024-04-19T02:15:30.274805+0000","last_fullsized":"2024-04-19T02:15:30.274805+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752643+0000","last_change":"2024-04-19T02:15:28.893067+0000","last_active":"2024-04-19T02:15:31.752643+0000","last_peered":"2024-04-19T02:15:31.752643+0000","last_clean":"2024-04-19T02:15:31.752643+0000","last_became_active":"2024-04-19T02:15:28.892781+0000","last_became_peered":"2024-04-19T02:15:28.892781+0000","last_unstale":"2024-04-19T02:15:31.752643+0000","last_undegraded":"2024-04-19T02:15:31.752643+0000","last_fullsized":"2024-04-19T02:15:31.752643+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:54:15.590143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752652+0000","last_change":"2024-04-19T02:15:29.281279+0000","last_active":"2024-04-19T02:15:31.752652+0000","last_peered":"2024-04-19T02:15:31.752652+0000","last_clean":"2024-04-19T02:15:31.752652+0000","last_became_active":"2024-04-19T02:15:29.279360+0000","last_became_peered":"2024-04-19T02:15:29.279360+0000","last_unstale":"2024-04-19T02:15:31.752652+0000","last_undegraded":"2024-04-19T02:15:31.752652+0000","last_fullsized":"2024-04-19T02:15:31.752652+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274993+0000","last_change":"2024-04-19T02:15:28.893239+0000","last_active":"2024-04-19T02:15:30.274993+0000","last_peered":"2024-04-19T02:15:30.274993+0000","last_clean":"2024-04-19T02:15:30.274993+0000","last_became_active":"2024-04-19T02:15:28.892881+0000","last_became_peered":"2024-04-19T02:15:28.892881+0000","last_unstale":"2024-04-19T02:15:30.274993+0000","last_undegraded":"2024-04-19T02:15:30.274993+0000","last_fullsized":"2024-04-19T02:15:30.274993+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752362+0000","last_change":"2024-04-19T02:15:29.281652+0000","last_active":"2024-04-19T02:15:31.752362+0000","last_peered":"2024-04-19T02:15:31.752362+0000","last_clean":"2024-04-19T02:15:31.752362+0000","last_became_active":"2024-04-19T02:15:29.281175+0000","last_became_peered":"2024-04-19T02:15:29.281175+0000","last_unstale":"2024-04-19T02:15:31.752362+0000","last_undegraded":"2024-04-19T02:15:31.752362+0000","last_fullsized":"2024-04-19T02:15:31.752362+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:16.568764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273639+0000","last_change":"2024-04-19T02:15:28.892058+0000","last_active":"2024-04-19T02:15:30.273639+0000","last_peered":"2024-04-19T02:15:30.273639+0000","last_clean":"2024-04-19T02:15:30.273639+0000","last_became_active":"2024-04-19T02:15:28.890877+0000","last_became_peered":"2024-04-19T02:15:28.890877+0000","last_unstale":"2024-04-19T02:15:30.273639+0000","last_undegraded":"2024-04-19T02:15:30.273639+0000","last_fullsized":"2024-04-19T02:15:30.273639+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:53.170180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274344+0000","last_change":"2024-04-19T02:15:29.278810+0000","last_active":"2024-04-19T02:15:30.274344+0000","last_peered":"2024-04-19T02:15:30.274344+0000","last_clean":"2024-04-19T02:15:30.274344+0000","last_became_active":"2024-04-19T02:15:29.277913+0000","last_became_peered":"2024-04-19T02:15:29.277913+0000","last_unstale":"2024-04-19T02:15:30.274344+0000","last_undegraded":"2024-04-19T02:15:30.274344+0000","last_fullsized":"2024-04-19T02:15:30.274344+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:24.082666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273821+0000","last_change":"2024-04-19T02:15:28.889132+0000","last_active":"2024-04-19T02:15:30.273821+0000","last_peered":"2024-04-19T02:15:30.273821+0000","last_clean":"2024-04-19T02:15:30.273821+0000","last_became_active":"2024-04-19T02:15:28.888926+0000","last_became_peered":"2024-04-19T02:15:28.888926+0000","last_unstale":"2024-04-19T02:15:30.273821+0000","last_undegraded":"2024-04-19T02:15:30.273821+0000","last_fullsized":"2024-04-19T02:15:30.273821+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752370+0000","last_change":"2024-04-19T02:15:29.282776+0000","last_active":"2024-04-19T02:15:31.752370+0000","last_peered":"2024-04-19T02:15:31.752370+0000","last_clean":"2024-04-19T02:15:31.752370+0000","last_became_active":"2024-04-19T02:15:29.279382+0000","last_became_peered":"2024-04-19T02:15:29.279382+0000","last_unstale":"2024-04-19T02:15:31.752370+0000","last_undegraded":"2024-04-19T02:15:31.752370+0000","last_fullsized":"2024-04-19T02:15:31.752370+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752208+0000","last_change":"2024-04-19T02:15:29.283537+0000","last_active":"2024-04-19T02:15:31.752208+0000","last_peered":"2024-04-19T02:15:31.752208+0000","last_clean":"2024-04-19T02:15:31.752208+0000","last_became_active":"2024-04-19T02:15:29.281801+0000","last_became_peered":"2024-04-19T02:15:29.281801+0000","last_unstale":"2024-04-19T02:15:31.752208+0000","last_undegraded":"2024-04-19T02:15:31.752208+0000","last_fullsized":"2024-04-19T02:15:31.752208+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.272816+0000","last_change":"2024-04-19T02:15:29.281560+0000","last_active":"2024-04-19T02:15:30.272816+0000","last_peered":"2024-04-19T02:15:30.272816+0000","last_clean":"2024-04-19T02:15:30.272816+0000","last_became_active":"2024-04-19T02:15:29.281261+0000","last_became_peered":"2024-04-19T02:15:29.281261+0000","last_unstale":"2024-04-19T02:15:30.272816+0000","last_undegraded":"2024-04-19T02:15:30.272816+0000","last_fullsized":"2024-04-19T02:15:30.272816+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274549+0000","last_change":"2024-04-19T02:15:29.280731+0000","last_active":"2024-04-19T02:15:30.274549+0000","last_peered":"2024-04-19T02:15:30.274549+0000","last_clean":"2024-04-19T02:15:30.274549+0000","last_became_active":"2024-04-19T02:15:29.280340+0000","last_became_peered":"2024-04-19T02:15:29.280340+0000","last_unstale":"2024-04-19T02:15:30.274549+0000","last_undegraded":"2024-04-19T02:15:30.274549+0000","last_fullsized":"2024-04-19T02:15:30.274549+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273481+0000","last_change":"2024-04-19T02:15:29.278702+0000","last_active":"2024-04-19T02:15:30.273481+0000","last_peered":"2024-04-19T02:15:30.273481+0000","last_clean":"2024-04-19T02:15:30.273481+0000","last_became_active":"2024-04-19T02:15:29.277756+0000","last_became_peered":"2024-04-19T02:15:29.277756+0000","last_unstale":"2024-04-19T02:15:30.273481+0000","last_undegraded":"2024-04-19T02:15:30.273481+0000","last_fullsized":"2024-04-19T02:15:30.273481+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274899+0000","last_change":"2024-04-19T02:15:29.277568+0000","last_active":"2024-04-19T02:15:30.274899+0000","last_peered":"2024-04-19T02:15:30.274899+0000","last_clean":"2024-04-19T02:15:30.274899+0000","last_became_active":"2024-04-19T02:15:29.276725+0000","last_became_peered":"2024-04-19T02:15:29.276725+0000","last_unstale":"2024-04-19T02:15:30.274899+0000","last_undegraded":"2024-04-19T02:15:30.274899+0000","last_fullsized":"2024-04-19T02:15:30.274899+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738371,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":139264,"data_stored":46663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31856,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":757760,"data_stored":638777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":749568,"data_stored":638161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:15:37.912 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:15:38.252 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:15:38.253 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-04-19T02:15:38.263 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-04-19T02:15:36.739085+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":247,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":159,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":86784,"kb_used_data":1608,"kb_used_omap":4,"kb_used_meta":85115,"kb_avail":283028736,"statfs":{"total":289910292480,"available":289821425664,"internally_reserved":0,"allocated":1646592,"data_stored":1323601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":87158098},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.861330"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.275255+0000","last_change":"2024-04-19T02:15:29.280412+0000","last_active":"2024-04-19T02:15:30.275255+0000","last_peered":"2024-04-19T02:15:30.275255+0000","last_clean":"2024-04-19T02:15:30.275255+0000","last_became_active":"2024-04-19T02:15:29.278762+0000","last_became_peered":"2024-04-19T02:15:29.278762+0000","last_unstale":"2024-04-19T02:15:30.275255+0000","last_undegraded":"2024-04-19T02:15:30.275255+0000","last_fullsized":"2024-04-19T02:15:30.275255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:45.301675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274720+0000","last_change":"2024-04-19T02:15:29.284695+0000","last_active":"2024-04-19T02:15:30.274720+0000","last_peered":"2024-04-19T02:15:30.274720+0000","last_clean":"2024-04-19T02:15:30.274720+0000","last_became_active":"2024-04-19T02:15:29.283468+0000","last_became_peered":"2024-04-19T02:15:29.283468+0000","last_unstale":"2024-04-19T02:15:30.274720+0000","last_undegraded":"2024-04-19T02:15:30.274720+0000","last_fullsized":"2024-04-19T02:15:30.274720+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.384881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752988+0000","last_change":"2024-04-19T02:15:29.286709+0000","last_active":"2024-04-19T02:15:31.752988+0000","last_peered":"2024-04-19T02:15:31.752988+0000","last_clean":"2024-04-19T02:15:31.752988+0000","last_became_active":"2024-04-19T02:15:29.286169+0000","last_became_peered":"2024-04-19T02:15:29.286169+0000","last_unstale":"2024-04-19T02:15:31.752988+0000","last_undegraded":"2024-04-19T02:15:31.752988+0000","last_fullsized":"2024-04-19T02:15:31.752988+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:58.741466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752842+0000","last_change":"2024-04-19T02:15:29.280131+0000","last_active":"2024-04-19T02:15:31.752842+0000","last_peered":"2024-04-19T02:15:31.752842+0000","last_clean":"2024-04-19T02:15:31.752842+0000","last_became_active":"2024-04-19T02:15:29.279388+0000","last_became_peered":"2024-04-19T02:15:29.279388+0000","last_unstale":"2024-04-19T02:15:31.752842+0000","last_undegraded":"2024-04-19T02:15:31.752842+0000","last_fullsized":"2024-04-19T02:15:31.752842+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:36:48.819486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274570+0000","last_change":"2024-04-19T02:15:29.279377+0000","last_active":"2024-04-19T02:15:30.274570+0000","last_peered":"2024-04-19T02:15:30.274570+0000","last_clean":"2024-04-19T02:15:30.274570+0000","last_became_active":"2024-04-19T02:15:29.278954+0000","last_became_peered":"2024-04-19T02:15:29.278954+0000","last_unstale":"2024-04-19T02:15:30.274570+0000","last_undegraded":"2024-04-19T02:15:30.274570+0000","last_fullsized":"2024-04-19T02:15:30.274570+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:34.883207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752217+0000","last_change":"2024-04-19T02:15:29.283908+0000","last_active":"2024-04-19T02:15:31.752217+0000","last_peered":"2024-04-19T02:15:31.752217+0000","last_clean":"2024-04-19T02:15:31.752217+0000","last_became_active":"2024-04-19T02:15:29.281729+0000","last_became_peered":"2024-04-19T02:15:29.281729+0000","last_unstale":"2024-04-19T02:15:31.752217+0000","last_undegraded":"2024-04-19T02:15:31.752217+0000","last_fullsized":"2024-04-19T02:15:31.752217+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:03:15.383476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752077+0000","last_change":"2024-04-19T02:15:29.281253+0000","last_active":"2024-04-19T02:15:31.752077+0000","last_peered":"2024-04-19T02:15:31.752077+0000","last_clean":"2024-04-19T02:15:31.752077+0000","last_became_active":"2024-04-19T02:15:29.279951+0000","last_became_peered":"2024-04-19T02:15:29.279951+0000","last_unstale":"2024-04-19T02:15:31.752077+0000","last_undegraded":"2024-04-19T02:15:31.752077+0000","last_fullsized":"2024-04-19T02:15:31.752077+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.751969+0000","last_change":"2024-04-19T02:15:29.283952+0000","last_active":"2024-04-19T02:15:31.751969+0000","last_peered":"2024-04-19T02:15:31.751969+0000","last_clean":"2024-04-19T02:15:31.751969+0000","last_became_active":"2024-04-19T02:15:29.282721+0000","last_became_peered":"2024-04-19T02:15:29.282721+0000","last_unstale":"2024-04-19T02:15:31.751969+0000","last_undegraded":"2024-04-19T02:15:31.751969+0000","last_fullsized":"2024-04-19T02:15:31.751969+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:45.301675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273597+0000","last_change":"2024-04-19T02:15:29.282150+0000","last_active":"2024-04-19T02:15:30.273597+0000","last_peered":"2024-04-19T02:15:30.273597+0000","last_clean":"2024-04-19T02:15:30.273597+0000","last_became_active":"2024-04-19T02:15:29.281538+0000","last_became_peered":"2024-04-19T02:15:29.281538+0000","last_unstale":"2024-04-19T02:15:30.273597+0000","last_undegraded":"2024-04-19T02:15:30.273597+0000","last_fullsized":"2024-04-19T02:15:30.273597+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274996+0000","last_change":"2024-04-19T02:15:29.284098+0000","last_active":"2024-04-19T02:15:30.274996+0000","last_peered":"2024-04-19T02:15:30.274996+0000","last_clean":"2024-04-19T02:15:30.274996+0000","last_became_active":"2024-04-19T02:15:29.282114+0000","last_became_peered":"2024-04-19T02:15:29.282114+0000","last_unstale":"2024-04-19T02:15:30.274996+0000","last_undegraded":"2024-04-19T02:15:30.274996+0000","last_fullsized":"2024-04-19T02:15:30.274996+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:16.568764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752773+0000","last_change":"2024-04-19T02:15:29.280606+0000","last_active":"2024-04-19T02:15:31.752773+0000","last_peered":"2024-04-19T02:15:31.752773+0000","last_clean":"2024-04-19T02:15:31.752773+0000","last_became_active":"2024-04-19T02:15:29.280151+0000","last_became_peered":"2024-04-19T02:15:29.280151+0000","last_unstale":"2024-04-19T02:15:31.752773+0000","last_undegraded":"2024-04-19T02:15:31.752773+0000","last_fullsized":"2024-04-19T02:15:31.752773+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:26:22.452488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274472+0000","last_change":"2024-04-19T02:15:29.283378+0000","last_active":"2024-04-19T02:15:30.274472+0000","last_peered":"2024-04-19T02:15:30.274472+0000","last_clean":"2024-04-19T02:15:30.274472+0000","last_became_active":"2024-04-19T02:15:29.281571+0000","last_became_peered":"2024-04-19T02:15:29.281571+0000","last_unstale":"2024-04-19T02:15:30.274472+0000","last_undegraded":"2024-04-19T02:15:30.274472+0000","last_fullsized":"2024-04-19T02:15:30.274472+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274373+0000","last_change":"2024-04-19T02:15:29.281811+0000","last_active":"2024-04-19T02:15:30.274373+0000","last_peered":"2024-04-19T02:15:30.274373+0000","last_clean":"2024-04-19T02:15:30.274373+0000","last_became_active":"2024-04-19T02:15:29.280700+0000","last_became_peered":"2024-04-19T02:15:29.280700+0000","last_unstale":"2024-04-19T02:15:30.274373+0000","last_undegraded":"2024-04-19T02:15:30.274373+0000","last_fullsized":"2024-04-19T02:15:30.274373+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752607+0000","last_change":"2024-04-19T02:15:29.284262+0000","last_active":"2024-04-19T02:15:31.752607+0000","last_peered":"2024-04-19T02:15:31.752607+0000","last_clean":"2024-04-19T02:15:31.752607+0000","last_became_active":"2024-04-19T02:15:29.283121+0000","last_became_peered":"2024-04-19T02:15:29.283121+0000","last_unstale":"2024-04-19T02:15:31.752607+0000","last_undegraded":"2024-04-19T02:15:31.752607+0000","last_fullsized":"2024-04-19T02:15:31.752607+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752216+0000","last_change":"2024-04-19T02:15:29.285139+0000","last_active":"2024-04-19T02:15:31.752216+0000","last_peered":"2024-04-19T02:15:31.752216+0000","last_clean":"2024-04-19T02:15:31.752216+0000","last_became_active":"2024-04-19T02:15:29.284649+0000","last_became_peered":"2024-04-19T02:15:29.284649+0000","last_unstale":"2024-04-19T02:15:31.752216+0000","last_undegraded":"2024-04-19T02:15:31.752216+0000","last_fullsized":"2024-04-19T02:15:31.752216+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752064+0000","last_change":"2024-04-19T02:15:29.283648+0000","last_active":"2024-04-19T02:15:31.752064+0000","last_peered":"2024-04-19T02:15:31.752064+0000","last_clean":"2024-04-19T02:15:31.752064+0000","last_became_active":"2024-04-19T02:15:29.281606+0000","last_became_peered":"2024-04-19T02:15:29.281606+0000","last_unstale":"2024-04-19T02:15:31.752064+0000","last_undegraded":"2024-04-19T02:15:31.752064+0000","last_fullsized":"2024-04-19T02:15:31.752064+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273606+0000","last_change":"2024-04-19T02:15:29.278673+0000","last_active":"2024-04-19T02:15:30.273606+0000","last_peered":"2024-04-19T02:15:30.273606+0000","last_clean":"2024-04-19T02:15:30.273606+0000","last_became_active":"2024-04-19T02:15:29.277699+0000","last_became_peered":"2024-04-19T02:15:29.277699+0000","last_unstale":"2024-04-19T02:15:30.273606+0000","last_undegraded":"2024-04-19T02:15:30.273606+0000","last_fullsized":"2024-04-19T02:15:30.273606+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.275113+0000","last_change":"2024-04-19T02:15:29.283341+0000","last_active":"2024-04-19T02:15:30.275113+0000","last_peered":"2024-04-19T02:15:30.275113+0000","last_clean":"2024-04-19T02:15:30.275113+0000","last_became_active":"2024-04-19T02:15:29.281591+0000","last_became_peered":"2024-04-19T02:15:29.281591+0000","last_unstale":"2024-04-19T02:15:30.275113+0000","last_undegraded":"2024-04-19T02:15:30.275113+0000","last_fullsized":"2024-04-19T02:15:30.275113+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:34.593754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273356+0000","last_change":"2024-04-19T02:15:29.282110+0000","last_active":"2024-04-19T02:15:30.273356+0000","last_peered":"2024-04-19T02:15:30.273356+0000","last_clean":"2024-04-19T02:15:30.273356+0000","last_became_active":"2024-04-19T02:15:29.281716+0000","last_became_peered":"2024-04-19T02:15:29.281716+0000","last_unstale":"2024-04-19T02:15:30.273356+0000","last_undegraded":"2024-04-19T02:15:30.273356+0000","last_fullsized":"2024-04-19T02:15:30.273356+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752789+0000","last_change":"2024-04-19T02:15:29.285237+0000","last_active":"2024-04-19T02:15:31.752789+0000","last_peered":"2024-04-19T02:15:31.752789+0000","last_clean":"2024-04-19T02:15:31.752789+0000","last_became_active":"2024-04-19T02:15:29.282790+0000","last_became_peered":"2024-04-19T02:15:29.282790+0000","last_unstale":"2024-04-19T02:15:31.752789+0000","last_undegraded":"2024-04-19T02:15:31.752789+0000","last_fullsized":"2024-04-19T02:15:31.752789+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752599+0000","last_change":"2024-04-19T02:15:29.282609+0000","last_active":"2024-04-19T02:15:31.752599+0000","last_peered":"2024-04-19T02:15:31.752599+0000","last_clean":"2024-04-19T02:15:31.752599+0000","last_became_active":"2024-04-19T02:15:29.281665+0000","last_became_peered":"2024-04-19T02:15:29.281665+0000","last_unstale":"2024-04-19T02:15:31.752599+0000","last_undegraded":"2024-04-19T02:15:31.752599+0000","last_fullsized":"2024-04-19T02:15:31.752599+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.384881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274303+0000","last_change":"2024-04-19T02:15:29.278890+0000","last_active":"2024-04-19T02:15:30.274303+0000","last_peered":"2024-04-19T02:15:30.274303+0000","last_clean":"2024-04-19T02:15:30.274303+0000","last_became_active":"2024-04-19T02:15:29.278074+0000","last_became_peered":"2024-04-19T02:15:29.278074+0000","last_unstale":"2024-04-19T02:15:30.274303+0000","last_undegraded":"2024-04-19T02:15:30.274303+0000","last_fullsized":"2024-04-19T02:15:30.274303+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:00.191179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.272977+0000","last_change":"2024-04-19T02:15:29.277109+0000","last_active":"2024-04-19T02:15:30.272977+0000","last_peered":"2024-04-19T02:15:30.272977+0000","last_clean":"2024-04-19T02:15:30.272977+0000","last_became_active":"2024-04-19T02:15:29.275417+0000","last_became_peered":"2024-04-19T02:15:29.275417+0000","last_unstale":"2024-04-19T02:15:30.272977+0000","last_undegraded":"2024-04-19T02:15:30.272977+0000","last_fullsized":"2024-04-19T02:15:30.272977+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274103+0000","last_change":"2024-04-19T02:15:29.283266+0000","last_active":"2024-04-19T02:15:30.274103+0000","last_peered":"2024-04-19T02:15:30.274103+0000","last_clean":"2024-04-19T02:15:30.274103+0000","last_became_active":"2024-04-19T02:15:29.281505+0000","last_became_peered":"2024-04-19T02:15:29.281505+0000","last_unstale":"2024-04-19T02:15:30.274103+0000","last_undegraded":"2024-04-19T02:15:30.274103+0000","last_fullsized":"2024-04-19T02:15:30.274103+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.275172+0000","last_change":"2024-04-19T02:15:29.278084+0000","last_active":"2024-04-19T02:15:30.275172+0000","last_peered":"2024-04-19T02:15:30.275172+0000","last_clean":"2024-04-19T02:15:30.275172+0000","last_became_active":"2024-04-19T02:15:29.276952+0000","last_became_peered":"2024-04-19T02:15:29.276952+0000","last_unstale":"2024-04-19T02:15:30.275172+0000","last_undegraded":"2024-04-19T02:15:30.275172+0000","last_fullsized":"2024-04-19T02:15:30.275172+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273711+0000","last_change":"2024-04-19T02:15:29.279904+0000","last_active":"2024-04-19T02:15:30.273711+0000","last_peered":"2024-04-19T02:15:30.273711+0000","last_clean":"2024-04-19T02:15:30.273711+0000","last_became_active":"2024-04-19T02:15:29.278938+0000","last_became_peered":"2024-04-19T02:15:29.278938+0000","last_unstale":"2024-04-19T02:15:30.273711+0000","last_undegraded":"2024-04-19T02:15:30.273711+0000","last_fullsized":"2024-04-19T02:15:30.273711+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752884+0000","last_change":"2024-04-19T02:15:29.287389+0000","last_active":"2024-04-19T02:15:31.752884+0000","last_peered":"2024-04-19T02:15:31.752884+0000","last_clean":"2024-04-19T02:15:31.752884+0000","last_became_active":"2024-04-19T02:15:29.286431+0000","last_became_peered":"2024-04-19T02:15:29.286431+0000","last_unstale":"2024-04-19T02:15:31.752884+0000","last_undegraded":"2024-04-19T02:15:31.752884+0000","last_fullsized":"2024-04-19T02:15:31.752884+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:58:30.117887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274282+0000","last_change":"2024-04-19T02:15:28.890403+0000","last_active":"2024-04-19T02:15:30.274282+0000","last_peered":"2024-04-19T02:15:30.274282+0000","last_clean":"2024-04-19T02:15:30.274282+0000","last_became_active":"2024-04-19T02:15:28.889780+0000","last_became_peered":"2024-04-19T02:15:28.889780+0000","last_unstale":"2024-04-19T02:15:30.274282+0000","last_undegraded":"2024-04-19T02:15:30.274282+0000","last_fullsized":"2024-04-19T02:15:30.274282+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:52:15.842316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.275112+0000","last_change":"2024-04-19T02:15:29.281792+0000","last_active":"2024-04-19T02:15:30.275112+0000","last_peered":"2024-04-19T02:15:30.275112+0000","last_clean":"2024-04-19T02:15:30.275112+0000","last_became_active":"2024-04-19T02:15:29.280479+0000","last_became_peered":"2024-04-19T02:15:29.280479+0000","last_unstale":"2024-04-19T02:15:30.275112+0000","last_undegraded":"2024-04-19T02:15:30.275112+0000","last_fullsized":"2024-04-19T02:15:30.275112+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273058+0000","last_change":"2024-04-19T02:15:28.888778+0000","last_active":"2024-04-19T02:15:30.273058+0000","last_peered":"2024-04-19T02:15:30.273058+0000","last_clean":"2024-04-19T02:15:30.273058+0000","last_became_active":"2024-04-19T02:15:28.888543+0000","last_became_peered":"2024-04-19T02:15:28.888543+0000","last_unstale":"2024-04-19T02:15:30.273058+0000","last_undegraded":"2024-04-19T02:15:30.273058+0000","last_fullsized":"2024-04-19T02:15:30.273058+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:43:51.221619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273526+0000","last_change":"2024-04-19T02:15:29.279986+0000","last_active":"2024-04-19T02:15:30.273526+0000","last_peered":"2024-04-19T02:15:30.273526+0000","last_clean":"2024-04-19T02:15:30.273526+0000","last_became_active":"2024-04-19T02:15:29.279690+0000","last_became_peered":"2024-04-19T02:15:29.279690+0000","last_unstale":"2024-04-19T02:15:30.273526+0000","last_undegraded":"2024-04-19T02:15:30.273526+0000","last_fullsized":"2024-04-19T02:15:30.273526+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.272885+0000","last_change":"2024-04-19T02:15:28.890463+0000","last_active":"2024-04-19T02:15:30.272885+0000","last_peered":"2024-04-19T02:15:30.272885+0000","last_clean":"2024-04-19T02:15:30.272885+0000","last_became_active":"2024-04-19T02:15:28.889777+0000","last_became_peered":"2024-04-19T02:15:28.889777+0000","last_unstale":"2024-04-19T02:15:30.272885+0000","last_undegraded":"2024-04-19T02:15:30.272885+0000","last_fullsized":"2024-04-19T02:15:30.272885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:58:21.520250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.275141+0000","last_change":"2024-04-19T02:15:29.280879+0000","last_active":"2024-04-19T02:15:30.275141+0000","last_peered":"2024-04-19T02:15:30.275141+0000","last_clean":"2024-04-19T02:15:30.275141+0000","last_became_active":"2024-04-19T02:15:29.279314+0000","last_became_peered":"2024-04-19T02:15:29.279314+0000","last_unstale":"2024-04-19T02:15:30.275141+0000","last_undegraded":"2024-04-19T02:15:30.275141+0000","last_fullsized":"2024-04-19T02:15:30.275141+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273829+0000","last_change":"2024-04-19T02:15:28.891867+0000","last_active":"2024-04-19T02:15:30.273829+0000","last_peered":"2024-04-19T02:15:30.273829+0000","last_clean":"2024-04-19T02:15:30.273829+0000","last_became_active":"2024-04-19T02:15:28.890806+0000","last_became_peered":"2024-04-19T02:15:28.890806+0000","last_unstale":"2024-04-19T02:15:30.273829+0000","last_undegraded":"2024-04-19T02:15:30.273829+0000","last_fullsized":"2024-04-19T02:15:30.273829+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:57.946581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.272758+0000","last_change":"2024-04-19T02:15:29.278148+0000","last_active":"2024-04-19T02:15:30.272758+0000","last_peered":"2024-04-19T02:15:30.272758+0000","last_clean":"2024-04-19T02:15:30.272758+0000","last_became_active":"2024-04-19T02:15:29.277402+0000","last_became_peered":"2024-04-19T02:15:29.277402+0000","last_unstale":"2024-04-19T02:15:30.272758+0000","last_undegraded":"2024-04-19T02:15:30.272758+0000","last_fullsized":"2024-04-19T02:15:30.272758+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752928+0000","last_change":"2024-04-19T02:15:28.892905+0000","last_active":"2024-04-19T02:15:31.752928+0000","last_peered":"2024-04-19T02:15:31.752928+0000","last_clean":"2024-04-19T02:15:31.752928+0000","last_became_active":"2024-04-19T02:15:28.892541+0000","last_became_peered":"2024-04-19T02:15:28.892541+0000","last_unstale":"2024-04-19T02:15:31.752928+0000","last_undegraded":"2024-04-19T02:15:31.752928+0000","last_fullsized":"2024-04-19T02:15:31.752928+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:33.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273109+0000","last_change":"2024-04-19T02:15:29.278810+0000","last_active":"2024-04-19T02:15:30.273109+0000","last_peered":"2024-04-19T02:15:30.273109+0000","last_clean":"2024-04-19T02:15:30.273109+0000","last_became_active":"2024-04-19T02:15:29.278093+0000","last_became_peered":"2024-04-19T02:15:29.278093+0000","last_unstale":"2024-04-19T02:15:30.273109+0000","last_undegraded":"2024-04-19T02:15:30.273109+0000","last_fullsized":"2024-04-19T02:15:30.273109+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:34.883207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274867+0000","last_change":"2024-04-19T02:15:28.892937+0000","last_active":"2024-04-19T02:15:30.274867+0000","last_peered":"2024-04-19T02:15:30.274867+0000","last_clean":"2024-04-19T02:15:30.274867+0000","last_became_active":"2024-04-19T02:15:28.891440+0000","last_became_peered":"2024-04-19T02:15:28.891440+0000","last_unstale":"2024-04-19T02:15:30.274867+0000","last_undegraded":"2024-04-19T02:15:30.274867+0000","last_fullsized":"2024-04-19T02:15:30.274867+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273027+0000","last_change":"2024-04-19T02:15:29.278404+0000","last_active":"2024-04-19T02:15:30.273027+0000","last_peered":"2024-04-19T02:15:30.273027+0000","last_clean":"2024-04-19T02:15:30.273027+0000","last_became_active":"2024-04-19T02:15:29.277460+0000","last_became_peered":"2024-04-19T02:15:29.277460+0000","last_unstale":"2024-04-19T02:15:30.273027+0000","last_undegraded":"2024-04-19T02:15:30.273027+0000","last_fullsized":"2024-04-19T02:15:30.273027+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752700+0000","last_change":"2024-04-19T02:15:28.891097+0000","last_active":"2024-04-19T02:15:31.752700+0000","last_peered":"2024-04-19T02:15:31.752700+0000","last_clean":"2024-04-19T02:15:31.752700+0000","last_became_active":"2024-04-19T02:15:28.890795+0000","last_became_peered":"2024-04-19T02:15:28.890795+0000","last_unstale":"2024-04-19T02:15:31.752700+0000","last_undegraded":"2024-04-19T02:15:31.752700+0000","last_fullsized":"2024-04-19T02:15:31.752700+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752913+0000","last_change":"2024-04-19T02:15:29.278546+0000","last_active":"2024-04-19T02:15:31.752913+0000","last_peered":"2024-04-19T02:15:31.752913+0000","last_clean":"2024-04-19T02:15:31.752913+0000","last_became_active":"2024-04-19T02:15:29.277547+0000","last_became_peered":"2024-04-19T02:15:29.277547+0000","last_unstale":"2024-04-19T02:15:31.752913+0000","last_undegraded":"2024-04-19T02:15:31.752913+0000","last_fullsized":"2024-04-19T02:15:31.752913+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752826+0000","last_change":"2024-04-19T02:15:28.892977+0000","last_active":"2024-04-19T02:15:31.752826+0000","last_peered":"2024-04-19T02:15:31.752826+0000","last_clean":"2024-04-19T02:15:31.752826+0000","last_became_active":"2024-04-19T02:15:28.892636+0000","last_became_peered":"2024-04-19T02:15:28.892636+0000","last_unstale":"2024-04-19T02:15:31.752826+0000","last_undegraded":"2024-04-19T02:15:31.752826+0000","last_fullsized":"2024-04-19T02:15:31.752826+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:43:51.221619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274651+0000","last_change":"2024-04-19T02:15:29.284260+0000","last_active":"2024-04-19T02:15:30.274651+0000","last_peered":"2024-04-19T02:15:30.274651+0000","last_clean":"2024-04-19T02:15:30.274651+0000","last_became_active":"2024-04-19T02:15:29.282990+0000","last_became_peered":"2024-04-19T02:15:29.282990+0000","last_unstale":"2024-04-19T02:15:30.274651+0000","last_undegraded":"2024-04-19T02:15:30.274651+0000","last_fullsized":"2024-04-19T02:15:30.274651+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:36:48.819486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273207+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:15:30.273207+0000","last_peered":"2024-04-19T02:15:30.273207+0000","last_clean":"2024-04-19T02:15:30.273207+0000","last_became_active":"2024-04-19T02:15:28.890751+0000","last_became_peered":"2024-04-19T02:15:28.890751+0000","last_unstale":"2024-04-19T02:15:30.273207+0000","last_undegraded":"2024-04-19T02:15:30.273207+0000","last_fullsized":"2024-04-19T02:15:30.273207+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.275108+0000","last_change":"2024-04-19T02:15:29.282068+0000","last_active":"2024-04-19T02:15:30.275108+0000","last_peered":"2024-04-19T02:15:30.275108+0000","last_clean":"2024-04-19T02:15:30.275108+0000","last_became_active":"2024-04-19T02:15:29.280450+0000","last_became_peered":"2024-04-19T02:15:29.280450+0000","last_unstale":"2024-04-19T02:15:30.275108+0000","last_undegraded":"2024-04-19T02:15:30.275108+0000","last_fullsized":"2024-04-19T02:15:30.275108+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274189+0000","last_change":"2024-04-19T02:15:28.892934+0000","last_active":"2024-04-19T02:15:30.274189+0000","last_peered":"2024-04-19T02:15:30.274189+0000","last_clean":"2024-04-19T02:15:30.274189+0000","last_became_active":"2024-04-19T02:15:28.891879+0000","last_became_peered":"2024-04-19T02:15:28.891879+0000","last_unstale":"2024-04-19T02:15:30.274189+0000","last_undegraded":"2024-04-19T02:15:30.274189+0000","last_fullsized":"2024-04-19T02:15:30.274189+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:10:12.514798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273640+0000","last_change":"2024-04-19T02:15:29.279685+0000","last_active":"2024-04-19T02:15:30.273640+0000","last_peered":"2024-04-19T02:15:30.273640+0000","last_clean":"2024-04-19T02:15:30.273640+0000","last_became_active":"2024-04-19T02:15:29.278810+0000","last_became_peered":"2024-04-19T02:15:29.278810+0000","last_unstale":"2024-04-19T02:15:30.273640+0000","last_undegraded":"2024-04-19T02:15:30.273640+0000","last_fullsized":"2024-04-19T02:15:30.273640+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752370+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:15:31.752370+0000","last_peered":"2024-04-19T02:15:31.752370+0000","last_clean":"2024-04-19T02:15:31.752370+0000","last_became_active":"2024-04-19T02:15:28.890882+0000","last_became_peered":"2024-04-19T02:15:28.890882+0000","last_unstale":"2024-04-19T02:15:31.752370+0000","last_undegraded":"2024-04-19T02:15:31.752370+0000","last_fullsized":"2024-04-19T02:15:31.752370+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:31.673938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274006+0000","last_change":"2024-04-19T02:15:29.284258+0000","last_active":"2024-04-19T02:15:30.274006+0000","last_peered":"2024-04-19T02:15:30.274006+0000","last_clean":"2024-04-19T02:15:30.274006+0000","last_became_active":"2024-04-19T02:15:29.283995+0000","last_became_peered":"2024-04-19T02:15:29.283995+0000","last_unstale":"2024-04-19T02:15:30.274006+0000","last_undegraded":"2024-04-19T02:15:30.274006+0000","last_fullsized":"2024-04-19T02:15:30.274006+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:35.941308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.753137+0000","last_change":"2024-04-19T02:15:28.890265+0000","last_active":"2024-04-19T02:15:31.753137+0000","last_peered":"2024-04-19T02:15:31.753137+0000","last_clean":"2024-04-19T02:15:31.753137+0000","last_became_active":"2024-04-19T02:15:28.890004+0000","last_became_peered":"2024-04-19T02:15:28.890004+0000","last_unstale":"2024-04-19T02:15:31.753137+0000","last_undegraded":"2024-04-19T02:15:31.753137+0000","last_fullsized":"2024-04-19T02:15:31.753137+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:02.517101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273866+0000","last_change":"2024-04-19T02:15:29.285529+0000","last_active":"2024-04-19T02:15:30.273866+0000","last_peered":"2024-04-19T02:15:30.273866+0000","last_clean":"2024-04-19T02:15:30.273866+0000","last_became_active":"2024-04-19T02:15:29.285197+0000","last_became_peered":"2024-04-19T02:15:29.285197+0000","last_unstale":"2024-04-19T02:15:30.273866+0000","last_undegraded":"2024-04-19T02:15:30.273866+0000","last_fullsized":"2024-04-19T02:15:30.273866+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274737+0000","last_change":"2024-04-19T02:15:28.893902+0000","last_active":"2024-04-19T02:15:30.274737+0000","last_peered":"2024-04-19T02:15:30.274737+0000","last_clean":"2024-04-19T02:15:30.274737+0000","last_became_active":"2024-04-19T02:15:28.893231+0000","last_became_peered":"2024-04-19T02:15:28.893231+0000","last_unstale":"2024-04-19T02:15:30.274737+0000","last_undegraded":"2024-04-19T02:15:30.274737+0000","last_fullsized":"2024-04-19T02:15:30.274737+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:23.658442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274341+0000","last_change":"2024-04-19T02:15:29.282874+0000","last_active":"2024-04-19T02:15:30.274341+0000","last_peered":"2024-04-19T02:15:30.274341+0000","last_clean":"2024-04-19T02:15:30.274341+0000","last_became_active":"2024-04-19T02:15:29.281675+0000","last_became_peered":"2024-04-19T02:15:29.281675+0000","last_unstale":"2024-04-19T02:15:30.274341+0000","last_undegraded":"2024-04-19T02:15:30.274341+0000","last_fullsized":"2024-04-19T02:15:30.274341+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:35.941308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752851+0000","last_change":"2024-04-19T02:15:28.891234+0000","last_active":"2024-04-19T02:15:31.752851+0000","last_peered":"2024-04-19T02:15:31.752851+0000","last_clean":"2024-04-19T02:15:31.752851+0000","last_became_active":"2024-04-19T02:15:28.890881+0000","last_became_peered":"2024-04-19T02:15:28.890881+0000","last_unstale":"2024-04-19T02:15:31.752851+0000","last_undegraded":"2024-04-19T02:15:31.752851+0000","last_fullsized":"2024-04-19T02:15:31.752851+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752380+0000","last_change":"2024-04-19T02:15:29.281937+0000","last_active":"2024-04-19T02:15:31.752380+0000","last_peered":"2024-04-19T02:15:31.752380+0000","last_clean":"2024-04-19T02:15:31.752380+0000","last_became_active":"2024-04-19T02:15:29.280727+0000","last_became_peered":"2024-04-19T02:15:29.280727+0000","last_unstale":"2024-04-19T02:15:31.752380+0000","last_undegraded":"2024-04-19T02:15:31.752380+0000","last_fullsized":"2024-04-19T02:15:31.752380+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752346+0000","last_change":"2024-04-19T02:15:28.892767+0000","last_active":"2024-04-19T02:15:31.752346+0000","last_peered":"2024-04-19T02:15:31.752346+0000","last_clean":"2024-04-19T02:15:31.752346+0000","last_became_active":"2024-04-19T02:15:28.892235+0000","last_became_peered":"2024-04-19T02:15:28.892235+0000","last_unstale":"2024-04-19T02:15:31.752346+0000","last_undegraded":"2024-04-19T02:15:31.752346+0000","last_fullsized":"2024-04-19T02:15:31.752346+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:37.690735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273357+0000","last_change":"2024-04-19T02:15:29.279857+0000","last_active":"2024-04-19T02:15:30.273357+0000","last_peered":"2024-04-19T02:15:30.273357+0000","last_clean":"2024-04-19T02:15:30.273357+0000","last_became_active":"2024-04-19T02:15:29.279536+0000","last_became_peered":"2024-04-19T02:15:29.279536+0000","last_unstale":"2024-04-19T02:15:30.273357+0000","last_undegraded":"2024-04-19T02:15:30.273357+0000","last_fullsized":"2024-04-19T02:15:30.273357+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:00.191179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273138+0000","last_change":"2024-04-19T02:15:28.891611+0000","last_active":"2024-04-19T02:15:30.273138+0000","last_peered":"2024-04-19T02:15:30.273138+0000","last_clean":"2024-04-19T02:15:30.273138+0000","last_became_active":"2024-04-19T02:15:28.890914+0000","last_became_peered":"2024-04-19T02:15:28.890914+0000","last_unstale":"2024-04-19T02:15:30.273138+0000","last_undegraded":"2024-04-19T02:15:30.273138+0000","last_fullsized":"2024-04-19T02:15:30.273138+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:37.690735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752522+0000","last_change":"2024-04-19T02:15:29.285774+0000","last_active":"2024-04-19T02:15:31.752522+0000","last_peered":"2024-04-19T02:15:31.752522+0000","last_clean":"2024-04-19T02:15:31.752522+0000","last_became_active":"2024-04-19T02:15:29.284705+0000","last_became_peered":"2024-04-19T02:15:29.284705+0000","last_unstale":"2024-04-19T02:15:31.752522+0000","last_undegraded":"2024-04-19T02:15:31.752522+0000","last_fullsized":"2024-04-19T02:15:31.752522+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752240+0000","last_change":"2024-04-19T02:15:28.892873+0000","last_active":"2024-04-19T02:15:31.752240+0000","last_peered":"2024-04-19T02:15:31.752240+0000","last_clean":"2024-04-19T02:15:31.752240+0000","last_became_active":"2024-04-19T02:15:28.892487+0000","last_became_peered":"2024-04-19T02:15:28.892487+0000","last_unstale":"2024-04-19T02:15:31.752240+0000","last_undegraded":"2024-04-19T02:15:31.752240+0000","last_fullsized":"2024-04-19T02:15:31.752240+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:35.412837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.753131+0000","last_change":"2024-04-19T02:15:29.285019+0000","last_active":"2024-04-19T02:15:31.753131+0000","last_peered":"2024-04-19T02:15:31.753131+0000","last_clean":"2024-04-19T02:15:31.753131+0000","last_became_active":"2024-04-19T02:15:29.284650+0000","last_became_peered":"2024-04-19T02:15:29.284650+0000","last_unstale":"2024-04-19T02:15:31.753131+0000","last_undegraded":"2024-04-19T02:15:31.753131+0000","last_fullsized":"2024-04-19T02:15:31.753131+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273991+0000","last_change":"2024-04-19T02:15:28.893245+0000","last_active":"2024-04-19T02:15:30.273991+0000","last_peered":"2024-04-19T02:15:30.273991+0000","last_clean":"2024-04-19T02:15:30.273991+0000","last_became_active":"2024-04-19T02:15:28.891932+0000","last_became_peered":"2024-04-19T02:15:28.891932+0000","last_unstale":"2024-04-19T02:15:30.273991+0000","last_undegraded":"2024-04-19T02:15:30.273991+0000","last_fullsized":"2024-04-19T02:15:30.273991+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:30.518182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.753047+0000","last_change":"2024-04-19T02:15:29.287190+0000","last_active":"2024-04-19T02:15:31.753047+0000","last_peered":"2024-04-19T02:15:31.753047+0000","last_clean":"2024-04-19T02:15:31.753047+0000","last_became_active":"2024-04-19T02:15:29.286606+0000","last_became_peered":"2024-04-19T02:15:29.286606+0000","last_unstale":"2024-04-19T02:15:31.753047+0000","last_undegraded":"2024-04-19T02:15:31.753047+0000","last_fullsized":"2024-04-19T02:15:31.753047+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:28.387062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274074+0000","last_change":"2024-04-19T02:15:28.894121+0000","last_active":"2024-04-19T02:15:30.274074+0000","last_peered":"2024-04-19T02:15:30.274074+0000","last_clean":"2024-04-19T02:15:30.274074+0000","last_became_active":"2024-04-19T02:15:28.893902+0000","last_became_peered":"2024-04-19T02:15:28.893902+0000","last_unstale":"2024-04-19T02:15:30.274074+0000","last_undegraded":"2024-04-19T02:15:30.274074+0000","last_fullsized":"2024-04-19T02:15:30.274074+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:10:35.146583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273739+0000","last_change":"2024-04-19T02:15:29.282870+0000","last_active":"2024-04-19T02:15:30.273739+0000","last_peered":"2024-04-19T02:15:30.273739+0000","last_clean":"2024-04-19T02:15:30.273739+0000","last_became_active":"2024-04-19T02:15:29.281873+0000","last_became_peered":"2024-04-19T02:15:29.281873+0000","last_unstale":"2024-04-19T02:15:30.273739+0000","last_undegraded":"2024-04-19T02:15:30.273739+0000","last_fullsized":"2024-04-19T02:15:30.273739+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.269354+0000","last_change":"2024-04-19T02:15:24.527061+0000","last_active":"2024-04-19T02:15:29.269354+0000","last_peered":"2024-04-19T02:15:29.269354+0000","last_clean":"2024-04-19T02:15:29.269354+0000","last_became_active":"2024-04-19T02:15:24.526757+0000","last_became_peered":"2024-04-19T02:15:24.526757+0000","last_unstale":"2024-04-19T02:15:29.269354+0000","last_undegraded":"2024-04-19T02:15:29.269354+0000","last_fullsized":"2024-04-19T02:15:29.269354+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:17:13.649077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.753003+0000","last_change":"2024-04-19T02:15:28.892766+0000","last_active":"2024-04-19T02:15:31.753003+0000","last_peered":"2024-04-19T02:15:31.753003+0000","last_clean":"2024-04-19T02:15:31.753003+0000","last_became_active":"2024-04-19T02:15:28.892396+0000","last_became_peered":"2024-04-19T02:15:28.892396+0000","last_unstale":"2024-04-19T02:15:31.753003+0000","last_undegraded":"2024-04-19T02:15:31.753003+0000","last_fullsized":"2024-04-19T02:15:31.753003+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:57.946581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274481+0000","last_change":"2024-04-19T02:15:29.277922+0000","last_active":"2024-04-19T02:15:30.274481+0000","last_peered":"2024-04-19T02:15:30.274481+0000","last_clean":"2024-04-19T02:15:30.274481+0000","last_became_active":"2024-04-19T02:15:29.276968+0000","last_became_peered":"2024-04-19T02:15:29.276968+0000","last_unstale":"2024-04-19T02:15:30.274481+0000","last_undegraded":"2024-04-19T02:15:30.274481+0000","last_fullsized":"2024-04-19T02:15:30.274481+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.276084+0000","last_change":"2024-04-19T02:15:24.530933+0000","last_active":"2024-04-19T02:15:29.276084+0000","last_peered":"2024-04-19T02:15:29.276084+0000","last_clean":"2024-04-19T02:15:29.276084+0000","last_became_active":"2024-04-19T02:15:24.530550+0000","last_became_peered":"2024-04-19T02:15:24.530550+0000","last_unstale":"2024-04-19T02:15:29.276084+0000","last_undegraded":"2024-04-19T02:15:29.276084+0000","last_fullsized":"2024-04-19T02:15:29.276084+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:18:15.194321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752725+0000","last_change":"2024-04-19T02:15:28.893062+0000","last_active":"2024-04-19T02:15:31.752725+0000","last_peered":"2024-04-19T02:15:31.752725+0000","last_clean":"2024-04-19T02:15:31.752725+0000","last_became_active":"2024-04-19T02:15:28.892798+0000","last_became_peered":"2024-04-19T02:15:28.892798+0000","last_unstale":"2024-04-19T02:15:31.752725+0000","last_undegraded":"2024-04-19T02:15:31.752725+0000","last_fullsized":"2024-04-19T02:15:31.752725+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:53.170180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273830+0000","last_change":"2024-04-19T02:15:29.278294+0000","last_active":"2024-04-19T02:15:30.273830+0000","last_peered":"2024-04-19T02:15:30.273830+0000","last_clean":"2024-04-19T02:15:30.273830+0000","last_became_active":"2024-04-19T02:15:29.277536+0000","last_became_peered":"2024-04-19T02:15:29.277536+0000","last_unstale":"2024-04-19T02:15:30.273830+0000","last_undegraded":"2024-04-19T02:15:30.273830+0000","last_fullsized":"2024-04-19T02:15:30.273830+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.268601+0000","last_change":"2024-04-19T02:15:24.527048+0000","last_active":"2024-04-19T02:15:29.268601+0000","last_peered":"2024-04-19T02:15:29.268601+0000","last_clean":"2024-04-19T02:15:29.268601+0000","last_became_active":"2024-04-19T02:15:24.526790+0000","last_became_peered":"2024-04-19T02:15:24.526790+0000","last_unstale":"2024-04-19T02:15:29.268601+0000","last_undegraded":"2024-04-19T02:15:29.268601+0000","last_fullsized":"2024-04-19T02:15:29.268601+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273986+0000","last_change":"2024-04-19T02:15:28.893858+0000","last_active":"2024-04-19T02:15:30.273986+0000","last_peered":"2024-04-19T02:15:30.273986+0000","last_clean":"2024-04-19T02:15:30.273986+0000","last_became_active":"2024-04-19T02:15:28.892497+0000","last_became_peered":"2024-04-19T02:15:28.892497+0000","last_unstale":"2024-04-19T02:15:30.273986+0000","last_undegraded":"2024-04-19T02:15:30.273986+0000","last_fullsized":"2024-04-19T02:15:30.273986+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:31.673938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273922+0000","last_change":"2024-04-19T02:15:29.282663+0000","last_active":"2024-04-19T02:15:30.273922+0000","last_peered":"2024-04-19T02:15:30.273922+0000","last_clean":"2024-04-19T02:15:30.273922+0000","last_became_active":"2024-04-19T02:15:29.282217+0000","last_became_peered":"2024-04-19T02:15:29.282217+0000","last_unstale":"2024-04-19T02:15:30.273922+0000","last_undegraded":"2024-04-19T02:15:30.273922+0000","last_fullsized":"2024-04-19T02:15:30.273922+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.276557+0000","last_change":"2024-04-19T02:15:24.530924+0000","last_active":"2024-04-19T02:15:29.276557+0000","last_peered":"2024-04-19T02:15:29.276557+0000","last_clean":"2024-04-19T02:15:29.276557+0000","last_became_active":"2024-04-19T02:15:24.530551+0000","last_became_peered":"2024-04-19T02:15:24.530551+0000","last_unstale":"2024-04-19T02:15:29.276557+0000","last_undegraded":"2024-04-19T02:15:29.276557+0000","last_fullsized":"2024-04-19T02:15:29.276557+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:30.576946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":210,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.275680+0000","last_change":"2024-04-19T02:15:24.533634+0000","last_active":"2024-04-19T02:15:29.275680+0000","last_peered":"2024-04-19T02:15:29.275680+0000","last_clean":"2024-04-19T02:15:29.275680+0000","last_became_active":"2024-04-19T02:15:24.533420+0000","last_became_peered":"2024-04-19T02:15:24.533420+0000","last_unstale":"2024-04-19T02:15:29.275680+0000","last_undegraded":"2024-04-19T02:15:29.275680+0000","last_fullsized":"2024-04-19T02:15:29.275680+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273047+0000","last_change":"2024-04-19T02:15:28.890244+0000","last_active":"2024-04-19T02:15:30.273047+0000","last_peered":"2024-04-19T02:15:30.273047+0000","last_clean":"2024-04-19T02:15:30.273047+0000","last_became_active":"2024-04-19T02:15:28.889831+0000","last_became_peered":"2024-04-19T02:15:28.889831+0000","last_unstale":"2024-04-19T02:15:30.273047+0000","last_undegraded":"2024-04-19T02:15:30.273047+0000","last_fullsized":"2024-04-19T02:15:30.273047+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.753121+0000","last_change":"2024-04-19T02:15:29.285015+0000","last_active":"2024-04-19T02:15:31.753121+0000","last_peered":"2024-04-19T02:15:31.753121+0000","last_clean":"2024-04-19T02:15:31.753121+0000","last_became_active":"2024-04-19T02:15:29.284164+0000","last_became_peered":"2024-04-19T02:15:29.284164+0000","last_unstale":"2024-04-19T02:15:31.753121+0000","last_undegraded":"2024-04-19T02:15:31.753121+0000","last_fullsized":"2024-04-19T02:15:31.753121+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:36.987844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.275722+0000","last_change":"2024-04-19T02:15:24.533912+0000","last_active":"2024-04-19T02:15:29.275722+0000","last_peered":"2024-04-19T02:15:29.275722+0000","last_clean":"2024-04-19T02:15:29.275722+0000","last_became_active":"2024-04-19T02:15:24.533580+0000","last_became_peered":"2024-04-19T02:15:24.533580+0000","last_unstale":"2024-04-19T02:15:29.275722+0000","last_undegraded":"2024-04-19T02:15:29.275722+0000","last_fullsized":"2024-04-19T02:15:29.275722+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:45.045477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.272710+0000","last_change":"2024-04-19T02:15:28.891889+0000","last_active":"2024-04-19T02:15:30.272710+0000","last_peered":"2024-04-19T02:15:30.272710+0000","last_clean":"2024-04-19T02:15:30.272710+0000","last_became_active":"2024-04-19T02:15:28.890919+0000","last_became_peered":"2024-04-19T02:15:28.890919+0000","last_unstale":"2024-04-19T02:15:30.272710+0000","last_undegraded":"2024-04-19T02:15:30.272710+0000","last_fullsized":"2024-04-19T02:15:30.272710+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:35.412837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.275017+0000","last_change":"2024-04-19T02:15:29.284266+0000","last_active":"2024-04-19T02:15:30.275017+0000","last_peered":"2024-04-19T02:15:30.275017+0000","last_clean":"2024-04-19T02:15:30.275017+0000","last_became_active":"2024-04-19T02:15:29.282994+0000","last_became_peered":"2024-04-19T02:15:29.282994+0000","last_unstale":"2024-04-19T02:15:30.275017+0000","last_undegraded":"2024-04-19T02:15:30.275017+0000","last_fullsized":"2024-04-19T02:15:30.275017+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.277544+0000","last_change":"2024-04-19T02:15:24.526751+0000","last_active":"2024-04-19T02:15:29.277544+0000","last_peered":"2024-04-19T02:15:29.277544+0000","last_clean":"2024-04-19T02:15:29.277544+0000","last_became_active":"2024-04-19T02:15:24.526511+0000","last_became_peered":"2024-04-19T02:15:24.526511+0000","last_unstale":"2024-04-19T02:15:29.277544+0000","last_undegraded":"2024-04-19T02:15:29.277544+0000","last_fullsized":"2024-04-19T02:15:29.277544+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:02:45.966851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273736+0000","last_change":"2024-04-19T02:15:28.892125+0000","last_active":"2024-04-19T02:15:30.273736+0000","last_peered":"2024-04-19T02:15:30.273736+0000","last_clean":"2024-04-19T02:15:30.273736+0000","last_became_active":"2024-04-19T02:15:28.891300+0000","last_became_peered":"2024-04-19T02:15:28.891300+0000","last_unstale":"2024-04-19T02:15:30.273736+0000","last_undegraded":"2024-04-19T02:15:30.273736+0000","last_fullsized":"2024-04-19T02:15:30.273736+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274547+0000","last_change":"2024-04-19T02:15:29.281694+0000","last_active":"2024-04-19T02:15:30.274547+0000","last_peered":"2024-04-19T02:15:30.274547+0000","last_clean":"2024-04-19T02:15:30.274547+0000","last_became_active":"2024-04-19T02:15:29.280519+0000","last_became_peered":"2024-04-19T02:15:29.280519+0000","last_unstale":"2024-04-19T02:15:30.274547+0000","last_undegraded":"2024-04-19T02:15:30.274547+0000","last_fullsized":"2024-04-19T02:15:30.274547+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:50.890545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273711+0000","last_change":"2024-04-19T02:15:28.891702+0000","last_active":"2024-04-19T02:15:30.273711+0000","last_peered":"2024-04-19T02:15:30.273711+0000","last_clean":"2024-04-19T02:15:30.273711+0000","last_became_active":"2024-04-19T02:15:28.890743+0000","last_became_peered":"2024-04-19T02:15:28.890743+0000","last_unstale":"2024-04-19T02:15:30.273711+0000","last_undegraded":"2024-04-19T02:15:30.273711+0000","last_fullsized":"2024-04-19T02:15:30.273711+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.269774+0000","last_change":"2024-04-19T02:15:24.526845+0000","last_active":"2024-04-19T02:15:29.269774+0000","last_peered":"2024-04-19T02:15:29.269774+0000","last_clean":"2024-04-19T02:15:29.269774+0000","last_became_active":"2024-04-19T02:15:24.526500+0000","last_became_peered":"2024-04-19T02:15:24.526500+0000","last_unstale":"2024-04-19T02:15:29.269774+0000","last_undegraded":"2024-04-19T02:15:29.269774+0000","last_fullsized":"2024-04-19T02:15:29.269774+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:16.883355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.272678+0000","last_change":"2024-04-19T02:15:29.278686+0000","last_active":"2024-04-19T02:15:30.272678+0000","last_peered":"2024-04-19T02:15:30.272678+0000","last_clean":"2024-04-19T02:15:30.272678+0000","last_became_active":"2024-04-19T02:15:29.278108+0000","last_became_peered":"2024-04-19T02:15:29.278108+0000","last_unstale":"2024-04-19T02:15:30.272678+0000","last_undegraded":"2024-04-19T02:15:30.272678+0000","last_fullsized":"2024-04-19T02:15:30.272678+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:34.593754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.277610+0000","last_change":"2024-04-19T02:15:24.533777+0000","last_active":"2024-04-19T02:15:29.277610+0000","last_peered":"2024-04-19T02:15:29.277610+0000","last_clean":"2024-04-19T02:15:29.277610+0000","last_became_active":"2024-04-19T02:15:24.533436+0000","last_became_peered":"2024-04-19T02:15:24.533436+0000","last_unstale":"2024-04-19T02:15:29.277610+0000","last_undegraded":"2024-04-19T02:15:29.277610+0000","last_fullsized":"2024-04-19T02:15:29.277610+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:53:25.922418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273431+0000","last_change":"2024-04-19T02:15:28.891370+0000","last_active":"2024-04-19T02:15:30.273431+0000","last_peered":"2024-04-19T02:15:30.273431+0000","last_clean":"2024-04-19T02:15:30.273431+0000","last_became_active":"2024-04-19T02:15:28.890702+0000","last_became_peered":"2024-04-19T02:15:28.890702+0000","last_unstale":"2024-04-19T02:15:30.273431+0000","last_undegraded":"2024-04-19T02:15:30.273431+0000","last_fullsized":"2024-04-19T02:15:30.273431+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:33.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274234+0000","last_change":"2024-04-19T02:15:29.282244+0000","last_active":"2024-04-19T02:15:30.274234+0000","last_peered":"2024-04-19T02:15:30.274234+0000","last_clean":"2024-04-19T02:15:30.274234+0000","last_became_active":"2024-04-19T02:15:29.280366+0000","last_became_peered":"2024-04-19T02:15:29.280366+0000","last_unstale":"2024-04-19T02:15:30.274234+0000","last_undegraded":"2024-04-19T02:15:30.274234+0000","last_fullsized":"2024-04-19T02:15:30.274234+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274392+0000","last_change":"2024-04-19T02:15:28.893027+0000","last_active":"2024-04-19T02:15:30.274392+0000","last_peered":"2024-04-19T02:15:30.274392+0000","last_clean":"2024-04-19T02:15:30.274392+0000","last_became_active":"2024-04-19T02:15:28.892695+0000","last_became_peered":"2024-04-19T02:15:28.892695+0000","last_unstale":"2024-04-19T02:15:30.274392+0000","last_undegraded":"2024-04-19T02:15:30.274392+0000","last_fullsized":"2024-04-19T02:15:30.274392+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274805+0000","last_change":"2024-04-19T02:15:29.283155+0000","last_active":"2024-04-19T02:15:30.274805+0000","last_peered":"2024-04-19T02:15:30.274805+0000","last_clean":"2024-04-19T02:15:30.274805+0000","last_became_active":"2024-04-19T02:15:29.281407+0000","last_became_peered":"2024-04-19T02:15:29.281407+0000","last_unstale":"2024-04-19T02:15:30.274805+0000","last_undegraded":"2024-04-19T02:15:30.274805+0000","last_fullsized":"2024-04-19T02:15:30.274805+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752643+0000","last_change":"2024-04-19T02:15:28.893067+0000","last_active":"2024-04-19T02:15:31.752643+0000","last_peered":"2024-04-19T02:15:31.752643+0000","last_clean":"2024-04-19T02:15:31.752643+0000","last_became_active":"2024-04-19T02:15:28.892781+0000","last_became_peered":"2024-04-19T02:15:28.892781+0000","last_unstale":"2024-04-19T02:15:31.752643+0000","last_undegraded":"2024-04-19T02:15:31.752643+0000","last_fullsized":"2024-04-19T02:15:31.752643+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:54:15.590143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752652+0000","last_change":"2024-04-19T02:15:29.281279+0000","last_active":"2024-04-19T02:15:31.752652+0000","last_peered":"2024-04-19T02:15:31.752652+0000","last_clean":"2024-04-19T02:15:31.752652+0000","last_became_active":"2024-04-19T02:15:29.279360+0000","last_became_peered":"2024-04-19T02:15:29.279360+0000","last_unstale":"2024-04-19T02:15:31.752652+0000","last_undegraded":"2024-04-19T02:15:31.752652+0000","last_fullsized":"2024-04-19T02:15:31.752652+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274993+0000","last_change":"2024-04-19T02:15:28.893239+0000","last_active":"2024-04-19T02:15:30.274993+0000","last_peered":"2024-04-19T02:15:30.274993+0000","last_clean":"2024-04-19T02:15:30.274993+0000","last_became_active":"2024-04-19T02:15:28.892881+0000","last_became_peered":"2024-04-19T02:15:28.892881+0000","last_unstale":"2024-04-19T02:15:30.274993+0000","last_undegraded":"2024-04-19T02:15:30.274993+0000","last_fullsized":"2024-04-19T02:15:30.274993+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752362+0000","last_change":"2024-04-19T02:15:29.281652+0000","last_active":"2024-04-19T02:15:31.752362+0000","last_peered":"2024-04-19T02:15:31.752362+0000","last_clean":"2024-04-19T02:15:31.752362+0000","last_became_active":"2024-04-19T02:15:29.281175+0000","last_became_peered":"2024-04-19T02:15:29.281175+0000","last_unstale":"2024-04-19T02:15:31.752362+0000","last_undegraded":"2024-04-19T02:15:31.752362+0000","last_fullsized":"2024-04-19T02:15:31.752362+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:16.568764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273639+0000","last_change":"2024-04-19T02:15:28.892058+0000","last_active":"2024-04-19T02:15:30.273639+0000","last_peered":"2024-04-19T02:15:30.273639+0000","last_clean":"2024-04-19T02:15:30.273639+0000","last_became_active":"2024-04-19T02:15:28.890877+0000","last_became_peered":"2024-04-19T02:15:28.890877+0000","last_unstale":"2024-04-19T02:15:30.273639+0000","last_undegraded":"2024-04-19T02:15:30.273639+0000","last_fullsized":"2024-04-19T02:15:30.273639+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:53.170180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274344+0000","last_change":"2024-04-19T02:15:29.278810+0000","last_active":"2024-04-19T02:15:30.274344+0000","last_peered":"2024-04-19T02:15:30.274344+0000","last_clean":"2024-04-19T02:15:30.274344+0000","last_became_active":"2024-04-19T02:15:29.277913+0000","last_became_peered":"2024-04-19T02:15:29.277913+0000","last_unstale":"2024-04-19T02:15:30.274344+0000","last_undegraded":"2024-04-19T02:15:30.274344+0000","last_fullsized":"2024-04-19T02:15:30.274344+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:24.082666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273821+0000","last_change":"2024-04-19T02:15:28.889132+0000","last_active":"2024-04-19T02:15:30.273821+0000","last_peered":"2024-04-19T02:15:30.273821+0000","last_clean":"2024-04-19T02:15:30.273821+0000","last_became_active":"2024-04-19T02:15:28.888926+0000","last_became_peered":"2024-04-19T02:15:28.888926+0000","last_unstale":"2024-04-19T02:15:30.273821+0000","last_undegraded":"2024-04-19T02:15:30.273821+0000","last_fullsized":"2024-04-19T02:15:30.273821+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752370+0000","last_change":"2024-04-19T02:15:29.282776+0000","last_active":"2024-04-19T02:15:31.752370+0000","last_peered":"2024-04-19T02:15:31.752370+0000","last_clean":"2024-04-19T02:15:31.752370+0000","last_became_active":"2024-04-19T02:15:29.279382+0000","last_became_peered":"2024-04-19T02:15:29.279382+0000","last_unstale":"2024-04-19T02:15:31.752370+0000","last_undegraded":"2024-04-19T02:15:31.752370+0000","last_fullsized":"2024-04-19T02:15:31.752370+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752208+0000","last_change":"2024-04-19T02:15:29.283537+0000","last_active":"2024-04-19T02:15:31.752208+0000","last_peered":"2024-04-19T02:15:31.752208+0000","last_clean":"2024-04-19T02:15:31.752208+0000","last_became_active":"2024-04-19T02:15:29.281801+0000","last_became_peered":"2024-04-19T02:15:29.281801+0000","last_unstale":"2024-04-19T02:15:31.752208+0000","last_undegraded":"2024-04-19T02:15:31.752208+0000","last_fullsized":"2024-04-19T02:15:31.752208+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.272816+0000","last_change":"2024-04-19T02:15:29.281560+0000","last_active":"2024-04-19T02:15:30.272816+0000","last_peered":"2024-04-19T02:15:30.272816+0000","last_clean":"2024-04-19T02:15:30.272816+0000","last_became_active":"2024-04-19T02:15:29.281261+0000","last_became_peered":"2024-04-19T02:15:29.281261+0000","last_unstale":"2024-04-19T02:15:30.272816+0000","last_undegraded":"2024-04-19T02:15:30.272816+0000","last_fullsized":"2024-04-19T02:15:30.272816+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274549+0000","last_change":"2024-04-19T02:15:29.280731+0000","last_active":"2024-04-19T02:15:30.274549+0000","last_peered":"2024-04-19T02:15:30.274549+0000","last_clean":"2024-04-19T02:15:30.274549+0000","last_became_active":"2024-04-19T02:15:29.280340+0000","last_became_peered":"2024-04-19T02:15:29.280340+0000","last_unstale":"2024-04-19T02:15:30.274549+0000","last_undegraded":"2024-04-19T02:15:30.274549+0000","last_fullsized":"2024-04-19T02:15:30.274549+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273481+0000","last_change":"2024-04-19T02:15:29.278702+0000","last_active":"2024-04-19T02:15:30.273481+0000","last_peered":"2024-04-19T02:15:30.273481+0000","last_clean":"2024-04-19T02:15:30.273481+0000","last_became_active":"2024-04-19T02:15:29.277756+0000","last_became_peered":"2024-04-19T02:15:29.277756+0000","last_unstale":"2024-04-19T02:15:30.273481+0000","last_undegraded":"2024-04-19T02:15:30.273481+0000","last_fullsized":"2024-04-19T02:15:30.273481+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274899+0000","last_change":"2024-04-19T02:15:29.277568+0000","last_active":"2024-04-19T02:15:30.274899+0000","last_peered":"2024-04-19T02:15:30.274899+0000","last_clean":"2024-04-19T02:15:30.274899+0000","last_became_active":"2024-04-19T02:15:29.276725+0000","last_became_peered":"2024-04-19T02:15:29.276725+0000","last_unstale":"2024-04-19T02:15:30.274899+0000","last_undegraded":"2024-04-19T02:15:30.274899+0000","last_fullsized":"2024-04-19T02:15:30.274899+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738371,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":139264,"data_stored":46663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31856,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":757760,"data_stored":638777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":749568,"data_stored":638161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:15:38.267 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-19T02:15:38.267 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-19T02:15:38.267 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-19T02:15:38.267 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-19T02:15:38.268 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-19T02:15:38.687 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:15:38.700 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":40849},{"type":"v1","addr":"172.21.15.121:6801","nonce":40849}]},"active_addr":"172.21.15.121:6801/40849","active_change":"2024-04-19T02:15:20.732560+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4113,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.121:0","nonce":2664160023}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.121:0","nonce":108584597}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.121:0","nonce":3369327183}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.121:0","nonce":1331267297}]}]} 2024-04-19T02:15:38.703 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-19T02:15:38.703 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-19T02:15:38.703 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T02:15:39.026 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:15:39.026 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":15,"fsid":"f6ab5dd0-bb9f-4b48-a9fc-4728c7955ca8","created":"2024-04-19T02:15:13.539846+0000","modified":"2024-04-19T02:15:30.265522+0000","last_up_change":"2024-04-19T02:15:22.519568+0000","last_in_change":"2024-04-19T02:15:15.482624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T02:15:22.776125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T02:15:23.264005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T02:15:27.675087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T02:15:28.232224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88cb15f3-271c-43d5-af51-1cd26b8ed13c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":41347},{"type":"v1","addr":"172.21.15.153:6801","nonce":41347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":41347},{"type":"v1","addr":"172.21.15.153:6803","nonce":41347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":41347},{"type":"v1","addr":"172.21.15.153:6807","nonce":41347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":41347},{"type":"v1","addr":"172.21.15.153:6805","nonce":41347}]},"public_addr":"172.21.15.153:6801/41347","cluster_addr":"172.21.15.153:6803/41347","heartbeat_back_addr":"172.21.15.153:6807/41347","heartbeat_front_addr":"172.21.15.153:6805/41347","state":["exists","up"]},{"osd":1,"uuid":"2674869a-db01-4d9f-a496-9fb3851b5b21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":41380},{"type":"v1","addr":"172.21.15.174:6801","nonce":41380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":41380},{"type":"v1","addr":"172.21.15.174:6803","nonce":41380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":41380},{"type":"v1","addr":"172.21.15.174:6807","nonce":41380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":41380},{"type":"v1","addr":"172.21.15.174:6805","nonce":41380}]},"public_addr":"172.21.15.174:6801/41380","cluster_addr":"172.21.15.174:6803/41380","heartbeat_back_addr":"172.21.15.174:6807/41380","heartbeat_front_addr":"172.21.15.174:6805/41380","state":["exists","up"]},{"osd":2,"uuid":"712ad943-2f98-49d9-aabe-f66b509be633","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":41508},{"type":"v1","addr":"172.21.15.177:6801","nonce":41508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":41508},{"type":"v1","addr":"172.21.15.177:6803","nonce":41508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":41508},{"type":"v1","addr":"172.21.15.177:6807","nonce":41508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":41508},{"type":"v1","addr":"172.21.15.177:6805","nonce":41508}]},"public_addr":"172.21.15.177:6801/41508","cluster_addr":"172.21.15.177:6803/41508","heartbeat_back_addr":"172.21.15.177:6807/41508","heartbeat_front_addr":"172.21.15.177:6805/41508","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:15:20.495280+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:15:20.594553+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:15:20.524253+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T02:15:39.040 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-19T02:15:39.040 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T02:15:39.363 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:15:39.364 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":15,"fsid":"f6ab5dd0-bb9f-4b48-a9fc-4728c7955ca8","created":"2024-04-19T02:15:13.539846+0000","modified":"2024-04-19T02:15:30.265522+0000","last_up_change":"2024-04-19T02:15:22.519568+0000","last_in_change":"2024-04-19T02:15:15.482624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T02:15:22.776125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T02:15:23.264005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T02:15:27.675087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T02:15:28.232224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88cb15f3-271c-43d5-af51-1cd26b8ed13c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":41347},{"type":"v1","addr":"172.21.15.153:6801","nonce":41347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":41347},{"type":"v1","addr":"172.21.15.153:6803","nonce":41347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":41347},{"type":"v1","addr":"172.21.15.153:6807","nonce":41347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":41347},{"type":"v1","addr":"172.21.15.153:6805","nonce":41347}]},"public_addr":"172.21.15.153:6801/41347","cluster_addr":"172.21.15.153:6803/41347","heartbeat_back_addr":"172.21.15.153:6807/41347","heartbeat_front_addr":"172.21.15.153:6805/41347","state":["exists","up"]},{"osd":1,"uuid":"2674869a-db01-4d9f-a496-9fb3851b5b21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":41380},{"type":"v1","addr":"172.21.15.174:6801","nonce":41380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":41380},{"type":"v1","addr":"172.21.15.174:6803","nonce":41380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":41380},{"type":"v1","addr":"172.21.15.174:6807","nonce":41380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":41380},{"type":"v1","addr":"172.21.15.174:6805","nonce":41380}]},"public_addr":"172.21.15.174:6801/41380","cluster_addr":"172.21.15.174:6803/41380","heartbeat_back_addr":"172.21.15.174:6807/41380","heartbeat_front_addr":"172.21.15.174:6805/41380","state":["exists","up"]},{"osd":2,"uuid":"712ad943-2f98-49d9-aabe-f66b509be633","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":41508},{"type":"v1","addr":"172.21.15.177:6801","nonce":41508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":41508},{"type":"v1","addr":"172.21.15.177:6803","nonce":41508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":41508},{"type":"v1","addr":"172.21.15.177:6807","nonce":41508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":41508},{"type":"v1","addr":"172.21.15.177:6805","nonce":41508}]},"public_addr":"172.21.15.177:6801/41508","cluster_addr":"172.21.15.177:6803/41508","heartbeat_back_addr":"172.21.15.177:6807/41508","heartbeat_front_addr":"172.21.15.177:6805/41508","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:15:20.495280+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:15:20.594553+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:15:20.524253+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T02:15:39.377 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-19T02:15:39.378 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-19T02:15:39.378 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-19T02:15:39.542 INFO:teuthology.orchestra.run.smithi121.stdout:34359738373 2024-04-19T02:15:39.542 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-19T02:15:39.559 INFO:teuthology.orchestra.run.smithi121.stdout:34359738374 2024-04-19T02:15:39.559 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-19T02:15:39.560 INFO:teuthology.orchestra.run.smithi121.stdout:34359738373 2024-04-19T02:15:39.561 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-19T02:15:39.909 INFO:teuthology.orchestra.run.smithi121.stdout:34359738372 2024-04-19T02:15:39.923 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738372 for osd.1 2024-04-19T02:15:39.945 INFO:teuthology.orchestra.run.smithi121.stdout:34359738372 2024-04-19T02:15:39.959 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738372 for osd.2 2024-04-19T02:15:39.967 INFO:teuthology.orchestra.run.smithi121.stdout:34359738373 2024-04-19T02:15:39.982 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738373 for osd.0 2024-04-19T02:15:40.924 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-19T02:15:40.960 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-19T02:15:40.983 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-19T02:15:41.289 INFO:teuthology.orchestra.run.smithi121.stdout:34359738372 2024-04-19T02:15:41.305 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738372 for osd.1 2024-04-19T02:15:41.333 INFO:teuthology.orchestra.run.smithi121.stdout:34359738373 2024-04-19T02:15:41.347 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738373 for osd.2 2024-04-19T02:15:41.347 DEBUG:teuthology.parallel:result is None 2024-04-19T02:15:41.358 INFO:teuthology.orchestra.run.smithi121.stdout:34359738374 2024-04-19T02:15:41.372 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738374 for osd.0 2024-04-19T02:15:41.372 DEBUG:teuthology.parallel:result is None 2024-04-19T02:15:42.305 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-19T02:15:42.634 INFO:teuthology.orchestra.run.smithi121.stdout:34359738373 2024-04-19T02:15:42.648 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738373 for osd.1 2024-04-19T02:15:42.648 DEBUG:teuthology.parallel:result is None 2024-04-19T02:15:42.648 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-19T02:15:42.648 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:15:42.977 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:15:42.979 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-04-19T02:15:42.989 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-19T02:15:42.740587+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":86784,"kb_used_data":1608,"kb_used_omap":4,"kb_used_meta":85115,"kb_avail":283028736,"statfs":{"total":289910292480,"available":289821425664,"internally_reserved":0,"allocated":1646592,"data_stored":1323601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":87158098},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002800"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.275255+0000","last_change":"2024-04-19T02:15:29.280412+0000","last_active":"2024-04-19T02:15:30.275255+0000","last_peered":"2024-04-19T02:15:30.275255+0000","last_clean":"2024-04-19T02:15:30.275255+0000","last_became_active":"2024-04-19T02:15:29.278762+0000","last_became_peered":"2024-04-19T02:15:29.278762+0000","last_unstale":"2024-04-19T02:15:30.275255+0000","last_undegraded":"2024-04-19T02:15:30.275255+0000","last_fullsized":"2024-04-19T02:15:30.275255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:45.301675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274720+0000","last_change":"2024-04-19T02:15:29.284695+0000","last_active":"2024-04-19T02:15:30.274720+0000","last_peered":"2024-04-19T02:15:30.274720+0000","last_clean":"2024-04-19T02:15:30.274720+0000","last_became_active":"2024-04-19T02:15:29.283468+0000","last_became_peered":"2024-04-19T02:15:29.283468+0000","last_unstale":"2024-04-19T02:15:30.274720+0000","last_undegraded":"2024-04-19T02:15:30.274720+0000","last_fullsized":"2024-04-19T02:15:30.274720+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.384881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752988+0000","last_change":"2024-04-19T02:15:29.286709+0000","last_active":"2024-04-19T02:15:31.752988+0000","last_peered":"2024-04-19T02:15:31.752988+0000","last_clean":"2024-04-19T02:15:31.752988+0000","last_became_active":"2024-04-19T02:15:29.286169+0000","last_became_peered":"2024-04-19T02:15:29.286169+0000","last_unstale":"2024-04-19T02:15:31.752988+0000","last_undegraded":"2024-04-19T02:15:31.752988+0000","last_fullsized":"2024-04-19T02:15:31.752988+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:58.741466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752842+0000","last_change":"2024-04-19T02:15:29.280131+0000","last_active":"2024-04-19T02:15:31.752842+0000","last_peered":"2024-04-19T02:15:31.752842+0000","last_clean":"2024-04-19T02:15:31.752842+0000","last_became_active":"2024-04-19T02:15:29.279388+0000","last_became_peered":"2024-04-19T02:15:29.279388+0000","last_unstale":"2024-04-19T02:15:31.752842+0000","last_undegraded":"2024-04-19T02:15:31.752842+0000","last_fullsized":"2024-04-19T02:15:31.752842+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:36:48.819486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274570+0000","last_change":"2024-04-19T02:15:29.279377+0000","last_active":"2024-04-19T02:15:30.274570+0000","last_peered":"2024-04-19T02:15:30.274570+0000","last_clean":"2024-04-19T02:15:30.274570+0000","last_became_active":"2024-04-19T02:15:29.278954+0000","last_became_peered":"2024-04-19T02:15:29.278954+0000","last_unstale":"2024-04-19T02:15:30.274570+0000","last_undegraded":"2024-04-19T02:15:30.274570+0000","last_fullsized":"2024-04-19T02:15:30.274570+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:34.883207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752217+0000","last_change":"2024-04-19T02:15:29.283908+0000","last_active":"2024-04-19T02:15:31.752217+0000","last_peered":"2024-04-19T02:15:31.752217+0000","last_clean":"2024-04-19T02:15:31.752217+0000","last_became_active":"2024-04-19T02:15:29.281729+0000","last_became_peered":"2024-04-19T02:15:29.281729+0000","last_unstale":"2024-04-19T02:15:31.752217+0000","last_undegraded":"2024-04-19T02:15:31.752217+0000","last_fullsized":"2024-04-19T02:15:31.752217+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:03:15.383476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752077+0000","last_change":"2024-04-19T02:15:29.281253+0000","last_active":"2024-04-19T02:15:31.752077+0000","last_peered":"2024-04-19T02:15:31.752077+0000","last_clean":"2024-04-19T02:15:31.752077+0000","last_became_active":"2024-04-19T02:15:29.279951+0000","last_became_peered":"2024-04-19T02:15:29.279951+0000","last_unstale":"2024-04-19T02:15:31.752077+0000","last_undegraded":"2024-04-19T02:15:31.752077+0000","last_fullsized":"2024-04-19T02:15:31.752077+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.751969+0000","last_change":"2024-04-19T02:15:29.283952+0000","last_active":"2024-04-19T02:15:31.751969+0000","last_peered":"2024-04-19T02:15:31.751969+0000","last_clean":"2024-04-19T02:15:31.751969+0000","last_became_active":"2024-04-19T02:15:29.282721+0000","last_became_peered":"2024-04-19T02:15:29.282721+0000","last_unstale":"2024-04-19T02:15:31.751969+0000","last_undegraded":"2024-04-19T02:15:31.751969+0000","last_fullsized":"2024-04-19T02:15:31.751969+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:45.301675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273597+0000","last_change":"2024-04-19T02:15:29.282150+0000","last_active":"2024-04-19T02:15:30.273597+0000","last_peered":"2024-04-19T02:15:30.273597+0000","last_clean":"2024-04-19T02:15:30.273597+0000","last_became_active":"2024-04-19T02:15:29.281538+0000","last_became_peered":"2024-04-19T02:15:29.281538+0000","last_unstale":"2024-04-19T02:15:30.273597+0000","last_undegraded":"2024-04-19T02:15:30.273597+0000","last_fullsized":"2024-04-19T02:15:30.273597+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274996+0000","last_change":"2024-04-19T02:15:29.284098+0000","last_active":"2024-04-19T02:15:30.274996+0000","last_peered":"2024-04-19T02:15:30.274996+0000","last_clean":"2024-04-19T02:15:30.274996+0000","last_became_active":"2024-04-19T02:15:29.282114+0000","last_became_peered":"2024-04-19T02:15:29.282114+0000","last_unstale":"2024-04-19T02:15:30.274996+0000","last_undegraded":"2024-04-19T02:15:30.274996+0000","last_fullsized":"2024-04-19T02:15:30.274996+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:16.568764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752773+0000","last_change":"2024-04-19T02:15:29.280606+0000","last_active":"2024-04-19T02:15:31.752773+0000","last_peered":"2024-04-19T02:15:31.752773+0000","last_clean":"2024-04-19T02:15:31.752773+0000","last_became_active":"2024-04-19T02:15:29.280151+0000","last_became_peered":"2024-04-19T02:15:29.280151+0000","last_unstale":"2024-04-19T02:15:31.752773+0000","last_undegraded":"2024-04-19T02:15:31.752773+0000","last_fullsized":"2024-04-19T02:15:31.752773+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:26:22.452488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274472+0000","last_change":"2024-04-19T02:15:29.283378+0000","last_active":"2024-04-19T02:15:30.274472+0000","last_peered":"2024-04-19T02:15:30.274472+0000","last_clean":"2024-04-19T02:15:30.274472+0000","last_became_active":"2024-04-19T02:15:29.281571+0000","last_became_peered":"2024-04-19T02:15:29.281571+0000","last_unstale":"2024-04-19T02:15:30.274472+0000","last_undegraded":"2024-04-19T02:15:30.274472+0000","last_fullsized":"2024-04-19T02:15:30.274472+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274373+0000","last_change":"2024-04-19T02:15:29.281811+0000","last_active":"2024-04-19T02:15:30.274373+0000","last_peered":"2024-04-19T02:15:30.274373+0000","last_clean":"2024-04-19T02:15:30.274373+0000","last_became_active":"2024-04-19T02:15:29.280700+0000","last_became_peered":"2024-04-19T02:15:29.280700+0000","last_unstale":"2024-04-19T02:15:30.274373+0000","last_undegraded":"2024-04-19T02:15:30.274373+0000","last_fullsized":"2024-04-19T02:15:30.274373+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752607+0000","last_change":"2024-04-19T02:15:29.284262+0000","last_active":"2024-04-19T02:15:31.752607+0000","last_peered":"2024-04-19T02:15:31.752607+0000","last_clean":"2024-04-19T02:15:31.752607+0000","last_became_active":"2024-04-19T02:15:29.283121+0000","last_became_peered":"2024-04-19T02:15:29.283121+0000","last_unstale":"2024-04-19T02:15:31.752607+0000","last_undegraded":"2024-04-19T02:15:31.752607+0000","last_fullsized":"2024-04-19T02:15:31.752607+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752216+0000","last_change":"2024-04-19T02:15:29.285139+0000","last_active":"2024-04-19T02:15:31.752216+0000","last_peered":"2024-04-19T02:15:31.752216+0000","last_clean":"2024-04-19T02:15:31.752216+0000","last_became_active":"2024-04-19T02:15:29.284649+0000","last_became_peered":"2024-04-19T02:15:29.284649+0000","last_unstale":"2024-04-19T02:15:31.752216+0000","last_undegraded":"2024-04-19T02:15:31.752216+0000","last_fullsized":"2024-04-19T02:15:31.752216+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752064+0000","last_change":"2024-04-19T02:15:29.283648+0000","last_active":"2024-04-19T02:15:31.752064+0000","last_peered":"2024-04-19T02:15:31.752064+0000","last_clean":"2024-04-19T02:15:31.752064+0000","last_became_active":"2024-04-19T02:15:29.281606+0000","last_became_peered":"2024-04-19T02:15:29.281606+0000","last_unstale":"2024-04-19T02:15:31.752064+0000","last_undegraded":"2024-04-19T02:15:31.752064+0000","last_fullsized":"2024-04-19T02:15:31.752064+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273606+0000","last_change":"2024-04-19T02:15:29.278673+0000","last_active":"2024-04-19T02:15:30.273606+0000","last_peered":"2024-04-19T02:15:30.273606+0000","last_clean":"2024-04-19T02:15:30.273606+0000","last_became_active":"2024-04-19T02:15:29.277699+0000","last_became_peered":"2024-04-19T02:15:29.277699+0000","last_unstale":"2024-04-19T02:15:30.273606+0000","last_undegraded":"2024-04-19T02:15:30.273606+0000","last_fullsized":"2024-04-19T02:15:30.273606+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.275113+0000","last_change":"2024-04-19T02:15:29.283341+0000","last_active":"2024-04-19T02:15:30.275113+0000","last_peered":"2024-04-19T02:15:30.275113+0000","last_clean":"2024-04-19T02:15:30.275113+0000","last_became_active":"2024-04-19T02:15:29.281591+0000","last_became_peered":"2024-04-19T02:15:29.281591+0000","last_unstale":"2024-04-19T02:15:30.275113+0000","last_undegraded":"2024-04-19T02:15:30.275113+0000","last_fullsized":"2024-04-19T02:15:30.275113+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:34.593754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273356+0000","last_change":"2024-04-19T02:15:29.282110+0000","last_active":"2024-04-19T02:15:30.273356+0000","last_peered":"2024-04-19T02:15:30.273356+0000","last_clean":"2024-04-19T02:15:30.273356+0000","last_became_active":"2024-04-19T02:15:29.281716+0000","last_became_peered":"2024-04-19T02:15:29.281716+0000","last_unstale":"2024-04-19T02:15:30.273356+0000","last_undegraded":"2024-04-19T02:15:30.273356+0000","last_fullsized":"2024-04-19T02:15:30.273356+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752789+0000","last_change":"2024-04-19T02:15:29.285237+0000","last_active":"2024-04-19T02:15:31.752789+0000","last_peered":"2024-04-19T02:15:31.752789+0000","last_clean":"2024-04-19T02:15:31.752789+0000","last_became_active":"2024-04-19T02:15:29.282790+0000","last_became_peered":"2024-04-19T02:15:29.282790+0000","last_unstale":"2024-04-19T02:15:31.752789+0000","last_undegraded":"2024-04-19T02:15:31.752789+0000","last_fullsized":"2024-04-19T02:15:31.752789+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752599+0000","last_change":"2024-04-19T02:15:29.282609+0000","last_active":"2024-04-19T02:15:31.752599+0000","last_peered":"2024-04-19T02:15:31.752599+0000","last_clean":"2024-04-19T02:15:31.752599+0000","last_became_active":"2024-04-19T02:15:29.281665+0000","last_became_peered":"2024-04-19T02:15:29.281665+0000","last_unstale":"2024-04-19T02:15:31.752599+0000","last_undegraded":"2024-04-19T02:15:31.752599+0000","last_fullsized":"2024-04-19T02:15:31.752599+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.384881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274303+0000","last_change":"2024-04-19T02:15:29.278890+0000","last_active":"2024-04-19T02:15:30.274303+0000","last_peered":"2024-04-19T02:15:30.274303+0000","last_clean":"2024-04-19T02:15:30.274303+0000","last_became_active":"2024-04-19T02:15:29.278074+0000","last_became_peered":"2024-04-19T02:15:29.278074+0000","last_unstale":"2024-04-19T02:15:30.274303+0000","last_undegraded":"2024-04-19T02:15:30.274303+0000","last_fullsized":"2024-04-19T02:15:30.274303+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:00.191179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.272977+0000","last_change":"2024-04-19T02:15:29.277109+0000","last_active":"2024-04-19T02:15:30.272977+0000","last_peered":"2024-04-19T02:15:30.272977+0000","last_clean":"2024-04-19T02:15:30.272977+0000","last_became_active":"2024-04-19T02:15:29.275417+0000","last_became_peered":"2024-04-19T02:15:29.275417+0000","last_unstale":"2024-04-19T02:15:30.272977+0000","last_undegraded":"2024-04-19T02:15:30.272977+0000","last_fullsized":"2024-04-19T02:15:30.272977+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274103+0000","last_change":"2024-04-19T02:15:29.283266+0000","last_active":"2024-04-19T02:15:30.274103+0000","last_peered":"2024-04-19T02:15:30.274103+0000","last_clean":"2024-04-19T02:15:30.274103+0000","last_became_active":"2024-04-19T02:15:29.281505+0000","last_became_peered":"2024-04-19T02:15:29.281505+0000","last_unstale":"2024-04-19T02:15:30.274103+0000","last_undegraded":"2024-04-19T02:15:30.274103+0000","last_fullsized":"2024-04-19T02:15:30.274103+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.275172+0000","last_change":"2024-04-19T02:15:29.278084+0000","last_active":"2024-04-19T02:15:30.275172+0000","last_peered":"2024-04-19T02:15:30.275172+0000","last_clean":"2024-04-19T02:15:30.275172+0000","last_became_active":"2024-04-19T02:15:29.276952+0000","last_became_peered":"2024-04-19T02:15:29.276952+0000","last_unstale":"2024-04-19T02:15:30.275172+0000","last_undegraded":"2024-04-19T02:15:30.275172+0000","last_fullsized":"2024-04-19T02:15:30.275172+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273711+0000","last_change":"2024-04-19T02:15:29.279904+0000","last_active":"2024-04-19T02:15:30.273711+0000","last_peered":"2024-04-19T02:15:30.273711+0000","last_clean":"2024-04-19T02:15:30.273711+0000","last_became_active":"2024-04-19T02:15:29.278938+0000","last_became_peered":"2024-04-19T02:15:29.278938+0000","last_unstale":"2024-04-19T02:15:30.273711+0000","last_undegraded":"2024-04-19T02:15:30.273711+0000","last_fullsized":"2024-04-19T02:15:30.273711+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752884+0000","last_change":"2024-04-19T02:15:29.287389+0000","last_active":"2024-04-19T02:15:31.752884+0000","last_peered":"2024-04-19T02:15:31.752884+0000","last_clean":"2024-04-19T02:15:31.752884+0000","last_became_active":"2024-04-19T02:15:29.286431+0000","last_became_peered":"2024-04-19T02:15:29.286431+0000","last_unstale":"2024-04-19T02:15:31.752884+0000","last_undegraded":"2024-04-19T02:15:31.752884+0000","last_fullsized":"2024-04-19T02:15:31.752884+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:58:30.117887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274282+0000","last_change":"2024-04-19T02:15:28.890403+0000","last_active":"2024-04-19T02:15:30.274282+0000","last_peered":"2024-04-19T02:15:30.274282+0000","last_clean":"2024-04-19T02:15:30.274282+0000","last_became_active":"2024-04-19T02:15:28.889780+0000","last_became_peered":"2024-04-19T02:15:28.889780+0000","last_unstale":"2024-04-19T02:15:30.274282+0000","last_undegraded":"2024-04-19T02:15:30.274282+0000","last_fullsized":"2024-04-19T02:15:30.274282+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:52:15.842316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.275112+0000","last_change":"2024-04-19T02:15:29.281792+0000","last_active":"2024-04-19T02:15:30.275112+0000","last_peered":"2024-04-19T02:15:30.275112+0000","last_clean":"2024-04-19T02:15:30.275112+0000","last_became_active":"2024-04-19T02:15:29.280479+0000","last_became_peered":"2024-04-19T02:15:29.280479+0000","last_unstale":"2024-04-19T02:15:30.275112+0000","last_undegraded":"2024-04-19T02:15:30.275112+0000","last_fullsized":"2024-04-19T02:15:30.275112+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273058+0000","last_change":"2024-04-19T02:15:28.888778+0000","last_active":"2024-04-19T02:15:30.273058+0000","last_peered":"2024-04-19T02:15:30.273058+0000","last_clean":"2024-04-19T02:15:30.273058+0000","last_became_active":"2024-04-19T02:15:28.888543+0000","last_became_peered":"2024-04-19T02:15:28.888543+0000","last_unstale":"2024-04-19T02:15:30.273058+0000","last_undegraded":"2024-04-19T02:15:30.273058+0000","last_fullsized":"2024-04-19T02:15:30.273058+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:43:51.221619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273526+0000","last_change":"2024-04-19T02:15:29.279986+0000","last_active":"2024-04-19T02:15:30.273526+0000","last_peered":"2024-04-19T02:15:30.273526+0000","last_clean":"2024-04-19T02:15:30.273526+0000","last_became_active":"2024-04-19T02:15:29.279690+0000","last_became_peered":"2024-04-19T02:15:29.279690+0000","last_unstale":"2024-04-19T02:15:30.273526+0000","last_undegraded":"2024-04-19T02:15:30.273526+0000","last_fullsized":"2024-04-19T02:15:30.273526+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.272885+0000","last_change":"2024-04-19T02:15:28.890463+0000","last_active":"2024-04-19T02:15:30.272885+0000","last_peered":"2024-04-19T02:15:30.272885+0000","last_clean":"2024-04-19T02:15:30.272885+0000","last_became_active":"2024-04-19T02:15:28.889777+0000","last_became_peered":"2024-04-19T02:15:28.889777+0000","last_unstale":"2024-04-19T02:15:30.272885+0000","last_undegraded":"2024-04-19T02:15:30.272885+0000","last_fullsized":"2024-04-19T02:15:30.272885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:58:21.520250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.275141+0000","last_change":"2024-04-19T02:15:29.280879+0000","last_active":"2024-04-19T02:15:30.275141+0000","last_peered":"2024-04-19T02:15:30.275141+0000","last_clean":"2024-04-19T02:15:30.275141+0000","last_became_active":"2024-04-19T02:15:29.279314+0000","last_became_peered":"2024-04-19T02:15:29.279314+0000","last_unstale":"2024-04-19T02:15:30.275141+0000","last_undegraded":"2024-04-19T02:15:30.275141+0000","last_fullsized":"2024-04-19T02:15:30.275141+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273829+0000","last_change":"2024-04-19T02:15:28.891867+0000","last_active":"2024-04-19T02:15:30.273829+0000","last_peered":"2024-04-19T02:15:30.273829+0000","last_clean":"2024-04-19T02:15:30.273829+0000","last_became_active":"2024-04-19T02:15:28.890806+0000","last_became_peered":"2024-04-19T02:15:28.890806+0000","last_unstale":"2024-04-19T02:15:30.273829+0000","last_undegraded":"2024-04-19T02:15:30.273829+0000","last_fullsized":"2024-04-19T02:15:30.273829+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:57.946581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.272758+0000","last_change":"2024-04-19T02:15:29.278148+0000","last_active":"2024-04-19T02:15:30.272758+0000","last_peered":"2024-04-19T02:15:30.272758+0000","last_clean":"2024-04-19T02:15:30.272758+0000","last_became_active":"2024-04-19T02:15:29.277402+0000","last_became_peered":"2024-04-19T02:15:29.277402+0000","last_unstale":"2024-04-19T02:15:30.272758+0000","last_undegraded":"2024-04-19T02:15:30.272758+0000","last_fullsized":"2024-04-19T02:15:30.272758+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752928+0000","last_change":"2024-04-19T02:15:28.892905+0000","last_active":"2024-04-19T02:15:31.752928+0000","last_peered":"2024-04-19T02:15:31.752928+0000","last_clean":"2024-04-19T02:15:31.752928+0000","last_became_active":"2024-04-19T02:15:28.892541+0000","last_became_peered":"2024-04-19T02:15:28.892541+0000","last_unstale":"2024-04-19T02:15:31.752928+0000","last_undegraded":"2024-04-19T02:15:31.752928+0000","last_fullsized":"2024-04-19T02:15:31.752928+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:33.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273109+0000","last_change":"2024-04-19T02:15:29.278810+0000","last_active":"2024-04-19T02:15:30.273109+0000","last_peered":"2024-04-19T02:15:30.273109+0000","last_clean":"2024-04-19T02:15:30.273109+0000","last_became_active":"2024-04-19T02:15:29.278093+0000","last_became_peered":"2024-04-19T02:15:29.278093+0000","last_unstale":"2024-04-19T02:15:30.273109+0000","last_undegraded":"2024-04-19T02:15:30.273109+0000","last_fullsized":"2024-04-19T02:15:30.273109+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:34.883207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274867+0000","last_change":"2024-04-19T02:15:28.892937+0000","last_active":"2024-04-19T02:15:30.274867+0000","last_peered":"2024-04-19T02:15:30.274867+0000","last_clean":"2024-04-19T02:15:30.274867+0000","last_became_active":"2024-04-19T02:15:28.891440+0000","last_became_peered":"2024-04-19T02:15:28.891440+0000","last_unstale":"2024-04-19T02:15:30.274867+0000","last_undegraded":"2024-04-19T02:15:30.274867+0000","last_fullsized":"2024-04-19T02:15:30.274867+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273027+0000","last_change":"2024-04-19T02:15:29.278404+0000","last_active":"2024-04-19T02:15:30.273027+0000","last_peered":"2024-04-19T02:15:30.273027+0000","last_clean":"2024-04-19T02:15:30.273027+0000","last_became_active":"2024-04-19T02:15:29.277460+0000","last_became_peered":"2024-04-19T02:15:29.277460+0000","last_unstale":"2024-04-19T02:15:30.273027+0000","last_undegraded":"2024-04-19T02:15:30.273027+0000","last_fullsized":"2024-04-19T02:15:30.273027+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752700+0000","last_change":"2024-04-19T02:15:28.891097+0000","last_active":"2024-04-19T02:15:31.752700+0000","last_peered":"2024-04-19T02:15:31.752700+0000","last_clean":"2024-04-19T02:15:31.752700+0000","last_became_active":"2024-04-19T02:15:28.890795+0000","last_became_peered":"2024-04-19T02:15:28.890795+0000","last_unstale":"2024-04-19T02:15:31.752700+0000","last_undegraded":"2024-04-19T02:15:31.752700+0000","last_fullsized":"2024-04-19T02:15:31.752700+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752913+0000","last_change":"2024-04-19T02:15:29.278546+0000","last_active":"2024-04-19T02:15:31.752913+0000","last_peered":"2024-04-19T02:15:31.752913+0000","last_clean":"2024-04-19T02:15:31.752913+0000","last_became_active":"2024-04-19T02:15:29.277547+0000","last_became_peered":"2024-04-19T02:15:29.277547+0000","last_unstale":"2024-04-19T02:15:31.752913+0000","last_undegraded":"2024-04-19T02:15:31.752913+0000","last_fullsized":"2024-04-19T02:15:31.752913+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752826+0000","last_change":"2024-04-19T02:15:28.892977+0000","last_active":"2024-04-19T02:15:31.752826+0000","last_peered":"2024-04-19T02:15:31.752826+0000","last_clean":"2024-04-19T02:15:31.752826+0000","last_became_active":"2024-04-19T02:15:28.892636+0000","last_became_peered":"2024-04-19T02:15:28.892636+0000","last_unstale":"2024-04-19T02:15:31.752826+0000","last_undegraded":"2024-04-19T02:15:31.752826+0000","last_fullsized":"2024-04-19T02:15:31.752826+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:43:51.221619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274651+0000","last_change":"2024-04-19T02:15:29.284260+0000","last_active":"2024-04-19T02:15:30.274651+0000","last_peered":"2024-04-19T02:15:30.274651+0000","last_clean":"2024-04-19T02:15:30.274651+0000","last_became_active":"2024-04-19T02:15:29.282990+0000","last_became_peered":"2024-04-19T02:15:29.282990+0000","last_unstale":"2024-04-19T02:15:30.274651+0000","last_undegraded":"2024-04-19T02:15:30.274651+0000","last_fullsized":"2024-04-19T02:15:30.274651+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:36:48.819486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273207+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:15:30.273207+0000","last_peered":"2024-04-19T02:15:30.273207+0000","last_clean":"2024-04-19T02:15:30.273207+0000","last_became_active":"2024-04-19T02:15:28.890751+0000","last_became_peered":"2024-04-19T02:15:28.890751+0000","last_unstale":"2024-04-19T02:15:30.273207+0000","last_undegraded":"2024-04-19T02:15:30.273207+0000","last_fullsized":"2024-04-19T02:15:30.273207+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.275108+0000","last_change":"2024-04-19T02:15:29.282068+0000","last_active":"2024-04-19T02:15:30.275108+0000","last_peered":"2024-04-19T02:15:30.275108+0000","last_clean":"2024-04-19T02:15:30.275108+0000","last_became_active":"2024-04-19T02:15:29.280450+0000","last_became_peered":"2024-04-19T02:15:29.280450+0000","last_unstale":"2024-04-19T02:15:30.275108+0000","last_undegraded":"2024-04-19T02:15:30.275108+0000","last_fullsized":"2024-04-19T02:15:30.275108+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274189+0000","last_change":"2024-04-19T02:15:28.892934+0000","last_active":"2024-04-19T02:15:30.274189+0000","last_peered":"2024-04-19T02:15:30.274189+0000","last_clean":"2024-04-19T02:15:30.274189+0000","last_became_active":"2024-04-19T02:15:28.891879+0000","last_became_peered":"2024-04-19T02:15:28.891879+0000","last_unstale":"2024-04-19T02:15:30.274189+0000","last_undegraded":"2024-04-19T02:15:30.274189+0000","last_fullsized":"2024-04-19T02:15:30.274189+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:10:12.514798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273640+0000","last_change":"2024-04-19T02:15:29.279685+0000","last_active":"2024-04-19T02:15:30.273640+0000","last_peered":"2024-04-19T02:15:30.273640+0000","last_clean":"2024-04-19T02:15:30.273640+0000","last_became_active":"2024-04-19T02:15:29.278810+0000","last_became_peered":"2024-04-19T02:15:29.278810+0000","last_unstale":"2024-04-19T02:15:30.273640+0000","last_undegraded":"2024-04-19T02:15:30.273640+0000","last_fullsized":"2024-04-19T02:15:30.273640+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752370+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:15:31.752370+0000","last_peered":"2024-04-19T02:15:31.752370+0000","last_clean":"2024-04-19T02:15:31.752370+0000","last_became_active":"2024-04-19T02:15:28.890882+0000","last_became_peered":"2024-04-19T02:15:28.890882+0000","last_unstale":"2024-04-19T02:15:31.752370+0000","last_undegraded":"2024-04-19T02:15:31.752370+0000","last_fullsized":"2024-04-19T02:15:31.752370+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:31.673938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274006+0000","last_change":"2024-04-19T02:15:29.284258+0000","last_active":"2024-04-19T02:15:30.274006+0000","last_peered":"2024-04-19T02:15:30.274006+0000","last_clean":"2024-04-19T02:15:30.274006+0000","last_became_active":"2024-04-19T02:15:29.283995+0000","last_became_peered":"2024-04-19T02:15:29.283995+0000","last_unstale":"2024-04-19T02:15:30.274006+0000","last_undegraded":"2024-04-19T02:15:30.274006+0000","last_fullsized":"2024-04-19T02:15:30.274006+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:35.941308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.753137+0000","last_change":"2024-04-19T02:15:28.890265+0000","last_active":"2024-04-19T02:15:31.753137+0000","last_peered":"2024-04-19T02:15:31.753137+0000","last_clean":"2024-04-19T02:15:31.753137+0000","last_became_active":"2024-04-19T02:15:28.890004+0000","last_became_peered":"2024-04-19T02:15:28.890004+0000","last_unstale":"2024-04-19T02:15:31.753137+0000","last_undegraded":"2024-04-19T02:15:31.753137+0000","last_fullsized":"2024-04-19T02:15:31.753137+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:02.517101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273866+0000","last_change":"2024-04-19T02:15:29.285529+0000","last_active":"2024-04-19T02:15:30.273866+0000","last_peered":"2024-04-19T02:15:30.273866+0000","last_clean":"2024-04-19T02:15:30.273866+0000","last_became_active":"2024-04-19T02:15:29.285197+0000","last_became_peered":"2024-04-19T02:15:29.285197+0000","last_unstale":"2024-04-19T02:15:30.273866+0000","last_undegraded":"2024-04-19T02:15:30.273866+0000","last_fullsized":"2024-04-19T02:15:30.273866+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274737+0000","last_change":"2024-04-19T02:15:28.893902+0000","last_active":"2024-04-19T02:15:30.274737+0000","last_peered":"2024-04-19T02:15:30.274737+0000","last_clean":"2024-04-19T02:15:30.274737+0000","last_became_active":"2024-04-19T02:15:28.893231+0000","last_became_peered":"2024-04-19T02:15:28.893231+0000","last_unstale":"2024-04-19T02:15:30.274737+0000","last_undegraded":"2024-04-19T02:15:30.274737+0000","last_fullsized":"2024-04-19T02:15:30.274737+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:23.658442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274341+0000","last_change":"2024-04-19T02:15:29.282874+0000","last_active":"2024-04-19T02:15:30.274341+0000","last_peered":"2024-04-19T02:15:30.274341+0000","last_clean":"2024-04-19T02:15:30.274341+0000","last_became_active":"2024-04-19T02:15:29.281675+0000","last_became_peered":"2024-04-19T02:15:29.281675+0000","last_unstale":"2024-04-19T02:15:30.274341+0000","last_undegraded":"2024-04-19T02:15:30.274341+0000","last_fullsized":"2024-04-19T02:15:30.274341+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:35.941308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752851+0000","last_change":"2024-04-19T02:15:28.891234+0000","last_active":"2024-04-19T02:15:31.752851+0000","last_peered":"2024-04-19T02:15:31.752851+0000","last_clean":"2024-04-19T02:15:31.752851+0000","last_became_active":"2024-04-19T02:15:28.890881+0000","last_became_peered":"2024-04-19T02:15:28.890881+0000","last_unstale":"2024-04-19T02:15:31.752851+0000","last_undegraded":"2024-04-19T02:15:31.752851+0000","last_fullsized":"2024-04-19T02:15:31.752851+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752380+0000","last_change":"2024-04-19T02:15:29.281937+0000","last_active":"2024-04-19T02:15:31.752380+0000","last_peered":"2024-04-19T02:15:31.752380+0000","last_clean":"2024-04-19T02:15:31.752380+0000","last_became_active":"2024-04-19T02:15:29.280727+0000","last_became_peered":"2024-04-19T02:15:29.280727+0000","last_unstale":"2024-04-19T02:15:31.752380+0000","last_undegraded":"2024-04-19T02:15:31.752380+0000","last_fullsized":"2024-04-19T02:15:31.752380+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752346+0000","last_change":"2024-04-19T02:15:28.892767+0000","last_active":"2024-04-19T02:15:31.752346+0000","last_peered":"2024-04-19T02:15:31.752346+0000","last_clean":"2024-04-19T02:15:31.752346+0000","last_became_active":"2024-04-19T02:15:28.892235+0000","last_became_peered":"2024-04-19T02:15:28.892235+0000","last_unstale":"2024-04-19T02:15:31.752346+0000","last_undegraded":"2024-04-19T02:15:31.752346+0000","last_fullsized":"2024-04-19T02:15:31.752346+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:37.690735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273357+0000","last_change":"2024-04-19T02:15:29.279857+0000","last_active":"2024-04-19T02:15:30.273357+0000","last_peered":"2024-04-19T02:15:30.273357+0000","last_clean":"2024-04-19T02:15:30.273357+0000","last_became_active":"2024-04-19T02:15:29.279536+0000","last_became_peered":"2024-04-19T02:15:29.279536+0000","last_unstale":"2024-04-19T02:15:30.273357+0000","last_undegraded":"2024-04-19T02:15:30.273357+0000","last_fullsized":"2024-04-19T02:15:30.273357+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:00.191179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273138+0000","last_change":"2024-04-19T02:15:28.891611+0000","last_active":"2024-04-19T02:15:30.273138+0000","last_peered":"2024-04-19T02:15:30.273138+0000","last_clean":"2024-04-19T02:15:30.273138+0000","last_became_active":"2024-04-19T02:15:28.890914+0000","last_became_peered":"2024-04-19T02:15:28.890914+0000","last_unstale":"2024-04-19T02:15:30.273138+0000","last_undegraded":"2024-04-19T02:15:30.273138+0000","last_fullsized":"2024-04-19T02:15:30.273138+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:37.690735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752522+0000","last_change":"2024-04-19T02:15:29.285774+0000","last_active":"2024-04-19T02:15:31.752522+0000","last_peered":"2024-04-19T02:15:31.752522+0000","last_clean":"2024-04-19T02:15:31.752522+0000","last_became_active":"2024-04-19T02:15:29.284705+0000","last_became_peered":"2024-04-19T02:15:29.284705+0000","last_unstale":"2024-04-19T02:15:31.752522+0000","last_undegraded":"2024-04-19T02:15:31.752522+0000","last_fullsized":"2024-04-19T02:15:31.752522+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752240+0000","last_change":"2024-04-19T02:15:28.892873+0000","last_active":"2024-04-19T02:15:31.752240+0000","last_peered":"2024-04-19T02:15:31.752240+0000","last_clean":"2024-04-19T02:15:31.752240+0000","last_became_active":"2024-04-19T02:15:28.892487+0000","last_became_peered":"2024-04-19T02:15:28.892487+0000","last_unstale":"2024-04-19T02:15:31.752240+0000","last_undegraded":"2024-04-19T02:15:31.752240+0000","last_fullsized":"2024-04-19T02:15:31.752240+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:35.412837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.753131+0000","last_change":"2024-04-19T02:15:29.285019+0000","last_active":"2024-04-19T02:15:31.753131+0000","last_peered":"2024-04-19T02:15:31.753131+0000","last_clean":"2024-04-19T02:15:31.753131+0000","last_became_active":"2024-04-19T02:15:29.284650+0000","last_became_peered":"2024-04-19T02:15:29.284650+0000","last_unstale":"2024-04-19T02:15:31.753131+0000","last_undegraded":"2024-04-19T02:15:31.753131+0000","last_fullsized":"2024-04-19T02:15:31.753131+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273991+0000","last_change":"2024-04-19T02:15:28.893245+0000","last_active":"2024-04-19T02:15:30.273991+0000","last_peered":"2024-04-19T02:15:30.273991+0000","last_clean":"2024-04-19T02:15:30.273991+0000","last_became_active":"2024-04-19T02:15:28.891932+0000","last_became_peered":"2024-04-19T02:15:28.891932+0000","last_unstale":"2024-04-19T02:15:30.273991+0000","last_undegraded":"2024-04-19T02:15:30.273991+0000","last_fullsized":"2024-04-19T02:15:30.273991+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:30.518182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.753047+0000","last_change":"2024-04-19T02:15:29.287190+0000","last_active":"2024-04-19T02:15:31.753047+0000","last_peered":"2024-04-19T02:15:31.753047+0000","last_clean":"2024-04-19T02:15:31.753047+0000","last_became_active":"2024-04-19T02:15:29.286606+0000","last_became_peered":"2024-04-19T02:15:29.286606+0000","last_unstale":"2024-04-19T02:15:31.753047+0000","last_undegraded":"2024-04-19T02:15:31.753047+0000","last_fullsized":"2024-04-19T02:15:31.753047+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:28.387062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274074+0000","last_change":"2024-04-19T02:15:28.894121+0000","last_active":"2024-04-19T02:15:30.274074+0000","last_peered":"2024-04-19T02:15:30.274074+0000","last_clean":"2024-04-19T02:15:30.274074+0000","last_became_active":"2024-04-19T02:15:28.893902+0000","last_became_peered":"2024-04-19T02:15:28.893902+0000","last_unstale":"2024-04-19T02:15:30.274074+0000","last_undegraded":"2024-04-19T02:15:30.274074+0000","last_fullsized":"2024-04-19T02:15:30.274074+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:10:35.146583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273739+0000","last_change":"2024-04-19T02:15:29.282870+0000","last_active":"2024-04-19T02:15:30.273739+0000","last_peered":"2024-04-19T02:15:30.273739+0000","last_clean":"2024-04-19T02:15:30.273739+0000","last_became_active":"2024-04-19T02:15:29.281873+0000","last_became_peered":"2024-04-19T02:15:29.281873+0000","last_unstale":"2024-04-19T02:15:30.273739+0000","last_undegraded":"2024-04-19T02:15:30.273739+0000","last_fullsized":"2024-04-19T02:15:30.273739+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.269354+0000","last_change":"2024-04-19T02:15:24.527061+0000","last_active":"2024-04-19T02:15:29.269354+0000","last_peered":"2024-04-19T02:15:29.269354+0000","last_clean":"2024-04-19T02:15:29.269354+0000","last_became_active":"2024-04-19T02:15:24.526757+0000","last_became_peered":"2024-04-19T02:15:24.526757+0000","last_unstale":"2024-04-19T02:15:29.269354+0000","last_undegraded":"2024-04-19T02:15:29.269354+0000","last_fullsized":"2024-04-19T02:15:29.269354+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:17:13.649077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.753003+0000","last_change":"2024-04-19T02:15:28.892766+0000","last_active":"2024-04-19T02:15:31.753003+0000","last_peered":"2024-04-19T02:15:31.753003+0000","last_clean":"2024-04-19T02:15:31.753003+0000","last_became_active":"2024-04-19T02:15:28.892396+0000","last_became_peered":"2024-04-19T02:15:28.892396+0000","last_unstale":"2024-04-19T02:15:31.753003+0000","last_undegraded":"2024-04-19T02:15:31.753003+0000","last_fullsized":"2024-04-19T02:15:31.753003+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:57.946581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274481+0000","last_change":"2024-04-19T02:15:29.277922+0000","last_active":"2024-04-19T02:15:30.274481+0000","last_peered":"2024-04-19T02:15:30.274481+0000","last_clean":"2024-04-19T02:15:30.274481+0000","last_became_active":"2024-04-19T02:15:29.276968+0000","last_became_peered":"2024-04-19T02:15:29.276968+0000","last_unstale":"2024-04-19T02:15:30.274481+0000","last_undegraded":"2024-04-19T02:15:30.274481+0000","last_fullsized":"2024-04-19T02:15:30.274481+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.276084+0000","last_change":"2024-04-19T02:15:24.530933+0000","last_active":"2024-04-19T02:15:29.276084+0000","last_peered":"2024-04-19T02:15:29.276084+0000","last_clean":"2024-04-19T02:15:29.276084+0000","last_became_active":"2024-04-19T02:15:24.530550+0000","last_became_peered":"2024-04-19T02:15:24.530550+0000","last_unstale":"2024-04-19T02:15:29.276084+0000","last_undegraded":"2024-04-19T02:15:29.276084+0000","last_fullsized":"2024-04-19T02:15:29.276084+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:18:15.194321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752725+0000","last_change":"2024-04-19T02:15:28.893062+0000","last_active":"2024-04-19T02:15:31.752725+0000","last_peered":"2024-04-19T02:15:31.752725+0000","last_clean":"2024-04-19T02:15:31.752725+0000","last_became_active":"2024-04-19T02:15:28.892798+0000","last_became_peered":"2024-04-19T02:15:28.892798+0000","last_unstale":"2024-04-19T02:15:31.752725+0000","last_undegraded":"2024-04-19T02:15:31.752725+0000","last_fullsized":"2024-04-19T02:15:31.752725+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:53.170180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273830+0000","last_change":"2024-04-19T02:15:29.278294+0000","last_active":"2024-04-19T02:15:30.273830+0000","last_peered":"2024-04-19T02:15:30.273830+0000","last_clean":"2024-04-19T02:15:30.273830+0000","last_became_active":"2024-04-19T02:15:29.277536+0000","last_became_peered":"2024-04-19T02:15:29.277536+0000","last_unstale":"2024-04-19T02:15:30.273830+0000","last_undegraded":"2024-04-19T02:15:30.273830+0000","last_fullsized":"2024-04-19T02:15:30.273830+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.268601+0000","last_change":"2024-04-19T02:15:24.527048+0000","last_active":"2024-04-19T02:15:29.268601+0000","last_peered":"2024-04-19T02:15:29.268601+0000","last_clean":"2024-04-19T02:15:29.268601+0000","last_became_active":"2024-04-19T02:15:24.526790+0000","last_became_peered":"2024-04-19T02:15:24.526790+0000","last_unstale":"2024-04-19T02:15:29.268601+0000","last_undegraded":"2024-04-19T02:15:29.268601+0000","last_fullsized":"2024-04-19T02:15:29.268601+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273986+0000","last_change":"2024-04-19T02:15:28.893858+0000","last_active":"2024-04-19T02:15:30.273986+0000","last_peered":"2024-04-19T02:15:30.273986+0000","last_clean":"2024-04-19T02:15:30.273986+0000","last_became_active":"2024-04-19T02:15:28.892497+0000","last_became_peered":"2024-04-19T02:15:28.892497+0000","last_unstale":"2024-04-19T02:15:30.273986+0000","last_undegraded":"2024-04-19T02:15:30.273986+0000","last_fullsized":"2024-04-19T02:15:30.273986+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:31.673938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273922+0000","last_change":"2024-04-19T02:15:29.282663+0000","last_active":"2024-04-19T02:15:30.273922+0000","last_peered":"2024-04-19T02:15:30.273922+0000","last_clean":"2024-04-19T02:15:30.273922+0000","last_became_active":"2024-04-19T02:15:29.282217+0000","last_became_peered":"2024-04-19T02:15:29.282217+0000","last_unstale":"2024-04-19T02:15:30.273922+0000","last_undegraded":"2024-04-19T02:15:30.273922+0000","last_fullsized":"2024-04-19T02:15:30.273922+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.276557+0000","last_change":"2024-04-19T02:15:24.530924+0000","last_active":"2024-04-19T02:15:29.276557+0000","last_peered":"2024-04-19T02:15:29.276557+0000","last_clean":"2024-04-19T02:15:29.276557+0000","last_became_active":"2024-04-19T02:15:24.530551+0000","last_became_peered":"2024-04-19T02:15:24.530551+0000","last_unstale":"2024-04-19T02:15:29.276557+0000","last_undegraded":"2024-04-19T02:15:29.276557+0000","last_fullsized":"2024-04-19T02:15:29.276557+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:30.576946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":210,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.275680+0000","last_change":"2024-04-19T02:15:24.533634+0000","last_active":"2024-04-19T02:15:29.275680+0000","last_peered":"2024-04-19T02:15:29.275680+0000","last_clean":"2024-04-19T02:15:29.275680+0000","last_became_active":"2024-04-19T02:15:24.533420+0000","last_became_peered":"2024-04-19T02:15:24.533420+0000","last_unstale":"2024-04-19T02:15:29.275680+0000","last_undegraded":"2024-04-19T02:15:29.275680+0000","last_fullsized":"2024-04-19T02:15:29.275680+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273047+0000","last_change":"2024-04-19T02:15:28.890244+0000","last_active":"2024-04-19T02:15:30.273047+0000","last_peered":"2024-04-19T02:15:30.273047+0000","last_clean":"2024-04-19T02:15:30.273047+0000","last_became_active":"2024-04-19T02:15:28.889831+0000","last_became_peered":"2024-04-19T02:15:28.889831+0000","last_unstale":"2024-04-19T02:15:30.273047+0000","last_undegraded":"2024-04-19T02:15:30.273047+0000","last_fullsized":"2024-04-19T02:15:30.273047+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.753121+0000","last_change":"2024-04-19T02:15:29.285015+0000","last_active":"2024-04-19T02:15:31.753121+0000","last_peered":"2024-04-19T02:15:31.753121+0000","last_clean":"2024-04-19T02:15:31.753121+0000","last_became_active":"2024-04-19T02:15:29.284164+0000","last_became_peered":"2024-04-19T02:15:29.284164+0000","last_unstale":"2024-04-19T02:15:31.753121+0000","last_undegraded":"2024-04-19T02:15:31.753121+0000","last_fullsized":"2024-04-19T02:15:31.753121+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:36.987844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.275722+0000","last_change":"2024-04-19T02:15:24.533912+0000","last_active":"2024-04-19T02:15:29.275722+0000","last_peered":"2024-04-19T02:15:29.275722+0000","last_clean":"2024-04-19T02:15:29.275722+0000","last_became_active":"2024-04-19T02:15:24.533580+0000","last_became_peered":"2024-04-19T02:15:24.533580+0000","last_unstale":"2024-04-19T02:15:29.275722+0000","last_undegraded":"2024-04-19T02:15:29.275722+0000","last_fullsized":"2024-04-19T02:15:29.275722+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:45.045477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.272710+0000","last_change":"2024-04-19T02:15:28.891889+0000","last_active":"2024-04-19T02:15:30.272710+0000","last_peered":"2024-04-19T02:15:30.272710+0000","last_clean":"2024-04-19T02:15:30.272710+0000","last_became_active":"2024-04-19T02:15:28.890919+0000","last_became_peered":"2024-04-19T02:15:28.890919+0000","last_unstale":"2024-04-19T02:15:30.272710+0000","last_undegraded":"2024-04-19T02:15:30.272710+0000","last_fullsized":"2024-04-19T02:15:30.272710+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:35.412837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.275017+0000","last_change":"2024-04-19T02:15:29.284266+0000","last_active":"2024-04-19T02:15:30.275017+0000","last_peered":"2024-04-19T02:15:30.275017+0000","last_clean":"2024-04-19T02:15:30.275017+0000","last_became_active":"2024-04-19T02:15:29.282994+0000","last_became_peered":"2024-04-19T02:15:29.282994+0000","last_unstale":"2024-04-19T02:15:30.275017+0000","last_undegraded":"2024-04-19T02:15:30.275017+0000","last_fullsized":"2024-04-19T02:15:30.275017+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.277544+0000","last_change":"2024-04-19T02:15:24.526751+0000","last_active":"2024-04-19T02:15:29.277544+0000","last_peered":"2024-04-19T02:15:29.277544+0000","last_clean":"2024-04-19T02:15:29.277544+0000","last_became_active":"2024-04-19T02:15:24.526511+0000","last_became_peered":"2024-04-19T02:15:24.526511+0000","last_unstale":"2024-04-19T02:15:29.277544+0000","last_undegraded":"2024-04-19T02:15:29.277544+0000","last_fullsized":"2024-04-19T02:15:29.277544+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:02:45.966851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273736+0000","last_change":"2024-04-19T02:15:28.892125+0000","last_active":"2024-04-19T02:15:30.273736+0000","last_peered":"2024-04-19T02:15:30.273736+0000","last_clean":"2024-04-19T02:15:30.273736+0000","last_became_active":"2024-04-19T02:15:28.891300+0000","last_became_peered":"2024-04-19T02:15:28.891300+0000","last_unstale":"2024-04-19T02:15:30.273736+0000","last_undegraded":"2024-04-19T02:15:30.273736+0000","last_fullsized":"2024-04-19T02:15:30.273736+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274547+0000","last_change":"2024-04-19T02:15:29.281694+0000","last_active":"2024-04-19T02:15:30.274547+0000","last_peered":"2024-04-19T02:15:30.274547+0000","last_clean":"2024-04-19T02:15:30.274547+0000","last_became_active":"2024-04-19T02:15:29.280519+0000","last_became_peered":"2024-04-19T02:15:29.280519+0000","last_unstale":"2024-04-19T02:15:30.274547+0000","last_undegraded":"2024-04-19T02:15:30.274547+0000","last_fullsized":"2024-04-19T02:15:30.274547+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:50.890545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273711+0000","last_change":"2024-04-19T02:15:28.891702+0000","last_active":"2024-04-19T02:15:30.273711+0000","last_peered":"2024-04-19T02:15:30.273711+0000","last_clean":"2024-04-19T02:15:30.273711+0000","last_became_active":"2024-04-19T02:15:28.890743+0000","last_became_peered":"2024-04-19T02:15:28.890743+0000","last_unstale":"2024-04-19T02:15:30.273711+0000","last_undegraded":"2024-04-19T02:15:30.273711+0000","last_fullsized":"2024-04-19T02:15:30.273711+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.269774+0000","last_change":"2024-04-19T02:15:24.526845+0000","last_active":"2024-04-19T02:15:29.269774+0000","last_peered":"2024-04-19T02:15:29.269774+0000","last_clean":"2024-04-19T02:15:29.269774+0000","last_became_active":"2024-04-19T02:15:24.526500+0000","last_became_peered":"2024-04-19T02:15:24.526500+0000","last_unstale":"2024-04-19T02:15:29.269774+0000","last_undegraded":"2024-04-19T02:15:29.269774+0000","last_fullsized":"2024-04-19T02:15:29.269774+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:16.883355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.272678+0000","last_change":"2024-04-19T02:15:29.278686+0000","last_active":"2024-04-19T02:15:30.272678+0000","last_peered":"2024-04-19T02:15:30.272678+0000","last_clean":"2024-04-19T02:15:30.272678+0000","last_became_active":"2024-04-19T02:15:29.278108+0000","last_became_peered":"2024-04-19T02:15:29.278108+0000","last_unstale":"2024-04-19T02:15:30.272678+0000","last_undegraded":"2024-04-19T02:15:30.272678+0000","last_fullsized":"2024-04-19T02:15:30.272678+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:34.593754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.277610+0000","last_change":"2024-04-19T02:15:24.533777+0000","last_active":"2024-04-19T02:15:29.277610+0000","last_peered":"2024-04-19T02:15:29.277610+0000","last_clean":"2024-04-19T02:15:29.277610+0000","last_became_active":"2024-04-19T02:15:24.533436+0000","last_became_peered":"2024-04-19T02:15:24.533436+0000","last_unstale":"2024-04-19T02:15:29.277610+0000","last_undegraded":"2024-04-19T02:15:29.277610+0000","last_fullsized":"2024-04-19T02:15:29.277610+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:53:25.922418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:32.743668+0000","last_change":"2024-04-19T02:15:28.891370+0000","last_active":"2024-04-19T02:15:32.743668+0000","last_peered":"2024-04-19T02:15:32.743668+0000","last_clean":"2024-04-19T02:15:32.743668+0000","last_became_active":"2024-04-19T02:15:28.890702+0000","last_became_peered":"2024-04-19T02:15:28.890702+0000","last_unstale":"2024-04-19T02:15:32.743668+0000","last_undegraded":"2024-04-19T02:15:32.743668+0000","last_fullsized":"2024-04-19T02:15:32.743668+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:33.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274234+0000","last_change":"2024-04-19T02:15:29.282244+0000","last_active":"2024-04-19T02:15:30.274234+0000","last_peered":"2024-04-19T02:15:30.274234+0000","last_clean":"2024-04-19T02:15:30.274234+0000","last_became_active":"2024-04-19T02:15:29.280366+0000","last_became_peered":"2024-04-19T02:15:29.280366+0000","last_unstale":"2024-04-19T02:15:30.274234+0000","last_undegraded":"2024-04-19T02:15:30.274234+0000","last_fullsized":"2024-04-19T02:15:30.274234+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274392+0000","last_change":"2024-04-19T02:15:28.893027+0000","last_active":"2024-04-19T02:15:30.274392+0000","last_peered":"2024-04-19T02:15:30.274392+0000","last_clean":"2024-04-19T02:15:30.274392+0000","last_became_active":"2024-04-19T02:15:28.892695+0000","last_became_peered":"2024-04-19T02:15:28.892695+0000","last_unstale":"2024-04-19T02:15:30.274392+0000","last_undegraded":"2024-04-19T02:15:30.274392+0000","last_fullsized":"2024-04-19T02:15:30.274392+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274805+0000","last_change":"2024-04-19T02:15:29.283155+0000","last_active":"2024-04-19T02:15:30.274805+0000","last_peered":"2024-04-19T02:15:30.274805+0000","last_clean":"2024-04-19T02:15:30.274805+0000","last_became_active":"2024-04-19T02:15:29.281407+0000","last_became_peered":"2024-04-19T02:15:29.281407+0000","last_unstale":"2024-04-19T02:15:30.274805+0000","last_undegraded":"2024-04-19T02:15:30.274805+0000","last_fullsized":"2024-04-19T02:15:30.274805+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752643+0000","last_change":"2024-04-19T02:15:28.893067+0000","last_active":"2024-04-19T02:15:31.752643+0000","last_peered":"2024-04-19T02:15:31.752643+0000","last_clean":"2024-04-19T02:15:31.752643+0000","last_became_active":"2024-04-19T02:15:28.892781+0000","last_became_peered":"2024-04-19T02:15:28.892781+0000","last_unstale":"2024-04-19T02:15:31.752643+0000","last_undegraded":"2024-04-19T02:15:31.752643+0000","last_fullsized":"2024-04-19T02:15:31.752643+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:54:15.590143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752652+0000","last_change":"2024-04-19T02:15:29.281279+0000","last_active":"2024-04-19T02:15:31.752652+0000","last_peered":"2024-04-19T02:15:31.752652+0000","last_clean":"2024-04-19T02:15:31.752652+0000","last_became_active":"2024-04-19T02:15:29.279360+0000","last_became_peered":"2024-04-19T02:15:29.279360+0000","last_unstale":"2024-04-19T02:15:31.752652+0000","last_undegraded":"2024-04-19T02:15:31.752652+0000","last_fullsized":"2024-04-19T02:15:31.752652+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274993+0000","last_change":"2024-04-19T02:15:28.893239+0000","last_active":"2024-04-19T02:15:30.274993+0000","last_peered":"2024-04-19T02:15:30.274993+0000","last_clean":"2024-04-19T02:15:30.274993+0000","last_became_active":"2024-04-19T02:15:28.892881+0000","last_became_peered":"2024-04-19T02:15:28.892881+0000","last_unstale":"2024-04-19T02:15:30.274993+0000","last_undegraded":"2024-04-19T02:15:30.274993+0000","last_fullsized":"2024-04-19T02:15:30.274993+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752362+0000","last_change":"2024-04-19T02:15:29.281652+0000","last_active":"2024-04-19T02:15:31.752362+0000","last_peered":"2024-04-19T02:15:31.752362+0000","last_clean":"2024-04-19T02:15:31.752362+0000","last_became_active":"2024-04-19T02:15:29.281175+0000","last_became_peered":"2024-04-19T02:15:29.281175+0000","last_unstale":"2024-04-19T02:15:31.752362+0000","last_undegraded":"2024-04-19T02:15:31.752362+0000","last_fullsized":"2024-04-19T02:15:31.752362+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:16.568764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273639+0000","last_change":"2024-04-19T02:15:28.892058+0000","last_active":"2024-04-19T02:15:30.273639+0000","last_peered":"2024-04-19T02:15:30.273639+0000","last_clean":"2024-04-19T02:15:30.273639+0000","last_became_active":"2024-04-19T02:15:28.890877+0000","last_became_peered":"2024-04-19T02:15:28.890877+0000","last_unstale":"2024-04-19T02:15:30.273639+0000","last_undegraded":"2024-04-19T02:15:30.273639+0000","last_fullsized":"2024-04-19T02:15:30.273639+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:53.170180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274344+0000","last_change":"2024-04-19T02:15:29.278810+0000","last_active":"2024-04-19T02:15:30.274344+0000","last_peered":"2024-04-19T02:15:30.274344+0000","last_clean":"2024-04-19T02:15:30.274344+0000","last_became_active":"2024-04-19T02:15:29.277913+0000","last_became_peered":"2024-04-19T02:15:29.277913+0000","last_unstale":"2024-04-19T02:15:30.274344+0000","last_undegraded":"2024-04-19T02:15:30.274344+0000","last_fullsized":"2024-04-19T02:15:30.274344+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:24.082666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273821+0000","last_change":"2024-04-19T02:15:28.889132+0000","last_active":"2024-04-19T02:15:30.273821+0000","last_peered":"2024-04-19T02:15:30.273821+0000","last_clean":"2024-04-19T02:15:30.273821+0000","last_became_active":"2024-04-19T02:15:28.888926+0000","last_became_peered":"2024-04-19T02:15:28.888926+0000","last_unstale":"2024-04-19T02:15:30.273821+0000","last_undegraded":"2024-04-19T02:15:30.273821+0000","last_fullsized":"2024-04-19T02:15:30.273821+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752370+0000","last_change":"2024-04-19T02:15:29.282776+0000","last_active":"2024-04-19T02:15:31.752370+0000","last_peered":"2024-04-19T02:15:31.752370+0000","last_clean":"2024-04-19T02:15:31.752370+0000","last_became_active":"2024-04-19T02:15:29.279382+0000","last_became_peered":"2024-04-19T02:15:29.279382+0000","last_unstale":"2024-04-19T02:15:31.752370+0000","last_undegraded":"2024-04-19T02:15:31.752370+0000","last_fullsized":"2024-04-19T02:15:31.752370+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752208+0000","last_change":"2024-04-19T02:15:29.283537+0000","last_active":"2024-04-19T02:15:31.752208+0000","last_peered":"2024-04-19T02:15:31.752208+0000","last_clean":"2024-04-19T02:15:31.752208+0000","last_became_active":"2024-04-19T02:15:29.281801+0000","last_became_peered":"2024-04-19T02:15:29.281801+0000","last_unstale":"2024-04-19T02:15:31.752208+0000","last_undegraded":"2024-04-19T02:15:31.752208+0000","last_fullsized":"2024-04-19T02:15:31.752208+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.272816+0000","last_change":"2024-04-19T02:15:29.281560+0000","last_active":"2024-04-19T02:15:30.272816+0000","last_peered":"2024-04-19T02:15:30.272816+0000","last_clean":"2024-04-19T02:15:30.272816+0000","last_became_active":"2024-04-19T02:15:29.281261+0000","last_became_peered":"2024-04-19T02:15:29.281261+0000","last_unstale":"2024-04-19T02:15:30.272816+0000","last_undegraded":"2024-04-19T02:15:30.272816+0000","last_fullsized":"2024-04-19T02:15:30.272816+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274549+0000","last_change":"2024-04-19T02:15:29.280731+0000","last_active":"2024-04-19T02:15:30.274549+0000","last_peered":"2024-04-19T02:15:30.274549+0000","last_clean":"2024-04-19T02:15:30.274549+0000","last_became_active":"2024-04-19T02:15:29.280340+0000","last_became_peered":"2024-04-19T02:15:29.280340+0000","last_unstale":"2024-04-19T02:15:30.274549+0000","last_undegraded":"2024-04-19T02:15:30.274549+0000","last_fullsized":"2024-04-19T02:15:30.274549+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273481+0000","last_change":"2024-04-19T02:15:29.278702+0000","last_active":"2024-04-19T02:15:30.273481+0000","last_peered":"2024-04-19T02:15:30.273481+0000","last_clean":"2024-04-19T02:15:30.273481+0000","last_became_active":"2024-04-19T02:15:29.277756+0000","last_became_peered":"2024-04-19T02:15:29.277756+0000","last_unstale":"2024-04-19T02:15:30.273481+0000","last_undegraded":"2024-04-19T02:15:30.273481+0000","last_fullsized":"2024-04-19T02:15:30.273481+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274899+0000","last_change":"2024-04-19T02:15:29.277568+0000","last_active":"2024-04-19T02:15:30.274899+0000","last_peered":"2024-04-19T02:15:30.274899+0000","last_clean":"2024-04-19T02:15:30.274899+0000","last_became_active":"2024-04-19T02:15:29.276725+0000","last_became_peered":"2024-04-19T02:15:29.276725+0000","last_unstale":"2024-04-19T02:15:30.274899+0000","last_undegraded":"2024-04-19T02:15:30.274899+0000","last_fullsized":"2024-04-19T02:15:30.274899+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":139264,"data_stored":46663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31856,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":757760,"data_stored":638777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":749568,"data_stored":638161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:15:42.993 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:15:43.358 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:15:43.360 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-04-19T02:15:43.370 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-19T02:15:42.740587+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":86784,"kb_used_data":1608,"kb_used_omap":4,"kb_used_meta":85115,"kb_avail":283028736,"statfs":{"total":289910292480,"available":289821425664,"internally_reserved":0,"allocated":1646592,"data_stored":1323601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":87158098},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002800"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.275255+0000","last_change":"2024-04-19T02:15:29.280412+0000","last_active":"2024-04-19T02:15:30.275255+0000","last_peered":"2024-04-19T02:15:30.275255+0000","last_clean":"2024-04-19T02:15:30.275255+0000","last_became_active":"2024-04-19T02:15:29.278762+0000","last_became_peered":"2024-04-19T02:15:29.278762+0000","last_unstale":"2024-04-19T02:15:30.275255+0000","last_undegraded":"2024-04-19T02:15:30.275255+0000","last_fullsized":"2024-04-19T02:15:30.275255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:45.301675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274720+0000","last_change":"2024-04-19T02:15:29.284695+0000","last_active":"2024-04-19T02:15:30.274720+0000","last_peered":"2024-04-19T02:15:30.274720+0000","last_clean":"2024-04-19T02:15:30.274720+0000","last_became_active":"2024-04-19T02:15:29.283468+0000","last_became_peered":"2024-04-19T02:15:29.283468+0000","last_unstale":"2024-04-19T02:15:30.274720+0000","last_undegraded":"2024-04-19T02:15:30.274720+0000","last_fullsized":"2024-04-19T02:15:30.274720+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.384881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752988+0000","last_change":"2024-04-19T02:15:29.286709+0000","last_active":"2024-04-19T02:15:31.752988+0000","last_peered":"2024-04-19T02:15:31.752988+0000","last_clean":"2024-04-19T02:15:31.752988+0000","last_became_active":"2024-04-19T02:15:29.286169+0000","last_became_peered":"2024-04-19T02:15:29.286169+0000","last_unstale":"2024-04-19T02:15:31.752988+0000","last_undegraded":"2024-04-19T02:15:31.752988+0000","last_fullsized":"2024-04-19T02:15:31.752988+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:58.741466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752842+0000","last_change":"2024-04-19T02:15:29.280131+0000","last_active":"2024-04-19T02:15:31.752842+0000","last_peered":"2024-04-19T02:15:31.752842+0000","last_clean":"2024-04-19T02:15:31.752842+0000","last_became_active":"2024-04-19T02:15:29.279388+0000","last_became_peered":"2024-04-19T02:15:29.279388+0000","last_unstale":"2024-04-19T02:15:31.752842+0000","last_undegraded":"2024-04-19T02:15:31.752842+0000","last_fullsized":"2024-04-19T02:15:31.752842+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:36:48.819486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274570+0000","last_change":"2024-04-19T02:15:29.279377+0000","last_active":"2024-04-19T02:15:30.274570+0000","last_peered":"2024-04-19T02:15:30.274570+0000","last_clean":"2024-04-19T02:15:30.274570+0000","last_became_active":"2024-04-19T02:15:29.278954+0000","last_became_peered":"2024-04-19T02:15:29.278954+0000","last_unstale":"2024-04-19T02:15:30.274570+0000","last_undegraded":"2024-04-19T02:15:30.274570+0000","last_fullsized":"2024-04-19T02:15:30.274570+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:34.883207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752217+0000","last_change":"2024-04-19T02:15:29.283908+0000","last_active":"2024-04-19T02:15:31.752217+0000","last_peered":"2024-04-19T02:15:31.752217+0000","last_clean":"2024-04-19T02:15:31.752217+0000","last_became_active":"2024-04-19T02:15:29.281729+0000","last_became_peered":"2024-04-19T02:15:29.281729+0000","last_unstale":"2024-04-19T02:15:31.752217+0000","last_undegraded":"2024-04-19T02:15:31.752217+0000","last_fullsized":"2024-04-19T02:15:31.752217+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:03:15.383476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752077+0000","last_change":"2024-04-19T02:15:29.281253+0000","last_active":"2024-04-19T02:15:31.752077+0000","last_peered":"2024-04-19T02:15:31.752077+0000","last_clean":"2024-04-19T02:15:31.752077+0000","last_became_active":"2024-04-19T02:15:29.279951+0000","last_became_peered":"2024-04-19T02:15:29.279951+0000","last_unstale":"2024-04-19T02:15:31.752077+0000","last_undegraded":"2024-04-19T02:15:31.752077+0000","last_fullsized":"2024-04-19T02:15:31.752077+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.751969+0000","last_change":"2024-04-19T02:15:29.283952+0000","last_active":"2024-04-19T02:15:31.751969+0000","last_peered":"2024-04-19T02:15:31.751969+0000","last_clean":"2024-04-19T02:15:31.751969+0000","last_became_active":"2024-04-19T02:15:29.282721+0000","last_became_peered":"2024-04-19T02:15:29.282721+0000","last_unstale":"2024-04-19T02:15:31.751969+0000","last_undegraded":"2024-04-19T02:15:31.751969+0000","last_fullsized":"2024-04-19T02:15:31.751969+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:45.301675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273597+0000","last_change":"2024-04-19T02:15:29.282150+0000","last_active":"2024-04-19T02:15:30.273597+0000","last_peered":"2024-04-19T02:15:30.273597+0000","last_clean":"2024-04-19T02:15:30.273597+0000","last_became_active":"2024-04-19T02:15:29.281538+0000","last_became_peered":"2024-04-19T02:15:29.281538+0000","last_unstale":"2024-04-19T02:15:30.273597+0000","last_undegraded":"2024-04-19T02:15:30.273597+0000","last_fullsized":"2024-04-19T02:15:30.273597+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274996+0000","last_change":"2024-04-19T02:15:29.284098+0000","last_active":"2024-04-19T02:15:30.274996+0000","last_peered":"2024-04-19T02:15:30.274996+0000","last_clean":"2024-04-19T02:15:30.274996+0000","last_became_active":"2024-04-19T02:15:29.282114+0000","last_became_peered":"2024-04-19T02:15:29.282114+0000","last_unstale":"2024-04-19T02:15:30.274996+0000","last_undegraded":"2024-04-19T02:15:30.274996+0000","last_fullsized":"2024-04-19T02:15:30.274996+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:16.568764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752773+0000","last_change":"2024-04-19T02:15:29.280606+0000","last_active":"2024-04-19T02:15:31.752773+0000","last_peered":"2024-04-19T02:15:31.752773+0000","last_clean":"2024-04-19T02:15:31.752773+0000","last_became_active":"2024-04-19T02:15:29.280151+0000","last_became_peered":"2024-04-19T02:15:29.280151+0000","last_unstale":"2024-04-19T02:15:31.752773+0000","last_undegraded":"2024-04-19T02:15:31.752773+0000","last_fullsized":"2024-04-19T02:15:31.752773+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:26:22.452488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274472+0000","last_change":"2024-04-19T02:15:29.283378+0000","last_active":"2024-04-19T02:15:30.274472+0000","last_peered":"2024-04-19T02:15:30.274472+0000","last_clean":"2024-04-19T02:15:30.274472+0000","last_became_active":"2024-04-19T02:15:29.281571+0000","last_became_peered":"2024-04-19T02:15:29.281571+0000","last_unstale":"2024-04-19T02:15:30.274472+0000","last_undegraded":"2024-04-19T02:15:30.274472+0000","last_fullsized":"2024-04-19T02:15:30.274472+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274373+0000","last_change":"2024-04-19T02:15:29.281811+0000","last_active":"2024-04-19T02:15:30.274373+0000","last_peered":"2024-04-19T02:15:30.274373+0000","last_clean":"2024-04-19T02:15:30.274373+0000","last_became_active":"2024-04-19T02:15:29.280700+0000","last_became_peered":"2024-04-19T02:15:29.280700+0000","last_unstale":"2024-04-19T02:15:30.274373+0000","last_undegraded":"2024-04-19T02:15:30.274373+0000","last_fullsized":"2024-04-19T02:15:30.274373+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752607+0000","last_change":"2024-04-19T02:15:29.284262+0000","last_active":"2024-04-19T02:15:31.752607+0000","last_peered":"2024-04-19T02:15:31.752607+0000","last_clean":"2024-04-19T02:15:31.752607+0000","last_became_active":"2024-04-19T02:15:29.283121+0000","last_became_peered":"2024-04-19T02:15:29.283121+0000","last_unstale":"2024-04-19T02:15:31.752607+0000","last_undegraded":"2024-04-19T02:15:31.752607+0000","last_fullsized":"2024-04-19T02:15:31.752607+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752216+0000","last_change":"2024-04-19T02:15:29.285139+0000","last_active":"2024-04-19T02:15:31.752216+0000","last_peered":"2024-04-19T02:15:31.752216+0000","last_clean":"2024-04-19T02:15:31.752216+0000","last_became_active":"2024-04-19T02:15:29.284649+0000","last_became_peered":"2024-04-19T02:15:29.284649+0000","last_unstale":"2024-04-19T02:15:31.752216+0000","last_undegraded":"2024-04-19T02:15:31.752216+0000","last_fullsized":"2024-04-19T02:15:31.752216+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752064+0000","last_change":"2024-04-19T02:15:29.283648+0000","last_active":"2024-04-19T02:15:31.752064+0000","last_peered":"2024-04-19T02:15:31.752064+0000","last_clean":"2024-04-19T02:15:31.752064+0000","last_became_active":"2024-04-19T02:15:29.281606+0000","last_became_peered":"2024-04-19T02:15:29.281606+0000","last_unstale":"2024-04-19T02:15:31.752064+0000","last_undegraded":"2024-04-19T02:15:31.752064+0000","last_fullsized":"2024-04-19T02:15:31.752064+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273606+0000","last_change":"2024-04-19T02:15:29.278673+0000","last_active":"2024-04-19T02:15:30.273606+0000","last_peered":"2024-04-19T02:15:30.273606+0000","last_clean":"2024-04-19T02:15:30.273606+0000","last_became_active":"2024-04-19T02:15:29.277699+0000","last_became_peered":"2024-04-19T02:15:29.277699+0000","last_unstale":"2024-04-19T02:15:30.273606+0000","last_undegraded":"2024-04-19T02:15:30.273606+0000","last_fullsized":"2024-04-19T02:15:30.273606+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.275113+0000","last_change":"2024-04-19T02:15:29.283341+0000","last_active":"2024-04-19T02:15:30.275113+0000","last_peered":"2024-04-19T02:15:30.275113+0000","last_clean":"2024-04-19T02:15:30.275113+0000","last_became_active":"2024-04-19T02:15:29.281591+0000","last_became_peered":"2024-04-19T02:15:29.281591+0000","last_unstale":"2024-04-19T02:15:30.275113+0000","last_undegraded":"2024-04-19T02:15:30.275113+0000","last_fullsized":"2024-04-19T02:15:30.275113+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:34.593754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273356+0000","last_change":"2024-04-19T02:15:29.282110+0000","last_active":"2024-04-19T02:15:30.273356+0000","last_peered":"2024-04-19T02:15:30.273356+0000","last_clean":"2024-04-19T02:15:30.273356+0000","last_became_active":"2024-04-19T02:15:29.281716+0000","last_became_peered":"2024-04-19T02:15:29.281716+0000","last_unstale":"2024-04-19T02:15:30.273356+0000","last_undegraded":"2024-04-19T02:15:30.273356+0000","last_fullsized":"2024-04-19T02:15:30.273356+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752789+0000","last_change":"2024-04-19T02:15:29.285237+0000","last_active":"2024-04-19T02:15:31.752789+0000","last_peered":"2024-04-19T02:15:31.752789+0000","last_clean":"2024-04-19T02:15:31.752789+0000","last_became_active":"2024-04-19T02:15:29.282790+0000","last_became_peered":"2024-04-19T02:15:29.282790+0000","last_unstale":"2024-04-19T02:15:31.752789+0000","last_undegraded":"2024-04-19T02:15:31.752789+0000","last_fullsized":"2024-04-19T02:15:31.752789+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752599+0000","last_change":"2024-04-19T02:15:29.282609+0000","last_active":"2024-04-19T02:15:31.752599+0000","last_peered":"2024-04-19T02:15:31.752599+0000","last_clean":"2024-04-19T02:15:31.752599+0000","last_became_active":"2024-04-19T02:15:29.281665+0000","last_became_peered":"2024-04-19T02:15:29.281665+0000","last_unstale":"2024-04-19T02:15:31.752599+0000","last_undegraded":"2024-04-19T02:15:31.752599+0000","last_fullsized":"2024-04-19T02:15:31.752599+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.384881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274303+0000","last_change":"2024-04-19T02:15:29.278890+0000","last_active":"2024-04-19T02:15:30.274303+0000","last_peered":"2024-04-19T02:15:30.274303+0000","last_clean":"2024-04-19T02:15:30.274303+0000","last_became_active":"2024-04-19T02:15:29.278074+0000","last_became_peered":"2024-04-19T02:15:29.278074+0000","last_unstale":"2024-04-19T02:15:30.274303+0000","last_undegraded":"2024-04-19T02:15:30.274303+0000","last_fullsized":"2024-04-19T02:15:30.274303+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:00.191179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.272977+0000","last_change":"2024-04-19T02:15:29.277109+0000","last_active":"2024-04-19T02:15:30.272977+0000","last_peered":"2024-04-19T02:15:30.272977+0000","last_clean":"2024-04-19T02:15:30.272977+0000","last_became_active":"2024-04-19T02:15:29.275417+0000","last_became_peered":"2024-04-19T02:15:29.275417+0000","last_unstale":"2024-04-19T02:15:30.272977+0000","last_undegraded":"2024-04-19T02:15:30.272977+0000","last_fullsized":"2024-04-19T02:15:30.272977+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274103+0000","last_change":"2024-04-19T02:15:29.283266+0000","last_active":"2024-04-19T02:15:30.274103+0000","last_peered":"2024-04-19T02:15:30.274103+0000","last_clean":"2024-04-19T02:15:30.274103+0000","last_became_active":"2024-04-19T02:15:29.281505+0000","last_became_peered":"2024-04-19T02:15:29.281505+0000","last_unstale":"2024-04-19T02:15:30.274103+0000","last_undegraded":"2024-04-19T02:15:30.274103+0000","last_fullsized":"2024-04-19T02:15:30.274103+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.275172+0000","last_change":"2024-04-19T02:15:29.278084+0000","last_active":"2024-04-19T02:15:30.275172+0000","last_peered":"2024-04-19T02:15:30.275172+0000","last_clean":"2024-04-19T02:15:30.275172+0000","last_became_active":"2024-04-19T02:15:29.276952+0000","last_became_peered":"2024-04-19T02:15:29.276952+0000","last_unstale":"2024-04-19T02:15:30.275172+0000","last_undegraded":"2024-04-19T02:15:30.275172+0000","last_fullsized":"2024-04-19T02:15:30.275172+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273711+0000","last_change":"2024-04-19T02:15:29.279904+0000","last_active":"2024-04-19T02:15:30.273711+0000","last_peered":"2024-04-19T02:15:30.273711+0000","last_clean":"2024-04-19T02:15:30.273711+0000","last_became_active":"2024-04-19T02:15:29.278938+0000","last_became_peered":"2024-04-19T02:15:29.278938+0000","last_unstale":"2024-04-19T02:15:30.273711+0000","last_undegraded":"2024-04-19T02:15:30.273711+0000","last_fullsized":"2024-04-19T02:15:30.273711+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752884+0000","last_change":"2024-04-19T02:15:29.287389+0000","last_active":"2024-04-19T02:15:31.752884+0000","last_peered":"2024-04-19T02:15:31.752884+0000","last_clean":"2024-04-19T02:15:31.752884+0000","last_became_active":"2024-04-19T02:15:29.286431+0000","last_became_peered":"2024-04-19T02:15:29.286431+0000","last_unstale":"2024-04-19T02:15:31.752884+0000","last_undegraded":"2024-04-19T02:15:31.752884+0000","last_fullsized":"2024-04-19T02:15:31.752884+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:58:30.117887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274282+0000","last_change":"2024-04-19T02:15:28.890403+0000","last_active":"2024-04-19T02:15:30.274282+0000","last_peered":"2024-04-19T02:15:30.274282+0000","last_clean":"2024-04-19T02:15:30.274282+0000","last_became_active":"2024-04-19T02:15:28.889780+0000","last_became_peered":"2024-04-19T02:15:28.889780+0000","last_unstale":"2024-04-19T02:15:30.274282+0000","last_undegraded":"2024-04-19T02:15:30.274282+0000","last_fullsized":"2024-04-19T02:15:30.274282+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:52:15.842316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.275112+0000","last_change":"2024-04-19T02:15:29.281792+0000","last_active":"2024-04-19T02:15:30.275112+0000","last_peered":"2024-04-19T02:15:30.275112+0000","last_clean":"2024-04-19T02:15:30.275112+0000","last_became_active":"2024-04-19T02:15:29.280479+0000","last_became_peered":"2024-04-19T02:15:29.280479+0000","last_unstale":"2024-04-19T02:15:30.275112+0000","last_undegraded":"2024-04-19T02:15:30.275112+0000","last_fullsized":"2024-04-19T02:15:30.275112+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273058+0000","last_change":"2024-04-19T02:15:28.888778+0000","last_active":"2024-04-19T02:15:30.273058+0000","last_peered":"2024-04-19T02:15:30.273058+0000","last_clean":"2024-04-19T02:15:30.273058+0000","last_became_active":"2024-04-19T02:15:28.888543+0000","last_became_peered":"2024-04-19T02:15:28.888543+0000","last_unstale":"2024-04-19T02:15:30.273058+0000","last_undegraded":"2024-04-19T02:15:30.273058+0000","last_fullsized":"2024-04-19T02:15:30.273058+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:43:51.221619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273526+0000","last_change":"2024-04-19T02:15:29.279986+0000","last_active":"2024-04-19T02:15:30.273526+0000","last_peered":"2024-04-19T02:15:30.273526+0000","last_clean":"2024-04-19T02:15:30.273526+0000","last_became_active":"2024-04-19T02:15:29.279690+0000","last_became_peered":"2024-04-19T02:15:29.279690+0000","last_unstale":"2024-04-19T02:15:30.273526+0000","last_undegraded":"2024-04-19T02:15:30.273526+0000","last_fullsized":"2024-04-19T02:15:30.273526+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.272885+0000","last_change":"2024-04-19T02:15:28.890463+0000","last_active":"2024-04-19T02:15:30.272885+0000","last_peered":"2024-04-19T02:15:30.272885+0000","last_clean":"2024-04-19T02:15:30.272885+0000","last_became_active":"2024-04-19T02:15:28.889777+0000","last_became_peered":"2024-04-19T02:15:28.889777+0000","last_unstale":"2024-04-19T02:15:30.272885+0000","last_undegraded":"2024-04-19T02:15:30.272885+0000","last_fullsized":"2024-04-19T02:15:30.272885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:58:21.520250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.275141+0000","last_change":"2024-04-19T02:15:29.280879+0000","last_active":"2024-04-19T02:15:30.275141+0000","last_peered":"2024-04-19T02:15:30.275141+0000","last_clean":"2024-04-19T02:15:30.275141+0000","last_became_active":"2024-04-19T02:15:29.279314+0000","last_became_peered":"2024-04-19T02:15:29.279314+0000","last_unstale":"2024-04-19T02:15:30.275141+0000","last_undegraded":"2024-04-19T02:15:30.275141+0000","last_fullsized":"2024-04-19T02:15:30.275141+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273829+0000","last_change":"2024-04-19T02:15:28.891867+0000","last_active":"2024-04-19T02:15:30.273829+0000","last_peered":"2024-04-19T02:15:30.273829+0000","last_clean":"2024-04-19T02:15:30.273829+0000","last_became_active":"2024-04-19T02:15:28.890806+0000","last_became_peered":"2024-04-19T02:15:28.890806+0000","last_unstale":"2024-04-19T02:15:30.273829+0000","last_undegraded":"2024-04-19T02:15:30.273829+0000","last_fullsized":"2024-04-19T02:15:30.273829+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:57.946581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.272758+0000","last_change":"2024-04-19T02:15:29.278148+0000","last_active":"2024-04-19T02:15:30.272758+0000","last_peered":"2024-04-19T02:15:30.272758+0000","last_clean":"2024-04-19T02:15:30.272758+0000","last_became_active":"2024-04-19T02:15:29.277402+0000","last_became_peered":"2024-04-19T02:15:29.277402+0000","last_unstale":"2024-04-19T02:15:30.272758+0000","last_undegraded":"2024-04-19T02:15:30.272758+0000","last_fullsized":"2024-04-19T02:15:30.272758+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752928+0000","last_change":"2024-04-19T02:15:28.892905+0000","last_active":"2024-04-19T02:15:31.752928+0000","last_peered":"2024-04-19T02:15:31.752928+0000","last_clean":"2024-04-19T02:15:31.752928+0000","last_became_active":"2024-04-19T02:15:28.892541+0000","last_became_peered":"2024-04-19T02:15:28.892541+0000","last_unstale":"2024-04-19T02:15:31.752928+0000","last_undegraded":"2024-04-19T02:15:31.752928+0000","last_fullsized":"2024-04-19T02:15:31.752928+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:33.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273109+0000","last_change":"2024-04-19T02:15:29.278810+0000","last_active":"2024-04-19T02:15:30.273109+0000","last_peered":"2024-04-19T02:15:30.273109+0000","last_clean":"2024-04-19T02:15:30.273109+0000","last_became_active":"2024-04-19T02:15:29.278093+0000","last_became_peered":"2024-04-19T02:15:29.278093+0000","last_unstale":"2024-04-19T02:15:30.273109+0000","last_undegraded":"2024-04-19T02:15:30.273109+0000","last_fullsized":"2024-04-19T02:15:30.273109+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:34.883207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274867+0000","last_change":"2024-04-19T02:15:28.892937+0000","last_active":"2024-04-19T02:15:30.274867+0000","last_peered":"2024-04-19T02:15:30.274867+0000","last_clean":"2024-04-19T02:15:30.274867+0000","last_became_active":"2024-04-19T02:15:28.891440+0000","last_became_peered":"2024-04-19T02:15:28.891440+0000","last_unstale":"2024-04-19T02:15:30.274867+0000","last_undegraded":"2024-04-19T02:15:30.274867+0000","last_fullsized":"2024-04-19T02:15:30.274867+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273027+0000","last_change":"2024-04-19T02:15:29.278404+0000","last_active":"2024-04-19T02:15:30.273027+0000","last_peered":"2024-04-19T02:15:30.273027+0000","last_clean":"2024-04-19T02:15:30.273027+0000","last_became_active":"2024-04-19T02:15:29.277460+0000","last_became_peered":"2024-04-19T02:15:29.277460+0000","last_unstale":"2024-04-19T02:15:30.273027+0000","last_undegraded":"2024-04-19T02:15:30.273027+0000","last_fullsized":"2024-04-19T02:15:30.273027+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752700+0000","last_change":"2024-04-19T02:15:28.891097+0000","last_active":"2024-04-19T02:15:31.752700+0000","last_peered":"2024-04-19T02:15:31.752700+0000","last_clean":"2024-04-19T02:15:31.752700+0000","last_became_active":"2024-04-19T02:15:28.890795+0000","last_became_peered":"2024-04-19T02:15:28.890795+0000","last_unstale":"2024-04-19T02:15:31.752700+0000","last_undegraded":"2024-04-19T02:15:31.752700+0000","last_fullsized":"2024-04-19T02:15:31.752700+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752913+0000","last_change":"2024-04-19T02:15:29.278546+0000","last_active":"2024-04-19T02:15:31.752913+0000","last_peered":"2024-04-19T02:15:31.752913+0000","last_clean":"2024-04-19T02:15:31.752913+0000","last_became_active":"2024-04-19T02:15:29.277547+0000","last_became_peered":"2024-04-19T02:15:29.277547+0000","last_unstale":"2024-04-19T02:15:31.752913+0000","last_undegraded":"2024-04-19T02:15:31.752913+0000","last_fullsized":"2024-04-19T02:15:31.752913+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752826+0000","last_change":"2024-04-19T02:15:28.892977+0000","last_active":"2024-04-19T02:15:31.752826+0000","last_peered":"2024-04-19T02:15:31.752826+0000","last_clean":"2024-04-19T02:15:31.752826+0000","last_became_active":"2024-04-19T02:15:28.892636+0000","last_became_peered":"2024-04-19T02:15:28.892636+0000","last_unstale":"2024-04-19T02:15:31.752826+0000","last_undegraded":"2024-04-19T02:15:31.752826+0000","last_fullsized":"2024-04-19T02:15:31.752826+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:43:51.221619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274651+0000","last_change":"2024-04-19T02:15:29.284260+0000","last_active":"2024-04-19T02:15:30.274651+0000","last_peered":"2024-04-19T02:15:30.274651+0000","last_clean":"2024-04-19T02:15:30.274651+0000","last_became_active":"2024-04-19T02:15:29.282990+0000","last_became_peered":"2024-04-19T02:15:29.282990+0000","last_unstale":"2024-04-19T02:15:30.274651+0000","last_undegraded":"2024-04-19T02:15:30.274651+0000","last_fullsized":"2024-04-19T02:15:30.274651+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:36:48.819486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273207+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:15:30.273207+0000","last_peered":"2024-04-19T02:15:30.273207+0000","last_clean":"2024-04-19T02:15:30.273207+0000","last_became_active":"2024-04-19T02:15:28.890751+0000","last_became_peered":"2024-04-19T02:15:28.890751+0000","last_unstale":"2024-04-19T02:15:30.273207+0000","last_undegraded":"2024-04-19T02:15:30.273207+0000","last_fullsized":"2024-04-19T02:15:30.273207+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.275108+0000","last_change":"2024-04-19T02:15:29.282068+0000","last_active":"2024-04-19T02:15:30.275108+0000","last_peered":"2024-04-19T02:15:30.275108+0000","last_clean":"2024-04-19T02:15:30.275108+0000","last_became_active":"2024-04-19T02:15:29.280450+0000","last_became_peered":"2024-04-19T02:15:29.280450+0000","last_unstale":"2024-04-19T02:15:30.275108+0000","last_undegraded":"2024-04-19T02:15:30.275108+0000","last_fullsized":"2024-04-19T02:15:30.275108+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274189+0000","last_change":"2024-04-19T02:15:28.892934+0000","last_active":"2024-04-19T02:15:30.274189+0000","last_peered":"2024-04-19T02:15:30.274189+0000","last_clean":"2024-04-19T02:15:30.274189+0000","last_became_active":"2024-04-19T02:15:28.891879+0000","last_became_peered":"2024-04-19T02:15:28.891879+0000","last_unstale":"2024-04-19T02:15:30.274189+0000","last_undegraded":"2024-04-19T02:15:30.274189+0000","last_fullsized":"2024-04-19T02:15:30.274189+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:10:12.514798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273640+0000","last_change":"2024-04-19T02:15:29.279685+0000","last_active":"2024-04-19T02:15:30.273640+0000","last_peered":"2024-04-19T02:15:30.273640+0000","last_clean":"2024-04-19T02:15:30.273640+0000","last_became_active":"2024-04-19T02:15:29.278810+0000","last_became_peered":"2024-04-19T02:15:29.278810+0000","last_unstale":"2024-04-19T02:15:30.273640+0000","last_undegraded":"2024-04-19T02:15:30.273640+0000","last_fullsized":"2024-04-19T02:15:30.273640+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752370+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:15:31.752370+0000","last_peered":"2024-04-19T02:15:31.752370+0000","last_clean":"2024-04-19T02:15:31.752370+0000","last_became_active":"2024-04-19T02:15:28.890882+0000","last_became_peered":"2024-04-19T02:15:28.890882+0000","last_unstale":"2024-04-19T02:15:31.752370+0000","last_undegraded":"2024-04-19T02:15:31.752370+0000","last_fullsized":"2024-04-19T02:15:31.752370+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:31.673938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274006+0000","last_change":"2024-04-19T02:15:29.284258+0000","last_active":"2024-04-19T02:15:30.274006+0000","last_peered":"2024-04-19T02:15:30.274006+0000","last_clean":"2024-04-19T02:15:30.274006+0000","last_became_active":"2024-04-19T02:15:29.283995+0000","last_became_peered":"2024-04-19T02:15:29.283995+0000","last_unstale":"2024-04-19T02:15:30.274006+0000","last_undegraded":"2024-04-19T02:15:30.274006+0000","last_fullsized":"2024-04-19T02:15:30.274006+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:35.941308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.753137+0000","last_change":"2024-04-19T02:15:28.890265+0000","last_active":"2024-04-19T02:15:31.753137+0000","last_peered":"2024-04-19T02:15:31.753137+0000","last_clean":"2024-04-19T02:15:31.753137+0000","last_became_active":"2024-04-19T02:15:28.890004+0000","last_became_peered":"2024-04-19T02:15:28.890004+0000","last_unstale":"2024-04-19T02:15:31.753137+0000","last_undegraded":"2024-04-19T02:15:31.753137+0000","last_fullsized":"2024-04-19T02:15:31.753137+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:02.517101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273866+0000","last_change":"2024-04-19T02:15:29.285529+0000","last_active":"2024-04-19T02:15:30.273866+0000","last_peered":"2024-04-19T02:15:30.273866+0000","last_clean":"2024-04-19T02:15:30.273866+0000","last_became_active":"2024-04-19T02:15:29.285197+0000","last_became_peered":"2024-04-19T02:15:29.285197+0000","last_unstale":"2024-04-19T02:15:30.273866+0000","last_undegraded":"2024-04-19T02:15:30.273866+0000","last_fullsized":"2024-04-19T02:15:30.273866+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274737+0000","last_change":"2024-04-19T02:15:28.893902+0000","last_active":"2024-04-19T02:15:30.274737+0000","last_peered":"2024-04-19T02:15:30.274737+0000","last_clean":"2024-04-19T02:15:30.274737+0000","last_became_active":"2024-04-19T02:15:28.893231+0000","last_became_peered":"2024-04-19T02:15:28.893231+0000","last_unstale":"2024-04-19T02:15:30.274737+0000","last_undegraded":"2024-04-19T02:15:30.274737+0000","last_fullsized":"2024-04-19T02:15:30.274737+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:23.658442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274341+0000","last_change":"2024-04-19T02:15:29.282874+0000","last_active":"2024-04-19T02:15:30.274341+0000","last_peered":"2024-04-19T02:15:30.274341+0000","last_clean":"2024-04-19T02:15:30.274341+0000","last_became_active":"2024-04-19T02:15:29.281675+0000","last_became_peered":"2024-04-19T02:15:29.281675+0000","last_unstale":"2024-04-19T02:15:30.274341+0000","last_undegraded":"2024-04-19T02:15:30.274341+0000","last_fullsized":"2024-04-19T02:15:30.274341+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:35.941308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752851+0000","last_change":"2024-04-19T02:15:28.891234+0000","last_active":"2024-04-19T02:15:31.752851+0000","last_peered":"2024-04-19T02:15:31.752851+0000","last_clean":"2024-04-19T02:15:31.752851+0000","last_became_active":"2024-04-19T02:15:28.890881+0000","last_became_peered":"2024-04-19T02:15:28.890881+0000","last_unstale":"2024-04-19T02:15:31.752851+0000","last_undegraded":"2024-04-19T02:15:31.752851+0000","last_fullsized":"2024-04-19T02:15:31.752851+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752380+0000","last_change":"2024-04-19T02:15:29.281937+0000","last_active":"2024-04-19T02:15:31.752380+0000","last_peered":"2024-04-19T02:15:31.752380+0000","last_clean":"2024-04-19T02:15:31.752380+0000","last_became_active":"2024-04-19T02:15:29.280727+0000","last_became_peered":"2024-04-19T02:15:29.280727+0000","last_unstale":"2024-04-19T02:15:31.752380+0000","last_undegraded":"2024-04-19T02:15:31.752380+0000","last_fullsized":"2024-04-19T02:15:31.752380+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752346+0000","last_change":"2024-04-19T02:15:28.892767+0000","last_active":"2024-04-19T02:15:31.752346+0000","last_peered":"2024-04-19T02:15:31.752346+0000","last_clean":"2024-04-19T02:15:31.752346+0000","last_became_active":"2024-04-19T02:15:28.892235+0000","last_became_peered":"2024-04-19T02:15:28.892235+0000","last_unstale":"2024-04-19T02:15:31.752346+0000","last_undegraded":"2024-04-19T02:15:31.752346+0000","last_fullsized":"2024-04-19T02:15:31.752346+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:37.690735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273357+0000","last_change":"2024-04-19T02:15:29.279857+0000","last_active":"2024-04-19T02:15:30.273357+0000","last_peered":"2024-04-19T02:15:30.273357+0000","last_clean":"2024-04-19T02:15:30.273357+0000","last_became_active":"2024-04-19T02:15:29.279536+0000","last_became_peered":"2024-04-19T02:15:29.279536+0000","last_unstale":"2024-04-19T02:15:30.273357+0000","last_undegraded":"2024-04-19T02:15:30.273357+0000","last_fullsized":"2024-04-19T02:15:30.273357+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:00.191179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273138+0000","last_change":"2024-04-19T02:15:28.891611+0000","last_active":"2024-04-19T02:15:30.273138+0000","last_peered":"2024-04-19T02:15:30.273138+0000","last_clean":"2024-04-19T02:15:30.273138+0000","last_became_active":"2024-04-19T02:15:28.890914+0000","last_became_peered":"2024-04-19T02:15:28.890914+0000","last_unstale":"2024-04-19T02:15:30.273138+0000","last_undegraded":"2024-04-19T02:15:30.273138+0000","last_fullsized":"2024-04-19T02:15:30.273138+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:37.690735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752522+0000","last_change":"2024-04-19T02:15:29.285774+0000","last_active":"2024-04-19T02:15:31.752522+0000","last_peered":"2024-04-19T02:15:31.752522+0000","last_clean":"2024-04-19T02:15:31.752522+0000","last_became_active":"2024-04-19T02:15:29.284705+0000","last_became_peered":"2024-04-19T02:15:29.284705+0000","last_unstale":"2024-04-19T02:15:31.752522+0000","last_undegraded":"2024-04-19T02:15:31.752522+0000","last_fullsized":"2024-04-19T02:15:31.752522+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752240+0000","last_change":"2024-04-19T02:15:28.892873+0000","last_active":"2024-04-19T02:15:31.752240+0000","last_peered":"2024-04-19T02:15:31.752240+0000","last_clean":"2024-04-19T02:15:31.752240+0000","last_became_active":"2024-04-19T02:15:28.892487+0000","last_became_peered":"2024-04-19T02:15:28.892487+0000","last_unstale":"2024-04-19T02:15:31.752240+0000","last_undegraded":"2024-04-19T02:15:31.752240+0000","last_fullsized":"2024-04-19T02:15:31.752240+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:35.412837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.753131+0000","last_change":"2024-04-19T02:15:29.285019+0000","last_active":"2024-04-19T02:15:31.753131+0000","last_peered":"2024-04-19T02:15:31.753131+0000","last_clean":"2024-04-19T02:15:31.753131+0000","last_became_active":"2024-04-19T02:15:29.284650+0000","last_became_peered":"2024-04-19T02:15:29.284650+0000","last_unstale":"2024-04-19T02:15:31.753131+0000","last_undegraded":"2024-04-19T02:15:31.753131+0000","last_fullsized":"2024-04-19T02:15:31.753131+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273991+0000","last_change":"2024-04-19T02:15:28.893245+0000","last_active":"2024-04-19T02:15:30.273991+0000","last_peered":"2024-04-19T02:15:30.273991+0000","last_clean":"2024-04-19T02:15:30.273991+0000","last_became_active":"2024-04-19T02:15:28.891932+0000","last_became_peered":"2024-04-19T02:15:28.891932+0000","last_unstale":"2024-04-19T02:15:30.273991+0000","last_undegraded":"2024-04-19T02:15:30.273991+0000","last_fullsized":"2024-04-19T02:15:30.273991+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:30.518182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.753047+0000","last_change":"2024-04-19T02:15:29.287190+0000","last_active":"2024-04-19T02:15:31.753047+0000","last_peered":"2024-04-19T02:15:31.753047+0000","last_clean":"2024-04-19T02:15:31.753047+0000","last_became_active":"2024-04-19T02:15:29.286606+0000","last_became_peered":"2024-04-19T02:15:29.286606+0000","last_unstale":"2024-04-19T02:15:31.753047+0000","last_undegraded":"2024-04-19T02:15:31.753047+0000","last_fullsized":"2024-04-19T02:15:31.753047+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:28.387062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274074+0000","last_change":"2024-04-19T02:15:28.894121+0000","last_active":"2024-04-19T02:15:30.274074+0000","last_peered":"2024-04-19T02:15:30.274074+0000","last_clean":"2024-04-19T02:15:30.274074+0000","last_became_active":"2024-04-19T02:15:28.893902+0000","last_became_peered":"2024-04-19T02:15:28.893902+0000","last_unstale":"2024-04-19T02:15:30.274074+0000","last_undegraded":"2024-04-19T02:15:30.274074+0000","last_fullsized":"2024-04-19T02:15:30.274074+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:10:35.146583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273739+0000","last_change":"2024-04-19T02:15:29.282870+0000","last_active":"2024-04-19T02:15:30.273739+0000","last_peered":"2024-04-19T02:15:30.273739+0000","last_clean":"2024-04-19T02:15:30.273739+0000","last_became_active":"2024-04-19T02:15:29.281873+0000","last_became_peered":"2024-04-19T02:15:29.281873+0000","last_unstale":"2024-04-19T02:15:30.273739+0000","last_undegraded":"2024-04-19T02:15:30.273739+0000","last_fullsized":"2024-04-19T02:15:30.273739+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.269354+0000","last_change":"2024-04-19T02:15:24.527061+0000","last_active":"2024-04-19T02:15:29.269354+0000","last_peered":"2024-04-19T02:15:29.269354+0000","last_clean":"2024-04-19T02:15:29.269354+0000","last_became_active":"2024-04-19T02:15:24.526757+0000","last_became_peered":"2024-04-19T02:15:24.526757+0000","last_unstale":"2024-04-19T02:15:29.269354+0000","last_undegraded":"2024-04-19T02:15:29.269354+0000","last_fullsized":"2024-04-19T02:15:29.269354+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:17:13.649077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.753003+0000","last_change":"2024-04-19T02:15:28.892766+0000","last_active":"2024-04-19T02:15:31.753003+0000","last_peered":"2024-04-19T02:15:31.753003+0000","last_clean":"2024-04-19T02:15:31.753003+0000","last_became_active":"2024-04-19T02:15:28.892396+0000","last_became_peered":"2024-04-19T02:15:28.892396+0000","last_unstale":"2024-04-19T02:15:31.753003+0000","last_undegraded":"2024-04-19T02:15:31.753003+0000","last_fullsized":"2024-04-19T02:15:31.753003+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:57.946581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274481+0000","last_change":"2024-04-19T02:15:29.277922+0000","last_active":"2024-04-19T02:15:30.274481+0000","last_peered":"2024-04-19T02:15:30.274481+0000","last_clean":"2024-04-19T02:15:30.274481+0000","last_became_active":"2024-04-19T02:15:29.276968+0000","last_became_peered":"2024-04-19T02:15:29.276968+0000","last_unstale":"2024-04-19T02:15:30.274481+0000","last_undegraded":"2024-04-19T02:15:30.274481+0000","last_fullsized":"2024-04-19T02:15:30.274481+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.276084+0000","last_change":"2024-04-19T02:15:24.530933+0000","last_active":"2024-04-19T02:15:29.276084+0000","last_peered":"2024-04-19T02:15:29.276084+0000","last_clean":"2024-04-19T02:15:29.276084+0000","last_became_active":"2024-04-19T02:15:24.530550+0000","last_became_peered":"2024-04-19T02:15:24.530550+0000","last_unstale":"2024-04-19T02:15:29.276084+0000","last_undegraded":"2024-04-19T02:15:29.276084+0000","last_fullsized":"2024-04-19T02:15:29.276084+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:18:15.194321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752725+0000","last_change":"2024-04-19T02:15:28.893062+0000","last_active":"2024-04-19T02:15:31.752725+0000","last_peered":"2024-04-19T02:15:31.752725+0000","last_clean":"2024-04-19T02:15:31.752725+0000","last_became_active":"2024-04-19T02:15:28.892798+0000","last_became_peered":"2024-04-19T02:15:28.892798+0000","last_unstale":"2024-04-19T02:15:31.752725+0000","last_undegraded":"2024-04-19T02:15:31.752725+0000","last_fullsized":"2024-04-19T02:15:31.752725+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:53.170180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273830+0000","last_change":"2024-04-19T02:15:29.278294+0000","last_active":"2024-04-19T02:15:30.273830+0000","last_peered":"2024-04-19T02:15:30.273830+0000","last_clean":"2024-04-19T02:15:30.273830+0000","last_became_active":"2024-04-19T02:15:29.277536+0000","last_became_peered":"2024-04-19T02:15:29.277536+0000","last_unstale":"2024-04-19T02:15:30.273830+0000","last_undegraded":"2024-04-19T02:15:30.273830+0000","last_fullsized":"2024-04-19T02:15:30.273830+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.268601+0000","last_change":"2024-04-19T02:15:24.527048+0000","last_active":"2024-04-19T02:15:29.268601+0000","last_peered":"2024-04-19T02:15:29.268601+0000","last_clean":"2024-04-19T02:15:29.268601+0000","last_became_active":"2024-04-19T02:15:24.526790+0000","last_became_peered":"2024-04-19T02:15:24.526790+0000","last_unstale":"2024-04-19T02:15:29.268601+0000","last_undegraded":"2024-04-19T02:15:29.268601+0000","last_fullsized":"2024-04-19T02:15:29.268601+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273986+0000","last_change":"2024-04-19T02:15:28.893858+0000","last_active":"2024-04-19T02:15:30.273986+0000","last_peered":"2024-04-19T02:15:30.273986+0000","last_clean":"2024-04-19T02:15:30.273986+0000","last_became_active":"2024-04-19T02:15:28.892497+0000","last_became_peered":"2024-04-19T02:15:28.892497+0000","last_unstale":"2024-04-19T02:15:30.273986+0000","last_undegraded":"2024-04-19T02:15:30.273986+0000","last_fullsized":"2024-04-19T02:15:30.273986+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:31.673938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273922+0000","last_change":"2024-04-19T02:15:29.282663+0000","last_active":"2024-04-19T02:15:30.273922+0000","last_peered":"2024-04-19T02:15:30.273922+0000","last_clean":"2024-04-19T02:15:30.273922+0000","last_became_active":"2024-04-19T02:15:29.282217+0000","last_became_peered":"2024-04-19T02:15:29.282217+0000","last_unstale":"2024-04-19T02:15:30.273922+0000","last_undegraded":"2024-04-19T02:15:30.273922+0000","last_fullsized":"2024-04-19T02:15:30.273922+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.276557+0000","last_change":"2024-04-19T02:15:24.530924+0000","last_active":"2024-04-19T02:15:29.276557+0000","last_peered":"2024-04-19T02:15:29.276557+0000","last_clean":"2024-04-19T02:15:29.276557+0000","last_became_active":"2024-04-19T02:15:24.530551+0000","last_became_peered":"2024-04-19T02:15:24.530551+0000","last_unstale":"2024-04-19T02:15:29.276557+0000","last_undegraded":"2024-04-19T02:15:29.276557+0000","last_fullsized":"2024-04-19T02:15:29.276557+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:30.576946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":210,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.275680+0000","last_change":"2024-04-19T02:15:24.533634+0000","last_active":"2024-04-19T02:15:29.275680+0000","last_peered":"2024-04-19T02:15:29.275680+0000","last_clean":"2024-04-19T02:15:29.275680+0000","last_became_active":"2024-04-19T02:15:24.533420+0000","last_became_peered":"2024-04-19T02:15:24.533420+0000","last_unstale":"2024-04-19T02:15:29.275680+0000","last_undegraded":"2024-04-19T02:15:29.275680+0000","last_fullsized":"2024-04-19T02:15:29.275680+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273047+0000","last_change":"2024-04-19T02:15:28.890244+0000","last_active":"2024-04-19T02:15:30.273047+0000","last_peered":"2024-04-19T02:15:30.273047+0000","last_clean":"2024-04-19T02:15:30.273047+0000","last_became_active":"2024-04-19T02:15:28.889831+0000","last_became_peered":"2024-04-19T02:15:28.889831+0000","last_unstale":"2024-04-19T02:15:30.273047+0000","last_undegraded":"2024-04-19T02:15:30.273047+0000","last_fullsized":"2024-04-19T02:15:30.273047+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.753121+0000","last_change":"2024-04-19T02:15:29.285015+0000","last_active":"2024-04-19T02:15:31.753121+0000","last_peered":"2024-04-19T02:15:31.753121+0000","last_clean":"2024-04-19T02:15:31.753121+0000","last_became_active":"2024-04-19T02:15:29.284164+0000","last_became_peered":"2024-04-19T02:15:29.284164+0000","last_unstale":"2024-04-19T02:15:31.753121+0000","last_undegraded":"2024-04-19T02:15:31.753121+0000","last_fullsized":"2024-04-19T02:15:31.753121+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:36.987844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.275722+0000","last_change":"2024-04-19T02:15:24.533912+0000","last_active":"2024-04-19T02:15:29.275722+0000","last_peered":"2024-04-19T02:15:29.275722+0000","last_clean":"2024-04-19T02:15:29.275722+0000","last_became_active":"2024-04-19T02:15:24.533580+0000","last_became_peered":"2024-04-19T02:15:24.533580+0000","last_unstale":"2024-04-19T02:15:29.275722+0000","last_undegraded":"2024-04-19T02:15:29.275722+0000","last_fullsized":"2024-04-19T02:15:29.275722+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:45.045477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.272710+0000","last_change":"2024-04-19T02:15:28.891889+0000","last_active":"2024-04-19T02:15:30.272710+0000","last_peered":"2024-04-19T02:15:30.272710+0000","last_clean":"2024-04-19T02:15:30.272710+0000","last_became_active":"2024-04-19T02:15:28.890919+0000","last_became_peered":"2024-04-19T02:15:28.890919+0000","last_unstale":"2024-04-19T02:15:30.272710+0000","last_undegraded":"2024-04-19T02:15:30.272710+0000","last_fullsized":"2024-04-19T02:15:30.272710+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:35.412837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.275017+0000","last_change":"2024-04-19T02:15:29.284266+0000","last_active":"2024-04-19T02:15:30.275017+0000","last_peered":"2024-04-19T02:15:30.275017+0000","last_clean":"2024-04-19T02:15:30.275017+0000","last_became_active":"2024-04-19T02:15:29.282994+0000","last_became_peered":"2024-04-19T02:15:29.282994+0000","last_unstale":"2024-04-19T02:15:30.275017+0000","last_undegraded":"2024-04-19T02:15:30.275017+0000","last_fullsized":"2024-04-19T02:15:30.275017+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.277544+0000","last_change":"2024-04-19T02:15:24.526751+0000","last_active":"2024-04-19T02:15:29.277544+0000","last_peered":"2024-04-19T02:15:29.277544+0000","last_clean":"2024-04-19T02:15:29.277544+0000","last_became_active":"2024-04-19T02:15:24.526511+0000","last_became_peered":"2024-04-19T02:15:24.526511+0000","last_unstale":"2024-04-19T02:15:29.277544+0000","last_undegraded":"2024-04-19T02:15:29.277544+0000","last_fullsized":"2024-04-19T02:15:29.277544+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:02:45.966851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273736+0000","last_change":"2024-04-19T02:15:28.892125+0000","last_active":"2024-04-19T02:15:30.273736+0000","last_peered":"2024-04-19T02:15:30.273736+0000","last_clean":"2024-04-19T02:15:30.273736+0000","last_became_active":"2024-04-19T02:15:28.891300+0000","last_became_peered":"2024-04-19T02:15:28.891300+0000","last_unstale":"2024-04-19T02:15:30.273736+0000","last_undegraded":"2024-04-19T02:15:30.273736+0000","last_fullsized":"2024-04-19T02:15:30.273736+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274547+0000","last_change":"2024-04-19T02:15:29.281694+0000","last_active":"2024-04-19T02:15:30.274547+0000","last_peered":"2024-04-19T02:15:30.274547+0000","last_clean":"2024-04-19T02:15:30.274547+0000","last_became_active":"2024-04-19T02:15:29.280519+0000","last_became_peered":"2024-04-19T02:15:29.280519+0000","last_unstale":"2024-04-19T02:15:30.274547+0000","last_undegraded":"2024-04-19T02:15:30.274547+0000","last_fullsized":"2024-04-19T02:15:30.274547+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:50.890545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273711+0000","last_change":"2024-04-19T02:15:28.891702+0000","last_active":"2024-04-19T02:15:30.273711+0000","last_peered":"2024-04-19T02:15:30.273711+0000","last_clean":"2024-04-19T02:15:30.273711+0000","last_became_active":"2024-04-19T02:15:28.890743+0000","last_became_peered":"2024-04-19T02:15:28.890743+0000","last_unstale":"2024-04-19T02:15:30.273711+0000","last_undegraded":"2024-04-19T02:15:30.273711+0000","last_fullsized":"2024-04-19T02:15:30.273711+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.269774+0000","last_change":"2024-04-19T02:15:24.526845+0000","last_active":"2024-04-19T02:15:29.269774+0000","last_peered":"2024-04-19T02:15:29.269774+0000","last_clean":"2024-04-19T02:15:29.269774+0000","last_became_active":"2024-04-19T02:15:24.526500+0000","last_became_peered":"2024-04-19T02:15:24.526500+0000","last_unstale":"2024-04-19T02:15:29.269774+0000","last_undegraded":"2024-04-19T02:15:29.269774+0000","last_fullsized":"2024-04-19T02:15:29.269774+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:16.883355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.272678+0000","last_change":"2024-04-19T02:15:29.278686+0000","last_active":"2024-04-19T02:15:30.272678+0000","last_peered":"2024-04-19T02:15:30.272678+0000","last_clean":"2024-04-19T02:15:30.272678+0000","last_became_active":"2024-04-19T02:15:29.278108+0000","last_became_peered":"2024-04-19T02:15:29.278108+0000","last_unstale":"2024-04-19T02:15:30.272678+0000","last_undegraded":"2024-04-19T02:15:30.272678+0000","last_fullsized":"2024-04-19T02:15:30.272678+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:34.593754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.277610+0000","last_change":"2024-04-19T02:15:24.533777+0000","last_active":"2024-04-19T02:15:29.277610+0000","last_peered":"2024-04-19T02:15:29.277610+0000","last_clean":"2024-04-19T02:15:29.277610+0000","last_became_active":"2024-04-19T02:15:24.533436+0000","last_became_peered":"2024-04-19T02:15:24.533436+0000","last_unstale":"2024-04-19T02:15:29.277610+0000","last_undegraded":"2024-04-19T02:15:29.277610+0000","last_fullsized":"2024-04-19T02:15:29.277610+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:53:25.922418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:32.743668+0000","last_change":"2024-04-19T02:15:28.891370+0000","last_active":"2024-04-19T02:15:32.743668+0000","last_peered":"2024-04-19T02:15:32.743668+0000","last_clean":"2024-04-19T02:15:32.743668+0000","last_became_active":"2024-04-19T02:15:28.890702+0000","last_became_peered":"2024-04-19T02:15:28.890702+0000","last_unstale":"2024-04-19T02:15:32.743668+0000","last_undegraded":"2024-04-19T02:15:32.743668+0000","last_fullsized":"2024-04-19T02:15:32.743668+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:33.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274234+0000","last_change":"2024-04-19T02:15:29.282244+0000","last_active":"2024-04-19T02:15:30.274234+0000","last_peered":"2024-04-19T02:15:30.274234+0000","last_clean":"2024-04-19T02:15:30.274234+0000","last_became_active":"2024-04-19T02:15:29.280366+0000","last_became_peered":"2024-04-19T02:15:29.280366+0000","last_unstale":"2024-04-19T02:15:30.274234+0000","last_undegraded":"2024-04-19T02:15:30.274234+0000","last_fullsized":"2024-04-19T02:15:30.274234+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274392+0000","last_change":"2024-04-19T02:15:28.893027+0000","last_active":"2024-04-19T02:15:30.274392+0000","last_peered":"2024-04-19T02:15:30.274392+0000","last_clean":"2024-04-19T02:15:30.274392+0000","last_became_active":"2024-04-19T02:15:28.892695+0000","last_became_peered":"2024-04-19T02:15:28.892695+0000","last_unstale":"2024-04-19T02:15:30.274392+0000","last_undegraded":"2024-04-19T02:15:30.274392+0000","last_fullsized":"2024-04-19T02:15:30.274392+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274805+0000","last_change":"2024-04-19T02:15:29.283155+0000","last_active":"2024-04-19T02:15:30.274805+0000","last_peered":"2024-04-19T02:15:30.274805+0000","last_clean":"2024-04-19T02:15:30.274805+0000","last_became_active":"2024-04-19T02:15:29.281407+0000","last_became_peered":"2024-04-19T02:15:29.281407+0000","last_unstale":"2024-04-19T02:15:30.274805+0000","last_undegraded":"2024-04-19T02:15:30.274805+0000","last_fullsized":"2024-04-19T02:15:30.274805+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752643+0000","last_change":"2024-04-19T02:15:28.893067+0000","last_active":"2024-04-19T02:15:31.752643+0000","last_peered":"2024-04-19T02:15:31.752643+0000","last_clean":"2024-04-19T02:15:31.752643+0000","last_became_active":"2024-04-19T02:15:28.892781+0000","last_became_peered":"2024-04-19T02:15:28.892781+0000","last_unstale":"2024-04-19T02:15:31.752643+0000","last_undegraded":"2024-04-19T02:15:31.752643+0000","last_fullsized":"2024-04-19T02:15:31.752643+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:54:15.590143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752652+0000","last_change":"2024-04-19T02:15:29.281279+0000","last_active":"2024-04-19T02:15:31.752652+0000","last_peered":"2024-04-19T02:15:31.752652+0000","last_clean":"2024-04-19T02:15:31.752652+0000","last_became_active":"2024-04-19T02:15:29.279360+0000","last_became_peered":"2024-04-19T02:15:29.279360+0000","last_unstale":"2024-04-19T02:15:31.752652+0000","last_undegraded":"2024-04-19T02:15:31.752652+0000","last_fullsized":"2024-04-19T02:15:31.752652+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274993+0000","last_change":"2024-04-19T02:15:28.893239+0000","last_active":"2024-04-19T02:15:30.274993+0000","last_peered":"2024-04-19T02:15:30.274993+0000","last_clean":"2024-04-19T02:15:30.274993+0000","last_became_active":"2024-04-19T02:15:28.892881+0000","last_became_peered":"2024-04-19T02:15:28.892881+0000","last_unstale":"2024-04-19T02:15:30.274993+0000","last_undegraded":"2024-04-19T02:15:30.274993+0000","last_fullsized":"2024-04-19T02:15:30.274993+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752362+0000","last_change":"2024-04-19T02:15:29.281652+0000","last_active":"2024-04-19T02:15:31.752362+0000","last_peered":"2024-04-19T02:15:31.752362+0000","last_clean":"2024-04-19T02:15:31.752362+0000","last_became_active":"2024-04-19T02:15:29.281175+0000","last_became_peered":"2024-04-19T02:15:29.281175+0000","last_unstale":"2024-04-19T02:15:31.752362+0000","last_undegraded":"2024-04-19T02:15:31.752362+0000","last_fullsized":"2024-04-19T02:15:31.752362+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:16.568764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273639+0000","last_change":"2024-04-19T02:15:28.892058+0000","last_active":"2024-04-19T02:15:30.273639+0000","last_peered":"2024-04-19T02:15:30.273639+0000","last_clean":"2024-04-19T02:15:30.273639+0000","last_became_active":"2024-04-19T02:15:28.890877+0000","last_became_peered":"2024-04-19T02:15:28.890877+0000","last_unstale":"2024-04-19T02:15:30.273639+0000","last_undegraded":"2024-04-19T02:15:30.273639+0000","last_fullsized":"2024-04-19T02:15:30.273639+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:53.170180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274344+0000","last_change":"2024-04-19T02:15:29.278810+0000","last_active":"2024-04-19T02:15:30.274344+0000","last_peered":"2024-04-19T02:15:30.274344+0000","last_clean":"2024-04-19T02:15:30.274344+0000","last_became_active":"2024-04-19T02:15:29.277913+0000","last_became_peered":"2024-04-19T02:15:29.277913+0000","last_unstale":"2024-04-19T02:15:30.274344+0000","last_undegraded":"2024-04-19T02:15:30.274344+0000","last_fullsized":"2024-04-19T02:15:30.274344+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:24.082666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273821+0000","last_change":"2024-04-19T02:15:28.889132+0000","last_active":"2024-04-19T02:15:30.273821+0000","last_peered":"2024-04-19T02:15:30.273821+0000","last_clean":"2024-04-19T02:15:30.273821+0000","last_became_active":"2024-04-19T02:15:28.888926+0000","last_became_peered":"2024-04-19T02:15:28.888926+0000","last_unstale":"2024-04-19T02:15:30.273821+0000","last_undegraded":"2024-04-19T02:15:30.273821+0000","last_fullsized":"2024-04-19T02:15:30.273821+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752370+0000","last_change":"2024-04-19T02:15:29.282776+0000","last_active":"2024-04-19T02:15:31.752370+0000","last_peered":"2024-04-19T02:15:31.752370+0000","last_clean":"2024-04-19T02:15:31.752370+0000","last_became_active":"2024-04-19T02:15:29.279382+0000","last_became_peered":"2024-04-19T02:15:29.279382+0000","last_unstale":"2024-04-19T02:15:31.752370+0000","last_undegraded":"2024-04-19T02:15:31.752370+0000","last_fullsized":"2024-04-19T02:15:31.752370+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752208+0000","last_change":"2024-04-19T02:15:29.283537+0000","last_active":"2024-04-19T02:15:31.752208+0000","last_peered":"2024-04-19T02:15:31.752208+0000","last_clean":"2024-04-19T02:15:31.752208+0000","last_became_active":"2024-04-19T02:15:29.281801+0000","last_became_peered":"2024-04-19T02:15:29.281801+0000","last_unstale":"2024-04-19T02:15:31.752208+0000","last_undegraded":"2024-04-19T02:15:31.752208+0000","last_fullsized":"2024-04-19T02:15:31.752208+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.272816+0000","last_change":"2024-04-19T02:15:29.281560+0000","last_active":"2024-04-19T02:15:30.272816+0000","last_peered":"2024-04-19T02:15:30.272816+0000","last_clean":"2024-04-19T02:15:30.272816+0000","last_became_active":"2024-04-19T02:15:29.281261+0000","last_became_peered":"2024-04-19T02:15:29.281261+0000","last_unstale":"2024-04-19T02:15:30.272816+0000","last_undegraded":"2024-04-19T02:15:30.272816+0000","last_fullsized":"2024-04-19T02:15:30.272816+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274549+0000","last_change":"2024-04-19T02:15:29.280731+0000","last_active":"2024-04-19T02:15:30.274549+0000","last_peered":"2024-04-19T02:15:30.274549+0000","last_clean":"2024-04-19T02:15:30.274549+0000","last_became_active":"2024-04-19T02:15:29.280340+0000","last_became_peered":"2024-04-19T02:15:29.280340+0000","last_unstale":"2024-04-19T02:15:30.274549+0000","last_undegraded":"2024-04-19T02:15:30.274549+0000","last_fullsized":"2024-04-19T02:15:30.274549+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273481+0000","last_change":"2024-04-19T02:15:29.278702+0000","last_active":"2024-04-19T02:15:30.273481+0000","last_peered":"2024-04-19T02:15:30.273481+0000","last_clean":"2024-04-19T02:15:30.273481+0000","last_became_active":"2024-04-19T02:15:29.277756+0000","last_became_peered":"2024-04-19T02:15:29.277756+0000","last_unstale":"2024-04-19T02:15:30.273481+0000","last_undegraded":"2024-04-19T02:15:30.273481+0000","last_fullsized":"2024-04-19T02:15:30.273481+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274899+0000","last_change":"2024-04-19T02:15:29.277568+0000","last_active":"2024-04-19T02:15:30.274899+0000","last_peered":"2024-04-19T02:15:30.274899+0000","last_clean":"2024-04-19T02:15:30.274899+0000","last_became_active":"2024-04-19T02:15:29.276725+0000","last_became_peered":"2024-04-19T02:15:29.276725+0000","last_unstale":"2024-04-19T02:15:30.274899+0000","last_undegraded":"2024-04-19T02:15:30.274899+0000","last_fullsized":"2024-04-19T02:15:30.274899+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":139264,"data_stored":46663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31856,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":757760,"data_stored":638777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":749568,"data_stored":638161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:15:43.374 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-19T02:15:43.374 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-19T02:15:43.374 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-19T02:15:43.375 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-19T02:15:43.775 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:15:43.775 INFO:teuthology.orchestra.run.smithi121.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-19T02:15:43.789 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-19T02:15:43.790 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T02:15:44.111 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:15:44.111 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":15,"fsid":"f6ab5dd0-bb9f-4b48-a9fc-4728c7955ca8","created":"2024-04-19T02:15:13.539846+0000","modified":"2024-04-19T02:15:30.265522+0000","last_up_change":"2024-04-19T02:15:22.519568+0000","last_in_change":"2024-04-19T02:15:15.482624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T02:15:22.776125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T02:15:23.264005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T02:15:27.675087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T02:15:28.232224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88cb15f3-271c-43d5-af51-1cd26b8ed13c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":41347},{"type":"v1","addr":"172.21.15.153:6801","nonce":41347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":41347},{"type":"v1","addr":"172.21.15.153:6803","nonce":41347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":41347},{"type":"v1","addr":"172.21.15.153:6807","nonce":41347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":41347},{"type":"v1","addr":"172.21.15.153:6805","nonce":41347}]},"public_addr":"172.21.15.153:6801/41347","cluster_addr":"172.21.15.153:6803/41347","heartbeat_back_addr":"172.21.15.153:6807/41347","heartbeat_front_addr":"172.21.15.153:6805/41347","state":["exists","up"]},{"osd":1,"uuid":"2674869a-db01-4d9f-a496-9fb3851b5b21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":41380},{"type":"v1","addr":"172.21.15.174:6801","nonce":41380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":41380},{"type":"v1","addr":"172.21.15.174:6803","nonce":41380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":41380},{"type":"v1","addr":"172.21.15.174:6807","nonce":41380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":41380},{"type":"v1","addr":"172.21.15.174:6805","nonce":41380}]},"public_addr":"172.21.15.174:6801/41380","cluster_addr":"172.21.15.174:6803/41380","heartbeat_back_addr":"172.21.15.174:6807/41380","heartbeat_front_addr":"172.21.15.174:6805/41380","state":["exists","up"]},{"osd":2,"uuid":"712ad943-2f98-49d9-aabe-f66b509be633","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":41508},{"type":"v1","addr":"172.21.15.177:6801","nonce":41508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":41508},{"type":"v1","addr":"172.21.15.177:6803","nonce":41508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":41508},{"type":"v1","addr":"172.21.15.177:6807","nonce":41508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":41508},{"type":"v1","addr":"172.21.15.177:6805","nonce":41508}]},"public_addr":"172.21.15.177:6801/41508","cluster_addr":"172.21.15.177:6803/41508","heartbeat_back_addr":"172.21.15.177:6807/41508","heartbeat_front_addr":"172.21.15.177:6805/41508","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:15:20.495280+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:15:20.594553+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:15:20.524253+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T02:15:44.125 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-19T02:15:22.776125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-19T02:15:23.264005+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-19T02:15:27.675087+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-19T02:15:28.232224+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-19T02:15:44.125 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-19T02:15:44.449 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 1 2024-04-19T02:15:44.463 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-19T02:15:44.787 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 8 2024-04-19T02:15:44.801 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-19T02:15:45.124 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 32 2024-04-19T02:15:45.138 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-19T02:15:45.462 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 64 2024-04-19T02:15:45.476 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-19T02:15:45.839 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:15:45.839 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-19T02:15:29.263369+0000","modified":"2024-04-19T02:15:32.274461+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4230":{"gid":4230,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6803/1144924022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":1144924022},{"type":"v1","addr":"172.21.15.121:6803","nonce":1144924022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-19T02:15:45.842 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 6 2024-04-19T02:15:45.853 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T02:15:46.176 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:15:46.176 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":15,"fsid":"f6ab5dd0-bb9f-4b48-a9fc-4728c7955ca8","created":"2024-04-19T02:15:13.539846+0000","modified":"2024-04-19T02:15:30.265522+0000","last_up_change":"2024-04-19T02:15:22.519568+0000","last_in_change":"2024-04-19T02:15:15.482624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T02:15:22.776125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T02:15:23.264005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T02:15:27.675087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T02:15:28.232224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88cb15f3-271c-43d5-af51-1cd26b8ed13c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":41347},{"type":"v1","addr":"172.21.15.153:6801","nonce":41347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":41347},{"type":"v1","addr":"172.21.15.153:6803","nonce":41347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":41347},{"type":"v1","addr":"172.21.15.153:6807","nonce":41347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":41347},{"type":"v1","addr":"172.21.15.153:6805","nonce":41347}]},"public_addr":"172.21.15.153:6801/41347","cluster_addr":"172.21.15.153:6803/41347","heartbeat_back_addr":"172.21.15.153:6807/41347","heartbeat_front_addr":"172.21.15.153:6805/41347","state":["exists","up"]},{"osd":1,"uuid":"2674869a-db01-4d9f-a496-9fb3851b5b21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":41380},{"type":"v1","addr":"172.21.15.174:6801","nonce":41380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":41380},{"type":"v1","addr":"172.21.15.174:6803","nonce":41380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":41380},{"type":"v1","addr":"172.21.15.174:6807","nonce":41380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":41380},{"type":"v1","addr":"172.21.15.174:6805","nonce":41380}]},"public_addr":"172.21.15.174:6801/41380","cluster_addr":"172.21.15.174:6803/41380","heartbeat_back_addr":"172.21.15.174:6807/41380","heartbeat_front_addr":"172.21.15.174:6805/41380","state":["exists","up"]},{"osd":2,"uuid":"712ad943-2f98-49d9-aabe-f66b509be633","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":41508},{"type":"v1","addr":"172.21.15.177:6801","nonce":41508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":41508},{"type":"v1","addr":"172.21.15.177:6803","nonce":41508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":41508},{"type":"v1","addr":"172.21.15.177:6807","nonce":41508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":41508},{"type":"v1","addr":"172.21.15.177:6805","nonce":41508}]},"public_addr":"172.21.15.177:6801/41508","cluster_addr":"172.21.15.177:6803/41508","heartbeat_back_addr":"172.21.15.177:6807/41508","heartbeat_front_addr":"172.21.15.177:6805/41508","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:15:20.495280+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:15:20.594553+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:15:20.524253+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T02:15:46.190 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-19T02:15:22.776125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-19T02:15:23.264005+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-19T02:15:27.675087+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-19T02:15:28.232224+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-19T02:15:46.190 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-19T02:15:46.518 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 1 2024-04-19T02:15:46.532 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-19T02:15:46.854 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 8 2024-04-19T02:15:46.868 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-19T02:15:47.192 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 32 2024-04-19T02:15:47.206 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-19T02:15:47.529 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 64 2024-04-19T02:15:47.544 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-19T02:15:47.908 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:15:47.908 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-19T02:15:29.263369+0000","modified":"2024-04-19T02:15:32.274461+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4230":{"gid":4230,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6803/1144924022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":1144924022},{"type":"v1","addr":"172.21.15.121:6803","nonce":1144924022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-19T02:15:47.911 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 6 2024-04-19T02:15:47.922 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T02:15:48.244 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:15:48.244 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":15,"fsid":"f6ab5dd0-bb9f-4b48-a9fc-4728c7955ca8","created":"2024-04-19T02:15:13.539846+0000","modified":"2024-04-19T02:15:30.265522+0000","last_up_change":"2024-04-19T02:15:22.519568+0000","last_in_change":"2024-04-19T02:15:15.482624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T02:15:22.776125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T02:15:23.264005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T02:15:27.675087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T02:15:28.232224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88cb15f3-271c-43d5-af51-1cd26b8ed13c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":41347},{"type":"v1","addr":"172.21.15.153:6801","nonce":41347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":41347},{"type":"v1","addr":"172.21.15.153:6803","nonce":41347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":41347},{"type":"v1","addr":"172.21.15.153:6807","nonce":41347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":41347},{"type":"v1","addr":"172.21.15.153:6805","nonce":41347}]},"public_addr":"172.21.15.153:6801/41347","cluster_addr":"172.21.15.153:6803/41347","heartbeat_back_addr":"172.21.15.153:6807/41347","heartbeat_front_addr":"172.21.15.153:6805/41347","state":["exists","up"]},{"osd":1,"uuid":"2674869a-db01-4d9f-a496-9fb3851b5b21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":41380},{"type":"v1","addr":"172.21.15.174:6801","nonce":41380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":41380},{"type":"v1","addr":"172.21.15.174:6803","nonce":41380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":41380},{"type":"v1","addr":"172.21.15.174:6807","nonce":41380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":41380},{"type":"v1","addr":"172.21.15.174:6805","nonce":41380}]},"public_addr":"172.21.15.174:6801/41380","cluster_addr":"172.21.15.174:6803/41380","heartbeat_back_addr":"172.21.15.174:6807/41380","heartbeat_front_addr":"172.21.15.174:6805/41380","state":["exists","up"]},{"osd":2,"uuid":"712ad943-2f98-49d9-aabe-f66b509be633","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":41508},{"type":"v1","addr":"172.21.15.177:6801","nonce":41508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":41508},{"type":"v1","addr":"172.21.15.177:6803","nonce":41508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":41508},{"type":"v1","addr":"172.21.15.177:6807","nonce":41508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":41508},{"type":"v1","addr":"172.21.15.177:6805","nonce":41508}]},"public_addr":"172.21.15.177:6801/41508","cluster_addr":"172.21.15.177:6803/41508","heartbeat_back_addr":"172.21.15.177:6807/41508","heartbeat_front_addr":"172.21.15.177:6805/41508","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:15:20.495280+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:15:20.594553+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:15:20.524253+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T02:15:48.258 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-19T02:15:48.623 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:15:48.623 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-19T02:15:29.263369+0000","modified":"2024-04-19T02:15:32.274461+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4230":{"gid":4230,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6803/1144924022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":1144924022},{"type":"v1","addr":"172.21.15.121:6803","nonce":1144924022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-19T02:15:48.625 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 6 2024-04-19T02:15:48.738 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-19T02:15:29.263369+0000', 'modified': '2024-04-19T02:15:32.274461+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4230}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4230': {'gid': 4230, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.121:6803/1144924022', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6802', 'nonce': 1144924022}, {'type': 'v1', 'addr': '172.21.15.121:6803', 'nonce': 1144924022}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-19T02:15:48.738 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-19T02:15:48.738 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-19T02:15:48.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-19T02:15:48.871+0000 7f8059ffb700 0 client.14435 ms_handle_reset on v2:172.21.15.121:6802/1144924022 2024-04-19T02:15:48.892 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-19T02:15:48.893+0000 7f8059ffb700 0 client.4483 ms_handle_reset on v2:172.21.15.121:6802/1144924022 2024-04-19T02:15:48.892 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-04-19T02:15:48.892 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_fsid": "f6ab5dd0-bb9f-4b48-a9fc-4728c7955ca8", 2024-04-19T02:15:48.892 INFO:teuthology.orchestra.run.smithi121.stdout: "whoami": 0, 2024-04-19T02:15:48.892 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 4230, 2024-04-19T02:15:48.892 INFO:teuthology.orchestra.run.smithi121.stdout: "want_state": "up:active", 2024-04-19T02:15:48.892 INFO:teuthology.orchestra.run.smithi121.stdout: "state": "up:active", 2024-04-19T02:15:48.892 INFO:teuthology.orchestra.run.smithi121.stdout: "fs_name": "cephfs", 2024-04-19T02:15:48.892 INFO:teuthology.orchestra.run.smithi121.stdout: "rank_uptime": 19.62768457, 2024-04-19T02:15:48.892 INFO:teuthology.orchestra.run.smithi121.stdout: "mdsmap_epoch": 6, 2024-04-19T02:15:48.892 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_epoch": 15, 2024-04-19T02:15:48.893 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_epoch_barrier": 15, 2024-04-19T02:15:48.893 INFO:teuthology.orchestra.run.smithi121.stdout: "uptime": 24.261491606 2024-04-19T02:15:48.893 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-04-19T02:15:48.905 INFO:teuthology.run_tasks:Running task thrashosds... 2024-04-19T02:15:48.935 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-04-19T02:15:48.935 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'reef'}, 'ceph': {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef', 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'}} 2024-04-19T02:15:48.935 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-04-19T02:15:48.935 INFO:tasks.thrashosds:Doing preliminary sync to avoid collateral damage... 2024-04-19T02:15:48.935 DEBUG:teuthology.orchestra.run.smithi121:> sync 2024-04-19T02:15:49.142 DEBUG:teuthology.orchestra.run.smithi153:> sync 2024-04-19T02:15:49.278 DEBUG:teuthology.orchestra.run.smithi174:> sync 2024-04-19T02:15:49.384 DEBUG:teuthology.orchestra.run.smithi177:> sync 2024-04-19T02:15:49.495 DEBUG:tasks.thrashosds:checking console status of smithi121 2024-04-19T02:15:49.496 DEBUG:teuthology.orchestra.console.smithi121:Waiting for login prompt 2024-04-19T02:15:49.496 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi121 2024-04-19T02:15:49.607 DEBUG:teuthology.orchestra.console.smithi121:expect before: [Enter `^Ec?' for help] CentOS Stream 8 Kernel 4.18.0-552.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2024-04-19T02:15:49.607 DEBUG:teuthology.orchestra.console.smithi121:expect after: smithi121 login: 2024-04-19T02:15:49.659 DEBUG:teuthology.orchestra.console.smithi121:console disconnect output: [Enter `^Ec?' for help] CentOS Stream 8 Kernel 4.18.0-552.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi121 login: [disconnect] 2024-04-19T02:15:49.761 DEBUG:tasks.thrashosds:checking console status of smithi153 2024-04-19T02:15:49.761 DEBUG:teuthology.orchestra.console.smithi153:Waiting for login prompt 2024-04-19T02:15:49.761 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi153 2024-04-19T02:15:49.886 DEBUG:teuthology.orchestra.console.smithi153:expect before: [Enter `^Ec?' for help] CentOS Stream 8 Kernel 4.18.0-552.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2024-04-19T02:15:49.887 DEBUG:teuthology.orchestra.console.smithi153:expect after: smithi153 login: 2024-04-19T02:15:49.939 DEBUG:teuthology.orchestra.console.smithi153:console disconnect output: [Enter `^Ec?' for help] CentOS Stream 8 Kernel 4.18.0-552.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi153 login: [disconnect] 2024-04-19T02:15:50.039 DEBUG:tasks.thrashosds:checking console status of smithi174 2024-04-19T02:15:50.039 DEBUG:teuthology.orchestra.console.smithi174:Waiting for login prompt 2024-04-19T02:15:50.040 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi174 2024-04-19T02:15:50.177 DEBUG:teuthology.orchestra.console.smithi174:expect before: [Enter `^Ec?' for help] CentOS Stream 8 Kernel 4.18.0-552.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2024-04-19T02:15:50.177 DEBUG:teuthology.orchestra.console.smithi174:expect after: smithi174 login: 2024-04-19T02:15:50.231 DEBUG:teuthology.orchestra.console.smithi174:console disconnect output: [Enter `^Ec?' for help] CentOS Stream 8 Kernel 4.18.0-552.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi174 login: [disconnect] 2024-04-19T02:15:50.331 DEBUG:tasks.thrashosds:checking console status of smithi177 2024-04-19T02:15:50.332 DEBUG:teuthology.orchestra.console.smithi177:Waiting for login prompt 2024-04-19T02:15:50.332 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi177 2024-04-19T02:15:50.446 DEBUG:teuthology.orchestra.console.smithi177:expect before: [Enter `^Ec?' for help] CentOS Stream 8 Kernel 4.18.0-552.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2024-04-19T02:15:50.447 DEBUG:teuthology.orchestra.console.smithi177:expect after: smithi177 login: 2024-04-19T02:15:50.499 DEBUG:teuthology.orchestra.console.smithi177:console disconnect output: [Enter `^Ec?' for help] CentOS Stream 8 Kernel 4.18.0-552.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi177 login: [disconnect] 2024-04-19T02:15:50.600 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-04-19T02:15:50.957 INFO:tasks.thrashosds:Beginning thrashosds... 2024-04-19T02:15:50.957 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-19T02:15:50.957 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:15:51.286 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:15:51.288 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-04-19T02:15:51.296 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-04-19T02:15:50.742117+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":86784,"kb_used_data":1608,"kb_used_omap":4,"kb_used_meta":85115,"kb_avail":283028736,"statfs":{"total":289910292480,"available":289821425664,"internally_reserved":0,"allocated":1646592,"data_stored":1323601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":87158098},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002613"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.275255+0000","last_change":"2024-04-19T02:15:29.280412+0000","last_active":"2024-04-19T02:15:30.275255+0000","last_peered":"2024-04-19T02:15:30.275255+0000","last_clean":"2024-04-19T02:15:30.275255+0000","last_became_active":"2024-04-19T02:15:29.278762+0000","last_became_peered":"2024-04-19T02:15:29.278762+0000","last_unstale":"2024-04-19T02:15:30.275255+0000","last_undegraded":"2024-04-19T02:15:30.275255+0000","last_fullsized":"2024-04-19T02:15:30.275255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:45.301675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274720+0000","last_change":"2024-04-19T02:15:29.284695+0000","last_active":"2024-04-19T02:15:30.274720+0000","last_peered":"2024-04-19T02:15:30.274720+0000","last_clean":"2024-04-19T02:15:30.274720+0000","last_became_active":"2024-04-19T02:15:29.283468+0000","last_became_peered":"2024-04-19T02:15:29.283468+0000","last_unstale":"2024-04-19T02:15:30.274720+0000","last_undegraded":"2024-04-19T02:15:30.274720+0000","last_fullsized":"2024-04-19T02:15:30.274720+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.384881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752988+0000","last_change":"2024-04-19T02:15:29.286709+0000","last_active":"2024-04-19T02:15:31.752988+0000","last_peered":"2024-04-19T02:15:31.752988+0000","last_clean":"2024-04-19T02:15:31.752988+0000","last_became_active":"2024-04-19T02:15:29.286169+0000","last_became_peered":"2024-04-19T02:15:29.286169+0000","last_unstale":"2024-04-19T02:15:31.752988+0000","last_undegraded":"2024-04-19T02:15:31.752988+0000","last_fullsized":"2024-04-19T02:15:31.752988+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:58.741466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752842+0000","last_change":"2024-04-19T02:15:29.280131+0000","last_active":"2024-04-19T02:15:31.752842+0000","last_peered":"2024-04-19T02:15:31.752842+0000","last_clean":"2024-04-19T02:15:31.752842+0000","last_became_active":"2024-04-19T02:15:29.279388+0000","last_became_peered":"2024-04-19T02:15:29.279388+0000","last_unstale":"2024-04-19T02:15:31.752842+0000","last_undegraded":"2024-04-19T02:15:31.752842+0000","last_fullsized":"2024-04-19T02:15:31.752842+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:36:48.819486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274570+0000","last_change":"2024-04-19T02:15:29.279377+0000","last_active":"2024-04-19T02:15:30.274570+0000","last_peered":"2024-04-19T02:15:30.274570+0000","last_clean":"2024-04-19T02:15:30.274570+0000","last_became_active":"2024-04-19T02:15:29.278954+0000","last_became_peered":"2024-04-19T02:15:29.278954+0000","last_unstale":"2024-04-19T02:15:30.274570+0000","last_undegraded":"2024-04-19T02:15:30.274570+0000","last_fullsized":"2024-04-19T02:15:30.274570+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:34.883207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752217+0000","last_change":"2024-04-19T02:15:29.283908+0000","last_active":"2024-04-19T02:15:31.752217+0000","last_peered":"2024-04-19T02:15:31.752217+0000","last_clean":"2024-04-19T02:15:31.752217+0000","last_became_active":"2024-04-19T02:15:29.281729+0000","last_became_peered":"2024-04-19T02:15:29.281729+0000","last_unstale":"2024-04-19T02:15:31.752217+0000","last_undegraded":"2024-04-19T02:15:31.752217+0000","last_fullsized":"2024-04-19T02:15:31.752217+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:03:15.383476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752077+0000","last_change":"2024-04-19T02:15:29.281253+0000","last_active":"2024-04-19T02:15:31.752077+0000","last_peered":"2024-04-19T02:15:31.752077+0000","last_clean":"2024-04-19T02:15:31.752077+0000","last_became_active":"2024-04-19T02:15:29.279951+0000","last_became_peered":"2024-04-19T02:15:29.279951+0000","last_unstale":"2024-04-19T02:15:31.752077+0000","last_undegraded":"2024-04-19T02:15:31.752077+0000","last_fullsized":"2024-04-19T02:15:31.752077+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.751969+0000","last_change":"2024-04-19T02:15:29.283952+0000","last_active":"2024-04-19T02:15:31.751969+0000","last_peered":"2024-04-19T02:15:31.751969+0000","last_clean":"2024-04-19T02:15:31.751969+0000","last_became_active":"2024-04-19T02:15:29.282721+0000","last_became_peered":"2024-04-19T02:15:29.282721+0000","last_unstale":"2024-04-19T02:15:31.751969+0000","last_undegraded":"2024-04-19T02:15:31.751969+0000","last_fullsized":"2024-04-19T02:15:31.751969+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:45.301675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273597+0000","last_change":"2024-04-19T02:15:29.282150+0000","last_active":"2024-04-19T02:15:30.273597+0000","last_peered":"2024-04-19T02:15:30.273597+0000","last_clean":"2024-04-19T02:15:30.273597+0000","last_became_active":"2024-04-19T02:15:29.281538+0000","last_became_peered":"2024-04-19T02:15:29.281538+0000","last_unstale":"2024-04-19T02:15:30.273597+0000","last_undegraded":"2024-04-19T02:15:30.273597+0000","last_fullsized":"2024-04-19T02:15:30.273597+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274996+0000","last_change":"2024-04-19T02:15:29.284098+0000","last_active":"2024-04-19T02:15:30.274996+0000","last_peered":"2024-04-19T02:15:30.274996+0000","last_clean":"2024-04-19T02:15:30.274996+0000","last_became_active":"2024-04-19T02:15:29.282114+0000","last_became_peered":"2024-04-19T02:15:29.282114+0000","last_unstale":"2024-04-19T02:15:30.274996+0000","last_undegraded":"2024-04-19T02:15:30.274996+0000","last_fullsized":"2024-04-19T02:15:30.274996+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:16.568764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752773+0000","last_change":"2024-04-19T02:15:29.280606+0000","last_active":"2024-04-19T02:15:31.752773+0000","last_peered":"2024-04-19T02:15:31.752773+0000","last_clean":"2024-04-19T02:15:31.752773+0000","last_became_active":"2024-04-19T02:15:29.280151+0000","last_became_peered":"2024-04-19T02:15:29.280151+0000","last_unstale":"2024-04-19T02:15:31.752773+0000","last_undegraded":"2024-04-19T02:15:31.752773+0000","last_fullsized":"2024-04-19T02:15:31.752773+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:26:22.452488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274472+0000","last_change":"2024-04-19T02:15:29.283378+0000","last_active":"2024-04-19T02:15:30.274472+0000","last_peered":"2024-04-19T02:15:30.274472+0000","last_clean":"2024-04-19T02:15:30.274472+0000","last_became_active":"2024-04-19T02:15:29.281571+0000","last_became_peered":"2024-04-19T02:15:29.281571+0000","last_unstale":"2024-04-19T02:15:30.274472+0000","last_undegraded":"2024-04-19T02:15:30.274472+0000","last_fullsized":"2024-04-19T02:15:30.274472+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274373+0000","last_change":"2024-04-19T02:15:29.281811+0000","last_active":"2024-04-19T02:15:30.274373+0000","last_peered":"2024-04-19T02:15:30.274373+0000","last_clean":"2024-04-19T02:15:30.274373+0000","last_became_active":"2024-04-19T02:15:29.280700+0000","last_became_peered":"2024-04-19T02:15:29.280700+0000","last_unstale":"2024-04-19T02:15:30.274373+0000","last_undegraded":"2024-04-19T02:15:30.274373+0000","last_fullsized":"2024-04-19T02:15:30.274373+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752607+0000","last_change":"2024-04-19T02:15:29.284262+0000","last_active":"2024-04-19T02:15:31.752607+0000","last_peered":"2024-04-19T02:15:31.752607+0000","last_clean":"2024-04-19T02:15:31.752607+0000","last_became_active":"2024-04-19T02:15:29.283121+0000","last_became_peered":"2024-04-19T02:15:29.283121+0000","last_unstale":"2024-04-19T02:15:31.752607+0000","last_undegraded":"2024-04-19T02:15:31.752607+0000","last_fullsized":"2024-04-19T02:15:31.752607+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752216+0000","last_change":"2024-04-19T02:15:29.285139+0000","last_active":"2024-04-19T02:15:31.752216+0000","last_peered":"2024-04-19T02:15:31.752216+0000","last_clean":"2024-04-19T02:15:31.752216+0000","last_became_active":"2024-04-19T02:15:29.284649+0000","last_became_peered":"2024-04-19T02:15:29.284649+0000","last_unstale":"2024-04-19T02:15:31.752216+0000","last_undegraded":"2024-04-19T02:15:31.752216+0000","last_fullsized":"2024-04-19T02:15:31.752216+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752064+0000","last_change":"2024-04-19T02:15:29.283648+0000","last_active":"2024-04-19T02:15:31.752064+0000","last_peered":"2024-04-19T02:15:31.752064+0000","last_clean":"2024-04-19T02:15:31.752064+0000","last_became_active":"2024-04-19T02:15:29.281606+0000","last_became_peered":"2024-04-19T02:15:29.281606+0000","last_unstale":"2024-04-19T02:15:31.752064+0000","last_undegraded":"2024-04-19T02:15:31.752064+0000","last_fullsized":"2024-04-19T02:15:31.752064+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273606+0000","last_change":"2024-04-19T02:15:29.278673+0000","last_active":"2024-04-19T02:15:30.273606+0000","last_peered":"2024-04-19T02:15:30.273606+0000","last_clean":"2024-04-19T02:15:30.273606+0000","last_became_active":"2024-04-19T02:15:29.277699+0000","last_became_peered":"2024-04-19T02:15:29.277699+0000","last_unstale":"2024-04-19T02:15:30.273606+0000","last_undegraded":"2024-04-19T02:15:30.273606+0000","last_fullsized":"2024-04-19T02:15:30.273606+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.275113+0000","last_change":"2024-04-19T02:15:29.283341+0000","last_active":"2024-04-19T02:15:30.275113+0000","last_peered":"2024-04-19T02:15:30.275113+0000","last_clean":"2024-04-19T02:15:30.275113+0000","last_became_active":"2024-04-19T02:15:29.281591+0000","last_became_peered":"2024-04-19T02:15:29.281591+0000","last_unstale":"2024-04-19T02:15:30.275113+0000","last_undegraded":"2024-04-19T02:15:30.275113+0000","last_fullsized":"2024-04-19T02:15:30.275113+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:34.593754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273356+0000","last_change":"2024-04-19T02:15:29.282110+0000","last_active":"2024-04-19T02:15:30.273356+0000","last_peered":"2024-04-19T02:15:30.273356+0000","last_clean":"2024-04-19T02:15:30.273356+0000","last_became_active":"2024-04-19T02:15:29.281716+0000","last_became_peered":"2024-04-19T02:15:29.281716+0000","last_unstale":"2024-04-19T02:15:30.273356+0000","last_undegraded":"2024-04-19T02:15:30.273356+0000","last_fullsized":"2024-04-19T02:15:30.273356+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752789+0000","last_change":"2024-04-19T02:15:29.285237+0000","last_active":"2024-04-19T02:15:31.752789+0000","last_peered":"2024-04-19T02:15:31.752789+0000","last_clean":"2024-04-19T02:15:31.752789+0000","last_became_active":"2024-04-19T02:15:29.282790+0000","last_became_peered":"2024-04-19T02:15:29.282790+0000","last_unstale":"2024-04-19T02:15:31.752789+0000","last_undegraded":"2024-04-19T02:15:31.752789+0000","last_fullsized":"2024-04-19T02:15:31.752789+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752599+0000","last_change":"2024-04-19T02:15:29.282609+0000","last_active":"2024-04-19T02:15:31.752599+0000","last_peered":"2024-04-19T02:15:31.752599+0000","last_clean":"2024-04-19T02:15:31.752599+0000","last_became_active":"2024-04-19T02:15:29.281665+0000","last_became_peered":"2024-04-19T02:15:29.281665+0000","last_unstale":"2024-04-19T02:15:31.752599+0000","last_undegraded":"2024-04-19T02:15:31.752599+0000","last_fullsized":"2024-04-19T02:15:31.752599+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.384881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274303+0000","last_change":"2024-04-19T02:15:29.278890+0000","last_active":"2024-04-19T02:15:30.274303+0000","last_peered":"2024-04-19T02:15:30.274303+0000","last_clean":"2024-04-19T02:15:30.274303+0000","last_became_active":"2024-04-19T02:15:29.278074+0000","last_became_peered":"2024-04-19T02:15:29.278074+0000","last_unstale":"2024-04-19T02:15:30.274303+0000","last_undegraded":"2024-04-19T02:15:30.274303+0000","last_fullsized":"2024-04-19T02:15:30.274303+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:00.191179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.272977+0000","last_change":"2024-04-19T02:15:29.277109+0000","last_active":"2024-04-19T02:15:30.272977+0000","last_peered":"2024-04-19T02:15:30.272977+0000","last_clean":"2024-04-19T02:15:30.272977+0000","last_became_active":"2024-04-19T02:15:29.275417+0000","last_became_peered":"2024-04-19T02:15:29.275417+0000","last_unstale":"2024-04-19T02:15:30.272977+0000","last_undegraded":"2024-04-19T02:15:30.272977+0000","last_fullsized":"2024-04-19T02:15:30.272977+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274103+0000","last_change":"2024-04-19T02:15:29.283266+0000","last_active":"2024-04-19T02:15:30.274103+0000","last_peered":"2024-04-19T02:15:30.274103+0000","last_clean":"2024-04-19T02:15:30.274103+0000","last_became_active":"2024-04-19T02:15:29.281505+0000","last_became_peered":"2024-04-19T02:15:29.281505+0000","last_unstale":"2024-04-19T02:15:30.274103+0000","last_undegraded":"2024-04-19T02:15:30.274103+0000","last_fullsized":"2024-04-19T02:15:30.274103+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.275172+0000","last_change":"2024-04-19T02:15:29.278084+0000","last_active":"2024-04-19T02:15:30.275172+0000","last_peered":"2024-04-19T02:15:30.275172+0000","last_clean":"2024-04-19T02:15:30.275172+0000","last_became_active":"2024-04-19T02:15:29.276952+0000","last_became_peered":"2024-04-19T02:15:29.276952+0000","last_unstale":"2024-04-19T02:15:30.275172+0000","last_undegraded":"2024-04-19T02:15:30.275172+0000","last_fullsized":"2024-04-19T02:15:30.275172+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273711+0000","last_change":"2024-04-19T02:15:29.279904+0000","last_active":"2024-04-19T02:15:30.273711+0000","last_peered":"2024-04-19T02:15:30.273711+0000","last_clean":"2024-04-19T02:15:30.273711+0000","last_became_active":"2024-04-19T02:15:29.278938+0000","last_became_peered":"2024-04-19T02:15:29.278938+0000","last_unstale":"2024-04-19T02:15:30.273711+0000","last_undegraded":"2024-04-19T02:15:30.273711+0000","last_fullsized":"2024-04-19T02:15:30.273711+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752884+0000","last_change":"2024-04-19T02:15:29.287389+0000","last_active":"2024-04-19T02:15:31.752884+0000","last_peered":"2024-04-19T02:15:31.752884+0000","last_clean":"2024-04-19T02:15:31.752884+0000","last_became_active":"2024-04-19T02:15:29.286431+0000","last_became_peered":"2024-04-19T02:15:29.286431+0000","last_unstale":"2024-04-19T02:15:31.752884+0000","last_undegraded":"2024-04-19T02:15:31.752884+0000","last_fullsized":"2024-04-19T02:15:31.752884+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:58:30.117887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274282+0000","last_change":"2024-04-19T02:15:28.890403+0000","last_active":"2024-04-19T02:15:30.274282+0000","last_peered":"2024-04-19T02:15:30.274282+0000","last_clean":"2024-04-19T02:15:30.274282+0000","last_became_active":"2024-04-19T02:15:28.889780+0000","last_became_peered":"2024-04-19T02:15:28.889780+0000","last_unstale":"2024-04-19T02:15:30.274282+0000","last_undegraded":"2024-04-19T02:15:30.274282+0000","last_fullsized":"2024-04-19T02:15:30.274282+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:52:15.842316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.275112+0000","last_change":"2024-04-19T02:15:29.281792+0000","last_active":"2024-04-19T02:15:30.275112+0000","last_peered":"2024-04-19T02:15:30.275112+0000","last_clean":"2024-04-19T02:15:30.275112+0000","last_became_active":"2024-04-19T02:15:29.280479+0000","last_became_peered":"2024-04-19T02:15:29.280479+0000","last_unstale":"2024-04-19T02:15:30.275112+0000","last_undegraded":"2024-04-19T02:15:30.275112+0000","last_fullsized":"2024-04-19T02:15:30.275112+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273058+0000","last_change":"2024-04-19T02:15:28.888778+0000","last_active":"2024-04-19T02:15:30.273058+0000","last_peered":"2024-04-19T02:15:30.273058+0000","last_clean":"2024-04-19T02:15:30.273058+0000","last_became_active":"2024-04-19T02:15:28.888543+0000","last_became_peered":"2024-04-19T02:15:28.888543+0000","last_unstale":"2024-04-19T02:15:30.273058+0000","last_undegraded":"2024-04-19T02:15:30.273058+0000","last_fullsized":"2024-04-19T02:15:30.273058+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:43:51.221619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273526+0000","last_change":"2024-04-19T02:15:29.279986+0000","last_active":"2024-04-19T02:15:30.273526+0000","last_peered":"2024-04-19T02:15:30.273526+0000","last_clean":"2024-04-19T02:15:30.273526+0000","last_became_active":"2024-04-19T02:15:29.279690+0000","last_became_peered":"2024-04-19T02:15:29.279690+0000","last_unstale":"2024-04-19T02:15:30.273526+0000","last_undegraded":"2024-04-19T02:15:30.273526+0000","last_fullsized":"2024-04-19T02:15:30.273526+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.272885+0000","last_change":"2024-04-19T02:15:28.890463+0000","last_active":"2024-04-19T02:15:30.272885+0000","last_peered":"2024-04-19T02:15:30.272885+0000","last_clean":"2024-04-19T02:15:30.272885+0000","last_became_active":"2024-04-19T02:15:28.889777+0000","last_became_peered":"2024-04-19T02:15:28.889777+0000","last_unstale":"2024-04-19T02:15:30.272885+0000","last_undegraded":"2024-04-19T02:15:30.272885+0000","last_fullsized":"2024-04-19T02:15:30.272885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:58:21.520250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.275141+0000","last_change":"2024-04-19T02:15:29.280879+0000","last_active":"2024-04-19T02:15:30.275141+0000","last_peered":"2024-04-19T02:15:30.275141+0000","last_clean":"2024-04-19T02:15:30.275141+0000","last_became_active":"2024-04-19T02:15:29.279314+0000","last_became_peered":"2024-04-19T02:15:29.279314+0000","last_unstale":"2024-04-19T02:15:30.275141+0000","last_undegraded":"2024-04-19T02:15:30.275141+0000","last_fullsized":"2024-04-19T02:15:30.275141+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273829+0000","last_change":"2024-04-19T02:15:28.891867+0000","last_active":"2024-04-19T02:15:30.273829+0000","last_peered":"2024-04-19T02:15:30.273829+0000","last_clean":"2024-04-19T02:15:30.273829+0000","last_became_active":"2024-04-19T02:15:28.890806+0000","last_became_peered":"2024-04-19T02:15:28.890806+0000","last_unstale":"2024-04-19T02:15:30.273829+0000","last_undegraded":"2024-04-19T02:15:30.273829+0000","last_fullsized":"2024-04-19T02:15:30.273829+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:57.946581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.272758+0000","last_change":"2024-04-19T02:15:29.278148+0000","last_active":"2024-04-19T02:15:30.272758+0000","last_peered":"2024-04-19T02:15:30.272758+0000","last_clean":"2024-04-19T02:15:30.272758+0000","last_became_active":"2024-04-19T02:15:29.277402+0000","last_became_peered":"2024-04-19T02:15:29.277402+0000","last_unstale":"2024-04-19T02:15:30.272758+0000","last_undegraded":"2024-04-19T02:15:30.272758+0000","last_fullsized":"2024-04-19T02:15:30.272758+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752928+0000","last_change":"2024-04-19T02:15:28.892905+0000","last_active":"2024-04-19T02:15:31.752928+0000","last_peered":"2024-04-19T02:15:31.752928+0000","last_clean":"2024-04-19T02:15:31.752928+0000","last_became_active":"2024-04-19T02:15:28.892541+0000","last_became_peered":"2024-04-19T02:15:28.892541+0000","last_unstale":"2024-04-19T02:15:31.752928+0000","last_undegraded":"2024-04-19T02:15:31.752928+0000","last_fullsized":"2024-04-19T02:15:31.752928+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:33.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273109+0000","last_change":"2024-04-19T02:15:29.278810+0000","last_active":"2024-04-19T02:15:30.273109+0000","last_peered":"2024-04-19T02:15:30.273109+0000","last_clean":"2024-04-19T02:15:30.273109+0000","last_became_active":"2024-04-19T02:15:29.278093+0000","last_became_peered":"2024-04-19T02:15:29.278093+0000","last_unstale":"2024-04-19T02:15:30.273109+0000","last_undegraded":"2024-04-19T02:15:30.273109+0000","last_fullsized":"2024-04-19T02:15:30.273109+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:34.883207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274867+0000","last_change":"2024-04-19T02:15:28.892937+0000","last_active":"2024-04-19T02:15:30.274867+0000","last_peered":"2024-04-19T02:15:30.274867+0000","last_clean":"2024-04-19T02:15:30.274867+0000","last_became_active":"2024-04-19T02:15:28.891440+0000","last_became_peered":"2024-04-19T02:15:28.891440+0000","last_unstale":"2024-04-19T02:15:30.274867+0000","last_undegraded":"2024-04-19T02:15:30.274867+0000","last_fullsized":"2024-04-19T02:15:30.274867+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273027+0000","last_change":"2024-04-19T02:15:29.278404+0000","last_active":"2024-04-19T02:15:30.273027+0000","last_peered":"2024-04-19T02:15:30.273027+0000","last_clean":"2024-04-19T02:15:30.273027+0000","last_became_active":"2024-04-19T02:15:29.277460+0000","last_became_peered":"2024-04-19T02:15:29.277460+0000","last_unstale":"2024-04-19T02:15:30.273027+0000","last_undegraded":"2024-04-19T02:15:30.273027+0000","last_fullsized":"2024-04-19T02:15:30.273027+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752700+0000","last_change":"2024-04-19T02:15:28.891097+0000","last_active":"2024-04-19T02:15:31.752700+0000","last_peered":"2024-04-19T02:15:31.752700+0000","last_clean":"2024-04-19T02:15:31.752700+0000","last_became_active":"2024-04-19T02:15:28.890795+0000","last_became_peered":"2024-04-19T02:15:28.890795+0000","last_unstale":"2024-04-19T02:15:31.752700+0000","last_undegraded":"2024-04-19T02:15:31.752700+0000","last_fullsized":"2024-04-19T02:15:31.752700+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752913+0000","last_change":"2024-04-19T02:15:29.278546+0000","last_active":"2024-04-19T02:15:31.752913+0000","last_peered":"2024-04-19T02:15:31.752913+0000","last_clean":"2024-04-19T02:15:31.752913+0000","last_became_active":"2024-04-19T02:15:29.277547+0000","last_became_peered":"2024-04-19T02:15:29.277547+0000","last_unstale":"2024-04-19T02:15:31.752913+0000","last_undegraded":"2024-04-19T02:15:31.752913+0000","last_fullsized":"2024-04-19T02:15:31.752913+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752826+0000","last_change":"2024-04-19T02:15:28.892977+0000","last_active":"2024-04-19T02:15:31.752826+0000","last_peered":"2024-04-19T02:15:31.752826+0000","last_clean":"2024-04-19T02:15:31.752826+0000","last_became_active":"2024-04-19T02:15:28.892636+0000","last_became_peered":"2024-04-19T02:15:28.892636+0000","last_unstale":"2024-04-19T02:15:31.752826+0000","last_undegraded":"2024-04-19T02:15:31.752826+0000","last_fullsized":"2024-04-19T02:15:31.752826+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:43:51.221619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274651+0000","last_change":"2024-04-19T02:15:29.284260+0000","last_active":"2024-04-19T02:15:30.274651+0000","last_peered":"2024-04-19T02:15:30.274651+0000","last_clean":"2024-04-19T02:15:30.274651+0000","last_became_active":"2024-04-19T02:15:29.282990+0000","last_became_peered":"2024-04-19T02:15:29.282990+0000","last_unstale":"2024-04-19T02:15:30.274651+0000","last_undegraded":"2024-04-19T02:15:30.274651+0000","last_fullsized":"2024-04-19T02:15:30.274651+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:36:48.819486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273207+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:15:30.273207+0000","last_peered":"2024-04-19T02:15:30.273207+0000","last_clean":"2024-04-19T02:15:30.273207+0000","last_became_active":"2024-04-19T02:15:28.890751+0000","last_became_peered":"2024-04-19T02:15:28.890751+0000","last_unstale":"2024-04-19T02:15:30.273207+0000","last_undegraded":"2024-04-19T02:15:30.273207+0000","last_fullsized":"2024-04-19T02:15:30.273207+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.275108+0000","last_change":"2024-04-19T02:15:29.282068+0000","last_active":"2024-04-19T02:15:30.275108+0000","last_peered":"2024-04-19T02:15:30.275108+0000","last_clean":"2024-04-19T02:15:30.275108+0000","last_became_active":"2024-04-19T02:15:29.280450+0000","last_became_peered":"2024-04-19T02:15:29.280450+0000","last_unstale":"2024-04-19T02:15:30.275108+0000","last_undegraded":"2024-04-19T02:15:30.275108+0000","last_fullsized":"2024-04-19T02:15:30.275108+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274189+0000","last_change":"2024-04-19T02:15:28.892934+0000","last_active":"2024-04-19T02:15:30.274189+0000","last_peered":"2024-04-19T02:15:30.274189+0000","last_clean":"2024-04-19T02:15:30.274189+0000","last_became_active":"2024-04-19T02:15:28.891879+0000","last_became_peered":"2024-04-19T02:15:28.891879+0000","last_unstale":"2024-04-19T02:15:30.274189+0000","last_undegraded":"2024-04-19T02:15:30.274189+0000","last_fullsized":"2024-04-19T02:15:30.274189+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:10:12.514798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273640+0000","last_change":"2024-04-19T02:15:29.279685+0000","last_active":"2024-04-19T02:15:30.273640+0000","last_peered":"2024-04-19T02:15:30.273640+0000","last_clean":"2024-04-19T02:15:30.273640+0000","last_became_active":"2024-04-19T02:15:29.278810+0000","last_became_peered":"2024-04-19T02:15:29.278810+0000","last_unstale":"2024-04-19T02:15:30.273640+0000","last_undegraded":"2024-04-19T02:15:30.273640+0000","last_fullsized":"2024-04-19T02:15:30.273640+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752370+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:15:31.752370+0000","last_peered":"2024-04-19T02:15:31.752370+0000","last_clean":"2024-04-19T02:15:31.752370+0000","last_became_active":"2024-04-19T02:15:28.890882+0000","last_became_peered":"2024-04-19T02:15:28.890882+0000","last_unstale":"2024-04-19T02:15:31.752370+0000","last_undegraded":"2024-04-19T02:15:31.752370+0000","last_fullsized":"2024-04-19T02:15:31.752370+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:31.673938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274006+0000","last_change":"2024-04-19T02:15:29.284258+0000","last_active":"2024-04-19T02:15:30.274006+0000","last_peered":"2024-04-19T02:15:30.274006+0000","last_clean":"2024-04-19T02:15:30.274006+0000","last_became_active":"2024-04-19T02:15:29.283995+0000","last_became_peered":"2024-04-19T02:15:29.283995+0000","last_unstale":"2024-04-19T02:15:30.274006+0000","last_undegraded":"2024-04-19T02:15:30.274006+0000","last_fullsized":"2024-04-19T02:15:30.274006+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:35.941308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.753137+0000","last_change":"2024-04-19T02:15:28.890265+0000","last_active":"2024-04-19T02:15:31.753137+0000","last_peered":"2024-04-19T02:15:31.753137+0000","last_clean":"2024-04-19T02:15:31.753137+0000","last_became_active":"2024-04-19T02:15:28.890004+0000","last_became_peered":"2024-04-19T02:15:28.890004+0000","last_unstale":"2024-04-19T02:15:31.753137+0000","last_undegraded":"2024-04-19T02:15:31.753137+0000","last_fullsized":"2024-04-19T02:15:31.753137+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:02.517101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273866+0000","last_change":"2024-04-19T02:15:29.285529+0000","last_active":"2024-04-19T02:15:30.273866+0000","last_peered":"2024-04-19T02:15:30.273866+0000","last_clean":"2024-04-19T02:15:30.273866+0000","last_became_active":"2024-04-19T02:15:29.285197+0000","last_became_peered":"2024-04-19T02:15:29.285197+0000","last_unstale":"2024-04-19T02:15:30.273866+0000","last_undegraded":"2024-04-19T02:15:30.273866+0000","last_fullsized":"2024-04-19T02:15:30.273866+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274737+0000","last_change":"2024-04-19T02:15:28.893902+0000","last_active":"2024-04-19T02:15:30.274737+0000","last_peered":"2024-04-19T02:15:30.274737+0000","last_clean":"2024-04-19T02:15:30.274737+0000","last_became_active":"2024-04-19T02:15:28.893231+0000","last_became_peered":"2024-04-19T02:15:28.893231+0000","last_unstale":"2024-04-19T02:15:30.274737+0000","last_undegraded":"2024-04-19T02:15:30.274737+0000","last_fullsized":"2024-04-19T02:15:30.274737+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:23.658442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274341+0000","last_change":"2024-04-19T02:15:29.282874+0000","last_active":"2024-04-19T02:15:30.274341+0000","last_peered":"2024-04-19T02:15:30.274341+0000","last_clean":"2024-04-19T02:15:30.274341+0000","last_became_active":"2024-04-19T02:15:29.281675+0000","last_became_peered":"2024-04-19T02:15:29.281675+0000","last_unstale":"2024-04-19T02:15:30.274341+0000","last_undegraded":"2024-04-19T02:15:30.274341+0000","last_fullsized":"2024-04-19T02:15:30.274341+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:35.941308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752851+0000","last_change":"2024-04-19T02:15:28.891234+0000","last_active":"2024-04-19T02:15:31.752851+0000","last_peered":"2024-04-19T02:15:31.752851+0000","last_clean":"2024-04-19T02:15:31.752851+0000","last_became_active":"2024-04-19T02:15:28.890881+0000","last_became_peered":"2024-04-19T02:15:28.890881+0000","last_unstale":"2024-04-19T02:15:31.752851+0000","last_undegraded":"2024-04-19T02:15:31.752851+0000","last_fullsized":"2024-04-19T02:15:31.752851+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752380+0000","last_change":"2024-04-19T02:15:29.281937+0000","last_active":"2024-04-19T02:15:31.752380+0000","last_peered":"2024-04-19T02:15:31.752380+0000","last_clean":"2024-04-19T02:15:31.752380+0000","last_became_active":"2024-04-19T02:15:29.280727+0000","last_became_peered":"2024-04-19T02:15:29.280727+0000","last_unstale":"2024-04-19T02:15:31.752380+0000","last_undegraded":"2024-04-19T02:15:31.752380+0000","last_fullsized":"2024-04-19T02:15:31.752380+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752346+0000","last_change":"2024-04-19T02:15:28.892767+0000","last_active":"2024-04-19T02:15:31.752346+0000","last_peered":"2024-04-19T02:15:31.752346+0000","last_clean":"2024-04-19T02:15:31.752346+0000","last_became_active":"2024-04-19T02:15:28.892235+0000","last_became_peered":"2024-04-19T02:15:28.892235+0000","last_unstale":"2024-04-19T02:15:31.752346+0000","last_undegraded":"2024-04-19T02:15:31.752346+0000","last_fullsized":"2024-04-19T02:15:31.752346+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:37.690735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273357+0000","last_change":"2024-04-19T02:15:29.279857+0000","last_active":"2024-04-19T02:15:30.273357+0000","last_peered":"2024-04-19T02:15:30.273357+0000","last_clean":"2024-04-19T02:15:30.273357+0000","last_became_active":"2024-04-19T02:15:29.279536+0000","last_became_peered":"2024-04-19T02:15:29.279536+0000","last_unstale":"2024-04-19T02:15:30.273357+0000","last_undegraded":"2024-04-19T02:15:30.273357+0000","last_fullsized":"2024-04-19T02:15:30.273357+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:00.191179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273138+0000","last_change":"2024-04-19T02:15:28.891611+0000","last_active":"2024-04-19T02:15:30.273138+0000","last_peered":"2024-04-19T02:15:30.273138+0000","last_clean":"2024-04-19T02:15:30.273138+0000","last_became_active":"2024-04-19T02:15:28.890914+0000","last_became_peered":"2024-04-19T02:15:28.890914+0000","last_unstale":"2024-04-19T02:15:30.273138+0000","last_undegraded":"2024-04-19T02:15:30.273138+0000","last_fullsized":"2024-04-19T02:15:30.273138+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:37.690735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752522+0000","last_change":"2024-04-19T02:15:29.285774+0000","last_active":"2024-04-19T02:15:31.752522+0000","last_peered":"2024-04-19T02:15:31.752522+0000","last_clean":"2024-04-19T02:15:31.752522+0000","last_became_active":"2024-04-19T02:15:29.284705+0000","last_became_peered":"2024-04-19T02:15:29.284705+0000","last_unstale":"2024-04-19T02:15:31.752522+0000","last_undegraded":"2024-04-19T02:15:31.752522+0000","last_fullsized":"2024-04-19T02:15:31.752522+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752240+0000","last_change":"2024-04-19T02:15:28.892873+0000","last_active":"2024-04-19T02:15:31.752240+0000","last_peered":"2024-04-19T02:15:31.752240+0000","last_clean":"2024-04-19T02:15:31.752240+0000","last_became_active":"2024-04-19T02:15:28.892487+0000","last_became_peered":"2024-04-19T02:15:28.892487+0000","last_unstale":"2024-04-19T02:15:31.752240+0000","last_undegraded":"2024-04-19T02:15:31.752240+0000","last_fullsized":"2024-04-19T02:15:31.752240+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:35.412837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.753131+0000","last_change":"2024-04-19T02:15:29.285019+0000","last_active":"2024-04-19T02:15:31.753131+0000","last_peered":"2024-04-19T02:15:31.753131+0000","last_clean":"2024-04-19T02:15:31.753131+0000","last_became_active":"2024-04-19T02:15:29.284650+0000","last_became_peered":"2024-04-19T02:15:29.284650+0000","last_unstale":"2024-04-19T02:15:31.753131+0000","last_undegraded":"2024-04-19T02:15:31.753131+0000","last_fullsized":"2024-04-19T02:15:31.753131+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273991+0000","last_change":"2024-04-19T02:15:28.893245+0000","last_active":"2024-04-19T02:15:30.273991+0000","last_peered":"2024-04-19T02:15:30.273991+0000","last_clean":"2024-04-19T02:15:30.273991+0000","last_became_active":"2024-04-19T02:15:28.891932+0000","last_became_peered":"2024-04-19T02:15:28.891932+0000","last_unstale":"2024-04-19T02:15:30.273991+0000","last_undegraded":"2024-04-19T02:15:30.273991+0000","last_fullsized":"2024-04-19T02:15:30.273991+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:30.518182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.753047+0000","last_change":"2024-04-19T02:15:29.287190+0000","last_active":"2024-04-19T02:15:31.753047+0000","last_peered":"2024-04-19T02:15:31.753047+0000","last_clean":"2024-04-19T02:15:31.753047+0000","last_became_active":"2024-04-19T02:15:29.286606+0000","last_became_peered":"2024-04-19T02:15:29.286606+0000","last_unstale":"2024-04-19T02:15:31.753047+0000","last_undegraded":"2024-04-19T02:15:31.753047+0000","last_fullsized":"2024-04-19T02:15:31.753047+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:28.387062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274074+0000","last_change":"2024-04-19T02:15:28.894121+0000","last_active":"2024-04-19T02:15:30.274074+0000","last_peered":"2024-04-19T02:15:30.274074+0000","last_clean":"2024-04-19T02:15:30.274074+0000","last_became_active":"2024-04-19T02:15:28.893902+0000","last_became_peered":"2024-04-19T02:15:28.893902+0000","last_unstale":"2024-04-19T02:15:30.274074+0000","last_undegraded":"2024-04-19T02:15:30.274074+0000","last_fullsized":"2024-04-19T02:15:30.274074+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:10:35.146583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273739+0000","last_change":"2024-04-19T02:15:29.282870+0000","last_active":"2024-04-19T02:15:30.273739+0000","last_peered":"2024-04-19T02:15:30.273739+0000","last_clean":"2024-04-19T02:15:30.273739+0000","last_became_active":"2024-04-19T02:15:29.281873+0000","last_became_peered":"2024-04-19T02:15:29.281873+0000","last_unstale":"2024-04-19T02:15:30.273739+0000","last_undegraded":"2024-04-19T02:15:30.273739+0000","last_fullsized":"2024-04-19T02:15:30.273739+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.269354+0000","last_change":"2024-04-19T02:15:24.527061+0000","last_active":"2024-04-19T02:15:29.269354+0000","last_peered":"2024-04-19T02:15:29.269354+0000","last_clean":"2024-04-19T02:15:29.269354+0000","last_became_active":"2024-04-19T02:15:24.526757+0000","last_became_peered":"2024-04-19T02:15:24.526757+0000","last_unstale":"2024-04-19T02:15:29.269354+0000","last_undegraded":"2024-04-19T02:15:29.269354+0000","last_fullsized":"2024-04-19T02:15:29.269354+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:17:13.649077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.753003+0000","last_change":"2024-04-19T02:15:28.892766+0000","last_active":"2024-04-19T02:15:31.753003+0000","last_peered":"2024-04-19T02:15:31.753003+0000","last_clean":"2024-04-19T02:15:31.753003+0000","last_became_active":"2024-04-19T02:15:28.892396+0000","last_became_peered":"2024-04-19T02:15:28.892396+0000","last_unstale":"2024-04-19T02:15:31.753003+0000","last_undegraded":"2024-04-19T02:15:31.753003+0000","last_fullsized":"2024-04-19T02:15:31.753003+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:57.946581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274481+0000","last_change":"2024-04-19T02:15:29.277922+0000","last_active":"2024-04-19T02:15:30.274481+0000","last_peered":"2024-04-19T02:15:30.274481+0000","last_clean":"2024-04-19T02:15:30.274481+0000","last_became_active":"2024-04-19T02:15:29.276968+0000","last_became_peered":"2024-04-19T02:15:29.276968+0000","last_unstale":"2024-04-19T02:15:30.274481+0000","last_undegraded":"2024-04-19T02:15:30.274481+0000","last_fullsized":"2024-04-19T02:15:30.274481+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.276084+0000","last_change":"2024-04-19T02:15:24.530933+0000","last_active":"2024-04-19T02:15:29.276084+0000","last_peered":"2024-04-19T02:15:29.276084+0000","last_clean":"2024-04-19T02:15:29.276084+0000","last_became_active":"2024-04-19T02:15:24.530550+0000","last_became_peered":"2024-04-19T02:15:24.530550+0000","last_unstale":"2024-04-19T02:15:29.276084+0000","last_undegraded":"2024-04-19T02:15:29.276084+0000","last_fullsized":"2024-04-19T02:15:29.276084+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:18:15.194321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752725+0000","last_change":"2024-04-19T02:15:28.893062+0000","last_active":"2024-04-19T02:15:31.752725+0000","last_peered":"2024-04-19T02:15:31.752725+0000","last_clean":"2024-04-19T02:15:31.752725+0000","last_became_active":"2024-04-19T02:15:28.892798+0000","last_became_peered":"2024-04-19T02:15:28.892798+0000","last_unstale":"2024-04-19T02:15:31.752725+0000","last_undegraded":"2024-04-19T02:15:31.752725+0000","last_fullsized":"2024-04-19T02:15:31.752725+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:53.170180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273830+0000","last_change":"2024-04-19T02:15:29.278294+0000","last_active":"2024-04-19T02:15:30.273830+0000","last_peered":"2024-04-19T02:15:30.273830+0000","last_clean":"2024-04-19T02:15:30.273830+0000","last_became_active":"2024-04-19T02:15:29.277536+0000","last_became_peered":"2024-04-19T02:15:29.277536+0000","last_unstale":"2024-04-19T02:15:30.273830+0000","last_undegraded":"2024-04-19T02:15:30.273830+0000","last_fullsized":"2024-04-19T02:15:30.273830+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.268601+0000","last_change":"2024-04-19T02:15:24.527048+0000","last_active":"2024-04-19T02:15:29.268601+0000","last_peered":"2024-04-19T02:15:29.268601+0000","last_clean":"2024-04-19T02:15:29.268601+0000","last_became_active":"2024-04-19T02:15:24.526790+0000","last_became_peered":"2024-04-19T02:15:24.526790+0000","last_unstale":"2024-04-19T02:15:29.268601+0000","last_undegraded":"2024-04-19T02:15:29.268601+0000","last_fullsized":"2024-04-19T02:15:29.268601+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273986+0000","last_change":"2024-04-19T02:15:28.893858+0000","last_active":"2024-04-19T02:15:30.273986+0000","last_peered":"2024-04-19T02:15:30.273986+0000","last_clean":"2024-04-19T02:15:30.273986+0000","last_became_active":"2024-04-19T02:15:28.892497+0000","last_became_peered":"2024-04-19T02:15:28.892497+0000","last_unstale":"2024-04-19T02:15:30.273986+0000","last_undegraded":"2024-04-19T02:15:30.273986+0000","last_fullsized":"2024-04-19T02:15:30.273986+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:31.673938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273922+0000","last_change":"2024-04-19T02:15:29.282663+0000","last_active":"2024-04-19T02:15:30.273922+0000","last_peered":"2024-04-19T02:15:30.273922+0000","last_clean":"2024-04-19T02:15:30.273922+0000","last_became_active":"2024-04-19T02:15:29.282217+0000","last_became_peered":"2024-04-19T02:15:29.282217+0000","last_unstale":"2024-04-19T02:15:30.273922+0000","last_undegraded":"2024-04-19T02:15:30.273922+0000","last_fullsized":"2024-04-19T02:15:30.273922+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.276557+0000","last_change":"2024-04-19T02:15:24.530924+0000","last_active":"2024-04-19T02:15:29.276557+0000","last_peered":"2024-04-19T02:15:29.276557+0000","last_clean":"2024-04-19T02:15:29.276557+0000","last_became_active":"2024-04-19T02:15:24.530551+0000","last_became_peered":"2024-04-19T02:15:24.530551+0000","last_unstale":"2024-04-19T02:15:29.276557+0000","last_undegraded":"2024-04-19T02:15:29.276557+0000","last_fullsized":"2024-04-19T02:15:29.276557+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:30.576946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":210,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.275680+0000","last_change":"2024-04-19T02:15:24.533634+0000","last_active":"2024-04-19T02:15:29.275680+0000","last_peered":"2024-04-19T02:15:29.275680+0000","last_clean":"2024-04-19T02:15:29.275680+0000","last_became_active":"2024-04-19T02:15:24.533420+0000","last_became_peered":"2024-04-19T02:15:24.533420+0000","last_unstale":"2024-04-19T02:15:29.275680+0000","last_undegraded":"2024-04-19T02:15:29.275680+0000","last_fullsized":"2024-04-19T02:15:29.275680+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273047+0000","last_change":"2024-04-19T02:15:28.890244+0000","last_active":"2024-04-19T02:15:30.273047+0000","last_peered":"2024-04-19T02:15:30.273047+0000","last_clean":"2024-04-19T02:15:30.273047+0000","last_became_active":"2024-04-19T02:15:28.889831+0000","last_became_peered":"2024-04-19T02:15:28.889831+0000","last_unstale":"2024-04-19T02:15:30.273047+0000","last_undegraded":"2024-04-19T02:15:30.273047+0000","last_fullsized":"2024-04-19T02:15:30.273047+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.753121+0000","last_change":"2024-04-19T02:15:29.285015+0000","last_active":"2024-04-19T02:15:31.753121+0000","last_peered":"2024-04-19T02:15:31.753121+0000","last_clean":"2024-04-19T02:15:31.753121+0000","last_became_active":"2024-04-19T02:15:29.284164+0000","last_became_peered":"2024-04-19T02:15:29.284164+0000","last_unstale":"2024-04-19T02:15:31.753121+0000","last_undegraded":"2024-04-19T02:15:31.753121+0000","last_fullsized":"2024-04-19T02:15:31.753121+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:36.987844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.275722+0000","last_change":"2024-04-19T02:15:24.533912+0000","last_active":"2024-04-19T02:15:29.275722+0000","last_peered":"2024-04-19T02:15:29.275722+0000","last_clean":"2024-04-19T02:15:29.275722+0000","last_became_active":"2024-04-19T02:15:24.533580+0000","last_became_peered":"2024-04-19T02:15:24.533580+0000","last_unstale":"2024-04-19T02:15:29.275722+0000","last_undegraded":"2024-04-19T02:15:29.275722+0000","last_fullsized":"2024-04-19T02:15:29.275722+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:45.045477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.272710+0000","last_change":"2024-04-19T02:15:28.891889+0000","last_active":"2024-04-19T02:15:30.272710+0000","last_peered":"2024-04-19T02:15:30.272710+0000","last_clean":"2024-04-19T02:15:30.272710+0000","last_became_active":"2024-04-19T02:15:28.890919+0000","last_became_peered":"2024-04-19T02:15:28.890919+0000","last_unstale":"2024-04-19T02:15:30.272710+0000","last_undegraded":"2024-04-19T02:15:30.272710+0000","last_fullsized":"2024-04-19T02:15:30.272710+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:35.412837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.275017+0000","last_change":"2024-04-19T02:15:29.284266+0000","last_active":"2024-04-19T02:15:30.275017+0000","last_peered":"2024-04-19T02:15:30.275017+0000","last_clean":"2024-04-19T02:15:30.275017+0000","last_became_active":"2024-04-19T02:15:29.282994+0000","last_became_peered":"2024-04-19T02:15:29.282994+0000","last_unstale":"2024-04-19T02:15:30.275017+0000","last_undegraded":"2024-04-19T02:15:30.275017+0000","last_fullsized":"2024-04-19T02:15:30.275017+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.277544+0000","last_change":"2024-04-19T02:15:24.526751+0000","last_active":"2024-04-19T02:15:29.277544+0000","last_peered":"2024-04-19T02:15:29.277544+0000","last_clean":"2024-04-19T02:15:29.277544+0000","last_became_active":"2024-04-19T02:15:24.526511+0000","last_became_peered":"2024-04-19T02:15:24.526511+0000","last_unstale":"2024-04-19T02:15:29.277544+0000","last_undegraded":"2024-04-19T02:15:29.277544+0000","last_fullsized":"2024-04-19T02:15:29.277544+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:02:45.966851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273736+0000","last_change":"2024-04-19T02:15:28.892125+0000","last_active":"2024-04-19T02:15:30.273736+0000","last_peered":"2024-04-19T02:15:30.273736+0000","last_clean":"2024-04-19T02:15:30.273736+0000","last_became_active":"2024-04-19T02:15:28.891300+0000","last_became_peered":"2024-04-19T02:15:28.891300+0000","last_unstale":"2024-04-19T02:15:30.273736+0000","last_undegraded":"2024-04-19T02:15:30.273736+0000","last_fullsized":"2024-04-19T02:15:30.273736+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274547+0000","last_change":"2024-04-19T02:15:29.281694+0000","last_active":"2024-04-19T02:15:30.274547+0000","last_peered":"2024-04-19T02:15:30.274547+0000","last_clean":"2024-04-19T02:15:30.274547+0000","last_became_active":"2024-04-19T02:15:29.280519+0000","last_became_peered":"2024-04-19T02:15:29.280519+0000","last_unstale":"2024-04-19T02:15:30.274547+0000","last_undegraded":"2024-04-19T02:15:30.274547+0000","last_fullsized":"2024-04-19T02:15:30.274547+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:50.890545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273711+0000","last_change":"2024-04-19T02:15:28.891702+0000","last_active":"2024-04-19T02:15:30.273711+0000","last_peered":"2024-04-19T02:15:30.273711+0000","last_clean":"2024-04-19T02:15:30.273711+0000","last_became_active":"2024-04-19T02:15:28.890743+0000","last_became_peered":"2024-04-19T02:15:28.890743+0000","last_unstale":"2024-04-19T02:15:30.273711+0000","last_undegraded":"2024-04-19T02:15:30.273711+0000","last_fullsized":"2024-04-19T02:15:30.273711+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.269774+0000","last_change":"2024-04-19T02:15:24.526845+0000","last_active":"2024-04-19T02:15:29.269774+0000","last_peered":"2024-04-19T02:15:29.269774+0000","last_clean":"2024-04-19T02:15:29.269774+0000","last_became_active":"2024-04-19T02:15:24.526500+0000","last_became_peered":"2024-04-19T02:15:24.526500+0000","last_unstale":"2024-04-19T02:15:29.269774+0000","last_undegraded":"2024-04-19T02:15:29.269774+0000","last_fullsized":"2024-04-19T02:15:29.269774+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:16.883355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.272678+0000","last_change":"2024-04-19T02:15:29.278686+0000","last_active":"2024-04-19T02:15:30.272678+0000","last_peered":"2024-04-19T02:15:30.272678+0000","last_clean":"2024-04-19T02:15:30.272678+0000","last_became_active":"2024-04-19T02:15:29.278108+0000","last_became_peered":"2024-04-19T02:15:29.278108+0000","last_unstale":"2024-04-19T02:15:30.272678+0000","last_undegraded":"2024-04-19T02:15:30.272678+0000","last_fullsized":"2024-04-19T02:15:30.272678+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:34.593754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.277610+0000","last_change":"2024-04-19T02:15:24.533777+0000","last_active":"2024-04-19T02:15:29.277610+0000","last_peered":"2024-04-19T02:15:29.277610+0000","last_clean":"2024-04-19T02:15:29.277610+0000","last_became_active":"2024-04-19T02:15:24.533436+0000","last_became_peered":"2024-04-19T02:15:24.533436+0000","last_unstale":"2024-04-19T02:15:29.277610+0000","last_undegraded":"2024-04-19T02:15:29.277610+0000","last_fullsized":"2024-04-19T02:15:29.277610+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:53:25.922418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:32.743668+0000","last_change":"2024-04-19T02:15:28.891370+0000","last_active":"2024-04-19T02:15:32.743668+0000","last_peered":"2024-04-19T02:15:32.743668+0000","last_clean":"2024-04-19T02:15:32.743668+0000","last_became_active":"2024-04-19T02:15:28.890702+0000","last_became_peered":"2024-04-19T02:15:28.890702+0000","last_unstale":"2024-04-19T02:15:32.743668+0000","last_undegraded":"2024-04-19T02:15:32.743668+0000","last_fullsized":"2024-04-19T02:15:32.743668+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:33.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274234+0000","last_change":"2024-04-19T02:15:29.282244+0000","last_active":"2024-04-19T02:15:30.274234+0000","last_peered":"2024-04-19T02:15:30.274234+0000","last_clean":"2024-04-19T02:15:30.274234+0000","last_became_active":"2024-04-19T02:15:29.280366+0000","last_became_peered":"2024-04-19T02:15:29.280366+0000","last_unstale":"2024-04-19T02:15:30.274234+0000","last_undegraded":"2024-04-19T02:15:30.274234+0000","last_fullsized":"2024-04-19T02:15:30.274234+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274392+0000","last_change":"2024-04-19T02:15:28.893027+0000","last_active":"2024-04-19T02:15:30.274392+0000","last_peered":"2024-04-19T02:15:30.274392+0000","last_clean":"2024-04-19T02:15:30.274392+0000","last_became_active":"2024-04-19T02:15:28.892695+0000","last_became_peered":"2024-04-19T02:15:28.892695+0000","last_unstale":"2024-04-19T02:15:30.274392+0000","last_undegraded":"2024-04-19T02:15:30.274392+0000","last_fullsized":"2024-04-19T02:15:30.274392+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274805+0000","last_change":"2024-04-19T02:15:29.283155+0000","last_active":"2024-04-19T02:15:30.274805+0000","last_peered":"2024-04-19T02:15:30.274805+0000","last_clean":"2024-04-19T02:15:30.274805+0000","last_became_active":"2024-04-19T02:15:29.281407+0000","last_became_peered":"2024-04-19T02:15:29.281407+0000","last_unstale":"2024-04-19T02:15:30.274805+0000","last_undegraded":"2024-04-19T02:15:30.274805+0000","last_fullsized":"2024-04-19T02:15:30.274805+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752643+0000","last_change":"2024-04-19T02:15:28.893067+0000","last_active":"2024-04-19T02:15:31.752643+0000","last_peered":"2024-04-19T02:15:31.752643+0000","last_clean":"2024-04-19T02:15:31.752643+0000","last_became_active":"2024-04-19T02:15:28.892781+0000","last_became_peered":"2024-04-19T02:15:28.892781+0000","last_unstale":"2024-04-19T02:15:31.752643+0000","last_undegraded":"2024-04-19T02:15:31.752643+0000","last_fullsized":"2024-04-19T02:15:31.752643+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:54:15.590143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752652+0000","last_change":"2024-04-19T02:15:29.281279+0000","last_active":"2024-04-19T02:15:31.752652+0000","last_peered":"2024-04-19T02:15:31.752652+0000","last_clean":"2024-04-19T02:15:31.752652+0000","last_became_active":"2024-04-19T02:15:29.279360+0000","last_became_peered":"2024-04-19T02:15:29.279360+0000","last_unstale":"2024-04-19T02:15:31.752652+0000","last_undegraded":"2024-04-19T02:15:31.752652+0000","last_fullsized":"2024-04-19T02:15:31.752652+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274993+0000","last_change":"2024-04-19T02:15:28.893239+0000","last_active":"2024-04-19T02:15:30.274993+0000","last_peered":"2024-04-19T02:15:30.274993+0000","last_clean":"2024-04-19T02:15:30.274993+0000","last_became_active":"2024-04-19T02:15:28.892881+0000","last_became_peered":"2024-04-19T02:15:28.892881+0000","last_unstale":"2024-04-19T02:15:30.274993+0000","last_undegraded":"2024-04-19T02:15:30.274993+0000","last_fullsized":"2024-04-19T02:15:30.274993+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752362+0000","last_change":"2024-04-19T02:15:29.281652+0000","last_active":"2024-04-19T02:15:31.752362+0000","last_peered":"2024-04-19T02:15:31.752362+0000","last_clean":"2024-04-19T02:15:31.752362+0000","last_became_active":"2024-04-19T02:15:29.281175+0000","last_became_peered":"2024-04-19T02:15:29.281175+0000","last_unstale":"2024-04-19T02:15:31.752362+0000","last_undegraded":"2024-04-19T02:15:31.752362+0000","last_fullsized":"2024-04-19T02:15:31.752362+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:16.568764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273639+0000","last_change":"2024-04-19T02:15:28.892058+0000","last_active":"2024-04-19T02:15:30.273639+0000","last_peered":"2024-04-19T02:15:30.273639+0000","last_clean":"2024-04-19T02:15:30.273639+0000","last_became_active":"2024-04-19T02:15:28.890877+0000","last_became_peered":"2024-04-19T02:15:28.890877+0000","last_unstale":"2024-04-19T02:15:30.273639+0000","last_undegraded":"2024-04-19T02:15:30.273639+0000","last_fullsized":"2024-04-19T02:15:30.273639+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:53.170180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274344+0000","last_change":"2024-04-19T02:15:29.278810+0000","last_active":"2024-04-19T02:15:30.274344+0000","last_peered":"2024-04-19T02:15:30.274344+0000","last_clean":"2024-04-19T02:15:30.274344+0000","last_became_active":"2024-04-19T02:15:29.277913+0000","last_became_peered":"2024-04-19T02:15:29.277913+0000","last_unstale":"2024-04-19T02:15:30.274344+0000","last_undegraded":"2024-04-19T02:15:30.274344+0000","last_fullsized":"2024-04-19T02:15:30.274344+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:24.082666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273821+0000","last_change":"2024-04-19T02:15:28.889132+0000","last_active":"2024-04-19T02:15:30.273821+0000","last_peered":"2024-04-19T02:15:30.273821+0000","last_clean":"2024-04-19T02:15:30.273821+0000","last_became_active":"2024-04-19T02:15:28.888926+0000","last_became_peered":"2024-04-19T02:15:28.888926+0000","last_unstale":"2024-04-19T02:15:30.273821+0000","last_undegraded":"2024-04-19T02:15:30.273821+0000","last_fullsized":"2024-04-19T02:15:30.273821+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752370+0000","last_change":"2024-04-19T02:15:29.282776+0000","last_active":"2024-04-19T02:15:31.752370+0000","last_peered":"2024-04-19T02:15:31.752370+0000","last_clean":"2024-04-19T02:15:31.752370+0000","last_became_active":"2024-04-19T02:15:29.279382+0000","last_became_peered":"2024-04-19T02:15:29.279382+0000","last_unstale":"2024-04-19T02:15:31.752370+0000","last_undegraded":"2024-04-19T02:15:31.752370+0000","last_fullsized":"2024-04-19T02:15:31.752370+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752208+0000","last_change":"2024-04-19T02:15:29.283537+0000","last_active":"2024-04-19T02:15:31.752208+0000","last_peered":"2024-04-19T02:15:31.752208+0000","last_clean":"2024-04-19T02:15:31.752208+0000","last_became_active":"2024-04-19T02:15:29.281801+0000","last_became_peered":"2024-04-19T02:15:29.281801+0000","last_unstale":"2024-04-19T02:15:31.752208+0000","last_undegraded":"2024-04-19T02:15:31.752208+0000","last_fullsized":"2024-04-19T02:15:31.752208+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.272816+0000","last_change":"2024-04-19T02:15:29.281560+0000","last_active":"2024-04-19T02:15:30.272816+0000","last_peered":"2024-04-19T02:15:30.272816+0000","last_clean":"2024-04-19T02:15:30.272816+0000","last_became_active":"2024-04-19T02:15:29.281261+0000","last_became_peered":"2024-04-19T02:15:29.281261+0000","last_unstale":"2024-04-19T02:15:30.272816+0000","last_undegraded":"2024-04-19T02:15:30.272816+0000","last_fullsized":"2024-04-19T02:15:30.272816+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274549+0000","last_change":"2024-04-19T02:15:29.280731+0000","last_active":"2024-04-19T02:15:30.274549+0000","last_peered":"2024-04-19T02:15:30.274549+0000","last_clean":"2024-04-19T02:15:30.274549+0000","last_became_active":"2024-04-19T02:15:29.280340+0000","last_became_peered":"2024-04-19T02:15:29.280340+0000","last_unstale":"2024-04-19T02:15:30.274549+0000","last_undegraded":"2024-04-19T02:15:30.274549+0000","last_fullsized":"2024-04-19T02:15:30.274549+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273481+0000","last_change":"2024-04-19T02:15:29.278702+0000","last_active":"2024-04-19T02:15:30.273481+0000","last_peered":"2024-04-19T02:15:30.273481+0000","last_clean":"2024-04-19T02:15:30.273481+0000","last_became_active":"2024-04-19T02:15:29.277756+0000","last_became_peered":"2024-04-19T02:15:29.277756+0000","last_unstale":"2024-04-19T02:15:30.273481+0000","last_undegraded":"2024-04-19T02:15:30.273481+0000","last_fullsized":"2024-04-19T02:15:30.273481+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274899+0000","last_change":"2024-04-19T02:15:29.277568+0000","last_active":"2024-04-19T02:15:30.274899+0000","last_peered":"2024-04-19T02:15:30.274899+0000","last_clean":"2024-04-19T02:15:30.274899+0000","last_became_active":"2024-04-19T02:15:29.276725+0000","last_became_peered":"2024-04-19T02:15:29.276725+0000","last_unstale":"2024-04-19T02:15:30.274899+0000","last_undegraded":"2024-04-19T02:15:30.274899+0000","last_fullsized":"2024-04-19T02:15:30.274899+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738375,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":139264,"data_stored":46663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]}]},{"osd":0,"up_from":8,"seq":34359738376,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31856,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":757760,"data_stored":638777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]}]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":749568,"data_stored":638161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:15:51.301 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:15:51.665 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:15:51.666 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-04-19T02:15:51.674 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-04-19T02:15:50.742117+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":86784,"kb_used_data":1608,"kb_used_omap":4,"kb_used_meta":85115,"kb_avail":283028736,"statfs":{"total":289910292480,"available":289821425664,"internally_reserved":0,"allocated":1646592,"data_stored":1323601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":87158098},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002613"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.275255+0000","last_change":"2024-04-19T02:15:29.280412+0000","last_active":"2024-04-19T02:15:30.275255+0000","last_peered":"2024-04-19T02:15:30.275255+0000","last_clean":"2024-04-19T02:15:30.275255+0000","last_became_active":"2024-04-19T02:15:29.278762+0000","last_became_peered":"2024-04-19T02:15:29.278762+0000","last_unstale":"2024-04-19T02:15:30.275255+0000","last_undegraded":"2024-04-19T02:15:30.275255+0000","last_fullsized":"2024-04-19T02:15:30.275255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:45.301675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274720+0000","last_change":"2024-04-19T02:15:29.284695+0000","last_active":"2024-04-19T02:15:30.274720+0000","last_peered":"2024-04-19T02:15:30.274720+0000","last_clean":"2024-04-19T02:15:30.274720+0000","last_became_active":"2024-04-19T02:15:29.283468+0000","last_became_peered":"2024-04-19T02:15:29.283468+0000","last_unstale":"2024-04-19T02:15:30.274720+0000","last_undegraded":"2024-04-19T02:15:30.274720+0000","last_fullsized":"2024-04-19T02:15:30.274720+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.384881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752988+0000","last_change":"2024-04-19T02:15:29.286709+0000","last_active":"2024-04-19T02:15:31.752988+0000","last_peered":"2024-04-19T02:15:31.752988+0000","last_clean":"2024-04-19T02:15:31.752988+0000","last_became_active":"2024-04-19T02:15:29.286169+0000","last_became_peered":"2024-04-19T02:15:29.286169+0000","last_unstale":"2024-04-19T02:15:31.752988+0000","last_undegraded":"2024-04-19T02:15:31.752988+0000","last_fullsized":"2024-04-19T02:15:31.752988+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:58.741466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752842+0000","last_change":"2024-04-19T02:15:29.280131+0000","last_active":"2024-04-19T02:15:31.752842+0000","last_peered":"2024-04-19T02:15:31.752842+0000","last_clean":"2024-04-19T02:15:31.752842+0000","last_became_active":"2024-04-19T02:15:29.279388+0000","last_became_peered":"2024-04-19T02:15:29.279388+0000","last_unstale":"2024-04-19T02:15:31.752842+0000","last_undegraded":"2024-04-19T02:15:31.752842+0000","last_fullsized":"2024-04-19T02:15:31.752842+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:36:48.819486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274570+0000","last_change":"2024-04-19T02:15:29.279377+0000","last_active":"2024-04-19T02:15:30.274570+0000","last_peered":"2024-04-19T02:15:30.274570+0000","last_clean":"2024-04-19T02:15:30.274570+0000","last_became_active":"2024-04-19T02:15:29.278954+0000","last_became_peered":"2024-04-19T02:15:29.278954+0000","last_unstale":"2024-04-19T02:15:30.274570+0000","last_undegraded":"2024-04-19T02:15:30.274570+0000","last_fullsized":"2024-04-19T02:15:30.274570+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:34.883207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752217+0000","last_change":"2024-04-19T02:15:29.283908+0000","last_active":"2024-04-19T02:15:31.752217+0000","last_peered":"2024-04-19T02:15:31.752217+0000","last_clean":"2024-04-19T02:15:31.752217+0000","last_became_active":"2024-04-19T02:15:29.281729+0000","last_became_peered":"2024-04-19T02:15:29.281729+0000","last_unstale":"2024-04-19T02:15:31.752217+0000","last_undegraded":"2024-04-19T02:15:31.752217+0000","last_fullsized":"2024-04-19T02:15:31.752217+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:03:15.383476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752077+0000","last_change":"2024-04-19T02:15:29.281253+0000","last_active":"2024-04-19T02:15:31.752077+0000","last_peered":"2024-04-19T02:15:31.752077+0000","last_clean":"2024-04-19T02:15:31.752077+0000","last_became_active":"2024-04-19T02:15:29.279951+0000","last_became_peered":"2024-04-19T02:15:29.279951+0000","last_unstale":"2024-04-19T02:15:31.752077+0000","last_undegraded":"2024-04-19T02:15:31.752077+0000","last_fullsized":"2024-04-19T02:15:31.752077+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.751969+0000","last_change":"2024-04-19T02:15:29.283952+0000","last_active":"2024-04-19T02:15:31.751969+0000","last_peered":"2024-04-19T02:15:31.751969+0000","last_clean":"2024-04-19T02:15:31.751969+0000","last_became_active":"2024-04-19T02:15:29.282721+0000","last_became_peered":"2024-04-19T02:15:29.282721+0000","last_unstale":"2024-04-19T02:15:31.751969+0000","last_undegraded":"2024-04-19T02:15:31.751969+0000","last_fullsized":"2024-04-19T02:15:31.751969+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:45.301675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273597+0000","last_change":"2024-04-19T02:15:29.282150+0000","last_active":"2024-04-19T02:15:30.273597+0000","last_peered":"2024-04-19T02:15:30.273597+0000","last_clean":"2024-04-19T02:15:30.273597+0000","last_became_active":"2024-04-19T02:15:29.281538+0000","last_became_peered":"2024-04-19T02:15:29.281538+0000","last_unstale":"2024-04-19T02:15:30.273597+0000","last_undegraded":"2024-04-19T02:15:30.273597+0000","last_fullsized":"2024-04-19T02:15:30.273597+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274996+0000","last_change":"2024-04-19T02:15:29.284098+0000","last_active":"2024-04-19T02:15:30.274996+0000","last_peered":"2024-04-19T02:15:30.274996+0000","last_clean":"2024-04-19T02:15:30.274996+0000","last_became_active":"2024-04-19T02:15:29.282114+0000","last_became_peered":"2024-04-19T02:15:29.282114+0000","last_unstale":"2024-04-19T02:15:30.274996+0000","last_undegraded":"2024-04-19T02:15:30.274996+0000","last_fullsized":"2024-04-19T02:15:30.274996+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:16.568764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752773+0000","last_change":"2024-04-19T02:15:29.280606+0000","last_active":"2024-04-19T02:15:31.752773+0000","last_peered":"2024-04-19T02:15:31.752773+0000","last_clean":"2024-04-19T02:15:31.752773+0000","last_became_active":"2024-04-19T02:15:29.280151+0000","last_became_peered":"2024-04-19T02:15:29.280151+0000","last_unstale":"2024-04-19T02:15:31.752773+0000","last_undegraded":"2024-04-19T02:15:31.752773+0000","last_fullsized":"2024-04-19T02:15:31.752773+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:26:22.452488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274472+0000","last_change":"2024-04-19T02:15:29.283378+0000","last_active":"2024-04-19T02:15:30.274472+0000","last_peered":"2024-04-19T02:15:30.274472+0000","last_clean":"2024-04-19T02:15:30.274472+0000","last_became_active":"2024-04-19T02:15:29.281571+0000","last_became_peered":"2024-04-19T02:15:29.281571+0000","last_unstale":"2024-04-19T02:15:30.274472+0000","last_undegraded":"2024-04-19T02:15:30.274472+0000","last_fullsized":"2024-04-19T02:15:30.274472+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274373+0000","last_change":"2024-04-19T02:15:29.281811+0000","last_active":"2024-04-19T02:15:30.274373+0000","last_peered":"2024-04-19T02:15:30.274373+0000","last_clean":"2024-04-19T02:15:30.274373+0000","last_became_active":"2024-04-19T02:15:29.280700+0000","last_became_peered":"2024-04-19T02:15:29.280700+0000","last_unstale":"2024-04-19T02:15:30.274373+0000","last_undegraded":"2024-04-19T02:15:30.274373+0000","last_fullsized":"2024-04-19T02:15:30.274373+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752607+0000","last_change":"2024-04-19T02:15:29.284262+0000","last_active":"2024-04-19T02:15:31.752607+0000","last_peered":"2024-04-19T02:15:31.752607+0000","last_clean":"2024-04-19T02:15:31.752607+0000","last_became_active":"2024-04-19T02:15:29.283121+0000","last_became_peered":"2024-04-19T02:15:29.283121+0000","last_unstale":"2024-04-19T02:15:31.752607+0000","last_undegraded":"2024-04-19T02:15:31.752607+0000","last_fullsized":"2024-04-19T02:15:31.752607+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752216+0000","last_change":"2024-04-19T02:15:29.285139+0000","last_active":"2024-04-19T02:15:31.752216+0000","last_peered":"2024-04-19T02:15:31.752216+0000","last_clean":"2024-04-19T02:15:31.752216+0000","last_became_active":"2024-04-19T02:15:29.284649+0000","last_became_peered":"2024-04-19T02:15:29.284649+0000","last_unstale":"2024-04-19T02:15:31.752216+0000","last_undegraded":"2024-04-19T02:15:31.752216+0000","last_fullsized":"2024-04-19T02:15:31.752216+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752064+0000","last_change":"2024-04-19T02:15:29.283648+0000","last_active":"2024-04-19T02:15:31.752064+0000","last_peered":"2024-04-19T02:15:31.752064+0000","last_clean":"2024-04-19T02:15:31.752064+0000","last_became_active":"2024-04-19T02:15:29.281606+0000","last_became_peered":"2024-04-19T02:15:29.281606+0000","last_unstale":"2024-04-19T02:15:31.752064+0000","last_undegraded":"2024-04-19T02:15:31.752064+0000","last_fullsized":"2024-04-19T02:15:31.752064+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273606+0000","last_change":"2024-04-19T02:15:29.278673+0000","last_active":"2024-04-19T02:15:30.273606+0000","last_peered":"2024-04-19T02:15:30.273606+0000","last_clean":"2024-04-19T02:15:30.273606+0000","last_became_active":"2024-04-19T02:15:29.277699+0000","last_became_peered":"2024-04-19T02:15:29.277699+0000","last_unstale":"2024-04-19T02:15:30.273606+0000","last_undegraded":"2024-04-19T02:15:30.273606+0000","last_fullsized":"2024-04-19T02:15:30.273606+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.275113+0000","last_change":"2024-04-19T02:15:29.283341+0000","last_active":"2024-04-19T02:15:30.275113+0000","last_peered":"2024-04-19T02:15:30.275113+0000","last_clean":"2024-04-19T02:15:30.275113+0000","last_became_active":"2024-04-19T02:15:29.281591+0000","last_became_peered":"2024-04-19T02:15:29.281591+0000","last_unstale":"2024-04-19T02:15:30.275113+0000","last_undegraded":"2024-04-19T02:15:30.275113+0000","last_fullsized":"2024-04-19T02:15:30.275113+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:34.593754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273356+0000","last_change":"2024-04-19T02:15:29.282110+0000","last_active":"2024-04-19T02:15:30.273356+0000","last_peered":"2024-04-19T02:15:30.273356+0000","last_clean":"2024-04-19T02:15:30.273356+0000","last_became_active":"2024-04-19T02:15:29.281716+0000","last_became_peered":"2024-04-19T02:15:29.281716+0000","last_unstale":"2024-04-19T02:15:30.273356+0000","last_undegraded":"2024-04-19T02:15:30.273356+0000","last_fullsized":"2024-04-19T02:15:30.273356+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752789+0000","last_change":"2024-04-19T02:15:29.285237+0000","last_active":"2024-04-19T02:15:31.752789+0000","last_peered":"2024-04-19T02:15:31.752789+0000","last_clean":"2024-04-19T02:15:31.752789+0000","last_became_active":"2024-04-19T02:15:29.282790+0000","last_became_peered":"2024-04-19T02:15:29.282790+0000","last_unstale":"2024-04-19T02:15:31.752789+0000","last_undegraded":"2024-04-19T02:15:31.752789+0000","last_fullsized":"2024-04-19T02:15:31.752789+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752599+0000","last_change":"2024-04-19T02:15:29.282609+0000","last_active":"2024-04-19T02:15:31.752599+0000","last_peered":"2024-04-19T02:15:31.752599+0000","last_clean":"2024-04-19T02:15:31.752599+0000","last_became_active":"2024-04-19T02:15:29.281665+0000","last_became_peered":"2024-04-19T02:15:29.281665+0000","last_unstale":"2024-04-19T02:15:31.752599+0000","last_undegraded":"2024-04-19T02:15:31.752599+0000","last_fullsized":"2024-04-19T02:15:31.752599+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.384881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274303+0000","last_change":"2024-04-19T02:15:29.278890+0000","last_active":"2024-04-19T02:15:30.274303+0000","last_peered":"2024-04-19T02:15:30.274303+0000","last_clean":"2024-04-19T02:15:30.274303+0000","last_became_active":"2024-04-19T02:15:29.278074+0000","last_became_peered":"2024-04-19T02:15:29.278074+0000","last_unstale":"2024-04-19T02:15:30.274303+0000","last_undegraded":"2024-04-19T02:15:30.274303+0000","last_fullsized":"2024-04-19T02:15:30.274303+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:00.191179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.272977+0000","last_change":"2024-04-19T02:15:29.277109+0000","last_active":"2024-04-19T02:15:30.272977+0000","last_peered":"2024-04-19T02:15:30.272977+0000","last_clean":"2024-04-19T02:15:30.272977+0000","last_became_active":"2024-04-19T02:15:29.275417+0000","last_became_peered":"2024-04-19T02:15:29.275417+0000","last_unstale":"2024-04-19T02:15:30.272977+0000","last_undegraded":"2024-04-19T02:15:30.272977+0000","last_fullsized":"2024-04-19T02:15:30.272977+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274103+0000","last_change":"2024-04-19T02:15:29.283266+0000","last_active":"2024-04-19T02:15:30.274103+0000","last_peered":"2024-04-19T02:15:30.274103+0000","last_clean":"2024-04-19T02:15:30.274103+0000","last_became_active":"2024-04-19T02:15:29.281505+0000","last_became_peered":"2024-04-19T02:15:29.281505+0000","last_unstale":"2024-04-19T02:15:30.274103+0000","last_undegraded":"2024-04-19T02:15:30.274103+0000","last_fullsized":"2024-04-19T02:15:30.274103+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.275172+0000","last_change":"2024-04-19T02:15:29.278084+0000","last_active":"2024-04-19T02:15:30.275172+0000","last_peered":"2024-04-19T02:15:30.275172+0000","last_clean":"2024-04-19T02:15:30.275172+0000","last_became_active":"2024-04-19T02:15:29.276952+0000","last_became_peered":"2024-04-19T02:15:29.276952+0000","last_unstale":"2024-04-19T02:15:30.275172+0000","last_undegraded":"2024-04-19T02:15:30.275172+0000","last_fullsized":"2024-04-19T02:15:30.275172+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273711+0000","last_change":"2024-04-19T02:15:29.279904+0000","last_active":"2024-04-19T02:15:30.273711+0000","last_peered":"2024-04-19T02:15:30.273711+0000","last_clean":"2024-04-19T02:15:30.273711+0000","last_became_active":"2024-04-19T02:15:29.278938+0000","last_became_peered":"2024-04-19T02:15:29.278938+0000","last_unstale":"2024-04-19T02:15:30.273711+0000","last_undegraded":"2024-04-19T02:15:30.273711+0000","last_fullsized":"2024-04-19T02:15:30.273711+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752884+0000","last_change":"2024-04-19T02:15:29.287389+0000","last_active":"2024-04-19T02:15:31.752884+0000","last_peered":"2024-04-19T02:15:31.752884+0000","last_clean":"2024-04-19T02:15:31.752884+0000","last_became_active":"2024-04-19T02:15:29.286431+0000","last_became_peered":"2024-04-19T02:15:29.286431+0000","last_unstale":"2024-04-19T02:15:31.752884+0000","last_undegraded":"2024-04-19T02:15:31.752884+0000","last_fullsized":"2024-04-19T02:15:31.752884+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:58:30.117887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274282+0000","last_change":"2024-04-19T02:15:28.890403+0000","last_active":"2024-04-19T02:15:30.274282+0000","last_peered":"2024-04-19T02:15:30.274282+0000","last_clean":"2024-04-19T02:15:30.274282+0000","last_became_active":"2024-04-19T02:15:28.889780+0000","last_became_peered":"2024-04-19T02:15:28.889780+0000","last_unstale":"2024-04-19T02:15:30.274282+0000","last_undegraded":"2024-04-19T02:15:30.274282+0000","last_fullsized":"2024-04-19T02:15:30.274282+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:52:15.842316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.275112+0000","last_change":"2024-04-19T02:15:29.281792+0000","last_active":"2024-04-19T02:15:30.275112+0000","last_peered":"2024-04-19T02:15:30.275112+0000","last_clean":"2024-04-19T02:15:30.275112+0000","last_became_active":"2024-04-19T02:15:29.280479+0000","last_became_peered":"2024-04-19T02:15:29.280479+0000","last_unstale":"2024-04-19T02:15:30.275112+0000","last_undegraded":"2024-04-19T02:15:30.275112+0000","last_fullsized":"2024-04-19T02:15:30.275112+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273058+0000","last_change":"2024-04-19T02:15:28.888778+0000","last_active":"2024-04-19T02:15:30.273058+0000","last_peered":"2024-04-19T02:15:30.273058+0000","last_clean":"2024-04-19T02:15:30.273058+0000","last_became_active":"2024-04-19T02:15:28.888543+0000","last_became_peered":"2024-04-19T02:15:28.888543+0000","last_unstale":"2024-04-19T02:15:30.273058+0000","last_undegraded":"2024-04-19T02:15:30.273058+0000","last_fullsized":"2024-04-19T02:15:30.273058+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:43:51.221619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273526+0000","last_change":"2024-04-19T02:15:29.279986+0000","last_active":"2024-04-19T02:15:30.273526+0000","last_peered":"2024-04-19T02:15:30.273526+0000","last_clean":"2024-04-19T02:15:30.273526+0000","last_became_active":"2024-04-19T02:15:29.279690+0000","last_became_peered":"2024-04-19T02:15:29.279690+0000","last_unstale":"2024-04-19T02:15:30.273526+0000","last_undegraded":"2024-04-19T02:15:30.273526+0000","last_fullsized":"2024-04-19T02:15:30.273526+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.272885+0000","last_change":"2024-04-19T02:15:28.890463+0000","last_active":"2024-04-19T02:15:30.272885+0000","last_peered":"2024-04-19T02:15:30.272885+0000","last_clean":"2024-04-19T02:15:30.272885+0000","last_became_active":"2024-04-19T02:15:28.889777+0000","last_became_peered":"2024-04-19T02:15:28.889777+0000","last_unstale":"2024-04-19T02:15:30.272885+0000","last_undegraded":"2024-04-19T02:15:30.272885+0000","last_fullsized":"2024-04-19T02:15:30.272885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:58:21.520250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.275141+0000","last_change":"2024-04-19T02:15:29.280879+0000","last_active":"2024-04-19T02:15:30.275141+0000","last_peered":"2024-04-19T02:15:30.275141+0000","last_clean":"2024-04-19T02:15:30.275141+0000","last_became_active":"2024-04-19T02:15:29.279314+0000","last_became_peered":"2024-04-19T02:15:29.279314+0000","last_unstale":"2024-04-19T02:15:30.275141+0000","last_undegraded":"2024-04-19T02:15:30.275141+0000","last_fullsized":"2024-04-19T02:15:30.275141+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273829+0000","last_change":"2024-04-19T02:15:28.891867+0000","last_active":"2024-04-19T02:15:30.273829+0000","last_peered":"2024-04-19T02:15:30.273829+0000","last_clean":"2024-04-19T02:15:30.273829+0000","last_became_active":"2024-04-19T02:15:28.890806+0000","last_became_peered":"2024-04-19T02:15:28.890806+0000","last_unstale":"2024-04-19T02:15:30.273829+0000","last_undegraded":"2024-04-19T02:15:30.273829+0000","last_fullsized":"2024-04-19T02:15:30.273829+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:57.946581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.272758+0000","last_change":"2024-04-19T02:15:29.278148+0000","last_active":"2024-04-19T02:15:30.272758+0000","last_peered":"2024-04-19T02:15:30.272758+0000","last_clean":"2024-04-19T02:15:30.272758+0000","last_became_active":"2024-04-19T02:15:29.277402+0000","last_became_peered":"2024-04-19T02:15:29.277402+0000","last_unstale":"2024-04-19T02:15:30.272758+0000","last_undegraded":"2024-04-19T02:15:30.272758+0000","last_fullsized":"2024-04-19T02:15:30.272758+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752928+0000","last_change":"2024-04-19T02:15:28.892905+0000","last_active":"2024-04-19T02:15:31.752928+0000","last_peered":"2024-04-19T02:15:31.752928+0000","last_clean":"2024-04-19T02:15:31.752928+0000","last_became_active":"2024-04-19T02:15:28.892541+0000","last_became_peered":"2024-04-19T02:15:28.892541+0000","last_unstale":"2024-04-19T02:15:31.752928+0000","last_undegraded":"2024-04-19T02:15:31.752928+0000","last_fullsized":"2024-04-19T02:15:31.752928+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:33.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273109+0000","last_change":"2024-04-19T02:15:29.278810+0000","last_active":"2024-04-19T02:15:30.273109+0000","last_peered":"2024-04-19T02:15:30.273109+0000","last_clean":"2024-04-19T02:15:30.273109+0000","last_became_active":"2024-04-19T02:15:29.278093+0000","last_became_peered":"2024-04-19T02:15:29.278093+0000","last_unstale":"2024-04-19T02:15:30.273109+0000","last_undegraded":"2024-04-19T02:15:30.273109+0000","last_fullsized":"2024-04-19T02:15:30.273109+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:34.883207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274867+0000","last_change":"2024-04-19T02:15:28.892937+0000","last_active":"2024-04-19T02:15:30.274867+0000","last_peered":"2024-04-19T02:15:30.274867+0000","last_clean":"2024-04-19T02:15:30.274867+0000","last_became_active":"2024-04-19T02:15:28.891440+0000","last_became_peered":"2024-04-19T02:15:28.891440+0000","last_unstale":"2024-04-19T02:15:30.274867+0000","last_undegraded":"2024-04-19T02:15:30.274867+0000","last_fullsized":"2024-04-19T02:15:30.274867+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273027+0000","last_change":"2024-04-19T02:15:29.278404+0000","last_active":"2024-04-19T02:15:30.273027+0000","last_peered":"2024-04-19T02:15:30.273027+0000","last_clean":"2024-04-19T02:15:30.273027+0000","last_became_active":"2024-04-19T02:15:29.277460+0000","last_became_peered":"2024-04-19T02:15:29.277460+0000","last_unstale":"2024-04-19T02:15:30.273027+0000","last_undegraded":"2024-04-19T02:15:30.273027+0000","last_fullsized":"2024-04-19T02:15:30.273027+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752700+0000","last_change":"2024-04-19T02:15:28.891097+0000","last_active":"2024-04-19T02:15:31.752700+0000","last_peered":"2024-04-19T02:15:31.752700+0000","last_clean":"2024-04-19T02:15:31.752700+0000","last_became_active":"2024-04-19T02:15:28.890795+0000","last_became_peered":"2024-04-19T02:15:28.890795+0000","last_unstale":"2024-04-19T02:15:31.752700+0000","last_undegraded":"2024-04-19T02:15:31.752700+0000","last_fullsized":"2024-04-19T02:15:31.752700+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752913+0000","last_change":"2024-04-19T02:15:29.278546+0000","last_active":"2024-04-19T02:15:31.752913+0000","last_peered":"2024-04-19T02:15:31.752913+0000","last_clean":"2024-04-19T02:15:31.752913+0000","last_became_active":"2024-04-19T02:15:29.277547+0000","last_became_peered":"2024-04-19T02:15:29.277547+0000","last_unstale":"2024-04-19T02:15:31.752913+0000","last_undegraded":"2024-04-19T02:15:31.752913+0000","last_fullsized":"2024-04-19T02:15:31.752913+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752826+0000","last_change":"2024-04-19T02:15:28.892977+0000","last_active":"2024-04-19T02:15:31.752826+0000","last_peered":"2024-04-19T02:15:31.752826+0000","last_clean":"2024-04-19T02:15:31.752826+0000","last_became_active":"2024-04-19T02:15:28.892636+0000","last_became_peered":"2024-04-19T02:15:28.892636+0000","last_unstale":"2024-04-19T02:15:31.752826+0000","last_undegraded":"2024-04-19T02:15:31.752826+0000","last_fullsized":"2024-04-19T02:15:31.752826+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:43:51.221619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274651+0000","last_change":"2024-04-19T02:15:29.284260+0000","last_active":"2024-04-19T02:15:30.274651+0000","last_peered":"2024-04-19T02:15:30.274651+0000","last_clean":"2024-04-19T02:15:30.274651+0000","last_became_active":"2024-04-19T02:15:29.282990+0000","last_became_peered":"2024-04-19T02:15:29.282990+0000","last_unstale":"2024-04-19T02:15:30.274651+0000","last_undegraded":"2024-04-19T02:15:30.274651+0000","last_fullsized":"2024-04-19T02:15:30.274651+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:36:48.819486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273207+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:15:30.273207+0000","last_peered":"2024-04-19T02:15:30.273207+0000","last_clean":"2024-04-19T02:15:30.273207+0000","last_became_active":"2024-04-19T02:15:28.890751+0000","last_became_peered":"2024-04-19T02:15:28.890751+0000","last_unstale":"2024-04-19T02:15:30.273207+0000","last_undegraded":"2024-04-19T02:15:30.273207+0000","last_fullsized":"2024-04-19T02:15:30.273207+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.275108+0000","last_change":"2024-04-19T02:15:29.282068+0000","last_active":"2024-04-19T02:15:30.275108+0000","last_peered":"2024-04-19T02:15:30.275108+0000","last_clean":"2024-04-19T02:15:30.275108+0000","last_became_active":"2024-04-19T02:15:29.280450+0000","last_became_peered":"2024-04-19T02:15:29.280450+0000","last_unstale":"2024-04-19T02:15:30.275108+0000","last_undegraded":"2024-04-19T02:15:30.275108+0000","last_fullsized":"2024-04-19T02:15:30.275108+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274189+0000","last_change":"2024-04-19T02:15:28.892934+0000","last_active":"2024-04-19T02:15:30.274189+0000","last_peered":"2024-04-19T02:15:30.274189+0000","last_clean":"2024-04-19T02:15:30.274189+0000","last_became_active":"2024-04-19T02:15:28.891879+0000","last_became_peered":"2024-04-19T02:15:28.891879+0000","last_unstale":"2024-04-19T02:15:30.274189+0000","last_undegraded":"2024-04-19T02:15:30.274189+0000","last_fullsized":"2024-04-19T02:15:30.274189+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:10:12.514798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273640+0000","last_change":"2024-04-19T02:15:29.279685+0000","last_active":"2024-04-19T02:15:30.273640+0000","last_peered":"2024-04-19T02:15:30.273640+0000","last_clean":"2024-04-19T02:15:30.273640+0000","last_became_active":"2024-04-19T02:15:29.278810+0000","last_became_peered":"2024-04-19T02:15:29.278810+0000","last_unstale":"2024-04-19T02:15:30.273640+0000","last_undegraded":"2024-04-19T02:15:30.273640+0000","last_fullsized":"2024-04-19T02:15:30.273640+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752370+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:15:31.752370+0000","last_peered":"2024-04-19T02:15:31.752370+0000","last_clean":"2024-04-19T02:15:31.752370+0000","last_became_active":"2024-04-19T02:15:28.890882+0000","last_became_peered":"2024-04-19T02:15:28.890882+0000","last_unstale":"2024-04-19T02:15:31.752370+0000","last_undegraded":"2024-04-19T02:15:31.752370+0000","last_fullsized":"2024-04-19T02:15:31.752370+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:31.673938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274006+0000","last_change":"2024-04-19T02:15:29.284258+0000","last_active":"2024-04-19T02:15:30.274006+0000","last_peered":"2024-04-19T02:15:30.274006+0000","last_clean":"2024-04-19T02:15:30.274006+0000","last_became_active":"2024-04-19T02:15:29.283995+0000","last_became_peered":"2024-04-19T02:15:29.283995+0000","last_unstale":"2024-04-19T02:15:30.274006+0000","last_undegraded":"2024-04-19T02:15:30.274006+0000","last_fullsized":"2024-04-19T02:15:30.274006+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:35.941308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.753137+0000","last_change":"2024-04-19T02:15:28.890265+0000","last_active":"2024-04-19T02:15:31.753137+0000","last_peered":"2024-04-19T02:15:31.753137+0000","last_clean":"2024-04-19T02:15:31.753137+0000","last_became_active":"2024-04-19T02:15:28.890004+0000","last_became_peered":"2024-04-19T02:15:28.890004+0000","last_unstale":"2024-04-19T02:15:31.753137+0000","last_undegraded":"2024-04-19T02:15:31.753137+0000","last_fullsized":"2024-04-19T02:15:31.753137+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:02.517101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273866+0000","last_change":"2024-04-19T02:15:29.285529+0000","last_active":"2024-04-19T02:15:30.273866+0000","last_peered":"2024-04-19T02:15:30.273866+0000","last_clean":"2024-04-19T02:15:30.273866+0000","last_became_active":"2024-04-19T02:15:29.285197+0000","last_became_peered":"2024-04-19T02:15:29.285197+0000","last_unstale":"2024-04-19T02:15:30.273866+0000","last_undegraded":"2024-04-19T02:15:30.273866+0000","last_fullsized":"2024-04-19T02:15:30.273866+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274737+0000","last_change":"2024-04-19T02:15:28.893902+0000","last_active":"2024-04-19T02:15:30.274737+0000","last_peered":"2024-04-19T02:15:30.274737+0000","last_clean":"2024-04-19T02:15:30.274737+0000","last_became_active":"2024-04-19T02:15:28.893231+0000","last_became_peered":"2024-04-19T02:15:28.893231+0000","last_unstale":"2024-04-19T02:15:30.274737+0000","last_undegraded":"2024-04-19T02:15:30.274737+0000","last_fullsized":"2024-04-19T02:15:30.274737+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:23.658442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274341+0000","last_change":"2024-04-19T02:15:29.282874+0000","last_active":"2024-04-19T02:15:30.274341+0000","last_peered":"2024-04-19T02:15:30.274341+0000","last_clean":"2024-04-19T02:15:30.274341+0000","last_became_active":"2024-04-19T02:15:29.281675+0000","last_became_peered":"2024-04-19T02:15:29.281675+0000","last_unstale":"2024-04-19T02:15:30.274341+0000","last_undegraded":"2024-04-19T02:15:30.274341+0000","last_fullsized":"2024-04-19T02:15:30.274341+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:35.941308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752851+0000","last_change":"2024-04-19T02:15:28.891234+0000","last_active":"2024-04-19T02:15:31.752851+0000","last_peered":"2024-04-19T02:15:31.752851+0000","last_clean":"2024-04-19T02:15:31.752851+0000","last_became_active":"2024-04-19T02:15:28.890881+0000","last_became_peered":"2024-04-19T02:15:28.890881+0000","last_unstale":"2024-04-19T02:15:31.752851+0000","last_undegraded":"2024-04-19T02:15:31.752851+0000","last_fullsized":"2024-04-19T02:15:31.752851+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752380+0000","last_change":"2024-04-19T02:15:29.281937+0000","last_active":"2024-04-19T02:15:31.752380+0000","last_peered":"2024-04-19T02:15:31.752380+0000","last_clean":"2024-04-19T02:15:31.752380+0000","last_became_active":"2024-04-19T02:15:29.280727+0000","last_became_peered":"2024-04-19T02:15:29.280727+0000","last_unstale":"2024-04-19T02:15:31.752380+0000","last_undegraded":"2024-04-19T02:15:31.752380+0000","last_fullsized":"2024-04-19T02:15:31.752380+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752346+0000","last_change":"2024-04-19T02:15:28.892767+0000","last_active":"2024-04-19T02:15:31.752346+0000","last_peered":"2024-04-19T02:15:31.752346+0000","last_clean":"2024-04-19T02:15:31.752346+0000","last_became_active":"2024-04-19T02:15:28.892235+0000","last_became_peered":"2024-04-19T02:15:28.892235+0000","last_unstale":"2024-04-19T02:15:31.752346+0000","last_undegraded":"2024-04-19T02:15:31.752346+0000","last_fullsized":"2024-04-19T02:15:31.752346+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:37.690735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273357+0000","last_change":"2024-04-19T02:15:29.279857+0000","last_active":"2024-04-19T02:15:30.273357+0000","last_peered":"2024-04-19T02:15:30.273357+0000","last_clean":"2024-04-19T02:15:30.273357+0000","last_became_active":"2024-04-19T02:15:29.279536+0000","last_became_peered":"2024-04-19T02:15:29.279536+0000","last_unstale":"2024-04-19T02:15:30.273357+0000","last_undegraded":"2024-04-19T02:15:30.273357+0000","last_fullsized":"2024-04-19T02:15:30.273357+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:00.191179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273138+0000","last_change":"2024-04-19T02:15:28.891611+0000","last_active":"2024-04-19T02:15:30.273138+0000","last_peered":"2024-04-19T02:15:30.273138+0000","last_clean":"2024-04-19T02:15:30.273138+0000","last_became_active":"2024-04-19T02:15:28.890914+0000","last_became_peered":"2024-04-19T02:15:28.890914+0000","last_unstale":"2024-04-19T02:15:30.273138+0000","last_undegraded":"2024-04-19T02:15:30.273138+0000","last_fullsized":"2024-04-19T02:15:30.273138+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:37.690735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752522+0000","last_change":"2024-04-19T02:15:29.285774+0000","last_active":"2024-04-19T02:15:31.752522+0000","last_peered":"2024-04-19T02:15:31.752522+0000","last_clean":"2024-04-19T02:15:31.752522+0000","last_became_active":"2024-04-19T02:15:29.284705+0000","last_became_peered":"2024-04-19T02:15:29.284705+0000","last_unstale":"2024-04-19T02:15:31.752522+0000","last_undegraded":"2024-04-19T02:15:31.752522+0000","last_fullsized":"2024-04-19T02:15:31.752522+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752240+0000","last_change":"2024-04-19T02:15:28.892873+0000","last_active":"2024-04-19T02:15:31.752240+0000","last_peered":"2024-04-19T02:15:31.752240+0000","last_clean":"2024-04-19T02:15:31.752240+0000","last_became_active":"2024-04-19T02:15:28.892487+0000","last_became_peered":"2024-04-19T02:15:28.892487+0000","last_unstale":"2024-04-19T02:15:31.752240+0000","last_undegraded":"2024-04-19T02:15:31.752240+0000","last_fullsized":"2024-04-19T02:15:31.752240+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:35.412837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.753131+0000","last_change":"2024-04-19T02:15:29.285019+0000","last_active":"2024-04-19T02:15:31.753131+0000","last_peered":"2024-04-19T02:15:31.753131+0000","last_clean":"2024-04-19T02:15:31.753131+0000","last_became_active":"2024-04-19T02:15:29.284650+0000","last_became_peered":"2024-04-19T02:15:29.284650+0000","last_unstale":"2024-04-19T02:15:31.753131+0000","last_undegraded":"2024-04-19T02:15:31.753131+0000","last_fullsized":"2024-04-19T02:15:31.753131+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273991+0000","last_change":"2024-04-19T02:15:28.893245+0000","last_active":"2024-04-19T02:15:30.273991+0000","last_peered":"2024-04-19T02:15:30.273991+0000","last_clean":"2024-04-19T02:15:30.273991+0000","last_became_active":"2024-04-19T02:15:28.891932+0000","last_became_peered":"2024-04-19T02:15:28.891932+0000","last_unstale":"2024-04-19T02:15:30.273991+0000","last_undegraded":"2024-04-19T02:15:30.273991+0000","last_fullsized":"2024-04-19T02:15:30.273991+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:30.518182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.753047+0000","last_change":"2024-04-19T02:15:29.287190+0000","last_active":"2024-04-19T02:15:31.753047+0000","last_peered":"2024-04-19T02:15:31.753047+0000","last_clean":"2024-04-19T02:15:31.753047+0000","last_became_active":"2024-04-19T02:15:29.286606+0000","last_became_peered":"2024-04-19T02:15:29.286606+0000","last_unstale":"2024-04-19T02:15:31.753047+0000","last_undegraded":"2024-04-19T02:15:31.753047+0000","last_fullsized":"2024-04-19T02:15:31.753047+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:28.387062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274074+0000","last_change":"2024-04-19T02:15:28.894121+0000","last_active":"2024-04-19T02:15:30.274074+0000","last_peered":"2024-04-19T02:15:30.274074+0000","last_clean":"2024-04-19T02:15:30.274074+0000","last_became_active":"2024-04-19T02:15:28.893902+0000","last_became_peered":"2024-04-19T02:15:28.893902+0000","last_unstale":"2024-04-19T02:15:30.274074+0000","last_undegraded":"2024-04-19T02:15:30.274074+0000","last_fullsized":"2024-04-19T02:15:30.274074+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:10:35.146583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273739+0000","last_change":"2024-04-19T02:15:29.282870+0000","last_active":"2024-04-19T02:15:30.273739+0000","last_peered":"2024-04-19T02:15:30.273739+0000","last_clean":"2024-04-19T02:15:30.273739+0000","last_became_active":"2024-04-19T02:15:29.281873+0000","last_became_peered":"2024-04-19T02:15:29.281873+0000","last_unstale":"2024-04-19T02:15:30.273739+0000","last_undegraded":"2024-04-19T02:15:30.273739+0000","last_fullsized":"2024-04-19T02:15:30.273739+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.269354+0000","last_change":"2024-04-19T02:15:24.527061+0000","last_active":"2024-04-19T02:15:29.269354+0000","last_peered":"2024-04-19T02:15:29.269354+0000","last_clean":"2024-04-19T02:15:29.269354+0000","last_became_active":"2024-04-19T02:15:24.526757+0000","last_became_peered":"2024-04-19T02:15:24.526757+0000","last_unstale":"2024-04-19T02:15:29.269354+0000","last_undegraded":"2024-04-19T02:15:29.269354+0000","last_fullsized":"2024-04-19T02:15:29.269354+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:17:13.649077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.753003+0000","last_change":"2024-04-19T02:15:28.892766+0000","last_active":"2024-04-19T02:15:31.753003+0000","last_peered":"2024-04-19T02:15:31.753003+0000","last_clean":"2024-04-19T02:15:31.753003+0000","last_became_active":"2024-04-19T02:15:28.892396+0000","last_became_peered":"2024-04-19T02:15:28.892396+0000","last_unstale":"2024-04-19T02:15:31.753003+0000","last_undegraded":"2024-04-19T02:15:31.753003+0000","last_fullsized":"2024-04-19T02:15:31.753003+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:57.946581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274481+0000","last_change":"2024-04-19T02:15:29.277922+0000","last_active":"2024-04-19T02:15:30.274481+0000","last_peered":"2024-04-19T02:15:30.274481+0000","last_clean":"2024-04-19T02:15:30.274481+0000","last_became_active":"2024-04-19T02:15:29.276968+0000","last_became_peered":"2024-04-19T02:15:29.276968+0000","last_unstale":"2024-04-19T02:15:30.274481+0000","last_undegraded":"2024-04-19T02:15:30.274481+0000","last_fullsized":"2024-04-19T02:15:30.274481+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.276084+0000","last_change":"2024-04-19T02:15:24.530933+0000","last_active":"2024-04-19T02:15:29.276084+0000","last_peered":"2024-04-19T02:15:29.276084+0000","last_clean":"2024-04-19T02:15:29.276084+0000","last_became_active":"2024-04-19T02:15:24.530550+0000","last_became_peered":"2024-04-19T02:15:24.530550+0000","last_unstale":"2024-04-19T02:15:29.276084+0000","last_undegraded":"2024-04-19T02:15:29.276084+0000","last_fullsized":"2024-04-19T02:15:29.276084+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:18:15.194321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752725+0000","last_change":"2024-04-19T02:15:28.893062+0000","last_active":"2024-04-19T02:15:31.752725+0000","last_peered":"2024-04-19T02:15:31.752725+0000","last_clean":"2024-04-19T02:15:31.752725+0000","last_became_active":"2024-04-19T02:15:28.892798+0000","last_became_peered":"2024-04-19T02:15:28.892798+0000","last_unstale":"2024-04-19T02:15:31.752725+0000","last_undegraded":"2024-04-19T02:15:31.752725+0000","last_fullsized":"2024-04-19T02:15:31.752725+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:53.170180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273830+0000","last_change":"2024-04-19T02:15:29.278294+0000","last_active":"2024-04-19T02:15:30.273830+0000","last_peered":"2024-04-19T02:15:30.273830+0000","last_clean":"2024-04-19T02:15:30.273830+0000","last_became_active":"2024-04-19T02:15:29.277536+0000","last_became_peered":"2024-04-19T02:15:29.277536+0000","last_unstale":"2024-04-19T02:15:30.273830+0000","last_undegraded":"2024-04-19T02:15:30.273830+0000","last_fullsized":"2024-04-19T02:15:30.273830+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.268601+0000","last_change":"2024-04-19T02:15:24.527048+0000","last_active":"2024-04-19T02:15:29.268601+0000","last_peered":"2024-04-19T02:15:29.268601+0000","last_clean":"2024-04-19T02:15:29.268601+0000","last_became_active":"2024-04-19T02:15:24.526790+0000","last_became_peered":"2024-04-19T02:15:24.526790+0000","last_unstale":"2024-04-19T02:15:29.268601+0000","last_undegraded":"2024-04-19T02:15:29.268601+0000","last_fullsized":"2024-04-19T02:15:29.268601+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273986+0000","last_change":"2024-04-19T02:15:28.893858+0000","last_active":"2024-04-19T02:15:30.273986+0000","last_peered":"2024-04-19T02:15:30.273986+0000","last_clean":"2024-04-19T02:15:30.273986+0000","last_became_active":"2024-04-19T02:15:28.892497+0000","last_became_peered":"2024-04-19T02:15:28.892497+0000","last_unstale":"2024-04-19T02:15:30.273986+0000","last_undegraded":"2024-04-19T02:15:30.273986+0000","last_fullsized":"2024-04-19T02:15:30.273986+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:31.673938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273922+0000","last_change":"2024-04-19T02:15:29.282663+0000","last_active":"2024-04-19T02:15:30.273922+0000","last_peered":"2024-04-19T02:15:30.273922+0000","last_clean":"2024-04-19T02:15:30.273922+0000","last_became_active":"2024-04-19T02:15:29.282217+0000","last_became_peered":"2024-04-19T02:15:29.282217+0000","last_unstale":"2024-04-19T02:15:30.273922+0000","last_undegraded":"2024-04-19T02:15:30.273922+0000","last_fullsized":"2024-04-19T02:15:30.273922+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.276557+0000","last_change":"2024-04-19T02:15:24.530924+0000","last_active":"2024-04-19T02:15:29.276557+0000","last_peered":"2024-04-19T02:15:29.276557+0000","last_clean":"2024-04-19T02:15:29.276557+0000","last_became_active":"2024-04-19T02:15:24.530551+0000","last_became_peered":"2024-04-19T02:15:24.530551+0000","last_unstale":"2024-04-19T02:15:29.276557+0000","last_undegraded":"2024-04-19T02:15:29.276557+0000","last_fullsized":"2024-04-19T02:15:29.276557+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:30.576946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":210,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.275680+0000","last_change":"2024-04-19T02:15:24.533634+0000","last_active":"2024-04-19T02:15:29.275680+0000","last_peered":"2024-04-19T02:15:29.275680+0000","last_clean":"2024-04-19T02:15:29.275680+0000","last_became_active":"2024-04-19T02:15:24.533420+0000","last_became_peered":"2024-04-19T02:15:24.533420+0000","last_unstale":"2024-04-19T02:15:29.275680+0000","last_undegraded":"2024-04-19T02:15:29.275680+0000","last_fullsized":"2024-04-19T02:15:29.275680+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273047+0000","last_change":"2024-04-19T02:15:28.890244+0000","last_active":"2024-04-19T02:15:30.273047+0000","last_peered":"2024-04-19T02:15:30.273047+0000","last_clean":"2024-04-19T02:15:30.273047+0000","last_became_active":"2024-04-19T02:15:28.889831+0000","last_became_peered":"2024-04-19T02:15:28.889831+0000","last_unstale":"2024-04-19T02:15:30.273047+0000","last_undegraded":"2024-04-19T02:15:30.273047+0000","last_fullsized":"2024-04-19T02:15:30.273047+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.753121+0000","last_change":"2024-04-19T02:15:29.285015+0000","last_active":"2024-04-19T02:15:31.753121+0000","last_peered":"2024-04-19T02:15:31.753121+0000","last_clean":"2024-04-19T02:15:31.753121+0000","last_became_active":"2024-04-19T02:15:29.284164+0000","last_became_peered":"2024-04-19T02:15:29.284164+0000","last_unstale":"2024-04-19T02:15:31.753121+0000","last_undegraded":"2024-04-19T02:15:31.753121+0000","last_fullsized":"2024-04-19T02:15:31.753121+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:36.987844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.275722+0000","last_change":"2024-04-19T02:15:24.533912+0000","last_active":"2024-04-19T02:15:29.275722+0000","last_peered":"2024-04-19T02:15:29.275722+0000","last_clean":"2024-04-19T02:15:29.275722+0000","last_became_active":"2024-04-19T02:15:24.533580+0000","last_became_peered":"2024-04-19T02:15:24.533580+0000","last_unstale":"2024-04-19T02:15:29.275722+0000","last_undegraded":"2024-04-19T02:15:29.275722+0000","last_fullsized":"2024-04-19T02:15:29.275722+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:45.045477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.272710+0000","last_change":"2024-04-19T02:15:28.891889+0000","last_active":"2024-04-19T02:15:30.272710+0000","last_peered":"2024-04-19T02:15:30.272710+0000","last_clean":"2024-04-19T02:15:30.272710+0000","last_became_active":"2024-04-19T02:15:28.890919+0000","last_became_peered":"2024-04-19T02:15:28.890919+0000","last_unstale":"2024-04-19T02:15:30.272710+0000","last_undegraded":"2024-04-19T02:15:30.272710+0000","last_fullsized":"2024-04-19T02:15:30.272710+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:35.412837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.275017+0000","last_change":"2024-04-19T02:15:29.284266+0000","last_active":"2024-04-19T02:15:30.275017+0000","last_peered":"2024-04-19T02:15:30.275017+0000","last_clean":"2024-04-19T02:15:30.275017+0000","last_became_active":"2024-04-19T02:15:29.282994+0000","last_became_peered":"2024-04-19T02:15:29.282994+0000","last_unstale":"2024-04-19T02:15:30.275017+0000","last_undegraded":"2024-04-19T02:15:30.275017+0000","last_fullsized":"2024-04-19T02:15:30.275017+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.277544+0000","last_change":"2024-04-19T02:15:24.526751+0000","last_active":"2024-04-19T02:15:29.277544+0000","last_peered":"2024-04-19T02:15:29.277544+0000","last_clean":"2024-04-19T02:15:29.277544+0000","last_became_active":"2024-04-19T02:15:24.526511+0000","last_became_peered":"2024-04-19T02:15:24.526511+0000","last_unstale":"2024-04-19T02:15:29.277544+0000","last_undegraded":"2024-04-19T02:15:29.277544+0000","last_fullsized":"2024-04-19T02:15:29.277544+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:02:45.966851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273736+0000","last_change":"2024-04-19T02:15:28.892125+0000","last_active":"2024-04-19T02:15:30.273736+0000","last_peered":"2024-04-19T02:15:30.273736+0000","last_clean":"2024-04-19T02:15:30.273736+0000","last_became_active":"2024-04-19T02:15:28.891300+0000","last_became_peered":"2024-04-19T02:15:28.891300+0000","last_unstale":"2024-04-19T02:15:30.273736+0000","last_undegraded":"2024-04-19T02:15:30.273736+0000","last_fullsized":"2024-04-19T02:15:30.273736+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274547+0000","last_change":"2024-04-19T02:15:29.281694+0000","last_active":"2024-04-19T02:15:30.274547+0000","last_peered":"2024-04-19T02:15:30.274547+0000","last_clean":"2024-04-19T02:15:30.274547+0000","last_became_active":"2024-04-19T02:15:29.280519+0000","last_became_peered":"2024-04-19T02:15:29.280519+0000","last_unstale":"2024-04-19T02:15:30.274547+0000","last_undegraded":"2024-04-19T02:15:30.274547+0000","last_fullsized":"2024-04-19T02:15:30.274547+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:50.890545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273711+0000","last_change":"2024-04-19T02:15:28.891702+0000","last_active":"2024-04-19T02:15:30.273711+0000","last_peered":"2024-04-19T02:15:30.273711+0000","last_clean":"2024-04-19T02:15:30.273711+0000","last_became_active":"2024-04-19T02:15:28.890743+0000","last_became_peered":"2024-04-19T02:15:28.890743+0000","last_unstale":"2024-04-19T02:15:30.273711+0000","last_undegraded":"2024-04-19T02:15:30.273711+0000","last_fullsized":"2024-04-19T02:15:30.273711+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.269774+0000","last_change":"2024-04-19T02:15:24.526845+0000","last_active":"2024-04-19T02:15:29.269774+0000","last_peered":"2024-04-19T02:15:29.269774+0000","last_clean":"2024-04-19T02:15:29.269774+0000","last_became_active":"2024-04-19T02:15:24.526500+0000","last_became_peered":"2024-04-19T02:15:24.526500+0000","last_unstale":"2024-04-19T02:15:29.269774+0000","last_undegraded":"2024-04-19T02:15:29.269774+0000","last_fullsized":"2024-04-19T02:15:29.269774+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:16.883355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.272678+0000","last_change":"2024-04-19T02:15:29.278686+0000","last_active":"2024-04-19T02:15:30.272678+0000","last_peered":"2024-04-19T02:15:30.272678+0000","last_clean":"2024-04-19T02:15:30.272678+0000","last_became_active":"2024-04-19T02:15:29.278108+0000","last_became_peered":"2024-04-19T02:15:29.278108+0000","last_unstale":"2024-04-19T02:15:30.272678+0000","last_undegraded":"2024-04-19T02:15:30.272678+0000","last_fullsized":"2024-04-19T02:15:30.272678+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:34.593754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-19T02:15:29.277610+0000","last_change":"2024-04-19T02:15:24.533777+0000","last_active":"2024-04-19T02:15:29.277610+0000","last_peered":"2024-04-19T02:15:29.277610+0000","last_clean":"2024-04-19T02:15:29.277610+0000","last_became_active":"2024-04-19T02:15:24.533436+0000","last_became_peered":"2024-04-19T02:15:24.533436+0000","last_unstale":"2024-04-19T02:15:29.277610+0000","last_undegraded":"2024-04-19T02:15:29.277610+0000","last_fullsized":"2024-04-19T02:15:29.277610+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:53:25.922418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:32.743668+0000","last_change":"2024-04-19T02:15:28.891370+0000","last_active":"2024-04-19T02:15:32.743668+0000","last_peered":"2024-04-19T02:15:32.743668+0000","last_clean":"2024-04-19T02:15:32.743668+0000","last_became_active":"2024-04-19T02:15:28.890702+0000","last_became_peered":"2024-04-19T02:15:28.890702+0000","last_unstale":"2024-04-19T02:15:32.743668+0000","last_undegraded":"2024-04-19T02:15:32.743668+0000","last_fullsized":"2024-04-19T02:15:32.743668+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:33.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274234+0000","last_change":"2024-04-19T02:15:29.282244+0000","last_active":"2024-04-19T02:15:30.274234+0000","last_peered":"2024-04-19T02:15:30.274234+0000","last_clean":"2024-04-19T02:15:30.274234+0000","last_became_active":"2024-04-19T02:15:29.280366+0000","last_became_peered":"2024-04-19T02:15:29.280366+0000","last_unstale":"2024-04-19T02:15:30.274234+0000","last_undegraded":"2024-04-19T02:15:30.274234+0000","last_fullsized":"2024-04-19T02:15:30.274234+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274392+0000","last_change":"2024-04-19T02:15:28.893027+0000","last_active":"2024-04-19T02:15:30.274392+0000","last_peered":"2024-04-19T02:15:30.274392+0000","last_clean":"2024-04-19T02:15:30.274392+0000","last_became_active":"2024-04-19T02:15:28.892695+0000","last_became_peered":"2024-04-19T02:15:28.892695+0000","last_unstale":"2024-04-19T02:15:30.274392+0000","last_undegraded":"2024-04-19T02:15:30.274392+0000","last_fullsized":"2024-04-19T02:15:30.274392+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274805+0000","last_change":"2024-04-19T02:15:29.283155+0000","last_active":"2024-04-19T02:15:30.274805+0000","last_peered":"2024-04-19T02:15:30.274805+0000","last_clean":"2024-04-19T02:15:30.274805+0000","last_became_active":"2024-04-19T02:15:29.281407+0000","last_became_peered":"2024-04-19T02:15:29.281407+0000","last_unstale":"2024-04-19T02:15:30.274805+0000","last_undegraded":"2024-04-19T02:15:30.274805+0000","last_fullsized":"2024-04-19T02:15:30.274805+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752643+0000","last_change":"2024-04-19T02:15:28.893067+0000","last_active":"2024-04-19T02:15:31.752643+0000","last_peered":"2024-04-19T02:15:31.752643+0000","last_clean":"2024-04-19T02:15:31.752643+0000","last_became_active":"2024-04-19T02:15:28.892781+0000","last_became_peered":"2024-04-19T02:15:28.892781+0000","last_unstale":"2024-04-19T02:15:31.752643+0000","last_undegraded":"2024-04-19T02:15:31.752643+0000","last_fullsized":"2024-04-19T02:15:31.752643+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:54:15.590143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752652+0000","last_change":"2024-04-19T02:15:29.281279+0000","last_active":"2024-04-19T02:15:31.752652+0000","last_peered":"2024-04-19T02:15:31.752652+0000","last_clean":"2024-04-19T02:15:31.752652+0000","last_became_active":"2024-04-19T02:15:29.279360+0000","last_became_peered":"2024-04-19T02:15:29.279360+0000","last_unstale":"2024-04-19T02:15:31.752652+0000","last_undegraded":"2024-04-19T02:15:31.752652+0000","last_fullsized":"2024-04-19T02:15:31.752652+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274993+0000","last_change":"2024-04-19T02:15:28.893239+0000","last_active":"2024-04-19T02:15:30.274993+0000","last_peered":"2024-04-19T02:15:30.274993+0000","last_clean":"2024-04-19T02:15:30.274993+0000","last_became_active":"2024-04-19T02:15:28.892881+0000","last_became_peered":"2024-04-19T02:15:28.892881+0000","last_unstale":"2024-04-19T02:15:30.274993+0000","last_undegraded":"2024-04-19T02:15:30.274993+0000","last_fullsized":"2024-04-19T02:15:30.274993+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752362+0000","last_change":"2024-04-19T02:15:29.281652+0000","last_active":"2024-04-19T02:15:31.752362+0000","last_peered":"2024-04-19T02:15:31.752362+0000","last_clean":"2024-04-19T02:15:31.752362+0000","last_became_active":"2024-04-19T02:15:29.281175+0000","last_became_peered":"2024-04-19T02:15:29.281175+0000","last_unstale":"2024-04-19T02:15:31.752362+0000","last_undegraded":"2024-04-19T02:15:31.752362+0000","last_fullsized":"2024-04-19T02:15:31.752362+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:16.568764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273639+0000","last_change":"2024-04-19T02:15:28.892058+0000","last_active":"2024-04-19T02:15:30.273639+0000","last_peered":"2024-04-19T02:15:30.273639+0000","last_clean":"2024-04-19T02:15:30.273639+0000","last_became_active":"2024-04-19T02:15:28.890877+0000","last_became_peered":"2024-04-19T02:15:28.890877+0000","last_unstale":"2024-04-19T02:15:30.273639+0000","last_undegraded":"2024-04-19T02:15:30.273639+0000","last_fullsized":"2024-04-19T02:15:30.273639+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:53.170180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274344+0000","last_change":"2024-04-19T02:15:29.278810+0000","last_active":"2024-04-19T02:15:30.274344+0000","last_peered":"2024-04-19T02:15:30.274344+0000","last_clean":"2024-04-19T02:15:30.274344+0000","last_became_active":"2024-04-19T02:15:29.277913+0000","last_became_peered":"2024-04-19T02:15:29.277913+0000","last_unstale":"2024-04-19T02:15:30.274344+0000","last_undegraded":"2024-04-19T02:15:30.274344+0000","last_fullsized":"2024-04-19T02:15:30.274344+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:24.082666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273821+0000","last_change":"2024-04-19T02:15:28.889132+0000","last_active":"2024-04-19T02:15:30.273821+0000","last_peered":"2024-04-19T02:15:30.273821+0000","last_clean":"2024-04-19T02:15:30.273821+0000","last_became_active":"2024-04-19T02:15:28.888926+0000","last_became_peered":"2024-04-19T02:15:28.888926+0000","last_unstale":"2024-04-19T02:15:30.273821+0000","last_undegraded":"2024-04-19T02:15:30.273821+0000","last_fullsized":"2024-04-19T02:15:30.273821+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752370+0000","last_change":"2024-04-19T02:15:29.282776+0000","last_active":"2024-04-19T02:15:31.752370+0000","last_peered":"2024-04-19T02:15:31.752370+0000","last_clean":"2024-04-19T02:15:31.752370+0000","last_became_active":"2024-04-19T02:15:29.279382+0000","last_became_peered":"2024-04-19T02:15:29.279382+0000","last_unstale":"2024-04-19T02:15:31.752370+0000","last_undegraded":"2024-04-19T02:15:31.752370+0000","last_fullsized":"2024-04-19T02:15:31.752370+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:31.752208+0000","last_change":"2024-04-19T02:15:29.283537+0000","last_active":"2024-04-19T02:15:31.752208+0000","last_peered":"2024-04-19T02:15:31.752208+0000","last_clean":"2024-04-19T02:15:31.752208+0000","last_became_active":"2024-04-19T02:15:29.281801+0000","last_became_peered":"2024-04-19T02:15:29.281801+0000","last_unstale":"2024-04-19T02:15:31.752208+0000","last_undegraded":"2024-04-19T02:15:31.752208+0000","last_fullsized":"2024-04-19T02:15:31.752208+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.272816+0000","last_change":"2024-04-19T02:15:29.281560+0000","last_active":"2024-04-19T02:15:30.272816+0000","last_peered":"2024-04-19T02:15:30.272816+0000","last_clean":"2024-04-19T02:15:30.272816+0000","last_became_active":"2024-04-19T02:15:29.281261+0000","last_became_peered":"2024-04-19T02:15:29.281261+0000","last_unstale":"2024-04-19T02:15:30.272816+0000","last_undegraded":"2024-04-19T02:15:30.272816+0000","last_fullsized":"2024-04-19T02:15:30.272816+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274549+0000","last_change":"2024-04-19T02:15:29.280731+0000","last_active":"2024-04-19T02:15:30.274549+0000","last_peered":"2024-04-19T02:15:30.274549+0000","last_clean":"2024-04-19T02:15:30.274549+0000","last_became_active":"2024-04-19T02:15:29.280340+0000","last_became_peered":"2024-04-19T02:15:29.280340+0000","last_unstale":"2024-04-19T02:15:30.274549+0000","last_undegraded":"2024-04-19T02:15:30.274549+0000","last_fullsized":"2024-04-19T02:15:30.274549+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.273481+0000","last_change":"2024-04-19T02:15:29.278702+0000","last_active":"2024-04-19T02:15:30.273481+0000","last_peered":"2024-04-19T02:15:30.273481+0000","last_clean":"2024-04-19T02:15:30.273481+0000","last_became_active":"2024-04-19T02:15:29.277756+0000","last_became_peered":"2024-04-19T02:15:29.277756+0000","last_unstale":"2024-04-19T02:15:30.273481+0000","last_undegraded":"2024-04-19T02:15:30.273481+0000","last_fullsized":"2024-04-19T02:15:30.273481+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T02:15:30.274899+0000","last_change":"2024-04-19T02:15:29.277568+0000","last_active":"2024-04-19T02:15:30.274899+0000","last_peered":"2024-04-19T02:15:30.274899+0000","last_clean":"2024-04-19T02:15:30.274899+0000","last_became_active":"2024-04-19T02:15:29.276725+0000","last_became_peered":"2024-04-19T02:15:29.276725+0000","last_unstale":"2024-04-19T02:15:30.274899+0000","last_undegraded":"2024-04-19T02:15:30.274899+0000","last_fullsized":"2024-04-19T02:15:30.274899+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738375,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":139264,"data_stored":46663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]}]},{"osd":0,"up_from":8,"seq":34359738376,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31856,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":757760,"data_stored":638777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]}]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":749568,"data_stored":638161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:15:51.678 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-19T02:15:51.678 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-04-19T02:15:52.041 INFO:teuthology.orchestra.run.smithi121.stdout:epoch 15 2024-04-19T02:15:52.041 INFO:teuthology.orchestra.run.smithi121.stdout:fsid f6ab5dd0-bb9f-4b48-a9fc-4728c7955ca8 2024-04-19T02:15:52.041 INFO:teuthology.orchestra.run.smithi121.stdout:created 2024-04-19T02:15:13.539846+0000 2024-04-19T02:15:52.041 INFO:teuthology.orchestra.run.smithi121.stdout:modified 2024-04-19T02:15:30.265522+0000 2024-04-19T02:15:52.041 INFO:teuthology.orchestra.run.smithi121.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-04-19T02:15:52.041 INFO:teuthology.orchestra.run.smithi121.stdout:crush_version 4 2024-04-19T02:15:52.041 INFO:teuthology.orchestra.run.smithi121.stdout:full_ratio 0.95 2024-04-19T02:15:52.041 INFO:teuthology.orchestra.run.smithi121.stdout:backfillfull_ratio 0.9 2024-04-19T02:15:52.041 INFO:teuthology.orchestra.run.smithi121.stdout:nearfull_ratio 0.85 2024-04-19T02:15:52.042 INFO:teuthology.orchestra.run.smithi121.stdout:require_min_compat_client luminous 2024-04-19T02:15:52.042 INFO:teuthology.orchestra.run.smithi121.stdout:min_compat_client jewel 2024-04-19T02:15:52.042 INFO:teuthology.orchestra.run.smithi121.stdout:require_osd_release reef 2024-04-19T02:15:52.042 INFO:teuthology.orchestra.run.smithi121.stdout:stretch_mode_enabled false 2024-04-19T02:15:52.042 INFO:teuthology.orchestra.run.smithi121.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 11 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 2.99 2024-04-19T02:15:52.042 INFO:teuthology.orchestra.run.smithi121.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 11 flags hashpspool stripe_width 0 application rbd read_balance_score 1.50 2024-04-19T02:15:52.042 INFO:teuthology.orchestra.run.smithi121.stdout:pool 3 'cephfs_metadata' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 14 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.13 2024-04-19T02:15:52.042 INFO:teuthology.orchestra.run.smithi121.stdout:pool 4 'cephfs_data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 15 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.13 2024-04-19T02:15:52.042 INFO:teuthology.orchestra.run.smithi121.stdout:max_osd 3 2024-04-19T02:15:52.042 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.153:6800/41347,v1:172.21.15.153:6801/41347] [v2:172.21.15.153:6802/41347,v1:172.21.15.153:6803/41347] exists,up 88cb15f3-271c-43d5-af51-1cd26b8ed13c 2024-04-19T02:15:52.042 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.174:6800/41380,v1:172.21.15.174:6801/41380] [v2:172.21.15.174:6802/41380,v1:172.21.15.174:6803/41380] exists,up 2674869a-db01-4d9f-a496-9fb3851b5b21 2024-04-19T02:15:52.042 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.177:6800/41508,v1:172.21.15.177:6801/41508] [v2:172.21.15.177:6802/41508,v1:172.21.15.177:6803/41508] exists,up 712ad943-2f98-49d9-aabe-f66b509be633 2024-04-19T02:15:52.055 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.153:6800/41347,v1:172.21.15.153:6801/41347] [v2:172.21.15.153:6802/41347,v1:172.21.15.153:6803/41347] exists,up 88cb15f3-271c-43d5-af51-1cd26b8ed13c', 'osd.1 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.174:6800/41380,v1:172.21.15.174:6801/41380] [v2:172.21.15.174:6802/41380,v1:172.21.15.174:6803/41380] exists,up 2674869a-db01-4d9f-a496-9fb3851b5b21', 'osd.2 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.177:6800/41508,v1:172.21.15.177:6801/41508] [v2:172.21.15.177:6802/41508,v1:172.21.15.177:6803/41508] exists,up 712ad943-2f98-49d9-aabe-f66b509be633'] 2024-04-19T02:15:52.055 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-04-19T02:15:52.176 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-04-19T02:15:52.176 INFO:teuthology.orchestra.run.smithi121.stdout: "name": "mon.a", 2024-04-19T02:15:52.176 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster": "ceph", 2024-04-19T02:15:52.176 INFO:teuthology.orchestra.run.smithi121.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-04-19T02:15:52.176 INFO:teuthology.orchestra.run.smithi121.stdout: "admin_socket_mode": "", 2024-04-19T02:15:52.177 INFO:teuthology.orchestra.run.smithi121.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-04-19T02:15:52.177 INFO:teuthology.orchestra.run.smithi121.stdout: "auth_client_required": "cephx, none", 2024-04-19T02:15:52.177 INFO:teuthology.orchestra.run.smithi121.stdout: "auth_cluster_required": "cephx", 2024-04-19T02:15:52.177 INFO:teuthology.orchestra.run.smithi121.stdout: "auth_debug": "true", 2024-04-19T02:15:52.177 INFO:teuthology.orchestra.run.smithi121.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-04-19T02:15:52.177 INFO:teuthology.orchestra.run.smithi121.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-04-19T02:15:52.177 INFO:teuthology.orchestra.run.smithi121.stdout: "auth_service_required": "cephx", 2024-04-19T02:15:52.177 INFO:teuthology.orchestra.run.smithi121.stdout: "auth_service_ticket_ttl": "240.000000", 2024-04-19T02:15:52.178 INFO:teuthology.orchestra.run.smithi121.stdout: "auth_supported": "cephx", 2024-04-19T02:15:52.178 INFO:teuthology.orchestra.run.smithi121.stdout: "bdev_aio": "true", 2024-04-19T02:15:52.178 INFO:teuthology.orchestra.run.smithi121.stdout: "bdev_aio_max_queue_depth": "1024", 2024-04-19T02:15:52.178 INFO:teuthology.orchestra.run.smithi121.stdout: "bdev_aio_poll_ms": "250", 2024-04-19T02:15:52.178 INFO:teuthology.orchestra.run.smithi121.stdout: "bdev_aio_reap_max": "16", 2024-04-19T02:15:52.178 INFO:teuthology.orchestra.run.smithi121.stdout: "bdev_async_discard": "false", 2024-04-19T02:15:52.178 INFO:teuthology.orchestra.run.smithi121.stdout: "bdev_block_size": "4096", 2024-04-19T02:15:52.178 INFO:teuthology.orchestra.run.smithi121.stdout: "bdev_debug_aio": "false", 2024-04-19T02:15:52.178 INFO:teuthology.orchestra.run.smithi121.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-04-19T02:15:52.179 INFO:teuthology.orchestra.run.smithi121.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-04-19T02:15:52.179 INFO:teuthology.orchestra.run.smithi121.stdout: "bdev_debug_inflight_ios": "false", 2024-04-19T02:15:52.179 INFO:teuthology.orchestra.run.smithi121.stdout: "bdev_enable_discard": "false", 2024-04-19T02:15:52.179 INFO:teuthology.orchestra.run.smithi121.stdout: "bdev_flock_retry": "3", 2024-04-19T02:15:52.179 INFO:teuthology.orchestra.run.smithi121.stdout: "bdev_flock_retry_interval": "0.100000", 2024-04-19T02:15:52.179 INFO:teuthology.orchestra.run.smithi121.stdout: "bdev_inject_crash": "0", 2024-04-19T02:15:52.179 INFO:teuthology.orchestra.run.smithi121.stdout: "bdev_inject_crash_flush_delay": "2", 2024-04-19T02:15:52.179 INFO:teuthology.orchestra.run.smithi121.stdout: "bdev_ioring": "false", 2024-04-19T02:15:52.179 INFO:teuthology.orchestra.run.smithi121.stdout: "bdev_ioring_hipri": "false", 2024-04-19T02:15:52.180 INFO:teuthology.orchestra.run.smithi121.stdout: "bdev_ioring_sqthread_poll": "false", 2024-04-19T02:15:52.180 INFO:teuthology.orchestra.run.smithi121.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-04-19T02:15:52.180 INFO:teuthology.orchestra.run.smithi121.stdout: "bdev_read_buffer_alignment": "4096", 2024-04-19T02:15:52.180 INFO:teuthology.orchestra.run.smithi121.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-04-19T02:15:52.181 INFO:teuthology.orchestra.run.smithi121.stdout: "bdev_type": "", 2024-04-19T02:15:52.181 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_alloc_size": "1048576", 2024-04-19T02:15:52.181 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_allocator": "hybrid", 2024-04-19T02:15:52.181 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_buffered_io": "true", 2024-04-19T02:15:52.181 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_check_for_zeros": "false", 2024-04-19T02:15:52.181 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_check_volume_selector_often": "false", 2024-04-19T02:15:52.181 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-04-19T02:15:52.181 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_compact_log_sync": "false", 2024-04-19T02:15:52.182 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-04-19T02:15:52.182 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-04-19T02:15:52.182 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_log_compact_min_size": "16777216", 2024-04-19T02:15:52.182 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_log_replay_check_allocations": "true", 2024-04-19T02:15:52.182 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_max_log_runway": "4194304", 2024-04-19T02:15:52.182 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_max_prefetch": "1048576", 2024-04-19T02:15:52.182 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_min_flush_size": "524288", 2024-04-19T02:15:52.182 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_min_log_runway": "1048576", 2024-04-19T02:15:52.182 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_replay_recovery": "false", 2024-04-19T02:15:52.183 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-04-19T02:15:52.183 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_shared_alloc_size": "65536", 2024-04-19T02:15:52.183 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_sync_write": "false", 2024-04-19T02:15:52.183 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-04-19T02:15:52.183 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-04-19T02:15:52.183 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-04-19T02:15:52.183 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_allocation_from_file": "true", 2024-04-19T02:15:52.183 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_allocator": "hybrid", 2024-04-19T02:15:52.183 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-04-19T02:15:52.184 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-04-19T02:15:52.184 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-04-19T02:15:52.184 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-04-19T02:15:52.184 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-04-19T02:15:52.184 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-04-19T02:15:52.184 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_blobid_prealloc": "10240", 2024-04-19T02:15:52.184 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_block_create": "true", 2024-04-19T02:15:52.184 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_block_db_create": "false", 2024-04-19T02:15:52.184 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_block_db_path": "", 2024-04-19T02:15:52.185 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_block_db_size": "0", 2024-04-19T02:15:52.185 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_block_path": "", 2024-04-19T02:15:52.185 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_block_preallocate_file": "false", 2024-04-19T02:15:52.185 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_block_size": "107374182400", 2024-04-19T02:15:52.185 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_block_wal_create": "false", 2024-04-19T02:15:52.185 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_block_wal_path": "", 2024-04-19T02:15:52.185 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_block_wal_size": "100663296", 2024-04-19T02:15:52.185 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_bluefs": "true", 2024-04-19T02:15:52.186 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-04-19T02:15:52.186 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_bluefs_env_mirror": "false", 2024-04-19T02:15:52.186 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-04-19T02:15:52.186 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-04-19T02:15:52.186 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-04-19T02:15:52.186 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-04-19T02:15:52.186 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-04-19T02:15:52.186 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-04-19T02:15:52.187 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_autotune": "true", 2024-04-19T02:15:52.187 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-04-19T02:15:52.187 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-04-19T02:15:52.187 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-04-19T02:15:52.187 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-04-19T02:15:52.187 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_size": "0", 2024-04-19T02:15:52.187 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-04-19T02:15:52.187 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-04-19T02:15:52.187 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-04-19T02:15:52.188 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-04-19T02:15:52.188 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_type": "2q", 2024-04-19T02:15:52.188 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-04-19T02:15:52.188 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_clone_cow": "true", 2024-04-19T02:15:52.188 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_compression_algorithm": "snappy", 2024-04-19T02:15:52.188 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_compression_max_blob_size": "0", 2024-04-19T02:15:52.188 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-04-19T02:15:52.188 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-04-19T02:15:52.188 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_compression_min_blob_size": "0", 2024-04-19T02:15:52.189 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-04-19T02:15:52.189 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-04-19T02:15:52.189 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_compression_mode": "none", 2024-04-19T02:15:52.189 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-04-19T02:15:52.189 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_csum_type": "crc32c", 2024-04-19T02:15:52.189 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_debug_enforce_settings": "default", 2024-04-19T02:15:52.189 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_debug_freelist": "false", 2024-04-19T02:15:52.189 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_debug_fsck_abort": "false", 2024-04-19T02:15:52.189 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-04-19T02:15:52.189 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_debug_inject_bug21040": "false", 2024-04-19T02:15:52.190 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-04-19T02:15:52.190 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_debug_inject_read_err": "false", 2024-04-19T02:15:52.190 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_debug_legacy_omap": "false", 2024-04-19T02:15:52.190 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-04-19T02:15:52.190 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-04-19T02:15:52.190 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-04-19T02:15:52.190 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-04-19T02:15:52.190 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_debug_prefill": "0.000000", 2024-04-19T02:15:52.190 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-04-19T02:15:52.191 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-04-19T02:15:52.191 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-04-19T02:15:52.191 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_debug_small_allocations": "0", 2024-04-19T02:15:52.191 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-04-19T02:15:52.191 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_default_buffered_read": "true", 2024-04-19T02:15:52.191 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_default_buffered_write": "false", 2024-04-19T02:15:52.191 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_deferred_batch_ops": "0", 2024-04-19T02:15:52.191 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-04-19T02:15:52.191 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-04-19T02:15:52.191 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-04-19T02:15:52.191 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-04-19T02:15:52.191 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-04-19T02:15:52.191 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-04-19T02:15:52.191 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-04-19T02:15:52.191 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fail_eio": "false", 2024-04-19T02:15:52.191 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-04-19T02:15:52.192 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-04-19T02:15:52.192 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-04-19T02:15:52.192 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-04-19T02:15:52.192 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fsck_on_mkfs": "true", 2024-04-19T02:15:52.192 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-04-19T02:15:52.192 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fsck_on_mount": "false", 2024-04-19T02:15:52.192 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-04-19T02:15:52.192 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fsck_on_umount": "false", 2024-04-19T02:15:52.192 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-04-19T02:15:52.192 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-04-19T02:15:52.192 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-04-19T02:15:52.192 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-04-19T02:15:52.192 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-04-19T02:15:52.192 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-04-19T02:15:52.192 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-04-19T02:15:52.192 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-04-19T02:15:52.193 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_ignore_data_csum": "false", 2024-04-19T02:15:52.193 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-04-19T02:15:52.193 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_kvbackend": "rocksdb", 2024-04-19T02:15:52.193 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-04-19T02:15:52.193 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-04-19T02:15:52.193 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_log_op_age": "5.000000", 2024-04-19T02:15:52.193 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_max_alloc_size": "0", 2024-04-19T02:15:52.193 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_max_blob_size": "0", 2024-04-19T02:15:52.193 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-04-19T02:15:52.193 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-04-19T02:15:52.193 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_max_defer_interval": "3.000000", 2024-04-19T02:15:52.193 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_max_deferred_txc": "32", 2024-04-19T02:15:52.193 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_min_alloc_size": "0", 2024-04-19T02:15:52.193 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-04-19T02:15:52.194 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-04-19T02:15:52.194 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_nid_prealloc": "1024", 2024-04-19T02:15:52.194 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_prefer_deferred_size": "0", 2024-04-19T02:15:52.194 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-04-19T02:15:52.194 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-04-19T02:15:52.194 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_qfsck_on_mount": "true", 2024-04-19T02:15:52.194 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_retry_disk_reads": "3", 2024-04-19T02:15:52.194 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_rocksdb_cf": "true", 2024-04-19T02:15:52.194 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-04-19T02:15:52.194 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-04-19T02:15:52.194 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_rocksdb_options_annex": "", 2024-04-19T02:15:52.194 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_spdk_coremask": "0x1", 2024-04-19T02:15:52.194 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_spdk_io_sleep": "5", 2024-04-19T02:15:52.194 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_spdk_max_io_completion": "0", 2024-04-19T02:15:52.195 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_spdk_mem": "512", 2024-04-19T02:15:52.195 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_sync_submit_transaction": "false", 2024-04-19T02:15:52.195 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_throttle_bytes": "67108864", 2024-04-19T02:15:52.195 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_throttle_cost_per_io": "0", 2024-04-19T02:15:52.195 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-04-19T02:15:52.195 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-04-19T02:15:52.195 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-04-19T02:15:52.195 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-04-19T02:15:52.195 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_tracing": "false", 2024-04-19T02:15:52.195 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-04-19T02:15:52.195 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-04-19T02:15:52.195 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_volume_selection_reserved": "0", 2024-04-19T02:15:52.195 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-04-19T02:15:52.195 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-04-19T02:15:52.195 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-04-19T02:15:52.195 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-04-19T02:15:52.196 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-04-19T02:15:52.196 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-04-19T02:15:52.196 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_zero_block_detection": "false", 2024-04-19T02:15:52.196 INFO:teuthology.orchestra.run.smithi121.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-04-19T02:15:52.196 INFO:teuthology.orchestra.run.smithi121.stdout: "cephfs_mirror_action_update_interval": "2", 2024-04-19T02:15:52.196 INFO:teuthology.orchestra.run.smithi121.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-04-19T02:15:52.196 INFO:teuthology.orchestra.run.smithi121.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-04-19T02:15:52.196 INFO:teuthology.orchestra.run.smithi121.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-04-19T02:15:52.196 INFO:teuthology.orchestra.run.smithi121.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-04-19T02:15:52.196 INFO:teuthology.orchestra.run.smithi121.stdout: "cephfs_mirror_mount_timeout": "10", 2024-04-19T02:15:52.196 INFO:teuthology.orchestra.run.smithi121.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-04-19T02:15:52.196 INFO:teuthology.orchestra.run.smithi121.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-04-19T02:15:52.196 INFO:teuthology.orchestra.run.smithi121.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-04-19T02:15:52.196 INFO:teuthology.orchestra.run.smithi121.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-04-19T02:15:52.196 INFO:teuthology.orchestra.run.smithi121.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-04-19T02:15:52.197 INFO:teuthology.orchestra.run.smithi121.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-04-19T02:15:52.197 INFO:teuthology.orchestra.run.smithi121.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-04-19T02:15:52.197 INFO:teuthology.orchestra.run.smithi121.stdout: "cephx_cluster_require_signatures": "false", 2024-04-19T02:15:52.197 INFO:teuthology.orchestra.run.smithi121.stdout: "cephx_cluster_require_version": "2", 2024-04-19T02:15:52.197 INFO:teuthology.orchestra.run.smithi121.stdout: "cephx_require_signatures": "false", 2024-04-19T02:15:52.197 INFO:teuthology.orchestra.run.smithi121.stdout: "cephx_require_version": "2", 2024-04-19T02:15:52.197 INFO:teuthology.orchestra.run.smithi121.stdout: "cephx_service_require_signatures": "false", 2024-04-19T02:15:52.197 INFO:teuthology.orchestra.run.smithi121.stdout: "cephx_service_require_version": "2", 2024-04-19T02:15:52.197 INFO:teuthology.orchestra.run.smithi121.stdout: "cephx_sign_messages": "true", 2024-04-19T02:15:52.197 INFO:teuthology.orchestra.run.smithi121.stdout: "chdir": "", 2024-04-19T02:15:52.197 INFO:teuthology.orchestra.run.smithi121.stdout: "client_acl_type": "", 2024-04-19T02:15:52.197 INFO:teuthology.orchestra.run.smithi121.stdout: "client_asio_thread_count": "2", 2024-04-19T02:15:52.197 INFO:teuthology.orchestra.run.smithi121.stdout: "client_cache_mid": "0.750000", 2024-04-19T02:15:52.197 INFO:teuthology.orchestra.run.smithi121.stdout: "client_cache_size": "16384", 2024-04-19T02:15:52.197 INFO:teuthology.orchestra.run.smithi121.stdout: "client_caps_release_delay": "5", 2024-04-19T02:15:52.198 INFO:teuthology.orchestra.run.smithi121.stdout: "client_check_pool_perm": "true", 2024-04-19T02:15:52.198 INFO:teuthology.orchestra.run.smithi121.stdout: "client_collect_and_send_global_metrics": "false", 2024-04-19T02:15:52.198 INFO:teuthology.orchestra.run.smithi121.stdout: "client_debug_force_sync_read": "false", 2024-04-19T02:15:52.198 INFO:teuthology.orchestra.run.smithi121.stdout: "client_debug_getattr_caps": "false", 2024-04-19T02:15:52.198 INFO:teuthology.orchestra.run.smithi121.stdout: "client_debug_inject_tick_delay": "0", 2024-04-19T02:15:52.198 INFO:teuthology.orchestra.run.smithi121.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-04-19T02:15:52.198 INFO:teuthology.orchestra.run.smithi121.stdout: "client_die_on_failed_remount": "false", 2024-04-19T02:15:52.198 INFO:teuthology.orchestra.run.smithi121.stdout: "client_dirsize_rbytes": "true", 2024-04-19T02:15:52.198 INFO:teuthology.orchestra.run.smithi121.stdout: "client_force_lazyio": "false", 2024-04-19T02:15:52.198 INFO:teuthology.orchestra.run.smithi121.stdout: "client_fs": "", 2024-04-19T02:15:52.198 INFO:teuthology.orchestra.run.smithi121.stdout: "client_inject_fixed_oldest_tid": "false", 2024-04-19T02:15:52.198 INFO:teuthology.orchestra.run.smithi121.stdout: "client_inject_release_failure": "false", 2024-04-19T02:15:52.198 INFO:teuthology.orchestra.run.smithi121.stdout: "client_max_inline_size": "4096", 2024-04-19T02:15:52.198 INFO:teuthology.orchestra.run.smithi121.stdout: "client_max_retries_on_remount_failure": "5", 2024-04-19T02:15:52.199 INFO:teuthology.orchestra.run.smithi121.stdout: "client_mds_namespace": "", 2024-04-19T02:15:52.199 INFO:teuthology.orchestra.run.smithi121.stdout: "client_metadata": "", 2024-04-19T02:15:52.199 INFO:teuthology.orchestra.run.smithi121.stdout: "client_mount_gid": "-1", 2024-04-19T02:15:52.199 INFO:teuthology.orchestra.run.smithi121.stdout: "client_mount_timeout": "300", 2024-04-19T02:15:52.199 INFO:teuthology.orchestra.run.smithi121.stdout: "client_mount_uid": "-1", 2024-04-19T02:15:52.199 INFO:teuthology.orchestra.run.smithi121.stdout: "client_mountpoint": "/", 2024-04-19T02:15:52.199 INFO:teuthology.orchestra.run.smithi121.stdout: "client_notify_timeout": "10", 2024-04-19T02:15:52.199 INFO:teuthology.orchestra.run.smithi121.stdout: "client_oc": "true", 2024-04-19T02:15:52.199 INFO:teuthology.orchestra.run.smithi121.stdout: "client_oc_max_dirty": "104857600", 2024-04-19T02:15:52.199 INFO:teuthology.orchestra.run.smithi121.stdout: "client_oc_max_dirty_age": "5.000000", 2024-04-19T02:15:52.199 INFO:teuthology.orchestra.run.smithi121.stdout: "client_oc_max_objects": "1000", 2024-04-19T02:15:52.199 INFO:teuthology.orchestra.run.smithi121.stdout: "client_oc_size": "209715200", 2024-04-19T02:15:52.200 INFO:teuthology.orchestra.run.smithi121.stdout: "client_oc_target_dirty": "8388608", 2024-04-19T02:15:52.200 INFO:teuthology.orchestra.run.smithi121.stdout: "client_permissions": "true", 2024-04-19T02:15:52.200 INFO:teuthology.orchestra.run.smithi121.stdout: "client_quota": "true", 2024-04-19T02:15:52.200 INFO:teuthology.orchestra.run.smithi121.stdout: "client_quota_df": "true", 2024-04-19T02:15:52.200 INFO:teuthology.orchestra.run.smithi121.stdout: "client_readahead_max_bytes": "0", 2024-04-19T02:15:52.200 INFO:teuthology.orchestra.run.smithi121.stdout: "client_readahead_max_periods": "4", 2024-04-19T02:15:52.200 INFO:teuthology.orchestra.run.smithi121.stdout: "client_readahead_min": "131072", 2024-04-19T02:15:52.200 INFO:teuthology.orchestra.run.smithi121.stdout: "client_reconnect_stale": "false", 2024-04-19T02:15:52.200 INFO:teuthology.orchestra.run.smithi121.stdout: "client_shutdown_timeout": "30", 2024-04-19T02:15:52.200 INFO:teuthology.orchestra.run.smithi121.stdout: "client_snapdir": ".snap", 2024-04-19T02:15:52.200 INFO:teuthology.orchestra.run.smithi121.stdout: "client_tick_interval": "1", 2024-04-19T02:15:52.200 INFO:teuthology.orchestra.run.smithi121.stdout: "client_trace": "", 2024-04-19T02:15:52.200 INFO:teuthology.orchestra.run.smithi121.stdout: "client_try_dentry_invalidate": "false", 2024-04-19T02:15:52.200 INFO:teuthology.orchestra.run.smithi121.stdout: "client_use_faked_inos": "false", 2024-04-19T02:15:52.200 INFO:teuthology.orchestra.run.smithi121.stdout: "client_use_random_mds": "false", 2024-04-19T02:15:52.201 INFO:teuthology.orchestra.run.smithi121.stdout: "clog_to_graylog": "false", 2024-04-19T02:15:52.201 INFO:teuthology.orchestra.run.smithi121.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-04-19T02:15:52.201 INFO:teuthology.orchestra.run.smithi121.stdout: "clog_to_graylog_port": "12201", 2024-04-19T02:15:52.201 INFO:teuthology.orchestra.run.smithi121.stdout: "clog_to_monitors": "default=true", 2024-04-19T02:15:52.201 INFO:teuthology.orchestra.run.smithi121.stdout: "clog_to_syslog": "false", 2024-04-19T02:15:52.201 INFO:teuthology.orchestra.run.smithi121.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-04-19T02:15:52.201 INFO:teuthology.orchestra.run.smithi121.stdout: "clog_to_syslog_level": "info", 2024-04-19T02:15:52.201 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_addr": "-", 2024-04-19T02:15:52.201 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_network": "", 2024-04-19T02:15:52.201 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_network_interface": "", 2024-04-19T02:15:52.201 INFO:teuthology.orchestra.run.smithi121.stdout: "compressor_zlib_isal": "false", 2024-04-19T02:15:52.201 INFO:teuthology.orchestra.run.smithi121.stdout: "compressor_zlib_level": "5", 2024-04-19T02:15:52.201 INFO:teuthology.orchestra.run.smithi121.stdout: "compressor_zlib_winsize": "-15", 2024-04-19T02:15:52.201 INFO:teuthology.orchestra.run.smithi121.stdout: "compressor_zstd_level": "1", 2024-04-19T02:15:52.201 INFO:teuthology.orchestra.run.smithi121.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-04-19T02:15:52.202 INFO:teuthology.orchestra.run.smithi121.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-04-19T02:15:52.202 INFO:teuthology.orchestra.run.smithi121.stdout: "crimson_alien_op_num_threads": "6", 2024-04-19T02:15:52.202 INFO:teuthology.orchestra.run.smithi121.stdout: "crimson_alien_thread_cpu_cores": "", 2024-04-19T02:15:52.202 INFO:teuthology.orchestra.run.smithi121.stdout: "crimson_osd_obc_lru_size": "10", 2024-04-19T02:15:52.202 INFO:teuthology.orchestra.run.smithi121.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-04-19T02:15:52.202 INFO:teuthology.orchestra.run.smithi121.stdout: "crimson_seastar_smp": "1", 2024-04-19T02:15:52.202 INFO:teuthology.orchestra.run.smithi121.stdout: "crush_location": "", 2024-04-19T02:15:52.202 INFO:teuthology.orchestra.run.smithi121.stdout: "crush_location_hook": "", 2024-04-19T02:15:52.202 INFO:teuthology.orchestra.run.smithi121.stdout: "crush_location_hook_timeout": "10", 2024-04-19T02:15:52.202 INFO:teuthology.orchestra.run.smithi121.stdout: "daemonize": "false", 2024-04-19T02:15:52.202 INFO:teuthology.orchestra.run.smithi121.stdout: "daos_pool": "tank", 2024-04-19T02:15:52.202 INFO:teuthology.orchestra.run.smithi121.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-04-19T02:15:52.202 INFO:teuthology.orchestra.run.smithi121.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-04-19T02:15:52.202 INFO:teuthology.orchestra.run.smithi121.stdout: "dbstore_db_name_prefix": "dbstore", 2024-04-19T02:15:52.203 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_alienstore": "0/5", 2024-04-19T02:15:52.203 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_allow_any_pool_priority": "false", 2024-04-19T02:15:52.203 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_asok": "1/5", 2024-04-19T02:15:52.203 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_asok_assert_abort": "false", 2024-04-19T02:15:52.203 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_asserts_on_shutdown": "true", 2024-04-19T02:15:52.203 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_auth": "20/20", 2024-04-19T02:15:52.203 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_bdev": "1/3", 2024-04-19T02:15:52.203 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_bluefs": "1/5", 2024-04-19T02:15:52.203 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_bluestore": "1/5", 2024-04-19T02:15:52.203 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_buffer": "0/1", 2024-04-19T02:15:52.203 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_ceph_exporter": "1/5", 2024-04-19T02:15:52.203 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_cephfs_mirror": "0/5", 2024-04-19T02:15:52.204 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_cephsqlite": "0/5", 2024-04-19T02:15:52.204 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_client": "0/5", 2024-04-19T02:15:52.204 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_compressor": "1/5", 2024-04-19T02:15:52.204 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_context": "0/1", 2024-04-19T02:15:52.204 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_crush": "1/1", 2024-04-19T02:15:52.204 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_crypto": "1/5", 2024-04-19T02:15:52.204 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_cyanstore": "0/5", 2024-04-19T02:15:52.204 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_deliberately_leak_memory": "false", 2024-04-19T02:15:52.204 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_disable_randomized_ping": "false", 2024-04-19T02:15:52.204 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_dpdk": "1/5", 2024-04-19T02:15:52.204 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_eventtrace": "1/5", 2024-04-19T02:15:52.204 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_filer": "0/1", 2024-04-19T02:15:52.204 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_filestore": "1/3", 2024-04-19T02:15:52.204 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_finisher": "1/1", 2024-04-19T02:15:52.204 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_fuse": "1/5", 2024-04-19T02:15:52.205 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_heartbeat_testing_span": "0", 2024-04-19T02:15:52.205 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_heartbeatmap": "1/5", 2024-04-19T02:15:52.205 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_immutable_obj_cache": "0/5", 2024-04-19T02:15:52.205 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_javaclient": "1/5", 2024-04-19T02:15:52.205 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_journal": "1/3", 2024-04-19T02:15:52.205 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_journaler": "0/5", 2024-04-19T02:15:52.205 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_kstore": "1/5", 2024-04-19T02:15:52.205 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_leveldb": "4/5", 2024-04-19T02:15:52.205 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_lockdep": "0/1", 2024-04-19T02:15:52.205 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_mclock": "1/5", 2024-04-19T02:15:52.205 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_mds": "1/5", 2024-04-19T02:15:52.205 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_mds_balancer": "1/5", 2024-04-19T02:15:52.205 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_mds_locker": "1/5", 2024-04-19T02:15:52.205 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_mds_log": "1/5", 2024-04-19T02:15:52.205 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_mds_log_expire": "1/5", 2024-04-19T02:15:52.206 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_mds_migrator": "1/5", 2024-04-19T02:15:52.206 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_memstore": "1/5", 2024-04-19T02:15:52.206 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_mgr": "2/5", 2024-04-19T02:15:52.206 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_mgrc": "1/5", 2024-04-19T02:15:52.206 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_mon": "20/20", 2024-04-19T02:15:52.206 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_monc": "0/10", 2024-04-19T02:15:52.206 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_ms": "1/1", 2024-04-19T02:15:52.206 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_none": "0/5", 2024-04-19T02:15:52.206 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_objclass": "0/5", 2024-04-19T02:15:52.206 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_objectcacher": "0/5", 2024-04-19T02:15:52.207 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_objecter": "0/1", 2024-04-19T02:15:52.207 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_optracker": "0/5", 2024-04-19T02:15:52.207 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_osd": "1/5", 2024-04-19T02:15:52.207 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_paxos": "20/20", 2024-04-19T02:15:52.207 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_perfcounter": "1/5", 2024-04-19T02:15:52.207 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_prioritycache": "1/5", 2024-04-19T02:15:52.207 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_rados": "0/5", 2024-04-19T02:15:52.207 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_rbd": "0/5", 2024-04-19T02:15:52.207 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_rbd_mirror": "0/5", 2024-04-19T02:15:52.207 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_rbd_pwl": "0/5", 2024-04-19T02:15:52.207 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_rbd_replay": "0/5", 2024-04-19T02:15:52.207 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_refs": "0/0", 2024-04-19T02:15:52.207 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_reserver": "1/1", 2024-04-19T02:15:52.207 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_rgw": "1/5", 2024-04-19T02:15:52.207 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_rgw_access": "1/5", 2024-04-19T02:15:52.207 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_rgw_datacache": "1/5", 2024-04-19T02:15:52.208 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_rgw_dbstore": "1/5", 2024-04-19T02:15:52.208 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_rgw_flight": "1/5", 2024-04-19T02:15:52.208 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_rgw_sync": "1/5", 2024-04-19T02:15:52.208 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_rocksdb": "4/5", 2024-04-19T02:15:52.208 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_seastore": "0/5", 2024-04-19T02:15:52.208 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_seastore_backref": "0/5", 2024-04-19T02:15:52.208 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_seastore_cache": "0/5", 2024-04-19T02:15:52.208 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_seastore_cleaner": "0/5", 2024-04-19T02:15:52.208 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_seastore_device": "0/5", 2024-04-19T02:15:52.208 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_seastore_epm": "0/5", 2024-04-19T02:15:52.208 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-04-19T02:15:52.208 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_seastore_journal": "0/5", 2024-04-19T02:15:52.208 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_seastore_lba": "0/5", 2024-04-19T02:15:52.208 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_seastore_odata": "0/5", 2024-04-19T02:15:52.208 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_seastore_omap": "0/5", 2024-04-19T02:15:52.209 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_seastore_onode": "0/5", 2024-04-19T02:15:52.209 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_seastore_t": "0/5", 2024-04-19T02:15:52.209 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_seastore_tm": "0/5", 2024-04-19T02:15:52.209 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_striper": "0/1", 2024-04-19T02:15:52.209 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_test": "0/5", 2024-04-19T02:15:52.209 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_throttle": "1/1", 2024-04-19T02:15:52.209 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_timer": "0/1", 2024-04-19T02:15:52.209 INFO:teuthology.orchestra.run.smithi121.stdout: "debug_tp": "0/5", 2024-04-19T02:15:52.209 INFO:teuthology.orchestra.run.smithi121.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-04-19T02:15:52.209 INFO:teuthology.orchestra.run.smithi121.stdout: "device_failure_prediction_mode": "none", 2024-04-19T02:15:52.209 INFO:teuthology.orchestra.run.smithi121.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-04-19T02:15:52.209 INFO:teuthology.orchestra.run.smithi121.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2024-04-19T02:15:52.209 INFO:teuthology.orchestra.run.smithi121.stdout: "err_to_graylog": "false", 2024-04-19T02:15:52.209 INFO:teuthology.orchestra.run.smithi121.stdout: "err_to_journald": "false", 2024-04-19T02:15:52.209 INFO:teuthology.orchestra.run.smithi121.stdout: "err_to_stderr": "true", 2024-04-19T02:15:52.210 INFO:teuthology.orchestra.run.smithi121.stdout: "err_to_syslog": "false", 2024-04-19T02:15:52.210 INFO:teuthology.orchestra.run.smithi121.stdout: "event_tracing": "false", 2024-04-19T02:15:52.210 INFO:teuthology.orchestra.run.smithi121.stdout: "exporter_addr": "0.0.0.0", 2024-04-19T02:15:52.210 INFO:teuthology.orchestra.run.smithi121.stdout: "exporter_http_port": "9926", 2024-04-19T02:15:52.210 INFO:teuthology.orchestra.run.smithi121.stdout: "exporter_prio_limit": "5", 2024-04-19T02:15:52.210 INFO:teuthology.orchestra.run.smithi121.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-04-19T02:15:52.210 INFO:teuthology.orchestra.run.smithi121.stdout: "exporter_sort_metrics": "true", 2024-04-19T02:15:52.210 INFO:teuthology.orchestra.run.smithi121.stdout: "exporter_stats_period": "5", 2024-04-19T02:15:52.210 INFO:teuthology.orchestra.run.smithi121.stdout: "fake_statfs_for_testing": "0", 2024-04-19T02:15:52.210 INFO:teuthology.orchestra.run.smithi121.stdout: "fatal_signal_handlers": "true", 2024-04-19T02:15:52.210 INFO:teuthology.orchestra.run.smithi121.stdout: "filer_max_purge_ops": "10", 2024-04-19T02:15:52.210 INFO:teuthology.orchestra.run.smithi121.stdout: "filer_max_truncate_ops": "128", 2024-04-19T02:15:52.210 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_apply_finisher_threads": "1", 2024-04-19T02:15:52.210 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_blackhole": "false", 2024-04-19T02:15:52.211 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_btrfs_clone_range": "true", 2024-04-19T02:15:52.211 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_btrfs_snap": "true", 2024-04-19T02:15:52.211 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_caller_concurrency": "10", 2024-04-19T02:15:52.211 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_collect_device_partition_information": "true", 2024-04-19T02:15:52.211 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_commit_timeout": "600.000000", 2024-04-19T02:15:52.211 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_debug_inject_read_err": "false", 2024-04-19T02:15:52.211 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_debug_omap_check": "false", 2024-04-19T02:15:52.211 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_debug_random_read_err": "0.000000", 2024-04-19T02:15:52.211 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_debug_verify_split": "false", 2024-04-19T02:15:52.211 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_dump_file": "", 2024-04-19T02:15:52.211 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-04-19T02:15:52.211 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-04-19T02:15:52.211 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_fadvise": "true", 2024-04-19T02:15:52.211 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_fail_eio": "true", 2024-04-19T02:15:52.211 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_fd_cache_shards": "16", 2024-04-19T02:15:52.212 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_fd_cache_size": "128", 2024-04-19T02:15:52.212 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_fiemap": "false", 2024-04-19T02:15:52.212 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_fiemap_threshold": "4096", 2024-04-19T02:15:52.212 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-04-19T02:15:52.212 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_index_retry_probability": "0.000000", 2024-04-19T02:15:52.212 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_inject_stall": "0", 2024-04-19T02:15:52.212 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_journal_parallel": "false", 2024-04-19T02:15:52.212 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_journal_trailing": "false", 2024-04-19T02:15:52.212 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_journal_writeahead": "false", 2024-04-19T02:15:52.212 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_kill_at": "0", 2024-04-19T02:15:52.212 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-04-19T02:15:52.212 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_max_inline_xattr_size": "0", 2024-04-19T02:15:52.212 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-04-19T02:15:52.212 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-04-19T02:15:52.212 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-04-19T02:15:52.212 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_max_inline_xattrs": "0", 2024-04-19T02:15:52.212 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-04-19T02:15:52.213 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_max_inline_xattrs_other": "2", 2024-04-19T02:15:52.213 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-04-19T02:15:52.213 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_max_sync_interval": "5.000000", 2024-04-19T02:15:52.213 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_max_xattr_value_size": "0", 2024-04-19T02:15:52.213 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-04-19T02:15:52.213 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-04-19T02:15:52.213 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-04-19T02:15:52.213 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_merge_threshold": "-10", 2024-04-19T02:15:52.213 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_min_sync_interval": "0.010000", 2024-04-19T02:15:52.213 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_odsync_write": "false", 2024-04-19T02:15:52.213 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_omap_backend": "rocksdb", 2024-04-19T02:15:52.213 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_omap_backend_path": "", 2024-04-19T02:15:52.213 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_omap_header_cache_size": "1024", 2024-04-19T02:15:52.214 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_ondisk_finisher_threads": "1", 2024-04-19T02:15:52.214 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-04-19T02:15:52.214 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_op_thread_timeout": "60", 2024-04-19T02:15:52.214 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_op_threads": "2", 2024-04-19T02:15:52.214 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_punch_hole": "false", 2024-04-19T02:15:52.214 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-04-19T02:15:52.214 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-04-19T02:15:52.214 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-04-19T02:15:52.214 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-04-19T02:15:52.214 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-04-19T02:15:52.214 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_queue_max_bytes": "104857600", 2024-04-19T02:15:52.214 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-04-19T02:15:52.214 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-04-19T02:15:52.214 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-04-19T02:15:52.215 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_queue_max_ops": "50", 2024-04-19T02:15:52.215 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-04-19T02:15:52.215 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_seek_data_hole": "false", 2024-04-19T02:15:52.215 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_sloppy_crc": "false", 2024-04-19T02:15:52.215 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-04-19T02:15:52.215 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_splice": "false", 2024-04-19T02:15:52.215 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_split_multiple": "2", 2024-04-19T02:15:52.215 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_split_rand_factor": "20", 2024-04-19T02:15:52.215 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_update_to": "1000", 2024-04-19T02:15:52.215 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-04-19T02:15:52.215 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-04-19T02:15:52.215 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-04-19T02:15:52.215 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-04-19T02:15:52.215 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-04-19T02:15:52.215 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-04-19T02:15:52.215 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_wbthrottle_enable": "true", 2024-04-19T02:15:52.216 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-04-19T02:15:52.216 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-04-19T02:15:52.216 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-04-19T02:15:52.216 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-04-19T02:15:52.216 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-04-19T02:15:52.216 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-04-19T02:15:52.216 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_xfs_extsize": "false", 2024-04-19T02:15:52.216 INFO:teuthology.orchestra.run.smithi121.stdout: "filestore_zfs_snap": "false", 2024-04-19T02:15:52.216 INFO:teuthology.orchestra.run.smithi121.stdout: "fio_dir": "/tmp/fio", 2024-04-19T02:15:52.216 INFO:teuthology.orchestra.run.smithi121.stdout: "fsid": "f6ab5dd0-bb9f-4b48-a9fc-4728c7955ca8", 2024-04-19T02:15:52.216 INFO:teuthology.orchestra.run.smithi121.stdout: "fuse_allow_other": "true", 2024-04-19T02:15:52.216 INFO:teuthology.orchestra.run.smithi121.stdout: "fuse_atomic_o_trunc": "true", 2024-04-19T02:15:52.216 INFO:teuthology.orchestra.run.smithi121.stdout: "fuse_big_writes": "true", 2024-04-19T02:15:52.216 INFO:teuthology.orchestra.run.smithi121.stdout: "fuse_debug": "false", 2024-04-19T02:15:52.216 INFO:teuthology.orchestra.run.smithi121.stdout: "fuse_default_permissions": "false", 2024-04-19T02:15:52.217 INFO:teuthology.orchestra.run.smithi121.stdout: "fuse_disable_pagecache": "false", 2024-04-19T02:15:52.217 INFO:teuthology.orchestra.run.smithi121.stdout: "fuse_max_write": "0", 2024-04-19T02:15:52.217 INFO:teuthology.orchestra.run.smithi121.stdout: "fuse_multithreaded": "true", 2024-04-19T02:15:52.217 INFO:teuthology.orchestra.run.smithi121.stdout: "fuse_require_active_mds": "true", 2024-04-19T02:15:52.217 INFO:teuthology.orchestra.run.smithi121.stdout: "fuse_set_user_groups": "true", 2024-04-19T02:15:52.217 INFO:teuthology.orchestra.run.smithi121.stdout: "fuse_splice_move": "true", 2024-04-19T02:15:52.217 INFO:teuthology.orchestra.run.smithi121.stdout: "fuse_splice_read": "true", 2024-04-19T02:15:52.217 INFO:teuthology.orchestra.run.smithi121.stdout: "fuse_splice_write": "true", 2024-04-19T02:15:52.217 INFO:teuthology.orchestra.run.smithi121.stdout: "fuse_syncfs_on_mksnap": "true", 2024-04-19T02:15:52.217 INFO:teuthology.orchestra.run.smithi121.stdout: "fuse_use_invalidate_cb": "true", 2024-04-19T02:15:52.217 INFO:teuthology.orchestra.run.smithi121.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-04-19T02:15:52.217 INFO:teuthology.orchestra.run.smithi121.stdout: "gss_target_name": "ceph", 2024-04-19T02:15:52.217 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_file": "", 2024-04-19T02:15:52.217 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_inject_failure": "0", 2024-04-19T02:15:52.217 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_interval": "5", 2024-04-19T02:15:52.217 INFO:teuthology.orchestra.run.smithi121.stdout: "host": "smithi121", 2024-04-19T02:15:52.217 INFO:teuthology.orchestra.run.smithi121.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-04-19T02:15:52.218 INFO:teuthology.orchestra.run.smithi121.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-04-19T02:15:52.218 INFO:teuthology.orchestra.run.smithi121.stdout: "immutable_object_cache_max_size": "1073741824", 2024-04-19T02:15:52.218 INFO:teuthology.orchestra.run.smithi121.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-04-19T02:15:52.218 INFO:teuthology.orchestra.run.smithi121.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-04-19T02:15:52.218 INFO:teuthology.orchestra.run.smithi121.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-04-19T02:15:52.218 INFO:teuthology.orchestra.run.smithi121.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-04-19T02:15:52.218 INFO:teuthology.orchestra.run.smithi121.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-04-19T02:15:52.218 INFO:teuthology.orchestra.run.smithi121.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-04-19T02:15:52.218 INFO:teuthology.orchestra.run.smithi121.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-04-19T02:15:52.218 INFO:teuthology.orchestra.run.smithi121.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-04-19T02:15:52.218 INFO:teuthology.orchestra.run.smithi121.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-04-19T02:15:52.218 INFO:teuthology.orchestra.run.smithi121.stdout: "immutable_object_cache_watermark": "0.900000", 2024-04-19T02:15:52.218 INFO:teuthology.orchestra.run.smithi121.stdout: "inject_early_sigterm": "false", 2024-04-19T02:15:52.218 INFO:teuthology.orchestra.run.smithi121.stdout: "jaeger_agent_port": "6799", 2024-04-19T02:15:52.218 INFO:teuthology.orchestra.run.smithi121.stdout: "jaeger_tracing_enable": "false", 2024-04-19T02:15:52.219 INFO:teuthology.orchestra.run.smithi121.stdout: "journal_aio": "true", 2024-04-19T02:15:52.219 INFO:teuthology.orchestra.run.smithi121.stdout: "journal_align_min_size": "65536", 2024-04-19T02:15:52.219 INFO:teuthology.orchestra.run.smithi121.stdout: "journal_block_align": "true", 2024-04-19T02:15:52.219 INFO:teuthology.orchestra.run.smithi121.stdout: "journal_block_size": "4096", 2024-04-19T02:15:52.219 INFO:teuthology.orchestra.run.smithi121.stdout: "journal_dio": "true", 2024-04-19T02:15:52.219 INFO:teuthology.orchestra.run.smithi121.stdout: "journal_discard": "false", 2024-04-19T02:15:52.219 INFO:teuthology.orchestra.run.smithi121.stdout: "journal_force_aio": "false", 2024-04-19T02:15:52.219 INFO:teuthology.orchestra.run.smithi121.stdout: "journal_ignore_corruption": "false", 2024-04-19T02:15:52.219 INFO:teuthology.orchestra.run.smithi121.stdout: "journal_max_write_bytes": "10485760", 2024-04-19T02:15:52.219 INFO:teuthology.orchestra.run.smithi121.stdout: "journal_max_write_entries": "100", 2024-04-19T02:15:52.219 INFO:teuthology.orchestra.run.smithi121.stdout: "journal_replay_from": "0", 2024-04-19T02:15:52.219 INFO:teuthology.orchestra.run.smithi121.stdout: "journal_throttle_high_multiple": "0.000000", 2024-04-19T02:15:52.220 INFO:teuthology.orchestra.run.smithi121.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-04-19T02:15:52.220 INFO:teuthology.orchestra.run.smithi121.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-04-19T02:15:52.220 INFO:teuthology.orchestra.run.smithi121.stdout: "journal_throttle_max_multiple": "0.000000", 2024-04-19T02:15:52.220 INFO:teuthology.orchestra.run.smithi121.stdout: "journal_write_header_frequency": "0", 2024-04-19T02:15:52.220 INFO:teuthology.orchestra.run.smithi121.stdout: "journal_zero_on_create": "false", 2024-04-19T02:15:52.220 INFO:teuthology.orchestra.run.smithi121.stdout: "journaler_prefetch_periods": "10", 2024-04-19T02:15:52.220 INFO:teuthology.orchestra.run.smithi121.stdout: "journaler_prezero_periods": "5", 2024-04-19T02:15:52.220 INFO:teuthology.orchestra.run.smithi121.stdout: "journaler_write_head_interval": "15", 2024-04-19T02:15:52.220 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "", 2024-04-19T02:15:52.220 INFO:teuthology.orchestra.run.smithi121.stdout: "keyfile": "", 2024-04-19T02:15:52.220 INFO:teuthology.orchestra.run.smithi121.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-04-19T02:15:52.220 INFO:teuthology.orchestra.run.smithi121.stdout: "kstore_backend": "rocksdb", 2024-04-19T02:15:52.220 INFO:teuthology.orchestra.run.smithi121.stdout: "kstore_default_stripe_size": "65536", 2024-04-19T02:15:52.220 INFO:teuthology.orchestra.run.smithi121.stdout: "kstore_fsck_on_mount": "false", 2024-04-19T02:15:52.220 INFO:teuthology.orchestra.run.smithi121.stdout: "kstore_fsck_on_mount_deep": "true", 2024-04-19T02:15:52.220 INFO:teuthology.orchestra.run.smithi121.stdout: "kstore_max_bytes": "67108864", 2024-04-19T02:15:52.221 INFO:teuthology.orchestra.run.smithi121.stdout: "kstore_max_ops": "512", 2024-04-19T02:15:52.221 INFO:teuthology.orchestra.run.smithi121.stdout: "kstore_nid_prealloc": "1024", 2024-04-19T02:15:52.221 INFO:teuthology.orchestra.run.smithi121.stdout: "kstore_onode_map_size": "1024", 2024-04-19T02:15:52.221 INFO:teuthology.orchestra.run.smithi121.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-04-19T02:15:52.221 INFO:teuthology.orchestra.run.smithi121.stdout: "kstore_sync_submit_transaction": "false", 2024-04-19T02:15:52.221 INFO:teuthology.orchestra.run.smithi121.stdout: "kstore_sync_transaction": "false", 2024-04-19T02:15:52.221 INFO:teuthology.orchestra.run.smithi121.stdout: "leveldb_block_size": "65536", 2024-04-19T02:15:52.221 INFO:teuthology.orchestra.run.smithi121.stdout: "leveldb_bloom_size": "0", 2024-04-19T02:15:52.221 INFO:teuthology.orchestra.run.smithi121.stdout: "leveldb_cache_size": "536870912", 2024-04-19T02:15:52.221 INFO:teuthology.orchestra.run.smithi121.stdout: "leveldb_compact_on_mount": "false", 2024-04-19T02:15:52.221 INFO:teuthology.orchestra.run.smithi121.stdout: "leveldb_compression": "false", 2024-04-19T02:15:52.221 INFO:teuthology.orchestra.run.smithi121.stdout: "leveldb_log": "", 2024-04-19T02:15:52.221 INFO:teuthology.orchestra.run.smithi121.stdout: "leveldb_log_to_ceph_log": "true", 2024-04-19T02:15:52.221 INFO:teuthology.orchestra.run.smithi121.stdout: "leveldb_max_open_files": "0", 2024-04-19T02:15:52.221 INFO:teuthology.orchestra.run.smithi121.stdout: "leveldb_paranoid": "false", 2024-04-19T02:15:52.221 INFO:teuthology.orchestra.run.smithi121.stdout: "leveldb_write_buffer_size": "33554432", 2024-04-19T02:15:52.221 INFO:teuthology.orchestra.run.smithi121.stdout: "librados_thread_count": "2", 2024-04-19T02:15:52.222 INFO:teuthology.orchestra.run.smithi121.stdout: "lockdep": "false", 2024-04-19T02:15:52.222 INFO:teuthology.orchestra.run.smithi121.stdout: "lockdep_force_backtrace": "false", 2024-04-19T02:15:52.222 INFO:teuthology.orchestra.run.smithi121.stdout: "log_coarse_timestamps": "true", 2024-04-19T02:15:52.222 INFO:teuthology.orchestra.run.smithi121.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-04-19T02:15:52.222 INFO:teuthology.orchestra.run.smithi121.stdout: "log_flush_on_exit": "false", 2024-04-19T02:15:52.222 INFO:teuthology.orchestra.run.smithi121.stdout: "log_graylog_host": "127.0.0.1", 2024-04-19T02:15:52.222 INFO:teuthology.orchestra.run.smithi121.stdout: "log_graylog_port": "12201", 2024-04-19T02:15:52.222 INFO:teuthology.orchestra.run.smithi121.stdout: "log_max_new": "1000", 2024-04-19T02:15:52.222 INFO:teuthology.orchestra.run.smithi121.stdout: "log_max_recent": "10000", 2024-04-19T02:15:52.222 INFO:teuthology.orchestra.run.smithi121.stdout: "log_stderr_prefix": "", 2024-04-19T02:15:52.222 INFO:teuthology.orchestra.run.smithi121.stdout: "log_stop_at_utilization": "0.970000", 2024-04-19T02:15:52.222 INFO:teuthology.orchestra.run.smithi121.stdout: "log_to_file": "true", 2024-04-19T02:15:52.222 INFO:teuthology.orchestra.run.smithi121.stdout: "log_to_graylog": "false", 2024-04-19T02:15:52.223 INFO:teuthology.orchestra.run.smithi121.stdout: "log_to_journald": "false", 2024-04-19T02:15:52.223 INFO:teuthology.orchestra.run.smithi121.stdout: "log_to_stderr": "false", 2024-04-19T02:15:52.223 INFO:teuthology.orchestra.run.smithi121.stdout: "log_to_syslog": "false", 2024-04-19T02:15:52.223 INFO:teuthology.orchestra.run.smithi121.stdout: "max_rotating_auth_attempts": "10", 2024-04-19T02:15:52.223 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-04-19T02:15:52.223 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_action_on_write_error": "1", 2024-04-19T02:15:52.223 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_alternate_name_max": "8192", 2024-04-19T02:15:52.223 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_asio_thread_count": "2", 2024-04-19T02:15:52.223 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_bal_export_pin": "true", 2024-04-19T02:15:52.223 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_bal_fragment_dirs": "true", 2024-04-19T02:15:52.223 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-04-19T02:15:52.223 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_bal_fragment_interval": "5", 2024-04-19T02:15:52.223 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_bal_fragment_size_max": "100000", 2024-04-19T02:15:52.223 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_bal_idle_threshold": "0.000000", 2024-04-19T02:15:52.224 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_bal_interval": "10", 2024-04-19T02:15:52.224 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_bal_max": "-1", 2024-04-19T02:15:52.224 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_bal_max_until": "-1", 2024-04-19T02:15:52.224 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_bal_merge_size": "50", 2024-04-19T02:15:52.224 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_bal_midchunk": "0.300000", 2024-04-19T02:15:52.224 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_bal_min_rebalance": "0.100000", 2024-04-19T02:15:52.224 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_bal_min_start": "0.200000", 2024-04-19T02:15:52.224 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_bal_minchunk": "0.001000", 2024-04-19T02:15:52.224 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_bal_mode": "0", 2024-04-19T02:15:52.224 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_bal_need_max": "1.200000", 2024-04-19T02:15:52.224 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_bal_need_min": "0.800000", 2024-04-19T02:15:52.224 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-04-19T02:15:52.224 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_bal_sample_interval": "3.000000", 2024-04-19T02:15:52.224 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_bal_split_bits": "3", 2024-04-19T02:15:52.224 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_bal_split_rd": "25000.000000", 2024-04-19T02:15:52.225 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_bal_split_size": "10000", 2024-04-19T02:15:52.225 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_bal_split_wr": "10000.000000", 2024-04-19T02:15:52.225 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_bal_target_decay": "10.000000", 2024-04-19T02:15:52.225 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-04-19T02:15:52.225 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_beacon_grace": "15.000000", 2024-04-19T02:15:52.225 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_beacon_interval": "4.000000", 2024-04-19T02:15:52.225 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_beacon_mon_down_grace": "60", 2024-04-19T02:15:52.225 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_cache_memory_limit": "4294967296", 2024-04-19T02:15:52.225 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_cache_mid": "0.700000", 2024-04-19T02:15:52.225 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_cache_release_free_interval": "10", 2024-04-19T02:15:52.225 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_cache_reservation": "0.050000", 2024-04-19T02:15:52.225 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-04-19T02:15:52.225 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_cache_trim_interval": "1", 2024-04-19T02:15:52.225 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_cache_trim_threshold": "262144", 2024-04-19T02:15:52.225 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-04-19T02:15:52.225 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-04-19T02:15:52.225 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_client_delegate_inos_pct": "50", 2024-04-19T02:15:52.226 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_client_prealloc_inos": "1000", 2024-04-19T02:15:52.226 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-04-19T02:15:52.226 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_connect_bootstrapping": "false", 2024-04-19T02:15:52.226 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_damage_table_max_entries": "10000", 2024-04-19T02:15:52.226 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-04-19T02:15:52.226 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_debug_auth_pins": "false", 2024-04-19T02:15:52.226 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_debug_frag": "false", 2024-04-19T02:15:52.226 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_debug_scatterstat": "false", 2024-04-19T02:15:52.226 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_debug_subtrees": "false", 2024-04-19T02:15:52.226 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_decay_halflife": "5.000000", 2024-04-19T02:15:52.226 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_default_dir_hash": "2", 2024-04-19T02:15:52.226 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_defer_session_stale": "true", 2024-04-19T02:15:52.226 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_deny_all_reconnect": "false", 2024-04-19T02:15:52.226 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_dir_keys_per_op": "16384", 2024-04-19T02:15:52.227 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_dir_max_commit_size": "10", 2024-04-19T02:15:52.227 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_dir_max_entries": "0", 2024-04-19T02:15:52.227 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_dir_prefetch": "true", 2024-04-19T02:15:52.227 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_dirstat_min_interval": "1.000000", 2024-04-19T02:15:52.227 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_dump_cache_after_rejoin": "false", 2024-04-19T02:15:52.227 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_dump_cache_on_map": "false", 2024-04-19T02:15:52.227 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_dump_cache_threshold_file": "0", 2024-04-19T02:15:52.227 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-04-19T02:15:52.227 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_early_reply": "true", 2024-04-19T02:15:52.227 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_enable_op_tracker": "true", 2024-04-19T02:15:52.227 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_enforce_unique_name": "true", 2024-04-19T02:15:52.227 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_export_ephemeral_distributed": "true", 2024-04-19T02:15:52.227 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-04-19T02:15:52.227 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_export_ephemeral_random": "true", 2024-04-19T02:15:52.227 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-04-19T02:15:52.227 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-04-19T02:15:52.227 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_forward_all_requests_to_auth": "false", 2024-04-19T02:15:52.228 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-04-19T02:15:52.228 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-04-19T02:15:52.228 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-04-19T02:15:52.228 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-04-19T02:15:52.228 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_health_cache_threshold": "1.500000", 2024-04-19T02:15:52.228 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_health_summarize_threshold": "10", 2024-04-19T02:15:52.228 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_heartbeat_grace": "15.000000", 2024-04-19T02:15:52.228 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_heartbeat_reset_grace": "1000", 2024-04-19T02:15:52.228 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_inject_health_dummy": "false", 2024-04-19T02:15:52.228 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-04-19T02:15:52.228 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_inject_migrator_session_race": "false", 2024-04-19T02:15:52.228 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-04-19T02:15:52.228 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-04-19T02:15:52.228 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-04-19T02:15:52.228 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_join_fs": "", 2024-04-19T02:15:52.228 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_journal_format": "1", 2024-04-19T02:15:52.228 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_kill_create_at": "0", 2024-04-19T02:15:52.229 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_kill_export_at": "0", 2024-04-19T02:15:52.229 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_kill_import_at": "0", 2024-04-19T02:15:52.229 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_kill_journal_at": "0", 2024-04-19T02:15:52.229 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_kill_journal_expire_at": "0", 2024-04-19T02:15:52.229 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_kill_journal_replay_at": "0", 2024-04-19T02:15:52.229 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_kill_link_at": "0", 2024-04-19T02:15:52.229 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_kill_mdstable_at": "0", 2024-04-19T02:15:52.229 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_kill_openc_at": "0", 2024-04-19T02:15:52.229 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_kill_rename_at": "0", 2024-04-19T02:15:52.229 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_kill_skip_replaying_inotable": "false", 2024-04-19T02:15:52.229 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_log_events_per_segment": "1024", 2024-04-19T02:15:52.229 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_log_max_events": "-1", 2024-04-19T02:15:52.229 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_log_max_segments": "128", 2024-04-19T02:15:52.229 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_log_pause": "false", 2024-04-19T02:15:52.229 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_log_segment_size": "0", 2024-04-19T02:15:52.229 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_log_skip_corrupt_events": "false", 2024-04-19T02:15:52.229 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_log_warn_factor": "2.000000", 2024-04-19T02:15:52.230 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_max_caps_per_client": "1048576", 2024-04-19T02:15:52.230 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_max_completed_flushes": "100000", 2024-04-19T02:15:52.230 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_max_completed_requests": "100000", 2024-04-19T02:15:52.230 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_max_export_size": "20971520", 2024-04-19T02:15:52.230 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_max_file_recover": "32", 2024-04-19T02:15:52.230 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_max_purge_files": "64", 2024-04-19T02:15:52.230 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_max_purge_ops": "8192", 2024-04-19T02:15:52.230 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-04-19T02:15:52.230 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-04-19T02:15:52.230 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_max_snaps_per_dir": "100", 2024-04-19T02:15:52.230 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_metrics_update_interval": "2", 2024-04-19T02:15:52.230 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_min_caps_per_client": "100", 2024-04-19T02:15:52.230 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_min_caps_working_set": "10000", 2024-04-19T02:15:52.230 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-04-19T02:15:52.231 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_numa_node": "-1", 2024-04-19T02:15:52.231 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-04-19T02:15:52.231 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_op_complaint_time": "30.000000", 2024-04-19T02:15:52.231 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_op_history_duration": "600", 2024-04-19T02:15:52.231 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_op_history_size": "20", 2024-04-19T02:15:52.231 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_op_history_slow_op_size": "20", 2024-04-19T02:15:52.231 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_op_history_slow_op_threshold": "10", 2024-04-19T02:15:52.231 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_op_log_threshold": "5", 2024-04-19T02:15:52.231 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_ping_grace": "15", 2024-04-19T02:15:52.231 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_ping_interval": "5", 2024-04-19T02:15:52.231 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-04-19T02:15:52.231 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-04-19T02:15:52.231 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_recall_max_caps": "30000", 2024-04-19T02:15:52.231 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-04-19T02:15:52.231 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_recall_max_decay_threshold": "131072", 2024-04-19T02:15:52.232 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-04-19T02:15:52.232 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_recall_warning_threshold": "262144", 2024-04-19T02:15:52.232 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_reconnect_timeout": "45.000000", 2024-04-19T02:15:52.232 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_replay_interval": "1.000000", 2024-04-19T02:15:52.232 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-04-19T02:15:52.232 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-04-19T02:15:52.232 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_root_ino_gid": "0", 2024-04-19T02:15:52.232 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_root_ino_uid": "0", 2024-04-19T02:15:52.232 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-04-19T02:15:52.232 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_session_blocklist_on_evict": "true", 2024-04-19T02:15:52.232 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_session_blocklist_on_timeout": "true", 2024-04-19T02:15:52.232 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-04-19T02:15:52.232 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-04-19T02:15:52.232 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-04-19T02:15:52.232 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-04-19T02:15:52.232 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-04-19T02:15:52.233 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_session_metadata_threshold": "16777216", 2024-04-19T02:15:52.233 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-04-19T02:15:52.233 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_shutdown_check": "0", 2024-04-19T02:15:52.233 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_skip_ino": "0", 2024-04-19T02:15:52.233 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_sleep_rank_change": "0.000000", 2024-04-19T02:15:52.233 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_snap_max_uid": "4294967294", 2024-04-19T02:15:52.233 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_snap_min_uid": "0", 2024-04-19T02:15:52.233 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_snap_rstat": "false", 2024-04-19T02:15:52.233 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_standby_replay_damaged": "false", 2024-04-19T02:15:52.233 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_symlink_recovery": "true", 2024-04-19T02:15:52.233 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_task_status_update_interval": "2.000000", 2024-04-19T02:15:52.233 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_thrash_exports": "0", 2024-04-19T02:15:52.233 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_thrash_fragments": "0", 2024-04-19T02:15:52.233 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_tick_interval": "5.000000", 2024-04-19T02:15:52.233 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_valgrind_exit": "false", 2024-04-19T02:15:52.233 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_verify_backtrace": "1", 2024-04-19T02:15:52.233 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_verify_scatter": "false", 2024-04-19T02:15:52.234 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_wipe_ino_prealloc": "false", 2024-04-19T02:15:52.234 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_wipe_sessions": "false", 2024-04-19T02:15:52.234 INFO:teuthology.orchestra.run.smithi121.stdout: "mempool_debug": "false", 2024-04-19T02:15:52.234 INFO:teuthology.orchestra.run.smithi121.stdout: "memstore_debug_omit_block_device_write": "false", 2024-04-19T02:15:52.234 INFO:teuthology.orchestra.run.smithi121.stdout: "memstore_device_bytes": "1073741824", 2024-04-19T02:15:52.234 INFO:teuthology.orchestra.run.smithi121.stdout: "memstore_page_set": "false", 2024-04-19T02:15:52.234 INFO:teuthology.orchestra.run.smithi121.stdout: "memstore_page_size": "65536", 2024-04-19T02:15:52.234 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr_client_bytes": "134217728", 2024-04-19T02:15:52.234 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr_client_messages": "512", 2024-04-19T02:15:52.234 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-04-19T02:15:52.234 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr_connect_retry_interval": "1.000000", 2024-04-19T02:15:52.234 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-04-19T02:15:52.234 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-04-19T02:15:52.235 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr_disabled_modules": "", 2024-04-19T02:15:52.235 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-04-19T02:15:52.235 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr_max_pg_num_change": "128", 2024-04-19T02:15:52.235 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr_mds_bytes": "134217728", 2024-04-19T02:15:52.235 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr_mds_messages": "128", 2024-04-19T02:15:52.235 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-04-19T02:15:52.235 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr_mon_bytes": "134217728", 2024-04-19T02:15:52.235 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr_mon_messages": "128", 2024-04-19T02:15:52.235 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr_osd_bytes": "536870912", 2024-04-19T02:15:52.235 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr_osd_messages": "8192", 2024-04-19T02:15:52.235 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr_pool": "true", 2024-04-19T02:15:52.235 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr_service_beacon_grace": "60.000000", 2024-04-19T02:15:52.235 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr_standby_modules": "true", 2024-04-19T02:15:52.235 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr_stats_period": "5", 2024-04-19T02:15:52.235 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr_stats_threshold": "5", 2024-04-19T02:15:52.236 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr_tick_period": "2", 2024-04-19T02:15:52.236 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-04-19T02:15:52.236 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_accept_timeout_factor": "2.000000", 2024-04-19T02:15:52.236 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_allow_pool_delete": "true", 2024-04-19T02:15:52.236 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_allow_pool_size_one": "true", 2024-04-19T02:15:52.236 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_auth_validate_all_caps": "true", 2024-04-19T02:15:52.236 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-04-19T02:15:52.236 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-04-19T02:15:52.236 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_client_bytes": "104857600", 2024-04-19T02:15:52.236 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_client_directed_command_retry": "2", 2024-04-19T02:15:52.236 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_client_hunt_interval": "3.000000", 2024-04-19T02:15:52.236 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-04-19T02:15:52.236 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-04-19T02:15:52.236 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-04-19T02:15:52.236 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_client_hunt_parallel": "3", 2024-04-19T02:15:52.236 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_client_log_interval": "1.000000", 2024-04-19T02:15:52.237 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-04-19T02:15:52.237 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_client_ping_interval": "10.000000", 2024-04-19T02:15:52.237 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_client_ping_timeout": "30.000000", 2024-04-19T02:15:52.237 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_clock_drift_allowed": "1.000000", 2024-04-19T02:15:52.237 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-04-19T02:15:52.237 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-04-19T02:15:52.237 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_cluster_log_file_level": "debug", 2024-04-19T02:15:52.237 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_cluster_log_to_file": "true", 2024-04-19T02:15:52.237 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_cluster_log_to_graylog": "false", 2024-04-19T02:15:52.237 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-04-19T02:15:52.237 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-04-19T02:15:52.237 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_cluster_log_to_journald": "false", 2024-04-19T02:15:52.237 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_cluster_log_to_stderr": "false", 2024-04-19T02:15:52.237 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-04-19T02:15:52.237 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-04-19T02:15:52.238 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-04-19T02:15:52.238 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_compact_on_bootstrap": "false", 2024-04-19T02:15:52.238 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_compact_on_start": "false", 2024-04-19T02:15:52.238 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_compact_on_trim": "true", 2024-04-19T02:15:52.238 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_con_tracker_persist_interval": "10", 2024-04-19T02:15:52.238 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_con_tracker_score_halflife": "43200", 2024-04-19T02:15:52.238 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_config_key_max_entry_size": "65536", 2024-04-19T02:15:52.238 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_cpu_threads": "4", 2024-04-19T02:15:52.238 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_crush_min_required_version": "hammer", 2024-04-19T02:15:52.238 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_daemon_bytes": "419430400", 2024-04-19T02:15:52.238 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-04-19T02:15:52.238 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_data_avail_crit": "5", 2024-04-19T02:15:52.238 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_data_avail_warn": "5", 2024-04-19T02:15:52.238 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_data_size_warn": "16106127360", 2024-04-19T02:15:52.239 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_debug_block_osdmap_trim": "false", 2024-04-19T02:15:52.239 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-04-19T02:15:52.239 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_debug_dump_json": "false", 2024-04-19T02:15:52.239 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-04-19T02:15:52.239 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_debug_dump_transactions": "false", 2024-04-19T02:15:52.239 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_debug_extra_checks": "false", 2024-04-19T02:15:52.239 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-04-19T02:15:52.239 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-04-19T02:15:52.239 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_debug_no_require_quincy": "false", 2024-04-19T02:15:52.239 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_debug_no_require_reef": "false", 2024-04-19T02:15:52.239 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-04-19T02:15:52.239 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_delta_reset_interval": "10.000000", 2024-04-19T02:15:52.239 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_dns_srv_name": "ceph-mon", 2024-04-19T02:15:52.239 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_down_mkfs_grace": "120", 2024-04-19T02:15:52.240 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_election_default_strategy": "1", 2024-04-19T02:15:52.240 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_election_timeout": "5.000000", 2024-04-19T02:15:52.240 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-04-19T02:15:52.240 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_elector_ping_divisor": "2", 2024-04-19T02:15:52.240 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_elector_ping_timeout": "2.000000", 2024-04-19T02:15:52.240 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_enable_op_tracker": "true", 2024-04-19T02:15:52.240 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_fake_pool_delete": "false", 2024-04-19T02:15:52.240 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_force_quorum_join": "false", 2024-04-19T02:15:52.240 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_globalid_prealloc": "10000", 2024-04-19T02:15:52.240 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_health_detail_to_clog": "false", 2024-04-19T02:15:52.240 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_health_log_update_period": "5", 2024-04-19T02:15:52.240 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_health_max_detail": "50", 2024-04-19T02:15:52.240 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_health_to_clog": "true", 2024-04-19T02:15:52.240 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_health_to_clog_interval": "600", 2024-04-19T02:15:52.240 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-04-19T02:15:52.241 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_host": "172.21.15.121,[v2:172.21.15.121:3301,v1:172.21.15.121:6790],[v2:172.21.15.121:3302,v1:172.21.15.121:6791]", 2024-04-19T02:15:52.241 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_host_override": "", 2024-04-19T02:15:52.241 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_initial_members": "", 2024-04-19T02:15:52.241 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-04-19T02:15:52.241 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-04-19T02:15:52.241 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-04-19T02:15:52.241 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-04-19T02:15:52.241 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_keyvaluedb": "rocksdb", 2024-04-19T02:15:52.241 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_lease": "5.000000", 2024-04-19T02:15:52.241 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-04-19T02:15:52.241 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-04-19T02:15:52.241 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_log_full_interval": "50", 2024-04-19T02:15:52.241 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_log_max": "10000", 2024-04-19T02:15:52.241 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_log_max_summary": "50", 2024-04-19T02:15:52.241 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_max_log_entries_per_event": "4096", 2024-04-19T02:15:52.241 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_max_log_epochs": "500", 2024-04-19T02:15:52.242 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_max_mdsmap_epochs": "500", 2024-04-19T02:15:52.242 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_max_mgrmap_epochs": "500", 2024-04-19T02:15:52.242 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_max_osd": "10000", 2024-04-19T02:15:52.242 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_max_pg_per_osd": "10000", 2024-04-19T02:15:52.242 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_max_pool_pg_num": "65536", 2024-04-19T02:15:52.242 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-04-19T02:15:52.242 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-04-19T02:15:52.242 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_mds_force_trim_to": "0", 2024-04-19T02:15:52.242 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_mds_skip_sanity": "false", 2024-04-19T02:15:52.242 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_memory_autotune": "true", 2024-04-19T02:15:52.242 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_memory_target": "2147483648", 2024-04-19T02:15:52.242 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_mgr_beacon_grace": "30", 2024-04-19T02:15:52.242 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-04-19T02:15:52.243 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_mgr_digest_period": "5", 2024-04-19T02:15:52.243 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_mgr_inactive_grace": "60", 2024-04-19T02:15:52.243 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_mgr_mkfs_grace": "240", 2024-04-19T02:15:52.243 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-04-19T02:15:52.243 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_min_osdmap_epochs": "500", 2024-04-19T02:15:52.243 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_op_complaint_time": "30", 2024-04-19T02:15:52.243 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_op_history_duration": "600", 2024-04-19T02:15:52.243 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_op_history_size": "20", 2024-04-19T02:15:52.243 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_op_history_slow_op_size": "20", 2024-04-19T02:15:52.243 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_op_history_slow_op_threshold": "10", 2024-04-19T02:15:52.243 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_op_log_threshold": "5", 2024-04-19T02:15:52.243 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-04-19T02:15:52.243 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-04-19T02:15:52.243 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-04-19T02:15:52.243 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_osd_auto_mark_in": "false", 2024-04-19T02:15:52.244 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_osd_auto_mark_new_in": "true", 2024-04-19T02:15:52.244 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-04-19T02:15:52.244 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-04-19T02:15:52.244 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_osd_cache_size": "500", 2024-04-19T02:15:52.244 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_osd_cache_size_min": "134217728", 2024-04-19T02:15:52.244 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_osd_crush_smoke_test": "true", 2024-04-19T02:15:52.244 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_osd_destroyed_out_interval": "600", 2024-04-19T02:15:52.244 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_osd_down_out_interval": "600", 2024-04-19T02:15:52.244 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-04-19T02:15:52.244 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-04-19T02:15:52.244 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_osd_force_trim_to": "0", 2024-04-19T02:15:52.244 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_osd_full_ratio": "0.950000", 2024-04-19T02:15:52.244 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-04-19T02:15:52.244 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_osd_laggy_halflife": "3600", 2024-04-19T02:15:52.244 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_osd_laggy_max_interval": "300", 2024-04-19T02:15:52.245 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_osd_laggy_weight": "0.300000", 2024-04-19T02:15:52.245 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-04-19T02:15:52.245 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_osd_max_creating_pgs": "1024", 2024-04-19T02:15:52.245 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_osd_max_initial_pgs": "1024", 2024-04-19T02:15:52.245 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_osd_min_down_reporters": "2", 2024-04-19T02:15:52.245 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-04-19T02:15:52.245 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-04-19T02:15:52.245 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-04-19T02:15:52.245 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_osd_prime_pg_temp": "true", 2024-04-19T02:15:52.245 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-04-19T02:15:52.245 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-04-19T02:15:52.245 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_osd_report_timeout": "900", 2024-04-19T02:15:52.245 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-04-19T02:15:52.245 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-04-19T02:15:52.245 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_osd_warn_num_repaired": "10", 2024-04-19T02:15:52.245 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_osd_warn_op_age": "32.000000", 2024-04-19T02:15:52.246 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-04-19T02:15:52.246 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_osdmap_full_prune_interval": "10", 2024-04-19T02:15:52.246 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_osdmap_full_prune_min": "10000", 2024-04-19T02:15:52.246 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-04-19T02:15:52.246 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-04-19T02:15:52.246 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_pg_stuck_threshold": "60", 2024-04-19T02:15:52.246 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-04-19T02:15:52.246 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_pg_warn_min_objects": "10000", 2024-04-19T02:15:52.246 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_pg_warn_min_per_osd": "0", 2024-04-19T02:15:52.246 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-04-19T02:15:52.246 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_pool_quota_crit_threshold": "0", 2024-04-19T02:15:52.246 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_pool_quota_warn_threshold": "0", 2024-04-19T02:15:52.246 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_probe_timeout": "2.000000", 2024-04-19T02:15:52.246 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_reweight_max_change": "0.050000", 2024-04-19T02:15:52.247 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_reweight_max_osds": "4", 2024-04-19T02:15:52.247 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-04-19T02:15:52.247 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-04-19T02:15:52.247 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-04-19T02:15:52.247 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-04-19T02:15:52.247 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-04-19T02:15:52.247 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_scrub_interval": "86400", 2024-04-19T02:15:52.247 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_scrub_max_keys": "100", 2024-04-19T02:15:52.247 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_scrub_timeout": "300", 2024-04-19T02:15:52.247 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_session_timeout": "300", 2024-04-19T02:15:52.247 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_smart_report_timeout": "5", 2024-04-19T02:15:52.247 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_stat_smooth_intervals": "6", 2024-04-19T02:15:52.247 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-04-19T02:15:52.247 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_stretch_pool_min_size": "2", 2024-04-19T02:15:52.247 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_stretch_pool_size": "4", 2024-04-19T02:15:52.248 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-04-19T02:15:52.248 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_subscribe_interval": "86400.000000", 2024-04-19T02:15:52.248 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_sync_debug": "false", 2024-04-19T02:15:52.248 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_sync_max_payload_keys": "2000", 2024-04-19T02:15:52.248 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_sync_max_payload_size": "1048576", 2024-04-19T02:15:52.248 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_sync_provider_kill_at": "0", 2024-04-19T02:15:52.248 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_sync_requester_kill_at": "0", 2024-04-19T02:15:52.248 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_sync_timeout": "60.000000", 2024-04-19T02:15:52.248 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_target_pg_per_osd": "100", 2024-04-19T02:15:52.249 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_tick_interval": "5", 2024-04-19T02:15:52.249 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_timecheck_interval": "300.000000", 2024-04-19T02:15:52.249 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-04-19T02:15:52.249 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_use_min_delay_socket": "false", 2024-04-19T02:15:52.249 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_warn_older_version_delay": "604800", 2024-04-19T02:15:52.249 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-04-19T02:15:52.249 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-04-19T02:15:52.249 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-04-19T02:15:52.249 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_warn_on_filestore_osds": "false", 2024-04-19T02:15:52.249 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-04-19T02:15:52.249 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-04-19T02:15:52.249 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-04-19T02:15:52.249 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_warn_on_misplaced": "false", 2024-04-19T02:15:52.249 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-04-19T02:15:52.249 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_warn_on_older_version": "true", 2024-04-19T02:15:52.249 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-04-19T02:15:52.250 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_warn_on_pool_no_app": "true", 2024-04-19T02:15:52.250 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-04-19T02:15:52.250 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-04-19T02:15:52.250 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-04-19T02:15:52.250 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-04-19T02:15:52.250 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_warn_on_too_few_osds": "false", 2024-04-19T02:15:52.250 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-04-19T02:15:52.250 INFO:teuthology.orchestra.run.smithi121.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-04-19T02:15:52.250 INFO:teuthology.orchestra.run.smithi121.stdout: "monmap": "", 2024-04-19T02:15:52.250 INFO:teuthology.orchestra.run.smithi121.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-19T02:15:52.250 INFO:teuthology.orchestra.run.smithi121.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-04-19T02:15:52.250 INFO:teuthology.orchestra.run.smithi121.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-04-19T02:15:52.250 INFO:teuthology.orchestra.run.smithi121.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-19T02:15:52.250 INFO:teuthology.orchestra.run.smithi121.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-04-19T02:15:52.251 INFO:teuthology.orchestra.run.smithi121.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-04-19T02:15:52.251 INFO:teuthology.orchestra.run.smithi121.stdout: "motr_tracing_enabled": "false", 2024-04-19T02:15:52.251 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_async_op_threads": "3", 2024-04-19T02:15:52.251 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_async_rdma_buffer_size": "131072", 2024-04-19T02:15:52.251 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_async_rdma_cm": "false", 2024-04-19T02:15:52.251 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_async_rdma_device_name": "", 2024-04-19T02:15:52.251 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_async_rdma_dscp": "96", 2024-04-19T02:15:52.251 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-04-19T02:15:52.251 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_async_rdma_gid_idx": "0", 2024-04-19T02:15:52.251 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_async_rdma_local_gid": "", 2024-04-19T02:15:52.251 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_async_rdma_polling_us": "1000", 2024-04-19T02:15:52.251 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_async_rdma_port_num": "1", 2024-04-19T02:15:52.251 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-04-19T02:15:52.251 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-04-19T02:15:52.251 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_async_rdma_roce_ver": "1", 2024-04-19T02:15:52.251 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_async_rdma_send_buffers": "1024", 2024-04-19T02:15:52.251 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_async_rdma_sl": "3", 2024-04-19T02:15:52.252 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_async_rdma_support_srq": "true", 2024-04-19T02:15:52.252 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_async_rdma_type": "ib", 2024-04-19T02:15:52.252 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_async_reap_threshold": "5", 2024-04-19T02:15:52.252 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_bind_before_connect": "false", 2024-04-19T02:15:52.252 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_bind_ipv4": "true", 2024-04-19T02:15:52.252 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_bind_ipv6": "false", 2024-04-19T02:15:52.252 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_bind_msgr1": "true", 2024-04-19T02:15:52.252 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_bind_msgr2": "true", 2024-04-19T02:15:52.252 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_bind_port_max": "7568", 2024-04-19T02:15:52.252 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_bind_port_min": "6800", 2024-04-19T02:15:52.252 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_bind_prefer_ipv4": "false", 2024-04-19T02:15:52.252 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_bind_retry_count": "3", 2024-04-19T02:15:52.252 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_bind_retry_delay": "5", 2024-04-19T02:15:52.252 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_blackhole_client": "false", 2024-04-19T02:15:52.252 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_blackhole_mds": "false", 2024-04-19T02:15:52.252 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_blackhole_mgr": "false", 2024-04-19T02:15:52.252 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_blackhole_mon": "false", 2024-04-19T02:15:52.253 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_blackhole_osd": "false", 2024-04-19T02:15:52.253 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_client_mode": "crc secure", 2024-04-19T02:15:52.253 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_cluster_mode": "crc secure", 2024-04-19T02:15:52.253 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_cluster_type": "", 2024-04-19T02:15:52.253 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_compress_secure": "false", 2024-04-19T02:15:52.253 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_connection_idle_timeout": "900", 2024-04-19T02:15:52.253 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_connection_ready_timeout": "10", 2024-04-19T02:15:52.253 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_crc_data": "true", 2024-04-19T02:15:52.253 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_crc_header": "true", 2024-04-19T02:15:52.254 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_die_on_bad_msg": "false", 2024-04-19T02:15:52.254 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_die_on_bug": "true", 2024-04-19T02:15:52.254 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_die_on_old_message": "true", 2024-04-19T02:15:52.254 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_die_on_skipped_message": "false", 2024-04-19T02:15:52.254 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_die_on_unhandled_msg": "false", 2024-04-19T02:15:52.254 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-04-19T02:15:52.254 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_dpdk_coremask": "0xF", 2024-04-19T02:15:52.254 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-04-19T02:15:52.254 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_dpdk_devs_allowlist": "", 2024-04-19T02:15:52.255 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_dpdk_enable_tso": "true", 2024-04-19T02:15:52.255 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-04-19T02:15:52.255 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-04-19T02:15:52.255 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_dpdk_hugepages": "", 2024-04-19T02:15:52.255 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_dpdk_hw_flow_control": "true", 2024-04-19T02:15:52.255 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-04-19T02:15:52.255 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_dpdk_lro": "true", 2024-04-19T02:15:52.255 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_dpdk_memory_channel": "4", 2024-04-19T02:15:52.255 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-04-19T02:15:52.256 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_dpdk_pmd": "", 2024-04-19T02:15:52.256 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_dpdk_port_id": "0", 2024-04-19T02:15:52.256 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-04-19T02:15:52.256 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_dump_corrupt_message_level": "1", 2024-04-19T02:15:52.256 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_dump_on_send": "false", 2024-04-19T02:15:52.256 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_initial_backoff": "0.200000", 2024-04-19T02:15:52.256 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_inject_delay_max": "1.000000", 2024-04-19T02:15:52.256 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_inject_delay_probability": "0.000000", 2024-04-19T02:15:52.256 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_inject_delay_type": "", 2024-04-19T02:15:52.257 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_inject_internal_delays": "0.000000", 2024-04-19T02:15:52.257 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_inject_network_congestion": "0", 2024-04-19T02:15:52.257 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_inject_socket_failures": "0", 2024-04-19T02:15:52.257 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_learn_addr_from_peer": "true", 2024-04-19T02:15:52.257 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_max_accept_failures": "4", 2024-04-19T02:15:52.257 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_max_backoff": "15.000000", 2024-04-19T02:15:52.258 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_mon_client_mode": "secure crc", 2024-04-19T02:15:52.258 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_mon_cluster_mode": "secure crc", 2024-04-19T02:15:52.258 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_mon_service_mode": "secure crc", 2024-04-19T02:15:52.258 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_osd_compress_min_size": "1024", 2024-04-19T02:15:52.258 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_osd_compress_mode": "none", 2024-04-19T02:15:52.258 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_osd_compression_algorithm": "snappy", 2024-04-19T02:15:52.259 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-04-19T02:15:52.259 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_pq_min_cost": "65536", 2024-04-19T02:15:52.259 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_public_type": "", 2024-04-19T02:15:52.259 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_service_mode": "crc secure", 2024-04-19T02:15:52.259 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_tcp_listen_backlog": "512", 2024-04-19T02:15:52.259 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_tcp_nodelay": "true", 2024-04-19T02:15:52.259 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-04-19T02:15:52.260 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_tcp_rcvbuf": "0", 2024-04-19T02:15:52.260 INFO:teuthology.orchestra.run.smithi121.stdout: "ms_type": "async+posix", 2024-04-19T02:15:52.260 INFO:teuthology.orchestra.run.smithi121.stdout: "no_config_file": "false", 2024-04-19T02:15:52.260 INFO:teuthology.orchestra.run.smithi121.stdout: "objecter_completion_locks_per_session": "32", 2024-04-19T02:15:52.260 INFO:teuthology.orchestra.run.smithi121.stdout: "objecter_debug_inject_relock_delay": "false", 2024-04-19T02:15:52.260 INFO:teuthology.orchestra.run.smithi121.stdout: "objecter_inflight_op_bytes": "104857600", 2024-04-19T02:15:52.260 INFO:teuthology.orchestra.run.smithi121.stdout: "objecter_inflight_ops": "1024", 2024-04-19T02:15:52.260 INFO:teuthology.orchestra.run.smithi121.stdout: "objecter_inject_no_watch_ping": "false", 2024-04-19T02:15:52.261 INFO:teuthology.orchestra.run.smithi121.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-04-19T02:15:52.261 INFO:teuthology.orchestra.run.smithi121.stdout: "objecter_tick_interval": "5.000000", 2024-04-19T02:15:52.261 INFO:teuthology.orchestra.run.smithi121.stdout: "objecter_timeout": "10.000000", 2024-04-19T02:15:52.261 INFO:teuthology.orchestra.run.smithi121.stdout: "objectstore_blackhole": "false", 2024-04-19T02:15:52.261 INFO:teuthology.orchestra.run.smithi121.stdout: "openssl_engine_opts": "", 2024-04-19T02:15:52.261 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_agent_delay_time": "5.000000", 2024-04-19T02:15:52.261 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_agent_hist_halflife": "1000", 2024-04-19T02:15:52.261 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_agent_max_low_ops": "2", 2024-04-19T02:15:52.261 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_agent_max_ops": "4", 2024-04-19T02:15:52.262 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-04-19T02:15:52.262 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_agent_quantize_effort": "0.100000", 2024-04-19T02:15:52.262 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_agent_slop": "0.020000", 2024-04-19T02:15:52.262 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-04-19T02:15:52.262 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_allow_recovery_below_min_size": "true", 2024-04-19T02:15:52.262 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_asio_thread_count": "2", 2024-04-19T02:15:52.263 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_async_recovery_min_cost": "100", 2024-04-19T02:15:52.263 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_auto_mark_unfound_lost": "false", 2024-04-19T02:15:52.263 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_backfill_retry_interval": "30.000000", 2024-04-19T02:15:52.263 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_backfill_scan_max": "512", 2024-04-19T02:15:52.263 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_backfill_scan_min": "64", 2024-04-19T02:15:52.263 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_backoff_on_degraded": "false", 2024-04-19T02:15:52.263 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_backoff_on_peering": "false", 2024-04-19T02:15:52.264 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_backoff_on_unfound": "true", 2024-04-19T02:15:52.264 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_beacon_report_interval": "300", 2024-04-19T02:15:52.264 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_bench_duration": "30", 2024-04-19T02:15:52.264 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-04-19T02:15:52.264 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_bench_max_block_size": "67108864", 2024-04-19T02:15:52.264 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_bench_small_size_max_iops": "100", 2024-04-19T02:15:52.264 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_blkin_trace_all": "false", 2024-04-19T02:15:52.264 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_blocked_scrub_grace_period": "120", 2024-04-19T02:15:52.264 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-04-19T02:15:52.264 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-04-19T02:15:52.265 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-04-19T02:15:52.265 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_check_for_log_corruption": "false", 2024-04-19T02:15:52.265 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-04-19T02:15:52.265 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-19T02:15:52.265 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2024-04-19T02:15:52.265 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-19T02:15:52.265 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_class_update_on_start": "true", 2024-04-19T02:15:52.265 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_client_message_cap": "256", 2024-04-19T02:15:52.265 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_client_message_size_cap": "524288000", 2024-04-19T02:15:52.265 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_client_op_priority": "63", 2024-04-19T02:15:52.265 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_client_watch_timeout": "30", 2024-04-19T02:15:52.265 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_command_max_records": "256", 2024-04-19T02:15:52.265 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_compact_on_start": "false", 2024-04-19T02:15:52.265 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-04-19T02:15:52.265 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_crush_chooseleaf_type": "0", 2024-04-19T02:15:52.266 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_crush_initial_weight": "-1.000000", 2024-04-19T02:15:52.266 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_crush_update_on_start": "true", 2024-04-19T02:15:52.266 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_crush_update_weight_set": "true", 2024-04-19T02:15:52.266 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-04-19T02:15:52.266 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-04-19T02:15:52.266 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-04-19T02:15:52.266 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_debug_drop_ping_duration": "0", 2024-04-19T02:15:52.266 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-04-19T02:15:52.266 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_debug_feed_pullee": "-1", 2024-04-19T02:15:52.266 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-04-19T02:15:52.266 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-04-19T02:15:52.266 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-04-19T02:15:52.266 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_debug_misdirected_ops": "false", 2024-04-19T02:15:52.266 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_debug_no_acting_change": "false", 2024-04-19T02:15:52.267 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_debug_no_purge_strays": "false", 2024-04-19T02:15:52.267 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_debug_op_order": "false", 2024-04-19T02:15:52.267 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_debug_pg_log_writeout": "false", 2024-04-19T02:15:52.267 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_debug_pretend_recovery_active": "false", 2024-04-19T02:15:52.267 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-04-19T02:15:52.267 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-04-19T02:15:52.267 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_debug_shutdown": "false", 2024-04-19T02:15:52.267 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-04-19T02:15:52.267 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-04-19T02:15:52.267 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_debug_verify_cached_snaps": "false", 2024-04-19T02:15:52.267 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_debug_verify_missing_on_start": "false", 2024-04-19T02:15:52.267 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_debug_verify_snaps": "false", 2024-04-19T02:15:52.267 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-04-19T02:15:52.267 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-04-19T02:15:52.267 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_deep_scrub_keys": "1024", 2024-04-19T02:15:52.268 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-04-19T02:15:52.268 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-04-19T02:15:52.268 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-04-19T02:15:52.268 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_deep_scrub_stride": "524288", 2024-04-19T02:15:52.268 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-04-19T02:15:52.268 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_default_data_pool_replay_window": "5", 2024-04-19T02:15:52.268 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_default_notify_timeout": "30", 2024-04-19T02:15:52.268 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_delete_sleep": "0.000000", 2024-04-19T02:15:52.268 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-04-19T02:15:52.268 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-04-19T02:15:52.268 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-04-19T02:15:52.268 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_discard_disconnected_ops": "true", 2024-04-19T02:15:52.268 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_enable_op_tracker": "true", 2024-04-19T02:15:52.268 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-04-19T02:15:52.268 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_extblkdev_plugins": "vdo", 2024-04-19T02:15:52.268 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-04-19T02:15:52.268 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-04-19T02:15:52.269 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_fast_info": "true", 2024-04-19T02:15:52.269 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_fast_shutdown": "true", 2024-04-19T02:15:52.269 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-04-19T02:15:52.269 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_fast_shutdown_timeout": "15", 2024-04-19T02:15:52.269 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-04-19T02:15:52.269 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-04-19T02:15:52.269 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-04-19T02:15:52.269 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_function_tracing": "false", 2024-04-19T02:15:52.269 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_heartbeat_grace": "20", 2024-04-19T02:15:52.269 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_heartbeat_interval": "6", 2024-04-19T02:15:52.269 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-04-19T02:15:52.269 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_heartbeat_min_peers": "10", 2024-04-19T02:15:52.269 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_heartbeat_min_size": "2000", 2024-04-19T02:15:52.269 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_heartbeat_stale": "600", 2024-04-19T02:15:52.269 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-04-19T02:15:52.269 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_hit_set_max_size": "100000", 2024-04-19T02:15:52.270 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_hit_set_min_size": "1000", 2024-04-19T02:15:52.270 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-04-19T02:15:52.270 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-04-19T02:15:52.270 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-04-19T02:15:52.270 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-04-19T02:15:52.270 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-04-19T02:15:52.270 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_journal_flush_on_shutdown": "true", 2024-04-19T02:15:52.270 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_journal_size": "5120", 2024-04-19T02:15:52.270 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_kill_backfill_at": "0", 2024-04-19T02:15:52.270 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_loop_before_reset_tphandle": "64", 2024-04-19T02:15:52.270 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_map_cache_size": "50", 2024-04-19T02:15:52.270 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_map_dedup": "true", 2024-04-19T02:15:52.270 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_map_message_max": "40", 2024-04-19T02:15:52.271 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_map_message_max_bytes": "10485760", 2024-04-19T02:15:52.271 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_map_share_max_epochs": "40", 2024-04-19T02:15:52.271 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_max_attr_name_len": "100", 2024-04-19T02:15:52.271 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_max_attr_size": "0", 2024-04-19T02:15:52.271 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_max_backfills": "1", 2024-04-19T02:15:52.271 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_max_markdown_count": "5", 2024-04-19T02:15:52.271 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_max_markdown_period": "600", 2024-04-19T02:15:52.271 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_max_object_name_len": "2048", 2024-04-19T02:15:52.271 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_max_object_namespace_len": "256", 2024-04-19T02:15:52.271 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_max_object_size": "134217728", 2024-04-19T02:15:52.271 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-04-19T02:15:52.271 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_max_omap_entries_per_request": "1024", 2024-04-19T02:15:52.271 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_max_pg_blocked_by": "16", 2024-04-19T02:15:52.271 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_max_pg_log_entries": "10000", 2024-04-19T02:15:52.271 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-04-19T02:15:52.271 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_max_pgls": "1024", 2024-04-19T02:15:52.271 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_max_push_cost": "8388608", 2024-04-19T02:15:52.272 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_max_push_objects": "10", 2024-04-19T02:15:52.272 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_max_scrubs": "3", 2024-04-19T02:15:52.272 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-04-19T02:15:52.272 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_max_trimming_pgs": "2", 2024-04-19T02:15:52.272 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_max_write_op_reply_len": "64", 2024-04-19T02:15:52.272 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_max_write_size": "90", 2024-04-19T02:15:52.272 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-04-19T02:15:52.272 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-04-19T02:15:52.272 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-04-19T02:15:52.272 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-04-19T02:15:52.272 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-04-19T02:15:52.272 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-04-19T02:15:52.272 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-04-19T02:15:52.272 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mclock_override_recovery_settings": "false", 2024-04-19T02:15:52.272 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mclock_profile": "balanced", 2024-04-19T02:15:52.273 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-04-19T02:15:52.273 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-04-19T02:15:52.273 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-04-19T02:15:52.273 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-04-19T02:15:52.273 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-04-19T02:15:52.273 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-04-19T02:15:52.273 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-04-19T02:15:52.273 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-04-19T02:15:52.273 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-04-19T02:15:52.273 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-04-19T02:15:52.273 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mclock_skip_benchmark": "false", 2024-04-19T02:15:52.273 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_memory_base": "805306368", 2024-04-19T02:15:52.273 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_memory_cache_min": "134217728", 2024-04-19T02:15:52.273 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-04-19T02:15:52.274 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-04-19T02:15:52.274 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_memory_target": "4294967296", 2024-04-19T02:15:52.274 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_memory_target_autotune": "false", 2024-04-19T02:15:52.274 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-04-19T02:15:52.274 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_min_pg_log_entries": "250", 2024-04-19T02:15:52.274 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_min_recovery_priority": "0", 2024-04-19T02:15:52.274 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mon_heartbeat_interval": "30", 2024-04-19T02:15:52.274 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-04-19T02:15:52.274 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mon_report_interval": "5", 2024-04-19T02:15:52.274 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mon_report_max_in_flight": "2", 2024-04-19T02:15:52.274 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-04-19T02:15:52.274 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_num_cache_shards": "32", 2024-04-19T02:15:52.274 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_num_op_tracker_shard": "32", 2024-04-19T02:15:52.274 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_numa_auto_affinity": "true", 2024-04-19T02:15:52.274 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_numa_node": "-1", 2024-04-19T02:15:52.275 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_numa_prefer_iface": "true", 2024-04-19T02:15:52.275 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-04-19T02:15:52.275 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_objecter_finishers": "1", 2024-04-19T02:15:52.275 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_objectstore": "bluestore", 2024-04-19T02:15:52.275 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_objectstore_fuse": "false", 2024-04-19T02:15:52.275 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_objectstore_tracing": "false", 2024-04-19T02:15:52.275 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_op_complaint_time": "30.000000", 2024-04-19T02:15:52.275 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_op_history_duration": "600", 2024-04-19T02:15:52.275 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_op_history_size": "20", 2024-04-19T02:15:52.275 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_op_history_slow_op_size": "20", 2024-04-19T02:15:52.275 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-04-19T02:15:52.275 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_op_log_threshold": "5", 2024-04-19T02:15:52.275 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_op_num_shards": "0", 2024-04-19T02:15:52.275 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_op_num_shards_hdd": "5", 2024-04-19T02:15:52.275 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_op_num_shards_ssd": "8", 2024-04-19T02:15:52.275 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_op_num_threads_per_shard": "0", 2024-04-19T02:15:52.275 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-04-19T02:15:52.275 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-04-19T02:15:52.276 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-04-19T02:15:52.276 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_op_pq_min_cost": "65536", 2024-04-19T02:15:52.276 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_op_queue": "mclock_scheduler", 2024-04-19T02:15:52.276 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_op_queue_cut_off": "high", 2024-04-19T02:15:52.276 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_op_thread_suicide_timeout": "150", 2024-04-19T02:15:52.276 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_op_thread_timeout": "15", 2024-04-19T02:15:52.276 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_open_classes_on_start": "true", 2024-04-19T02:15:52.276 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_os_flags": "0", 2024-04-19T02:15:52.276 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_peering_op_priority": "255", 2024-04-19T02:15:52.276 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pg_delete_cost": "1048576", 2024-04-19T02:15:52.276 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pg_delete_priority": "5", 2024-04-19T02:15:52.276 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-04-19T02:15:52.276 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-04-19T02:15:52.276 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pg_log_dups_tracked": "3000", 2024-04-19T02:15:52.276 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pg_log_trim_max": "10000", 2024-04-19T02:15:52.276 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pg_log_trim_min": "100", 2024-04-19T02:15:52.277 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-04-19T02:15:52.277 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pg_object_context_cache_count": "64", 2024-04-19T02:15:52.277 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pg_stat_report_interval_max": "500", 2024-04-19T02:15:52.277 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-04-19T02:15:52.277 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-04-19T02:15:52.277 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-04-19T02:15:52.277 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-04-19T02:15:52.277 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-04-19T02:15:52.277 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-04-19T02:15:52.277 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pool_default_crimson": "false", 2024-04-19T02:15:52.277 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pool_default_crush_rule": "-1", 2024-04-19T02:15:52.277 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pool_default_ec_fast_read": "false", 2024-04-19T02:15:52.277 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-04-19T02:15:52.277 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pool_default_flag_bulk": "false", 2024-04-19T02:15:52.277 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-04-19T02:15:52.278 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pool_default_flag_nodelete": "false", 2024-04-19T02:15:52.278 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-04-19T02:15:52.278 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-04-19T02:15:52.278 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pool_default_flags": "0", 2024-04-19T02:15:52.278 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-04-19T02:15:52.278 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pool_default_min_size": "0", 2024-04-19T02:15:52.278 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-04-19T02:15:52.278 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pool_default_pg_num": "32", 2024-04-19T02:15:52.278 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pool_default_pgp_num": "0", 2024-04-19T02:15:52.278 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-04-19T02:15:52.278 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pool_default_size": "2", 2024-04-19T02:15:52.278 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pool_default_type": "replicated", 2024-04-19T02:15:52.278 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-04-19T02:15:52.279 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pool_use_gmt_hitset": "true", 2024-04-19T02:15:52.279 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_push_per_object_cost": "1000", 2024-04-19T02:15:52.279 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_read_ec_check_for_errors": "false", 2024-04-19T02:15:52.279 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_recover_clone_overlap": "true", 2024-04-19T02:15:52.279 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_recover_clone_overlap_limit": "10", 2024-04-19T02:15:52.279 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_recovery_cost": "20971520", 2024-04-19T02:15:52.279 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_recovery_delay_start": "0.000000", 2024-04-19T02:15:52.279 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_recovery_max_active": "0", 2024-04-19T02:15:52.279 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_recovery_max_active_hdd": "3", 2024-04-19T02:15:52.279 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_recovery_max_active_ssd": "10", 2024-04-19T02:15:52.279 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_recovery_max_chunk": "8388608", 2024-04-19T02:15:52.279 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-04-19T02:15:52.279 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_recovery_max_single_start": "1", 2024-04-19T02:15:52.279 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_recovery_op_priority": "3", 2024-04-19T02:15:52.280 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_recovery_op_warn_multiple": "16", 2024-04-19T02:15:52.280 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_recovery_priority": "5", 2024-04-19T02:15:52.280 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_recovery_retry_interval": "30.000000", 2024-04-19T02:15:52.280 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_recovery_sleep": "0.000000", 2024-04-19T02:15:52.280 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-04-19T02:15:52.280 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-04-19T02:15:52.280 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-04-19T02:15:52.280 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_repair_during_recovery": "false", 2024-04-19T02:15:52.280 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_requested_scrub_priority": "120", 2024-04-19T02:15:52.280 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-04-19T02:15:52.280 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_rollback_to_cluster_snap": "", 2024-04-19T02:15:52.280 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_scrub_auto_repair": "false", 2024-04-19T02:15:52.280 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-04-19T02:15:52.280 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-04-19T02:15:52.280 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_scrub_begin_hour": "0", 2024-04-19T02:15:52.281 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_scrub_begin_week_day": "0", 2024-04-19T02:15:52.281 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_scrub_chunk_max": "25", 2024-04-19T02:15:52.281 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_scrub_chunk_min": "5", 2024-04-19T02:15:52.281 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_scrub_cost": "52428800", 2024-04-19T02:15:52.281 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_scrub_during_recovery": "false", 2024-04-19T02:15:52.281 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_scrub_end_hour": "0", 2024-04-19T02:15:52.281 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_scrub_end_week_day": "0", 2024-04-19T02:15:52.281 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_scrub_event_cost": "4096", 2024-04-19T02:15:52.281 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-04-19T02:15:52.281 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-04-19T02:15:52.281 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_scrub_invalid_stats": "true", 2024-04-19T02:15:52.281 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_scrub_load_threshold": "0.500000", 2024-04-19T02:15:52.281 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_scrub_max_interval": "604800.000000", 2024-04-19T02:15:52.281 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_scrub_max_preemptions": "5", 2024-04-19T02:15:52.281 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_scrub_min_interval": "86400.000000", 2024-04-19T02:15:52.282 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_scrub_priority": "5", 2024-04-19T02:15:52.282 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_scrub_reservation_timeout": "5000", 2024-04-19T02:15:52.282 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_scrub_sleep": "0.000000", 2024-04-19T02:15:52.282 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_scrub_slow_reservation_response": "2200", 2024-04-19T02:15:52.282 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-04-19T02:15:52.282 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-04-19T02:15:52.282 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_shutdown_pgref_assert": "false", 2024-04-19T02:15:52.282 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_skip_data_digest": "false", 2024-04-19T02:15:52.282 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_smart_report_timeout": "5", 2024-04-19T02:15:52.282 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_snap_trim_cost": "1048576", 2024-04-19T02:15:52.282 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_snap_trim_priority": "5", 2024-04-19T02:15:52.282 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_snap_trim_sleep": "0.000000", 2024-04-19T02:15:52.282 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-04-19T02:15:52.282 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-04-19T02:15:52.283 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-04-19T02:15:52.283 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-04-19T02:15:52.283 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_stats_update_period_scrubbing": "15", 2024-04-19T02:15:52.283 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-04-19T02:15:52.283 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_target_transaction_size": "30", 2024-04-19T02:15:52.283 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-04-19T02:15:52.283 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-04-19T02:15:52.283 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-04-19T02:15:52.283 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-04-19T02:15:52.283 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-04-19T02:15:52.283 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-04-19T02:15:52.283 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-04-19T02:15:52.283 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_tier_default_cache_mode": "writeback", 2024-04-19T02:15:52.283 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-04-19T02:15:52.284 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-04-19T02:15:52.284 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_tracing": "false", 2024-04-19T02:15:52.284 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_use_stale_snap": "false", 2024-04-19T02:15:52.284 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-04-19T02:15:52.284 INFO:teuthology.orchestra.run.smithi121.stdout: "osdc_blkin_trace_all": "false", 2024-04-19T02:15:52.284 INFO:teuthology.orchestra.run.smithi121.stdout: "paxos_kill_at": "0", 2024-04-19T02:15:52.284 INFO:teuthology.orchestra.run.smithi121.stdout: "paxos_max_join_drift": "10", 2024-04-19T02:15:52.284 INFO:teuthology.orchestra.run.smithi121.stdout: "paxos_min": "500", 2024-04-19T02:15:52.284 INFO:teuthology.orchestra.run.smithi121.stdout: "paxos_min_wait": "0.050000", 2024-04-19T02:15:52.284 INFO:teuthology.orchestra.run.smithi121.stdout: "paxos_propose_interval": "1.000000", 2024-04-19T02:15:52.284 INFO:teuthology.orchestra.run.smithi121.stdout: "paxos_service_trim_max": "500", 2024-04-19T02:15:52.284 INFO:teuthology.orchestra.run.smithi121.stdout: "paxos_service_trim_max_multiplier": "20", 2024-04-19T02:15:52.284 INFO:teuthology.orchestra.run.smithi121.stdout: "paxos_service_trim_min": "250", 2024-04-19T02:15:52.284 INFO:teuthology.orchestra.run.smithi121.stdout: "paxos_stash_full_interval": "25", 2024-04-19T02:15:52.284 INFO:teuthology.orchestra.run.smithi121.stdout: "paxos_trim_max": "500", 2024-04-19T02:15:52.285 INFO:teuthology.orchestra.run.smithi121.stdout: "paxos_trim_min": "250", 2024-04-19T02:15:52.285 INFO:teuthology.orchestra.run.smithi121.stdout: "perf": "true", 2024-04-19T02:15:52.285 INFO:teuthology.orchestra.run.smithi121.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-04-19T02:15:52.285 INFO:teuthology.orchestra.run.smithi121.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-04-19T02:15:52.285 INFO:teuthology.orchestra.run.smithi121.stdout: "plugin_dir": "/usr/lib64/ceph", 2024-04-19T02:15:52.285 INFO:teuthology.orchestra.run.smithi121.stdout: "public_addr": "-", 2024-04-19T02:15:52.285 INFO:teuthology.orchestra.run.smithi121.stdout: "public_addrv": "", 2024-04-19T02:15:52.285 INFO:teuthology.orchestra.run.smithi121.stdout: "public_bind_addr": "-", 2024-04-19T02:15:52.285 INFO:teuthology.orchestra.run.smithi121.stdout: "public_network": "", 2024-04-19T02:15:52.285 INFO:teuthology.orchestra.run.smithi121.stdout: "public_network_interface": "", 2024-04-19T02:15:52.285 INFO:teuthology.orchestra.run.smithi121.stdout: "qat_compressor_enabled": "false", 2024-04-19T02:15:52.285 INFO:teuthology.orchestra.run.smithi121.stdout: "qat_compressor_session_max_number": "256", 2024-04-19T02:15:52.285 INFO:teuthology.orchestra.run.smithi121.stdout: "rados_mon_op_timeout": "0", 2024-04-19T02:15:52.285 INFO:teuthology.orchestra.run.smithi121.stdout: "rados_osd_op_timeout": "0", 2024-04-19T02:15:52.285 INFO:teuthology.orchestra.run.smithi121.stdout: "rados_tracing": "false", 2024-04-19T02:15:52.286 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_atime_update_interval": "60", 2024-04-19T02:15:52.286 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-04-19T02:15:52.286 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_balance_parent_reads": "false", 2024-04-19T02:15:52.286 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_balance_snap_reads": "false", 2024-04-19T02:15:52.286 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_blkin_trace_all": "false", 2024-04-19T02:15:52.286 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_blocklist_expire_seconds": "0", 2024-04-19T02:15:52.286 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_blocklist_on_break_lock": "true", 2024-04-19T02:15:52.286 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_cache": "true", 2024-04-19T02:15:52.286 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_cache_block_writes_upfront": "false", 2024-04-19T02:15:52.286 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_cache_max_dirty": "25165824", 2024-04-19T02:15:52.286 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-04-19T02:15:52.286 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_cache_max_dirty_object": "0", 2024-04-19T02:15:52.286 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_cache_policy": "writearound", 2024-04-19T02:15:52.287 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_cache_size": "33554432", 2024-04-19T02:15:52.287 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_cache_target_dirty": "16777216", 2024-04-19T02:15:52.287 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-04-19T02:15:52.287 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_clone_copy_on_read": "false", 2024-04-19T02:15:52.287 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_compression_hint": "none", 2024-04-19T02:15:52.287 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_concurrent_management_ops": "10", 2024-04-19T02:15:52.287 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-04-19T02:15:52.287 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_default_clone_format": "auto", 2024-04-19T02:15:52.287 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_default_data_pool": "", 2024-04-19T02:15:52.287 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_default_features": "61", 2024-04-19T02:15:52.287 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_default_format": "2", 2024-04-19T02:15:52.287 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_default_map_options": "", 2024-04-19T02:15:52.287 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_default_order": "22", 2024-04-19T02:15:52.287 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_default_pool": "rbd", 2024-04-19T02:15:52.287 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-04-19T02:15:52.288 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_default_stripe_count": "0", 2024-04-19T02:15:52.288 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_default_stripe_unit": "0", 2024-04-19T02:15:52.288 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_disable_zero_copy_writes": "true", 2024-04-19T02:15:52.288 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_discard_granularity_bytes": "65536", 2024-04-19T02:15:52.288 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-04-19T02:15:52.288 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_enable_alloc_hint": "true", 2024-04-19T02:15:52.288 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-04-19T02:15:52.288 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_io_scheduler": "simple", 2024-04-19T02:15:52.288 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-04-19T02:15:52.288 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_journal_commit_age": "5.000000", 2024-04-19T02:15:52.288 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-04-19T02:15:52.288 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-04-19T02:15:52.288 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-04-19T02:15:52.288 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-04-19T02:15:52.288 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_journal_object_flush_interval": "0", 2024-04-19T02:15:52.288 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-04-19T02:15:52.289 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-04-19T02:15:52.289 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_journal_order": "24", 2024-04-19T02:15:52.289 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_journal_pool": "", 2024-04-19T02:15:52.289 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_journal_splay_width": "4", 2024-04-19T02:15:52.289 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_localize_parent_reads": "false", 2024-04-19T02:15:52.289 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_localize_snap_reads": "false", 2024-04-19T02:15:52.289 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-04-19T02:15:52.289 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-04-19T02:15:52.289 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-04-19T02:15:52.289 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-04-19T02:15:52.289 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-04-19T02:15:52.289 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-04-19T02:15:52.289 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_mirror_image_policy_type": "simple", 2024-04-19T02:15:52.289 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-04-19T02:15:52.289 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-04-19T02:15:52.289 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-04-19T02:15:52.290 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-04-19T02:15:52.290 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-04-19T02:15:52.290 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-04-19T02:15:52.290 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-04-19T02:15:52.290 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_mirror_memory_autotune": "true", 2024-04-19T02:15:52.290 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_mirror_memory_base": "805306368", 2024-04-19T02:15:52.290 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-04-19T02:15:52.290 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-04-19T02:15:52.290 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-04-19T02:15:52.290 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-04-19T02:15:52.290 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_mirror_memory_target": "4294967296", 2024-04-19T02:15:52.290 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-04-19T02:15:52.291 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-04-19T02:15:52.291 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-04-19T02:15:52.291 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_mirroring_delete_delay": "0", 2024-04-19T02:15:52.291 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-04-19T02:15:52.291 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_mirroring_replay_delay": "0", 2024-04-19T02:15:52.291 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-04-19T02:15:52.291 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-04-19T02:15:52.291 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_move_to_trash_on_remove": "false", 2024-04-19T02:15:52.291 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-04-19T02:15:52.291 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_mtime_update_interval": "60", 2024-04-19T02:15:52.291 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_non_blocking_aio": "true", 2024-04-19T02:15:52.291 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_op_thread_timeout": "60", 2024-04-19T02:15:52.291 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_op_threads": "1", 2024-04-19T02:15:52.292 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_parent_cache_enabled": "false", 2024-04-19T02:15:52.292 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_persistent_cache_mode": "disabled", 2024-04-19T02:15:52.292 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_persistent_cache_path": "/tmp", 2024-04-19T02:15:52.292 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_persistent_cache_size": "1073741824", 2024-04-19T02:15:52.292 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_plugins": "", 2024-04-19T02:15:52.292 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_qos_bps_burst": "0", 2024-04-19T02:15:52.292 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-04-19T02:15:52.292 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_qos_bps_limit": "0", 2024-04-19T02:15:52.292 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_qos_exclude_ops": "0", 2024-04-19T02:15:52.292 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_qos_iops_burst": "0", 2024-04-19T02:15:52.292 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-04-19T02:15:52.292 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_qos_iops_limit": "0", 2024-04-19T02:15:52.292 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_qos_read_bps_burst": "0", 2024-04-19T02:15:52.292 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-04-19T02:15:52.292 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_qos_read_bps_limit": "0", 2024-04-19T02:15:52.293 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_qos_read_iops_burst": "0", 2024-04-19T02:15:52.293 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-04-19T02:15:52.293 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_qos_read_iops_limit": "0", 2024-04-19T02:15:52.293 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_qos_schedule_tick_min": "50", 2024-04-19T02:15:52.293 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_qos_write_bps_burst": "0", 2024-04-19T02:15:52.293 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-04-19T02:15:52.293 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_qos_write_bps_limit": "0", 2024-04-19T02:15:52.293 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_qos_write_iops_burst": "0", 2024-04-19T02:15:52.293 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-04-19T02:15:52.293 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_qos_write_iops_limit": "0", 2024-04-19T02:15:52.293 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_quiesce_notification_attempts": "10", 2024-04-19T02:15:52.293 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_read_from_replica_policy": "default", 2024-04-19T02:15:52.293 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-04-19T02:15:52.293 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_readahead_max_bytes": "524288", 2024-04-19T02:15:52.294 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_readahead_trigger_requests": "10", 2024-04-19T02:15:52.294 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_request_timed_out_seconds": "30", 2024-04-19T02:15:52.294 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_skip_partial_discard": "true", 2024-04-19T02:15:52.294 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-04-19T02:15:52.294 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_tracing": "false", 2024-04-19T02:15:52.294 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_validate_names": "true", 2024-04-19T02:15:52.294 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd_validate_pool": "true", 2024-04-19T02:15:52.294 INFO:teuthology.orchestra.run.smithi121.stdout: "restapi_base_url": "", 2024-04-19T02:15:52.294 INFO:teuthology.orchestra.run.smithi121.stdout: "restapi_log_level": "", 2024-04-19T02:15:52.295 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_acl_grants_max_num": "100", 2024-04-19T02:15:52.295 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_admin_entry": "admin", 2024-04-19T02:15:52.295 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-04-19T02:15:52.295 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_backend_store": "rados", 2024-04-19T02:15:52.295 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_barbican_url": "", 2024-04-19T02:15:52.295 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_beast_enable_async": "true", 2024-04-19T02:15:52.295 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-04-19T02:15:52.295 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-04-19T02:15:52.296 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_bucket_index_max_aio": "128", 2024-04-19T02:15:52.296 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-04-19T02:15:52.296 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-04-19T02:15:52.296 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_bucket_quota_ttl": "600", 2024-04-19T02:15:52.296 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-04-19T02:15:52.296 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_cache_enabled": "true", 2024-04-19T02:15:52.296 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_cache_expiry_interval": "900", 2024-04-19T02:15:52.296 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_cache_lru_size": "10000", 2024-04-19T02:15:52.296 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_config_store": "rados", 2024-04-19T02:15:52.296 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_content_length_compat": "false", 2024-04-19T02:15:52.296 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_copy_obj_progress": "true", 2024-04-19T02:15:52.297 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-04-19T02:15:52.297 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_cors_rules_max_num": "100", 2024-04-19T02:15:52.297 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_cross_domain_policy": "", 2024-04-19T02:15:52.297 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_crypt_default_encryption_key": "", 2024-04-19T02:15:52.297 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_crypt_kmip_addr": "", 2024-04-19T02:15:52.297 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_crypt_kmip_ca_path": "", 2024-04-19T02:15:52.297 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_crypt_kmip_client_cert": "", 2024-04-19T02:15:52.297 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_crypt_kmip_client_key": "", 2024-04-19T02:15:52.297 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-04-19T02:15:52.297 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_crypt_kmip_password": "", 2024-04-19T02:15:52.297 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-04-19T02:15:52.297 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_crypt_kmip_username": "", 2024-04-19T02:15:52.297 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_crypt_require_ssl": "true", 2024-04-19T02:15:52.297 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-04-19T02:15:52.298 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-04-19T02:15:52.298 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-04-19T02:15:52.298 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-04-19T02:15:52.298 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-04-19T02:15:52.298 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-04-19T02:15:52.298 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-04-19T02:15:52.298 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-04-19T02:15:52.298 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-04-19T02:15:52.298 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-04-19T02:15:52.298 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-04-19T02:15:52.298 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-04-19T02:15:52.298 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-04-19T02:15:52.299 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-04-19T02:15:52.299 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_crypt_suppress_logs": "true", 2024-04-19T02:15:52.299 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_crypt_vault_addr": "", 2024-04-19T02:15:52.299 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_crypt_vault_auth": "token", 2024-04-19T02:15:52.299 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_crypt_vault_namespace": "", 2024-04-19T02:15:52.299 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_crypt_vault_prefix": "", 2024-04-19T02:15:52.299 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-04-19T02:15:52.299 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-04-19T02:15:52.299 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-04-19T02:15:52.299 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-04-19T02:15:52.299 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_crypt_vault_token_file": "", 2024-04-19T02:15:52.299 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-04-19T02:15:52.299 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_curl_buffersize": "524288", 2024-04-19T02:15:52.300 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_curl_low_speed_limit": "1024", 2024-04-19T02:15:52.300 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_curl_low_speed_time": "300", 2024-04-19T02:15:52.300 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_curl_tcp_keepalive": "0", 2024-04-19T02:15:52.300 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-04-19T02:15:52.300 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-04-19T02:15:52.300 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-04-19T02:15:52.300 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-04-19T02:15:52.300 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-04-19T02:15:52.300 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_d3n_l1_fadvise": "4", 2024-04-19T02:15:52.300 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-04-19T02:15:52.301 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-04-19T02:15:52.301 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-04-19T02:15:52.301 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-04-19T02:15:52.301 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_data_log_changes_size": "1000", 2024-04-19T02:15:52.301 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_data_log_num_shards": "128", 2024-04-19T02:15:52.301 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-04-19T02:15:52.301 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_data_log_window": "30", 2024-04-19T02:15:52.301 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_data_notify_interval_msec": "0", 2024-04-19T02:15:52.301 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_data_sync_poll_interval": "20", 2024-04-19T02:15:52.301 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_data_sync_spawn_window": "20", 2024-04-19T02:15:52.301 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-04-19T02:15:52.301 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-04-19T02:15:52.302 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_default_data_log_backing": "fifo", 2024-04-19T02:15:52.302 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-04-19T02:15:52.302 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_default_region_info_oid": "default.region", 2024-04-19T02:15:52.302 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-04-19T02:15:52.302 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-04-19T02:15:52.302 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_defer_to_bucket_acls": "", 2024-04-19T02:15:52.302 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-04-19T02:15:52.302 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-04-19T02:15:52.302 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-04-19T02:15:52.302 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-04-19T02:15:52.302 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-04-19T02:15:52.302 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-04-19T02:15:52.302 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-04-19T02:15:52.303 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-04-19T02:15:52.303 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_dmclock_data_res": "500.000000", 2024-04-19T02:15:52.303 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-04-19T02:15:52.303 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-04-19T02:15:52.303 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-04-19T02:15:52.303 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-04-19T02:15:52.303 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_dns_name": "", 2024-04-19T02:15:52.303 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_dns_s3website_name": "", 2024-04-19T02:15:52.303 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_dynamic_resharding": "true", 2024-04-19T02:15:52.303 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-04-19T02:15:52.303 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_enable_gc_threads": "true", 2024-04-19T02:15:52.303 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_enable_lc_threads": "true", 2024-04-19T02:15:52.303 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_enable_ops_log": "false", 2024-04-19T02:15:52.304 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_enable_quota_threads": "true", 2024-04-19T02:15:52.304 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_enable_static_website": "false", 2024-04-19T02:15:52.304 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_enable_usage_log": "false", 2024-04-19T02:15:52.304 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_enforce_swift_acls": "true", 2024-04-19T02:15:52.304 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_exit_timeout_secs": "120", 2024-04-19T02:15:52.304 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_expose_bucket": "false", 2024-04-19T02:15:52.304 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_extended_http_attrs": "", 2024-04-19T02:15:52.304 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_filter": "none", 2024-04-19T02:15:52.304 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-04-19T02:15:52.304 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_frontends": "beast port=7480", 2024-04-19T02:15:52.304 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_gc_max_concurrent_io": "10", 2024-04-19T02:15:52.304 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_gc_max_deferred": "50", 2024-04-19T02:15:52.304 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-04-19T02:15:52.304 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_gc_max_objs": "32", 2024-04-19T02:15:52.305 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_gc_max_queue_size": "134213632", 2024-04-19T02:15:52.305 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_gc_max_trim_chunk": "16", 2024-04-19T02:15:52.305 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_gc_obj_min_wait": "7200", 2024-04-19T02:15:52.305 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_gc_processor_max_time": "3600", 2024-04-19T02:15:52.305 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_gc_processor_period": "3600", 2024-04-19T02:15:52.305 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-04-19T02:15:52.305 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_get_obj_window_size": "16777216", 2024-04-19T02:15:52.305 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_healthcheck_disabling_path": "", 2024-04-19T02:15:52.305 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_ignore_get_invalid_range": "false", 2024-04-19T02:15:52.305 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_init_timeout": "300", 2024-04-19T02:15:52.305 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-04-19T02:15:52.305 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-04-19T02:15:52.305 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-04-19T02:15:52.305 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-04-19T02:15:52.305 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_keystone_admin_domain": "", 2024-04-19T02:15:52.306 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_keystone_admin_password": "", 2024-04-19T02:15:52.306 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_keystone_admin_password_path": "", 2024-04-19T02:15:52.306 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_keystone_admin_project": "", 2024-04-19T02:15:52.306 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_keystone_admin_tenant": "", 2024-04-19T02:15:52.306 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_keystone_admin_token": "", 2024-04-19T02:15:52.306 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_keystone_admin_token_path": "", 2024-04-19T02:15:52.306 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_keystone_admin_user": "", 2024-04-19T02:15:52.306 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_keystone_api_version": "2", 2024-04-19T02:15:52.306 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_keystone_barbican_domain": "", 2024-04-19T02:15:52.306 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_keystone_barbican_password": "", 2024-04-19T02:15:52.306 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_keystone_barbican_project": "", 2024-04-19T02:15:52.306 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_keystone_barbican_tenant": "", 2024-04-19T02:15:52.306 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_keystone_barbican_user": "", 2024-04-19T02:15:52.307 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-04-19T02:15:52.307 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_keystone_implicit_tenants": "false", 2024-04-19T02:15:52.307 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-04-19T02:15:52.307 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_keystone_service_token_enabled": "false", 2024-04-19T02:15:52.307 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_keystone_token_cache_size": "10000", 2024-04-19T02:15:52.307 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_keystone_url": "", 2024-04-19T02:15:52.307 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_keystone_verify_ssl": "true", 2024-04-19T02:15:52.307 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_lc_debug_interval": "-1", 2024-04-19T02:15:52.307 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_lc_lock_max_time": "90", 2024-04-19T02:15:52.307 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_lc_max_objs": "32", 2024-04-19T02:15:52.307 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_lc_max_rules": "1000", 2024-04-19T02:15:52.307 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_lc_max_worker": "3", 2024-04-19T02:15:52.307 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_lc_max_wp_worker": "3", 2024-04-19T02:15:52.307 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_lc_thread_delay": "0", 2024-04-19T02:15:52.307 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-04-19T02:15:52.307 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_ldap_dnattr": "uid", 2024-04-19T02:15:52.308 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-04-19T02:15:52.308 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_ldap_searchfilter": "", 2024-04-19T02:15:52.308 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-04-19T02:15:52.308 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_ldap_uri": "ldaps://", 2024-04-19T02:15:52.308 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-04-19T02:15:52.308 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-04-19T02:15:52.308 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-04-19T02:15:52.308 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_log_http_headers": "", 2024-04-19T02:15:52.308 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_log_nonexistent_bucket": "false", 2024-04-19T02:15:52.308 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-04-19T02:15:52.308 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_log_object_name_utc": "false", 2024-04-19T02:15:52.308 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_luarocks_location": "/tmp/luarocks", 2024-04-19T02:15:52.308 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_max_attr_name_len": "0", 2024-04-19T02:15:52.308 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_max_attr_size": "0", 2024-04-19T02:15:52.308 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_max_attrs_num_in_req": "0", 2024-04-19T02:15:52.309 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_max_chunk_size": "4194304", 2024-04-19T02:15:52.309 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_max_concurrent_requests": "1024", 2024-04-19T02:15:52.309 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-04-19T02:15:52.309 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_max_dynamic_shards": "1999", 2024-04-19T02:15:52.309 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_max_listing_results": "1000", 2024-04-19T02:15:52.309 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_max_notify_retries": "10", 2024-04-19T02:15:52.309 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_max_objs_per_shard": "100000", 2024-04-19T02:15:52.309 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_max_put_param_size": "1048576", 2024-04-19T02:15:52.309 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_max_put_size": "5368709120", 2024-04-19T02:15:52.309 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_max_slo_entries": "1000", 2024-04-19T02:15:52.309 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_md_log_max_shards": "64", 2024-04-19T02:15:52.309 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_md_notify_interval_msec": "200", 2024-04-19T02:15:52.309 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_meta_sync_poll_interval": "20", 2024-04-19T02:15:52.309 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_meta_sync_spawn_window": "20", 2024-04-19T02:15:52.309 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-04-19T02:15:52.309 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_mp_lock_max_time": "600", 2024-04-19T02:15:52.310 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-04-19T02:15:52.310 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_multipart_min_part_size": "5242880", 2024-04-19T02:15:52.310 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-04-19T02:15:52.310 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-04-19T02:15:52.310 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_nfs_fhcache_size": "2017", 2024-04-19T02:15:52.310 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-04-19T02:15:52.310 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-04-19T02:15:52.310 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_nfs_lru_lanes": "5", 2024-04-19T02:15:52.310 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_nfs_max_gc": "300", 2024-04-19T02:15:52.310 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-04-19T02:15:52.310 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_nfs_run_gc_threads": "false", 2024-04-19T02:15:52.310 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_nfs_run_lc_threads": "false", 2024-04-19T02:15:52.310 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_nfs_run_quota_threads": "false", 2024-04-19T02:15:52.311 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_nfs_run_sync_thread": "false", 2024-04-19T02:15:52.311 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-04-19T02:15:52.311 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-04-19T02:15:52.311 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_num_async_rados_threads": "32", 2024-04-19T02:15:52.311 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_num_control_oids": "8", 2024-04-19T02:15:52.311 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_numa_node": "-1", 2024-04-19T02:15:52.311 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_obj_stripe_size": "4194304", 2024-04-19T02:15:52.311 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-04-19T02:15:52.311 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_objexp_chunk_size": "100", 2024-04-19T02:15:52.311 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_objexp_gc_interval": "600", 2024-04-19T02:15:52.311 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_objexp_hints_num_shards": "127", 2024-04-19T02:15:52.311 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-04-19T02:15:52.311 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-04-19T02:15:52.311 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_op_thread_timeout": "600", 2024-04-19T02:15:52.312 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_op_tracing": "false", 2024-04-19T02:15:52.312 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_opa_token": "", 2024-04-19T02:15:52.312 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_opa_url": "", 2024-04-19T02:15:52.312 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_opa_verify_ssl": "true", 2024-04-19T02:15:52.312 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-04-19T02:15:52.312 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-04-19T02:15:52.312 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_ops_log_rados": "false", 2024-04-19T02:15:52.312 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_ops_log_socket_path": "", 2024-04-19T02:15:52.312 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-04-19T02:15:52.312 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-04-19T02:15:52.312 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-04-19T02:15:52.312 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_period_push_interval": "2.000000", 2024-04-19T02:15:52.312 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_period_push_interval_max": "30.000000", 2024-04-19T02:15:52.312 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_period_root_pool": ".rgw.root", 2024-04-19T02:15:52.312 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-04-19T02:15:52.313 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_print_continue": "true", 2024-04-19T02:15:52.313 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_print_prohibited_content_length": "false", 2024-04-19T02:15:52.313 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-04-19T02:15:52.313 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-04-19T02:15:52.313 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-04-19T02:15:52.313 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-04-19T02:15:52.313 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_rados_tracing": "false", 2024-04-19T02:15:52.313 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_realm": "", 2024-04-19T02:15:52.313 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_realm_id": "", 2024-04-19T02:15:52.313 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-04-19T02:15:52.313 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_region": "", 2024-04-19T02:15:52.313 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_region_root_pool": ".rgw.root", 2024-04-19T02:15:52.313 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_relaxed_region_enforcement": "false", 2024-04-19T02:15:52.314 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-04-19T02:15:52.314 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-04-19T02:15:52.314 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_request_uri": "", 2024-04-19T02:15:52.314 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_reshard_batch_size": "64", 2024-04-19T02:15:52.314 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-04-19T02:15:52.314 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_reshard_max_aio": "128", 2024-04-19T02:15:52.314 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_reshard_num_logs": "16", 2024-04-19T02:15:52.314 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_reshard_thread_interval": "600", 2024-04-19T02:15:52.314 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_resolve_cname": "false", 2024-04-19T02:15:52.314 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_rest_getusage_op_compat": "false", 2024-04-19T02:15:52.314 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_run_sync_thread": "true", 2024-04-19T02:15:52.314 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-04-19T02:15:52.314 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_s3_auth_use_keystone": "false", 2024-04-19T02:15:52.315 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_s3_auth_use_ldap": "false", 2024-04-19T02:15:52.315 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_s3_auth_use_rados": "true", 2024-04-19T02:15:52.315 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_s3_auth_use_sts": "false", 2024-04-19T02:15:52.315 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-04-19T02:15:52.315 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_s3_success_create_obj_status": "0", 2024-04-19T02:15:52.315 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-04-19T02:15:52.315 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_scheduler_type": "throttler", 2024-04-19T02:15:52.315 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_script_uri": "", 2024-04-19T02:15:52.315 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_service_provider_name": "", 2024-04-19T02:15:52.315 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-04-19T02:15:52.315 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_sts_client_id": "", 2024-04-19T02:15:52.315 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_sts_client_secret": "", 2024-04-19T02:15:52.315 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_sts_entry": "sts", 2024-04-19T02:15:52.315 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_sts_key": "sts", 2024-04-19T02:15:52.315 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_sts_max_session_duration": "43200", 2024-04-19T02:15:52.316 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_sts_min_session_duration": "900", 2024-04-19T02:15:52.316 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_sts_token_introspection_url": "", 2024-04-19T02:15:52.316 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_swift_account_in_url": "false", 2024-04-19T02:15:52.316 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_swift_auth_entry": "auth", 2024-04-19T02:15:52.316 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_swift_auth_url": "", 2024-04-19T02:15:52.316 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_swift_custom_header": "", 2024-04-19T02:15:52.316 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_swift_enforce_content_length": "false", 2024-04-19T02:15:52.316 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_swift_need_stats": "true", 2024-04-19T02:15:52.316 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_swift_tenant_name": "", 2024-04-19T02:15:52.316 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_swift_token_expiration": "86400", 2024-04-19T02:15:52.316 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_swift_url": "", 2024-04-19T02:15:52.316 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_swift_url_prefix": "swift", 2024-04-19T02:15:52.316 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_swift_versioning_enabled": "false", 2024-04-19T02:15:52.316 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-04-19T02:15:52.316 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-04-19T02:15:52.316 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_sync_lease_period": "120", 2024-04-19T02:15:52.317 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-04-19T02:15:52.317 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_sync_log_trim_interval": "1200", 2024-04-19T02:15:52.317 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-04-19T02:15:52.317 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-04-19T02:15:52.317 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-04-19T02:15:52.317 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_sync_obj_etag_verify": "false", 2024-04-19T02:15:52.317 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_sync_trace_history_size": "4096", 2024-04-19T02:15:52.317 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-04-19T02:15:52.317 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-04-19T02:15:52.317 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_thread_pool_size": "512", 2024-04-19T02:15:52.317 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_torrent_comment": "", 2024-04-19T02:15:52.317 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_torrent_createby": "", 2024-04-19T02:15:52.317 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_torrent_encoding": "", 2024-04-19T02:15:52.317 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_torrent_flag": "false", 2024-04-19T02:15:52.317 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_torrent_origin": "", 2024-04-19T02:15:52.318 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_torrent_sha_unit": "524288", 2024-04-19T02:15:52.318 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_torrent_tracker": "", 2024-04-19T02:15:52.318 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_trust_forwarded_https": "false", 2024-04-19T02:15:52.318 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-04-19T02:15:52.318 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_usage_log_tick_interval": "30", 2024-04-19T02:15:52.319 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_usage_max_shards": "32", 2024-04-19T02:15:52.319 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_usage_max_user_shards": "1", 2024-04-19T02:15:52.319 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_use_opa_authz": "false", 2024-04-19T02:15:52.319 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-04-19T02:15:52.319 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_user_default_quota_max_size": "-1", 2024-04-19T02:15:52.319 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_user_max_buckets": "1000", 2024-04-19T02:15:52.319 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_user_policies_max_num": "100", 2024-04-19T02:15:52.319 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-04-19T02:15:52.319 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-04-19T02:15:52.319 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_user_quota_sync_interval": "86400", 2024-04-19T02:15:52.319 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-04-19T02:15:52.319 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_user_unique_email": "true", 2024-04-19T02:15:52.319 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_verify_ssl": "true", 2024-04-19T02:15:52.319 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_website_routing_rules_max_num": "50", 2024-04-19T02:15:52.319 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_zone": "", 2024-04-19T02:15:52.320 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_zone_id": "", 2024-04-19T02:15:52.320 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-04-19T02:15:52.320 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_zonegroup": "", 2024-04-19T02:15:52.320 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_zonegroup_id": "", 2024-04-19T02:15:52.320 INFO:teuthology.orchestra.run.smithi121.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-04-19T02:15:52.320 INFO:teuthology.orchestra.run.smithi121.stdout: "rgwlc_auto_session_clear": "true", 2024-04-19T02:15:52.320 INFO:teuthology.orchestra.run.smithi121.stdout: "rgwlc_skip_bucket_step": "false", 2024-04-19T02:15:52.320 INFO:teuthology.orchestra.run.smithi121.stdout: "rocksdb_block_size": "4096", 2024-04-19T02:15:52.321 INFO:teuthology.orchestra.run.smithi121.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-04-19T02:15:52.321 INFO:teuthology.orchestra.run.smithi121.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-04-19T02:15:52.321 INFO:teuthology.orchestra.run.smithi121.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-04-19T02:15:52.321 INFO:teuthology.orchestra.run.smithi121.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-04-19T02:15:52.321 INFO:teuthology.orchestra.run.smithi121.stdout: "rocksdb_cache_shard_bits": "4", 2024-04-19T02:15:52.321 INFO:teuthology.orchestra.run.smithi121.stdout: "rocksdb_cache_size": "536870912", 2024-04-19T02:15:52.321 INFO:teuthology.orchestra.run.smithi121.stdout: "rocksdb_cache_type": "binned_lru", 2024-04-19T02:15:52.321 INFO:teuthology.orchestra.run.smithi121.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-04-19T02:15:52.321 INFO:teuthology.orchestra.run.smithi121.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-04-19T02:15:52.321 INFO:teuthology.orchestra.run.smithi121.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-04-19T02:15:52.321 INFO:teuthology.orchestra.run.smithi121.stdout: "rocksdb_collect_compaction_stats": "false", 2024-04-19T02:15:52.321 INFO:teuthology.orchestra.run.smithi121.stdout: "rocksdb_collect_extended_stats": "false", 2024-04-19T02:15:52.321 INFO:teuthology.orchestra.run.smithi121.stdout: "rocksdb_collect_memory_stats": "false", 2024-04-19T02:15:52.321 INFO:teuthology.orchestra.run.smithi121.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-04-19T02:15:52.321 INFO:teuthology.orchestra.run.smithi121.stdout: "rocksdb_index_type": "binary_search", 2024-04-19T02:15:52.322 INFO:teuthology.orchestra.run.smithi121.stdout: "rocksdb_log_to_ceph_log": "true", 2024-04-19T02:15:52.322 INFO:teuthology.orchestra.run.smithi121.stdout: "rocksdb_metadata_block_size": "4096", 2024-04-19T02:15:52.322 INFO:teuthology.orchestra.run.smithi121.stdout: "rocksdb_partition_filters": "false", 2024-04-19T02:15:52.322 INFO:teuthology.orchestra.run.smithi121.stdout: "rocksdb_perf": "false", 2024-04-19T02:15:52.322 INFO:teuthology.orchestra.run.smithi121.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-04-19T02:15:52.322 INFO:teuthology.orchestra.run.smithi121.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-04-19T02:15:52.322 INFO:teuthology.orchestra.run.smithi121.stdout: "rotating_keys_renewal_timeout": "10", 2024-04-19T02:15:52.322 INFO:teuthology.orchestra.run.smithi121.stdout: "run_dir": "/var/run/ceph", 2024-04-19T02:15:52.322 INFO:teuthology.orchestra.run.smithi121.stdout: "seastore_block_create": "true", 2024-04-19T02:15:52.322 INFO:teuthology.orchestra.run.smithi121.stdout: "seastore_cache_lru_size": "67108864", 2024-04-19T02:15:52.322 INFO:teuthology.orchestra.run.smithi121.stdout: "seastore_cbjournal_size": "5368709120", 2024-04-19T02:15:52.322 INFO:teuthology.orchestra.run.smithi121.stdout: "seastore_default_max_object_size": "16777216", 2024-04-19T02:15:52.322 INFO:teuthology.orchestra.run.smithi121.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-04-19T02:15:52.323 INFO:teuthology.orchestra.run.smithi121.stdout: "seastore_device_size": "53687091200", 2024-04-19T02:15:52.323 INFO:teuthology.orchestra.run.smithi121.stdout: "seastore_journal_batch_capacity": "16", 2024-04-19T02:15:52.323 INFO:teuthology.orchestra.run.smithi121.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-04-19T02:15:52.323 INFO:teuthology.orchestra.run.smithi121.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-04-19T02:15:52.323 INFO:teuthology.orchestra.run.smithi121.stdout: "seastore_journal_iodepth_limit": "5", 2024-04-19T02:15:52.323 INFO:teuthology.orchestra.run.smithi121.stdout: "seastore_main_device_type": "SSD", 2024-04-19T02:15:52.323 INFO:teuthology.orchestra.run.smithi121.stdout: "seastore_max_concurrent_transactions": "8", 2024-04-19T02:15:52.323 INFO:teuthology.orchestra.run.smithi121.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-04-19T02:15:52.324 INFO:teuthology.orchestra.run.smithi121.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-04-19T02:15:52.324 INFO:teuthology.orchestra.run.smithi121.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-04-19T02:15:52.324 INFO:teuthology.orchestra.run.smithi121.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-04-19T02:15:52.324 INFO:teuthology.orchestra.run.smithi121.stdout: "seastore_segment_size": "67108864", 2024-04-19T02:15:52.324 INFO:teuthology.orchestra.run.smithi121.stdout: "set_keepcaps": "false", 2024-04-19T02:15:52.324 INFO:teuthology.orchestra.run.smithi121.stdout: "setgroup": "", 2024-04-19T02:15:52.324 INFO:teuthology.orchestra.run.smithi121.stdout: "setuser": "", 2024-04-19T02:15:52.324 INFO:teuthology.orchestra.run.smithi121.stdout: "setuser_match_path": "", 2024-04-19T02:15:52.324 INFO:teuthology.orchestra.run.smithi121.stdout: "target_max_misplaced_ratio": "0.050000", 2024-04-19T02:15:52.324 INFO:teuthology.orchestra.run.smithi121.stdout: "thp": "false", 2024-04-19T02:15:52.324 INFO:teuthology.orchestra.run.smithi121.stdout: "threadpool_default_timeout": "60", 2024-04-19T02:15:52.324 INFO:teuthology.orchestra.run.smithi121.stdout: "threadpool_empty_queue_max_wait": "2", 2024-04-19T02:15:52.324 INFO:teuthology.orchestra.run.smithi121.stdout: "throttler_perf_counter": "true" 2024-04-19T02:15:52.324 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-04-19T02:15:52.327 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-04-19T02:15:52.460 INFO:teuthology.orchestra.run.smithi121.stdout:mon.a: {} 2024-04-19T02:15:52.469 INFO:teuthology.orchestra.run.smithi121.stdout:mon.b: {} 2024-04-19T02:15:52.478 INFO:teuthology.orchestra.run.smithi121.stdout:mon.c: {} 2024-04-19T02:15:52.479 INFO:teuthology.orchestra.run.smithi121.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-19T02:15:52.479 INFO:teuthology.orchestra.run.smithi121.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-19T02:15:52.479 INFO:teuthology.orchestra.run.smithi121.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-19T02:15:52.490 INFO:tasks.thrashosds.thrasher:Unable to test ceph-objectstore-tool, powercycle testing 2024-04-19T02:15:52.493 INFO:teuthology.run_tasks:Running task radosbench... 2024-04-19T02:15:52.536 INFO:tasks.radosbench:Beginning radosbench... 2024-04-19T02:15:52.536 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2024-04-19T02:15:52.536 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_0 16 2024-04-19T02:15:52.537 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-04-19T02:15:52.537 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-19T02:15:52.537 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T02:15:52.537 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-04-19T02:15:52.537 INFO:tasks.thrashosds.thrasher:Setting osd 1 primary_affinity to 0.712287 2024-04-19T02:15:52.537 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 0.7122865270041161 2024-04-19T02:15:52.538 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-04-19T02:15:52.538 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-04-19T02:15:52.538 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:15:52.539 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-04-19T02:15:52.539 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:15:52.539 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-04-19T02:15:52.539 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T02:15:52.541 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:15:52.540+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:15:52.640 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:15:52.640+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:15:52.679 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:15:52.679 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-04-19T02:15:52.680 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-04-19T02:15:52.680 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:15:52.690 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:15:52.728 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:15:52.740 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:15:52.741+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:15:52.748 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:15:52.768 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2: {} 2024-04-19T02:15:52.769 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:15:52.769 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:15:52.769 INFO:teuthology.orchestra.run.smithi121.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:15:52.817 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:15:52.817 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:15:52.827 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:15:52.842 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:15:52.842+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:15:52.942 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:15:52.943+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:15:52.951 INFO:teuthology.orchestra.run.smithi121.stderr:noscrub is set 2024-04-19T02:15:52.951 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'unique_pool_0' created 2024-04-19T02:15:52.951 INFO:teuthology.orchestra.run.smithi121.stderr:set osd.1 primary-affinity to 0.712287 (8466802) 2024-04-19T02:15:52.956 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:15:52.956 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:15:52.964 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2024-04-19T02:15:52.966 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:15:53.043 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:15:53.043+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:15:53.106 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:15:53.106 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:15:53.115 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:15:53.144 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:15:53.145+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:15:53.240 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:15:53.241 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:15:53.245 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:15:53.246+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:15:53.251 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:15:53.346 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:15:53.347+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:15:53.418 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:15:53.418 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:15:53.428 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:15:53.472 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:15:53.473+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:15:53.548 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:15:53.549+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:15:53.567 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:15:53.567 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:15:53.577 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:15:53.650 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:15:53.651+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:15:53.743 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:15:53.744 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:15:53.751 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:15:53.752+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:15:53.753 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:15:53.852 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:15:53.853+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:15:53.879 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:15:53.879 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:15:53.889 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:15:53.954 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:15:53.954+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:15:53.955 INFO:teuthology.orchestra.run.smithi121.stderr:enabled application 'rados' on pool 'unique_pool_0' 2024-04-19T02:15:54.028 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:15:54.028 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:15:54.038 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:15:54.054 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:15:54.055+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:15:54.155 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:15:54.155+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:15:54.165 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:15:54.165 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:15:54.175 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:15:54.256 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:15:54.256+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:15:54.342 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:15:54.343 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:15:54.353 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:15:54.356 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:15:54.357+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:15:54.457 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:15:54.458+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:15:54.487 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:15:54.487 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:15:54.497 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:15:54.584 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:15:54.585+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:15:54.659 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:15:54.660+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:15:54.664 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:15:54.664 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:15:54.674 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:15:54.759 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:15:54.761+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:15:54.784 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:15:54.842 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:15:54.842 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:15:54.852 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:15:54.893 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:15:54.894+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:15:54.939 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:15:54.959 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:15:54.962 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:15:54.962+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:15:54.970 DEBUG:teuthology.orchestra.run.smithi121:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_0 bench 60 write' 2024-04-19T02:15:54.970 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T02:15:54.973 INFO:teuthology.run_tasks:Running task admin_socket... 2024-04-19T02:15:54.999 DEBUG:tasks.admin_socket:Running admin socket tests on client.0 2024-04-19T02:15:55.000 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -- /home/ubuntu/cephtest/admin_socket_client.0 && while test '!' -e /var/run/ceph/ceph-client.0.asok ; do sleep 1 ; done 2024-04-19T02:15:55.001 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-04-19T02:15:55.001 INFO:teuthology.orchestra.run.smithi177.stdout: "ops": [], 2024-04-19T02:15:55.001 INFO:teuthology.orchestra.run.smithi177.stdout: "num_ops": 0 2024-04-19T02:15:55.001 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-04-19T02:15:55.001 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2: {} 2024-04-19T02:15:55.002 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:15:55.002 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:15:55.002 INFO:teuthology.orchestra.run.smithi121.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:15:55.003 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:15:55.024 INFO:tasks.radosbench.radosbench.0.smithi121.stdout:hints = 1 2024-04-19T02:15:55.024 INFO:tasks.radosbench.radosbench.0.smithi121.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 60 seconds or 0 objects 2024-04-19T02:15:55.024 INFO:tasks.radosbench.radosbench.0.smithi121.stdout:Object prefix: benchmark_data_smithi121_44835 2024-04-19T02:15:55.025 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-19T02:15:55.025 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 0 0 0 0 0 0 - 0 2024-04-19T02:15:55.040 DEBUG:tasks.admin_socket:Testing objecter_requests with config {'test': 'http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch}', 'branch': 'reef'} 2024-04-19T02:15:55.041 DEBUG:teuthology.orchestra.run.smithi121:> wget -q -O /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests -- 'http://git.ceph.com/?p=ceph.git;a=blob_plain;f=src/test/admin_socket/objecter_requests;hb=reef' && chmod u=rx -- /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests 2024-04-19T02:15:55.063 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:15:55.064+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:15:55.164 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:15:55.165+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:15:55.211 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-04-19T02:15:55.212 INFO:teuthology.orchestra.run.smithi177.stdout: "ops": [], 2024-04-19T02:15:55.212 INFO:teuthology.orchestra.run.smithi177.stdout: "complaint_time": 30, 2024-04-19T02:15:55.212 INFO:teuthology.orchestra.run.smithi177.stdout: "num_blocked_ops": 0 2024-04-19T02:15:55.212 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-04-19T02:15:55.223 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:15:55.265 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:15:55.265+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:15:55.365 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:15:55.365+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:15:55.400 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-04-19T02:15:55.401 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 20, 2024-04-19T02:15:55.401 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 600, 2024-04-19T02:15:55.401 INFO:teuthology.orchestra.run.smithi177.stdout: "ops": [ 2024-04-19T02:15:55.401 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.401 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:15:55.401 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:29.270159+0000", 2024-04-19T02:15:55.401 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 26.129552625999999, 2024-04-19T02:15:55.401 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015837766999999999, 2024-04-19T02:15:55.401 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:15:55.401 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:55.401 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:15:55.401 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.401 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:15:55.402 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270159+0000", 2024-04-19T02:15:55.402 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:55.402 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.402 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.402 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:15:55.402 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270159+0000", 2024-04-19T02:15:55.402 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:55.402 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.402 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.402 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:15:55.402 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270158+0000", 2024-04-19T02:15:55.402 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999986 2024-04-19T02:15:55.402 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.402 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.403 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:15:55.403 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270171+0000", 2024-04-19T02:15:55.403 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.3050999999999999e-05 2024-04-19T02:15:55.403 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.403 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.403 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:15:55.403 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270187+0000", 2024-04-19T02:15:55.403 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.6351999999999999e-05 2024-04-19T02:15:55.403 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.403 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.403 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:15:55.403 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270203+0000", 2024-04-19T02:15:55.403 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.6056e-05 2024-04-19T02:15:55.403 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.403 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.404 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:15:55.404 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.271261+0000", 2024-04-19T02:15:55.404 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0010576520000000001 2024-04-19T02:15:55.404 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.404 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.404 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:15:55.404 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.271385+0000", 2024-04-19T02:15:55.404 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012376800000000001 2024-04-19T02:15:55.404 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.404 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.404 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:15:55.404 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.271539+0000", 2024-04-19T02:15:55.404 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00015414000000000001 2024-04-19T02:15:55.404 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.404 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.404 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:15:55.405 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.275422+0000", 2024-04-19T02:15:55.405 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.003883507 2024-04-19T02:15:55.405 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.405 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.405 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:55.405 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.285870+0000", 2024-04-19T02:15:55.405 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.010447700000000001 2024-04-19T02:15:55.405 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.405 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.405 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:15:55.405 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.285947+0000", 2024-04-19T02:15:55.405 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.7429999999999996e-05 2024-04-19T02:15:55.405 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.405 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.405 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:15:55.406 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.285997+0000", 2024-04-19T02:15:55.406 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.9666999999999997e-05 2024-04-19T02:15:55.406 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:55.406 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:15:55.406 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:55.406 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.406 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.406 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:15:55.406 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:29.270219+0000", 2024-04-19T02:15:55.406 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 26.129492939999999, 2024-04-19T02:15:55.406 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015932135, 2024-04-19T02:15:55.406 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:15:55.406 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:55.406 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:15:55.407 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.407 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:15:55.407 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270219+0000", 2024-04-19T02:15:55.407 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:55.407 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.407 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.407 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:15:55.407 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270219+0000", 2024-04-19T02:15:55.407 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:55.407 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.407 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.407 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:15:55.407 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270218+0000", 2024-04-19T02:15:55.407 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:55.407 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.408 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.408 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:15:55.408 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270223+0000", 2024-04-19T02:15:55.408 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.6090000000000003e-06 2024-04-19T02:15:55.408 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.408 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.408 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:15:55.408 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270230+0000", 2024-04-19T02:15:55.408 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.9929999999999998e-06 2024-04-19T02:15:55.408 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.408 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.408 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:15:55.408 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270237+0000", 2024-04-19T02:15:55.408 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.9990000000000002e-06 2024-04-19T02:15:55.408 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.409 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.409 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:15:55.409 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.272960+0000", 2024-04-19T02:15:55.409 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0027234730000000001 2024-04-19T02:15:55.409 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.409 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.409 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:15:55.409 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.273062+0000", 2024-04-19T02:15:55.409 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000102043 2024-04-19T02:15:55.409 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.409 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.409 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:15:55.409 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.273578+0000", 2024-04-19T02:15:55.409 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00051574499999999996 2024-04-19T02:15:55.409 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.409 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.410 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:15:55.410 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.277063+0000", 2024-04-19T02:15:55.410 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0034846109999999999 2024-04-19T02:15:55.410 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.410 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.410 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:55.410 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286077+0000", 2024-04-19T02:15:55.410 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0090144509999999997 2024-04-19T02:15:55.410 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.410 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.410 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:15:55.410 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286115+0000", 2024-04-19T02:15:55.410 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.7710999999999999e-05 2024-04-19T02:15:55.410 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.410 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.411 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:15:55.411 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286151+0000", 2024-04-19T02:15:55.411 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6049e-05 2024-04-19T02:15:55.411 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:55.411 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:15:55.411 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:55.411 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.411 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.411 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(mds.0.3:15 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:15:55.411 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:29.270244+0000", 2024-04-19T02:15:55.411 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 26.129467754, 2024-04-19T02:15:55.411 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015030304, 2024-04-19T02:15:55.411 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:15:55.411 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:55.411 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:15:55.411 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.411 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:15:55.412 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270244+0000", 2024-04-19T02:15:55.412 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:55.412 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.412 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.412 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:15:55.412 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270244+0000", 2024-04-19T02:15:55.412 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:55.412 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.412 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.412 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:15:55.412 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270244+0000", 2024-04-19T02:15:55.412 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:55.412 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.412 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.412 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:15:55.413 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270248+0000", 2024-04-19T02:15:55.413 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.2139999999999998e-06 2024-04-19T02:15:55.413 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.413 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.413 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:15:55.413 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270256+0000", 2024-04-19T02:15:55.413 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.8650000000000001e-06 2024-04-19T02:15:55.413 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.413 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.413 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:15:55.413 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270265+0000", 2024-04-19T02:15:55.413 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.8210000000000008e-06 2024-04-19T02:15:55.413 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.413 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.413 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:15:55.414 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.273182+0000", 2024-04-19T02:15:55.414 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0029179420000000002 2024-04-19T02:15:55.414 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.414 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.414 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:15:55.414 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.273653+0000", 2024-04-19T02:15:55.414 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00047090700000000001 2024-04-19T02:15:55.414 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.414 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.414 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 1", 2024-04-19T02:15:55.414 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.273818+0000", 2024-04-19T02:15:55.414 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000164382 2024-04-19T02:15:55.414 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.414 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.414 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:15:55.415 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.278281+0000", 2024-04-19T02:15:55.415 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0044635059999999999 2024-04-19T02:15:55.415 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.415 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.415 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:55.415 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.285194+0000", 2024-04-19T02:15:55.415 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0069127420000000004 2024-04-19T02:15:55.415 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.415 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.415 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:15:55.415 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.285237+0000", 2024-04-19T02:15:55.415 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.3448000000000001e-05 2024-04-19T02:15:55.415 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.415 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.416 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:15:55.416 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.285274+0000", 2024-04-19T02:15:55.416 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6921000000000001e-05 2024-04-19T02:15:55.416 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:55.416 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:15:55.416 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:55.416 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.416 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.416 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:15:55.416 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:29.270271+0000", 2024-04-19T02:15:55.416 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 26.129440783, 2024-04-19T02:15:55.416 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015123286999999999, 2024-04-19T02:15:55.416 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:15:55.416 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:55.416 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:15:55.417 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.417 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:15:55.417 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270271+0000", 2024-04-19T02:15:55.417 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:55.417 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.417 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.417 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:15:55.417 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270271+0000", 2024-04-19T02:15:55.417 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:55.417 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.417 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.417 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:15:55.417 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270271+0000", 2024-04-19T02:15:55.417 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:55.417 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.418 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.418 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:15:55.418 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270279+0000", 2024-04-19T02:15:55.418 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.2490000000000001e-06 2024-04-19T02:15:55.418 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.418 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.418 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:15:55.418 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270287+0000", 2024-04-19T02:15:55.418 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.8979999999999996e-06 2024-04-19T02:15:55.418 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.418 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.418 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:15:55.418 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270299+0000", 2024-04-19T02:15:55.418 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.24e-05 2024-04-19T02:15:55.418 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.419 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.419 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:15:55.419 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.274674+0000", 2024-04-19T02:15:55.419 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0043751429999999997 2024-04-19T02:15:55.419 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.419 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.419 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:15:55.419 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.274754+0000", 2024-04-19T02:15:55.419 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.9362000000000004e-05 2024-04-19T02:15:55.419 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.419 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.419 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 1", 2024-04-19T02:15:55.419 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.274918+0000", 2024-04-19T02:15:55.419 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000164616 2024-04-19T02:15:55.419 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.420 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.420 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:15:55.420 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.278603+0000", 2024-04-19T02:15:55.420 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0036852370000000001 2024-04-19T02:15:55.420 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.420 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.420 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:55.420 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.285314+0000", 2024-04-19T02:15:55.420 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0067103240000000001 2024-04-19T02:15:55.420 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.420 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.420 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:15:55.420 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.285357+0000", 2024-04-19T02:15:55.420 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.3288999999999998e-05 2024-04-19T02:15:55.420 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.421 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.421 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:15:55.421 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.285394+0000", 2024-04-19T02:15:55.421 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.7199000000000001e-05 2024-04-19T02:15:55.421 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:55.421 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:15:55.421 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:55.421 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.421 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.421 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(mds.0.3:16 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:15:55.421 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:29.270306+0000", 2024-04-19T02:15:55.421 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 26.129405504000001, 2024-04-19T02:15:55.421 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016306661, 2024-04-19T02:15:55.421 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:15:55.422 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:55.422 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:15:55.422 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.422 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:15:55.422 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270306+0000", 2024-04-19T02:15:55.422 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:55.422 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.422 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.422 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:15:55.422 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270306+0000", 2024-04-19T02:15:55.422 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:55.422 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.422 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.422 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:15:55.422 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270306+0000", 2024-04-19T02:15:55.423 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:55.423 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.423 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.423 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:15:55.423 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270310+0000", 2024-04-19T02:15:55.423 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.0990000000000001e-06 2024-04-19T02:15:55.423 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.423 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.423 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:15:55.423 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270317+0000", 2024-04-19T02:15:55.423 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.7100000000000001e-06 2024-04-19T02:15:55.423 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.423 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.423 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:15:55.423 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270324+0000", 2024-04-19T02:15:55.424 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.374e-06 2024-04-19T02:15:55.424 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.424 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.424 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:15:55.424 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.274312+0000", 2024-04-19T02:15:55.424 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0039885140000000003 2024-04-19T02:15:55.424 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.424 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.424 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:15:55.424 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.274737+0000", 2024-04-19T02:15:55.424 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00042410899999999999 2024-04-19T02:15:55.424 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.424 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.424 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:15:55.424 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.274893+0000", 2024-04-19T02:15:55.424 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00015594599999999999 2024-04-19T02:15:55.425 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.425 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.425 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:15:55.425 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.278597+0000", 2024-04-19T02:15:55.425 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0037046869999999999 2024-04-19T02:15:55.425 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.425 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.425 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:55.425 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286522+0000", 2024-04-19T02:15:55.425 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0079243809999999994 2024-04-19T02:15:55.425 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.425 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.425 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:15:55.425 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286576+0000", 2024-04-19T02:15:55.426 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.4728999999999997e-05 2024-04-19T02:15:55.426 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.426 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.426 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:15:55.426 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286613+0000", 2024-04-19T02:15:55.426 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6661e-05 2024-04-19T02:15:55.426 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:55.426 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:15:55.426 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:55.426 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.426 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.426 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(mds.0.3:18 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:15:55.426 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:29.270329+0000", 2024-04-19T02:15:55.426 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 26.129383016999999, 2024-04-19T02:15:55.427 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016172755, 2024-04-19T02:15:55.427 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:15:55.427 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:55.427 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:15:55.427 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.427 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:15:55.427 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270329+0000", 2024-04-19T02:15:55.427 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:55.427 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.427 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.427 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:15:55.427 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270329+0000", 2024-04-19T02:15:55.427 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:55.427 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.427 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.427 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:15:55.428 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270328+0000", 2024-04-19T02:15:55.428 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:55.428 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.428 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.428 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:15:55.428 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270331+0000", 2024-04-19T02:15:55.428 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.9629999999999998e-06 2024-04-19T02:15:55.428 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.428 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.428 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:15:55.428 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270338+0000", 2024-04-19T02:15:55.428 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.1410000000000002e-06 2024-04-19T02:15:55.428 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.428 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.428 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:15:55.429 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270344+0000", 2024-04-19T02:15:55.429 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.7410000000000003e-06 2024-04-19T02:15:55.429 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.429 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.429 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:15:55.429 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270418+0000", 2024-04-19T02:15:55.429 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.3598999999999998e-05 2024-04-19T02:15:55.429 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.429 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.429 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:15:55.429 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270623+0000", 2024-04-19T02:15:55.429 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00020499599999999999 2024-04-19T02:15:55.429 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.429 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.429 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:15:55.430 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.271086+0000", 2024-04-19T02:15:55.430 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00046345199999999999 2024-04-19T02:15:55.430 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.430 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.430 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:15:55.430 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.276220+0000", 2024-04-19T02:15:55.430 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0051338490000000002 2024-04-19T02:15:55.430 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.430 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.430 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:55.430 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286426+0000", 2024-04-19T02:15:55.430 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.010205982000000001 2024-04-19T02:15:55.430 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.430 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.431 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:15:55.431 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286461+0000", 2024-04-19T02:15:55.431 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.5280000000000001e-05 2024-04-19T02:15:55.431 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.431 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.431 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:15:55.431 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286502+0000", 2024-04-19T02:15:55.431 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.0102000000000003e-05 2024-04-19T02:15:55.431 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:55.431 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:15:55.431 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:55.431 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.431 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.431 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(mds.0.3:23 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:15:55.432 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:29.270358+0000", 2024-04-19T02:15:55.432 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 26.129354295999999, 2024-04-19T02:15:55.432 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016257511999999998, 2024-04-19T02:15:55.432 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:15:55.432 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:15:55.432 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:15:55.432 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.432 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:15:55.432 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270358+0000", 2024-04-19T02:15:55.432 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:55.432 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.432 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.432 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:15:55.432 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270358+0000", 2024-04-19T02:15:55.432 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:55.433 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.433 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.433 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:15:55.433 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270357+0000", 2024-04-19T02:15:55.433 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:55.433 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.433 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.433 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:15:55.433 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270360+0000", 2024-04-19T02:15:55.433 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.106e-06 2024-04-19T02:15:55.433 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.433 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.433 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:15:55.433 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270368+0000", 2024-04-19T02:15:55.434 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.6279999999999996e-06 2024-04-19T02:15:55.434 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.434 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.434 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:15:55.434 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270373+0000", 2024-04-19T02:15:55.434 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.1410000000000004e-06 2024-04-19T02:15:55.434 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.434 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.434 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:15:55.434 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.271505+0000", 2024-04-19T02:15:55.434 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0011319069999999999 2024-04-19T02:15:55.434 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.434 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.434 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:15:55.435 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.271652+0000", 2024-04-19T02:15:55.435 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00014698399999999999 2024-04-19T02:15:55.435 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.435 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.435 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:15:55.435 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286615+0000", 2024-04-19T02:15:55.435 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.014963156999999999 2024-04-19T02:15:55.435 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:55.435 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:15:55.435 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:55.435 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.435 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.435 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(mds.0.3:24 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:15:55.435 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:29.270411+0000", 2024-04-19T02:15:55.435 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 26.129301303999998, 2024-04-19T02:15:55.436 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016334762999999999, 2024-04-19T02:15:55.436 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:15:55.436 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:15:55.436 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:15:55.436 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.436 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:15:55.436 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270411+0000", 2024-04-19T02:15:55.436 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:55.436 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.436 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.436 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:15:55.436 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270411+0000", 2024-04-19T02:15:55.436 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:55.436 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.436 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.436 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:15:55.437 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270410+0000", 2024-04-19T02:15:55.437 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:55.437 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.437 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.437 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:15:55.437 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270413+0000", 2024-04-19T02:15:55.437 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.303e-06 2024-04-19T02:15:55.437 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.437 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.437 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:15:55.437 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270421+0000", 2024-04-19T02:15:55.437 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.3769999999999998e-06 2024-04-19T02:15:55.437 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.437 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.437 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:15:55.438 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270429+0000", 2024-04-19T02:15:55.438 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.6740000000000003e-06 2024-04-19T02:15:55.438 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.438 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.438 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:15:55.438 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.275527+0000", 2024-04-19T02:15:55.438 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0050975869999999998 2024-04-19T02:15:55.438 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.438 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.438 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:15:55.438 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.275946+0000", 2024-04-19T02:15:55.438 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00041882699999999998 2024-04-19T02:15:55.438 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.438 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.439 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:15:55.439 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286745+0000", 2024-04-19T02:15:55.439 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.010799477 2024-04-19T02:15:55.439 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:55.439 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:15:55.439 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:55.439 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.439 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.439 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(mds.0.3:26 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:15:55.439 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:29.270451+0000", 2024-04-19T02:15:55.439 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 26.129260496000001, 2024-04-19T02:15:55.439 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.010895475, 2024-04-19T02:15:55.439 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:15:55.439 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:15:55.439 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:15:55.439 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.440 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:15:55.440 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270451+0000", 2024-04-19T02:15:55.440 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:55.440 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.440 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.440 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:15:55.440 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270451+0000", 2024-04-19T02:15:55.440 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:55.440 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.440 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.440 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:15:55.440 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270451+0000", 2024-04-19T02:15:55.440 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:55.440 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.441 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.441 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:15:55.441 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270465+0000", 2024-04-19T02:15:55.441 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.4715000000000001e-05 2024-04-19T02:15:55.441 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.441 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.441 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:15:55.441 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270475+0000", 2024-04-19T02:15:55.441 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.4190000000000008e-06 2024-04-19T02:15:55.441 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.441 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.441 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:15:55.441 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270481+0000", 2024-04-19T02:15:55.441 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.4749999999999998e-06 2024-04-19T02:15:55.441 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.442 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.442 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:15:55.442 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270528+0000", 2024-04-19T02:15:55.442 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.6294000000000001e-05 2024-04-19T02:15:55.442 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.442 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.442 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:15:55.442 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270715+0000", 2024-04-19T02:15:55.442 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00018693900000000001 2024-04-19T02:15:55.442 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.442 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.442 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:15:55.442 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.281347+0000", 2024-04-19T02:15:55.442 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.010632225 2024-04-19T02:15:55.442 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:55.443 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:15:55.443 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:55.443 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.443 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.443 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:113 5.5 5:a2dfc1cf:::benchmark_data_smithi121_44835_object112:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:15:55.443 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:55.057311+0000", 2024-04-19T02:15:55.443 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.34240124100000002, 2024-04-19T02:15:55.443 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.01068332, 2024-04-19T02:15:55.443 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:15:55.443 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:55.443 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:15:55.443 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:15:55.443 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:55.443 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 113 2024-04-19T02:15:55.444 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.444 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:15:55.444 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.444 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:15:55.444 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.057311+0000", 2024-04-19T02:15:55.444 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:55.444 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.444 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.444 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:15:55.444 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.057311+0000", 2024-04-19T02:15:55.444 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:55.444 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.444 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.444 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:15:55.444 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.057310+0000", 2024-04-19T02:15:55.445 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:15:55.445 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.445 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.445 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:15:55.445 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.057337+0000", 2024-04-19T02:15:55.445 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.7511000000000001e-05 2024-04-19T02:15:55.445 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.445 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.445 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:15:55.445 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.057346+0000", 2024-04-19T02:15:55.445 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.721e-06 2024-04-19T02:15:55.445 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.445 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.445 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:15:55.445 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.057355+0000", 2024-04-19T02:15:55.445 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.9740000000000008e-06 2024-04-19T02:15:55.446 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.446 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.446 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:15:55.446 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.057396+0000", 2024-04-19T02:15:55.446 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.1312e-05 2024-04-19T02:15:55.446 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.446 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.446 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:15:55.446 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.057534+0000", 2024-04-19T02:15:55.446 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00013766900000000001 2024-04-19T02:15:55.446 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.446 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.446 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:15:55.446 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.057667+0000", 2024-04-19T02:15:55.446 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00013333 2024-04-19T02:15:55.447 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.447 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.447 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:55.447 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.060145+0000", 2024-04-19T02:15:55.447 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0024780520000000001 2024-04-19T02:15:55.447 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.447 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.447 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:15:55.447 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.067911+0000", 2024-04-19T02:15:55.447 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0077653849999999996 2024-04-19T02:15:55.447 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.447 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.447 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:15:55.447 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.067947+0000", 2024-04-19T02:15:55.447 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.629e-05 2024-04-19T02:15:55.448 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.448 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.448 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:15:55.448 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.067994+0000", 2024-04-19T02:15:55.448 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.6986e-05 2024-04-19T02:15:55.448 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:55.448 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:15:55.448 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:55.448 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.448 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.448 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:144 5.6 5:6da317a9:::benchmark_data_smithi121_44835_object143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:15:55.448 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:55.069061+0000", 2024-04-19T02:15:55.448 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.33065071000000001, 2024-04-19T02:15:55.448 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.011797775, 2024-04-19T02:15:55.449 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:15:55.449 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:55.449 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:15:55.449 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:15:55.449 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:55.449 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 144 2024-04-19T02:15:55.449 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.449 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:15:55.449 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.449 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:15:55.449 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.069061+0000", 2024-04-19T02:15:55.449 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:55.449 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.449 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.449 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:15:55.450 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.069061+0000", 2024-04-19T02:15:55.450 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:55.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.450 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.450 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:15:55.450 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.069060+0000", 2024-04-19T02:15:55.450 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:55.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.450 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.450 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:15:55.450 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.069094+0000", 2024-04-19T02:15:55.450 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.3123000000000001e-05 2024-04-19T02:15:55.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.450 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.450 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:15:55.450 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.069101+0000", 2024-04-19T02:15:55.451 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.2509999999999997e-06 2024-04-19T02:15:55.451 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.451 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.451 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:15:55.451 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.069107+0000", 2024-04-19T02:15:55.451 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.9839999999999998e-06 2024-04-19T02:15:55.451 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.451 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.451 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:15:55.451 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.070096+0000", 2024-04-19T02:15:55.451 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00098945499999999998 2024-04-19T02:15:55.451 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.451 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.451 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:15:55.451 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.070170+0000", 2024-04-19T02:15:55.452 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.3258999999999998e-05 2024-04-19T02:15:55.452 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.452 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.452 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:15:55.452 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.070290+0000", 2024-04-19T02:15:55.452 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000120356 2024-04-19T02:15:55.452 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.452 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.452 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:15:55.452 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.071965+0000", 2024-04-19T02:15:55.452 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00167512 2024-04-19T02:15:55.452 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.452 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.452 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:55.453 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.080802+0000", 2024-04-19T02:15:55.453 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0088372820000000001 2024-04-19T02:15:55.453 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.453 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.453 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:15:55.453 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.080831+0000", 2024-04-19T02:15:55.453 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.8217000000000001e-05 2024-04-19T02:15:55.453 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.453 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.453 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:15:55.453 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.080859+0000", 2024-04-19T02:15:55.453 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.8356000000000001e-05 2024-04-19T02:15:55.453 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:55.453 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:15:55.453 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:55.454 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.454 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.454 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:145 5.6 5:63a61e55:::benchmark_data_smithi121_44835_object144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:15:55.454 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:55.069113+0000", 2024-04-19T02:15:55.454 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.33059877199999999, 2024-04-19T02:15:55.454 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.011892615, 2024-04-19T02:15:55.454 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:15:55.454 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:55.454 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:15:55.454 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:15:55.454 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:55.454 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 145 2024-04-19T02:15:55.454 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.454 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:15:55.454 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.455 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:15:55.455 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.069113+0000", 2024-04-19T02:15:55.455 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:55.455 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.455 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.455 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:15:55.455 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.069113+0000", 2024-04-19T02:15:55.455 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:55.455 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.455 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.455 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:15:55.455 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.069112+0000", 2024-04-19T02:15:55.455 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:55.455 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.456 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.456 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:15:55.456 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.069255+0000", 2024-04-19T02:15:55.456 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00014223999999999999 2024-04-19T02:15:55.456 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.456 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.456 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:15:55.456 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.069266+0000", 2024-04-19T02:15:55.456 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0946e-05 2024-04-19T02:15:55.456 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.456 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.456 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:15:55.456 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.069272+0000", 2024-04-19T02:15:55.456 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.4309999999999999e-06 2024-04-19T02:15:55.457 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.457 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.457 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:15:55.457 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.070634+0000", 2024-04-19T02:15:55.457 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0013623229999999999 2024-04-19T02:15:55.457 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.457 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.457 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:15:55.457 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.070741+0000", 2024-04-19T02:15:55.457 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00010652199999999999 2024-04-19T02:15:55.457 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.457 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.457 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:15:55.457 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.070870+0000", 2024-04-19T02:15:55.458 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012935 2024-04-19T02:15:55.458 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.458 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.458 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:15:55.458 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.073104+0000", 2024-04-19T02:15:55.458 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0022332680000000001 2024-04-19T02:15:55.458 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.458 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.458 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:55.458 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.080910+0000", 2024-04-19T02:15:55.458 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0078061959999999996 2024-04-19T02:15:55.458 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.458 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.458 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:15:55.458 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.080963+0000", 2024-04-19T02:15:55.459 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.3238000000000001e-05 2024-04-19T02:15:55.459 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.459 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.459 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:15:55.459 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.081006+0000", 2024-04-19T02:15:55.459 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.2697999999999997e-05 2024-04-19T02:15:55.459 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:55.459 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:15:55.459 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:55.459 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.459 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.459 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:436 5.6 5:653e4243:::benchmark_data_smithi121_44835_object435:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:15:55.459 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:55.151523+0000", 2024-04-19T02:15:55.459 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.248188307, 2024-04-19T02:15:55.460 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.011398999, 2024-04-19T02:15:55.460 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:15:55.460 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:55.460 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:15:55.460 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:15:55.460 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:55.460 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 436 2024-04-19T02:15:55.460 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.460 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:15:55.460 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.460 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:15:55.460 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.151523+0000", 2024-04-19T02:15:55.460 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:55.460 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.460 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.461 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:15:55.461 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.151523+0000", 2024-04-19T02:15:55.461 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:55.461 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.461 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.461 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:15:55.461 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.151523+0000", 2024-04-19T02:15:55.461 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:55.461 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.461 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.461 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:15:55.461 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.151702+0000", 2024-04-19T02:15:55.461 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000179309 2024-04-19T02:15:55.461 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.462 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.462 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:15:55.462 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.151711+0000", 2024-04-19T02:15:55.462 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.3350000000000007e-06 2024-04-19T02:15:55.462 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.462 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.462 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:15:55.462 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.151717+0000", 2024-04-19T02:15:55.462 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.1160000000000004e-06 2024-04-19T02:15:55.462 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.462 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.462 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:15:55.462 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.154246+0000", 2024-04-19T02:15:55.462 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0025291129999999999 2024-04-19T02:15:55.463 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.463 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.463 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:15:55.463 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.154363+0000", 2024-04-19T02:15:55.463 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000116995 2024-04-19T02:15:55.463 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.463 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.463 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:15:55.463 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.154514+0000", 2024-04-19T02:15:55.463 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000151385 2024-04-19T02:15:55.463 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.463 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.463 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:15:55.463 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.155468+0000", 2024-04-19T02:15:55.463 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00095345399999999996 2024-04-19T02:15:55.464 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.464 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.464 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:55.464 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.162874+0000", 2024-04-19T02:15:55.464 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0074059740000000001 2024-04-19T02:15:55.464 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.464 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.464 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:15:55.464 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.162901+0000", 2024-04-19T02:15:55.464 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.7183999999999999e-05 2024-04-19T02:15:55.464 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.464 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.464 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:15:55.465 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.162922+0000", 2024-04-19T02:15:55.465 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.1559000000000001e-05 2024-04-19T02:15:55.465 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:55.465 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:15:55.465 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:55.465 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.465 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.465 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:488 5.6 5:65b2f767:::benchmark_data_smithi121_44835_object487:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:15:55.465 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:55.168443+0000", 2024-04-19T02:15:55.465 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.23126925000000001, 2024-04-19T02:15:55.465 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.010864561999999999, 2024-04-19T02:15:55.465 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:15:55.465 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:55.465 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:15:55.465 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:15:55.466 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:55.466 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 488 2024-04-19T02:15:55.466 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.466 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:15:55.466 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.466 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:15:55.466 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.168443+0000", 2024-04-19T02:15:55.466 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:55.466 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.466 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.466 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:15:55.466 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.168443+0000", 2024-04-19T02:15:55.466 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:55.466 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.467 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.467 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:15:55.467 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.168442+0000", 2024-04-19T02:15:55.467 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:55.467 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.467 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.467 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:15:55.467 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.168477+0000", 2024-04-19T02:15:55.467 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.5193e-05 2024-04-19T02:15:55.467 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.467 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.467 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:15:55.467 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.168483+0000", 2024-04-19T02:15:55.467 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.9850000000000003e-06 2024-04-19T02:15:55.467 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.468 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.468 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:15:55.468 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.168487+0000", 2024-04-19T02:15:55.468 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6480000000000001e-06 2024-04-19T02:15:55.468 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.468 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.468 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:15:55.468 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.168892+0000", 2024-04-19T02:15:55.468 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00040478699999999999 2024-04-19T02:15:55.468 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.468 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.468 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:15:55.468 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.168967+0000", 2024-04-19T02:15:55.468 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.5420999999999995e-05 2024-04-19T02:15:55.468 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.469 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.469 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:15:55.469 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.169092+0000", 2024-04-19T02:15:55.469 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012511999999999999 2024-04-19T02:15:55.469 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.469 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.469 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:15:55.469 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.170797+0000", 2024-04-19T02:15:55.469 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.001704328 2024-04-19T02:15:55.469 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.469 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.469 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:55.469 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.179228+0000", 2024-04-19T02:15:55.469 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0084317379999999994 2024-04-19T02:15:55.469 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.469 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.470 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:15:55.470 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.179274+0000", 2024-04-19T02:15:55.470 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.5969e-05 2024-04-19T02:15:55.470 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.470 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.470 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:15:55.470 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.179307+0000", 2024-04-19T02:15:55.470 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.2722999999999998e-05 2024-04-19T02:15:55.470 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:55.470 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:15:55.470 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:55.470 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.470 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.470 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:630 5.3 5:c9fc5f6a:::benchmark_data_smithi121_44835_object629:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:15:55.471 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:55.207164+0000", 2024-04-19T02:15:55.471 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.19254761200000001, 2024-04-19T02:15:55.471 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.014098078, 2024-04-19T02:15:55.471 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:15:55.471 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:55.471 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:15:55.471 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:15:55.471 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:55.471 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 630 2024-04-19T02:15:55.471 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.471 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:15:55.471 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.471 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:15:55.471 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.207164+0000", 2024-04-19T02:15:55.471 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:55.471 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.471 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.472 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:15:55.472 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.207164+0000", 2024-04-19T02:15:55.472 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:55.472 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.472 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.472 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:15:55.472 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.207164+0000", 2024-04-19T02:15:55.472 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:55.472 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.472 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.472 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:15:55.472 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.207248+0000", 2024-04-19T02:15:55.472 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.4414999999999997e-05 2024-04-19T02:15:55.472 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.472 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.473 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:15:55.473 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.207257+0000", 2024-04-19T02:15:55.473 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.5720000000000003e-06 2024-04-19T02:15:55.473 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.473 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.473 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:15:55.473 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.207264+0000", 2024-04-19T02:15:55.473 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.1430000000000001e-06 2024-04-19T02:15:55.473 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.473 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.473 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:15:55.473 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.208420+0000", 2024-04-19T02:15:55.473 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.001155959 2024-04-19T02:15:55.473 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.473 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.473 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:15:55.474 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.208526+0000", 2024-04-19T02:15:55.474 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000105821 2024-04-19T02:15:55.474 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.474 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.474 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:15:55.474 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.208624+0000", 2024-04-19T02:15:55.474 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.8218000000000001e-05 2024-04-19T02:15:55.474 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.474 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.474 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:55.474 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.210553+0000", 2024-04-19T02:15:55.474 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.001929046 2024-04-19T02:15:55.474 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.474 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.474 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:15:55.475 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.221190+0000", 2024-04-19T02:15:55.475 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.010636672 2024-04-19T02:15:55.475 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.475 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.475 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:15:55.475 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.221233+0000", 2024-04-19T02:15:55.475 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.3185000000000001e-05 2024-04-19T02:15:55.475 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.475 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.475 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:15:55.475 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.221262+0000", 2024-04-19T02:15:55.475 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.9539e-05 2024-04-19T02:15:55.475 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:55.475 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:15:55.475 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:55.476 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.476 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.476 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:632 5.a 5:59148eb4:::benchmark_data_smithi121_44835_object631:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:15:55.476 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:55.207966+0000", 2024-04-19T02:15:55.476 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.19174575699999999, 2024-04-19T02:15:55.476 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.013388169, 2024-04-19T02:15:55.476 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:15:55.476 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:55.476 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:15:55.476 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:15:55.476 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:55.476 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 632 2024-04-19T02:15:55.476 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.476 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:15:55.476 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.476 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:15:55.477 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.207966+0000", 2024-04-19T02:15:55.477 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:55.477 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.477 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.477 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:15:55.477 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.207966+0000", 2024-04-19T02:15:55.477 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:55.477 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.477 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.477 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:15:55.477 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.207965+0000", 2024-04-19T02:15:55.477 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:15:55.477 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.477 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.477 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:15:55.478 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.208058+0000", 2024-04-19T02:15:55.478 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.2375999999999998e-05 2024-04-19T02:15:55.478 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.478 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.478 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:15:55.478 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.208066+0000", 2024-04-19T02:15:55.478 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.772e-06 2024-04-19T02:15:55.478 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.478 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.478 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:15:55.478 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.208074+0000", 2024-04-19T02:15:55.478 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.1840000000000002e-06 2024-04-19T02:15:55.478 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.478 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.478 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:15:55.479 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.208353+0000", 2024-04-19T02:15:55.479 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00027955299999999998 2024-04-19T02:15:55.479 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.479 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.479 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:15:55.479 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.208442+0000", 2024-04-19T02:15:55.479 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.9000999999999997e-05 2024-04-19T02:15:55.479 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.479 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.479 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 1", 2024-04-19T02:15:55.479 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.208531+0000", 2024-04-19T02:15:55.479 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.9211999999999999e-05 2024-04-19T02:15:55.479 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.479 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.479 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:55.479 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.210524+0000", 2024-04-19T02:15:55.480 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0019927859999999999 2024-04-19T02:15:55.480 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.480 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.480 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:15:55.480 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.221153+0000", 2024-04-19T02:15:55.480 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.010629013 2024-04-19T02:15:55.480 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.480 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.480 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:15:55.480 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.221213+0000", 2024-04-19T02:15:55.480 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.9596999999999999e-05 2024-04-19T02:15:55.480 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.480 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.480 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:15:55.480 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.221354+0000", 2024-04-19T02:15:55.481 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000141426 2024-04-19T02:15:55.481 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:55.481 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:15:55.481 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:55.481 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.481 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.481 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:633 5.c 5:3a45c519:::benchmark_data_smithi121_44835_object632:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:15:55.481 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:55.208131+0000", 2024-04-19T02:15:55.481 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.19158072000000001, 2024-04-19T02:15:55.481 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.013134708, 2024-04-19T02:15:55.481 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:15:55.481 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:55.481 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:15:55.481 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:15:55.482 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:55.482 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 633 2024-04-19T02:15:55.482 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.482 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:15:55.482 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.482 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:15:55.482 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.208131+0000", 2024-04-19T02:15:55.482 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:55.482 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.482 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.482 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:15:55.482 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.208131+0000", 2024-04-19T02:15:55.482 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:55.482 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.482 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.483 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:15:55.483 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.208130+0000", 2024-04-19T02:15:55.483 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:55.483 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.483 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.483 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:15:55.483 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.208215+0000", 2024-04-19T02:15:55.483 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.4124999999999998e-05 2024-04-19T02:15:55.483 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.483 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.483 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:15:55.483 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.208224+0000", 2024-04-19T02:15:55.483 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.0229999999999998e-06 2024-04-19T02:15:55.483 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.483 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.484 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:15:55.484 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.208231+0000", 2024-04-19T02:15:55.484 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.1280000000000002e-06 2024-04-19T02:15:55.484 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.484 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.484 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:15:55.484 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.208262+0000", 2024-04-19T02:15:55.484 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.1090000000000002e-05 2024-04-19T02:15:55.484 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.484 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.484 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:15:55.484 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.208369+0000", 2024-04-19T02:15:55.484 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000107044 2024-04-19T02:15:55.484 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.484 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.484 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:15:55.485 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.208507+0000", 2024-04-19T02:15:55.485 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000138579 2024-04-19T02:15:55.485 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.485 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.485 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:55.485 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.210535+0000", 2024-04-19T02:15:55.485 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0020274440000000002 2024-04-19T02:15:55.485 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.485 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.485 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:15:55.485 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.221185+0000", 2024-04-19T02:15:55.485 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.010650277999999999 2024-04-19T02:15:55.485 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.485 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.485 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:15:55.486 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.221231+0000", 2024-04-19T02:15:55.486 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.6152999999999997e-05 2024-04-19T02:15:55.486 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.486 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.486 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:15:55.486 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.221266+0000", 2024-04-19T02:15:55.486 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.4462000000000003e-05 2024-04-19T02:15:55.486 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:55.486 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:15:55.486 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:55.486 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.486 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.486 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:635 5.5 5:a0a36cd8:::benchmark_data_smithi121_44835_object634:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:15:55.486 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:55.209425+0000", 2024-04-19T02:15:55.487 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.19028700600000001, 2024-04-19T02:15:55.487 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.011904539, 2024-04-19T02:15:55.487 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:15:55.487 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:55.487 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:15:55.487 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:15:55.487 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:55.487 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 635 2024-04-19T02:15:55.487 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.487 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:15:55.487 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.487 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:15:55.487 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.209425+0000", 2024-04-19T02:15:55.487 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:55.487 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.487 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.488 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:15:55.488 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.209425+0000", 2024-04-19T02:15:55.488 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:55.488 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.488 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.488 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:15:55.488 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.209424+0000", 2024-04-19T02:15:55.488 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:55.488 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.488 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.488 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:15:55.488 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.209511+0000", 2024-04-19T02:15:55.488 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.6686000000000003e-05 2024-04-19T02:15:55.488 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.488 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.489 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:15:55.489 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.209518+0000", 2024-04-19T02:15:55.489 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.2099999999999996e-06 2024-04-19T02:15:55.489 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.489 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.489 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:15:55.489 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.209522+0000", 2024-04-19T02:15:55.489 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.2320000000000003e-06 2024-04-19T02:15:55.489 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.489 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.489 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:15:55.489 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.209560+0000", 2024-04-19T02:15:55.489 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.7960000000000002e-05 2024-04-19T02:15:55.489 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.489 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.490 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:15:55.490 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.209678+0000", 2024-04-19T02:15:55.490 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000117717 2024-04-19T02:15:55.490 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.490 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.490 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:15:55.490 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.209818+0000", 2024-04-19T02:15:55.490 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000140123 2024-04-19T02:15:55.490 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.490 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.490 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:55.490 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.211810+0000", 2024-04-19T02:15:55.490 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0019922849999999999 2024-04-19T02:15:55.490 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.490 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.491 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:15:55.491 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.221254+0000", 2024-04-19T02:15:55.491 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0094437470000000006 2024-04-19T02:15:55.491 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.491 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.491 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:15:55.491 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.221294+0000", 2024-04-19T02:15:55.491 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.0326e-05 2024-04-19T02:15:55.491 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.491 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.491 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:15:55.491 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.221329+0000", 2024-04-19T02:15:55.491 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.4858999999999999e-05 2024-04-19T02:15:55.491 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:55.492 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:15:55.492 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:55.492 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.492 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.492 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:634 5.8 e18/16 5:1b48906c:::benchmark_data_smithi121_44835_object633:head v 18'38, mlcod=18'36)", 2024-04-19T02:15:55.492 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:55.209756+0000", 2024-04-19T02:15:55.492 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.189956176, 2024-04-19T02:15:55.492 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.011488956, 2024-04-19T02:15:55.492 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:15:55.492 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:55.492 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:15:55.492 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.492 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:15:55.492 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.209756+0000", 2024-04-19T02:15:55.492 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:55.492 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.493 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.493 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:15:55.493 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.209756+0000", 2024-04-19T02:15:55.493 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:55.493 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.493 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.493 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:15:55.493 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.209755+0000", 2024-04-19T02:15:55.493 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:55.493 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.493 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.493 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:15:55.493 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.209818+0000", 2024-04-19T02:15:55.493 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.2697e-05 2024-04-19T02:15:55.494 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.494 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.494 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:15:55.494 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.209824+0000", 2024-04-19T02:15:55.494 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.8039999999999998e-06 2024-04-19T02:15:55.494 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.494 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.494 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:15:55.494 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.209827+0000", 2024-04-19T02:15:55.494 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.4979999999999998e-06 2024-04-19T02:15:55.494 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.494 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.494 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:15:55.494 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.209858+0000", 2024-04-19T02:15:55.494 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.0497999999999998e-05 2024-04-19T02:15:55.495 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.495 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.495 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:15:55.495 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.209878+0000", 2024-04-19T02:15:55.495 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.0330999999999999e-05 2024-04-19T02:15:55.495 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.495 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.495 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:15:55.495 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.221199+0000", 2024-04-19T02:15:55.495 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.011320563000000001 2024-04-19T02:15:55.495 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.495 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.495 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:15:55.495 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.221245+0000", 2024-04-19T02:15:55.495 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.5992999999999998e-05 2024-04-19T02:15:55.496 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:55.496 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:15:55.496 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:55.496 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.496 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.496 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:636 5.5 5:a3139b12:::benchmark_data_smithi121_44835_object635:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:15:55.496 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:55.210727+0000", 2024-04-19T02:15:55.496 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.18898446499999999, 2024-04-19T02:15:55.496 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.010890276000000001, 2024-04-19T02:15:55.496 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:15:55.496 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:55.496 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:15:55.496 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:15:55.497 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:55.497 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 636 2024-04-19T02:15:55.497 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.497 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:15:55.497 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.497 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:15:55.497 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.210727+0000", 2024-04-19T02:15:55.497 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:55.497 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.497 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.497 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:15:55.497 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.210727+0000", 2024-04-19T02:15:55.497 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:55.497 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.497 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.497 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:15:55.498 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.210727+0000", 2024-04-19T02:15:55.498 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:55.498 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.498 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.498 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:15:55.498 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.210816+0000", 2024-04-19T02:15:55.498 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.9728999999999994e-05 2024-04-19T02:15:55.498 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.498 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.498 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:15:55.498 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.210824+0000", 2024-04-19T02:15:55.498 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.7309999999999993e-06 2024-04-19T02:15:55.498 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.498 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.499 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:15:55.499 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.210829+0000", 2024-04-19T02:15:55.499 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.7260000000000002e-06 2024-04-19T02:15:55.499 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.499 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.499 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:15:55.499 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.211285+0000", 2024-04-19T02:15:55.499 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00045644199999999999 2024-04-19T02:15:55.499 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.499 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.499 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:15:55.499 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.211374+0000", 2024-04-19T02:15:55.499 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.8145000000000004e-05 2024-04-19T02:15:55.499 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.499 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.500 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:15:55.500 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.211458+0000", 2024-04-19T02:15:55.500 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.4625999999999999e-05 2024-04-19T02:15:55.500 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.500 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.500 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:55.500 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.212253+0000", 2024-04-19T02:15:55.500 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00079523400000000002 2024-04-19T02:15:55.500 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.500 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.500 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:15:55.500 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.221544+0000", 2024-04-19T02:15:55.500 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0092904939999999998 2024-04-19T02:15:55.500 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.500 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.500 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:15:55.501 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.221586+0000", 2024-04-19T02:15:55.501 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.2085000000000001e-05 2024-04-19T02:15:55.501 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:55.501 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:55.501 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:15:55.501 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.221618+0000", 2024-04-19T02:15:55.501 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.1658000000000001e-05 2024-04-19T02:15:55.501 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:55.501 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:15:55.501 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:55.501 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:55.501 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:15:55.501 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-04-19T02:15:55.503 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:15:55.503+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:15:55.503 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:15:55.605 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:15:55.605+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:15:55.659 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:15:55.659 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:15:55.659 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.659 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:2288 5.1 5:856ac222:::benchmark_data_smithi121_44835_object2287:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:15:55.659 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:55.645410+0000", 2024-04-19T02:15:55.659 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.013807171, 2024-04-19T02:15:55.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013827845, 2024-04-19T02:15:55.660 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:15:55.660 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:15:55.660 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:15:55.660 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:15:55.660 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:55.660 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 2288 2024-04-19T02:15:55.660 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.660 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:15:55.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.660 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:15:55.660 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.645410+0000", 2024-04-19T02:15:55.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:55.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.661 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.661 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:15:55.661 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.645410+0000", 2024-04-19T02:15:55.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:55.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.661 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.661 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:15:55.661 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.645409+0000", 2024-04-19T02:15:55.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:55.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.661 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.662 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:15:55.662 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.645559+0000", 2024-04-19T02:15:55.662 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000149896 2024-04-19T02:15:55.662 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.662 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.662 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:15:55.662 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.645566+0000", 2024-04-19T02:15:55.662 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.024e-06 2024-04-19T02:15:55.662 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.662 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.662 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:15:55.662 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.645573+0000", 2024-04-19T02:15:55.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2870000000000001e-06 2024-04-19T02:15:55.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:55.663 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.649319+0000", 2024-04-19T02:15:55.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037463919999999999 2024-04-19T02:15:55.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:15:55.663 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.649417+0000", 2024-04-19T02:15:55.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7794999999999995e-05 2024-04-19T02:15:55.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.664 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.664 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:15:55.664 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.649545+0000", 2024-04-19T02:15:55.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012766399999999999 2024-04-19T02:15:55.664 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.664 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.664 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:55.664 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.651873+0000", 2024-04-19T02:15:55.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0023286090000000001 2024-04-19T02:15:55.664 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:55.664 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:15:55.664 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:55.664 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.665 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.665 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:2294 5.f 5:f1bdca10:::benchmark_data_smithi121_44835_object2293:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:15:55.665 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:55.645699+0000", 2024-04-19T02:15:55.665 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.013517695999999999, 2024-04-19T02:15:55.665 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013590174, 2024-04-19T02:15:55.665 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:15:55.665 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:15:55.665 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:15:55.665 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:15:55.665 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:55.665 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 2294 2024-04-19T02:15:55.665 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.665 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:15:55.665 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.666 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:15:55.666 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.645699+0000", 2024-04-19T02:15:55.666 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:55.666 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.666 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.666 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:15:55.666 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.645699+0000", 2024-04-19T02:15:55.666 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:55.666 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.666 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.666 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:15:55.666 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.645699+0000", 2024-04-19T02:15:55.667 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:55.667 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.667 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.667 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:15:55.667 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.645790+0000", 2024-04-19T02:15:55.667 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1139999999999998e-05 2024-04-19T02:15:55.667 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.667 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.667 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:15:55.667 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.645797+0000", 2024-04-19T02:15:55.667 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2749999999999998e-06 2024-04-19T02:15:55.667 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:15:55.668 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.645803+0000", 2024-04-19T02:15:55.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9109999999999998e-06 2024-04-19T02:15:55.668 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:55.668 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.645837+0000", 2024-04-19T02:15:55.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3469000000000001e-05 2024-04-19T02:15:55.668 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:15:55.668 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.645947+0000", 2024-04-19T02:15:55.669 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000110018 2024-04-19T02:15:55.669 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.669 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.669 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:15:55.669 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.646066+0000", 2024-04-19T02:15:55.669 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000118898 2024-04-19T02:15:55.669 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.669 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.669 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:55.669 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.651872+0000", 2024-04-19T02:15:55.669 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0058065510000000001 2024-04-19T02:15:55.669 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:55.669 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:15:55.670 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:55.670 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.670 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.670 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4549.0:2290 5.5 e18/16 5:a870a399:::benchmark_data_smithi121_44835_object2289:head v 18'147, mlcod=18'145)", 2024-04-19T02:15:55.670 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:55.645955+0000", 2024-04-19T02:15:55.670 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.013261769, 2024-04-19T02:15:55.670 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013377735999999999, 2024-04-19T02:15:55.670 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:15:55.670 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:15:55.670 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:15:55.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.671 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:15:55.671 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.645955+0000", 2024-04-19T02:15:55.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:55.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.671 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:15:55.671 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.645955+0000", 2024-04-19T02:15:55.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:55.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.671 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:15:55.671 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.645955+0000", 2024-04-19T02:15:55.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:55.672 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.672 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.672 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:15:55.672 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.646028+0000", 2024-04-19T02:15:55.672 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3250999999999994e-05 2024-04-19T02:15:55.672 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.672 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.672 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:15:55.672 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.646037+0000", 2024-04-19T02:15:55.672 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6780000000000006e-06 2024-04-19T02:15:55.672 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.672 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.672 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:15:55.673 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.646043+0000", 2024-04-19T02:15:55.673 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2029999999999997e-06 2024-04-19T02:15:55.673 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.673 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.673 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:55.673 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.649101+0000", 2024-04-19T02:15:55.673 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003058285 2024-04-19T02:15:55.673 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.673 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.673 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:15:55.673 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.649120+0000", 2024-04-19T02:15:55.673 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8822e-05 2024-04-19T02:15:55.674 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:55.674 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:15:55.674 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:55.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.674 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.674 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:2297 5.f 5:ffa08c3a:::benchmark_data_smithi121_44835_object2296:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:15:55.674 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:55.646941+0000", 2024-04-19T02:15:55.674 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.012275816, 2024-04-19T02:15:55.674 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012427241, 2024-04-19T02:15:55.674 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:15:55.675 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:15:55.675 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:15:55.675 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:15:55.675 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:55.675 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 2297 2024-04-19T02:15:55.675 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.675 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:15:55.675 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.675 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:15:55.675 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.646941+0000", 2024-04-19T02:15:55.675 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:55.675 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.676 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.676 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:15:55.676 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.646941+0000", 2024-04-19T02:15:55.676 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:55.676 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.676 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.676 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:15:55.676 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.646941+0000", 2024-04-19T02:15:55.676 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:55.676 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.676 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.676 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:15:55.677 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.647009+0000", 2024-04-19T02:15:55.677 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8819000000000006e-05 2024-04-19T02:15:55.677 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.677 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.677 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:15:55.677 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.647020+0000", 2024-04-19T02:15:55.677 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0567999999999999e-05 2024-04-19T02:15:55.677 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.677 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.677 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:15:55.677 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.647036+0000", 2024-04-19T02:15:55.677 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6432000000000001e-05 2024-04-19T02:15:55.678 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.678 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.678 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:55.678 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.649062+0000", 2024-04-19T02:15:55.678 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002025135 2024-04-19T02:15:55.678 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.678 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.678 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:15:55.678 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.649150+0000", 2024-04-19T02:15:55.678 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8459000000000001e-05 2024-04-19T02:15:55.678 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.678 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.679 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:15:55.679 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.649248+0000", 2024-04-19T02:15:55.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7888999999999997e-05 2024-04-19T02:15:55.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.679 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.679 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:55.679 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.651896+0000", 2024-04-19T02:15:55.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026482229999999999 2024-04-19T02:15:55.679 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:55.679 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:15:55.679 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:55.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.679 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.680 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4549.0:2296 5.5 e18/16 5:a5d39efa:::benchmark_data_smithi121_44835_object2295:head v 18'148, mlcod=18'145)", 2024-04-19T02:15:55.680 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:55.647052+0000", 2024-04-19T02:15:55.680 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.012165066, 2024-04-19T02:15:55.680 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012357669999999999, 2024-04-19T02:15:55.680 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:15:55.680 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:15:55.680 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:15:55.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.680 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:15:55.680 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.647052+0000", 2024-04-19T02:15:55.680 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:55.680 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.681 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.681 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:15:55.681 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.647052+0000", 2024-04-19T02:15:55.681 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:55.681 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.681 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.681 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:15:55.681 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.647051+0000", 2024-04-19T02:15:55.681 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:55.681 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.681 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.681 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:15:55.681 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.647104+0000", 2024-04-19T02:15:55.682 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2138000000000001e-05 2024-04-19T02:15:55.682 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.682 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.682 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:15:55.682 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.647116+0000", 2024-04-19T02:15:55.682 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2425999999999999e-05 2024-04-19T02:15:55.682 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.682 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.682 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:15:55.682 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.647123+0000", 2024-04-19T02:15:55.682 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5100000000000001e-06 2024-04-19T02:15:55.682 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.682 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.683 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:55.683 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.651744+0000", 2024-04-19T02:15:55.683 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0046207000000000002 2024-04-19T02:15:55.683 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.683 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.683 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:15:55.683 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.651765+0000", 2024-04-19T02:15:55.683 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0398999999999999e-05 2024-04-19T02:15:55.683 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:55.683 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:15:55.683 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:55.683 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.683 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.684 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4549.0:2298 5.5 e18/16 5:a533ec4e:::benchmark_data_smithi121_44835_object2297:head v 18'149, mlcod=18'145)", 2024-04-19T02:15:55.684 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:55.649854+0000", 2024-04-19T02:15:55.684 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0093634080000000001, 2024-04-19T02:15:55.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0095874329999999994, 2024-04-19T02:15:55.684 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:15:55.684 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:15:55.684 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:15:55.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.684 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:15:55.684 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.649854+0000", 2024-04-19T02:15:55.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:55.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:15:55.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.649854+0000", 2024-04-19T02:15:55.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:55.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:15:55.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.649853+0000", 2024-04-19T02:15:55.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:55.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:15:55.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.649923+0000", 2024-04-19T02:15:55.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9686999999999999e-05 2024-04-19T02:15:55.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:15:55.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.649934+0000", 2024-04-19T02:15:55.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.118e-05 2024-04-19T02:15:55.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:15:55.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.649941+0000", 2024-04-19T02:15:55.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5320000000000003e-06 2024-04-19T02:15:55.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.687 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.687 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:55.687 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.654478+0000", 2024-04-19T02:15:55.687 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045373560000000002 2024-04-19T02:15:55.687 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.687 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.687 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:15:55.687 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.654498+0000", 2024-04-19T02:15:55.687 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0100999999999999e-05 2024-04-19T02:15:55.687 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:55.687 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:15:55.687 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:55.688 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.688 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.688 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:2300 5.d 5:b128803b:::benchmark_data_smithi121_44835_object2299:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:15:55.688 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:55.649935+0000", 2024-04-19T02:15:55.688 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0092824210000000008, 2024-04-19T02:15:55.688 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0095590169999999995, 2024-04-19T02:15:55.688 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:15:55.688 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:15:55.688 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:15:55.688 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:15:55.688 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:55.688 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 2300 2024-04-19T02:15:55.689 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.689 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:15:55.689 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.689 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:15:55.689 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.649935+0000", 2024-04-19T02:15:55.689 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:55.689 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.689 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.689 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:15:55.689 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.649935+0000", 2024-04-19T02:15:55.689 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:55.689 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.690 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.690 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:15:55.690 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.649934+0000", 2024-04-19T02:15:55.690 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:55.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.690 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.690 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:15:55.690 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.650077+0000", 2024-04-19T02:15:55.690 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014281999999999999 2024-04-19T02:15:55.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.690 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.690 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:15:55.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.650084+0000", 2024-04-19T02:15:55.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9160000000000004e-06 2024-04-19T02:15:55.691 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.691 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.691 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:15:55.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.650088+0000", 2024-04-19T02:15:55.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1749999999999998e-06 2024-04-19T02:15:55.691 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.691 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.691 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:55.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.654466+0000", 2024-04-19T02:15:55.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0043775840000000003 2024-04-19T02:15:55.692 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.692 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.692 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:15:55.692 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.654565+0000", 2024-04-19T02:15:55.692 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9792999999999998e-05 2024-04-19T02:15:55.692 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.692 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.692 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:15:55.692 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.654662+0000", 2024-04-19T02:15:55.692 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6403000000000005e-05 2024-04-19T02:15:55.692 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:55.693 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:15:55.693 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:55.693 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.693 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.693 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:2302 5.7 5:e5029409:::benchmark_data_smithi121_44835_object2301:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:15:55.693 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:55.652275+0000", 2024-04-19T02:15:55.693 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0069419620000000003, 2024-04-19T02:15:55.693 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0072651770000000003, 2024-04-19T02:15:55.693 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:15:55.693 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:15:55.693 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:15:55.693 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:15:55.693 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:55.694 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 2302 2024-04-19T02:15:55.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.694 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:15:55.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:15:55.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.652275+0000", 2024-04-19T02:15:55.694 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:55.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:15:55.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.652275+0000", 2024-04-19T02:15:55.694 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:55.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.695 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.695 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:15:55.695 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.652275+0000", 2024-04-19T02:15:55.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:55.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.695 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.695 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:15:55.695 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.652334+0000", 2024-04-19T02:15:55.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9191000000000003e-05 2024-04-19T02:15:55.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.696 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.696 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:15:55.696 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.652343+0000", 2024-04-19T02:15:55.696 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1349999999999998e-06 2024-04-19T02:15:55.696 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.696 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.696 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:15:55.696 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.652348+0000", 2024-04-19T02:15:55.696 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.49e-06 2024-04-19T02:15:55.696 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.696 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.696 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:55.697 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.652384+0000", 2024-04-19T02:15:55.697 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5673000000000002e-05 2024-04-19T02:15:55.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.697 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:15:55.697 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.652508+0000", 2024-04-19T02:15:55.697 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000123626 2024-04-19T02:15:55.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.697 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:15:55.697 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.652648+0000", 2024-04-19T02:15:55.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014083999999999999 2024-04-19T02:15:55.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.698 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:55.698 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.655621+0000", 2024-04-19T02:15:55.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0029723689999999999 2024-04-19T02:15:55.698 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:55.698 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:15:55.698 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:55.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.698 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:2304 5.d 5.447e66fd (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:15:55.699 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:55.653828+0000", 2024-04-19T02:15:55.699 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0053889669999999997, 2024-04-19T02:15:55.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0057829930000000002, 2024-04-19T02:15:55.699 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:15:55.699 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-04-19T02:15:55.699 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:15:55.699 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:15:55.699 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:55.699 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 2304 2024-04-19T02:15:55.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.699 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:15:55.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:15:55.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.653828+0000", 2024-04-19T02:15:55.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:55.700 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.700 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:15:55.700 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.653828+0000", 2024-04-19T02:15:55.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:55.700 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.700 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:15:55.700 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.653828+0000", 2024-04-19T02:15:55.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:55.700 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.700 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:15:55.701 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.653889+0000", 2024-04-19T02:15:55.701 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0962999999999999e-05 2024-04-19T02:15:55.701 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.701 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.701 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:15:55.701 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.653898+0000", 2024-04-19T02:15:55.701 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0450000000000006e-06 2024-04-19T02:15:55.701 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.701 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.701 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:15:55.701 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.653902+0000", 2024-04-19T02:15:55.701 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4009999999999999e-06 2024-04-19T02:15:55.701 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:55.701 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:15:55.702 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:55.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.702 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4549.0:2303 5.6 e18/16 5:6c4e0318:::benchmark_data_smithi121_44835_object2302:head v 18'171, mlcod=18'169)", 2024-04-19T02:15:55.702 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:55.654163+0000", 2024-04-19T02:15:55.702 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0050542800000000004, 2024-04-19T02:15:55.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0054869630000000001, 2024-04-19T02:15:55.702 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:15:55.702 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:15:55.702 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:15:55.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.702 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:15:55.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.654163+0000", 2024-04-19T02:15:55.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:55.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.703 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:15:55.703 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.654163+0000", 2024-04-19T02:15:55.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:55.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.703 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:15:55.703 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.654162+0000", 2024-04-19T02:15:55.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:55.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:15:55.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.654231+0000", 2024-04-19T02:15:55.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9014e-05 2024-04-19T02:15:55.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:15:55.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.654242+0000", 2024-04-19T02:15:55.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1182999999999999e-05 2024-04-19T02:15:55.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:15:55.705 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.654263+0000", 2024-04-19T02:15:55.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0747999999999999e-05 2024-04-19T02:15:55.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.705 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:55.705 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.654285+0000", 2024-04-19T02:15:55.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2053999999999999e-05 2024-04-19T02:15:55.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.705 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:15:55.705 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.654304+0000", 2024-04-19T02:15:55.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8773000000000001e-05 2024-04-19T02:15:55.706 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:55.706 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:15:55.706 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:55.706 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.706 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4549.0:2300 5.d e18/16)", 2024-04-19T02:15:55.706 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:55.655708+0000", 2024-04-19T02:15:55.706 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.003509201, 2024-04-19T02:15:55.706 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039748989999999996, 2024-04-19T02:15:55.706 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:15:55.706 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-04-19T02:15:55.706 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:15:55.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:15:55.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.655708+0000", 2024-04-19T02:15:55.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:55.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:15:55.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.655708+0000", 2024-04-19T02:15:55.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:55.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:15:55.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.655707+0000", 2024-04-19T02:15:55.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:55.708 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:15:55.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.655711+0000", 2024-04-19T02:15:55.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9219999999999999e-06 2024-04-19T02:15:55.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.709 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:15:55.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.655721+0000", 2024-04-19T02:15:55.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5980000000000003e-06 2024-04-19T02:15:55.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.709 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:15:55.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.655726+0000", 2024-04-19T02:15:55.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3210000000000004e-06 2024-04-19T02:15:55.710 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:55.710 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:15:55.710 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:55.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.710 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:2305 5.f 5:fa58dff4:::benchmark_data_smithi121_44835_object2304:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:15:55.710 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:55.657507+0000", 2024-04-19T02:15:55.710 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.001710512, 2024-04-19T02:15:55.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022087410000000002, 2024-04-19T02:15:55.710 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:15:55.710 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:15:55.710 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:15:55.711 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:15:55.711 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:55.711 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 2305 2024-04-19T02:15:55.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.711 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:15:55.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.711 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:15:55.711 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.657507+0000", 2024-04-19T02:15:55.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:55.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:15:55.712 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.657507+0000", 2024-04-19T02:15:55.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:55.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:15:55.712 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.657506+0000", 2024-04-19T02:15:55.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:15:55.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:15:55.712 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.657602+0000", 2024-04-19T02:15:55.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5906e-05 2024-04-19T02:15:55.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:15:55.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.657613+0000", 2024-04-19T02:15:55.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.113e-05 2024-04-19T02:15:55.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:15:55.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.657619+0000", 2024-04-19T02:15:55.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.711e-06 2024-04-19T02:15:55.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:55.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.657647+0000", 2024-04-19T02:15:55.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8393000000000001e-05 2024-04-19T02:15:55.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.714 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:15:55.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.657722+0000", 2024-04-19T02:15:55.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5264000000000003e-05 2024-04-19T02:15:55.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.714 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:15:55.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.657800+0000", 2024-04-19T02:15:55.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7649000000000001e-05 2024-04-19T02:15:55.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.715 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:55.715 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.659634+0000", 2024-04-19T02:15:55.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001833922 2024-04-19T02:15:55.715 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:55.715 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:15:55.715 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:55.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.715 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:2310 5.1 5:8e43a152:::benchmark_data_smithi121_44835_object2309:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:15:55.715 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:55.659651+0000", 2024-04-19T02:15:55.716 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9995656, 2024-04-19T02:15:55.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013080899999999999, 2024-04-19T02:15:55.716 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:15:55.716 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-04-19T02:15:55.716 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:15:55.716 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:15:55.716 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:55.716 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 2310 2024-04-19T02:15:55.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.716 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:15:55.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.716 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:15:55.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.659651+0000", 2024-04-19T02:15:55.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:55.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:15:55.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.659651+0000", 2024-04-19T02:15:55.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:55.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:15:55.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.659651+0000", 2024-04-19T02:15:55.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:15:55.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:15:55.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.659698+0000", 2024-04-19T02:15:55.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7624999999999999e-05 2024-04-19T02:15:55.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:15:55.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.659708+0000", 2024-04-19T02:15:55.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8190000000000003e-06 2024-04-19T02:15:55.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:15:55.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.659718+0000", 2024-04-19T02:15:55.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4099999999999997e-06 2024-04-19T02:15:55.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:55.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.659756+0000", 2024-04-19T02:15:55.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8868999999999997e-05 2024-04-19T02:15:55.719 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:55.719 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:15:55.719 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:55.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.720 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:2285 5.d 5:b310a433:::benchmark_data_smithi121_44835_object2284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:15:55.720 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:55.643557+0000", 2024-04-19T02:15:55.720 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.015660476999999999, 2024-04-19T02:15:55.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016263587999999999, 2024-04-19T02:15:55.720 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:15:55.720 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:15:55.720 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:15:55.720 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:15:55.720 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:55.720 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 2285 2024-04-19T02:15:55.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.721 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:15:55.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.721 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:15:55.721 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643557+0000", 2024-04-19T02:15:55.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:55.721 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.721 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:15:55.721 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643557+0000", 2024-04-19T02:15:55.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:55.721 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:15:55.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643556+0000", 2024-04-19T02:15:55.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:55.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:15:55.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643625+0000", 2024-04-19T02:15:55.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9393000000000005e-05 2024-04-19T02:15:55.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:15:55.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643634+0000", 2024-04-19T02:15:55.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.14e-06 2024-04-19T02:15:55.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:15:55.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643640+0000", 2024-04-19T02:15:55.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.601e-06 2024-04-19T02:15:55.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:55.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643669+0000", 2024-04-19T02:15:55.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9292999999999999e-05 2024-04-19T02:15:55.724 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.724 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.724 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:15:55.724 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643760+0000", 2024-04-19T02:15:55.724 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0526999999999996e-05 2024-04-19T02:15:55.724 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.724 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.724 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:15:55.724 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643892+0000", 2024-04-19T02:15:55.724 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000131607 2024-04-19T02:15:55.724 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:55.724 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:55.724 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:55.725 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.649122+0000", 2024-04-19T02:15:55.725 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052308279999999999 2024-04-19T02:15:55.725 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:55.725 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:15:55.725 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:55.725 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:55.725 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-04-19T02:15:55.725 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 14 2024-04-19T02:15:55.725 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:15:55.727 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:15:55.728 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:15:55.728+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:15:55.821 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --admin-daemon /var/run/ceph/ceph-client.0.asok objecter_requests 2024-04-19T02:15:55.827 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:15:55.828+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:15:55.926 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:15:55.927 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-04-19T02:15:55.927 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-04-19T02:15:55.927 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-04-19T02:15:55.927 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:15:55.928 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:15:55.928+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:15:55.941 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:15:55.949 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-04-19T02:15:55.949 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [ 2024-04-19T02:15:55.949 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:15:55.949 INFO:teuthology.orchestra.run.smithi121.stdout: "tid": 3369, 2024-04-19T02:15:55.949 INFO:teuthology.orchestra.run.smithi121.stdout: "pg": "5.1c7a5e9f", 2024-04-19T02:15:55.949 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": 0, 2024-04-19T02:15:55.949 INFO:teuthology.orchestra.run.smithi121.stdout: "object_id": "benchmark_data_smithi121_44835_object3368", 2024-04-19T02:15:55.949 INFO:teuthology.orchestra.run.smithi121.stdout: "object_locator": "@5", 2024-04-19T02:15:55.949 INFO:teuthology.orchestra.run.smithi121.stdout: "target_object_id": "benchmark_data_smithi121_44835_object3368", 2024-04-19T02:15:55.949 INFO:teuthology.orchestra.run.smithi121.stdout: "target_object_locator": "@5", 2024-04-19T02:15:55.949 INFO:teuthology.orchestra.run.smithi121.stdout: "paused": 0, 2024-04-19T02:15:55.949 INFO:teuthology.orchestra.run.smithi121.stdout: "used_replica": 0, 2024-04-19T02:15:55.950 INFO:teuthology.orchestra.run.smithi121.stdout: "precalc_pgid": 0, 2024-04-19T02:15:55.950 INFO:teuthology.orchestra.run.smithi121.stdout: "last_sent": "621.348883s", 2024-04-19T02:15:55.950 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.0019999739999999998, 2024-04-19T02:15:55.950 INFO:teuthology.orchestra.run.smithi121.stdout: "attempts": 1, 2024-04-19T02:15:55.950 INFO:teuthology.orchestra.run.smithi121.stdout: "snapid": "head", 2024-04-19T02:15:55.950 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_context": "0=[]", 2024-04-19T02:15:55.950 INFO:teuthology.orchestra.run.smithi121.stdout: "mtime": "2024-04-19T02:15:55.947823+0000", 2024-04-19T02:15:55.950 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_ops": [ 2024-04-19T02:15:55.950 INFO:teuthology.orchestra.run.smithi121.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-19T02:15:55.950 INFO:teuthology.orchestra.run.smithi121.stdout: "write 0~65536 in=65536b" 2024-04-19T02:15:55.950 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:15:55.950 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:55.950 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:15:55.950 INFO:teuthology.orchestra.run.smithi121.stdout: "tid": 3370, 2024-04-19T02:15:55.951 INFO:teuthology.orchestra.run.smithi121.stdout: "pg": "5.23ef4fef", 2024-04-19T02:15:55.951 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": 0, 2024-04-19T02:15:55.951 INFO:teuthology.orchestra.run.smithi121.stdout: "object_id": "benchmark_data_smithi121_44835_object3369", 2024-04-19T02:15:55.951 INFO:teuthology.orchestra.run.smithi121.stdout: "object_locator": "@5", 2024-04-19T02:15:55.951 INFO:teuthology.orchestra.run.smithi121.stdout: "target_object_id": "benchmark_data_smithi121_44835_object3369", 2024-04-19T02:15:55.951 INFO:teuthology.orchestra.run.smithi121.stdout: "target_object_locator": "@5", 2024-04-19T02:15:55.951 INFO:teuthology.orchestra.run.smithi121.stdout: "paused": 0, 2024-04-19T02:15:55.951 INFO:teuthology.orchestra.run.smithi121.stdout: "used_replica": 0, 2024-04-19T02:15:55.951 INFO:teuthology.orchestra.run.smithi121.stdout: "precalc_pgid": 0, 2024-04-19T02:15:55.951 INFO:teuthology.orchestra.run.smithi121.stdout: "last_sent": "621.348883s", 2024-04-19T02:15:55.951 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.0019999739999999998, 2024-04-19T02:15:55.951 INFO:teuthology.orchestra.run.smithi121.stdout: "attempts": 1, 2024-04-19T02:15:55.952 INFO:teuthology.orchestra.run.smithi121.stdout: "snapid": "head", 2024-04-19T02:15:55.952 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_context": "0=[]", 2024-04-19T02:15:55.952 INFO:teuthology.orchestra.run.smithi121.stdout: "mtime": "2024-04-19T02:15:55.947843+0000", 2024-04-19T02:15:55.952 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_ops": [ 2024-04-19T02:15:55.952 INFO:teuthology.orchestra.run.smithi121.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-19T02:15:55.952 INFO:teuthology.orchestra.run.smithi121.stdout: "write 0~65536 in=65536b" 2024-04-19T02:15:55.952 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:15:55.952 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:55.952 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:15:55.952 INFO:teuthology.orchestra.run.smithi121.stdout: "tid": 3374, 2024-04-19T02:15:55.952 INFO:teuthology.orchestra.run.smithi121.stdout: "pg": "5.48537351", 2024-04-19T02:15:55.952 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": 0, 2024-04-19T02:15:55.953 INFO:teuthology.orchestra.run.smithi121.stdout: "object_id": "benchmark_data_smithi121_44835_object3373", 2024-04-19T02:15:55.953 INFO:teuthology.orchestra.run.smithi121.stdout: "object_locator": "@5", 2024-04-19T02:15:55.953 INFO:teuthology.orchestra.run.smithi121.stdout: "target_object_id": "benchmark_data_smithi121_44835_object3373", 2024-04-19T02:15:55.953 INFO:teuthology.orchestra.run.smithi121.stdout: "target_object_locator": "@5", 2024-04-19T02:15:55.953 INFO:teuthology.orchestra.run.smithi121.stdout: "paused": 0, 2024-04-19T02:15:55.953 INFO:teuthology.orchestra.run.smithi121.stdout: "used_replica": 0, 2024-04-19T02:15:55.953 INFO:teuthology.orchestra.run.smithi121.stdout: "precalc_pgid": 0, 2024-04-19T02:15:55.953 INFO:teuthology.orchestra.run.smithi121.stdout: "last_sent": "621.348883s", 2024-04-19T02:15:55.953 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.0019999739999999998, 2024-04-19T02:15:55.953 INFO:teuthology.orchestra.run.smithi121.stdout: "attempts": 1, 2024-04-19T02:15:55.953 INFO:teuthology.orchestra.run.smithi121.stdout: "snapid": "head", 2024-04-19T02:15:55.953 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_context": "0=[]", 2024-04-19T02:15:55.953 INFO:teuthology.orchestra.run.smithi121.stdout: "mtime": "2024-04-19T02:15:55.947970+0000", 2024-04-19T02:15:55.953 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_ops": [ 2024-04-19T02:15:55.953 INFO:teuthology.orchestra.run.smithi121.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-19T02:15:55.954 INFO:teuthology.orchestra.run.smithi121.stdout: "write 0~65536 in=65536b" 2024-04-19T02:15:55.954 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:15:55.954 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:55.954 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:15:55.954 INFO:teuthology.orchestra.run.smithi121.stdout: "tid": 3376, 2024-04-19T02:15:55.954 INFO:teuthology.orchestra.run.smithi121.stdout: "pg": "5.77381822", 2024-04-19T02:15:55.954 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": 0, 2024-04-19T02:15:55.954 INFO:teuthology.orchestra.run.smithi121.stdout: "object_id": "benchmark_data_smithi121_44835_object3375", 2024-04-19T02:15:55.954 INFO:teuthology.orchestra.run.smithi121.stdout: "object_locator": "@5", 2024-04-19T02:15:55.954 INFO:teuthology.orchestra.run.smithi121.stdout: "target_object_id": "benchmark_data_smithi121_44835_object3375", 2024-04-19T02:15:55.954 INFO:teuthology.orchestra.run.smithi121.stdout: "target_object_locator": "@5", 2024-04-19T02:15:55.954 INFO:teuthology.orchestra.run.smithi121.stdout: "paused": 0, 2024-04-19T02:15:55.955 INFO:teuthology.orchestra.run.smithi121.stdout: "used_replica": 0, 2024-04-19T02:15:55.955 INFO:teuthology.orchestra.run.smithi121.stdout: "precalc_pgid": 0, 2024-04-19T02:15:55.955 INFO:teuthology.orchestra.run.smithi121.stdout: "last_sent": "621.348883s", 2024-04-19T02:15:55.955 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.0019999739999999998, 2024-04-19T02:15:55.955 INFO:teuthology.orchestra.run.smithi121.stdout: "attempts": 1, 2024-04-19T02:15:55.955 INFO:teuthology.orchestra.run.smithi121.stdout: "snapid": "head", 2024-04-19T02:15:55.955 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_context": "0=[]", 2024-04-19T02:15:55.955 INFO:teuthology.orchestra.run.smithi121.stdout: "mtime": "2024-04-19T02:15:55.948056+0000", 2024-04-19T02:15:55.955 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_ops": [ 2024-04-19T02:15:55.955 INFO:teuthology.orchestra.run.smithi121.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-19T02:15:55.955 INFO:teuthology.orchestra.run.smithi121.stdout: "write 0~65536 in=65536b" 2024-04-19T02:15:55.955 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:15:55.955 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:55.955 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:15:55.955 INFO:teuthology.orchestra.run.smithi121.stdout: "tid": 3377, 2024-04-19T02:15:55.956 INFO:teuthology.orchestra.run.smithi121.stdout: "pg": "5.7684572f", 2024-04-19T02:15:55.956 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": 0, 2024-04-19T02:15:55.956 INFO:teuthology.orchestra.run.smithi121.stdout: "object_id": "benchmark_data_smithi121_44835_object3376", 2024-04-19T02:15:55.956 INFO:teuthology.orchestra.run.smithi121.stdout: "object_locator": "@5", 2024-04-19T02:15:55.956 INFO:teuthology.orchestra.run.smithi121.stdout: "target_object_id": "benchmark_data_smithi121_44835_object3376", 2024-04-19T02:15:55.956 INFO:teuthology.orchestra.run.smithi121.stdout: "target_object_locator": "@5", 2024-04-19T02:15:55.956 INFO:teuthology.orchestra.run.smithi121.stdout: "paused": 0, 2024-04-19T02:15:55.956 INFO:teuthology.orchestra.run.smithi121.stdout: "used_replica": 0, 2024-04-19T02:15:55.956 INFO:teuthology.orchestra.run.smithi121.stdout: "precalc_pgid": 0, 2024-04-19T02:15:55.956 INFO:teuthology.orchestra.run.smithi121.stdout: "last_sent": "621.348883s", 2024-04-19T02:15:55.956 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.0019999739999999998, 2024-04-19T02:15:55.956 INFO:teuthology.orchestra.run.smithi121.stdout: "attempts": 1, 2024-04-19T02:15:55.956 INFO:teuthology.orchestra.run.smithi121.stdout: "snapid": "head", 2024-04-19T02:15:55.956 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_context": "0=[]", 2024-04-19T02:15:55.956 INFO:teuthology.orchestra.run.smithi121.stdout: "mtime": "2024-04-19T02:15:55.948076+0000", 2024-04-19T02:15:55.957 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_ops": [ 2024-04-19T02:15:55.957 INFO:teuthology.orchestra.run.smithi121.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-19T02:15:55.957 INFO:teuthology.orchestra.run.smithi121.stdout: "write 0~65536 in=65536b" 2024-04-19T02:15:55.957 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:15:55.957 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:55.957 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:15:55.957 INFO:teuthology.orchestra.run.smithi121.stdout: "tid": 3379, 2024-04-19T02:15:55.957 INFO:teuthology.orchestra.run.smithi121.stdout: "pg": "5.ea936ae1", 2024-04-19T02:15:55.957 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": 0, 2024-04-19T02:15:55.957 INFO:teuthology.orchestra.run.smithi121.stdout: "object_id": "benchmark_data_smithi121_44835_object3378", 2024-04-19T02:15:55.957 INFO:teuthology.orchestra.run.smithi121.stdout: "object_locator": "@5", 2024-04-19T02:15:55.957 INFO:teuthology.orchestra.run.smithi121.stdout: "target_object_id": "benchmark_data_smithi121_44835_object3378", 2024-04-19T02:15:55.957 INFO:teuthology.orchestra.run.smithi121.stdout: "target_object_locator": "@5", 2024-04-19T02:15:55.957 INFO:teuthology.orchestra.run.smithi121.stdout: "paused": 0, 2024-04-19T02:15:55.958 INFO:teuthology.orchestra.run.smithi121.stdout: "used_replica": 0, 2024-04-19T02:15:55.958 INFO:teuthology.orchestra.run.smithi121.stdout: "precalc_pgid": 0, 2024-04-19T02:15:55.958 INFO:teuthology.orchestra.run.smithi121.stdout: "last_sent": "621.348883s", 2024-04-19T02:15:55.958 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.0019999739999999998, 2024-04-19T02:15:55.958 INFO:teuthology.orchestra.run.smithi121.stdout: "attempts": 1, 2024-04-19T02:15:55.958 INFO:teuthology.orchestra.run.smithi121.stdout: "snapid": "head", 2024-04-19T02:15:55.958 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_context": "0=[]", 2024-04-19T02:15:55.958 INFO:teuthology.orchestra.run.smithi121.stdout: "mtime": "2024-04-19T02:15:55.948112+0000", 2024-04-19T02:15:55.958 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_ops": [ 2024-04-19T02:15:55.958 INFO:teuthology.orchestra.run.smithi121.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-19T02:15:55.958 INFO:teuthology.orchestra.run.smithi121.stdout: "write 0~65536 in=65536b" 2024-04-19T02:15:55.958 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:15:55.958 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:55.959 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:15:55.959 INFO:teuthology.orchestra.run.smithi121.stdout: "tid": 3381, 2024-04-19T02:15:55.959 INFO:teuthology.orchestra.run.smithi121.stdout: "pg": "5.345ee971", 2024-04-19T02:15:55.959 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": 0, 2024-04-19T02:15:55.959 INFO:teuthology.orchestra.run.smithi121.stdout: "object_id": "benchmark_data_smithi121_44835_object3380", 2024-04-19T02:15:55.959 INFO:teuthology.orchestra.run.smithi121.stdout: "object_locator": "@5", 2024-04-19T02:15:55.959 INFO:teuthology.orchestra.run.smithi121.stdout: "target_object_id": "benchmark_data_smithi121_44835_object3380", 2024-04-19T02:15:55.959 INFO:teuthology.orchestra.run.smithi121.stdout: "target_object_locator": "@5", 2024-04-19T02:15:55.959 INFO:teuthology.orchestra.run.smithi121.stdout: "paused": 0, 2024-04-19T02:15:55.959 INFO:teuthology.orchestra.run.smithi121.stdout: "used_replica": 0, 2024-04-19T02:15:55.959 INFO:teuthology.orchestra.run.smithi121.stdout: "precalc_pgid": 0, 2024-04-19T02:15:55.959 INFO:teuthology.orchestra.run.smithi121.stdout: "last_sent": "621.349883s", 2024-04-19T02:15:55.959 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.00099998699999999992, 2024-04-19T02:15:55.959 INFO:teuthology.orchestra.run.smithi121.stdout: "attempts": 1, 2024-04-19T02:15:55.960 INFO:teuthology.orchestra.run.smithi121.stdout: "snapid": "head", 2024-04-19T02:15:55.960 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_context": "0=[]", 2024-04-19T02:15:55.960 INFO:teuthology.orchestra.run.smithi121.stdout: "mtime": "2024-04-19T02:15:55.948423+0000", 2024-04-19T02:15:55.960 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_ops": [ 2024-04-19T02:15:55.960 INFO:teuthology.orchestra.run.smithi121.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-19T02:15:55.960 INFO:teuthology.orchestra.run.smithi121.stdout: "write 0~65536 in=65536b" 2024-04-19T02:15:55.960 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:15:55.960 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:55.960 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:15:55.960 INFO:teuthology.orchestra.run.smithi121.stdout: "tid": 3382, 2024-04-19T02:15:55.960 INFO:teuthology.orchestra.run.smithi121.stdout: "pg": "5.34511529", 2024-04-19T02:15:55.960 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": 0, 2024-04-19T02:15:55.960 INFO:teuthology.orchestra.run.smithi121.stdout: "object_id": "benchmark_data_smithi121_44835_object3381", 2024-04-19T02:15:55.961 INFO:teuthology.orchestra.run.smithi121.stdout: "object_locator": "@5", 2024-04-19T02:15:55.961 INFO:teuthology.orchestra.run.smithi121.stdout: "target_object_id": "benchmark_data_smithi121_44835_object3381", 2024-04-19T02:15:55.961 INFO:teuthology.orchestra.run.smithi121.stdout: "target_object_locator": "@5", 2024-04-19T02:15:55.961 INFO:teuthology.orchestra.run.smithi121.stdout: "paused": 0, 2024-04-19T02:15:55.961 INFO:teuthology.orchestra.run.smithi121.stdout: "used_replica": 0, 2024-04-19T02:15:55.961 INFO:teuthology.orchestra.run.smithi121.stdout: "precalc_pgid": 0, 2024-04-19T02:15:55.961 INFO:teuthology.orchestra.run.smithi121.stdout: "last_sent": "621.349883s", 2024-04-19T02:15:55.961 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.00099998699999999992, 2024-04-19T02:15:55.961 INFO:teuthology.orchestra.run.smithi121.stdout: "attempts": 1, 2024-04-19T02:15:55.961 INFO:teuthology.orchestra.run.smithi121.stdout: "snapid": "head", 2024-04-19T02:15:55.961 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_context": "0=[]", 2024-04-19T02:15:55.961 INFO:teuthology.orchestra.run.smithi121.stdout: "mtime": "2024-04-19T02:15:55.948432+0000", 2024-04-19T02:15:55.961 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_ops": [ 2024-04-19T02:15:55.961 INFO:teuthology.orchestra.run.smithi121.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-19T02:15:55.961 INFO:teuthology.orchestra.run.smithi121.stdout: "write 0~65536 in=65536b" 2024-04-19T02:15:55.962 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:15:55.962 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:55.962 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:15:55.962 INFO:teuthology.orchestra.run.smithi121.stdout: "tid": 3383, 2024-04-19T02:15:55.962 INFO:teuthology.orchestra.run.smithi121.stdout: "pg": "5.ab140f4f", 2024-04-19T02:15:55.962 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": 0, 2024-04-19T02:15:55.962 INFO:teuthology.orchestra.run.smithi121.stdout: "object_id": "benchmark_data_smithi121_44835_object3382", 2024-04-19T02:15:55.962 INFO:teuthology.orchestra.run.smithi121.stdout: "object_locator": "@5", 2024-04-19T02:15:55.962 INFO:teuthology.orchestra.run.smithi121.stdout: "target_object_id": "benchmark_data_smithi121_44835_object3382", 2024-04-19T02:15:55.962 INFO:teuthology.orchestra.run.smithi121.stdout: "target_object_locator": "@5", 2024-04-19T02:15:55.962 INFO:teuthology.orchestra.run.smithi121.stdout: "paused": 0, 2024-04-19T02:15:55.962 INFO:teuthology.orchestra.run.smithi121.stdout: "used_replica": 0, 2024-04-19T02:15:55.962 INFO:teuthology.orchestra.run.smithi121.stdout: "precalc_pgid": 0, 2024-04-19T02:15:55.962 INFO:teuthology.orchestra.run.smithi121.stdout: "last_sent": "621.349883s", 2024-04-19T02:15:55.963 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.00099998699999999992, 2024-04-19T02:15:55.963 INFO:teuthology.orchestra.run.smithi121.stdout: "attempts": 1, 2024-04-19T02:15:55.963 INFO:teuthology.orchestra.run.smithi121.stdout: "snapid": "head", 2024-04-19T02:15:55.963 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_context": "0=[]", 2024-04-19T02:15:55.963 INFO:teuthology.orchestra.run.smithi121.stdout: "mtime": "2024-04-19T02:15:55.948931+0000", 2024-04-19T02:15:55.963 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_ops": [ 2024-04-19T02:15:55.963 INFO:teuthology.orchestra.run.smithi121.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-19T02:15:55.963 INFO:teuthology.orchestra.run.smithi121.stdout: "write 0~65536 in=65536b" 2024-04-19T02:15:55.963 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:15:55.963 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:55.963 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:15:55.963 INFO:teuthology.orchestra.run.smithi121.stdout: "tid": 3384, 2024-04-19T02:15:55.963 INFO:teuthology.orchestra.run.smithi121.stdout: "pg": "5.d672bd9f", 2024-04-19T02:15:55.963 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": 0, 2024-04-19T02:15:55.963 INFO:teuthology.orchestra.run.smithi121.stdout: "object_id": "benchmark_data_smithi121_44835_object3383", 2024-04-19T02:15:55.963 INFO:teuthology.orchestra.run.smithi121.stdout: "object_locator": "@5", 2024-04-19T02:15:55.964 INFO:teuthology.orchestra.run.smithi121.stdout: "target_object_id": "benchmark_data_smithi121_44835_object3383", 2024-04-19T02:15:55.964 INFO:teuthology.orchestra.run.smithi121.stdout: "target_object_locator": "@5", 2024-04-19T02:15:55.964 INFO:teuthology.orchestra.run.smithi121.stdout: "paused": 0, 2024-04-19T02:15:55.964 INFO:teuthology.orchestra.run.smithi121.stdout: "used_replica": 0, 2024-04-19T02:15:55.964 INFO:teuthology.orchestra.run.smithi121.stdout: "precalc_pgid": 0, 2024-04-19T02:15:55.964 INFO:teuthology.orchestra.run.smithi121.stdout: "last_sent": "621.350883s", 2024-04-19T02:15:55.964 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0, 2024-04-19T02:15:55.964 INFO:teuthology.orchestra.run.smithi121.stdout: "attempts": 1, 2024-04-19T02:15:55.964 INFO:teuthology.orchestra.run.smithi121.stdout: "snapid": "head", 2024-04-19T02:15:55.964 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_context": "0=[]", 2024-04-19T02:15:55.964 INFO:teuthology.orchestra.run.smithi121.stdout: "mtime": "2024-04-19T02:15:55.949918+0000", 2024-04-19T02:15:55.964 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_ops": [ 2024-04-19T02:15:55.964 INFO:teuthology.orchestra.run.smithi121.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-19T02:15:55.964 INFO:teuthology.orchestra.run.smithi121.stdout: "write 0~65536 in=65536b" 2024-04-19T02:15:55.965 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:15:55.965 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:55.965 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:15:55.965 INFO:teuthology.orchestra.run.smithi121.stdout: "tid": 3371, 2024-04-19T02:15:55.965 INFO:teuthology.orchestra.run.smithi121.stdout: "pg": "5.e2451a9c", 2024-04-19T02:15:55.965 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": 2, 2024-04-19T02:15:55.965 INFO:teuthology.orchestra.run.smithi121.stdout: "object_id": "benchmark_data_smithi121_44835_object3370", 2024-04-19T02:15:55.965 INFO:teuthology.orchestra.run.smithi121.stdout: "object_locator": "@5", 2024-04-19T02:15:55.965 INFO:teuthology.orchestra.run.smithi121.stdout: "target_object_id": "benchmark_data_smithi121_44835_object3370", 2024-04-19T02:15:55.965 INFO:teuthology.orchestra.run.smithi121.stdout: "target_object_locator": "@5", 2024-04-19T02:15:55.965 INFO:teuthology.orchestra.run.smithi121.stdout: "paused": 0, 2024-04-19T02:15:55.965 INFO:teuthology.orchestra.run.smithi121.stdout: "used_replica": 0, 2024-04-19T02:15:55.965 INFO:teuthology.orchestra.run.smithi121.stdout: "precalc_pgid": 0, 2024-04-19T02:15:55.965 INFO:teuthology.orchestra.run.smithi121.stdout: "last_sent": "621.348883s", 2024-04-19T02:15:55.965 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.0019999739999999998, 2024-04-19T02:15:55.966 INFO:teuthology.orchestra.run.smithi121.stdout: "attempts": 1, 2024-04-19T02:15:55.966 INFO:teuthology.orchestra.run.smithi121.stdout: "snapid": "head", 2024-04-19T02:15:55.966 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_context": "0=[]", 2024-04-19T02:15:55.966 INFO:teuthology.orchestra.run.smithi121.stdout: "mtime": "2024-04-19T02:15:55.947847+0000", 2024-04-19T02:15:55.966 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_ops": [ 2024-04-19T02:15:55.966 INFO:teuthology.orchestra.run.smithi121.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-19T02:15:55.966 INFO:teuthology.orchestra.run.smithi121.stdout: "write 0~65536 in=65536b" 2024-04-19T02:15:55.966 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:15:55.966 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:55.966 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:15:55.966 INFO:teuthology.orchestra.run.smithi121.stdout: "tid": 3372, 2024-04-19T02:15:55.966 INFO:teuthology.orchestra.run.smithi121.stdout: "pg": "5.e2606ec3", 2024-04-19T02:15:55.966 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": 2, 2024-04-19T02:15:55.967 INFO:teuthology.orchestra.run.smithi121.stdout: "object_id": "benchmark_data_smithi121_44835_object3371", 2024-04-19T02:15:55.967 INFO:teuthology.orchestra.run.smithi121.stdout: "object_locator": "@5", 2024-04-19T02:15:55.967 INFO:teuthology.orchestra.run.smithi121.stdout: "target_object_id": "benchmark_data_smithi121_44835_object3371", 2024-04-19T02:15:55.967 INFO:teuthology.orchestra.run.smithi121.stdout: "target_object_locator": "@5", 2024-04-19T02:15:55.967 INFO:teuthology.orchestra.run.smithi121.stdout: "paused": 0, 2024-04-19T02:15:55.967 INFO:teuthology.orchestra.run.smithi121.stdout: "used_replica": 0, 2024-04-19T02:15:55.967 INFO:teuthology.orchestra.run.smithi121.stdout: "precalc_pgid": 0, 2024-04-19T02:15:55.967 INFO:teuthology.orchestra.run.smithi121.stdout: "last_sent": "621.348883s", 2024-04-19T02:15:55.967 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.0019999739999999998, 2024-04-19T02:15:55.967 INFO:teuthology.orchestra.run.smithi121.stdout: "attempts": 1, 2024-04-19T02:15:55.967 INFO:teuthology.orchestra.run.smithi121.stdout: "snapid": "head", 2024-04-19T02:15:55.967 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_context": "0=[]", 2024-04-19T02:15:55.967 INFO:teuthology.orchestra.run.smithi121.stdout: "mtime": "2024-04-19T02:15:55.947854+0000", 2024-04-19T02:15:55.967 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_ops": [ 2024-04-19T02:15:55.968 INFO:teuthology.orchestra.run.smithi121.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-19T02:15:55.968 INFO:teuthology.orchestra.run.smithi121.stdout: "write 0~65536 in=65536b" 2024-04-19T02:15:55.969 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:15:55.969 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:55.970 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:15:55.970 INFO:teuthology.orchestra.run.smithi121.stdout: "tid": 3373, 2024-04-19T02:15:55.970 INFO:teuthology.orchestra.run.smithi121.stdout: "pg": "5.647cbb13", 2024-04-19T02:15:55.970 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": 2, 2024-04-19T02:15:55.970 INFO:teuthology.orchestra.run.smithi121.stdout: "object_id": "benchmark_data_smithi121_44835_object3372", 2024-04-19T02:15:55.970 INFO:teuthology.orchestra.run.smithi121.stdout: "object_locator": "@5", 2024-04-19T02:15:55.970 INFO:teuthology.orchestra.run.smithi121.stdout: "target_object_id": "benchmark_data_smithi121_44835_object3372", 2024-04-19T02:15:55.970 INFO:teuthology.orchestra.run.smithi121.stdout: "target_object_locator": "@5", 2024-04-19T02:15:55.970 INFO:teuthology.orchestra.run.smithi121.stdout: "paused": 0, 2024-04-19T02:15:55.970 INFO:teuthology.orchestra.run.smithi121.stdout: "used_replica": 0, 2024-04-19T02:15:55.970 INFO:teuthology.orchestra.run.smithi121.stdout: "precalc_pgid": 0, 2024-04-19T02:15:55.970 INFO:teuthology.orchestra.run.smithi121.stdout: "last_sent": "621.348883s", 2024-04-19T02:15:55.970 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.0019999739999999998, 2024-04-19T02:15:55.971 INFO:teuthology.orchestra.run.smithi121.stdout: "attempts": 1, 2024-04-19T02:15:55.971 INFO:teuthology.orchestra.run.smithi121.stdout: "snapid": "head", 2024-04-19T02:15:55.971 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_context": "0=[]", 2024-04-19T02:15:55.971 INFO:teuthology.orchestra.run.smithi121.stdout: "mtime": "2024-04-19T02:15:55.947858+0000", 2024-04-19T02:15:55.971 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_ops": [ 2024-04-19T02:15:55.971 INFO:teuthology.orchestra.run.smithi121.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-19T02:15:55.971 INFO:teuthology.orchestra.run.smithi121.stdout: "write 0~65536 in=65536b" 2024-04-19T02:15:55.971 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:15:55.971 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:55.971 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:15:55.971 INFO:teuthology.orchestra.run.smithi121.stdout: "tid": 3375, 2024-04-19T02:15:55.971 INFO:teuthology.orchestra.run.smithi121.stdout: "pg": "5.77cd75ec", 2024-04-19T02:15:55.971 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": 2, 2024-04-19T02:15:55.971 INFO:teuthology.orchestra.run.smithi121.stdout: "object_id": "benchmark_data_smithi121_44835_object3374", 2024-04-19T02:15:55.972 INFO:teuthology.orchestra.run.smithi121.stdout: "object_locator": "@5", 2024-04-19T02:15:55.972 INFO:teuthology.orchestra.run.smithi121.stdout: "target_object_id": "benchmark_data_smithi121_44835_object3374", 2024-04-19T02:15:55.972 INFO:teuthology.orchestra.run.smithi121.stdout: "target_object_locator": "@5", 2024-04-19T02:15:55.972 INFO:teuthology.orchestra.run.smithi121.stdout: "paused": 0, 2024-04-19T02:15:55.972 INFO:teuthology.orchestra.run.smithi121.stdout: "used_replica": 0, 2024-04-19T02:15:55.972 INFO:teuthology.orchestra.run.smithi121.stdout: "precalc_pgid": 0, 2024-04-19T02:15:55.972 INFO:teuthology.orchestra.run.smithi121.stdout: "last_sent": "621.348883s", 2024-04-19T02:15:55.972 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.0019999739999999998, 2024-04-19T02:15:55.972 INFO:teuthology.orchestra.run.smithi121.stdout: "attempts": 1, 2024-04-19T02:15:55.972 INFO:teuthology.orchestra.run.smithi121.stdout: "snapid": "head", 2024-04-19T02:15:55.972 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_context": "0=[]", 2024-04-19T02:15:55.972 INFO:teuthology.orchestra.run.smithi121.stdout: "mtime": "2024-04-19T02:15:55.948046+0000", 2024-04-19T02:15:55.972 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_ops": [ 2024-04-19T02:15:55.972 INFO:teuthology.orchestra.run.smithi121.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-19T02:15:55.973 INFO:teuthology.orchestra.run.smithi121.stdout: "write 0~65536 in=65536b" 2024-04-19T02:15:55.973 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:15:55.973 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:55.973 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:15:55.973 INFO:teuthology.orchestra.run.smithi121.stdout: "tid": 3378, 2024-04-19T02:15:55.973 INFO:teuthology.orchestra.run.smithi121.stdout: "pg": "5.4d8d84ca", 2024-04-19T02:15:55.973 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": 2, 2024-04-19T02:15:55.973 INFO:teuthology.orchestra.run.smithi121.stdout: "object_id": "benchmark_data_smithi121_44835_object3377", 2024-04-19T02:15:55.973 INFO:teuthology.orchestra.run.smithi121.stdout: "object_locator": "@5", 2024-04-19T02:15:55.973 INFO:teuthology.orchestra.run.smithi121.stdout: "target_object_id": "benchmark_data_smithi121_44835_object3377", 2024-04-19T02:15:55.973 INFO:teuthology.orchestra.run.smithi121.stdout: "target_object_locator": "@5", 2024-04-19T02:15:55.973 INFO:teuthology.orchestra.run.smithi121.stdout: "paused": 0, 2024-04-19T02:15:55.973 INFO:teuthology.orchestra.run.smithi121.stdout: "used_replica": 0, 2024-04-19T02:15:55.973 INFO:teuthology.orchestra.run.smithi121.stdout: "precalc_pgid": 0, 2024-04-19T02:15:55.973 INFO:teuthology.orchestra.run.smithi121.stdout: "last_sent": "621.348883s", 2024-04-19T02:15:55.973 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.0019999739999999998, 2024-04-19T02:15:55.974 INFO:teuthology.orchestra.run.smithi121.stdout: "attempts": 1, 2024-04-19T02:15:55.974 INFO:teuthology.orchestra.run.smithi121.stdout: "snapid": "head", 2024-04-19T02:15:55.974 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_context": "0=[]", 2024-04-19T02:15:55.974 INFO:teuthology.orchestra.run.smithi121.stdout: "mtime": "2024-04-19T02:15:55.948081+0000", 2024-04-19T02:15:55.974 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_ops": [ 2024-04-19T02:15:55.974 INFO:teuthology.orchestra.run.smithi121.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-19T02:15:55.974 INFO:teuthology.orchestra.run.smithi121.stdout: "write 0~65536 in=65536b" 2024-04-19T02:15:55.974 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:15:55.974 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:55.974 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:15:55.974 INFO:teuthology.orchestra.run.smithi121.stdout: "tid": 3380, 2024-04-19T02:15:55.974 INFO:teuthology.orchestra.run.smithi121.stdout: "pg": "5.ea0de3f3", 2024-04-19T02:15:55.974 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": 2, 2024-04-19T02:15:55.975 INFO:teuthology.orchestra.run.smithi121.stdout: "object_id": "benchmark_data_smithi121_44835_object3379", 2024-04-19T02:15:55.975 INFO:teuthology.orchestra.run.smithi121.stdout: "object_locator": "@5", 2024-04-19T02:15:55.975 INFO:teuthology.orchestra.run.smithi121.stdout: "target_object_id": "benchmark_data_smithi121_44835_object3379", 2024-04-19T02:15:55.975 INFO:teuthology.orchestra.run.smithi121.stdout: "target_object_locator": "@5", 2024-04-19T02:15:55.975 INFO:teuthology.orchestra.run.smithi121.stdout: "paused": 0, 2024-04-19T02:15:55.975 INFO:teuthology.orchestra.run.smithi121.stdout: "used_replica": 0, 2024-04-19T02:15:55.975 INFO:teuthology.orchestra.run.smithi121.stdout: "precalc_pgid": 0, 2024-04-19T02:15:55.975 INFO:teuthology.orchestra.run.smithi121.stdout: "last_sent": "621.348883s", 2024-04-19T02:15:55.975 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.0019999739999999998, 2024-04-19T02:15:55.975 INFO:teuthology.orchestra.run.smithi121.stdout: "attempts": 1, 2024-04-19T02:15:55.975 INFO:teuthology.orchestra.run.smithi121.stdout: "snapid": "head", 2024-04-19T02:15:55.975 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_context": "0=[]", 2024-04-19T02:15:55.975 INFO:teuthology.orchestra.run.smithi121.stdout: "mtime": "2024-04-19T02:15:55.948182+0000", 2024-04-19T02:15:55.975 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_ops": [ 2024-04-19T02:15:55.976 INFO:teuthology.orchestra.run.smithi121.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-19T02:15:55.976 INFO:teuthology.orchestra.run.smithi121.stdout: "write 0~65536 in=65536b" 2024-04-19T02:15:55.976 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:15:55.976 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:15:55.976 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-04-19T02:15:55.976 INFO:teuthology.orchestra.run.smithi121.stdout: "linger_ops": [], 2024-04-19T02:15:55.976 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_ops": [], 2024-04-19T02:15:55.976 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_stat_ops": [], 2024-04-19T02:15:55.976 INFO:teuthology.orchestra.run.smithi121.stdout: "statfs_ops": [], 2024-04-19T02:15:55.976 INFO:teuthology.orchestra.run.smithi121.stdout: "command_ops": [] 2024-04-19T02:15:55.976 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-04-19T02:15:55.977 INFO:teuthology.orchestra.run.smithi121.stderr:nodeep-scrub is set 2024-04-19T02:15:55.978 DEBUG:tasks.admin_socket:admin socket command objecter_requests returned { "ops": [ { "tid": 3369, "pg": "5.1c7a5e9f", "osd": 0, "object_id": "benchmark_data_smithi121_44835_object3368", "object_locator": "@5", "target_object_id": "benchmark_data_smithi121_44835_object3368", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "621.348883s", "age": 0.0019999739999999998, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-19T02:15:55.947823+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 3370, "pg": "5.23ef4fef", "osd": 0, "object_id": "benchmark_data_smithi121_44835_object3369", "object_locator": "@5", "target_object_id": "benchmark_data_smithi121_44835_object3369", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "621.348883s", "age": 0.0019999739999999998, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-19T02:15:55.947843+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 3374, "pg": "5.48537351", "osd": 0, "object_id": "benchmark_data_smithi121_44835_object3373", "object_locator": "@5", "target_object_id": "benchmark_data_smithi121_44835_object3373", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "621.348883s", "age": 0.0019999739999999998, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-19T02:15:55.947970+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 3376, "pg": "5.77381822", "osd": 0, "object_id": "benchmark_data_smithi121_44835_object3375", "object_locator": "@5", "target_object_id": "benchmark_data_smithi121_44835_object3375", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "621.348883s", "age": 0.0019999739999999998, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-19T02:15:55.948056+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 3377, "pg": "5.7684572f", "osd": 0, "object_id": "benchmark_data_smithi121_44835_object3376", "object_locator": "@5", "target_object_id": "benchmark_data_smithi121_44835_object3376", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "621.348883s", "age": 0.0019999739999999998, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-19T02:15:55.948076+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 3379, "pg": "5.ea936ae1", "osd": 0, "object_id": "benchmark_data_smithi121_44835_object3378", "object_locator": "@5", "target_object_id": "benchmark_data_smithi121_44835_object3378", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "621.348883s", "age": 0.0019999739999999998, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-19T02:15:55.948112+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 3381, "pg": "5.345ee971", "osd": 0, "object_id": "benchmark_data_smithi121_44835_object3380", "object_locator": "@5", "target_object_id": "benchmark_data_smithi121_44835_object3380", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "621.349883s", "age": 0.00099998699999999992, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-19T02:15:55.948423+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 3382, "pg": "5.34511529", "osd": 0, "object_id": "benchmark_data_smithi121_44835_object3381", "object_locator": "@5", "target_object_id": "benchmark_data_smithi121_44835_object3381", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "621.349883s", "age": 0.00099998699999999992, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-19T02:15:55.948432+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 3383, "pg": "5.ab140f4f", "osd": 0, "object_id": "benchmark_data_smithi121_44835_object3382", "object_locator": "@5", "target_object_id": "benchmark_data_smithi121_44835_object3382", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "621.349883s", "age": 0.00099998699999999992, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-19T02:15:55.948931+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 3384, "pg": "5.d672bd9f", "osd": 0, "object_id": "benchmark_data_smithi121_44835_object3383", "object_locator": "@5", "target_object_id": "benchmark_data_smithi121_44835_object3383", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "621.350883s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-19T02:15:55.949918+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 3371, "pg": "5.e2451a9c", "osd": 2, "object_id": "benchmark_data_smithi121_44835_object3370", "object_locator": "@5", "target_object_id": "benchmark_data_smithi121_44835_object3370", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "621.348883s", "age": 0.0019999739999999998, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-19T02:15:55.947847+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 3372, "pg": "5.e2606ec3", "osd": 2, "object_id": "benchmark_data_smithi121_44835_object3371", "object_locator": "@5", "target_object_id": "benchmark_data_smithi121_44835_object3371", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "621.348883s", "age": 0.0019999739999999998, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-19T02:15:55.947854+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 3373, "pg": "5.647cbb13", "osd": 2, "object_id": "benchmark_data_smithi121_44835_object3372", "object_locator": "@5", "target_object_id": "benchmark_data_smithi121_44835_object3372", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "621.348883s", "age": 0.0019999739999999998, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-19T02:15:55.947858+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 3375, "pg": "5.77cd75ec", "osd": 2, "object_id": "benchmark_data_smithi121_44835_object3374", "object_locator": "@5", "target_object_id": "benchmark_data_smithi121_44835_object3374", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "621.348883s", "age": 0.0019999739999999998, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-19T02:15:55.948046+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 3378, "pg": "5.4d8d84ca", "osd": 2, "object_id": "benchmark_data_smithi121_44835_object3377", "object_locator": "@5", "target_object_id": "benchmark_data_smithi121_44835_object3377", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "621.348883s", "age": 0.0019999739999999998, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-19T02:15:55.948081+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 3380, "pg": "5.ea0de3f3", "osd": 2, "object_id": "benchmark_data_smithi121_44835_object3379", "object_locator": "@5", "target_object_id": "benchmark_data_smithi121_44835_object3379", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "621.348883s", "age": 0.0019999739999999998, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-19T02:15:55.948182+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] } ], "linger_ops": [], "pool_ops": [], "pool_stat_ops": [], "statfs_ops": [], "command_ops": [] } 2024-04-19T02:15:55.978 DEBUG:teuthology.orchestra.run.smithi121:> /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests 2024-04-19T02:15:56.025 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 1 16 3666 3650 228.113 228.125 0.00372467 0.00436095 2024-04-19T02:15:56.029 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:15:56.030+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:15:56.061 DEBUG:teuthology.orchestra.run.smithi121:> rm -rf -- /home/ubuntu/cephtest/admin_socket_client.0 2024-04-19T02:15:56.110 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:15:56.110 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-04-19T02:15:56.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-04-19T02:15:56.111 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:15:56.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.111 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:15:56.111 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269657+0000", 2024-04-19T02:15:56.111 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.840014937999999, 2024-04-19T02:15:56.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018569239000000001, 2024-04-19T02:15:56.111 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:15:56.111 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:56.111 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:15:56.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:15:56.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269657+0000", 2024-04-19T02:15:56.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:56.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:15:56.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269657+0000", 2024-04-19T02:15:56.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:56.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:15:56.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269656+0000", 2024-04-19T02:15:56.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:56.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:15:56.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269666+0000", 2024-04-19T02:15:56.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.628e-06 2024-04-19T02:15:56.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:15:56.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269673+0000", 2024-04-19T02:15:56.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1690000000000003e-06 2024-04-19T02:15:56.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:15:56.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269680+0000", 2024-04-19T02:15:56.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8940000000000004e-06 2024-04-19T02:15:56.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:56.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269788+0000", 2024-04-19T02:15:56.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107725 2024-04-19T02:15:56.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.114 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:15:56.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269791+0000", 2024-04-19T02:15:56.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9699999999999999e-06 2024-04-19T02:15:56.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.114 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:56.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.277693+0000", 2024-04-19T02:15:56.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079026979999999997 2024-04-19T02:15:56.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.114 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:15:56.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.277838+0000", 2024-04-19T02:15:56.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014444699999999999 2024-04-19T02:15:56.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:15:56.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.277996+0000", 2024-04-19T02:15:56.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015794499999999999 2024-04-19T02:15:56.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:15:56.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282534+0000", 2024-04-19T02:15:56.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045383070000000001 2024-04-19T02:15:56.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:56.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288134+0000", 2024-04-19T02:15:56.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0056005020000000003 2024-04-19T02:15:56.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:15:56.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288187+0000", 2024-04-19T02:15:56.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2884999999999999e-05 2024-04-19T02:15:56.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:15:56.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288226+0000", 2024-04-19T02:15:56.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8458999999999999e-05 2024-04-19T02:15:56.116 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:56.117 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:15:56.117 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:56.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.117 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:15:56.117 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269684+0000", 2024-04-19T02:15:56.117 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.839987368999999, 2024-04-19T02:15:56.117 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019077493000000001, 2024-04-19T02:15:56.117 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:15:56.117 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:56.117 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:15:56.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.117 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:15:56.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269684+0000", 2024-04-19T02:15:56.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:56.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:15:56.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269684+0000", 2024-04-19T02:15:56.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:56.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:15:56.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269684+0000", 2024-04-19T02:15:56.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:56.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:15:56.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269686+0000", 2024-04-19T02:15:56.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2740000000000002e-06 2024-04-19T02:15:56.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:15:56.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269690+0000", 2024-04-19T02:15:56.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8829999999999999e-06 2024-04-19T02:15:56.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:15:56.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269693+0000", 2024-04-19T02:15:56.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4199999999999999e-06 2024-04-19T02:15:56.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:56.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269875+0000", 2024-04-19T02:15:56.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018114800000000001 2024-04-19T02:15:56.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:15:56.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269880+0000", 2024-04-19T02:15:56.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5620000000000003e-06 2024-04-19T02:15:56.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:56.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278610+0000", 2024-04-19T02:15:56.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.008729423 2024-04-19T02:15:56.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:15:56.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278724+0000", 2024-04-19T02:15:56.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011428400000000001 2024-04-19T02:15:56.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:15:56.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278860+0000", 2024-04-19T02:15:56.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013601600000000001 2024-04-19T02:15:56.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:15:56.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282632+0000", 2024-04-19T02:15:56.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037722889999999999 2024-04-19T02:15:56.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:56.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288712+0000", 2024-04-19T02:15:56.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0060799599999999997 2024-04-19T02:15:56.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:15:56.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288742+0000", 2024-04-19T02:15:56.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0048000000000001e-05 2024-04-19T02:15:56.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:15:56.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288762+0000", 2024-04-19T02:15:56.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9482000000000001e-05 2024-04-19T02:15:56.123 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:56.123 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:15:56.123 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:56.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.123 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:12 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:15:56.123 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269696+0000", 2024-04-19T02:15:56.123 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.839975291000002, 2024-04-19T02:15:56.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018617073000000001, 2024-04-19T02:15:56.123 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:15:56.123 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:56.123 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:15:56.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:15:56.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269696+0000", 2024-04-19T02:15:56.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:56.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:15:56.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269696+0000", 2024-04-19T02:15:56.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:56.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:15:56.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269696+0000", 2024-04-19T02:15:56.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967296 2024-04-19T02:15:56.125 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.125 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.125 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:15:56.125 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269698+0000", 2024-04-19T02:15:56.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9570000000000001e-06 2024-04-19T02:15:56.125 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.125 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.125 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:15:56.125 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269702+0000", 2024-04-19T02:15:56.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2459999999999997e-06 2024-04-19T02:15:56.125 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.125 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.125 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:15:56.125 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269708+0000", 2024-04-19T02:15:56.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2709999999999998e-06 2024-04-19T02:15:56.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.126 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:56.126 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269749+0000", 2024-04-19T02:15:56.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0500000000000002e-05 2024-04-19T02:15:56.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.126 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-04-19T02:15:56.126 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269754+0000", 2024-04-19T02:15:56.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.502e-06 2024-04-19T02:15:56.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:56.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.277984+0000", 2024-04-19T02:15:56.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0082293049999999993 2024-04-19T02:15:56.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:15:56.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278489+0000", 2024-04-19T02:15:56.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00050499699999999998 2024-04-19T02:15:56.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:15:56.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278649+0000", 2024-04-19T02:15:56.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016012000000000001 2024-04-19T02:15:56.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:15:56.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286855+0000", 2024-04-19T02:15:56.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0082066139999999992 2024-04-19T02:15:56.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:56.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288248+0000", 2024-04-19T02:15:56.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001392838 2024-04-19T02:15:56.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:15:56.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288287+0000", 2024-04-19T02:15:56.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8516000000000002e-05 2024-04-19T02:15:56.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.129 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:15:56.129 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288313+0000", 2024-04-19T02:15:56.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6420000000000001e-05 2024-04-19T02:15:56.129 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:56.129 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:15:56.129 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:56.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.129 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:15:56.129 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269753+0000", 2024-04-19T02:15:56.129 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.839917986, 2024-04-19T02:15:56.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019088755999999998, 2024-04-19T02:15:56.129 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:15:56.130 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:56.130 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:15:56.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.130 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:15:56.130 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269753+0000", 2024-04-19T02:15:56.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:56.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.130 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:15:56.130 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269753+0000", 2024-04-19T02:15:56.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:56.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.130 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:15:56.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269753+0000", 2024-04-19T02:15:56.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:56.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:15:56.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269770+0000", 2024-04-19T02:15:56.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7150999999999999e-05 2024-04-19T02:15:56.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:15:56.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269779+0000", 2024-04-19T02:15:56.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4139999999999994e-06 2024-04-19T02:15:56.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.132 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:15:56.132 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269786+0000", 2024-04-19T02:15:56.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.537e-06 2024-04-19T02:15:56.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.132 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:56.132 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269913+0000", 2024-04-19T02:15:56.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012699599999999999 2024-04-19T02:15:56.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.132 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:15:56.132 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269916+0000", 2024-04-19T02:15:56.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9280000000000002e-06 2024-04-19T02:15:56.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.133 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:56.133 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.279143+0000", 2024-04-19T02:15:56.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0092270129999999992 2024-04-19T02:15:56.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.133 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:15:56.133 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.279223+0000", 2024-04-19T02:15:56.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0050999999999996e-05 2024-04-19T02:15:56.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.133 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:15:56.133 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.279364+0000", 2024-04-19T02:15:56.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000140934 2024-04-19T02:15:56.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:15:56.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286189+0000", 2024-04-19T02:15:56.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.006825327 2024-04-19T02:15:56.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:56.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288791+0000", 2024-04-19T02:15:56.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026021500000000001 2024-04-19T02:15:56.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:15:56.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288822+0000", 2024-04-19T02:15:56.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0162999999999999e-05 2024-04-19T02:15:56.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:15:56.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288842+0000", 2024-04-19T02:15:56.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0644000000000001e-05 2024-04-19T02:15:56.135 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:56.135 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:15:56.135 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:56.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.135 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:15:56.135 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:15:56.135 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.839879512, 2024-04-19T02:15:56.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020307345000000001, 2024-04-19T02:15:56.136 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:15:56.136 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:56.136 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:15:56.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.136 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:15:56.136 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:15:56.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:56.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.136 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:15:56.136 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:15:56.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:56.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:15:56.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269791+0000", 2024-04-19T02:15:56.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:56.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:15:56.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269795+0000", 2024-04-19T02:15:56.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5619999999999999e-06 2024-04-19T02:15:56.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:15:56.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269802+0000", 2024-04-19T02:15:56.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8469999999999998e-06 2024-04-19T02:15:56.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.138 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:15:56.138 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269807+0000", 2024-04-19T02:15:56.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.707e-06 2024-04-19T02:15:56.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.138 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:56.138 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269950+0000", 2024-04-19T02:15:56.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000143313 2024-04-19T02:15:56.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.138 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:15:56.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269955+0000", 2024-04-19T02:15:56.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4029999999999998e-06 2024-04-19T02:15:56.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:56.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.283806+0000", 2024-04-19T02:15:56.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013850220999999999 2024-04-19T02:15:56.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:15:56.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.283896+0000", 2024-04-19T02:15:56.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0261999999999997e-05 2024-04-19T02:15:56.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:15:56.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284022+0000", 2024-04-19T02:15:56.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012641200000000001 2024-04-19T02:15:56.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:56.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289066+0000", 2024-04-19T02:15:56.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050438490000000004 2024-04-19T02:15:56.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:15:56.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290011+0000", 2024-04-19T02:15:56.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00094490700000000004 2024-04-19T02:15:56.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:15:56.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290054+0000", 2024-04-19T02:15:56.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.337e-05 2024-04-19T02:15:56.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:15:56.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290099+0000", 2024-04-19T02:15:56.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4987999999999997e-05 2024-04-19T02:15:56.141 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:56.141 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:15:56.141 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:56.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.142 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:15:56.142 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:15:56.142 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.839801582, 2024-04-19T02:15:56.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020331023, 2024-04-19T02:15:56.142 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:15:56.142 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:56.142 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:15:56.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.142 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:15:56.142 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:15:56.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:56.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.143 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:15:56.143 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:15:56.143 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:56.143 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.143 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.143 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:15:56.143 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269869+0000", 2024-04-19T02:15:56.143 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:56.143 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.143 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.143 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:15:56.143 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269873+0000", 2024-04-19T02:15:56.143 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0219999999999998e-06 2024-04-19T02:15:56.143 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.144 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:15:56.144 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269881+0000", 2024-04-19T02:15:56.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.79e-06 2024-04-19T02:15:56.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.144 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:15:56.144 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269887+0000", 2024-04-19T02:15:56.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7899999999999996e-06 2024-04-19T02:15:56.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.144 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:56.144 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269983+0000", 2024-04-19T02:15:56.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6057000000000005e-05 2024-04-19T02:15:56.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:15:56.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269986+0000", 2024-04-19T02:15:56.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9220000000000001e-06 2024-04-19T02:15:56.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:56.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284350+0000", 2024-04-19T02:15:56.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014364335000000001 2024-04-19T02:15:56.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:15:56.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284664+0000", 2024-04-19T02:15:56.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000313646 2024-04-19T02:15:56.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:15:56.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284794+0000", 2024-04-19T02:15:56.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129839 2024-04-19T02:15:56.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:56.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289107+0000", 2024-04-19T02:15:56.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0043127060000000004 2024-04-19T02:15:56.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.147 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:15:56.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290108+0000", 2024-04-19T02:15:56.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0010010590000000001 2024-04-19T02:15:56.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.147 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:15:56.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290144+0000", 2024-04-19T02:15:56.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6709999999999999e-05 2024-04-19T02:15:56.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.147 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:15:56.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290201+0000", 2024-04-19T02:15:56.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6654999999999999e-05 2024-04-19T02:15:56.147 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:56.148 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:15:56.148 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:56.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.148 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:15:56.148 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:15:56.148 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.839759240999999, 2024-04-19T02:15:56.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020507241999999998, 2024-04-19T02:15:56.148 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:15:56.148 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:56.148 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:15:56.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:15:56.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:15:56.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:56.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:15:56.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:15:56.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:56.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:15:56.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:15:56.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:56.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:15:56.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269915+0000", 2024-04-19T02:15:56.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.472e-06 2024-04-19T02:15:56.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:15:56.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269928+0000", 2024-04-19T02:15:56.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2979000000000001e-05 2024-04-19T02:15:56.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:15:56.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269935+0000", 2024-04-19T02:15:56.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8859999999999998e-06 2024-04-19T02:15:56.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:56.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270009+0000", 2024-04-19T02:15:56.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3429000000000005e-05 2024-04-19T02:15:56.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:15:56.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270013+0000", 2024-04-19T02:15:56.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2590000000000002e-06 2024-04-19T02:15:56.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:56.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285375+0000", 2024-04-19T02:15:56.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015362275999999999 2024-04-19T02:15:56.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:15:56.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285451+0000", 2024-04-19T02:15:56.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5338000000000003e-05 2024-04-19T02:15:56.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:15:56.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285562+0000", 2024-04-19T02:15:56.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000111285 2024-04-19T02:15:56.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:56.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289134+0000", 2024-04-19T02:15:56.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035719670000000001 2024-04-19T02:15:56.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:15:56.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290341+0000", 2024-04-19T02:15:56.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012074500000000001 2024-04-19T02:15:56.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:15:56.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290383+0000", 2024-04-19T02:15:56.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1386e-05 2024-04-19T02:15:56.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:15:56.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290419+0000", 2024-04-19T02:15:56.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6884000000000001e-05 2024-04-19T02:15:56.153 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:56.153 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:15:56.154 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:56.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.154 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:15:56.154 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269945+0000", 2024-04-19T02:15:56.154 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.839726659, 2024-04-19T02:15:56.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019709098000000001, 2024-04-19T02:15:56.154 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:15:56.154 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:56.154 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:15:56.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:15:56.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269945+0000", 2024-04-19T02:15:56.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:56.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:15:56.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269945+0000", 2024-04-19T02:15:56.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:56.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:15:56.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269944+0000", 2024-04-19T02:15:56.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:56.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:15:56.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269965+0000", 2024-04-19T02:15:56.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0803999999999999e-05 2024-04-19T02:15:56.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:15:56.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269973+0000", 2024-04-19T02:15:56.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3560000000000004e-06 2024-04-19T02:15:56.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:15:56.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269982+0000", 2024-04-19T02:15:56.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9600000000000006e-06 2024-04-19T02:15:56.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:56.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270014+0000", 2024-04-19T02:15:56.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2913000000000001e-05 2024-04-19T02:15:56.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:15:56.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270018+0000", 2024-04-19T02:15:56.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2200000000000001e-06 2024-04-19T02:15:56.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:56.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278999+0000", 2024-04-19T02:15:56.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0089818009999999993 2024-04-19T02:15:56.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:15:56.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.279088+0000", 2024-04-19T02:15:56.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8988999999999998e-05 2024-04-19T02:15:56.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:15:56.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.280160+0000", 2024-04-19T02:15:56.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001071572 2024-04-19T02:15:56.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:56.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288342+0000", 2024-04-19T02:15:56.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.008182468 2024-04-19T02:15:56.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:15:56.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289545+0000", 2024-04-19T02:15:56.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012026739999999999 2024-04-19T02:15:56.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:15:56.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289608+0000", 2024-04-19T02:15:56.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2904999999999995e-05 2024-04-19T02:15:56.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:15:56.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289654+0000", 2024-04-19T02:15:56.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5850000000000003e-05 2024-04-19T02:15:56.160 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:56.160 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:15:56.160 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:56.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.160 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:15:56.160 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:15:56.160 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.839680981000001, 2024-04-19T02:15:56.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022007204999999998, 2024-04-19T02:15:56.160 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:15:56.161 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:56.161 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:15:56.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:15:56.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:15:56.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:56.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:15:56.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:15:56.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:56.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:15:56.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269990+0000", 2024-04-19T02:15:56.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:56.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:15:56.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269999+0000", 2024-04-19T02:15:56.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9539999999999993e-06 2024-04-19T02:15:56.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:15:56.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270006+0000", 2024-04-19T02:15:56.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.216e-06 2024-04-19T02:15:56.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:15:56.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270012+0000", 2024-04-19T02:15:56.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5049999999999998e-06 2024-04-19T02:15:56.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:56.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270058+0000", 2024-04-19T02:15:56.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.634e-05 2024-04-19T02:15:56.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:15:56.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270064+0000", 2024-04-19T02:15:56.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0669999999999997e-06 2024-04-19T02:15:56.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.164 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:56.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287159+0000", 2024-04-19T02:15:56.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017095086999999998 2024-04-19T02:15:56.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.164 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:15:56.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287254+0000", 2024-04-19T02:15:56.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4716000000000006e-05 2024-04-19T02:15:56.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.164 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:15:56.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287389+0000", 2024-04-19T02:15:56.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013511900000000001 2024-04-19T02:15:56.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:15:56.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290481+0000", 2024-04-19T02:15:56.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030920169999999999 2024-04-19T02:15:56.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:56.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291931+0000", 2024-04-19T02:15:56.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001450118 2024-04-19T02:15:56.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:15:56.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291960+0000", 2024-04-19T02:15:56.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9096000000000001e-05 2024-04-19T02:15:56.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:15:56.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291998+0000", 2024-04-19T02:15:56.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7514e-05 2024-04-19T02:15:56.166 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:56.166 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:15:56.166 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:56.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.166 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:15:56.166 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:15:56.166 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.839620409999998, 2024-04-19T02:15:56.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020759494999999999, 2024-04-19T02:15:56.167 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:15:56.167 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:56.167 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:15:56.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:15:56.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:15:56.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:56.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:15:56.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:15:56.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:56.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:15:56.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:15:56.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:56.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:15:56.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270054+0000", 2024-04-19T02:15:56.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.27e-06 2024-04-19T02:15:56.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:15:56.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270061+0000", 2024-04-19T02:15:56.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1289999999999998e-06 2024-04-19T02:15:56.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:15:56.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270067+0000", 2024-04-19T02:15:56.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.207e-06 2024-04-19T02:15:56.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:56.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270105+0000", 2024-04-19T02:15:56.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7549999999999998e-05 2024-04-19T02:15:56.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:15:56.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270112+0000", 2024-04-19T02:15:56.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3200000000000002e-06 2024-04-19T02:15:56.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:56.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282454+0000", 2024-04-19T02:15:56.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012341569 2024-04-19T02:15:56.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:15:56.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282740+0000", 2024-04-19T02:15:56.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000286481 2024-04-19T02:15:56.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:15:56.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282879+0000", 2024-04-19T02:15:56.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013887799999999999 2024-04-19T02:15:56.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:15:56.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290325+0000", 2024-04-19T02:15:56.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074459779999999998 2024-04-19T02:15:56.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:56.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290759+0000", 2024-04-19T02:15:56.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000433688 2024-04-19T02:15:56.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:15:56.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290789+0000", 2024-04-19T02:15:56.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9960000000000001e-05 2024-04-19T02:15:56.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:15:56.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290811+0000", 2024-04-19T02:15:56.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1965999999999999e-05 2024-04-19T02:15:56.172 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:56.173 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:15:56.173 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:56.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.174 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:15:56.174 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270078+0000", 2024-04-19T02:15:56.174 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.839593956999998, 2024-04-19T02:15:56.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018194683, 2024-04-19T02:15:56.174 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:15:56.174 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:56.174 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:15:56.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.174 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:15:56.174 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270078+0000", 2024-04-19T02:15:56.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:56.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:15:56.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270078+0000", 2024-04-19T02:15:56.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:56.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:15:56.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270077+0000", 2024-04-19T02:15:56.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:56.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:15:56.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270080+0000", 2024-04-19T02:15:56.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8389999999999998e-06 2024-04-19T02:15:56.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:15:56.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270086+0000", 2024-04-19T02:15:56.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6160000000000001e-06 2024-04-19T02:15:56.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:15:56.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270091+0000", 2024-04-19T02:15:56.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1390000000000003e-06 2024-04-19T02:15:56.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:56.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270124+0000", 2024-04-19T02:15:56.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3359999999999999e-05 2024-04-19T02:15:56.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-04-19T02:15:56.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270127+0000", 2024-04-19T02:15:56.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.219e-06 2024-04-19T02:15:56.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:56.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.277938+0000", 2024-04-19T02:15:56.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0078111559999999997 2024-04-19T02:15:56.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:15:56.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278413+0000", 2024-04-19T02:15:56.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00047432600000000001 2024-04-19T02:15:56.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:15:56.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278540+0000", 2024-04-19T02:15:56.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012753299999999999 2024-04-19T02:15:56.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:15:56.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.283045+0000", 2024-04-19T02:15:56.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045051580000000004 2024-04-19T02:15:56.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:56.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288192+0000", 2024-04-19T02:15:56.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051468210000000002 2024-04-19T02:15:56.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:15:56.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288239+0000", 2024-04-19T02:15:56.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7089999999999998e-05 2024-04-19T02:15:56.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:15:56.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288272+0000", 2024-04-19T02:15:56.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2799999999999998e-05 2024-04-19T02:15:56.179 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:56.179 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:15:56.180 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:56.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.180 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:15:56.180 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:15:56.180 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.839570205000001, 2024-04-19T02:15:56.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020837887999999999, 2024-04-19T02:15:56.180 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:15:56.180 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:56.180 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:15:56.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:15:56.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:15:56.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:56.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:15:56.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:15:56.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:56.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:15:56.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:15:56.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:56.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:15:56.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270109+0000", 2024-04-19T02:15:56.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3110000000000006e-06 2024-04-19T02:15:56.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:15:56.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270117+0000", 2024-04-19T02:15:56.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0479999999999999e-06 2024-04-19T02:15:56.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:15:56.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270123+0000", 2024-04-19T02:15:56.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5500000000000002e-06 2024-04-19T02:15:56.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:56.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270150+0000", 2024-04-19T02:15:56.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7712000000000002e-05 2024-04-19T02:15:56.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:15:56.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270153+0000", 2024-04-19T02:15:56.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6089999999999999e-06 2024-04-19T02:15:56.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:56.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285958+0000", 2024-04-19T02:15:56.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015805274000000001 2024-04-19T02:15:56.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:15:56.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286126+0000", 2024-04-19T02:15:56.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016765700000000001 2024-04-19T02:15:56.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:15:56.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286296+0000", 2024-04-19T02:15:56.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017007 2024-04-19T02:15:56.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:15:56.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290426+0000", 2024-04-19T02:15:56.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041299839999999997 2024-04-19T02:15:56.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:56.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290867+0000", 2024-04-19T02:15:56.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00044083300000000001 2024-04-19T02:15:56.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:15:56.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290900+0000", 2024-04-19T02:15:56.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3380000000000002e-05 2024-04-19T02:15:56.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:15:56.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290939+0000", 2024-04-19T02:15:56.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8970000000000001e-05 2024-04-19T02:15:56.185 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:56.185 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:15:56.185 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:56.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.186 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:17 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:15:56.186 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270134+0000", 2024-04-19T02:15:56.186 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.839537764999999, 2024-04-19T02:15:56.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017217329999999999, 2024-04-19T02:15:56.186 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:15:56.186 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:56.186 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:15:56.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:15:56.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270134+0000", 2024-04-19T02:15:56.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:56.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:15:56.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270134+0000", 2024-04-19T02:15:56.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:56.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:15:56.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270133+0000", 2024-04-19T02:15:56.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:56.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:15:56.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270136+0000", 2024-04-19T02:15:56.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1760000000000002e-06 2024-04-19T02:15:56.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:15:56.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270145+0000", 2024-04-19T02:15:56.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8550000000000008e-06 2024-04-19T02:15:56.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:15:56.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270151+0000", 2024-04-19T02:15:56.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0270000000000001e-06 2024-04-19T02:15:56.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:56.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270192+0000", 2024-04-19T02:15:56.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1176e-05 2024-04-19T02:15:56.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:15:56.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270198+0000", 2024-04-19T02:15:56.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1749999999999996e-06 2024-04-19T02:15:56.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:56.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.279159+0000", 2024-04-19T02:15:56.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0089612310000000001 2024-04-19T02:15:56.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:15:56.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.279295+0000", 2024-04-19T02:15:56.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000136033 2024-04-19T02:15:56.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:15:56.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.279437+0000", 2024-04-19T02:15:56.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000142132 2024-04-19T02:15:56.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:15:56.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286064+0000", 2024-04-19T02:15:56.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0066272739999999998 2024-04-19T02:15:56.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:56.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287263+0000", 2024-04-19T02:15:56.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001198504 2024-04-19T02:15:56.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:15:56.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287312+0000", 2024-04-19T02:15:56.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9500999999999999e-05 2024-04-19T02:15:56.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:15:56.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287351+0000", 2024-04-19T02:15:56.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8754000000000002e-05 2024-04-19T02:15:56.191 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:56.191 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:15:56.191 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:56.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.192 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:20 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:15:56.192 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270161+0000", 2024-04-19T02:15:56.192 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.839510516000001, 2024-04-19T02:15:56.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018061383, 2024-04-19T02:15:56.192 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:15:56.192 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:56.192 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:15:56.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:15:56.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270161+0000", 2024-04-19T02:15:56.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:56.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:15:56.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270161+0000", 2024-04-19T02:15:56.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:56.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:15:56.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270161+0000", 2024-04-19T02:15:56.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:56.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:15:56.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270164+0000", 2024-04-19T02:15:56.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3000000000000002e-06 2024-04-19T02:15:56.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:15:56.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270170+0000", 2024-04-19T02:15:56.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2310000000000001e-06 2024-04-19T02:15:56.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:15:56.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270180+0000", 2024-04-19T02:15:56.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9320000000000008e-06 2024-04-19T02:15:56.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:56.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270214+0000", 2024-04-19T02:15:56.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4048999999999999e-05 2024-04-19T02:15:56.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-04-19T02:15:56.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270220+0000", 2024-04-19T02:15:56.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7769999999999999e-06 2024-04-19T02:15:56.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:56.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.277220+0000", 2024-04-19T02:15:56.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0070006759999999999 2024-04-19T02:15:56.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:15:56.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.277341+0000", 2024-04-19T02:15:56.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120758 2024-04-19T02:15:56.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:15:56.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.277480+0000", 2024-04-19T02:15:56.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013903900000000001 2024-04-19T02:15:56.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:15:56.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282351+0000", 2024-04-19T02:15:56.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0048703110000000004 2024-04-19T02:15:56.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:56.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288147+0000", 2024-04-19T02:15:56.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0057962500000000002 2024-04-19T02:15:56.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:15:56.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288190+0000", 2024-04-19T02:15:56.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2998999999999999e-05 2024-04-19T02:15:56.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:15:56.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288222+0000", 2024-04-19T02:15:56.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2499999999999997e-05 2024-04-19T02:15:56.198 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:56.198 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:15:56.198 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:56.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.198 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:21 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:15:56.198 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:15:56.198 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.839481533000001, 2024-04-19T02:15:56.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020833187999999999, 2024-04-19T02:15:56.198 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:15:56.198 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:15:56.198 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:15:56.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:15:56.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:15:56.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:56.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:15:56.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:15:56.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:56.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:15:56.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270189+0000", 2024-04-19T02:15:56.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:56.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:15:56.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270192+0000", 2024-04-19T02:15:56.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7549999999999999e-06 2024-04-19T02:15:56.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:15:56.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270198+0000", 2024-04-19T02:15:56.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0859999999999998e-06 2024-04-19T02:15:56.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:15:56.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270204+0000", 2024-04-19T02:15:56.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1970000000000004e-06 2024-04-19T02:15:56.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:56.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270238+0000", 2024-04-19T02:15:56.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4282000000000001e-05 2024-04-19T02:15:56.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:15:56.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270240+0000", 2024-04-19T02:15:56.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3099999999999999e-06 2024-04-19T02:15:56.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:56.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287131+0000", 2024-04-19T02:15:56.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01689104 2024-04-19T02:15:56.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:15:56.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287262+0000", 2024-04-19T02:15:56.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130347 2024-04-19T02:15:56.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:15:56.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291023+0000", 2024-04-19T02:15:56.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037616350000000002 2024-04-19T02:15:56.203 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:56.203 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:15:56.203 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:56.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.203 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:2280 5.d 5:bbae9ebc:::benchmark_data_smithi121_44835_object2279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:15:56.203 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:55.642317+0000", 2024-04-19T02:15:56.203 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.46735400300000002, 2024-04-19T02:15:56.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017373597000000001, 2024-04-19T02:15:56.203 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:15:56.203 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:56.203 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:15:56.203 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:15:56.203 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:56.203 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 2280 2024-04-19T02:15:56.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.204 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:15:56.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:15:56.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.642317+0000", 2024-04-19T02:15:56.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:56.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:15:56.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.642317+0000", 2024-04-19T02:15:56.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:56.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:15:56.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.642317+0000", 2024-04-19T02:15:56.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:56.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:15:56.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.642392+0000", 2024-04-19T02:15:56.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4684999999999994e-05 2024-04-19T02:15:56.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:15:56.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.642397+0000", 2024-04-19T02:15:56.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3009999999999997e-06 2024-04-19T02:15:56.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:15:56.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.642401+0000", 2024-04-19T02:15:56.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5389999999999999e-06 2024-04-19T02:15:56.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:56.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.642704+0000", 2024-04-19T02:15:56.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00030363699999999999 2024-04-19T02:15:56.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:15:56.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.642836+0000", 2024-04-19T02:15:56.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000132259 2024-04-19T02:15:56.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:15:56.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.642987+0000", 2024-04-19T02:15:56.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015096 2024-04-19T02:15:56.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:56.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.649071+0000", 2024-04-19T02:15:56.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0060841189999999998 2024-04-19T02:15:56.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:15:56.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.659605+0000", 2024-04-19T02:15:56.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010533722000000001 2024-04-19T02:15:56.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:15:56.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.659652+0000", 2024-04-19T02:15:56.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7148999999999999e-05 2024-04-19T02:15:56.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:15:56.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.659691+0000", 2024-04-19T02:15:56.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8724999999999999e-05 2024-04-19T02:15:56.208 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:56.208 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:15:56.208 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:56.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.208 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:2285 5.d 5:b310a433:::benchmark_data_smithi121_44835_object2284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:15:56.208 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:55.643557+0000", 2024-04-19T02:15:56.209 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.46611481100000002, 2024-04-19T02:15:56.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018865537000000002, 2024-04-19T02:15:56.209 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:15:56.209 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:56.209 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:15:56.209 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:15:56.209 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:56.209 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 2285 2024-04-19T02:15:56.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.209 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:15:56.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:15:56.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643557+0000", 2024-04-19T02:15:56.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:56.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:15:56.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643557+0000", 2024-04-19T02:15:56.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:56.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:15:56.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643556+0000", 2024-04-19T02:15:56.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:56.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:15:56.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643625+0000", 2024-04-19T02:15:56.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9393000000000005e-05 2024-04-19T02:15:56.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:15:56.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643634+0000", 2024-04-19T02:15:56.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.14e-06 2024-04-19T02:15:56.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:15:56.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643640+0000", 2024-04-19T02:15:56.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.601e-06 2024-04-19T02:15:56.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:56.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643669+0000", 2024-04-19T02:15:56.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9292999999999999e-05 2024-04-19T02:15:56.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:15:56.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643760+0000", 2024-04-19T02:15:56.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0526999999999996e-05 2024-04-19T02:15:56.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:15:56.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643892+0000", 2024-04-19T02:15:56.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000131607 2024-04-19T02:15:56.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:56.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.649122+0000", 2024-04-19T02:15:56.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052308279999999999 2024-04-19T02:15:56.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:15:56.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.662321+0000", 2024-04-19T02:15:56.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013198774999999999 2024-04-19T02:15:56.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:15:56.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.662385+0000", 2024-04-19T02:15:56.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4261e-05 2024-04-19T02:15:56.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:15:56.214 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.662422+0000", 2024-04-19T02:15:56.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.676e-05 2024-04-19T02:15:56.214 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:56.214 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:15:56.214 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:56.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.214 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:2288 5.1 5:856ac222:::benchmark_data_smithi121_44835_object2287:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:15:56.214 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:55.645410+0000", 2024-04-19T02:15:56.214 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.46426150500000002, 2024-04-19T02:15:56.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017014257000000001, 2024-04-19T02:15:56.214 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:15:56.214 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:56.214 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:15:56.215 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:15:56.215 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:56.215 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 2288 2024-04-19T02:15:56.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.215 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:15:56.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:15:56.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.645410+0000", 2024-04-19T02:15:56.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:56.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:15:56.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.645410+0000", 2024-04-19T02:15:56.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:56.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:15:56.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.645409+0000", 2024-04-19T02:15:56.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:56.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:15:56.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.645559+0000", 2024-04-19T02:15:56.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000149896 2024-04-19T02:15:56.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:15:56.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.645566+0000", 2024-04-19T02:15:56.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.024e-06 2024-04-19T02:15:56.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:15:56.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.645573+0000", 2024-04-19T02:15:56.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2870000000000001e-06 2024-04-19T02:15:56.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:56.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.649319+0000", 2024-04-19T02:15:56.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037463919999999999 2024-04-19T02:15:56.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:15:56.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.649417+0000", 2024-04-19T02:15:56.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7794999999999995e-05 2024-04-19T02:15:56.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:15:56.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.649545+0000", 2024-04-19T02:15:56.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012766399999999999 2024-04-19T02:15:56.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:56.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.651873+0000", 2024-04-19T02:15:56.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0023286090000000001 2024-04-19T02:15:56.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:15:56.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.662353+0000", 2024-04-19T02:15:56.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010479741000000001 2024-04-19T02:15:56.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:15:56.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.662390+0000", 2024-04-19T02:15:56.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7049999999999999e-05 2024-04-19T02:15:56.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:15:56.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.662424+0000", 2024-04-19T02:15:56.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4317999999999999e-05 2024-04-19T02:15:56.220 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:56.220 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:15:56.220 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:56.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.220 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:2294 5.f 5:f1bdca10:::benchmark_data_smithi121_44835_object2293:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:15:56.220 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:55.645699+0000", 2024-04-19T02:15:56.220 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.46397202999999998, 2024-04-19T02:15:56.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016652493000000001, 2024-04-19T02:15:56.220 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:15:56.220 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:56.220 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:15:56.220 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:15:56.220 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:56.221 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 2294 2024-04-19T02:15:56.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.221 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:15:56.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:15:56.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.645699+0000", 2024-04-19T02:15:56.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:56.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:15:56.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.645699+0000", 2024-04-19T02:15:56.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:56.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:15:56.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.645699+0000", 2024-04-19T02:15:56.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:56.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:15:56.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.645790+0000", 2024-04-19T02:15:56.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1139999999999998e-05 2024-04-19T02:15:56.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:15:56.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.645797+0000", 2024-04-19T02:15:56.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2749999999999998e-06 2024-04-19T02:15:56.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.223 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:15:56.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.645803+0000", 2024-04-19T02:15:56.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9109999999999998e-06 2024-04-19T02:15:56.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.223 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:56.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.645837+0000", 2024-04-19T02:15:56.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3469000000000001e-05 2024-04-19T02:15:56.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.223 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:15:56.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.645947+0000", 2024-04-19T02:15:56.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000110018 2024-04-19T02:15:56.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:15:56.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.646066+0000", 2024-04-19T02:15:56.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000118898 2024-04-19T02:15:56.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:56.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.651872+0000", 2024-04-19T02:15:56.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0058065510000000001 2024-04-19T02:15:56.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:15:56.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.662276+0000", 2024-04-19T02:15:56.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010403376000000001 2024-04-19T02:15:56.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:15:56.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.662313+0000", 2024-04-19T02:15:56.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7404999999999998e-05 2024-04-19T02:15:56.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:15:56.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.662352+0000", 2024-04-19T02:15:56.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8905000000000001e-05 2024-04-19T02:15:56.225 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:56.225 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:15:56.225 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:56.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.226 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4549.0:2290 5.5 e18/16 5:a870a399:::benchmark_data_smithi121_44835_object2289:head v 18'147, mlcod=18'145)", 2024-04-19T02:15:56.226 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:55.645955+0000", 2024-04-19T02:15:56.226 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.46371610299999999, 2024-04-19T02:15:56.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017366943999999999, 2024-04-19T02:15:56.226 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:15:56.226 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:56.226 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:15:56.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:15:56.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.645955+0000", 2024-04-19T02:15:56.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:56.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:15:56.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.645955+0000", 2024-04-19T02:15:56.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:56.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:15:56.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.645955+0000", 2024-04-19T02:15:56.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:56.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:15:56.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.646028+0000", 2024-04-19T02:15:56.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3250999999999994e-05 2024-04-19T02:15:56.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.228 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:15:56.228 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.646037+0000", 2024-04-19T02:15:56.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6780000000000006e-06 2024-04-19T02:15:56.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.228 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:15:56.228 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.646043+0000", 2024-04-19T02:15:56.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2029999999999997e-06 2024-04-19T02:15:56.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.228 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:56.228 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.649101+0000", 2024-04-19T02:15:56.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003058285 2024-04-19T02:15:56.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:15:56.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.649120+0000", 2024-04-19T02:15:56.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8822e-05 2024-04-19T02:15:56.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:15:56.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.663293+0000", 2024-04-19T02:15:56.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014172689 2024-04-19T02:15:56.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:56.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:56.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:15:56.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.663322+0000", 2024-04-19T02:15:56.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9544e-05 2024-04-19T02:15:56.229 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:56.230 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:15:56.230 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:56.230 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:56.230 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:15:56.230 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:15:56.231 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:15:56.232+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:15:56.232 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:15:56.233 DEBUG:teuthology.parallel:result is None 2024-04-19T02:15:56.233 DEBUG:teuthology.run_tasks:Unwinding manager radosbench 2024-04-19T02:15:56.242 INFO:tasks.radosbench:joining radosbench (timing out after 2100s) 2024-04-19T02:15:56.242 INFO:teuthology.orchestra.run:waiting for 2100 2024-04-19T02:15:56.332 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:15:56.332+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:15:56.411 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:15:56.411 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:15:56.411 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.411 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:5061 5.4 5:26a5db30:::benchmark_data_smithi121_44835_object5060:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-19T02:15:56.411 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:56.408800+0000", 2024-04-19T02:15:56.411 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.002070513, 2024-04-19T02:15:56.411 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.002100724, 2024-04-19T02:15:56.412 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:15:56.412 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:15:56.412 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:15:56.412 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:15:56.412 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:56.412 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 5061 2024-04-19T02:15:56.412 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.412 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:15:56.412 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.412 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:15:56.412 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.408800+0000", 2024-04-19T02:15:56.412 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.412 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.412 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.412 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:15:56.412 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.408800+0000", 2024-04-19T02:15:56.413 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.413 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.413 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.413 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:15:56.413 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.408799+0000", 2024-04-19T02:15:56.413 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:15:56.413 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.413 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.413 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:15:56.413 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.408917+0000", 2024-04-19T02:15:56.413 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011798699999999999 2024-04-19T02:15:56.413 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.413 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.413 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:15:56.413 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.408925+0000", 2024-04-19T02:15:56.414 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.4379999999999998e-06 2024-04-19T02:15:56.414 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.414 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.414 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:15:56.414 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.408930+0000", 2024-04-19T02:15:56.414 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.091e-06 2024-04-19T02:15:56.414 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.414 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.414 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:15:56.414 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.408965+0000", 2024-04-19T02:15:56.414 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5039000000000001e-05 2024-04-19T02:15:56.414 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.414 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.414 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:15:56.414 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.409099+0000", 2024-04-19T02:15:56.414 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013446700000000001 2024-04-19T02:15:56.415 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.415 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.415 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:15:56.415 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.409236+0000", 2024-04-19T02:15:56.415 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013710799999999999 2024-04-19T02:15:56.415 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.415 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:15:56.415 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.415 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.415 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.415 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:5062 5.b 5:d12434f8:::benchmark_data_smithi121_44835_object5061:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-19T02:15:56.415 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:56.408978+0000", 2024-04-19T02:15:56.415 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.001892658, 2024-04-19T02:15:56.415 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0020301080000000001, 2024-04-19T02:15:56.415 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:15:56.415 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:15:56.415 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:15:56.416 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:15:56.416 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:56.416 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 5062 2024-04-19T02:15:56.416 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.416 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:15:56.416 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.416 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:15:56.416 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.408978+0000", 2024-04-19T02:15:56.416 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.416 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.416 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.416 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:15:56.416 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.408978+0000", 2024-04-19T02:15:56.417 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.417 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.417 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.417 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:15:56.417 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.408977+0000", 2024-04-19T02:15:56.417 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:56.417 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.417 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.417 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:15:56.417 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.409087+0000", 2024-04-19T02:15:56.417 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000109677 2024-04-19T02:15:56.417 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.417 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.417 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:15:56.418 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.409095+0000", 2024-04-19T02:15:56.418 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.7479999999999993e-06 2024-04-19T02:15:56.418 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.418 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.418 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:15:56.418 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.409100+0000", 2024-04-19T02:15:56.418 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0679999999999996e-06 2024-04-19T02:15:56.418 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.418 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.418 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:15:56.418 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.409155+0000", 2024-04-19T02:15:56.418 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.4870999999999997e-05 2024-04-19T02:15:56.418 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.418 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.419 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:15:56.419 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.409263+0000", 2024-04-19T02:15:56.419 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010806699999999999 2024-04-19T02:15:56.419 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.419 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.419 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:15:56.419 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.409345+0000", 2024-04-19T02:15:56.419 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2374999999999997e-05 2024-04-19T02:15:56.419 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.419 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:15:56.419 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.419 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.419 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.419 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:5063 5.b 5:da19f49d:::benchmark_data_smithi121_44835_object5062:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-19T02:15:56.420 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:56.409105+0000", 2024-04-19T02:15:56.420 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.00176527, 2024-04-19T02:15:56.420 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0019956689999999998, 2024-04-19T02:15:56.420 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:15:56.420 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:15:56.420 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:15:56.420 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:15:56.420 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:56.420 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 5063 2024-04-19T02:15:56.420 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.420 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:15:56.420 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.420 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:15:56.420 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.409105+0000", 2024-04-19T02:15:56.420 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.421 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.421 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.421 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:15:56.421 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.409105+0000", 2024-04-19T02:15:56.421 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.421 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.421 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.421 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:15:56.421 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.409105+0000", 2024-04-19T02:15:56.421 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:56.421 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.421 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.421 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:15:56.421 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.409167+0000", 2024-04-19T02:15:56.421 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.2170999999999998e-05 2024-04-19T02:15:56.421 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.422 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.422 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:15:56.422 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.409174+0000", 2024-04-19T02:15:56.422 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.4889999999999998e-06 2024-04-19T02:15:56.422 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.422 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.422 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:15:56.422 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.409180+0000", 2024-04-19T02:15:56.422 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.1460000000000001e-06 2024-04-19T02:15:56.422 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.422 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.422 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:15:56.422 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.409639+0000", 2024-04-19T02:15:56.422 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00045854000000000001 2024-04-19T02:15:56.423 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.423 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.423 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:15:56.423 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.409715+0000", 2024-04-19T02:15:56.423 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.6038999999999995e-05 2024-04-19T02:15:56.423 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.423 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.423 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:15:56.423 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.409795+0000", 2024-04-19T02:15:56.423 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0433999999999996e-05 2024-04-19T02:15:56.423 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.423 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:15:56.423 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.423 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.423 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.423 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:5064 5.8 5:1fd10344:::benchmark_data_smithi121_44835_object5063:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-19T02:15:56.424 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:56.410631+0000", 2024-04-19T02:15:56.424 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.00023978199999999999, 2024-04-19T02:15:56.424 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00056559899999999996, 2024-04-19T02:15:56.424 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:15:56.424 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:15:56.424 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:15:56.424 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:15:56.424 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:56.424 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 5064 2024-04-19T02:15:56.424 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.424 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:15:56.424 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.424 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:15:56.424 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.410631+0000", 2024-04-19T02:15:56.424 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.425 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.425 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.425 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:15:56.425 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.410631+0000", 2024-04-19T02:15:56.425 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.425 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.425 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.425 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:15:56.425 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.410630+0000", 2024-04-19T02:15:56.425 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:56.425 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.425 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.425 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:15:56.425 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.410740+0000", 2024-04-19T02:15:56.425 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000110367 2024-04-19T02:15:56.425 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.425 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.426 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:15:56.426 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.410748+0000", 2024-04-19T02:15:56.426 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.841e-06 2024-04-19T02:15:56.426 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.426 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.426 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:15:56.426 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.410753+0000", 2024-04-19T02:15:56.426 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.7929999999999997e-06 2024-04-19T02:15:56.426 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.426 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.426 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:15:56.426 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.410782+0000", 2024-04-19T02:15:56.426 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.8478000000000001e-05 2024-04-19T02:15:56.426 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.426 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.427 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:15:56.427 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.410853+0000", 2024-04-19T02:15:56.427 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1964000000000004e-05 2024-04-19T02:15:56.427 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.427 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.427 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:15:56.427 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.410929+0000", 2024-04-19T02:15:56.427 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.6023e-05 2024-04-19T02:15:56.427 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.427 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:15:56.427 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.427 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.427 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.427 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:5069 5.b 5:db60032d:::benchmark_data_smithi121_44835_object5068:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-19T02:15:56.427 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:56.410868+0000", 2024-04-19T02:15:56.427 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 2.1119999999999999e-06, 2024-04-19T02:15:56.428 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00042311099999999999, 2024-04-19T02:15:56.428 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:15:56.428 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:15:56.428 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:15:56.428 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:15:56.428 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:56.428 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 5069 2024-04-19T02:15:56.428 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.428 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:15:56.428 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.428 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:15:56.428 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.410868+0000", 2024-04-19T02:15:56.428 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.428 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.428 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.428 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:15:56.429 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.410868+0000", 2024-04-19T02:15:56.429 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.429 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.429 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.429 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:15:56.429 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.410868+0000", 2024-04-19T02:15:56.429 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:56.429 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.429 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.429 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:15:56.429 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.410958+0000", 2024-04-19T02:15:56.429 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.9920999999999995e-05 2024-04-19T02:15:56.429 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.429 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.429 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:15:56.429 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.410967+0000", 2024-04-19T02:15:56.429 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7089999999999997e-06 2024-04-19T02:15:56.430 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.430 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.430 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:15:56.430 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.410971+0000", 2024-04-19T02:15:56.430 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.551e-06 2024-04-19T02:15:56.430 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.430 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.430 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:15:56.430 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.411010+0000", 2024-04-19T02:15:56.430 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9542999999999997e-05 2024-04-19T02:15:56.430 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.430 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.430 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:15:56.430 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.411104+0000", 2024-04-19T02:15:56.430 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3073999999999997e-05 2024-04-19T02:15:56.430 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.431 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.431 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:15:56.431 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.411211+0000", 2024-04-19T02:15:56.431 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000107818 2024-04-19T02:15:56.431 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.431 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:15:56.431 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.431 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.431 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.431 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:5070 5.0 5:03e6544b:::benchmark_data_smithi121_44835_object5069:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-19T02:15:56.431 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:56.410989+0000", 2024-04-19T02:15:56.431 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 4294967295.9998813, 2024-04-19T02:15:56.431 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000393027, 2024-04-19T02:15:56.431 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:15:56.432 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:15:56.432 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:15:56.432 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:15:56.432 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:56.432 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 5070 2024-04-19T02:15:56.432 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.432 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:15:56.432 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.432 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:15:56.432 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.410989+0000", 2024-04-19T02:15:56.432 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.432 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.432 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.432 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:15:56.432 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.410989+0000", 2024-04-19T02:15:56.432 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.432 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.433 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.433 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:15:56.433 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.410989+0000", 2024-04-19T02:15:56.433 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:56.433 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.433 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.433 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:15:56.433 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.411029+0000", 2024-04-19T02:15:56.433 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0218e-05 2024-04-19T02:15:56.433 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.433 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.433 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:15:56.433 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.411038+0000", 2024-04-19T02:15:56.433 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2769999999999994e-06 2024-04-19T02:15:56.433 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.433 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.434 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:15:56.434 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.411044+0000", 2024-04-19T02:15:56.434 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.0689999999999998e-06 2024-04-19T02:15:56.434 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.434 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.434 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:15:56.434 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.411079+0000", 2024-04-19T02:15:56.434 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4502000000000003e-05 2024-04-19T02:15:56.434 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.434 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.434 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:15:56.434 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.411166+0000", 2024-04-19T02:15:56.434 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.7466000000000006e-05 2024-04-19T02:15:56.434 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.434 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.434 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:15:56.434 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.411254+0000", 2024-04-19T02:15:56.435 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.7682000000000005e-05 2024-04-19T02:15:56.435 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.435 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:15:56.435 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.435 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.435 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.435 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:5071 5.8 5:128ee459:::benchmark_data_smithi121_44835_object5070:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-19T02:15:56.435 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:56.411186+0000", 2024-04-19T02:15:56.435 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 4294967295.9996843, 2024-04-19T02:15:56.435 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00029904299999999998, 2024-04-19T02:15:56.435 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:15:56.435 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:15:56.435 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:15:56.435 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:15:56.435 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:56.435 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 5071 2024-04-19T02:15:56.436 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.436 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:15:56.436 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.436 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:15:56.436 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.411186+0000", 2024-04-19T02:15:56.436 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.436 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.436 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.436 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:15:56.436 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.411186+0000", 2024-04-19T02:15:56.436 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.436 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.436 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.436 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:15:56.436 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.411185+0000", 2024-04-19T02:15:56.437 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:15:56.437 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.437 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.437 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:15:56.437 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.411267+0000", 2024-04-19T02:15:56.437 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2096999999999997e-05 2024-04-19T02:15:56.437 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.437 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.437 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:15:56.437 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.411277+0000", 2024-04-19T02:15:56.437 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2369999999999998e-06 2024-04-19T02:15:56.437 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.437 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.437 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:15:56.437 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.411284+0000", 2024-04-19T02:15:56.437 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.0509999999999999e-06 2024-04-19T02:15:56.438 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.438 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.438 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:15:56.438 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.411312+0000", 2024-04-19T02:15:56.438 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.8113999999999999e-05 2024-04-19T02:15:56.438 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.438 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.438 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:15:56.438 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.411394+0000", 2024-04-19T02:15:56.438 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2606000000000002e-05 2024-04-19T02:15:56.438 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.438 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:15:56.438 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.438 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.438 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.438 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:5065 5.a e19/16 5:50af10a0:::benchmark_data_smithi121_44835_object5064:head v 19'310, mlcod=19'308)", 2024-04-19T02:15:56.438 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:56.411255+0000", 2024-04-19T02:15:56.439 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 4294967295.9996157, 2024-04-19T02:15:56.439 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00030858600000000002, 2024-04-19T02:15:56.439 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:15:56.439 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:15:56.439 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:15:56.439 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.439 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:15:56.439 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.411255+0000", 2024-04-19T02:15:56.439 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.439 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.439 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.439 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:15:56.440 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.411255+0000", 2024-04-19T02:15:56.440 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.440 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.440 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.440 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:15:56.440 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.411254+0000", 2024-04-19T02:15:56.440 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:56.440 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.440 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.440 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:15:56.440 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.411372+0000", 2024-04-19T02:15:56.440 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011818 2024-04-19T02:15:56.440 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.440 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.440 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:15:56.440 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.411382+0000", 2024-04-19T02:15:56.441 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.1390000000000001e-06 2024-04-19T02:15:56.441 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.441 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.441 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:15:56.441 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.411388+0000", 2024-04-19T02:15:56.441 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.3300000000000004e-06 2024-04-19T02:15:56.441 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.441 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.441 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:15:56.441 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.411423+0000", 2024-04-19T02:15:56.441 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5098000000000002e-05 2024-04-19T02:15:56.441 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.441 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.441 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:15:56.441 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.411443+0000", 2024-04-19T02:15:56.442 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.0222999999999999e-05 2024-04-19T02:15:56.442 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.442 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:15:56.442 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.442 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.442 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.442 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:5068 5.9 e19/16 5:96b5d7f7:::benchmark_data_smithi121_44835_object5067:head v 19'318, mlcod=19'316)", 2024-04-19T02:15:56.442 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:56.411314+0000", 2024-04-19T02:15:56.442 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 4294967295.999557, 2024-04-19T02:15:56.442 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00031984299999999999, 2024-04-19T02:15:56.442 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:15:56.442 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:15:56.442 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:15:56.442 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.442 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:15:56.443 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.411314+0000", 2024-04-19T02:15:56.443 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.443 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.443 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.443 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:15:56.443 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.411314+0000", 2024-04-19T02:15:56.443 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.443 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.443 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.443 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:15:56.443 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.411313+0000", 2024-04-19T02:15:56.443 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:56.443 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.443 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.443 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:15:56.444 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.411377+0000", 2024-04-19T02:15:56.444 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.3826999999999997e-05 2024-04-19T02:15:56.444 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.444 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.444 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:15:56.444 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.411384+0000", 2024-04-19T02:15:56.444 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.6299999999999998e-06 2024-04-19T02:15:56.444 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.444 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.444 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:15:56.444 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.411390+0000", 2024-04-19T02:15:56.444 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.4070000000000001e-06 2024-04-19T02:15:56.444 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.445 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.445 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:15:56.445 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.411432+0000", 2024-04-19T02:15:56.445 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2162000000000001e-05 2024-04-19T02:15:56.445 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.445 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.445 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:15:56.445 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.411450+0000", 2024-04-19T02:15:56.445 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.8189000000000002e-05 2024-04-19T02:15:56.445 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.445 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:15:56.445 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.445 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.445 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.445 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:5058 5.e 5:7bf918f1:::benchmark_data_smithi121_44835_object5057:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-19T02:15:56.446 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:56.407947+0000", 2024-04-19T02:15:56.446 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0029237669999999999, 2024-04-19T02:15:56.446 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0037575690000000001, 2024-04-19T02:15:56.446 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:15:56.446 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:15:56.446 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:15:56.446 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:15:56.446 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:56.446 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 5058 2024-04-19T02:15:56.446 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.446 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:15:56.446 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.446 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:15:56.447 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.407947+0000", 2024-04-19T02:15:56.447 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.447 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.447 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.447 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:15:56.447 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.407947+0000", 2024-04-19T02:15:56.447 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.447 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.447 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.447 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:15:56.447 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.407946+0000", 2024-04-19T02:15:56.447 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:56.447 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.447 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.447 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:15:56.448 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.407983+0000", 2024-04-19T02:15:56.448 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7338000000000001e-05 2024-04-19T02:15:56.448 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.448 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.448 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:15:56.448 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.407991+0000", 2024-04-19T02:15:56.448 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.4900000000000003e-06 2024-04-19T02:15:56.448 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.448 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.448 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:15:56.448 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.407998+0000", 2024-04-19T02:15:56.448 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5819999999999998e-06 2024-04-19T02:15:56.448 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.449 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.449 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:15:56.449 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.408044+0000", 2024-04-19T02:15:56.449 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.6350999999999997e-05 2024-04-19T02:15:56.449 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.449 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.449 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:15:56.449 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.408189+0000", 2024-04-19T02:15:56.449 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014496999999999999 2024-04-19T02:15:56.449 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.449 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.449 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:15:56.449 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.408353+0000", 2024-04-19T02:15:56.449 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000163788 2024-04-19T02:15:56.449 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.449 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.449 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:15:56.450 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.409217+0000", 2024-04-19T02:15:56.450 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00086439799999999995 2024-04-19T02:15:56.450 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.450 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:15:56.450 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.450 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.450 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.450 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:5059 5.b 5:d96bd99a:::benchmark_data_smithi121_44835_object5058:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-19T02:15:56.450 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:56.408136+0000", 2024-04-19T02:15:56.450 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0027343659999999998, 2024-04-19T02:15:56.450 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0036544170000000001, 2024-04-19T02:15:56.450 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:15:56.450 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:15:56.450 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:15:56.451 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:15:56.451 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:56.451 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 5059 2024-04-19T02:15:56.451 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.451 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:15:56.451 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.451 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:15:56.451 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.408136+0000", 2024-04-19T02:15:56.451 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.451 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.451 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.451 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:15:56.451 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.408136+0000", 2024-04-19T02:15:56.451 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.451 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.451 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.451 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:15:56.452 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.408135+0000", 2024-04-19T02:15:56.452 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:56.452 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.452 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.452 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:15:56.452 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.408245+0000", 2024-04-19T02:15:56.452 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0001092 2024-04-19T02:15:56.452 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.452 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.452 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:15:56.452 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.408252+0000", 2024-04-19T02:15:56.452 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.9480000000000002e-06 2024-04-19T02:15:56.452 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.452 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.452 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:15:56.452 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.408258+0000", 2024-04-19T02:15:56.452 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.9429999999999997e-06 2024-04-19T02:15:56.453 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.453 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.453 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:15:56.453 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.408426+0000", 2024-04-19T02:15:56.453 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00016868300000000001 2024-04-19T02:15:56.453 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.453 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.453 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:15:56.453 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.408572+0000", 2024-04-19T02:15:56.453 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014622699999999999 2024-04-19T02:15:56.453 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.453 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.453 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:15:56.453 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.408692+0000", 2024-04-19T02:15:56.453 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000120015 2024-04-19T02:15:56.453 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.453 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:15:56.454 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.454 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.454 INFO:teuthology.orchestra.run.smithi174.stdout: ], 2024-04-19T02:15:56.454 INFO:teuthology.orchestra.run.smithi174.stdout: "num_ops": 11 2024-04-19T02:15:56.454 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:15:56.455 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:15:56.455+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:15:56.456 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:15:56.556 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:15:56.557+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:15:56.620 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:15:56.621 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [], 2024-04-19T02:15:56.621 INFO:teuthology.orchestra.run.smithi174.stdout: "complaint_time": 30, 2024-04-19T02:15:56.621 INFO:teuthology.orchestra.run.smithi174.stdout: "num_blocked_ops": 0 2024-04-19T02:15:56.621 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:15:56.633 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:15:56.677 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:15:56.678+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:15:56.758 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:15:56.759+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:15:56.802 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:15:56.802 INFO:teuthology.orchestra.run.smithi174.stdout: "size": 20, 2024-04-19T02:15:56.802 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 600, 2024-04-19T02:15:56.802 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:15:56.802 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.802 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:10 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:15:56.802 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269877+0000", 2024-04-19T02:15:56.802 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 27.530697525000001, 2024-04-19T02:15:56.803 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020732751000000001, 2024-04-19T02:15:56.803 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:15:56.803 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:56.803 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:15:56.803 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.803 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:15:56.803 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269877+0000", 2024-04-19T02:15:56.803 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.803 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.803 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.803 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:15:56.803 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269877+0000", 2024-04-19T02:15:56.803 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.803 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.803 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.804 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:15:56.804 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269875+0000", 2024-04-19T02:15:56.804 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:15:56.804 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.804 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.804 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:15:56.804 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269891+0000", 2024-04-19T02:15:56.804 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.5494000000000001e-05 2024-04-19T02:15:56.804 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.804 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.804 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:15:56.804 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269903+0000", 2024-04-19T02:15:56.804 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2003e-05 2024-04-19T02:15:56.805 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.805 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.805 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:15:56.805 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269914+0000", 2024-04-19T02:15:56.805 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0947e-05 2024-04-19T02:15:56.805 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.805 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.805 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:15:56.805 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269971+0000", 2024-04-19T02:15:56.805 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7036000000000001e-05 2024-04-19T02:15:56.805 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.805 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.805 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:15:56.805 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269979+0000", 2024-04-19T02:15:56.805 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.6660000000000008e-06 2024-04-19T02:15:56.806 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.806 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.806 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:15:56.806 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284891+0000", 2024-04-19T02:15:56.806 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014912584 2024-04-19T02:15:56.806 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.806 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.806 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:15:56.806 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285213+0000", 2024-04-19T02:15:56.806 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00032172199999999998 2024-04-19T02:15:56.806 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.806 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.806 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:15:56.807 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285357+0000", 2024-04-19T02:15:56.807 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014367899999999999 2024-04-19T02:15:56.807 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.807 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.807 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:15:56.807 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288883+0000", 2024-04-19T02:15:56.807 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0035268719999999999 2024-04-19T02:15:56.807 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.807 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.807 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:56.807 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290537+0000", 2024-04-19T02:15:56.807 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016537399999999999 2024-04-19T02:15:56.807 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.807 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.807 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:15:56.807 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290576+0000", 2024-04-19T02:15:56.808 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9266e-05 2024-04-19T02:15:56.808 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.808 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.808 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:15:56.808 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290609+0000", 2024-04-19T02:15:56.808 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2818000000000003e-05 2024-04-19T02:15:56.808 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.808 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:15:56.808 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.808 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.808 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.808 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:11 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:15:56.808 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:15:56.809 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 27.530644603999999, 2024-04-19T02:15:56.809 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020352748, 2024-04-19T02:15:56.809 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:15:56.809 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:56.809 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:15:56.809 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.809 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:15:56.809 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:15:56.809 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.809 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.809 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.809 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:15:56.809 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:15:56.809 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.810 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.810 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.810 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:15:56.810 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:15:56.810 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:56.810 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.810 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.810 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:15:56.810 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269933+0000", 2024-04-19T02:15:56.810 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2169999999999996e-06 2024-04-19T02:15:56.810 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.810 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.810 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:15:56.811 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269940+0000", 2024-04-19T02:15:56.811 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1500000000000002e-06 2024-04-19T02:15:56.811 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.811 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.811 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:15:56.811 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269948+0000", 2024-04-19T02:15:56.811 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.8690000000000004e-06 2024-04-19T02:15:56.811 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.811 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.811 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:15:56.811 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:15:56.811 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2994999999999997e-05 2024-04-19T02:15:56.811 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.811 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.811 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:15:56.811 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269997+0000", 2024-04-19T02:15:56.812 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.9020000000000004e-06 2024-04-19T02:15:56.812 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.812 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.812 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:15:56.812 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.282729+0000", 2024-04-19T02:15:56.812 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.012732537 2024-04-19T02:15:56.812 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.812 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.812 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:15:56.812 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.282838+0000", 2024-04-19T02:15:56.812 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000108298 2024-04-19T02:15:56.812 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.812 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.812 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:15:56.812 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.283002+0000", 2024-04-19T02:15:56.813 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00016466300000000001 2024-04-19T02:15:56.813 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.813 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.813 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:15:56.813 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288708+0000", 2024-04-19T02:15:56.813 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.005705066 2024-04-19T02:15:56.813 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.813 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.813 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:56.813 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290215+0000", 2024-04-19T02:15:56.813 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0015075010000000001 2024-04-19T02:15:56.813 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.813 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.813 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:15:56.814 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290259+0000", 2024-04-19T02:15:56.814 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3711999999999998e-05 2024-04-19T02:15:56.814 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.814 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.814 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:15:56.814 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290282+0000", 2024-04-19T02:15:56.814 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3458000000000001e-05 2024-04-19T02:15:56.814 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.814 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:15:56.814 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.814 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.814 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.814 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:14 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:15:56.814 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:15:56.815 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 27.530610813999999, 2024-04-19T02:15:56.815 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020137202, 2024-04-19T02:15:56.815 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:15:56.815 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:56.815 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:15:56.815 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.815 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:15:56.815 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:15:56.815 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.815 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.815 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.815 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:15:56.815 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:15:56.816 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.816 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.816 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.816 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:15:56.816 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:15:56.816 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:56.816 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.816 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.816 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:15:56.816 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269971+0000", 2024-04-19T02:15:56.816 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.5459999999999992e-06 2024-04-19T02:15:56.816 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.817 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.817 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:15:56.817 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269979+0000", 2024-04-19T02:15:56.817 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9130000000000003e-06 2024-04-19T02:15:56.817 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.817 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.817 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:15:56.817 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269986+0000", 2024-04-19T02:15:56.817 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.3779999999999998e-06 2024-04-19T02:15:56.817 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.817 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.817 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:15:56.817 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270030+0000", 2024-04-19T02:15:56.817 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3982e-05 2024-04-19T02:15:56.818 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.818 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.818 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:15:56.818 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270034+0000", 2024-04-19T02:15:56.818 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1779999999999996e-06 2024-04-19T02:15:56.818 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.818 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.818 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:15:56.818 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.277870+0000", 2024-04-19T02:15:56.818 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0078362150000000005 2024-04-19T02:15:56.818 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.818 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.818 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:15:56.818 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.278216+0000", 2024-04-19T02:15:56.818 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00034634999999999999 2024-04-19T02:15:56.819 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.819 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.819 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:15:56.819 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.278732+0000", 2024-04-19T02:15:56.819 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00051536099999999999 2024-04-19T02:15:56.819 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.819 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.819 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:15:56.819 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.287694+0000", 2024-04-19T02:15:56.819 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0089621019999999996 2024-04-19T02:15:56.819 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.819 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.819 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:56.819 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290026+0000", 2024-04-19T02:15:56.820 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0023323139999999998 2024-04-19T02:15:56.820 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.820 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.820 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:15:56.820 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290067+0000", 2024-04-19T02:15:56.820 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1043e-05 2024-04-19T02:15:56.820 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.820 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.820 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:15:56.820 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290100+0000", 2024-04-19T02:15:56.820 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3278999999999998e-05 2024-04-19T02:15:56.820 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.820 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:15:56.820 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.820 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.821 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.821 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:15:56.821 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:15:56.821 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 27.530579022000001, 2024-04-19T02:15:56.821 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020731702000000001, 2024-04-19T02:15:56.821 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:15:56.821 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:56.821 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:15:56.821 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.821 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:15:56.821 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:15:56.821 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.821 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.821 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.821 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:15:56.822 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:15:56.822 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.822 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.822 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.822 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:15:56.822 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:15:56.822 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:56.822 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.822 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.822 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:15:56.822 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269998+0000", 2024-04-19T02:15:56.822 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7100000000000001e-06 2024-04-19T02:15:56.822 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.823 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.823 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:15:56.823 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270005+0000", 2024-04-19T02:15:56.823 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.241e-06 2024-04-19T02:15:56.823 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.823 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.823 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:15:56.823 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270011+0000", 2024-04-19T02:15:56.823 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6279999999999999e-06 2024-04-19T02:15:56.823 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.823 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.823 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:15:56.823 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270046+0000", 2024-04-19T02:15:56.823 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5173999999999999e-05 2024-04-19T02:15:56.823 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.824 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.824 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:15:56.824 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:15:56.824 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0019999999999997e-06 2024-04-19T02:15:56.824 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.824 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.824 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:15:56.824 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285619+0000", 2024-04-19T02:15:56.824 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015567391 2024-04-19T02:15:56.824 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.825 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.825 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:15:56.825 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285671+0000", 2024-04-19T02:15:56.825 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2460999999999998e-05 2024-04-19T02:15:56.825 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.825 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.825 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:15:56.825 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285775+0000", 2024-04-19T02:15:56.825 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000103389 2024-04-19T02:15:56.825 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.825 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.825 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:15:56.825 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288934+0000", 2024-04-19T02:15:56.825 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0031595859999999998 2024-04-19T02:15:56.826 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.826 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.826 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:56.826 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290650+0000", 2024-04-19T02:15:56.826 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001716242 2024-04-19T02:15:56.826 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.826 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.826 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:15:56.826 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290692+0000", 2024-04-19T02:15:56.826 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1910999999999999e-05 2024-04-19T02:15:56.826 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.826 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.826 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:15:56.826 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290727+0000", 2024-04-19T02:15:56.827 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4412000000000002e-05 2024-04-19T02:15:56.827 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.827 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:15:56.827 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.827 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.827 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.827 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:15:56.827 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270019+0000", 2024-04-19T02:15:56.827 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 27.530555426999999, 2024-04-19T02:15:56.827 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020572014999999999, 2024-04-19T02:15:56.827 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:15:56.827 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:56.827 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:15:56.827 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.828 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:15:56.828 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270019+0000", 2024-04-19T02:15:56.828 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.828 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.828 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.828 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:15:56.828 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270019+0000", 2024-04-19T02:15:56.828 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.828 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.828 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.828 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:15:56.828 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270018+0000", 2024-04-19T02:15:56.828 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:56.828 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.828 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.829 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:15:56.829 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270021+0000", 2024-04-19T02:15:56.829 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0319999999999999e-06 2024-04-19T02:15:56.829 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.829 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.829 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:15:56.829 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270028+0000", 2024-04-19T02:15:56.829 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6189999999999996e-06 2024-04-19T02:15:56.829 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.829 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.829 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:15:56.829 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270035+0000", 2024-04-19T02:15:56.829 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1690000000000003e-06 2024-04-19T02:15:56.830 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.830 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.830 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:15:56.830 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270078+0000", 2024-04-19T02:15:56.830 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3061e-05 2024-04-19T02:15:56.830 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.830 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.830 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:15:56.830 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270082+0000", 2024-04-19T02:15:56.830 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4510000000000002e-06 2024-04-19T02:15:56.830 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.830 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.830 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:15:56.830 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284354+0000", 2024-04-19T02:15:56.831 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014271588999999999 2024-04-19T02:15:56.831 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.831 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.831 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:15:56.831 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284497+0000", 2024-04-19T02:15:56.831 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014335800000000001 2024-04-19T02:15:56.831 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.831 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.831 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:15:56.831 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284626+0000", 2024-04-19T02:15:56.831 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000128744 2024-04-19T02:15:56.831 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.831 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.831 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:15:56.831 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288844+0000", 2024-04-19T02:15:56.832 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00421807 2024-04-19T02:15:56.832 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.832 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.832 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:56.832 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290508+0000", 2024-04-19T02:15:56.832 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001663774 2024-04-19T02:15:56.832 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.832 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.832 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:15:56.832 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290556+0000", 2024-04-19T02:15:56.832 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.7599999999999998e-05 2024-04-19T02:15:56.832 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.832 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.832 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:15:56.833 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290591+0000", 2024-04-19T02:15:56.833 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5034999999999999e-05 2024-04-19T02:15:56.833 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.833 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:15:56.833 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.833 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.833 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.833 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:15:56.833 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:15:56.833 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 27.530532564000001, 2024-04-19T02:15:56.833 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020192280999999999, 2024-04-19T02:15:56.833 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:15:56.833 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:56.834 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:15:56.834 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.834 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:15:56.834 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:15:56.834 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.834 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.834 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.834 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:15:56.834 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:15:56.834 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.834 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.834 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.834 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:15:56.834 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:15:56.835 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:56.835 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.835 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.835 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:15:56.835 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270045+0000", 2024-04-19T02:15:56.835 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8680000000000001e-06 2024-04-19T02:15:56.835 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.835 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.835 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:15:56.835 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270052+0000", 2024-04-19T02:15:56.835 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.9999999999999999e-06 2024-04-19T02:15:56.835 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.835 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.835 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:15:56.835 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270056+0000", 2024-04-19T02:15:56.836 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4479999999999996e-06 2024-04-19T02:15:56.836 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.836 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.836 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:15:56.836 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270089+0000", 2024-04-19T02:15:56.836 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3071000000000002e-05 2024-04-19T02:15:56.836 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.836 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.836 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:15:56.836 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270092+0000", 2024-04-19T02:15:56.836 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9780000000000001e-06 2024-04-19T02:15:56.836 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.836 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.836 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:15:56.836 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.280632+0000", 2024-04-19T02:15:56.837 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010539712 2024-04-19T02:15:56.837 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.837 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.837 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:15:56.837 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.280743+0000", 2024-04-19T02:15:56.837 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000111048 2024-04-19T02:15:56.837 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.837 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.837 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:15:56.837 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.281531+0000", 2024-04-19T02:15:56.837 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00078738199999999999 2024-04-19T02:15:56.837 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.837 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.837 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:15:56.837 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.287949+0000", 2024-04-19T02:15:56.838 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0064185730000000003 2024-04-19T02:15:56.838 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.838 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.838 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:56.838 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290184+0000", 2024-04-19T02:15:56.838 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0022350849999999999 2024-04-19T02:15:56.838 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.838 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.838 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:15:56.838 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290209+0000", 2024-04-19T02:15:56.838 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4907000000000001e-05 2024-04-19T02:15:56.838 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.838 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.839 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:15:56.839 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290234+0000", 2024-04-19T02:15:56.839 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4666999999999999e-05 2024-04-19T02:15:56.839 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.839 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:15:56.839 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.839 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.839 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.839 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:19 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:15:56.839 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:15:56.839 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 27.530511098000002, 2024-04-19T02:15:56.839 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020818203, 2024-04-19T02:15:56.839 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:15:56.839 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:56.840 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:15:56.840 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.840 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:15:56.840 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:15:56.840 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.840 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.840 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.840 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:15:56.840 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:15:56.840 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.840 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.840 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.840 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:15:56.840 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:15:56.840 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:56.841 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.841 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.841 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:15:56.841 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270065+0000", 2024-04-19T02:15:56.841 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4310000000000001e-06 2024-04-19T02:15:56.841 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.841 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.841 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:15:56.841 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270070+0000", 2024-04-19T02:15:56.841 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2859999999999999e-06 2024-04-19T02:15:56.841 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.841 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.841 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:15:56.841 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270077+0000", 2024-04-19T02:15:56.842 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5270000000000004e-06 2024-04-19T02:15:56.842 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.842 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.842 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:15:56.842 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270107+0000", 2024-04-19T02:15:56.842 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0205999999999998e-05 2024-04-19T02:15:56.842 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.842 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.842 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:15:56.842 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270111+0000", 2024-04-19T02:15:56.842 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8650000000000003e-06 2024-04-19T02:15:56.843 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.843 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.843 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:15:56.843 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285936+0000", 2024-04-19T02:15:56.843 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015824677999999998 2024-04-19T02:15:56.843 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.843 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.843 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:15:56.843 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286007+0000", 2024-04-19T02:15:56.843 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1157999999999999e-05 2024-04-19T02:15:56.843 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.843 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.843 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:15:56.844 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286086+0000", 2024-04-19T02:15:56.844 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9084000000000004e-05 2024-04-19T02:15:56.844 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.844 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.844 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:15:56.844 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290740+0000", 2024-04-19T02:15:56.844 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0046543679999999999 2024-04-19T02:15:56.844 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.844 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.844 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:56.844 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290833+0000", 2024-04-19T02:15:56.844 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2551000000000002e-05 2024-04-19T02:15:56.844 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.844 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.845 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:15:56.845 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290859+0000", 2024-04-19T02:15:56.845 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.6696999999999999e-05 2024-04-19T02:15:56.845 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.845 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.845 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:15:56.845 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290881+0000", 2024-04-19T02:15:56.845 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1653000000000001e-05 2024-04-19T02:15:56.845 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.845 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:15:56.845 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.845 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.845 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.845 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:22 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:15:56.846 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270081+0000", 2024-04-19T02:15:56.846 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 27.530492824, 2024-04-19T02:15:56.846 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014566841000000001, 2024-04-19T02:15:56.846 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:15:56.846 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:15:56.846 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:15:56.846 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.846 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:15:56.846 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270081+0000", 2024-04-19T02:15:56.846 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.846 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.846 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.846 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:15:56.847 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270081+0000", 2024-04-19T02:15:56.847 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.847 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.847 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.847 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:15:56.847 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270081+0000", 2024-04-19T02:15:56.847 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:56.847 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.847 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.847 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:15:56.847 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270083+0000", 2024-04-19T02:15:56.847 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.21e-06 2024-04-19T02:15:56.847 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.847 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.847 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:15:56.848 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270100+0000", 2024-04-19T02:15:56.848 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.7045e-05 2024-04-19T02:15:56.848 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.848 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.848 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:15:56.848 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270106+0000", 2024-04-19T02:15:56.848 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.6710000000000004e-06 2024-04-19T02:15:56.848 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.848 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.848 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:15:56.848 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270134+0000", 2024-04-19T02:15:56.848 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.8192999999999999e-05 2024-04-19T02:15:56.848 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.848 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.848 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:15:56.848 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270137+0000", 2024-04-19T02:15:56.849 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.117e-06 2024-04-19T02:15:56.849 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.849 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.849 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:15:56.849 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.275452+0000", 2024-04-19T02:15:56.849 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0053144389999999998 2024-04-19T02:15:56.849 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.849 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.849 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:15:56.849 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.275576+0000", 2024-04-19T02:15:56.849 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012455800000000001 2024-04-19T02:15:56.849 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.849 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.849 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:15:56.849 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284648+0000", 2024-04-19T02:15:56.850 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0090719689999999992 2024-04-19T02:15:56.850 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.850 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:15:56.850 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.850 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.850 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.850 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:25 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:15:56.850 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270117+0000", 2024-04-19T02:15:56.850 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 27.530457165000001, 2024-04-19T02:15:56.850 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010133444, 2024-04-19T02:15:56.850 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:15:56.850 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:15:56.850 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:15:56.851 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.851 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:15:56.851 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270117+0000", 2024-04-19T02:15:56.851 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.851 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.851 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.851 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:15:56.851 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270117+0000", 2024-04-19T02:15:56.851 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.851 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.851 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.851 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:15:56.851 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270116+0000", 2024-04-19T02:15:56.851 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:56.851 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.852 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.852 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:15:56.852 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270120+0000", 2024-04-19T02:15:56.852 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1990000000000002e-06 2024-04-19T02:15:56.852 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.852 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.852 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:15:56.852 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270125+0000", 2024-04-19T02:15:56.852 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.4689999999999996e-06 2024-04-19T02:15:56.852 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.852 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.852 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:15:56.852 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270129+0000", 2024-04-19T02:15:56.852 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0080000000000004e-06 2024-04-19T02:15:56.852 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.853 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.853 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:15:56.853 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270163+0000", 2024-04-19T02:15:56.853 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4227999999999998e-05 2024-04-19T02:15:56.853 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.853 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.853 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:15:56.853 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270169+0000", 2024-04-19T02:15:56.853 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2920000000000003e-06 2024-04-19T02:15:56.853 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.853 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.853 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:15:56.853 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.275284+0000", 2024-04-19T02:15:56.853 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0051157770000000002 2024-04-19T02:15:56.854 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.854 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.854 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:15:56.854 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.275450+0000", 2024-04-19T02:15:56.854 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00016537 2024-04-19T02:15:56.854 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.854 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.854 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:15:56.854 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.280250+0000", 2024-04-19T02:15:56.854 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00480066 2024-04-19T02:15:56.854 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.854 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:15:56.854 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.854 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.854 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.855 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(mds.0.3:20 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-19T02:15:56.855 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.277828+0000", 2024-04-19T02:15:56.855 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 27.522746456, 2024-04-19T02:15:56.855 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010186172, 2024-04-19T02:15:56.855 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:15:56.855 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:56.855 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:15:56.855 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.855 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:15:56.855 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.277828+0000", 2024-04-19T02:15:56.855 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.855 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.855 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.856 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:15:56.856 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.277828+0000", 2024-04-19T02:15:56.856 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.856 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.856 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.856 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:15:56.856 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.277827+0000", 2024-04-19T02:15:56.856 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:56.856 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.856 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.856 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:15:56.856 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.277832+0000", 2024-04-19T02:15:56.856 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.7430000000000002e-06 2024-04-19T02:15:56.857 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.857 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.857 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:15:56.857 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.277838+0000", 2024-04-19T02:15:56.857 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.0270000000000001e-06 2024-04-19T02:15:56.857 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.857 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.857 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:15:56.857 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.277844+0000", 2024-04-19T02:15:56.857 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.1040000000000003e-06 2024-04-19T02:15:56.857 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.857 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.857 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:15:56.858 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.281410+0000", 2024-04-19T02:15:56.858 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0035658249999999999 2024-04-19T02:15:56.858 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.858 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.858 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:15:56.858 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.281432+0000", 2024-04-19T02:15:56.858 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1630000000000001e-05 2024-04-19T02:15:56.858 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.858 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.858 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:15:56.858 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.287983+0000", 2024-04-19T02:15:56.858 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0065510799999999999 2024-04-19T02:15:56.859 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.859 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.859 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:15:56.859 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288014+0000", 2024-04-19T02:15:56.859 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1047999999999998e-05 2024-04-19T02:15:56.859 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.859 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:15:56.859 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.859 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.859 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.859 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:110 5.b 5:d74a8f5e:::benchmark_data_smithi121_44835_object109:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:15:56.859 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:55.057013+0000", 2024-04-19T02:15:56.859 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 1.7435609400000001, 2024-04-19T02:15:56.860 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.011467052, 2024-04-19T02:15:56.860 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:15:56.860 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:56.860 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:15:56.860 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:15:56.860 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:56.860 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 110 2024-04-19T02:15:56.860 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.860 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:15:56.860 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.860 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:15:56.860 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057013+0000", 2024-04-19T02:15:56.860 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.860 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.860 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.861 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:15:56.861 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057013+0000", 2024-04-19T02:15:56.861 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.861 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.861 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.861 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:15:56.861 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057012+0000", 2024-04-19T02:15:56.861 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:56.861 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.861 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.861 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:15:56.861 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057115+0000", 2024-04-19T02:15:56.861 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010210299999999999 2024-04-19T02:15:56.862 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.862 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.862 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:15:56.862 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057123+0000", 2024-04-19T02:15:56.862 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2470000000000008e-06 2024-04-19T02:15:56.862 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.862 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.862 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:15:56.862 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057129+0000", 2024-04-19T02:15:56.862 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6000000000000003e-06 2024-04-19T02:15:56.862 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.862 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.862 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:15:56.863 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057296+0000", 2024-04-19T02:15:56.863 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000166398 2024-04-19T02:15:56.863 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.863 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.863 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:15:56.863 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057419+0000", 2024-04-19T02:15:56.863 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012348799999999999 2024-04-19T02:15:56.863 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.863 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.863 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:15:56.863 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057533+0000", 2024-04-19T02:15:56.863 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000113736 2024-04-19T02:15:56.863 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.864 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.864 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:15:56.864 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.059021+0000", 2024-04-19T02:15:56.864 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001488135 2024-04-19T02:15:56.864 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.864 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.864 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:56.864 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.068402+0000", 2024-04-19T02:15:56.864 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0093810000000000004 2024-04-19T02:15:56.864 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.864 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.864 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:15:56.864 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.068447+0000", 2024-04-19T02:15:56.864 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4876000000000002e-05 2024-04-19T02:15:56.865 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.865 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.865 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:15:56.865 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.068480+0000", 2024-04-19T02:15:56.865 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3154000000000001e-05 2024-04-19T02:15:56.865 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.865 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:15:56.865 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.865 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.865 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.865 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:111 5.b 5:d905127a:::benchmark_data_smithi121_44835_object110:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:15:56.865 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:55.057138+0000", 2024-04-19T02:15:56.865 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 1.743435836, 2024-04-19T02:15:56.865 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.011436411, 2024-04-19T02:15:56.866 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:15:56.866 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:56.866 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:15:56.866 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:15:56.866 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:56.866 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 111 2024-04-19T02:15:56.866 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.866 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:15:56.866 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.866 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:15:56.866 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057138+0000", 2024-04-19T02:15:56.866 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.866 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.866 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.867 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:15:56.867 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057138+0000", 2024-04-19T02:15:56.867 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.867 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.867 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.867 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:15:56.867 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057138+0000", 2024-04-19T02:15:56.867 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:56.867 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.867 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.867 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:15:56.867 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057200+0000", 2024-04-19T02:15:56.867 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.2469000000000001e-05 2024-04-19T02:15:56.868 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.868 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.868 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:15:56.868 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057211+0000", 2024-04-19T02:15:56.868 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.066e-05 2024-04-19T02:15:56.868 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.868 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.868 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:15:56.868 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057217+0000", 2024-04-19T02:15:56.868 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5729999999999996e-06 2024-04-19T02:15:56.868 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.868 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.869 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:15:56.869 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057792+0000", 2024-04-19T02:15:56.869 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000574959 2024-04-19T02:15:56.869 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.869 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.869 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:15:56.869 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057867+0000", 2024-04-19T02:15:56.869 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.4493999999999995e-05 2024-04-19T02:15:56.869 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.869 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.869 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:15:56.869 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057948+0000", 2024-04-19T02:15:56.869 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.1458999999999994e-05 2024-04-19T02:15:56.869 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.869 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.870 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:15:56.870 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.059050+0000", 2024-04-19T02:15:56.870 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001102029 2024-04-19T02:15:56.870 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.870 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.870 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:56.870 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.068529+0000", 2024-04-19T02:15:56.870 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0094792499999999998 2024-04-19T02:15:56.870 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.870 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.870 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:15:56.870 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.068557+0000", 2024-04-19T02:15:56.871 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7118999999999999e-05 2024-04-19T02:15:56.871 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.871 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.871 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:15:56.871 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.068575+0000", 2024-04-19T02:15:56.871 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.8065000000000001e-05 2024-04-19T02:15:56.871 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.871 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:15:56.871 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.871 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.871 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.871 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:116 5.4 5:28d9d93e:::benchmark_data_smithi121_44835_object115:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:15:56.871 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:55.057602+0000", 2024-04-19T02:15:56.872 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 1.742971968, 2024-04-19T02:15:56.872 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010969147, 2024-04-19T02:15:56.872 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:15:56.872 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:56.872 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:15:56.872 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:15:56.872 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:56.872 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 116 2024-04-19T02:15:56.872 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.872 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:15:56.872 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.872 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:15:56.872 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057602+0000", 2024-04-19T02:15:56.872 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.872 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.873 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.873 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:15:56.873 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057602+0000", 2024-04-19T02:15:56.873 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.873 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.873 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.873 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:15:56.873 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057601+0000", 2024-04-19T02:15:56.873 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:15:56.873 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.873 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.873 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:15:56.873 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057757+0000", 2024-04-19T02:15:56.873 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00015546200000000001 2024-04-19T02:15:56.873 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.873 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.874 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:15:56.874 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057772+0000", 2024-04-19T02:15:56.874 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.5094e-05 2024-04-19T02:15:56.874 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.874 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.874 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:15:56.874 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057779+0000", 2024-04-19T02:15:56.874 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.046e-06 2024-04-19T02:15:56.874 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.874 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.874 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:15:56.874 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057818+0000", 2024-04-19T02:15:56.874 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8915000000000003e-05 2024-04-19T02:15:56.874 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.875 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.875 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:15:56.875 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057929+0000", 2024-04-19T02:15:56.875 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011114499999999999 2024-04-19T02:15:56.875 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.875 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.875 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:15:56.875 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.058064+0000", 2024-04-19T02:15:56.875 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013497699999999999 2024-04-19T02:15:56.875 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.875 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.875 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:15:56.875 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.059068+0000", 2024-04-19T02:15:56.875 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0010040400000000001 2024-04-19T02:15:56.875 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.876 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.876 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:56.876 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.068496+0000", 2024-04-19T02:15:56.876 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0094283790000000006 2024-04-19T02:15:56.876 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.876 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.876 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:15:56.876 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.068538+0000", 2024-04-19T02:15:56.876 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1909000000000001e-05 2024-04-19T02:15:56.876 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.876 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.877 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:15:56.877 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.068571+0000", 2024-04-19T02:15:56.877 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3009999999999997e-05 2024-04-19T02:15:56.877 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.877 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:15:56.877 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.877 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.877 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.877 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:120 5.8 5:10bbd8b5:::benchmark_data_smithi121_44835_object119:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:15:56.877 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:55.058462+0000", 2024-04-19T02:15:56.877 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 1.7421122389999999, 2024-04-19T02:15:56.877 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010060685999999999, 2024-04-19T02:15:56.877 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:15:56.877 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:56.878 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:15:56.878 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:15:56.878 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:56.878 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 120 2024-04-19T02:15:56.878 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.878 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:15:56.878 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.878 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:15:56.878 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.058462+0000", 2024-04-19T02:15:56.878 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.878 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.878 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.878 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:15:56.879 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.058462+0000", 2024-04-19T02:15:56.879 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.879 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.879 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.879 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:15:56.879 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.058461+0000", 2024-04-19T02:15:56.879 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:56.879 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.879 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.879 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:15:56.879 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.058564+0000", 2024-04-19T02:15:56.879 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0001021 2024-04-19T02:15:56.879 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.880 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.880 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:15:56.880 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.058571+0000", 2024-04-19T02:15:56.880 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.559e-06 2024-04-19T02:15:56.880 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.880 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.880 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:15:56.880 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.058575+0000", 2024-04-19T02:15:56.880 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3039999999999998e-06 2024-04-19T02:15:56.880 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.880 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.880 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:15:56.880 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.058604+0000", 2024-04-19T02:15:56.881 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.8198999999999999e-05 2024-04-19T02:15:56.881 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.881 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.881 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:15:56.881 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.058755+0000", 2024-04-19T02:15:56.881 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00015156100000000001 2024-04-19T02:15:56.881 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.881 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.881 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:15:56.881 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.058927+0000", 2024-04-19T02:15:56.881 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000171752 2024-04-19T02:15:56.881 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.881 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.881 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:15:56.882 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.059711+0000", 2024-04-19T02:15:56.882 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00078429599999999997 2024-04-19T02:15:56.882 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.882 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.882 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:56.882 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.068448+0000", 2024-04-19T02:15:56.882 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0087368120000000001 2024-04-19T02:15:56.882 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.882 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.882 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:15:56.882 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.068489+0000", 2024-04-19T02:15:56.882 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0571999999999997e-05 2024-04-19T02:15:56.882 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.883 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.883 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:15:56.883 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.068522+0000", 2024-04-19T02:15:56.883 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3896999999999997e-05 2024-04-19T02:15:56.883 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.883 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:15:56.884 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.884 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.884 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.884 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:634 5.8 5:1b48906c:::benchmark_data_smithi121_44835_object633:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:15:56.884 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:55.209349+0000", 2024-04-19T02:15:56.884 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 1.591225425, 2024-04-19T02:15:56.884 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.012294819, 2024-04-19T02:15:56.884 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:15:56.884 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:56.884 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:15:56.884 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:15:56.884 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:56.884 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 634 2024-04-19T02:15:56.884 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.885 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:15:56.885 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.885 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:15:56.885 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.209349+0000", 2024-04-19T02:15:56.885 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.885 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.885 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.885 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:15:56.885 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.209349+0000", 2024-04-19T02:15:56.885 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.885 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.885 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.885 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:15:56.886 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.209348+0000", 2024-04-19T02:15:56.886 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:56.886 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.886 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.886 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:15:56.886 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.209462+0000", 2024-04-19T02:15:56.886 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000113962 2024-04-19T02:15:56.886 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.886 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.886 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:15:56.886 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.209470+0000", 2024-04-19T02:15:56.886 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0209999999999999e-06 2024-04-19T02:15:56.886 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.887 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.887 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:15:56.887 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.209475+0000", 2024-04-19T02:15:56.887 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0710000000000002e-06 2024-04-19T02:15:56.887 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.887 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.887 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:15:56.887 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.209502+0000", 2024-04-19T02:15:56.887 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7234e-05 2024-04-19T02:15:56.887 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.887 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.887 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:15:56.887 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.209576+0000", 2024-04-19T02:15:56.888 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.4064000000000001e-05 2024-04-19T02:15:56.888 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.888 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.888 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:15:56.888 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.209655+0000", 2024-04-19T02:15:56.888 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.8484000000000003e-05 2024-04-19T02:15:56.888 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.888 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.888 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:15:56.888 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.210802+0000", 2024-04-19T02:15:56.888 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0011468940000000001 2024-04-19T02:15:56.888 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.888 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.888 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:56.889 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.221582+0000", 2024-04-19T02:15:56.889 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010780339999999999 2024-04-19T02:15:56.889 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.889 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.889 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:15:56.889 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.221612+0000", 2024-04-19T02:15:56.889 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9842e-05 2024-04-19T02:15:56.889 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.889 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.889 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:15:56.889 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.221643+0000", 2024-04-19T02:15:56.889 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1606999999999997e-05 2024-04-19T02:15:56.889 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.889 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:15:56.889 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.890 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.890 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.890 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:638 5.e 5:751b1bf7:::benchmark_data_smithi121_44835_object637:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:15:56.890 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:55.212248+0000", 2024-04-19T02:15:56.890 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 1.5883263219999999, 2024-04-19T02:15:56.890 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0095858409999999995, 2024-04-19T02:15:56.890 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:15:56.890 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:56.890 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:15:56.890 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:15:56.890 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:56.890 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 638 2024-04-19T02:15:56.890 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.891 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:15:56.891 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.891 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:15:56.891 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.212248+0000", 2024-04-19T02:15:56.891 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.891 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.891 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.891 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:15:56.891 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.212248+0000", 2024-04-19T02:15:56.891 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.891 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.892 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.892 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:15:56.892 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.212247+0000", 2024-04-19T02:15:56.892 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:56.892 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.892 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.892 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:15:56.892 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.212342+0000", 2024-04-19T02:15:56.892 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.5410999999999998e-05 2024-04-19T02:15:56.892 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.892 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.892 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:15:56.892 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.212355+0000", 2024-04-19T02:15:56.892 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2836999999999999e-05 2024-04-19T02:15:56.893 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.893 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.893 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:15:56.893 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.212362+0000", 2024-04-19T02:15:56.893 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.922e-06 2024-04-19T02:15:56.893 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.893 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.893 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:15:56.893 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.212386+0000", 2024-04-19T02:15:56.893 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3519e-05 2024-04-19T02:15:56.893 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.893 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.893 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:15:56.893 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.212452+0000", 2024-04-19T02:15:56.894 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6416999999999998e-05 2024-04-19T02:15:56.894 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.894 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.894 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:15:56.894 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.212529+0000", 2024-04-19T02:15:56.894 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.6935999999999997e-05 2024-04-19T02:15:56.894 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.894 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.894 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:15:56.894 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.213224+0000", 2024-04-19T02:15:56.895 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00069491400000000004 2024-04-19T02:15:56.895 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.895 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.895 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:56.895 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.221756+0000", 2024-04-19T02:15:56.895 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0085324010000000002 2024-04-19T02:15:56.895 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.895 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.895 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:15:56.895 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.221803+0000", 2024-04-19T02:15:56.895 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.6227000000000003e-05 2024-04-19T02:15:56.895 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.895 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.895 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:15:56.896 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.221834+0000", 2024-04-19T02:15:56.896 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0907000000000001e-05 2024-04-19T02:15:56.896 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.896 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:15:56.896 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.896 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.896 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.896 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:639 5.8 5:1c3d0320:::benchmark_data_smithi121_44835_object638:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:15:56.896 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:55.212371+0000", 2024-04-19T02:15:56.896 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 1.588203217, 2024-04-19T02:15:56.896 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0098058920000000001, 2024-04-19T02:15:56.896 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:15:56.896 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:56.896 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:15:56.897 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:15:56.897 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:56.897 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 639 2024-04-19T02:15:56.897 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.897 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:15:56.897 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.897 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:15:56.897 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.212371+0000", 2024-04-19T02:15:56.897 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.897 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.897 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.897 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:15:56.897 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.212371+0000", 2024-04-19T02:15:56.897 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.897 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.898 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.898 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:15:56.898 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.212370+0000", 2024-04-19T02:15:56.898 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:56.898 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.898 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.898 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:15:56.898 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.212495+0000", 2024-04-19T02:15:56.898 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000125069 2024-04-19T02:15:56.898 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.898 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.898 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:15:56.898 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.212504+0000", 2024-04-19T02:15:56.898 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.6139999999999992e-06 2024-04-19T02:15:56.899 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.899 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.899 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:15:56.899 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.212517+0000", 2024-04-19T02:15:56.899 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2965e-05 2024-04-19T02:15:56.899 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.899 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.899 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:15:56.899 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.212550+0000", 2024-04-19T02:15:56.899 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2795e-05 2024-04-19T02:15:56.899 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.899 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.899 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:15:56.900 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.212661+0000", 2024-04-19T02:15:56.900 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000111045 2024-04-19T02:15:56.900 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.900 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.900 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:15:56.900 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.212794+0000", 2024-04-19T02:15:56.900 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013286299999999999 2024-04-19T02:15:56.900 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.900 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.900 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:15:56.900 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.213496+0000", 2024-04-19T02:15:56.900 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00070214099999999998 2024-04-19T02:15:56.900 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.900 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.901 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:56.901 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.222123+0000", 2024-04-19T02:15:56.901 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0086268100000000004 2024-04-19T02:15:56.901 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.901 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.901 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:15:56.901 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.222156+0000", 2024-04-19T02:15:56.901 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3807999999999999e-05 2024-04-19T02:15:56.901 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.901 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.901 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:15:56.901 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.222177+0000", 2024-04-19T02:15:56.901 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.0268e-05 2024-04-19T02:15:56.901 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.901 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:15:56.902 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.902 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.902 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.902 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:641 5.4 5:2cb39dde:::benchmark_data_smithi121_44835_object640:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:15:56.902 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:55.212525+0000", 2024-04-19T02:15:56.902 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 1.5880490169999999, 2024-04-19T02:15:56.902 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0092601009999999997, 2024-04-19T02:15:56.902 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:15:56.902 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:56.902 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:15:56.902 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:15:56.902 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:56.902 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 641 2024-04-19T02:15:56.902 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.903 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:15:56.903 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.903 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:15:56.903 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.212525+0000", 2024-04-19T02:15:56.903 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.903 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.903 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.903 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:15:56.903 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.212525+0000", 2024-04-19T02:15:56.903 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.903 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.903 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.903 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:15:56.903 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.212524+0000", 2024-04-19T02:15:56.903 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:56.903 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.904 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.904 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:15:56.904 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.212568+0000", 2024-04-19T02:15:56.904 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3452999999999999e-05 2024-04-19T02:15:56.904 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.904 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.904 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:15:56.904 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.212577+0000", 2024-04-19T02:15:56.904 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.7760000000000003e-06 2024-04-19T02:15:56.904 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.904 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.904 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:15:56.904 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.212591+0000", 2024-04-19T02:15:56.904 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.3862e-05 2024-04-19T02:15:56.904 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.905 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.905 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:15:56.905 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.212621+0000", 2024-04-19T02:15:56.905 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0137e-05 2024-04-19T02:15:56.905 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.905 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.905 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:15:56.905 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.212693+0000", 2024-04-19T02:15:56.905 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.2720999999999997e-05 2024-04-19T02:15:56.905 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.905 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.905 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:15:56.905 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.212770+0000", 2024-04-19T02:15:56.905 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.6897999999999995e-05 2024-04-19T02:15:56.906 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.906 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.906 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:15:56.906 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.213526+0000", 2024-04-19T02:15:56.906 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00075584199999999995 2024-04-19T02:15:56.906 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.906 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.906 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:56.906 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.221708+0000", 2024-04-19T02:15:56.906 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0081817950000000004 2024-04-19T02:15:56.906 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.906 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.906 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:15:56.907 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.221752+0000", 2024-04-19T02:15:56.907 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4413000000000003e-05 2024-04-19T02:15:56.907 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.907 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.907 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:15:56.907 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.221785+0000", 2024-04-19T02:15:56.907 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2784000000000003e-05 2024-04-19T02:15:56.907 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.907 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:15:56.907 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.907 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.907 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.907 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:644 5.b 5:d2d923df:::benchmark_data_smithi121_44835_object643:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:15:56.907 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:55.212598+0000", 2024-04-19T02:15:56.907 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 1.5879761110000001, 2024-04-19T02:15:56.908 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0096675200000000006, 2024-04-19T02:15:56.908 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:15:56.908 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:56.908 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:15:56.908 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:15:56.908 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:56.908 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 644 2024-04-19T02:15:56.908 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.908 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:15:56.908 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.908 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:15:56.908 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.212598+0000", 2024-04-19T02:15:56.908 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.909 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.909 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.909 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:15:56.909 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.212598+0000", 2024-04-19T02:15:56.909 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.909 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.909 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.909 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:15:56.909 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.212597+0000", 2024-04-19T02:15:56.909 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:56.909 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.909 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.909 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:15:56.909 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.212658+0000", 2024-04-19T02:15:56.910 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.1020999999999997e-05 2024-04-19T02:15:56.910 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.910 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.910 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:15:56.910 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.212666+0000", 2024-04-19T02:15:56.910 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.4719999999999998e-06 2024-04-19T02:15:56.910 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.910 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.910 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:15:56.910 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.212673+0000", 2024-04-19T02:15:56.910 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.9870000000000002e-06 2024-04-19T02:15:56.910 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.910 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.910 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:15:56.911 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.212711+0000", 2024-04-19T02:15:56.911 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7758e-05 2024-04-19T02:15:56.911 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.911 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.911 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:15:56.911 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.212852+0000", 2024-04-19T02:15:56.911 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000141249 2024-04-19T02:15:56.911 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.911 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.911 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:15:56.911 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.212987+0000", 2024-04-19T02:15:56.911 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013516299999999999 2024-04-19T02:15:56.911 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.911 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.912 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:15:56.912 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.213726+0000", 2024-04-19T02:15:56.912 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00073854699999999999 2024-04-19T02:15:56.912 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.912 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.912 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:56.912 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.222159+0000", 2024-04-19T02:15:56.912 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0084330550000000001 2024-04-19T02:15:56.912 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.912 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.912 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:15:56.912 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.222229+0000", 2024-04-19T02:15:56.912 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.0667000000000006e-05 2024-04-19T02:15:56.912 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.912 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.913 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:15:56.913 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.222265+0000", 2024-04-19T02:15:56.913 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6180000000000003e-05 2024-04-19T02:15:56.913 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.913 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:15:56.913 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.913 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.913 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.913 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:3082 5.e 5:7aefefdd:::benchmark_data_smithi121_44835_object3081:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:15:56.913 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:55.865519+0000", 2024-04-19T02:15:56.913 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.93505503999999995, 2024-04-19T02:15:56.913 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0094645319999999995, 2024-04-19T02:15:56.913 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:15:56.913 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:15:56.913 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:15:56.914 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:15:56.914 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:56.914 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 3082 2024-04-19T02:15:56.914 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.914 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:15:56.914 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.914 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:15:56.914 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.865519+0000", 2024-04-19T02:15:56.914 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.914 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.914 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.914 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:15:56.914 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.865519+0000", 2024-04-19T02:15:56.915 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:15:56.915 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.915 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.915 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:15:56.915 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.865519+0000", 2024-04-19T02:15:56.915 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:56.915 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.915 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.915 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:15:56.915 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.865564+0000", 2024-04-19T02:15:56.915 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.5231000000000001e-05 2024-04-19T02:15:56.915 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.915 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.915 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:15:56.915 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.865569+0000", 2024-04-19T02:15:56.916 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.9180000000000002e-06 2024-04-19T02:15:56.916 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.916 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.916 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:15:56.916 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.865572+0000", 2024-04-19T02:15:56.916 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5650000000000002e-06 2024-04-19T02:15:56.916 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.916 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.916 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:15:56.916 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.865607+0000", 2024-04-19T02:15:56.916 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5051e-05 2024-04-19T02:15:56.916 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.916 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.916 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:15:56.916 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.865754+0000", 2024-04-19T02:15:56.916 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014660300000000001 2024-04-19T02:15:56.917 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.917 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.917 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:15:56.917 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.865917+0000", 2024-04-19T02:15:56.917 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000162762 2024-04-19T02:15:56.917 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.917 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.917 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:15:56.917 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.867093+0000", 2024-04-19T02:15:56.917 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0011764950000000001 2024-04-19T02:15:56.917 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.917 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.917 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:56.917 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.874902+0000", 2024-04-19T02:15:56.917 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0078084590000000002 2024-04-19T02:15:56.917 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.918 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.918 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:15:56.918 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.874948+0000", 2024-04-19T02:15:56.918 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.6155000000000001e-05 2024-04-19T02:15:56.918 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:15:56.918 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:15:56.918 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:15:56.918 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.874984+0000", 2024-04-19T02:15:56.918 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5633999999999998e-05 2024-04-19T02:15:56.918 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.918 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:15:56.918 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.918 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:15:56.918 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:15:56.919 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:15:56.920 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:15:56.921 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:15:56.921+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:15:57.004 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:15:57.021 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:15:57.021+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:15:57.025 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 2 16 7323 7307 228.329 228.562 0.00592085 0.0043707 2024-04-19T02:15:57.099 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-04-19T02:15:57.099 INFO:teuthology.orchestra.run.smithi177.stdout: "ops": [ 2024-04-19T02:15:57.099 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.099 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:7552 5.b e19/16 5:d2e30b37:::benchmark_data_smithi121_44835_object7551:head v 19'476, mlcod=19'474)", 2024-04-19T02:15:57.099 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:57.096030+0000", 2024-04-19T02:15:57.099 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0039903769999999998, 2024-04-19T02:15:57.100 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0040168369999999997, 2024-04-19T02:15:57.100 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:15:57.100 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:15:57.100 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:15:57.100 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.100 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:15:57.100 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.096030+0000", 2024-04-19T02:15:57.100 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:57.100 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.100 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.100 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:15:57.100 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.096030+0000", 2024-04-19T02:15:57.100 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:57.100 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.100 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.100 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:15:57.101 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.096029+0000", 2024-04-19T02:15:57.101 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:57.101 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.101 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.101 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:15:57.101 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.096093+0000", 2024-04-19T02:15:57.101 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.3868000000000006e-05 2024-04-19T02:15:57.101 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.101 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.101 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:15:57.101 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.096100+0000", 2024-04-19T02:15:57.101 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.3690000000000001e-06 2024-04-19T02:15:57.101 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.101 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.101 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:15:57.101 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.096107+0000", 2024-04-19T02:15:57.102 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.1210000000000003e-06 2024-04-19T02:15:57.102 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.102 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.102 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:15:57.102 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.096148+0000", 2024-04-19T02:15:57.102 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.1023999999999999e-05 2024-04-19T02:15:57.102 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.102 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.102 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:15:57.102 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.096174+0000", 2024-04-19T02:15:57.102 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.6040000000000001e-05 2024-04-19T02:15:57.102 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:57.102 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:15:57.102 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:57.103 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.103 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.103 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:7553 5.8 e19/16 5:137f5ed0:::benchmark_data_smithi121_44835_object7552:head v 19'465, mlcod=19'461)", 2024-04-19T02:15:57.103 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:57.096946+0000", 2024-04-19T02:15:57.103 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0030743789999999999, 2024-04-19T02:15:57.103 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.003157829, 2024-04-19T02:15:57.103 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:15:57.103 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:15:57.103 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:15:57.103 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.103 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:15:57.103 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.096946+0000", 2024-04-19T02:15:57.103 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:57.103 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.103 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.104 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:15:57.104 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.096946+0000", 2024-04-19T02:15:57.104 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:57.104 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.104 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.104 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:15:57.104 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.096945+0000", 2024-04-19T02:15:57.104 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:57.104 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.104 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.104 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:15:57.104 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.097005+0000", 2024-04-19T02:15:57.104 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.0210000000000001e-05 2024-04-19T02:15:57.104 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.104 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.105 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:15:57.105 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.097013+0000", 2024-04-19T02:15:57.105 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.5140000000000004e-06 2024-04-19T02:15:57.105 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.105 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.105 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:15:57.105 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.097020+0000", 2024-04-19T02:15:57.105 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.7179999999999999e-06 2024-04-19T02:15:57.105 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.105 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.105 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:15:57.105 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.097056+0000", 2024-04-19T02:15:57.105 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.5859999999999999e-05 2024-04-19T02:15:57.105 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.106 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.106 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:15:57.106 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.097066+0000", 2024-04-19T02:15:57.106 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0625000000000001e-05 2024-04-19T02:15:57.106 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:57.106 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:15:57.106 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:57.106 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.106 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.106 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:7554 5.b e19/16 5:d8b6870e:::benchmark_data_smithi121_44835_object7553:head v 19'477, mlcod=19'474)", 2024-04-19T02:15:57.106 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:57.097914+0000", 2024-04-19T02:15:57.106 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0021059310000000001, 2024-04-19T02:15:57.106 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0022320339999999999, 2024-04-19T02:15:57.106 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:15:57.107 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:15:57.107 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:15:57.107 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.107 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:15:57.107 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.097914+0000", 2024-04-19T02:15:57.107 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:57.107 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.107 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.107 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:15:57.107 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.097914+0000", 2024-04-19T02:15:57.107 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:57.107 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.107 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.107 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:15:57.107 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.097914+0000", 2024-04-19T02:15:57.107 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:57.107 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.108 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.108 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:15:57.108 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.097965+0000", 2024-04-19T02:15:57.108 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.1007999999999997e-05 2024-04-19T02:15:57.108 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.108 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.108 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:15:57.108 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.097972+0000", 2024-04-19T02:15:57.108 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.9979999999999997e-06 2024-04-19T02:15:57.108 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.108 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.108 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:15:57.108 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.097975+0000", 2024-04-19T02:15:57.108 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.8500000000000004e-06 2024-04-19T02:15:57.108 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.109 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.109 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:15:57.109 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.097998+0000", 2024-04-19T02:15:57.109 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.2099999999999998e-05 2024-04-19T02:15:57.109 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.109 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.109 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:15:57.109 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.098008+0000", 2024-04-19T02:15:57.109 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0712e-05 2024-04-19T02:15:57.109 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:57.109 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:15:57.109 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:57.109 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.109 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.109 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:7557 5.c 5:3b4df1ae:::benchmark_data_smithi121_44835_object7556:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-19T02:15:57.110 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:57.098490+0000", 2024-04-19T02:15:57.110 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.001529596, 2024-04-19T02:15:57.110 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0017023069999999999, 2024-04-19T02:15:57.110 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:15:57.110 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:15:57.110 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:15:57.110 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:15:57.110 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:57.110 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 7557 2024-04-19T02:15:57.110 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.110 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:15:57.110 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.110 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:15:57.110 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.098490+0000", 2024-04-19T02:15:57.111 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:57.111 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.111 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.111 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:15:57.111 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.098490+0000", 2024-04-19T02:15:57.111 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:57.111 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.111 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.111 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:15:57.111 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.098490+0000", 2024-04-19T02:15:57.111 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:15:57.111 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.111 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.111 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:15:57.112 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.098611+0000", 2024-04-19T02:15:57.112 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000121976 2024-04-19T02:15:57.112 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.112 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.112 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:15:57.112 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.098617+0000", 2024-04-19T02:15:57.112 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.7830000000000004e-06 2024-04-19T02:15:57.112 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.112 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.112 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:15:57.112 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.098621+0000", 2024-04-19T02:15:57.112 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.9060000000000004e-06 2024-04-19T02:15:57.112 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.112 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.112 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:15:57.113 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.098645+0000", 2024-04-19T02:15:57.113 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.4125e-05 2024-04-19T02:15:57.113 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.113 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.113 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:15:57.113 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.098720+0000", 2024-04-19T02:15:57.113 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.5049000000000006e-05 2024-04-19T02:15:57.113 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.113 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.113 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:15:57.113 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.098794+0000", 2024-04-19T02:15:57.113 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.4052000000000002e-05 2024-04-19T02:15:57.113 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.113 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.113 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:57.113 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.099981+0000", 2024-04-19T02:15:57.114 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0011866260000000001 2024-04-19T02:15:57.114 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:57.114 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:15:57.114 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:57.114 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.114 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.114 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:7559 5.a 5:56e6edc7:::benchmark_data_smithi121_44835_object7558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-19T02:15:57.114 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:57.098684+0000", 2024-04-19T02:15:57.114 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.001336453, 2024-04-19T02:15:57.114 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.001563189, 2024-04-19T02:15:57.114 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:15:57.114 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:15:57.114 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:15:57.114 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:15:57.115 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:57.115 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 7559 2024-04-19T02:15:57.115 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.115 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:15:57.115 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.115 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:15:57.115 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.098684+0000", 2024-04-19T02:15:57.115 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:57.115 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.115 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.115 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:15:57.115 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.098684+0000", 2024-04-19T02:15:57.115 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:57.115 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.115 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.116 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:15:57.116 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.098683+0000", 2024-04-19T02:15:57.116 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:57.116 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.116 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.116 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:15:57.116 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.098743+0000", 2024-04-19T02:15:57.116 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.0432e-05 2024-04-19T02:15:57.116 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.116 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.116 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:15:57.116 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.098748+0000", 2024-04-19T02:15:57.116 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.0320000000000003e-06 2024-04-19T02:15:57.116 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.116 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.117 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:15:57.117 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.098752+0000", 2024-04-19T02:15:57.117 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.2480000000000001e-06 2024-04-19T02:15:57.117 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.117 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.117 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:15:57.117 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.098775+0000", 2024-04-19T02:15:57.117 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.351e-05 2024-04-19T02:15:57.117 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.117 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.117 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:15:57.117 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.098919+0000", 2024-04-19T02:15:57.117 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000144034 2024-04-19T02:15:57.117 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.117 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.118 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 1", 2024-04-19T02:15:57.118 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.099039+0000", 2024-04-19T02:15:57.118 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00011952500000000001 2024-04-19T02:15:57.118 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:57.118 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:15:57.118 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:57.118 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.118 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.118 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:7555 5.e e19/16 5:7d45c38b:::benchmark_data_smithi121_44835_object7554:head v 19'464, mlcod=19'462)", 2024-04-19T02:15:57.118 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:57.098848+0000", 2024-04-19T02:15:57.118 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.001171765, 2024-04-19T02:15:57.118 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0014385019999999999, 2024-04-19T02:15:57.118 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:15:57.118 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:15:57.118 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:15:57.119 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.119 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:15:57.119 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.098848+0000", 2024-04-19T02:15:57.119 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:57.119 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.119 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.119 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:15:57.119 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.098848+0000", 2024-04-19T02:15:57.119 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:57.119 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.119 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.119 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:15:57.119 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.098848+0000", 2024-04-19T02:15:57.119 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:57.119 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.119 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.120 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:15:57.120 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.098928+0000", 2024-04-19T02:15:57.120 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.0427999999999996e-05 2024-04-19T02:15:57.120 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.120 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.120 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:15:57.120 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.098939+0000", 2024-04-19T02:15:57.120 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.077e-05 2024-04-19T02:15:57.120 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.120 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.120 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:15:57.120 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.098946+0000", 2024-04-19T02:15:57.120 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.9550000000000003e-06 2024-04-19T02:15:57.120 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.120 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.120 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:15:57.120 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.098974+0000", 2024-04-19T02:15:57.121 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.7849000000000001e-05 2024-04-19T02:15:57.121 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.121 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.121 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:15:57.121 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.098985+0000", 2024-04-19T02:15:57.121 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0967e-05 2024-04-19T02:15:57.121 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:57.121 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:15:57.121 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:57.121 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.121 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.121 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:7560 5.2 e19/16 5:42052927:::benchmark_data_smithi121_44835_object7559:head v 19'490, mlcod=19'488)", 2024-04-19T02:15:57.121 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:57.099176+0000", 2024-04-19T02:15:57.121 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.000843599, 2024-04-19T02:15:57.121 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0011547020000000001, 2024-04-19T02:15:57.121 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:15:57.122 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:15:57.122 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:15:57.122 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.122 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:15:57.122 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.099176+0000", 2024-04-19T02:15:57.122 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:57.122 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.122 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.122 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:15:57.122 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.099176+0000", 2024-04-19T02:15:57.122 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:57.122 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.122 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.122 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:15:57.122 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.099176+0000", 2024-04-19T02:15:57.123 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:57.123 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.123 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.123 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:15:57.123 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.099247+0000", 2024-04-19T02:15:57.123 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.0531999999999995e-05 2024-04-19T02:15:57.123 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.123 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.123 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:15:57.123 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.099259+0000", 2024-04-19T02:15:57.123 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.2928999999999999e-05 2024-04-19T02:15:57.123 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.123 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.123 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:15:57.123 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.099266+0000", 2024-04-19T02:15:57.123 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.1419999999999998e-06 2024-04-19T02:15:57.123 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.124 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.124 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:15:57.124 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.099286+0000", 2024-04-19T02:15:57.124 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.0800000000000001e-05 2024-04-19T02:15:57.124 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.124 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.124 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:15:57.124 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.099298+0000", 2024-04-19T02:15:57.124 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.19e-05 2024-04-19T02:15:57.124 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:57.124 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:15:57.124 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:57.124 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.124 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.124 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:7563 5.7 e19/16 5:e2864530:::benchmark_data_smithi121_44835_object7562:head v 19'450, mlcod=19'448)", 2024-04-19T02:15:57.125 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:57.100029+0000", 2024-04-19T02:15:57.125 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4294967295.9999905, 2024-04-19T02:15:57.125 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00033836700000000001, 2024-04-19T02:15:57.125 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:15:57.125 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:15:57.125 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:15:57.125 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.125 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:15:57.125 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.100029+0000", 2024-04-19T02:15:57.125 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:57.125 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.125 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.125 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:15:57.125 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.100029+0000", 2024-04-19T02:15:57.126 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:57.126 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.126 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.126 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:15:57.126 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.100029+0000", 2024-04-19T02:15:57.126 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:57.126 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.126 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.126 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:15:57.126 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.100094+0000", 2024-04-19T02:15:57.126 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.5170000000000001e-05 2024-04-19T02:15:57.126 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.126 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.126 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:15:57.127 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.100101+0000", 2024-04-19T02:15:57.127 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.5710000000000003e-06 2024-04-19T02:15:57.127 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.127 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.127 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:15:57.127 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.100105+0000", 2024-04-19T02:15:57.127 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.8850000000000001e-06 2024-04-19T02:15:57.127 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.127 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.127 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:15:57.127 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.100135+0000", 2024-04-19T02:15:57.127 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.0465000000000001e-05 2024-04-19T02:15:57.127 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.127 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.127 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:15:57.127 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.100148+0000", 2024-04-19T02:15:57.127 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.3495999999999999e-05 2024-04-19T02:15:57.128 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:57.128 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:15:57.128 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:57.128 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.128 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.128 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:7564 5.0 e19/16 5:0e3362c8:::benchmark_data_smithi121_44835_object7563:head v 19'450, mlcod=19'448)", 2024-04-19T02:15:57.128 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:57.100230+0000", 2024-04-19T02:15:57.128 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4294967295.9997902, 2024-04-19T02:15:57.128 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000175036, 2024-04-19T02:15:57.128 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:15:57.128 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:15:57.128 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:15:57.128 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.128 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:15:57.128 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.100230+0000", 2024-04-19T02:15:57.128 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:57.128 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.129 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.129 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:15:57.129 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.100230+0000", 2024-04-19T02:15:57.129 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:15:57.129 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.129 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.129 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:15:57.129 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.100229+0000", 2024-04-19T02:15:57.129 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:57.129 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.129 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.129 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:15:57.129 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.100292+0000", 2024-04-19T02:15:57.129 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.2694999999999995e-05 2024-04-19T02:15:57.129 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.129 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.130 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:15:57.130 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.100299+0000", 2024-04-19T02:15:57.130 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.562e-06 2024-04-19T02:15:57.130 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.130 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.130 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:15:57.130 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.100302+0000", 2024-04-19T02:15:57.130 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.7340000000000002e-06 2024-04-19T02:15:57.130 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.130 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.130 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:15:57.130 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.100328+0000", 2024-04-19T02:15:57.130 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.5439000000000002e-05 2024-04-19T02:15:57.130 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:15:57.130 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:15:57.131 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:15:57.131 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:57.100347+0000", 2024-04-19T02:15:57.131 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.9296e-05 2024-04-19T02:15:57.131 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:57.131 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:15:57.131 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:57.131 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:15:57.131 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2024-04-19T02:15:57.131 INFO:teuthology.orchestra.run.smithi177.stdout: "num_ops": 9 2024-04-19T02:15:57.131 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-04-19T02:15:57.133 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:15:57.133 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:15:57.133+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:15:57.154 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:15:57.174 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:15:57.193 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2: {} 2024-04-19T02:15:57.195 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:15:57.195 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:15:57.195 INFO:teuthology.orchestra.run.smithi121.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:15:57.233 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:15:57.234+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:15:57.333 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:15:57.334+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:15:57.341 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:15:57.341 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:15:57.355 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:15:57.435 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:15:57.435+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:15:57.520 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:15:57.521 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:15:57.536 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:15:57.537+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:15:57.537 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:15:57.637 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:15:57.638+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:15:57.709 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:15:57.709 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:15:57.724 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:15:57.737 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:15:57.739+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:15:57.838 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:15:57.839+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:15:57.931 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:15:57.932 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:15:57.939 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:15:57.940+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:15:57.948 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:15:57.971 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-19T02:15:57.971 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T02:15:57.971 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-04-19T02:15:57.972 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-19T02:15:57.979 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T02:15:58.025 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 3 16 10677 10661 222.088 209.625 0.010742 0.00449028 2024-04-19T02:15:58.040 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:15:58.041+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:15:58.141 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:15:58.142+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:15:58.151 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:15:58.151 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:15:58.165 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:15:58.241 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:15:58.242+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:15:58.328 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:15:58.328 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:15:58.343 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:15:58.344 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:15:58.343+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:15:58.344 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:15:58.344 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-04-19T02:15:58.344 INFO:teuthology.orchestra.run.smithi121.stdout: "epoch": 19, 2024-04-19T02:15:58.344 INFO:teuthology.orchestra.run.smithi121.stdout: "fsid": "f6ab5dd0-bb9f-4b48-a9fc-4728c7955ca8", 2024-04-19T02:15:58.344 INFO:teuthology.orchestra.run.smithi121.stdout: "created": "2024-04-19T02:15:13.539846+0000", 2024-04-19T02:15:58.344 INFO:teuthology.orchestra.run.smithi121.stdout: "modified": "2024-04-19T02:15:55.953086+0000", 2024-04-19T02:15:58.344 INFO:teuthology.orchestra.run.smithi121.stdout: "last_up_change": "2024-04-19T02:15:22.519568+0000", 2024-04-19T02:15:58.344 INFO:teuthology.orchestra.run.smithi121.stdout: "last_in_change": "2024-04-19T02:15:15.482624+0000", 2024-04-19T02:15:58.344 INFO:teuthology.orchestra.run.smithi121.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-19T02:15:58.344 INFO:teuthology.orchestra.run.smithi121.stdout: "flags_num": 5806080, 2024-04-19T02:15:58.345 INFO:teuthology.orchestra.run.smithi121.stdout: "flags_set": [ 2024-04-19T02:15:58.345 INFO:teuthology.orchestra.run.smithi121.stdout: "nodeep-scrub", 2024-04-19T02:15:58.345 INFO:teuthology.orchestra.run.smithi121.stdout: "noscrub", 2024-04-19T02:15:58.345 INFO:teuthology.orchestra.run.smithi121.stdout: "pglog_hardlimit", 2024-04-19T02:15:58.345 INFO:teuthology.orchestra.run.smithi121.stdout: "purged_snapdirs", 2024-04-19T02:15:58.345 INFO:teuthology.orchestra.run.smithi121.stdout: "recovery_deletes", 2024-04-19T02:15:58.345 INFO:teuthology.orchestra.run.smithi121.stdout: "sortbitwise" 2024-04-19T02:15:58.345 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-04-19T02:15:58.345 INFO:teuthology.orchestra.run.smithi121.stdout: "crush_version": 4, 2024-04-19T02:15:58.345 INFO:teuthology.orchestra.run.smithi121.stdout: "full_ratio": 0.94999998807907104, 2024-04-19T02:15:58.345 INFO:teuthology.orchestra.run.smithi121.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-19T02:15:58.345 INFO:teuthology.orchestra.run.smithi121.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-19T02:15:58.345 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_snapshot": "", 2024-04-19T02:15:58.345 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_max": 5, 2024-04-19T02:15:58.345 INFO:teuthology.orchestra.run.smithi121.stdout: "max_osd": 3, 2024-04-19T02:15:58.346 INFO:teuthology.orchestra.run.smithi121.stdout: "require_min_compat_client": "luminous", 2024-04-19T02:15:58.346 INFO:teuthology.orchestra.run.smithi121.stdout: "min_compat_client": "jewel", 2024-04-19T02:15:58.346 INFO:teuthology.orchestra.run.smithi121.stdout: "require_osd_release": "reef", 2024-04-19T02:15:58.346 INFO:teuthology.orchestra.run.smithi121.stdout: "allow_crimson": false, 2024-04-19T02:15:58.346 INFO:teuthology.orchestra.run.smithi121.stdout: "pools": [ 2024-04-19T02:15:58.346 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:15:58.346 INFO:teuthology.orchestra.run.smithi121.stdout: "pool": 1, 2024-04-19T02:15:58.346 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_name": ".mgr", 2024-04-19T02:15:58.346 INFO:teuthology.orchestra.run.smithi121.stdout: "create_time": "2024-04-19T02:15:22.776125+0000", 2024-04-19T02:15:58.346 INFO:teuthology.orchestra.run.smithi121.stdout: "flags": 1, 2024-04-19T02:15:58.346 INFO:teuthology.orchestra.run.smithi121.stdout: "flags_names": "hashpspool", 2024-04-19T02:15:58.346 INFO:teuthology.orchestra.run.smithi121.stdout: "type": 1, 2024-04-19T02:15:58.346 INFO:teuthology.orchestra.run.smithi121.stdout: "size": 2, 2024-04-19T02:15:58.346 INFO:teuthology.orchestra.run.smithi121.stdout: "min_size": 1, 2024-04-19T02:15:58.346 INFO:teuthology.orchestra.run.smithi121.stdout: "crush_rule": 0, 2024-04-19T02:15:58.347 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_count": 0, 2024-04-19T02:15:58.347 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_target": 0, 2024-04-19T02:15:58.347 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T02:15:58.347 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T02:15:58.347 INFO:teuthology.orchestra.run.smithi121.stdout: "object_hash": 2, 2024-04-19T02:15:58.347 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_autoscale_mode": "off", 2024-04-19T02:15:58.347 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num": 1, 2024-04-19T02:15:58.347 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_placement_num": 1, 2024-04-19T02:15:58.347 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_placement_num_target": 1, 2024-04-19T02:15:58.347 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_target": 1, 2024-04-19T02:15:58.347 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_pending": 1, 2024-04-19T02:15:58.347 INFO:teuthology.orchestra.run.smithi121.stdout: "last_pg_merge_meta": { 2024-04-19T02:15:58.347 INFO:teuthology.orchestra.run.smithi121.stdout: "source_pgid": "0.0", 2024-04-19T02:15:58.347 INFO:teuthology.orchestra.run.smithi121.stdout: "ready_epoch": 0, 2024-04-19T02:15:58.347 INFO:teuthology.orchestra.run.smithi121.stdout: "last_epoch_started": 0, 2024-04-19T02:15:58.348 INFO:teuthology.orchestra.run.smithi121.stdout: "last_epoch_clean": 0, 2024-04-19T02:15:58.348 INFO:teuthology.orchestra.run.smithi121.stdout: "source_version": "0'0", 2024-04-19T02:15:58.348 INFO:teuthology.orchestra.run.smithi121.stdout: "target_version": "0'0" 2024-04-19T02:15:58.348 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:58.348 INFO:teuthology.orchestra.run.smithi121.stdout: "last_change": "11", 2024-04-19T02:15:58.348 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend": "0", 2024-04-19T02:15:58.348 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T02:15:58.348 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T02:15:58.348 INFO:teuthology.orchestra.run.smithi121.stdout: "auid": 0, 2024-04-19T02:15:58.348 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_mode": "selfmanaged", 2024-04-19T02:15:58.348 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_seq": 0, 2024-04-19T02:15:58.348 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_epoch": 0, 2024-04-19T02:15:58.348 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_snaps": [], 2024-04-19T02:15:58.348 INFO:teuthology.orchestra.run.smithi121.stdout: "removed_snaps": "[]", 2024-04-19T02:15:58.348 INFO:teuthology.orchestra.run.smithi121.stdout: "quota_max_bytes": 0, 2024-04-19T02:15:58.349 INFO:teuthology.orchestra.run.smithi121.stdout: "quota_max_objects": 0, 2024-04-19T02:15:58.349 INFO:teuthology.orchestra.run.smithi121.stdout: "tiers": [], 2024-04-19T02:15:58.349 INFO:teuthology.orchestra.run.smithi121.stdout: "tier_of": -1, 2024-04-19T02:15:58.349 INFO:teuthology.orchestra.run.smithi121.stdout: "read_tier": -1, 2024-04-19T02:15:58.349 INFO:teuthology.orchestra.run.smithi121.stdout: "write_tier": -1, 2024-04-19T02:15:58.349 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_mode": "none", 2024-04-19T02:15:58.349 INFO:teuthology.orchestra.run.smithi121.stdout: "target_max_bytes": 0, 2024-04-19T02:15:58.349 INFO:teuthology.orchestra.run.smithi121.stdout: "target_max_objects": 0, 2024-04-19T02:15:58.349 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T02:15:58.349 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T02:15:58.349 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T02:15:58.349 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_min_flush_age": 0, 2024-04-19T02:15:58.349 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_min_evict_age": 0, 2024-04-19T02:15:58.349 INFO:teuthology.orchestra.run.smithi121.stdout: "erasure_code_profile": "", 2024-04-19T02:15:58.350 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_params": { 2024-04-19T02:15:58.350 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "none" 2024-04-19T02:15:58.350 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:58.350 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_period": 0, 2024-04-19T02:15:58.350 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_count": 0, 2024-04-19T02:15:58.350 INFO:teuthology.orchestra.run.smithi121.stdout: "use_gmt_hitset": true, 2024-04-19T02:15:58.350 INFO:teuthology.orchestra.run.smithi121.stdout: "min_read_recency_for_promote": 0, 2024-04-19T02:15:58.350 INFO:teuthology.orchestra.run.smithi121.stdout: "min_write_recency_for_promote": 0, 2024-04-19T02:15:58.350 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T02:15:58.350 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_search_last_n": 0, 2024-04-19T02:15:58.350 INFO:teuthology.orchestra.run.smithi121.stdout: "grade_table": [], 2024-04-19T02:15:58.350 INFO:teuthology.orchestra.run.smithi121.stdout: "stripe_width": 0, 2024-04-19T02:15:58.350 INFO:teuthology.orchestra.run.smithi121.stdout: "expected_num_objects": 0, 2024-04-19T02:15:58.350 INFO:teuthology.orchestra.run.smithi121.stdout: "fast_read": false, 2024-04-19T02:15:58.351 INFO:teuthology.orchestra.run.smithi121.stdout: "options": { 2024-04-19T02:15:58.351 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_max": 32, 2024-04-19T02:15:58.351 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_min": 1 2024-04-19T02:15:58.351 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:58.351 INFO:teuthology.orchestra.run.smithi121.stdout: "application_metadata": { 2024-04-19T02:15:58.351 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": {} 2024-04-19T02:15:58.351 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:58.351 INFO:teuthology.orchestra.run.smithi121.stdout: "read_balance": { 2024-04-19T02:15:58.351 INFO:teuthology.orchestra.run.smithi121.stdout: "score_acting": 2.9900000095367432, 2024-04-19T02:15:58.351 INFO:teuthology.orchestra.run.smithi121.stdout: "score_stable": 2.9900000095367432, 2024-04-19T02:15:58.351 INFO:teuthology.orchestra.run.smithi121.stdout: "optimal_score": 0.67000001668930054, 2024-04-19T02:15:58.351 INFO:teuthology.orchestra.run.smithi121.stdout: "raw_score_acting": 2, 2024-04-19T02:15:58.351 INFO:teuthology.orchestra.run.smithi121.stdout: "raw_score_stable": 2, 2024-04-19T02:15:58.351 INFO:teuthology.orchestra.run.smithi121.stdout: "primary_affinity_weighted": 0.90409350395202637, 2024-04-19T02:15:58.351 INFO:teuthology.orchestra.run.smithi121.stdout: "average_primary_affinity": 0.89999997615814209, 2024-04-19T02:15:58.352 INFO:teuthology.orchestra.run.smithi121.stdout: "average_primary_affinity_weighted": 0.89999997615814209 2024-04-19T02:15:58.352 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:15:58.352 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:58.352 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:15:58.352 INFO:teuthology.orchestra.run.smithi121.stdout: "pool": 2, 2024-04-19T02:15:58.352 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_name": "rbd", 2024-04-19T02:15:58.352 INFO:teuthology.orchestra.run.smithi121.stdout: "create_time": "2024-04-19T02:15:23.264005+0000", 2024-04-19T02:15:58.352 INFO:teuthology.orchestra.run.smithi121.stdout: "flags": 1, 2024-04-19T02:15:58.352 INFO:teuthology.orchestra.run.smithi121.stdout: "flags_names": "hashpspool", 2024-04-19T02:15:58.352 INFO:teuthology.orchestra.run.smithi121.stdout: "type": 1, 2024-04-19T02:15:58.352 INFO:teuthology.orchestra.run.smithi121.stdout: "size": 2, 2024-04-19T02:15:58.352 INFO:teuthology.orchestra.run.smithi121.stdout: "min_size": 1, 2024-04-19T02:15:58.352 INFO:teuthology.orchestra.run.smithi121.stdout: "crush_rule": 0, 2024-04-19T02:15:58.352 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_count": 0, 2024-04-19T02:15:58.353 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_target": 0, 2024-04-19T02:15:58.353 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T02:15:58.353 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T02:15:58.353 INFO:teuthology.orchestra.run.smithi121.stdout: "object_hash": 2, 2024-04-19T02:15:58.353 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_autoscale_mode": "off", 2024-04-19T02:15:58.353 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num": 8, 2024-04-19T02:15:58.353 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_placement_num": 8, 2024-04-19T02:15:58.353 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_placement_num_target": 8, 2024-04-19T02:15:58.353 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_target": 8, 2024-04-19T02:15:58.353 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_pending": 8, 2024-04-19T02:15:58.353 INFO:teuthology.orchestra.run.smithi121.stdout: "last_pg_merge_meta": { 2024-04-19T02:15:58.353 INFO:teuthology.orchestra.run.smithi121.stdout: "source_pgid": "0.0", 2024-04-19T02:15:58.353 INFO:teuthology.orchestra.run.smithi121.stdout: "ready_epoch": 0, 2024-04-19T02:15:58.353 INFO:teuthology.orchestra.run.smithi121.stdout: "last_epoch_started": 0, 2024-04-19T02:15:58.353 INFO:teuthology.orchestra.run.smithi121.stdout: "last_epoch_clean": 0, 2024-04-19T02:15:58.354 INFO:teuthology.orchestra.run.smithi121.stdout: "source_version": "0'0", 2024-04-19T02:15:58.354 INFO:teuthology.orchestra.run.smithi121.stdout: "target_version": "0'0" 2024-04-19T02:15:58.354 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:58.354 INFO:teuthology.orchestra.run.smithi121.stdout: "last_change": "11", 2024-04-19T02:15:58.354 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend": "0", 2024-04-19T02:15:58.354 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T02:15:58.354 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T02:15:58.354 INFO:teuthology.orchestra.run.smithi121.stdout: "auid": 0, 2024-04-19T02:15:58.354 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_mode": "selfmanaged", 2024-04-19T02:15:58.354 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_seq": 0, 2024-04-19T02:15:58.354 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_epoch": 0, 2024-04-19T02:15:58.354 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_snaps": [], 2024-04-19T02:15:58.354 INFO:teuthology.orchestra.run.smithi121.stdout: "removed_snaps": "[]", 2024-04-19T02:15:58.354 INFO:teuthology.orchestra.run.smithi121.stdout: "quota_max_bytes": 0, 2024-04-19T02:15:58.355 INFO:teuthology.orchestra.run.smithi121.stdout: "quota_max_objects": 0, 2024-04-19T02:15:58.355 INFO:teuthology.orchestra.run.smithi121.stdout: "tiers": [], 2024-04-19T02:15:58.355 INFO:teuthology.orchestra.run.smithi121.stdout: "tier_of": -1, 2024-04-19T02:15:58.355 INFO:teuthology.orchestra.run.smithi121.stdout: "read_tier": -1, 2024-04-19T02:15:58.355 INFO:teuthology.orchestra.run.smithi121.stdout: "write_tier": -1, 2024-04-19T02:15:58.355 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_mode": "none", 2024-04-19T02:15:58.355 INFO:teuthology.orchestra.run.smithi121.stdout: "target_max_bytes": 0, 2024-04-19T02:15:58.355 INFO:teuthology.orchestra.run.smithi121.stdout: "target_max_objects": 0, 2024-04-19T02:15:58.355 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T02:15:58.355 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T02:15:58.355 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T02:15:58.355 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_min_flush_age": 0, 2024-04-19T02:15:58.355 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_min_evict_age": 0, 2024-04-19T02:15:58.355 INFO:teuthology.orchestra.run.smithi121.stdout: "erasure_code_profile": "", 2024-04-19T02:15:58.355 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_params": { 2024-04-19T02:15:58.355 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "none" 2024-04-19T02:15:58.356 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:58.356 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_period": 0, 2024-04-19T02:15:58.356 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_count": 0, 2024-04-19T02:15:58.356 INFO:teuthology.orchestra.run.smithi121.stdout: "use_gmt_hitset": true, 2024-04-19T02:15:58.356 INFO:teuthology.orchestra.run.smithi121.stdout: "min_read_recency_for_promote": 0, 2024-04-19T02:15:58.356 INFO:teuthology.orchestra.run.smithi121.stdout: "min_write_recency_for_promote": 0, 2024-04-19T02:15:58.356 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T02:15:58.356 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_search_last_n": 0, 2024-04-19T02:15:58.356 INFO:teuthology.orchestra.run.smithi121.stdout: "grade_table": [], 2024-04-19T02:15:58.356 INFO:teuthology.orchestra.run.smithi121.stdout: "stripe_width": 0, 2024-04-19T02:15:58.356 INFO:teuthology.orchestra.run.smithi121.stdout: "expected_num_objects": 0, 2024-04-19T02:15:58.356 INFO:teuthology.orchestra.run.smithi121.stdout: "fast_read": false, 2024-04-19T02:15:58.356 INFO:teuthology.orchestra.run.smithi121.stdout: "options": {}, 2024-04-19T02:15:58.356 INFO:teuthology.orchestra.run.smithi121.stdout: "application_metadata": { 2024-04-19T02:15:58.356 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd": {} 2024-04-19T02:15:58.357 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:58.357 INFO:teuthology.orchestra.run.smithi121.stdout: "read_balance": { 2024-04-19T02:15:58.357 INFO:teuthology.orchestra.run.smithi121.stdout: "score_acting": 1.5, 2024-04-19T02:15:58.357 INFO:teuthology.orchestra.run.smithi121.stdout: "score_stable": 1.5, 2024-04-19T02:15:58.357 INFO:teuthology.orchestra.run.smithi121.stdout: "optimal_score": 1, 2024-04-19T02:15:58.357 INFO:teuthology.orchestra.run.smithi121.stdout: "raw_score_acting": 1.5, 2024-04-19T02:15:58.357 INFO:teuthology.orchestra.run.smithi121.stdout: "raw_score_stable": 1.5, 2024-04-19T02:15:58.357 INFO:teuthology.orchestra.run.smithi121.stdout: "primary_affinity_weighted": 0.90409350395202637, 2024-04-19T02:15:58.357 INFO:teuthology.orchestra.run.smithi121.stdout: "average_primary_affinity": 0.89999997615814209, 2024-04-19T02:15:58.357 INFO:teuthology.orchestra.run.smithi121.stdout: "average_primary_affinity_weighted": 0.89999997615814209 2024-04-19T02:15:58.357 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:15:58.357 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:58.357 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:15:58.357 INFO:teuthology.orchestra.run.smithi121.stdout: "pool": 3, 2024-04-19T02:15:58.357 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_name": "cephfs_metadata", 2024-04-19T02:15:58.358 INFO:teuthology.orchestra.run.smithi121.stdout: "create_time": "2024-04-19T02:15:27.675087+0000", 2024-04-19T02:15:58.358 INFO:teuthology.orchestra.run.smithi121.stdout: "flags": 1, 2024-04-19T02:15:58.358 INFO:teuthology.orchestra.run.smithi121.stdout: "flags_names": "hashpspool", 2024-04-19T02:15:58.358 INFO:teuthology.orchestra.run.smithi121.stdout: "type": 1, 2024-04-19T02:15:58.358 INFO:teuthology.orchestra.run.smithi121.stdout: "size": 2, 2024-04-19T02:15:58.358 INFO:teuthology.orchestra.run.smithi121.stdout: "min_size": 1, 2024-04-19T02:15:58.358 INFO:teuthology.orchestra.run.smithi121.stdout: "crush_rule": 0, 2024-04-19T02:15:58.358 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_count": 0, 2024-04-19T02:15:58.358 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_target": 0, 2024-04-19T02:15:58.358 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T02:15:58.358 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T02:15:58.358 INFO:teuthology.orchestra.run.smithi121.stdout: "object_hash": 2, 2024-04-19T02:15:58.358 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_autoscale_mode": "off", 2024-04-19T02:15:58.358 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num": 32, 2024-04-19T02:15:58.359 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_placement_num": 32, 2024-04-19T02:15:58.359 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_placement_num_target": 32, 2024-04-19T02:15:58.359 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_target": 32, 2024-04-19T02:15:58.359 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_pending": 32, 2024-04-19T02:15:58.359 INFO:teuthology.orchestra.run.smithi121.stdout: "last_pg_merge_meta": { 2024-04-19T02:15:58.359 INFO:teuthology.orchestra.run.smithi121.stdout: "source_pgid": "0.0", 2024-04-19T02:15:58.359 INFO:teuthology.orchestra.run.smithi121.stdout: "ready_epoch": 0, 2024-04-19T02:15:58.359 INFO:teuthology.orchestra.run.smithi121.stdout: "last_epoch_started": 0, 2024-04-19T02:15:58.359 INFO:teuthology.orchestra.run.smithi121.stdout: "last_epoch_clean": 0, 2024-04-19T02:15:58.359 INFO:teuthology.orchestra.run.smithi121.stdout: "source_version": "0'0", 2024-04-19T02:15:58.359 INFO:teuthology.orchestra.run.smithi121.stdout: "target_version": "0'0" 2024-04-19T02:15:58.359 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:58.359 INFO:teuthology.orchestra.run.smithi121.stdout: "last_change": "14", 2024-04-19T02:15:58.359 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend": "0", 2024-04-19T02:15:58.360 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T02:15:58.360 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T02:15:58.360 INFO:teuthology.orchestra.run.smithi121.stdout: "auid": 0, 2024-04-19T02:15:58.360 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_mode": "selfmanaged", 2024-04-19T02:15:58.360 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_seq": 0, 2024-04-19T02:15:58.360 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_epoch": 0, 2024-04-19T02:15:58.360 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_snaps": [], 2024-04-19T02:15:58.360 INFO:teuthology.orchestra.run.smithi121.stdout: "removed_snaps": "[]", 2024-04-19T02:15:58.360 INFO:teuthology.orchestra.run.smithi121.stdout: "quota_max_bytes": 0, 2024-04-19T02:15:58.360 INFO:teuthology.orchestra.run.smithi121.stdout: "quota_max_objects": 0, 2024-04-19T02:15:58.360 INFO:teuthology.orchestra.run.smithi121.stdout: "tiers": [], 2024-04-19T02:15:58.360 INFO:teuthology.orchestra.run.smithi121.stdout: "tier_of": -1, 2024-04-19T02:15:58.360 INFO:teuthology.orchestra.run.smithi121.stdout: "read_tier": -1, 2024-04-19T02:15:58.360 INFO:teuthology.orchestra.run.smithi121.stdout: "write_tier": -1, 2024-04-19T02:15:58.360 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_mode": "none", 2024-04-19T02:15:58.361 INFO:teuthology.orchestra.run.smithi121.stdout: "target_max_bytes": 0, 2024-04-19T02:15:58.361 INFO:teuthology.orchestra.run.smithi121.stdout: "target_max_objects": 0, 2024-04-19T02:15:58.361 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T02:15:58.361 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T02:15:58.361 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T02:15:58.361 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_min_flush_age": 0, 2024-04-19T02:15:58.361 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_min_evict_age": 0, 2024-04-19T02:15:58.361 INFO:teuthology.orchestra.run.smithi121.stdout: "erasure_code_profile": "", 2024-04-19T02:15:58.361 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_params": { 2024-04-19T02:15:58.361 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "none" 2024-04-19T02:15:58.361 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:58.361 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_period": 0, 2024-04-19T02:15:58.361 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_count": 0, 2024-04-19T02:15:58.361 INFO:teuthology.orchestra.run.smithi121.stdout: "use_gmt_hitset": true, 2024-04-19T02:15:58.361 INFO:teuthology.orchestra.run.smithi121.stdout: "min_read_recency_for_promote": 0, 2024-04-19T02:15:58.362 INFO:teuthology.orchestra.run.smithi121.stdout: "min_write_recency_for_promote": 0, 2024-04-19T02:15:58.362 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T02:15:58.362 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_search_last_n": 0, 2024-04-19T02:15:58.362 INFO:teuthology.orchestra.run.smithi121.stdout: "grade_table": [], 2024-04-19T02:15:58.362 INFO:teuthology.orchestra.run.smithi121.stdout: "stripe_width": 0, 2024-04-19T02:15:58.362 INFO:teuthology.orchestra.run.smithi121.stdout: "expected_num_objects": 0, 2024-04-19T02:15:58.362 INFO:teuthology.orchestra.run.smithi121.stdout: "fast_read": false, 2024-04-19T02:15:58.362 INFO:teuthology.orchestra.run.smithi121.stdout: "options": { 2024-04-19T02:15:58.362 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_autoscale_bias": 4, 2024-04-19T02:15:58.362 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_min": 16, 2024-04-19T02:15:58.362 INFO:teuthology.orchestra.run.smithi121.stdout: "recovery_priority": 5 2024-04-19T02:15:58.362 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:58.362 INFO:teuthology.orchestra.run.smithi121.stdout: "application_metadata": { 2024-04-19T02:15:58.362 INFO:teuthology.orchestra.run.smithi121.stdout: "cephfs": { 2024-04-19T02:15:58.362 INFO:teuthology.orchestra.run.smithi121.stdout: "metadata": "cephfs" 2024-04-19T02:15:58.363 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:15:58.363 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:58.363 INFO:teuthology.orchestra.run.smithi121.stdout: "read_balance": { 2024-04-19T02:15:58.363 INFO:teuthology.orchestra.run.smithi121.stdout: "score_acting": 1.2200000286102295, 2024-04-19T02:15:58.363 INFO:teuthology.orchestra.run.smithi121.stdout: "score_stable": 1.2200000286102295, 2024-04-19T02:15:58.363 INFO:teuthology.orchestra.run.smithi121.stdout: "optimal_score": 1, 2024-04-19T02:15:58.363 INFO:teuthology.orchestra.run.smithi121.stdout: "raw_score_acting": 1.2200000286102295, 2024-04-19T02:15:58.363 INFO:teuthology.orchestra.run.smithi121.stdout: "raw_score_stable": 1.2200000286102295, 2024-04-19T02:15:58.363 INFO:teuthology.orchestra.run.smithi121.stdout: "primary_affinity_weighted": 0.90409350395202637, 2024-04-19T02:15:58.363 INFO:teuthology.orchestra.run.smithi121.stdout: "average_primary_affinity": 0.89999997615814209, 2024-04-19T02:15:58.363 INFO:teuthology.orchestra.run.smithi121.stdout: "average_primary_affinity_weighted": 0.89999997615814209 2024-04-19T02:15:58.363 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:15:58.363 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:58.363 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:15:58.363 INFO:teuthology.orchestra.run.smithi121.stdout: "pool": 4, 2024-04-19T02:15:58.364 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_name": "cephfs_data", 2024-04-19T02:15:58.364 INFO:teuthology.orchestra.run.smithi121.stdout: "create_time": "2024-04-19T02:15:28.232224+0000", 2024-04-19T02:15:58.364 INFO:teuthology.orchestra.run.smithi121.stdout: "flags": 1, 2024-04-19T02:15:58.364 INFO:teuthology.orchestra.run.smithi121.stdout: "flags_names": "hashpspool", 2024-04-19T02:15:58.364 INFO:teuthology.orchestra.run.smithi121.stdout: "type": 1, 2024-04-19T02:15:58.364 INFO:teuthology.orchestra.run.smithi121.stdout: "size": 2, 2024-04-19T02:15:58.364 INFO:teuthology.orchestra.run.smithi121.stdout: "min_size": 1, 2024-04-19T02:15:58.364 INFO:teuthology.orchestra.run.smithi121.stdout: "crush_rule": 0, 2024-04-19T02:15:58.364 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_count": 0, 2024-04-19T02:15:58.364 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_target": 0, 2024-04-19T02:15:58.364 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T02:15:58.364 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T02:15:58.364 INFO:teuthology.orchestra.run.smithi121.stdout: "object_hash": 2, 2024-04-19T02:15:58.364 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_autoscale_mode": "off", 2024-04-19T02:15:58.365 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num": 64, 2024-04-19T02:15:58.365 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_placement_num": 64, 2024-04-19T02:15:58.365 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_placement_num_target": 64, 2024-04-19T02:15:58.365 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_target": 64, 2024-04-19T02:15:58.365 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_pending": 64, 2024-04-19T02:15:58.365 INFO:teuthology.orchestra.run.smithi121.stdout: "last_pg_merge_meta": { 2024-04-19T02:15:58.365 INFO:teuthology.orchestra.run.smithi121.stdout: "source_pgid": "0.0", 2024-04-19T02:15:58.365 INFO:teuthology.orchestra.run.smithi121.stdout: "ready_epoch": 0, 2024-04-19T02:15:58.365 INFO:teuthology.orchestra.run.smithi121.stdout: "last_epoch_started": 0, 2024-04-19T02:15:58.365 INFO:teuthology.orchestra.run.smithi121.stdout: "last_epoch_clean": 0, 2024-04-19T02:15:58.365 INFO:teuthology.orchestra.run.smithi121.stdout: "source_version": "0'0", 2024-04-19T02:15:58.365 INFO:teuthology.orchestra.run.smithi121.stdout: "target_version": "0'0" 2024-04-19T02:15:58.365 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:58.365 INFO:teuthology.orchestra.run.smithi121.stdout: "last_change": "15", 2024-04-19T02:15:58.365 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend": "0", 2024-04-19T02:15:58.366 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T02:15:58.366 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T02:15:58.366 INFO:teuthology.orchestra.run.smithi121.stdout: "auid": 0, 2024-04-19T02:15:58.366 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_mode": "selfmanaged", 2024-04-19T02:15:58.366 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_seq": 0, 2024-04-19T02:15:58.366 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_epoch": 0, 2024-04-19T02:15:58.366 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_snaps": [], 2024-04-19T02:15:58.366 INFO:teuthology.orchestra.run.smithi121.stdout: "removed_snaps": "[]", 2024-04-19T02:15:58.366 INFO:teuthology.orchestra.run.smithi121.stdout: "quota_max_bytes": 0, 2024-04-19T02:15:58.366 INFO:teuthology.orchestra.run.smithi121.stdout: "quota_max_objects": 0, 2024-04-19T02:15:58.366 INFO:teuthology.orchestra.run.smithi121.stdout: "tiers": [], 2024-04-19T02:15:58.366 INFO:teuthology.orchestra.run.smithi121.stdout: "tier_of": -1, 2024-04-19T02:15:58.366 INFO:teuthology.orchestra.run.smithi121.stdout: "read_tier": -1, 2024-04-19T02:15:58.366 INFO:teuthology.orchestra.run.smithi121.stdout: "write_tier": -1, 2024-04-19T02:15:58.367 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_mode": "none", 2024-04-19T02:15:58.367 INFO:teuthology.orchestra.run.smithi121.stdout: "target_max_bytes": 0, 2024-04-19T02:15:58.367 INFO:teuthology.orchestra.run.smithi121.stdout: "target_max_objects": 0, 2024-04-19T02:15:58.367 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T02:15:58.367 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T02:15:58.367 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T02:15:58.367 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_min_flush_age": 0, 2024-04-19T02:15:58.367 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_min_evict_age": 0, 2024-04-19T02:15:58.367 INFO:teuthology.orchestra.run.smithi121.stdout: "erasure_code_profile": "", 2024-04-19T02:15:58.367 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_params": { 2024-04-19T02:15:58.367 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "none" 2024-04-19T02:15:58.367 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:58.367 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_period": 0, 2024-04-19T02:15:58.367 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_count": 0, 2024-04-19T02:15:58.368 INFO:teuthology.orchestra.run.smithi121.stdout: "use_gmt_hitset": true, 2024-04-19T02:15:58.368 INFO:teuthology.orchestra.run.smithi121.stdout: "min_read_recency_for_promote": 0, 2024-04-19T02:15:58.368 INFO:teuthology.orchestra.run.smithi121.stdout: "min_write_recency_for_promote": 0, 2024-04-19T02:15:58.368 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T02:15:58.368 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_search_last_n": 0, 2024-04-19T02:15:58.368 INFO:teuthology.orchestra.run.smithi121.stdout: "grade_table": [], 2024-04-19T02:15:58.368 INFO:teuthology.orchestra.run.smithi121.stdout: "stripe_width": 0, 2024-04-19T02:15:58.368 INFO:teuthology.orchestra.run.smithi121.stdout: "expected_num_objects": 0, 2024-04-19T02:15:58.368 INFO:teuthology.orchestra.run.smithi121.stdout: "fast_read": false, 2024-04-19T02:15:58.368 INFO:teuthology.orchestra.run.smithi121.stdout: "options": { 2024-04-19T02:15:58.368 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_min": 64, 2024-04-19T02:15:58.368 INFO:teuthology.orchestra.run.smithi121.stdout: "target_size_ratio": 0.89999997615814209 2024-04-19T02:15:58.368 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:58.368 INFO:teuthology.orchestra.run.smithi121.stdout: "application_metadata": { 2024-04-19T02:15:58.368 INFO:teuthology.orchestra.run.smithi121.stdout: "cephfs": { 2024-04-19T02:15:58.369 INFO:teuthology.orchestra.run.smithi121.stdout: "data": "cephfs" 2024-04-19T02:15:58.369 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:15:58.369 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:58.369 INFO:teuthology.orchestra.run.smithi121.stdout: "read_balance": { 2024-04-19T02:15:58.369 INFO:teuthology.orchestra.run.smithi121.stdout: "score_acting": 1.1699999570846558, 2024-04-19T02:15:58.369 INFO:teuthology.orchestra.run.smithi121.stdout: "score_stable": 1.1699999570846558, 2024-04-19T02:15:58.369 INFO:teuthology.orchestra.run.smithi121.stdout: "optimal_score": 1, 2024-04-19T02:15:58.369 INFO:teuthology.orchestra.run.smithi121.stdout: "raw_score_acting": 1.1699999570846558, 2024-04-19T02:15:58.369 INFO:teuthology.orchestra.run.smithi121.stdout: "raw_score_stable": 1.1699999570846558, 2024-04-19T02:15:58.369 INFO:teuthology.orchestra.run.smithi121.stdout: "primary_affinity_weighted": 0.90409350395202637, 2024-04-19T02:15:58.369 INFO:teuthology.orchestra.run.smithi121.stdout: "average_primary_affinity": 0.89999997615814209, 2024-04-19T02:15:58.369 INFO:teuthology.orchestra.run.smithi121.stdout: "average_primary_affinity_weighted": 0.89999997615814209 2024-04-19T02:15:58.369 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:15:58.369 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:58.369 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:15:58.370 INFO:teuthology.orchestra.run.smithi121.stdout: "pool": 5, 2024-04-19T02:15:58.370 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_name": "unique_pool_0", 2024-04-19T02:15:58.370 INFO:teuthology.orchestra.run.smithi121.stdout: "create_time": "2024-04-19T02:15:52.929114+0000", 2024-04-19T02:15:58.370 INFO:teuthology.orchestra.run.smithi121.stdout: "flags": 1, 2024-04-19T02:15:58.370 INFO:teuthology.orchestra.run.smithi121.stdout: "flags_names": "hashpspool", 2024-04-19T02:15:58.370 INFO:teuthology.orchestra.run.smithi121.stdout: "type": 1, 2024-04-19T02:15:58.370 INFO:teuthology.orchestra.run.smithi121.stdout: "size": 2, 2024-04-19T02:15:58.370 INFO:teuthology.orchestra.run.smithi121.stdout: "min_size": 1, 2024-04-19T02:15:58.370 INFO:teuthology.orchestra.run.smithi121.stdout: "crush_rule": 0, 2024-04-19T02:15:58.370 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_count": 0, 2024-04-19T02:15:58.370 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_target": 0, 2024-04-19T02:15:58.370 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T02:15:58.370 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T02:15:58.370 INFO:teuthology.orchestra.run.smithi121.stdout: "object_hash": 2, 2024-04-19T02:15:58.371 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_autoscale_mode": "off", 2024-04-19T02:15:58.371 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num": 16, 2024-04-19T02:15:58.371 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_placement_num": 16, 2024-04-19T02:15:58.371 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_placement_num_target": 16, 2024-04-19T02:15:58.371 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_target": 16, 2024-04-19T02:15:58.371 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_pending": 16, 2024-04-19T02:15:58.371 INFO:teuthology.orchestra.run.smithi121.stdout: "last_pg_merge_meta": { 2024-04-19T02:15:58.371 INFO:teuthology.orchestra.run.smithi121.stdout: "source_pgid": "0.0", 2024-04-19T02:15:58.371 INFO:teuthology.orchestra.run.smithi121.stdout: "ready_epoch": 0, 2024-04-19T02:15:58.371 INFO:teuthology.orchestra.run.smithi121.stdout: "last_epoch_started": 0, 2024-04-19T02:15:58.371 INFO:teuthology.orchestra.run.smithi121.stdout: "last_epoch_clean": 0, 2024-04-19T02:15:58.371 INFO:teuthology.orchestra.run.smithi121.stdout: "source_version": "0'0", 2024-04-19T02:15:58.371 INFO:teuthology.orchestra.run.smithi121.stdout: "target_version": "0'0" 2024-04-19T02:15:58.371 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:58.371 INFO:teuthology.orchestra.run.smithi121.stdout: "last_change": "18", 2024-04-19T02:15:58.371 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend": "0", 2024-04-19T02:15:58.372 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T02:15:58.372 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T02:15:58.372 INFO:teuthology.orchestra.run.smithi121.stdout: "auid": 0, 2024-04-19T02:15:58.372 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_mode": "selfmanaged", 2024-04-19T02:15:58.372 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_seq": 0, 2024-04-19T02:15:58.372 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_epoch": 0, 2024-04-19T02:15:58.372 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_snaps": [], 2024-04-19T02:15:58.372 INFO:teuthology.orchestra.run.smithi121.stdout: "removed_snaps": "[]", 2024-04-19T02:15:58.372 INFO:teuthology.orchestra.run.smithi121.stdout: "quota_max_bytes": 0, 2024-04-19T02:15:58.372 INFO:teuthology.orchestra.run.smithi121.stdout: "quota_max_objects": 0, 2024-04-19T02:15:58.372 INFO:teuthology.orchestra.run.smithi121.stdout: "tiers": [], 2024-04-19T02:15:58.372 INFO:teuthology.orchestra.run.smithi121.stdout: "tier_of": -1, 2024-04-19T02:15:58.372 INFO:teuthology.orchestra.run.smithi121.stdout: "read_tier": -1, 2024-04-19T02:15:58.372 INFO:teuthology.orchestra.run.smithi121.stdout: "write_tier": -1, 2024-04-19T02:15:58.372 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_mode": "none", 2024-04-19T02:15:58.373 INFO:teuthology.orchestra.run.smithi121.stdout: "target_max_bytes": 0, 2024-04-19T02:15:58.373 INFO:teuthology.orchestra.run.smithi121.stdout: "target_max_objects": 0, 2024-04-19T02:15:58.373 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T02:15:58.373 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T02:15:58.373 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T02:15:58.373 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_min_flush_age": 0, 2024-04-19T02:15:58.373 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_min_evict_age": 0, 2024-04-19T02:15:58.373 INFO:teuthology.orchestra.run.smithi121.stdout: "erasure_code_profile": "", 2024-04-19T02:15:58.373 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_params": { 2024-04-19T02:15:58.373 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "none" 2024-04-19T02:15:58.373 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:58.373 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_period": 0, 2024-04-19T02:15:58.373 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_count": 0, 2024-04-19T02:15:58.373 INFO:teuthology.orchestra.run.smithi121.stdout: "use_gmt_hitset": true, 2024-04-19T02:15:58.373 INFO:teuthology.orchestra.run.smithi121.stdout: "min_read_recency_for_promote": 0, 2024-04-19T02:15:58.374 INFO:teuthology.orchestra.run.smithi121.stdout: "min_write_recency_for_promote": 0, 2024-04-19T02:15:58.374 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T02:15:58.374 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_search_last_n": 0, 2024-04-19T02:15:58.374 INFO:teuthology.orchestra.run.smithi121.stdout: "grade_table": [], 2024-04-19T02:15:58.374 INFO:teuthology.orchestra.run.smithi121.stdout: "stripe_width": 0, 2024-04-19T02:15:58.374 INFO:teuthology.orchestra.run.smithi121.stdout: "expected_num_objects": 0, 2024-04-19T02:15:58.374 INFO:teuthology.orchestra.run.smithi121.stdout: "fast_read": false, 2024-04-19T02:15:58.374 INFO:teuthology.orchestra.run.smithi121.stdout: "options": {}, 2024-04-19T02:15:58.374 INFO:teuthology.orchestra.run.smithi121.stdout: "application_metadata": { 2024-04-19T02:15:58.374 INFO:teuthology.orchestra.run.smithi121.stdout: "rados": {} 2024-04-19T02:15:58.374 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:58.374 INFO:teuthology.orchestra.run.smithi121.stdout: "read_balance": { 2024-04-19T02:15:58.374 INFO:teuthology.orchestra.run.smithi121.stdout: "score_acting": 1.1299999952316284, 2024-04-19T02:15:58.374 INFO:teuthology.orchestra.run.smithi121.stdout: "score_stable": 1.1299999952316284, 2024-04-19T02:15:58.374 INFO:teuthology.orchestra.run.smithi121.stdout: "optimal_score": 1, 2024-04-19T02:15:58.375 INFO:teuthology.orchestra.run.smithi121.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-19T02:15:58.375 INFO:teuthology.orchestra.run.smithi121.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-19T02:15:58.375 INFO:teuthology.orchestra.run.smithi121.stdout: "primary_affinity_weighted": 0.90409350395202637, 2024-04-19T02:15:58.375 INFO:teuthology.orchestra.run.smithi121.stdout: "average_primary_affinity": 0.89999997615814209, 2024-04-19T02:15:58.375 INFO:teuthology.orchestra.run.smithi121.stdout: "average_primary_affinity_weighted": 0.89999997615814209 2024-04-19T02:15:58.375 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:15:58.375 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:15:58.375 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-04-19T02:15:58.375 INFO:teuthology.orchestra.run.smithi121.stdout: "osds": [ 2024-04-19T02:15:58.375 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:15:58.375 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": 0, 2024-04-19T02:15:58.375 INFO:teuthology.orchestra.run.smithi121.stdout: "uuid": "88cb15f3-271c-43d5-af51-1cd26b8ed13c", 2024-04-19T02:15:58.375 INFO:teuthology.orchestra.run.smithi121.stdout: "up": 1, 2024-04-19T02:15:58.375 INFO:teuthology.orchestra.run.smithi121.stdout: "in": 1, 2024-04-19T02:15:58.375 INFO:teuthology.orchestra.run.smithi121.stdout: "weight": 1, 2024-04-19T02:15:58.375 INFO:teuthology.orchestra.run.smithi121.stdout: "primary_affinity": 1, 2024-04-19T02:15:58.376 INFO:teuthology.orchestra.run.smithi121.stdout: "last_clean_begin": 0, 2024-04-19T02:15:58.376 INFO:teuthology.orchestra.run.smithi121.stdout: "last_clean_end": 0, 2024-04-19T02:15:58.376 INFO:teuthology.orchestra.run.smithi121.stdout: "up_from": 8, 2024-04-19T02:15:58.376 INFO:teuthology.orchestra.run.smithi121.stdout: "up_thru": 16, 2024-04-19T02:15:58.376 INFO:teuthology.orchestra.run.smithi121.stdout: "down_at": 0, 2024-04-19T02:15:58.376 INFO:teuthology.orchestra.run.smithi121.stdout: "lost_at": 0, 2024-04-19T02:15:58.376 INFO:teuthology.orchestra.run.smithi121.stdout: "public_addrs": { 2024-04-19T02:15:58.376 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:15:58.376 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:15:58.376 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:15:58.376 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.153:6800", 2024-04-19T02:15:58.376 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41347 2024-04-19T02:15:58.376 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:58.376 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:15:58.377 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:15:58.377 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.153:6801", 2024-04-19T02:15:58.377 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41347 2024-04-19T02:15:58.377 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:15:58.377 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:15:58.377 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:58.377 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_addrs": { 2024-04-19T02:15:58.377 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:15:58.377 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:15:58.377 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:15:58.377 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.153:6802", 2024-04-19T02:15:58.377 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41347 2024-04-19T02:15:58.377 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:58.377 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:15:58.377 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:15:58.378 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.153:6803", 2024-04-19T02:15:58.378 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41347 2024-04-19T02:15:58.378 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:15:58.378 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:15:58.378 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:58.378 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_back_addrs": { 2024-04-19T02:15:58.378 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:15:58.378 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:15:58.378 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:15:58.378 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.153:6806", 2024-04-19T02:15:58.378 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41347 2024-04-19T02:15:58.378 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:58.378 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:15:58.378 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:15:58.379 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.153:6807", 2024-04-19T02:15:58.379 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41347 2024-04-19T02:15:58.379 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:15:58.379 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:15:58.379 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:58.379 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_front_addrs": { 2024-04-19T02:15:58.379 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:15:58.379 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:15:58.379 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:15:58.379 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.153:6804", 2024-04-19T02:15:58.379 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41347 2024-04-19T02:15:58.379 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:58.379 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:15:58.379 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:15:58.379 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.153:6805", 2024-04-19T02:15:58.380 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41347 2024-04-19T02:15:58.380 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:15:58.380 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:15:58.380 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:58.380 INFO:teuthology.orchestra.run.smithi121.stdout: "public_addr": "172.21.15.153:6801/41347", 2024-04-19T02:15:58.380 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_addr": "172.21.15.153:6803/41347", 2024-04-19T02:15:58.380 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_back_addr": "172.21.15.153:6807/41347", 2024-04-19T02:15:58.380 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_front_addr": "172.21.15.153:6805/41347", 2024-04-19T02:15:58.380 INFO:teuthology.orchestra.run.smithi121.stdout: "state": [ 2024-04-19T02:15:58.380 INFO:teuthology.orchestra.run.smithi121.stdout: "exists", 2024-04-19T02:15:58.380 INFO:teuthology.orchestra.run.smithi121.stdout: "up" 2024-04-19T02:15:58.380 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:15:58.380 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:58.380 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:15:58.381 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": 1, 2024-04-19T02:15:58.381 INFO:teuthology.orchestra.run.smithi121.stdout: "uuid": "2674869a-db01-4d9f-a496-9fb3851b5b21", 2024-04-19T02:15:58.381 INFO:teuthology.orchestra.run.smithi121.stdout: "up": 1, 2024-04-19T02:15:58.381 INFO:teuthology.orchestra.run.smithi121.stdout: "in": 1, 2024-04-19T02:15:58.381 INFO:teuthology.orchestra.run.smithi121.stdout: "weight": 1, 2024-04-19T02:15:58.381 INFO:teuthology.orchestra.run.smithi121.stdout: "primary_affinity": 0.7122802734375, 2024-04-19T02:15:58.381 INFO:teuthology.orchestra.run.smithi121.stdout: "last_clean_begin": 0, 2024-04-19T02:15:58.381 INFO:teuthology.orchestra.run.smithi121.stdout: "last_clean_end": 0, 2024-04-19T02:15:58.381 INFO:teuthology.orchestra.run.smithi121.stdout: "up_from": 8, 2024-04-19T02:15:58.381 INFO:teuthology.orchestra.run.smithi121.stdout: "up_thru": 16, 2024-04-19T02:15:58.381 INFO:teuthology.orchestra.run.smithi121.stdout: "down_at": 0, 2024-04-19T02:15:58.381 INFO:teuthology.orchestra.run.smithi121.stdout: "lost_at": 0, 2024-04-19T02:15:58.381 INFO:teuthology.orchestra.run.smithi121.stdout: "public_addrs": { 2024-04-19T02:15:58.381 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:15:58.381 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:15:58.382 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:15:58.382 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.174:6800", 2024-04-19T02:15:58.382 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41380 2024-04-19T02:15:58.382 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:58.382 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:15:58.382 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:15:58.382 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.174:6801", 2024-04-19T02:15:58.382 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41380 2024-04-19T02:15:58.382 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:15:58.382 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:15:58.382 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:58.382 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_addrs": { 2024-04-19T02:15:58.382 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:15:58.383 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:15:58.383 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:15:58.383 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.174:6802", 2024-04-19T02:15:58.383 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41380 2024-04-19T02:15:58.383 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:58.383 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:15:58.383 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:15:58.383 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.174:6803", 2024-04-19T02:15:58.383 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41380 2024-04-19T02:15:58.383 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:15:58.383 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:15:58.383 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:58.383 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_back_addrs": { 2024-04-19T02:15:58.383 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:15:58.384 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:15:58.384 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:15:58.384 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.174:6806", 2024-04-19T02:15:58.384 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41380 2024-04-19T02:15:58.384 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:58.384 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:15:58.384 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:15:58.384 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.174:6807", 2024-04-19T02:15:58.384 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41380 2024-04-19T02:15:58.384 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:15:58.384 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:15:58.384 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:58.384 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_front_addrs": { 2024-04-19T02:15:58.384 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:15:58.384 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:15:58.384 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:15:58.385 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.174:6804", 2024-04-19T02:15:58.385 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41380 2024-04-19T02:15:58.385 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:58.385 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:15:58.385 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:15:58.385 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.174:6805", 2024-04-19T02:15:58.385 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41380 2024-04-19T02:15:58.385 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:15:58.385 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:15:58.385 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:58.385 INFO:teuthology.orchestra.run.smithi121.stdout: "public_addr": "172.21.15.174:6801/41380", 2024-04-19T02:15:58.385 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_addr": "172.21.15.174:6803/41380", 2024-04-19T02:15:58.385 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_back_addr": "172.21.15.174:6807/41380", 2024-04-19T02:15:58.385 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_front_addr": "172.21.15.174:6805/41380", 2024-04-19T02:15:58.385 INFO:teuthology.orchestra.run.smithi121.stdout: "state": [ 2024-04-19T02:15:58.386 INFO:teuthology.orchestra.run.smithi121.stdout: "exists", 2024-04-19T02:15:58.386 INFO:teuthology.orchestra.run.smithi121.stdout: "up" 2024-04-19T02:15:58.386 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:15:58.386 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:58.386 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:15:58.386 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": 2, 2024-04-19T02:15:58.386 INFO:teuthology.orchestra.run.smithi121.stdout: "uuid": "712ad943-2f98-49d9-aabe-f66b509be633", 2024-04-19T02:15:58.386 INFO:teuthology.orchestra.run.smithi121.stdout: "up": 1, 2024-04-19T02:15:58.386 INFO:teuthology.orchestra.run.smithi121.stdout: "in": 1, 2024-04-19T02:15:58.386 INFO:teuthology.orchestra.run.smithi121.stdout: "weight": 1, 2024-04-19T02:15:58.386 INFO:teuthology.orchestra.run.smithi121.stdout: "primary_affinity": 1, 2024-04-19T02:15:58.386 INFO:teuthology.orchestra.run.smithi121.stdout: "last_clean_begin": 0, 2024-04-19T02:15:58.386 INFO:teuthology.orchestra.run.smithi121.stdout: "last_clean_end": 0, 2024-04-19T02:15:58.386 INFO:teuthology.orchestra.run.smithi121.stdout: "up_from": 8, 2024-04-19T02:15:58.387 INFO:teuthology.orchestra.run.smithi121.stdout: "up_thru": 16, 2024-04-19T02:15:58.387 INFO:teuthology.orchestra.run.smithi121.stdout: "down_at": 0, 2024-04-19T02:15:58.387 INFO:teuthology.orchestra.run.smithi121.stdout: "lost_at": 0, 2024-04-19T02:15:58.387 INFO:teuthology.orchestra.run.smithi121.stdout: "public_addrs": { 2024-04-19T02:15:58.387 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:15:58.387 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:15:58.387 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:15:58.387 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.177:6800", 2024-04-19T02:15:58.387 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41508 2024-04-19T02:15:58.387 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:58.387 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:15:58.387 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:15:58.387 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.177:6801", 2024-04-19T02:15:58.387 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41508 2024-04-19T02:15:58.387 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:15:58.388 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:15:58.388 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:58.388 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_addrs": { 2024-04-19T02:15:58.388 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:15:58.388 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:15:58.388 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:15:58.388 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.177:6802", 2024-04-19T02:15:58.388 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41508 2024-04-19T02:15:58.388 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:58.388 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:15:58.388 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:15:58.388 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.177:6803", 2024-04-19T02:15:58.388 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41508 2024-04-19T02:15:58.388 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:15:58.388 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:15:58.389 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:58.389 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_back_addrs": { 2024-04-19T02:15:58.389 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:15:58.389 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:15:58.389 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:15:58.389 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.177:6806", 2024-04-19T02:15:58.389 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41508 2024-04-19T02:15:58.389 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:58.389 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:15:58.389 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:15:58.389 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.177:6807", 2024-04-19T02:15:58.389 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41508 2024-04-19T02:15:58.389 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:15:58.389 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:15:58.389 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:58.390 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_front_addrs": { 2024-04-19T02:15:58.390 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:15:58.390 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:15:58.390 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:15:58.390 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.177:6804", 2024-04-19T02:15:58.390 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41508 2024-04-19T02:15:58.390 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:58.390 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:15:58.390 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:15:58.390 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.177:6805", 2024-04-19T02:15:58.390 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41508 2024-04-19T02:15:58.390 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:15:58.390 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:15:58.390 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:58.390 INFO:teuthology.orchestra.run.smithi121.stdout: "public_addr": "172.21.15.177:6801/41508", 2024-04-19T02:15:58.391 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_addr": "172.21.15.177:6803/41508", 2024-04-19T02:15:58.391 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_back_addr": "172.21.15.177:6807/41508", 2024-04-19T02:15:58.391 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_front_addr": "172.21.15.177:6805/41508", 2024-04-19T02:15:58.391 INFO:teuthology.orchestra.run.smithi121.stdout: "state": [ 2024-04-19T02:15:58.391 INFO:teuthology.orchestra.run.smithi121.stdout: "exists", 2024-04-19T02:15:58.391 INFO:teuthology.orchestra.run.smithi121.stdout: "up" 2024-04-19T02:15:58.391 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:15:58.391 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:15:58.391 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-04-19T02:15:58.391 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_xinfo": [ 2024-04-19T02:15:58.391 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:15:58.391 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": 0, 2024-04-19T02:15:58.391 INFO:teuthology.orchestra.run.smithi121.stdout: "down_stamp": "0.000000", 2024-04-19T02:15:58.391 INFO:teuthology.orchestra.run.smithi121.stdout: "laggy_probability": 0, 2024-04-19T02:15:58.392 INFO:teuthology.orchestra.run.smithi121.stdout: "laggy_interval": 0, 2024-04-19T02:15:58.392 INFO:teuthology.orchestra.run.smithi121.stdout: "features": 4540138322906710015, 2024-04-19T02:15:58.392 INFO:teuthology.orchestra.run.smithi121.stdout: "old_weight": 0, 2024-04-19T02:15:58.392 INFO:teuthology.orchestra.run.smithi121.stdout: "last_purged_snaps_scrub": "2024-04-19T02:15:20.495280+0000", 2024-04-19T02:15:58.392 INFO:teuthology.orchestra.run.smithi121.stdout: "dead_epoch": 0 2024-04-19T02:15:58.392 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:58.392 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:15:58.392 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": 1, 2024-04-19T02:15:58.392 INFO:teuthology.orchestra.run.smithi121.stdout: "down_stamp": "0.000000", 2024-04-19T02:15:58.392 INFO:teuthology.orchestra.run.smithi121.stdout: "laggy_probability": 0, 2024-04-19T02:15:58.392 INFO:teuthology.orchestra.run.smithi121.stdout: "laggy_interval": 0, 2024-04-19T02:15:58.392 INFO:teuthology.orchestra.run.smithi121.stdout: "features": 4540138322906710015, 2024-04-19T02:15:58.392 INFO:teuthology.orchestra.run.smithi121.stdout: "old_weight": 0, 2024-04-19T02:15:58.392 INFO:teuthology.orchestra.run.smithi121.stdout: "last_purged_snaps_scrub": "2024-04-19T02:15:20.594553+0000", 2024-04-19T02:15:58.392 INFO:teuthology.orchestra.run.smithi121.stdout: "dead_epoch": 0 2024-04-19T02:15:58.393 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:58.393 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:15:58.393 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": 2, 2024-04-19T02:15:58.393 INFO:teuthology.orchestra.run.smithi121.stdout: "down_stamp": "0.000000", 2024-04-19T02:15:58.393 INFO:teuthology.orchestra.run.smithi121.stdout: "laggy_probability": 0, 2024-04-19T02:15:58.393 INFO:teuthology.orchestra.run.smithi121.stdout: "laggy_interval": 0, 2024-04-19T02:15:58.393 INFO:teuthology.orchestra.run.smithi121.stdout: "features": 4540138322906710015, 2024-04-19T02:15:58.393 INFO:teuthology.orchestra.run.smithi121.stdout: "old_weight": 0, 2024-04-19T02:15:58.393 INFO:teuthology.orchestra.run.smithi121.stdout: "last_purged_snaps_scrub": "2024-04-19T02:15:20.524253+0000", 2024-04-19T02:15:58.393 INFO:teuthology.orchestra.run.smithi121.stdout: "dead_epoch": 0 2024-04-19T02:15:58.393 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:15:58.393 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-04-19T02:15:58.393 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_upmap": [], 2024-04-19T02:15:58.393 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_upmap_items": [], 2024-04-19T02:15:58.394 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_upmap_primaries": [], 2024-04-19T02:15:58.394 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_temp": [], 2024-04-19T02:15:58.394 INFO:teuthology.orchestra.run.smithi121.stdout: "primary_temp": [], 2024-04-19T02:15:58.394 INFO:teuthology.orchestra.run.smithi121.stdout: "blocklist": {}, 2024-04-19T02:15:58.394 INFO:teuthology.orchestra.run.smithi121.stdout: "range_blocklist": {}, 2024-04-19T02:15:58.394 INFO:teuthology.orchestra.run.smithi121.stdout: "erasure_code_profiles": { 2024-04-19T02:15:58.394 INFO:teuthology.orchestra.run.smithi121.stdout: "default": { 2024-04-19T02:15:58.394 INFO:teuthology.orchestra.run.smithi121.stdout: "crush-failure-domain": "osd", 2024-04-19T02:15:58.394 INFO:teuthology.orchestra.run.smithi121.stdout: "k": "2", 2024-04-19T02:15:58.394 INFO:teuthology.orchestra.run.smithi121.stdout: "m": "1", 2024-04-19T02:15:58.394 INFO:teuthology.orchestra.run.smithi121.stdout: "plugin": "jerasure", 2024-04-19T02:15:58.394 INFO:teuthology.orchestra.run.smithi121.stdout: "technique": "reed_sol_van" 2024-04-19T02:15:58.394 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:15:58.394 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:15:58.394 INFO:teuthology.orchestra.run.smithi121.stdout: "removed_snaps_queue": [], 2024-04-19T02:15:58.395 INFO:teuthology.orchestra.run.smithi121.stdout: "new_removed_snaps": [], 2024-04-19T02:15:58.395 INFO:teuthology.orchestra.run.smithi121.stdout: "new_purged_snaps": [], 2024-04-19T02:15:58.395 INFO:teuthology.orchestra.run.smithi121.stdout: "crush_node_flags": {}, 2024-04-19T02:15:58.395 INFO:teuthology.orchestra.run.smithi121.stdout: "device_class_flags": {}, 2024-04-19T02:15:58.395 INFO:teuthology.orchestra.run.smithi121.stdout: "stretch_mode": { 2024-04-19T02:15:58.395 INFO:teuthology.orchestra.run.smithi121.stdout: "stretch_mode_enabled": false, 2024-04-19T02:15:58.395 INFO:teuthology.orchestra.run.smithi121.stdout: "stretch_bucket_count": 0, 2024-04-19T02:15:58.395 INFO:teuthology.orchestra.run.smithi121.stdout: "degraded_stretch_mode": 0, 2024-04-19T02:15:58.395 INFO:teuthology.orchestra.run.smithi121.stdout: "recovering_stretch_mode": 0, 2024-04-19T02:15:58.395 INFO:teuthology.orchestra.run.smithi121.stdout: "stretch_mode_bucket": 0 2024-04-19T02:15:58.395 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:15:58.396 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-04-19T02:15:58.398 INFO:tasks.thrashosds.thrasher:j is {'epoch': 19, 'fsid': 'f6ab5dd0-bb9f-4b48-a9fc-4728c7955ca8', 'created': '2024-04-19T02:15:13.539846+0000', 'modified': '2024-04-19T02:15:55.953086+0000', 'last_up_change': '2024-04-19T02:15:22.519568+0000', 'last_in_change': '2024-04-19T02:15:15.482624+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-19T02:15:22.776125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9040935039520264, 'average_primary_affinity': 0.8999999761581421, 'average_primary_affinity_weighted': 0.8999999761581421}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-19T02:15:23.264005+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9040935039520264, 'average_primary_affinity': 0.8999999761581421, 'average_primary_affinity_weighted': 0.8999999761581421}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-19T02:15:27.675087+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.2200000286102295, 'score_stable': 1.2200000286102295, 'optimal_score': 1, 'raw_score_acting': 1.2200000286102295, 'raw_score_stable': 1.2200000286102295, 'primary_affinity_weighted': 0.9040935039520264, 'average_primary_affinity': 0.8999999761581421, 'average_primary_affinity_weighted': 0.8999999761581421}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-19T02:15:28.232224+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1699999570846558, 'score_stable': 1.1699999570846558, 'optimal_score': 1, 'raw_score_acting': 1.1699999570846558, 'raw_score_stable': 1.1699999570846558, 'primary_affinity_weighted': 0.9040935039520264, 'average_primary_affinity': 0.8999999761581421, 'average_primary_affinity_weighted': 0.8999999761581421}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2024-04-19T02:15:52.929114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 0.9040935039520264, 'average_primary_affinity': 0.8999999761581421, 'average_primary_affinity_weighted': 0.8999999761581421}}], 'osds': [{'osd': 0, 'uuid': '88cb15f3-271c-43d5-af51-1cd26b8ed13c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6800', 'nonce': 41347}, {'type': 'v1', 'addr': '172.21.15.153:6801', 'nonce': 41347}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6802', 'nonce': 41347}, {'type': 'v1', 'addr': '172.21.15.153:6803', 'nonce': 41347}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6806', 'nonce': 41347}, {'type': 'v1', 'addr': '172.21.15.153:6807', 'nonce': 41347}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6804', 'nonce': 41347}, {'type': 'v1', 'addr': '172.21.15.153:6805', 'nonce': 41347}]}, 'public_addr': '172.21.15.153:6801/41347', 'cluster_addr': '172.21.15.153:6803/41347', 'heartbeat_back_addr': '172.21.15.153:6807/41347', 'heartbeat_front_addr': '172.21.15.153:6805/41347', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '2674869a-db01-4d9f-a496-9fb3851b5b21', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.7122802734375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6800', 'nonce': 41380}, {'type': 'v1', 'addr': '172.21.15.174:6801', 'nonce': 41380}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6802', 'nonce': 41380}, {'type': 'v1', 'addr': '172.21.15.174:6803', 'nonce': 41380}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6806', 'nonce': 41380}, {'type': 'v1', 'addr': '172.21.15.174:6807', 'nonce': 41380}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6804', 'nonce': 41380}, {'type': 'v1', 'addr': '172.21.15.174:6805', 'nonce': 41380}]}, 'public_addr': '172.21.15.174:6801/41380', 'cluster_addr': '172.21.15.174:6803/41380', 'heartbeat_back_addr': '172.21.15.174:6807/41380', 'heartbeat_front_addr': '172.21.15.174:6805/41380', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '712ad943-2f98-49d9-aabe-f66b509be633', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6800', 'nonce': 41508}, {'type': 'v1', 'addr': '172.21.15.177:6801', 'nonce': 41508}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6802', 'nonce': 41508}, {'type': 'v1', 'addr': '172.21.15.177:6803', 'nonce': 41508}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6806', 'nonce': 41508}, {'type': 'v1', 'addr': '172.21.15.177:6807', 'nonce': 41508}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6804', 'nonce': 41508}, {'type': 'v1', 'addr': '172.21.15.177:6805', 'nonce': 41508}]}, 'public_addr': '172.21.15.177:6801/41508', 'cluster_addr': '172.21.15.177:6803/41508', 'heartbeat_back_addr': '172.21.15.177:6807/41508', 'heartbeat_front_addr': '172.21.15.177:6805/41508', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-19T02:15:20.495280+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-19T02:15:20.594553+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-19T02:15:20.524253+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-19T02:15:58.398 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:15:58.443 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:15:58.444+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:15:58.544 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:15:58.545+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:15:58.556 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:15:58.556 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:15:58.570 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:15:58.645 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:15:58.646+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:15:58.728 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:15:58.728 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:15:58.741 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:15:58.786 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:15:58.786+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:15:58.794 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:15:58.796 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-04-19T02:15:58.806 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-04-19T02:15:58.743798+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":636226394,"num_objects":9723,"num_object_clones":0,"num_object_copies":19446,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9723,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":9947,"num_write_kb":624210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9895,"ondisk_log_size":9895,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":234,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1145344,"kb_used_data":1031512,"kb_used_omap":4,"kb_used_meta":113787,"kb_avail":281970176,"statfs":{"total":289910292480,"available":288737460224,"internally_reserved":0,"allocated":1056268288,"data_stored":1055856122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":116518226},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,7,5],"upper_bound":8},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":635633664,"num_objects":9699,"num_object_clones":0,"num_object_copies":19398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9699,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9699,"num_write_kb":620736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.797099"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.955921+0000","last_change":"2024-04-19T02:15:29.280412+0000","last_active":"2024-04-19T02:15:54.955921+0000","last_peered":"2024-04-19T02:15:54.955921+0000","last_clean":"2024-04-19T02:15:54.955921+0000","last_became_active":"2024-04-19T02:15:29.278762+0000","last_became_peered":"2024-04-19T02:15:29.278762+0000","last_unstale":"2024-04-19T02:15:54.955921+0000","last_undegraded":"2024-04-19T02:15:54.955921+0000","last_fullsized":"2024-04-19T02:15:54.955921+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:45.301675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.955609+0000","last_change":"2024-04-19T02:15:29.284695+0000","last_active":"2024-04-19T02:15:54.955609+0000","last_peered":"2024-04-19T02:15:54.955609+0000","last_clean":"2024-04-19T02:15:54.955609+0000","last_became_active":"2024-04-19T02:15:29.283468+0000","last_became_peered":"2024-04-19T02:15:29.283468+0000","last_unstale":"2024-04-19T02:15:54.955609+0000","last_undegraded":"2024-04-19T02:15:54.955609+0000","last_fullsized":"2024-04-19T02:15:54.955609+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.384881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:55.031796+0000","last_change":"2024-04-19T02:15:29.286709+0000","last_active":"2024-04-19T02:15:55.031796+0000","last_peered":"2024-04-19T02:15:55.031796+0000","last_clean":"2024-04-19T02:15:55.031796+0000","last_became_active":"2024-04-19T02:15:29.286169+0000","last_became_peered":"2024-04-19T02:15:29.286169+0000","last_unstale":"2024-04-19T02:15:55.031796+0000","last_undegraded":"2024-04-19T02:15:55.031796+0000","last_fullsized":"2024-04-19T02:15:55.031796+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:58.741466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:55.031603+0000","last_change":"2024-04-19T02:15:29.280131+0000","last_active":"2024-04-19T02:15:55.031603+0000","last_peered":"2024-04-19T02:15:55.031603+0000","last_clean":"2024-04-19T02:15:55.031603+0000","last_became_active":"2024-04-19T02:15:29.279388+0000","last_became_peered":"2024-04-19T02:15:29.279388+0000","last_unstale":"2024-04-19T02:15:55.031603+0000","last_undegraded":"2024-04-19T02:15:55.031603+0000","last_fullsized":"2024-04-19T02:15:55.031603+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:36:48.819486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T02:15:55.963679+0000","last_change":"2024-04-19T02:15:53.955892+0000","last_active":"2024-04-19T02:15:55.963679+0000","last_peered":"2024-04-19T02:15:55.963679+0000","last_clean":"2024-04-19T02:15:55.963679+0000","last_became_active":"2024-04-19T02:15:53.955553+0000","last_became_peered":"2024-04-19T02:15:53.955553+0000","last_unstale":"2024-04-19T02:15:55.963679+0000","last_undegraded":"2024-04-19T02:15:55.963679+0000","last_fullsized":"2024-04-19T02:15:55.963679+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:45:39.791209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:55.030346+0000","last_change":"2024-04-19T02:15:29.283908+0000","last_active":"2024-04-19T02:15:55.030346+0000","last_peered":"2024-04-19T02:15:55.030346+0000","last_clean":"2024-04-19T02:15:55.030346+0000","last_became_active":"2024-04-19T02:15:29.281729+0000","last_became_peered":"2024-04-19T02:15:29.281729+0000","last_unstale":"2024-04-19T02:15:55.030346+0000","last_undegraded":"2024-04-19T02:15:55.030346+0000","last_fullsized":"2024-04-19T02:15:55.030346+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:03:15.383476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:55.030218+0000","last_change":"2024-04-19T02:15:29.281253+0000","last_active":"2024-04-19T02:15:55.030218+0000","last_peered":"2024-04-19T02:15:55.030218+0000","last_clean":"2024-04-19T02:15:55.030218+0000","last_became_active":"2024-04-19T02:15:29.279951+0000","last_became_peered":"2024-04-19T02:15:29.279951+0000","last_unstale":"2024-04-19T02:15:55.030218+0000","last_undegraded":"2024-04-19T02:15:55.030218+0000","last_fullsized":"2024-04-19T02:15:55.030218+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:55.030105+0000","last_change":"2024-04-19T02:15:29.283952+0000","last_active":"2024-04-19T02:15:55.030105+0000","last_peered":"2024-04-19T02:15:55.030105+0000","last_clean":"2024-04-19T02:15:55.030105+0000","last_became_active":"2024-04-19T02:15:29.282721+0000","last_became_peered":"2024-04-19T02:15:29.282721+0000","last_unstale":"2024-04-19T02:15:55.030105+0000","last_undegraded":"2024-04-19T02:15:55.030105+0000","last_fullsized":"2024-04-19T02:15:55.030105+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:45.301675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.956544+0000","last_change":"2024-04-19T02:15:29.282150+0000","last_active":"2024-04-19T02:15:54.956544+0000","last_peered":"2024-04-19T02:15:54.956544+0000","last_clean":"2024-04-19T02:15:54.956544+0000","last_became_active":"2024-04-19T02:15:29.281538+0000","last_became_peered":"2024-04-19T02:15:29.281538+0000","last_unstale":"2024-04-19T02:15:54.956544+0000","last_undegraded":"2024-04-19T02:15:54.956544+0000","last_fullsized":"2024-04-19T02:15:54.956544+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.955755+0000","last_change":"2024-04-19T02:15:29.284098+0000","last_active":"2024-04-19T02:15:54.955755+0000","last_peered":"2024-04-19T02:15:54.955755+0000","last_clean":"2024-04-19T02:15:54.955755+0000","last_became_active":"2024-04-19T02:15:29.282114+0000","last_became_peered":"2024-04-19T02:15:29.282114+0000","last_unstale":"2024-04-19T02:15:54.955755+0000","last_undegraded":"2024-04-19T02:15:54.955755+0000","last_fullsized":"2024-04-19T02:15:54.955755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:16.568764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:55.031487+0000","last_change":"2024-04-19T02:15:29.280606+0000","last_active":"2024-04-19T02:15:55.031487+0000","last_peered":"2024-04-19T02:15:55.031487+0000","last_clean":"2024-04-19T02:15:55.031487+0000","last_became_active":"2024-04-19T02:15:29.280151+0000","last_became_peered":"2024-04-19T02:15:29.280151+0000","last_unstale":"2024-04-19T02:15:55.031487+0000","last_undegraded":"2024-04-19T02:15:55.031487+0000","last_fullsized":"2024-04-19T02:15:55.031487+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:26:22.452488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T02:15:55.960335+0000","last_change":"2024-04-19T02:15:53.958876+0000","last_active":"2024-04-19T02:15:55.960335+0000","last_peered":"2024-04-19T02:15:55.960335+0000","last_clean":"2024-04-19T02:15:55.960335+0000","last_became_active":"2024-04-19T02:15:53.958626+0000","last_became_peered":"2024-04-19T02:15:53.958626+0000","last_unstale":"2024-04-19T02:15:55.960335+0000","last_undegraded":"2024-04-19T02:15:55.960335+0000","last_fullsized":"2024-04-19T02:15:55.960335+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:23:57.044018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T02:15:55.963407+0000","last_change":"2024-04-19T02:15:53.956801+0000","last_active":"2024-04-19T02:15:55.963407+0000","last_peered":"2024-04-19T02:15:55.963407+0000","last_clean":"2024-04-19T02:15:55.963407+0000","last_became_active":"2024-04-19T02:15:53.956620+0000","last_became_peered":"2024-04-19T02:15:53.956620+0000","last_unstale":"2024-04-19T02:15:55.963407+0000","last_undegraded":"2024-04-19T02:15:55.963407+0000","last_fullsized":"2024-04-19T02:15:55.963407+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:57:05.843101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:55.030621+0000","last_change":"2024-04-19T02:15:29.284262+0000","last_active":"2024-04-19T02:15:55.030621+0000","last_peered":"2024-04-19T02:15:55.030621+0000","last_clean":"2024-04-19T02:15:55.030621+0000","last_became_active":"2024-04-19T02:15:29.283121+0000","last_became_peered":"2024-04-19T02:15:29.283121+0000","last_unstale":"2024-04-19T02:15:55.030621+0000","last_undegraded":"2024-04-19T02:15:55.030621+0000","last_fullsized":"2024-04-19T02:15:55.030621+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:55.030521+0000","last_change":"2024-04-19T02:15:29.285139+0000","last_active":"2024-04-19T02:15:55.030521+0000","last_peered":"2024-04-19T02:15:55.030521+0000","last_clean":"2024-04-19T02:15:55.030521+0000","last_became_active":"2024-04-19T02:15:29.284649+0000","last_became_peered":"2024-04-19T02:15:29.284649+0000","last_unstale":"2024-04-19T02:15:55.030521+0000","last_undegraded":"2024-04-19T02:15:55.030521+0000","last_fullsized":"2024-04-19T02:15:55.030521+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:55.030110+0000","last_change":"2024-04-19T02:15:29.283648+0000","last_active":"2024-04-19T02:15:55.030110+0000","last_peered":"2024-04-19T02:15:55.030110+0000","last_clean":"2024-04-19T02:15:55.030110+0000","last_became_active":"2024-04-19T02:15:29.281606+0000","last_became_peered":"2024-04-19T02:15:29.281606+0000","last_unstale":"2024-04-19T02:15:55.030110+0000","last_undegraded":"2024-04-19T02:15:55.030110+0000","last_fullsized":"2024-04-19T02:15:55.030110+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.956576+0000","last_change":"2024-04-19T02:15:29.278673+0000","last_active":"2024-04-19T02:15:54.956576+0000","last_peered":"2024-04-19T02:15:54.956576+0000","last_clean":"2024-04-19T02:15:54.956576+0000","last_became_active":"2024-04-19T02:15:29.277699+0000","last_became_peered":"2024-04-19T02:15:29.277699+0000","last_unstale":"2024-04-19T02:15:54.956576+0000","last_undegraded":"2024-04-19T02:15:54.956576+0000","last_fullsized":"2024-04-19T02:15:54.956576+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.955812+0000","last_change":"2024-04-19T02:15:29.283341+0000","last_active":"2024-04-19T02:15:54.955812+0000","last_peered":"2024-04-19T02:15:54.955812+0000","last_clean":"2024-04-19T02:15:54.955812+0000","last_became_active":"2024-04-19T02:15:29.281591+0000","last_became_peered":"2024-04-19T02:15:29.281591+0000","last_unstale":"2024-04-19T02:15:54.955812+0000","last_undegraded":"2024-04-19T02:15:54.955812+0000","last_fullsized":"2024-04-19T02:15:54.955812+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:34.593754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.956491+0000","last_change":"2024-04-19T02:15:29.282110+0000","last_active":"2024-04-19T02:15:54.956491+0000","last_peered":"2024-04-19T02:15:54.956491+0000","last_clean":"2024-04-19T02:15:54.956491+0000","last_became_active":"2024-04-19T02:15:29.281716+0000","last_became_peered":"2024-04-19T02:15:29.281716+0000","last_unstale":"2024-04-19T02:15:54.956491+0000","last_undegraded":"2024-04-19T02:15:54.956491+0000","last_fullsized":"2024-04-19T02:15:54.956491+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:55.031646+0000","last_change":"2024-04-19T02:15:29.285237+0000","last_active":"2024-04-19T02:15:55.031646+0000","last_peered":"2024-04-19T02:15:55.031646+0000","last_clean":"2024-04-19T02:15:55.031646+0000","last_became_active":"2024-04-19T02:15:29.282790+0000","last_became_peered":"2024-04-19T02:15:29.282790+0000","last_unstale":"2024-04-19T02:15:55.031646+0000","last_undegraded":"2024-04-19T02:15:55.031646+0000","last_fullsized":"2024-04-19T02:15:55.031646+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:55.030698+0000","last_change":"2024-04-19T02:15:29.282609+0000","last_active":"2024-04-19T02:15:55.030698+0000","last_peered":"2024-04-19T02:15:55.030698+0000","last_clean":"2024-04-19T02:15:55.030698+0000","last_became_active":"2024-04-19T02:15:29.281665+0000","last_became_peered":"2024-04-19T02:15:29.281665+0000","last_unstale":"2024-04-19T02:15:55.030698+0000","last_undegraded":"2024-04-19T02:15:55.030698+0000","last_fullsized":"2024-04-19T02:15:55.030698+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.384881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T02:15:55.960144+0000","last_change":"2024-04-19T02:15:53.955813+0000","last_active":"2024-04-19T02:15:55.960144+0000","last_peered":"2024-04-19T02:15:55.960144+0000","last_clean":"2024-04-19T02:15:55.960144+0000","last_became_active":"2024-04-19T02:15:53.955614+0000","last_became_peered":"2024-04-19T02:15:53.955614+0000","last_unstale":"2024-04-19T02:15:55.960144+0000","last_undegraded":"2024-04-19T02:15:55.960144+0000","last_fullsized":"2024-04-19T02:15:55.960144+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:58:03.192647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.955035+0000","last_change":"2024-04-19T02:15:29.277109+0000","last_active":"2024-04-19T02:15:54.955035+0000","last_peered":"2024-04-19T02:15:54.955035+0000","last_clean":"2024-04-19T02:15:54.955035+0000","last_became_active":"2024-04-19T02:15:29.275417+0000","last_became_peered":"2024-04-19T02:15:29.275417+0000","last_unstale":"2024-04-19T02:15:54.955035+0000","last_undegraded":"2024-04-19T02:15:54.955035+0000","last_fullsized":"2024-04-19T02:15:54.955035+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.955264+0000","last_change":"2024-04-19T02:15:29.283266+0000","last_active":"2024-04-19T02:15:54.955264+0000","last_peered":"2024-04-19T02:15:54.955264+0000","last_clean":"2024-04-19T02:15:54.955264+0000","last_became_active":"2024-04-19T02:15:29.281505+0000","last_became_peered":"2024-04-19T02:15:29.281505+0000","last_unstale":"2024-04-19T02:15:54.955264+0000","last_undegraded":"2024-04-19T02:15:54.955264+0000","last_fullsized":"2024-04-19T02:15:54.955264+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.955881+0000","last_change":"2024-04-19T02:15:29.278084+0000","last_active":"2024-04-19T02:15:54.955881+0000","last_peered":"2024-04-19T02:15:54.955881+0000","last_clean":"2024-04-19T02:15:54.955881+0000","last_became_active":"2024-04-19T02:15:29.276952+0000","last_became_peered":"2024-04-19T02:15:29.276952+0000","last_unstale":"2024-04-19T02:15:54.955881+0000","last_undegraded":"2024-04-19T02:15:54.955881+0000","last_fullsized":"2024-04-19T02:15:54.955881+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.956797+0000","last_change":"2024-04-19T02:15:29.279904+0000","last_active":"2024-04-19T02:15:54.956797+0000","last_peered":"2024-04-19T02:15:54.956797+0000","last_clean":"2024-04-19T02:15:54.956797+0000","last_became_active":"2024-04-19T02:15:29.278938+0000","last_became_peered":"2024-04-19T02:15:29.278938+0000","last_unstale":"2024-04-19T02:15:54.956797+0000","last_undegraded":"2024-04-19T02:15:54.956797+0000","last_fullsized":"2024-04-19T02:15:54.956797+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:55.031592+0000","last_change":"2024-04-19T02:15:29.287389+0000","last_active":"2024-04-19T02:15:55.031592+0000","last_peered":"2024-04-19T02:15:55.031592+0000","last_clean":"2024-04-19T02:15:55.031592+0000","last_became_active":"2024-04-19T02:15:29.286431+0000","last_became_peered":"2024-04-19T02:15:29.286431+0000","last_unstale":"2024-04-19T02:15:55.031592+0000","last_undegraded":"2024-04-19T02:15:55.031592+0000","last_fullsized":"2024-04-19T02:15:55.031592+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:58:30.117887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T02:15:55.963620+0000","last_change":"2024-04-19T02:15:53.959207+0000","last_active":"2024-04-19T02:15:55.963620+0000","last_peered":"2024-04-19T02:15:55.963620+0000","last_clean":"2024-04-19T02:15:55.963620+0000","last_became_active":"2024-04-19T02:15:53.959007+0000","last_became_peered":"2024-04-19T02:15:53.959007+0000","last_unstale":"2024-04-19T02:15:55.963620+0000","last_undegraded":"2024-04-19T02:15:55.963620+0000","last_fullsized":"2024-04-19T02:15:55.963620+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:08:21.065077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.955810+0000","last_change":"2024-04-19T02:15:29.281792+0000","last_active":"2024-04-19T02:15:54.955810+0000","last_peered":"2024-04-19T02:15:54.955810+0000","last_clean":"2024-04-19T02:15:54.955810+0000","last_became_active":"2024-04-19T02:15:29.280479+0000","last_became_peered":"2024-04-19T02:15:29.280479+0000","last_unstale":"2024-04-19T02:15:54.955810+0000","last_undegraded":"2024-04-19T02:15:54.955810+0000","last_fullsized":"2024-04-19T02:15:54.955810+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.955095+0000","last_change":"2024-04-19T02:15:28.888778+0000","last_active":"2024-04-19T02:15:54.955095+0000","last_peered":"2024-04-19T02:15:54.955095+0000","last_clean":"2024-04-19T02:15:54.955095+0000","last_became_active":"2024-04-19T02:15:28.888543+0000","last_became_peered":"2024-04-19T02:15:28.888543+0000","last_unstale":"2024-04-19T02:15:54.955095+0000","last_undegraded":"2024-04-19T02:15:54.955095+0000","last_fullsized":"2024-04-19T02:15:54.955095+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:43:51.221619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.956591+0000","last_change":"2024-04-19T02:15:29.279986+0000","last_active":"2024-04-19T02:15:54.956591+0000","last_peered":"2024-04-19T02:15:54.956591+0000","last_clean":"2024-04-19T02:15:54.956591+0000","last_became_active":"2024-04-19T02:15:29.279690+0000","last_became_peered":"2024-04-19T02:15:29.279690+0000","last_unstale":"2024-04-19T02:15:54.956591+0000","last_undegraded":"2024-04-19T02:15:54.956591+0000","last_fullsized":"2024-04-19T02:15:54.956591+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.955161+0000","last_change":"2024-04-19T02:15:28.890463+0000","last_active":"2024-04-19T02:15:54.955161+0000","last_peered":"2024-04-19T02:15:54.955161+0000","last_clean":"2024-04-19T02:15:54.955161+0000","last_became_active":"2024-04-19T02:15:28.889777+0000","last_became_peered":"2024-04-19T02:15:28.889777+0000","last_unstale":"2024-04-19T02:15:54.955161+0000","last_undegraded":"2024-04-19T02:15:54.955161+0000","last_fullsized":"2024-04-19T02:15:54.955161+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:58:21.520250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.955877+0000","last_change":"2024-04-19T02:15:29.280879+0000","last_active":"2024-04-19T02:15:54.955877+0000","last_peered":"2024-04-19T02:15:54.955877+0000","last_clean":"2024-04-19T02:15:54.955877+0000","last_became_active":"2024-04-19T02:15:29.279314+0000","last_became_peered":"2024-04-19T02:15:29.279314+0000","last_unstale":"2024-04-19T02:15:54.955877+0000","last_undegraded":"2024-04-19T02:15:54.955877+0000","last_fullsized":"2024-04-19T02:15:54.955877+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.956723+0000","last_change":"2024-04-19T02:15:28.891867+0000","last_active":"2024-04-19T02:15:54.956723+0000","last_peered":"2024-04-19T02:15:54.956723+0000","last_clean":"2024-04-19T02:15:54.956723+0000","last_became_active":"2024-04-19T02:15:28.890806+0000","last_became_peered":"2024-04-19T02:15:28.890806+0000","last_unstale":"2024-04-19T02:15:54.956723+0000","last_undegraded":"2024-04-19T02:15:54.956723+0000","last_fullsized":"2024-04-19T02:15:54.956723+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:57.946581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.954963+0000","last_change":"2024-04-19T02:15:29.278148+0000","last_active":"2024-04-19T02:15:54.954963+0000","last_peered":"2024-04-19T02:15:54.954963+0000","last_clean":"2024-04-19T02:15:54.954963+0000","last_became_active":"2024-04-19T02:15:29.277402+0000","last_became_peered":"2024-04-19T02:15:29.277402+0000","last_unstale":"2024-04-19T02:15:54.954963+0000","last_undegraded":"2024-04-19T02:15:54.954963+0000","last_fullsized":"2024-04-19T02:15:54.954963+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:55.030934+0000","last_change":"2024-04-19T02:15:28.892905+0000","last_active":"2024-04-19T02:15:55.030934+0000","last_peered":"2024-04-19T02:15:55.030934+0000","last_clean":"2024-04-19T02:15:55.030934+0000","last_became_active":"2024-04-19T02:15:28.892541+0000","last_became_peered":"2024-04-19T02:15:28.892541+0000","last_unstale":"2024-04-19T02:15:55.030934+0000","last_undegraded":"2024-04-19T02:15:55.030934+0000","last_fullsized":"2024-04-19T02:15:55.030934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:33.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.955176+0000","last_change":"2024-04-19T02:15:29.278810+0000","last_active":"2024-04-19T02:15:54.955176+0000","last_peered":"2024-04-19T02:15:54.955176+0000","last_clean":"2024-04-19T02:15:54.955176+0000","last_became_active":"2024-04-19T02:15:29.278093+0000","last_became_peered":"2024-04-19T02:15:29.278093+0000","last_unstale":"2024-04-19T02:15:54.955176+0000","last_undegraded":"2024-04-19T02:15:54.955176+0000","last_fullsized":"2024-04-19T02:15:54.955176+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:34.883207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.955548+0000","last_change":"2024-04-19T02:15:28.892937+0000","last_active":"2024-04-19T02:15:54.955548+0000","last_peered":"2024-04-19T02:15:54.955548+0000","last_clean":"2024-04-19T02:15:54.955548+0000","last_became_active":"2024-04-19T02:15:28.891440+0000","last_became_peered":"2024-04-19T02:15:28.891440+0000","last_unstale":"2024-04-19T02:15:54.955548+0000","last_undegraded":"2024-04-19T02:15:54.955548+0000","last_fullsized":"2024-04-19T02:15:54.955548+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.955309+0000","last_change":"2024-04-19T02:15:29.278404+0000","last_active":"2024-04-19T02:15:54.955309+0000","last_peered":"2024-04-19T02:15:54.955309+0000","last_clean":"2024-04-19T02:15:54.955309+0000","last_became_active":"2024-04-19T02:15:29.277460+0000","last_became_peered":"2024-04-19T02:15:29.277460+0000","last_unstale":"2024-04-19T02:15:54.955309+0000","last_undegraded":"2024-04-19T02:15:54.955309+0000","last_fullsized":"2024-04-19T02:15:54.955309+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:55.031365+0000","last_change":"2024-04-19T02:15:28.891097+0000","last_active":"2024-04-19T02:15:55.031365+0000","last_peered":"2024-04-19T02:15:55.031365+0000","last_clean":"2024-04-19T02:15:55.031365+0000","last_became_active":"2024-04-19T02:15:28.890795+0000","last_became_peered":"2024-04-19T02:15:28.890795+0000","last_unstale":"2024-04-19T02:15:55.031365+0000","last_undegraded":"2024-04-19T02:15:55.031365+0000","last_fullsized":"2024-04-19T02:15:55.031365+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:55.031460+0000","last_change":"2024-04-19T02:15:29.278546+0000","last_active":"2024-04-19T02:15:55.031460+0000","last_peered":"2024-04-19T02:15:55.031460+0000","last_clean":"2024-04-19T02:15:55.031460+0000","last_became_active":"2024-04-19T02:15:29.277547+0000","last_became_peered":"2024-04-19T02:15:29.277547+0000","last_unstale":"2024-04-19T02:15:55.031460+0000","last_undegraded":"2024-04-19T02:15:55.031460+0000","last_fullsized":"2024-04-19T02:15:55.031460+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:55.031316+0000","last_change":"2024-04-19T02:15:28.892977+0000","last_active":"2024-04-19T02:15:55.031316+0000","last_peered":"2024-04-19T02:15:55.031316+0000","last_clean":"2024-04-19T02:15:55.031316+0000","last_became_active":"2024-04-19T02:15:28.892636+0000","last_became_peered":"2024-04-19T02:15:28.892636+0000","last_unstale":"2024-04-19T02:15:55.031316+0000","last_undegraded":"2024-04-19T02:15:55.031316+0000","last_fullsized":"2024-04-19T02:15:55.031316+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:43:51.221619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T02:15:55.963487+0000","last_change":"2024-04-19T02:15:53.955655+0000","last_active":"2024-04-19T02:15:55.963487+0000","last_peered":"2024-04-19T02:15:55.963487+0000","last_clean":"2024-04-19T02:15:55.963487+0000","last_became_active":"2024-04-19T02:15:53.955382+0000","last_became_peered":"2024-04-19T02:15:53.955382+0000","last_unstale":"2024-04-19T02:15:55.963487+0000","last_undegraded":"2024-04-19T02:15:55.963487+0000","last_fullsized":"2024-04-19T02:15:55.963487+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:48.239260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.955384+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:15:54.955384+0000","last_peered":"2024-04-19T02:15:54.955384+0000","last_clean":"2024-04-19T02:15:54.955384+0000","last_became_active":"2024-04-19T02:15:28.890751+0000","last_became_peered":"2024-04-19T02:15:28.890751+0000","last_unstale":"2024-04-19T02:15:54.955384+0000","last_undegraded":"2024-04-19T02:15:54.955384+0000","last_fullsized":"2024-04-19T02:15:54.955384+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T02:15:55.963554+0000","last_change":"2024-04-19T02:15:53.957865+0000","last_active":"2024-04-19T02:15:55.963554+0000","last_peered":"2024-04-19T02:15:55.963554+0000","last_clean":"2024-04-19T02:15:55.963554+0000","last_became_active":"2024-04-19T02:15:53.957627+0000","last_became_peered":"2024-04-19T02:15:53.957627+0000","last_unstale":"2024-04-19T02:15:55.963554+0000","last_undegraded":"2024-04-19T02:15:55.963554+0000","last_fullsized":"2024-04-19T02:15:55.963554+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:16:45.799016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.955076+0000","last_change":"2024-04-19T02:15:28.892934+0000","last_active":"2024-04-19T02:15:54.955076+0000","last_peered":"2024-04-19T02:15:54.955076+0000","last_clean":"2024-04-19T02:15:54.955076+0000","last_became_active":"2024-04-19T02:15:28.891879+0000","last_became_peered":"2024-04-19T02:15:28.891879+0000","last_unstale":"2024-04-19T02:15:54.955076+0000","last_undegraded":"2024-04-19T02:15:54.955076+0000","last_fullsized":"2024-04-19T02:15:54.955076+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:10:12.514798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.956714+0000","last_change":"2024-04-19T02:15:29.279685+0000","last_active":"2024-04-19T02:15:54.956714+0000","last_peered":"2024-04-19T02:15:54.956714+0000","last_clean":"2024-04-19T02:15:54.956714+0000","last_became_active":"2024-04-19T02:15:29.278810+0000","last_became_peered":"2024-04-19T02:15:29.278810+0000","last_unstale":"2024-04-19T02:15:54.956714+0000","last_undegraded":"2024-04-19T02:15:54.956714+0000","last_fullsized":"2024-04-19T02:15:54.956714+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":23,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:55.030733+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:15:55.030733+0000","last_peered":"2024-04-19T02:15:55.030733+0000","last_clean":"2024-04-19T02:15:55.030733+0000","last_became_active":"2024-04-19T02:15:28.890882+0000","last_became_peered":"2024-04-19T02:15:28.890882+0000","last_unstale":"2024-04-19T02:15:55.030733+0000","last_undegraded":"2024-04-19T02:15:55.030733+0000","last_fullsized":"2024-04-19T02:15:55.030733+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:31.673938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.956848+0000","last_change":"2024-04-19T02:15:29.284258+0000","last_active":"2024-04-19T02:15:54.956848+0000","last_peered":"2024-04-19T02:15:54.956848+0000","last_clean":"2024-04-19T02:15:54.956848+0000","last_became_active":"2024-04-19T02:15:29.283995+0000","last_became_peered":"2024-04-19T02:15:29.283995+0000","last_unstale":"2024-04-19T02:15:54.956848+0000","last_undegraded":"2024-04-19T02:15:54.956848+0000","last_fullsized":"2024-04-19T02:15:54.956848+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:35.941308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"19'612","reported_seq":621,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T02:15:57.743888+0000","last_change":"2024-04-19T02:15:53.956977+0000","last_active":"2024-04-19T02:15:57.743888+0000","last_peered":"2024-04-19T02:15:57.743888+0000","last_clean":"2024-04-19T02:15:57.743888+0000","last_became_active":"2024-04-19T02:15:53.956730+0000","last_became_peered":"2024-04-19T02:15:53.956730+0000","last_unstale":"2024-04-19T02:15:57.743888+0000","last_undegraded":"2024-04-19T02:15:57.743888+0000","last_fullsized":"2024-04-19T02:15:57.743888+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:56:46.323499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40108032,"num_objects":612,"num_object_clones":0,"num_object_copies":1224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":612,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":612,"num_write_kb":39168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:55.031429+0000","last_change":"2024-04-19T02:15:28.890265+0000","last_active":"2024-04-19T02:15:55.031429+0000","last_peered":"2024-04-19T02:15:55.031429+0000","last_clean":"2024-04-19T02:15:55.031429+0000","last_became_active":"2024-04-19T02:15:28.890004+0000","last_became_peered":"2024-04-19T02:15:28.890004+0000","last_unstale":"2024-04-19T02:15:55.031429+0000","last_undegraded":"2024-04-19T02:15:55.031429+0000","last_fullsized":"2024-04-19T02:15:55.031429+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:02.517101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.955003+0000","last_change":"2024-04-19T02:15:29.285529+0000","last_active":"2024-04-19T02:15:54.955003+0000","last_peered":"2024-04-19T02:15:54.955003+0000","last_clean":"2024-04-19T02:15:54.955003+0000","last_became_active":"2024-04-19T02:15:29.285197+0000","last_became_peered":"2024-04-19T02:15:29.285197+0000","last_unstale":"2024-04-19T02:15:54.955003+0000","last_undegraded":"2024-04-19T02:15:54.955003+0000","last_fullsized":"2024-04-19T02:15:54.955003+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"19'592","reported_seq":603,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T02:15:57.747525+0000","last_change":"2024-04-19T02:15:53.958523+0000","last_active":"2024-04-19T02:15:57.747525+0000","last_peered":"2024-04-19T02:15:57.747525+0000","last_clean":"2024-04-19T02:15:57.747525+0000","last_became_active":"2024-04-19T02:15:53.957627+0000","last_became_peered":"2024-04-19T02:15:53.957627+0000","last_unstale":"2024-04-19T02:15:57.747525+0000","last_undegraded":"2024-04-19T02:15:57.747525+0000","last_fullsized":"2024-04-19T02:15:57.747525+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:59:55.120296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38797312,"num_objects":592,"num_object_clones":0,"num_object_copies":1184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":592,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":592,"num_write_kb":37888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.955635+0000","last_change":"2024-04-19T02:15:28.893902+0000","last_active":"2024-04-19T02:15:54.955635+0000","last_peered":"2024-04-19T02:15:54.955635+0000","last_clean":"2024-04-19T02:15:54.955635+0000","last_became_active":"2024-04-19T02:15:28.893231+0000","last_became_peered":"2024-04-19T02:15:28.893231+0000","last_unstale":"2024-04-19T02:15:54.955635+0000","last_undegraded":"2024-04-19T02:15:54.955635+0000","last_fullsized":"2024-04-19T02:15:54.955635+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:23.658442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.955254+0000","last_change":"2024-04-19T02:15:29.282874+0000","last_active":"2024-04-19T02:15:54.955254+0000","last_peered":"2024-04-19T02:15:54.955254+0000","last_clean":"2024-04-19T02:15:54.955254+0000","last_became_active":"2024-04-19T02:15:29.281675+0000","last_became_peered":"2024-04-19T02:15:29.281675+0000","last_unstale":"2024-04-19T02:15:54.955254+0000","last_undegraded":"2024-04-19T02:15:54.955254+0000","last_fullsized":"2024-04-19T02:15:54.955254+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:35.941308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"19'619","reported_seq":630,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T02:15:57.747446+0000","last_change":"2024-04-19T02:15:53.958324+0000","last_active":"2024-04-19T02:15:57.747446+0000","last_peered":"2024-04-19T02:15:57.747446+0000","last_clean":"2024-04-19T02:15:57.747446+0000","last_became_active":"2024-04-19T02:15:53.957392+0000","last_became_peered":"2024-04-19T02:15:53.957392+0000","last_unstale":"2024-04-19T02:15:57.747446+0000","last_undegraded":"2024-04-19T02:15:57.747446+0000","last_fullsized":"2024-04-19T02:15:57.747446+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:12:58.132969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40566784,"num_objects":619,"num_object_clones":0,"num_object_copies":1238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":619,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":619,"num_write_kb":39616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:55.031701+0000","last_change":"2024-04-19T02:15:28.891234+0000","last_active":"2024-04-19T02:15:55.031701+0000","last_peered":"2024-04-19T02:15:55.031701+0000","last_clean":"2024-04-19T02:15:55.031701+0000","last_became_active":"2024-04-19T02:15:28.890881+0000","last_became_peered":"2024-04-19T02:15:28.890881+0000","last_unstale":"2024-04-19T02:15:55.031701+0000","last_undegraded":"2024-04-19T02:15:55.031701+0000","last_fullsized":"2024-04-19T02:15:55.031701+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:55.030512+0000","last_change":"2024-04-19T02:15:29.281937+0000","last_active":"2024-04-19T02:15:55.030512+0000","last_peered":"2024-04-19T02:15:55.030512+0000","last_clean":"2024-04-19T02:15:55.030512+0000","last_became_active":"2024-04-19T02:15:29.280727+0000","last_became_peered":"2024-04-19T02:15:29.280727+0000","last_unstale":"2024-04-19T02:15:55.030512+0000","last_undegraded":"2024-04-19T02:15:55.030512+0000","last_fullsized":"2024-04-19T02:15:55.030512+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"19'601","reported_seq":612,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T02:15:57.748381+0000","last_change":"2024-04-19T02:15:53.959099+0000","last_active":"2024-04-19T02:15:57.748381+0000","last_peered":"2024-04-19T02:15:57.748381+0000","last_clean":"2024-04-19T02:15:57.748381+0000","last_became_active":"2024-04-19T02:15:53.958885+0000","last_became_peered":"2024-04-19T02:15:53.958885+0000","last_unstale":"2024-04-19T02:15:57.748381+0000","last_undegraded":"2024-04-19T02:15:57.748381+0000","last_fullsized":"2024-04-19T02:15:57.748381+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":601,"log_dups_size":0,"ondisk_log_size":601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:53:26.969927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39387136,"num_objects":601,"num_object_clones":0,"num_object_copies":1202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":601,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":601,"num_write_kb":38464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:55.030793+0000","last_change":"2024-04-19T02:15:28.892767+0000","last_active":"2024-04-19T02:15:55.030793+0000","last_peered":"2024-04-19T02:15:55.030793+0000","last_clean":"2024-04-19T02:15:55.030793+0000","last_became_active":"2024-04-19T02:15:28.892235+0000","last_became_peered":"2024-04-19T02:15:28.892235+0000","last_unstale":"2024-04-19T02:15:55.030793+0000","last_undegraded":"2024-04-19T02:15:55.030793+0000","last_fullsized":"2024-04-19T02:15:55.030793+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:37.690735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.955503+0000","last_change":"2024-04-19T02:15:29.279857+0000","last_active":"2024-04-19T02:15:54.955503+0000","last_peered":"2024-04-19T02:15:54.955503+0000","last_clean":"2024-04-19T02:15:54.955503+0000","last_became_active":"2024-04-19T02:15:29.279536+0000","last_became_peered":"2024-04-19T02:15:29.279536+0000","last_unstale":"2024-04-19T02:15:54.955503+0000","last_undegraded":"2024-04-19T02:15:54.955503+0000","last_fullsized":"2024-04-19T02:15:54.955503+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:00.191179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"19'596","reported_seq":607,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T02:15:57.743310+0000","last_change":"2024-04-19T02:15:53.957261+0000","last_active":"2024-04-19T02:15:57.743310+0000","last_peered":"2024-04-19T02:15:57.743310+0000","last_clean":"2024-04-19T02:15:57.743310+0000","last_became_active":"2024-04-19T02:15:53.957092+0000","last_became_peered":"2024-04-19T02:15:53.957092+0000","last_unstale":"2024-04-19T02:15:57.743310+0000","last_undegraded":"2024-04-19T02:15:57.743310+0000","last_fullsized":"2024-04-19T02:15:57.743310+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":596,"log_dups_size":0,"ondisk_log_size":596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:54:15.544923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39059456,"num_objects":596,"num_object_clones":0,"num_object_copies":1192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":596,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":596,"num_write_kb":38144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.955463+0000","last_change":"2024-04-19T02:15:28.891611+0000","last_active":"2024-04-19T02:15:54.955463+0000","last_peered":"2024-04-19T02:15:54.955463+0000","last_clean":"2024-04-19T02:15:54.955463+0000","last_became_active":"2024-04-19T02:15:28.890914+0000","last_became_peered":"2024-04-19T02:15:28.890914+0000","last_unstale":"2024-04-19T02:15:54.955463+0000","last_undegraded":"2024-04-19T02:15:54.955463+0000","last_fullsized":"2024-04-19T02:15:54.955463+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:37.690735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:55.030843+0000","last_change":"2024-04-19T02:15:29.285774+0000","last_active":"2024-04-19T02:15:55.030843+0000","last_peered":"2024-04-19T02:15:55.030843+0000","last_clean":"2024-04-19T02:15:55.030843+0000","last_became_active":"2024-04-19T02:15:29.284705+0000","last_became_peered":"2024-04-19T02:15:29.284705+0000","last_unstale":"2024-04-19T02:15:55.030843+0000","last_undegraded":"2024-04-19T02:15:55.030843+0000","last_fullsized":"2024-04-19T02:15:55.030843+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"19'593","reported_seq":603,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T02:15:57.748930+0000","last_change":"2024-04-19T02:15:53.955286+0000","last_active":"2024-04-19T02:15:57.748930+0000","last_peered":"2024-04-19T02:15:57.748930+0000","last_clean":"2024-04-19T02:15:57.748930+0000","last_became_active":"2024-04-19T02:15:53.955026+0000","last_became_peered":"2024-04-19T02:15:53.955026+0000","last_unstale":"2024-04-19T02:15:57.748930+0000","last_undegraded":"2024-04-19T02:15:57.748930+0000","last_fullsized":"2024-04-19T02:15:57.748930+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:05:48.594301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38862848,"num_objects":593,"num_object_clones":0,"num_object_copies":1186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":593,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":593,"num_write_kb":37952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:55.030368+0000","last_change":"2024-04-19T02:15:28.892873+0000","last_active":"2024-04-19T02:15:55.030368+0000","last_peered":"2024-04-19T02:15:55.030368+0000","last_clean":"2024-04-19T02:15:55.030368+0000","last_became_active":"2024-04-19T02:15:28.892487+0000","last_became_peered":"2024-04-19T02:15:28.892487+0000","last_unstale":"2024-04-19T02:15:55.030368+0000","last_undegraded":"2024-04-19T02:15:55.030368+0000","last_fullsized":"2024-04-19T02:15:55.030368+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:35.412837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:55.032042+0000","last_change":"2024-04-19T02:15:29.285019+0000","last_active":"2024-04-19T02:15:55.032042+0000","last_peered":"2024-04-19T02:15:55.032042+0000","last_clean":"2024-04-19T02:15:55.032042+0000","last_became_active":"2024-04-19T02:15:29.284650+0000","last_became_peered":"2024-04-19T02:15:29.284650+0000","last_unstale":"2024-04-19T02:15:55.032042+0000","last_undegraded":"2024-04-19T02:15:55.032042+0000","last_fullsized":"2024-04-19T02:15:55.032042+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"19'594","reported_seq":604,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T02:15:57.725504+0000","last_change":"2024-04-19T02:15:53.957403+0000","last_active":"2024-04-19T02:15:57.725504+0000","last_peered":"2024-04-19T02:15:57.725504+0000","last_clean":"2024-04-19T02:15:57.725504+0000","last_became_active":"2024-04-19T02:15:53.957190+0000","last_became_peered":"2024-04-19T02:15:53.957190+0000","last_unstale":"2024-04-19T02:15:57.725504+0000","last_undegraded":"2024-04-19T02:15:57.725504+0000","last_fullsized":"2024-04-19T02:15:57.725504+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:07:12.817884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38928384,"num_objects":594,"num_object_clones":0,"num_object_copies":1188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":594,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":594,"num_write_kb":38016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T02:15:55.960108+0000","last_change":"2024-04-19T02:15:53.956839+0000","last_active":"2024-04-19T02:15:55.960108+0000","last_peered":"2024-04-19T02:15:55.960108+0000","last_clean":"2024-04-19T02:15:55.960108+0000","last_became_active":"2024-04-19T02:15:53.956630+0000","last_became_peered":"2024-04-19T02:15:53.956630+0000","last_unstale":"2024-04-19T02:15:55.960108+0000","last_undegraded":"2024-04-19T02:15:55.960108+0000","last_fullsized":"2024-04-19T02:15:55.960108+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:47.229730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:55.030990+0000","last_change":"2024-04-19T02:15:29.287190+0000","last_active":"2024-04-19T02:15:55.030990+0000","last_peered":"2024-04-19T02:15:55.030990+0000","last_clean":"2024-04-19T02:15:55.030990+0000","last_became_active":"2024-04-19T02:15:29.286606+0000","last_became_peered":"2024-04-19T02:15:29.286606+0000","last_unstale":"2024-04-19T02:15:55.030990+0000","last_undegraded":"2024-04-19T02:15:55.030990+0000","last_fullsized":"2024-04-19T02:15:55.030990+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:28.387062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"19'591","reported_seq":602,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T02:15:57.743845+0000","last_change":"2024-04-19T02:15:53.958448+0000","last_active":"2024-04-19T02:15:57.743845+0000","last_peered":"2024-04-19T02:15:57.743845+0000","last_clean":"2024-04-19T02:15:57.743845+0000","last_became_active":"2024-04-19T02:15:53.957595+0000","last_became_peered":"2024-04-19T02:15:53.957595+0000","last_unstale":"2024-04-19T02:15:57.743845+0000","last_undegraded":"2024-04-19T02:15:57.743845+0000","last_fullsized":"2024-04-19T02:15:57.743845+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:26:31.855319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38731776,"num_objects":591,"num_object_clones":0,"num_object_copies":1182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":591,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":591,"num_write_kb":37824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.955161+0000","last_change":"2024-04-19T02:15:28.894121+0000","last_active":"2024-04-19T02:15:54.955161+0000","last_peered":"2024-04-19T02:15:54.955161+0000","last_clean":"2024-04-19T02:15:54.955161+0000","last_became_active":"2024-04-19T02:15:28.893902+0000","last_became_peered":"2024-04-19T02:15:28.893902+0000","last_unstale":"2024-04-19T02:15:54.955161+0000","last_undegraded":"2024-04-19T02:15:54.955161+0000","last_fullsized":"2024-04-19T02:15:54.955161+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:10:35.146583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.956654+0000","last_change":"2024-04-19T02:15:29.282870+0000","last_active":"2024-04-19T02:15:54.956654+0000","last_peered":"2024-04-19T02:15:54.956654+0000","last_clean":"2024-04-19T02:15:54.956654+0000","last_became_active":"2024-04-19T02:15:29.281873+0000","last_became_peered":"2024-04-19T02:15:29.281873+0000","last_unstale":"2024-04-19T02:15:54.956654+0000","last_undegraded":"2024-04-19T02:15:54.956654+0000","last_fullsized":"2024-04-19T02:15:54.956654+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"19'632","reported_seq":640,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T02:15:57.731716+0000","last_change":"2024-04-19T02:15:53.955498+0000","last_active":"2024-04-19T02:15:57.731716+0000","last_peered":"2024-04-19T02:15:57.731716+0000","last_clean":"2024-04-19T02:15:57.731716+0000","last_became_active":"2024-04-19T02:15:53.954910+0000","last_became_peered":"2024-04-19T02:15:53.954910+0000","last_unstale":"2024-04-19T02:15:57.731716+0000","last_undegraded":"2024-04-19T02:15:57.731716+0000","last_fullsized":"2024-04-19T02:15:57.731716+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":632,"log_dups_size":0,"ondisk_log_size":632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:58:27.262672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41418752,"num_objects":632,"num_object_clones":0,"num_object_copies":1264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":632,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":632,"num_write_kb":40448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.956198+0000","last_change":"2024-04-19T02:15:24.527061+0000","last_active":"2024-04-19T02:15:54.956198+0000","last_peered":"2024-04-19T02:15:54.956198+0000","last_clean":"2024-04-19T02:15:54.956198+0000","last_became_active":"2024-04-19T02:15:24.526757+0000","last_became_peered":"2024-04-19T02:15:24.526757+0000","last_unstale":"2024-04-19T02:15:54.956198+0000","last_undegraded":"2024-04-19T02:15:54.956198+0000","last_fullsized":"2024-04-19T02:15:54.956198+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:17:13.649077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:55.031880+0000","last_change":"2024-04-19T02:15:28.892766+0000","last_active":"2024-04-19T02:15:55.031880+0000","last_peered":"2024-04-19T02:15:55.031880+0000","last_clean":"2024-04-19T02:15:55.031880+0000","last_became_active":"2024-04-19T02:15:28.892396+0000","last_became_peered":"2024-04-19T02:15:28.892396+0000","last_unstale":"2024-04-19T02:15:55.031880+0000","last_undegraded":"2024-04-19T02:15:55.031880+0000","last_fullsized":"2024-04-19T02:15:55.031880+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:57.946581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.955542+0000","last_change":"2024-04-19T02:15:29.277922+0000","last_active":"2024-04-19T02:15:54.955542+0000","last_peered":"2024-04-19T02:15:54.955542+0000","last_clean":"2024-04-19T02:15:54.955542+0000","last_became_active":"2024-04-19T02:15:29.276968+0000","last_became_peered":"2024-04-19T02:15:29.276968+0000","last_unstale":"2024-04-19T02:15:54.955542+0000","last_undegraded":"2024-04-19T02:15:54.955542+0000","last_fullsized":"2024-04-19T02:15:54.955542+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"19'599","reported_seq":610,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T02:15:57.743902+0000","last_change":"2024-04-19T02:15:53.955228+0000","last_active":"2024-04-19T02:15:57.743902+0000","last_peered":"2024-04-19T02:15:57.743902+0000","last_clean":"2024-04-19T02:15:57.743902+0000","last_became_active":"2024-04-19T02:15:53.954960+0000","last_became_peered":"2024-04-19T02:15:53.954960+0000","last_unstale":"2024-04-19T02:15:57.743902+0000","last_undegraded":"2024-04-19T02:15:57.743902+0000","last_fullsized":"2024-04-19T02:15:57.743902+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:46:07.409922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39256064,"num_objects":599,"num_object_clones":0,"num_object_copies":1198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":599,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":599,"num_write_kb":38336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:55.030666+0000","last_change":"2024-04-19T02:15:24.530933+0000","last_active":"2024-04-19T02:15:55.030666+0000","last_peered":"2024-04-19T02:15:55.030666+0000","last_clean":"2024-04-19T02:15:55.030666+0000","last_became_active":"2024-04-19T02:15:24.530550+0000","last_became_peered":"2024-04-19T02:15:24.530550+0000","last_unstale":"2024-04-19T02:15:55.030666+0000","last_undegraded":"2024-04-19T02:15:55.030666+0000","last_fullsized":"2024-04-19T02:15:55.030666+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:18:15.194321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:55.030945+0000","last_change":"2024-04-19T02:15:28.893062+0000","last_active":"2024-04-19T02:15:55.030945+0000","last_peered":"2024-04-19T02:15:55.030945+0000","last_clean":"2024-04-19T02:15:55.030945+0000","last_became_active":"2024-04-19T02:15:28.892798+0000","last_became_peered":"2024-04-19T02:15:28.892798+0000","last_unstale":"2024-04-19T02:15:55.030945+0000","last_undegraded":"2024-04-19T02:15:55.030945+0000","last_fullsized":"2024-04-19T02:15:55.030945+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:53.170180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.955993+0000","last_change":"2024-04-19T02:15:29.278294+0000","last_active":"2024-04-19T02:15:54.955993+0000","last_peered":"2024-04-19T02:15:54.955993+0000","last_clean":"2024-04-19T02:15:54.955993+0000","last_became_active":"2024-04-19T02:15:29.277536+0000","last_became_peered":"2024-04-19T02:15:29.277536+0000","last_unstale":"2024-04-19T02:15:54.955993+0000","last_undegraded":"2024-04-19T02:15:54.955993+0000","last_fullsized":"2024-04-19T02:15:54.955993+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"19'603","reported_seq":613,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T02:15:57.744098+0000","last_change":"2024-04-19T02:15:53.956251+0000","last_active":"2024-04-19T02:15:57.744098+0000","last_peered":"2024-04-19T02:15:57.744098+0000","last_clean":"2024-04-19T02:15:57.744098+0000","last_became_active":"2024-04-19T02:15:53.955886+0000","last_became_peered":"2024-04-19T02:15:53.955886+0000","last_unstale":"2024-04-19T02:15:57.744098+0000","last_undegraded":"2024-04-19T02:15:57.744098+0000","last_fullsized":"2024-04-19T02:15:57.744098+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:38:38.586906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39518208,"num_objects":603,"num_object_clones":0,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":603,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":603,"num_write_kb":38592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.955013+0000","last_change":"2024-04-19T02:15:24.527048+0000","last_active":"2024-04-19T02:15:54.955013+0000","last_peered":"2024-04-19T02:15:54.955013+0000","last_clean":"2024-04-19T02:15:54.955013+0000","last_became_active":"2024-04-19T02:15:24.526790+0000","last_became_peered":"2024-04-19T02:15:24.526790+0000","last_unstale":"2024-04-19T02:15:54.955013+0000","last_undegraded":"2024-04-19T02:15:54.955013+0000","last_fullsized":"2024-04-19T02:15:54.955013+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T02:15:55.959619+0000","last_change":"2024-04-19T02:15:53.956945+0000","last_active":"2024-04-19T02:15:55.959619+0000","last_peered":"2024-04-19T02:15:55.959619+0000","last_clean":"2024-04-19T02:15:55.959619+0000","last_became_active":"2024-04-19T02:15:53.956719+0000","last_became_peered":"2024-04-19T02:15:53.956719+0000","last_unstale":"2024-04-19T02:15:55.959619+0000","last_undegraded":"2024-04-19T02:15:55.959619+0000","last_fullsized":"2024-04-19T02:15:55.959619+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:00:37.754624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.956798+0000","last_change":"2024-04-19T02:15:29.282663+0000","last_active":"2024-04-19T02:15:54.956798+0000","last_peered":"2024-04-19T02:15:54.956798+0000","last_clean":"2024-04-19T02:15:54.956798+0000","last_became_active":"2024-04-19T02:15:29.282217+0000","last_became_peered":"2024-04-19T02:15:29.282217+0000","last_unstale":"2024-04-19T02:15:54.956798+0000","last_undegraded":"2024-04-19T02:15:54.956798+0000","last_fullsized":"2024-04-19T02:15:54.956798+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"19'644","reported_seq":654,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T02:15:57.748137+0000","last_change":"2024-04-19T02:15:53.958264+0000","last_active":"2024-04-19T02:15:57.748137+0000","last_peered":"2024-04-19T02:15:57.748137+0000","last_clean":"2024-04-19T02:15:57.748137+0000","last_became_active":"2024-04-19T02:15:53.956689+0000","last_became_peered":"2024-04-19T02:15:53.956689+0000","last_unstale":"2024-04-19T02:15:57.748137+0000","last_undegraded":"2024-04-19T02:15:57.748137+0000","last_fullsized":"2024-04-19T02:15:57.748137+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:24:32.928594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42205184,"num_objects":644,"num_object_clones":0,"num_object_copies":1288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":644,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":644,"num_write_kb":41216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:55.031153+0000","last_change":"2024-04-19T02:15:24.530924+0000","last_active":"2024-04-19T02:15:55.031153+0000","last_peered":"2024-04-19T02:15:55.031153+0000","last_clean":"2024-04-19T02:15:55.031153+0000","last_became_active":"2024-04-19T02:15:24.530551+0000","last_became_peered":"2024-04-19T02:15:24.530551+0000","last_unstale":"2024-04-19T02:15:55.031153+0000","last_undegraded":"2024-04-19T02:15:55.031153+0000","last_fullsized":"2024-04-19T02:15:55.031153+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:30.576946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":214,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:55.030199+0000","last_change":"2024-04-19T02:15:24.533634+0000","last_active":"2024-04-19T02:15:55.030199+0000","last_peered":"2024-04-19T02:15:55.030199+0000","last_clean":"2024-04-19T02:15:55.030199+0000","last_became_active":"2024-04-19T02:15:24.533420+0000","last_became_peered":"2024-04-19T02:15:24.533420+0000","last_unstale":"2024-04-19T02:15:55.030199+0000","last_undegraded":"2024-04-19T02:15:55.030199+0000","last_fullsized":"2024-04-19T02:15:55.030199+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.955210+0000","last_change":"2024-04-19T02:15:28.890244+0000","last_active":"2024-04-19T02:15:54.955210+0000","last_peered":"2024-04-19T02:15:54.955210+0000","last_clean":"2024-04-19T02:15:54.955210+0000","last_became_active":"2024-04-19T02:15:28.889831+0000","last_became_peered":"2024-04-19T02:15:28.889831+0000","last_unstale":"2024-04-19T02:15:54.955210+0000","last_undegraded":"2024-04-19T02:15:54.955210+0000","last_fullsized":"2024-04-19T02:15:54.955210+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:55.031958+0000","last_change":"2024-04-19T02:15:29.285015+0000","last_active":"2024-04-19T02:15:55.031958+0000","last_peered":"2024-04-19T02:15:55.031958+0000","last_clean":"2024-04-19T02:15:55.031958+0000","last_became_active":"2024-04-19T02:15:29.284164+0000","last_became_peered":"2024-04-19T02:15:29.284164+0000","last_unstale":"2024-04-19T02:15:55.031958+0000","last_undegraded":"2024-04-19T02:15:55.031958+0000","last_fullsized":"2024-04-19T02:15:55.031958+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:36.987844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"19'586","reported_seq":595,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T02:15:57.735513+0000","last_change":"2024-04-19T02:15:53.956463+0000","last_active":"2024-04-19T02:15:57.735513+0000","last_peered":"2024-04-19T02:15:57.735513+0000","last_clean":"2024-04-19T02:15:57.735513+0000","last_became_active":"2024-04-19T02:15:53.955819+0000","last_became_peered":"2024-04-19T02:15:53.955819+0000","last_unstale":"2024-04-19T02:15:57.735513+0000","last_undegraded":"2024-04-19T02:15:57.735513+0000","last_fullsized":"2024-04-19T02:15:57.735513+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:46:07.409922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38404096,"num_objects":586,"num_object_clones":0,"num_object_copies":1172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":586,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":586,"num_write_kb":37504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:55.030308+0000","last_change":"2024-04-19T02:15:24.533912+0000","last_active":"2024-04-19T02:15:55.030308+0000","last_peered":"2024-04-19T02:15:55.030308+0000","last_clean":"2024-04-19T02:15:55.030308+0000","last_became_active":"2024-04-19T02:15:24.533580+0000","last_became_peered":"2024-04-19T02:15:24.533580+0000","last_unstale":"2024-04-19T02:15:55.030308+0000","last_undegraded":"2024-04-19T02:15:55.030308+0000","last_fullsized":"2024-04-19T02:15:55.030308+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:45.045477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.954922+0000","last_change":"2024-04-19T02:15:28.891889+0000","last_active":"2024-04-19T02:15:54.954922+0000","last_peered":"2024-04-19T02:15:54.954922+0000","last_clean":"2024-04-19T02:15:54.954922+0000","last_became_active":"2024-04-19T02:15:28.890919+0000","last_became_peered":"2024-04-19T02:15:28.890919+0000","last_unstale":"2024-04-19T02:15:54.954922+0000","last_undegraded":"2024-04-19T02:15:54.954922+0000","last_fullsized":"2024-04-19T02:15:54.954922+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:35.412837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T02:15:55.964547+0000","last_change":"2024-04-19T02:15:53.957881+0000","last_active":"2024-04-19T02:15:55.964547+0000","last_peered":"2024-04-19T02:15:55.964547+0000","last_clean":"2024-04-19T02:15:55.964547+0000","last_became_active":"2024-04-19T02:15:53.957657+0000","last_became_peered":"2024-04-19T02:15:53.957657+0000","last_unstale":"2024-04-19T02:15:55.964547+0000","last_undegraded":"2024-04-19T02:15:55.964547+0000","last_fullsized":"2024-04-19T02:15:55.964547+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:46.921714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"19'642","reported_seq":651,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T02:15:57.725754+0000","last_change":"2024-04-19T02:15:53.955068+0000","last_active":"2024-04-19T02:15:57.725754+0000","last_peered":"2024-04-19T02:15:57.725754+0000","last_clean":"2024-04-19T02:15:57.725754+0000","last_became_active":"2024-04-19T02:15:53.954721+0000","last_became_peered":"2024-04-19T02:15:53.954721+0000","last_unstale":"2024-04-19T02:15:57.725754+0000","last_undegraded":"2024-04-19T02:15:57.725754+0000","last_fullsized":"2024-04-19T02:15:57.725754+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":642,"log_dups_size":0,"ondisk_log_size":642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:18:29.742535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42074112,"num_objects":642,"num_object_clones":0,"num_object_copies":1284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":642,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":642,"num_write_kb":41088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T02:15:55.963711+0000","last_change":"2024-04-19T02:15:53.959105+0000","last_active":"2024-04-19T02:15:55.963711+0000","last_peered":"2024-04-19T02:15:55.963711+0000","last_clean":"2024-04-19T02:15:55.963711+0000","last_became_active":"2024-04-19T02:15:53.958836+0000","last_became_peered":"2024-04-19T02:15:53.958836+0000","last_unstale":"2024-04-19T02:15:55.963711+0000","last_undegraded":"2024-04-19T02:15:55.963711+0000","last_fullsized":"2024-04-19T02:15:55.963711+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:18:00.321514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.955913+0000","last_change":"2024-04-19T02:15:28.892125+0000","last_active":"2024-04-19T02:15:54.955913+0000","last_peered":"2024-04-19T02:15:54.955913+0000","last_clean":"2024-04-19T02:15:54.955913+0000","last_became_active":"2024-04-19T02:15:28.891300+0000","last_became_peered":"2024-04-19T02:15:28.891300+0000","last_unstale":"2024-04-19T02:15:54.955913+0000","last_undegraded":"2024-04-19T02:15:54.955913+0000","last_fullsized":"2024-04-19T02:15:54.955913+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.955224+0000","last_change":"2024-04-19T02:15:29.281694+0000","last_active":"2024-04-19T02:15:54.955224+0000","last_peered":"2024-04-19T02:15:54.955224+0000","last_clean":"2024-04-19T02:15:54.955224+0000","last_became_active":"2024-04-19T02:15:29.280519+0000","last_became_peered":"2024-04-19T02:15:29.280519+0000","last_unstale":"2024-04-19T02:15:54.955224+0000","last_undegraded":"2024-04-19T02:15:54.955224+0000","last_fullsized":"2024-04-19T02:15:54.955224+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:50.890545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"19'610","reported_seq":620,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T02:15:57.743934+0000","last_change":"2024-04-19T02:15:53.955079+0000","last_active":"2024-04-19T02:15:57.743934+0000","last_peered":"2024-04-19T02:15:57.743934+0000","last_clean":"2024-04-19T02:15:57.743934+0000","last_became_active":"2024-04-19T02:15:53.954767+0000","last_became_peered":"2024-04-19T02:15:53.954767+0000","last_unstale":"2024-04-19T02:15:57.743934+0000","last_undegraded":"2024-04-19T02:15:57.743934+0000","last_fullsized":"2024-04-19T02:15:57.743934+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:17:09.869041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39976960,"num_objects":610,"num_object_clones":0,"num_object_copies":1220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":610,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":610,"num_write_kb":39040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.956633+0000","last_change":"2024-04-19T02:15:28.891702+0000","last_active":"2024-04-19T02:15:54.956633+0000","last_peered":"2024-04-19T02:15:54.956633+0000","last_clean":"2024-04-19T02:15:54.956633+0000","last_became_active":"2024-04-19T02:15:28.890743+0000","last_became_peered":"2024-04-19T02:15:28.890743+0000","last_unstale":"2024-04-19T02:15:54.956633+0000","last_undegraded":"2024-04-19T02:15:54.956633+0000","last_fullsized":"2024-04-19T02:15:54.956633+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.956696+0000","last_change":"2024-04-19T02:15:24.526845+0000","last_active":"2024-04-19T02:15:54.956696+0000","last_peered":"2024-04-19T02:15:54.956696+0000","last_clean":"2024-04-19T02:15:54.956696+0000","last_became_active":"2024-04-19T02:15:24.526500+0000","last_became_peered":"2024-04-19T02:15:24.526500+0000","last_unstale":"2024-04-19T02:15:54.956696+0000","last_undegraded":"2024-04-19T02:15:54.956696+0000","last_fullsized":"2024-04-19T02:15:54.956696+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:16.883355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.954900+0000","last_change":"2024-04-19T02:15:29.278686+0000","last_active":"2024-04-19T02:15:54.954900+0000","last_peered":"2024-04-19T02:15:54.954900+0000","last_clean":"2024-04-19T02:15:54.954900+0000","last_became_active":"2024-04-19T02:15:29.278108+0000","last_became_peered":"2024-04-19T02:15:29.278108+0000","last_unstale":"2024-04-19T02:15:54.954900+0000","last_undegraded":"2024-04-19T02:15:54.954900+0000","last_fullsized":"2024-04-19T02:15:54.954900+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:34.593754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"19'585","reported_seq":595,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T02:15:57.747488+0000","last_change":"2024-04-19T02:15:53.957269+0000","last_active":"2024-04-19T02:15:57.747488+0000","last_peered":"2024-04-19T02:15:57.747488+0000","last_clean":"2024-04-19T02:15:57.747488+0000","last_became_active":"2024-04-19T02:15:53.956554+0000","last_became_peered":"2024-04-19T02:15:53.956554+0000","last_unstale":"2024-04-19T02:15:57.747488+0000","last_undegraded":"2024-04-19T02:15:57.747488+0000","last_fullsized":"2024-04-19T02:15:57.747488+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:29:38.789719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38338560,"num_objects":585,"num_object_clones":0,"num_object_copies":1170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":585,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":585,"num_write_kb":37440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:55.031592+0000","last_change":"2024-04-19T02:15:24.533777+0000","last_active":"2024-04-19T02:15:55.031592+0000","last_peered":"2024-04-19T02:15:55.031592+0000","last_clean":"2024-04-19T02:15:55.031592+0000","last_became_active":"2024-04-19T02:15:24.533436+0000","last_became_peered":"2024-04-19T02:15:24.533436+0000","last_unstale":"2024-04-19T02:15:55.031592+0000","last_undegraded":"2024-04-19T02:15:55.031592+0000","last_fullsized":"2024-04-19T02:15:55.031592+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:53:25.922418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.956618+0000","last_change":"2024-04-19T02:15:28.891370+0000","last_active":"2024-04-19T02:15:54.956618+0000","last_peered":"2024-04-19T02:15:54.956618+0000","last_clean":"2024-04-19T02:15:54.956618+0000","last_became_active":"2024-04-19T02:15:28.890702+0000","last_became_peered":"2024-04-19T02:15:28.890702+0000","last_unstale":"2024-04-19T02:15:54.956618+0000","last_undegraded":"2024-04-19T02:15:54.956618+0000","last_fullsized":"2024-04-19T02:15:54.956618+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:33.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.955104+0000","last_change":"2024-04-19T02:15:29.282244+0000","last_active":"2024-04-19T02:15:54.955104+0000","last_peered":"2024-04-19T02:15:54.955104+0000","last_clean":"2024-04-19T02:15:54.955104+0000","last_became_active":"2024-04-19T02:15:29.280366+0000","last_became_peered":"2024-04-19T02:15:29.280366+0000","last_unstale":"2024-04-19T02:15:54.955104+0000","last_undegraded":"2024-04-19T02:15:54.955104+0000","last_fullsized":"2024-04-19T02:15:54.955104+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.955328+0000","last_change":"2024-04-19T02:15:28.893027+0000","last_active":"2024-04-19T02:15:54.955328+0000","last_peered":"2024-04-19T02:15:54.955328+0000","last_clean":"2024-04-19T02:15:54.955328+0000","last_became_active":"2024-04-19T02:15:28.892695+0000","last_became_peered":"2024-04-19T02:15:28.892695+0000","last_unstale":"2024-04-19T02:15:54.955328+0000","last_undegraded":"2024-04-19T02:15:54.955328+0000","last_fullsized":"2024-04-19T02:15:54.955328+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.955539+0000","last_change":"2024-04-19T02:15:29.283155+0000","last_active":"2024-04-19T02:15:54.955539+0000","last_peered":"2024-04-19T02:15:54.955539+0000","last_clean":"2024-04-19T02:15:54.955539+0000","last_became_active":"2024-04-19T02:15:29.281407+0000","last_became_peered":"2024-04-19T02:15:29.281407+0000","last_unstale":"2024-04-19T02:15:54.955539+0000","last_undegraded":"2024-04-19T02:15:54.955539+0000","last_fullsized":"2024-04-19T02:15:54.955539+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:55.030945+0000","last_change":"2024-04-19T02:15:28.893067+0000","last_active":"2024-04-19T02:15:55.030945+0000","last_peered":"2024-04-19T02:15:55.030945+0000","last_clean":"2024-04-19T02:15:55.030945+0000","last_became_active":"2024-04-19T02:15:28.892781+0000","last_became_peered":"2024-04-19T02:15:28.892781+0000","last_unstale":"2024-04-19T02:15:55.030945+0000","last_undegraded":"2024-04-19T02:15:55.030945+0000","last_fullsized":"2024-04-19T02:15:55.030945+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:54:15.590143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:55.030859+0000","last_change":"2024-04-19T02:15:29.281279+0000","last_active":"2024-04-19T02:15:55.030859+0000","last_peered":"2024-04-19T02:15:55.030859+0000","last_clean":"2024-04-19T02:15:55.030859+0000","last_became_active":"2024-04-19T02:15:29.279360+0000","last_became_peered":"2024-04-19T02:15:29.279360+0000","last_unstale":"2024-04-19T02:15:55.030859+0000","last_undegraded":"2024-04-19T02:15:55.030859+0000","last_fullsized":"2024-04-19T02:15:55.030859+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.955658+0000","last_change":"2024-04-19T02:15:28.893239+0000","last_active":"2024-04-19T02:15:54.955658+0000","last_peered":"2024-04-19T02:15:54.955658+0000","last_clean":"2024-04-19T02:15:54.955658+0000","last_became_active":"2024-04-19T02:15:28.892881+0000","last_became_peered":"2024-04-19T02:15:28.892881+0000","last_unstale":"2024-04-19T02:15:54.955658+0000","last_undegraded":"2024-04-19T02:15:54.955658+0000","last_fullsized":"2024-04-19T02:15:54.955658+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:55.030443+0000","last_change":"2024-04-19T02:15:29.281652+0000","last_active":"2024-04-19T02:15:55.030443+0000","last_peered":"2024-04-19T02:15:55.030443+0000","last_clean":"2024-04-19T02:15:55.030443+0000","last_became_active":"2024-04-19T02:15:29.281175+0000","last_became_peered":"2024-04-19T02:15:29.281175+0000","last_unstale":"2024-04-19T02:15:55.030443+0000","last_undegraded":"2024-04-19T02:15:55.030443+0000","last_fullsized":"2024-04-19T02:15:55.030443+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:16.568764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.956749+0000","last_change":"2024-04-19T02:15:28.892058+0000","last_active":"2024-04-19T02:15:54.956749+0000","last_peered":"2024-04-19T02:15:54.956749+0000","last_clean":"2024-04-19T02:15:54.956749+0000","last_became_active":"2024-04-19T02:15:28.890877+0000","last_became_peered":"2024-04-19T02:15:28.890877+0000","last_unstale":"2024-04-19T02:15:54.956749+0000","last_undegraded":"2024-04-19T02:15:54.956749+0000","last_fullsized":"2024-04-19T02:15:54.956749+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:53.170180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.955335+0000","last_change":"2024-04-19T02:15:29.278810+0000","last_active":"2024-04-19T02:15:54.955335+0000","last_peered":"2024-04-19T02:15:54.955335+0000","last_clean":"2024-04-19T02:15:54.955335+0000","last_became_active":"2024-04-19T02:15:29.277913+0000","last_became_peered":"2024-04-19T02:15:29.277913+0000","last_unstale":"2024-04-19T02:15:54.955335+0000","last_undegraded":"2024-04-19T02:15:54.955335+0000","last_fullsized":"2024-04-19T02:15:54.955335+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:24.082666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.956716+0000","last_change":"2024-04-19T02:15:28.889132+0000","last_active":"2024-04-19T02:15:54.956716+0000","last_peered":"2024-04-19T02:15:54.956716+0000","last_clean":"2024-04-19T02:15:54.956716+0000","last_became_active":"2024-04-19T02:15:28.888926+0000","last_became_peered":"2024-04-19T02:15:28.888926+0000","last_unstale":"2024-04-19T02:15:54.956716+0000","last_undegraded":"2024-04-19T02:15:54.956716+0000","last_fullsized":"2024-04-19T02:15:54.956716+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:55.030526+0000","last_change":"2024-04-19T02:15:29.282776+0000","last_active":"2024-04-19T02:15:55.030526+0000","last_peered":"2024-04-19T02:15:55.030526+0000","last_clean":"2024-04-19T02:15:55.030526+0000","last_became_active":"2024-04-19T02:15:29.279382+0000","last_became_peered":"2024-04-19T02:15:29.279382+0000","last_unstale":"2024-04-19T02:15:55.030526+0000","last_undegraded":"2024-04-19T02:15:55.030526+0000","last_fullsized":"2024-04-19T02:15:55.030526+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:55.030403+0000","last_change":"2024-04-19T02:15:29.283537+0000","last_active":"2024-04-19T02:15:55.030403+0000","last_peered":"2024-04-19T02:15:55.030403+0000","last_clean":"2024-04-19T02:15:55.030403+0000","last_became_active":"2024-04-19T02:15:29.281801+0000","last_became_peered":"2024-04-19T02:15:29.281801+0000","last_unstale":"2024-04-19T02:15:55.030403+0000","last_undegraded":"2024-04-19T02:15:55.030403+0000","last_fullsized":"2024-04-19T02:15:55.030403+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.954928+0000","last_change":"2024-04-19T02:15:29.281560+0000","last_active":"2024-04-19T02:15:54.954928+0000","last_peered":"2024-04-19T02:15:54.954928+0000","last_clean":"2024-04-19T02:15:54.954928+0000","last_became_active":"2024-04-19T02:15:29.281261+0000","last_became_peered":"2024-04-19T02:15:29.281261+0000","last_unstale":"2024-04-19T02:15:54.954928+0000","last_undegraded":"2024-04-19T02:15:54.954928+0000","last_fullsized":"2024-04-19T02:15:54.954928+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T02:15:55.960049+0000","last_change":"2024-04-19T02:15:53.955913+0000","last_active":"2024-04-19T02:15:55.960049+0000","last_peered":"2024-04-19T02:15:55.960049+0000","last_clean":"2024-04-19T02:15:55.960049+0000","last_became_active":"2024-04-19T02:15:53.955676+0000","last_became_peered":"2024-04-19T02:15:53.955676+0000","last_unstale":"2024-04-19T02:15:55.960049+0000","last_undegraded":"2024-04-19T02:15:55.960049+0000","last_fullsized":"2024-04-19T02:15:55.960049+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:53:02.899902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.955551+0000","last_change":"2024-04-19T02:15:29.278702+0000","last_active":"2024-04-19T02:15:54.955551+0000","last_peered":"2024-04-19T02:15:54.955551+0000","last_clean":"2024-04-19T02:15:54.955551+0000","last_became_active":"2024-04-19T02:15:29.277756+0000","last_became_peered":"2024-04-19T02:15:29.277756+0000","last_unstale":"2024-04-19T02:15:54.955551+0000","last_undegraded":"2024-04-19T02:15:54.955551+0000","last_fullsized":"2024-04-19T02:15:54.955551+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T02:15:54.955623+0000","last_change":"2024-04-19T02:15:29.277568+0000","last_active":"2024-04-19T02:15:54.955623+0000","last_peered":"2024-04-19T02:15:54.955623+0000","last_clean":"2024-04-19T02:15:54.955623+0000","last_became_active":"2024-04-19T02:15:29.276725+0000","last_became_peered":"2024-04-19T02:15:29.276725+0000","last_unstale":"2024-04-19T02:15:54.955623+0000","last_undegraded":"2024-04-19T02:15:54.955623+0000","last_fullsized":"2024-04-19T02:15:54.955623+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":635633664,"num_objects":9699,"num_object_clones":0,"num_object_copies":19398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9699,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9699,"num_write_kb":620736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1271332864,"data_stored":1271332864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9699,"ondisk_log_size":9699,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738377,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":504840,"kb_used_data":465528,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":93867000,"statfs":{"total":96636764160,"available":96119808000,"internally_reserved":0,"allocated":476700672,"data_stored":476578346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738378,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":370336,"kb_used_data":331028,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94001504,"statfs":{"total":96636764160,"available":96257540096,"internally_reserved":0,"allocated":338972672,"data_stored":338823964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,6,4],"upper_bound":8},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.192}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]}]},{"osd":1,"up_from":8,"seq":34359738377,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":270168,"kb_used_data":234956,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94101672,"statfs":{"total":96636764160,"available":96360112128,"internally_reserved":0,"allocated":240594944,"data_stored":240453812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,1,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.17799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.21099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":397672448,"data_stored":397672448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":356057088,"data_stored":356057088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":517603328,"data_stored":517603328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:15:58.811 INFO:tasks.thrashosds.thrasher:Setting 3.8 to [2, 0, 1] 2024-04-19T02:15:58.811 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '3.8', '2', '0', '1'] 2024-04-19T02:15:58.812 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 3.8 2 0 1 2024-04-19T02:15:58.847 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:15:58.848+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:15:58.916 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:15:58.917 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:15:58.931 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:15:58.948 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:15:58.949+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:15:58.978 INFO:teuthology.orchestra.run.smithi121.stderr:noscrub is unset 2024-04-19T02:15:59.025 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 4 16 13770 13754 214.89 193.312 0.00490208 0.00464945 2024-04-19T02:15:59.050 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:15:59.051+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:15:59.144 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:15:59.145 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:15:59.151 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:15:59.151+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:15:59.159 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:15:59.207 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:15:59.217 INFO:teuthology.orchestra.run.smithi121.stderr:Error EINVAL: you must specify pairs of osd ids to be remapped 2024-04-19T02:15:59.220 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-19T02:15:59.220 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2024-04-19T02:15:59.252 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:15:59.252+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:15:59.336 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:15:59.336 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:15:59.350 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:15:59.353 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:15:59.353+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:15:59.355 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:15:59.376 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:15:59.396 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2: {} 2024-04-19T02:15:59.397 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:15:59.397 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:15:59.397 INFO:teuthology.orchestra.run.smithi121.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:15:59.453 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:15:59.454+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:15:59.523 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:15:59.523 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:15:59.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.524 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4549.0:15393 5.6 e20/16 5:6a95dfcf:::benchmark_data_smithi121_44835_object15392:head v 20'951, mlcod=20'948)", 2024-04-19T02:15:59.524 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.521510+0000", 2024-04-19T02:15:59.524 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00190409, 2024-04-19T02:15:59.524 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019269630000000001, 2024-04-19T02:15:59.524 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:15:59.524 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:15:59.524 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:15:59.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.524 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:15:59.524 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.521510+0000", 2024-04-19T02:15:59.524 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:59.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.524 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:15:59.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.521510+0000", 2024-04-19T02:15:59.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:59.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.525 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:15:59.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.521509+0000", 2024-04-19T02:15:59.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:59.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.525 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:15:59.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.521592+0000", 2024-04-19T02:15:59.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2542999999999999e-05 2024-04-19T02:15:59.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.525 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:15:59.526 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.521599+0000", 2024-04-19T02:15:59.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3159999999999999e-06 2024-04-19T02:15:59.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.526 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:15:59.526 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.521605+0000", 2024-04-19T02:15:59.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5990000000000001e-06 2024-04-19T02:15:59.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.526 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:59.526 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.521635+0000", 2024-04-19T02:15:59.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0493000000000001e-05 2024-04-19T02:15:59.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:15:59.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.521648+0000", 2024-04-19T02:15:59.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2312e-05 2024-04-19T02:15:59.527 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:59.527 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:15:59.527 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:59.527 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.527 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4549.0:15396 5.6 e20/16 5:62ef1fcf:::benchmark_data_smithi121_44835_object15395:head v 20'952, mlcod=20'948)", 2024-04-19T02:15:59.527 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.522350+0000", 2024-04-19T02:15:59.527 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0010642640000000001, 2024-04-19T02:15:59.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0011562860000000001, 2024-04-19T02:15:59.527 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:15:59.527 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:15:59.527 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:15:59.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.528 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:15:59.528 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.522350+0000", 2024-04-19T02:15:59.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:59.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.528 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:15:59.528 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.522350+0000", 2024-04-19T02:15:59.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:59.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.528 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:15:59.528 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.522349+0000", 2024-04-19T02:15:59.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:59.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.529 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:15:59.529 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.522385+0000", 2024-04-19T02:15:59.529 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5778999999999997e-05 2024-04-19T02:15:59.529 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.529 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.529 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:15:59.529 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.522392+0000", 2024-04-19T02:15:59.529 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9269999999999999e-06 2024-04-19T02:15:59.529 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.529 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.529 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:15:59.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.522397+0000", 2024-04-19T02:15:59.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3589999999999999e-06 2024-04-19T02:15:59.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.530 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:59.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.522505+0000", 2024-04-19T02:15:59.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010737400000000001 2024-04-19T02:15:59.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.530 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:15:59.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.522522+0000", 2024-04-19T02:15:59.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7609e-05 2024-04-19T02:15:59.530 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:59.530 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:15:59.530 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:59.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.531 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:15398 5.2 5:49ae91be:::benchmark_data_smithi121_44835_object15397:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:15:59.531 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.522408+0000", 2024-04-19T02:15:59.531 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0010055489999999999, 2024-04-19T02:15:59.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0011665250000000001, 2024-04-19T02:15:59.531 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:15:59.531 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:15:59.531 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:15:59.531 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:15:59.531 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:59.531 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15398 2024-04-19T02:15:59.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.531 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:15:59.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:15:59.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.522408+0000", 2024-04-19T02:15:59.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:59.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.532 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:15:59.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.522408+0000", 2024-04-19T02:15:59.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:59.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.532 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:15:59.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.522407+0000", 2024-04-19T02:15:59.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:15:59.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.532 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:15:59.533 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.522477+0000", 2024-04-19T02:15:59.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0026999999999999e-05 2024-04-19T02:15:59.533 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.533 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.533 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:15:59.533 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.522487+0000", 2024-04-19T02:15:59.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7100000000000002e-06 2024-04-19T02:15:59.533 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.533 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.533 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:15:59.533 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.522495+0000", 2024-04-19T02:15:59.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5000000000000002e-06 2024-04-19T02:15:59.533 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.533 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.533 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:59.533 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.522538+0000", 2024-04-19T02:15:59.534 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3096000000000002e-05 2024-04-19T02:15:59.534 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.534 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.534 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:15:59.534 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.522661+0000", 2024-04-19T02:15:59.534 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000123421 2024-04-19T02:15:59.534 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.534 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.534 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:15:59.534 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.522789+0000", 2024-04-19T02:15:59.534 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012769800000000001 2024-04-19T02:15:59.534 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:59.534 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:15:59.534 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:59.535 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.535 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.535 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:15399 5.7 5:e962f3d0:::benchmark_data_smithi121_44835_object15398:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:15:59.535 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.522506+0000", 2024-04-19T02:15:59.535 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00090811099999999997, 2024-04-19T02:15:59.535 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0011654460000000001, 2024-04-19T02:15:59.535 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:15:59.535 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:15:59.535 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:15:59.535 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:15:59.535 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:59.535 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15399 2024-04-19T02:15:59.535 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.535 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:15:59.535 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.535 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:15:59.536 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.522506+0000", 2024-04-19T02:15:59.536 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:59.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.536 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:15:59.536 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.522506+0000", 2024-04-19T02:15:59.536 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:59.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.536 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:15:59.536 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.522505+0000", 2024-04-19T02:15:59.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:59.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:15:59.537 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.522559+0000", 2024-04-19T02:15:59.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3606999999999997e-05 2024-04-19T02:15:59.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:15:59.537 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.522567+0000", 2024-04-19T02:15:59.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1750000000000005e-06 2024-04-19T02:15:59.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.538 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.538 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:15:59.538 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.522573+0000", 2024-04-19T02:15:59.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0780000000000001e-06 2024-04-19T02:15:59.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.538 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.538 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:59.538 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.522600+0000", 2024-04-19T02:15:59.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6817000000000001e-05 2024-04-19T02:15:59.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.538 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.538 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:15:59.538 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.522670+0000", 2024-04-19T02:15:59.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0766999999999995e-05 2024-04-19T02:15:59.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.539 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.539 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:15:59.539 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.522760+0000", 2024-04-19T02:15:59.539 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9349000000000001e-05 2024-04-19T02:15:59.539 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:59.539 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:15:59.539 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:59.539 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.539 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.539 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:15400 5.f 5:f6fdb9f4:::benchmark_data_smithi121_44835_object15399:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:15:59.539 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.522579+0000", 2024-04-19T02:15:59.539 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00083485799999999995, 2024-04-19T02:15:59.539 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0011999129999999999, 2024-04-19T02:15:59.539 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:15:59.539 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:15:59.540 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:15:59.540 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:15:59.540 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:59.540 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15400 2024-04-19T02:15:59.540 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.540 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:15:59.540 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.540 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:15:59.540 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.522579+0000", 2024-04-19T02:15:59.540 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:59.540 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.540 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.540 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:15:59.540 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.522579+0000", 2024-04-19T02:15:59.540 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:59.541 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.541 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.541 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:15:59.541 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.522578+0000", 2024-04-19T02:15:59.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:59.541 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.541 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.541 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:15:59.541 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.522643+0000", 2024-04-19T02:15:59.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4123999999999998e-05 2024-04-19T02:15:59.541 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.541 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.541 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:15:59.541 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.522651+0000", 2024-04-19T02:15:59.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2069999999999995e-06 2024-04-19T02:15:59.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.542 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:15:59.542 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.522656+0000", 2024-04-19T02:15:59.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6579999999999999e-06 2024-04-19T02:15:59.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.542 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:59.542 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.522971+0000", 2024-04-19T02:15:59.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00031500799999999998 2024-04-19T02:15:59.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.542 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:15:59.542 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.523083+0000", 2024-04-19T02:15:59.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011132 2024-04-19T02:15:59.543 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.543 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.543 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:15:59.543 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.523214+0000", 2024-04-19T02:15:59.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013083499999999999 2024-04-19T02:15:59.543 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:59.543 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:15:59.543 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:59.543 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.543 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.543 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:15402 5.7 5:e4361299:::benchmark_data_smithi121_44835_object15401:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:15:59.543 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.522662+0000", 2024-04-19T02:15:59.543 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00075145599999999996, 2024-04-19T02:15:59.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001186842, 2024-04-19T02:15:59.543 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:15:59.544 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:15:59.544 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:15:59.544 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:15:59.544 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:59.544 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15402 2024-04-19T02:15:59.544 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.544 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:15:59.544 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.544 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:15:59.544 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.522662+0000", 2024-04-19T02:15:59.544 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:59.544 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.544 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.544 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:15:59.545 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.522662+0000", 2024-04-19T02:15:59.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:59.545 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.545 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.545 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:15:59.545 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.522662+0000", 2024-04-19T02:15:59.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:59.545 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.545 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.545 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:15:59.545 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.522702+0000", 2024-04-19T02:15:59.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0327999999999997e-05 2024-04-19T02:15:59.545 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.545 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.545 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:15:59.545 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.522710+0000", 2024-04-19T02:15:59.546 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5179999999999998e-06 2024-04-19T02:15:59.546 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.546 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:15:59.546 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.522715+0000", 2024-04-19T02:15:59.546 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7309999999999998e-06 2024-04-19T02:15:59.546 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.546 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:59.546 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.523352+0000", 2024-04-19T02:15:59.546 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00063621100000000002 2024-04-19T02:15:59.546 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.546 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:15:59.547 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.523474+0000", 2024-04-19T02:15:59.547 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000122504 2024-04-19T02:15:59.547 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.547 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.547 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:15:59.547 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.523624+0000", 2024-04-19T02:15:59.547 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000150371 2024-04-19T02:15:59.547 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:59.547 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:15:59.547 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:59.547 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.547 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.547 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:15403 5.d 5:b3866bfd:::benchmark_data_smithi121_44835_object15402:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:15:59.547 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.522782+0000", 2024-04-19T02:15:59.547 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00063229200000000001, 2024-04-19T02:15:59.548 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001119374, 2024-04-19T02:15:59.548 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:15:59.548 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:15:59.548 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:15:59.548 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:15:59.548 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:59.548 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15403 2024-04-19T02:15:59.548 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.548 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:15:59.548 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.548 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:15:59.548 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.522782+0000", 2024-04-19T02:15:59.548 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:59.548 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.548 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.549 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:15:59.549 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.522782+0000", 2024-04-19T02:15:59.549 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:59.549 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.549 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.549 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:15:59.549 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.522781+0000", 2024-04-19T02:15:59.549 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:59.549 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.549 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.549 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:15:59.549 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.522836+0000", 2024-04-19T02:15:59.549 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5074999999999997e-05 2024-04-19T02:15:59.549 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.549 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.550 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:15:59.550 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.522844+0000", 2024-04-19T02:15:59.550 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8539999999999997e-06 2024-04-19T02:15:59.550 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.550 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.550 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:15:59.550 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.522850+0000", 2024-04-19T02:15:59.550 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9739999999999999e-06 2024-04-19T02:15:59.550 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.550 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.550 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:59.550 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.522891+0000", 2024-04-19T02:15:59.550 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0729000000000003e-05 2024-04-19T02:15:59.551 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.551 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.551 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:15:59.551 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.523014+0000", 2024-04-19T02:15:59.551 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000123359 2024-04-19T02:15:59.551 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.551 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.551 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:15:59.551 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.523137+0000", 2024-04-19T02:15:59.551 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012333600000000001 2024-04-19T02:15:59.551 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:59.551 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:15:59.551 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:59.552 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.552 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.552 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:15386 5.7 5:ed764d53:::benchmark_data_smithi121_44835_object15385:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:15:59.552 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.518446+0000", 2024-04-19T02:15:59.552 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0049679490000000001, 2024-04-19T02:15:59.552 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.005501878, 2024-04-19T02:15:59.552 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:15:59.553 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:15:59.553 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:15:59.553 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:15:59.553 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:59.553 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15386 2024-04-19T02:15:59.553 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.553 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:15:59.553 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.553 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:15:59.553 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.518446+0000", 2024-04-19T02:15:59.553 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:59.553 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.553 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.553 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:15:59.554 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.518446+0000", 2024-04-19T02:15:59.554 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:59.554 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.554 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.554 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:15:59.554 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.518445+0000", 2024-04-19T02:15:59.554 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:59.554 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.554 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.554 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:15:59.554 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.518479+0000", 2024-04-19T02:15:59.554 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3736999999999999e-05 2024-04-19T02:15:59.554 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.555 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.555 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:15:59.555 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.518487+0000", 2024-04-19T02:15:59.555 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3019999999999995e-06 2024-04-19T02:15:59.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.555 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.555 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:15:59.555 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.518493+0000", 2024-04-19T02:15:59.555 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0900000000000001e-06 2024-04-19T02:15:59.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.555 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.555 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:59.555 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.519302+0000", 2024-04-19T02:15:59.555 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00080864700000000001 2024-04-19T02:15:59.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.556 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.556 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:15:59.556 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.519414+0000", 2024-04-19T02:15:59.556 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000112305 2024-04-19T02:15:59.556 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.556 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.556 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:15:59.556 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.519538+0000", 2024-04-19T02:15:59.556 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000123261 2024-04-19T02:15:59.556 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.556 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.556 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:59.556 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.522551+0000", 2024-04-19T02:15:59.556 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030138650000000001 2024-04-19T02:15:59.556 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:59.556 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:15:59.557 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:59.557 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.557 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.557 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:15387 5.7 5:ed157a46:::benchmark_data_smithi121_44835_object15386:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:15:59.557 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.518872+0000", 2024-04-19T02:15:59.557 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0045415890000000004, 2024-04-19T02:15:59.557 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051220440000000001, 2024-04-19T02:15:59.557 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:15:59.557 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:15:59.557 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:15:59.557 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:15:59.557 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:59.557 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15387 2024-04-19T02:15:59.557 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.557 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:15:59.557 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.557 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:15:59.558 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.518872+0000", 2024-04-19T02:15:59.558 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:59.558 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.558 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.558 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:15:59.558 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.518872+0000", 2024-04-19T02:15:59.558 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:59.558 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.558 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.558 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:15:59.558 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.518872+0000", 2024-04-19T02:15:59.558 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:59.558 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.558 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.558 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:15:59.559 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.518972+0000", 2024-04-19T02:15:59.559 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010033 2024-04-19T02:15:59.559 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.559 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.559 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:15:59.559 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.518982+0000", 2024-04-19T02:15:59.559 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7650000000000005e-06 2024-04-19T02:15:59.559 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.559 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.559 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:15:59.559 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.518989+0000", 2024-04-19T02:15:59.559 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5630000000000003e-06 2024-04-19T02:15:59.559 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.559 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.559 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:59.559 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.520526+0000", 2024-04-19T02:15:59.560 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001536298 2024-04-19T02:15:59.560 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.560 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.560 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:15:59.560 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.520633+0000", 2024-04-19T02:15:59.560 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010717600000000001 2024-04-19T02:15:59.560 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.560 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.560 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:15:59.560 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.520718+0000", 2024-04-19T02:15:59.560 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5000999999999995e-05 2024-04-19T02:15:59.560 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.560 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.560 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:59.560 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.522577+0000", 2024-04-19T02:15:59.560 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0018590880000000001 2024-04-19T02:15:59.561 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:59.561 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:15:59.561 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:59.561 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.561 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.561 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:15392 5.1 5:81dd6e8e:::benchmark_data_smithi121_44835_object15391:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:15:59.561 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.520207+0000", 2024-04-19T02:15:59.561 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0032072200000000002, 2024-04-19T02:15:59.561 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038349830000000001, 2024-04-19T02:15:59.561 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:15:59.561 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:15:59.561 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:15:59.561 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:15:59.561 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:59.562 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15392 2024-04-19T02:15:59.562 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.562 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:15:59.562 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.562 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:15:59.562 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.520207+0000", 2024-04-19T02:15:59.562 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:59.562 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.562 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.562 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:15:59.562 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.520207+0000", 2024-04-19T02:15:59.562 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:59.562 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.562 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.563 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:15:59.563 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.520206+0000", 2024-04-19T02:15:59.563 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:15:59.563 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.563 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.563 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:15:59.563 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.520285+0000", 2024-04-19T02:15:59.563 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9666999999999995e-05 2024-04-19T02:15:59.563 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.563 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.563 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:15:59.563 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.520294+0000", 2024-04-19T02:15:59.563 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4630000000000001e-06 2024-04-19T02:15:59.563 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.563 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.564 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:15:59.564 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.520300+0000", 2024-04-19T02:15:59.564 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4119999999999998e-06 2024-04-19T02:15:59.564 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.564 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.564 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:59.564 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.520342+0000", 2024-04-19T02:15:59.564 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1519e-05 2024-04-19T02:15:59.564 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.564 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.564 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:15:59.564 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.520489+0000", 2024-04-19T02:15:59.564 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000147396 2024-04-19T02:15:59.564 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.565 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.565 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:15:59.565 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.520644+0000", 2024-04-19T02:15:59.565 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000154444 2024-04-19T02:15:59.565 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.565 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.565 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:15:59.565 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.522597+0000", 2024-04-19T02:15:59.565 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019537140000000001 2024-04-19T02:15:59.565 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:59.565 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:15:59.565 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:59.565 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.565 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.565 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:15394 5.1 5:81a0a41a:::benchmark_data_smithi121_44835_object15393:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:15:59.565 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.520830+0000", 2024-04-19T02:15:59.566 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0025834299999999998, 2024-04-19T02:15:59.566 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032570870000000001, 2024-04-19T02:15:59.566 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:15:59.566 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:15:59.566 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:15:59.566 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:15:59.566 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:59.566 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15394 2024-04-19T02:15:59.566 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.566 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:15:59.566 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.566 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:15:59.566 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.520830+0000", 2024-04-19T02:15:59.566 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:59.566 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.567 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.567 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:15:59.567 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.520830+0000", 2024-04-19T02:15:59.567 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:59.567 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.567 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.567 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:15:59.567 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.520830+0000", 2024-04-19T02:15:59.567 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:59.567 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.567 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.567 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:15:59.567 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.520885+0000", 2024-04-19T02:15:59.567 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5238000000000002e-05 2024-04-19T02:15:59.567 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.568 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.568 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:15:59.568 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.520895+0000", 2024-04-19T02:15:59.568 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7110000000000007e-06 2024-04-19T02:15:59.568 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.568 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.568 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:15:59.568 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.520910+0000", 2024-04-19T02:15:59.568 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4841000000000001e-05 2024-04-19T02:15:59.568 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.568 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.568 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:59.568 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.521670+0000", 2024-04-19T02:15:59.568 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00076016199999999999 2024-04-19T02:15:59.568 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.568 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.568 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:15:59.569 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.521781+0000", 2024-04-19T02:15:59.569 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000111078 2024-04-19T02:15:59.569 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.569 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.569 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:15:59.569 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.521904+0000", 2024-04-19T02:15:59.569 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012359400000000001 2024-04-19T02:15:59.569 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:59.569 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:15:59.569 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:59.569 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.569 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.569 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4549.0:15390 5.3 e20/16 5:c901094d:::benchmark_data_smithi121_44835_object15389:head v 20'985, mlcod=20'983)", 2024-04-19T02:15:59.569 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.521232+0000", 2024-04-19T02:15:59.569 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0021820429999999998, 2024-04-19T02:15:59.569 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0028963209999999999, 2024-04-19T02:15:59.569 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:15:59.570 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:15:59.570 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:15:59.570 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.570 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:15:59.570 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.521232+0000", 2024-04-19T02:15:59.570 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:59.570 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.570 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.570 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:15:59.570 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.521232+0000", 2024-04-19T02:15:59.570 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:59.570 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.570 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.570 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:15:59.570 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.521231+0000", 2024-04-19T02:15:59.570 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:15:59.571 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.571 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.571 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:15:59.571 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.521295+0000", 2024-04-19T02:15:59.571 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3528000000000006e-05 2024-04-19T02:15:59.571 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.571 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.571 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:15:59.571 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.521303+0000", 2024-04-19T02:15:59.571 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9869999999999999e-06 2024-04-19T02:15:59.571 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.571 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.571 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:15:59.571 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.521308+0000", 2024-04-19T02:15:59.571 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3689999999999998e-06 2024-04-19T02:15:59.572 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.572 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.572 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:59.572 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.521336+0000", 2024-04-19T02:15:59.572 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8019999999999999e-05 2024-04-19T02:15:59.572 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.572 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.572 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:15:59.572 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.521352+0000", 2024-04-19T02:15:59.572 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6004000000000001e-05 2024-04-19T02:15:59.572 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:59.572 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:15:59.572 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:59.572 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.572 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.573 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:15395 5.2 5:4682f4ab:::benchmark_data_smithi121_44835_object15394:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:15:59.573 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.521421+0000", 2024-04-19T02:15:59.573 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0019923990000000002, 2024-04-19T02:15:59.573 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027421289999999998, 2024-04-19T02:15:59.573 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:15:59.573 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:15:59.573 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:15:59.573 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:15:59.573 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:15:59.573 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15395 2024-04-19T02:15:59.573 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.573 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:15:59.573 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.574 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:15:59.574 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.521421+0000", 2024-04-19T02:15:59.574 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:59.574 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.574 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.574 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:15:59.574 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.521421+0000", 2024-04-19T02:15:59.574 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:15:59.574 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.574 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.574 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:15:59.574 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.521421+0000", 2024-04-19T02:15:59.575 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:15:59.575 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.575 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.575 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:15:59.575 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.521486+0000", 2024-04-19T02:15:59.575 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5190000000000004e-05 2024-04-19T02:15:59.575 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.575 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.575 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:15:59.575 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.521508+0000", 2024-04-19T02:15:59.575 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2308999999999999e-05 2024-04-19T02:15:59.575 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.575 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.575 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:15:59.575 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.521517+0000", 2024-04-19T02:15:59.576 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5969999999999992e-06 2024-04-19T02:15:59.576 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.576 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.576 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:15:59.576 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.521559+0000", 2024-04-19T02:15:59.576 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2122000000000001e-05 2024-04-19T02:15:59.576 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.576 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.576 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:15:59.576 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.521694+0000", 2024-04-19T02:15:59.576 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000134869 2024-04-19T02:15:59.576 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:15:59.576 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:15:59.576 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:15:59.576 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.521812+0000", 2024-04-19T02:15:59.576 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011796800000000001 2024-04-19T02:15:59.576 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:59.577 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:15:59.577 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:59.577 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:15:59.577 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-04-19T02:15:59.577 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 13 2024-04-19T02:15:59.577 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:15:59.578 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:15:59.579 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:15:59.579+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:15:59.679 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:15:59.680+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:15:59.779 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:15:59.780+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:15:59.788 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:15:59.788 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-04-19T02:15:59.788 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-04-19T02:15:59.788 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-04-19T02:15:59.788 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:15:59.803 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:15:59.887 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:15:59.888+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:15:59.980 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:15:59.981+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:00.015 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:16:00.015 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-04-19T02:16:00.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-04-19T02:16:00.015 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:16:00.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.015 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:00.015 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269657+0000", 2024-04-19T02:16:00.015 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.743745178000001, 2024-04-19T02:16:00.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018569239000000001, 2024-04-19T02:16:00.016 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:00.016 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:00.016 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:00.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:00.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269657+0000", 2024-04-19T02:16:00.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:00.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:00.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269657+0000", 2024-04-19T02:16:00.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:00.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:00.017 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269656+0000", 2024-04-19T02:16:00.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:00.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.017 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:00.017 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269666+0000", 2024-04-19T02:16:00.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.628e-06 2024-04-19T02:16:00.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.017 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:00.017 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269673+0000", 2024-04-19T02:16:00.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1690000000000003e-06 2024-04-19T02:16:00.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:00.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269680+0000", 2024-04-19T02:16:00.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8940000000000004e-06 2024-04-19T02:16:00.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:00.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269788+0000", 2024-04-19T02:16:00.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107725 2024-04-19T02:16:00.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:00.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269791+0000", 2024-04-19T02:16:00.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9699999999999999e-06 2024-04-19T02:16:00.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:00.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.277693+0000", 2024-04-19T02:16:00.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079026979999999997 2024-04-19T02:16:00.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:00.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.277838+0000", 2024-04-19T02:16:00.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014444699999999999 2024-04-19T02:16:00.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.020 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:00.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.277996+0000", 2024-04-19T02:16:00.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015794499999999999 2024-04-19T02:16:00.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.020 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:00.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282534+0000", 2024-04-19T02:16:00.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045383070000000001 2024-04-19T02:16:00.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:00.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288134+0000", 2024-04-19T02:16:00.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0056005020000000003 2024-04-19T02:16:00.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:00.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288187+0000", 2024-04-19T02:16:00.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2884999999999999e-05 2024-04-19T02:16:00.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:00.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288226+0000", 2024-04-19T02:16:00.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8458999999999999e-05 2024-04-19T02:16:00.022 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:00.022 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:00.022 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:00.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.022 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:00.022 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269684+0000", 2024-04-19T02:16:00.022 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.743717609000001, 2024-04-19T02:16:00.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019077493000000001, 2024-04-19T02:16:00.023 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:00.023 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:00.023 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:00.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:00.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269684+0000", 2024-04-19T02:16:00.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:00.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:00.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269684+0000", 2024-04-19T02:16:00.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:00.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:00.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269684+0000", 2024-04-19T02:16:00.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:00.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:00.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269686+0000", 2024-04-19T02:16:00.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2740000000000002e-06 2024-04-19T02:16:00.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:00.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269690+0000", 2024-04-19T02:16:00.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8829999999999999e-06 2024-04-19T02:16:00.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:00.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269693+0000", 2024-04-19T02:16:00.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4199999999999999e-06 2024-04-19T02:16:00.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.026 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:00.026 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269875+0000", 2024-04-19T02:16:00.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018114800000000001 2024-04-19T02:16:00.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.026 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:00.026 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269880+0000", 2024-04-19T02:16:00.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5620000000000003e-06 2024-04-19T02:16:00.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.026 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:00.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278610+0000", 2024-04-19T02:16:00.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.008729423 2024-04-19T02:16:00.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:00.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278724+0000", 2024-04-19T02:16:00.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011428400000000001 2024-04-19T02:16:00.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:00.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278860+0000", 2024-04-19T02:16:00.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013601600000000001 2024-04-19T02:16:00.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:00.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282632+0000", 2024-04-19T02:16:00.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037722889999999999 2024-04-19T02:16:00.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:00.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288712+0000", 2024-04-19T02:16:00.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0060799599999999997 2024-04-19T02:16:00.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:00.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288742+0000", 2024-04-19T02:16:00.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0048000000000001e-05 2024-04-19T02:16:00.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:00.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288762+0000", 2024-04-19T02:16:00.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9482000000000001e-05 2024-04-19T02:16:00.029 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:00.029 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:00.029 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:00.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.029 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:12 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:00.029 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269696+0000", 2024-04-19T02:16:00.029 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.743705531, 2024-04-19T02:16:00.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018617073000000001, 2024-04-19T02:16:00.029 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:00.030 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:00.030 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:00.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.030 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:00.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269696+0000", 2024-04-19T02:16:00.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:00.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.030 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:00.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269696+0000", 2024-04-19T02:16:00.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:00.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:00.031 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269696+0000", 2024-04-19T02:16:00.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967296 2024-04-19T02:16:00.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:00.031 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269698+0000", 2024-04-19T02:16:00.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9570000000000001e-06 2024-04-19T02:16:00.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:00.031 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269702+0000", 2024-04-19T02:16:00.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2459999999999997e-06 2024-04-19T02:16:00.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:00.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269708+0000", 2024-04-19T02:16:00.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2709999999999998e-06 2024-04-19T02:16:00.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:00.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269749+0000", 2024-04-19T02:16:00.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0500000000000002e-05 2024-04-19T02:16:00.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-04-19T02:16:00.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269754+0000", 2024-04-19T02:16:00.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.502e-06 2024-04-19T02:16:00.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:00.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.277984+0000", 2024-04-19T02:16:00.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0082293049999999993 2024-04-19T02:16:00.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:00.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278489+0000", 2024-04-19T02:16:00.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00050499699999999998 2024-04-19T02:16:00.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:00.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278649+0000", 2024-04-19T02:16:00.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016012000000000001 2024-04-19T02:16:00.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:00.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286855+0000", 2024-04-19T02:16:00.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0082066139999999992 2024-04-19T02:16:00.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:00.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288248+0000", 2024-04-19T02:16:00.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001392838 2024-04-19T02:16:00.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:00.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288287+0000", 2024-04-19T02:16:00.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8516000000000002e-05 2024-04-19T02:16:00.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.035 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:00.035 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288313+0000", 2024-04-19T02:16:00.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6420000000000001e-05 2024-04-19T02:16:00.035 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:00.035 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:00.035 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:00.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.035 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:00.035 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269753+0000", 2024-04-19T02:16:00.035 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.743648226000001, 2024-04-19T02:16:00.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019088755999999998, 2024-04-19T02:16:00.035 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:00.035 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:00.036 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:00.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.036 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:00.036 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269753+0000", 2024-04-19T02:16:00.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:00.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.036 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:00.036 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269753+0000", 2024-04-19T02:16:00.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:00.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:00.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269753+0000", 2024-04-19T02:16:00.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:00.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:00.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269770+0000", 2024-04-19T02:16:00.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7150999999999999e-05 2024-04-19T02:16:00.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:00.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269779+0000", 2024-04-19T02:16:00.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4139999999999994e-06 2024-04-19T02:16:00.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:00.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269786+0000", 2024-04-19T02:16:00.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.537e-06 2024-04-19T02:16:00.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:00.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269913+0000", 2024-04-19T02:16:00.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012699599999999999 2024-04-19T02:16:00.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:00.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269916+0000", 2024-04-19T02:16:00.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9280000000000002e-06 2024-04-19T02:16:00.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:00.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.279143+0000", 2024-04-19T02:16:00.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0092270129999999992 2024-04-19T02:16:00.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:00.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.279223+0000", 2024-04-19T02:16:00.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0050999999999996e-05 2024-04-19T02:16:00.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:00.040 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.279364+0000", 2024-04-19T02:16:00.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000140934 2024-04-19T02:16:00.040 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.040 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:00.040 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286189+0000", 2024-04-19T02:16:00.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.006825327 2024-04-19T02:16:00.040 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.040 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:00.040 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288791+0000", 2024-04-19T02:16:00.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026021500000000001 2024-04-19T02:16:00.040 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.040 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:00.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288822+0000", 2024-04-19T02:16:00.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0162999999999999e-05 2024-04-19T02:16:00.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:00.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288842+0000", 2024-04-19T02:16:00.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0644000000000001e-05 2024-04-19T02:16:00.041 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:00.041 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:00.041 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:00.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.041 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:00.041 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:16:00.041 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.743609752000001, 2024-04-19T02:16:00.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020307345000000001, 2024-04-19T02:16:00.042 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:00.042 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:00.042 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:00.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.042 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:00.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:16:00.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:00.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.042 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:00.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:16:00.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:00.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:00.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269791+0000", 2024-04-19T02:16:00.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:00.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:00.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269795+0000", 2024-04-19T02:16:00.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5619999999999999e-06 2024-04-19T02:16:00.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:00.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269802+0000", 2024-04-19T02:16:00.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8469999999999998e-06 2024-04-19T02:16:00.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:00.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269807+0000", 2024-04-19T02:16:00.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.707e-06 2024-04-19T02:16:00.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:00.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269950+0000", 2024-04-19T02:16:00.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000143313 2024-04-19T02:16:00.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:00.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269955+0000", 2024-04-19T02:16:00.045 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4029999999999998e-06 2024-04-19T02:16:00.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.045 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:00.045 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.283806+0000", 2024-04-19T02:16:00.045 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013850220999999999 2024-04-19T02:16:00.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.045 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:00.045 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.283896+0000", 2024-04-19T02:16:00.045 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0261999999999997e-05 2024-04-19T02:16:00.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.045 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:00.045 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284022+0000", 2024-04-19T02:16:00.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012641200000000001 2024-04-19T02:16:00.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:00.046 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289066+0000", 2024-04-19T02:16:00.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050438490000000004 2024-04-19T02:16:00.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:00.046 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290011+0000", 2024-04-19T02:16:00.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00094490700000000004 2024-04-19T02:16:00.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:00.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290054+0000", 2024-04-19T02:16:00.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.337e-05 2024-04-19T02:16:00.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:00.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290099+0000", 2024-04-19T02:16:00.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4987999999999997e-05 2024-04-19T02:16:00.047 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:00.047 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:00.047 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:00.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.047 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:00.047 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:16:00.047 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.743531822000001, 2024-04-19T02:16:00.048 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020331023, 2024-04-19T02:16:00.048 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:00.048 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:00.048 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:00.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.048 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:00.048 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:16:00.048 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:00.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.048 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:00.048 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:16:00.048 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:00.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.048 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:00.049 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269869+0000", 2024-04-19T02:16:00.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:00.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.049 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:00.049 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269873+0000", 2024-04-19T02:16:00.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0219999999999998e-06 2024-04-19T02:16:00.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.049 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:00.049 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269881+0000", 2024-04-19T02:16:00.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.79e-06 2024-04-19T02:16:00.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.049 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:00.050 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269887+0000", 2024-04-19T02:16:00.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7899999999999996e-06 2024-04-19T02:16:00.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.050 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:00.050 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269983+0000", 2024-04-19T02:16:00.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6057000000000005e-05 2024-04-19T02:16:00.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.050 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:00.050 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269986+0000", 2024-04-19T02:16:00.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9220000000000001e-06 2024-04-19T02:16:00.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.051 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:00.051 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284350+0000", 2024-04-19T02:16:00.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014364335000000001 2024-04-19T02:16:00.051 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.051 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:00.051 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284664+0000", 2024-04-19T02:16:00.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000313646 2024-04-19T02:16:00.051 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.051 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:00.051 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284794+0000", 2024-04-19T02:16:00.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129839 2024-04-19T02:16:00.051 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:00.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289107+0000", 2024-04-19T02:16:00.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0043127060000000004 2024-04-19T02:16:00.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:00.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290108+0000", 2024-04-19T02:16:00.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0010010590000000001 2024-04-19T02:16:00.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:00.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290144+0000", 2024-04-19T02:16:00.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6709999999999999e-05 2024-04-19T02:16:00.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:00.053 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290201+0000", 2024-04-19T02:16:00.053 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6654999999999999e-05 2024-04-19T02:16:00.053 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:00.053 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:00.053 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:00.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.053 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:00.053 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:16:00.053 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.743489481000001, 2024-04-19T02:16:00.053 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020507241999999998, 2024-04-19T02:16:00.053 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:00.053 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:00.053 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:00.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.054 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:00.054 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:16:00.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:00.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.054 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:00.054 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:16:00.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:00.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.054 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:00.054 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:16:00.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:00.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.055 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:00.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269915+0000", 2024-04-19T02:16:00.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.472e-06 2024-04-19T02:16:00.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.055 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:00.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269928+0000", 2024-04-19T02:16:00.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2979000000000001e-05 2024-04-19T02:16:00.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.055 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:00.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269935+0000", 2024-04-19T02:16:00.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8859999999999998e-06 2024-04-19T02:16:00.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.056 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:00.056 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270009+0000", 2024-04-19T02:16:00.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3429000000000005e-05 2024-04-19T02:16:00.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.056 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:00.056 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270013+0000", 2024-04-19T02:16:00.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2590000000000002e-06 2024-04-19T02:16:00.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.056 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:00.056 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285375+0000", 2024-04-19T02:16:00.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015362275999999999 2024-04-19T02:16:00.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.057 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:00.057 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285451+0000", 2024-04-19T02:16:00.057 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5338000000000003e-05 2024-04-19T02:16:00.057 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.057 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:00.057 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285562+0000", 2024-04-19T02:16:00.057 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000111285 2024-04-19T02:16:00.057 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.057 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:00.057 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289134+0000", 2024-04-19T02:16:00.057 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035719670000000001 2024-04-19T02:16:00.057 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.058 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:00.058 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290341+0000", 2024-04-19T02:16:00.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012074500000000001 2024-04-19T02:16:00.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.058 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:00.058 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290383+0000", 2024-04-19T02:16:00.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1386e-05 2024-04-19T02:16:00.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.058 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:00.058 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290419+0000", 2024-04-19T02:16:00.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6884000000000001e-05 2024-04-19T02:16:00.059 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:00.059 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:00.059 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:00.059 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.059 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.059 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:00.059 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269945+0000", 2024-04-19T02:16:00.059 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.743456899000002, 2024-04-19T02:16:00.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019709098000000001, 2024-04-19T02:16:00.059 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:00.059 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:00.059 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:00.059 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.059 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:00.059 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269945+0000", 2024-04-19T02:16:00.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:00.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:00.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269945+0000", 2024-04-19T02:16:00.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:00.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:00.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269944+0000", 2024-04-19T02:16:00.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:00.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:00.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269965+0000", 2024-04-19T02:16:00.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0803999999999999e-05 2024-04-19T02:16:00.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.061 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:00.061 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269973+0000", 2024-04-19T02:16:00.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3560000000000004e-06 2024-04-19T02:16:00.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.061 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:00.061 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269982+0000", 2024-04-19T02:16:00.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9600000000000006e-06 2024-04-19T02:16:00.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.061 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:00.061 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270014+0000", 2024-04-19T02:16:00.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2913000000000001e-05 2024-04-19T02:16:00.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.062 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:00.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270018+0000", 2024-04-19T02:16:00.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2200000000000001e-06 2024-04-19T02:16:00.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.062 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:00.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278999+0000", 2024-04-19T02:16:00.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0089818009999999993 2024-04-19T02:16:00.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.062 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:00.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.279088+0000", 2024-04-19T02:16:00.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8988999999999998e-05 2024-04-19T02:16:00.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:00.063 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.280160+0000", 2024-04-19T02:16:00.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001071572 2024-04-19T02:16:00.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:00.063 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288342+0000", 2024-04-19T02:16:00.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.008182468 2024-04-19T02:16:00.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:00.063 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289545+0000", 2024-04-19T02:16:00.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012026739999999999 2024-04-19T02:16:00.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.064 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:00.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289608+0000", 2024-04-19T02:16:00.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2904999999999995e-05 2024-04-19T02:16:00.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:00.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289654+0000", 2024-04-19T02:16:00.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5850000000000003e-05 2024-04-19T02:16:00.066 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:00.066 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:00.066 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:00.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.066 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:00.066 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:16:00.066 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.743411220999999, 2024-04-19T02:16:00.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022007204999999998, 2024-04-19T02:16:00.067 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:00.067 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:00.067 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:00.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.067 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:00.067 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:16:00.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:00.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.067 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:00.067 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:16:00.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:00.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:00.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269990+0000", 2024-04-19T02:16:00.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:00.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:00.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269999+0000", 2024-04-19T02:16:00.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9539999999999993e-06 2024-04-19T02:16:00.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:00.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270006+0000", 2024-04-19T02:16:00.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.216e-06 2024-04-19T02:16:00.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:00.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270012+0000", 2024-04-19T02:16:00.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5049999999999998e-06 2024-04-19T02:16:00.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:00.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270058+0000", 2024-04-19T02:16:00.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.634e-05 2024-04-19T02:16:00.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:00.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270064+0000", 2024-04-19T02:16:00.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0669999999999997e-06 2024-04-19T02:16:00.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.070 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:00.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287159+0000", 2024-04-19T02:16:00.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017095086999999998 2024-04-19T02:16:00.070 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.070 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.070 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:00.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287254+0000", 2024-04-19T02:16:00.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4716000000000006e-05 2024-04-19T02:16:00.070 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.070 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.070 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:00.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287389+0000", 2024-04-19T02:16:00.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013511900000000001 2024-04-19T02:16:00.070 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.071 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:00.071 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290481+0000", 2024-04-19T02:16:00.071 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030920169999999999 2024-04-19T02:16:00.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.071 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:00.071 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291931+0000", 2024-04-19T02:16:00.071 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001450118 2024-04-19T02:16:00.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.071 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:00.071 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291960+0000", 2024-04-19T02:16:00.071 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9096000000000001e-05 2024-04-19T02:16:00.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.072 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:00.072 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291998+0000", 2024-04-19T02:16:00.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7514e-05 2024-04-19T02:16:00.072 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:00.072 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:00.072 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:00.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.072 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:00.072 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:00.072 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.74335065, 2024-04-19T02:16:00.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020759494999999999, 2024-04-19T02:16:00.072 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:00.072 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:00.072 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:00.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:00.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:00.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:00.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:00.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:00.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:00.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:00.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:00.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:00.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:00.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270054+0000", 2024-04-19T02:16:00.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.27e-06 2024-04-19T02:16:00.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:00.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270061+0000", 2024-04-19T02:16:00.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1289999999999998e-06 2024-04-19T02:16:00.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:00.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270067+0000", 2024-04-19T02:16:00.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.207e-06 2024-04-19T02:16:00.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:00.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270105+0000", 2024-04-19T02:16:00.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7549999999999998e-05 2024-04-19T02:16:00.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:00.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270112+0000", 2024-04-19T02:16:00.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3200000000000002e-06 2024-04-19T02:16:00.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:00.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282454+0000", 2024-04-19T02:16:00.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012341569 2024-04-19T02:16:00.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:00.076 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282740+0000", 2024-04-19T02:16:00.076 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000286481 2024-04-19T02:16:00.076 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.076 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.076 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:00.076 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282879+0000", 2024-04-19T02:16:00.076 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013887799999999999 2024-04-19T02:16:00.076 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.076 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.076 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:00.076 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290325+0000", 2024-04-19T02:16:00.076 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074459779999999998 2024-04-19T02:16:00.076 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.076 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.076 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:00.076 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290759+0000", 2024-04-19T02:16:00.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000433688 2024-04-19T02:16:00.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.077 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.077 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:00.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290789+0000", 2024-04-19T02:16:00.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9960000000000001e-05 2024-04-19T02:16:00.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.077 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.077 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:00.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290811+0000", 2024-04-19T02:16:00.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1965999999999999e-05 2024-04-19T02:16:00.077 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:00.077 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:00.077 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:00.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.078 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:00.078 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270078+0000", 2024-04-19T02:16:00.078 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.743324197, 2024-04-19T02:16:00.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018194683, 2024-04-19T02:16:00.078 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:00.078 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:00.078 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:00.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:00.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270078+0000", 2024-04-19T02:16:00.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:00.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:00.079 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270078+0000", 2024-04-19T02:16:00.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:00.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.079 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:00.079 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270077+0000", 2024-04-19T02:16:00.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:00.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.079 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:00.079 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270080+0000", 2024-04-19T02:16:00.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8389999999999998e-06 2024-04-19T02:16:00.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.079 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:00.080 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270086+0000", 2024-04-19T02:16:00.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6160000000000001e-06 2024-04-19T02:16:00.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.080 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.080 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:00.080 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270091+0000", 2024-04-19T02:16:00.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1390000000000003e-06 2024-04-19T02:16:00.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.080 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.080 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:00.080 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270124+0000", 2024-04-19T02:16:00.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3359999999999999e-05 2024-04-19T02:16:00.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.080 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.080 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-04-19T02:16:00.081 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270127+0000", 2024-04-19T02:16:00.081 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.219e-06 2024-04-19T02:16:00.081 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.081 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:00.081 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.277938+0000", 2024-04-19T02:16:00.081 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0078111559999999997 2024-04-19T02:16:00.081 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.081 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:00.081 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278413+0000", 2024-04-19T02:16:00.081 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00047432600000000001 2024-04-19T02:16:00.081 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.081 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:00.082 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278540+0000", 2024-04-19T02:16:00.082 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012753299999999999 2024-04-19T02:16:00.082 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.082 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:00.082 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.283045+0000", 2024-04-19T02:16:00.082 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045051580000000004 2024-04-19T02:16:00.082 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.082 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:00.082 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288192+0000", 2024-04-19T02:16:00.082 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051468210000000002 2024-04-19T02:16:00.082 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:00.083 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288239+0000", 2024-04-19T02:16:00.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7089999999999998e-05 2024-04-19T02:16:00.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:00.083 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288272+0000", 2024-04-19T02:16:00.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2799999999999998e-05 2024-04-19T02:16:00.083 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:00.083 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:00.083 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:00.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.083 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:00.084 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:16:00.084 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.743300444999999, 2024-04-19T02:16:00.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020837887999999999, 2024-04-19T02:16:00.084 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:00.084 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:00.084 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:00.084 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.084 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:00.084 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:16:00.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:00.084 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.084 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.084 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:00.084 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:16:00.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:00.085 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.085 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.085 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:00.085 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:16:00.085 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:00.085 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.085 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.085 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:00.085 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270109+0000", 2024-04-19T02:16:00.085 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3110000000000006e-06 2024-04-19T02:16:00.085 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.085 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.085 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:00.085 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270117+0000", 2024-04-19T02:16:00.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0479999999999999e-06 2024-04-19T02:16:00.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.086 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:00.086 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270123+0000", 2024-04-19T02:16:00.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5500000000000002e-06 2024-04-19T02:16:00.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.086 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:00.086 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270150+0000", 2024-04-19T02:16:00.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7712000000000002e-05 2024-04-19T02:16:00.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.086 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:00.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270153+0000", 2024-04-19T02:16:00.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6089999999999999e-06 2024-04-19T02:16:00.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.087 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:00.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285958+0000", 2024-04-19T02:16:00.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015805274000000001 2024-04-19T02:16:00.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.087 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:00.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286126+0000", 2024-04-19T02:16:00.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016765700000000001 2024-04-19T02:16:00.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.087 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:00.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286296+0000", 2024-04-19T02:16:00.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017007 2024-04-19T02:16:00.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:00.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290426+0000", 2024-04-19T02:16:00.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041299839999999997 2024-04-19T02:16:00.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:00.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290867+0000", 2024-04-19T02:16:00.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00044083300000000001 2024-04-19T02:16:00.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:00.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290900+0000", 2024-04-19T02:16:00.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3380000000000002e-05 2024-04-19T02:16:00.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:00.089 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290939+0000", 2024-04-19T02:16:00.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8970000000000001e-05 2024-04-19T02:16:00.089 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:00.089 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:00.089 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:00.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.089 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:20 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:00.089 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270161+0000", 2024-04-19T02:16:00.089 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.743240755999999, 2024-04-19T02:16:00.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018061383, 2024-04-19T02:16:00.090 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:00.090 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:00.090 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:00.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:00.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270161+0000", 2024-04-19T02:16:00.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:00.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:00.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270161+0000", 2024-04-19T02:16:00.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:00.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:00.091 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270161+0000", 2024-04-19T02:16:00.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:00.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.091 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:00.091 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270164+0000", 2024-04-19T02:16:00.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3000000000000002e-06 2024-04-19T02:16:00.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.091 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:00.091 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270170+0000", 2024-04-19T02:16:00.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2310000000000001e-06 2024-04-19T02:16:00.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.091 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:00.092 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270180+0000", 2024-04-19T02:16:00.092 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9320000000000008e-06 2024-04-19T02:16:00.092 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.092 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.092 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:00.092 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270214+0000", 2024-04-19T02:16:00.092 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4048999999999999e-05 2024-04-19T02:16:00.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.093 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-04-19T02:16:00.093 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270220+0000", 2024-04-19T02:16:00.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7769999999999999e-06 2024-04-19T02:16:00.094 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.094 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:00.094 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.277220+0000", 2024-04-19T02:16:00.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0070006759999999999 2024-04-19T02:16:00.094 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.094 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:00.094 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.277341+0000", 2024-04-19T02:16:00.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120758 2024-04-19T02:16:00.094 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.094 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:00.094 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.277480+0000", 2024-04-19T02:16:00.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013903900000000001 2024-04-19T02:16:00.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:00.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282351+0000", 2024-04-19T02:16:00.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0048703110000000004 2024-04-19T02:16:00.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:00.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288147+0000", 2024-04-19T02:16:00.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0057962500000000002 2024-04-19T02:16:00.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:00.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288190+0000", 2024-04-19T02:16:00.096 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2998999999999999e-05 2024-04-19T02:16:00.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.096 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:00.096 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288222+0000", 2024-04-19T02:16:00.096 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2499999999999997e-05 2024-04-19T02:16:00.096 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:00.096 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:00.096 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:00.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.096 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:21 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:00.096 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:16:00.096 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.743211772999999, 2024-04-19T02:16:00.096 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020833187999999999, 2024-04-19T02:16:00.097 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:00.097 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:16:00.097 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:00.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:00.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:16:00.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:00.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:00.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:16:00.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:00.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:00.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270189+0000", 2024-04-19T02:16:00.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:00.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.098 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:00.098 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270192+0000", 2024-04-19T02:16:00.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7549999999999999e-06 2024-04-19T02:16:00.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.098 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:00.098 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270198+0000", 2024-04-19T02:16:00.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0859999999999998e-06 2024-04-19T02:16:00.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:00.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270204+0000", 2024-04-19T02:16:00.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1970000000000004e-06 2024-04-19T02:16:00.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:00.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270238+0000", 2024-04-19T02:16:00.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4282000000000001e-05 2024-04-19T02:16:00.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:00.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270240+0000", 2024-04-19T02:16:00.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3099999999999999e-06 2024-04-19T02:16:00.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:00.100 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287131+0000", 2024-04-19T02:16:00.100 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01689104 2024-04-19T02:16:00.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.100 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.100 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:00.100 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287262+0000", 2024-04-19T02:16:00.100 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130347 2024-04-19T02:16:00.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.100 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.100 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:00.100 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291023+0000", 2024-04-19T02:16:00.100 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037616350000000002 2024-04-19T02:16:00.100 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:00.100 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:00.101 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:00.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.101 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:2280 5.d 5:bbae9ebc:::benchmark_data_smithi121_44835_object2279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:16:00.101 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:55.642317+0000", 2024-04-19T02:16:00.101 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.3710842430000003, 2024-04-19T02:16:00.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017373597000000001, 2024-04-19T02:16:00.101 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:00.101 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:00.101 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:00.101 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:00.101 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:00.101 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 2280 2024-04-19T02:16:00.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.101 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:00.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:00.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.642317+0000", 2024-04-19T02:16:00.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:00.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:00.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.642317+0000", 2024-04-19T02:16:00.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:00.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:00.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.642317+0000", 2024-04-19T02:16:00.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:00.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:00.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.642392+0000", 2024-04-19T02:16:00.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4684999999999994e-05 2024-04-19T02:16:00.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:00.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.642397+0000", 2024-04-19T02:16:00.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3009999999999997e-06 2024-04-19T02:16:00.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:00.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.642401+0000", 2024-04-19T02:16:00.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5389999999999999e-06 2024-04-19T02:16:00.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:00.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.642704+0000", 2024-04-19T02:16:00.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00030363699999999999 2024-04-19T02:16:00.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:00.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.642836+0000", 2024-04-19T02:16:00.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000132259 2024-04-19T02:16:00.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:00.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.642987+0000", 2024-04-19T02:16:00.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015096 2024-04-19T02:16:00.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:00.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.649071+0000", 2024-04-19T02:16:00.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0060841189999999998 2024-04-19T02:16:00.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:00.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.659605+0000", 2024-04-19T02:16:00.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010533722000000001 2024-04-19T02:16:00.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:00.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.659652+0000", 2024-04-19T02:16:00.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7148999999999999e-05 2024-04-19T02:16:00.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.106 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:00.106 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.659691+0000", 2024-04-19T02:16:00.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8724999999999999e-05 2024-04-19T02:16:00.106 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:00.106 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:00.106 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:00.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.106 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:2285 5.d 5:b310a433:::benchmark_data_smithi121_44835_object2284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:16:00.106 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:55.643557+0000", 2024-04-19T02:16:00.106 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.3698450510000004, 2024-04-19T02:16:00.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018865537000000002, 2024-04-19T02:16:00.106 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:00.107 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:00.107 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:00.107 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:00.107 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:00.107 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 2285 2024-04-19T02:16:00.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.107 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:00.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:00.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643557+0000", 2024-04-19T02:16:00.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:00.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:00.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643557+0000", 2024-04-19T02:16:00.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:00.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:00.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643556+0000", 2024-04-19T02:16:00.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:00.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:00.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643625+0000", 2024-04-19T02:16:00.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9393000000000005e-05 2024-04-19T02:16:00.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:00.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643634+0000", 2024-04-19T02:16:00.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.14e-06 2024-04-19T02:16:00.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:00.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643640+0000", 2024-04-19T02:16:00.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.601e-06 2024-04-19T02:16:00.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:00.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643669+0000", 2024-04-19T02:16:00.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9292999999999999e-05 2024-04-19T02:16:00.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:00.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643760+0000", 2024-04-19T02:16:00.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0526999999999996e-05 2024-04-19T02:16:00.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.110 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:00.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643892+0000", 2024-04-19T02:16:00.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000131607 2024-04-19T02:16:00.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.110 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:00.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.649122+0000", 2024-04-19T02:16:00.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052308279999999999 2024-04-19T02:16:00.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.110 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:00.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.662321+0000", 2024-04-19T02:16:00.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013198774999999999 2024-04-19T02:16:00.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:00.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.662385+0000", 2024-04-19T02:16:00.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4261e-05 2024-04-19T02:16:00.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:00.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.662422+0000", 2024-04-19T02:16:00.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.676e-05 2024-04-19T02:16:00.111 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:00.111 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:00.111 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:00.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.112 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:16494 5.7 5:e2c19dca:::benchmark_data_smithi121_44835_object16493:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:00.112 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.871684+0000", 2024-04-19T02:16:00.112 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.141718118, 2024-04-19T02:16:00.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019343257999999999, 2024-04-19T02:16:00.112 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:00.112 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:00.112 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:00.112 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:00.112 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:00.112 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16494 2024-04-19T02:16:00.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.112 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:00.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:00.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871684+0000", 2024-04-19T02:16:00.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:00.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:00.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871684+0000", 2024-04-19T02:16:00.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:00.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:00.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871683+0000", 2024-04-19T02:16:00.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:00.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:00.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871762+0000", 2024-04-19T02:16:00.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8981999999999997e-05 2024-04-19T02:16:00.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.114 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:00.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871770+0000", 2024-04-19T02:16:00.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7060000000000004e-06 2024-04-19T02:16:00.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.114 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:00.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871776+0000", 2024-04-19T02:16:00.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4880000000000004e-06 2024-04-19T02:16:00.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.114 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:00.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.874098+0000", 2024-04-19T02:16:00.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0023215309999999999 2024-04-19T02:16:00.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:00.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.874245+0000", 2024-04-19T02:16:00.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014735599999999999 2024-04-19T02:16:00.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:00.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.874394+0000", 2024-04-19T02:16:00.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014848300000000001 2024-04-19T02:16:00.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:00.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.876474+0000", 2024-04-19T02:16:00.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020803060000000001 2024-04-19T02:16:00.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:00.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.890939+0000", 2024-04-19T02:16:00.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014464985 2024-04-19T02:16:00.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:00.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.890986+0000", 2024-04-19T02:16:00.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7321000000000003e-05 2024-04-19T02:16:00.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:00.117 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891027+0000", 2024-04-19T02:16:00.117 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0689999999999998e-05 2024-04-19T02:16:00.117 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:00.117 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:00.117 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:00.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.117 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:16519 5.f 5:fc30d3a1:::benchmark_data_smithi121_44835_object16518:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:00.117 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.880723+0000", 2024-04-19T02:16:00.117 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.13267899499999999, 2024-04-19T02:16:00.117 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020492519000000001, 2024-04-19T02:16:00.117 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:00.117 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:00.117 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:00.117 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:00.118 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:00.118 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16519 2024-04-19T02:16:00.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.118 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:00.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:00.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880723+0000", 2024-04-19T02:16:00.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:00.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:00.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880723+0000", 2024-04-19T02:16:00.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:00.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:00.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880722+0000", 2024-04-19T02:16:00.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:00.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:00.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880794+0000", 2024-04-19T02:16:00.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1515999999999998e-05 2024-04-19T02:16:00.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:00.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880805+0000", 2024-04-19T02:16:00.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1353e-05 2024-04-19T02:16:00.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:00.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880812+0000", 2024-04-19T02:16:00.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1230000000000002e-06 2024-04-19T02:16:00.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:00.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.890954+0000", 2024-04-19T02:16:00.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010142253 2024-04-19T02:16:00.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:00.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891079+0000", 2024-04-19T02:16:00.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000124917 2024-04-19T02:16:00.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:00.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891218+0000", 2024-04-19T02:16:00.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000138715 2024-04-19T02:16:00.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:00.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.897321+0000", 2024-04-19T02:16:00.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0061026830000000002 2024-04-19T02:16:00.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:00.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901137+0000", 2024-04-19T02:16:00.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038161699999999998 2024-04-19T02:16:00.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:00.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901181+0000", 2024-04-19T02:16:00.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4362e-05 2024-04-19T02:16:00.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:00.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901215+0000", 2024-04-19T02:16:00.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3929e-05 2024-04-19T02:16:00.122 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:00.122 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:00.122 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:00.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.122 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:16520 5.f 5:f0474691:::benchmark_data_smithi121_44835_object16519:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:00.122 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.880833+0000", 2024-04-19T02:16:00.122 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.13256898, 2024-04-19T02:16:00.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020460160000000002, 2024-04-19T02:16:00.123 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:00.123 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:00.123 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:00.123 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:00.123 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:00.123 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16520 2024-04-19T02:16:00.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.123 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:00.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.123 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:00.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880833+0000", 2024-04-19T02:16:00.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:00.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:00.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880833+0000", 2024-04-19T02:16:00.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:00.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:00.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880832+0000", 2024-04-19T02:16:00.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:00.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:00.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880909+0000", 2024-04-19T02:16:00.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7095000000000006e-05 2024-04-19T02:16:00.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.125 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:00.125 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880919+0000", 2024-04-19T02:16:00.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8919999999999995e-06 2024-04-19T02:16:00.125 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.125 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.125 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:00.125 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880927+0000", 2024-04-19T02:16:00.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8809999999999996e-06 2024-04-19T02:16:00.125 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.125 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.125 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:00.125 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891901+0000", 2024-04-19T02:16:00.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010974263999999999 2024-04-19T02:16:00.125 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.125 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.126 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:00.126 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.892021+0000", 2024-04-19T02:16:00.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120074 2024-04-19T02:16:00.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.126 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:00.126 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.892165+0000", 2024-04-19T02:16:00.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014328600000000001 2024-04-19T02:16:00.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.126 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:00.126 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.897347+0000", 2024-04-19T02:16:00.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.005182603 2024-04-19T02:16:00.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:00.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901224+0000", 2024-04-19T02:16:00.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038767620000000002 2024-04-19T02:16:00.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:00.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901264+0000", 2024-04-19T02:16:00.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9579000000000002e-05 2024-04-19T02:16:00.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:00.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901293+0000", 2024-04-19T02:16:00.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9300999999999999e-05 2024-04-19T02:16:00.127 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:00.128 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:00.128 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:00.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.128 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:16523 5.f 5:f36d1d17:::benchmark_data_smithi121_44835_object16522:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:00.128 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.883946+0000", 2024-04-19T02:16:00.128 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.12945569800000001, 2024-04-19T02:16:00.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017431283999999998, 2024-04-19T02:16:00.128 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:00.128 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:00.128 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:00.128 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:00.128 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:00.128 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16523 2024-04-19T02:16:00.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.129 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:00.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.129 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:00.129 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.883946+0000", 2024-04-19T02:16:00.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:00.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.129 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:00.129 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.883946+0000", 2024-04-19T02:16:00.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:00.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.129 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:00.129 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.883945+0000", 2024-04-19T02:16:00.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:00.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.130 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:00.130 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.883977+0000", 2024-04-19T02:16:00.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1834e-05 2024-04-19T02:16:00.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.130 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:00.130 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.883986+0000", 2024-04-19T02:16:00.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1220000000000001e-06 2024-04-19T02:16:00.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.130 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:00.130 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.883990+0000", 2024-04-19T02:16:00.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9829999999999998e-06 2024-04-19T02:16:00.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:00.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.894524+0000", 2024-04-19T02:16:00.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010533776 2024-04-19T02:16:00.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:00.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.894666+0000", 2024-04-19T02:16:00.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000142058 2024-04-19T02:16:00.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:00.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.894830+0000", 2024-04-19T02:16:00.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000163921 2024-04-19T02:16:00.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.132 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:00.132 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.897379+0000", 2024-04-19T02:16:00.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0025491340000000002 2024-04-19T02:16:00.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.132 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:00.132 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901299+0000", 2024-04-19T02:16:00.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039197809999999998 2024-04-19T02:16:00.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.132 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:00.132 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901344+0000", 2024-04-19T02:16:00.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4564999999999998e-05 2024-04-19T02:16:00.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:00.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:00.133 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:00.133 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901377+0000", 2024-04-19T02:16:00.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3679000000000001e-05 2024-04-19T02:16:00.133 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:00.133 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:00.133 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:00.133 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:00.133 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:00.133 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:16:00.134 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 5 16 16956 16940 211.734 199.125 0.00555779 0.00472031 2024-04-19T02:16:00.135 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:00.134+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:00.135 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:16:00.235 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:00.235+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:00.311 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:16:00.311 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:16:00.311 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.311 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:17861 5.b 5:dab92627:::benchmark_data_smithi121_44835_object17860:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:00.311 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:00.307520+0000", 2024-04-19T02:16:00.311 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0039258629999999999, 2024-04-19T02:16:00.311 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0039474310000000004, 2024-04-19T02:16:00.311 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:00.311 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:00.311 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:00.311 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:00.311 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:00.311 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 17861 2024-04-19T02:16:00.312 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.312 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:00.312 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.312 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:00.312 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.307520+0000", 2024-04-19T02:16:00.312 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:00.312 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.312 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.312 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:00.312 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.307520+0000", 2024-04-19T02:16:00.312 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:00.312 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.312 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.312 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:00.312 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.307519+0000", 2024-04-19T02:16:00.313 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:00.313 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.313 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.313 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:00.313 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.307738+0000", 2024-04-19T02:16:00.313 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000219304 2024-04-19T02:16:00.313 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.313 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.313 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:00.313 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.307746+0000", 2024-04-19T02:16:00.313 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2069999999999995e-06 2024-04-19T02:16:00.313 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.313 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.313 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:00.314 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.307751+0000", 2024-04-19T02:16:00.314 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.9099999999999996e-06 2024-04-19T02:16:00.314 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.314 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.314 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:00.314 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.307787+0000", 2024-04-19T02:16:00.314 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5512999999999997e-05 2024-04-19T02:16:00.314 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.314 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.314 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:00.314 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.307909+0000", 2024-04-19T02:16:00.314 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012207200000000001 2024-04-19T02:16:00.314 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.314 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.315 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:00.315 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.308041+0000", 2024-04-19T02:16:00.315 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013239600000000001 2024-04-19T02:16:00.315 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.315 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.315 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:00.315 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.310749+0000", 2024-04-19T02:16:00.315 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0027071830000000002 2024-04-19T02:16:00.315 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:00.315 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:00.315 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:00.315 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.315 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.315 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:17865 5.4 5:27de6819:::benchmark_data_smithi121_44835_object17864:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:00.315 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:00.307757+0000", 2024-04-19T02:16:00.316 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0036883770000000001, 2024-04-19T02:16:00.316 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0037633110000000001, 2024-04-19T02:16:00.316 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:00.316 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:00.316 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:00.316 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:00.316 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:00.316 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 17865 2024-04-19T02:16:00.316 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.316 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:00.316 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.316 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:00.316 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.307757+0000", 2024-04-19T02:16:00.316 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:00.316 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.316 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.317 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:00.317 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.307757+0000", 2024-04-19T02:16:00.317 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:00.317 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.317 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.317 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:00.317 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.307757+0000", 2024-04-19T02:16:00.317 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:00.317 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.317 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.317 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:00.317 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.307804+0000", 2024-04-19T02:16:00.317 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.7348000000000001e-05 2024-04-19T02:16:00.317 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.318 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.318 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:00.318 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.307809+0000", 2024-04-19T02:16:00.318 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.9790000000000001e-06 2024-04-19T02:16:00.318 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.318 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.318 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:00.318 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.307816+0000", 2024-04-19T02:16:00.318 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.7020000000000004e-06 2024-04-19T02:16:00.318 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.318 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.318 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:00.319 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.307847+0000", 2024-04-19T02:16:00.319 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0808e-05 2024-04-19T02:16:00.319 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.319 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.319 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:00.319 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.307935+0000", 2024-04-19T02:16:00.319 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.7887999999999996e-05 2024-04-19T02:16:00.319 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.319 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.319 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:00.319 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.308015+0000", 2024-04-19T02:16:00.319 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0220000000000001e-05 2024-04-19T02:16:00.319 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.319 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.319 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:00.319 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.310728+0000", 2024-04-19T02:16:00.320 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0027132670000000001 2024-04-19T02:16:00.320 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:00.320 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:00.320 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:00.320 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.320 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.320 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:17869 5.a e20/16 5:54914d9b:::benchmark_data_smithi121_44835_object17868:head v 20'1126, mlcod=20'1122)", 2024-04-19T02:16:00.320 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:00.311176+0000", 2024-04-19T02:16:00.320 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.000269676, 2024-04-19T02:16:00.320 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00038958200000000003, 2024-04-19T02:16:00.320 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:00.321 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:16:00.321 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:00.321 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.321 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:00.321 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.311176+0000", 2024-04-19T02:16:00.321 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:00.321 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.321 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.321 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:00.321 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.311176+0000", 2024-04-19T02:16:00.321 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:00.321 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.321 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.321 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:00.322 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.311175+0000", 2024-04-19T02:16:00.322 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:00.322 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.322 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.322 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:00.322 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.311260+0000", 2024-04-19T02:16:00.322 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.4500999999999996e-05 2024-04-19T02:16:00.322 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.322 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.322 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:00.322 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.311267+0000", 2024-04-19T02:16:00.322 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.2779999999999996e-06 2024-04-19T02:16:00.322 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.322 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.322 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:00.323 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.311272+0000", 2024-04-19T02:16:00.323 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4190000000000004e-06 2024-04-19T02:16:00.323 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.323 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.323 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:00.323 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.311298+0000", 2024-04-19T02:16:00.323 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.6512e-05 2024-04-19T02:16:00.323 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.323 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.323 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:00.323 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.311312+0000", 2024-04-19T02:16:00.323 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.3769e-05 2024-04-19T02:16:00.323 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:00.323 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:00.323 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:00.324 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:00.324 INFO:teuthology.orchestra.run.smithi174.stdout: ], 2024-04-19T02:16:00.324 INFO:teuthology.orchestra.run.smithi174.stdout: "num_ops": 3 2024-04-19T02:16:00.324 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:16:00.325 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:16:00.369 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:00.370+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:00.437 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:00.437+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:00.489 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:16:00.489 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [], 2024-04-19T02:16:00.489 INFO:teuthology.orchestra.run.smithi174.stdout: "complaint_time": 30, 2024-04-19T02:16:00.489 INFO:teuthology.orchestra.run.smithi174.stdout: "num_blocked_ops": 0 2024-04-19T02:16:00.489 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:16:00.502 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:16:00.538 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:00.539+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:00.639 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:00.640+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:00.713 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:16:00.713 INFO:teuthology.orchestra.run.smithi174.stdout: "size": 20, 2024-04-19T02:16:00.713 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 600, 2024-04-19T02:16:00.713 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:16:00.713 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.713 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:10 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:00.713 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269877+0000", 2024-04-19T02:16:00.713 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 31.441112129, 2024-04-19T02:16:00.713 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020732751000000001, 2024-04-19T02:16:00.713 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:00.713 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:00.714 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:00.714 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.714 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:00.714 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269877+0000", 2024-04-19T02:16:00.714 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:00.714 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.714 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.714 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:00.714 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269877+0000", 2024-04-19T02:16:00.714 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:00.714 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.714 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.714 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:00.714 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269875+0000", 2024-04-19T02:16:00.715 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:00.715 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.715 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.715 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:00.715 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269891+0000", 2024-04-19T02:16:00.715 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.5494000000000001e-05 2024-04-19T02:16:00.715 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.715 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.715 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:00.715 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269903+0000", 2024-04-19T02:16:00.715 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2003e-05 2024-04-19T02:16:00.715 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.715 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.715 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:00.715 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269914+0000", 2024-04-19T02:16:00.716 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0947e-05 2024-04-19T02:16:00.716 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.716 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.716 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:00.716 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269971+0000", 2024-04-19T02:16:00.716 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7036000000000001e-05 2024-04-19T02:16:00.716 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.716 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.716 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:16:00.716 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269979+0000", 2024-04-19T02:16:00.716 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.6660000000000008e-06 2024-04-19T02:16:00.716 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.716 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.716 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:00.717 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284891+0000", 2024-04-19T02:16:00.717 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014912584 2024-04-19T02:16:00.717 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.717 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.717 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:00.717 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285213+0000", 2024-04-19T02:16:00.717 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00032172199999999998 2024-04-19T02:16:00.717 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.717 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.717 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:00.717 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285357+0000", 2024-04-19T02:16:00.717 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014367899999999999 2024-04-19T02:16:00.717 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.717 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.717 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:00.718 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288883+0000", 2024-04-19T02:16:00.718 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0035268719999999999 2024-04-19T02:16:00.718 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.718 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.718 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:00.718 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290537+0000", 2024-04-19T02:16:00.718 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016537399999999999 2024-04-19T02:16:00.718 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.718 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.718 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:00.718 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290576+0000", 2024-04-19T02:16:00.718 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9266e-05 2024-04-19T02:16:00.718 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.718 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.719 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:00.719 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290609+0000", 2024-04-19T02:16:00.719 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2818000000000003e-05 2024-04-19T02:16:00.719 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:00.719 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:00.719 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:00.719 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.719 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.719 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:11 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:00.719 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:00.719 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 31.441059207999999, 2024-04-19T02:16:00.719 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020352748, 2024-04-19T02:16:00.719 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:00.719 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:00.720 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:00.720 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.720 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:00.720 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:00.720 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:00.720 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.720 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.720 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:00.720 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:00.720 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:00.720 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.720 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.720 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:00.720 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:00.720 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:00.721 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.721 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.721 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:00.721 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269933+0000", 2024-04-19T02:16:00.721 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2169999999999996e-06 2024-04-19T02:16:00.721 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.721 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.721 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:00.721 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269940+0000", 2024-04-19T02:16:00.721 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1500000000000002e-06 2024-04-19T02:16:00.721 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.721 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.721 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:00.721 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269948+0000", 2024-04-19T02:16:00.721 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.8690000000000004e-06 2024-04-19T02:16:00.722 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.722 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.722 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:00.722 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:16:00.722 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2994999999999997e-05 2024-04-19T02:16:00.722 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.722 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.722 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:16:00.722 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269997+0000", 2024-04-19T02:16:00.722 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.9020000000000004e-06 2024-04-19T02:16:00.722 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.722 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.722 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:00.722 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.282729+0000", 2024-04-19T02:16:00.723 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.012732537 2024-04-19T02:16:00.723 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.723 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.723 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:00.723 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.282838+0000", 2024-04-19T02:16:00.723 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000108298 2024-04-19T02:16:00.723 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.723 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.723 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:00.723 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.283002+0000", 2024-04-19T02:16:00.723 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00016466300000000001 2024-04-19T02:16:00.723 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.723 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.723 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:00.724 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288708+0000", 2024-04-19T02:16:00.724 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.005705066 2024-04-19T02:16:00.724 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.724 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.724 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:00.724 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290215+0000", 2024-04-19T02:16:00.724 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0015075010000000001 2024-04-19T02:16:00.724 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.724 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.724 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:00.724 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290259+0000", 2024-04-19T02:16:00.724 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3711999999999998e-05 2024-04-19T02:16:00.724 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.724 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.724 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:00.725 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290282+0000", 2024-04-19T02:16:00.725 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3458000000000001e-05 2024-04-19T02:16:00.725 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:00.725 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:00.725 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:00.725 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.725 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.725 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:14 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:00.725 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:00.725 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 31.441025417999999, 2024-04-19T02:16:00.725 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020137202, 2024-04-19T02:16:00.725 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:00.725 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:00.725 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:00.725 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.726 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:00.726 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:00.726 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:00.726 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.726 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.726 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:00.726 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:00.726 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:00.726 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.726 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.726 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:00.726 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:00.726 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:00.726 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.727 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.727 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:00.727 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269971+0000", 2024-04-19T02:16:00.727 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.5459999999999992e-06 2024-04-19T02:16:00.727 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.727 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.727 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:00.727 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269979+0000", 2024-04-19T02:16:00.727 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9130000000000003e-06 2024-04-19T02:16:00.727 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.727 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.727 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:00.727 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269986+0000", 2024-04-19T02:16:00.727 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.3779999999999998e-06 2024-04-19T02:16:00.728 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.728 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.728 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:00.728 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270030+0000", 2024-04-19T02:16:00.728 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3982e-05 2024-04-19T02:16:00.728 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.728 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.728 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:16:00.728 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270034+0000", 2024-04-19T02:16:00.728 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1779999999999996e-06 2024-04-19T02:16:00.728 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.728 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.728 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:00.728 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.277870+0000", 2024-04-19T02:16:00.728 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0078362150000000005 2024-04-19T02:16:00.729 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.729 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.729 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:00.729 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.278216+0000", 2024-04-19T02:16:00.729 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00034634999999999999 2024-04-19T02:16:00.729 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.729 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.729 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:00.729 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.278732+0000", 2024-04-19T02:16:00.729 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00051536099999999999 2024-04-19T02:16:00.729 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.729 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.729 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:00.729 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.287694+0000", 2024-04-19T02:16:00.729 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0089621019999999996 2024-04-19T02:16:00.730 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.730 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.730 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:00.730 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290026+0000", 2024-04-19T02:16:00.730 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0023323139999999998 2024-04-19T02:16:00.730 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.730 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.730 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:00.730 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290067+0000", 2024-04-19T02:16:00.730 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1043e-05 2024-04-19T02:16:00.730 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.730 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.730 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:00.730 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290100+0000", 2024-04-19T02:16:00.731 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3278999999999998e-05 2024-04-19T02:16:00.731 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:00.731 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:00.731 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:00.731 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.731 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.731 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:00.731 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:00.731 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 31.440993626000001, 2024-04-19T02:16:00.731 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020731702000000001, 2024-04-19T02:16:00.731 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:00.731 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:00.731 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:00.731 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.732 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:00.732 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:00.732 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:00.732 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.732 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.732 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:00.732 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:00.732 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:00.732 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.732 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.732 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:00.732 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:00.732 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:00.732 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.732 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.732 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:00.733 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269998+0000", 2024-04-19T02:16:00.733 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7100000000000001e-06 2024-04-19T02:16:00.733 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.733 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.733 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:00.733 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270005+0000", 2024-04-19T02:16:00.733 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.241e-06 2024-04-19T02:16:00.733 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.733 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.733 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:00.733 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270011+0000", 2024-04-19T02:16:00.733 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6279999999999999e-06 2024-04-19T02:16:00.733 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.733 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.734 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:00.734 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270046+0000", 2024-04-19T02:16:00.734 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5173999999999999e-05 2024-04-19T02:16:00.734 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.734 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.734 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:00.734 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:00.734 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0019999999999997e-06 2024-04-19T02:16:00.734 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.734 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.734 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:00.734 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285619+0000", 2024-04-19T02:16:00.734 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015567391 2024-04-19T02:16:00.734 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.734 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.735 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:00.735 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285671+0000", 2024-04-19T02:16:00.735 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2460999999999998e-05 2024-04-19T02:16:00.735 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.735 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.735 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:00.735 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285775+0000", 2024-04-19T02:16:00.735 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000103389 2024-04-19T02:16:00.735 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.735 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.735 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:00.735 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288934+0000", 2024-04-19T02:16:00.735 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0031595859999999998 2024-04-19T02:16:00.735 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.735 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.736 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:00.736 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290650+0000", 2024-04-19T02:16:00.736 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001716242 2024-04-19T02:16:00.736 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.736 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.736 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:00.736 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290692+0000", 2024-04-19T02:16:00.736 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1910999999999999e-05 2024-04-19T02:16:00.736 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.736 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.736 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:00.736 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290727+0000", 2024-04-19T02:16:00.736 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4412000000000002e-05 2024-04-19T02:16:00.736 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:00.737 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:00.737 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:00.737 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.737 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.737 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:00.737 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270019+0000", 2024-04-19T02:16:00.737 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 31.440970030999999, 2024-04-19T02:16:00.737 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020572014999999999, 2024-04-19T02:16:00.737 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:00.737 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:00.737 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:00.737 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.737 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:00.737 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270019+0000", 2024-04-19T02:16:00.738 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:00.738 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.738 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.738 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:00.738 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270019+0000", 2024-04-19T02:16:00.738 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:00.738 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.738 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.738 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:00.738 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270018+0000", 2024-04-19T02:16:00.738 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:00.738 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.738 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.738 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:00.739 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270021+0000", 2024-04-19T02:16:00.739 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0319999999999999e-06 2024-04-19T02:16:00.739 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.739 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.739 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:00.739 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270028+0000", 2024-04-19T02:16:00.739 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6189999999999996e-06 2024-04-19T02:16:00.739 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.739 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.739 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:00.739 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270035+0000", 2024-04-19T02:16:00.739 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1690000000000003e-06 2024-04-19T02:16:00.739 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.739 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.740 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:00.740 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270078+0000", 2024-04-19T02:16:00.740 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3061e-05 2024-04-19T02:16:00.740 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.740 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.740 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:00.740 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270082+0000", 2024-04-19T02:16:00.740 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4510000000000002e-06 2024-04-19T02:16:00.740 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.740 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.740 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:00.740 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284354+0000", 2024-04-19T02:16:00.740 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014271588999999999 2024-04-19T02:16:00.740 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.741 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.741 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:00.741 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284497+0000", 2024-04-19T02:16:00.741 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014335800000000001 2024-04-19T02:16:00.741 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.741 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.741 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:00.741 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284626+0000", 2024-04-19T02:16:00.741 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000128744 2024-04-19T02:16:00.742 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.742 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.742 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:00.742 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288844+0000", 2024-04-19T02:16:00.742 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00421807 2024-04-19T02:16:00.742 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.742 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.742 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:00.742 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290508+0000", 2024-04-19T02:16:00.742 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001663774 2024-04-19T02:16:00.742 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.742 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.742 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:00.742 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290556+0000", 2024-04-19T02:16:00.743 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.7599999999999998e-05 2024-04-19T02:16:00.743 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.743 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.743 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:00.743 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290591+0000", 2024-04-19T02:16:00.743 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5034999999999999e-05 2024-04-19T02:16:00.743 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:00.743 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:00.743 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:00.743 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.743 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.743 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:00.743 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:00.743 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 31.440947168000001, 2024-04-19T02:16:00.744 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020192280999999999, 2024-04-19T02:16:00.744 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:00.744 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:00.744 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:00.744 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.744 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:00.744 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:00.744 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:00.744 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.744 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.744 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:00.744 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:00.744 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:00.744 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.744 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.745 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:00.745 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:00.745 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:00.745 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.745 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.745 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:00.745 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270045+0000", 2024-04-19T02:16:00.745 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8680000000000001e-06 2024-04-19T02:16:00.745 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.745 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.745 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:00.745 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270052+0000", 2024-04-19T02:16:00.745 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.9999999999999999e-06 2024-04-19T02:16:00.745 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.745 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.746 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:00.746 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270056+0000", 2024-04-19T02:16:00.746 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4479999999999996e-06 2024-04-19T02:16:00.746 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.746 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.746 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:00.746 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270089+0000", 2024-04-19T02:16:00.746 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3071000000000002e-05 2024-04-19T02:16:00.746 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.746 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.746 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:00.746 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270092+0000", 2024-04-19T02:16:00.746 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9780000000000001e-06 2024-04-19T02:16:00.747 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.747 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.747 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:00.747 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.280632+0000", 2024-04-19T02:16:00.747 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010539712 2024-04-19T02:16:00.747 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.747 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.747 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:00.747 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.280743+0000", 2024-04-19T02:16:00.747 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000111048 2024-04-19T02:16:00.747 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.747 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.747 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:00.747 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.281531+0000", 2024-04-19T02:16:00.747 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00078738199999999999 2024-04-19T02:16:00.748 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.748 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.748 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:00.748 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.287949+0000", 2024-04-19T02:16:00.748 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0064185730000000003 2024-04-19T02:16:00.748 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.748 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.748 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:00.748 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290184+0000", 2024-04-19T02:16:00.748 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0022350849999999999 2024-04-19T02:16:00.748 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.748 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.748 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:00.748 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290209+0000", 2024-04-19T02:16:00.748 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4907000000000001e-05 2024-04-19T02:16:00.749 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.749 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.749 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:00.749 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290234+0000", 2024-04-19T02:16:00.749 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4666999999999999e-05 2024-04-19T02:16:00.749 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:00.749 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:00.749 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:00.749 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.749 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.749 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:19 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:00.749 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:00.749 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 31.440925702000001, 2024-04-19T02:16:00.749 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020818203, 2024-04-19T02:16:00.750 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:00.750 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:00.750 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:00.750 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.750 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:00.750 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:00.750 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:00.750 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.750 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.750 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:00.750 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:00.750 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:00.750 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.750 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.751 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:00.751 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:00.751 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:00.751 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.751 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.751 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:00.751 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270065+0000", 2024-04-19T02:16:00.751 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4310000000000001e-06 2024-04-19T02:16:00.751 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.751 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.751 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:00.751 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270070+0000", 2024-04-19T02:16:00.751 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2859999999999999e-06 2024-04-19T02:16:00.751 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.751 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.752 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:00.752 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270077+0000", 2024-04-19T02:16:00.752 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5270000000000004e-06 2024-04-19T02:16:00.752 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.752 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.752 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:00.752 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270107+0000", 2024-04-19T02:16:00.752 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0205999999999998e-05 2024-04-19T02:16:00.752 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.752 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.752 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:00.752 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270111+0000", 2024-04-19T02:16:00.752 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8650000000000003e-06 2024-04-19T02:16:00.752 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.752 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.753 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:00.753 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285936+0000", 2024-04-19T02:16:00.753 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015824677999999998 2024-04-19T02:16:00.753 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.753 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.753 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:00.753 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286007+0000", 2024-04-19T02:16:00.753 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1157999999999999e-05 2024-04-19T02:16:00.753 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.753 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.753 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:00.753 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286086+0000", 2024-04-19T02:16:00.753 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9084000000000004e-05 2024-04-19T02:16:00.753 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.754 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.754 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:00.754 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290740+0000", 2024-04-19T02:16:00.754 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0046543679999999999 2024-04-19T02:16:00.754 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.754 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.754 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:00.754 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290833+0000", 2024-04-19T02:16:00.754 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2551000000000002e-05 2024-04-19T02:16:00.754 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.754 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.754 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:00.754 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290859+0000", 2024-04-19T02:16:00.754 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.6696999999999999e-05 2024-04-19T02:16:00.755 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.755 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.755 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:00.755 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290881+0000", 2024-04-19T02:16:00.755 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1653000000000001e-05 2024-04-19T02:16:00.755 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:00.755 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:00.755 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:00.755 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.755 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.755 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:22 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:00.755 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270081+0000", 2024-04-19T02:16:00.755 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 31.440907427999999, 2024-04-19T02:16:00.755 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014566841000000001, 2024-04-19T02:16:00.756 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:00.756 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:16:00.756 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:00.756 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.756 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:00.756 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270081+0000", 2024-04-19T02:16:00.756 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:00.756 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.756 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.756 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:00.756 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270081+0000", 2024-04-19T02:16:00.756 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:00.756 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.756 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.756 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:00.757 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270081+0000", 2024-04-19T02:16:00.757 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:00.757 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.757 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.757 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:00.757 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270083+0000", 2024-04-19T02:16:00.757 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.21e-06 2024-04-19T02:16:00.757 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.757 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.757 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:00.757 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270100+0000", 2024-04-19T02:16:00.757 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.7045e-05 2024-04-19T02:16:00.757 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.757 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.757 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:00.758 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270106+0000", 2024-04-19T02:16:00.758 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.6710000000000004e-06 2024-04-19T02:16:00.758 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.758 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.758 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:00.758 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270134+0000", 2024-04-19T02:16:00.758 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.8192999999999999e-05 2024-04-19T02:16:00.758 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.758 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.758 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:16:00.758 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270137+0000", 2024-04-19T02:16:00.758 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.117e-06 2024-04-19T02:16:00.758 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.758 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.759 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:00.759 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.275452+0000", 2024-04-19T02:16:00.759 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0053144389999999998 2024-04-19T02:16:00.759 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.759 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.759 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:00.759 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.275576+0000", 2024-04-19T02:16:00.759 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012455800000000001 2024-04-19T02:16:00.759 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.759 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.759 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:00.759 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284648+0000", 2024-04-19T02:16:00.759 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0090719689999999992 2024-04-19T02:16:00.759 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:00.759 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:00.760 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:00.760 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.760 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.760 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:110 5.b 5:d74a8f5e:::benchmark_data_smithi121_44835_object109:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:16:00.760 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:55.057013+0000", 2024-04-19T02:16:00.760 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 5.6539755439999997, 2024-04-19T02:16:00.760 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.011467052, 2024-04-19T02:16:00.760 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:00.760 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:00.760 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:00.760 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:00.760 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:00.760 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 110 2024-04-19T02:16:00.761 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.761 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:00.761 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.761 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:00.761 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057013+0000", 2024-04-19T02:16:00.761 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:00.761 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.761 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.761 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:00.761 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057013+0000", 2024-04-19T02:16:00.761 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:00.761 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.761 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.761 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:00.761 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057012+0000", 2024-04-19T02:16:00.762 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:00.762 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.762 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.762 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:00.762 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057115+0000", 2024-04-19T02:16:00.762 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010210299999999999 2024-04-19T02:16:00.762 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.762 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.762 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:00.762 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057123+0000", 2024-04-19T02:16:00.762 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2470000000000008e-06 2024-04-19T02:16:00.762 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.762 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.762 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:00.763 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057129+0000", 2024-04-19T02:16:00.763 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6000000000000003e-06 2024-04-19T02:16:00.763 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.763 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.763 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:00.763 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057296+0000", 2024-04-19T02:16:00.763 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000166398 2024-04-19T02:16:00.763 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.763 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.763 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:00.763 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057419+0000", 2024-04-19T02:16:00.763 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012348799999999999 2024-04-19T02:16:00.763 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.763 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.764 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:00.764 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057533+0000", 2024-04-19T02:16:00.764 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000113736 2024-04-19T02:16:00.764 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.764 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.764 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:00.764 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.059021+0000", 2024-04-19T02:16:00.764 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001488135 2024-04-19T02:16:00.764 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.764 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.764 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:00.764 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.068402+0000", 2024-04-19T02:16:00.764 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0093810000000000004 2024-04-19T02:16:00.764 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.764 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.764 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:00.765 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.068447+0000", 2024-04-19T02:16:00.765 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4876000000000002e-05 2024-04-19T02:16:00.765 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.765 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.765 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:00.765 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.068480+0000", 2024-04-19T02:16:00.765 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3154000000000001e-05 2024-04-19T02:16:00.765 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:00.765 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:00.765 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:00.765 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.765 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.765 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:111 5.b 5:d905127a:::benchmark_data_smithi121_44835_object110:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:16:00.765 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:55.057138+0000", 2024-04-19T02:16:00.765 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 5.6538504400000003, 2024-04-19T02:16:00.766 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.011436411, 2024-04-19T02:16:00.766 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:00.766 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:00.766 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:00.766 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:00.766 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:00.766 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 111 2024-04-19T02:16:00.766 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.766 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:00.766 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.766 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:00.766 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057138+0000", 2024-04-19T02:16:00.766 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:00.767 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.767 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.767 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:00.767 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057138+0000", 2024-04-19T02:16:00.767 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:00.767 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.767 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.767 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:00.767 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057138+0000", 2024-04-19T02:16:00.767 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:00.767 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.767 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.767 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:00.767 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057200+0000", 2024-04-19T02:16:00.767 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.2469000000000001e-05 2024-04-19T02:16:00.768 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.768 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.768 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:00.768 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057211+0000", 2024-04-19T02:16:00.768 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.066e-05 2024-04-19T02:16:00.768 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.768 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.768 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:00.768 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057217+0000", 2024-04-19T02:16:00.768 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5729999999999996e-06 2024-04-19T02:16:00.768 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.768 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.768 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:00.768 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057792+0000", 2024-04-19T02:16:00.768 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000574959 2024-04-19T02:16:00.768 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.769 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.769 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:00.769 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057867+0000", 2024-04-19T02:16:00.769 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.4493999999999995e-05 2024-04-19T02:16:00.769 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.769 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.769 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:00.769 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057948+0000", 2024-04-19T02:16:00.769 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.1458999999999994e-05 2024-04-19T02:16:00.769 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.769 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.769 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:00.769 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.059050+0000", 2024-04-19T02:16:00.769 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001102029 2024-04-19T02:16:00.770 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.770 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.770 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:00.770 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.068529+0000", 2024-04-19T02:16:00.770 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0094792499999999998 2024-04-19T02:16:00.770 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.770 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.770 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:00.770 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.068557+0000", 2024-04-19T02:16:00.770 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7118999999999999e-05 2024-04-19T02:16:00.770 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.770 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.770 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:00.770 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.068575+0000", 2024-04-19T02:16:00.770 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.8065000000000001e-05 2024-04-19T02:16:00.771 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:00.771 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:00.771 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:00.771 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.771 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.771 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:116 5.4 5:28d9d93e:::benchmark_data_smithi121_44835_object115:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:16:00.771 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:55.057602+0000", 2024-04-19T02:16:00.771 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 5.6533865720000005, 2024-04-19T02:16:00.771 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010969147, 2024-04-19T02:16:00.771 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:00.771 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:00.771 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:00.771 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:00.771 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:00.771 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 116 2024-04-19T02:16:00.772 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.772 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:00.772 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.772 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:00.772 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057602+0000", 2024-04-19T02:16:00.772 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:00.772 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.772 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.772 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:00.772 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057602+0000", 2024-04-19T02:16:00.772 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:00.772 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.772 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.772 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:00.772 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057601+0000", 2024-04-19T02:16:00.773 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:00.773 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.773 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.773 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:00.773 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057757+0000", 2024-04-19T02:16:00.773 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00015546200000000001 2024-04-19T02:16:00.773 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.773 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.773 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:00.773 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057772+0000", 2024-04-19T02:16:00.773 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.5094e-05 2024-04-19T02:16:00.773 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.773 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.773 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:00.774 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057779+0000", 2024-04-19T02:16:00.774 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.046e-06 2024-04-19T02:16:00.774 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.774 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.774 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:00.774 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057818+0000", 2024-04-19T02:16:00.774 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8915000000000003e-05 2024-04-19T02:16:00.774 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.774 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.774 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:00.774 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057929+0000", 2024-04-19T02:16:00.774 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011114499999999999 2024-04-19T02:16:00.774 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.774 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.775 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:00.775 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.058064+0000", 2024-04-19T02:16:00.775 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013497699999999999 2024-04-19T02:16:00.775 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.775 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.775 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:00.775 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.059068+0000", 2024-04-19T02:16:00.775 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0010040400000000001 2024-04-19T02:16:00.775 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.775 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.775 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:00.775 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.068496+0000", 2024-04-19T02:16:00.775 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0094283790000000006 2024-04-19T02:16:00.775 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.775 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.776 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:00.776 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.068538+0000", 2024-04-19T02:16:00.776 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1909000000000001e-05 2024-04-19T02:16:00.776 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.776 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.776 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:00.776 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.068571+0000", 2024-04-19T02:16:00.776 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3009999999999997e-05 2024-04-19T02:16:00.776 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:00.776 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:00.776 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:00.776 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.776 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.776 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:634 5.8 5:1b48906c:::benchmark_data_smithi121_44835_object633:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:16:00.776 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:55.209349+0000", 2024-04-19T02:16:00.777 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 5.5016400289999998, 2024-04-19T02:16:00.777 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.012294819, 2024-04-19T02:16:00.777 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:00.777 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:00.777 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:00.777 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:00.777 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:00.777 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 634 2024-04-19T02:16:00.777 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.777 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:00.777 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.777 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:00.777 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.209349+0000", 2024-04-19T02:16:00.777 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:00.777 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.777 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.778 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:00.778 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.209349+0000", 2024-04-19T02:16:00.778 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:00.778 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.778 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.778 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:00.778 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.209348+0000", 2024-04-19T02:16:00.778 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:00.778 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.778 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.778 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:00.778 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.209462+0000", 2024-04-19T02:16:00.778 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000113962 2024-04-19T02:16:00.779 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.779 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.779 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:00.779 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.209470+0000", 2024-04-19T02:16:00.779 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0209999999999999e-06 2024-04-19T02:16:00.779 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.779 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.779 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:00.779 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.209475+0000", 2024-04-19T02:16:00.779 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0710000000000002e-06 2024-04-19T02:16:00.779 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.779 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.779 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:00.779 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.209502+0000", 2024-04-19T02:16:00.779 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7234e-05 2024-04-19T02:16:00.780 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.780 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.780 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:00.780 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.209576+0000", 2024-04-19T02:16:00.780 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.4064000000000001e-05 2024-04-19T02:16:00.780 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.780 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.780 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:00.780 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.209655+0000", 2024-04-19T02:16:00.780 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.8484000000000003e-05 2024-04-19T02:16:00.780 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.780 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.780 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:00.780 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.210802+0000", 2024-04-19T02:16:00.781 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0011468940000000001 2024-04-19T02:16:00.781 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.781 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.781 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:00.781 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.221582+0000", 2024-04-19T02:16:00.781 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010780339999999999 2024-04-19T02:16:00.781 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.781 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.781 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:00.781 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.221612+0000", 2024-04-19T02:16:00.781 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9842e-05 2024-04-19T02:16:00.781 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.781 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.781 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:00.781 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.221643+0000", 2024-04-19T02:16:00.782 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1606999999999997e-05 2024-04-19T02:16:00.782 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:00.782 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:00.782 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:00.782 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.782 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.782 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:6718 5.8 5:19750adf:::benchmark_data_smithi121_44835_object6717:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-19T02:16:00.782 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:56.852211+0000", 2024-04-19T02:16:00.782 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 3.8587775369999999, 2024-04-19T02:16:00.782 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.011254470000000001, 2024-04-19T02:16:00.782 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:00.782 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:00.782 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:00.782 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:00.783 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:00.783 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 6718 2024-04-19T02:16:00.783 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.783 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:00.783 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.783 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:00.783 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.852211+0000", 2024-04-19T02:16:00.783 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:00.783 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.783 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.783 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:00.783 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.852211+0000", 2024-04-19T02:16:00.783 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:00.783 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.784 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.784 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:00.784 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.852211+0000", 2024-04-19T02:16:00.784 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:00.784 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.784 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.784 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:00.784 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.852264+0000", 2024-04-19T02:16:00.784 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2861000000000001e-05 2024-04-19T02:16:00.784 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.784 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.784 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:00.784 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.852268+0000", 2024-04-19T02:16:00.784 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3780000000000003e-06 2024-04-19T02:16:00.784 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.784 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.785 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:00.785 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.852271+0000", 2024-04-19T02:16:00.785 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0450000000000001e-06 2024-04-19T02:16:00.785 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.785 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.785 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:00.785 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.854707+0000", 2024-04-19T02:16:00.785 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.002435886 2024-04-19T02:16:00.785 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.785 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.785 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:00.785 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.854826+0000", 2024-04-19T02:16:00.785 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000118783 2024-04-19T02:16:00.785 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.785 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.785 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:00.786 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.854927+0000", 2024-04-19T02:16:00.786 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000101745 2024-04-19T02:16:00.786 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.786 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.786 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:00.786 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.856539+0000", 2024-04-19T02:16:00.786 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016111599999999999 2024-04-19T02:16:00.786 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.786 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.786 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:00.786 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.863375+0000", 2024-04-19T02:16:00.786 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0068364109999999997 2024-04-19T02:16:00.786 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.787 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.787 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:00.787 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.863421+0000", 2024-04-19T02:16:00.787 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.5577000000000001e-05 2024-04-19T02:16:00.787 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.787 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.787 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:00.787 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.863466+0000", 2024-04-19T02:16:00.787 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4938999999999998e-05 2024-04-19T02:16:00.787 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:00.787 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:00.787 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:00.787 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.787 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.787 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:6719 5.e 5:7f950491:::benchmark_data_smithi121_44835_object6718:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-19T02:16:00.787 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:56.852274+0000", 2024-04-19T02:16:00.788 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 3.8587145519999999, 2024-04-19T02:16:00.788 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.011178176999999999, 2024-04-19T02:16:00.788 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:00.788 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:00.788 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:00.788 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:00.788 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:00.788 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 6719 2024-04-19T02:16:00.788 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.788 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:00.788 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.788 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:00.788 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.852274+0000", 2024-04-19T02:16:00.788 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:00.788 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.789 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.789 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:00.789 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.852274+0000", 2024-04-19T02:16:00.789 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:00.789 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.789 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.789 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:00.789 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.852274+0000", 2024-04-19T02:16:00.789 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:00.789 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.789 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.789 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:00.789 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.852381+0000", 2024-04-19T02:16:00.789 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010733199999999999 2024-04-19T02:16:00.789 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.789 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.789 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:00.790 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.852385+0000", 2024-04-19T02:16:00.790 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4479999999999996e-06 2024-04-19T02:16:00.790 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.790 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.790 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:00.790 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.852388+0000", 2024-04-19T02:16:00.790 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9830000000000001e-06 2024-04-19T02:16:00.790 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.790 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.790 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:00.790 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.854168+0000", 2024-04-19T02:16:00.790 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001779426 2024-04-19T02:16:00.790 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.791 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.791 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:00.791 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.854288+0000", 2024-04-19T02:16:00.791 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000119821 2024-04-19T02:16:00.791 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.791 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.791 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:00.791 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.854386+0000", 2024-04-19T02:16:00.791 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.8065000000000004e-05 2024-04-19T02:16:00.791 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.791 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.791 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:00.791 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.855713+0000", 2024-04-19T02:16:00.791 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0013276830000000001 2024-04-19T02:16:00.792 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.792 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.792 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:00.792 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.863359+0000", 2024-04-19T02:16:00.792 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0076451610000000001 2024-04-19T02:16:00.792 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.792 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.792 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:00.792 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.863407+0000", 2024-04-19T02:16:00.792 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8356000000000003e-05 2024-04-19T02:16:00.792 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.792 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.792 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:00.792 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.863452+0000", 2024-04-19T02:16:00.792 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.5272000000000003e-05 2024-04-19T02:16:00.793 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:00.793 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:00.793 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:00.793 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.793 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.793 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:6963 5.9 e19/16 5:9a0b8daa:::benchmark_data_smithi121_44835_object6962:head v 19'436, mlcod=19'430)", 2024-04-19T02:16:00.793 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:56.928121+0000", 2024-04-19T02:16:00.793 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 3.7828679100000002, 2024-04-19T02:16:00.793 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010301655999999999, 2024-04-19T02:16:00.793 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:00.793 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:00.793 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:00.793 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.793 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:00.794 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.928121+0000", 2024-04-19T02:16:00.794 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:00.794 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.794 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.794 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:00.794 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.928121+0000", 2024-04-19T02:16:00.794 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:00.794 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.794 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.794 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:00.794 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.928120+0000", 2024-04-19T02:16:00.794 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:00.794 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.794 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.795 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:00.795 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.928177+0000", 2024-04-19T02:16:00.795 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7156e-05 2024-04-19T02:16:00.795 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.795 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.795 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:00.795 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.928184+0000", 2024-04-19T02:16:00.795 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.7120000000000003e-06 2024-04-19T02:16:00.795 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.795 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.795 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:00.795 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.928188+0000", 2024-04-19T02:16:00.795 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0369999999999996e-06 2024-04-19T02:16:00.795 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.795 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.795 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:00.796 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.928214+0000", 2024-04-19T02:16:00.796 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.5354000000000002e-05 2024-04-19T02:16:00.796 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.796 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.796 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:00.796 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.928229+0000", 2024-04-19T02:16:00.796 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.5386000000000001e-05 2024-04-19T02:16:00.796 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.796 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.796 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:00.796 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.938381+0000", 2024-04-19T02:16:00.796 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010151817 2024-04-19T02:16:00.796 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.796 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.796 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:00.797 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.938422+0000", 2024-04-19T02:16:00.797 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1671999999999997e-05 2024-04-19T02:16:00.797 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:00.797 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:00.797 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:00.797 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.797 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.797 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:15659 5.4 5:23d1bdb9:::benchmark_data_smithi121_44835_object15658:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:00.797 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:59.598829+0000", 2024-04-19T02:16:00.797 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 1.1121594379999999, 2024-04-19T02:16:00.797 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010468315000000001, 2024-04-19T02:16:00.797 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:00.797 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:00.797 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:00.797 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:00.798 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:00.798 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 15659 2024-04-19T02:16:00.798 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.798 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:00.798 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.798 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:00.798 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:59.598829+0000", 2024-04-19T02:16:00.798 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:00.798 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.798 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.798 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:00.798 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:59.598829+0000", 2024-04-19T02:16:00.798 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:00.798 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.798 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.799 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:00.799 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:59.598828+0000", 2024-04-19T02:16:00.799 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:00.799 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.799 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.799 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:00.799 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:59.598872+0000", 2024-04-19T02:16:00.799 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3844000000000002e-05 2024-04-19T02:16:00.799 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.799 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.799 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:00.799 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:59.598884+0000", 2024-04-19T02:16:00.799 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1725999999999999e-05 2024-04-19T02:16:00.799 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.799 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.799 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:00.800 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:59.598891+0000", 2024-04-19T02:16:00.800 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1180000000000003e-06 2024-04-19T02:16:00.800 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.800 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.800 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:00.800 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:59.598929+0000", 2024-04-19T02:16:00.800 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7815999999999998e-05 2024-04-19T02:16:00.800 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.800 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.800 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:00.800 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:59.599041+0000", 2024-04-19T02:16:00.800 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000112413 2024-04-19T02:16:00.800 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.800 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.800 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:00.800 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:59.599191+0000", 2024-04-19T02:16:00.801 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014968699999999999 2024-04-19T02:16:00.801 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.801 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.801 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:00.801 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:59.605069+0000", 2024-04-19T02:16:00.801 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0058780600000000001 2024-04-19T02:16:00.801 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.801 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.801 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:00.801 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:59.609232+0000", 2024-04-19T02:16:00.801 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0041631180000000004 2024-04-19T02:16:00.801 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.801 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.801 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:00.802 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:59.609260+0000", 2024-04-19T02:16:00.802 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.8272999999999998e-05 2024-04-19T02:16:00.802 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.802 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.802 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:00.802 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:59.609298+0000", 2024-04-19T02:16:00.802 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7027000000000003e-05 2024-04-19T02:16:00.802 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:00.802 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:00.802 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:00.802 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.802 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.802 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:17024 5.b 5:d13e28be:::benchmark_data_smithi121_44835_object17023:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:00.802 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:00.047714+0000", 2024-04-19T02:16:00.803 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.66327481300000002, 2024-04-19T02:16:00.803 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010418291, 2024-04-19T02:16:00.803 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:00.803 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:00.803 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:00.803 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:00.803 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:00.803 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 17024 2024-04-19T02:16:00.803 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.803 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:00.803 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.803 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:00.803 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.047714+0000", 2024-04-19T02:16:00.803 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:00.803 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.804 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.804 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:00.804 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.047714+0000", 2024-04-19T02:16:00.804 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:00.804 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.804 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.804 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:00.804 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.047713+0000", 2024-04-19T02:16:00.804 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:00.804 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.804 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.804 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:00.804 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.047875+0000", 2024-04-19T02:16:00.804 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00016178399999999999 2024-04-19T02:16:00.805 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.805 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.805 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:00.805 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.047884+0000", 2024-04-19T02:16:00.805 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.6910000000000003e-06 2024-04-19T02:16:00.805 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.805 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.805 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:00.805 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.047890+0000", 2024-04-19T02:16:00.805 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6259999999999997e-06 2024-04-19T02:16:00.805 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.805 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.805 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:00.805 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.049454+0000", 2024-04-19T02:16:00.806 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001563542 2024-04-19T02:16:00.806 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.806 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.806 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:00.806 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.049559+0000", 2024-04-19T02:16:00.806 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010555 2024-04-19T02:16:00.806 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.806 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.806 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:00.806 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.049650+0000", 2024-04-19T02:16:00.806 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0812999999999999e-05 2024-04-19T02:16:00.806 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.806 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.806 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:00.807 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.050569+0000", 2024-04-19T02:16:00.807 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00091896600000000001 2024-04-19T02:16:00.807 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.807 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.807 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:00.807 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.058058+0000", 2024-04-19T02:16:00.807 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0074886190000000002 2024-04-19T02:16:00.807 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.807 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.807 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:00.807 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.058099+0000", 2024-04-19T02:16:00.807 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1199000000000003e-05 2024-04-19T02:16:00.807 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.807 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.808 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:00.808 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.058132+0000", 2024-04-19T02:16:00.808 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3209e-05 2024-04-19T02:16:00.808 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:00.808 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:00.808 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:00.808 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.808 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.808 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:17458 5.b 5:d4165d79:::benchmark_data_smithi121_44835_object17457:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:00.808 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:00.173792+0000", 2024-04-19T02:16:00.808 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.53719700800000003, 2024-04-19T02:16:00.808 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010464268000000001, 2024-04-19T02:16:00.808 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:00.808 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:00.808 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:00.809 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:00.809 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:00.809 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 17458 2024-04-19T02:16:00.809 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.809 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:00.809 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.809 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:00.809 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.173792+0000", 2024-04-19T02:16:00.809 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:00.809 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.809 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.809 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:00.809 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.173792+0000", 2024-04-19T02:16:00.809 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:00.810 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.810 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.810 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:00.810 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.173791+0000", 2024-04-19T02:16:00.810 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:00.810 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.810 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.810 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:00.810 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.173878+0000", 2024-04-19T02:16:00.810 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.6749000000000006e-05 2024-04-19T02:16:00.810 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.810 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.810 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:00.810 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.173885+0000", 2024-04-19T02:16:00.811 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.8739999999999995e-06 2024-04-19T02:16:00.811 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.811 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.811 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:00.811 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.173892+0000", 2024-04-19T02:16:00.811 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.0780000000000001e-06 2024-04-19T02:16:00.811 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.811 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.811 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:00.811 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.173934+0000", 2024-04-19T02:16:00.811 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2633999999999999e-05 2024-04-19T02:16:00.811 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.811 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.811 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:00.811 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.174079+0000", 2024-04-19T02:16:00.812 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014478599999999999 2024-04-19T02:16:00.812 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.812 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.812 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:00.812 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.174220+0000", 2024-04-19T02:16:00.812 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014130600000000001 2024-04-19T02:16:00.812 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.812 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.812 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:00.812 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.178027+0000", 2024-04-19T02:16:00.812 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0038070439999999999 2024-04-19T02:16:00.812 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.812 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.812 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:00.813 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.184199+0000", 2024-04-19T02:16:00.813 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0061719390000000004 2024-04-19T02:16:00.813 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.813 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.813 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:00.813 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.184233+0000", 2024-04-19T02:16:00.813 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4056000000000001e-05 2024-04-19T02:16:00.813 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.813 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.813 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:00.813 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.184256+0000", 2024-04-19T02:16:00.813 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.2622000000000001e-05 2024-04-19T02:16:00.813 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:00.813 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:00.813 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:00.814 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.814 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.814 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:17643 5.b 5:de305560:::benchmark_data_smithi121_44835_object17642:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:00.814 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:00.232477+0000", 2024-04-19T02:16:00.814 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.47851209099999997, 2024-04-19T02:16:00.814 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010616746999999999, 2024-04-19T02:16:00.814 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:00.814 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:00.814 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:00.814 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:00.814 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:00.814 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 17643 2024-04-19T02:16:00.814 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.814 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:00.815 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.815 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:00.815 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.232477+0000", 2024-04-19T02:16:00.815 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:00.815 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.815 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.815 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:00.815 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.232477+0000", 2024-04-19T02:16:00.815 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:00.815 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.815 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.815 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:00.815 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.232476+0000", 2024-04-19T02:16:00.815 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:00.815 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.816 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.816 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:00.816 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.232552+0000", 2024-04-19T02:16:00.816 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.5934999999999997e-05 2024-04-19T02:16:00.816 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.816 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.816 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:00.816 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.232561+0000", 2024-04-19T02:16:00.816 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0589999999999992e-06 2024-04-19T02:16:00.816 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.816 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.816 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:00.816 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.232568+0000", 2024-04-19T02:16:00.816 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.8859999999999998e-06 2024-04-19T02:16:00.816 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.816 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.817 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:00.817 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.235750+0000", 2024-04-19T02:16:00.817 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0031821380000000002 2024-04-19T02:16:00.817 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.817 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.817 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:00.817 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.235833+0000", 2024-04-19T02:16:00.817 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.3084000000000006e-05 2024-04-19T02:16:00.817 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.817 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.817 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:00.817 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.235917+0000", 2024-04-19T02:16:00.817 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.365e-05 2024-04-19T02:16:00.817 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.818 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.818 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:00.818 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.238913+0000", 2024-04-19T02:16:00.818 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0029963429999999998 2024-04-19T02:16:00.818 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.818 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.818 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:00.818 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.243031+0000", 2024-04-19T02:16:00.818 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.004117679 2024-04-19T02:16:00.818 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.818 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.818 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:00.818 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.243071+0000", 2024-04-19T02:16:00.819 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0173999999999999e-05 2024-04-19T02:16:00.819 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.819 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.819 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:00.819 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.243093+0000", 2024-04-19T02:16:00.819 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.2339000000000001e-05 2024-04-19T02:16:00.819 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:00.819 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:00.819 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:00.819 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.819 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.819 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:17656 5.4 5:28eda8f7:::benchmark_data_smithi121_44835_object17655:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:00.819 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:00.238803+0000", 2024-04-19T02:16:00.819 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.47218522499999999, 2024-04-19T02:16:00.819 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010514133, 2024-04-19T02:16:00.820 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:00.820 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:00.820 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:00.820 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:00.820 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:00.820 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 17656 2024-04-19T02:16:00.820 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.820 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:00.820 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.820 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:00.820 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.238803+0000", 2024-04-19T02:16:00.820 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:00.820 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.820 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.820 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:00.821 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.238803+0000", 2024-04-19T02:16:00.821 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:00.821 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.821 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.821 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:00.821 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.238803+0000", 2024-04-19T02:16:00.821 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:00.821 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.821 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.821 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:00.821 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.239002+0000", 2024-04-19T02:16:00.821 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00019917000000000001 2024-04-19T02:16:00.821 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.821 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.821 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:00.822 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.239010+0000", 2024-04-19T02:16:00.822 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.1310000000000006e-06 2024-04-19T02:16:00.822 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.822 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.822 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:00.822 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.239016+0000", 2024-04-19T02:16:00.822 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.241e-06 2024-04-19T02:16:00.822 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.822 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.822 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:00.822 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.239504+0000", 2024-04-19T02:16:00.822 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000488152 2024-04-19T02:16:00.822 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.822 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.823 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:00.823 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.239630+0000", 2024-04-19T02:16:00.823 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012601600000000001 2024-04-19T02:16:00.823 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.823 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.823 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:00.823 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.239712+0000", 2024-04-19T02:16:00.823 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.1919e-05 2024-04-19T02:16:00.823 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.823 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.823 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:00.823 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.243047+0000", 2024-04-19T02:16:00.823 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0033342509999999999 2024-04-19T02:16:00.823 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.823 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.824 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:00.824 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.249255+0000", 2024-04-19T02:16:00.824 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.006208748 2024-04-19T02:16:00.824 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.824 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.824 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:00.824 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.249293+0000", 2024-04-19T02:16:00.824 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7249999999999997e-05 2024-04-19T02:16:00.824 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:00.824 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:00.824 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:00.824 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.249318+0000", 2024-04-19T02:16:00.824 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4944e-05 2024-04-19T02:16:00.824 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:00.825 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:00.825 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:00.825 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:00.825 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:00.825 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:16:00.826 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:16:00.827 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:00.827+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:00.927 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:00.927+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:00.992 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T02:16:01.004 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-04-19T02:16:01.004 INFO:teuthology.orchestra.run.smithi177.stdout: "ops": [ 2024-04-19T02:16:01.004 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.004 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:20031 5.6 5:652d6b0b:::benchmark_data_smithi121_44835_object20030:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:01.004 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:01.002477+0000", 2024-04-19T02:16:01.004 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0017430480000000001, 2024-04-19T02:16:01.004 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0017720749999999999, 2024-04-19T02:16:01.004 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:01.004 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:01.004 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:01.004 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:01.004 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:01.005 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 20031 2024-04-19T02:16:01.005 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.005 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:01.005 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.005 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:01.005 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.002477+0000", 2024-04-19T02:16:01.005 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.005 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.005 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.005 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:01.005 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.002477+0000", 2024-04-19T02:16:01.005 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.005 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.005 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.005 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:01.006 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.002476+0000", 2024-04-19T02:16:01.006 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:01.006 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.006 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.006 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:01.006 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.002531+0000", 2024-04-19T02:16:01.006 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.5220000000000003e-05 2024-04-19T02:16:01.006 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.006 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.006 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:01.006 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.002543+0000", 2024-04-19T02:16:01.006 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.1868999999999999e-05 2024-04-19T02:16:01.006 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.006 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.007 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:01.007 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.002550+0000", 2024-04-19T02:16:01.007 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.4450000000000001e-06 2024-04-19T02:16:01.007 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.007 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.007 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:01.007 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.002585+0000", 2024-04-19T02:16:01.007 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.5438999999999997e-05 2024-04-19T02:16:01.007 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.007 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.007 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:01.007 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.002672+0000", 2024-04-19T02:16:01.007 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.6533999999999995e-05 2024-04-19T02:16:01.007 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.007 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.008 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:01.008 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.002754+0000", 2024-04-19T02:16:01.008 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.2218000000000005e-05 2024-04-19T02:16:01.008 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.008 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.008 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:01.008 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.003847+0000", 2024-04-19T02:16:01.008 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0010932579999999999 2024-04-19T02:16:01.008 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.008 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:01.008 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.008 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.008 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.008 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:20032 5.3 5:c65edcd8:::benchmark_data_smithi121_44835_object20031:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:01.008 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:01.002566+0000", 2024-04-19T02:16:01.009 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.001653961, 2024-04-19T02:16:01.009 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0017867169999999999, 2024-04-19T02:16:01.009 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:01.009 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:01.009 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:01.009 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:01.009 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:01.009 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 20032 2024-04-19T02:16:01.009 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.009 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:01.009 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.009 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:01.009 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.002566+0000", 2024-04-19T02:16:01.009 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.009 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.010 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.010 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:01.010 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.002566+0000", 2024-04-19T02:16:01.010 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.010 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.010 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.010 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:01.010 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.002566+0000", 2024-04-19T02:16:01.010 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:01.010 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.010 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.010 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:01.010 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.002603+0000", 2024-04-19T02:16:01.010 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.7871999999999999e-05 2024-04-19T02:16:01.011 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.011 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.011 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:01.011 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.002608+0000", 2024-04-19T02:16:01.011 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.9180000000000002e-06 2024-04-19T02:16:01.011 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.011 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.011 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:01.011 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.002612+0000", 2024-04-19T02:16:01.011 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.0430000000000001e-06 2024-04-19T02:16:01.011 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.011 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.011 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:01.011 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.002649+0000", 2024-04-19T02:16:01.011 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.7055999999999999e-05 2024-04-19T02:16:01.012 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.012 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.012 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:01.012 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.002747+0000", 2024-04-19T02:16:01.012 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.7996000000000002e-05 2024-04-19T02:16:01.012 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.012 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.012 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:01.012 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.002888+0000", 2024-04-19T02:16:01.012 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000140958 2024-04-19T02:16:01.012 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.012 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.012 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:01.012 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.004128+0000", 2024-04-19T02:16:01.012 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0012400379999999999 2024-04-19T02:16:01.012 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.012 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:01.013 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.013 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.013 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.013 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:20028 5.7 e20/16 5:ea6330dd:::benchmark_data_smithi121_44835_object20027:head v 20'1247, mlcod=20'1244)", 2024-04-19T02:16:01.013 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:01.002996+0000", 2024-04-19T02:16:01.013 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.00122383, 2024-04-19T02:16:01.013 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0014387740000000001, 2024-04-19T02:16:01.013 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:01.013 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:01.013 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:01.013 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.013 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:01.013 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.002996+0000", 2024-04-19T02:16:01.013 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.013 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.014 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.014 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:01.014 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.002996+0000", 2024-04-19T02:16:01.014 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.014 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.014 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.014 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:01.014 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.002996+0000", 2024-04-19T02:16:01.014 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:01.014 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.014 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.014 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:01.014 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.003056+0000", 2024-04-19T02:16:01.014 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.0059000000000002e-05 2024-04-19T02:16:01.015 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.015 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.015 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:01.015 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.003066+0000", 2024-04-19T02:16:01.015 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.9529999999999994e-06 2024-04-19T02:16:01.015 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.015 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.015 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:01.015 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.003073+0000", 2024-04-19T02:16:01.015 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.0639999999999996e-06 2024-04-19T02:16:01.015 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.015 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.015 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:01.015 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.003108+0000", 2024-04-19T02:16:01.015 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.4903000000000001e-05 2024-04-19T02:16:01.015 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.016 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.016 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:01.016 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.003126+0000", 2024-04-19T02:16:01.016 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.8637000000000001e-05 2024-04-19T02:16:01.016 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.016 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:01.016 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.016 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.016 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.016 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:20033 5.8 e20/16 5:1a9b51c8:::benchmark_data_smithi121_44835_object20032:head v 20'1263, mlcod=20'1261)", 2024-04-19T02:16:01.016 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:01.003173+0000", 2024-04-19T02:16:01.016 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.001047145, 2024-04-19T02:16:01.016 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0013334040000000001, 2024-04-19T02:16:01.016 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:01.016 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:01.017 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:01.017 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.017 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:01.017 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.003173+0000", 2024-04-19T02:16:01.017 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.017 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.017 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.017 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:01.017 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.003173+0000", 2024-04-19T02:16:01.017 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.017 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.017 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.017 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:01.017 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.003172+0000", 2024-04-19T02:16:01.017 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:01.017 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.018 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.018 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:01.018 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.003232+0000", 2024-04-19T02:16:01.018 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.9419000000000001e-05 2024-04-19T02:16:01.018 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.018 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.018 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:01.018 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.003240+0000", 2024-04-19T02:16:01.018 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.5599999999999994e-06 2024-04-19T02:16:01.018 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.018 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.018 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:01.018 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.003245+0000", 2024-04-19T02:16:01.018 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.0649999999999998e-06 2024-04-19T02:16:01.019 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.019 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.019 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:01.019 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.003285+0000", 2024-04-19T02:16:01.019 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.9749000000000002e-05 2024-04-19T02:16:01.019 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.019 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.019 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:01.019 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.003306+0000", 2024-04-19T02:16:01.019 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.0615000000000002e-05 2024-04-19T02:16:01.019 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.019 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:01.019 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.019 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.019 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.019 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:20034 5.0 e20/16 5:00fb1de1:::benchmark_data_smithi121_44835_object20033:head v 20'1202, mlcod=20'1200)", 2024-04-19T02:16:01.020 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:01.003475+0000", 2024-04-19T02:16:01.020 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.00074548400000000003, 2024-04-19T02:16:01.020 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.001111124, 2024-04-19T02:16:01.020 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:01.020 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:01.020 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:01.020 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.020 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:01.020 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.003475+0000", 2024-04-19T02:16:01.020 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.020 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.020 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.020 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:01.020 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.003475+0000", 2024-04-19T02:16:01.020 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.021 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.021 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.021 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:01.021 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.003474+0000", 2024-04-19T02:16:01.021 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:01.021 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.021 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.021 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:01.021 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.003542+0000", 2024-04-19T02:16:01.021 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.834e-05 2024-04-19T02:16:01.021 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.021 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.021 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:01.021 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.003555+0000", 2024-04-19T02:16:01.021 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.3179999999999999e-05 2024-04-19T02:16:01.022 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.022 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.022 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:01.022 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.003563+0000", 2024-04-19T02:16:01.022 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.6799999999999993e-06 2024-04-19T02:16:01.022 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.022 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.022 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:01.022 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.003625+0000", 2024-04-19T02:16:01.022 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.1651999999999999e-05 2024-04-19T02:16:01.022 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.022 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.022 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:01.022 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.003645+0000", 2024-04-19T02:16:01.022 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.0322e-05 2024-04-19T02:16:01.023 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.023 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:01.023 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.023 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.023 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.023 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:20035 5.8 e20/16 5:14d55801:::benchmark_data_smithi121_44835_object20034:head v 20'1264, mlcod=20'1261)", 2024-04-19T02:16:01.023 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:01.004027+0000", 2024-04-19T02:16:01.023 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.000192769, 2024-04-19T02:16:01.023 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00063742099999999999, 2024-04-19T02:16:01.023 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:01.023 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:01.023 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:01.023 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.023 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:01.023 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.004027+0000", 2024-04-19T02:16:01.023 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.024 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.024 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.024 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:01.024 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.004027+0000", 2024-04-19T02:16:01.024 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.024 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.024 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.024 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:01.024 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.004027+0000", 2024-04-19T02:16:01.024 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:01.024 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.024 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.024 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:01.024 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.004158+0000", 2024-04-19T02:16:01.024 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00013142500000000001 2024-04-19T02:16:01.024 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.025 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.025 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:01.025 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.004172+0000", 2024-04-19T02:16:01.025 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.4258e-05 2024-04-19T02:16:01.025 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.025 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.025 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:01.025 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.004179+0000", 2024-04-19T02:16:01.025 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.1929999999999998e-06 2024-04-19T02:16:01.025 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.025 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.025 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:01.025 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.004208+0000", 2024-04-19T02:16:01.025 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.9726e-05 2024-04-19T02:16:01.025 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.025 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.026 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:01.026 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.004229+0000", 2024-04-19T02:16:01.026 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.0696999999999999e-05 2024-04-19T02:16:01.026 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.026 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:01.026 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.026 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.026 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.026 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:20038 5.2 e20/16 5:415860e5:::benchmark_data_smithi121_44835_object20037:head v 20'1290, mlcod=20'1288)", 2024-04-19T02:16:01.026 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:01.004289+0000", 2024-04-19T02:16:01.026 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4294967295.9999313, 2024-04-19T02:16:01.026 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00044596099999999998, 2024-04-19T02:16:01.026 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:01.026 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:01.026 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:01.027 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.027 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:01.027 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.004289+0000", 2024-04-19T02:16:01.027 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.027 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.027 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.027 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:01.027 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.004289+0000", 2024-04-19T02:16:01.027 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.027 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.027 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.027 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:01.027 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.004288+0000", 2024-04-19T02:16:01.027 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:01.027 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.027 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.028 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:01.028 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.004385+0000", 2024-04-19T02:16:01.028 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.6716e-05 2024-04-19T02:16:01.028 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.028 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.028 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:01.028 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.004395+0000", 2024-04-19T02:16:01.028 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0491e-05 2024-04-19T02:16:01.028 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.028 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.028 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:01.028 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.004402+0000", 2024-04-19T02:16:01.028 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.511e-06 2024-04-19T02:16:01.028 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.028 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.028 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:01.029 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.004439+0000", 2024-04-19T02:16:01.029 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.7500999999999999e-05 2024-04-19T02:16:01.029 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.029 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.029 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:01.029 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.004454+0000", 2024-04-19T02:16:01.029 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.4569999999999999e-05 2024-04-19T02:16:01.029 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.029 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:01.029 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.029 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.029 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.029 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:20037 5.0 e20/16 5:0ee9b5d9:::benchmark_data_smithi121_44835_object20036:head v 20'1203, mlcod=20'1200)", 2024-04-19T02:16:01.029 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:01.004316+0000", 2024-04-19T02:16:01.030 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4294967295.9999037, 2024-04-19T02:16:01.030 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00047881600000000002, 2024-04-19T02:16:01.030 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:01.030 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:01.030 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:01.030 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.030 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:01.030 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.004316+0000", 2024-04-19T02:16:01.030 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.030 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.030 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.030 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:01.030 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.004316+0000", 2024-04-19T02:16:01.030 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.030 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.031 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.031 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:01.031 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.004316+0000", 2024-04-19T02:16:01.031 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:01.031 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.031 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.031 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:01.031 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.004413+0000", 2024-04-19T02:16:01.031 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.7726999999999995e-05 2024-04-19T02:16:01.031 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.031 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.031 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:01.031 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.004423+0000", 2024-04-19T02:16:01.031 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.4490000000000005e-06 2024-04-19T02:16:01.031 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.031 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.032 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:01.032 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.004441+0000", 2024-04-19T02:16:01.032 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.7745999999999999e-05 2024-04-19T02:16:01.032 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.032 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.032 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:01.032 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.004511+0000", 2024-04-19T02:16:01.032 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.0481000000000005e-05 2024-04-19T02:16:01.032 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.032 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.032 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:01.032 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.004528+0000", 2024-04-19T02:16:01.032 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.7115000000000001e-05 2024-04-19T02:16:01.032 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.033 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:01.033 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.033 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.033 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.033 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:20040 5.7 e20/16 5:ebda0c2d:::benchmark_data_smithi121_44835_object20039:head v 20'1248, mlcod=20'1244)", 2024-04-19T02:16:01.033 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:01.004417+0000", 2024-04-19T02:16:01.033 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4294967295.9998031, 2024-04-19T02:16:01.033 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000435489, 2024-04-19T02:16:01.033 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:01.033 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:01.033 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:01.033 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.033 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:01.033 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.004417+0000", 2024-04-19T02:16:01.033 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.033 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.034 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.034 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:01.034 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.004417+0000", 2024-04-19T02:16:01.034 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.034 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.034 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.034 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:01.034 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.004416+0000", 2024-04-19T02:16:01.034 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:01.034 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.034 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.034 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:01.034 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.004515+0000", 2024-04-19T02:16:01.034 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.8445999999999999e-05 2024-04-19T02:16:01.034 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.035 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.035 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:01.035 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.004522+0000", 2024-04-19T02:16:01.035 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.2740000000000002e-06 2024-04-19T02:16:01.035 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.035 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.035 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:01.035 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.004528+0000", 2024-04-19T02:16:01.035 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.5180000000000004e-06 2024-04-19T02:16:01.035 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.035 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.035 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:01.035 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.004583+0000", 2024-04-19T02:16:01.035 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.5007999999999999e-05 2024-04-19T02:16:01.035 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.036 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.036 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:01.036 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.004602+0000", 2024-04-19T02:16:01.036 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.9330999999999998e-05 2024-04-19T02:16:01.036 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.036 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:01.036 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.036 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.036 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.036 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:20039 5.4 e20/16 5:25245f0e:::benchmark_data_smithi121_44835_object20038:head v 20'1252, mlcod=20'1250)", 2024-04-19T02:16:01.036 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:01.004450+0000", 2024-04-19T02:16:01.036 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4294967295.9997697, 2024-04-19T02:16:01.036 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00045188699999999999, 2024-04-19T02:16:01.036 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:01.036 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:01.036 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:01.037 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.037 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:01.037 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.004450+0000", 2024-04-19T02:16:01.037 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.037 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.037 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.037 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:01.037 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.004450+0000", 2024-04-19T02:16:01.037 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.037 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.037 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.037 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:01.037 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.004450+0000", 2024-04-19T02:16:01.037 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:01.037 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.038 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.038 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:01.038 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.004518+0000", 2024-04-19T02:16:01.038 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.8534000000000005e-05 2024-04-19T02:16:01.038 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.038 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.038 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:01.038 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.004527+0000", 2024-04-19T02:16:01.038 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.1519999999999992e-06 2024-04-19T02:16:01.038 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.038 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.038 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:01.038 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.004533+0000", 2024-04-19T02:16:01.038 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.5370000000000003e-06 2024-04-19T02:16:01.038 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.039 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.039 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:01.039 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.004582+0000", 2024-04-19T02:16:01.039 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.8816999999999997e-05 2024-04-19T02:16:01.039 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.039 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.039 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:01.039 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.004599+0000", 2024-04-19T02:16:01.039 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.7229999999999999e-05 2024-04-19T02:16:01.039 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.039 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:01.039 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.039 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.039 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.039 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:20020 5.3 5:ce93388f:::benchmark_data_smithi121_44835_object20019:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:01.040 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:00.997032+0000", 2024-04-19T02:16:01.040 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0071877829999999997, 2024-04-19T02:16:01.040 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0079083499999999998, 2024-04-19T02:16:01.040 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:01.040 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:01.040 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:01.040 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:01.040 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:01.040 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 20020 2024-04-19T02:16:01.040 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.040 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:01.040 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.040 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:01.040 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.997032+0000", 2024-04-19T02:16:01.040 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.040 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.041 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.041 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:01.041 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.997032+0000", 2024-04-19T02:16:01.041 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.041 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.041 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.041 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:01.041 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.997032+0000", 2024-04-19T02:16:01.041 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:01.041 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.041 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.041 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:01.041 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.997151+0000", 2024-04-19T02:16:01.041 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000119652 2024-04-19T02:16:01.041 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.042 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.042 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:01.042 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.997159+0000", 2024-04-19T02:16:01.042 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.8590000000000005e-06 2024-04-19T02:16:01.042 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.042 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.042 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:01.042 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.997165+0000", 2024-04-19T02:16:01.042 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.7910000000000001e-06 2024-04-19T02:16:01.042 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.042 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.042 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:01.042 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.997199+0000", 2024-04-19T02:16:01.042 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.3939000000000002e-05 2024-04-19T02:16:01.042 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.043 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.043 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:01.043 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.997323+0000", 2024-04-19T02:16:01.043 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000124583 2024-04-19T02:16:01.043 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.043 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.043 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:01.043 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.997462+0000", 2024-04-19T02:16:01.043 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00013821300000000001 2024-04-19T02:16:01.043 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.043 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.043 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:01.043 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.998798+0000", 2024-04-19T02:16:01.043 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0013361149999999999 2024-04-19T02:16:01.043 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.044 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:01.044 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.044 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.044 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2024-04-19T02:16:01.044 INFO:teuthology.orchestra.run.smithi177.stdout: "num_ops": 11 2024-04-19T02:16:01.044 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-04-19T02:16:01.045 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 6 16 20108 20092 209.276 197 0.00230782 0.00477285 2024-04-19T02:16:01.046 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:16:01.046 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:01.045+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:01.146 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:01.146+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:01.247 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:01.248+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:01.261 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-04-19T02:16:01.261 INFO:teuthology.orchestra.run.smithi177.stdout: "ops": [], 2024-04-19T02:16:01.261 INFO:teuthology.orchestra.run.smithi177.stdout: "complaint_time": 30, 2024-04-19T02:16:01.261 INFO:teuthology.orchestra.run.smithi177.stdout: "num_blocked_ops": 0 2024-04-19T02:16:01.261 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-04-19T02:16:01.276 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:16:01.348 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:01.349+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:01.409 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:16:01.450 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:01.450+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:01.459 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-04-19T02:16:01.459 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 20, 2024-04-19T02:16:01.459 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 600, 2024-04-19T02:16:01.459 INFO:teuthology.orchestra.run.smithi177.stdout: "ops": [ 2024-04-19T02:16:01.459 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.459 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:01.459 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:29.270159+0000", 2024-04-19T02:16:01.459 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 32.187411257000001, 2024-04-19T02:16:01.459 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015837766999999999, 2024-04-19T02:16:01.460 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:01.460 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:01.460 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:01.460 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.460 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:01.460 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270159+0000", 2024-04-19T02:16:01.460 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.460 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.460 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.460 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:01.460 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270159+0000", 2024-04-19T02:16:01.460 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.461 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.461 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.461 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:01.461 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270158+0000", 2024-04-19T02:16:01.461 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:01.461 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.461 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.461 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:01.462 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270171+0000", 2024-04-19T02:16:01.462 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.3050999999999999e-05 2024-04-19T02:16:01.462 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.462 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.462 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:01.462 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270187+0000", 2024-04-19T02:16:01.462 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.6351999999999999e-05 2024-04-19T02:16:01.463 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.463 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.463 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:01.463 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270203+0000", 2024-04-19T02:16:01.463 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.6056e-05 2024-04-19T02:16:01.463 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.463 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.463 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:01.463 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.271261+0000", 2024-04-19T02:16:01.464 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0010576520000000001 2024-04-19T02:16:01.464 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.464 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.464 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:01.464 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.271385+0000", 2024-04-19T02:16:01.464 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012376800000000001 2024-04-19T02:16:01.464 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.464 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.464 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:01.465 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.271539+0000", 2024-04-19T02:16:01.465 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00015414000000000001 2024-04-19T02:16:01.465 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.465 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.465 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:01.465 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.275422+0000", 2024-04-19T02:16:01.466 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.003883507 2024-04-19T02:16:01.466 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.466 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.466 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:01.466 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.285870+0000", 2024-04-19T02:16:01.466 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.010447700000000001 2024-04-19T02:16:01.467 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.467 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.467 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:01.467 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.285947+0000", 2024-04-19T02:16:01.467 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.7429999999999996e-05 2024-04-19T02:16:01.467 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.467 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.467 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:01.468 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.285997+0000", 2024-04-19T02:16:01.468 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.9666999999999997e-05 2024-04-19T02:16:01.468 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.468 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:01.468 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.468 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.468 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.468 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:01.469 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:29.270219+0000", 2024-04-19T02:16:01.469 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 32.187351571000001, 2024-04-19T02:16:01.469 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015932135, 2024-04-19T02:16:01.469 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:01.469 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:01.469 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:01.469 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.470 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:01.470 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270219+0000", 2024-04-19T02:16:01.470 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.470 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.470 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.470 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:01.471 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270219+0000", 2024-04-19T02:16:01.471 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.471 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.471 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.471 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:01.471 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270218+0000", 2024-04-19T02:16:01.472 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:01.472 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.472 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.472 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:01.472 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270223+0000", 2024-04-19T02:16:01.472 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.6090000000000003e-06 2024-04-19T02:16:01.472 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.473 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.473 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:01.473 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270230+0000", 2024-04-19T02:16:01.473 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.9929999999999998e-06 2024-04-19T02:16:01.473 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.473 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.473 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:01.473 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270237+0000", 2024-04-19T02:16:01.473 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.9990000000000002e-06 2024-04-19T02:16:01.473 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.473 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.473 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:01.473 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.272960+0000", 2024-04-19T02:16:01.474 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0027234730000000001 2024-04-19T02:16:01.474 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.474 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.474 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:01.474 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.273062+0000", 2024-04-19T02:16:01.474 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000102043 2024-04-19T02:16:01.474 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.474 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.474 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:01.474 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.273578+0000", 2024-04-19T02:16:01.474 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00051574499999999996 2024-04-19T02:16:01.474 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.475 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.475 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:01.475 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.277063+0000", 2024-04-19T02:16:01.475 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0034846109999999999 2024-04-19T02:16:01.475 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.475 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.475 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:01.475 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286077+0000", 2024-04-19T02:16:01.475 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0090144509999999997 2024-04-19T02:16:01.475 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.475 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.475 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:01.475 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286115+0000", 2024-04-19T02:16:01.476 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.7710999999999999e-05 2024-04-19T02:16:01.476 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.476 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.476 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:01.476 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286151+0000", 2024-04-19T02:16:01.476 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6049e-05 2024-04-19T02:16:01.476 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.476 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:01.476 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.476 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.476 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.476 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(mds.0.3:15 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:01.476 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:29.270244+0000", 2024-04-19T02:16:01.476 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 32.187326384999999, 2024-04-19T02:16:01.477 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015030304, 2024-04-19T02:16:01.477 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:01.477 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:01.477 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:01.477 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.477 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:01.477 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270244+0000", 2024-04-19T02:16:01.477 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.477 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.477 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.477 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:01.477 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270244+0000", 2024-04-19T02:16:01.477 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.477 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.477 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.478 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:01.478 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270244+0000", 2024-04-19T02:16:01.478 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:01.478 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.478 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.478 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:01.478 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270248+0000", 2024-04-19T02:16:01.478 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.2139999999999998e-06 2024-04-19T02:16:01.478 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.478 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.478 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:01.478 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270256+0000", 2024-04-19T02:16:01.478 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.8650000000000001e-06 2024-04-19T02:16:01.479 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.479 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.479 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:01.479 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270265+0000", 2024-04-19T02:16:01.479 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.8210000000000008e-06 2024-04-19T02:16:01.479 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.479 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.479 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:01.479 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.273182+0000", 2024-04-19T02:16:01.479 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0029179420000000002 2024-04-19T02:16:01.479 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.480 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.480 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:01.480 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.273653+0000", 2024-04-19T02:16:01.480 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00047090700000000001 2024-04-19T02:16:01.480 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.480 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.480 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:01.480 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.273818+0000", 2024-04-19T02:16:01.480 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000164382 2024-04-19T02:16:01.480 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.480 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.480 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:01.480 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.278281+0000", 2024-04-19T02:16:01.480 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0044635059999999999 2024-04-19T02:16:01.481 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.481 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.481 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:01.481 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.285194+0000", 2024-04-19T02:16:01.481 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0069127420000000004 2024-04-19T02:16:01.481 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.481 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.481 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:01.481 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.285237+0000", 2024-04-19T02:16:01.481 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.3448000000000001e-05 2024-04-19T02:16:01.481 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.481 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.481 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:01.481 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.285274+0000", 2024-04-19T02:16:01.482 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6921000000000001e-05 2024-04-19T02:16:01.482 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.482 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:01.482 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.482 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.482 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.482 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:01.482 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:29.270271+0000", 2024-04-19T02:16:01.482 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 32.187299414000002, 2024-04-19T02:16:01.482 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015123286999999999, 2024-04-19T02:16:01.482 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:01.483 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:01.483 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:01.483 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.483 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:01.483 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270271+0000", 2024-04-19T02:16:01.483 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.483 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.483 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.484 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:01.484 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270271+0000", 2024-04-19T02:16:01.484 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.484 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.484 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.484 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:01.484 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270271+0000", 2024-04-19T02:16:01.484 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:01.484 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.485 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.485 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:01.485 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270279+0000", 2024-04-19T02:16:01.485 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.2490000000000001e-06 2024-04-19T02:16:01.485 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.485 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.485 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:01.485 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270287+0000", 2024-04-19T02:16:01.485 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.8979999999999996e-06 2024-04-19T02:16:01.486 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.486 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.486 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:01.486 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270299+0000", 2024-04-19T02:16:01.486 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.24e-05 2024-04-19T02:16:01.486 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.486 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.487 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:01.487 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.274674+0000", 2024-04-19T02:16:01.487 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0043751429999999997 2024-04-19T02:16:01.487 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.487 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.487 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:01.487 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.274754+0000", 2024-04-19T02:16:01.487 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.9362000000000004e-05 2024-04-19T02:16:01.488 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.488 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.488 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:01.488 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.274918+0000", 2024-04-19T02:16:01.488 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000164616 2024-04-19T02:16:01.488 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.488 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.488 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:01.488 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.278603+0000", 2024-04-19T02:16:01.489 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0036852370000000001 2024-04-19T02:16:01.489 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.489 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.489 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:01.489 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.285314+0000", 2024-04-19T02:16:01.489 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0067103240000000001 2024-04-19T02:16:01.489 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.489 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.490 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:01.490 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.285357+0000", 2024-04-19T02:16:01.490 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.3288999999999998e-05 2024-04-19T02:16:01.490 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.490 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.490 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:01.490 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.285394+0000", 2024-04-19T02:16:01.490 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.7199000000000001e-05 2024-04-19T02:16:01.491 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.491 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:01.491 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.491 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.491 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.491 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(mds.0.3:16 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:01.491 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:29.270306+0000", 2024-04-19T02:16:01.491 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 32.187264134999999, 2024-04-19T02:16:01.491 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016306661, 2024-04-19T02:16:01.491 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:01.492 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:01.492 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:01.492 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.492 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:01.492 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270306+0000", 2024-04-19T02:16:01.492 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.492 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.492 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.492 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:01.493 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270306+0000", 2024-04-19T02:16:01.493 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.493 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.493 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.493 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:01.493 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270306+0000", 2024-04-19T02:16:01.493 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:01.493 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.493 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.494 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:01.494 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270310+0000", 2024-04-19T02:16:01.494 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.0990000000000001e-06 2024-04-19T02:16:01.494 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.494 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.494 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:01.494 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270317+0000", 2024-04-19T02:16:01.494 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.7100000000000001e-06 2024-04-19T02:16:01.495 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.495 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.495 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:01.495 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270324+0000", 2024-04-19T02:16:01.495 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.374e-06 2024-04-19T02:16:01.495 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.495 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.495 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:01.495 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.274312+0000", 2024-04-19T02:16:01.496 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0039885140000000003 2024-04-19T02:16:01.496 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.496 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.496 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:01.496 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.274737+0000", 2024-04-19T02:16:01.496 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00042410899999999999 2024-04-19T02:16:01.496 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.496 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.497 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:01.497 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.274893+0000", 2024-04-19T02:16:01.497 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00015594599999999999 2024-04-19T02:16:01.497 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.497 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.497 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:01.497 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.278597+0000", 2024-04-19T02:16:01.497 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0037046869999999999 2024-04-19T02:16:01.497 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.497 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.497 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:01.497 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286522+0000", 2024-04-19T02:16:01.497 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0079243809999999994 2024-04-19T02:16:01.497 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.498 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.498 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:01.498 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286576+0000", 2024-04-19T02:16:01.498 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.4728999999999997e-05 2024-04-19T02:16:01.498 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.498 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.498 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:01.498 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286613+0000", 2024-04-19T02:16:01.498 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6661e-05 2024-04-19T02:16:01.498 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.499 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:01.499 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.499 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.499 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.499 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(mds.0.3:18 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:01.499 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:29.270329+0000", 2024-04-19T02:16:01.499 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 32.187241647999997, 2024-04-19T02:16:01.499 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016172755, 2024-04-19T02:16:01.499 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:01.499 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:01.500 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:01.500 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.500 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:01.500 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270329+0000", 2024-04-19T02:16:01.500 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.500 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.500 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.500 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:01.500 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270329+0000", 2024-04-19T02:16:01.503 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.504 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.504 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.504 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:01.504 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270328+0000", 2024-04-19T02:16:01.504 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:01.504 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.504 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.504 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:01.504 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270331+0000", 2024-04-19T02:16:01.504 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.9629999999999998e-06 2024-04-19T02:16:01.504 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.504 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.504 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:01.504 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270338+0000", 2024-04-19T02:16:01.505 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.1410000000000002e-06 2024-04-19T02:16:01.505 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.505 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.505 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:01.505 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270344+0000", 2024-04-19T02:16:01.505 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.7410000000000003e-06 2024-04-19T02:16:01.505 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.505 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.505 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:01.505 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270418+0000", 2024-04-19T02:16:01.505 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.3598999999999998e-05 2024-04-19T02:16:01.505 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.505 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.505 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:01.505 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270623+0000", 2024-04-19T02:16:01.505 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00020499599999999999 2024-04-19T02:16:01.506 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.506 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.506 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:01.506 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.271086+0000", 2024-04-19T02:16:01.506 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00046345199999999999 2024-04-19T02:16:01.506 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.506 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.506 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:01.506 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.276220+0000", 2024-04-19T02:16:01.506 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0051338490000000002 2024-04-19T02:16:01.506 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.506 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.506 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:01.507 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286426+0000", 2024-04-19T02:16:01.507 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.010205982000000001 2024-04-19T02:16:01.507 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.507 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.507 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:01.507 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286461+0000", 2024-04-19T02:16:01.507 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.5280000000000001e-05 2024-04-19T02:16:01.507 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.507 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.507 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:01.507 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286502+0000", 2024-04-19T02:16:01.507 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.0102000000000003e-05 2024-04-19T02:16:01.507 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.507 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:01.507 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.508 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.508 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.508 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(mds.0.3:23 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:01.508 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:29.270358+0000", 2024-04-19T02:16:01.508 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 32.187212926999997, 2024-04-19T02:16:01.508 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016257511999999998, 2024-04-19T02:16:01.508 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:01.508 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:01.508 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:01.508 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.508 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:01.508 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270358+0000", 2024-04-19T02:16:01.509 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.509 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.509 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.509 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:01.509 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270358+0000", 2024-04-19T02:16:01.509 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.509 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.509 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.509 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:01.509 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270357+0000", 2024-04-19T02:16:01.509 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:01.509 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.509 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.509 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:01.509 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270360+0000", 2024-04-19T02:16:01.510 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.106e-06 2024-04-19T02:16:01.510 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.510 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.510 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:01.510 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270368+0000", 2024-04-19T02:16:01.510 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.6279999999999996e-06 2024-04-19T02:16:01.510 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.510 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.510 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:01.510 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270373+0000", 2024-04-19T02:16:01.510 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.1410000000000004e-06 2024-04-19T02:16:01.510 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.510 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.510 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:01.510 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.271505+0000", 2024-04-19T02:16:01.511 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0011319069999999999 2024-04-19T02:16:01.511 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.511 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.511 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:01.511 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.271652+0000", 2024-04-19T02:16:01.511 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00014698399999999999 2024-04-19T02:16:01.511 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.511 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.511 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:01.511 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286615+0000", 2024-04-19T02:16:01.511 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.014963156999999999 2024-04-19T02:16:01.511 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.512 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:01.512 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.512 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.512 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.512 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(mds.0.3:24 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:01.512 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:29.270411+0000", 2024-04-19T02:16:01.512 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 32.187159934999997, 2024-04-19T02:16:01.512 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016334762999999999, 2024-04-19T02:16:01.512 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:01.512 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:01.512 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:01.512 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.512 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:01.512 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270411+0000", 2024-04-19T02:16:01.513 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.513 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.513 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.513 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:01.513 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270411+0000", 2024-04-19T02:16:01.513 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.513 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.513 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.513 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:01.513 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270410+0000", 2024-04-19T02:16:01.513 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:01.513 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.513 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.513 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:01.513 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270413+0000", 2024-04-19T02:16:01.514 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.303e-06 2024-04-19T02:16:01.514 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.514 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.514 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:01.514 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270421+0000", 2024-04-19T02:16:01.514 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.3769999999999998e-06 2024-04-19T02:16:01.514 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.514 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.514 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:01.514 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270429+0000", 2024-04-19T02:16:01.515 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.6740000000000003e-06 2024-04-19T02:16:01.515 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.515 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.515 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:01.515 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.275527+0000", 2024-04-19T02:16:01.515 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0050975869999999998 2024-04-19T02:16:01.515 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.515 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.515 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:01.515 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.275946+0000", 2024-04-19T02:16:01.515 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00041882699999999998 2024-04-19T02:16:01.515 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.515 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.515 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:01.515 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286745+0000", 2024-04-19T02:16:01.516 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.010799477 2024-04-19T02:16:01.516 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.516 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:01.516 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.516 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.516 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.516 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:630 5.3 5:c9fc5f6a:::benchmark_data_smithi121_44835_object629:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:16:01.516 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:55.207164+0000", 2024-04-19T02:16:01.516 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 6.2504062429999996, 2024-04-19T02:16:01.516 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.014098078, 2024-04-19T02:16:01.516 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:01.516 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:01.516 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:01.516 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:01.516 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:01.517 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 630 2024-04-19T02:16:01.517 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.517 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:01.517 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.517 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:01.517 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.207164+0000", 2024-04-19T02:16:01.517 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.517 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.517 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.517 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:01.517 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.207164+0000", 2024-04-19T02:16:01.517 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.517 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.517 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.518 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:01.518 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.207164+0000", 2024-04-19T02:16:01.518 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:01.518 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.518 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.518 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:01.518 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.207248+0000", 2024-04-19T02:16:01.518 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.4414999999999997e-05 2024-04-19T02:16:01.518 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.518 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.518 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:01.518 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.207257+0000", 2024-04-19T02:16:01.518 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.5720000000000003e-06 2024-04-19T02:16:01.518 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.519 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.519 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:01.519 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.207264+0000", 2024-04-19T02:16:01.519 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.1430000000000001e-06 2024-04-19T02:16:01.519 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.519 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.519 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:01.519 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.208420+0000", 2024-04-19T02:16:01.519 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.001155959 2024-04-19T02:16:01.519 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.519 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.519 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:01.519 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.208526+0000", 2024-04-19T02:16:01.519 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000105821 2024-04-19T02:16:01.519 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.520 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.520 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:01.520 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.208624+0000", 2024-04-19T02:16:01.520 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.8218000000000001e-05 2024-04-19T02:16:01.520 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.520 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.520 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:01.520 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.210553+0000", 2024-04-19T02:16:01.520 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.001929046 2024-04-19T02:16:01.520 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.520 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.520 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:01.520 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.221190+0000", 2024-04-19T02:16:01.520 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.010636672 2024-04-19T02:16:01.520 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.520 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.521 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:01.521 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.221233+0000", 2024-04-19T02:16:01.521 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.3185000000000001e-05 2024-04-19T02:16:01.521 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.521 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.521 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:01.521 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.221262+0000", 2024-04-19T02:16:01.521 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.9539e-05 2024-04-19T02:16:01.521 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.521 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:01.521 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.521 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.521 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.521 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:2290 5.5 5:a870a399:::benchmark_data_smithi121_44835_object2289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:16:01.521 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:55.645524+0000", 2024-04-19T02:16:01.522 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 5.812046585, 2024-04-19T02:16:01.522 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.018181836999999999, 2024-04-19T02:16:01.522 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:01.522 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:01.522 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:01.522 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:01.522 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:01.522 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 2290 2024-04-19T02:16:01.522 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.522 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:01.522 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.522 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:01.522 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645524+0000", 2024-04-19T02:16:01.522 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.523 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.523 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.523 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:01.523 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645524+0000", 2024-04-19T02:16:01.523 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.523 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.523 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.523 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:01.523 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645524+0000", 2024-04-19T02:16:01.523 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:01.523 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.523 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.523 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:01.523 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645603+0000", 2024-04-19T02:16:01.523 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.9983999999999999e-05 2024-04-19T02:16:01.523 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.524 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.524 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:01.524 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645609+0000", 2024-04-19T02:16:01.524 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.5500000000000002e-06 2024-04-19T02:16:01.524 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.524 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.524 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:01.524 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645613+0000", 2024-04-19T02:16:01.524 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.591e-06 2024-04-19T02:16:01.524 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.524 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.524 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:01.524 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645649+0000", 2024-04-19T02:16:01.524 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6769e-05 2024-04-19T02:16:01.524 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.525 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.525 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:01.525 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645765+0000", 2024-04-19T02:16:01.525 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00011593499999999999 2024-04-19T02:16:01.525 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.525 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.525 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:01.525 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645899+0000", 2024-04-19T02:16:01.525 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00013329499999999999 2024-04-19T02:16:01.525 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.525 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.525 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:01.525 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.649261+0000", 2024-04-19T02:16:01.525 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0033619639999999998 2024-04-19T02:16:01.525 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.526 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.526 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:01.526 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.663657+0000", 2024-04-19T02:16:01.526 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.014396137999999999 2024-04-19T02:16:01.526 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.526 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.526 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:01.526 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.663686+0000", 2024-04-19T02:16:01.526 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.8841999999999999e-05 2024-04-19T02:16:01.526 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.526 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.526 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:01.526 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.663706+0000", 2024-04-19T02:16:01.526 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.0108000000000001e-05 2024-04-19T02:16:01.526 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.527 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:01.527 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.527 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.527 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.527 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:2296 5.5 5:a5d39efa:::benchmark_data_smithi121_44835_object2295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:16:01.527 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:55.646720+0000", 2024-04-19T02:16:01.527 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 5.810850791, 2024-04-19T02:16:01.527 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.017072077000000001, 2024-04-19T02:16:01.527 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:01.527 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:01.527 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:01.527 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:01.527 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:01.527 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 2296 2024-04-19T02:16:01.527 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.528 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:01.528 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.528 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:01.528 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646720+0000", 2024-04-19T02:16:01.528 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.528 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.528 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.528 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:01.528 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646720+0000", 2024-04-19T02:16:01.528 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.528 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.528 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.528 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:01.528 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646719+0000", 2024-04-19T02:16:01.528 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:01.529 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.529 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.529 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:01.529 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646778+0000", 2024-04-19T02:16:01.529 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.9264e-05 2024-04-19T02:16:01.529 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.529 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.529 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:01.529 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646792+0000", 2024-04-19T02:16:01.529 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.3573e-05 2024-04-19T02:16:01.529 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.529 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.529 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:01.529 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646797+0000", 2024-04-19T02:16:01.530 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.3190000000000002e-06 2024-04-19T02:16:01.530 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.530 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.530 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:01.530 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646826+0000", 2024-04-19T02:16:01.530 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.8787999999999999e-05 2024-04-19T02:16:01.530 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.530 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.530 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:01.530 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646913+0000", 2024-04-19T02:16:01.530 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.7601000000000004e-05 2024-04-19T02:16:01.530 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.530 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.530 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:01.531 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646996+0000", 2024-04-19T02:16:01.531 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.2237000000000006e-05 2024-04-19T02:16:01.531 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.531 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.531 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:01.531 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.649533+0000", 2024-04-19T02:16:01.531 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.002537564 2024-04-19T02:16:01.531 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.531 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.531 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:01.531 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.663741+0000", 2024-04-19T02:16:01.531 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.014207322 2024-04-19T02:16:01.531 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.531 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.531 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:01.532 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.663771+0000", 2024-04-19T02:16:01.532 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.0324e-05 2024-04-19T02:16:01.532 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.532 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.532 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:01.532 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.663792+0000", 2024-04-19T02:16:01.532 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.0778999999999999e-05 2024-04-19T02:16:01.532 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.532 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:01.532 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.532 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.532 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.532 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:2298 5.5 5:a533ec4e:::benchmark_data_smithi121_44835_object2297:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:16:01.532 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:55.649474+0000", 2024-04-19T02:16:01.533 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 5.8080962569999999, 2024-04-19T02:16:01.533 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.014385101000000001, 2024-04-19T02:16:01.533 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:01.533 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:01.533 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:01.533 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:01.533 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:01.533 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 2298 2024-04-19T02:16:01.533 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.533 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:01.533 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.533 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:01.533 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.649474+0000", 2024-04-19T02:16:01.533 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.533 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.534 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.534 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:01.534 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.649474+0000", 2024-04-19T02:16:01.534 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.534 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.534 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.534 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:01.534 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.649474+0000", 2024-04-19T02:16:01.534 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:01.534 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.534 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.534 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:01.534 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.649589+0000", 2024-04-19T02:16:01.534 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000115796 2024-04-19T02:16:01.535 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.535 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.535 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:01.535 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.649598+0000", 2024-04-19T02:16:01.535 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.2660000000000001e-06 2024-04-19T02:16:01.535 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.535 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.535 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:01.535 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.649604+0000", 2024-04-19T02:16:01.535 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.1670000000000004e-06 2024-04-19T02:16:01.535 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.535 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.535 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:01.535 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.649629+0000", 2024-04-19T02:16:01.535 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.4808999999999999e-05 2024-04-19T02:16:01.536 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.536 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.536 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:01.536 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.649723+0000", 2024-04-19T02:16:01.536 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.4114e-05 2024-04-19T02:16:01.536 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.536 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.536 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:01.536 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.649809+0000", 2024-04-19T02:16:01.536 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.6463000000000002e-05 2024-04-19T02:16:01.536 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.536 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.536 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:01.536 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.653093+0000", 2024-04-19T02:16:01.537 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0032834100000000001 2024-04-19T02:16:01.537 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.537 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.537 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:01.537 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.663814+0000", 2024-04-19T02:16:01.537 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.010721212000000001 2024-04-19T02:16:01.537 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.537 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.537 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:01.537 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.663837+0000", 2024-04-19T02:16:01.537 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.3587999999999998e-05 2024-04-19T02:16:01.537 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.537 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.537 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:01.537 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.663859+0000", 2024-04-19T02:16:01.538 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.1869999999999999e-05 2024-04-19T02:16:01.538 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.538 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:01.538 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.538 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.538 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.538 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:16497 5.c 5:3cb287d4:::benchmark_data_smithi121_44835_object16496:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:01.538 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:59.873454+0000", 2024-04-19T02:16:01.538 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 1.584116842, 2024-04-19T02:16:01.538 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.017103489999999999, 2024-04-19T02:16:01.538 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:01.538 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:01.538 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:01.538 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:01.539 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:01.539 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 16497 2024-04-19T02:16:01.539 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.539 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:01.539 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.539 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:01.539 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873454+0000", 2024-04-19T02:16:01.539 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.539 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.539 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.539 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:01.539 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873454+0000", 2024-04-19T02:16:01.539 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.539 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.539 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.540 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:01.540 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873453+0000", 2024-04-19T02:16:01.540 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:01.540 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.540 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.540 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:01.540 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873512+0000", 2024-04-19T02:16:01.540 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.8730999999999997e-05 2024-04-19T02:16:01.540 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.540 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.540 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:01.540 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873518+0000", 2024-04-19T02:16:01.540 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.9789999999999998e-06 2024-04-19T02:16:01.540 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.540 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.541 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:01.541 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873522+0000", 2024-04-19T02:16:01.541 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.0570000000000003e-06 2024-04-19T02:16:01.541 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.541 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.541 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:01.541 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873590+0000", 2024-04-19T02:16:01.541 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.8504999999999995e-05 2024-04-19T02:16:01.541 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.541 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.541 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:01.541 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873709+0000", 2024-04-19T02:16:01.541 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000118497 2024-04-19T02:16:01.541 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.542 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.542 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:01.542 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873881+0000", 2024-04-19T02:16:01.542 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000172129 2024-04-19T02:16:01.542 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.542 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.542 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:01.542 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.874627+0000", 2024-04-19T02:16:01.542 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00074580100000000004 2024-04-19T02:16:01.542 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.542 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.542 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:01.542 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.890478+0000", 2024-04-19T02:16:01.542 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015850672 2024-04-19T02:16:01.543 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.543 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.543 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:01.543 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.890522+0000", 2024-04-19T02:16:01.543 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.4376000000000003e-05 2024-04-19T02:16:01.543 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.543 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.543 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:01.543 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.890557+0000", 2024-04-19T02:16:01.543 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.5151999999999998e-05 2024-04-19T02:16:01.543 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.543 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:01.543 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.543 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.543 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.544 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:18635 5.c 5:3691d6fb:::benchmark_data_smithi121_44835_object18634:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:01.544 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:00.547499+0000", 2024-04-19T02:16:01.544 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.91007161999999997, 2024-04-19T02:16:01.544 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015584394, 2024-04-19T02:16:01.544 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:01.544 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:01.544 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:01.544 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:01.544 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:01.544 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 18635 2024-04-19T02:16:01.544 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.544 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:01.544 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.544 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:01.544 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.547499+0000", 2024-04-19T02:16:01.545 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.545 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.545 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.545 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:01.545 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.547499+0000", 2024-04-19T02:16:01.545 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.545 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.545 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.545 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:01.545 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.547499+0000", 2024-04-19T02:16:01.545 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:01.545 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.545 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.545 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:01.545 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.547592+0000", 2024-04-19T02:16:01.545 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.3144000000000001e-05 2024-04-19T02:16:01.546 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.546 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.546 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:01.546 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.547598+0000", 2024-04-19T02:16:01.546 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.0390000000000001e-06 2024-04-19T02:16:01.546 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.546 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.546 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:01.546 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.547601+0000", 2024-04-19T02:16:01.546 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.5389999999999999e-06 2024-04-19T02:16:01.546 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.546 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.546 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:01.546 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.548268+0000", 2024-04-19T02:16:01.547 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00066695700000000003 2024-04-19T02:16:01.547 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.547 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.547 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:01.547 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.548384+0000", 2024-04-19T02:16:01.547 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000115562 2024-04-19T02:16:01.547 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.547 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.547 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:01.547 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.548510+0000", 2024-04-19T02:16:01.547 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012620900000000001 2024-04-19T02:16:01.547 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.547 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.547 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:01.548 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.549792+0000", 2024-04-19T02:16:01.548 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00128213 2024-04-19T02:16:01.548 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.548 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.548 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:01.548 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.563011+0000", 2024-04-19T02:16:01.548 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.013219244 2024-04-19T02:16:01.548 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.548 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.548 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:01.548 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.563050+0000", 2024-04-19T02:16:01.548 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.8448999999999997e-05 2024-04-19T02:16:01.548 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.548 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.549 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:01.549 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.563083+0000", 2024-04-19T02:16:01.549 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.3402000000000003e-05 2024-04-19T02:16:01.549 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.549 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:01.549 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.549 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.549 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.549 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:18796 5.3 5:cca224f1:::benchmark_data_smithi121_44835_object18795:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:01.549 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:00.596456+0000", 2024-04-19T02:16:01.549 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.86111455599999998, 2024-04-19T02:16:01.549 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015251391, 2024-04-19T02:16:01.549 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:01.549 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:01.549 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:01.550 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:01.550 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:01.550 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 18796 2024-04-19T02:16:01.550 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.550 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:01.550 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.550 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:01.550 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.596456+0000", 2024-04-19T02:16:01.550 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.550 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.550 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.550 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:01.550 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.596456+0000", 2024-04-19T02:16:01.550 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.550 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.550 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.551 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:01.551 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.596455+0000", 2024-04-19T02:16:01.551 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:01.551 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.551 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.551 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:01.551 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.596531+0000", 2024-04-19T02:16:01.551 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.5585000000000002e-05 2024-04-19T02:16:01.551 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.551 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.551 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:01.551 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.596540+0000", 2024-04-19T02:16:01.551 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.5820000000000008e-06 2024-04-19T02:16:01.551 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.552 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.552 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:01.552 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.596548+0000", 2024-04-19T02:16:01.552 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.3869999999999997e-06 2024-04-19T02:16:01.552 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.552 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.552 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:01.552 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.599086+0000", 2024-04-19T02:16:01.552 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.002538135 2024-04-19T02:16:01.552 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.552 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.552 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:01.552 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.599202+0000", 2024-04-19T02:16:01.552 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000115605 2024-04-19T02:16:01.552 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.552 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.553 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:01.553 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.599326+0000", 2024-04-19T02:16:01.553 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012427900000000001 2024-04-19T02:16:01.553 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.553 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.553 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:01.553 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.602295+0000", 2024-04-19T02:16:01.553 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0029694719999999999 2024-04-19T02:16:01.553 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.553 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.553 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:01.553 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.611625+0000", 2024-04-19T02:16:01.553 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0093301180000000001 2024-04-19T02:16:01.553 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.553 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.554 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:01.554 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.611670+0000", 2024-04-19T02:16:01.554 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.4366999999999997e-05 2024-04-19T02:16:01.554 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.554 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.554 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:01.554 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.611707+0000", 2024-04-19T02:16:01.554 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.7518999999999998e-05 2024-04-19T02:16:01.554 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.554 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:01.554 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.554 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.554 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.554 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:18947 5.c 5:37ebacf7:::benchmark_data_smithi121_44835_object18946:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:01.555 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:00.644594+0000", 2024-04-19T02:16:01.555 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.81297622999999997, 2024-04-19T02:16:01.555 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.013756665, 2024-04-19T02:16:01.555 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:01.555 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:01.555 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:01.555 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:01.555 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:01.555 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 18947 2024-04-19T02:16:01.555 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.555 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:01.555 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.555 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:01.555 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.644594+0000", 2024-04-19T02:16:01.555 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.555 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.556 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.556 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:01.556 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.644594+0000", 2024-04-19T02:16:01.556 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.556 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.556 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.556 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:01.556 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.644593+0000", 2024-04-19T02:16:01.556 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:01.556 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.556 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.556 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:01.556 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.644712+0000", 2024-04-19T02:16:01.556 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00011828999999999999 2024-04-19T02:16:01.556 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.556 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.557 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:01.557 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.644723+0000", 2024-04-19T02:16:01.557 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.1099e-05 2024-04-19T02:16:01.557 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.557 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.557 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:01.557 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.644730+0000", 2024-04-19T02:16:01.557 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.0380000000000002e-06 2024-04-19T02:16:01.557 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.557 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.557 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:01.557 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.647756+0000", 2024-04-19T02:16:01.557 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0030264799999999998 2024-04-19T02:16:01.557 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.557 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.558 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:01.558 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.647834+0000", 2024-04-19T02:16:01.558 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.7700999999999993e-05 2024-04-19T02:16:01.558 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.558 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.558 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:01.558 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.647927+0000", 2024-04-19T02:16:01.558 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.3165000000000007e-05 2024-04-19T02:16:01.558 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.558 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.558 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:01.558 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.649508+0000", 2024-04-19T02:16:01.558 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.001580573 2024-04-19T02:16:01.559 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.559 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.559 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:01.559 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.658272+0000", 2024-04-19T02:16:01.559 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0087641899999999998 2024-04-19T02:16:01.559 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.559 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.559 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:01.559 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.658315+0000", 2024-04-19T02:16:01.559 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.3123e-05 2024-04-19T02:16:01.559 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.559 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.559 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:01.559 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.658351+0000", 2024-04-19T02:16:01.559 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.5824000000000001e-05 2024-04-19T02:16:01.560 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.560 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:01.560 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.560 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.560 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.560 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:19164 5.c 5:3be9e189:::benchmark_data_smithi121_44835_object19163:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:01.560 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:00.711074+0000", 2024-04-19T02:16:01.560 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.74649663399999999, 2024-04-19T02:16:01.560 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.013577385000000001, 2024-04-19T02:16:01.560 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:01.560 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:01.560 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:01.560 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:01.560 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:01.560 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 19164 2024-04-19T02:16:01.560 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.561 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:01.561 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.561 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:01.561 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.711074+0000", 2024-04-19T02:16:01.561 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.561 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.561 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.561 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:01.561 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.711074+0000", 2024-04-19T02:16:01.561 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.561 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.561 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.561 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:01.561 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.711073+0000", 2024-04-19T02:16:01.561 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:01.562 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.562 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.562 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:01.562 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.711153+0000", 2024-04-19T02:16:01.562 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.9932999999999995e-05 2024-04-19T02:16:01.562 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.562 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.562 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:01.562 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.711161+0000", 2024-04-19T02:16:01.562 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.2090000000000005e-06 2024-04-19T02:16:01.562 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.562 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.562 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:01.563 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.711170+0000", 2024-04-19T02:16:01.563 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.8789999999999992e-06 2024-04-19T02:16:01.563 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.563 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.563 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:01.563 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.711230+0000", 2024-04-19T02:16:01.563 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.9963999999999997e-05 2024-04-19T02:16:01.563 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.563 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.563 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:01.563 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.711304+0000", 2024-04-19T02:16:01.563 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.4134000000000005e-05 2024-04-19T02:16:01.563 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.563 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.563 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:01.564 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.711380+0000", 2024-04-19T02:16:01.564 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.6012000000000003e-05 2024-04-19T02:16:01.564 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.564 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.564 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:01.564 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.715993+0000", 2024-04-19T02:16:01.564 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0046132990000000004 2024-04-19T02:16:01.564 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.564 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.564 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:01.564 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.724582+0000", 2024-04-19T02:16:01.564 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0085888370000000002 2024-04-19T02:16:01.564 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.564 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.565 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:01.565 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.724626+0000", 2024-04-19T02:16:01.565 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.3964000000000001e-05 2024-04-19T02:16:01.565 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.565 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.565 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:01.565 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.724651+0000", 2024-04-19T02:16:01.565 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.4890000000000001e-05 2024-04-19T02:16:01.565 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.565 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:01.565 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.565 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.565 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.565 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:19998 5.3 5:c6c2fea7:::benchmark_data_smithi121_44835_object19997:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:01.565 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:00.985607+0000", 2024-04-19T02:16:01.566 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.47196301000000002, 2024-04-19T02:16:01.566 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.014005625000000001, 2024-04-19T02:16:01.566 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:01.566 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:01.566 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:01.566 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:01.566 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:01.566 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 19998 2024-04-19T02:16:01.566 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.566 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:01.566 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.566 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:01.566 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.985607+0000", 2024-04-19T02:16:01.566 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.566 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.567 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.567 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:01.567 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.985607+0000", 2024-04-19T02:16:01.567 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.567 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.567 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.567 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:01.567 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.985607+0000", 2024-04-19T02:16:01.567 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:01.567 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.567 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.567 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:01.567 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.985755+0000", 2024-04-19T02:16:01.567 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000148076 2024-04-19T02:16:01.568 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.568 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.568 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:01.568 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.985764+0000", 2024-04-19T02:16:01.568 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.3789999999999995e-06 2024-04-19T02:16:01.568 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.568 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.568 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:01.568 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.985770+0000", 2024-04-19T02:16:01.568 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.0499999999999997e-06 2024-04-19T02:16:01.568 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.568 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.568 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:01.568 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.987212+0000", 2024-04-19T02:16:01.569 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0014413259999999999 2024-04-19T02:16:01.569 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.569 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.569 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:01.569 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.987336+0000", 2024-04-19T02:16:01.569 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012401900000000001 2024-04-19T02:16:01.569 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.569 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.569 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:01.569 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.987474+0000", 2024-04-19T02:16:01.569 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000138431 2024-04-19T02:16:01.569 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.569 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.569 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:01.570 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.989723+0000", 2024-04-19T02:16:01.570 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0022492570000000002 2024-04-19T02:16:01.570 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.570 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.570 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:01.570 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.999533+0000", 2024-04-19T02:16:01.570 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0098098999999999999 2024-04-19T02:16:01.570 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.570 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.570 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:01.570 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.999578+0000", 2024-04-19T02:16:01.570 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.4424e-05 2024-04-19T02:16:01.570 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.571 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.571 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:01.571 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.999613+0000", 2024-04-19T02:16:01.571 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.5231999999999997e-05 2024-04-19T02:16:01.571 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.571 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:01.571 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.571 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.571 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.571 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:20553 5.5 5:a3f892a2:::benchmark_data_smithi121_44835_object20552:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:01.571 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:01.179670+0000", 2024-04-19T02:16:01.571 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.27789996099999997, 2024-04-19T02:16:01.571 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.01588498, 2024-04-19T02:16:01.571 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:01.571 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:01.572 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:01.572 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:01.572 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:01.572 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 20553 2024-04-19T02:16:01.572 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.572 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:01.572 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.572 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:01.572 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.179670+0000", 2024-04-19T02:16:01.572 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.572 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.572 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.572 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:01.572 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.179670+0000", 2024-04-19T02:16:01.572 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.573 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.573 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.573 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:01.573 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.179670+0000", 2024-04-19T02:16:01.573 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:01.573 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.573 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.573 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:01.573 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.179698+0000", 2024-04-19T02:16:01.573 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.7849999999999999e-05 2024-04-19T02:16:01.573 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.573 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.573 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:01.573 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.179710+0000", 2024-04-19T02:16:01.573 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.1992e-05 2024-04-19T02:16:01.574 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.574 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.574 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:01.574 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.179717+0000", 2024-04-19T02:16:01.574 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.7400000000000004e-06 2024-04-19T02:16:01.574 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.574 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.574 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:01.574 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.179760+0000", 2024-04-19T02:16:01.574 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.2169999999999998e-05 2024-04-19T02:16:01.574 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.574 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.574 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:01.574 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.179876+0000", 2024-04-19T02:16:01.574 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000116972 2024-04-19T02:16:01.575 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.575 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.575 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:01.575 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.180055+0000", 2024-04-19T02:16:01.575 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00017899100000000001 2024-04-19T02:16:01.575 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.575 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.575 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:01.575 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.183338+0000", 2024-04-19T02:16:01.575 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0032824719999999998 2024-04-19T02:16:01.575 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.575 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.575 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:01.575 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.195464+0000", 2024-04-19T02:16:01.575 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.012126504999999999 2024-04-19T02:16:01.576 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.576 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.576 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:01.576 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.195516+0000", 2024-04-19T02:16:01.576 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.1622000000000001e-05 2024-04-19T02:16:01.576 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.576 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.576 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:01.576 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.195555+0000", 2024-04-19T02:16:01.576 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.9366999999999998e-05 2024-04-19T02:16:01.576 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.576 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:01.576 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.576 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.576 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.577 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:20997 5.6 5:68aa1358:::benchmark_data_smithi121_44835_object20996:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:01.577 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:01.334236+0000", 2024-04-19T02:16:01.577 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.123334577, 2024-04-19T02:16:01.577 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.014634767, 2024-04-19T02:16:01.577 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:01.577 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:01.577 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:01.577 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:01.577 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:01.577 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 20997 2024-04-19T02:16:01.577 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.577 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:01.577 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.577 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:01.577 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.334236+0000", 2024-04-19T02:16:01.577 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.578 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.578 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.578 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:01.578 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.334236+0000", 2024-04-19T02:16:01.578 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:01.578 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.578 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.578 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:01.578 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.334235+0000", 2024-04-19T02:16:01.578 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:01.578 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.578 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.578 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:01.578 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.334313+0000", 2024-04-19T02:16:01.579 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.7305999999999995e-05 2024-04-19T02:16:01.579 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.579 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.579 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:01.579 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.334322+0000", 2024-04-19T02:16:01.579 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.0040000000000005e-06 2024-04-19T02:16:01.579 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.579 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.579 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:01.579 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.334327+0000", 2024-04-19T02:16:01.579 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.6670000000000001e-06 2024-04-19T02:16:01.579 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.579 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.579 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:01.579 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.334358+0000", 2024-04-19T02:16:01.579 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.0368000000000001e-05 2024-04-19T02:16:01.580 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.580 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.580 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:01.580 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.334436+0000", 2024-04-19T02:16:01.580 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.8788000000000005e-05 2024-04-19T02:16:01.580 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.580 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.580 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:01.580 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.334515+0000", 2024-04-19T02:16:01.580 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.8632000000000002e-05 2024-04-19T02:16:01.580 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.580 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.580 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:01.580 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.337171+0000", 2024-04-19T02:16:01.580 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0026560989999999999 2024-04-19T02:16:01.581 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.581 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.581 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:01.581 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.348786+0000", 2024-04-19T02:16:01.581 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.011614585 2024-04-19T02:16:01.581 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.581 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.581 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:01.581 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.348832+0000", 2024-04-19T02:16:01.581 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.6007000000000002e-05 2024-04-19T02:16:01.581 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:01.581 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:01.581 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:01.581 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.348871+0000", 2024-04-19T02:16:01.581 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.8958999999999997e-05 2024-04-19T02:16:01.582 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.582 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:01.582 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.582 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:01.582 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:01.582 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-04-19T02:16:01.583 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:01.583+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:01.583 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:16:01.584 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:16:01.584 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:16:01.603 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2: {} 2024-04-19T02:16:01.604 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:16:01.604 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:16:01.604 INFO:teuthology.orchestra.run.smithi121.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:16:01.684 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:01.685+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:01.753 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:01.753 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:01.767 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:16:01.810 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:01.811+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:01.887 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:01.887+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:01.936 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:01.936 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:01.951 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:16:01.983 INFO:teuthology.orchestra.run.smithi121.stderr:nodeep-scrub is unset 2024-04-19T02:16:01.986 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:01.986+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:02.025 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 7 16 23089 23073 205.994 186.312 0.00462528 0.00484906 2024-04-19T02:16:02.088 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:02.089+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:02.159 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:02.159 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:02.173 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:16:02.190 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:02.190+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:02.290 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:02.291+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:02.341 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:02.341 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:02.357 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:16:02.390 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:02.391+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:02.492 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:02.492+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:02.524 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:02.524 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:02.537 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:16:02.592 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:02.593+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:02.694 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:02.694+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:02.704 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:02.704 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:02.717 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:16:02.795 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:02.796+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:02.895 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:02.896 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:02.896 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:02.896+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:02.909 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:16:02.997 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:02.998+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:03.025 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 8 16 26070 26054 203.531 186.312 0.00300535 0.00491015 2024-04-19T02:16:03.098 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:03.099+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:03.128 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:03.129 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:03.143 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:16:03.199 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:03.200+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:03.300 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:03.301+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:03.361 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:03.361 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:03.376 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:16:03.401 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:03.401+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:03.502 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:03.503+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:03.546 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:03.546 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:03.558 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:16:03.604 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:03.604+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:03.615 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:16:03.705 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:03.706+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:03.732 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:03.732 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:03.745 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:16:03.768 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:16:03.789 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:16:03.806 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:03.806+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:03.809 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2: {} 2024-04-19T02:16:03.811 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:16:03.811 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:16:03.811 INFO:teuthology.orchestra.run.smithi121.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:16:03.907 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:03.907+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:03.955 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:16:03.955 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-04-19T02:16:03.955 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-04-19T02:16:03.955 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:16:03.955 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.955 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:03.955 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269657+0000", 2024-04-19T02:16:03.955 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.682848757999999, 2024-04-19T02:16:03.955 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018569239000000001, 2024-04-19T02:16:03.955 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:03.955 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:03.955 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:03.956 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.956 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:03.956 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269657+0000", 2024-04-19T02:16:03.956 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:03.956 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.956 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.956 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:03.956 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269657+0000", 2024-04-19T02:16:03.956 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:03.956 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.956 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.956 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:03.956 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269656+0000", 2024-04-19T02:16:03.956 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:03.957 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.957 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.957 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:03.957 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269666+0000", 2024-04-19T02:16:03.957 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.628e-06 2024-04-19T02:16:03.957 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.957 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.957 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:03.957 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269673+0000", 2024-04-19T02:16:03.957 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1690000000000003e-06 2024-04-19T02:16:03.957 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.957 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.957 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:03.957 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269680+0000", 2024-04-19T02:16:03.957 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8940000000000004e-06 2024-04-19T02:16:03.958 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.958 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.958 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:03.958 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269788+0000", 2024-04-19T02:16:03.958 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107725 2024-04-19T02:16:03.958 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.958 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.958 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:03.958 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269791+0000", 2024-04-19T02:16:03.958 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9699999999999999e-06 2024-04-19T02:16:03.958 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.958 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.958 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:03.958 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.277693+0000", 2024-04-19T02:16:03.959 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079026979999999997 2024-04-19T02:16:03.959 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.959 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.959 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:03.959 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.277838+0000", 2024-04-19T02:16:03.959 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014444699999999999 2024-04-19T02:16:03.959 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.959 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.959 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:03.959 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.277996+0000", 2024-04-19T02:16:03.959 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015794499999999999 2024-04-19T02:16:03.959 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.959 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.959 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:03.959 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282534+0000", 2024-04-19T02:16:03.959 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045383070000000001 2024-04-19T02:16:03.960 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.960 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.960 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:03.960 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288134+0000", 2024-04-19T02:16:03.960 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0056005020000000003 2024-04-19T02:16:03.960 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.960 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.960 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:03.960 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288187+0000", 2024-04-19T02:16:03.960 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2884999999999999e-05 2024-04-19T02:16:03.960 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.960 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.960 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:03.960 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288226+0000", 2024-04-19T02:16:03.960 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8458999999999999e-05 2024-04-19T02:16:03.960 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:03.960 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:03.961 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:03.961 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.961 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.961 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:03.961 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269684+0000", 2024-04-19T02:16:03.961 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.682821189000002, 2024-04-19T02:16:03.961 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019077493000000001, 2024-04-19T02:16:03.961 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:03.961 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:03.961 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:03.961 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.961 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:03.961 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269684+0000", 2024-04-19T02:16:03.961 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:03.961 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.961 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.961 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:03.962 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269684+0000", 2024-04-19T02:16:03.962 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:03.962 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.962 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.962 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:03.962 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269684+0000", 2024-04-19T02:16:03.962 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:03.962 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.962 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.962 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:03.962 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269686+0000", 2024-04-19T02:16:03.962 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2740000000000002e-06 2024-04-19T02:16:03.962 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.962 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.963 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:03.963 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269690+0000", 2024-04-19T02:16:03.963 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8829999999999999e-06 2024-04-19T02:16:03.963 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.963 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.963 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:03.963 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269693+0000", 2024-04-19T02:16:03.963 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4199999999999999e-06 2024-04-19T02:16:03.963 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.963 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.963 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:03.963 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269875+0000", 2024-04-19T02:16:03.963 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018114800000000001 2024-04-19T02:16:03.963 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.963 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.963 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:03.964 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269880+0000", 2024-04-19T02:16:03.964 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5620000000000003e-06 2024-04-19T02:16:03.964 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.964 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.964 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:03.964 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278610+0000", 2024-04-19T02:16:03.964 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.008729423 2024-04-19T02:16:03.964 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.964 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.964 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:03.964 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278724+0000", 2024-04-19T02:16:03.964 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011428400000000001 2024-04-19T02:16:03.964 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.965 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.965 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:03.965 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278860+0000", 2024-04-19T02:16:03.965 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013601600000000001 2024-04-19T02:16:03.965 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.965 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.965 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:03.965 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282632+0000", 2024-04-19T02:16:03.965 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037722889999999999 2024-04-19T02:16:03.965 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.965 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.965 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:03.966 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288712+0000", 2024-04-19T02:16:03.966 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0060799599999999997 2024-04-19T02:16:03.966 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.966 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.966 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:03.966 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288742+0000", 2024-04-19T02:16:03.966 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0048000000000001e-05 2024-04-19T02:16:03.966 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.966 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.966 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:03.966 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288762+0000", 2024-04-19T02:16:03.966 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9482000000000001e-05 2024-04-19T02:16:03.966 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:03.966 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:03.966 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:03.967 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.967 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.967 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:12 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:03.967 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269696+0000", 2024-04-19T02:16:03.967 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.682809110999997, 2024-04-19T02:16:03.967 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018617073000000001, 2024-04-19T02:16:03.967 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:03.967 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:03.967 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:03.967 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.967 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:03.967 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269696+0000", 2024-04-19T02:16:03.967 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:03.967 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.968 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.968 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:03.968 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269696+0000", 2024-04-19T02:16:03.968 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:03.968 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.968 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.968 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:03.968 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269696+0000", 2024-04-19T02:16:03.968 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967296 2024-04-19T02:16:03.968 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.968 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.968 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:03.968 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269698+0000", 2024-04-19T02:16:03.968 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9570000000000001e-06 2024-04-19T02:16:03.968 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.969 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.969 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:03.969 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269702+0000", 2024-04-19T02:16:03.969 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2459999999999997e-06 2024-04-19T02:16:03.969 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.969 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.969 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:03.969 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269708+0000", 2024-04-19T02:16:03.969 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2709999999999998e-06 2024-04-19T02:16:03.969 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.969 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.969 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:03.969 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269749+0000", 2024-04-19T02:16:03.969 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0500000000000002e-05 2024-04-19T02:16:03.969 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.970 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.970 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-04-19T02:16:03.970 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269754+0000", 2024-04-19T02:16:03.970 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.502e-06 2024-04-19T02:16:03.970 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.970 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.970 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:03.970 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.277984+0000", 2024-04-19T02:16:03.970 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0082293049999999993 2024-04-19T02:16:03.970 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.970 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.970 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:03.970 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278489+0000", 2024-04-19T02:16:03.970 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00050499699999999998 2024-04-19T02:16:03.970 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.971 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.971 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:03.971 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278649+0000", 2024-04-19T02:16:03.971 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016012000000000001 2024-04-19T02:16:03.971 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.971 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.971 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:03.971 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286855+0000", 2024-04-19T02:16:03.971 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0082066139999999992 2024-04-19T02:16:03.971 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.971 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.971 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:03.971 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288248+0000", 2024-04-19T02:16:03.971 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001392838 2024-04-19T02:16:03.971 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.972 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.972 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:03.972 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288287+0000", 2024-04-19T02:16:03.972 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8516000000000002e-05 2024-04-19T02:16:03.972 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.972 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.972 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:03.972 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288313+0000", 2024-04-19T02:16:03.972 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6420000000000001e-05 2024-04-19T02:16:03.972 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:03.972 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:03.972 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:03.972 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.972 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.972 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:03.973 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269753+0000", 2024-04-19T02:16:03.973 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.682751805999999, 2024-04-19T02:16:03.973 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019088755999999998, 2024-04-19T02:16:03.973 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:03.973 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:03.973 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:03.973 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.973 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:03.973 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269753+0000", 2024-04-19T02:16:03.973 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:03.973 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.973 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.973 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:03.973 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269753+0000", 2024-04-19T02:16:03.973 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:03.974 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.974 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.974 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:03.974 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269753+0000", 2024-04-19T02:16:03.974 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:03.974 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.974 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.974 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:03.974 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269770+0000", 2024-04-19T02:16:03.974 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7150999999999999e-05 2024-04-19T02:16:03.974 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.974 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.974 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:03.974 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269779+0000", 2024-04-19T02:16:03.975 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4139999999999994e-06 2024-04-19T02:16:03.975 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.975 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.975 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:03.975 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269786+0000", 2024-04-19T02:16:03.975 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.537e-06 2024-04-19T02:16:03.975 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.975 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.975 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:03.975 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269913+0000", 2024-04-19T02:16:03.975 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012699599999999999 2024-04-19T02:16:03.975 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.975 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.975 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:03.975 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269916+0000", 2024-04-19T02:16:03.976 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9280000000000002e-06 2024-04-19T02:16:03.976 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.976 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.976 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:03.976 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.279143+0000", 2024-04-19T02:16:03.976 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0092270129999999992 2024-04-19T02:16:03.976 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.976 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.976 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:03.976 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.279223+0000", 2024-04-19T02:16:03.976 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0050999999999996e-05 2024-04-19T02:16:03.976 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.976 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.977 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:03.977 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.279364+0000", 2024-04-19T02:16:03.977 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000140934 2024-04-19T02:16:03.977 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.977 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.977 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:03.977 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286189+0000", 2024-04-19T02:16:03.977 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.006825327 2024-04-19T02:16:03.977 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.977 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.977 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:03.977 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288791+0000", 2024-04-19T02:16:03.977 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026021500000000001 2024-04-19T02:16:03.977 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.977 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.978 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:03.978 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288822+0000", 2024-04-19T02:16:03.978 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0162999999999999e-05 2024-04-19T02:16:03.978 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.978 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.978 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:03.978 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288842+0000", 2024-04-19T02:16:03.978 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0644000000000001e-05 2024-04-19T02:16:03.978 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:03.978 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:03.978 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:03.978 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.978 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.978 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:03.978 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:16:03.979 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.682713331999999, 2024-04-19T02:16:03.979 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020307345000000001, 2024-04-19T02:16:03.979 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:03.979 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:03.979 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:03.979 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.979 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:03.979 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:16:03.979 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:03.979 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.979 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.979 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:03.979 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:16:03.979 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:03.979 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.979 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.980 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:03.980 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269791+0000", 2024-04-19T02:16:03.980 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:03.980 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.980 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.980 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:03.980 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269795+0000", 2024-04-19T02:16:03.980 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5619999999999999e-06 2024-04-19T02:16:03.980 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.980 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.980 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:03.980 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269802+0000", 2024-04-19T02:16:03.980 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8469999999999998e-06 2024-04-19T02:16:03.981 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.981 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.981 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:03.981 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269807+0000", 2024-04-19T02:16:03.981 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.707e-06 2024-04-19T02:16:03.981 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.981 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.981 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:03.981 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269950+0000", 2024-04-19T02:16:03.981 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000143313 2024-04-19T02:16:03.981 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.981 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.981 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:03.981 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269955+0000", 2024-04-19T02:16:03.982 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4029999999999998e-06 2024-04-19T02:16:03.982 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.982 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.982 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:03.982 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.283806+0000", 2024-04-19T02:16:03.982 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013850220999999999 2024-04-19T02:16:03.982 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.982 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.982 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:03.982 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.283896+0000", 2024-04-19T02:16:03.982 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0261999999999997e-05 2024-04-19T02:16:03.982 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.982 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.983 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:03.983 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284022+0000", 2024-04-19T02:16:03.983 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012641200000000001 2024-04-19T02:16:03.983 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.983 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.983 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:03.983 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289066+0000", 2024-04-19T02:16:03.983 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050438490000000004 2024-04-19T02:16:03.983 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.983 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.983 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:03.983 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290011+0000", 2024-04-19T02:16:03.983 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00094490700000000004 2024-04-19T02:16:03.983 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.984 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.984 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:03.984 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290054+0000", 2024-04-19T02:16:03.984 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.337e-05 2024-04-19T02:16:03.984 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.984 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.984 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:03.984 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290099+0000", 2024-04-19T02:16:03.984 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4987999999999997e-05 2024-04-19T02:16:03.984 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:03.984 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:03.984 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:03.984 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.984 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.985 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:03.985 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:16:03.985 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.682635402000003, 2024-04-19T02:16:03.985 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020331023, 2024-04-19T02:16:03.985 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:03.985 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:03.985 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:03.985 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.985 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:03.985 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:16:03.985 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:03.985 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.985 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.985 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:03.985 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:16:03.986 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:03.986 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.986 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.986 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:03.986 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269869+0000", 2024-04-19T02:16:03.986 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:03.986 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.986 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.986 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:03.986 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269873+0000", 2024-04-19T02:16:03.986 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0219999999999998e-06 2024-04-19T02:16:03.986 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.986 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.986 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:03.987 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269881+0000", 2024-04-19T02:16:03.987 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.79e-06 2024-04-19T02:16:03.987 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.987 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:03.987 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269887+0000", 2024-04-19T02:16:03.987 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7899999999999996e-06 2024-04-19T02:16:03.987 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.987 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:03.987 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269983+0000", 2024-04-19T02:16:03.987 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6057000000000005e-05 2024-04-19T02:16:03.987 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.987 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:03.987 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269986+0000", 2024-04-19T02:16:03.988 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9220000000000001e-06 2024-04-19T02:16:03.988 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.988 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:03.988 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284350+0000", 2024-04-19T02:16:03.988 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014364335000000001 2024-04-19T02:16:03.988 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.988 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:03.988 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284664+0000", 2024-04-19T02:16:03.988 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000313646 2024-04-19T02:16:03.988 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.988 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:03.988 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284794+0000", 2024-04-19T02:16:03.989 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129839 2024-04-19T02:16:03.989 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.989 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.989 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:03.989 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289107+0000", 2024-04-19T02:16:03.989 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0043127060000000004 2024-04-19T02:16:03.989 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.989 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.989 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:03.989 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290108+0000", 2024-04-19T02:16:03.989 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0010010590000000001 2024-04-19T02:16:03.989 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.989 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.989 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:03.989 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290144+0000", 2024-04-19T02:16:03.989 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6709999999999999e-05 2024-04-19T02:16:03.990 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.990 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.990 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:03.990 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290201+0000", 2024-04-19T02:16:03.990 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6654999999999999e-05 2024-04-19T02:16:03.990 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:03.990 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:03.990 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:03.990 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.990 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.990 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:03.990 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:16:03.990 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.682593060999999, 2024-04-19T02:16:03.990 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020507241999999998, 2024-04-19T02:16:03.991 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:03.991 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:03.991 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:03.991 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.991 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:03.991 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:16:03.991 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:03.991 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.991 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.991 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:03.991 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:16:03.992 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:03.992 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.992 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.992 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:03.992 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:16:03.992 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:03.992 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.992 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.992 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:03.992 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269915+0000", 2024-04-19T02:16:03.992 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.472e-06 2024-04-19T02:16:03.992 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.992 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.992 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:03.992 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269928+0000", 2024-04-19T02:16:03.993 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2979000000000001e-05 2024-04-19T02:16:03.993 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.993 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.993 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:03.993 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269935+0000", 2024-04-19T02:16:03.993 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8859999999999998e-06 2024-04-19T02:16:03.993 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.993 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.993 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:03.993 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270009+0000", 2024-04-19T02:16:03.993 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3429000000000005e-05 2024-04-19T02:16:03.993 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.993 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.993 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:03.993 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270013+0000", 2024-04-19T02:16:03.994 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2590000000000002e-06 2024-04-19T02:16:03.994 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.994 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.994 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:03.994 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285375+0000", 2024-04-19T02:16:03.994 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015362275999999999 2024-04-19T02:16:03.994 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.994 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.994 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:03.994 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285451+0000", 2024-04-19T02:16:03.994 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5338000000000003e-05 2024-04-19T02:16:03.994 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.994 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.994 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:03.995 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285562+0000", 2024-04-19T02:16:03.995 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000111285 2024-04-19T02:16:03.995 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.995 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:03.995 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289134+0000", 2024-04-19T02:16:03.995 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035719670000000001 2024-04-19T02:16:03.995 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.995 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:03.995 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290341+0000", 2024-04-19T02:16:03.995 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012074500000000001 2024-04-19T02:16:03.995 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.996 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:03.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290383+0000", 2024-04-19T02:16:03.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1386e-05 2024-04-19T02:16:03.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.996 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:03.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290419+0000", 2024-04-19T02:16:03.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6884000000000001e-05 2024-04-19T02:16:03.996 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:03.996 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:03.996 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:03.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.996 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:03.996 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269945+0000", 2024-04-19T02:16:03.997 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.682560479000003, 2024-04-19T02:16:03.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019709098000000001, 2024-04-19T02:16:03.997 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:03.997 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:03.997 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:03.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:03.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269945+0000", 2024-04-19T02:16:03.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:03.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:03.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269945+0000", 2024-04-19T02:16:03.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:03.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.998 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:03.998 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269944+0000", 2024-04-19T02:16:03.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:03.998 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.998 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:03.998 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269965+0000", 2024-04-19T02:16:03.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0803999999999999e-05 2024-04-19T02:16:03.998 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.998 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:03.998 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269973+0000", 2024-04-19T02:16:03.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3560000000000004e-06 2024-04-19T02:16:03.998 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:03.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269982+0000", 2024-04-19T02:16:03.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9600000000000006e-06 2024-04-19T02:16:03.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:03.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270014+0000", 2024-04-19T02:16:03.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2913000000000001e-05 2024-04-19T02:16:03.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:03.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:03.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:03.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270018+0000", 2024-04-19T02:16:03.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2200000000000001e-06 2024-04-19T02:16:03.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.000 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:04.000 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278999+0000", 2024-04-19T02:16:04.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0089818009999999993 2024-04-19T02:16:04.000 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.000 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:04.000 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.279088+0000", 2024-04-19T02:16:04.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8988999999999998e-05 2024-04-19T02:16:04.000 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.000 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:04.000 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.280160+0000", 2024-04-19T02:16:04.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001071572 2024-04-19T02:16:04.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:04.001 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288342+0000", 2024-04-19T02:16:04.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.008182468 2024-04-19T02:16:04.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:04.001 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289545+0000", 2024-04-19T02:16:04.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012026739999999999 2024-04-19T02:16:04.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:04.001 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289608+0000", 2024-04-19T02:16:04.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2904999999999995e-05 2024-04-19T02:16:04.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.002 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:04.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289654+0000", 2024-04-19T02:16:04.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5850000000000003e-05 2024-04-19T02:16:04.002 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:04.002 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:04.002 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:04.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.002 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:04.002 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:16:04.002 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.682514800999996, 2024-04-19T02:16:04.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022007204999999998, 2024-04-19T02:16:04.003 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:04.003 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:04.003 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:04.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:04.003 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:16:04.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:04.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:04.003 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:16:04.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:04.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.004 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:04.004 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269990+0000", 2024-04-19T02:16:04.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:04.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.004 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:04.004 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269999+0000", 2024-04-19T02:16:04.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9539999999999993e-06 2024-04-19T02:16:04.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.004 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:04.004 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270006+0000", 2024-04-19T02:16:04.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.216e-06 2024-04-19T02:16:04.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.005 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:04.005 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270012+0000", 2024-04-19T02:16:04.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5049999999999998e-06 2024-04-19T02:16:04.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.005 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:04.005 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270058+0000", 2024-04-19T02:16:04.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.634e-05 2024-04-19T02:16:04.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.005 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:04.005 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270064+0000", 2024-04-19T02:16:04.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0669999999999997e-06 2024-04-19T02:16:04.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:04.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287159+0000", 2024-04-19T02:16:04.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017095086999999998 2024-04-19T02:16:04.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:04.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287254+0000", 2024-04-19T02:16:04.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4716000000000006e-05 2024-04-19T02:16:04.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:04.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287389+0000", 2024-04-19T02:16:04.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013511900000000001 2024-04-19T02:16:04.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.007 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:04.007 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290481+0000", 2024-04-19T02:16:04.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030920169999999999 2024-04-19T02:16:04.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.007 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:04.007 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291931+0000", 2024-04-19T02:16:04.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001450118 2024-04-19T02:16:04.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.007 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:04.007 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291960+0000", 2024-04-19T02:16:04.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9096000000000001e-05 2024-04-19T02:16:04.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:04.008 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291998+0000", 2024-04-19T02:16:04.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7514e-05 2024-04-19T02:16:04.008 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:04.008 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:04.008 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:04.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.008 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:04.008 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:04.008 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.682454229999998, 2024-04-19T02:16:04.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020759494999999999, 2024-04-19T02:16:04.009 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:04.009 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:04.009 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:04.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:04.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:04.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:04.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:04.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:04.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:04.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.010 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:04.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:04.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:04.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.010 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:04.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270054+0000", 2024-04-19T02:16:04.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.27e-06 2024-04-19T02:16:04.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.010 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:04.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270061+0000", 2024-04-19T02:16:04.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1289999999999998e-06 2024-04-19T02:16:04.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.011 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:04.011 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270067+0000", 2024-04-19T02:16:04.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.207e-06 2024-04-19T02:16:04.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.011 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:04.011 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270105+0000", 2024-04-19T02:16:04.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7549999999999998e-05 2024-04-19T02:16:04.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.011 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:04.011 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270112+0000", 2024-04-19T02:16:04.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3200000000000002e-06 2024-04-19T02:16:04.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.012 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:04.012 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282454+0000", 2024-04-19T02:16:04.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012341569 2024-04-19T02:16:04.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.012 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:04.012 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282740+0000", 2024-04-19T02:16:04.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000286481 2024-04-19T02:16:04.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.012 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:04.012 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282879+0000", 2024-04-19T02:16:04.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013887799999999999 2024-04-19T02:16:04.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:04.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290325+0000", 2024-04-19T02:16:04.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074459779999999998 2024-04-19T02:16:04.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:04.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290759+0000", 2024-04-19T02:16:04.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000433688 2024-04-19T02:16:04.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:04.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290789+0000", 2024-04-19T02:16:04.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9960000000000001e-05 2024-04-19T02:16:04.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:04.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290811+0000", 2024-04-19T02:16:04.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1965999999999999e-05 2024-04-19T02:16:04.014 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:04.014 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:04.014 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:04.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.014 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:04.014 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270078+0000", 2024-04-19T02:16:04.015 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.682427777000001, 2024-04-19T02:16:04.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018194683, 2024-04-19T02:16:04.015 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:04.015 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:04.015 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:04.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:04.015 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270078+0000", 2024-04-19T02:16:04.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:04.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:04.015 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270078+0000", 2024-04-19T02:16:04.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:04.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:04.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270077+0000", 2024-04-19T02:16:04.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:04.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:04.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270080+0000", 2024-04-19T02:16:04.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8389999999999998e-06 2024-04-19T02:16:04.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:04.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270086+0000", 2024-04-19T02:16:04.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6160000000000001e-06 2024-04-19T02:16:04.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.017 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:04.017 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270091+0000", 2024-04-19T02:16:04.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1390000000000003e-06 2024-04-19T02:16:04.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.017 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:04.017 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270124+0000", 2024-04-19T02:16:04.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3359999999999999e-05 2024-04-19T02:16:04.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.017 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-04-19T02:16:04.017 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270127+0000", 2024-04-19T02:16:04.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.219e-06 2024-04-19T02:16:04.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:04.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.277938+0000", 2024-04-19T02:16:04.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0078111559999999997 2024-04-19T02:16:04.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:04.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278413+0000", 2024-04-19T02:16:04.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00047432600000000001 2024-04-19T02:16:04.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:04.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278540+0000", 2024-04-19T02:16:04.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012753299999999999 2024-04-19T02:16:04.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:04.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.283045+0000", 2024-04-19T02:16:04.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045051580000000004 2024-04-19T02:16:04.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:04.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288192+0000", 2024-04-19T02:16:04.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051468210000000002 2024-04-19T02:16:04.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:04.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288239+0000", 2024-04-19T02:16:04.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7089999999999998e-05 2024-04-19T02:16:04.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.020 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:04.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288272+0000", 2024-04-19T02:16:04.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2799999999999998e-05 2024-04-19T02:16:04.020 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:04.020 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:04.020 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:04.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.020 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:04.020 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:16:04.021 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.682404024999997, 2024-04-19T02:16:04.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020837887999999999, 2024-04-19T02:16:04.021 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:04.021 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:04.021 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:04.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:04.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:16:04.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:04.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:04.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:16:04.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:04.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:04.022 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:16:04.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:04.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.022 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:04.022 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270109+0000", 2024-04-19T02:16:04.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3110000000000006e-06 2024-04-19T02:16:04.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.022 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:04.022 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270117+0000", 2024-04-19T02:16:04.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0479999999999999e-06 2024-04-19T02:16:04.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:04.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270123+0000", 2024-04-19T02:16:04.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5500000000000002e-06 2024-04-19T02:16:04.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:04.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270150+0000", 2024-04-19T02:16:04.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7712000000000002e-05 2024-04-19T02:16:04.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:04.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270153+0000", 2024-04-19T02:16:04.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6089999999999999e-06 2024-04-19T02:16:04.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:04.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285958+0000", 2024-04-19T02:16:04.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015805274000000001 2024-04-19T02:16:04.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:04.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286126+0000", 2024-04-19T02:16:04.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016765700000000001 2024-04-19T02:16:04.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:04.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286296+0000", 2024-04-19T02:16:04.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017007 2024-04-19T02:16:04.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:04.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290426+0000", 2024-04-19T02:16:04.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041299839999999997 2024-04-19T02:16:04.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:04.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290867+0000", 2024-04-19T02:16:04.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00044083300000000001 2024-04-19T02:16:04.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:04.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290900+0000", 2024-04-19T02:16:04.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3380000000000002e-05 2024-04-19T02:16:04.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.026 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:04.026 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290939+0000", 2024-04-19T02:16:04.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8970000000000001e-05 2024-04-19T02:16:04.026 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:04.026 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:04.026 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:04.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.026 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:20 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:04.026 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270161+0000", 2024-04-19T02:16:04.026 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.682344336, 2024-04-19T02:16:04.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018061383, 2024-04-19T02:16:04.026 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:04.026 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:04.026 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:04.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:04.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270161+0000", 2024-04-19T02:16:04.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:04.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:04.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270161+0000", 2024-04-19T02:16:04.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:04.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:04.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270161+0000", 2024-04-19T02:16:04.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:04.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:04.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270164+0000", 2024-04-19T02:16:04.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3000000000000002e-06 2024-04-19T02:16:04.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:04.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270170+0000", 2024-04-19T02:16:04.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2310000000000001e-06 2024-04-19T02:16:04.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:04.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270180+0000", 2024-04-19T02:16:04.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9320000000000008e-06 2024-04-19T02:16:04.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:04.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270214+0000", 2024-04-19T02:16:04.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4048999999999999e-05 2024-04-19T02:16:04.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-04-19T02:16:04.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270220+0000", 2024-04-19T02:16:04.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7769999999999999e-06 2024-04-19T02:16:04.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.030 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:04.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.277220+0000", 2024-04-19T02:16:04.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0070006759999999999 2024-04-19T02:16:04.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.030 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:04.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.277341+0000", 2024-04-19T02:16:04.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120758 2024-04-19T02:16:04.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.030 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:04.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.277480+0000", 2024-04-19T02:16:04.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013903900000000001 2024-04-19T02:16:04.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:04.031 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282351+0000", 2024-04-19T02:16:04.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0048703110000000004 2024-04-19T02:16:04.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:04.031 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288147+0000", 2024-04-19T02:16:04.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0057962500000000002 2024-04-19T02:16:04.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:04.031 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288190+0000", 2024-04-19T02:16:04.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2998999999999999e-05 2024-04-19T02:16:04.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:04.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288222+0000", 2024-04-19T02:16:04.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2499999999999997e-05 2024-04-19T02:16:04.032 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:04.032 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:04.032 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:04.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.032 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:21 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:04.032 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:16:04.032 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.682315353, 2024-04-19T02:16:04.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020833187999999999, 2024-04-19T02:16:04.032 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:04.032 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:16:04.033 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:04.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:04.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:16:04.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:04.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:04.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:16:04.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:04.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:04.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270189+0000", 2024-04-19T02:16:04.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:04.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:04.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270192+0000", 2024-04-19T02:16:04.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7549999999999999e-06 2024-04-19T02:16:04.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:04.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270198+0000", 2024-04-19T02:16:04.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0859999999999998e-06 2024-04-19T02:16:04.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:04.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270204+0000", 2024-04-19T02:16:04.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1970000000000004e-06 2024-04-19T02:16:04.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.035 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:04.035 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270238+0000", 2024-04-19T02:16:04.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4282000000000001e-05 2024-04-19T02:16:04.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.035 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:04.035 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270240+0000", 2024-04-19T02:16:04.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3099999999999999e-06 2024-04-19T02:16:04.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.035 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:04.035 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287131+0000", 2024-04-19T02:16:04.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01689104 2024-04-19T02:16:04.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.036 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:04.036 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287262+0000", 2024-04-19T02:16:04.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130347 2024-04-19T02:16:04.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.036 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:04.036 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291023+0000", 2024-04-19T02:16:04.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037616350000000002 2024-04-19T02:16:04.036 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:04.036 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:04.036 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:04.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.037 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:2280 5.d 5:bbae9ebc:::benchmark_data_smithi121_44835_object2279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:16:04.037 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:55.642317+0000", 2024-04-19T02:16:04.037 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.3101878229999997, 2024-04-19T02:16:04.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017373597000000001, 2024-04-19T02:16:04.037 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:04.037 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:04.037 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:04.037 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:04.037 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:04.037 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 2280 2024-04-19T02:16:04.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.037 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:04.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:04.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.642317+0000", 2024-04-19T02:16:04.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:04.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:04.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.642317+0000", 2024-04-19T02:16:04.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:04.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:04.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.642317+0000", 2024-04-19T02:16:04.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:04.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:04.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.642392+0000", 2024-04-19T02:16:04.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4684999999999994e-05 2024-04-19T02:16:04.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:04.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.642397+0000", 2024-04-19T02:16:04.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3009999999999997e-06 2024-04-19T02:16:04.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:04.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.642401+0000", 2024-04-19T02:16:04.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5389999999999999e-06 2024-04-19T02:16:04.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.040 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:04.040 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.642704+0000", 2024-04-19T02:16:04.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00030363699999999999 2024-04-19T02:16:04.040 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.040 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:04.040 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.642836+0000", 2024-04-19T02:16:04.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000132259 2024-04-19T02:16:04.040 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.040 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:04.040 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.642987+0000", 2024-04-19T02:16:04.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015096 2024-04-19T02:16:04.040 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:04.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.649071+0000", 2024-04-19T02:16:04.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0060841189999999998 2024-04-19T02:16:04.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:04.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.659605+0000", 2024-04-19T02:16:04.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010533722000000001 2024-04-19T02:16:04.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:04.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.659652+0000", 2024-04-19T02:16:04.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7148999999999999e-05 2024-04-19T02:16:04.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.042 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:04.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.659691+0000", 2024-04-19T02:16:04.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8724999999999999e-05 2024-04-19T02:16:04.042 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:04.042 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:04.042 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:04.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.042 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:2285 5.d 5:b310a433:::benchmark_data_smithi121_44835_object2284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:16:04.042 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:55.643557+0000", 2024-04-19T02:16:04.042 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.3089486309999998, 2024-04-19T02:16:04.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018865537000000002, 2024-04-19T02:16:04.043 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:04.043 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:04.043 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:04.043 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:04.043 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:04.043 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 2285 2024-04-19T02:16:04.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.043 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:04.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:04.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643557+0000", 2024-04-19T02:16:04.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:04.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:04.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643557+0000", 2024-04-19T02:16:04.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:04.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:04.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643556+0000", 2024-04-19T02:16:04.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:04.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:04.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643625+0000", 2024-04-19T02:16:04.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9393000000000005e-05 2024-04-19T02:16:04.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:04.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643634+0000", 2024-04-19T02:16:04.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.14e-06 2024-04-19T02:16:04.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.045 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:04.045 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643640+0000", 2024-04-19T02:16:04.045 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.601e-06 2024-04-19T02:16:04.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.045 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:04.045 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643669+0000", 2024-04-19T02:16:04.045 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9292999999999999e-05 2024-04-19T02:16:04.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.045 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:04.045 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643760+0000", 2024-04-19T02:16:04.045 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0526999999999996e-05 2024-04-19T02:16:04.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:04.046 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643892+0000", 2024-04-19T02:16:04.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000131607 2024-04-19T02:16:04.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:04.046 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.649122+0000", 2024-04-19T02:16:04.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052308279999999999 2024-04-19T02:16:04.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:04.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.662321+0000", 2024-04-19T02:16:04.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013198774999999999 2024-04-19T02:16:04.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:04.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.662385+0000", 2024-04-19T02:16:04.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4261e-05 2024-04-19T02:16:04.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:04.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.662422+0000", 2024-04-19T02:16:04.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.676e-05 2024-04-19T02:16:04.047 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:04.047 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:04.047 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:04.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.048 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:16494 5.7 5:e2c19dca:::benchmark_data_smithi121_44835_object16493:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:04.048 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.871684+0000", 2024-04-19T02:16:04.048 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.0808216980000003, 2024-04-19T02:16:04.048 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019343257999999999, 2024-04-19T02:16:04.048 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:04.048 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:04.048 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:04.048 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:04.048 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:04.048 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16494 2024-04-19T02:16:04.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.048 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:04.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.048 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:04.049 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871684+0000", 2024-04-19T02:16:04.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:04.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.049 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:04.049 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871684+0000", 2024-04-19T02:16:04.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:04.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.049 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:04.049 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871683+0000", 2024-04-19T02:16:04.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:04.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.050 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:04.050 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871762+0000", 2024-04-19T02:16:04.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8981999999999997e-05 2024-04-19T02:16:04.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.050 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:04.050 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871770+0000", 2024-04-19T02:16:04.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7060000000000004e-06 2024-04-19T02:16:04.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.050 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:04.050 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871776+0000", 2024-04-19T02:16:04.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4880000000000004e-06 2024-04-19T02:16:04.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.051 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:04.051 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.874098+0000", 2024-04-19T02:16:04.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0023215309999999999 2024-04-19T02:16:04.051 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.051 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:04.051 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.874245+0000", 2024-04-19T02:16:04.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014735599999999999 2024-04-19T02:16:04.051 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.051 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:04.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.874394+0000", 2024-04-19T02:16:04.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014848300000000001 2024-04-19T02:16:04.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:04.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.876474+0000", 2024-04-19T02:16:04.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020803060000000001 2024-04-19T02:16:04.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:04.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.890939+0000", 2024-04-19T02:16:04.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014464985 2024-04-19T02:16:04.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.053 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:04.053 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.890986+0000", 2024-04-19T02:16:04.053 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7321000000000003e-05 2024-04-19T02:16:04.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.053 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:04.053 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891027+0000", 2024-04-19T02:16:04.053 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0689999999999998e-05 2024-04-19T02:16:04.053 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:04.053 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:04.053 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:04.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.053 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:16519 5.f 5:fc30d3a1:::benchmark_data_smithi121_44835_object16518:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:04.053 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.880723+0000", 2024-04-19T02:16:04.054 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.0717825750000003, 2024-04-19T02:16:04.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020492519000000001, 2024-04-19T02:16:04.054 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:04.054 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:04.054 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:04.054 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:04.054 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:04.054 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16519 2024-04-19T02:16:04.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.054 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:04.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.054 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:04.054 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880723+0000", 2024-04-19T02:16:04.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:04.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.055 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:04.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880723+0000", 2024-04-19T02:16:04.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:04.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.055 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:04.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880722+0000", 2024-04-19T02:16:04.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:04.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.055 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:04.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880794+0000", 2024-04-19T02:16:04.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1515999999999998e-05 2024-04-19T02:16:04.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.056 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:04.056 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880805+0000", 2024-04-19T02:16:04.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1353e-05 2024-04-19T02:16:04.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.056 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:04.056 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880812+0000", 2024-04-19T02:16:04.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1230000000000002e-06 2024-04-19T02:16:04.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.056 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:04.056 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.890954+0000", 2024-04-19T02:16:04.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010142253 2024-04-19T02:16:04.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.057 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:04.057 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891079+0000", 2024-04-19T02:16:04.057 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000124917 2024-04-19T02:16:04.057 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.057 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:04.057 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891218+0000", 2024-04-19T02:16:04.057 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000138715 2024-04-19T02:16:04.057 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.057 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:04.057 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.897321+0000", 2024-04-19T02:16:04.057 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0061026830000000002 2024-04-19T02:16:04.057 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.058 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:04.058 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901137+0000", 2024-04-19T02:16:04.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038161699999999998 2024-04-19T02:16:04.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.058 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:04.058 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901181+0000", 2024-04-19T02:16:04.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4362e-05 2024-04-19T02:16:04.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.058 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:04.058 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901215+0000", 2024-04-19T02:16:04.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3929e-05 2024-04-19T02:16:04.059 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:04.059 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:04.059 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:04.059 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.059 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.059 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:16520 5.f 5:f0474691:::benchmark_data_smithi121_44835_object16519:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:04.059 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.880833+0000", 2024-04-19T02:16:04.059 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.0716725599999997, 2024-04-19T02:16:04.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020460160000000002, 2024-04-19T02:16:04.059 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:04.059 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:04.059 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:04.059 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:04.059 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:04.059 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16520 2024-04-19T02:16:04.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.060 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:04.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:04.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880833+0000", 2024-04-19T02:16:04.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:04.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:04.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880833+0000", 2024-04-19T02:16:04.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:04.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:04.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880832+0000", 2024-04-19T02:16:04.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:04.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.061 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:04.061 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880909+0000", 2024-04-19T02:16:04.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7095000000000006e-05 2024-04-19T02:16:04.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.061 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:04.061 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880919+0000", 2024-04-19T02:16:04.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8919999999999995e-06 2024-04-19T02:16:04.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.061 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:04.061 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880927+0000", 2024-04-19T02:16:04.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8809999999999996e-06 2024-04-19T02:16:04.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.062 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:04.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891901+0000", 2024-04-19T02:16:04.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010974263999999999 2024-04-19T02:16:04.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.062 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:04.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.892021+0000", 2024-04-19T02:16:04.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120074 2024-04-19T02:16:04.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.062 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:04.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.892165+0000", 2024-04-19T02:16:04.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014328600000000001 2024-04-19T02:16:04.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:04.063 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.897347+0000", 2024-04-19T02:16:04.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.005182603 2024-04-19T02:16:04.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:04.063 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901224+0000", 2024-04-19T02:16:04.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038767620000000002 2024-04-19T02:16:04.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:04.063 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901264+0000", 2024-04-19T02:16:04.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9579000000000002e-05 2024-04-19T02:16:04.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.064 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.064 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:04.064 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901293+0000", 2024-04-19T02:16:04.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9300999999999999e-05 2024-04-19T02:16:04.065 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:04.065 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:04.065 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:04.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.065 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:16523 5.f 5:f36d1d17:::benchmark_data_smithi121_44835_object16522:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:04.065 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.883946+0000", 2024-04-19T02:16:04.065 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.0685592780000004, 2024-04-19T02:16:04.065 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017431283999999998, 2024-04-19T02:16:04.065 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:04.065 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:04.065 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:04.065 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:04.065 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:04.065 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16523 2024-04-19T02:16:04.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.066 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:04.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:04.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.883946+0000", 2024-04-19T02:16:04.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:04.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:04.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.883946+0000", 2024-04-19T02:16:04.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:04.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:04.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.883945+0000", 2024-04-19T02:16:04.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:04.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.067 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:04.067 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.883977+0000", 2024-04-19T02:16:04.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1834e-05 2024-04-19T02:16:04.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.067 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:04.067 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.883986+0000", 2024-04-19T02:16:04.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1220000000000001e-06 2024-04-19T02:16:04.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.067 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:04.067 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.883990+0000", 2024-04-19T02:16:04.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9829999999999998e-06 2024-04-19T02:16:04.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:04.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.894524+0000", 2024-04-19T02:16:04.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010533776 2024-04-19T02:16:04.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:04.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.894666+0000", 2024-04-19T02:16:04.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000142058 2024-04-19T02:16:04.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:04.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.894830+0000", 2024-04-19T02:16:04.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000163921 2024-04-19T02:16:04.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:04.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.897379+0000", 2024-04-19T02:16:04.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0025491340000000002 2024-04-19T02:16:04.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:04.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901299+0000", 2024-04-19T02:16:04.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039197809999999998 2024-04-19T02:16:04.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:04.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901344+0000", 2024-04-19T02:16:04.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4564999999999998e-05 2024-04-19T02:16:04.070 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:04.070 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:04.070 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:04.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901377+0000", 2024-04-19T02:16:04.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3679000000000001e-05 2024-04-19T02:16:04.070 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:04.070 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:04.070 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:04.070 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:04.070 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:04.070 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:16:04.071 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T02:16:04.072 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 9 16 28913 28897 200.658 177.688 0.00437605 0.00498107 2024-04-19T02:16:04.073 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:16:04.073 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:04.073+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:04.172 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:04.173+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:04.221 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-19T02:16:04.221 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T02:16:04.221 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-04-19T02:16:04.222 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-19T02:16:04.239 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:16:04.239 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:16:04.239 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.239 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:29543 5.4 5:268ba6d6:::benchmark_data_smithi121_44835_object29542:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-19T02:16:04.239 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:04.238025+0000", 2024-04-19T02:16:04.239 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0018364189999999999, 2024-04-19T02:16:04.239 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0018556270000000001, 2024-04-19T02:16:04.239 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:04.239 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:04.239 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:04.240 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:04.240 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:04.240 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 29543 2024-04-19T02:16:04.240 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.240 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:04.240 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.240 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:04.240 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.238025+0000", 2024-04-19T02:16:04.240 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:04.240 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.240 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.240 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:04.240 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.238025+0000", 2024-04-19T02:16:04.241 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:04.241 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.241 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.241 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:04.241 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.238024+0000", 2024-04-19T02:16:04.241 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:04.241 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.241 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.241 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:04.241 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.238093+0000", 2024-04-19T02:16:04.241 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.8615000000000006e-05 2024-04-19T02:16:04.241 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.241 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.242 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:04.242 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.238103+0000", 2024-04-19T02:16:04.242 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0225e-05 2024-04-19T02:16:04.242 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.242 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.242 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:04.242 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.238111+0000", 2024-04-19T02:16:04.242 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.7540000000000006e-06 2024-04-19T02:16:04.242 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.242 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.242 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:04.242 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.238144+0000", 2024-04-19T02:16:04.242 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2628e-05 2024-04-19T02:16:04.243 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.243 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.243 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:04.243 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.238233+0000", 2024-04-19T02:16:04.243 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.9349000000000001e-05 2024-04-19T02:16:04.243 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.243 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.243 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:04.243 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.238310+0000", 2024-04-19T02:16:04.243 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.7026000000000004e-05 2024-04-19T02:16:04.243 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:04.243 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:04.243 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:04.244 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.244 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.244 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:29544 5.0 5:0aadae62:::benchmark_data_smithi121_44835_object29543:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-19T02:16:04.244 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:04.238253+0000", 2024-04-19T02:16:04.244 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0016080000000000001, 2024-04-19T02:16:04.244 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001682764, 2024-04-19T02:16:04.244 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:04.244 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:04.244 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:04.244 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:04.244 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:04.244 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 29544 2024-04-19T02:16:04.244 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.244 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:04.244 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.245 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:04.245 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.238253+0000", 2024-04-19T02:16:04.245 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:04.245 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.245 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.245 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:04.245 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.238253+0000", 2024-04-19T02:16:04.245 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:04.245 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.245 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.245 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:04.245 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.238253+0000", 2024-04-19T02:16:04.245 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:04.245 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.246 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.246 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:04.246 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.238325+0000", 2024-04-19T02:16:04.246 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.2803000000000001e-05 2024-04-19T02:16:04.246 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.246 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.246 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:04.246 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.238334+0000", 2024-04-19T02:16:04.246 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.7190000000000007e-06 2024-04-19T02:16:04.246 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.246 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.246 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:04.246 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.238339+0000", 2024-04-19T02:16:04.247 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.1580000000000004e-06 2024-04-19T02:16:04.247 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.247 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.247 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:04.247 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.238386+0000", 2024-04-19T02:16:04.247 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.6993000000000002e-05 2024-04-19T02:16:04.247 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.247 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.247 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:04.247 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.238491+0000", 2024-04-19T02:16:04.247 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010440799999999999 2024-04-19T02:16:04.247 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.247 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.247 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:04.248 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.238567+0000", 2024-04-19T02:16:04.248 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.6327000000000003e-05 2024-04-19T02:16:04.248 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.248 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.248 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:04.248 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.239941+0000", 2024-04-19T02:16:04.248 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0013740950000000001 2024-04-19T02:16:04.248 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:04.248 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:04.248 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:04.248 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.248 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.248 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:29545 5.b 5:de77b66d:::benchmark_data_smithi121_44835_object29544:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-19T02:16:04.248 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:04.239348+0000", 2024-04-19T02:16:04.249 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.00051325999999999997, 2024-04-19T02:16:04.249 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00064103599999999999, 2024-04-19T02:16:04.249 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:04.249 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:04.249 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:04.249 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:04.249 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:04.249 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 29545 2024-04-19T02:16:04.249 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.249 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:04.249 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.249 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:04.249 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.239348+0000", 2024-04-19T02:16:04.249 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:04.249 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.250 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.250 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:04.250 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.239348+0000", 2024-04-19T02:16:04.250 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:04.250 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.250 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.250 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:04.250 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.239348+0000", 2024-04-19T02:16:04.250 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:04.250 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.250 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.250 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:04.250 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.239403+0000", 2024-04-19T02:16:04.250 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.5946000000000003e-05 2024-04-19T02:16:04.251 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.251 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.251 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:04.251 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.239412+0000", 2024-04-19T02:16:04.251 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2060000000000007e-06 2024-04-19T02:16:04.251 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.251 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.251 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:04.251 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.239417+0000", 2024-04-19T02:16:04.251 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0579999999999997e-06 2024-04-19T02:16:04.251 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.251 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.251 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:04.251 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.239451+0000", 2024-04-19T02:16:04.252 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4601999999999998e-05 2024-04-19T02:16:04.252 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.252 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.252 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:04.252 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.239528+0000", 2024-04-19T02:16:04.252 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.6215000000000001e-05 2024-04-19T02:16:04.252 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.252 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.252 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:04.252 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.239613+0000", 2024-04-19T02:16:04.252 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.5896999999999994e-05 2024-04-19T02:16:04.252 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:04.253 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:04.253 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:04.253 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:04.253 INFO:teuthology.orchestra.run.smithi174.stdout: ], 2024-04-19T02:16:04.253 INFO:teuthology.orchestra.run.smithi174.stdout: "num_ops": 3 2024-04-19T02:16:04.253 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:16:04.254 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:16:04.274 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:04.274+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:04.375 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:04.375+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:04.473 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:16:04.473 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [], 2024-04-19T02:16:04.473 INFO:teuthology.orchestra.run.smithi174.stdout: "complaint_time": 30, 2024-04-19T02:16:04.473 INFO:teuthology.orchestra.run.smithi174.stdout: "num_blocked_ops": 0 2024-04-19T02:16:04.473 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:16:04.476 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:04.476+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:04.487 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:16:04.577 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:04.577+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:04.577 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:16:04.577 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-04-19T02:16:04.577 INFO:teuthology.orchestra.run.smithi121.stdout: "epoch": 21, 2024-04-19T02:16:04.577 INFO:teuthology.orchestra.run.smithi121.stdout: "fsid": "f6ab5dd0-bb9f-4b48-a9fc-4728c7955ca8", 2024-04-19T02:16:04.578 INFO:teuthology.orchestra.run.smithi121.stdout: "created": "2024-04-19T02:15:13.539846+0000", 2024-04-19T02:16:04.578 INFO:teuthology.orchestra.run.smithi121.stdout: "modified": "2024-04-19T02:16:01.970564+0000", 2024-04-19T02:16:04.578 INFO:teuthology.orchestra.run.smithi121.stdout: "last_up_change": "2024-04-19T02:15:22.519568+0000", 2024-04-19T02:16:04.578 INFO:teuthology.orchestra.run.smithi121.stdout: "last_in_change": "2024-04-19T02:15:15.482624+0000", 2024-04-19T02:16:04.578 INFO:teuthology.orchestra.run.smithi121.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-19T02:16:04.578 INFO:teuthology.orchestra.run.smithi121.stdout: "flags_num": 5799936, 2024-04-19T02:16:04.578 INFO:teuthology.orchestra.run.smithi121.stdout: "flags_set": [ 2024-04-19T02:16:04.578 INFO:teuthology.orchestra.run.smithi121.stdout: "pglog_hardlimit", 2024-04-19T02:16:04.578 INFO:teuthology.orchestra.run.smithi121.stdout: "purged_snapdirs", 2024-04-19T02:16:04.578 INFO:teuthology.orchestra.run.smithi121.stdout: "recovery_deletes", 2024-04-19T02:16:04.578 INFO:teuthology.orchestra.run.smithi121.stdout: "sortbitwise" 2024-04-19T02:16:04.578 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-04-19T02:16:04.578 INFO:teuthology.orchestra.run.smithi121.stdout: "crush_version": 4, 2024-04-19T02:16:04.578 INFO:teuthology.orchestra.run.smithi121.stdout: "full_ratio": 0.94999998807907104, 2024-04-19T02:16:04.579 INFO:teuthology.orchestra.run.smithi121.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-19T02:16:04.579 INFO:teuthology.orchestra.run.smithi121.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-19T02:16:04.579 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_snapshot": "", 2024-04-19T02:16:04.579 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_max": 5, 2024-04-19T02:16:04.579 INFO:teuthology.orchestra.run.smithi121.stdout: "max_osd": 3, 2024-04-19T02:16:04.579 INFO:teuthology.orchestra.run.smithi121.stdout: "require_min_compat_client": "luminous", 2024-04-19T02:16:04.579 INFO:teuthology.orchestra.run.smithi121.stdout: "min_compat_client": "jewel", 2024-04-19T02:16:04.579 INFO:teuthology.orchestra.run.smithi121.stdout: "require_osd_release": "reef", 2024-04-19T02:16:04.579 INFO:teuthology.orchestra.run.smithi121.stdout: "allow_crimson": false, 2024-04-19T02:16:04.579 INFO:teuthology.orchestra.run.smithi121.stdout: "pools": [ 2024-04-19T02:16:04.579 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:04.579 INFO:teuthology.orchestra.run.smithi121.stdout: "pool": 1, 2024-04-19T02:16:04.579 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_name": ".mgr", 2024-04-19T02:16:04.579 INFO:teuthology.orchestra.run.smithi121.stdout: "create_time": "2024-04-19T02:15:22.776125+0000", 2024-04-19T02:16:04.579 INFO:teuthology.orchestra.run.smithi121.stdout: "flags": 1, 2024-04-19T02:16:04.580 INFO:teuthology.orchestra.run.smithi121.stdout: "flags_names": "hashpspool", 2024-04-19T02:16:04.580 INFO:teuthology.orchestra.run.smithi121.stdout: "type": 1, 2024-04-19T02:16:04.580 INFO:teuthology.orchestra.run.smithi121.stdout: "size": 2, 2024-04-19T02:16:04.580 INFO:teuthology.orchestra.run.smithi121.stdout: "min_size": 1, 2024-04-19T02:16:04.580 INFO:teuthology.orchestra.run.smithi121.stdout: "crush_rule": 0, 2024-04-19T02:16:04.580 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_count": 0, 2024-04-19T02:16:04.580 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_target": 0, 2024-04-19T02:16:04.580 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T02:16:04.580 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T02:16:04.580 INFO:teuthology.orchestra.run.smithi121.stdout: "object_hash": 2, 2024-04-19T02:16:04.580 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_autoscale_mode": "off", 2024-04-19T02:16:04.580 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num": 1, 2024-04-19T02:16:04.580 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_placement_num": 1, 2024-04-19T02:16:04.580 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_placement_num_target": 1, 2024-04-19T02:16:04.580 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_target": 1, 2024-04-19T02:16:04.581 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_pending": 1, 2024-04-19T02:16:04.581 INFO:teuthology.orchestra.run.smithi121.stdout: "last_pg_merge_meta": { 2024-04-19T02:16:04.581 INFO:teuthology.orchestra.run.smithi121.stdout: "source_pgid": "0.0", 2024-04-19T02:16:04.581 INFO:teuthology.orchestra.run.smithi121.stdout: "ready_epoch": 0, 2024-04-19T02:16:04.581 INFO:teuthology.orchestra.run.smithi121.stdout: "last_epoch_started": 0, 2024-04-19T02:16:04.581 INFO:teuthology.orchestra.run.smithi121.stdout: "last_epoch_clean": 0, 2024-04-19T02:16:04.581 INFO:teuthology.orchestra.run.smithi121.stdout: "source_version": "0'0", 2024-04-19T02:16:04.581 INFO:teuthology.orchestra.run.smithi121.stdout: "target_version": "0'0" 2024-04-19T02:16:04.581 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:04.581 INFO:teuthology.orchestra.run.smithi121.stdout: "last_change": "11", 2024-04-19T02:16:04.581 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend": "0", 2024-04-19T02:16:04.581 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T02:16:04.581 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T02:16:04.581 INFO:teuthology.orchestra.run.smithi121.stdout: "auid": 0, 2024-04-19T02:16:04.582 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_mode": "selfmanaged", 2024-04-19T02:16:04.582 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_seq": 0, 2024-04-19T02:16:04.582 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_epoch": 0, 2024-04-19T02:16:04.582 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_snaps": [], 2024-04-19T02:16:04.582 INFO:teuthology.orchestra.run.smithi121.stdout: "removed_snaps": "[]", 2024-04-19T02:16:04.582 INFO:teuthology.orchestra.run.smithi121.stdout: "quota_max_bytes": 0, 2024-04-19T02:16:04.582 INFO:teuthology.orchestra.run.smithi121.stdout: "quota_max_objects": 0, 2024-04-19T02:16:04.582 INFO:teuthology.orchestra.run.smithi121.stdout: "tiers": [], 2024-04-19T02:16:04.582 INFO:teuthology.orchestra.run.smithi121.stdout: "tier_of": -1, 2024-04-19T02:16:04.582 INFO:teuthology.orchestra.run.smithi121.stdout: "read_tier": -1, 2024-04-19T02:16:04.582 INFO:teuthology.orchestra.run.smithi121.stdout: "write_tier": -1, 2024-04-19T02:16:04.582 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_mode": "none", 2024-04-19T02:16:04.583 INFO:teuthology.orchestra.run.smithi121.stdout: "target_max_bytes": 0, 2024-04-19T02:16:04.583 INFO:teuthology.orchestra.run.smithi121.stdout: "target_max_objects": 0, 2024-04-19T02:16:04.583 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T02:16:04.583 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T02:16:04.583 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T02:16:04.583 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_min_flush_age": 0, 2024-04-19T02:16:04.583 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_min_evict_age": 0, 2024-04-19T02:16:04.583 INFO:teuthology.orchestra.run.smithi121.stdout: "erasure_code_profile": "", 2024-04-19T02:16:04.583 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_params": { 2024-04-19T02:16:04.583 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "none" 2024-04-19T02:16:04.583 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:04.583 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_period": 0, 2024-04-19T02:16:04.583 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_count": 0, 2024-04-19T02:16:04.584 INFO:teuthology.orchestra.run.smithi121.stdout: "use_gmt_hitset": true, 2024-04-19T02:16:04.584 INFO:teuthology.orchestra.run.smithi121.stdout: "min_read_recency_for_promote": 0, 2024-04-19T02:16:04.584 INFO:teuthology.orchestra.run.smithi121.stdout: "min_write_recency_for_promote": 0, 2024-04-19T02:16:04.584 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T02:16:04.584 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_search_last_n": 0, 2024-04-19T02:16:04.584 INFO:teuthology.orchestra.run.smithi121.stdout: "grade_table": [], 2024-04-19T02:16:04.584 INFO:teuthology.orchestra.run.smithi121.stdout: "stripe_width": 0, 2024-04-19T02:16:04.584 INFO:teuthology.orchestra.run.smithi121.stdout: "expected_num_objects": 0, 2024-04-19T02:16:04.584 INFO:teuthology.orchestra.run.smithi121.stdout: "fast_read": false, 2024-04-19T02:16:04.584 INFO:teuthology.orchestra.run.smithi121.stdout: "options": { 2024-04-19T02:16:04.584 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_max": 32, 2024-04-19T02:16:04.584 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_min": 1 2024-04-19T02:16:04.584 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:04.585 INFO:teuthology.orchestra.run.smithi121.stdout: "application_metadata": { 2024-04-19T02:16:04.585 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": {} 2024-04-19T02:16:04.585 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:04.585 INFO:teuthology.orchestra.run.smithi121.stdout: "read_balance": { 2024-04-19T02:16:04.585 INFO:teuthology.orchestra.run.smithi121.stdout: "score_acting": 2.9900000095367432, 2024-04-19T02:16:04.585 INFO:teuthology.orchestra.run.smithi121.stdout: "score_stable": 2.9900000095367432, 2024-04-19T02:16:04.585 INFO:teuthology.orchestra.run.smithi121.stdout: "optimal_score": 0.67000001668930054, 2024-04-19T02:16:04.585 INFO:teuthology.orchestra.run.smithi121.stdout: "raw_score_acting": 2, 2024-04-19T02:16:04.585 INFO:teuthology.orchestra.run.smithi121.stdout: "raw_score_stable": 2, 2024-04-19T02:16:04.585 INFO:teuthology.orchestra.run.smithi121.stdout: "primary_affinity_weighted": 0.90409350395202637, 2024-04-19T02:16:04.585 INFO:teuthology.orchestra.run.smithi121.stdout: "average_primary_affinity": 0.89999997615814209, 2024-04-19T02:16:04.585 INFO:teuthology.orchestra.run.smithi121.stdout: "average_primary_affinity_weighted": 0.89999997615814209 2024-04-19T02:16:04.585 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:04.585 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:04.585 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:04.586 INFO:teuthology.orchestra.run.smithi121.stdout: "pool": 2, 2024-04-19T02:16:04.586 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_name": "rbd", 2024-04-19T02:16:04.586 INFO:teuthology.orchestra.run.smithi121.stdout: "create_time": "2024-04-19T02:15:23.264005+0000", 2024-04-19T02:16:04.586 INFO:teuthology.orchestra.run.smithi121.stdout: "flags": 1, 2024-04-19T02:16:04.586 INFO:teuthology.orchestra.run.smithi121.stdout: "flags_names": "hashpspool", 2024-04-19T02:16:04.586 INFO:teuthology.orchestra.run.smithi121.stdout: "type": 1, 2024-04-19T02:16:04.586 INFO:teuthology.orchestra.run.smithi121.stdout: "size": 2, 2024-04-19T02:16:04.586 INFO:teuthology.orchestra.run.smithi121.stdout: "min_size": 1, 2024-04-19T02:16:04.586 INFO:teuthology.orchestra.run.smithi121.stdout: "crush_rule": 0, 2024-04-19T02:16:04.586 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_count": 0, 2024-04-19T02:16:04.586 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_target": 0, 2024-04-19T02:16:04.586 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T02:16:04.586 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T02:16:04.587 INFO:teuthology.orchestra.run.smithi121.stdout: "object_hash": 2, 2024-04-19T02:16:04.587 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_autoscale_mode": "off", 2024-04-19T02:16:04.587 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num": 8, 2024-04-19T02:16:04.587 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_placement_num": 8, 2024-04-19T02:16:04.587 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_placement_num_target": 8, 2024-04-19T02:16:04.587 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_target": 8, 2024-04-19T02:16:04.587 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_pending": 8, 2024-04-19T02:16:04.587 INFO:teuthology.orchestra.run.smithi121.stdout: "last_pg_merge_meta": { 2024-04-19T02:16:04.587 INFO:teuthology.orchestra.run.smithi121.stdout: "source_pgid": "0.0", 2024-04-19T02:16:04.587 INFO:teuthology.orchestra.run.smithi121.stdout: "ready_epoch": 0, 2024-04-19T02:16:04.587 INFO:teuthology.orchestra.run.smithi121.stdout: "last_epoch_started": 0, 2024-04-19T02:16:04.587 INFO:teuthology.orchestra.run.smithi121.stdout: "last_epoch_clean": 0, 2024-04-19T02:16:04.587 INFO:teuthology.orchestra.run.smithi121.stdout: "source_version": "0'0", 2024-04-19T02:16:04.587 INFO:teuthology.orchestra.run.smithi121.stdout: "target_version": "0'0" 2024-04-19T02:16:04.588 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:04.588 INFO:teuthology.orchestra.run.smithi121.stdout: "last_change": "11", 2024-04-19T02:16:04.588 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend": "0", 2024-04-19T02:16:04.588 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T02:16:04.588 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T02:16:04.588 INFO:teuthology.orchestra.run.smithi121.stdout: "auid": 0, 2024-04-19T02:16:04.588 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_mode": "selfmanaged", 2024-04-19T02:16:04.588 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_seq": 0, 2024-04-19T02:16:04.588 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_epoch": 0, 2024-04-19T02:16:04.588 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_snaps": [], 2024-04-19T02:16:04.588 INFO:teuthology.orchestra.run.smithi121.stdout: "removed_snaps": "[]", 2024-04-19T02:16:04.588 INFO:teuthology.orchestra.run.smithi121.stdout: "quota_max_bytes": 0, 2024-04-19T02:16:04.588 INFO:teuthology.orchestra.run.smithi121.stdout: "quota_max_objects": 0, 2024-04-19T02:16:04.588 INFO:teuthology.orchestra.run.smithi121.stdout: "tiers": [], 2024-04-19T02:16:04.589 INFO:teuthology.orchestra.run.smithi121.stdout: "tier_of": -1, 2024-04-19T02:16:04.589 INFO:teuthology.orchestra.run.smithi121.stdout: "read_tier": -1, 2024-04-19T02:16:04.589 INFO:teuthology.orchestra.run.smithi121.stdout: "write_tier": -1, 2024-04-19T02:16:04.589 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_mode": "none", 2024-04-19T02:16:04.589 INFO:teuthology.orchestra.run.smithi121.stdout: "target_max_bytes": 0, 2024-04-19T02:16:04.589 INFO:teuthology.orchestra.run.smithi121.stdout: "target_max_objects": 0, 2024-04-19T02:16:04.589 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T02:16:04.589 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T02:16:04.589 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T02:16:04.589 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_min_flush_age": 0, 2024-04-19T02:16:04.589 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_min_evict_age": 0, 2024-04-19T02:16:04.589 INFO:teuthology.orchestra.run.smithi121.stdout: "erasure_code_profile": "", 2024-04-19T02:16:04.589 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_params": { 2024-04-19T02:16:04.589 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "none" 2024-04-19T02:16:04.589 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:04.590 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_period": 0, 2024-04-19T02:16:04.590 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_count": 0, 2024-04-19T02:16:04.590 INFO:teuthology.orchestra.run.smithi121.stdout: "use_gmt_hitset": true, 2024-04-19T02:16:04.590 INFO:teuthology.orchestra.run.smithi121.stdout: "min_read_recency_for_promote": 0, 2024-04-19T02:16:04.590 INFO:teuthology.orchestra.run.smithi121.stdout: "min_write_recency_for_promote": 0, 2024-04-19T02:16:04.590 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T02:16:04.590 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_search_last_n": 0, 2024-04-19T02:16:04.590 INFO:teuthology.orchestra.run.smithi121.stdout: "grade_table": [], 2024-04-19T02:16:04.590 INFO:teuthology.orchestra.run.smithi121.stdout: "stripe_width": 0, 2024-04-19T02:16:04.590 INFO:teuthology.orchestra.run.smithi121.stdout: "expected_num_objects": 0, 2024-04-19T02:16:04.590 INFO:teuthology.orchestra.run.smithi121.stdout: "fast_read": false, 2024-04-19T02:16:04.590 INFO:teuthology.orchestra.run.smithi121.stdout: "options": {}, 2024-04-19T02:16:04.590 INFO:teuthology.orchestra.run.smithi121.stdout: "application_metadata": { 2024-04-19T02:16:04.591 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd": {} 2024-04-19T02:16:04.591 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:04.591 INFO:teuthology.orchestra.run.smithi121.stdout: "read_balance": { 2024-04-19T02:16:04.591 INFO:teuthology.orchestra.run.smithi121.stdout: "score_acting": 1.5, 2024-04-19T02:16:04.591 INFO:teuthology.orchestra.run.smithi121.stdout: "score_stable": 1.5, 2024-04-19T02:16:04.591 INFO:teuthology.orchestra.run.smithi121.stdout: "optimal_score": 1, 2024-04-19T02:16:04.591 INFO:teuthology.orchestra.run.smithi121.stdout: "raw_score_acting": 1.5, 2024-04-19T02:16:04.591 INFO:teuthology.orchestra.run.smithi121.stdout: "raw_score_stable": 1.5, 2024-04-19T02:16:04.591 INFO:teuthology.orchestra.run.smithi121.stdout: "primary_affinity_weighted": 0.90409350395202637, 2024-04-19T02:16:04.591 INFO:teuthology.orchestra.run.smithi121.stdout: "average_primary_affinity": 0.89999997615814209, 2024-04-19T02:16:04.591 INFO:teuthology.orchestra.run.smithi121.stdout: "average_primary_affinity_weighted": 0.89999997615814209 2024-04-19T02:16:04.591 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:04.591 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:04.591 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:04.591 INFO:teuthology.orchestra.run.smithi121.stdout: "pool": 3, 2024-04-19T02:16:04.592 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_name": "cephfs_metadata", 2024-04-19T02:16:04.592 INFO:teuthology.orchestra.run.smithi121.stdout: "create_time": "2024-04-19T02:15:27.675087+0000", 2024-04-19T02:16:04.592 INFO:teuthology.orchestra.run.smithi121.stdout: "flags": 1, 2024-04-19T02:16:04.592 INFO:teuthology.orchestra.run.smithi121.stdout: "flags_names": "hashpspool", 2024-04-19T02:16:04.592 INFO:teuthology.orchestra.run.smithi121.stdout: "type": 1, 2024-04-19T02:16:04.592 INFO:teuthology.orchestra.run.smithi121.stdout: "size": 2, 2024-04-19T02:16:04.592 INFO:teuthology.orchestra.run.smithi121.stdout: "min_size": 1, 2024-04-19T02:16:04.592 INFO:teuthology.orchestra.run.smithi121.stdout: "crush_rule": 0, 2024-04-19T02:16:04.592 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_count": 0, 2024-04-19T02:16:04.592 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_target": 0, 2024-04-19T02:16:04.592 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T02:16:04.592 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T02:16:04.592 INFO:teuthology.orchestra.run.smithi121.stdout: "object_hash": 2, 2024-04-19T02:16:04.592 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_autoscale_mode": "off", 2024-04-19T02:16:04.593 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num": 32, 2024-04-19T02:16:04.593 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_placement_num": 32, 2024-04-19T02:16:04.593 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_placement_num_target": 32, 2024-04-19T02:16:04.593 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_target": 32, 2024-04-19T02:16:04.593 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_pending": 32, 2024-04-19T02:16:04.593 INFO:teuthology.orchestra.run.smithi121.stdout: "last_pg_merge_meta": { 2024-04-19T02:16:04.593 INFO:teuthology.orchestra.run.smithi121.stdout: "source_pgid": "0.0", 2024-04-19T02:16:04.593 INFO:teuthology.orchestra.run.smithi121.stdout: "ready_epoch": 0, 2024-04-19T02:16:04.593 INFO:teuthology.orchestra.run.smithi121.stdout: "last_epoch_started": 0, 2024-04-19T02:16:04.593 INFO:teuthology.orchestra.run.smithi121.stdout: "last_epoch_clean": 0, 2024-04-19T02:16:04.593 INFO:teuthology.orchestra.run.smithi121.stdout: "source_version": "0'0", 2024-04-19T02:16:04.593 INFO:teuthology.orchestra.run.smithi121.stdout: "target_version": "0'0" 2024-04-19T02:16:04.593 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:04.593 INFO:teuthology.orchestra.run.smithi121.stdout: "last_change": "14", 2024-04-19T02:16:04.593 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend": "0", 2024-04-19T02:16:04.593 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T02:16:04.594 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T02:16:04.594 INFO:teuthology.orchestra.run.smithi121.stdout: "auid": 0, 2024-04-19T02:16:04.594 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_mode": "selfmanaged", 2024-04-19T02:16:04.594 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_seq": 0, 2024-04-19T02:16:04.594 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_epoch": 0, 2024-04-19T02:16:04.594 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_snaps": [], 2024-04-19T02:16:04.594 INFO:teuthology.orchestra.run.smithi121.stdout: "removed_snaps": "[]", 2024-04-19T02:16:04.594 INFO:teuthology.orchestra.run.smithi121.stdout: "quota_max_bytes": 0, 2024-04-19T02:16:04.594 INFO:teuthology.orchestra.run.smithi121.stdout: "quota_max_objects": 0, 2024-04-19T02:16:04.594 INFO:teuthology.orchestra.run.smithi121.stdout: "tiers": [], 2024-04-19T02:16:04.594 INFO:teuthology.orchestra.run.smithi121.stdout: "tier_of": -1, 2024-04-19T02:16:04.594 INFO:teuthology.orchestra.run.smithi121.stdout: "read_tier": -1, 2024-04-19T02:16:04.594 INFO:teuthology.orchestra.run.smithi121.stdout: "write_tier": -1, 2024-04-19T02:16:04.595 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_mode": "none", 2024-04-19T02:16:04.595 INFO:teuthology.orchestra.run.smithi121.stdout: "target_max_bytes": 0, 2024-04-19T02:16:04.595 INFO:teuthology.orchestra.run.smithi121.stdout: "target_max_objects": 0, 2024-04-19T02:16:04.595 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T02:16:04.595 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T02:16:04.595 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T02:16:04.595 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_min_flush_age": 0, 2024-04-19T02:16:04.595 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_min_evict_age": 0, 2024-04-19T02:16:04.595 INFO:teuthology.orchestra.run.smithi121.stdout: "erasure_code_profile": "", 2024-04-19T02:16:04.595 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_params": { 2024-04-19T02:16:04.595 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "none" 2024-04-19T02:16:04.595 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:04.595 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_period": 0, 2024-04-19T02:16:04.595 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_count": 0, 2024-04-19T02:16:04.595 INFO:teuthology.orchestra.run.smithi121.stdout: "use_gmt_hitset": true, 2024-04-19T02:16:04.595 INFO:teuthology.orchestra.run.smithi121.stdout: "min_read_recency_for_promote": 0, 2024-04-19T02:16:04.596 INFO:teuthology.orchestra.run.smithi121.stdout: "min_write_recency_for_promote": 0, 2024-04-19T02:16:04.596 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T02:16:04.596 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_search_last_n": 0, 2024-04-19T02:16:04.596 INFO:teuthology.orchestra.run.smithi121.stdout: "grade_table": [], 2024-04-19T02:16:04.596 INFO:teuthology.orchestra.run.smithi121.stdout: "stripe_width": 0, 2024-04-19T02:16:04.596 INFO:teuthology.orchestra.run.smithi121.stdout: "expected_num_objects": 0, 2024-04-19T02:16:04.596 INFO:teuthology.orchestra.run.smithi121.stdout: "fast_read": false, 2024-04-19T02:16:04.596 INFO:teuthology.orchestra.run.smithi121.stdout: "options": { 2024-04-19T02:16:04.596 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_autoscale_bias": 4, 2024-04-19T02:16:04.596 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_min": 16, 2024-04-19T02:16:04.596 INFO:teuthology.orchestra.run.smithi121.stdout: "recovery_priority": 5 2024-04-19T02:16:04.596 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:04.596 INFO:teuthology.orchestra.run.smithi121.stdout: "application_metadata": { 2024-04-19T02:16:04.596 INFO:teuthology.orchestra.run.smithi121.stdout: "cephfs": { 2024-04-19T02:16:04.597 INFO:teuthology.orchestra.run.smithi121.stdout: "metadata": "cephfs" 2024-04-19T02:16:04.597 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:04.597 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:04.597 INFO:teuthology.orchestra.run.smithi121.stdout: "read_balance": { 2024-04-19T02:16:04.597 INFO:teuthology.orchestra.run.smithi121.stdout: "score_acting": 1.2200000286102295, 2024-04-19T02:16:04.597 INFO:teuthology.orchestra.run.smithi121.stdout: "score_stable": 1.2200000286102295, 2024-04-19T02:16:04.597 INFO:teuthology.orchestra.run.smithi121.stdout: "optimal_score": 1, 2024-04-19T02:16:04.597 INFO:teuthology.orchestra.run.smithi121.stdout: "raw_score_acting": 1.2200000286102295, 2024-04-19T02:16:04.597 INFO:teuthology.orchestra.run.smithi121.stdout: "raw_score_stable": 1.2200000286102295, 2024-04-19T02:16:04.597 INFO:teuthology.orchestra.run.smithi121.stdout: "primary_affinity_weighted": 0.90409350395202637, 2024-04-19T02:16:04.597 INFO:teuthology.orchestra.run.smithi121.stdout: "average_primary_affinity": 0.89999997615814209, 2024-04-19T02:16:04.597 INFO:teuthology.orchestra.run.smithi121.stdout: "average_primary_affinity_weighted": 0.89999997615814209 2024-04-19T02:16:04.597 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:04.597 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:04.597 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:04.597 INFO:teuthology.orchestra.run.smithi121.stdout: "pool": 4, 2024-04-19T02:16:04.597 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_name": "cephfs_data", 2024-04-19T02:16:04.598 INFO:teuthology.orchestra.run.smithi121.stdout: "create_time": "2024-04-19T02:15:28.232224+0000", 2024-04-19T02:16:04.598 INFO:teuthology.orchestra.run.smithi121.stdout: "flags": 1, 2024-04-19T02:16:04.598 INFO:teuthology.orchestra.run.smithi121.stdout: "flags_names": "hashpspool", 2024-04-19T02:16:04.598 INFO:teuthology.orchestra.run.smithi121.stdout: "type": 1, 2024-04-19T02:16:04.598 INFO:teuthology.orchestra.run.smithi121.stdout: "size": 2, 2024-04-19T02:16:04.598 INFO:teuthology.orchestra.run.smithi121.stdout: "min_size": 1, 2024-04-19T02:16:04.598 INFO:teuthology.orchestra.run.smithi121.stdout: "crush_rule": 0, 2024-04-19T02:16:04.598 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_count": 0, 2024-04-19T02:16:04.598 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_target": 0, 2024-04-19T02:16:04.598 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T02:16:04.598 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T02:16:04.598 INFO:teuthology.orchestra.run.smithi121.stdout: "object_hash": 2, 2024-04-19T02:16:04.598 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_autoscale_mode": "off", 2024-04-19T02:16:04.598 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num": 64, 2024-04-19T02:16:04.599 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_placement_num": 64, 2024-04-19T02:16:04.599 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_placement_num_target": 64, 2024-04-19T02:16:04.599 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_target": 64, 2024-04-19T02:16:04.599 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_pending": 64, 2024-04-19T02:16:04.599 INFO:teuthology.orchestra.run.smithi121.stdout: "last_pg_merge_meta": { 2024-04-19T02:16:04.599 INFO:teuthology.orchestra.run.smithi121.stdout: "source_pgid": "0.0", 2024-04-19T02:16:04.599 INFO:teuthology.orchestra.run.smithi121.stdout: "ready_epoch": 0, 2024-04-19T02:16:04.599 INFO:teuthology.orchestra.run.smithi121.stdout: "last_epoch_started": 0, 2024-04-19T02:16:04.599 INFO:teuthology.orchestra.run.smithi121.stdout: "last_epoch_clean": 0, 2024-04-19T02:16:04.599 INFO:teuthology.orchestra.run.smithi121.stdout: "source_version": "0'0", 2024-04-19T02:16:04.599 INFO:teuthology.orchestra.run.smithi121.stdout: "target_version": "0'0" 2024-04-19T02:16:04.599 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:04.599 INFO:teuthology.orchestra.run.smithi121.stdout: "last_change": "15", 2024-04-19T02:16:04.599 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend": "0", 2024-04-19T02:16:04.600 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T02:16:04.600 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T02:16:04.600 INFO:teuthology.orchestra.run.smithi121.stdout: "auid": 0, 2024-04-19T02:16:04.600 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_mode": "selfmanaged", 2024-04-19T02:16:04.600 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_seq": 0, 2024-04-19T02:16:04.600 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_epoch": 0, 2024-04-19T02:16:04.600 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_snaps": [], 2024-04-19T02:16:04.600 INFO:teuthology.orchestra.run.smithi121.stdout: "removed_snaps": "[]", 2024-04-19T02:16:04.600 INFO:teuthology.orchestra.run.smithi121.stdout: "quota_max_bytes": 0, 2024-04-19T02:16:04.600 INFO:teuthology.orchestra.run.smithi121.stdout: "quota_max_objects": 0, 2024-04-19T02:16:04.600 INFO:teuthology.orchestra.run.smithi121.stdout: "tiers": [], 2024-04-19T02:16:04.600 INFO:teuthology.orchestra.run.smithi121.stdout: "tier_of": -1, 2024-04-19T02:16:04.600 INFO:teuthology.orchestra.run.smithi121.stdout: "read_tier": -1, 2024-04-19T02:16:04.600 INFO:teuthology.orchestra.run.smithi121.stdout: "write_tier": -1, 2024-04-19T02:16:04.601 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_mode": "none", 2024-04-19T02:16:04.601 INFO:teuthology.orchestra.run.smithi121.stdout: "target_max_bytes": 0, 2024-04-19T02:16:04.601 INFO:teuthology.orchestra.run.smithi121.stdout: "target_max_objects": 0, 2024-04-19T02:16:04.601 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T02:16:04.601 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T02:16:04.601 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T02:16:04.601 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_min_flush_age": 0, 2024-04-19T02:16:04.601 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_min_evict_age": 0, 2024-04-19T02:16:04.601 INFO:teuthology.orchestra.run.smithi121.stdout: "erasure_code_profile": "", 2024-04-19T02:16:04.601 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_params": { 2024-04-19T02:16:04.601 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "none" 2024-04-19T02:16:04.601 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:04.601 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_period": 0, 2024-04-19T02:16:04.601 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_count": 0, 2024-04-19T02:16:04.601 INFO:teuthology.orchestra.run.smithi121.stdout: "use_gmt_hitset": true, 2024-04-19T02:16:04.602 INFO:teuthology.orchestra.run.smithi121.stdout: "min_read_recency_for_promote": 0, 2024-04-19T02:16:04.602 INFO:teuthology.orchestra.run.smithi121.stdout: "min_write_recency_for_promote": 0, 2024-04-19T02:16:04.602 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T02:16:04.602 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_search_last_n": 0, 2024-04-19T02:16:04.602 INFO:teuthology.orchestra.run.smithi121.stdout: "grade_table": [], 2024-04-19T02:16:04.602 INFO:teuthology.orchestra.run.smithi121.stdout: "stripe_width": 0, 2024-04-19T02:16:04.602 INFO:teuthology.orchestra.run.smithi121.stdout: "expected_num_objects": 0, 2024-04-19T02:16:04.602 INFO:teuthology.orchestra.run.smithi121.stdout: "fast_read": false, 2024-04-19T02:16:04.602 INFO:teuthology.orchestra.run.smithi121.stdout: "options": { 2024-04-19T02:16:04.602 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_min": 64, 2024-04-19T02:16:04.602 INFO:teuthology.orchestra.run.smithi121.stdout: "target_size_ratio": 0.89999997615814209 2024-04-19T02:16:04.602 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:04.602 INFO:teuthology.orchestra.run.smithi121.stdout: "application_metadata": { 2024-04-19T02:16:04.602 INFO:teuthology.orchestra.run.smithi121.stdout: "cephfs": { 2024-04-19T02:16:04.603 INFO:teuthology.orchestra.run.smithi121.stdout: "data": "cephfs" 2024-04-19T02:16:04.603 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:04.603 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:04.603 INFO:teuthology.orchestra.run.smithi121.stdout: "read_balance": { 2024-04-19T02:16:04.603 INFO:teuthology.orchestra.run.smithi121.stdout: "score_acting": 1.1699999570846558, 2024-04-19T02:16:04.603 INFO:teuthology.orchestra.run.smithi121.stdout: "score_stable": 1.1699999570846558, 2024-04-19T02:16:04.603 INFO:teuthology.orchestra.run.smithi121.stdout: "optimal_score": 1, 2024-04-19T02:16:04.603 INFO:teuthology.orchestra.run.smithi121.stdout: "raw_score_acting": 1.1699999570846558, 2024-04-19T02:16:04.603 INFO:teuthology.orchestra.run.smithi121.stdout: "raw_score_stable": 1.1699999570846558, 2024-04-19T02:16:04.603 INFO:teuthology.orchestra.run.smithi121.stdout: "primary_affinity_weighted": 0.90409350395202637, 2024-04-19T02:16:04.603 INFO:teuthology.orchestra.run.smithi121.stdout: "average_primary_affinity": 0.89999997615814209, 2024-04-19T02:16:04.603 INFO:teuthology.orchestra.run.smithi121.stdout: "average_primary_affinity_weighted": 0.89999997615814209 2024-04-19T02:16:04.603 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:04.603 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:04.603 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:04.604 INFO:teuthology.orchestra.run.smithi121.stdout: "pool": 5, 2024-04-19T02:16:04.604 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_name": "unique_pool_0", 2024-04-19T02:16:04.604 INFO:teuthology.orchestra.run.smithi121.stdout: "create_time": "2024-04-19T02:15:52.929114+0000", 2024-04-19T02:16:04.604 INFO:teuthology.orchestra.run.smithi121.stdout: "flags": 1, 2024-04-19T02:16:04.604 INFO:teuthology.orchestra.run.smithi121.stdout: "flags_names": "hashpspool", 2024-04-19T02:16:04.604 INFO:teuthology.orchestra.run.smithi121.stdout: "type": 1, 2024-04-19T02:16:04.604 INFO:teuthology.orchestra.run.smithi121.stdout: "size": 2, 2024-04-19T02:16:04.604 INFO:teuthology.orchestra.run.smithi121.stdout: "min_size": 1, 2024-04-19T02:16:04.604 INFO:teuthology.orchestra.run.smithi121.stdout: "crush_rule": 0, 2024-04-19T02:16:04.604 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_count": 0, 2024-04-19T02:16:04.604 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_target": 0, 2024-04-19T02:16:04.604 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T02:16:04.604 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T02:16:04.604 INFO:teuthology.orchestra.run.smithi121.stdout: "object_hash": 2, 2024-04-19T02:16:04.605 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_autoscale_mode": "off", 2024-04-19T02:16:04.605 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num": 16, 2024-04-19T02:16:04.605 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_placement_num": 16, 2024-04-19T02:16:04.605 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_placement_num_target": 16, 2024-04-19T02:16:04.605 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_target": 16, 2024-04-19T02:16:04.605 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_pending": 16, 2024-04-19T02:16:04.605 INFO:teuthology.orchestra.run.smithi121.stdout: "last_pg_merge_meta": { 2024-04-19T02:16:04.605 INFO:teuthology.orchestra.run.smithi121.stdout: "source_pgid": "0.0", 2024-04-19T02:16:04.605 INFO:teuthology.orchestra.run.smithi121.stdout: "ready_epoch": 0, 2024-04-19T02:16:04.605 INFO:teuthology.orchestra.run.smithi121.stdout: "last_epoch_started": 0, 2024-04-19T02:16:04.605 INFO:teuthology.orchestra.run.smithi121.stdout: "last_epoch_clean": 0, 2024-04-19T02:16:04.605 INFO:teuthology.orchestra.run.smithi121.stdout: "source_version": "0'0", 2024-04-19T02:16:04.605 INFO:teuthology.orchestra.run.smithi121.stdout: "target_version": "0'0" 2024-04-19T02:16:04.605 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:04.606 INFO:teuthology.orchestra.run.smithi121.stdout: "last_change": "18", 2024-04-19T02:16:04.606 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend": "0", 2024-04-19T02:16:04.606 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T02:16:04.606 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T02:16:04.606 INFO:teuthology.orchestra.run.smithi121.stdout: "auid": 0, 2024-04-19T02:16:04.606 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_mode": "selfmanaged", 2024-04-19T02:16:04.606 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_seq": 0, 2024-04-19T02:16:04.606 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_epoch": 0, 2024-04-19T02:16:04.606 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_snaps": [], 2024-04-19T02:16:04.606 INFO:teuthology.orchestra.run.smithi121.stdout: "removed_snaps": "[]", 2024-04-19T02:16:04.606 INFO:teuthology.orchestra.run.smithi121.stdout: "quota_max_bytes": 0, 2024-04-19T02:16:04.606 INFO:teuthology.orchestra.run.smithi121.stdout: "quota_max_objects": 0, 2024-04-19T02:16:04.606 INFO:teuthology.orchestra.run.smithi121.stdout: "tiers": [], 2024-04-19T02:16:04.606 INFO:teuthology.orchestra.run.smithi121.stdout: "tier_of": -1, 2024-04-19T02:16:04.607 INFO:teuthology.orchestra.run.smithi121.stdout: "read_tier": -1, 2024-04-19T02:16:04.607 INFO:teuthology.orchestra.run.smithi121.stdout: "write_tier": -1, 2024-04-19T02:16:04.607 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_mode": "none", 2024-04-19T02:16:04.607 INFO:teuthology.orchestra.run.smithi121.stdout: "target_max_bytes": 0, 2024-04-19T02:16:04.607 INFO:teuthology.orchestra.run.smithi121.stdout: "target_max_objects": 0, 2024-04-19T02:16:04.607 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T02:16:04.607 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T02:16:04.607 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T02:16:04.607 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_min_flush_age": 0, 2024-04-19T02:16:04.607 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_min_evict_age": 0, 2024-04-19T02:16:04.607 INFO:teuthology.orchestra.run.smithi121.stdout: "erasure_code_profile": "", 2024-04-19T02:16:04.607 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_params": { 2024-04-19T02:16:04.607 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "none" 2024-04-19T02:16:04.607 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:04.607 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_period": 0, 2024-04-19T02:16:04.608 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_count": 0, 2024-04-19T02:16:04.608 INFO:teuthology.orchestra.run.smithi121.stdout: "use_gmt_hitset": true, 2024-04-19T02:16:04.608 INFO:teuthology.orchestra.run.smithi121.stdout: "min_read_recency_for_promote": 0, 2024-04-19T02:16:04.608 INFO:teuthology.orchestra.run.smithi121.stdout: "min_write_recency_for_promote": 0, 2024-04-19T02:16:04.608 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T02:16:04.608 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_search_last_n": 0, 2024-04-19T02:16:04.608 INFO:teuthology.orchestra.run.smithi121.stdout: "grade_table": [], 2024-04-19T02:16:04.608 INFO:teuthology.orchestra.run.smithi121.stdout: "stripe_width": 0, 2024-04-19T02:16:04.608 INFO:teuthology.orchestra.run.smithi121.stdout: "expected_num_objects": 0, 2024-04-19T02:16:04.608 INFO:teuthology.orchestra.run.smithi121.stdout: "fast_read": false, 2024-04-19T02:16:04.608 INFO:teuthology.orchestra.run.smithi121.stdout: "options": {}, 2024-04-19T02:16:04.608 INFO:teuthology.orchestra.run.smithi121.stdout: "application_metadata": { 2024-04-19T02:16:04.608 INFO:teuthology.orchestra.run.smithi121.stdout: "rados": {} 2024-04-19T02:16:04.608 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:04.609 INFO:teuthology.orchestra.run.smithi121.stdout: "read_balance": { 2024-04-19T02:16:04.609 INFO:teuthology.orchestra.run.smithi121.stdout: "score_acting": 1.1299999952316284, 2024-04-19T02:16:04.609 INFO:teuthology.orchestra.run.smithi121.stdout: "score_stable": 1.1299999952316284, 2024-04-19T02:16:04.609 INFO:teuthology.orchestra.run.smithi121.stdout: "optimal_score": 1, 2024-04-19T02:16:04.609 INFO:teuthology.orchestra.run.smithi121.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-19T02:16:04.609 INFO:teuthology.orchestra.run.smithi121.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-19T02:16:04.609 INFO:teuthology.orchestra.run.smithi121.stdout: "primary_affinity_weighted": 0.90409350395202637, 2024-04-19T02:16:04.609 INFO:teuthology.orchestra.run.smithi121.stdout: "average_primary_affinity": 0.89999997615814209, 2024-04-19T02:16:04.609 INFO:teuthology.orchestra.run.smithi121.stdout: "average_primary_affinity_weighted": 0.89999997615814209 2024-04-19T02:16:04.609 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:04.609 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:04.609 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-04-19T02:16:04.609 INFO:teuthology.orchestra.run.smithi121.stdout: "osds": [ 2024-04-19T02:16:04.609 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:04.610 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": 0, 2024-04-19T02:16:04.610 INFO:teuthology.orchestra.run.smithi121.stdout: "uuid": "88cb15f3-271c-43d5-af51-1cd26b8ed13c", 2024-04-19T02:16:04.610 INFO:teuthology.orchestra.run.smithi121.stdout: "up": 1, 2024-04-19T02:16:04.610 INFO:teuthology.orchestra.run.smithi121.stdout: "in": 1, 2024-04-19T02:16:04.610 INFO:teuthology.orchestra.run.smithi121.stdout: "weight": 1, 2024-04-19T02:16:04.610 INFO:teuthology.orchestra.run.smithi121.stdout: "primary_affinity": 1, 2024-04-19T02:16:04.610 INFO:teuthology.orchestra.run.smithi121.stdout: "last_clean_begin": 0, 2024-04-19T02:16:04.610 INFO:teuthology.orchestra.run.smithi121.stdout: "last_clean_end": 0, 2024-04-19T02:16:04.610 INFO:teuthology.orchestra.run.smithi121.stdout: "up_from": 8, 2024-04-19T02:16:04.610 INFO:teuthology.orchestra.run.smithi121.stdout: "up_thru": 16, 2024-04-19T02:16:04.610 INFO:teuthology.orchestra.run.smithi121.stdout: "down_at": 0, 2024-04-19T02:16:04.610 INFO:teuthology.orchestra.run.smithi121.stdout: "lost_at": 0, 2024-04-19T02:16:04.610 INFO:teuthology.orchestra.run.smithi121.stdout: "public_addrs": { 2024-04-19T02:16:04.611 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:16:04.611 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:04.611 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:16:04.611 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.153:6800", 2024-04-19T02:16:04.611 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41347 2024-04-19T02:16:04.611 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:04.611 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:04.611 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:16:04.611 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.153:6801", 2024-04-19T02:16:04.611 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41347 2024-04-19T02:16:04.611 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:04.611 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:16:04.611 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:04.612 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_addrs": { 2024-04-19T02:16:04.612 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:16:04.612 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:04.612 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:16:04.612 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.153:6802", 2024-04-19T02:16:04.612 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41347 2024-04-19T02:16:04.612 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:04.612 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:04.612 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:16:04.612 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.153:6803", 2024-04-19T02:16:04.612 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41347 2024-04-19T02:16:04.612 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:04.613 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:16:04.613 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:04.613 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_back_addrs": { 2024-04-19T02:16:04.613 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:16:04.613 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:04.613 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:16:04.613 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.153:6806", 2024-04-19T02:16:04.613 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41347 2024-04-19T02:16:04.613 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:04.613 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:04.613 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:16:04.613 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.153:6807", 2024-04-19T02:16:04.613 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41347 2024-04-19T02:16:04.613 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:04.614 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:16:04.614 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:04.614 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_front_addrs": { 2024-04-19T02:16:04.614 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:16:04.614 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:04.614 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:16:04.614 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.153:6804", 2024-04-19T02:16:04.614 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41347 2024-04-19T02:16:04.614 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:04.614 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:04.614 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:16:04.614 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.153:6805", 2024-04-19T02:16:04.614 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41347 2024-04-19T02:16:04.614 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:04.614 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:16:04.615 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:04.615 INFO:teuthology.orchestra.run.smithi121.stdout: "public_addr": "172.21.15.153:6801/41347", 2024-04-19T02:16:04.615 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_addr": "172.21.15.153:6803/41347", 2024-04-19T02:16:04.615 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_back_addr": "172.21.15.153:6807/41347", 2024-04-19T02:16:04.615 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_front_addr": "172.21.15.153:6805/41347", 2024-04-19T02:16:04.615 INFO:teuthology.orchestra.run.smithi121.stdout: "state": [ 2024-04-19T02:16:04.615 INFO:teuthology.orchestra.run.smithi121.stdout: "exists", 2024-04-19T02:16:04.615 INFO:teuthology.orchestra.run.smithi121.stdout: "up" 2024-04-19T02:16:04.615 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:16:04.615 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:04.615 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:04.615 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": 1, 2024-04-19T02:16:04.615 INFO:teuthology.orchestra.run.smithi121.stdout: "uuid": "2674869a-db01-4d9f-a496-9fb3851b5b21", 2024-04-19T02:16:04.615 INFO:teuthology.orchestra.run.smithi121.stdout: "up": 1, 2024-04-19T02:16:04.615 INFO:teuthology.orchestra.run.smithi121.stdout: "in": 1, 2024-04-19T02:16:04.615 INFO:teuthology.orchestra.run.smithi121.stdout: "weight": 1, 2024-04-19T02:16:04.616 INFO:teuthology.orchestra.run.smithi121.stdout: "primary_affinity": 0.7122802734375, 2024-04-19T02:16:04.616 INFO:teuthology.orchestra.run.smithi121.stdout: "last_clean_begin": 0, 2024-04-19T02:16:04.616 INFO:teuthology.orchestra.run.smithi121.stdout: "last_clean_end": 0, 2024-04-19T02:16:04.616 INFO:teuthology.orchestra.run.smithi121.stdout: "up_from": 8, 2024-04-19T02:16:04.616 INFO:teuthology.orchestra.run.smithi121.stdout: "up_thru": 16, 2024-04-19T02:16:04.616 INFO:teuthology.orchestra.run.smithi121.stdout: "down_at": 0, 2024-04-19T02:16:04.616 INFO:teuthology.orchestra.run.smithi121.stdout: "lost_at": 0, 2024-04-19T02:16:04.616 INFO:teuthology.orchestra.run.smithi121.stdout: "public_addrs": { 2024-04-19T02:16:04.616 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:16:04.616 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:04.616 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:16:04.616 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.174:6800", 2024-04-19T02:16:04.617 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41380 2024-04-19T02:16:04.617 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:04.617 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:04.617 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:16:04.617 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.174:6801", 2024-04-19T02:16:04.617 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41380 2024-04-19T02:16:04.617 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:04.617 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:16:04.617 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:04.617 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_addrs": { 2024-04-19T02:16:04.617 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:16:04.617 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:04.617 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:16:04.618 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.174:6802", 2024-04-19T02:16:04.618 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41380 2024-04-19T02:16:04.618 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:04.618 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:04.618 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:16:04.618 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.174:6803", 2024-04-19T02:16:04.618 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41380 2024-04-19T02:16:04.618 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:04.618 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:16:04.618 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:04.618 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_back_addrs": { 2024-04-19T02:16:04.618 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:16:04.619 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:04.619 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:16:04.619 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.174:6806", 2024-04-19T02:16:04.619 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41380 2024-04-19T02:16:04.619 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:04.619 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:04.619 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:16:04.619 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.174:6807", 2024-04-19T02:16:04.619 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41380 2024-04-19T02:16:04.619 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:04.619 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:16:04.619 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:04.619 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_front_addrs": { 2024-04-19T02:16:04.619 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:16:04.620 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:04.620 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:16:04.620 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.174:6804", 2024-04-19T02:16:04.620 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41380 2024-04-19T02:16:04.620 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:04.620 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:04.620 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:16:04.620 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.174:6805", 2024-04-19T02:16:04.620 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41380 2024-04-19T02:16:04.620 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:04.620 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:16:04.620 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:04.621 INFO:teuthology.orchestra.run.smithi121.stdout: "public_addr": "172.21.15.174:6801/41380", 2024-04-19T02:16:04.621 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_addr": "172.21.15.174:6803/41380", 2024-04-19T02:16:04.621 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_back_addr": "172.21.15.174:6807/41380", 2024-04-19T02:16:04.621 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_front_addr": "172.21.15.174:6805/41380", 2024-04-19T02:16:04.621 INFO:teuthology.orchestra.run.smithi121.stdout: "state": [ 2024-04-19T02:16:04.621 INFO:teuthology.orchestra.run.smithi121.stdout: "exists", 2024-04-19T02:16:04.621 INFO:teuthology.orchestra.run.smithi121.stdout: "up" 2024-04-19T02:16:04.621 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:16:04.621 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:04.621 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:04.621 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": 2, 2024-04-19T02:16:04.621 INFO:teuthology.orchestra.run.smithi121.stdout: "uuid": "712ad943-2f98-49d9-aabe-f66b509be633", 2024-04-19T02:16:04.621 INFO:teuthology.orchestra.run.smithi121.stdout: "up": 1, 2024-04-19T02:16:04.622 INFO:teuthology.orchestra.run.smithi121.stdout: "in": 1, 2024-04-19T02:16:04.622 INFO:teuthology.orchestra.run.smithi121.stdout: "weight": 1, 2024-04-19T02:16:04.622 INFO:teuthology.orchestra.run.smithi121.stdout: "primary_affinity": 1, 2024-04-19T02:16:04.622 INFO:teuthology.orchestra.run.smithi121.stdout: "last_clean_begin": 0, 2024-04-19T02:16:04.622 INFO:teuthology.orchestra.run.smithi121.stdout: "last_clean_end": 0, 2024-04-19T02:16:04.622 INFO:teuthology.orchestra.run.smithi121.stdout: "up_from": 8, 2024-04-19T02:16:04.622 INFO:teuthology.orchestra.run.smithi121.stdout: "up_thru": 16, 2024-04-19T02:16:04.622 INFO:teuthology.orchestra.run.smithi121.stdout: "down_at": 0, 2024-04-19T02:16:04.622 INFO:teuthology.orchestra.run.smithi121.stdout: "lost_at": 0, 2024-04-19T02:16:04.622 INFO:teuthology.orchestra.run.smithi121.stdout: "public_addrs": { 2024-04-19T02:16:04.622 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:16:04.622 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:04.623 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:16:04.623 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.177:6800", 2024-04-19T02:16:04.623 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41508 2024-04-19T02:16:04.623 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:04.623 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:04.623 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:16:04.623 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.177:6801", 2024-04-19T02:16:04.623 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41508 2024-04-19T02:16:04.623 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:04.623 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:16:04.623 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:04.623 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_addrs": { 2024-04-19T02:16:04.623 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:16:04.623 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:04.624 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:16:04.624 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.177:6802", 2024-04-19T02:16:04.624 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41508 2024-04-19T02:16:04.624 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:04.624 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:04.624 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:16:04.624 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.177:6803", 2024-04-19T02:16:04.624 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41508 2024-04-19T02:16:04.624 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:04.624 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:16:04.624 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:04.624 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_back_addrs": { 2024-04-19T02:16:04.624 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:16:04.624 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:04.625 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:16:04.625 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.177:6806", 2024-04-19T02:16:04.625 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41508 2024-04-19T02:16:04.625 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:04.625 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:04.625 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:16:04.625 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.177:6807", 2024-04-19T02:16:04.625 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41508 2024-04-19T02:16:04.625 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:04.625 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:16:04.625 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:04.625 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_front_addrs": { 2024-04-19T02:16:04.625 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:16:04.625 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:04.625 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:16:04.626 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.177:6804", 2024-04-19T02:16:04.626 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41508 2024-04-19T02:16:04.626 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:04.626 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:04.626 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:16:04.626 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.177:6805", 2024-04-19T02:16:04.626 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41508 2024-04-19T02:16:04.626 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:04.626 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:16:04.626 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:04.626 INFO:teuthology.orchestra.run.smithi121.stdout: "public_addr": "172.21.15.177:6801/41508", 2024-04-19T02:16:04.626 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_addr": "172.21.15.177:6803/41508", 2024-04-19T02:16:04.626 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_back_addr": "172.21.15.177:6807/41508", 2024-04-19T02:16:04.626 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_front_addr": "172.21.15.177:6805/41508", 2024-04-19T02:16:04.627 INFO:teuthology.orchestra.run.smithi121.stdout: "state": [ 2024-04-19T02:16:04.627 INFO:teuthology.orchestra.run.smithi121.stdout: "exists", 2024-04-19T02:16:04.627 INFO:teuthology.orchestra.run.smithi121.stdout: "up" 2024-04-19T02:16:04.627 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:16:04.627 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:04.627 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-04-19T02:16:04.627 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_xinfo": [ 2024-04-19T02:16:04.627 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:04.627 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": 0, 2024-04-19T02:16:04.627 INFO:teuthology.orchestra.run.smithi121.stdout: "down_stamp": "0.000000", 2024-04-19T02:16:04.627 INFO:teuthology.orchestra.run.smithi121.stdout: "laggy_probability": 0, 2024-04-19T02:16:04.627 INFO:teuthology.orchestra.run.smithi121.stdout: "laggy_interval": 0, 2024-04-19T02:16:04.627 INFO:teuthology.orchestra.run.smithi121.stdout: "features": 4540138322906710015, 2024-04-19T02:16:04.627 INFO:teuthology.orchestra.run.smithi121.stdout: "old_weight": 0, 2024-04-19T02:16:04.627 INFO:teuthology.orchestra.run.smithi121.stdout: "last_purged_snaps_scrub": "2024-04-19T02:15:20.495280+0000", 2024-04-19T02:16:04.628 INFO:teuthology.orchestra.run.smithi121.stdout: "dead_epoch": 0 2024-04-19T02:16:04.628 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:04.628 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:04.628 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": 1, 2024-04-19T02:16:04.628 INFO:teuthology.orchestra.run.smithi121.stdout: "down_stamp": "0.000000", 2024-04-19T02:16:04.628 INFO:teuthology.orchestra.run.smithi121.stdout: "laggy_probability": 0, 2024-04-19T02:16:04.628 INFO:teuthology.orchestra.run.smithi121.stdout: "laggy_interval": 0, 2024-04-19T02:16:04.628 INFO:teuthology.orchestra.run.smithi121.stdout: "features": 4540138322906710015, 2024-04-19T02:16:04.628 INFO:teuthology.orchestra.run.smithi121.stdout: "old_weight": 0, 2024-04-19T02:16:04.628 INFO:teuthology.orchestra.run.smithi121.stdout: "last_purged_snaps_scrub": "2024-04-19T02:15:20.594553+0000", 2024-04-19T02:16:04.628 INFO:teuthology.orchestra.run.smithi121.stdout: "dead_epoch": 0 2024-04-19T02:16:04.628 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:04.628 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:04.628 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": 2, 2024-04-19T02:16:04.628 INFO:teuthology.orchestra.run.smithi121.stdout: "down_stamp": "0.000000", 2024-04-19T02:16:04.628 INFO:teuthology.orchestra.run.smithi121.stdout: "laggy_probability": 0, 2024-04-19T02:16:04.629 INFO:teuthology.orchestra.run.smithi121.stdout: "laggy_interval": 0, 2024-04-19T02:16:04.629 INFO:teuthology.orchestra.run.smithi121.stdout: "features": 4540138322906710015, 2024-04-19T02:16:04.629 INFO:teuthology.orchestra.run.smithi121.stdout: "old_weight": 0, 2024-04-19T02:16:04.629 INFO:teuthology.orchestra.run.smithi121.stdout: "last_purged_snaps_scrub": "2024-04-19T02:15:20.524253+0000", 2024-04-19T02:16:04.629 INFO:teuthology.orchestra.run.smithi121.stdout: "dead_epoch": 0 2024-04-19T02:16:04.629 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:04.629 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-04-19T02:16:04.629 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_upmap": [], 2024-04-19T02:16:04.629 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_upmap_items": [], 2024-04-19T02:16:04.629 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_upmap_primaries": [], 2024-04-19T02:16:04.629 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_temp": [], 2024-04-19T02:16:04.629 INFO:teuthology.orchestra.run.smithi121.stdout: "primary_temp": [], 2024-04-19T02:16:04.629 INFO:teuthology.orchestra.run.smithi121.stdout: "blocklist": {}, 2024-04-19T02:16:04.629 INFO:teuthology.orchestra.run.smithi121.stdout: "range_blocklist": {}, 2024-04-19T02:16:04.629 INFO:teuthology.orchestra.run.smithi121.stdout: "erasure_code_profiles": { 2024-04-19T02:16:04.629 INFO:teuthology.orchestra.run.smithi121.stdout: "default": { 2024-04-19T02:16:04.630 INFO:teuthology.orchestra.run.smithi121.stdout: "crush-failure-domain": "osd", 2024-04-19T02:16:04.630 INFO:teuthology.orchestra.run.smithi121.stdout: "k": "2", 2024-04-19T02:16:04.630 INFO:teuthology.orchestra.run.smithi121.stdout: "m": "1", 2024-04-19T02:16:04.630 INFO:teuthology.orchestra.run.smithi121.stdout: "plugin": "jerasure", 2024-04-19T02:16:04.630 INFO:teuthology.orchestra.run.smithi121.stdout: "technique": "reed_sol_van" 2024-04-19T02:16:04.630 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:04.630 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:04.630 INFO:teuthology.orchestra.run.smithi121.stdout: "removed_snaps_queue": [], 2024-04-19T02:16:04.630 INFO:teuthology.orchestra.run.smithi121.stdout: "new_removed_snaps": [], 2024-04-19T02:16:04.630 INFO:teuthology.orchestra.run.smithi121.stdout: "new_purged_snaps": [], 2024-04-19T02:16:04.630 INFO:teuthology.orchestra.run.smithi121.stdout: "crush_node_flags": {}, 2024-04-19T02:16:04.630 INFO:teuthology.orchestra.run.smithi121.stdout: "device_class_flags": {}, 2024-04-19T02:16:04.630 INFO:teuthology.orchestra.run.smithi121.stdout: "stretch_mode": { 2024-04-19T02:16:04.631 INFO:teuthology.orchestra.run.smithi121.stdout: "stretch_mode_enabled": false, 2024-04-19T02:16:04.631 INFO:teuthology.orchestra.run.smithi121.stdout: "stretch_bucket_count": 0, 2024-04-19T02:16:04.631 INFO:teuthology.orchestra.run.smithi121.stdout: "degraded_stretch_mode": 0, 2024-04-19T02:16:04.631 INFO:teuthology.orchestra.run.smithi121.stdout: "recovering_stretch_mode": 0, 2024-04-19T02:16:04.631 INFO:teuthology.orchestra.run.smithi121.stdout: "stretch_mode_bucket": 0 2024-04-19T02:16:04.631 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:04.631 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-04-19T02:16:04.632 INFO:tasks.thrashosds.thrasher:j is {'epoch': 21, 'fsid': 'f6ab5dd0-bb9f-4b48-a9fc-4728c7955ca8', 'created': '2024-04-19T02:15:13.539846+0000', 'modified': '2024-04-19T02:16:01.970564+0000', 'last_up_change': '2024-04-19T02:15:22.519568+0000', 'last_in_change': '2024-04-19T02:15:15.482624+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-19T02:15:22.776125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9040935039520264, 'average_primary_affinity': 0.8999999761581421, 'average_primary_affinity_weighted': 0.8999999761581421}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-19T02:15:23.264005+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9040935039520264, 'average_primary_affinity': 0.8999999761581421, 'average_primary_affinity_weighted': 0.8999999761581421}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-19T02:15:27.675087+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.2200000286102295, 'score_stable': 1.2200000286102295, 'optimal_score': 1, 'raw_score_acting': 1.2200000286102295, 'raw_score_stable': 1.2200000286102295, 'primary_affinity_weighted': 0.9040935039520264, 'average_primary_affinity': 0.8999999761581421, 'average_primary_affinity_weighted': 0.8999999761581421}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-19T02:15:28.232224+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1699999570846558, 'score_stable': 1.1699999570846558, 'optimal_score': 1, 'raw_score_acting': 1.1699999570846558, 'raw_score_stable': 1.1699999570846558, 'primary_affinity_weighted': 0.9040935039520264, 'average_primary_affinity': 0.8999999761581421, 'average_primary_affinity_weighted': 0.8999999761581421}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2024-04-19T02:15:52.929114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 0.9040935039520264, 'average_primary_affinity': 0.8999999761581421, 'average_primary_affinity_weighted': 0.8999999761581421}}], 'osds': [{'osd': 0, 'uuid': '88cb15f3-271c-43d5-af51-1cd26b8ed13c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6800', 'nonce': 41347}, {'type': 'v1', 'addr': '172.21.15.153:6801', 'nonce': 41347}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6802', 'nonce': 41347}, {'type': 'v1', 'addr': '172.21.15.153:6803', 'nonce': 41347}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6806', 'nonce': 41347}, {'type': 'v1', 'addr': '172.21.15.153:6807', 'nonce': 41347}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6804', 'nonce': 41347}, {'type': 'v1', 'addr': '172.21.15.153:6805', 'nonce': 41347}]}, 'public_addr': '172.21.15.153:6801/41347', 'cluster_addr': '172.21.15.153:6803/41347', 'heartbeat_back_addr': '172.21.15.153:6807/41347', 'heartbeat_front_addr': '172.21.15.153:6805/41347', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '2674869a-db01-4d9f-a496-9fb3851b5b21', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.7122802734375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6800', 'nonce': 41380}, {'type': 'v1', 'addr': '172.21.15.174:6801', 'nonce': 41380}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6802', 'nonce': 41380}, {'type': 'v1', 'addr': '172.21.15.174:6803', 'nonce': 41380}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6806', 'nonce': 41380}, {'type': 'v1', 'addr': '172.21.15.174:6807', 'nonce': 41380}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6804', 'nonce': 41380}, {'type': 'v1', 'addr': '172.21.15.174:6805', 'nonce': 41380}]}, 'public_addr': '172.21.15.174:6801/41380', 'cluster_addr': '172.21.15.174:6803/41380', 'heartbeat_back_addr': '172.21.15.174:6807/41380', 'heartbeat_front_addr': '172.21.15.174:6805/41380', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '712ad943-2f98-49d9-aabe-f66b509be633', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6800', 'nonce': 41508}, {'type': 'v1', 'addr': '172.21.15.177:6801', 'nonce': 41508}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6802', 'nonce': 41508}, {'type': 'v1', 'addr': '172.21.15.177:6803', 'nonce': 41508}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6806', 'nonce': 41508}, {'type': 'v1', 'addr': '172.21.15.177:6807', 'nonce': 41508}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6804', 'nonce': 41508}, {'type': 'v1', 'addr': '172.21.15.177:6805', 'nonce': 41508}]}, 'public_addr': '172.21.15.177:6801/41508', 'cluster_addr': '172.21.15.177:6803/41508', 'heartbeat_back_addr': '172.21.15.177:6807/41508', 'heartbeat_front_addr': '172.21.15.177:6805/41508', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-19T02:15:20.495280+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-19T02:15:20.594553+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-19T02:15:20.524253+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-19T02:16:04.633 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:16:04.658 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:16:04.658 INFO:teuthology.orchestra.run.smithi174.stdout: "size": 20, 2024-04-19T02:16:04.658 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 600, 2024-04-19T02:16:04.658 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:16:04.658 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.658 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:10 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:04.659 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269877+0000", 2024-04-19T02:16:04.659 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 35.386705380000002, 2024-04-19T02:16:04.659 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020732751000000001, 2024-04-19T02:16:04.659 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:04.659 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:04.659 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:04.659 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.659 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:04.659 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269877+0000", 2024-04-19T02:16:04.659 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:04.659 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.659 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.659 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:04.660 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269877+0000", 2024-04-19T02:16:04.660 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:04.660 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.660 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.660 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:04.660 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269875+0000", 2024-04-19T02:16:04.660 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:04.660 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.660 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.660 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:04.660 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269891+0000", 2024-04-19T02:16:04.660 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.5494000000000001e-05 2024-04-19T02:16:04.661 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.661 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.661 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:04.661 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269903+0000", 2024-04-19T02:16:04.661 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2003e-05 2024-04-19T02:16:04.661 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.661 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.661 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:04.661 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269914+0000", 2024-04-19T02:16:04.661 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0947e-05 2024-04-19T02:16:04.661 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.661 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.661 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:04.662 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269971+0000", 2024-04-19T02:16:04.662 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7036000000000001e-05 2024-04-19T02:16:04.662 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.662 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.662 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:16:04.662 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269979+0000", 2024-04-19T02:16:04.662 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.6660000000000008e-06 2024-04-19T02:16:04.662 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.662 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.662 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:04.662 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284891+0000", 2024-04-19T02:16:04.662 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014912584 2024-04-19T02:16:04.663 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.663 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.663 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:04.663 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285213+0000", 2024-04-19T02:16:04.663 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00032172199999999998 2024-04-19T02:16:04.663 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.663 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.663 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:04.663 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285357+0000", 2024-04-19T02:16:04.663 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014367899999999999 2024-04-19T02:16:04.663 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.663 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.663 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:04.664 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288883+0000", 2024-04-19T02:16:04.664 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0035268719999999999 2024-04-19T02:16:04.664 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.664 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.664 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:04.664 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290537+0000", 2024-04-19T02:16:04.664 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016537399999999999 2024-04-19T02:16:04.664 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.664 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.664 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:04.664 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290576+0000", 2024-04-19T02:16:04.664 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9266e-05 2024-04-19T02:16:04.664 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.665 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.665 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:04.665 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290609+0000", 2024-04-19T02:16:04.665 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2818000000000003e-05 2024-04-19T02:16:04.665 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:04.665 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:04.665 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:04.665 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.665 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.665 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:11 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:04.665 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:04.666 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 35.386652458999997, 2024-04-19T02:16:04.666 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020352748, 2024-04-19T02:16:04.666 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:04.666 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:04.666 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:04.666 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.666 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:04.666 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:04.666 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:04.666 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.666 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.666 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:04.667 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:04.667 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:04.667 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.667 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.667 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:04.667 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:04.667 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:04.667 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.667 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.667 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:04.667 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269933+0000", 2024-04-19T02:16:04.667 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2169999999999996e-06 2024-04-19T02:16:04.668 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.668 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.668 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:04.668 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269940+0000", 2024-04-19T02:16:04.668 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1500000000000002e-06 2024-04-19T02:16:04.668 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.668 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.668 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:04.668 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269948+0000", 2024-04-19T02:16:04.668 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.8690000000000004e-06 2024-04-19T02:16:04.668 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.668 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.669 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:04.669 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:16:04.669 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2994999999999997e-05 2024-04-19T02:16:04.669 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.669 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.669 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:16:04.669 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269997+0000", 2024-04-19T02:16:04.669 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.9020000000000004e-06 2024-04-19T02:16:04.669 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.669 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.669 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:04.669 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.282729+0000", 2024-04-19T02:16:04.669 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.012732537 2024-04-19T02:16:04.670 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.670 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.670 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:04.670 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.282838+0000", 2024-04-19T02:16:04.670 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000108298 2024-04-19T02:16:04.670 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.670 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.670 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:04.670 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.283002+0000", 2024-04-19T02:16:04.670 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00016466300000000001 2024-04-19T02:16:04.671 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.671 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.671 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:04.671 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288708+0000", 2024-04-19T02:16:04.671 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.005705066 2024-04-19T02:16:04.671 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.671 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.671 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:04.671 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290215+0000", 2024-04-19T02:16:04.671 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0015075010000000001 2024-04-19T02:16:04.671 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.671 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.672 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:04.672 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290259+0000", 2024-04-19T02:16:04.672 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3711999999999998e-05 2024-04-19T02:16:04.672 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.672 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.672 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:04.672 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290282+0000", 2024-04-19T02:16:04.672 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3458000000000001e-05 2024-04-19T02:16:04.672 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:04.672 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:04.672 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:04.672 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.672 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.673 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:14 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:04.673 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:04.673 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 35.386618669000001, 2024-04-19T02:16:04.673 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020137202, 2024-04-19T02:16:04.673 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:04.673 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:04.673 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:04.673 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.673 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:04.673 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:04.673 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:04.673 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.673 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.674 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:04.674 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:04.674 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:04.674 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.674 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.674 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:04.674 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:04.674 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:04.674 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.674 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.674 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:04.675 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269971+0000", 2024-04-19T02:16:04.675 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.5459999999999992e-06 2024-04-19T02:16:04.675 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.675 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.675 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:04.675 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269979+0000", 2024-04-19T02:16:04.675 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9130000000000003e-06 2024-04-19T02:16:04.675 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.675 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.675 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:04.675 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269986+0000", 2024-04-19T02:16:04.675 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.3779999999999998e-06 2024-04-19T02:16:04.675 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.676 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.676 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:04.676 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270030+0000", 2024-04-19T02:16:04.676 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3982e-05 2024-04-19T02:16:04.676 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.676 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.676 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:16:04.676 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270034+0000", 2024-04-19T02:16:04.676 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1779999999999996e-06 2024-04-19T02:16:04.676 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.676 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.677 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:04.677 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.277870+0000", 2024-04-19T02:16:04.677 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0078362150000000005 2024-04-19T02:16:04.677 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.677 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.677 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:04.677 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.278216+0000", 2024-04-19T02:16:04.677 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00034634999999999999 2024-04-19T02:16:04.677 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.677 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.677 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:04.678 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.278732+0000", 2024-04-19T02:16:04.678 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00051536099999999999 2024-04-19T02:16:04.678 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.678 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.678 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:04.678 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.287694+0000", 2024-04-19T02:16:04.678 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0089621019999999996 2024-04-19T02:16:04.678 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.678 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.678 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:04.678 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290026+0000", 2024-04-19T02:16:04.678 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0023323139999999998 2024-04-19T02:16:04.679 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.679 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.679 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:04.679 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290067+0000", 2024-04-19T02:16:04.679 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1043e-05 2024-04-19T02:16:04.679 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.679 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.679 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:04.679 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290100+0000", 2024-04-19T02:16:04.679 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3278999999999998e-05 2024-04-19T02:16:04.679 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:04.679 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:04.679 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:04.680 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.680 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.680 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:04.680 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:04.680 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 35.386586876999999, 2024-04-19T02:16:04.680 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020731702000000001, 2024-04-19T02:16:04.680 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:04.680 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:04.680 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:04.680 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.680 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:04.680 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:04.680 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:04.681 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.681 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.681 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:04.681 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:04.681 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:04.681 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.681 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.681 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:04.681 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:04.681 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:04.681 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.681 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.681 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:04.682 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269998+0000", 2024-04-19T02:16:04.682 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7100000000000001e-06 2024-04-19T02:16:04.682 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.682 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.682 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:04.682 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270005+0000", 2024-04-19T02:16:04.682 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.241e-06 2024-04-19T02:16:04.682 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.682 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.682 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:04.682 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270011+0000", 2024-04-19T02:16:04.682 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6279999999999999e-06 2024-04-19T02:16:04.683 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.683 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.683 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:04.683 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270046+0000", 2024-04-19T02:16:04.683 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5173999999999999e-05 2024-04-19T02:16:04.683 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.683 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.683 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:04.683 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:04.683 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0019999999999997e-06 2024-04-19T02:16:04.683 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.684 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.684 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:04.684 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285619+0000", 2024-04-19T02:16:04.684 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015567391 2024-04-19T02:16:04.684 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.684 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.684 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:04.684 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285671+0000", 2024-04-19T02:16:04.684 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2460999999999998e-05 2024-04-19T02:16:04.684 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.684 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.684 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:04.684 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285775+0000", 2024-04-19T02:16:04.685 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000103389 2024-04-19T02:16:04.685 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.685 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.685 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:04.685 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288934+0000", 2024-04-19T02:16:04.685 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0031595859999999998 2024-04-19T02:16:04.685 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.685 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.685 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:04.685 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290650+0000", 2024-04-19T02:16:04.685 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001716242 2024-04-19T02:16:04.685 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.685 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.686 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:04.686 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290692+0000", 2024-04-19T02:16:04.686 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1910999999999999e-05 2024-04-19T02:16:04.686 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.686 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.686 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:04.686 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290727+0000", 2024-04-19T02:16:04.686 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4412000000000002e-05 2024-04-19T02:16:04.686 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:04.686 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:04.686 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:04.686 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.686 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.687 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:04.687 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270019+0000", 2024-04-19T02:16:04.687 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 35.386563281999997, 2024-04-19T02:16:04.687 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020572014999999999, 2024-04-19T02:16:04.687 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:04.687 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:04.687 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:04.687 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.687 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:04.687 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270019+0000", 2024-04-19T02:16:04.687 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:04.687 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.687 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.688 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:04.688 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270019+0000", 2024-04-19T02:16:04.688 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:04.688 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.688 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.688 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:04.688 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270018+0000", 2024-04-19T02:16:04.688 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:04.688 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.688 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.688 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:04.688 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270021+0000", 2024-04-19T02:16:04.689 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0319999999999999e-06 2024-04-19T02:16:04.689 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.689 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.689 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:04.689 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270028+0000", 2024-04-19T02:16:04.689 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6189999999999996e-06 2024-04-19T02:16:04.689 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.689 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.689 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:04.689 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270035+0000", 2024-04-19T02:16:04.689 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1690000000000003e-06 2024-04-19T02:16:04.689 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.690 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.690 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:04.690 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270078+0000", 2024-04-19T02:16:04.690 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3061e-05 2024-04-19T02:16:04.690 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.690 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.690 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:04.690 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270082+0000", 2024-04-19T02:16:04.690 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4510000000000002e-06 2024-04-19T02:16:04.690 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.690 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.690 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:04.691 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284354+0000", 2024-04-19T02:16:04.691 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014271588999999999 2024-04-19T02:16:04.691 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.691 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.691 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:04.691 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284497+0000", 2024-04-19T02:16:04.691 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014335800000000001 2024-04-19T02:16:04.691 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.691 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.691 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:04.691 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284626+0000", 2024-04-19T02:16:04.691 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000128744 2024-04-19T02:16:04.692 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.692 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.692 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:04.692 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288844+0000", 2024-04-19T02:16:04.692 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00421807 2024-04-19T02:16:04.692 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.692 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.692 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:04.692 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290508+0000", 2024-04-19T02:16:04.692 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001663774 2024-04-19T02:16:04.692 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.692 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.693 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:04.693 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290556+0000", 2024-04-19T02:16:04.693 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.7599999999999998e-05 2024-04-19T02:16:04.693 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.693 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.693 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:04.693 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290591+0000", 2024-04-19T02:16:04.693 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5034999999999999e-05 2024-04-19T02:16:04.693 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:04.693 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:04.693 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:04.693 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.694 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.694 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:04.694 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:04.694 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 35.386540418999999, 2024-04-19T02:16:04.694 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020192280999999999, 2024-04-19T02:16:04.694 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:04.694 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:04.694 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:04.694 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.694 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:04.694 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:04.695 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:04.695 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.695 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.695 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:04.695 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:04.695 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:04.695 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.695 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.695 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:04.695 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:04.695 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:04.696 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.696 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.696 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:04.696 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270045+0000", 2024-04-19T02:16:04.696 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8680000000000001e-06 2024-04-19T02:16:04.696 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.696 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.696 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:04.696 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270052+0000", 2024-04-19T02:16:04.696 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.9999999999999999e-06 2024-04-19T02:16:04.697 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.697 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.697 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:04.697 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270056+0000", 2024-04-19T02:16:04.697 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4479999999999996e-06 2024-04-19T02:16:04.697 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.697 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.697 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:04.697 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270089+0000", 2024-04-19T02:16:04.697 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3071000000000002e-05 2024-04-19T02:16:04.697 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.698 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.698 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:04.698 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270092+0000", 2024-04-19T02:16:04.698 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9780000000000001e-06 2024-04-19T02:16:04.698 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.698 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.698 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:04.698 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.280632+0000", 2024-04-19T02:16:04.698 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010539712 2024-04-19T02:16:04.698 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.698 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.699 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:04.699 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.280743+0000", 2024-04-19T02:16:04.699 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000111048 2024-04-19T02:16:04.699 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.699 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.699 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:04.699 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.281531+0000", 2024-04-19T02:16:04.699 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00078738199999999999 2024-04-19T02:16:04.699 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.699 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.699 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:04.699 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.287949+0000", 2024-04-19T02:16:04.700 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0064185730000000003 2024-04-19T02:16:04.700 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.700 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.700 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:04.700 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290184+0000", 2024-04-19T02:16:04.700 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0022350849999999999 2024-04-19T02:16:04.700 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.700 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.700 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:04.700 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290209+0000", 2024-04-19T02:16:04.700 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4907000000000001e-05 2024-04-19T02:16:04.700 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.701 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.701 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:04.701 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290234+0000", 2024-04-19T02:16:04.701 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4666999999999999e-05 2024-04-19T02:16:04.701 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:04.701 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:04.701 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:04.701 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.701 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.701 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:19 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:04.701 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:04.702 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 35.386518952999999, 2024-04-19T02:16:04.702 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020818203, 2024-04-19T02:16:04.702 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:04.702 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:04.702 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:04.702 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.702 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:04.702 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:04.702 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:04.702 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.702 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.702 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:04.703 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:04.703 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:04.703 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.703 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.703 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:04.703 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:04.703 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:04.703 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.703 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.703 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:04.703 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270065+0000", 2024-04-19T02:16:04.703 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4310000000000001e-06 2024-04-19T02:16:04.703 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.704 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.704 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:04.704 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270070+0000", 2024-04-19T02:16:04.704 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2859999999999999e-06 2024-04-19T02:16:04.704 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.704 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.704 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:04.704 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270077+0000", 2024-04-19T02:16:04.704 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5270000000000004e-06 2024-04-19T02:16:04.704 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.704 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.705 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:04.705 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270107+0000", 2024-04-19T02:16:04.705 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0205999999999998e-05 2024-04-19T02:16:04.705 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.705 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.705 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:04.705 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270111+0000", 2024-04-19T02:16:04.705 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8650000000000003e-06 2024-04-19T02:16:04.705 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.705 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.705 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:04.705 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285936+0000", 2024-04-19T02:16:04.705 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015824677999999998 2024-04-19T02:16:04.706 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.706 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.706 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:04.706 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286007+0000", 2024-04-19T02:16:04.706 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1157999999999999e-05 2024-04-19T02:16:04.706 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.706 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.706 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:04.706 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286086+0000", 2024-04-19T02:16:04.706 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9084000000000004e-05 2024-04-19T02:16:04.706 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.706 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.707 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:04.707 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290740+0000", 2024-04-19T02:16:04.707 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0046543679999999999 2024-04-19T02:16:04.707 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.707 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.707 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:04.707 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290833+0000", 2024-04-19T02:16:04.707 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2551000000000002e-05 2024-04-19T02:16:04.707 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.708 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.708 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:04.708 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290859+0000", 2024-04-19T02:16:04.708 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.6696999999999999e-05 2024-04-19T02:16:04.708 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.708 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.708 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:04.708 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290881+0000", 2024-04-19T02:16:04.708 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1653000000000001e-05 2024-04-19T02:16:04.708 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:04.708 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:04.708 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:04.709 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.709 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.709 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:22 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:04.709 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270081+0000", 2024-04-19T02:16:04.709 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 35.386500679000001, 2024-04-19T02:16:04.709 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014566841000000001, 2024-04-19T02:16:04.709 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:04.709 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:16:04.709 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:04.709 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.709 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:04.710 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270081+0000", 2024-04-19T02:16:04.710 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:04.710 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.710 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.710 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:04.710 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270081+0000", 2024-04-19T02:16:04.710 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:04.710 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.710 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.710 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:04.710 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270081+0000", 2024-04-19T02:16:04.711 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:04.711 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.711 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.711 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:04.711 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270083+0000", 2024-04-19T02:16:04.711 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.21e-06 2024-04-19T02:16:04.711 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.711 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.711 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:04.711 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270100+0000", 2024-04-19T02:16:04.711 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.7045e-05 2024-04-19T02:16:04.712 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.712 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.712 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:04.712 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270106+0000", 2024-04-19T02:16:04.712 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.6710000000000004e-06 2024-04-19T02:16:04.712 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.712 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.712 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:04.712 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270134+0000", 2024-04-19T02:16:04.712 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.8192999999999999e-05 2024-04-19T02:16:04.712 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.713 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.713 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:16:04.713 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270137+0000", 2024-04-19T02:16:04.713 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.117e-06 2024-04-19T02:16:04.713 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.713 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.713 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:04.713 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.275452+0000", 2024-04-19T02:16:04.713 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0053144389999999998 2024-04-19T02:16:04.713 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.713 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.713 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:04.714 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.275576+0000", 2024-04-19T02:16:04.714 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012455800000000001 2024-04-19T02:16:04.714 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.714 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.714 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:04.714 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284648+0000", 2024-04-19T02:16:04.714 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0090719689999999992 2024-04-19T02:16:04.714 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:04.714 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:04.714 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:04.714 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.715 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.715 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:110 5.b 5:d74a8f5e:::benchmark_data_smithi121_44835_object109:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:16:04.715 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:55.057013+0000", 2024-04-19T02:16:04.715 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 9.5995687949999997, 2024-04-19T02:16:04.715 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.011467052, 2024-04-19T02:16:04.715 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:04.715 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:04.715 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:04.715 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:04.715 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:04.715 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 110 2024-04-19T02:16:04.715 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.715 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:04.716 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.716 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:04.716 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057013+0000", 2024-04-19T02:16:04.716 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:04.717 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.717 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.717 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:04.717 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057013+0000", 2024-04-19T02:16:04.717 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:04.717 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.717 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.717 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:04.717 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057012+0000", 2024-04-19T02:16:04.717 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:04.717 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.717 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.717 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:04.718 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057115+0000", 2024-04-19T02:16:04.718 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010210299999999999 2024-04-19T02:16:04.718 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.718 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.718 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:04.718 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057123+0000", 2024-04-19T02:16:04.718 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2470000000000008e-06 2024-04-19T02:16:04.718 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.718 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.718 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:04.718 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057129+0000", 2024-04-19T02:16:04.718 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6000000000000003e-06 2024-04-19T02:16:04.719 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.719 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.719 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:04.719 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057296+0000", 2024-04-19T02:16:04.719 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000166398 2024-04-19T02:16:04.719 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.719 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.719 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:04.719 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057419+0000", 2024-04-19T02:16:04.719 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012348799999999999 2024-04-19T02:16:04.719 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.719 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.720 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:04.720 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057533+0000", 2024-04-19T02:16:04.720 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000113736 2024-04-19T02:16:04.720 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.720 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.720 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:04.720 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.059021+0000", 2024-04-19T02:16:04.720 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001488135 2024-04-19T02:16:04.720 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.720 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.720 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:04.721 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.068402+0000", 2024-04-19T02:16:04.721 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0093810000000000004 2024-04-19T02:16:04.721 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.721 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.721 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:04.721 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.068447+0000", 2024-04-19T02:16:04.721 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4876000000000002e-05 2024-04-19T02:16:04.721 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.721 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.721 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:04.721 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.068480+0000", 2024-04-19T02:16:04.721 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3154000000000001e-05 2024-04-19T02:16:04.721 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:04.722 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:04.722 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:04.722 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.722 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.722 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:111 5.b 5:d905127a:::benchmark_data_smithi121_44835_object110:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:16:04.722 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:55.057138+0000", 2024-04-19T02:16:04.722 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 9.5994436909999994, 2024-04-19T02:16:04.722 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.011436411, 2024-04-19T02:16:04.722 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:04.722 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:04.722 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:04.722 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:04.723 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:04.723 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 111 2024-04-19T02:16:04.723 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.723 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:04.723 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.723 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:04.723 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057138+0000", 2024-04-19T02:16:04.723 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:04.723 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.723 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.723 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:04.724 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057138+0000", 2024-04-19T02:16:04.724 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:04.724 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.724 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.724 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:04.724 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057138+0000", 2024-04-19T02:16:04.724 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:04.724 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.724 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.724 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:04.724 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057200+0000", 2024-04-19T02:16:04.724 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.2469000000000001e-05 2024-04-19T02:16:04.724 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.725 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.725 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:04.725 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057211+0000", 2024-04-19T02:16:04.725 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.066e-05 2024-04-19T02:16:04.725 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.725 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.725 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:04.725 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057217+0000", 2024-04-19T02:16:04.725 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5729999999999996e-06 2024-04-19T02:16:04.725 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.725 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.725 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:04.726 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057792+0000", 2024-04-19T02:16:04.726 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000574959 2024-04-19T02:16:04.726 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.727 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.727 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:04.727 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057867+0000", 2024-04-19T02:16:04.727 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.4493999999999995e-05 2024-04-19T02:16:04.727 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.727 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.727 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:04.727 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.057948+0000", 2024-04-19T02:16:04.727 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.1458999999999994e-05 2024-04-19T02:16:04.728 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.728 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.728 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:04.728 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.059050+0000", 2024-04-19T02:16:04.728 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001102029 2024-04-19T02:16:04.728 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.728 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.728 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:04.728 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.068529+0000", 2024-04-19T02:16:04.728 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0094792499999999998 2024-04-19T02:16:04.728 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.729 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.729 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:04.729 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.068557+0000", 2024-04-19T02:16:04.729 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7118999999999999e-05 2024-04-19T02:16:04.729 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.729 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.729 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:04.729 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.068575+0000", 2024-04-19T02:16:04.729 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.8065000000000001e-05 2024-04-19T02:16:04.729 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:04.729 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:04.729 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:04.730 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.730 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.730 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:634 5.8 5:1b48906c:::benchmark_data_smithi121_44835_object633:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:16:04.730 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:55.209349+0000", 2024-04-19T02:16:04.730 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 9.4472332800000007, 2024-04-19T02:16:04.730 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.012294819, 2024-04-19T02:16:04.730 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:04.730 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:04.730 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:04.730 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:04.730 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:04.731 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 634 2024-04-19T02:16:04.731 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.731 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:04.731 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.731 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:04.731 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.209349+0000", 2024-04-19T02:16:04.731 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:04.731 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.731 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.731 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:04.731 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.209349+0000", 2024-04-19T02:16:04.731 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:04.732 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.732 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.732 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:04.732 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.209348+0000", 2024-04-19T02:16:04.732 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:04.732 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.732 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.732 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:04.732 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.209462+0000", 2024-04-19T02:16:04.732 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000113962 2024-04-19T02:16:04.732 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.732 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.733 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:04.733 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.209470+0000", 2024-04-19T02:16:04.733 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0209999999999999e-06 2024-04-19T02:16:04.733 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.733 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.733 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:04.733 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.209475+0000", 2024-04-19T02:16:04.733 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0710000000000002e-06 2024-04-19T02:16:04.733 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.733 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.733 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:04.733 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.209502+0000", 2024-04-19T02:16:04.734 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7234e-05 2024-04-19T02:16:04.734 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.734 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.734 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:04.734 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.209576+0000", 2024-04-19T02:16:04.734 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.4064000000000001e-05 2024-04-19T02:16:04.734 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.734 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.734 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:04.734 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.209655+0000", 2024-04-19T02:16:04.734 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.8484000000000003e-05 2024-04-19T02:16:04.735 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.735 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.735 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:04.735 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.210802+0000", 2024-04-19T02:16:04.735 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0011468940000000001 2024-04-19T02:16:04.735 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.735 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.735 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:04.735 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.221582+0000", 2024-04-19T02:16:04.735 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010780339999999999 2024-04-19T02:16:04.735 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.735 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.735 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:04.736 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.221612+0000", 2024-04-19T02:16:04.736 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9842e-05 2024-04-19T02:16:04.736 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.736 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.736 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:04.736 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:55.221643+0000", 2024-04-19T02:16:04.736 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1606999999999997e-05 2024-04-19T02:16:04.736 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:04.736 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:04.736 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:04.736 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.736 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.736 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:6718 5.8 5:19750adf:::benchmark_data_smithi121_44835_object6717:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-19T02:16:04.736 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:56.852211+0000", 2024-04-19T02:16:04.736 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 7.8043707879999999, 2024-04-19T02:16:04.737 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.011254470000000001, 2024-04-19T02:16:04.737 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:04.737 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:04.737 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:04.737 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:04.737 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:04.737 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 6718 2024-04-19T02:16:04.737 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.737 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:04.737 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.737 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:04.737 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.852211+0000", 2024-04-19T02:16:04.737 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:04.738 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.738 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.738 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:04.738 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.852211+0000", 2024-04-19T02:16:04.738 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:04.738 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.738 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.738 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:04.738 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.852211+0000", 2024-04-19T02:16:04.738 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:04.738 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.739 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.739 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:04.739 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.852264+0000", 2024-04-19T02:16:04.739 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2861000000000001e-05 2024-04-19T02:16:04.739 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.739 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.739 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:04.739 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.852268+0000", 2024-04-19T02:16:04.739 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3780000000000003e-06 2024-04-19T02:16:04.739 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.739 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.740 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:04.740 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.852271+0000", 2024-04-19T02:16:04.740 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0450000000000001e-06 2024-04-19T02:16:04.740 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.740 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.740 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:04.740 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.854707+0000", 2024-04-19T02:16:04.740 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.002435886 2024-04-19T02:16:04.740 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.740 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.740 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:04.741 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.854826+0000", 2024-04-19T02:16:04.741 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000118783 2024-04-19T02:16:04.741 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.741 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.741 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:04.741 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.854927+0000", 2024-04-19T02:16:04.741 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000101745 2024-04-19T02:16:04.741 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.741 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.741 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:04.741 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.856539+0000", 2024-04-19T02:16:04.742 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016111599999999999 2024-04-19T02:16:04.742 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.742 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.742 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:04.742 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.863375+0000", 2024-04-19T02:16:04.742 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0068364109999999997 2024-04-19T02:16:04.742 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.742 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.742 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:04.742 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.863421+0000", 2024-04-19T02:16:04.742 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.5577000000000001e-05 2024-04-19T02:16:04.743 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.743 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.743 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:04.743 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.863466+0000", 2024-04-19T02:16:04.743 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4938999999999998e-05 2024-04-19T02:16:04.743 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:04.743 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:04.743 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:04.743 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.743 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.743 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:6719 5.e 5:7f950491:::benchmark_data_smithi121_44835_object6718:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-19T02:16:04.743 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:56.852274+0000", 2024-04-19T02:16:04.743 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 7.8043078030000004, 2024-04-19T02:16:04.743 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.011178176999999999, 2024-04-19T02:16:04.743 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:04.744 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:04.744 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:04.744 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:04.744 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:04.744 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 6719 2024-04-19T02:16:04.744 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.744 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:04.744 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.744 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:04.744 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.852274+0000", 2024-04-19T02:16:04.744 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:04.744 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.745 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.745 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:04.745 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.852274+0000", 2024-04-19T02:16:04.745 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:04.745 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.745 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.745 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:04.745 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.852274+0000", 2024-04-19T02:16:04.745 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:04.745 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.745 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.745 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:04.746 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.852381+0000", 2024-04-19T02:16:04.746 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010733199999999999 2024-04-19T02:16:04.746 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.746 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.746 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:04.746 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.852385+0000", 2024-04-19T02:16:04.746 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4479999999999996e-06 2024-04-19T02:16:04.746 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.746 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.746 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:04.746 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.852388+0000", 2024-04-19T02:16:04.746 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9830000000000001e-06 2024-04-19T02:16:04.747 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.747 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.747 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:04.747 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.854168+0000", 2024-04-19T02:16:04.747 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001779426 2024-04-19T02:16:04.747 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.747 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.747 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:04.747 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.854288+0000", 2024-04-19T02:16:04.747 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000119821 2024-04-19T02:16:04.747 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.747 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.747 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:04.748 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.854386+0000", 2024-04-19T02:16:04.748 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.8065000000000004e-05 2024-04-19T02:16:04.748 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.748 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.748 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:04.748 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.855713+0000", 2024-04-19T02:16:04.748 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0013276830000000001 2024-04-19T02:16:04.748 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.748 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.748 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:04.748 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.863359+0000", 2024-04-19T02:16:04.749 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0076451610000000001 2024-04-19T02:16:04.749 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.749 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.749 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:04.749 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.863407+0000", 2024-04-19T02:16:04.749 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8356000000000003e-05 2024-04-19T02:16:04.749 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.749 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.749 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:04.749 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:56.863452+0000", 2024-04-19T02:16:04.749 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.5272000000000003e-05 2024-04-19T02:16:04.749 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:04.749 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:04.750 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:04.750 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.750 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.750 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:19174 5.4 5:2f42d48e:::benchmark_data_smithi121_44835_object19173:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:04.750 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:00.712766+0000", 2024-04-19T02:16:04.750 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 3.9438157130000002, 2024-04-19T02:16:04.750 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016423842000000001, 2024-04-19T02:16:04.750 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:04.750 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:04.750 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:04.750 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:04.750 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:04.751 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 19174 2024-04-19T02:16:04.751 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.751 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:04.751 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.751 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:04.751 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.712766+0000", 2024-04-19T02:16:04.751 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:04.751 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.751 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.751 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:04.751 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.712766+0000", 2024-04-19T02:16:04.751 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:04.751 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.752 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.752 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:04.752 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.712765+0000", 2024-04-19T02:16:04.752 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:04.752 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.752 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.752 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:04.752 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.712876+0000", 2024-04-19T02:16:04.752 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000110543 2024-04-19T02:16:04.752 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.752 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.752 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:04.752 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.712887+0000", 2024-04-19T02:16:04.752 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1420000000000001e-05 2024-04-19T02:16:04.753 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.753 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.753 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:04.753 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.712896+0000", 2024-04-19T02:16:04.753 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.4330000000000004e-06 2024-04-19T02:16:04.753 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.753 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.753 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:04.753 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.712923+0000", 2024-04-19T02:16:04.753 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7070999999999999e-05 2024-04-19T02:16:04.753 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.753 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.753 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:04.754 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.713005+0000", 2024-04-19T02:16:04.754 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2279000000000003e-05 2024-04-19T02:16:04.754 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.754 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.754 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:04.754 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.713094+0000", 2024-04-19T02:16:04.754 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.9251000000000003e-05 2024-04-19T02:16:04.754 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.754 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.754 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:04.754 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.714553+0000", 2024-04-19T02:16:04.755 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0014587339999999999 2024-04-19T02:16:04.755 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.755 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.755 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:04.755 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.729110+0000", 2024-04-19T02:16:04.755 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014557037 2024-04-19T02:16:04.755 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.755 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.755 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:04.755 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.729158+0000", 2024-04-19T02:16:04.755 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.829e-05 2024-04-19T02:16:04.755 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.755 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.756 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:04.756 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.729190+0000", 2024-04-19T02:16:04.756 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1673e-05 2024-04-19T02:16:04.756 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:04.756 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:04.756 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:04.756 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.756 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.756 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:19967 5.e 5:79906587:::benchmark_data_smithi121_44835_object19966:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:04.756 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:00.971648+0000", 2024-04-19T02:16:04.756 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 3.6849336049999999, 2024-04-19T02:16:04.756 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.012902805999999999, 2024-04-19T02:16:04.756 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:04.757 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:04.757 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:04.757 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:04.757 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:04.757 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 19967 2024-04-19T02:16:04.757 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.757 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:04.757 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.757 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:04.757 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.971648+0000", 2024-04-19T02:16:04.757 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:04.757 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.758 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.758 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:04.758 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.971648+0000", 2024-04-19T02:16:04.758 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:04.758 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.758 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.758 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:04.758 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.971648+0000", 2024-04-19T02:16:04.758 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:04.758 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.758 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.758 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:04.759 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.971727+0000", 2024-04-19T02:16:04.759 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9055999999999997e-05 2024-04-19T02:16:04.759 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.759 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.759 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:04.759 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.971735+0000", 2024-04-19T02:16:04.759 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.1689999999999992e-06 2024-04-19T02:16:04.759 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.759 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.759 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:04.759 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.971740+0000", 2024-04-19T02:16:04.759 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.9779999999999996e-06 2024-04-19T02:16:04.759 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.760 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.760 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:04.760 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.971771+0000", 2024-04-19T02:16:04.760 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1021e-05 2024-04-19T02:16:04.760 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.760 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.760 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:04.760 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.971881+0000", 2024-04-19T02:16:04.760 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011044000000000001 2024-04-19T02:16:04.760 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.760 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.760 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:04.760 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.971982+0000", 2024-04-19T02:16:04.761 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010034099999999999 2024-04-19T02:16:04.761 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.761 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.761 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:04.761 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.976489+0000", 2024-04-19T02:16:04.761 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0045072619999999997 2024-04-19T02:16:04.761 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.761 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.761 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:04.761 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.984473+0000", 2024-04-19T02:16:04.761 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0079836690000000005 2024-04-19T02:16:04.761 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.761 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.761 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:04.761 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.984513+0000", 2024-04-19T02:16:04.762 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9996000000000001e-05 2024-04-19T02:16:04.762 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.762 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.762 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:04.762 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.984551+0000", 2024-04-19T02:16:04.762 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8478e-05 2024-04-19T02:16:04.762 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:04.762 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:04.762 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:04.762 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.762 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.762 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:29469 5.e 5:719ffe1d:::benchmark_data_smithi121_44835_object29468:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-19T02:16:04.763 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:04.212788+0000", 2024-04-19T02:16:04.763 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.44379391200000001, 2024-04-19T02:16:04.763 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.011384883, 2024-04-19T02:16:04.763 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:04.763 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:04.763 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:04.763 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:04.763 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:04.763 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 29469 2024-04-19T02:16:04.763 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.763 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:04.763 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.763 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:04.764 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.212788+0000", 2024-04-19T02:16:04.764 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:04.764 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.764 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.764 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:04.764 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.212788+0000", 2024-04-19T02:16:04.764 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:04.764 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.764 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.764 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:04.764 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.212787+0000", 2024-04-19T02:16:04.764 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:04.765 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.765 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.765 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:04.765 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.212833+0000", 2024-04-19T02:16:04.765 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.5868999999999997e-05 2024-04-19T02:16:04.765 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.765 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.765 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:04.765 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.212840+0000", 2024-04-19T02:16:04.765 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.9609999999999999e-06 2024-04-19T02:16:04.765 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.765 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.766 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:04.766 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.212844+0000", 2024-04-19T02:16:04.766 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2039999999999999e-06 2024-04-19T02:16:04.766 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.766 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.766 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:04.766 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.217506+0000", 2024-04-19T02:16:04.766 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0046617949999999998 2024-04-19T02:16:04.766 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.766 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.766 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:04.767 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.217616+0000", 2024-04-19T02:16:04.767 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010932700000000001 2024-04-19T02:16:04.767 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.767 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.767 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:04.767 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.217762+0000", 2024-04-19T02:16:04.767 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014665300000000001 2024-04-19T02:16:04.767 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.767 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.767 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:04.767 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.220842+0000", 2024-04-19T02:16:04.768 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0030795250000000001 2024-04-19T02:16:04.768 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.768 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.768 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:04.768 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.224109+0000", 2024-04-19T02:16:04.768 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0032675320000000001 2024-04-19T02:16:04.768 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.768 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.768 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:04.768 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.224151+0000", 2024-04-19T02:16:04.769 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1600000000000002e-05 2024-04-19T02:16:04.769 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.769 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.769 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:04.769 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.224173+0000", 2024-04-19T02:16:04.769 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1950000000000002e-05 2024-04-19T02:16:04.769 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:04.769 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:04.769 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:04.769 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.769 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.769 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:30568 5.0 5:077dd9ed:::benchmark_data_smithi121_44835_object30567:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-19T02:16:04.770 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:04.575077+0000", 2024-04-19T02:16:04.770 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.081505191000000005, 2024-04-19T02:16:04.770 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.012632924, 2024-04-19T02:16:04.770 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:04.770 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:04.770 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:04.770 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:04.770 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:04.770 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 30568 2024-04-19T02:16:04.770 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.770 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:04.770 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.771 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:04.771 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.575077+0000", 2024-04-19T02:16:04.771 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:04.771 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.771 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.771 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:04.771 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.575077+0000", 2024-04-19T02:16:04.771 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:04.771 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.771 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.772 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:04.772 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.575076+0000", 2024-04-19T02:16:04.772 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:04.772 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.772 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.772 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:04.772 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.575169+0000", 2024-04-19T02:16:04.772 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2743000000000003e-05 2024-04-19T02:16:04.772 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.772 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.772 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:04.772 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.575176+0000", 2024-04-19T02:16:04.773 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.601e-06 2024-04-19T02:16:04.773 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.773 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.773 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:04.773 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.575180+0000", 2024-04-19T02:16:04.773 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.493e-06 2024-04-19T02:16:04.773 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.773 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.773 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:04.773 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.577147+0000", 2024-04-19T02:16:04.773 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001967066 2024-04-19T02:16:04.774 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.774 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.774 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:04.774 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.577295+0000", 2024-04-19T02:16:04.774 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014791500000000001 2024-04-19T02:16:04.774 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.774 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.774 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:04.774 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.577424+0000", 2024-04-19T02:16:04.774 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012875000000000001 2024-04-19T02:16:04.774 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.775 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.775 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:04.775 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.579098+0000", 2024-04-19T02:16:04.775 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001674032 2024-04-19T02:16:04.775 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.775 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.775 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:04.775 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.587649+0000", 2024-04-19T02:16:04.775 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0085510970000000006 2024-04-19T02:16:04.775 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.776 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.776 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:04.776 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.587677+0000", 2024-04-19T02:16:04.776 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7625999999999999e-05 2024-04-19T02:16:04.776 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.776 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.776 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:04.776 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.587710+0000", 2024-04-19T02:16:04.776 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3108000000000002e-05 2024-04-19T02:16:04.776 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:04.776 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:04.776 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:04.777 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.777 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.777 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:30571 5.0 5:09c36ea9:::benchmark_data_smithi121_44835_object30570:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-19T02:16:04.777 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:04.575330+0000", 2024-04-19T02:16:04.777 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.081251776999999997, 2024-04-19T02:16:04.777 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.012466213, 2024-04-19T02:16:04.777 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:04.777 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:04.777 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:04.777 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:04.777 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:04.778 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 30571 2024-04-19T02:16:04.778 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.778 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:04.778 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.778 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:04.778 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.575330+0000", 2024-04-19T02:16:04.778 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:04.778 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.778 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.778 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:04.778 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.575330+0000", 2024-04-19T02:16:04.778 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:04.779 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.779 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.779 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:04.779 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.575330+0000", 2024-04-19T02:16:04.779 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:04.779 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.779 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.779 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:04.779 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.575367+0000", 2024-04-19T02:16:04.779 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6977999999999997e-05 2024-04-19T02:16:04.779 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.779 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.779 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:04.779 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.575373+0000", 2024-04-19T02:16:04.780 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.1940000000000003e-06 2024-04-19T02:16:04.780 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.780 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.780 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:04.780 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.575379+0000", 2024-04-19T02:16:04.780 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.0020000000000003e-06 2024-04-19T02:16:04.780 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.780 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.780 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:04.780 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.578285+0000", 2024-04-19T02:16:04.780 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.002906109 2024-04-19T02:16:04.780 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.780 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.781 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:04.781 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.578365+0000", 2024-04-19T02:16:04.781 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9704999999999997e-05 2024-04-19T02:16:04.781 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.781 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.781 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:04.781 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.578464+0000", 2024-04-19T02:16:04.781 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.9155999999999997e-05 2024-04-19T02:16:04.781 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.781 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.781 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:04.782 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.579863+0000", 2024-04-19T02:16:04.782 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001398872 2024-04-19T02:16:04.782 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.782 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.782 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:04.782 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.587738+0000", 2024-04-19T02:16:04.782 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0078748599999999992 2024-04-19T02:16:04.782 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.782 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.782 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:04.783 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.587770+0000", 2024-04-19T02:16:04.783 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2329999999999997e-05 2024-04-19T02:16:04.783 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.783 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.783 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:04.783 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.587796+0000", 2024-04-19T02:16:04.783 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.6397000000000002e-05 2024-04-19T02:16:04.783 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:04.783 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:04.783 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:04.783 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.783 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.783 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:30575 5.0 5:049446cf:::benchmark_data_smithi121_44835_object30574:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-19T02:16:04.783 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:04.575472+0000", 2024-04-19T02:16:04.784 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.081109783000000005, 2024-04-19T02:16:04.784 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.012666481, 2024-04-19T02:16:04.784 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:04.784 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:04.784 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:04.784 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:04.784 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:04.784 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 30575 2024-04-19T02:16:04.784 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.784 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:04.784 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.784 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:04.784 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.575472+0000", 2024-04-19T02:16:04.785 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:04.785 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.785 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.785 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:04.785 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.575472+0000", 2024-04-19T02:16:04.785 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:04.785 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.785 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.785 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:04.785 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.575472+0000", 2024-04-19T02:16:04.785 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:04.785 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.786 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.786 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:04.786 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.575541+0000", 2024-04-19T02:16:04.786 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.9769000000000002e-05 2024-04-19T02:16:04.786 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.786 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.786 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:04.786 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.575546+0000", 2024-04-19T02:16:04.786 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0590000000000002e-06 2024-04-19T02:16:04.786 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.787 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.787 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:04.787 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.575550+0000", 2024-04-19T02:16:04.787 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0749999999999999e-06 2024-04-19T02:16:04.787 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.787 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.787 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:04.787 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.579113+0000", 2024-04-19T02:16:04.787 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.003562431 2024-04-19T02:16:04.787 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.787 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.787 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:04.788 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.579192+0000", 2024-04-19T02:16:04.788 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9049999999999997e-05 2024-04-19T02:16:04.788 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.788 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.788 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:04.788 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.579277+0000", 2024-04-19T02:16:04.788 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.5295000000000002e-05 2024-04-19T02:16:04.788 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.788 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.788 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:04.788 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.580124+0000", 2024-04-19T02:16:04.788 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00084716000000000001 2024-04-19T02:16:04.788 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.789 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.789 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:04.789 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.588084+0000", 2024-04-19T02:16:04.789 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0079595989999999995 2024-04-19T02:16:04.789 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.789 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.789 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:04.789 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.588115+0000", 2024-04-19T02:16:04.789 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1130000000000002e-05 2024-04-19T02:16:04.789 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.789 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.789 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:04.789 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.588139+0000", 2024-04-19T02:16:04.790 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3493999999999999e-05 2024-04-19T02:16:04.790 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:04.790 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:04.790 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:04.790 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.790 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.790 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:30578 5.b 5:d314dbf6:::benchmark_data_smithi121_44835_object30577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-19T02:16:04.790 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:04.575635+0000", 2024-04-19T02:16:04.790 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.080946711000000005, 2024-04-19T02:16:04.790 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.012060056, 2024-04-19T02:16:04.790 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:04.790 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:04.791 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:04.791 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:04.791 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:04.791 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 30578 2024-04-19T02:16:04.791 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.791 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:04.791 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.791 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:04.791 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.575635+0000", 2024-04-19T02:16:04.791 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:04.791 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.791 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.791 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:04.792 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.575635+0000", 2024-04-19T02:16:04.792 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:04.792 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.792 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.792 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:04.792 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.575635+0000", 2024-04-19T02:16:04.792 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:04.792 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.792 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.792 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:04.792 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.575701+0000", 2024-04-19T02:16:04.792 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6802000000000002e-05 2024-04-19T02:16:04.792 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.793 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.793 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:04.793 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.575708+0000", 2024-04-19T02:16:04.793 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.0889999999999996e-06 2024-04-19T02:16:04.793 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.793 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.793 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:04.793 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.575711+0000", 2024-04-19T02:16:04.793 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5779999999999999e-06 2024-04-19T02:16:04.793 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.793 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.793 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:04.793 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.575739+0000", 2024-04-19T02:16:04.793 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7729000000000002e-05 2024-04-19T02:16:04.794 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.794 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.794 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:04.794 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.575849+0000", 2024-04-19T02:16:04.794 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000110031 2024-04-19T02:16:04.794 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.794 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.794 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:04.794 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.575993+0000", 2024-04-19T02:16:04.794 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000144535 2024-04-19T02:16:04.794 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.795 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.795 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:04.795 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.577822+0000", 2024-04-19T02:16:04.795 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001828498 2024-04-19T02:16:04.795 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.795 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.795 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:04.795 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.587646+0000", 2024-04-19T02:16:04.795 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0098237029999999996 2024-04-19T02:16:04.795 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.795 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.795 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:04.795 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.587675+0000", 2024-04-19T02:16:04.796 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.8894000000000002e-05 2024-04-19T02:16:04.796 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:04.796 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:04.796 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:04.796 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.587695+0000", 2024-04-19T02:16:04.796 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.0704999999999999e-05 2024-04-19T02:16:04.796 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:04.796 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:04.796 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:04.796 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:04.796 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:04.796 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:16:04.798 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:16:04.799 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:04.798+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:04.898 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:04.899+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:04.984 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:16:04.987 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-04-19T02:16:04.987 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-04-19T02:16:04.987 INFO:teuthology.orchestra.run.smithi177.stdout: "ops": [ 2024-04-19T02:16:04.987 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:04.987 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:31662 5.0 e21/16 5:0a6b82b4:::benchmark_data_smithi121_44835_object31661:head v 21'1925, mlcod=21'1922)", 2024-04-19T02:16:04.987 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:04.974380+0000", 2024-04-19T02:16:04.987 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0070377790000000001, 2024-04-19T02:16:04.987 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0070627299999999997, 2024-04-19T02:16:04.988 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:04.988 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:04.988 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:04.988 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:04.988 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:04.988 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.974380+0000", 2024-04-19T02:16:04.988 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:04.988 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:04.988 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:04.988 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:04.988 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.974380+0000", 2024-04-19T02:16:04.988 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:04.988 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:04.988 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:04.988 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:04.989 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.974380+0000", 2024-04-19T02:16:04.989 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:04.989 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:04.989 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:04.989 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:04.989 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.974442+0000", 2024-04-19T02:16:04.989 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.2321000000000002e-05 2024-04-19T02:16:04.989 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:04.989 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:04.989 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:04.989 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.974449+0000", 2024-04-19T02:16:04.989 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.5769999999999999e-06 2024-04-19T02:16:04.989 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:04.989 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:04.989 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:04.989 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.974456+0000", 2024-04-19T02:16:04.990 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.1930000000000004e-06 2024-04-19T02:16:04.990 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:04.990 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:04.990 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:04.990 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.974489+0000", 2024-04-19T02:16:04.990 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.2530999999999997e-05 2024-04-19T02:16:04.990 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:04.990 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:04.990 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:04.990 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.974510+0000", 2024-04-19T02:16:04.990 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.1106000000000001e-05 2024-04-19T02:16:04.990 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:04.990 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:04.990 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:04.991 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:04.991 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:04.991 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:31664 5.a 5:5af742dd:::benchmark_data_smithi121_44835_object31663:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-19T02:16:04.991 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:04.975272+0000", 2024-04-19T02:16:04.991 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.006146182, 2024-04-19T02:16:04.991 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0062258890000000001, 2024-04-19T02:16:04.991 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:04.991 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:04.991 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:04.991 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:04.991 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:04.991 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 31664 2024-04-19T02:16:04.991 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:04.991 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:04.992 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:04.992 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:04.992 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.975272+0000", 2024-04-19T02:16:04.992 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:04.992 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:04.992 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:04.992 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:04.992 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.975272+0000", 2024-04-19T02:16:04.992 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:04.992 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:04.992 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:04.992 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:04.992 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.975271+0000", 2024-04-19T02:16:04.992 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:04.993 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:04.993 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:04.993 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:04.993 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.975336+0000", 2024-04-19T02:16:04.993 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.4389999999999998e-05 2024-04-19T02:16:04.993 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:04.993 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:04.993 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:04.993 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.975345+0000", 2024-04-19T02:16:04.993 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.9479999999999997e-06 2024-04-19T02:16:04.993 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:04.993 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:04.993 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:04.993 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.975352+0000", 2024-04-19T02:16:04.993 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.9840000000000004e-06 2024-04-19T02:16:04.994 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:04.994 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:04.994 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:04.994 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.977864+0000", 2024-04-19T02:16:04.994 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0025128429999999998 2024-04-19T02:16:04.994 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:04.994 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:04.994 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:04.994 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.978014+0000", 2024-04-19T02:16:04.994 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000150056 2024-04-19T02:16:04.994 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:04.994 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:04.994 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:04.994 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.978164+0000", 2024-04-19T02:16:04.995 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00014986000000000001 2024-04-19T02:16:04.995 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:04.995 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:04.995 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:04.995 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.980689+0000", 2024-04-19T02:16:04.995 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0025243179999999998 2024-04-19T02:16:04.995 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:04.995 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:04.995 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:04.995 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:04.995 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:04.995 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:31667 5.8 e21/16 5:11f44b9f:::benchmark_data_smithi121_44835_object31666:head v 21'1983, mlcod=21'1981)", 2024-04-19T02:16:04.995 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:04.977111+0000", 2024-04-19T02:16:04.995 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.00430731, 2024-04-19T02:16:04.996 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0044388170000000003, 2024-04-19T02:16:04.996 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:04.996 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:04.996 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:04.996 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:04.996 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:04.996 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.977111+0000", 2024-04-19T02:16:04.996 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:04.996 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:04.996 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:04.996 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:04.996 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.977111+0000", 2024-04-19T02:16:04.996 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:04.996 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:04.996 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:04.997 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:04.997 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.977110+0000", 2024-04-19T02:16:04.997 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:04.997 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:04.997 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:04.997 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:04.997 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.977181+0000", 2024-04-19T02:16:04.997 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.0543000000000005e-05 2024-04-19T02:16:04.997 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:04.997 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:04.997 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:04.997 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.977191+0000", 2024-04-19T02:16:04.997 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0346999999999999e-05 2024-04-19T02:16:04.997 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:04.997 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:04.998 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:04.998 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.977199+0000", 2024-04-19T02:16:04.998 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.5569999999999998e-06 2024-04-19T02:16:04.998 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:04.998 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:04.998 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:04.998 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.977795+0000", 2024-04-19T02:16:04.998 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00059660799999999999 2024-04-19T02:16:04.998 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:04.998 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:04.998 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:04.998 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.977814+0000", 2024-04-19T02:16:04.998 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.8368000000000001e-05 2024-04-19T02:16:04.998 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:04.999 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:04.999 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:04.999 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:04.999 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:04.999 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:31668 5.5 5:a2fd5c6c:::benchmark_data_smithi121_44835_object31667:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-19T02:16:04.999 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:04.978167+0000", 2024-04-19T02:16:04.999 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.003251388, 2024-04-19T02:16:04.999 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0034384720000000001, 2024-04-19T02:16:04.999 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:04.999 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:04.999 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:04.999 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:04.999 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:04.999 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 31668 2024-04-19T02:16:05.000 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.000 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:05.000 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.000 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:05.000 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.978167+0000", 2024-04-19T02:16:05.000 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.000 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.000 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.000 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:05.000 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.978167+0000", 2024-04-19T02:16:05.000 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.000 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.000 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.000 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:05.001 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.978166+0000", 2024-04-19T02:16:05.001 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:05.001 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.001 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.001 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:05.001 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.978226+0000", 2024-04-19T02:16:05.001 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.9707000000000003e-05 2024-04-19T02:16:05.001 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.001 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.001 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:05.001 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.978235+0000", 2024-04-19T02:16:05.001 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.5710000000000004e-06 2024-04-19T02:16:05.001 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.001 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.002 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:05.002 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.978247+0000", 2024-04-19T02:16:05.002 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.1255e-05 2024-04-19T02:16:05.002 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.002 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.002 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:05.002 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.978285+0000", 2024-04-19T02:16:05.002 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.8194000000000001e-05 2024-04-19T02:16:05.002 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.002 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.002 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:05.002 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.978407+0000", 2024-04-19T02:16:05.002 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000121946 2024-04-19T02:16:05.002 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.002 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.003 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:05.003 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.978547+0000", 2024-04-19T02:16:05.003 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000140013 2024-04-19T02:16:05.003 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.003 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.003 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:05.003 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.980640+0000", 2024-04-19T02:16:05.003 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0020931050000000001 2024-04-19T02:16:05.003 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.003 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:05.003 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.003 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.003 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.003 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:31672 5.3 5:c1da0467:::benchmark_data_smithi121_44835_object31671:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-19T02:16:05.004 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:04.978366+0000", 2024-04-19T02:16:05.004 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0030524609999999998, 2024-04-19T02:16:05.004 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.003311184, 2024-04-19T02:16:05.004 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:05.004 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:05.004 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:05.004 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:05.004 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:05.004 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 31672 2024-04-19T02:16:05.004 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.004 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:05.004 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.004 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:05.004 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.978366+0000", 2024-04-19T02:16:05.005 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.005 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.005 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.005 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:05.005 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.978366+0000", 2024-04-19T02:16:05.005 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.005 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.005 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.005 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:05.005 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.978365+0000", 2024-04-19T02:16:05.005 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:05.005 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.005 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.005 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:05.005 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.978536+0000", 2024-04-19T02:16:05.006 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00017118499999999999 2024-04-19T02:16:05.006 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.006 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.006 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:05.006 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.978545+0000", 2024-04-19T02:16:05.006 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.1030000000000008e-06 2024-04-19T02:16:05.006 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.006 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.006 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:05.006 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.978551+0000", 2024-04-19T02:16:05.006 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.9510000000000003e-06 2024-04-19T02:16:05.006 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.006 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.006 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:05.007 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.978595+0000", 2024-04-19T02:16:05.007 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.3803000000000001e-05 2024-04-19T02:16:05.007 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.007 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.007 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:05.007 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.978830+0000", 2024-04-19T02:16:05.007 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00023498900000000001 2024-04-19T02:16:05.007 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.007 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.007 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:05.007 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.978983+0000", 2024-04-19T02:16:05.007 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00015262399999999999 2024-04-19T02:16:05.007 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.007 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.007 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:05.008 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.980939+0000", 2024-04-19T02:16:05.008 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0019563979999999998 2024-04-19T02:16:05.008 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.008 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:05.008 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.008 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.008 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.008 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:31676 5.c 5:399342d4:::benchmark_data_smithi121_44835_object31675:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-19T02:16:05.008 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:04.978659+0000", 2024-04-19T02:16:05.008 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.002759479, 2024-04-19T02:16:05.008 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0030656400000000001, 2024-04-19T02:16:05.008 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:05.008 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:05.008 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:05.009 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:05.009 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:05.009 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 31676 2024-04-19T02:16:05.009 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.009 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:05.009 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.009 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:05.009 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.978659+0000", 2024-04-19T02:16:05.009 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.009 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.009 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.009 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:05.009 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.978659+0000", 2024-04-19T02:16:05.009 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.009 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.010 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.010 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:05.010 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.978658+0000", 2024-04-19T02:16:05.010 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:05.010 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.010 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.010 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:05.010 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.978745+0000", 2024-04-19T02:16:05.010 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.6765e-05 2024-04-19T02:16:05.010 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.010 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.010 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:05.010 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.978755+0000", 2024-04-19T02:16:05.010 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.9219999999999992e-06 2024-04-19T02:16:05.010 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.011 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.011 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:05.011 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.978762+0000", 2024-04-19T02:16:05.011 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.3180000000000001e-06 2024-04-19T02:16:05.011 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.011 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.011 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:05.011 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.978801+0000", 2024-04-19T02:16:05.011 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.8479000000000002e-05 2024-04-19T02:16:05.011 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.011 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.011 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:05.011 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.978929+0000", 2024-04-19T02:16:05.011 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000127997 2024-04-19T02:16:05.011 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.012 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.012 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:05.012 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.979006+0000", 2024-04-19T02:16:05.012 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.7340000000000002e-05 2024-04-19T02:16:05.012 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.012 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.012 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:05.012 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.980970+0000", 2024-04-19T02:16:05.012 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0019642029999999999 2024-04-19T02:16:05.012 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.012 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:05.012 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.012 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.012 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.013 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:31669 5.1 e21/16 5:81f2e9d5:::benchmark_data_smithi121_44835_object31668:head v 21'1979, mlcod=21'1977)", 2024-04-19T02:16:05.013 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:04.978688+0000", 2024-04-19T02:16:05.013 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0027304289999999999, 2024-04-19T02:16:05.013 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0030805170000000001, 2024-04-19T02:16:05.013 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:05.013 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:05.013 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:05.013 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.013 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:05.013 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.978688+0000", 2024-04-19T02:16:05.013 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.013 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.013 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.013 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:05.014 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.978688+0000", 2024-04-19T02:16:05.014 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.014 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.014 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.014 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:05.014 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.978687+0000", 2024-04-19T02:16:05.014 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:05.014 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.014 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.014 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:05.014 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.978792+0000", 2024-04-19T02:16:05.014 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000104419 2024-04-19T02:16:05.014 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.014 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.015 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:05.015 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.978798+0000", 2024-04-19T02:16:05.015 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.5490000000000003e-06 2024-04-19T02:16:05.015 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.015 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.015 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:05.015 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.978802+0000", 2024-04-19T02:16:05.015 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.8970000000000001e-06 2024-04-19T02:16:05.015 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.015 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.015 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:05.015 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.978831+0000", 2024-04-19T02:16:05.015 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.832e-05 2024-04-19T02:16:05.015 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.015 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.015 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:05.016 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.978843+0000", 2024-04-19T02:16:05.016 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.255e-05 2024-04-19T02:16:05.016 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.016 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:05.016 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.016 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.016 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.016 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:31670 5.0 e21/16 5:0c753444:::benchmark_data_smithi121_44835_object31669:head v 21'1926, mlcod=21'1923)", 2024-04-19T02:16:05.016 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:04.979249+0000", 2024-04-19T02:16:05.016 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0021696509999999999, 2024-04-19T02:16:05.016 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.002555421, 2024-04-19T02:16:05.016 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:05.016 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:05.016 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:05.016 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.017 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:05.017 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.979249+0000", 2024-04-19T02:16:05.017 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.017 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.017 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.017 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:05.017 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.979249+0000", 2024-04-19T02:16:05.017 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.017 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.017 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.017 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:05.017 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.979248+0000", 2024-04-19T02:16:05.017 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:05.017 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.018 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.018 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:05.018 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.979318+0000", 2024-04-19T02:16:05.018 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.0346999999999996e-05 2024-04-19T02:16:05.018 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.018 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.018 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:05.018 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.979329+0000", 2024-04-19T02:16:05.018 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0599e-05 2024-04-19T02:16:05.018 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.018 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.018 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:05.018 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.979335+0000", 2024-04-19T02:16:05.018 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.1920000000000002e-06 2024-04-19T02:16:05.019 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.019 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.019 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:05.019 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.979367+0000", 2024-04-19T02:16:05.019 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.1563000000000003e-05 2024-04-19T02:16:05.019 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.019 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.019 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:05.019 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.979384+0000", 2024-04-19T02:16:05.019 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.7456e-05 2024-04-19T02:16:05.019 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.019 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:05.019 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.019 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.019 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.020 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:31674 5.e e21/16 5:71559762:::benchmark_data_smithi121_44835_object31673:head v 21'1942, mlcod=21'1940)", 2024-04-19T02:16:05.020 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:04.979451+0000", 2024-04-19T02:16:05.020 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0019676099999999998, 2024-04-19T02:16:05.020 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0023859749999999998, 2024-04-19T02:16:05.020 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:05.020 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:05.020 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:05.020 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.020 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:05.020 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.979451+0000", 2024-04-19T02:16:05.020 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.020 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.020 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.020 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:05.021 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.979451+0000", 2024-04-19T02:16:05.021 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.021 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.021 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.021 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:05.021 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.979450+0000", 2024-04-19T02:16:05.021 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:05.021 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.021 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.021 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:05.021 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.979501+0000", 2024-04-19T02:16:05.021 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.0488999999999997e-05 2024-04-19T02:16:05.021 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.021 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.021 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:05.022 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.979509+0000", 2024-04-19T02:16:05.022 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.2439999999999993e-06 2024-04-19T02:16:05.022 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.022 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.022 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:05.022 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.979514+0000", 2024-04-19T02:16:05.022 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.0529999999999997e-06 2024-04-19T02:16:05.022 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.022 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.022 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:05.022 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.979549+0000", 2024-04-19T02:16:05.022 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.4817999999999998e-05 2024-04-19T02:16:05.022 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.022 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.022 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:05.023 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.979568+0000", 2024-04-19T02:16:05.023 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.9524000000000001e-05 2024-04-19T02:16:05.023 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.023 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:05.023 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.023 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.023 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.023 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:31675 5.0 e21/16 5:09d94b55:::benchmark_data_smithi121_44835_object31674:head v 21'1927, mlcod=21'1923)", 2024-04-19T02:16:05.023 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:04.980231+0000", 2024-04-19T02:16:05.023 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0011871900000000001, 2024-04-19T02:16:05.023 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.001644171, 2024-04-19T02:16:05.023 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:05.023 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:05.023 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:05.023 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.024 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:05.024 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.980231+0000", 2024-04-19T02:16:05.024 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.024 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.024 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.024 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:05.024 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.980231+0000", 2024-04-19T02:16:05.024 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.024 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.024 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.024 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:05.024 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.980231+0000", 2024-04-19T02:16:05.024 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:05.024 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.025 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.025 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:05.025 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.980301+0000", 2024-04-19T02:16:05.025 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.0588999999999998e-05 2024-04-19T02:16:05.025 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.025 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.025 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:05.025 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.980308+0000", 2024-04-19T02:16:05.025 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.9519999999999997e-06 2024-04-19T02:16:05.025 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.025 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.025 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:05.025 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.980312+0000", 2024-04-19T02:16:05.025 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.0280000000000002e-06 2024-04-19T02:16:05.025 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.026 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.026 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:05.026 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.980644+0000", 2024-04-19T02:16:05.026 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00033175199999999999 2024-04-19T02:16:05.026 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.026 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.026 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:05.026 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.980657+0000", 2024-04-19T02:16:05.026 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.2675e-05 2024-04-19T02:16:05.026 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.026 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:05.026 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.026 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.026 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.027 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:31678 5.1 e21/16 5:8369c364:::benchmark_data_smithi121_44835_object31677:head v 21'1980, mlcod=21'1977)", 2024-04-19T02:16:05.027 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:04.981329+0000", 2024-04-19T02:16:05.027 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 8.9095e-05, 2024-04-19T02:16:05.027 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00057873400000000002, 2024-04-19T02:16:05.027 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:05.027 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:05.027 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:05.027 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.027 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:05.027 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.981329+0000", 2024-04-19T02:16:05.027 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.027 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.027 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.027 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:05.027 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.981329+0000", 2024-04-19T02:16:05.028 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.028 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.028 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.028 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:05.028 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.981329+0000", 2024-04-19T02:16:05.028 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:05.028 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.028 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.028 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:05.028 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.981418+0000", 2024-04-19T02:16:05.028 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.9116999999999994e-05 2024-04-19T02:16:05.028 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.028 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.028 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:05.028 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.981428+0000", 2024-04-19T02:16:05.029 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0236e-05 2024-04-19T02:16:05.029 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.029 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.029 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:05.029 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.981434+0000", 2024-04-19T02:16:05.029 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.1149999999999999e-06 2024-04-19T02:16:05.029 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.029 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.029 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:05.029 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.981465+0000", 2024-04-19T02:16:05.029 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.074e-05 2024-04-19T02:16:05.029 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.029 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.029 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:05.030 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:04.981478+0000", 2024-04-19T02:16:05.030 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.3103e-05 2024-04-19T02:16:05.030 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.030 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:05.030 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.030 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.030 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2024-04-19T02:16:05.030 INFO:teuthology.orchestra.run.smithi177.stdout: "num_ops": 11 2024-04-19T02:16:05.030 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-04-19T02:16:05.032 INFO:teuthology.orchestra.run.smithi121.stderr:noscrub is set 2024-04-19T02:16:05.033 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:16:05.033 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:05.032+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:05.033 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-04-19T02:16:04.744786+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1654524762,"num_objects":25261,"num_object_clones":0,"num_object_copies":50522,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25261,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":25485,"num_write_kb":1618642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25433,"ondisk_log_size":25433,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":242,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":3196916,"kb_used_data":3038804,"kb_used_omap":4,"kb_used_meta":158075,"kb_avail":279918604,"statfs":{"total":289910292480,"available":286636650496,"internally_reserved":0,"allocated":3111735296,"data_stored":3111284635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":161869138},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,0,1,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1653932032,"num_objects":25237,"num_object_clones":0,"num_object_copies":50474,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25237,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25237,"num_write_kb":1615168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001441"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.977533+0000","last_change":"2024-04-19T02:15:29.280412+0000","last_active":"2024-04-19T02:15:58.977533+0000","last_peered":"2024-04-19T02:15:58.977533+0000","last_clean":"2024-04-19T02:15:58.977533+0000","last_became_active":"2024-04-19T02:15:29.278762+0000","last_became_peered":"2024-04-19T02:15:29.278762+0000","last_unstale":"2024-04-19T02:15:58.977533+0000","last_undegraded":"2024-04-19T02:15:58.977533+0000","last_fullsized":"2024-04-19T02:15:58.977533+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:45.301675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.977066+0000","last_change":"2024-04-19T02:15:29.284695+0000","last_active":"2024-04-19T02:15:58.977066+0000","last_peered":"2024-04-19T02:15:58.977066+0000","last_clean":"2024-04-19T02:15:58.977066+0000","last_became_active":"2024-04-19T02:15:29.283468+0000","last_became_peered":"2024-04-19T02:15:29.283468+0000","last_unstale":"2024-04-19T02:15:58.977066+0000","last_undegraded":"2024-04-19T02:15:58.977066+0000","last_fullsized":"2024-04-19T02:15:58.977066+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.384881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.986172+0000","last_change":"2024-04-19T02:15:29.286709+0000","last_active":"2024-04-19T02:15:58.986172+0000","last_peered":"2024-04-19T02:15:58.986172+0000","last_clean":"2024-04-19T02:15:58.986172+0000","last_became_active":"2024-04-19T02:15:29.286169+0000","last_became_peered":"2024-04-19T02:15:29.286169+0000","last_unstale":"2024-04-19T02:15:58.986172+0000","last_undegraded":"2024-04-19T02:15:58.986172+0000","last_fullsized":"2024-04-19T02:15:58.986172+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:58.741466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.984988+0000","last_change":"2024-04-19T02:15:29.280131+0000","last_active":"2024-04-19T02:15:58.984988+0000","last_peered":"2024-04-19T02:15:58.984988+0000","last_clean":"2024-04-19T02:15:58.984988+0000","last_became_active":"2024-04-19T02:15:29.279388+0000","last_became_peered":"2024-04-19T02:15:29.279388+0000","last_unstale":"2024-04-19T02:15:58.984988+0000","last_undegraded":"2024-04-19T02:15:58.984988+0000","last_fullsized":"2024-04-19T02:15:58.984988+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:36:48.819486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.977743+0000","last_change":"2024-04-19T02:15:53.955892+0000","last_active":"2024-04-19T02:15:58.977743+0000","last_peered":"2024-04-19T02:15:58.977743+0000","last_clean":"2024-04-19T02:15:58.977743+0000","last_became_active":"2024-04-19T02:15:53.955553+0000","last_became_peered":"2024-04-19T02:15:53.955553+0000","last_unstale":"2024-04-19T02:15:58.977743+0000","last_undegraded":"2024-04-19T02:15:58.977743+0000","last_fullsized":"2024-04-19T02:15:58.977743+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:45:39.791209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.984286+0000","last_change":"2024-04-19T02:15:29.283908+0000","last_active":"2024-04-19T02:15:58.984286+0000","last_peered":"2024-04-19T02:15:58.984286+0000","last_clean":"2024-04-19T02:15:58.984286+0000","last_became_active":"2024-04-19T02:15:29.281729+0000","last_became_peered":"2024-04-19T02:15:29.281729+0000","last_unstale":"2024-04-19T02:15:58.984286+0000","last_undegraded":"2024-04-19T02:15:58.984286+0000","last_fullsized":"2024-04-19T02:15:58.984286+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:03:15.383476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.984137+0000","last_change":"2024-04-19T02:15:29.281253+0000","last_active":"2024-04-19T02:15:58.984137+0000","last_peered":"2024-04-19T02:15:58.984137+0000","last_clean":"2024-04-19T02:15:58.984137+0000","last_became_active":"2024-04-19T02:15:29.279951+0000","last_became_peered":"2024-04-19T02:15:29.279951+0000","last_unstale":"2024-04-19T02:15:58.984137+0000","last_undegraded":"2024-04-19T02:15:58.984137+0000","last_fullsized":"2024-04-19T02:15:58.984137+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.983981+0000","last_change":"2024-04-19T02:15:29.283952+0000","last_active":"2024-04-19T02:15:58.983981+0000","last_peered":"2024-04-19T02:15:58.983981+0000","last_clean":"2024-04-19T02:15:58.983981+0000","last_became_active":"2024-04-19T02:15:29.282721+0000","last_became_peered":"2024-04-19T02:15:29.282721+0000","last_unstale":"2024-04-19T02:15:58.983981+0000","last_undegraded":"2024-04-19T02:15:58.983981+0000","last_fullsized":"2024-04-19T02:15:58.983981+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:45.301675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.977024+0000","last_change":"2024-04-19T02:15:29.282150+0000","last_active":"2024-04-19T02:15:58.977024+0000","last_peered":"2024-04-19T02:15:58.977024+0000","last_clean":"2024-04-19T02:15:58.977024+0000","last_became_active":"2024-04-19T02:15:29.281538+0000","last_became_peered":"2024-04-19T02:15:29.281538+0000","last_unstale":"2024-04-19T02:15:58.977024+0000","last_undegraded":"2024-04-19T02:15:58.977024+0000","last_fullsized":"2024-04-19T02:15:58.977024+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.977312+0000","last_change":"2024-04-19T02:15:29.284098+0000","last_active":"2024-04-19T02:15:58.977312+0000","last_peered":"2024-04-19T02:15:58.977312+0000","last_clean":"2024-04-19T02:15:58.977312+0000","last_became_active":"2024-04-19T02:15:29.282114+0000","last_became_peered":"2024-04-19T02:15:29.282114+0000","last_unstale":"2024-04-19T02:15:58.977312+0000","last_undegraded":"2024-04-19T02:15:58.977312+0000","last_fullsized":"2024-04-19T02:15:58.977312+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:16.568764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.986060+0000","last_change":"2024-04-19T02:15:29.280606+0000","last_active":"2024-04-19T02:15:58.986060+0000","last_peered":"2024-04-19T02:15:58.986060+0000","last_clean":"2024-04-19T02:15:58.986060+0000","last_became_active":"2024-04-19T02:15:29.280151+0000","last_became_peered":"2024-04-19T02:15:29.280151+0000","last_unstale":"2024-04-19T02:15:58.986060+0000","last_undegraded":"2024-04-19T02:15:58.986060+0000","last_fullsized":"2024-04-19T02:15:58.986060+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:26:22.452488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.984790+0000","last_change":"2024-04-19T02:15:53.958876+0000","last_active":"2024-04-19T02:15:58.984790+0000","last_peered":"2024-04-19T02:15:58.984790+0000","last_clean":"2024-04-19T02:15:58.984790+0000","last_became_active":"2024-04-19T02:15:53.958626+0000","last_became_peered":"2024-04-19T02:15:53.958626+0000","last_unstale":"2024-04-19T02:15:58.984790+0000","last_undegraded":"2024-04-19T02:15:58.984790+0000","last_fullsized":"2024-04-19T02:15:58.984790+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:23:57.044018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.978016+0000","last_change":"2024-04-19T02:15:53.956801+0000","last_active":"2024-04-19T02:15:58.978016+0000","last_peered":"2024-04-19T02:15:58.978016+0000","last_clean":"2024-04-19T02:15:58.978016+0000","last_became_active":"2024-04-19T02:15:53.956620+0000","last_became_peered":"2024-04-19T02:15:53.956620+0000","last_unstale":"2024-04-19T02:15:58.978016+0000","last_undegraded":"2024-04-19T02:15:58.978016+0000","last_fullsized":"2024-04-19T02:15:58.978016+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:57:05.843101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.985996+0000","last_change":"2024-04-19T02:15:29.284262+0000","last_active":"2024-04-19T02:15:58.985996+0000","last_peered":"2024-04-19T02:15:58.985996+0000","last_clean":"2024-04-19T02:15:58.985996+0000","last_became_active":"2024-04-19T02:15:29.283121+0000","last_became_peered":"2024-04-19T02:15:29.283121+0000","last_unstale":"2024-04-19T02:15:58.985996+0000","last_undegraded":"2024-04-19T02:15:58.985996+0000","last_fullsized":"2024-04-19T02:15:58.985996+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.984225+0000","last_change":"2024-04-19T02:15:29.285139+0000","last_active":"2024-04-19T02:15:58.984225+0000","last_peered":"2024-04-19T02:15:58.984225+0000","last_clean":"2024-04-19T02:15:58.984225+0000","last_became_active":"2024-04-19T02:15:29.284649+0000","last_became_peered":"2024-04-19T02:15:29.284649+0000","last_unstale":"2024-04-19T02:15:58.984225+0000","last_undegraded":"2024-04-19T02:15:58.984225+0000","last_fullsized":"2024-04-19T02:15:58.984225+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.984090+0000","last_change":"2024-04-19T02:15:29.283648+0000","last_active":"2024-04-19T02:15:58.984090+0000","last_peered":"2024-04-19T02:15:58.984090+0000","last_clean":"2024-04-19T02:15:58.984090+0000","last_became_active":"2024-04-19T02:15:29.281606+0000","last_became_peered":"2024-04-19T02:15:29.281606+0000","last_unstale":"2024-04-19T02:15:58.984090+0000","last_undegraded":"2024-04-19T02:15:58.984090+0000","last_fullsized":"2024-04-19T02:15:58.984090+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.977049+0000","last_change":"2024-04-19T02:15:29.278673+0000","last_active":"2024-04-19T02:15:58.977049+0000","last_peered":"2024-04-19T02:15:58.977049+0000","last_clean":"2024-04-19T02:15:58.977049+0000","last_became_active":"2024-04-19T02:15:29.277699+0000","last_became_peered":"2024-04-19T02:15:29.277699+0000","last_unstale":"2024-04-19T02:15:58.977049+0000","last_undegraded":"2024-04-19T02:15:58.977049+0000","last_fullsized":"2024-04-19T02:15:58.977049+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.977271+0000","last_change":"2024-04-19T02:15:29.283341+0000","last_active":"2024-04-19T02:15:58.977271+0000","last_peered":"2024-04-19T02:15:58.977271+0000","last_clean":"2024-04-19T02:15:58.977271+0000","last_became_active":"2024-04-19T02:15:29.281591+0000","last_became_peered":"2024-04-19T02:15:29.281591+0000","last_unstale":"2024-04-19T02:15:58.977271+0000","last_undegraded":"2024-04-19T02:15:58.977271+0000","last_fullsized":"2024-04-19T02:15:58.977271+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:34.593754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.977682+0000","last_change":"2024-04-19T02:15:29.282110+0000","last_active":"2024-04-19T02:15:58.977682+0000","last_peered":"2024-04-19T02:15:58.977682+0000","last_clean":"2024-04-19T02:15:58.977682+0000","last_became_active":"2024-04-19T02:15:29.281716+0000","last_became_peered":"2024-04-19T02:15:29.281716+0000","last_unstale":"2024-04-19T02:15:58.977682+0000","last_undegraded":"2024-04-19T02:15:58.977682+0000","last_fullsized":"2024-04-19T02:15:58.977682+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.984938+0000","last_change":"2024-04-19T02:15:29.285237+0000","last_active":"2024-04-19T02:15:58.984938+0000","last_peered":"2024-04-19T02:15:58.984938+0000","last_clean":"2024-04-19T02:15:58.984938+0000","last_became_active":"2024-04-19T02:15:29.282790+0000","last_became_peered":"2024-04-19T02:15:29.282790+0000","last_unstale":"2024-04-19T02:15:58.984938+0000","last_undegraded":"2024-04-19T02:15:58.984938+0000","last_fullsized":"2024-04-19T02:15:58.984938+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.984786+0000","last_change":"2024-04-19T02:15:29.282609+0000","last_active":"2024-04-19T02:15:58.984786+0000","last_peered":"2024-04-19T02:15:58.984786+0000","last_clean":"2024-04-19T02:15:58.984786+0000","last_became_active":"2024-04-19T02:15:29.281665+0000","last_became_peered":"2024-04-19T02:15:29.281665+0000","last_unstale":"2024-04-19T02:15:58.984786+0000","last_undegraded":"2024-04-19T02:15:58.984786+0000","last_fullsized":"2024-04-19T02:15:58.984786+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.384881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.984185+0000","last_change":"2024-04-19T02:15:53.955813+0000","last_active":"2024-04-19T02:15:58.984185+0000","last_peered":"2024-04-19T02:15:58.984185+0000","last_clean":"2024-04-19T02:15:58.984185+0000","last_became_active":"2024-04-19T02:15:53.955614+0000","last_became_peered":"2024-04-19T02:15:53.955614+0000","last_unstale":"2024-04-19T02:15:58.984185+0000","last_undegraded":"2024-04-19T02:15:58.984185+0000","last_fullsized":"2024-04-19T02:15:58.984185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:58:03.192647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.976503+0000","last_change":"2024-04-19T02:15:29.277109+0000","last_active":"2024-04-19T02:15:58.976503+0000","last_peered":"2024-04-19T02:15:58.976503+0000","last_clean":"2024-04-19T02:15:58.976503+0000","last_became_active":"2024-04-19T02:15:29.275417+0000","last_became_peered":"2024-04-19T02:15:29.275417+0000","last_unstale":"2024-04-19T02:15:58.976503+0000","last_undegraded":"2024-04-19T02:15:58.976503+0000","last_fullsized":"2024-04-19T02:15:58.976503+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.977633+0000","last_change":"2024-04-19T02:15:29.283266+0000","last_active":"2024-04-19T02:15:58.977633+0000","last_peered":"2024-04-19T02:15:58.977633+0000","last_clean":"2024-04-19T02:15:58.977633+0000","last_became_active":"2024-04-19T02:15:29.281505+0000","last_became_peered":"2024-04-19T02:15:29.281505+0000","last_unstale":"2024-04-19T02:15:58.977633+0000","last_undegraded":"2024-04-19T02:15:58.977633+0000","last_fullsized":"2024-04-19T02:15:58.977633+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.977488+0000","last_change":"2024-04-19T02:15:29.278084+0000","last_active":"2024-04-19T02:15:58.977488+0000","last_peered":"2024-04-19T02:15:58.977488+0000","last_clean":"2024-04-19T02:15:58.977488+0000","last_became_active":"2024-04-19T02:15:29.276952+0000","last_became_peered":"2024-04-19T02:15:29.276952+0000","last_unstale":"2024-04-19T02:15:58.977488+0000","last_undegraded":"2024-04-19T02:15:58.977488+0000","last_fullsized":"2024-04-19T02:15:58.977488+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.978068+0000","last_change":"2024-04-19T02:15:29.279904+0000","last_active":"2024-04-19T02:15:58.978068+0000","last_peered":"2024-04-19T02:15:58.978068+0000","last_clean":"2024-04-19T02:15:58.978068+0000","last_became_active":"2024-04-19T02:15:29.278938+0000","last_became_peered":"2024-04-19T02:15:29.278938+0000","last_unstale":"2024-04-19T02:15:58.978068+0000","last_undegraded":"2024-04-19T02:15:58.978068+0000","last_fullsized":"2024-04-19T02:15:58.978068+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.986122+0000","last_change":"2024-04-19T02:15:29.287389+0000","last_active":"2024-04-19T02:15:58.986122+0000","last_peered":"2024-04-19T02:15:58.986122+0000","last_clean":"2024-04-19T02:15:58.986122+0000","last_became_active":"2024-04-19T02:15:29.286431+0000","last_became_peered":"2024-04-19T02:15:29.286431+0000","last_unstale":"2024-04-19T02:15:58.986122+0000","last_undegraded":"2024-04-19T02:15:58.986122+0000","last_fullsized":"2024-04-19T02:15:58.986122+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:58:30.117887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.977311+0000","last_change":"2024-04-19T02:15:53.959207+0000","last_active":"2024-04-19T02:15:58.977311+0000","last_peered":"2024-04-19T02:15:58.977311+0000","last_clean":"2024-04-19T02:15:58.977311+0000","last_became_active":"2024-04-19T02:15:53.959007+0000","last_became_peered":"2024-04-19T02:15:53.959007+0000","last_unstale":"2024-04-19T02:15:58.977311+0000","last_undegraded":"2024-04-19T02:15:58.977311+0000","last_fullsized":"2024-04-19T02:15:58.977311+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:08:21.065077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.977392+0000","last_change":"2024-04-19T02:15:29.281792+0000","last_active":"2024-04-19T02:15:58.977392+0000","last_peered":"2024-04-19T02:15:58.977392+0000","last_clean":"2024-04-19T02:15:58.977392+0000","last_became_active":"2024-04-19T02:15:29.280479+0000","last_became_peered":"2024-04-19T02:15:29.280479+0000","last_unstale":"2024-04-19T02:15:58.977392+0000","last_undegraded":"2024-04-19T02:15:58.977392+0000","last_fullsized":"2024-04-19T02:15:58.977392+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.976593+0000","last_change":"2024-04-19T02:15:28.888778+0000","last_active":"2024-04-19T02:15:58.976593+0000","last_peered":"2024-04-19T02:15:58.976593+0000","last_clean":"2024-04-19T02:15:58.976593+0000","last_became_active":"2024-04-19T02:15:28.888543+0000","last_became_peered":"2024-04-19T02:15:28.888543+0000","last_unstale":"2024-04-19T02:15:58.976593+0000","last_undegraded":"2024-04-19T02:15:58.976593+0000","last_fullsized":"2024-04-19T02:15:58.976593+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:43:51.221619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.977755+0000","last_change":"2024-04-19T02:15:29.279986+0000","last_active":"2024-04-19T02:15:58.977755+0000","last_peered":"2024-04-19T02:15:58.977755+0000","last_clean":"2024-04-19T02:15:58.977755+0000","last_became_active":"2024-04-19T02:15:29.279690+0000","last_became_peered":"2024-04-19T02:15:29.279690+0000","last_unstale":"2024-04-19T02:15:58.977755+0000","last_undegraded":"2024-04-19T02:15:58.977755+0000","last_fullsized":"2024-04-19T02:15:58.977755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.977090+0000","last_change":"2024-04-19T02:15:28.890463+0000","last_active":"2024-04-19T02:15:58.977090+0000","last_peered":"2024-04-19T02:15:58.977090+0000","last_clean":"2024-04-19T02:15:58.977090+0000","last_became_active":"2024-04-19T02:15:28.889777+0000","last_became_peered":"2024-04-19T02:15:28.889777+0000","last_unstale":"2024-04-19T02:15:58.977090+0000","last_undegraded":"2024-04-19T02:15:58.977090+0000","last_fullsized":"2024-04-19T02:15:58.977090+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:58:21.520250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.977484+0000","last_change":"2024-04-19T02:15:29.280879+0000","last_active":"2024-04-19T02:15:58.977484+0000","last_peered":"2024-04-19T02:15:58.977484+0000","last_clean":"2024-04-19T02:15:58.977484+0000","last_became_active":"2024-04-19T02:15:29.279314+0000","last_became_peered":"2024-04-19T02:15:29.279314+0000","last_unstale":"2024-04-19T02:15:58.977484+0000","last_undegraded":"2024-04-19T02:15:58.977484+0000","last_fullsized":"2024-04-19T02:15:58.977484+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.977197+0000","last_change":"2024-04-19T02:15:28.891867+0000","last_active":"2024-04-19T02:15:58.977197+0000","last_peered":"2024-04-19T02:15:58.977197+0000","last_clean":"2024-04-19T02:15:58.977197+0000","last_became_active":"2024-04-19T02:15:28.890806+0000","last_became_peered":"2024-04-19T02:15:28.890806+0000","last_unstale":"2024-04-19T02:15:58.977197+0000","last_undegraded":"2024-04-19T02:15:58.977197+0000","last_fullsized":"2024-04-19T02:15:58.977197+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:57.946581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.976935+0000","last_change":"2024-04-19T02:15:29.278148+0000","last_active":"2024-04-19T02:15:58.976935+0000","last_peered":"2024-04-19T02:15:58.976935+0000","last_clean":"2024-04-19T02:15:58.976935+0000","last_became_active":"2024-04-19T02:15:29.277402+0000","last_became_peered":"2024-04-19T02:15:29.277402+0000","last_unstale":"2024-04-19T02:15:58.976935+0000","last_undegraded":"2024-04-19T02:15:58.976935+0000","last_fullsized":"2024-04-19T02:15:58.976935+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.985855+0000","last_change":"2024-04-19T02:15:28.892905+0000","last_active":"2024-04-19T02:15:58.985855+0000","last_peered":"2024-04-19T02:15:58.985855+0000","last_clean":"2024-04-19T02:15:58.985855+0000","last_became_active":"2024-04-19T02:15:28.892541+0000","last_became_peered":"2024-04-19T02:15:28.892541+0000","last_unstale":"2024-04-19T02:15:58.985855+0000","last_undegraded":"2024-04-19T02:15:58.985855+0000","last_fullsized":"2024-04-19T02:15:58.985855+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:33.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.976659+0000","last_change":"2024-04-19T02:15:29.278810+0000","last_active":"2024-04-19T02:15:58.976659+0000","last_peered":"2024-04-19T02:15:58.976659+0000","last_clean":"2024-04-19T02:15:58.976659+0000","last_became_active":"2024-04-19T02:15:29.278093+0000","last_became_peered":"2024-04-19T02:15:29.278093+0000","last_unstale":"2024-04-19T02:15:58.976659+0000","last_undegraded":"2024-04-19T02:15:58.976659+0000","last_fullsized":"2024-04-19T02:15:58.976659+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:34.883207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.977108+0000","last_change":"2024-04-19T02:15:28.892937+0000","last_active":"2024-04-19T02:15:58.977108+0000","last_peered":"2024-04-19T02:15:58.977108+0000","last_clean":"2024-04-19T02:15:58.977108+0000","last_became_active":"2024-04-19T02:15:28.891440+0000","last_became_peered":"2024-04-19T02:15:28.891440+0000","last_unstale":"2024-04-19T02:15:58.977108+0000","last_undegraded":"2024-04-19T02:15:58.977108+0000","last_fullsized":"2024-04-19T02:15:58.977108+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.977074+0000","last_change":"2024-04-19T02:15:29.278404+0000","last_active":"2024-04-19T02:15:58.977074+0000","last_peered":"2024-04-19T02:15:58.977074+0000","last_clean":"2024-04-19T02:15:58.977074+0000","last_became_active":"2024-04-19T02:15:29.277460+0000","last_became_peered":"2024-04-19T02:15:29.277460+0000","last_unstale":"2024-04-19T02:15:58.977074+0000","last_undegraded":"2024-04-19T02:15:58.977074+0000","last_fullsized":"2024-04-19T02:15:58.977074+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":23,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.984895+0000","last_change":"2024-04-19T02:15:28.891097+0000","last_active":"2024-04-19T02:15:58.984895+0000","last_peered":"2024-04-19T02:15:58.984895+0000","last_clean":"2024-04-19T02:15:58.984895+0000","last_became_active":"2024-04-19T02:15:28.890795+0000","last_became_peered":"2024-04-19T02:15:28.890795+0000","last_unstale":"2024-04-19T02:15:58.984895+0000","last_undegraded":"2024-04-19T02:15:58.984895+0000","last_fullsized":"2024-04-19T02:15:58.984895+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.985938+0000","last_change":"2024-04-19T02:15:29.278546+0000","last_active":"2024-04-19T02:15:58.985938+0000","last_peered":"2024-04-19T02:15:58.985938+0000","last_clean":"2024-04-19T02:15:58.985938+0000","last_became_active":"2024-04-19T02:15:29.277547+0000","last_became_peered":"2024-04-19T02:15:29.277547+0000","last_unstale":"2024-04-19T02:15:58.985938+0000","last_undegraded":"2024-04-19T02:15:58.985938+0000","last_fullsized":"2024-04-19T02:15:58.985938+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.985837+0000","last_change":"2024-04-19T02:15:28.892977+0000","last_active":"2024-04-19T02:15:58.985837+0000","last_peered":"2024-04-19T02:15:58.985837+0000","last_clean":"2024-04-19T02:15:58.985837+0000","last_became_active":"2024-04-19T02:15:28.892636+0000","last_became_peered":"2024-04-19T02:15:28.892636+0000","last_unstale":"2024-04-19T02:15:58.985837+0000","last_undegraded":"2024-04-19T02:15:58.985837+0000","last_fullsized":"2024-04-19T02:15:58.985837+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:43:51.221619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.976781+0000","last_change":"2024-04-19T02:15:53.955655+0000","last_active":"2024-04-19T02:15:58.976781+0000","last_peered":"2024-04-19T02:15:58.976781+0000","last_clean":"2024-04-19T02:15:58.976781+0000","last_became_active":"2024-04-19T02:15:53.955382+0000","last_became_peered":"2024-04-19T02:15:53.955382+0000","last_unstale":"2024-04-19T02:15:58.976781+0000","last_undegraded":"2024-04-19T02:15:58.976781+0000","last_fullsized":"2024-04-19T02:15:58.976781+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:48.239260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.977220+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:15:58.977220+0000","last_peered":"2024-04-19T02:15:58.977220+0000","last_clean":"2024-04-19T02:15:58.977220+0000","last_became_active":"2024-04-19T02:15:28.890751+0000","last_became_peered":"2024-04-19T02:15:28.890751+0000","last_unstale":"2024-04-19T02:15:58.977220+0000","last_undegraded":"2024-04-19T02:15:58.977220+0000","last_fullsized":"2024-04-19T02:15:58.977220+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.976964+0000","last_change":"2024-04-19T02:15:53.957865+0000","last_active":"2024-04-19T02:15:58.976964+0000","last_peered":"2024-04-19T02:15:58.976964+0000","last_clean":"2024-04-19T02:15:58.976964+0000","last_became_active":"2024-04-19T02:15:53.957627+0000","last_became_peered":"2024-04-19T02:15:53.957627+0000","last_unstale":"2024-04-19T02:15:58.976964+0000","last_undegraded":"2024-04-19T02:15:58.976964+0000","last_fullsized":"2024-04-19T02:15:58.976964+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:16:45.799016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.976548+0000","last_change":"2024-04-19T02:15:28.892934+0000","last_active":"2024-04-19T02:15:58.976548+0000","last_peered":"2024-04-19T02:15:58.976548+0000","last_clean":"2024-04-19T02:15:58.976548+0000","last_became_active":"2024-04-19T02:15:28.891879+0000","last_became_peered":"2024-04-19T02:15:28.891879+0000","last_unstale":"2024-04-19T02:15:58.976548+0000","last_undegraded":"2024-04-19T02:15:58.976548+0000","last_fullsized":"2024-04-19T02:15:58.976548+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:10:12.514798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.977951+0000","last_change":"2024-04-19T02:15:29.279685+0000","last_active":"2024-04-19T02:15:58.977951+0000","last_peered":"2024-04-19T02:15:58.977951+0000","last_clean":"2024-04-19T02:15:58.977951+0000","last_became_active":"2024-04-19T02:15:29.278810+0000","last_became_peered":"2024-04-19T02:15:29.278810+0000","last_unstale":"2024-04-19T02:15:58.977951+0000","last_undegraded":"2024-04-19T02:15:58.977951+0000","last_fullsized":"2024-04-19T02:15:58.977951+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.984282+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:15:58.984282+0000","last_peered":"2024-04-19T02:15:58.984282+0000","last_clean":"2024-04-19T02:15:58.984282+0000","last_became_active":"2024-04-19T02:15:28.890882+0000","last_became_peered":"2024-04-19T02:15:28.890882+0000","last_unstale":"2024-04-19T02:15:58.984282+0000","last_undegraded":"2024-04-19T02:15:58.984282+0000","last_fullsized":"2024-04-19T02:15:58.984282+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:31.673938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.977408+0000","last_change":"2024-04-19T02:15:29.284258+0000","last_active":"2024-04-19T02:15:58.977408+0000","last_peered":"2024-04-19T02:15:58.977408+0000","last_clean":"2024-04-19T02:15:58.977408+0000","last_became_active":"2024-04-19T02:15:29.283995+0000","last_became_peered":"2024-04-19T02:15:29.283995+0000","last_unstale":"2024-04-19T02:15:58.977408+0000","last_undegraded":"2024-04-19T02:15:58.977408+0000","last_fullsized":"2024-04-19T02:15:58.977408+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:35.941308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"21'1614","reported_seq":1627,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:02.748122+0000","last_change":"2024-04-19T02:15:53.956977+0000","last_active":"2024-04-19T02:16:02.748122+0000","last_peered":"2024-04-19T02:16:02.748122+0000","last_clean":"2024-04-19T02:16:02.748122+0000","last_became_active":"2024-04-19T02:15:53.956730+0000","last_became_peered":"2024-04-19T02:15:53.956730+0000","last_unstale":"2024-04-19T02:16:02.748122+0000","last_undegraded":"2024-04-19T02:16:02.748122+0000","last_fullsized":"2024-04-19T02:16:02.748122+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":1614,"log_dups_size":0,"ondisk_log_size":1614,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:56:46.323499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105775104,"num_objects":1614,"num_object_clones":0,"num_object_copies":3228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1614,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1614,"num_write_kb":103296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.985342+0000","last_change":"2024-04-19T02:15:28.890265+0000","last_active":"2024-04-19T02:15:58.985342+0000","last_peered":"2024-04-19T02:15:58.985342+0000","last_clean":"2024-04-19T02:15:58.985342+0000","last_became_active":"2024-04-19T02:15:28.890004+0000","last_became_peered":"2024-04-19T02:15:28.890004+0000","last_unstale":"2024-04-19T02:15:58.985342+0000","last_undegraded":"2024-04-19T02:15:58.985342+0000","last_fullsized":"2024-04-19T02:15:58.985342+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:02.517101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.977436+0000","last_change":"2024-04-19T02:15:29.285529+0000","last_active":"2024-04-19T02:15:58.977436+0000","last_peered":"2024-04-19T02:15:58.977436+0000","last_clean":"2024-04-19T02:15:58.977436+0000","last_became_active":"2024-04-19T02:15:29.285197+0000","last_became_peered":"2024-04-19T02:15:29.285197+0000","last_unstale":"2024-04-19T02:15:58.977436+0000","last_undegraded":"2024-04-19T02:15:58.977436+0000","last_fullsized":"2024-04-19T02:15:58.977436+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"21'1586","reported_seq":1598,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:02.748420+0000","last_change":"2024-04-19T02:15:53.958523+0000","last_active":"2024-04-19T02:16:02.748420+0000","last_peered":"2024-04-19T02:16:02.748420+0000","last_clean":"2024-04-19T02:16:02.748420+0000","last_became_active":"2024-04-19T02:15:53.957627+0000","last_became_peered":"2024-04-19T02:15:53.957627+0000","last_unstale":"2024-04-19T02:16:02.748420+0000","last_undegraded":"2024-04-19T02:16:02.748420+0000","last_fullsized":"2024-04-19T02:16:02.748420+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":1586,"log_dups_size":0,"ondisk_log_size":1586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:59:55.120296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103940096,"num_objects":1586,"num_object_clones":0,"num_object_copies":3172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1586,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1586,"num_write_kb":101504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.977119+0000","last_change":"2024-04-19T02:15:28.893902+0000","last_active":"2024-04-19T02:15:58.977119+0000","last_peered":"2024-04-19T02:15:58.977119+0000","last_clean":"2024-04-19T02:15:58.977119+0000","last_became_active":"2024-04-19T02:15:28.893231+0000","last_became_peered":"2024-04-19T02:15:28.893231+0000","last_unstale":"2024-04-19T02:15:58.977119+0000","last_undegraded":"2024-04-19T02:15:58.977119+0000","last_fullsized":"2024-04-19T02:15:58.977119+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:23.658442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.976634+0000","last_change":"2024-04-19T02:15:29.282874+0000","last_active":"2024-04-19T02:15:58.976634+0000","last_peered":"2024-04-19T02:15:58.976634+0000","last_clean":"2024-04-19T02:15:58.976634+0000","last_became_active":"2024-04-19T02:15:29.281675+0000","last_became_peered":"2024-04-19T02:15:29.281675+0000","last_unstale":"2024-04-19T02:15:58.976634+0000","last_undegraded":"2024-04-19T02:15:58.976634+0000","last_fullsized":"2024-04-19T02:15:58.976634+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:35.941308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"21'1575","reported_seq":1588,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:02.742549+0000","last_change":"2024-04-19T02:15:53.958324+0000","last_active":"2024-04-19T02:16:02.742549+0000","last_peered":"2024-04-19T02:16:02.742549+0000","last_clean":"2024-04-19T02:16:02.742549+0000","last_became_active":"2024-04-19T02:15:53.957392+0000","last_became_peered":"2024-04-19T02:15:53.957392+0000","last_unstale":"2024-04-19T02:16:02.742549+0000","last_undegraded":"2024-04-19T02:16:02.742549+0000","last_fullsized":"2024-04-19T02:16:02.742549+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":1575,"log_dups_size":0,"ondisk_log_size":1575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:12:58.132969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103219200,"num_objects":1575,"num_object_clones":0,"num_object_copies":3150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1575,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1575,"num_write_kb":100800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.986119+0000","last_change":"2024-04-19T02:15:28.891234+0000","last_active":"2024-04-19T02:15:58.986119+0000","last_peered":"2024-04-19T02:15:58.986119+0000","last_clean":"2024-04-19T02:15:58.986119+0000","last_became_active":"2024-04-19T02:15:28.890881+0000","last_became_peered":"2024-04-19T02:15:28.890881+0000","last_unstale":"2024-04-19T02:15:58.986119+0000","last_undegraded":"2024-04-19T02:15:58.986119+0000","last_fullsized":"2024-04-19T02:15:58.986119+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.984369+0000","last_change":"2024-04-19T02:15:29.281937+0000","last_active":"2024-04-19T02:15:58.984369+0000","last_peered":"2024-04-19T02:15:58.984369+0000","last_clean":"2024-04-19T02:15:58.984369+0000","last_became_active":"2024-04-19T02:15:29.280727+0000","last_became_peered":"2024-04-19T02:15:29.280727+0000","last_unstale":"2024-04-19T02:15:58.984369+0000","last_undegraded":"2024-04-19T02:15:58.984369+0000","last_fullsized":"2024-04-19T02:15:58.984369+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"21'1585","reported_seq":1598,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:02.745615+0000","last_change":"2024-04-19T02:15:53.959099+0000","last_active":"2024-04-19T02:16:02.745615+0000","last_peered":"2024-04-19T02:16:02.745615+0000","last_clean":"2024-04-19T02:16:02.745615+0000","last_became_active":"2024-04-19T02:15:53.958885+0000","last_became_peered":"2024-04-19T02:15:53.958885+0000","last_unstale":"2024-04-19T02:16:02.745615+0000","last_undegraded":"2024-04-19T02:16:02.745615+0000","last_fullsized":"2024-04-19T02:16:02.745615+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":1585,"log_dups_size":0,"ondisk_log_size":1585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:53:26.969927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103874560,"num_objects":1585,"num_object_clones":0,"num_object_copies":3170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1585,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1585,"num_write_kb":101440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.984709+0000","last_change":"2024-04-19T02:15:28.892767+0000","last_active":"2024-04-19T02:15:58.984709+0000","last_peered":"2024-04-19T02:15:58.984709+0000","last_clean":"2024-04-19T02:15:58.984709+0000","last_became_active":"2024-04-19T02:15:28.892235+0000","last_became_peered":"2024-04-19T02:15:28.892235+0000","last_unstale":"2024-04-19T02:15:58.984709+0000","last_undegraded":"2024-04-19T02:15:58.984709+0000","last_fullsized":"2024-04-19T02:15:58.984709+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:37.690735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.977999+0000","last_change":"2024-04-19T02:15:29.279857+0000","last_active":"2024-04-19T02:15:58.977999+0000","last_peered":"2024-04-19T02:15:58.977999+0000","last_clean":"2024-04-19T02:15:58.977999+0000","last_became_active":"2024-04-19T02:15:29.279536+0000","last_became_peered":"2024-04-19T02:15:29.279536+0000","last_unstale":"2024-04-19T02:15:58.977999+0000","last_undegraded":"2024-04-19T02:15:58.977999+0000","last_fullsized":"2024-04-19T02:15:58.977999+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:00.191179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"21'1562","reported_seq":1575,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:02.745876+0000","last_change":"2024-04-19T02:15:53.957261+0000","last_active":"2024-04-19T02:16:02.745876+0000","last_peered":"2024-04-19T02:16:02.745876+0000","last_clean":"2024-04-19T02:16:02.745876+0000","last_became_active":"2024-04-19T02:15:53.957092+0000","last_became_peered":"2024-04-19T02:15:53.957092+0000","last_unstale":"2024-04-19T02:16:02.745876+0000","last_undegraded":"2024-04-19T02:16:02.745876+0000","last_fullsized":"2024-04-19T02:16:02.745876+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":1562,"log_dups_size":0,"ondisk_log_size":1562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:54:15.544923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102367232,"num_objects":1562,"num_object_clones":0,"num_object_copies":3124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1562,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1562,"num_write_kb":99968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.977869+0000","last_change":"2024-04-19T02:15:28.891611+0000","last_active":"2024-04-19T02:15:58.977869+0000","last_peered":"2024-04-19T02:15:58.977869+0000","last_clean":"2024-04-19T02:15:58.977869+0000","last_became_active":"2024-04-19T02:15:28.890914+0000","last_became_peered":"2024-04-19T02:15:28.890914+0000","last_unstale":"2024-04-19T02:15:58.977869+0000","last_undegraded":"2024-04-19T02:15:58.977869+0000","last_fullsized":"2024-04-19T02:15:58.977869+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:37.690735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.984763+0000","last_change":"2024-04-19T02:15:29.285774+0000","last_active":"2024-04-19T02:15:58.984763+0000","last_peered":"2024-04-19T02:15:58.984763+0000","last_clean":"2024-04-19T02:15:58.984763+0000","last_became_active":"2024-04-19T02:15:29.284705+0000","last_became_peered":"2024-04-19T02:15:29.284705+0000","last_unstale":"2024-04-19T02:15:58.984763+0000","last_undegraded":"2024-04-19T02:15:58.984763+0000","last_fullsized":"2024-04-19T02:15:58.984763+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"21'1577","reported_seq":1590,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:02.736288+0000","last_change":"2024-04-19T02:15:53.955286+0000","last_active":"2024-04-19T02:16:02.736288+0000","last_peered":"2024-04-19T02:16:02.736288+0000","last_clean":"2024-04-19T02:16:02.736288+0000","last_became_active":"2024-04-19T02:15:53.955026+0000","last_became_peered":"2024-04-19T02:15:53.955026+0000","last_unstale":"2024-04-19T02:16:02.736288+0000","last_undegraded":"2024-04-19T02:16:02.736288+0000","last_fullsized":"2024-04-19T02:16:02.736288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":1577,"log_dups_size":0,"ondisk_log_size":1577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:05:48.594301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103350272,"num_objects":1577,"num_object_clones":0,"num_object_copies":3154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1577,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1577,"num_write_kb":100928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.984295+0000","last_change":"2024-04-19T02:15:28.892873+0000","last_active":"2024-04-19T02:15:58.984295+0000","last_peered":"2024-04-19T02:15:58.984295+0000","last_clean":"2024-04-19T02:15:58.984295+0000","last_became_active":"2024-04-19T02:15:28.892487+0000","last_became_peered":"2024-04-19T02:15:28.892487+0000","last_unstale":"2024-04-19T02:15:58.984295+0000","last_undegraded":"2024-04-19T02:15:58.984295+0000","last_fullsized":"2024-04-19T02:15:58.984295+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:35.412837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.986241+0000","last_change":"2024-04-19T02:15:29.285019+0000","last_active":"2024-04-19T02:15:58.986241+0000","last_peered":"2024-04-19T02:15:58.986241+0000","last_clean":"2024-04-19T02:15:58.986241+0000","last_became_active":"2024-04-19T02:15:29.284650+0000","last_became_peered":"2024-04-19T02:15:29.284650+0000","last_unstale":"2024-04-19T02:15:58.986241+0000","last_undegraded":"2024-04-19T02:15:58.986241+0000","last_fullsized":"2024-04-19T02:15:58.986241+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"21'1592","reported_seq":1604,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:02.741784+0000","last_change":"2024-04-19T02:15:53.957403+0000","last_active":"2024-04-19T02:16:02.741784+0000","last_peered":"2024-04-19T02:16:02.741784+0000","last_clean":"2024-04-19T02:16:02.741784+0000","last_became_active":"2024-04-19T02:15:53.957190+0000","last_became_peered":"2024-04-19T02:15:53.957190+0000","last_unstale":"2024-04-19T02:16:02.741784+0000","last_undegraded":"2024-04-19T02:16:02.741784+0000","last_fullsized":"2024-04-19T02:16:02.741784+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":1592,"log_dups_size":0,"ondisk_log_size":1592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:07:12.817884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104333312,"num_objects":1592,"num_object_clones":0,"num_object_copies":3184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1592,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1592,"num_write_kb":101888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.984102+0000","last_change":"2024-04-19T02:15:53.956839+0000","last_active":"2024-04-19T02:15:58.984102+0000","last_peered":"2024-04-19T02:15:58.984102+0000","last_clean":"2024-04-19T02:15:58.984102+0000","last_became_active":"2024-04-19T02:15:53.956630+0000","last_became_peered":"2024-04-19T02:15:53.956630+0000","last_unstale":"2024-04-19T02:15:58.984102+0000","last_undegraded":"2024-04-19T02:15:58.984102+0000","last_fullsized":"2024-04-19T02:15:58.984102+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:47.229730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.985965+0000","last_change":"2024-04-19T02:15:29.287190+0000","last_active":"2024-04-19T02:15:58.985965+0000","last_peered":"2024-04-19T02:15:58.985965+0000","last_clean":"2024-04-19T02:15:58.985965+0000","last_became_active":"2024-04-19T02:15:29.286606+0000","last_became_peered":"2024-04-19T02:15:29.286606+0000","last_unstale":"2024-04-19T02:15:58.985965+0000","last_undegraded":"2024-04-19T02:15:58.985965+0000","last_fullsized":"2024-04-19T02:15:58.985965+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:28.387062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"21'1554","reported_seq":1567,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:02.743073+0000","last_change":"2024-04-19T02:15:53.958448+0000","last_active":"2024-04-19T02:16:02.743073+0000","last_peered":"2024-04-19T02:16:02.743073+0000","last_clean":"2024-04-19T02:16:02.743073+0000","last_became_active":"2024-04-19T02:15:53.957595+0000","last_became_peered":"2024-04-19T02:15:53.957595+0000","last_unstale":"2024-04-19T02:16:02.743073+0000","last_undegraded":"2024-04-19T02:16:02.743073+0000","last_fullsized":"2024-04-19T02:16:02.743073+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":1554,"log_dups_size":0,"ondisk_log_size":1554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:26:31.855319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101842944,"num_objects":1554,"num_object_clones":0,"num_object_copies":3108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1554,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1554,"num_write_kb":99456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.977587+0000","last_change":"2024-04-19T02:15:28.894121+0000","last_active":"2024-04-19T02:15:58.977587+0000","last_peered":"2024-04-19T02:15:58.977587+0000","last_clean":"2024-04-19T02:15:58.977587+0000","last_became_active":"2024-04-19T02:15:28.893902+0000","last_became_peered":"2024-04-19T02:15:28.893902+0000","last_unstale":"2024-04-19T02:15:58.977587+0000","last_undegraded":"2024-04-19T02:15:58.977587+0000","last_fullsized":"2024-04-19T02:15:58.977587+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:10:35.146583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.977123+0000","last_change":"2024-04-19T02:15:29.282870+0000","last_active":"2024-04-19T02:15:58.977123+0000","last_peered":"2024-04-19T02:15:58.977123+0000","last_clean":"2024-04-19T02:15:58.977123+0000","last_became_active":"2024-04-19T02:15:29.281873+0000","last_became_peered":"2024-04-19T02:15:29.281873+0000","last_unstale":"2024-04-19T02:15:58.977123+0000","last_undegraded":"2024-04-19T02:15:58.977123+0000","last_fullsized":"2024-04-19T02:15:58.977123+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"21'1598","reported_seq":1611,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:02.736022+0000","last_change":"2024-04-19T02:15:53.955498+0000","last_active":"2024-04-19T02:16:02.736022+0000","last_peered":"2024-04-19T02:16:02.736022+0000","last_clean":"2024-04-19T02:16:02.736022+0000","last_became_active":"2024-04-19T02:15:53.954910+0000","last_became_peered":"2024-04-19T02:15:53.954910+0000","last_unstale":"2024-04-19T02:16:02.736022+0000","last_undegraded":"2024-04-19T02:16:02.736022+0000","last_fullsized":"2024-04-19T02:16:02.736022+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":1598,"log_dups_size":0,"ondisk_log_size":1598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:58:27.262672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104726528,"num_objects":1598,"num_object_clones":0,"num_object_copies":3196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1598,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1598,"num_write_kb":102272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.977528+0000","last_change":"2024-04-19T02:15:24.527061+0000","last_active":"2024-04-19T02:15:58.977528+0000","last_peered":"2024-04-19T02:15:58.977528+0000","last_clean":"2024-04-19T02:15:58.977528+0000","last_became_active":"2024-04-19T02:15:24.526757+0000","last_became_peered":"2024-04-19T02:15:24.526757+0000","last_unstale":"2024-04-19T02:15:58.977528+0000","last_undegraded":"2024-04-19T02:15:58.977528+0000","last_fullsized":"2024-04-19T02:15:58.977528+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:17:13.649077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.986191+0000","last_change":"2024-04-19T02:15:28.892766+0000","last_active":"2024-04-19T02:15:58.986191+0000","last_peered":"2024-04-19T02:15:58.986191+0000","last_clean":"2024-04-19T02:15:58.986191+0000","last_became_active":"2024-04-19T02:15:28.892396+0000","last_became_peered":"2024-04-19T02:15:28.892396+0000","last_unstale":"2024-04-19T02:15:58.986191+0000","last_undegraded":"2024-04-19T02:15:58.986191+0000","last_fullsized":"2024-04-19T02:15:58.986191+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:57.946581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.976910+0000","last_change":"2024-04-19T02:15:29.277922+0000","last_active":"2024-04-19T02:15:58.976910+0000","last_peered":"2024-04-19T02:15:58.976910+0000","last_clean":"2024-04-19T02:15:58.976910+0000","last_became_active":"2024-04-19T02:15:29.276968+0000","last_became_peered":"2024-04-19T02:15:29.276968+0000","last_unstale":"2024-04-19T02:15:58.976910+0000","last_undegraded":"2024-04-19T02:15:58.976910+0000","last_fullsized":"2024-04-19T02:15:58.976910+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"21'1545","reported_seq":1558,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:02.736432+0000","last_change":"2024-04-19T02:15:53.955228+0000","last_active":"2024-04-19T02:16:02.736432+0000","last_peered":"2024-04-19T02:16:02.736432+0000","last_clean":"2024-04-19T02:16:02.736432+0000","last_became_active":"2024-04-19T02:15:53.954960+0000","last_became_peered":"2024-04-19T02:15:53.954960+0000","last_unstale":"2024-04-19T02:16:02.736432+0000","last_undegraded":"2024-04-19T02:16:02.736432+0000","last_fullsized":"2024-04-19T02:16:02.736432+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":1545,"log_dups_size":0,"ondisk_log_size":1545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:46:07.409922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101253120,"num_objects":1545,"num_object_clones":0,"num_object_copies":3090,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1545,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1545,"num_write_kb":98880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.985910+0000","last_change":"2024-04-19T02:15:24.530933+0000","last_active":"2024-04-19T02:15:58.985910+0000","last_peered":"2024-04-19T02:15:58.985910+0000","last_clean":"2024-04-19T02:15:58.985910+0000","last_became_active":"2024-04-19T02:15:24.530550+0000","last_became_peered":"2024-04-19T02:15:24.530550+0000","last_unstale":"2024-04-19T02:15:58.985910+0000","last_undegraded":"2024-04-19T02:15:58.985910+0000","last_fullsized":"2024-04-19T02:15:58.985910+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:18:15.194321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.984932+0000","last_change":"2024-04-19T02:15:28.893062+0000","last_active":"2024-04-19T02:15:58.984932+0000","last_peered":"2024-04-19T02:15:58.984932+0000","last_clean":"2024-04-19T02:15:58.984932+0000","last_became_active":"2024-04-19T02:15:28.892798+0000","last_became_peered":"2024-04-19T02:15:28.892798+0000","last_unstale":"2024-04-19T02:15:58.984932+0000","last_undegraded":"2024-04-19T02:15:58.984932+0000","last_fullsized":"2024-04-19T02:15:58.984932+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:53.170180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.977337+0000","last_change":"2024-04-19T02:15:29.278294+0000","last_active":"2024-04-19T02:15:58.977337+0000","last_peered":"2024-04-19T02:15:58.977337+0000","last_clean":"2024-04-19T02:15:58.977337+0000","last_became_active":"2024-04-19T02:15:29.277536+0000","last_became_peered":"2024-04-19T02:15:29.277536+0000","last_unstale":"2024-04-19T02:15:58.977337+0000","last_undegraded":"2024-04-19T02:15:58.977337+0000","last_fullsized":"2024-04-19T02:15:58.977337+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"21'1568","reported_seq":1580,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:02.743070+0000","last_change":"2024-04-19T02:15:53.956251+0000","last_active":"2024-04-19T02:16:02.743070+0000","last_peered":"2024-04-19T02:16:02.743070+0000","last_clean":"2024-04-19T02:16:02.743070+0000","last_became_active":"2024-04-19T02:15:53.955886+0000","last_became_peered":"2024-04-19T02:15:53.955886+0000","last_unstale":"2024-04-19T02:16:02.743070+0000","last_undegraded":"2024-04-19T02:16:02.743070+0000","last_fullsized":"2024-04-19T02:16:02.743070+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":1568,"log_dups_size":0,"ondisk_log_size":1568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:38:38.586906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102760448,"num_objects":1568,"num_object_clones":0,"num_object_copies":3136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1568,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1568,"num_write_kb":100352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.976492+0000","last_change":"2024-04-19T02:15:24.527048+0000","last_active":"2024-04-19T02:15:58.976492+0000","last_peered":"2024-04-19T02:15:58.976492+0000","last_clean":"2024-04-19T02:15:58.976492+0000","last_became_active":"2024-04-19T02:15:24.526790+0000","last_became_peered":"2024-04-19T02:15:24.526790+0000","last_unstale":"2024-04-19T02:15:58.976492+0000","last_undegraded":"2024-04-19T02:15:58.976492+0000","last_fullsized":"2024-04-19T02:15:58.976492+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.983872+0000","last_change":"2024-04-19T02:15:53.956945+0000","last_active":"2024-04-19T02:15:58.983872+0000","last_peered":"2024-04-19T02:15:58.983872+0000","last_clean":"2024-04-19T02:15:58.983872+0000","last_became_active":"2024-04-19T02:15:53.956719+0000","last_became_peered":"2024-04-19T02:15:53.956719+0000","last_unstale":"2024-04-19T02:15:58.983872+0000","last_undegraded":"2024-04-19T02:15:58.983872+0000","last_fullsized":"2024-04-19T02:15:58.983872+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:00:37.754624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.977271+0000","last_change":"2024-04-19T02:15:29.282663+0000","last_active":"2024-04-19T02:15:58.977271+0000","last_peered":"2024-04-19T02:15:58.977271+0000","last_clean":"2024-04-19T02:15:58.977271+0000","last_became_active":"2024-04-19T02:15:29.282217+0000","last_became_peered":"2024-04-19T02:15:29.282217+0000","last_unstale":"2024-04-19T02:15:58.977271+0000","last_undegraded":"2024-04-19T02:15:58.977271+0000","last_fullsized":"2024-04-19T02:15:58.977271+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"21'1583","reported_seq":1596,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:02.728423+0000","last_change":"2024-04-19T02:15:53.958264+0000","last_active":"2024-04-19T02:16:02.728423+0000","last_peered":"2024-04-19T02:16:02.728423+0000","last_clean":"2024-04-19T02:16:02.728423+0000","last_became_active":"2024-04-19T02:15:53.956689+0000","last_became_peered":"2024-04-19T02:15:53.956689+0000","last_unstale":"2024-04-19T02:16:02.728423+0000","last_undegraded":"2024-04-19T02:16:02.728423+0000","last_fullsized":"2024-04-19T02:16:02.728423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":1583,"log_dups_size":0,"ondisk_log_size":1583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:24:32.928594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103743488,"num_objects":1583,"num_object_clones":0,"num_object_copies":3166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1583,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1583,"num_write_kb":101312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.985319+0000","last_change":"2024-04-19T02:15:24.530924+0000","last_active":"2024-04-19T02:15:58.985319+0000","last_peered":"2024-04-19T02:15:58.985319+0000","last_clean":"2024-04-19T02:15:58.985319+0000","last_became_active":"2024-04-19T02:15:24.530551+0000","last_became_peered":"2024-04-19T02:15:24.530551+0000","last_unstale":"2024-04-19T02:15:58.985319+0000","last_undegraded":"2024-04-19T02:15:58.985319+0000","last_fullsized":"2024-04-19T02:15:58.985319+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:30.576946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":216,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.984091+0000","last_change":"2024-04-19T02:15:24.533634+0000","last_active":"2024-04-19T02:15:58.984091+0000","last_peered":"2024-04-19T02:15:58.984091+0000","last_clean":"2024-04-19T02:15:58.984091+0000","last_became_active":"2024-04-19T02:15:24.533420+0000","last_became_peered":"2024-04-19T02:15:24.533420+0000","last_unstale":"2024-04-19T02:15:58.984091+0000","last_undegraded":"2024-04-19T02:15:58.984091+0000","last_fullsized":"2024-04-19T02:15:58.984091+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.976975+0000","last_change":"2024-04-19T02:15:28.890244+0000","last_active":"2024-04-19T02:15:58.976975+0000","last_peered":"2024-04-19T02:15:58.976975+0000","last_clean":"2024-04-19T02:15:58.976975+0000","last_became_active":"2024-04-19T02:15:28.889831+0000","last_became_peered":"2024-04-19T02:15:28.889831+0000","last_unstale":"2024-04-19T02:15:58.976975+0000","last_undegraded":"2024-04-19T02:15:58.976975+0000","last_fullsized":"2024-04-19T02:15:58.976975+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.986220+0000","last_change":"2024-04-19T02:15:29.285015+0000","last_active":"2024-04-19T02:15:58.986220+0000","last_peered":"2024-04-19T02:15:58.986220+0000","last_clean":"2024-04-19T02:15:58.986220+0000","last_became_active":"2024-04-19T02:15:29.284164+0000","last_became_peered":"2024-04-19T02:15:29.284164+0000","last_unstale":"2024-04-19T02:15:58.986220+0000","last_undegraded":"2024-04-19T02:15:58.986220+0000","last_fullsized":"2024-04-19T02:15:58.986220+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:36.987844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"21'1589","reported_seq":1602,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:02.744712+0000","last_change":"2024-04-19T02:15:53.956463+0000","last_active":"2024-04-19T02:16:02.744712+0000","last_peered":"2024-04-19T02:16:02.744712+0000","last_clean":"2024-04-19T02:16:02.744712+0000","last_became_active":"2024-04-19T02:15:53.955819+0000","last_became_peered":"2024-04-19T02:15:53.955819+0000","last_unstale":"2024-04-19T02:16:02.744712+0000","last_undegraded":"2024-04-19T02:16:02.744712+0000","last_fullsized":"2024-04-19T02:16:02.744712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":1589,"log_dups_size":0,"ondisk_log_size":1589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:46:07.409922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104136704,"num_objects":1589,"num_object_clones":0,"num_object_copies":3178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1589,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1589,"num_write_kb":101696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.984231+0000","last_change":"2024-04-19T02:15:24.533912+0000","last_active":"2024-04-19T02:15:58.984231+0000","last_peered":"2024-04-19T02:15:58.984231+0000","last_clean":"2024-04-19T02:15:58.984231+0000","last_became_active":"2024-04-19T02:15:24.533580+0000","last_became_peered":"2024-04-19T02:15:24.533580+0000","last_unstale":"2024-04-19T02:15:58.984231+0000","last_undegraded":"2024-04-19T02:15:58.984231+0000","last_fullsized":"2024-04-19T02:15:58.984231+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:45.045477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.976405+0000","last_change":"2024-04-19T02:15:28.891889+0000","last_active":"2024-04-19T02:15:58.976405+0000","last_peered":"2024-04-19T02:15:58.976405+0000","last_clean":"2024-04-19T02:15:58.976405+0000","last_became_active":"2024-04-19T02:15:28.890919+0000","last_became_peered":"2024-04-19T02:15:28.890919+0000","last_unstale":"2024-04-19T02:15:58.976405+0000","last_undegraded":"2024-04-19T02:15:58.976405+0000","last_fullsized":"2024-04-19T02:15:58.976405+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:35.412837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.977504+0000","last_change":"2024-04-19T02:15:53.957881+0000","last_active":"2024-04-19T02:15:58.977504+0000","last_peered":"2024-04-19T02:15:58.977504+0000","last_clean":"2024-04-19T02:15:58.977504+0000","last_became_active":"2024-04-19T02:15:53.957657+0000","last_became_peered":"2024-04-19T02:15:53.957657+0000","last_unstale":"2024-04-19T02:15:58.977504+0000","last_undegraded":"2024-04-19T02:15:58.977504+0000","last_fullsized":"2024-04-19T02:15:58.977504+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:46.921714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"21'1636","reported_seq":1647,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:02.749077+0000","last_change":"2024-04-19T02:15:53.955068+0000","last_active":"2024-04-19T02:16:02.749077+0000","last_peered":"2024-04-19T02:16:02.749077+0000","last_clean":"2024-04-19T02:16:02.749077+0000","last_became_active":"2024-04-19T02:15:53.954721+0000","last_became_peered":"2024-04-19T02:15:53.954721+0000","last_unstale":"2024-04-19T02:16:02.749077+0000","last_undegraded":"2024-04-19T02:16:02.749077+0000","last_fullsized":"2024-04-19T02:16:02.749077+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":1636,"log_dups_size":0,"ondisk_log_size":1636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:18:29.742535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107216896,"num_objects":1636,"num_object_clones":0,"num_object_copies":3272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1636,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1636,"num_write_kb":104704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.977371+0000","last_change":"2024-04-19T02:15:53.959105+0000","last_active":"2024-04-19T02:15:58.977371+0000","last_peered":"2024-04-19T02:15:58.977371+0000","last_clean":"2024-04-19T02:15:58.977371+0000","last_became_active":"2024-04-19T02:15:53.958836+0000","last_became_peered":"2024-04-19T02:15:53.958836+0000","last_unstale":"2024-04-19T02:15:58.977371+0000","last_undegraded":"2024-04-19T02:15:58.977371+0000","last_fullsized":"2024-04-19T02:15:58.977371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:18:00.321514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.977249+0000","last_change":"2024-04-19T02:15:28.892125+0000","last_active":"2024-04-19T02:15:58.977249+0000","last_peered":"2024-04-19T02:15:58.977249+0000","last_clean":"2024-04-19T02:15:58.977249+0000","last_became_active":"2024-04-19T02:15:28.891300+0000","last_became_peered":"2024-04-19T02:15:28.891300+0000","last_unstale":"2024-04-19T02:15:58.977249+0000","last_undegraded":"2024-04-19T02:15:58.977249+0000","last_fullsized":"2024-04-19T02:15:58.977249+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.976669+0000","last_change":"2024-04-19T02:15:29.281694+0000","last_active":"2024-04-19T02:15:58.976669+0000","last_peered":"2024-04-19T02:15:58.976669+0000","last_clean":"2024-04-19T02:15:58.976669+0000","last_became_active":"2024-04-19T02:15:29.280519+0000","last_became_peered":"2024-04-19T02:15:29.280519+0000","last_unstale":"2024-04-19T02:15:58.976669+0000","last_undegraded":"2024-04-19T02:15:58.976669+0000","last_fullsized":"2024-04-19T02:15:58.976669+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:50.890545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"21'1566","reported_seq":1578,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:02.753272+0000","last_change":"2024-04-19T02:15:53.955079+0000","last_active":"2024-04-19T02:16:02.753272+0000","last_peered":"2024-04-19T02:16:02.753272+0000","last_clean":"2024-04-19T02:16:02.753272+0000","last_became_active":"2024-04-19T02:15:53.954767+0000","last_became_peered":"2024-04-19T02:15:53.954767+0000","last_unstale":"2024-04-19T02:16:02.753272+0000","last_undegraded":"2024-04-19T02:16:02.753272+0000","last_fullsized":"2024-04-19T02:16:02.753272+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":1566,"log_dups_size":0,"ondisk_log_size":1566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:17:09.869041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102629376,"num_objects":1566,"num_object_clones":0,"num_object_copies":3132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1566,"num_write_kb":100224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.977106+0000","last_change":"2024-04-19T02:15:28.891702+0000","last_active":"2024-04-19T02:15:58.977106+0000","last_peered":"2024-04-19T02:15:58.977106+0000","last_clean":"2024-04-19T02:15:58.977106+0000","last_became_active":"2024-04-19T02:15:28.890743+0000","last_became_peered":"2024-04-19T02:15:28.890743+0000","last_unstale":"2024-04-19T02:15:58.977106+0000","last_undegraded":"2024-04-19T02:15:58.977106+0000","last_fullsized":"2024-04-19T02:15:58.977106+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.977869+0000","last_change":"2024-04-19T02:15:24.526845+0000","last_active":"2024-04-19T02:15:58.977869+0000","last_peered":"2024-04-19T02:15:58.977869+0000","last_clean":"2024-04-19T02:15:58.977869+0000","last_became_active":"2024-04-19T02:15:24.526500+0000","last_became_peered":"2024-04-19T02:15:24.526500+0000","last_unstale":"2024-04-19T02:15:58.977869+0000","last_undegraded":"2024-04-19T02:15:58.977869+0000","last_fullsized":"2024-04-19T02:15:58.977869+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:16.883355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.976849+0000","last_change":"2024-04-19T02:15:29.278686+0000","last_active":"2024-04-19T02:15:58.976849+0000","last_peered":"2024-04-19T02:15:58.976849+0000","last_clean":"2024-04-19T02:15:58.976849+0000","last_became_active":"2024-04-19T02:15:29.278108+0000","last_became_peered":"2024-04-19T02:15:29.278108+0000","last_unstale":"2024-04-19T02:15:58.976849+0000","last_undegraded":"2024-04-19T02:15:58.976849+0000","last_fullsized":"2024-04-19T02:15:58.976849+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:34.593754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"21'1507","reported_seq":1520,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T02:16:02.743295+0000","last_change":"2024-04-19T02:15:53.957269+0000","last_active":"2024-04-19T02:16:02.743295+0000","last_peered":"2024-04-19T02:16:02.743295+0000","last_clean":"2024-04-19T02:16:02.743295+0000","last_became_active":"2024-04-19T02:15:53.956554+0000","last_became_peered":"2024-04-19T02:15:53.956554+0000","last_unstale":"2024-04-19T02:16:02.743295+0000","last_undegraded":"2024-04-19T02:16:02.743295+0000","last_fullsized":"2024-04-19T02:16:02.743295+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":1507,"log_dups_size":0,"ondisk_log_size":1507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:29:38.789719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98762752,"num_objects":1507,"num_object_clones":0,"num_object_copies":3014,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1507,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1507,"num_write_kb":96448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.985369+0000","last_change":"2024-04-19T02:15:24.533777+0000","last_active":"2024-04-19T02:15:58.985369+0000","last_peered":"2024-04-19T02:15:58.985369+0000","last_clean":"2024-04-19T02:15:58.985369+0000","last_became_active":"2024-04-19T02:15:24.533436+0000","last_became_peered":"2024-04-19T02:15:24.533436+0000","last_unstale":"2024-04-19T02:15:58.985369+0000","last_undegraded":"2024-04-19T02:15:58.985369+0000","last_fullsized":"2024-04-19T02:15:58.985369+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:53:25.922418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.977686+0000","last_change":"2024-04-19T02:15:28.891370+0000","last_active":"2024-04-19T02:15:58.977686+0000","last_peered":"2024-04-19T02:15:58.977686+0000","last_clean":"2024-04-19T02:15:58.977686+0000","last_became_active":"2024-04-19T02:15:28.890702+0000","last_became_peered":"2024-04-19T02:15:28.890702+0000","last_unstale":"2024-04-19T02:15:58.977686+0000","last_undegraded":"2024-04-19T02:15:58.977686+0000","last_fullsized":"2024-04-19T02:15:58.977686+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:33.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.976562+0000","last_change":"2024-04-19T02:15:29.282244+0000","last_active":"2024-04-19T02:15:58.976562+0000","last_peered":"2024-04-19T02:15:58.976562+0000","last_clean":"2024-04-19T02:15:58.976562+0000","last_became_active":"2024-04-19T02:15:29.280366+0000","last_became_peered":"2024-04-19T02:15:29.280366+0000","last_unstale":"2024-04-19T02:15:58.976562+0000","last_undegraded":"2024-04-19T02:15:58.976562+0000","last_fullsized":"2024-04-19T02:15:58.976562+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.976730+0000","last_change":"2024-04-19T02:15:28.893027+0000","last_active":"2024-04-19T02:15:58.976730+0000","last_peered":"2024-04-19T02:15:58.976730+0000","last_clean":"2024-04-19T02:15:58.976730+0000","last_became_active":"2024-04-19T02:15:28.892695+0000","last_became_peered":"2024-04-19T02:15:28.892695+0000","last_unstale":"2024-04-19T02:15:58.976730+0000","last_undegraded":"2024-04-19T02:15:58.976730+0000","last_fullsized":"2024-04-19T02:15:58.976730+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.977191+0000","last_change":"2024-04-19T02:15:29.283155+0000","last_active":"2024-04-19T02:15:58.977191+0000","last_peered":"2024-04-19T02:15:58.977191+0000","last_clean":"2024-04-19T02:15:58.977191+0000","last_became_active":"2024-04-19T02:15:29.281407+0000","last_became_peered":"2024-04-19T02:15:29.281407+0000","last_unstale":"2024-04-19T02:15:58.977191+0000","last_undegraded":"2024-04-19T02:15:58.977191+0000","last_fullsized":"2024-04-19T02:15:58.977191+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.984859+0000","last_change":"2024-04-19T02:15:28.893067+0000","last_active":"2024-04-19T02:15:58.984859+0000","last_peered":"2024-04-19T02:15:58.984859+0000","last_clean":"2024-04-19T02:15:58.984859+0000","last_became_active":"2024-04-19T02:15:28.892781+0000","last_became_peered":"2024-04-19T02:15:28.892781+0000","last_unstale":"2024-04-19T02:15:58.984859+0000","last_undegraded":"2024-04-19T02:15:58.984859+0000","last_fullsized":"2024-04-19T02:15:58.984859+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:54:15.590143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.984859+0000","last_change":"2024-04-19T02:15:29.281279+0000","last_active":"2024-04-19T02:15:58.984859+0000","last_peered":"2024-04-19T02:15:58.984859+0000","last_clean":"2024-04-19T02:15:58.984859+0000","last_became_active":"2024-04-19T02:15:29.279360+0000","last_became_peered":"2024-04-19T02:15:29.279360+0000","last_unstale":"2024-04-19T02:15:58.984859+0000","last_undegraded":"2024-04-19T02:15:58.984859+0000","last_fullsized":"2024-04-19T02:15:58.984859+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.977291+0000","last_change":"2024-04-19T02:15:28.893239+0000","last_active":"2024-04-19T02:15:58.977291+0000","last_peered":"2024-04-19T02:15:58.977291+0000","last_clean":"2024-04-19T02:15:58.977291+0000","last_became_active":"2024-04-19T02:15:28.892881+0000","last_became_peered":"2024-04-19T02:15:28.892881+0000","last_unstale":"2024-04-19T02:15:58.977291+0000","last_undegraded":"2024-04-19T02:15:58.977291+0000","last_fullsized":"2024-04-19T02:15:58.977291+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.984387+0000","last_change":"2024-04-19T02:15:29.281652+0000","last_active":"2024-04-19T02:15:58.984387+0000","last_peered":"2024-04-19T02:15:58.984387+0000","last_clean":"2024-04-19T02:15:58.984387+0000","last_became_active":"2024-04-19T02:15:29.281175+0000","last_became_peered":"2024-04-19T02:15:29.281175+0000","last_unstale":"2024-04-19T02:15:58.984387+0000","last_undegraded":"2024-04-19T02:15:58.984387+0000","last_fullsized":"2024-04-19T02:15:58.984387+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:16.568764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.978050+0000","last_change":"2024-04-19T02:15:28.892058+0000","last_active":"2024-04-19T02:15:58.978050+0000","last_peered":"2024-04-19T02:15:58.978050+0000","last_clean":"2024-04-19T02:15:58.978050+0000","last_became_active":"2024-04-19T02:15:28.890877+0000","last_became_peered":"2024-04-19T02:15:28.890877+0000","last_unstale":"2024-04-19T02:15:58.978050+0000","last_undegraded":"2024-04-19T02:15:58.978050+0000","last_fullsized":"2024-04-19T02:15:58.978050+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:53.170180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.976757+0000","last_change":"2024-04-19T02:15:29.278810+0000","last_active":"2024-04-19T02:15:58.976757+0000","last_peered":"2024-04-19T02:15:58.976757+0000","last_clean":"2024-04-19T02:15:58.976757+0000","last_became_active":"2024-04-19T02:15:29.277913+0000","last_became_peered":"2024-04-19T02:15:29.277913+0000","last_unstale":"2024-04-19T02:15:58.976757+0000","last_undegraded":"2024-04-19T02:15:58.976757+0000","last_fullsized":"2024-04-19T02:15:58.976757+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:24.082666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.977488+0000","last_change":"2024-04-19T02:15:28.889132+0000","last_active":"2024-04-19T02:15:58.977488+0000","last_peered":"2024-04-19T02:15:58.977488+0000","last_clean":"2024-04-19T02:15:58.977488+0000","last_became_active":"2024-04-19T02:15:28.888926+0000","last_became_peered":"2024-04-19T02:15:28.888926+0000","last_unstale":"2024-04-19T02:15:58.977488+0000","last_undegraded":"2024-04-19T02:15:58.977488+0000","last_fullsized":"2024-04-19T02:15:58.977488+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.984367+0000","last_change":"2024-04-19T02:15:29.282776+0000","last_active":"2024-04-19T02:15:58.984367+0000","last_peered":"2024-04-19T02:15:58.984367+0000","last_clean":"2024-04-19T02:15:58.984367+0000","last_became_active":"2024-04-19T02:15:29.279382+0000","last_became_peered":"2024-04-19T02:15:29.279382+0000","last_unstale":"2024-04-19T02:15:58.984367+0000","last_undegraded":"2024-04-19T02:15:58.984367+0000","last_fullsized":"2024-04-19T02:15:58.984367+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.984190+0000","last_change":"2024-04-19T02:15:29.283537+0000","last_active":"2024-04-19T02:15:58.984190+0000","last_peered":"2024-04-19T02:15:58.984190+0000","last_clean":"2024-04-19T02:15:58.984190+0000","last_became_active":"2024-04-19T02:15:29.281801+0000","last_became_peered":"2024-04-19T02:15:29.281801+0000","last_unstale":"2024-04-19T02:15:58.984190+0000","last_undegraded":"2024-04-19T02:15:58.984190+0000","last_fullsized":"2024-04-19T02:15:58.984190+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.976402+0000","last_change":"2024-04-19T02:15:29.281560+0000","last_active":"2024-04-19T02:15:58.976402+0000","last_peered":"2024-04-19T02:15:58.976402+0000","last_clean":"2024-04-19T02:15:58.976402+0000","last_became_active":"2024-04-19T02:15:29.281261+0000","last_became_peered":"2024-04-19T02:15:29.281261+0000","last_unstale":"2024-04-19T02:15:58.976402+0000","last_undegraded":"2024-04-19T02:15:58.976402+0000","last_fullsized":"2024-04-19T02:15:58.976402+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.984144+0000","last_change":"2024-04-19T02:15:53.955913+0000","last_active":"2024-04-19T02:15:58.984144+0000","last_peered":"2024-04-19T02:15:58.984144+0000","last_clean":"2024-04-19T02:15:58.984144+0000","last_became_active":"2024-04-19T02:15:53.955676+0000","last_became_peered":"2024-04-19T02:15:53.955676+0000","last_unstale":"2024-04-19T02:15:58.984144+0000","last_undegraded":"2024-04-19T02:15:58.984144+0000","last_fullsized":"2024-04-19T02:15:58.984144+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:53:02.899902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.978111+0000","last_change":"2024-04-19T02:15:29.278702+0000","last_active":"2024-04-19T02:15:58.978111+0000","last_peered":"2024-04-19T02:15:58.978111+0000","last_clean":"2024-04-19T02:15:58.978111+0000","last_became_active":"2024-04-19T02:15:29.277756+0000","last_became_peered":"2024-04-19T02:15:29.277756+0000","last_unstale":"2024-04-19T02:15:58.978111+0000","last_undegraded":"2024-04-19T02:15:58.978111+0000","last_fullsized":"2024-04-19T02:15:58.978111+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T02:15:58.977310+0000","last_change":"2024-04-19T02:15:29.277568+0000","last_active":"2024-04-19T02:15:58.977310+0000","last_peered":"2024-04-19T02:15:58.977310+0000","last_clean":"2024-04-19T02:15:58.977310+0000","last_became_active":"2024-04-19T02:15:29.276725+0000","last_became_peered":"2024-04-19T02:15:29.276725+0000","last_unstale":"2024-04-19T02:15:58.977310+0000","last_undegraded":"2024-04-19T02:15:58.977310+0000","last_fullsized":"2024-04-19T02:15:58.977310+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1653932032,"num_objects":25237,"num_object_clones":0,"num_object_copies":50474,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25237,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25237,"num_write_kb":1615168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3308978176,"data_stored":3308978176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25237,"ondisk_log_size":25237,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738378,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1335644,"kb_used_data":1274192,"kb_used_omap":1,"kb_used_meta":61438,"kb_avail":93036196,"statfs":{"total":96636764160,"available":95269064704,"internally_reserved":0,"allocated":1304772608,"data_stored":1304634884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":62912966},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.17299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738379,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1019832,"kb_used_data":962476,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":93352008,"statfs":{"total":96636764160,"available":95592456192,"internally_reserved":0,"allocated":985575424,"data_stored":985411318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.19600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738378,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":841440,"kb_used_data":802136,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":93530400,"statfs":{"total":96636764160,"available":95775129600,"internally_reserved":0,"allocated":821387264,"data_stored":821238433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,0,1,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1039073280,"data_stored":1039073280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":928120832,"data_stored":928120832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1341784064,"data_stored":1341784064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:16:05.038 INFO:tasks.thrashosds.thrasher:Setting 3.1d to [0, 2, 1] 2024-04-19T02:16:05.038 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '3.1d', '0', '2', '1'] 2024-04-19T02:16:05.038 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 3.1d 0 2 1 2024-04-19T02:16:05.039 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 10 16 31794 31778 198.597 180.062 0.0103188 0.00503237 2024-04-19T02:16:05.132 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:05.133+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:05.233 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:05.234+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:05.265 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-04-19T02:16:05.265 INFO:teuthology.orchestra.run.smithi177.stdout: "ops": [], 2024-04-19T02:16:05.265 INFO:teuthology.orchestra.run.smithi177.stdout: "complaint_time": 30, 2024-04-19T02:16:05.265 INFO:teuthology.orchestra.run.smithi177.stdout: "num_blocked_ops": 0 2024-04-19T02:16:05.265 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-04-19T02:16:05.280 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:16:05.334 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:05.334+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:05.435 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:05.435+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:05.438 INFO:teuthology.orchestra.run.smithi121.stderr:Error EINVAL: you must specify pairs of osd ids to be remapped 2024-04-19T02:16:05.441 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-19T02:16:05.442 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2024-04-19T02:16:05.465 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-04-19T02:16:05.465 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 20, 2024-04-19T02:16:05.465 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 600, 2024-04-19T02:16:05.465 INFO:teuthology.orchestra.run.smithi177.stdout: "ops": [ 2024-04-19T02:16:05.465 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.465 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:05.466 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:29.270159+0000", 2024-04-19T02:16:05.466 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 36.193699670000001, 2024-04-19T02:16:05.466 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015837766999999999, 2024-04-19T02:16:05.466 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:05.466 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:05.466 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:05.466 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.466 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:05.466 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270159+0000", 2024-04-19T02:16:05.466 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.466 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.466 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.466 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:05.467 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270159+0000", 2024-04-19T02:16:05.467 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.467 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.467 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.467 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:05.467 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270158+0000", 2024-04-19T02:16:05.467 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:05.467 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.467 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.467 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:05.467 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270171+0000", 2024-04-19T02:16:05.467 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.3050999999999999e-05 2024-04-19T02:16:05.467 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.467 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.468 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:05.468 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270187+0000", 2024-04-19T02:16:05.468 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.6351999999999999e-05 2024-04-19T02:16:05.468 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.468 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.468 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:05.468 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270203+0000", 2024-04-19T02:16:05.468 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.6056e-05 2024-04-19T02:16:05.468 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.468 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.468 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:05.468 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.271261+0000", 2024-04-19T02:16:05.468 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0010576520000000001 2024-04-19T02:16:05.468 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.468 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.469 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:05.469 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.271385+0000", 2024-04-19T02:16:05.469 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012376800000000001 2024-04-19T02:16:05.469 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.469 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.469 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:05.469 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.271539+0000", 2024-04-19T02:16:05.469 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00015414000000000001 2024-04-19T02:16:05.469 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.469 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.469 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:05.469 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.275422+0000", 2024-04-19T02:16:05.469 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.003883507 2024-04-19T02:16:05.469 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.470 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.470 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:05.470 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.285870+0000", 2024-04-19T02:16:05.470 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.010447700000000001 2024-04-19T02:16:05.470 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.470 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.470 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:05.470 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.285947+0000", 2024-04-19T02:16:05.470 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.7429999999999996e-05 2024-04-19T02:16:05.470 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.470 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.470 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:05.470 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.285997+0000", 2024-04-19T02:16:05.470 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.9666999999999997e-05 2024-04-19T02:16:05.471 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.471 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:05.471 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.471 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.471 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.471 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:05.471 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:29.270219+0000", 2024-04-19T02:16:05.471 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 36.193639984000001, 2024-04-19T02:16:05.471 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015932135, 2024-04-19T02:16:05.471 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:05.471 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:05.471 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:05.471 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.471 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:05.471 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270219+0000", 2024-04-19T02:16:05.472 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.472 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.472 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.472 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:05.472 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270219+0000", 2024-04-19T02:16:05.472 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.472 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.472 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.472 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:05.472 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270218+0000", 2024-04-19T02:16:05.472 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:05.472 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.472 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.472 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:05.472 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270223+0000", 2024-04-19T02:16:05.473 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.6090000000000003e-06 2024-04-19T02:16:05.473 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.473 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.473 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:05.473 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270230+0000", 2024-04-19T02:16:05.473 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.9929999999999998e-06 2024-04-19T02:16:05.473 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.473 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.473 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:05.473 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270237+0000", 2024-04-19T02:16:05.473 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.9990000000000002e-06 2024-04-19T02:16:05.473 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.473 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.473 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:05.473 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.272960+0000", 2024-04-19T02:16:05.474 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0027234730000000001 2024-04-19T02:16:05.474 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.474 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.474 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:05.474 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.273062+0000", 2024-04-19T02:16:05.474 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000102043 2024-04-19T02:16:05.474 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.474 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.474 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:05.474 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.273578+0000", 2024-04-19T02:16:05.474 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00051574499999999996 2024-04-19T02:16:05.474 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.474 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.474 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:05.475 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.277063+0000", 2024-04-19T02:16:05.475 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0034846109999999999 2024-04-19T02:16:05.475 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.475 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.475 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:05.475 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286077+0000", 2024-04-19T02:16:05.475 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0090144509999999997 2024-04-19T02:16:05.475 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.475 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.475 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:05.475 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286115+0000", 2024-04-19T02:16:05.475 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.7710999999999999e-05 2024-04-19T02:16:05.475 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.475 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.475 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:05.475 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286151+0000", 2024-04-19T02:16:05.476 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6049e-05 2024-04-19T02:16:05.476 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.476 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:05.476 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.476 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.476 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.476 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(mds.0.3:15 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:05.476 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:29.270244+0000", 2024-04-19T02:16:05.476 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 36.193614797999999, 2024-04-19T02:16:05.476 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015030304, 2024-04-19T02:16:05.476 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:05.476 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:05.476 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:05.476 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.476 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:05.477 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270244+0000", 2024-04-19T02:16:05.477 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.477 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.477 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.477 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:05.477 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270244+0000", 2024-04-19T02:16:05.477 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.477 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.477 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.477 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:05.477 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270244+0000", 2024-04-19T02:16:05.477 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:05.477 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.477 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.477 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:05.478 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270248+0000", 2024-04-19T02:16:05.478 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.2139999999999998e-06 2024-04-19T02:16:05.478 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.478 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.478 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:05.478 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270256+0000", 2024-04-19T02:16:05.478 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.8650000000000001e-06 2024-04-19T02:16:05.478 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.478 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.478 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:05.478 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270265+0000", 2024-04-19T02:16:05.478 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.8210000000000008e-06 2024-04-19T02:16:05.478 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.478 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.478 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:05.479 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.273182+0000", 2024-04-19T02:16:05.479 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0029179420000000002 2024-04-19T02:16:05.479 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.479 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.479 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:05.479 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.273653+0000", 2024-04-19T02:16:05.479 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00047090700000000001 2024-04-19T02:16:05.479 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.479 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.479 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:05.479 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.273818+0000", 2024-04-19T02:16:05.479 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000164382 2024-04-19T02:16:05.479 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.479 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.479 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:05.480 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.278281+0000", 2024-04-19T02:16:05.480 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0044635059999999999 2024-04-19T02:16:05.480 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.480 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.480 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:05.480 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.285194+0000", 2024-04-19T02:16:05.480 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0069127420000000004 2024-04-19T02:16:05.480 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.480 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.480 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:05.480 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.285237+0000", 2024-04-19T02:16:05.480 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.3448000000000001e-05 2024-04-19T02:16:05.480 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.480 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.480 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:05.481 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.285274+0000", 2024-04-19T02:16:05.481 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6921000000000001e-05 2024-04-19T02:16:05.481 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.481 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:05.481 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.481 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.481 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.481 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:05.481 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:29.270271+0000", 2024-04-19T02:16:05.481 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 36.193587827000002, 2024-04-19T02:16:05.481 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015123286999999999, 2024-04-19T02:16:05.481 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:05.481 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:05.481 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:05.482 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.482 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:05.482 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270271+0000", 2024-04-19T02:16:05.482 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.482 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.482 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.482 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:05.482 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270271+0000", 2024-04-19T02:16:05.482 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.482 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.482 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.482 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:05.482 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270271+0000", 2024-04-19T02:16:05.482 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:05.483 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.483 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.483 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:05.483 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270279+0000", 2024-04-19T02:16:05.483 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.2490000000000001e-06 2024-04-19T02:16:05.483 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.483 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.483 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:05.483 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270287+0000", 2024-04-19T02:16:05.483 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.8979999999999996e-06 2024-04-19T02:16:05.483 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.483 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.483 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:05.483 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270299+0000", 2024-04-19T02:16:05.483 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.24e-05 2024-04-19T02:16:05.484 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.484 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.484 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:05.484 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.274674+0000", 2024-04-19T02:16:05.484 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0043751429999999997 2024-04-19T02:16:05.484 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.484 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.484 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:05.484 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.274754+0000", 2024-04-19T02:16:05.484 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.9362000000000004e-05 2024-04-19T02:16:05.484 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.484 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.484 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:05.484 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.274918+0000", 2024-04-19T02:16:05.484 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000164616 2024-04-19T02:16:05.485 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.485 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.485 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:05.485 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.278603+0000", 2024-04-19T02:16:05.485 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0036852370000000001 2024-04-19T02:16:05.485 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.485 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.485 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:05.485 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.285314+0000", 2024-04-19T02:16:05.485 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0067103240000000001 2024-04-19T02:16:05.485 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.485 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.485 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:05.485 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.285357+0000", 2024-04-19T02:16:05.485 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.3288999999999998e-05 2024-04-19T02:16:05.486 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.486 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.486 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:05.486 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.285394+0000", 2024-04-19T02:16:05.486 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.7199000000000001e-05 2024-04-19T02:16:05.486 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.486 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:05.486 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.486 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.486 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.486 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(mds.0.3:16 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:05.486 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:29.270306+0000", 2024-04-19T02:16:05.486 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 36.193552548, 2024-04-19T02:16:05.486 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016306661, 2024-04-19T02:16:05.487 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:05.487 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:05.487 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:05.487 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.487 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:05.487 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270306+0000", 2024-04-19T02:16:05.487 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.487 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.487 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.487 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:05.487 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270306+0000", 2024-04-19T02:16:05.487 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.487 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.487 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.487 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:05.488 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270306+0000", 2024-04-19T02:16:05.488 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:05.488 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.488 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.488 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:05.488 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270310+0000", 2024-04-19T02:16:05.488 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.0990000000000001e-06 2024-04-19T02:16:05.488 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.488 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.488 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:05.488 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270317+0000", 2024-04-19T02:16:05.488 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.7100000000000001e-06 2024-04-19T02:16:05.488 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.488 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.488 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:05.489 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270324+0000", 2024-04-19T02:16:05.489 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.374e-06 2024-04-19T02:16:05.489 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.489 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.489 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:05.489 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.274312+0000", 2024-04-19T02:16:05.489 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0039885140000000003 2024-04-19T02:16:05.489 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.489 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.489 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:05.489 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.274737+0000", 2024-04-19T02:16:05.489 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00042410899999999999 2024-04-19T02:16:05.489 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.489 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.489 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:05.490 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.274893+0000", 2024-04-19T02:16:05.490 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00015594599999999999 2024-04-19T02:16:05.490 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.490 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.490 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:05.490 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.278597+0000", 2024-04-19T02:16:05.490 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0037046869999999999 2024-04-19T02:16:05.490 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.490 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.490 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:05.490 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286522+0000", 2024-04-19T02:16:05.490 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0079243809999999994 2024-04-19T02:16:05.490 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.490 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.490 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:05.491 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286576+0000", 2024-04-19T02:16:05.491 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.4728999999999997e-05 2024-04-19T02:16:05.491 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.491 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.491 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:05.491 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286613+0000", 2024-04-19T02:16:05.491 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6661e-05 2024-04-19T02:16:05.491 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.491 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:05.491 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.491 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.491 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.491 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(mds.0.3:18 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:05.491 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:29.270329+0000", 2024-04-19T02:16:05.491 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 36.193530060999997, 2024-04-19T02:16:05.492 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016172755, 2024-04-19T02:16:05.492 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:05.492 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:05.492 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:05.492 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.492 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:05.492 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270329+0000", 2024-04-19T02:16:05.492 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.492 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.492 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.492 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:05.492 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270329+0000", 2024-04-19T02:16:05.492 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.492 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.492 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.493 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:05.493 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270328+0000", 2024-04-19T02:16:05.493 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:05.493 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.493 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.493 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:05.493 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270331+0000", 2024-04-19T02:16:05.493 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.9629999999999998e-06 2024-04-19T02:16:05.493 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.493 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.493 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:05.493 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270338+0000", 2024-04-19T02:16:05.493 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.1410000000000002e-06 2024-04-19T02:16:05.493 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.494 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.494 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:05.494 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270344+0000", 2024-04-19T02:16:05.494 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.7410000000000003e-06 2024-04-19T02:16:05.494 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.494 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.494 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:05.494 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270418+0000", 2024-04-19T02:16:05.494 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.3598999999999998e-05 2024-04-19T02:16:05.494 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.494 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.494 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:05.494 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270623+0000", 2024-04-19T02:16:05.494 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00020499599999999999 2024-04-19T02:16:05.495 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.495 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.495 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:05.495 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.271086+0000", 2024-04-19T02:16:05.495 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00046345199999999999 2024-04-19T02:16:05.495 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.495 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.495 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:05.495 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.276220+0000", 2024-04-19T02:16:05.495 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0051338490000000002 2024-04-19T02:16:05.495 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.495 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.495 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:05.495 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286426+0000", 2024-04-19T02:16:05.495 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.010205982000000001 2024-04-19T02:16:05.496 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.496 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.496 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:05.496 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286461+0000", 2024-04-19T02:16:05.496 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.5280000000000001e-05 2024-04-19T02:16:05.496 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.496 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.496 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:05.496 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286502+0000", 2024-04-19T02:16:05.496 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.0102000000000003e-05 2024-04-19T02:16:05.496 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.496 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:05.496 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.496 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.497 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.497 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(mds.0.3:23 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:05.497 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:29.270358+0000", 2024-04-19T02:16:05.497 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 36.193501339999997, 2024-04-19T02:16:05.497 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016257511999999998, 2024-04-19T02:16:05.497 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:05.497 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:05.497 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:05.497 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.497 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:05.497 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270358+0000", 2024-04-19T02:16:05.497 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.497 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.497 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.497 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:05.498 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270358+0000", 2024-04-19T02:16:05.498 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.498 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.498 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.498 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:05.498 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270357+0000", 2024-04-19T02:16:05.498 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:05.498 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.498 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.498 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:05.498 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270360+0000", 2024-04-19T02:16:05.498 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.106e-06 2024-04-19T02:16:05.498 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.498 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.499 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:05.499 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270368+0000", 2024-04-19T02:16:05.499 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.6279999999999996e-06 2024-04-19T02:16:05.499 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.499 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.499 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:05.499 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270373+0000", 2024-04-19T02:16:05.499 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.1410000000000004e-06 2024-04-19T02:16:05.499 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.499 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.499 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:05.499 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.271505+0000", 2024-04-19T02:16:05.499 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0011319069999999999 2024-04-19T02:16:05.499 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.500 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.500 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:05.500 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.271652+0000", 2024-04-19T02:16:05.500 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00014698399999999999 2024-04-19T02:16:05.500 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.500 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.500 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:05.500 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286615+0000", 2024-04-19T02:16:05.500 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.014963156999999999 2024-04-19T02:16:05.500 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.500 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:05.500 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.500 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.500 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.501 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(mds.0.3:24 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:05.501 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:29.270411+0000", 2024-04-19T02:16:05.501 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 36.193448347999997, 2024-04-19T02:16:05.501 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016334762999999999, 2024-04-19T02:16:05.501 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:05.501 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:05.501 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:05.501 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.501 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:05.501 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270411+0000", 2024-04-19T02:16:05.501 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.501 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.501 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.501 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:05.502 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270411+0000", 2024-04-19T02:16:05.502 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.502 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.502 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.502 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:05.502 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270410+0000", 2024-04-19T02:16:05.502 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:05.502 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.502 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.502 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:05.502 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270413+0000", 2024-04-19T02:16:05.502 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.303e-06 2024-04-19T02:16:05.502 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.502 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.502 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:05.503 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270421+0000", 2024-04-19T02:16:05.503 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.3769999999999998e-06 2024-04-19T02:16:05.503 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.503 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.503 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:05.503 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270429+0000", 2024-04-19T02:16:05.503 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.6740000000000003e-06 2024-04-19T02:16:05.503 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.503 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.503 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:05.503 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.275527+0000", 2024-04-19T02:16:05.503 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0050975869999999998 2024-04-19T02:16:05.503 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.503 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.504 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:05.504 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.275946+0000", 2024-04-19T02:16:05.504 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00041882699999999998 2024-04-19T02:16:05.504 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.504 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.504 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:05.504 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286745+0000", 2024-04-19T02:16:05.504 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.010799477 2024-04-19T02:16:05.504 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.504 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:05.504 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.504 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.504 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.504 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:630 5.3 5:c9fc5f6a:::benchmark_data_smithi121_44835_object629:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:16:05.504 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:55.207164+0000", 2024-04-19T02:16:05.505 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 10.256694656000001, 2024-04-19T02:16:05.505 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.014098078, 2024-04-19T02:16:05.505 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:05.505 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:05.505 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:05.505 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:05.505 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:05.505 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 630 2024-04-19T02:16:05.505 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.505 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:05.505 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.505 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:05.505 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.207164+0000", 2024-04-19T02:16:05.505 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.505 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.505 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.506 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:05.506 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.207164+0000", 2024-04-19T02:16:05.506 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.506 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.506 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.506 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:05.506 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.207164+0000", 2024-04-19T02:16:05.506 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:05.506 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.506 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.506 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:05.506 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.207248+0000", 2024-04-19T02:16:05.506 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.4414999999999997e-05 2024-04-19T02:16:05.506 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.506 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.507 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:05.507 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.207257+0000", 2024-04-19T02:16:05.507 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.5720000000000003e-06 2024-04-19T02:16:05.507 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.507 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.507 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:05.507 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.207264+0000", 2024-04-19T02:16:05.507 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.1430000000000001e-06 2024-04-19T02:16:05.507 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.507 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.507 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:05.507 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.208420+0000", 2024-04-19T02:16:05.507 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.001155959 2024-04-19T02:16:05.507 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.507 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.507 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:05.508 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.208526+0000", 2024-04-19T02:16:05.508 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000105821 2024-04-19T02:16:05.508 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.508 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.508 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:05.508 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.208624+0000", 2024-04-19T02:16:05.508 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.8218000000000001e-05 2024-04-19T02:16:05.508 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.508 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.508 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:05.508 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.210553+0000", 2024-04-19T02:16:05.508 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.001929046 2024-04-19T02:16:05.508 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.508 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.508 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:05.509 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.221190+0000", 2024-04-19T02:16:05.509 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.010636672 2024-04-19T02:16:05.509 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.509 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.509 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:05.509 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.221233+0000", 2024-04-19T02:16:05.509 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.3185000000000001e-05 2024-04-19T02:16:05.509 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.509 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.509 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:05.509 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.221262+0000", 2024-04-19T02:16:05.509 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.9539e-05 2024-04-19T02:16:05.509 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.509 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:05.509 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.510 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.510 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.510 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:2290 5.5 5:a870a399:::benchmark_data_smithi121_44835_object2289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:16:05.510 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:55.645524+0000", 2024-04-19T02:16:05.510 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 9.8183349979999992, 2024-04-19T02:16:05.510 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.018181836999999999, 2024-04-19T02:16:05.510 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:05.510 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:05.510 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:05.510 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:05.510 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:05.510 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 2290 2024-04-19T02:16:05.510 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.510 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:05.511 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.511 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:05.511 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645524+0000", 2024-04-19T02:16:05.511 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.511 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.511 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.511 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:05.511 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645524+0000", 2024-04-19T02:16:05.511 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.511 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.511 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.511 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:05.511 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645524+0000", 2024-04-19T02:16:05.511 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:05.511 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.512 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.512 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:05.512 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645603+0000", 2024-04-19T02:16:05.512 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.9983999999999999e-05 2024-04-19T02:16:05.512 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.512 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.512 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:05.512 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645609+0000", 2024-04-19T02:16:05.512 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.5500000000000002e-06 2024-04-19T02:16:05.512 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.512 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.512 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:05.512 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645613+0000", 2024-04-19T02:16:05.512 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.591e-06 2024-04-19T02:16:05.512 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.513 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.513 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:05.513 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645649+0000", 2024-04-19T02:16:05.513 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6769e-05 2024-04-19T02:16:05.513 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.513 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.513 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:05.513 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645765+0000", 2024-04-19T02:16:05.513 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00011593499999999999 2024-04-19T02:16:05.513 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.513 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.513 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:05.513 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645899+0000", 2024-04-19T02:16:05.513 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00013329499999999999 2024-04-19T02:16:05.513 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.514 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.514 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:05.514 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.649261+0000", 2024-04-19T02:16:05.514 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0033619639999999998 2024-04-19T02:16:05.514 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.514 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.514 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:05.514 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.663657+0000", 2024-04-19T02:16:05.514 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.014396137999999999 2024-04-19T02:16:05.514 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.514 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.514 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:05.514 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.663686+0000", 2024-04-19T02:16:05.515 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.8841999999999999e-05 2024-04-19T02:16:05.515 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.515 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.515 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:05.515 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.663706+0000", 2024-04-19T02:16:05.515 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.0108000000000001e-05 2024-04-19T02:16:05.515 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.515 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:05.515 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.515 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.515 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.515 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:2296 5.5 5:a5d39efa:::benchmark_data_smithi121_44835_object2295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:16:05.515 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:55.646720+0000", 2024-04-19T02:16:05.515 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 9.8171392040000001, 2024-04-19T02:16:05.515 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.017072077000000001, 2024-04-19T02:16:05.515 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:05.515 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:05.516 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:05.516 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:05.516 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:05.516 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 2296 2024-04-19T02:16:05.516 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.516 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:05.516 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.516 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:05.516 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646720+0000", 2024-04-19T02:16:05.516 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.516 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.516 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.516 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:05.516 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646720+0000", 2024-04-19T02:16:05.516 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.516 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.517 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.517 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:05.517 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646719+0000", 2024-04-19T02:16:05.517 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:05.517 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.517 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.517 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:05.517 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646778+0000", 2024-04-19T02:16:05.517 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.9264e-05 2024-04-19T02:16:05.517 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.517 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.517 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:05.517 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646792+0000", 2024-04-19T02:16:05.517 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.3573e-05 2024-04-19T02:16:05.517 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.518 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.518 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:05.518 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646797+0000", 2024-04-19T02:16:05.518 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.3190000000000002e-06 2024-04-19T02:16:05.518 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.518 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.518 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:05.518 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646826+0000", 2024-04-19T02:16:05.518 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.8787999999999999e-05 2024-04-19T02:16:05.518 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.518 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.518 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:05.518 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646913+0000", 2024-04-19T02:16:05.519 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.7601000000000004e-05 2024-04-19T02:16:05.519 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.519 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.519 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:05.519 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646996+0000", 2024-04-19T02:16:05.519 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.2237000000000006e-05 2024-04-19T02:16:05.519 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.519 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.519 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:05.519 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.649533+0000", 2024-04-19T02:16:05.519 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.002537564 2024-04-19T02:16:05.519 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.519 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.519 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:05.519 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.663741+0000", 2024-04-19T02:16:05.519 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.014207322 2024-04-19T02:16:05.520 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.520 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.520 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:05.520 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.663771+0000", 2024-04-19T02:16:05.520 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.0324e-05 2024-04-19T02:16:05.520 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.520 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.520 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:05.520 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.663792+0000", 2024-04-19T02:16:05.520 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.0778999999999999e-05 2024-04-19T02:16:05.520 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.520 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:05.520 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.520 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.521 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.521 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:2298 5.5 5:a533ec4e:::benchmark_data_smithi121_44835_object2297:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:16:05.521 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:55.649474+0000", 2024-04-19T02:16:05.521 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 9.8143846700000008, 2024-04-19T02:16:05.521 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.014385101000000001, 2024-04-19T02:16:05.521 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:05.521 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:05.521 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:05.521 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:05.521 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:05.521 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 2298 2024-04-19T02:16:05.521 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.521 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:05.521 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.521 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:05.522 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.649474+0000", 2024-04-19T02:16:05.522 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.522 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.522 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.522 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:05.522 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.649474+0000", 2024-04-19T02:16:05.522 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.522 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.522 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.522 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:05.522 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.649474+0000", 2024-04-19T02:16:05.523 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:05.523 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.523 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.523 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:05.523 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.649589+0000", 2024-04-19T02:16:05.523 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000115796 2024-04-19T02:16:05.523 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.523 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.523 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:05.523 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.649598+0000", 2024-04-19T02:16:05.523 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.2660000000000001e-06 2024-04-19T02:16:05.523 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.523 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.523 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:05.524 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.649604+0000", 2024-04-19T02:16:05.524 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.1670000000000004e-06 2024-04-19T02:16:05.524 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.524 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.524 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:05.524 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.649629+0000", 2024-04-19T02:16:05.524 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.4808999999999999e-05 2024-04-19T02:16:05.524 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.524 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.524 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:05.524 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.649723+0000", 2024-04-19T02:16:05.524 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.4114e-05 2024-04-19T02:16:05.524 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.524 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.525 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:05.525 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.649809+0000", 2024-04-19T02:16:05.525 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.6463000000000002e-05 2024-04-19T02:16:05.525 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.525 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.525 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:05.525 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.653093+0000", 2024-04-19T02:16:05.525 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0032834100000000001 2024-04-19T02:16:05.525 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.525 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.525 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:05.525 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.663814+0000", 2024-04-19T02:16:05.525 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.010721212000000001 2024-04-19T02:16:05.525 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.525 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.525 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:05.526 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.663837+0000", 2024-04-19T02:16:05.526 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.3587999999999998e-05 2024-04-19T02:16:05.526 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.526 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.526 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:05.526 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.663859+0000", 2024-04-19T02:16:05.526 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.1869999999999999e-05 2024-04-19T02:16:05.526 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.526 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:05.526 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.526 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.526 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.526 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:16497 5.c 5:3cb287d4:::benchmark_data_smithi121_44835_object16496:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:05.526 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:59.873454+0000", 2024-04-19T02:16:05.526 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 5.5904052550000003, 2024-04-19T02:16:05.527 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.017103489999999999, 2024-04-19T02:16:05.527 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:05.527 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:05.527 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:05.527 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:05.527 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:05.527 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 16497 2024-04-19T02:16:05.527 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.527 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:05.527 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.527 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:05.527 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873454+0000", 2024-04-19T02:16:05.527 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.527 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.527 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.528 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:05.528 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873454+0000", 2024-04-19T02:16:05.528 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.528 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.528 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.528 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:05.528 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873453+0000", 2024-04-19T02:16:05.528 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:05.528 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.528 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.528 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:05.528 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873512+0000", 2024-04-19T02:16:05.528 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.8730999999999997e-05 2024-04-19T02:16:05.528 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.528 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.529 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:05.529 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873518+0000", 2024-04-19T02:16:05.529 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.9789999999999998e-06 2024-04-19T02:16:05.529 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.529 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.529 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:05.529 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873522+0000", 2024-04-19T02:16:05.529 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.0570000000000003e-06 2024-04-19T02:16:05.529 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.529 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.529 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:05.529 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873590+0000", 2024-04-19T02:16:05.529 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.8504999999999995e-05 2024-04-19T02:16:05.529 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.529 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.529 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:05.530 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873709+0000", 2024-04-19T02:16:05.530 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000118497 2024-04-19T02:16:05.530 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.530 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.530 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:05.530 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873881+0000", 2024-04-19T02:16:05.530 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000172129 2024-04-19T02:16:05.530 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.530 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.530 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:05.530 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.874627+0000", 2024-04-19T02:16:05.530 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00074580100000000004 2024-04-19T02:16:05.530 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.530 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.531 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:05.531 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.890478+0000", 2024-04-19T02:16:05.531 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015850672 2024-04-19T02:16:05.531 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.531 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.531 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:05.531 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.890522+0000", 2024-04-19T02:16:05.531 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.4376000000000003e-05 2024-04-19T02:16:05.531 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.531 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.531 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:05.531 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.890557+0000", 2024-04-19T02:16:05.531 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.5151999999999998e-05 2024-04-19T02:16:05.531 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.531 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:05.531 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.532 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.532 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.532 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:18635 5.c 5:3691d6fb:::benchmark_data_smithi121_44835_object18634:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:05.532 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:00.547499+0000", 2024-04-19T02:16:05.532 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4.9163600330000001, 2024-04-19T02:16:05.532 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015584394, 2024-04-19T02:16:05.532 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:05.532 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:05.532 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:05.532 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:05.532 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:05.532 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 18635 2024-04-19T02:16:05.532 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.532 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:05.532 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.532 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:05.533 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.547499+0000", 2024-04-19T02:16:05.533 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.533 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.533 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.533 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:05.533 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.547499+0000", 2024-04-19T02:16:05.533 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.533 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.533 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.533 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:05.533 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.547499+0000", 2024-04-19T02:16:05.533 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:05.533 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.533 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.533 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:05.534 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.547592+0000", 2024-04-19T02:16:05.534 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.3144000000000001e-05 2024-04-19T02:16:05.534 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.534 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.534 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:05.534 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.547598+0000", 2024-04-19T02:16:05.534 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.0390000000000001e-06 2024-04-19T02:16:05.534 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.534 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.534 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:05.534 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.547601+0000", 2024-04-19T02:16:05.534 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.5389999999999999e-06 2024-04-19T02:16:05.534 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.534 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.535 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:05.535 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.548268+0000", 2024-04-19T02:16:05.535 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00066695700000000003 2024-04-19T02:16:05.535 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.535 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.535 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:05.535 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.548384+0000", 2024-04-19T02:16:05.535 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000115562 2024-04-19T02:16:05.535 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.535 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.535 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:05.535 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.548510+0000", 2024-04-19T02:16:05.535 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012620900000000001 2024-04-19T02:16:05.535 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.535 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.536 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:05.536 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.549792+0000", 2024-04-19T02:16:05.536 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00128213 2024-04-19T02:16:05.536 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.536 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.536 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:05.536 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.563011+0000", 2024-04-19T02:16:05.536 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.013219244 2024-04-19T02:16:05.536 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.536 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.536 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:05.536 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.563050+0000", 2024-04-19T02:16:05.536 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.8448999999999997e-05 2024-04-19T02:16:05.536 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.536 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.536 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:05.537 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.563083+0000", 2024-04-19T02:16:05.537 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.3402000000000003e-05 2024-04-19T02:16:05.537 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.537 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:05.537 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.537 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.537 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.537 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:18796 5.3 5:cca224f1:::benchmark_data_smithi121_44835_object18795:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:05.537 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:00.596456+0000", 2024-04-19T02:16:05.537 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4.8674029690000005, 2024-04-19T02:16:05.537 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015251391, 2024-04-19T02:16:05.537 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:05.537 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:05.537 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:05.538 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:05.538 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:05.538 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 18796 2024-04-19T02:16:05.538 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.538 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:05.538 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.538 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:05.538 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.596456+0000", 2024-04-19T02:16:05.538 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.538 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.538 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.538 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:05.538 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.596456+0000", 2024-04-19T02:16:05.538 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.539 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.539 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.539 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:05.539 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.596455+0000", 2024-04-19T02:16:05.539 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:05.539 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.539 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.539 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:05.539 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.596531+0000", 2024-04-19T02:16:05.539 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.5585000000000002e-05 2024-04-19T02:16:05.539 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.539 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.539 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:05.539 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.596540+0000", 2024-04-19T02:16:05.539 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.5820000000000008e-06 2024-04-19T02:16:05.540 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.540 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.540 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:05.540 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.596548+0000", 2024-04-19T02:16:05.540 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.3869999999999997e-06 2024-04-19T02:16:05.540 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.540 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.540 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:05.540 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.599086+0000", 2024-04-19T02:16:05.540 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.002538135 2024-04-19T02:16:05.540 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.540 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.540 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:05.540 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.599202+0000", 2024-04-19T02:16:05.540 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000115605 2024-04-19T02:16:05.541 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.541 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.541 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:05.541 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.599326+0000", 2024-04-19T02:16:05.541 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012427900000000001 2024-04-19T02:16:05.541 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.541 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.541 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:05.541 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.602295+0000", 2024-04-19T02:16:05.541 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0029694719999999999 2024-04-19T02:16:05.541 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.541 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.541 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:05.541 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.611625+0000", 2024-04-19T02:16:05.541 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0093301180000000001 2024-04-19T02:16:05.541 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.542 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.542 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:05.542 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.611670+0000", 2024-04-19T02:16:05.542 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.4366999999999997e-05 2024-04-19T02:16:05.542 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.542 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.542 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:05.542 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.611707+0000", 2024-04-19T02:16:05.542 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.7518999999999998e-05 2024-04-19T02:16:05.542 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.542 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:05.542 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.542 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.543 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.543 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:18947 5.c 5:37ebacf7:::benchmark_data_smithi121_44835_object18946:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:05.543 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:00.644594+0000", 2024-04-19T02:16:05.543 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4.8192646430000003, 2024-04-19T02:16:05.543 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.013756665, 2024-04-19T02:16:05.543 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:05.543 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:05.543 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:05.543 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:05.543 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:05.543 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 18947 2024-04-19T02:16:05.543 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.543 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:05.543 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.544 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:05.544 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.644594+0000", 2024-04-19T02:16:05.544 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.544 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.544 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.544 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:05.544 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.644594+0000", 2024-04-19T02:16:05.544 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.544 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.544 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.544 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:05.544 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.644593+0000", 2024-04-19T02:16:05.544 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:05.544 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.544 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.545 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:05.545 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.644712+0000", 2024-04-19T02:16:05.545 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00011828999999999999 2024-04-19T02:16:05.545 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.545 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.545 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:05.545 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.644723+0000", 2024-04-19T02:16:05.545 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.1099e-05 2024-04-19T02:16:05.545 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.545 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.545 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:05.545 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.644730+0000", 2024-04-19T02:16:05.545 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.0380000000000002e-06 2024-04-19T02:16:05.545 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.545 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.546 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:05.546 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.647756+0000", 2024-04-19T02:16:05.546 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0030264799999999998 2024-04-19T02:16:05.546 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.546 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.546 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:05.546 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.647834+0000", 2024-04-19T02:16:05.546 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.7700999999999993e-05 2024-04-19T02:16:05.546 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.546 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.546 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:05.546 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.647927+0000", 2024-04-19T02:16:05.546 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.3165000000000007e-05 2024-04-19T02:16:05.546 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.547 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.547 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:05.547 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.649508+0000", 2024-04-19T02:16:05.547 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.001580573 2024-04-19T02:16:05.547 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.547 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.547 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:05.547 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.658272+0000", 2024-04-19T02:16:05.547 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0087641899999999998 2024-04-19T02:16:05.547 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.547 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.547 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:05.547 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.658315+0000", 2024-04-19T02:16:05.547 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.3123e-05 2024-04-19T02:16:05.547 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.548 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.548 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:05.548 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.658351+0000", 2024-04-19T02:16:05.548 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.5824000000000001e-05 2024-04-19T02:16:05.548 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.548 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:05.548 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.548 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.548 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.548 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:19164 5.c 5:3be9e189:::benchmark_data_smithi121_44835_object19163:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:05.548 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:00.711074+0000", 2024-04-19T02:16:05.548 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4.7527850469999997, 2024-04-19T02:16:05.548 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.013577385000000001, 2024-04-19T02:16:05.548 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:05.548 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:05.549 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:05.549 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:05.549 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:05.549 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 19164 2024-04-19T02:16:05.549 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.549 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:05.549 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.549 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:05.549 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.711074+0000", 2024-04-19T02:16:05.549 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.549 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.549 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.549 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:05.549 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.711074+0000", 2024-04-19T02:16:05.549 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.550 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.550 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.550 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:05.550 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.711073+0000", 2024-04-19T02:16:05.550 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:05.550 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.550 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.550 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:05.550 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.711153+0000", 2024-04-19T02:16:05.550 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.9932999999999995e-05 2024-04-19T02:16:05.550 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.550 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.550 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:05.551 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.711161+0000", 2024-04-19T02:16:05.551 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.2090000000000005e-06 2024-04-19T02:16:05.551 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.551 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.551 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:05.551 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.711170+0000", 2024-04-19T02:16:05.551 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.8789999999999992e-06 2024-04-19T02:16:05.551 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.551 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.551 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:05.551 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.711230+0000", 2024-04-19T02:16:05.551 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.9963999999999997e-05 2024-04-19T02:16:05.551 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.551 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.551 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:05.552 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.711304+0000", 2024-04-19T02:16:05.552 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.4134000000000005e-05 2024-04-19T02:16:05.552 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.552 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.552 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:05.552 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.711380+0000", 2024-04-19T02:16:05.552 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.6012000000000003e-05 2024-04-19T02:16:05.552 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.552 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.552 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:05.552 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.715993+0000", 2024-04-19T02:16:05.552 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0046132990000000004 2024-04-19T02:16:05.552 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.552 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.553 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:05.553 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.724582+0000", 2024-04-19T02:16:05.553 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0085888370000000002 2024-04-19T02:16:05.553 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.553 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.553 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:05.553 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.724626+0000", 2024-04-19T02:16:05.553 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.3964000000000001e-05 2024-04-19T02:16:05.553 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.553 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.553 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:05.553 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.724651+0000", 2024-04-19T02:16:05.553 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.4890000000000001e-05 2024-04-19T02:16:05.553 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.554 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:05.554 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.554 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.554 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.554 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:19998 5.3 5:c6c2fea7:::benchmark_data_smithi121_44835_object19997:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:05.554 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:00.985607+0000", 2024-04-19T02:16:05.554 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4.4782514229999997, 2024-04-19T02:16:05.554 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.014005625000000001, 2024-04-19T02:16:05.554 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:05.554 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:05.554 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:05.554 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:05.554 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:05.554 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 19998 2024-04-19T02:16:05.555 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.555 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:05.555 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.555 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:05.555 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.985607+0000", 2024-04-19T02:16:05.555 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.555 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.555 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.555 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:05.555 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.985607+0000", 2024-04-19T02:16:05.555 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.555 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.555 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.555 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:05.556 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.985607+0000", 2024-04-19T02:16:05.556 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:05.556 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.556 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.556 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:05.556 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.985755+0000", 2024-04-19T02:16:05.556 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000148076 2024-04-19T02:16:05.556 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.556 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.556 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:05.556 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.985764+0000", 2024-04-19T02:16:05.556 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.3789999999999995e-06 2024-04-19T02:16:05.556 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.556 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.556 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:05.557 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.985770+0000", 2024-04-19T02:16:05.557 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.0499999999999997e-06 2024-04-19T02:16:05.557 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.557 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.557 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:05.557 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.987212+0000", 2024-04-19T02:16:05.557 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0014413259999999999 2024-04-19T02:16:05.557 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.557 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.557 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:05.557 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.987336+0000", 2024-04-19T02:16:05.557 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012401900000000001 2024-04-19T02:16:05.557 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.557 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.557 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:05.558 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.987474+0000", 2024-04-19T02:16:05.558 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000138431 2024-04-19T02:16:05.558 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.558 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.558 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:05.558 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.989723+0000", 2024-04-19T02:16:05.558 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0022492570000000002 2024-04-19T02:16:05.558 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.558 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.558 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:05.558 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.999533+0000", 2024-04-19T02:16:05.558 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0098098999999999999 2024-04-19T02:16:05.558 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.559 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.559 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:05.559 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.999578+0000", 2024-04-19T02:16:05.559 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.4424e-05 2024-04-19T02:16:05.559 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.559 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.559 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:05.559 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.999613+0000", 2024-04-19T02:16:05.559 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.5231999999999997e-05 2024-04-19T02:16:05.559 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.559 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:05.559 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.559 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.559 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.559 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:20553 5.5 5:a3f892a2:::benchmark_data_smithi121_44835_object20552:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:05.560 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:01.179670+0000", 2024-04-19T02:16:05.560 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4.2841883740000002, 2024-04-19T02:16:05.560 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.01588498, 2024-04-19T02:16:05.560 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:05.560 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:05.560 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:05.560 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:05.560 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:05.560 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 20553 2024-04-19T02:16:05.560 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.560 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:05.560 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.560 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:05.560 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.179670+0000", 2024-04-19T02:16:05.560 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.560 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.561 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.561 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:05.561 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.179670+0000", 2024-04-19T02:16:05.561 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.561 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.561 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.561 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:05.561 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.179670+0000", 2024-04-19T02:16:05.561 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:05.561 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.561 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.561 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:05.561 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.179698+0000", 2024-04-19T02:16:05.561 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.7849999999999999e-05 2024-04-19T02:16:05.561 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.562 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.562 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:05.562 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.179710+0000", 2024-04-19T02:16:05.562 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.1992e-05 2024-04-19T02:16:05.562 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.562 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.562 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:05.562 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.179717+0000", 2024-04-19T02:16:05.562 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.7400000000000004e-06 2024-04-19T02:16:05.562 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.562 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.562 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:05.562 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.179760+0000", 2024-04-19T02:16:05.562 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.2169999999999998e-05 2024-04-19T02:16:05.563 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.563 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.563 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:05.563 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.179876+0000", 2024-04-19T02:16:05.563 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000116972 2024-04-19T02:16:05.563 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.563 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.563 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:05.563 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.180055+0000", 2024-04-19T02:16:05.563 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00017899100000000001 2024-04-19T02:16:05.563 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.563 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.563 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:05.563 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.183338+0000", 2024-04-19T02:16:05.564 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0032824719999999998 2024-04-19T02:16:05.564 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.564 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.564 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:05.564 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.195464+0000", 2024-04-19T02:16:05.564 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.012126504999999999 2024-04-19T02:16:05.564 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.564 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.564 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:05.564 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.195516+0000", 2024-04-19T02:16:05.564 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.1622000000000001e-05 2024-04-19T02:16:05.564 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.564 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.564 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:05.565 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.195555+0000", 2024-04-19T02:16:05.565 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.9366999999999998e-05 2024-04-19T02:16:05.565 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.565 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:05.565 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.565 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.565 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.565 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:20997 5.6 5:68aa1358:::benchmark_data_smithi121_44835_object20996:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:05.565 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:01.334236+0000", 2024-04-19T02:16:05.565 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4.1296229899999997, 2024-04-19T02:16:05.565 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.014634767, 2024-04-19T02:16:05.565 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:05.565 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:05.565 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:05.565 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:05.566 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:05.566 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 20997 2024-04-19T02:16:05.566 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.566 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:05.566 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.566 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:05.566 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.334236+0000", 2024-04-19T02:16:05.566 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.566 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.566 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.566 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:05.566 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.334236+0000", 2024-04-19T02:16:05.566 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:05.567 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.567 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.567 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:05.567 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.334235+0000", 2024-04-19T02:16:05.567 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:05.567 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.567 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.567 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:05.567 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.334313+0000", 2024-04-19T02:16:05.567 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.7305999999999995e-05 2024-04-19T02:16:05.567 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.567 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.567 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:05.567 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.334322+0000", 2024-04-19T02:16:05.567 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.0040000000000005e-06 2024-04-19T02:16:05.568 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.568 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.568 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:05.568 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.334327+0000", 2024-04-19T02:16:05.568 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.6670000000000001e-06 2024-04-19T02:16:05.568 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.568 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.568 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:05.568 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.334358+0000", 2024-04-19T02:16:05.568 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.0368000000000001e-05 2024-04-19T02:16:05.568 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.568 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.568 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:05.568 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.334436+0000", 2024-04-19T02:16:05.569 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.8788000000000005e-05 2024-04-19T02:16:05.569 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.569 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.569 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:05.569 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.334515+0000", 2024-04-19T02:16:05.569 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.8632000000000002e-05 2024-04-19T02:16:05.569 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.569 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.569 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:05.569 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.337171+0000", 2024-04-19T02:16:05.569 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0026560989999999999 2024-04-19T02:16:05.569 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.569 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.569 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:05.569 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.348786+0000", 2024-04-19T02:16:05.570 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.011614585 2024-04-19T02:16:05.570 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.570 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.570 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:05.570 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.348832+0000", 2024-04-19T02:16:05.570 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.6007000000000002e-05 2024-04-19T02:16:05.570 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:05.570 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:05.570 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:05.570 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.348871+0000", 2024-04-19T02:16:05.570 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.8958999999999997e-05 2024-04-19T02:16:05.570 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.571 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:05.571 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.571 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:05.571 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:05.571 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-04-19T02:16:05.572 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:16:05.573 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:05.573+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:05.673 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:05.673+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:05.754 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:16:05.754 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:16:05.754 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.755 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4549.0:33846 5.6 e22/16 5:6bfac6fc:::benchmark_data_smithi121_44835_object33845:head v 22'2096, mlcod=22'2094)", 2024-04-19T02:16:05.755 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:05.753471+0000", 2024-04-19T02:16:05.755 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0012354009999999999, 2024-04-19T02:16:05.755 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001252242, 2024-04-19T02:16:05.755 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:05.755 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:16:05.755 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:05.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.755 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:05.755 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.753471+0000", 2024-04-19T02:16:05.755 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:05.755 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.755 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:05.756 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.753471+0000", 2024-04-19T02:16:05.756 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:05.756 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.756 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.756 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:05.756 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.753470+0000", 2024-04-19T02:16:05.756 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:05.756 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.756 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.756 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:05.756 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.753588+0000", 2024-04-19T02:16:05.756 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011787599999999999 2024-04-19T02:16:05.756 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.756 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.756 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:05.757 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.753602+0000", 2024-04-19T02:16:05.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4316e-05 2024-04-19T02:16:05.757 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.757 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.757 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:05.757 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.753609+0000", 2024-04-19T02:16:05.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3040000000000001e-06 2024-04-19T02:16:05.757 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.757 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.757 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:05.757 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.753650+0000", 2024-04-19T02:16:05.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1516e-05 2024-04-19T02:16:05.757 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.757 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.757 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:05.758 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.753670+0000", 2024-04-19T02:16:05.758 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9712999999999999e-05 2024-04-19T02:16:05.758 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:05.758 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:05.758 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:05.758 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.758 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.758 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:33847 5.d 5:bc541eb7:::benchmark_data_smithi121_44835_object33846:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-19T02:16:05.758 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:05.753464+0000", 2024-04-19T02:16:05.758 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0012420389999999999, 2024-04-19T02:16:05.758 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013030979999999999, 2024-04-19T02:16:05.758 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:05.758 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:05.758 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:05.759 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:05.759 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:05.759 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 33847 2024-04-19T02:16:05.759 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.759 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:05.759 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.759 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:05.759 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.753464+0000", 2024-04-19T02:16:05.759 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:05.759 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.759 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.759 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:05.759 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.753464+0000", 2024-04-19T02:16:05.759 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:05.760 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.760 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.760 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:05.760 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.753463+0000", 2024-04-19T02:16:05.760 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:05.760 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.760 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.760 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:05.760 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.753593+0000", 2024-04-19T02:16:05.760 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012948300000000001 2024-04-19T02:16:05.760 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.760 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.760 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:05.760 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.753604+0000", 2024-04-19T02:16:05.760 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1737e-05 2024-04-19T02:16:05.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.761 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.761 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:05.761 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.753613+0000", 2024-04-19T02:16:05.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2930000000000001e-06 2024-04-19T02:16:05.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.761 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.761 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:05.761 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.753672+0000", 2024-04-19T02:16:05.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9327000000000003e-05 2024-04-19T02:16:05.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.761 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.761 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:05.761 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.753769+0000", 2024-04-19T02:16:05.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7487999999999999e-05 2024-04-19T02:16:05.762 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.762 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:05.762 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.753848+0000", 2024-04-19T02:16:05.762 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8232000000000006e-05 2024-04-19T02:16:05.762 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:05.762 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:05.762 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:05.762 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.762 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4549.0:33848 5.c e22/16 5:315468ca:::benchmark_data_smithi121_44835_object33847:head v 22'2100, mlcod=22'2098)", 2024-04-19T02:16:05.762 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:05.754012+0000", 2024-04-19T02:16:05.762 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00069345799999999999, 2024-04-19T02:16:05.762 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00079945099999999996, 2024-04-19T02:16:05.763 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:05.763 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:16:05.763 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:05.763 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.763 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:05.763 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.754012+0000", 2024-04-19T02:16:05.763 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:05.763 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.763 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.763 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:05.763 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.754012+0000", 2024-04-19T02:16:05.763 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:05.763 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.763 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.764 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:05.764 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.754012+0000", 2024-04-19T02:16:05.764 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:05.764 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.764 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.764 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:05.764 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.754072+0000", 2024-04-19T02:16:05.764 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0548999999999999e-05 2024-04-19T02:16:05.764 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.764 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.764 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:05.764 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.754082+0000", 2024-04-19T02:16:05.764 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0939999999999997e-06 2024-04-19T02:16:05.764 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.764 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.765 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:05.765 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.754087+0000", 2024-04-19T02:16:05.765 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1660000000000002e-06 2024-04-19T02:16:05.765 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.765 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.765 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:05.765 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.754126+0000", 2024-04-19T02:16:05.765 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9209999999999999e-05 2024-04-19T02:16:05.765 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.765 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.765 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:05.765 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.754145+0000", 2024-04-19T02:16:05.765 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8955000000000001e-05 2024-04-19T02:16:05.765 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:05.765 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:05.766 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:05.766 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.766 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:33822 5.f 5:fab003c8:::benchmark_data_smithi121_44835_object33821:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-19T02:16:05.766 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:05.746734+0000", 2024-04-19T02:16:05.766 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0079715129999999995, 2024-04-19T02:16:05.766 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0081148680000000008, 2024-04-19T02:16:05.766 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:05.766 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:05.766 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:05.766 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:05.766 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:05.766 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 33822 2024-04-19T02:16:05.766 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.767 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:05.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.767 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:05.767 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.746734+0000", 2024-04-19T02:16:05.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:05.767 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.767 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:05.767 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.746734+0000", 2024-04-19T02:16:05.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:05.767 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.767 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:05.767 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.746734+0000", 2024-04-19T02:16:05.768 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:05.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.768 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.768 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:05.768 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.746847+0000", 2024-04-19T02:16:05.768 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000113137 2024-04-19T02:16:05.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.768 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.768 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:05.768 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.746859+0000", 2024-04-19T02:16:05.768 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2153e-05 2024-04-19T02:16:05.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.768 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.768 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:05.768 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.746866+0000", 2024-04-19T02:16:05.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.289e-06 2024-04-19T02:16:05.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.769 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:05.769 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.746893+0000", 2024-04-19T02:16:05.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6502000000000001e-05 2024-04-19T02:16:05.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.769 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:05.769 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.746974+0000", 2024-04-19T02:16:05.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1062000000000004e-05 2024-04-19T02:16:05.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.769 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:05.769 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.747073+0000", 2024-04-19T02:16:05.770 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9408999999999996e-05 2024-04-19T02:16:05.770 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.770 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.770 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:05.770 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.749828+0000", 2024-04-19T02:16:05.770 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027552620000000001 2024-04-19T02:16:05.770 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:05.770 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:05.770 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:05.770 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.770 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.770 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:33825 5.f 5:f1854a11:::benchmark_data_smithi121_44835_object33824:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-19T02:16:05.770 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:05.747410+0000", 2024-04-19T02:16:05.770 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0072962729999999998, 2024-04-19T02:16:05.771 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074885170000000001, 2024-04-19T02:16:05.771 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:05.771 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:05.771 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:05.771 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:05.771 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:05.771 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 33825 2024-04-19T02:16:05.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.771 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:05.771 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.771 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:05.771 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.747410+0000", 2024-04-19T02:16:05.771 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:05.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.771 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.771 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:05.772 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.747410+0000", 2024-04-19T02:16:05.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:05.772 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.772 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:05.772 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.747409+0000", 2024-04-19T02:16:05.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:05.772 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.772 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:05.772 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.747561+0000", 2024-04-19T02:16:05.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015221899999999999 2024-04-19T02:16:05.772 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.772 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:05.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.747575+0000", 2024-04-19T02:16:05.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4048e-05 2024-04-19T02:16:05.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:05.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.747588+0000", 2024-04-19T02:16:05.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3281999999999999e-05 2024-04-19T02:16:05.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:05.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.748256+0000", 2024-04-19T02:16:05.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00066759000000000002 2024-04-19T02:16:05.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:05.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.748368+0000", 2024-04-19T02:16:05.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000111836 2024-04-19T02:16:05.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:05.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.748497+0000", 2024-04-19T02:16:05.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000128777 2024-04-19T02:16:05.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:05.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.752376+0000", 2024-04-19T02:16:05.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038793399999999998 2024-04-19T02:16:05.774 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:05.774 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:05.774 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:05.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.775 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:33834 5.f 5:f10a06ca:::benchmark_data_smithi121_44835_object33833:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-19T02:16:05.775 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:05.750456+0000", 2024-04-19T02:16:05.775 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0042500530000000002, 2024-04-19T02:16:05.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00450228, 2024-04-19T02:16:05.775 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:05.775 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:05.775 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:05.775 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:05.775 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:05.775 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 33834 2024-04-19T02:16:05.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.775 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:05.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.776 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:05.776 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.750456+0000", 2024-04-19T02:16:05.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:05.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.776 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:05.776 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.750456+0000", 2024-04-19T02:16:05.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:05.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.776 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:05.776 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.750455+0000", 2024-04-19T02:16:05.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:05.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.777 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:05.777 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.750562+0000", 2024-04-19T02:16:05.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000106371 2024-04-19T02:16:05.777 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.777 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.777 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:05.777 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.750570+0000", 2024-04-19T02:16:05.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5699999999999993e-06 2024-04-19T02:16:05.777 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.777 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.777 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:05.777 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.750578+0000", 2024-04-19T02:16:05.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8080000000000005e-06 2024-04-19T02:16:05.777 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.777 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:05.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.750629+0000", 2024-04-19T02:16:05.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0726999999999997e-05 2024-04-19T02:16:05.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:05.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.750751+0000", 2024-04-19T02:16:05.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012225699999999999 2024-04-19T02:16:05.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:05.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.750887+0000", 2024-04-19T02:16:05.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013606100000000001 2024-04-19T02:16:05.778 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:05.778 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:05.779 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:05.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.779 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:33840 5.7 5:e5e9da07:::benchmark_data_smithi121_44835_object33839:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-19T02:16:05.779 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:05.751595+0000", 2024-04-19T02:16:05.779 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0031109940000000002, 2024-04-19T02:16:05.779 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0034446339999999998, 2024-04-19T02:16:05.779 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:05.779 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:05.779 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:05.779 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:05.779 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:05.779 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 33840 2024-04-19T02:16:05.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.779 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:05.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.780 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:05.780 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.751595+0000", 2024-04-19T02:16:05.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:05.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.780 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:05.780 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.751595+0000", 2024-04-19T02:16:05.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:05.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.780 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:05.780 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.751594+0000", 2024-04-19T02:16:05.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:05.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.781 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:05.781 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.751692+0000", 2024-04-19T02:16:05.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7924000000000006e-05 2024-04-19T02:16:05.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.781 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:05.781 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.751705+0000", 2024-04-19T02:16:05.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3286e-05 2024-04-19T02:16:05.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.781 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:05.781 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.751717+0000", 2024-04-19T02:16:05.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1426e-05 2024-04-19T02:16:05.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.782 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.782 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:05.782 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.752354+0000", 2024-04-19T02:16:05.782 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00063742300000000003 2024-04-19T02:16:05.782 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.782 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.782 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:05.782 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.752478+0000", 2024-04-19T02:16:05.782 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012371300000000001 2024-04-19T02:16:05.782 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.782 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.782 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:05.782 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.752614+0000", 2024-04-19T02:16:05.782 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013635899999999999 2024-04-19T02:16:05.783 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:05.783 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:05.783 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:05.783 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.783 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.783 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:33841 5.7 5.50eeb9b7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-19T02:16:05.783 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:05.751842+0000", 2024-04-19T02:16:05.783 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0028637580000000001, 2024-04-19T02:16:05.783 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032805320000000001, 2024-04-19T02:16:05.783 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:05.783 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-04-19T02:16:05.783 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:05.783 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:05.783 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:05.783 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 33841 2024-04-19T02:16:05.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.784 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:05.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.784 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:05.784 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.751842+0000", 2024-04-19T02:16:05.784 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:05.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.784 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:05.784 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.751842+0000", 2024-04-19T02:16:05.784 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:05.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.784 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:05.784 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.751841+0000", 2024-04-19T02:16:05.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:05.785 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.785 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.785 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:05.785 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.751900+0000", 2024-04-19T02:16:05.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8649e-05 2024-04-19T02:16:05.785 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.785 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.785 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:05.785 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.751911+0000", 2024-04-19T02:16:05.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1474000000000001e-05 2024-04-19T02:16:05.785 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.785 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.785 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:05.785 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.751920+0000", 2024-04-19T02:16:05.786 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2609999999999993e-06 2024-04-19T02:16:05.786 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:05.786 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:05.786 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:05.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.786 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:33845 5.9 5:91c8850b:::benchmark_data_smithi121_44835_object33844:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-19T02:16:05.786 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:05.752919+0000", 2024-04-19T02:16:05.786 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.001786482, 2024-04-19T02:16:05.786 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022459519999999998, 2024-04-19T02:16:05.786 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:05.786 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:05.786 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:05.786 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:05.786 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:05.787 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 33845 2024-04-19T02:16:05.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.787 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:05.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:05.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.752919+0000", 2024-04-19T02:16:05.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:05.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:05.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.752919+0000", 2024-04-19T02:16:05.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:05.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:05.788 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.752918+0000", 2024-04-19T02:16:05.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:05.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.788 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:05.788 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.753057+0000", 2024-04-19T02:16:05.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000138481 2024-04-19T02:16:05.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.788 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:05.788 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.753070+0000", 2024-04-19T02:16:05.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3246e-05 2024-04-19T02:16:05.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.788 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:05.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.753078+0000", 2024-04-19T02:16:05.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0050000000000004e-06 2024-04-19T02:16:05.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:05.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.753110+0000", 2024-04-19T02:16:05.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1962999999999999e-05 2024-04-19T02:16:05.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:05.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.753190+0000", 2024-04-19T02:16:05.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9940999999999999e-05 2024-04-19T02:16:05.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:05.790 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.753269+0000", 2024-04-19T02:16:05.790 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9157000000000001e-05 2024-04-19T02:16:05.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:05.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:05.790 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:05.790 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:05.755103+0000", 2024-04-19T02:16:05.790 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0018343840000000001 2024-04-19T02:16:05.790 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:05.790 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:05.790 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:05.790 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:05.790 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-04-19T02:16:05.790 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 9 2024-04-19T02:16:05.790 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:16:05.794 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:05.794+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:05.795 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:16:05.823 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:16:05.895 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:05.896+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:05.971 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:16:05.973 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:05.973 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:05.987 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:16:05.993 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:16:05.996 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:05.996+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:06.014 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2: {} 2024-04-19T02:16:06.015 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:16:06.016 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:16:06.016 INFO:teuthology.orchestra.run.smithi121.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:16:06.025 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 11 16 34595 34579 196.457 175.062 0.00900488 0.00508678 2024-04-19T02:16:06.096 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:06.097+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:06.198 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:06.198+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:06.208 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:06.208 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:06.224 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:16:06.299 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:06.299+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:06.391 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:06.392 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:06.400 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:06.400+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:06.407 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:16:06.501 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:06.501+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:06.595 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:06.595 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:06.601 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:06.602+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:06.608 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:16:06.702 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:06.702+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:06.775 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:06.775 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:06.790 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:16:06.831 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:06.831+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:06.904 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:06.904+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:06.947 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:06.947 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:06.963 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:16:07.004 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:07.004+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:07.026 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 12 16 36982 36966 192.516 149.188 0.00390736 0.00518944 2024-04-19T02:16:07.040 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T02:16:07.105 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:07.105+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:07.189 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:07.189 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:07.204 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:16:07.205 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:07.206+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:07.306 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:07.306+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:07.376 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:07.376 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:07.391 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:16:07.407 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:07.407+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:07.508 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:07.508+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:07.560 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:07.560 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:07.573 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:16:07.609 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:07.609+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:07.710 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:07.711+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:07.741 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:07.741 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:07.756 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:16:07.810 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:07.811+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:07.912 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:07.911+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:07.967 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:07.968 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:07.983 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:16:08.005 INFO:teuthology.orchestra.run.smithi121.stderr:nodeep-scrub is set 2024-04-19T02:16:08.012 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:08.013+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:08.026 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 13 16 39583 39567 190.211 162.562 0.00455741 0.00525459 2024-04-19T02:16:08.027 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:16:08.114 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:08.115+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:08.151 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:08.151 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:08.165 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:16:08.174 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:16:08.196 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:16:08.215 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:08.215+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:08.216 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2: {} 2024-04-19T02:16:08.217 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:16:08.217 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:16:08.217 INFO:teuthology.orchestra.run.smithi121.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:16:08.315 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:08.316+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:08.334 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:16:08.335 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [], 2024-04-19T02:16:08.335 INFO:teuthology.orchestra.run.smithi174.stdout: "complaint_time": 30, 2024-04-19T02:16:08.335 INFO:teuthology.orchestra.run.smithi174.stdout: "num_blocked_ops": 0 2024-04-19T02:16:08.335 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:16:08.348 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:16:08.416 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:08.417+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:08.513 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:16:08.513 INFO:teuthology.orchestra.run.smithi174.stdout: "size": 20, 2024-04-19T02:16:08.513 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 600, 2024-04-19T02:16:08.513 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:16:08.513 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.513 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:10 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:08.513 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269877+0000", 2024-04-19T02:16:08.513 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 39.241756267, 2024-04-19T02:16:08.513 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020732751000000001, 2024-04-19T02:16:08.513 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:08.513 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:08.514 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:08.514 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.514 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:08.514 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269877+0000", 2024-04-19T02:16:08.514 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:08.514 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.514 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.514 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:08.514 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269877+0000", 2024-04-19T02:16:08.514 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:08.514 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.514 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.514 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:08.514 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269875+0000", 2024-04-19T02:16:08.515 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:08.515 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.515 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.515 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:08.515 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269891+0000", 2024-04-19T02:16:08.515 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.5494000000000001e-05 2024-04-19T02:16:08.515 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.515 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.515 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:08.515 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269903+0000", 2024-04-19T02:16:08.515 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2003e-05 2024-04-19T02:16:08.515 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.515 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.515 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:08.516 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269914+0000", 2024-04-19T02:16:08.516 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0947e-05 2024-04-19T02:16:08.516 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.516 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.516 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:08.516 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269971+0000", 2024-04-19T02:16:08.516 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7036000000000001e-05 2024-04-19T02:16:08.516 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.516 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.516 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:16:08.516 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269979+0000", 2024-04-19T02:16:08.516 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.6660000000000008e-06 2024-04-19T02:16:08.516 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.516 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.516 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:08.516 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284891+0000", 2024-04-19T02:16:08.517 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014912584 2024-04-19T02:16:08.517 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.517 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.517 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:08.517 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285213+0000", 2024-04-19T02:16:08.517 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00032172199999999998 2024-04-19T02:16:08.517 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.517 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.517 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:08.517 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285357+0000", 2024-04-19T02:16:08.517 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014367899999999999 2024-04-19T02:16:08.517 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.517 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.517 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:08.517 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288883+0000", 2024-04-19T02:16:08.517 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0035268719999999999 2024-04-19T02:16:08.518 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.518 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.518 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:08.518 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290537+0000", 2024-04-19T02:16:08.518 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016537399999999999 2024-04-19T02:16:08.518 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.518 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.518 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:08.518 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290576+0000", 2024-04-19T02:16:08.518 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9266e-05 2024-04-19T02:16:08.518 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.518 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.518 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:08.518 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290609+0000", 2024-04-19T02:16:08.519 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2818000000000003e-05 2024-04-19T02:16:08.519 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:08.519 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:08.519 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:08.519 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.519 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.519 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:11 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:08.519 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:08.519 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 39.241703346000001, 2024-04-19T02:16:08.519 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020352748, 2024-04-19T02:16:08.519 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:08.519 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:08.519 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:08.519 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.519 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:08.520 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:08.520 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:08.520 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.520 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.520 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:08.520 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:08.520 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:08.520 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.520 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.520 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:08.520 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:08.520 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:08.520 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.521 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.521 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:08.521 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269933+0000", 2024-04-19T02:16:08.521 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2169999999999996e-06 2024-04-19T02:16:08.521 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.521 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.521 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:08.521 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269940+0000", 2024-04-19T02:16:08.521 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1500000000000002e-06 2024-04-19T02:16:08.521 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.521 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.521 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:08.521 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269948+0000", 2024-04-19T02:16:08.521 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.8690000000000004e-06 2024-04-19T02:16:08.521 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.522 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.522 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:08.522 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:16:08.522 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2994999999999997e-05 2024-04-19T02:16:08.522 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.522 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.522 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:16:08.522 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269997+0000", 2024-04-19T02:16:08.522 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.9020000000000004e-06 2024-04-19T02:16:08.522 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.522 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.522 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:08.522 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.282729+0000", 2024-04-19T02:16:08.522 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.012732537 2024-04-19T02:16:08.523 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.523 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.523 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:08.523 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.282838+0000", 2024-04-19T02:16:08.523 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000108298 2024-04-19T02:16:08.523 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.523 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.523 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:08.523 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.283002+0000", 2024-04-19T02:16:08.523 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00016466300000000001 2024-04-19T02:16:08.523 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.523 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.523 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:08.523 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288708+0000", 2024-04-19T02:16:08.524 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.005705066 2024-04-19T02:16:08.524 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.524 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.524 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:08.524 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290215+0000", 2024-04-19T02:16:08.524 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0015075010000000001 2024-04-19T02:16:08.524 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.524 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.524 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:08.524 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290259+0000", 2024-04-19T02:16:08.524 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3711999999999998e-05 2024-04-19T02:16:08.524 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.524 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.524 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:08.524 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290282+0000", 2024-04-19T02:16:08.524 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3458000000000001e-05 2024-04-19T02:16:08.525 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:08.525 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:08.525 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:08.525 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.525 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.525 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:14 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:08.525 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:08.525 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 39.241669555999998, 2024-04-19T02:16:08.525 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020137202, 2024-04-19T02:16:08.525 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:08.525 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:08.525 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:08.525 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.525 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:08.525 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:08.526 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:08.526 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.526 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.526 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:08.526 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:08.526 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:08.526 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.526 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.526 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:08.526 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:08.526 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:08.526 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.526 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.527 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:08.527 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269971+0000", 2024-04-19T02:16:08.527 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.5459999999999992e-06 2024-04-19T02:16:08.527 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.527 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.527 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:08.527 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269979+0000", 2024-04-19T02:16:08.527 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9130000000000003e-06 2024-04-19T02:16:08.527 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.527 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.527 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:08.527 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269986+0000", 2024-04-19T02:16:08.527 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.3779999999999998e-06 2024-04-19T02:16:08.527 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.528 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.528 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:08.528 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270030+0000", 2024-04-19T02:16:08.528 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3982e-05 2024-04-19T02:16:08.528 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.528 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.528 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:16:08.528 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270034+0000", 2024-04-19T02:16:08.528 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1779999999999996e-06 2024-04-19T02:16:08.528 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.528 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.528 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:08.528 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.277870+0000", 2024-04-19T02:16:08.528 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0078362150000000005 2024-04-19T02:16:08.528 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.529 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.529 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:08.529 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.278216+0000", 2024-04-19T02:16:08.529 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00034634999999999999 2024-04-19T02:16:08.529 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.529 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.529 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:08.529 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.278732+0000", 2024-04-19T02:16:08.529 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00051536099999999999 2024-04-19T02:16:08.529 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.529 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.529 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:08.529 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.287694+0000", 2024-04-19T02:16:08.529 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0089621019999999996 2024-04-19T02:16:08.529 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.530 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.530 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:08.530 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290026+0000", 2024-04-19T02:16:08.530 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0023323139999999998 2024-04-19T02:16:08.530 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.530 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.530 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:08.530 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290067+0000", 2024-04-19T02:16:08.530 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1043e-05 2024-04-19T02:16:08.530 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.530 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.530 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:08.530 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290100+0000", 2024-04-19T02:16:08.530 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3278999999999998e-05 2024-04-19T02:16:08.530 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:08.531 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:08.531 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:08.531 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.531 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.531 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:08.531 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:08.531 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 39.241637763999996, 2024-04-19T02:16:08.531 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020731702000000001, 2024-04-19T02:16:08.531 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:08.531 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:08.531 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:08.531 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.531 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:08.531 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:08.532 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:08.532 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.532 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.532 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:08.532 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:08.532 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:08.532 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.532 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.532 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:08.532 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:08.532 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:08.532 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.532 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.532 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:08.532 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269998+0000", 2024-04-19T02:16:08.532 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7100000000000001e-06 2024-04-19T02:16:08.533 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.533 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.533 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:08.533 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270005+0000", 2024-04-19T02:16:08.533 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.241e-06 2024-04-19T02:16:08.533 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.533 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.533 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:08.533 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270011+0000", 2024-04-19T02:16:08.533 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6279999999999999e-06 2024-04-19T02:16:08.533 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.533 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.533 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:08.533 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270046+0000", 2024-04-19T02:16:08.534 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5173999999999999e-05 2024-04-19T02:16:08.534 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.534 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.534 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:08.534 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:08.534 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0019999999999997e-06 2024-04-19T02:16:08.534 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.534 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.534 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:08.534 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285619+0000", 2024-04-19T02:16:08.534 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015567391 2024-04-19T02:16:08.534 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.534 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.534 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:08.535 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285671+0000", 2024-04-19T02:16:08.535 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2460999999999998e-05 2024-04-19T02:16:08.535 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.535 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.535 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:08.535 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285775+0000", 2024-04-19T02:16:08.535 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000103389 2024-04-19T02:16:08.535 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.535 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.535 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:08.535 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288934+0000", 2024-04-19T02:16:08.535 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0031595859999999998 2024-04-19T02:16:08.535 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.535 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.535 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:08.536 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290650+0000", 2024-04-19T02:16:08.536 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001716242 2024-04-19T02:16:08.536 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.536 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.536 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:08.536 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290692+0000", 2024-04-19T02:16:08.536 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1910999999999999e-05 2024-04-19T02:16:08.536 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.536 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.536 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:08.536 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290727+0000", 2024-04-19T02:16:08.536 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4412000000000002e-05 2024-04-19T02:16:08.536 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:08.536 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:08.536 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:08.537 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.537 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.537 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:08.537 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270019+0000", 2024-04-19T02:16:08.537 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 39.241614169000002, 2024-04-19T02:16:08.537 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020572014999999999, 2024-04-19T02:16:08.537 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:08.537 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:08.537 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:08.537 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.537 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:08.537 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270019+0000", 2024-04-19T02:16:08.537 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:08.537 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.538 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.538 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:08.538 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270019+0000", 2024-04-19T02:16:08.538 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:08.538 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.538 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.538 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:08.538 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270018+0000", 2024-04-19T02:16:08.538 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:08.538 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.538 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.538 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:08.538 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270021+0000", 2024-04-19T02:16:08.538 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0319999999999999e-06 2024-04-19T02:16:08.538 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.539 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.539 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:08.539 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270028+0000", 2024-04-19T02:16:08.539 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6189999999999996e-06 2024-04-19T02:16:08.539 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.539 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.539 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:08.539 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270035+0000", 2024-04-19T02:16:08.539 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1690000000000003e-06 2024-04-19T02:16:08.539 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.539 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.539 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:08.539 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270078+0000", 2024-04-19T02:16:08.539 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3061e-05 2024-04-19T02:16:08.539 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.540 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.540 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:08.540 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270082+0000", 2024-04-19T02:16:08.540 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4510000000000002e-06 2024-04-19T02:16:08.540 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.540 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.540 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:08.540 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284354+0000", 2024-04-19T02:16:08.540 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014271588999999999 2024-04-19T02:16:08.540 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.540 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.540 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:08.540 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284497+0000", 2024-04-19T02:16:08.540 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014335800000000001 2024-04-19T02:16:08.540 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.541 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.541 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:08.541 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284626+0000", 2024-04-19T02:16:08.541 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000128744 2024-04-19T02:16:08.541 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.541 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.541 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:08.541 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288844+0000", 2024-04-19T02:16:08.541 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00421807 2024-04-19T02:16:08.541 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.541 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.541 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:08.541 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290508+0000", 2024-04-19T02:16:08.541 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001663774 2024-04-19T02:16:08.542 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.542 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.542 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:08.542 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290556+0000", 2024-04-19T02:16:08.542 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.7599999999999998e-05 2024-04-19T02:16:08.542 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.542 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.542 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:08.542 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290591+0000", 2024-04-19T02:16:08.542 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5034999999999999e-05 2024-04-19T02:16:08.542 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:08.542 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:08.542 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:08.542 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.542 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.543 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:08.543 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:08.543 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 39.241591305999997, 2024-04-19T02:16:08.543 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020192280999999999, 2024-04-19T02:16:08.543 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:08.543 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:08.543 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:08.543 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.543 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:08.543 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:08.543 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:08.543 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.543 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.543 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:08.543 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:08.544 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:08.544 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.544 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.544 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:08.544 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:08.544 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:08.544 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.544 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.544 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:08.544 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270045+0000", 2024-04-19T02:16:08.544 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8680000000000001e-06 2024-04-19T02:16:08.544 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.544 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.544 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:08.544 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270052+0000", 2024-04-19T02:16:08.545 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.9999999999999999e-06 2024-04-19T02:16:08.545 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.545 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.545 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:08.545 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270056+0000", 2024-04-19T02:16:08.545 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4479999999999996e-06 2024-04-19T02:16:08.545 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.545 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.545 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:08.545 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270089+0000", 2024-04-19T02:16:08.545 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3071000000000002e-05 2024-04-19T02:16:08.545 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.545 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.545 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:08.546 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270092+0000", 2024-04-19T02:16:08.546 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9780000000000001e-06 2024-04-19T02:16:08.546 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.546 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.546 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:08.546 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.280632+0000", 2024-04-19T02:16:08.546 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010539712 2024-04-19T02:16:08.546 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.546 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.546 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:08.546 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.280743+0000", 2024-04-19T02:16:08.546 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000111048 2024-04-19T02:16:08.546 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.546 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.546 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:08.547 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.281531+0000", 2024-04-19T02:16:08.547 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00078738199999999999 2024-04-19T02:16:08.547 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.547 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.547 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:08.547 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.287949+0000", 2024-04-19T02:16:08.547 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0064185730000000003 2024-04-19T02:16:08.547 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.547 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.547 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:08.547 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290184+0000", 2024-04-19T02:16:08.547 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0022350849999999999 2024-04-19T02:16:08.547 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.547 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.547 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:08.547 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290209+0000", 2024-04-19T02:16:08.548 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4907000000000001e-05 2024-04-19T02:16:08.548 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.548 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.548 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:08.548 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290234+0000", 2024-04-19T02:16:08.548 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4666999999999999e-05 2024-04-19T02:16:08.548 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:08.548 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:08.548 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:08.548 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.548 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.548 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:19 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:08.548 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:08.549 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 39.241569839999997, 2024-04-19T02:16:08.549 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020818203, 2024-04-19T02:16:08.549 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:08.549 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:08.549 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:08.549 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.549 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:08.549 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:08.549 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:08.549 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.549 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.549 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:08.549 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:08.549 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:08.550 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.550 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.550 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:08.550 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:08.550 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:08.550 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.550 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.550 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:08.550 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270065+0000", 2024-04-19T02:16:08.550 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4310000000000001e-06 2024-04-19T02:16:08.550 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.550 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.550 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:08.550 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270070+0000", 2024-04-19T02:16:08.550 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2859999999999999e-06 2024-04-19T02:16:08.551 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.551 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.551 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:08.551 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270077+0000", 2024-04-19T02:16:08.551 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5270000000000004e-06 2024-04-19T02:16:08.551 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.551 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.551 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:08.551 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270107+0000", 2024-04-19T02:16:08.551 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0205999999999998e-05 2024-04-19T02:16:08.551 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.551 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.551 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:08.551 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270111+0000", 2024-04-19T02:16:08.551 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8650000000000003e-06 2024-04-19T02:16:08.552 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.552 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.552 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:08.552 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285936+0000", 2024-04-19T02:16:08.552 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015824677999999998 2024-04-19T02:16:08.552 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.552 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.552 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:08.552 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286007+0000", 2024-04-19T02:16:08.552 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1157999999999999e-05 2024-04-19T02:16:08.552 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.552 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.552 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:08.552 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286086+0000", 2024-04-19T02:16:08.552 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9084000000000004e-05 2024-04-19T02:16:08.553 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.553 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.553 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:08.553 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290740+0000", 2024-04-19T02:16:08.553 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0046543679999999999 2024-04-19T02:16:08.553 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.553 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.553 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:08.553 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290833+0000", 2024-04-19T02:16:08.553 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2551000000000002e-05 2024-04-19T02:16:08.553 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.553 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.553 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:08.553 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290859+0000", 2024-04-19T02:16:08.554 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.6696999999999999e-05 2024-04-19T02:16:08.554 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.554 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.554 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:08.554 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290881+0000", 2024-04-19T02:16:08.554 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1653000000000001e-05 2024-04-19T02:16:08.554 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:08.554 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:08.554 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:08.554 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.554 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.554 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:22 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:08.554 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270081+0000", 2024-04-19T02:16:08.554 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 39.241551565999998, 2024-04-19T02:16:08.554 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014566841000000001, 2024-04-19T02:16:08.555 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:08.555 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:16:08.555 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:08.555 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.555 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:08.555 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270081+0000", 2024-04-19T02:16:08.555 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:08.555 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.555 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.555 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:08.555 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270081+0000", 2024-04-19T02:16:08.555 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:08.555 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.555 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.556 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:08.556 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270081+0000", 2024-04-19T02:16:08.556 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:08.556 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.556 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.556 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:08.556 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270083+0000", 2024-04-19T02:16:08.556 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.21e-06 2024-04-19T02:16:08.556 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.556 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.556 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:08.556 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270100+0000", 2024-04-19T02:16:08.556 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.7045e-05 2024-04-19T02:16:08.556 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.556 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.557 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:08.557 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270106+0000", 2024-04-19T02:16:08.557 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.6710000000000004e-06 2024-04-19T02:16:08.557 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.557 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.557 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:08.557 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270134+0000", 2024-04-19T02:16:08.557 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.8192999999999999e-05 2024-04-19T02:16:08.557 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.557 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.557 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:16:08.557 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270137+0000", 2024-04-19T02:16:08.557 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.117e-06 2024-04-19T02:16:08.557 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.557 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.557 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:08.558 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.275452+0000", 2024-04-19T02:16:08.558 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0053144389999999998 2024-04-19T02:16:08.558 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.558 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.558 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:08.558 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.275576+0000", 2024-04-19T02:16:08.558 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012455800000000001 2024-04-19T02:16:08.558 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.558 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.558 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:08.558 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284648+0000", 2024-04-19T02:16:08.558 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0090719689999999992 2024-04-19T02:16:08.558 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:08.558 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:08.559 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:08.559 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.559 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.559 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:19174 5.4 5:2f42d48e:::benchmark_data_smithi121_44835_object19173:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:08.559 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:00.712766+0000", 2024-04-19T02:16:08.559 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 7.7988666000000002, 2024-04-19T02:16:08.559 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016423842000000001, 2024-04-19T02:16:08.559 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:08.559 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:08.559 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:08.559 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:08.559 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:08.559 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 19174 2024-04-19T02:16:08.559 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.560 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:08.560 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.560 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:08.560 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.712766+0000", 2024-04-19T02:16:08.560 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:08.560 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.560 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.560 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:08.560 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.712766+0000", 2024-04-19T02:16:08.560 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:08.560 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.560 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.560 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:08.560 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.712765+0000", 2024-04-19T02:16:08.561 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:08.561 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.561 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.561 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:08.561 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.712876+0000", 2024-04-19T02:16:08.561 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000110543 2024-04-19T02:16:08.561 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.561 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.561 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:08.561 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.712887+0000", 2024-04-19T02:16:08.561 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1420000000000001e-05 2024-04-19T02:16:08.561 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.561 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.561 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:08.561 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.712896+0000", 2024-04-19T02:16:08.562 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.4330000000000004e-06 2024-04-19T02:16:08.562 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.562 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.562 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:08.562 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.712923+0000", 2024-04-19T02:16:08.562 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7070999999999999e-05 2024-04-19T02:16:08.562 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.562 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.562 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:08.562 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.713005+0000", 2024-04-19T02:16:08.562 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2279000000000003e-05 2024-04-19T02:16:08.562 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.562 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.562 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:08.563 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.713094+0000", 2024-04-19T02:16:08.563 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.9251000000000003e-05 2024-04-19T02:16:08.563 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.563 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.563 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:08.563 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.714553+0000", 2024-04-19T02:16:08.563 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0014587339999999999 2024-04-19T02:16:08.563 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.563 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.563 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:08.563 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.729110+0000", 2024-04-19T02:16:08.563 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014557037 2024-04-19T02:16:08.563 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.563 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.564 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:08.564 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.729158+0000", 2024-04-19T02:16:08.564 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.829e-05 2024-04-19T02:16:08.564 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.564 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.564 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:08.564 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.729190+0000", 2024-04-19T02:16:08.564 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1673e-05 2024-04-19T02:16:08.564 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:08.564 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:08.564 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:08.564 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.564 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.564 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:19967 5.e 5:79906587:::benchmark_data_smithi121_44835_object19966:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:08.565 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:00.971648+0000", 2024-04-19T02:16:08.565 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 7.5399844920000003, 2024-04-19T02:16:08.565 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.012902805999999999, 2024-04-19T02:16:08.565 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:08.565 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:08.565 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:08.565 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:08.565 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:08.565 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 19967 2024-04-19T02:16:08.565 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.565 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:08.565 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.565 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:08.565 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.971648+0000", 2024-04-19T02:16:08.565 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:08.566 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.566 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.566 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:08.566 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.971648+0000", 2024-04-19T02:16:08.566 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:08.566 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.566 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.566 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:08.566 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.971648+0000", 2024-04-19T02:16:08.566 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:08.566 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.566 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.566 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:08.566 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.971727+0000", 2024-04-19T02:16:08.566 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9055999999999997e-05 2024-04-19T02:16:08.567 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.567 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.567 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:08.567 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.971735+0000", 2024-04-19T02:16:08.567 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.1689999999999992e-06 2024-04-19T02:16:08.567 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.567 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.567 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:08.567 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.971740+0000", 2024-04-19T02:16:08.567 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.9779999999999996e-06 2024-04-19T02:16:08.567 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.567 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.567 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:08.567 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.971771+0000", 2024-04-19T02:16:08.567 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1021e-05 2024-04-19T02:16:08.568 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.568 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.568 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:08.568 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.971881+0000", 2024-04-19T02:16:08.568 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011044000000000001 2024-04-19T02:16:08.568 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.568 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.568 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:08.568 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.971982+0000", 2024-04-19T02:16:08.568 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010034099999999999 2024-04-19T02:16:08.568 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.568 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.568 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:08.568 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.976489+0000", 2024-04-19T02:16:08.569 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0045072619999999997 2024-04-19T02:16:08.569 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.569 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.569 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:08.569 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.984473+0000", 2024-04-19T02:16:08.569 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0079836690000000005 2024-04-19T02:16:08.569 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.569 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.569 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:08.569 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.984513+0000", 2024-04-19T02:16:08.569 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9996000000000001e-05 2024-04-19T02:16:08.569 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.569 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.569 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:08.569 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.984551+0000", 2024-04-19T02:16:08.570 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8478e-05 2024-04-19T02:16:08.570 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:08.570 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:08.570 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:08.570 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.570 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.570 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:30575 5.0 5:049446cf:::benchmark_data_smithi121_44835_object30574:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-19T02:16:08.570 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:04.575472+0000", 2024-04-19T02:16:08.570 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 3.93616067, 2024-04-19T02:16:08.570 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.012666481, 2024-04-19T02:16:08.570 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:08.570 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:08.570 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:08.570 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:08.570 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:08.571 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 30575 2024-04-19T02:16:08.571 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.571 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:08.571 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.571 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:08.571 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.575472+0000", 2024-04-19T02:16:08.571 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:08.571 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.571 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.571 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:08.571 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.575472+0000", 2024-04-19T02:16:08.571 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:08.571 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.571 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.571 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:08.572 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.575472+0000", 2024-04-19T02:16:08.572 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:08.572 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.572 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.572 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:08.572 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.575541+0000", 2024-04-19T02:16:08.572 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.9769000000000002e-05 2024-04-19T02:16:08.572 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.572 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.572 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:08.572 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.575546+0000", 2024-04-19T02:16:08.572 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0590000000000002e-06 2024-04-19T02:16:08.572 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.572 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.572 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:08.573 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.575550+0000", 2024-04-19T02:16:08.573 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0749999999999999e-06 2024-04-19T02:16:08.573 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.573 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.573 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:08.573 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.579113+0000", 2024-04-19T02:16:08.573 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.003562431 2024-04-19T02:16:08.573 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.573 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.573 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:08.573 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.579192+0000", 2024-04-19T02:16:08.573 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9049999999999997e-05 2024-04-19T02:16:08.573 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.573 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.573 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:08.574 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.579277+0000", 2024-04-19T02:16:08.574 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.5295000000000002e-05 2024-04-19T02:16:08.574 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.574 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.574 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:08.574 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.580124+0000", 2024-04-19T02:16:08.574 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00084716000000000001 2024-04-19T02:16:08.574 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.574 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.574 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:08.574 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.588084+0000", 2024-04-19T02:16:08.574 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0079595989999999995 2024-04-19T02:16:08.574 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.574 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.574 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:08.575 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.588115+0000", 2024-04-19T02:16:08.575 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1130000000000002e-05 2024-04-19T02:16:08.575 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.575 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.575 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:08.575 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.588139+0000", 2024-04-19T02:16:08.575 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3493999999999999e-05 2024-04-19T02:16:08.575 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:08.575 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:08.575 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:08.575 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.575 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.575 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:31117 5.8 5:1f785b1b:::benchmark_data_smithi121_44835_object31116:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-19T02:16:08.575 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:04.771679+0000", 2024-04-19T02:16:08.575 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 3.7399534459999999, 2024-04-19T02:16:08.576 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.013743966, 2024-04-19T02:16:08.576 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:08.576 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:08.576 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:08.576 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:08.576 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:08.576 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 31117 2024-04-19T02:16:08.576 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.576 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:08.576 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.576 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:08.576 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.771679+0000", 2024-04-19T02:16:08.576 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:08.576 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.576 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.577 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:08.577 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.771679+0000", 2024-04-19T02:16:08.577 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:08.577 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.577 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.577 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:08.577 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.771679+0000", 2024-04-19T02:16:08.577 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:08.577 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.577 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.577 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:08.577 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.771744+0000", 2024-04-19T02:16:08.577 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5049999999999996e-05 2024-04-19T02:16:08.577 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.577 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.577 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:08.578 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.771752+0000", 2024-04-19T02:16:08.578 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.3380000000000005e-06 2024-04-19T02:16:08.578 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.578 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.578 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:08.578 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.771759+0000", 2024-04-19T02:16:08.578 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.9800000000000001e-06 2024-04-19T02:16:08.578 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.578 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.578 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:08.578 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.773745+0000", 2024-04-19T02:16:08.578 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0019856769999999999 2024-04-19T02:16:08.578 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.578 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.578 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:08.579 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.773837+0000", 2024-04-19T02:16:08.579 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.1879000000000006e-05 2024-04-19T02:16:08.579 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.579 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.579 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:08.579 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.773983+0000", 2024-04-19T02:16:08.579 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000146389 2024-04-19T02:16:08.579 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.579 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.579 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:08.579 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.775410+0000", 2024-04-19T02:16:08.579 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001426901 2024-04-19T02:16:08.579 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.579 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.579 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:08.580 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.785345+0000", 2024-04-19T02:16:08.580 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0099350319999999999 2024-04-19T02:16:08.580 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.580 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.580 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:08.580 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.785388+0000", 2024-04-19T02:16:08.580 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2862999999999999e-05 2024-04-19T02:16:08.580 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.580 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.580 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:08.580 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.785423+0000", 2024-04-19T02:16:08.580 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5505e-05 2024-04-19T02:16:08.580 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:08.580 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:08.580 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:08.581 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.581 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.581 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:31625 5.e 5:7641e3a5:::benchmark_data_smithi121_44835_object31624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-19T02:16:08.581 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:04.957129+0000", 2024-04-19T02:16:08.581 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 3.5545038939999998, 2024-04-19T02:16:08.581 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015292867999999999, 2024-04-19T02:16:08.581 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:08.581 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:08.581 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:08.581 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:08.581 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:08.581 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 31625 2024-04-19T02:16:08.581 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.581 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:08.581 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.581 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:08.582 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.957129+0000", 2024-04-19T02:16:08.582 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:08.582 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.582 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.582 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:08.582 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.957129+0000", 2024-04-19T02:16:08.582 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:08.582 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.582 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.582 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:08.582 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.957128+0000", 2024-04-19T02:16:08.582 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:08.582 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.582 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.582 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:08.583 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.957150+0000", 2024-04-19T02:16:08.583 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1812999999999999e-05 2024-04-19T02:16:08.583 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.583 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.583 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:08.583 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.957155+0000", 2024-04-19T02:16:08.583 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0080000000000002e-06 2024-04-19T02:16:08.583 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.583 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.583 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:08.583 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.957159+0000", 2024-04-19T02:16:08.583 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2830000000000002e-06 2024-04-19T02:16:08.583 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.583 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.583 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:08.584 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.959584+0000", 2024-04-19T02:16:08.584 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0024255290000000001 2024-04-19T02:16:08.584 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.584 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.584 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:08.584 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.959676+0000", 2024-04-19T02:16:08.584 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.1434000000000006e-05 2024-04-19T02:16:08.584 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.584 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.584 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:08.584 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.959773+0000", 2024-04-19T02:16:08.584 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7866000000000001e-05 2024-04-19T02:16:08.584 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.584 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.584 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:08.585 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.965221+0000", 2024-04-19T02:16:08.585 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0054474190000000002 2024-04-19T02:16:08.585 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.585 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.585 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:08.585 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.972372+0000", 2024-04-19T02:16:08.585 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0071516829999999998 2024-04-19T02:16:08.585 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.585 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.585 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:08.585 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.972400+0000", 2024-04-19T02:16:08.585 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7946e-05 2024-04-19T02:16:08.585 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.585 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.585 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:08.586 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.972422+0000", 2024-04-19T02:16:08.586 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1319e-05 2024-04-19T02:16:08.586 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:08.586 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:08.586 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:08.586 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.586 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.586 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:31628 5.e 5:7a7a642b:::benchmark_data_smithi121_44835_object31627:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-19T02:16:08.586 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:04.958655+0000", 2024-04-19T02:16:08.586 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 3.5529777, 2024-04-19T02:16:08.586 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015118138999999999, 2024-04-19T02:16:08.586 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:08.586 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:08.586 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:08.586 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:08.587 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:08.587 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 31628 2024-04-19T02:16:08.587 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.587 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:08.587 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.587 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:08.587 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.958655+0000", 2024-04-19T02:16:08.587 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:08.587 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.587 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.587 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:08.587 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.958655+0000", 2024-04-19T02:16:08.587 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:08.587 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.587 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.587 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:08.588 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.958654+0000", 2024-04-19T02:16:08.588 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:08.588 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.588 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.588 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:08.588 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.958711+0000", 2024-04-19T02:16:08.588 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.6474999999999997e-05 2024-04-19T02:16:08.588 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.588 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.588 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:08.588 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.958720+0000", 2024-04-19T02:16:08.588 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.1779999999999992e-06 2024-04-19T02:16:08.588 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.588 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.588 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:08.589 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.958725+0000", 2024-04-19T02:16:08.589 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.101e-06 2024-04-19T02:16:08.589 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.589 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.589 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:08.589 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.962283+0000", 2024-04-19T02:16:08.589 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0035576340000000001 2024-04-19T02:16:08.589 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.589 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.589 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:08.589 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.962373+0000", 2024-04-19T02:16:08.589 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0124000000000007e-05 2024-04-19T02:16:08.589 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.589 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.589 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:08.589 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.962505+0000", 2024-04-19T02:16:08.590 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013171299999999999 2024-04-19T02:16:08.590 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.590 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.590 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:08.590 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.966039+0000", 2024-04-19T02:16:08.590 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.003534943 2024-04-19T02:16:08.590 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.590 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.590 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:08.590 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.973700+0000", 2024-04-19T02:16:08.590 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0076601359999999997 2024-04-19T02:16:08.590 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.590 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.590 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:08.591 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.973741+0000", 2024-04-19T02:16:08.591 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1267000000000003e-05 2024-04-19T02:16:08.591 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.591 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.591 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:08.591 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.973773+0000", 2024-04-19T02:16:08.591 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2363999999999997e-05 2024-04-19T02:16:08.591 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:08.591 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:08.591 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:08.591 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.591 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.591 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:31632 5.e 5:7c608c66:::benchmark_data_smithi121_44835_object31631:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-19T02:16:08.591 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:04.960320+0000", 2024-04-19T02:16:08.591 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 3.5513131119999999, 2024-04-19T02:16:08.592 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016282966999999999, 2024-04-19T02:16:08.592 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:08.592 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:08.592 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:08.592 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:08.592 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:08.592 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 31632 2024-04-19T02:16:08.592 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.592 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:08.592 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.592 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:08.592 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.960320+0000", 2024-04-19T02:16:08.592 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:08.592 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.592 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.592 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:08.593 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.960320+0000", 2024-04-19T02:16:08.593 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:08.593 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.593 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.593 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:08.593 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.960319+0000", 2024-04-19T02:16:08.593 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:08.593 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.593 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.593 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:08.593 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.960359+0000", 2024-04-19T02:16:08.593 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0120999999999998e-05 2024-04-19T02:16:08.593 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.593 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.593 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:08.593 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.960370+0000", 2024-04-19T02:16:08.594 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1124999999999999e-05 2024-04-19T02:16:08.594 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.594 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.594 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:08.594 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.960376+0000", 2024-04-19T02:16:08.594 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.6840000000000001e-06 2024-04-19T02:16:08.594 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.594 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.594 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:08.594 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.965241+0000", 2024-04-19T02:16:08.594 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0048651709999999997 2024-04-19T02:16:08.594 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.594 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.594 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:08.594 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.965330+0000", 2024-04-19T02:16:08.595 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.9345999999999995e-05 2024-04-19T02:16:08.595 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.595 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.595 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:08.595 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.965409+0000", 2024-04-19T02:16:08.595 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.8757000000000005e-05 2024-04-19T02:16:08.595 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.595 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.595 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:08.595 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.966312+0000", 2024-04-19T02:16:08.595 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00090340199999999998 2024-04-19T02:16:08.595 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.595 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.595 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:08.595 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.976537+0000", 2024-04-19T02:16:08.596 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010224680999999999 2024-04-19T02:16:08.596 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.596 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.596 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:08.596 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.976580+0000", 2024-04-19T02:16:08.596 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3234e-05 2024-04-19T02:16:08.596 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.596 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.596 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:08.596 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.976603+0000", 2024-04-19T02:16:08.596 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.2421000000000001e-05 2024-04-19T02:16:08.596 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:08.596 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:08.596 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:08.596 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.597 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.597 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:40284 5.8 5:1e312d43:::benchmark_data_smithi121_44835_object40283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:08.597 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:08.287007+0000", 2024-04-19T02:16:08.597 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.224625516, 2024-04-19T02:16:08.597 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014162001, 2024-04-19T02:16:08.597 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:08.597 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:08.597 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:08.597 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:08.597 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:08.597 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 40284 2024-04-19T02:16:08.597 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.597 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:08.597 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.597 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:08.598 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.287007+0000", 2024-04-19T02:16:08.598 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:08.598 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.598 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.598 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:08.598 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.287007+0000", 2024-04-19T02:16:08.598 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:08.598 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.598 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.598 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:08.598 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.287007+0000", 2024-04-19T02:16:08.598 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:08.598 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.598 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.598 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:08.599 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.287043+0000", 2024-04-19T02:16:08.599 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6208000000000003e-05 2024-04-19T02:16:08.599 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.599 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.599 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:08.599 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.287054+0000", 2024-04-19T02:16:08.599 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0733e-05 2024-04-19T02:16:08.599 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.599 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.599 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:08.599 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.287060+0000", 2024-04-19T02:16:08.599 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.0780000000000001e-06 2024-04-19T02:16:08.599 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.599 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.599 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:08.599 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.287149+0000", 2024-04-19T02:16:08.600 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.9598000000000005e-05 2024-04-19T02:16:08.600 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.600 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.600 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:08.600 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.287261+0000", 2024-04-19T02:16:08.600 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000111353 2024-04-19T02:16:08.600 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.600 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.600 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:08.600 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.287389+0000", 2024-04-19T02:16:08.600 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000128684 2024-04-19T02:16:08.600 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.600 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.600 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:08.600 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.290293+0000", 2024-04-19T02:16:08.601 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0029040759999999998 2024-04-19T02:16:08.601 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.601 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.601 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:08.601 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.301115+0000", 2024-04-19T02:16:08.601 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010821498000000001 2024-04-19T02:16:08.601 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.601 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.601 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:08.601 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.301145+0000", 2024-04-19T02:16:08.601 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0074999999999999e-05 2024-04-19T02:16:08.601 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.601 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.601 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:08.601 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.301169+0000", 2024-04-19T02:16:08.601 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4260000000000002e-05 2024-04-19T02:16:08.602 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:08.602 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:08.602 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:08.602 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.602 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.602 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:40289 5.8 5:10fdb467:::benchmark_data_smithi121_44835_object40288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:08.602 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:08.287582+0000", 2024-04-19T02:16:08.602 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.22405028799999999, 2024-04-19T02:16:08.602 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.013684158, 2024-04-19T02:16:08.602 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:08.602 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:08.602 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:08.602 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:08.602 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:08.603 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 40289 2024-04-19T02:16:08.603 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.603 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:08.603 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.603 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:08.603 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.287582+0000", 2024-04-19T02:16:08.603 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:08.603 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.603 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.603 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:08.603 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.287582+0000", 2024-04-19T02:16:08.603 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:08.603 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.603 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.603 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:08.604 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.287582+0000", 2024-04-19T02:16:08.604 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:08.604 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.604 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.604 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:08.604 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.287847+0000", 2024-04-19T02:16:08.604 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00026524699999999998 2024-04-19T02:16:08.604 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.604 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.604 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:08.604 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.287863+0000", 2024-04-19T02:16:08.604 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.5610000000000001e-05 2024-04-19T02:16:08.604 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.604 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.604 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:08.605 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.287871+0000", 2024-04-19T02:16:08.605 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.7180000000000002e-06 2024-04-19T02:16:08.605 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.605 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.605 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:08.605 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.288758+0000", 2024-04-19T02:16:08.605 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00088713099999999999 2024-04-19T02:16:08.605 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.605 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.605 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:08.605 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.288870+0000", 2024-04-19T02:16:08.605 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000111938 2024-04-19T02:16:08.605 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.605 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.605 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:08.606 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.288984+0000", 2024-04-19T02:16:08.606 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011385 2024-04-19T02:16:08.606 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.606 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.606 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:08.606 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.291361+0000", 2024-04-19T02:16:08.606 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0023763859999999999 2024-04-19T02:16:08.606 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.606 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.606 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:08.606 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.301210+0000", 2024-04-19T02:16:08.606 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0098496380000000008 2024-04-19T02:16:08.606 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.606 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.606 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:08.607 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.301244+0000", 2024-04-19T02:16:08.607 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4140000000000002e-05 2024-04-19T02:16:08.607 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.607 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.607 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:08.607 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.301267+0000", 2024-04-19T02:16:08.607 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.2195999999999999e-05 2024-04-19T02:16:08.607 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:08.607 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:08.607 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:08.607 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.607 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.607 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:40295 5.8 5:1b750b2f:::benchmark_data_smithi121_44835_object40294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:08.607 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:08.292569+0000", 2024-04-19T02:16:08.607 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.219063866, 2024-04-19T02:16:08.608 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014369256, 2024-04-19T02:16:08.608 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:08.608 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:08.608 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:08.608 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:08.608 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:08.608 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 40295 2024-04-19T02:16:08.608 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.608 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:08.608 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.608 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:08.608 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.292569+0000", 2024-04-19T02:16:08.608 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:08.608 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.608 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.609 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:08.609 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.292569+0000", 2024-04-19T02:16:08.609 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:08.609 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.609 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.609 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:08.609 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.292569+0000", 2024-04-19T02:16:08.609 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:08.609 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.609 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.609 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:08.609 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.292729+0000", 2024-04-19T02:16:08.609 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00016024799999999999 2024-04-19T02:16:08.609 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.609 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.609 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:08.610 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.292734+0000", 2024-04-19T02:16:08.610 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.7899999999999999e-06 2024-04-19T02:16:08.610 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.610 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.610 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:08.610 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.292738+0000", 2024-04-19T02:16:08.610 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8409999999999999e-06 2024-04-19T02:16:08.610 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.610 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.610 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:08.610 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.293893+0000", 2024-04-19T02:16:08.610 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0011550390000000001 2024-04-19T02:16:08.610 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.610 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.611 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:08.611 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.293994+0000", 2024-04-19T02:16:08.611 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010097799999999999 2024-04-19T02:16:08.611 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.611 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.611 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:08.611 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.294124+0000", 2024-04-19T02:16:08.611 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012905100000000001 2024-04-19T02:16:08.611 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.611 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.611 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:08.611 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.296736+0000", 2024-04-19T02:16:08.611 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0026127920000000001 2024-04-19T02:16:08.611 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.611 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.611 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:08.612 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.306875+0000", 2024-04-19T02:16:08.612 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010138261000000001 2024-04-19T02:16:08.612 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.612 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.612 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:08.612 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.306915+0000", 2024-04-19T02:16:08.612 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0771e-05 2024-04-19T02:16:08.612 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.612 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.612 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:08.612 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.306938+0000", 2024-04-19T02:16:08.612 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.2827e-05 2024-04-19T02:16:08.612 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:08.612 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:08.612 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:08.613 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.613 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.613 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:40538 5.b 5:d3fc91d5:::benchmark_data_smithi121_44835_object40537:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:08.613 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:08.398560+0000", 2024-04-19T02:16:08.613 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.113072808, 2024-04-19T02:16:08.613 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014904897, 2024-04-19T02:16:08.613 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:08.613 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:08.613 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:08.613 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:08.613 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:08.613 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 40538 2024-04-19T02:16:08.613 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.613 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:08.613 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.614 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:08.614 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.398560+0000", 2024-04-19T02:16:08.614 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:08.614 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.614 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.614 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:08.614 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.398560+0000", 2024-04-19T02:16:08.614 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:08.614 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.614 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.614 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:08.614 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.398560+0000", 2024-04-19T02:16:08.614 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:08.614 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.614 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.615 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:08.615 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.398604+0000", 2024-04-19T02:16:08.615 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4376000000000003e-05 2024-04-19T02:16:08.615 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.615 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.615 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:08.615 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.398611+0000", 2024-04-19T02:16:08.615 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.8970000000000002e-06 2024-04-19T02:16:08.615 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.615 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.615 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:08.615 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.398616+0000", 2024-04-19T02:16:08.615 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2660000000000001e-06 2024-04-19T02:16:08.615 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.615 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.616 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:08.616 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.400131+0000", 2024-04-19T02:16:08.616 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0015154089999999999 2024-04-19T02:16:08.616 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.616 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.616 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:08.616 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.400252+0000", 2024-04-19T02:16:08.616 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000120728 2024-04-19T02:16:08.616 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.616 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.616 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:08.616 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.400384+0000", 2024-04-19T02:16:08.616 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013187100000000001 2024-04-19T02:16:08.616 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.616 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.617 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:08.617 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.402978+0000", 2024-04-19T02:16:08.617 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.002593995 2024-04-19T02:16:08.617 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.617 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.617 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:08.617 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.413394+0000", 2024-04-19T02:16:08.617 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010416338000000001 2024-04-19T02:16:08.617 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.617 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.617 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:08.617 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.413431+0000", 2024-04-19T02:16:08.617 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6402000000000001e-05 2024-04-19T02:16:08.617 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.617 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.618 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:08.618 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.413465+0000", 2024-04-19T02:16:08.618 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4069000000000002e-05 2024-04-19T02:16:08.618 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:08.618 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:08.618 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:08.618 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.618 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.618 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:40785 5.a e23/16 5:502bb3cb:::benchmark_data_smithi121_44835_object40784:head v 23'2602, mlcod=23'2599)", 2024-04-19T02:16:08.618 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:08.490262+0000", 2024-04-19T02:16:08.618 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.021371075999999999, 2024-04-19T02:16:08.618 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.013093794000000001, 2024-04-19T02:16:08.618 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:08.618 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:08.618 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:08.619 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.619 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:08.619 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.490262+0000", 2024-04-19T02:16:08.619 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:08.619 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.619 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.619 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:08.619 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.490262+0000", 2024-04-19T02:16:08.619 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:08.619 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.619 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.619 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:08.619 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.490261+0000", 2024-04-19T02:16:08.619 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:08.619 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.619 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.620 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:08.620 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.490333+0000", 2024-04-19T02:16:08.620 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.2125000000000005e-05 2024-04-19T02:16:08.620 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.620 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.620 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:08.620 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.490341+0000", 2024-04-19T02:16:08.620 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.5449999999999998e-06 2024-04-19T02:16:08.620 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.620 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.620 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:08.620 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.490346+0000", 2024-04-19T02:16:08.620 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.4299999999999997e-06 2024-04-19T02:16:08.620 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.620 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.621 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:08.621 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.490373+0000", 2024-04-19T02:16:08.621 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.6996e-05 2024-04-19T02:16:08.621 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.621 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.621 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:08.621 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.490385+0000", 2024-04-19T02:16:08.621 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1433e-05 2024-04-19T02:16:08.621 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.621 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.621 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:08.621 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.503325+0000", 2024-04-19T02:16:08.621 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.012940596 2024-04-19T02:16:08.621 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:08.621 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:08.621 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:08.622 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.503355+0000", 2024-04-19T02:16:08.622 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0154999999999998e-05 2024-04-19T02:16:08.622 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:08.622 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:08.622 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:08.622 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:08.622 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:08.622 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:16:08.624 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:16:08.624 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:08.624+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:08.724 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:08.725+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:08.807 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-04-19T02:16:08.807 INFO:teuthology.orchestra.run.smithi177.stdout: "ops": [ 2024-04-19T02:16:08.807 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.807 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:41568 5.3 5:c2b093b0:::benchmark_data_smithi121_44835_object41567:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:08.807 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:08.802769+0000", 2024-04-19T02:16:08.807 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0040564490000000002, 2024-04-19T02:16:08.807 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0040909850000000001, 2024-04-19T02:16:08.807 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:08.807 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:08.807 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:08.808 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:08.808 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:08.808 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 41568 2024-04-19T02:16:08.808 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.808 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:08.808 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.808 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:08.808 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.802769+0000", 2024-04-19T02:16:08.808 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:08.808 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.808 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.808 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:08.808 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.802769+0000", 2024-04-19T02:16:08.808 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:08.808 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.808 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.809 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:08.809 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.802768+0000", 2024-04-19T02:16:08.809 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:08.809 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.809 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.809 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:08.809 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.802794+0000", 2024-04-19T02:16:08.809 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.5865000000000001e-05 2024-04-19T02:16:08.809 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.809 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.809 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:08.809 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.802802+0000", 2024-04-19T02:16:08.809 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.1599999999999998e-06 2024-04-19T02:16:08.809 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.810 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.810 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:08.810 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.802808+0000", 2024-04-19T02:16:08.810 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.4450000000000001e-06 2024-04-19T02:16:08.810 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.810 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.810 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:08.810 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.803914+0000", 2024-04-19T02:16:08.810 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0011059189999999999 2024-04-19T02:16:08.810 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.810 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.810 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:08.810 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.804055+0000", 2024-04-19T02:16:08.810 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00014074700000000001 2024-04-19T02:16:08.810 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.811 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.811 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:08.811 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.804193+0000", 2024-04-19T02:16:08.811 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00013783799999999999 2024-04-19T02:16:08.811 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:08.811 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:08.811 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:08.811 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.811 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.811 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:41569 5.c 5:3feca7da:::benchmark_data_smithi121_44835_object41568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:08.811 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:08.803895+0000", 2024-04-19T02:16:08.811 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0029302310000000002, 2024-04-19T02:16:08.811 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0030501619999999999, 2024-04-19T02:16:08.811 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:08.811 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:08.812 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:08.812 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:08.812 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:08.812 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 41569 2024-04-19T02:16:08.812 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.812 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:08.812 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.812 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:08.812 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.803895+0000", 2024-04-19T02:16:08.812 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:08.812 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.813 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.813 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:08.813 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.803895+0000", 2024-04-19T02:16:08.813 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:08.813 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.813 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.813 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:08.813 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.803894+0000", 2024-04-19T02:16:08.813 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:08.813 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.813 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.813 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:08.813 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.803918+0000", 2024-04-19T02:16:08.814 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.3645000000000001e-05 2024-04-19T02:16:08.814 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.814 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.814 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:08.814 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.803928+0000", 2024-04-19T02:16:08.814 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.6029999999999994e-06 2024-04-19T02:16:08.814 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.814 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.814 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:08.814 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.803935+0000", 2024-04-19T02:16:08.814 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.5630000000000003e-06 2024-04-19T02:16:08.814 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.814 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.814 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:08.815 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.803982+0000", 2024-04-19T02:16:08.815 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.7324999999999998e-05 2024-04-19T02:16:08.815 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.815 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.815 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:08.815 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.804111+0000", 2024-04-19T02:16:08.815 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0001282 2024-04-19T02:16:08.815 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.815 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.815 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:08.815 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.804249+0000", 2024-04-19T02:16:08.815 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000138145 2024-04-19T02:16:08.815 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:08.815 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:08.815 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:08.815 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.816 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.816 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:41574 5.6 5:6ecbf27d:::benchmark_data_smithi121_44835_object41573:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:08.816 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:08.804053+0000", 2024-04-19T02:16:08.816 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0027726999999999999, 2024-04-19T02:16:08.816 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0029689109999999999, 2024-04-19T02:16:08.816 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:08.816 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:08.816 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:08.816 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:08.817 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:08.817 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 41574 2024-04-19T02:16:08.817 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.817 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:08.817 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.817 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:08.817 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.804053+0000", 2024-04-19T02:16:08.817 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:08.817 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.817 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.817 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:08.817 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.804053+0000", 2024-04-19T02:16:08.817 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:08.817 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.817 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.818 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:08.818 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.804052+0000", 2024-04-19T02:16:08.818 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:08.818 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.818 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.818 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:08.818 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.804158+0000", 2024-04-19T02:16:08.818 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000106486 2024-04-19T02:16:08.818 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.818 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.818 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:08.818 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.804167+0000", 2024-04-19T02:16:08.818 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.8210000000000008e-06 2024-04-19T02:16:08.818 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.818 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.819 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:08.819 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.804175+0000", 2024-04-19T02:16:08.819 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.2390000000000002e-06 2024-04-19T02:16:08.819 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.819 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.819 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:08.819 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.804206+0000", 2024-04-19T02:16:08.819 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.1061e-05 2024-04-19T02:16:08.819 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.819 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.819 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:08.819 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.804286+0000", 2024-04-19T02:16:08.819 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.9841999999999999e-05 2024-04-19T02:16:08.819 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.819 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.819 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:08.820 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.804366+0000", 2024-04-19T02:16:08.820 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.9528000000000002e-05 2024-04-19T02:16:08.820 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:08.820 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:08.820 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:08.820 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.820 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.820 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:41570 5.4 e23/16 5:2e662a0a:::benchmark_data_smithi121_44835_object41569:head v 23'2587, mlcod=23'2584)", 2024-04-19T02:16:08.820 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:08.804063+0000", 2024-04-19T02:16:08.820 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0027626550000000001, 2024-04-19T02:16:08.821 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0030321850000000002, 2024-04-19T02:16:08.821 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:08.821 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:08.821 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:08.821 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.821 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:08.821 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.804063+0000", 2024-04-19T02:16:08.821 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:08.821 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.821 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.821 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:08.821 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.804063+0000", 2024-04-19T02:16:08.821 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:08.822 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.822 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.822 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:08.822 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.804062+0000", 2024-04-19T02:16:08.822 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:08.822 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.822 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.822 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:08.822 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.804162+0000", 2024-04-19T02:16:08.822 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000100435 2024-04-19T02:16:08.822 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.822 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.822 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:08.822 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.804170+0000", 2024-04-19T02:16:08.823 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.9209999999999992e-06 2024-04-19T02:16:08.823 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.823 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.823 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:08.823 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.804177+0000", 2024-04-19T02:16:08.823 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.1789999999999996e-06 2024-04-19T02:16:08.823 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.823 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.823 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:08.823 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.804887+0000", 2024-04-19T02:16:08.823 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00071088100000000001 2024-04-19T02:16:08.823 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.823 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.824 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:08.824 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.804907+0000", 2024-04-19T02:16:08.824 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.9429999999999999e-05 2024-04-19T02:16:08.824 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:08.824 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:08.824 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:08.824 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.824 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.824 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:41575 5.5 5:a0b92cfe:::benchmark_data_smithi121_44835_object41574:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:08.824 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:08.804184+0000", 2024-04-19T02:16:08.824 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0026411540000000002, 2024-04-19T02:16:08.824 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0029737119999999999, 2024-04-19T02:16:08.824 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:08.824 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:08.825 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:08.825 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:08.825 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:08.825 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 41575 2024-04-19T02:16:08.825 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.825 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:08.825 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.825 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:08.825 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.804184+0000", 2024-04-19T02:16:08.825 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:08.825 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.825 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.825 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:08.825 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.804184+0000", 2024-04-19T02:16:08.825 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:08.826 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.826 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.826 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:08.826 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.804183+0000", 2024-04-19T02:16:08.826 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:08.826 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.826 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.826 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:08.827 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.804230+0000", 2024-04-19T02:16:08.827 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.6613999999999998e-05 2024-04-19T02:16:08.827 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.827 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.827 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:08.827 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.804236+0000", 2024-04-19T02:16:08.827 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.7219999999999996e-06 2024-04-19T02:16:08.827 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.827 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.827 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:08.827 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.804240+0000", 2024-04-19T02:16:08.827 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.8229999999999997e-06 2024-04-19T02:16:08.827 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.827 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.828 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:08.828 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.804275+0000", 2024-04-19T02:16:08.828 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.5679000000000002e-05 2024-04-19T02:16:08.828 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.828 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.828 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:08.828 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.804387+0000", 2024-04-19T02:16:08.828 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000111476 2024-04-19T02:16:08.828 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.828 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.828 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:08.828 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.804488+0000", 2024-04-19T02:16:08.828 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000101184 2024-04-19T02:16:08.828 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:08.828 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:08.828 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:08.829 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.829 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.829 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:41576 5.4 e23/16 5:26e2e89c:::benchmark_data_smithi121_44835_object41575:head v 23'2588, mlcod=23'2584)", 2024-04-19T02:16:08.829 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:08.805547+0000", 2024-04-19T02:16:08.829 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.001278579, 2024-04-19T02:16:08.829 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0016834860000000001, 2024-04-19T02:16:08.829 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:08.829 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:08.829 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:08.829 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.829 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:08.829 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.805547+0000", 2024-04-19T02:16:08.829 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:08.829 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.829 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.830 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:08.830 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.805547+0000", 2024-04-19T02:16:08.830 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:08.830 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.830 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.830 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:08.830 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.805546+0000", 2024-04-19T02:16:08.830 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:08.830 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.830 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.830 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:08.830 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.805613+0000", 2024-04-19T02:16:08.830 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.7510999999999998e-05 2024-04-19T02:16:08.830 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.830 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.831 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:08.831 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.805623+0000", 2024-04-19T02:16:08.831 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.4730000000000006e-06 2024-04-19T02:16:08.831 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.831 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.831 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:08.831 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.805629+0000", 2024-04-19T02:16:08.831 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.0360000000000003e-06 2024-04-19T02:16:08.831 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.831 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.831 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:08.831 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.806307+0000", 2024-04-19T02:16:08.831 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000677869 2024-04-19T02:16:08.831 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.831 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.832 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:08.832 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.806326+0000", 2024-04-19T02:16:08.832 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.8743e-05 2024-04-19T02:16:08.832 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:08.832 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:08.832 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:08.832 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.832 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.832 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:41578 5.5 5:a5ce7c9c:::benchmark_data_smithi121_44835_object41577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:08.832 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:08.805885+0000", 2024-04-19T02:16:08.832 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.00093980699999999997, 2024-04-19T02:16:08.832 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0014105140000000001, 2024-04-19T02:16:08.832 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:08.832 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:08.832 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:08.833 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:08.833 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:08.833 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 41578 2024-04-19T02:16:08.833 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.833 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:08.833 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.833 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:08.833 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.805885+0000", 2024-04-19T02:16:08.833 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:08.833 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.833 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.833 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:08.833 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.805885+0000", 2024-04-19T02:16:08.833 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:08.833 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.834 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.834 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:08.834 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.805885+0000", 2024-04-19T02:16:08.834 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:08.834 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.834 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.834 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:08.834 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.805982+0000", 2024-04-19T02:16:08.834 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.7442999999999995e-05 2024-04-19T02:16:08.834 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.834 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.834 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:08.834 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.805993+0000", 2024-04-19T02:16:08.835 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.1221e-05 2024-04-19T02:16:08.835 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.835 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.835 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:08.835 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.806003+0000", 2024-04-19T02:16:08.835 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.3929999999999997e-06 2024-04-19T02:16:08.835 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.835 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.835 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:08.835 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.806039+0000", 2024-04-19T02:16:08.835 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6239999999999999e-05 2024-04-19T02:16:08.835 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.835 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.835 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:08.835 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.806169+0000", 2024-04-19T02:16:08.835 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012991399999999999 2024-04-19T02:16:08.836 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.836 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.836 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:08.836 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.806287+0000", 2024-04-19T02:16:08.836 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00011847 2024-04-19T02:16:08.836 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:08.836 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:08.836 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:08.836 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.836 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.836 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:41579 5.3 5:ce0604bc:::benchmark_data_smithi121_44835_object41578:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:08.836 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:08.806090+0000", 2024-04-19T02:16:08.836 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.00073519799999999995, 2024-04-19T02:16:08.838 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.001286939, 2024-04-19T02:16:08.838 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:08.838 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:08.838 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:08.838 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:08.838 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:08.838 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 41579 2024-04-19T02:16:08.838 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.838 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:08.838 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.839 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:08.839 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.806090+0000", 2024-04-19T02:16:08.839 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:08.839 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.839 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.839 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:08.839 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.806090+0000", 2024-04-19T02:16:08.839 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:08.839 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.839 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.839 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:08.839 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.806089+0000", 2024-04-19T02:16:08.839 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:08.839 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.839 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.840 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:08.840 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.806191+0000", 2024-04-19T02:16:08.840 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000101574 2024-04-19T02:16:08.840 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.840 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.840 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:08.840 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.806200+0000", 2024-04-19T02:16:08.840 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.9649999999999997e-06 2024-04-19T02:16:08.840 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.840 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.840 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:08.840 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.806207+0000", 2024-04-19T02:16:08.840 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.9140000000000002e-06 2024-04-19T02:16:08.840 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.840 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.841 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:08.841 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.806247+0000", 2024-04-19T02:16:08.841 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.9925999999999997e-05 2024-04-19T02:16:08.841 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.841 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.841 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:08.841 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.806348+0000", 2024-04-19T02:16:08.841 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000100901 2024-04-19T02:16:08.841 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.841 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.841 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:08.841 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.806426+0000", 2024-04-19T02:16:08.841 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.8288999999999995e-05 2024-04-19T02:16:08.841 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:08.841 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:08.842 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:08.842 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.842 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.842 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:41577 5.7 e23/16 5:e5555878:::benchmark_data_smithi121_44835_object41576:head v 23'2592, mlcod=23'2590)", 2024-04-19T02:16:08.842 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:08.807109+0000", 2024-04-19T02:16:08.842 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4294967295.9997168, 2024-04-19T02:16:08.842 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00035018799999999997, 2024-04-19T02:16:08.842 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:08.842 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:08.842 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:08.842 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.842 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:08.842 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.807109+0000", 2024-04-19T02:16:08.842 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:08.842 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.843 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.843 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:08.843 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.807109+0000", 2024-04-19T02:16:08.843 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:08.843 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.843 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.843 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:08.843 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.807108+0000", 2024-04-19T02:16:08.843 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:08.843 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.843 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.843 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:08.843 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.807140+0000", 2024-04-19T02:16:08.843 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.1436999999999997e-05 2024-04-19T02:16:08.843 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.844 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.844 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:08.844 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.807149+0000", 2024-04-19T02:16:08.844 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.1810000000000007e-06 2024-04-19T02:16:08.844 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.844 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.844 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:08.844 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.807156+0000", 2024-04-19T02:16:08.844 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.2450000000000001e-06 2024-04-19T02:16:08.844 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.844 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.844 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:08.844 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.807212+0000", 2024-04-19T02:16:08.844 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.6314000000000003e-05 2024-04-19T02:16:08.844 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.845 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.845 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:08.845 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.807236+0000", 2024-04-19T02:16:08.845 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.3266999999999999e-05 2024-04-19T02:16:08.845 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:08.845 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:08.845 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:08.845 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.845 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.845 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:41580 5.2 e23/16)", 2024-04-19T02:16:08.845 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:08.807168+0000", 2024-04-19T02:16:08.845 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4294967295.9996572, 2024-04-19T02:16:08.845 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00035836, 2024-04-19T02:16:08.845 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:08.845 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "queued for pg", 2024-04-19T02:16:08.846 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:08.846 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.846 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:08.846 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.807168+0000", 2024-04-19T02:16:08.846 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:08.846 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.846 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.846 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:08.846 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.807168+0000", 2024-04-19T02:16:08.846 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:08.846 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.846 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.846 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:08.846 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.807168+0000", 2024-04-19T02:16:08.847 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:08.847 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.847 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.847 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:08.847 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.807196+0000", 2024-04-19T02:16:08.847 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.8551000000000002e-05 2024-04-19T02:16:08.847 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.847 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.847 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:08.847 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.807203+0000", 2024-04-19T02:16:08.847 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.3939999999999998e-06 2024-04-19T02:16:08.847 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.847 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.847 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:08.847 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.807209+0000", 2024-04-19T02:16:08.847 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.5670000000000002e-06 2024-04-19T02:16:08.848 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:08.848 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:08.848 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:08.848 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.848 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.848 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:41581 5.3 5.a910db3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:08.848 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:08.807226+0000", 2024-04-19T02:16:08.848 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4294967295.9995995, 2024-04-19T02:16:08.848 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00038397099999999999, 2024-04-19T02:16:08.848 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:08.848 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "queued for pg", 2024-04-19T02:16:08.848 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:08.848 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:08.848 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:08.848 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 41581 2024-04-19T02:16:08.849 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.849 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:08.849 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.849 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:08.849 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.807226+0000", 2024-04-19T02:16:08.849 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:08.849 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.849 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.849 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:08.849 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.807226+0000", 2024-04-19T02:16:08.849 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:08.849 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.849 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.849 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:08.849 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.807225+0000", 2024-04-19T02:16:08.850 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:08.850 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.850 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.850 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:08.850 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.807247+0000", 2024-04-19T02:16:08.850 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.1149e-05 2024-04-19T02:16:08.850 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.850 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.850 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:08.850 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.807252+0000", 2024-04-19T02:16:08.850 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.8839999999999999e-06 2024-04-19T02:16:08.850 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:08.850 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:08.850 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:08.850 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.807257+0000", 2024-04-19T02:16:08.851 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.109e-06 2024-04-19T02:16:08.851 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:08.851 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:08.851 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:08.851 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:08.851 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2024-04-19T02:16:08.851 INFO:teuthology.orchestra.run.smithi177.stdout: "num_ops": 11 2024-04-19T02:16:08.851 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-04-19T02:16:08.853 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:16:08.853 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:08.853+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:08.953 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:08.954+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:09.026 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 14 16 42130 42114 187.994 159.188 0.00713521 0.00531651 2024-04-19T02:16:09.055 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:09.055+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:09.069 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-04-19T02:16:09.070 INFO:teuthology.orchestra.run.smithi177.stdout: "ops": [], 2024-04-19T02:16:09.070 INFO:teuthology.orchestra.run.smithi177.stdout: "complaint_time": 30, 2024-04-19T02:16:09.070 INFO:teuthology.orchestra.run.smithi177.stdout: "num_blocked_ops": 0 2024-04-19T02:16:09.070 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-04-19T02:16:09.086 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:16:09.155 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:09.156+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:09.256 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:09.257+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:09.310 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-04-19T02:16:09.310 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 20, 2024-04-19T02:16:09.310 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 600, 2024-04-19T02:16:09.310 INFO:teuthology.orchestra.run.smithi177.stdout: "ops": [ 2024-04-19T02:16:09.310 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.310 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:09.310 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:29.270159+0000", 2024-04-19T02:16:09.310 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 40.038427519999999, 2024-04-19T02:16:09.310 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015837766999999999, 2024-04-19T02:16:09.310 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:09.311 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:09.311 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:09.311 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.311 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:09.311 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270159+0000", 2024-04-19T02:16:09.311 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:09.311 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.311 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.311 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:09.311 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270159+0000", 2024-04-19T02:16:09.311 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:09.311 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.311 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.311 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:09.311 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270158+0000", 2024-04-19T02:16:09.312 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:09.312 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.312 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.312 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:09.312 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270171+0000", 2024-04-19T02:16:09.312 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.3050999999999999e-05 2024-04-19T02:16:09.312 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.312 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.312 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:09.312 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270187+0000", 2024-04-19T02:16:09.312 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.6351999999999999e-05 2024-04-19T02:16:09.312 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.312 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.312 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:09.312 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270203+0000", 2024-04-19T02:16:09.313 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.6056e-05 2024-04-19T02:16:09.313 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.313 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.313 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:09.313 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.271261+0000", 2024-04-19T02:16:09.313 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0010576520000000001 2024-04-19T02:16:09.313 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.313 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.313 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:09.313 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.271385+0000", 2024-04-19T02:16:09.313 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012376800000000001 2024-04-19T02:16:09.313 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.313 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.313 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:09.314 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.271539+0000", 2024-04-19T02:16:09.314 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00015414000000000001 2024-04-19T02:16:09.314 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.314 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.314 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:09.314 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.275422+0000", 2024-04-19T02:16:09.314 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.003883507 2024-04-19T02:16:09.314 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.314 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.314 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:09.314 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.285870+0000", 2024-04-19T02:16:09.314 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.010447700000000001 2024-04-19T02:16:09.314 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.314 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.315 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:09.315 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.285947+0000", 2024-04-19T02:16:09.315 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.7429999999999996e-05 2024-04-19T02:16:09.315 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.315 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.315 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:09.315 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.285997+0000", 2024-04-19T02:16:09.315 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.9666999999999997e-05 2024-04-19T02:16:09.315 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:09.315 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:09.315 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:09.315 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.315 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.315 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:09.315 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:29.270219+0000", 2024-04-19T02:16:09.316 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 40.038367833999999, 2024-04-19T02:16:09.316 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015932135, 2024-04-19T02:16:09.316 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:09.316 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:09.316 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:09.316 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.316 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:09.316 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270219+0000", 2024-04-19T02:16:09.316 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:09.316 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.316 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.316 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:09.316 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270219+0000", 2024-04-19T02:16:09.316 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:09.317 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.317 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.317 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:09.317 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270218+0000", 2024-04-19T02:16:09.317 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:09.317 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.317 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.317 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:09.317 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270223+0000", 2024-04-19T02:16:09.317 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.6090000000000003e-06 2024-04-19T02:16:09.317 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.317 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.317 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:09.317 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270230+0000", 2024-04-19T02:16:09.317 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.9929999999999998e-06 2024-04-19T02:16:09.318 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.318 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.318 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:09.318 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270237+0000", 2024-04-19T02:16:09.318 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.9990000000000002e-06 2024-04-19T02:16:09.318 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.318 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.318 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:09.318 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.272960+0000", 2024-04-19T02:16:09.318 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0027234730000000001 2024-04-19T02:16:09.318 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.318 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.318 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:09.318 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.273062+0000", 2024-04-19T02:16:09.319 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000102043 2024-04-19T02:16:09.319 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.319 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.319 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:09.319 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.273578+0000", 2024-04-19T02:16:09.319 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00051574499999999996 2024-04-19T02:16:09.319 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.319 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.319 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:09.319 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.277063+0000", 2024-04-19T02:16:09.319 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0034846109999999999 2024-04-19T02:16:09.319 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.319 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.319 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:09.319 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286077+0000", 2024-04-19T02:16:09.319 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0090144509999999997 2024-04-19T02:16:09.320 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.320 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.320 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:09.320 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286115+0000", 2024-04-19T02:16:09.320 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.7710999999999999e-05 2024-04-19T02:16:09.320 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.320 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.320 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:09.320 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286151+0000", 2024-04-19T02:16:09.320 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6049e-05 2024-04-19T02:16:09.320 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:09.320 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:09.320 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:09.320 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.321 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.321 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(mds.0.3:15 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:09.321 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:29.270244+0000", 2024-04-19T02:16:09.321 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 40.038342647999997, 2024-04-19T02:16:09.321 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015030304, 2024-04-19T02:16:09.321 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:09.321 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:09.321 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:09.321 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.321 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:09.321 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270244+0000", 2024-04-19T02:16:09.321 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:09.321 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.321 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.321 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:09.322 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270244+0000", 2024-04-19T02:16:09.322 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:09.322 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.322 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.322 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:09.322 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270244+0000", 2024-04-19T02:16:09.322 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:09.322 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.322 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.322 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:09.322 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270248+0000", 2024-04-19T02:16:09.322 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.2139999999999998e-06 2024-04-19T02:16:09.322 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.322 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.323 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:09.323 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270256+0000", 2024-04-19T02:16:09.323 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.8650000000000001e-06 2024-04-19T02:16:09.323 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.323 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.323 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:09.323 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270265+0000", 2024-04-19T02:16:09.323 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.8210000000000008e-06 2024-04-19T02:16:09.323 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.323 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.323 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:09.323 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.273182+0000", 2024-04-19T02:16:09.323 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0029179420000000002 2024-04-19T02:16:09.323 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.324 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.324 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:09.324 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.273653+0000", 2024-04-19T02:16:09.324 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00047090700000000001 2024-04-19T02:16:09.324 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.324 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.324 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:09.324 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.273818+0000", 2024-04-19T02:16:09.324 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000164382 2024-04-19T02:16:09.324 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.324 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.324 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:09.324 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.278281+0000", 2024-04-19T02:16:09.324 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0044635059999999999 2024-04-19T02:16:09.324 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.325 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.325 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:09.325 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.285194+0000", 2024-04-19T02:16:09.325 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0069127420000000004 2024-04-19T02:16:09.325 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.325 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.325 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:09.325 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.285237+0000", 2024-04-19T02:16:09.325 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.3448000000000001e-05 2024-04-19T02:16:09.325 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.325 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.325 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:09.325 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.285274+0000", 2024-04-19T02:16:09.325 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6921000000000001e-05 2024-04-19T02:16:09.325 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:09.325 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:09.326 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:09.326 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.326 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.326 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:09.326 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:29.270271+0000", 2024-04-19T02:16:09.326 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 40.038315677, 2024-04-19T02:16:09.326 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015123286999999999, 2024-04-19T02:16:09.326 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:09.326 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:09.326 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:09.326 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.326 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:09.326 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270271+0000", 2024-04-19T02:16:09.326 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:09.326 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.327 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.327 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:09.327 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270271+0000", 2024-04-19T02:16:09.327 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:09.327 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.327 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.327 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:09.327 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270271+0000", 2024-04-19T02:16:09.327 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:09.327 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.327 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.327 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:09.327 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270279+0000", 2024-04-19T02:16:09.327 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.2490000000000001e-06 2024-04-19T02:16:09.328 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.328 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.328 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:09.328 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270287+0000", 2024-04-19T02:16:09.328 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.8979999999999996e-06 2024-04-19T02:16:09.328 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.328 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.328 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:09.328 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270299+0000", 2024-04-19T02:16:09.328 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.24e-05 2024-04-19T02:16:09.328 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.328 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.328 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:09.328 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.274674+0000", 2024-04-19T02:16:09.328 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0043751429999999997 2024-04-19T02:16:09.328 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.328 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.329 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:09.329 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.274754+0000", 2024-04-19T02:16:09.329 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.9362000000000004e-05 2024-04-19T02:16:09.329 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.329 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.329 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:09.329 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.274918+0000", 2024-04-19T02:16:09.329 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000164616 2024-04-19T02:16:09.329 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.329 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.329 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:09.329 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.278603+0000", 2024-04-19T02:16:09.329 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0036852370000000001 2024-04-19T02:16:09.329 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.329 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.329 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:09.330 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.285314+0000", 2024-04-19T02:16:09.330 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0067103240000000001 2024-04-19T02:16:09.330 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.330 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.330 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:09.330 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.285357+0000", 2024-04-19T02:16:09.330 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.3288999999999998e-05 2024-04-19T02:16:09.330 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.330 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.330 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:09.330 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.285394+0000", 2024-04-19T02:16:09.330 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.7199000000000001e-05 2024-04-19T02:16:09.330 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:09.330 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:09.330 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:09.331 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.331 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.331 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(mds.0.3:16 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:09.331 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:29.270306+0000", 2024-04-19T02:16:09.331 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 40.038280397999998, 2024-04-19T02:16:09.331 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016306661, 2024-04-19T02:16:09.331 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:09.331 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:09.331 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:09.331 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.331 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:09.331 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270306+0000", 2024-04-19T02:16:09.331 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:09.331 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.331 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.331 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:09.331 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270306+0000", 2024-04-19T02:16:09.332 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:09.332 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.332 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.332 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:09.332 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270306+0000", 2024-04-19T02:16:09.332 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:09.332 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.332 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.332 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:09.332 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270310+0000", 2024-04-19T02:16:09.332 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.0990000000000001e-06 2024-04-19T02:16:09.332 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.332 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.332 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:09.333 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270317+0000", 2024-04-19T02:16:09.333 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.7100000000000001e-06 2024-04-19T02:16:09.333 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.333 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.333 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:09.333 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270324+0000", 2024-04-19T02:16:09.333 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.374e-06 2024-04-19T02:16:09.333 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.333 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.333 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:09.333 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.274312+0000", 2024-04-19T02:16:09.333 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0039885140000000003 2024-04-19T02:16:09.333 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.333 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.333 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:09.333 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.274737+0000", 2024-04-19T02:16:09.333 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00042410899999999999 2024-04-19T02:16:09.333 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.334 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.334 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:09.334 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.274893+0000", 2024-04-19T02:16:09.334 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00015594599999999999 2024-04-19T02:16:09.334 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.334 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.334 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:09.334 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.278597+0000", 2024-04-19T02:16:09.334 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0037046869999999999 2024-04-19T02:16:09.334 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.334 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.334 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:09.334 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286522+0000", 2024-04-19T02:16:09.334 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0079243809999999994 2024-04-19T02:16:09.334 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.334 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.335 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:09.335 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286576+0000", 2024-04-19T02:16:09.335 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.4728999999999997e-05 2024-04-19T02:16:09.335 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.335 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.335 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:09.335 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286613+0000", 2024-04-19T02:16:09.335 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6661e-05 2024-04-19T02:16:09.335 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:09.335 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:09.335 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:09.335 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.335 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.335 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(mds.0.3:18 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:09.335 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:29.270329+0000", 2024-04-19T02:16:09.335 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 40.038257911000002, 2024-04-19T02:16:09.336 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016172755, 2024-04-19T02:16:09.336 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:09.336 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:09.336 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:09.336 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.336 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:09.336 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270329+0000", 2024-04-19T02:16:09.336 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:09.336 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.336 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.336 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:09.336 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270329+0000", 2024-04-19T02:16:09.336 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:09.336 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.337 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.337 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:09.337 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270328+0000", 2024-04-19T02:16:09.337 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:09.337 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.337 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.337 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:09.337 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270331+0000", 2024-04-19T02:16:09.337 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.9629999999999998e-06 2024-04-19T02:16:09.337 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.337 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.337 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:09.337 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270338+0000", 2024-04-19T02:16:09.337 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.1410000000000002e-06 2024-04-19T02:16:09.337 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.338 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.338 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:09.338 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270344+0000", 2024-04-19T02:16:09.338 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.7410000000000003e-06 2024-04-19T02:16:09.338 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.338 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.338 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:09.338 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270418+0000", 2024-04-19T02:16:09.338 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.3598999999999998e-05 2024-04-19T02:16:09.338 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.338 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.338 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:09.338 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270623+0000", 2024-04-19T02:16:09.338 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00020499599999999999 2024-04-19T02:16:09.338 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.339 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.339 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:09.339 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.271086+0000", 2024-04-19T02:16:09.339 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00046345199999999999 2024-04-19T02:16:09.339 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.339 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.339 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:09.339 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.276220+0000", 2024-04-19T02:16:09.339 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0051338490000000002 2024-04-19T02:16:09.339 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.339 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.339 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:09.339 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286426+0000", 2024-04-19T02:16:09.339 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.010205982000000001 2024-04-19T02:16:09.340 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.340 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.340 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:09.340 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286461+0000", 2024-04-19T02:16:09.340 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.5280000000000001e-05 2024-04-19T02:16:09.340 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.340 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.340 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:09.340 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286502+0000", 2024-04-19T02:16:09.340 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.0102000000000003e-05 2024-04-19T02:16:09.340 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:09.340 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:09.340 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:09.340 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.341 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.341 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(mds.0.3:23 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:09.341 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:29.270358+0000", 2024-04-19T02:16:09.341 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 40.038229190000003, 2024-04-19T02:16:09.341 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016257511999999998, 2024-04-19T02:16:09.341 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:09.341 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:09.341 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:09.341 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.342 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:09.342 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270358+0000", 2024-04-19T02:16:09.342 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:09.342 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.342 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.342 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:09.342 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270358+0000", 2024-04-19T02:16:09.342 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:09.342 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.342 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.342 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:09.342 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270357+0000", 2024-04-19T02:16:09.342 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:09.342 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.343 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.343 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:09.343 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270360+0000", 2024-04-19T02:16:09.343 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.106e-06 2024-04-19T02:16:09.343 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.343 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.343 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:09.343 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270368+0000", 2024-04-19T02:16:09.343 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.6279999999999996e-06 2024-04-19T02:16:09.343 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.343 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.343 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:09.343 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270373+0000", 2024-04-19T02:16:09.343 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.1410000000000004e-06 2024-04-19T02:16:09.344 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.344 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.344 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:09.344 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.271505+0000", 2024-04-19T02:16:09.344 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0011319069999999999 2024-04-19T02:16:09.344 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.344 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.344 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:09.344 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.271652+0000", 2024-04-19T02:16:09.344 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00014698399999999999 2024-04-19T02:16:09.344 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.344 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.344 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:09.344 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286615+0000", 2024-04-19T02:16:09.344 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.014963156999999999 2024-04-19T02:16:09.345 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:09.345 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:09.345 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:09.345 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.345 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.345 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(mds.0.3:24 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:09.345 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:29.270411+0000", 2024-04-19T02:16:09.345 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 40.038176198000002, 2024-04-19T02:16:09.345 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016334762999999999, 2024-04-19T02:16:09.345 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:09.345 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:09.345 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:09.345 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.345 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:09.346 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270411+0000", 2024-04-19T02:16:09.346 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:09.346 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.346 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.346 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:09.346 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270411+0000", 2024-04-19T02:16:09.346 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:09.346 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.346 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.346 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:09.346 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270410+0000", 2024-04-19T02:16:09.346 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:09.346 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.346 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.347 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:09.347 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270413+0000", 2024-04-19T02:16:09.347 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.303e-06 2024-04-19T02:16:09.347 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.347 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.347 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:09.347 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270421+0000", 2024-04-19T02:16:09.347 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.3769999999999998e-06 2024-04-19T02:16:09.347 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.347 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.347 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:09.347 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270429+0000", 2024-04-19T02:16:09.347 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.6740000000000003e-06 2024-04-19T02:16:09.347 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.347 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.348 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:09.348 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.275527+0000", 2024-04-19T02:16:09.348 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0050975869999999998 2024-04-19T02:16:09.348 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.348 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.348 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:09.348 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.275946+0000", 2024-04-19T02:16:09.348 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00041882699999999998 2024-04-19T02:16:09.348 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.348 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.348 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:09.348 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286745+0000", 2024-04-19T02:16:09.348 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.010799477 2024-04-19T02:16:09.348 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:09.349 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:09.349 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:09.349 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.349 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.349 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:2290 5.5 5:a870a399:::benchmark_data_smithi121_44835_object2289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:16:09.349 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:55.645524+0000", 2024-04-19T02:16:09.349 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 13.663062847999999, 2024-04-19T02:16:09.349 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.018181836999999999, 2024-04-19T02:16:09.349 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:09.349 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:09.349 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:09.349 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:09.349 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:09.349 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 2290 2024-04-19T02:16:09.349 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.350 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:09.350 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.350 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:09.350 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645524+0000", 2024-04-19T02:16:09.350 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:09.350 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.350 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.350 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:09.350 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645524+0000", 2024-04-19T02:16:09.350 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:09.350 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.350 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.350 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:09.350 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645524+0000", 2024-04-19T02:16:09.351 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:09.351 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.351 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.351 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:09.351 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645603+0000", 2024-04-19T02:16:09.351 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.9983999999999999e-05 2024-04-19T02:16:09.351 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.351 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.351 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:09.351 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645609+0000", 2024-04-19T02:16:09.351 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.5500000000000002e-06 2024-04-19T02:16:09.351 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.351 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.351 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:09.351 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645613+0000", 2024-04-19T02:16:09.351 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.591e-06 2024-04-19T02:16:09.352 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.352 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.352 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:09.352 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645649+0000", 2024-04-19T02:16:09.352 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6769e-05 2024-04-19T02:16:09.352 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.352 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.352 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:09.352 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645765+0000", 2024-04-19T02:16:09.352 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00011593499999999999 2024-04-19T02:16:09.352 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.352 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.352 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:09.352 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645899+0000", 2024-04-19T02:16:09.352 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00013329499999999999 2024-04-19T02:16:09.353 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.353 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.353 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:09.353 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.649261+0000", 2024-04-19T02:16:09.353 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0033619639999999998 2024-04-19T02:16:09.353 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.353 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.353 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:09.353 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.663657+0000", 2024-04-19T02:16:09.353 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.014396137999999999 2024-04-19T02:16:09.353 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.353 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.353 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:09.353 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.663686+0000", 2024-04-19T02:16:09.353 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.8841999999999999e-05 2024-04-19T02:16:09.354 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.354 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.354 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:09.354 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.663706+0000", 2024-04-19T02:16:09.354 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.0108000000000001e-05 2024-04-19T02:16:09.354 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:09.354 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:09.354 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:09.354 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.354 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.354 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:2296 5.5 5:a5d39efa:::benchmark_data_smithi121_44835_object2295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:16:09.355 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:55.646720+0000", 2024-04-19T02:16:09.355 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 13.661867054, 2024-04-19T02:16:09.355 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.017072077000000001, 2024-04-19T02:16:09.355 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:09.355 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:09.355 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:09.355 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:09.355 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:09.355 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 2296 2024-04-19T02:16:09.355 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.356 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:09.356 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.356 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:09.356 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646720+0000", 2024-04-19T02:16:09.356 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:09.356 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.356 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.356 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:09.356 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646720+0000", 2024-04-19T02:16:09.356 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:09.356 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.356 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.356 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:09.356 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646719+0000", 2024-04-19T02:16:09.357 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:09.357 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.357 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.357 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:09.357 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646778+0000", 2024-04-19T02:16:09.357 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.9264e-05 2024-04-19T02:16:09.357 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.357 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.357 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:09.357 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646792+0000", 2024-04-19T02:16:09.357 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.3573e-05 2024-04-19T02:16:09.357 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.357 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.357 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:09.357 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646797+0000", 2024-04-19T02:16:09.358 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.3190000000000002e-06 2024-04-19T02:16:09.358 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.358 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.358 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:09.358 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646826+0000", 2024-04-19T02:16:09.358 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.8787999999999999e-05 2024-04-19T02:16:09.358 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.358 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.358 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:09.358 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646913+0000", 2024-04-19T02:16:09.358 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.7601000000000004e-05 2024-04-19T02:16:09.358 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.358 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.358 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:09.359 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646996+0000", 2024-04-19T02:16:09.359 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.2237000000000006e-05 2024-04-19T02:16:09.359 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.359 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.359 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:09.359 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.649533+0000", 2024-04-19T02:16:09.359 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.002537564 2024-04-19T02:16:09.359 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.359 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.359 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:09.359 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.663741+0000", 2024-04-19T02:16:09.359 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.014207322 2024-04-19T02:16:09.359 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.359 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.359 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:09.359 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.663771+0000", 2024-04-19T02:16:09.360 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.0324e-05 2024-04-19T02:16:09.360 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.360 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.360 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:09.360 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.663792+0000", 2024-04-19T02:16:09.360 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.0778999999999999e-05 2024-04-19T02:16:09.360 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:09.360 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:09.360 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:09.360 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.360 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.360 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:16497 5.c 5:3cb287d4:::benchmark_data_smithi121_44835_object16496:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:09.360 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:59.873454+0000", 2024-04-19T02:16:09.360 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 9.4351331050000002, 2024-04-19T02:16:09.360 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.017103489999999999, 2024-04-19T02:16:09.360 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:09.361 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:09.361 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:09.361 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:09.361 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:09.361 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 16497 2024-04-19T02:16:09.361 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.361 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:09.361 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.361 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:09.361 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873454+0000", 2024-04-19T02:16:09.361 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:09.361 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.361 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.361 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:09.361 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873454+0000", 2024-04-19T02:16:09.362 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:09.362 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.362 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.362 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:09.362 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873453+0000", 2024-04-19T02:16:09.362 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:09.362 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.362 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.362 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:09.363 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873512+0000", 2024-04-19T02:16:09.363 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.8730999999999997e-05 2024-04-19T02:16:09.363 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.363 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.363 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:09.363 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873518+0000", 2024-04-19T02:16:09.363 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.9789999999999998e-06 2024-04-19T02:16:09.363 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.363 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.363 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:09.363 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873522+0000", 2024-04-19T02:16:09.363 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.0570000000000003e-06 2024-04-19T02:16:09.363 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.363 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.363 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:09.363 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873590+0000", 2024-04-19T02:16:09.364 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.8504999999999995e-05 2024-04-19T02:16:09.364 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.364 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.364 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:09.364 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873709+0000", 2024-04-19T02:16:09.364 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000118497 2024-04-19T02:16:09.364 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.364 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.364 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:09.364 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873881+0000", 2024-04-19T02:16:09.364 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000172129 2024-04-19T02:16:09.364 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.364 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.364 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:09.364 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.874627+0000", 2024-04-19T02:16:09.364 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00074580100000000004 2024-04-19T02:16:09.365 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.365 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.365 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:09.365 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.890478+0000", 2024-04-19T02:16:09.365 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015850672 2024-04-19T02:16:09.365 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.365 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.365 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:09.365 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.890522+0000", 2024-04-19T02:16:09.365 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.4376000000000003e-05 2024-04-19T02:16:09.365 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.365 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.365 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:09.365 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.890557+0000", 2024-04-19T02:16:09.365 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.5151999999999998e-05 2024-04-19T02:16:09.365 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:09.365 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:09.366 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:09.366 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.366 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.366 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:18635 5.c 5:3691d6fb:::benchmark_data_smithi121_44835_object18634:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:09.366 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:00.547499+0000", 2024-04-19T02:16:09.366 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 8.7610878830000001, 2024-04-19T02:16:09.366 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015584394, 2024-04-19T02:16:09.366 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:09.366 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:09.366 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:09.366 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:09.366 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:09.366 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 18635 2024-04-19T02:16:09.366 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.366 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:09.367 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.367 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:09.367 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.547499+0000", 2024-04-19T02:16:09.367 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:09.367 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.367 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.367 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:09.367 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.547499+0000", 2024-04-19T02:16:09.367 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:09.367 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.367 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.367 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:09.367 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.547499+0000", 2024-04-19T02:16:09.367 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:09.367 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.367 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.368 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:09.368 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.547592+0000", 2024-04-19T02:16:09.368 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.3144000000000001e-05 2024-04-19T02:16:09.368 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.368 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.368 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:09.368 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.547598+0000", 2024-04-19T02:16:09.368 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.0390000000000001e-06 2024-04-19T02:16:09.368 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.368 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.368 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:09.368 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.547601+0000", 2024-04-19T02:16:09.368 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.5389999999999999e-06 2024-04-19T02:16:09.368 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.368 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.368 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:09.368 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.548268+0000", 2024-04-19T02:16:09.369 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00066695700000000003 2024-04-19T02:16:09.369 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.369 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.369 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:09.369 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.548384+0000", 2024-04-19T02:16:09.369 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000115562 2024-04-19T02:16:09.369 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.369 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.369 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:09.369 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.548510+0000", 2024-04-19T02:16:09.369 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012620900000000001 2024-04-19T02:16:09.369 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.369 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.369 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:09.370 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.549792+0000", 2024-04-19T02:16:09.370 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00128213 2024-04-19T02:16:09.370 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.370 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.370 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:09.370 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.563011+0000", 2024-04-19T02:16:09.370 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.013219244 2024-04-19T02:16:09.370 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.370 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.370 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:09.370 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.563050+0000", 2024-04-19T02:16:09.371 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.8448999999999997e-05 2024-04-19T02:16:09.371 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.371 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.371 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:09.371 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.563083+0000", 2024-04-19T02:16:09.371 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.3402000000000003e-05 2024-04-19T02:16:09.371 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:09.371 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:09.371 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:09.371 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.371 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.371 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:18796 5.3 5:cca224f1:::benchmark_data_smithi121_44835_object18795:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:09.371 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:00.596456+0000", 2024-04-19T02:16:09.371 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 8.7121308190000004, 2024-04-19T02:16:09.371 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015251391, 2024-04-19T02:16:09.372 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:09.372 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:09.372 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:09.372 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:09.372 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:09.372 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 18796 2024-04-19T02:16:09.372 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.372 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:09.372 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.372 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:09.372 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.596456+0000", 2024-04-19T02:16:09.372 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:09.372 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.372 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.373 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:09.373 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.596456+0000", 2024-04-19T02:16:09.373 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:09.373 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.373 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.373 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:09.373 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.596455+0000", 2024-04-19T02:16:09.373 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:09.373 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.373 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.373 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:09.373 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.596531+0000", 2024-04-19T02:16:09.373 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.5585000000000002e-05 2024-04-19T02:16:09.373 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.373 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.374 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:09.374 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.596540+0000", 2024-04-19T02:16:09.374 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.5820000000000008e-06 2024-04-19T02:16:09.374 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.374 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.374 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:09.374 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.596548+0000", 2024-04-19T02:16:09.374 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.3869999999999997e-06 2024-04-19T02:16:09.374 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.374 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.374 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:09.374 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.599086+0000", 2024-04-19T02:16:09.375 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.002538135 2024-04-19T02:16:09.375 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.375 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.375 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:09.375 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.599202+0000", 2024-04-19T02:16:09.375 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000115605 2024-04-19T02:16:09.375 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.375 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.375 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:09.375 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.599326+0000", 2024-04-19T02:16:09.375 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012427900000000001 2024-04-19T02:16:09.375 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.375 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.375 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:09.376 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.602295+0000", 2024-04-19T02:16:09.376 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0029694719999999999 2024-04-19T02:16:09.376 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.376 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.376 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:09.376 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.611625+0000", 2024-04-19T02:16:09.376 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0093301180000000001 2024-04-19T02:16:09.376 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.376 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.376 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:09.376 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.611670+0000", 2024-04-19T02:16:09.376 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.4366999999999997e-05 2024-04-19T02:16:09.376 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.376 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.376 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:09.377 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.611707+0000", 2024-04-19T02:16:09.377 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.7518999999999998e-05 2024-04-19T02:16:09.377 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:09.377 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:09.377 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:09.377 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.377 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.377 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:20553 5.5 5:a3f892a2:::benchmark_data_smithi121_44835_object20552:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:09.377 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:01.179670+0000", 2024-04-19T02:16:09.377 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 8.1289162239999992, 2024-04-19T02:16:09.377 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.01588498, 2024-04-19T02:16:09.377 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:09.377 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:09.377 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:09.377 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:09.378 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:09.378 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 20553 2024-04-19T02:16:09.378 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.378 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:09.378 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.378 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:09.378 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.179670+0000", 2024-04-19T02:16:09.378 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:09.378 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.378 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.378 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:09.378 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.179670+0000", 2024-04-19T02:16:09.378 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:09.378 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.378 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.379 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:09.379 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.179670+0000", 2024-04-19T02:16:09.379 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:09.379 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.379 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.379 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:09.379 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.179698+0000", 2024-04-19T02:16:09.379 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.7849999999999999e-05 2024-04-19T02:16:09.379 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.379 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.379 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:09.379 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.179710+0000", 2024-04-19T02:16:09.379 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.1992e-05 2024-04-19T02:16:09.379 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.379 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.380 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:09.380 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.179717+0000", 2024-04-19T02:16:09.380 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.7400000000000004e-06 2024-04-19T02:16:09.380 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.380 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.380 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:09.380 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.179760+0000", 2024-04-19T02:16:09.380 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.2169999999999998e-05 2024-04-19T02:16:09.380 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.380 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.380 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:09.380 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.179876+0000", 2024-04-19T02:16:09.380 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000116972 2024-04-19T02:16:09.380 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.380 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.381 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:09.381 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.180055+0000", 2024-04-19T02:16:09.381 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00017899100000000001 2024-04-19T02:16:09.381 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.381 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.381 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:09.381 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.183338+0000", 2024-04-19T02:16:09.381 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0032824719999999998 2024-04-19T02:16:09.381 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.381 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.381 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:09.381 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.195464+0000", 2024-04-19T02:16:09.381 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.012126504999999999 2024-04-19T02:16:09.381 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.381 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.381 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:09.382 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.195516+0000", 2024-04-19T02:16:09.382 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.1622000000000001e-05 2024-04-19T02:16:09.382 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.382 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.382 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:09.382 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.195555+0000", 2024-04-19T02:16:09.382 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.9366999999999998e-05 2024-04-19T02:16:09.382 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:09.382 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:09.382 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:09.382 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.382 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.382 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:32982 5.c 5:34483e6c:::benchmark_data_smithi121_44835_object32981:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-19T02:16:09.382 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:05.451717+0000", 2024-04-19T02:16:09.383 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 3.8568698530000001, 2024-04-19T02:16:09.383 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015737741, 2024-04-19T02:16:09.383 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:09.383 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:09.383 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:09.383 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:09.383 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:09.383 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 32982 2024-04-19T02:16:09.383 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.383 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:09.383 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.383 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:09.383 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:05.451717+0000", 2024-04-19T02:16:09.383 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:09.383 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.384 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.384 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:09.384 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:05.451717+0000", 2024-04-19T02:16:09.384 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:09.384 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.384 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.384 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:09.384 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:05.451716+0000", 2024-04-19T02:16:09.384 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:09.384 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.384 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.384 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:09.384 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:05.451791+0000", 2024-04-19T02:16:09.384 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.5321999999999995e-05 2024-04-19T02:16:09.384 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.385 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.385 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:09.385 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:05.451800+0000", 2024-04-19T02:16:09.385 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.901e-06 2024-04-19T02:16:09.385 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.385 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.385 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:09.385 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:05.451807+0000", 2024-04-19T02:16:09.385 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.28e-06 2024-04-19T02:16:09.385 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.385 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.385 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:09.385 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:05.456226+0000", 2024-04-19T02:16:09.385 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0044192540000000001 2024-04-19T02:16:09.385 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.386 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.386 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:09.386 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:05.456313+0000", 2024-04-19T02:16:09.386 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.6729000000000003e-05 2024-04-19T02:16:09.386 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.386 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.386 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:09.386 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:05.456441+0000", 2024-04-19T02:16:09.386 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012880699999999999 2024-04-19T02:16:09.386 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.386 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.386 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:09.386 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:05.464380+0000", 2024-04-19T02:16:09.386 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0079384829999999997 2024-04-19T02:16:09.386 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.387 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.387 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:09.387 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:05.467375+0000", 2024-04-19T02:16:09.387 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0029951610000000001 2024-04-19T02:16:09.387 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.387 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.387 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:09.387 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:05.467416+0000", 2024-04-19T02:16:09.387 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.1325000000000002e-05 2024-04-19T02:16:09.387 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.387 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.387 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:09.387 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:05.467455+0000", 2024-04-19T02:16:09.387 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.8158999999999998e-05 2024-04-19T02:16:09.387 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:09.387 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:09.388 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:09.388 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.388 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.388 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:41329 5.6 5:6c982e85:::benchmark_data_smithi121_44835_object41328:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:09.388 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:08.706619+0000", 2024-04-19T02:16:09.388 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.60196750899999996, 2024-04-19T02:16:09.388 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015090447, 2024-04-19T02:16:09.388 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:09.388 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:09.388 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:09.388 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:09.388 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:09.388 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 41329 2024-04-19T02:16:09.388 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.388 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:09.389 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.389 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:09.389 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.706619+0000", 2024-04-19T02:16:09.389 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:09.389 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.389 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.389 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:09.389 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.706619+0000", 2024-04-19T02:16:09.389 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:09.389 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.389 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.389 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:09.389 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.706615+0000", 2024-04-19T02:16:09.389 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999952 2024-04-19T02:16:09.389 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.389 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.390 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:09.390 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.706712+0000", 2024-04-19T02:16:09.390 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.7151000000000005e-05 2024-04-19T02:16:09.390 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.390 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.390 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:09.390 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.706719+0000", 2024-04-19T02:16:09.390 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.0600000000000002e-06 2024-04-19T02:16:09.390 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.390 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.390 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:09.390 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.706724+0000", 2024-04-19T02:16:09.390 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.3940000000000004e-06 2024-04-19T02:16:09.390 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.390 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.391 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:09.391 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.710585+0000", 2024-04-19T02:16:09.391 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0038609859999999998 2024-04-19T02:16:09.391 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.391 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.391 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:09.391 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.710715+0000", 2024-04-19T02:16:09.391 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012972600000000001 2024-04-19T02:16:09.391 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.391 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.391 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:09.391 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.710812+0000", 2024-04-19T02:16:09.391 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.7322000000000001e-05 2024-04-19T02:16:09.391 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.391 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.391 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:09.391 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.713186+0000", 2024-04-19T02:16:09.392 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0023735280000000002 2024-04-19T02:16:09.392 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.392 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.392 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:09.392 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.721622+0000", 2024-04-19T02:16:09.392 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0084366430000000006 2024-04-19T02:16:09.392 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.392 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.392 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:09.392 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.721673+0000", 2024-04-19T02:16:09.392 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.0556999999999997e-05 2024-04-19T02:16:09.392 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.392 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.392 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:09.392 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:08.721710+0000", 2024-04-19T02:16:09.392 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6770000000000002e-05 2024-04-19T02:16:09.393 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:09.393 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:09.393 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:09.393 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.393 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.393 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:42115 5.6 5:61e6399d:::benchmark_data_smithi121_44835_object42114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:09.393 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:09.021513+0000", 2024-04-19T02:16:09.393 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.28707339999999998, 2024-04-19T02:16:09.393 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015878396999999999, 2024-04-19T02:16:09.393 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:09.393 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:09.393 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:09.393 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:09.393 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:09.393 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 42115 2024-04-19T02:16:09.394 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.394 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:09.394 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.394 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:09.394 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.021513+0000", 2024-04-19T02:16:09.394 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:09.394 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.394 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.394 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:09.394 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.021513+0000", 2024-04-19T02:16:09.394 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:09.394 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.394 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.394 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:09.395 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.021512+0000", 2024-04-19T02:16:09.395 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:09.395 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.395 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.395 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:09.395 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.021539+0000", 2024-04-19T02:16:09.395 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.6383000000000001e-05 2024-04-19T02:16:09.395 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.395 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.395 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:09.395 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.021549+0000", 2024-04-19T02:16:09.395 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0115000000000001e-05 2024-04-19T02:16:09.395 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.395 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.395 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:09.396 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.021555+0000", 2024-04-19T02:16:09.396 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.3740000000000003e-06 2024-04-19T02:16:09.396 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.396 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.396 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:09.396 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.025711+0000", 2024-04-19T02:16:09.396 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0041556170000000003 2024-04-19T02:16:09.396 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.396 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.396 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:09.396 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.025885+0000", 2024-04-19T02:16:09.396 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00017444499999999999 2024-04-19T02:16:09.396 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.396 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.396 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:09.396 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.025981+0000", 2024-04-19T02:16:09.396 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.5427000000000006e-05 2024-04-19T02:16:09.397 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.397 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.397 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:09.397 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.034992+0000", 2024-04-19T02:16:09.397 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0090113309999999992 2024-04-19T02:16:09.397 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.397 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.397 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:09.397 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.037309+0000", 2024-04-19T02:16:09.397 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.002316519 2024-04-19T02:16:09.397 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.397 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.397 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:09.397 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.037357+0000", 2024-04-19T02:16:09.397 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.8528e-05 2024-04-19T02:16:09.397 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.397 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.398 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:09.398 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.037392+0000", 2024-04-19T02:16:09.398 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.4489999999999997e-05 2024-04-19T02:16:09.398 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:09.398 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:09.398 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:09.398 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.398 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.398 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:42294 5.6 5:600ebb50:::benchmark_data_smithi121_44835_object42293:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:09.398 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:09.092618+0000", 2024-04-19T02:16:09.398 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.21596821799999999, 2024-04-19T02:16:09.398 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015594693, 2024-04-19T02:16:09.398 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:09.398 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:09.398 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:09.399 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:09.399 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:09.399 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 42294 2024-04-19T02:16:09.399 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.399 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:09.399 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.399 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:09.399 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.092618+0000", 2024-04-19T02:16:09.399 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:09.399 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.399 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.399 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:09.399 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.092618+0000", 2024-04-19T02:16:09.399 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:09.400 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.400 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.400 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:09.400 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.092618+0000", 2024-04-19T02:16:09.400 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:09.400 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.400 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.400 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:09.400 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.092676+0000", 2024-04-19T02:16:09.400 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.8301000000000003e-05 2024-04-19T02:16:09.400 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.400 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.400 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:09.400 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.092688+0000", 2024-04-19T02:16:09.400 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.2179e-05 2024-04-19T02:16:09.401 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.401 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.401 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:09.401 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.092696+0000", 2024-04-19T02:16:09.401 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.5460000000000003e-06 2024-04-19T02:16:09.401 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.401 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.401 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:09.401 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.093848+0000", 2024-04-19T02:16:09.401 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00115245 2024-04-19T02:16:09.401 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.401 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.401 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:09.401 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.093975+0000", 2024-04-19T02:16:09.401 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012678599999999999 2024-04-19T02:16:09.401 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.402 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.402 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:09.402 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.094116+0000", 2024-04-19T02:16:09.402 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00014102599999999999 2024-04-19T02:16:09.402 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.402 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.402 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:09.402 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.096305+0000", 2024-04-19T02:16:09.402 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0021888350000000001 2024-04-19T02:16:09.402 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.402 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.402 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:09.402 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.108141+0000", 2024-04-19T02:16:09.402 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.011835930999999999 2024-04-19T02:16:09.402 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.403 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.403 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:09.403 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.108179+0000", 2024-04-19T02:16:09.403 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.8722e-05 2024-04-19T02:16:09.403 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.403 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.403 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:09.403 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.108213+0000", 2024-04-19T02:16:09.403 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.3707000000000001e-05 2024-04-19T02:16:09.403 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:09.403 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:09.403 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:09.403 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.403 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.403 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:42714 5.c 5:32899b28:::benchmark_data_smithi121_44835_object42713:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:09.403 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:09.266429+0000", 2024-04-19T02:16:09.404 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.042158097999999998, 2024-04-19T02:16:09.404 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.017445751999999998, 2024-04-19T02:16:09.404 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:09.404 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:09.404 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:09.404 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:09.404 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:09.404 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 42714 2024-04-19T02:16:09.404 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.404 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:09.404 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.404 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:09.404 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.266429+0000", 2024-04-19T02:16:09.404 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:09.404 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.405 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.405 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:09.405 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.266429+0000", 2024-04-19T02:16:09.405 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:09.405 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.405 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.405 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:09.405 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.266428+0000", 2024-04-19T02:16:09.405 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:09.405 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.405 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.405 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:09.405 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.266523+0000", 2024-04-19T02:16:09.405 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.4913000000000004e-05 2024-04-19T02:16:09.405 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.405 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.406 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:09.406 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.266535+0000", 2024-04-19T02:16:09.406 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.2187e-05 2024-04-19T02:16:09.406 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.406 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.406 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:09.406 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.266542+0000", 2024-04-19T02:16:09.406 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.7139999999999993e-06 2024-04-19T02:16:09.406 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.406 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.406 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:09.406 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.267446+0000", 2024-04-19T02:16:09.406 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00090385699999999999 2024-04-19T02:16:09.406 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.407 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.407 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:09.407 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.267570+0000", 2024-04-19T02:16:09.407 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012405599999999999 2024-04-19T02:16:09.407 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.407 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.407 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:09.407 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.267733+0000", 2024-04-19T02:16:09.407 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000162225 2024-04-19T02:16:09.407 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.407 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.407 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:09.407 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.275131+0000", 2024-04-19T02:16:09.407 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0073988639999999998 2024-04-19T02:16:09.407 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.408 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.408 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:09.408 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.283761+0000", 2024-04-19T02:16:09.408 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0086299989999999993 2024-04-19T02:16:09.408 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.408 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.408 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:09.408 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.283824+0000", 2024-04-19T02:16:09.408 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.2632000000000006e-05 2024-04-19T02:16:09.408 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.408 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.408 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:09.408 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.283874+0000", 2024-04-19T02:16:09.408 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.0290999999999997e-05 2024-04-19T02:16:09.408 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:09.408 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:09.409 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:09.409 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.409 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.409 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:42724 5.0 e23/16 5:0d0b7b99:::benchmark_data_smithi121_44835_object42723:head v 23'2565, mlcod=23'2563)", 2024-04-19T02:16:09.409 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:09.271090+0000", 2024-04-19T02:16:09.409 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.037496765000000001, 2024-04-19T02:16:09.409 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016714757, 2024-04-19T02:16:09.409 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:09.409 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:09.409 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:09.409 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.409 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:09.409 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.271090+0000", 2024-04-19T02:16:09.409 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:09.410 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.410 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.410 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:09.410 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.271090+0000", 2024-04-19T02:16:09.410 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:09.410 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.410 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.410 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:09.410 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.271090+0000", 2024-04-19T02:16:09.410 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:09.410 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.410 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.410 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:09.411 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.271139+0000", 2024-04-19T02:16:09.411 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.9614999999999998e-05 2024-04-19T02:16:09.411 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.411 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.411 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:09.411 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.271147+0000", 2024-04-19T02:16:09.411 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.6960000000000005e-06 2024-04-19T02:16:09.411 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.411 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.411 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:09.411 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.271151+0000", 2024-04-19T02:16:09.411 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.3030000000000001e-06 2024-04-19T02:16:09.411 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.411 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.411 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:09.412 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.271179+0000", 2024-04-19T02:16:09.412 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.7971e-05 2024-04-19T02:16:09.412 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.412 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.412 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:09.412 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.271194+0000", 2024-04-19T02:16:09.412 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.4406999999999999e-05 2024-04-19T02:16:09.412 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.412 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.412 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:09.412 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.287772+0000", 2024-04-19T02:16:09.412 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016578275 2024-04-19T02:16:09.412 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:09.412 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:09.413 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:09.413 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.287805+0000", 2024-04-19T02:16:09.413 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.2914999999999999e-05 2024-04-19T02:16:09.413 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:09.413 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:09.413 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:09.413 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:09.413 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:09.413 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-04-19T02:16:09.415 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:09.415+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:09.415 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:16:09.515 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:09.516+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:09.591 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:16:09.592 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:16:09.592 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.592 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4549.0:43503 5.1 e23/16)", 2024-04-19T02:16:09.592 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:09.588666+0000", 2024-04-19T02:16:09.592 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.000168345, 2024-04-19T02:16:09.592 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018306900000000001, 2024-04-19T02:16:09.592 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:09.592 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-04-19T02:16:09.592 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:09.592 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.592 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:09.592 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.588666+0000", 2024-04-19T02:16:09.592 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:09.593 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.593 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.593 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:09.593 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.588666+0000", 2024-04-19T02:16:09.593 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:09.593 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.593 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.593 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:09.593 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.588665+0000", 2024-04-19T02:16:09.593 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:09.593 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.593 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.593 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:09.593 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.588670+0000", 2024-04-19T02:16:09.594 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4009999999999999e-06 2024-04-19T02:16:09.594 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.594 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.594 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:09.594 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.588677+0000", 2024-04-19T02:16:09.594 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5490000000000001e-06 2024-04-19T02:16:09.594 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.594 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.594 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:09.594 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.588682+0000", 2024-04-19T02:16:09.594 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1420000000000003e-06 2024-04-19T02:16:09.594 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:09.594 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:09.594 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:09.595 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.595 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.595 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:43498 5.2 5:441b9689:::benchmark_data_smithi121_44835_object43497:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:09.595 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:09.583060+0000", 2024-04-19T02:16:09.595 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0057741950000000002, 2024-04-19T02:16:09.595 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0058281339999999996, 2024-04-19T02:16:09.595 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:09.595 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:09.595 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:09.595 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:09.595 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:09.595 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 43498 2024-04-19T02:16:09.595 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.595 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:09.596 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.596 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:09.596 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.583060+0000", 2024-04-19T02:16:09.596 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:09.596 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.596 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.596 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:09.596 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.583060+0000", 2024-04-19T02:16:09.596 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:09.596 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.596 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.596 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:09.596 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.583059+0000", 2024-04-19T02:16:09.596 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:09.596 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.597 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.597 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:09.597 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.583130+0000", 2024-04-19T02:16:09.597 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0340999999999996e-05 2024-04-19T02:16:09.597 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.597 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.597 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:09.597 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.583139+0000", 2024-04-19T02:16:09.597 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5589999999999994e-06 2024-04-19T02:16:09.597 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.597 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.597 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:09.597 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.583148+0000", 2024-04-19T02:16:09.597 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9940000000000006e-06 2024-04-19T02:16:09.598 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.598 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.598 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:09.598 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.586210+0000", 2024-04-19T02:16:09.598 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003061809 2024-04-19T02:16:09.598 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.598 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.598 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:09.598 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.586327+0000", 2024-04-19T02:16:09.598 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000116649 2024-04-19T02:16:09.598 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.598 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.598 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:09.598 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.586444+0000", 2024-04-19T02:16:09.598 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117787 2024-04-19T02:16:09.599 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.599 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.599 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:09.599 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.588142+0000", 2024-04-19T02:16:09.599 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0016973380000000001 2024-04-19T02:16:09.599 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:09.599 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:09.599 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:09.599 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.599 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.599 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:43499 5.1 5:8ff55ec2:::benchmark_data_smithi121_44835_object43498:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:09.599 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:09.583156+0000", 2024-04-19T02:16:09.599 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0056780340000000002, 2024-04-19T02:16:09.599 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0057962140000000001, 2024-04-19T02:16:09.600 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:09.600 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:09.600 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:09.600 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:09.600 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:09.600 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 43499 2024-04-19T02:16:09.600 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.600 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:09.600 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.600 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:09.600 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.583156+0000", 2024-04-19T02:16:09.600 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:09.600 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.600 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.600 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:09.601 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.583156+0000", 2024-04-19T02:16:09.601 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:09.601 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.601 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.601 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:09.601 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.583156+0000", 2024-04-19T02:16:09.601 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:09.601 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.601 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.601 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:09.601 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.583197+0000", 2024-04-19T02:16:09.601 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1810000000000001e-05 2024-04-19T02:16:09.601 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.601 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.601 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:09.602 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.583203+0000", 2024-04-19T02:16:09.602 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5890000000000002e-06 2024-04-19T02:16:09.602 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.602 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.602 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:09.602 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.583207+0000", 2024-04-19T02:16:09.602 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0810000000000004e-06 2024-04-19T02:16:09.602 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.602 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.602 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:09.602 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.583238+0000", 2024-04-19T02:16:09.602 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1262e-05 2024-04-19T02:16:09.602 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.602 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.603 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:09.603 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.583345+0000", 2024-04-19T02:16:09.603 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000106458 2024-04-19T02:16:09.603 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.603 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.603 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:09.603 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.583424+0000", 2024-04-19T02:16:09.603 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9009000000000002e-05 2024-04-19T02:16:09.603 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.603 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.603 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:09.603 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.588107+0000", 2024-04-19T02:16:09.603 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0046836009999999999 2024-04-19T02:16:09.603 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:09.604 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:09.604 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:09.604 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.604 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.604 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:43500 5.f 5:faa03dfb:::benchmark_data_smithi121_44835_object43499:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:09.604 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:09.583213+0000", 2024-04-19T02:16:09.604 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0056213790000000001, 2024-04-19T02:16:09.604 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0057896400000000004, 2024-04-19T02:16:09.604 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:09.604 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:09.604 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:09.604 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:09.604 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:09.604 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 43500 2024-04-19T02:16:09.604 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.605 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:09.605 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.605 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:09.605 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.583213+0000", 2024-04-19T02:16:09.605 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:09.605 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.605 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.605 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:09.605 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.583213+0000", 2024-04-19T02:16:09.605 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:09.605 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.605 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.605 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:09.605 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.583212+0000", 2024-04-19T02:16:09.606 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:09.606 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.606 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.606 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:09.606 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.583247+0000", 2024-04-19T02:16:09.606 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4424000000000001e-05 2024-04-19T02:16:09.606 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.606 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.606 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:09.606 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.583254+0000", 2024-04-19T02:16:09.606 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9619999999999996e-06 2024-04-19T02:16:09.606 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.606 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.606 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:09.606 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.583260+0000", 2024-04-19T02:16:09.607 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.711e-06 2024-04-19T02:16:09.607 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.607 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.607 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:09.607 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.583295+0000", 2024-04-19T02:16:09.607 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5462e-05 2024-04-19T02:16:09.607 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.607 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.607 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:09.607 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.583390+0000", 2024-04-19T02:16:09.607 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5005000000000003e-05 2024-04-19T02:16:09.607 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.607 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.607 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:09.607 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.583490+0000", 2024-04-19T02:16:09.607 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9827999999999994e-05 2024-04-19T02:16:09.608 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.608 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.608 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:09.608 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.586483+0000", 2024-04-19T02:16:09.608 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0029934139999999998 2024-04-19T02:16:09.608 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:09.608 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:09.608 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:09.608 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.608 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.608 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:43501 5.f 5:fcdb3c1f:::benchmark_data_smithi121_44835_object43500:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:09.608 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:09.583267+0000", 2024-04-19T02:16:09.608 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0055668089999999998, 2024-04-19T02:16:09.608 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0057821909999999999, 2024-04-19T02:16:09.609 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:09.609 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:09.609 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:09.609 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:09.609 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:09.609 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 43501 2024-04-19T02:16:09.609 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.609 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:09.609 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.609 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:09.609 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.583267+0000", 2024-04-19T02:16:09.609 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:09.609 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.609 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.609 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:09.610 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.583267+0000", 2024-04-19T02:16:09.610 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:09.610 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.610 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.610 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:09.610 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.583267+0000", 2024-04-19T02:16:09.610 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:09.610 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.610 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.610 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:09.610 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.583301+0000", 2024-04-19T02:16:09.610 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4041999999999997e-05 2024-04-19T02:16:09.610 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.611 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.611 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:09.611 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.583308+0000", 2024-04-19T02:16:09.611 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8650000000000003e-06 2024-04-19T02:16:09.611 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.611 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.611 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:09.611 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.583314+0000", 2024-04-19T02:16:09.611 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.852e-06 2024-04-19T02:16:09.611 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.611 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.611 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:09.611 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.586503+0000", 2024-04-19T02:16:09.611 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031891390000000001 2024-04-19T02:16:09.611 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.612 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.612 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:09.612 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.586607+0000", 2024-04-19T02:16:09.612 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010445799999999999 2024-04-19T02:16:09.612 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.612 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.612 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:09.612 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.586737+0000", 2024-04-19T02:16:09.612 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012950900000000001 2024-04-19T02:16:09.612 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:09.612 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:09.612 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:09.612 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.612 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.612 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:43503 5.1 5:8d2ff8b5:::benchmark_data_smithi121_44835_object43502:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:09.612 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:09.584111+0000", 2024-04-19T02:16:09.613 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0047234829999999997, 2024-04-19T02:16:09.613 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0049821220000000003, 2024-04-19T02:16:09.613 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:09.613 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:09.613 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:09.613 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:09.613 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:09.613 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 43503 2024-04-19T02:16:09.613 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.613 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:09.613 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.613 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:09.613 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.584111+0000", 2024-04-19T02:16:09.613 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:09.613 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.613 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.614 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:09.614 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.584111+0000", 2024-04-19T02:16:09.614 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:09.614 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.614 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.614 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:09.614 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.584110+0000", 2024-04-19T02:16:09.614 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:09.614 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.614 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.614 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:09.614 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.584253+0000", 2024-04-19T02:16:09.614 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014248 2024-04-19T02:16:09.614 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.614 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.615 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:09.615 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.584263+0000", 2024-04-19T02:16:09.615 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0857e-05 2024-04-19T02:16:09.615 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.615 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.615 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:09.615 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.584271+0000", 2024-04-19T02:16:09.615 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8089999999999993e-06 2024-04-19T02:16:09.615 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.615 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.615 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:09.615 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.586613+0000", 2024-04-19T02:16:09.615 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002342041 2024-04-19T02:16:09.615 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.615 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.616 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:09.616 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.586726+0000", 2024-04-19T02:16:09.616 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011283200000000001 2024-04-19T02:16:09.616 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.616 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.616 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:09.616 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.586848+0000", 2024-04-19T02:16:09.616 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012228599999999999 2024-04-19T02:16:09.616 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:09.616 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:09.616 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:09.616 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.616 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.616 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4549.0:43507 5.6 e23/16 5:668fa85a:::benchmark_data_smithi121_44835_object43506:head v 23'2739, mlcod=23'2737)", 2024-04-19T02:16:09.616 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:09.587205+0000", 2024-04-19T02:16:09.617 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0016296889999999999, 2024-04-19T02:16:09.617 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019297139999999999, 2024-04-19T02:16:09.617 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:09.617 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:16:09.617 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:09.617 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.617 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:09.617 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.587205+0000", 2024-04-19T02:16:09.617 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:09.617 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.617 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.617 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:09.617 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.587205+0000", 2024-04-19T02:16:09.617 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:09.617 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.618 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.618 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:09.618 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.587204+0000", 2024-04-19T02:16:09.618 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:09.618 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.618 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.618 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:09.618 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.587265+0000", 2024-04-19T02:16:09.618 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0365999999999998e-05 2024-04-19T02:16:09.618 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.618 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.618 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:09.618 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.587271+0000", 2024-04-19T02:16:09.618 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.494e-06 2024-04-19T02:16:09.619 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.619 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.619 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:09.619 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.587275+0000", 2024-04-19T02:16:09.619 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0940000000000001e-06 2024-04-19T02:16:09.619 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.619 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.619 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:09.619 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.587308+0000", 2024-04-19T02:16:09.619 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2873999999999997e-05 2024-04-19T02:16:09.619 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.619 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.619 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:09.619 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.587326+0000", 2024-04-19T02:16:09.619 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8284999999999999e-05 2024-04-19T02:16:09.620 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:09.620 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:09.620 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:09.620 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.620 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.620 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:43506 5.7 5:e655fe54:::benchmark_data_smithi121_44835_object43505:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:09.620 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:09.587918+0000", 2024-04-19T02:16:09.620 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00091677499999999999, 2024-04-19T02:16:09.620 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012565619999999999, 2024-04-19T02:16:09.620 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:09.620 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:09.620 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:09.620 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:09.620 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:09.620 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 43506 2024-04-19T02:16:09.620 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.621 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:09.621 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.621 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:09.621 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.587918+0000", 2024-04-19T02:16:09.621 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:09.621 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.621 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.621 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:09.621 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.587918+0000", 2024-04-19T02:16:09.621 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:09.621 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.621 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.621 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:09.621 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.587916+0000", 2024-04-19T02:16:09.621 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:09.621 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.622 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.622 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:09.622 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.587949+0000", 2024-04-19T02:16:09.622 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2838e-05 2024-04-19T02:16:09.622 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.622 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.622 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:09.622 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.587959+0000", 2024-04-19T02:16:09.622 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7000000000000003e-06 2024-04-19T02:16:09.622 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.622 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.622 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:09.622 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.587967+0000", 2024-04-19T02:16:09.622 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5059999999999998e-06 2024-04-19T02:16:09.623 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.623 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.623 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:09.623 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.588005+0000", 2024-04-19T02:16:09.623 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8194000000000001e-05 2024-04-19T02:16:09.623 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.623 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.623 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:09.623 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.588123+0000", 2024-04-19T02:16:09.623 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000118583 2024-04-19T02:16:09.623 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.623 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.623 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:09.623 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.588225+0000", 2024-04-19T02:16:09.623 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101809 2024-04-19T02:16:09.624 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:09.624 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:09.624 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:09.624 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.624 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.624 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:43508 5.d 5:bd7ffe7e:::benchmark_data_smithi121_44835_object43507:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:09.624 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:09.587975+0000", 2024-04-19T02:16:09.624 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00085901700000000001, 2024-04-19T02:16:09.624 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012416370000000001, 2024-04-19T02:16:09.624 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:09.624 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:09.624 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:09.624 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:09.624 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:09.624 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 43508 2024-04-19T02:16:09.625 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.625 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:09.625 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.625 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:09.625 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.587975+0000", 2024-04-19T02:16:09.625 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:09.625 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.625 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.625 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:09.625 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.587975+0000", 2024-04-19T02:16:09.625 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:09.625 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.625 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.625 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:09.625 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.587975+0000", 2024-04-19T02:16:09.626 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:09.626 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.626 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.626 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:09.626 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.588013+0000", 2024-04-19T02:16:09.626 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7795e-05 2024-04-19T02:16:09.626 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.626 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.626 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:09.626 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.588021+0000", 2024-04-19T02:16:09.626 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9199999999999993e-06 2024-04-19T02:16:09.626 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.626 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.626 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:09.627 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.588028+0000", 2024-04-19T02:16:09.627 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3810000000000004e-06 2024-04-19T02:16:09.627 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.627 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.627 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:09.627 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.588067+0000", 2024-04-19T02:16:09.627 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8896000000000002e-05 2024-04-19T02:16:09.627 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.627 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.627 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:09.627 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.588182+0000", 2024-04-19T02:16:09.627 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000115005 2024-04-19T02:16:09.627 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.627 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.627 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:09.628 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.588333+0000", 2024-04-19T02:16:09.628 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015170400000000001 2024-04-19T02:16:09.628 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:09.628 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:09.628 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:09.628 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.628 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.628 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:43509 5.f 5.92dde75f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:09.628 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:09.588040+0000", 2024-04-19T02:16:09.628 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00079465500000000001, 2024-04-19T02:16:09.628 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001217252, 2024-04-19T02:16:09.628 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:09.628 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-04-19T02:16:09.628 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:09.628 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:09.629 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:09.629 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 43509 2024-04-19T02:16:09.629 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.629 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:09.629 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.629 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:09.629 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.588040+0000", 2024-04-19T02:16:09.629 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:09.629 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.629 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.629 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:09.629 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.588040+0000", 2024-04-19T02:16:09.629 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:09.629 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.629 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.629 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:09.630 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.588039+0000", 2024-04-19T02:16:09.630 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:09.630 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.630 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.630 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:09.630 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.588072+0000", 2024-04-19T02:16:09.630 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3303000000000003e-05 2024-04-19T02:16:09.630 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.630 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.630 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:09.630 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.588079+0000", 2024-04-19T02:16:09.630 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8800000000000002e-06 2024-04-19T02:16:09.630 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.630 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.630 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:09.631 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.588086+0000", 2024-04-19T02:16:09.631 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5180000000000001e-06 2024-04-19T02:16:09.631 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:09.631 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:09.631 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:09.631 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.631 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.631 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:43510 5.f 5.9909659f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:09.631 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:09.588091+0000", 2024-04-19T02:16:09.631 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00074288200000000005, 2024-04-19T02:16:09.631 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001195485, 2024-04-19T02:16:09.631 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:09.631 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-04-19T02:16:09.631 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:09.631 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:09.631 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:09.632 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 43510 2024-04-19T02:16:09.632 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.632 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:09.632 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.632 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:09.632 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.588091+0000", 2024-04-19T02:16:09.632 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:09.632 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.632 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.632 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:09.632 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.588091+0000", 2024-04-19T02:16:09.632 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:09.632 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.632 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.632 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:09.633 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.588091+0000", 2024-04-19T02:16:09.633 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:09.633 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.633 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.633 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:09.633 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.588124+0000", 2024-04-19T02:16:09.633 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3182000000000002e-05 2024-04-19T02:16:09.633 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.633 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.633 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:09.633 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.588130+0000", 2024-04-19T02:16:09.633 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3609999999999997e-06 2024-04-19T02:16:09.633 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.633 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.633 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:09.634 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.588137+0000", 2024-04-19T02:16:09.634 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3389999999999998e-06 2024-04-19T02:16:09.634 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:09.634 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:09.634 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:09.634 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.634 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.634 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:43511 5.9 5:911c7579:::benchmark_data_smithi121_44835_object43510:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:09.634 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:09.588142+0000", 2024-04-19T02:16:09.634 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00069214700000000005, 2024-04-19T02:16:09.634 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001177162, 2024-04-19T02:16:09.634 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:09.634 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:09.634 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:09.635 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:09.635 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:09.635 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 43511 2024-04-19T02:16:09.635 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.635 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:09.635 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.635 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:09.635 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.588142+0000", 2024-04-19T02:16:09.635 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:09.635 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.635 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.635 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:09.635 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.588142+0000", 2024-04-19T02:16:09.635 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:09.636 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.636 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.636 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:09.636 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.588142+0000", 2024-04-19T02:16:09.636 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:09.636 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.636 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.636 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:09.636 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.588182+0000", 2024-04-19T02:16:09.636 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0145999999999998e-05 2024-04-19T02:16:09.636 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.636 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.636 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:09.636 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.588189+0000", 2024-04-19T02:16:09.637 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2099999999999996e-06 2024-04-19T02:16:09.637 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.637 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.637 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:09.637 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.588194+0000", 2024-04-19T02:16:09.637 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2809999999999999e-06 2024-04-19T02:16:09.637 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.637 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.637 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:09.637 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.588223+0000", 2024-04-19T02:16:09.637 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8466000000000002e-05 2024-04-19T02:16:09.637 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.637 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.637 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:09.638 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.588332+0000", 2024-04-19T02:16:09.638 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109337 2024-04-19T02:16:09.638 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.638 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.638 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:09.638 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.588447+0000", 2024-04-19T02:16:09.638 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000114559 2024-04-19T02:16:09.638 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:09.638 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:09.638 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:09.638 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.638 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.638 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:43492 5.7 5:ef537b84:::benchmark_data_smithi121_44835_object43491:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:09.638 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:09.578201+0000", 2024-04-19T02:16:09.639 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.010633174, 2024-04-19T02:16:09.639 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011161091, 2024-04-19T02:16:09.639 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:09.639 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:09.639 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:09.639 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:09.639 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:09.639 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 43492 2024-04-19T02:16:09.639 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.639 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:09.639 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.639 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:09.639 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.578201+0000", 2024-04-19T02:16:09.639 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:09.639 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.640 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.640 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:09.640 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.578201+0000", 2024-04-19T02:16:09.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:09.640 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.640 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.640 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:09.640 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.578201+0000", 2024-04-19T02:16:09.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:09.640 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.640 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.640 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:09.640 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.578228+0000", 2024-04-19T02:16:09.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6942999999999999e-05 2024-04-19T02:16:09.640 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:09.641 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.578235+0000", 2024-04-19T02:16:09.641 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1550000000000001e-06 2024-04-19T02:16:09.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:09.641 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.578241+0000", 2024-04-19T02:16:09.641 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0229999999999998e-06 2024-04-19T02:16:09.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:09.641 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.582251+0000", 2024-04-19T02:16:09.641 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040100739999999998 2024-04-19T02:16:09.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.642 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:09.642 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.582337+0000", 2024-04-19T02:16:09.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5723000000000006e-05 2024-04-19T02:16:09.642 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.642 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:09.642 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.582422+0000", 2024-04-19T02:16:09.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5612000000000006e-05 2024-04-19T02:16:09.642 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.642 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:09.642 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.586990+0000", 2024-04-19T02:16:09.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045678519999999998 2024-04-19T02:16:09.642 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:09.643 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:09.643 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:09.643 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.643 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.643 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:43512 5.d 5.cc0c014d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:09.643 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:09.588366+0000", 2024-04-19T02:16:09.643 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.000468042, 2024-04-19T02:16:09.643 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001044597, 2024-04-19T02:16:09.643 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:09.643 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-04-19T02:16:09.643 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:09.643 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:09.643 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:09.643 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 43512 2024-04-19T02:16:09.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.644 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:09.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.644 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:09.644 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.588366+0000", 2024-04-19T02:16:09.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:09.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.644 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:09.644 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.588366+0000", 2024-04-19T02:16:09.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:09.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.644 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:09.645 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.588366+0000", 2024-04-19T02:16:09.645 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:09.645 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.645 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.645 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:09.645 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.588458+0000", 2024-04-19T02:16:09.645 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1858e-05 2024-04-19T02:16:09.645 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.645 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.645 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:09.645 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.588463+0000", 2024-04-19T02:16:09.645 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6080000000000003e-06 2024-04-19T02:16:09.645 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.645 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.645 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:09.646 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.588467+0000", 2024-04-19T02:16:09.646 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.109e-06 2024-04-19T02:16:09.646 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:09.646 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:09.646 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:09.646 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.646 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:43514 5.9 5.80d8ba79 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:09.646 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:09.588473+0000", 2024-04-19T02:16:09.646 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00036161899999999998, 2024-04-19T02:16:09.646 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000971718, 2024-04-19T02:16:09.646 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:09.646 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-04-19T02:16:09.646 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:09.646 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:09.647 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:09.647 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 43514 2024-04-19T02:16:09.647 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.647 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:09.647 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.647 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:09.647 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.588473+0000", 2024-04-19T02:16:09.647 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:09.647 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.647 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.647 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:09.647 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.588473+0000", 2024-04-19T02:16:09.647 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:09.647 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.647 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.647 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:09.648 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.588472+0000", 2024-04-19T02:16:09.648 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:09.648 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.648 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.648 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:09.648 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.588554+0000", 2024-04-19T02:16:09.648 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2074000000000001e-05 2024-04-19T02:16:09.648 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.648 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.648 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:09.648 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.588560+0000", 2024-04-19T02:16:09.648 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6509999999999998e-06 2024-04-19T02:16:09.648 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:09.648 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:09.648 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:09.648 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.588564+0000", 2024-04-19T02:16:09.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9179999999999996e-06 2024-04-19T02:16:09.649 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:09.649 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:09.649 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:09.649 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:09.649 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-04-19T02:16:09.649 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 15 2024-04-19T02:16:09.649 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:16:09.650 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:09.651+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:09.651 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:16:09.751 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:09.752+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:09.820 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:16:09.820 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-04-19T02:16:09.820 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-04-19T02:16:09.820 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-04-19T02:16:09.820 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:16:09.834 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:16:09.879 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:09.880+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:09.953 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:09.954+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:10.006 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:16:10.006 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-04-19T02:16:10.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-04-19T02:16:10.006 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:16:10.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.006 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:10.006 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269657+0000", 2024-04-19T02:16:10.006 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.734818785999998, 2024-04-19T02:16:10.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018569239000000001, 2024-04-19T02:16:10.006 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:10.007 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:10.007 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:10.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.007 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:10.007 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269657+0000", 2024-04-19T02:16:10.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:10.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.007 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:10.007 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269657+0000", 2024-04-19T02:16:10.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:10.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.007 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:10.008 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269656+0000", 2024-04-19T02:16:10.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:10.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:10.008 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269666+0000", 2024-04-19T02:16:10.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.628e-06 2024-04-19T02:16:10.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:10.008 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269673+0000", 2024-04-19T02:16:10.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1690000000000003e-06 2024-04-19T02:16:10.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:10.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269680+0000", 2024-04-19T02:16:10.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8940000000000004e-06 2024-04-19T02:16:10.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:10.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269788+0000", 2024-04-19T02:16:10.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107725 2024-04-19T02:16:10.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:10.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269791+0000", 2024-04-19T02:16:10.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9699999999999999e-06 2024-04-19T02:16:10.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.010 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:10.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.277693+0000", 2024-04-19T02:16:10.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079026979999999997 2024-04-19T02:16:10.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.010 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:10.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.277838+0000", 2024-04-19T02:16:10.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014444699999999999 2024-04-19T02:16:10.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.010 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:10.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.277996+0000", 2024-04-19T02:16:10.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015794499999999999 2024-04-19T02:16:10.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.011 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:10.011 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282534+0000", 2024-04-19T02:16:10.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045383070000000001 2024-04-19T02:16:10.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.011 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:10.011 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288134+0000", 2024-04-19T02:16:10.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0056005020000000003 2024-04-19T02:16:10.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.011 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:10.011 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288187+0000", 2024-04-19T02:16:10.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2884999999999999e-05 2024-04-19T02:16:10.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.012 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:10.012 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288226+0000", 2024-04-19T02:16:10.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8458999999999999e-05 2024-04-19T02:16:10.012 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:10.012 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:10.012 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:10.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.012 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:10.012 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269684+0000", 2024-04-19T02:16:10.012 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.734791217000001, 2024-04-19T02:16:10.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019077493000000001, 2024-04-19T02:16:10.013 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:10.013 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:10.013 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:10.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:10.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269684+0000", 2024-04-19T02:16:10.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:10.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:10.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269684+0000", 2024-04-19T02:16:10.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:10.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:10.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269684+0000", 2024-04-19T02:16:10.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:10.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:10.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269686+0000", 2024-04-19T02:16:10.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2740000000000002e-06 2024-04-19T02:16:10.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:10.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269690+0000", 2024-04-19T02:16:10.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8829999999999999e-06 2024-04-19T02:16:10.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:10.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269693+0000", 2024-04-19T02:16:10.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4199999999999999e-06 2024-04-19T02:16:10.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:10.015 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269875+0000", 2024-04-19T02:16:10.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018114800000000001 2024-04-19T02:16:10.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:10.015 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269880+0000", 2024-04-19T02:16:10.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5620000000000003e-06 2024-04-19T02:16:10.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:10.015 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278610+0000", 2024-04-19T02:16:10.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.008729423 2024-04-19T02:16:10.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:10.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278724+0000", 2024-04-19T02:16:10.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011428400000000001 2024-04-19T02:16:10.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:10.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278860+0000", 2024-04-19T02:16:10.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013601600000000001 2024-04-19T02:16:10.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:10.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282632+0000", 2024-04-19T02:16:10.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037722889999999999 2024-04-19T02:16:10.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.017 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:10.017 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288712+0000", 2024-04-19T02:16:10.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0060799599999999997 2024-04-19T02:16:10.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.017 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:10.017 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288742+0000", 2024-04-19T02:16:10.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0048000000000001e-05 2024-04-19T02:16:10.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.017 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:10.017 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288762+0000", 2024-04-19T02:16:10.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9482000000000001e-05 2024-04-19T02:16:10.017 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:10.018 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:10.018 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:10.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.018 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:12 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:10.018 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269696+0000", 2024-04-19T02:16:10.018 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.734779138999997, 2024-04-19T02:16:10.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018617073000000001, 2024-04-19T02:16:10.018 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:10.018 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:10.018 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:10.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:10.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269696+0000", 2024-04-19T02:16:10.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:10.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:10.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269696+0000", 2024-04-19T02:16:10.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:10.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:10.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269696+0000", 2024-04-19T02:16:10.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967296 2024-04-19T02:16:10.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:10.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269698+0000", 2024-04-19T02:16:10.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9570000000000001e-06 2024-04-19T02:16:10.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.020 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:10.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269702+0000", 2024-04-19T02:16:10.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2459999999999997e-06 2024-04-19T02:16:10.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.020 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:10.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269708+0000", 2024-04-19T02:16:10.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2709999999999998e-06 2024-04-19T02:16:10.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.020 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:10.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269749+0000", 2024-04-19T02:16:10.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0500000000000002e-05 2024-04-19T02:16:10.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-04-19T02:16:10.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269754+0000", 2024-04-19T02:16:10.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.502e-06 2024-04-19T02:16:10.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:10.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.277984+0000", 2024-04-19T02:16:10.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0082293049999999993 2024-04-19T02:16:10.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:10.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278489+0000", 2024-04-19T02:16:10.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00050499699999999998 2024-04-19T02:16:10.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.022 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:10.022 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278649+0000", 2024-04-19T02:16:10.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016012000000000001 2024-04-19T02:16:10.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.022 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:10.022 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286855+0000", 2024-04-19T02:16:10.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0082066139999999992 2024-04-19T02:16:10.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.022 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:10.022 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288248+0000", 2024-04-19T02:16:10.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001392838 2024-04-19T02:16:10.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:10.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288287+0000", 2024-04-19T02:16:10.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8516000000000002e-05 2024-04-19T02:16:10.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:10.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288313+0000", 2024-04-19T02:16:10.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6420000000000001e-05 2024-04-19T02:16:10.023 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:10.023 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:10.023 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:10.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.024 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:10.024 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269753+0000", 2024-04-19T02:16:10.024 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.734721833999998, 2024-04-19T02:16:10.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019088755999999998, 2024-04-19T02:16:10.024 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:10.024 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:10.024 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:10.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:10.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269753+0000", 2024-04-19T02:16:10.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:10.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:10.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269753+0000", 2024-04-19T02:16:10.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:10.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:10.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269753+0000", 2024-04-19T02:16:10.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:10.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:10.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269770+0000", 2024-04-19T02:16:10.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7150999999999999e-05 2024-04-19T02:16:10.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:10.026 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269779+0000", 2024-04-19T02:16:10.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4139999999999994e-06 2024-04-19T02:16:10.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.026 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:10.026 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269786+0000", 2024-04-19T02:16:10.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.537e-06 2024-04-19T02:16:10.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.026 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:10.026 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269913+0000", 2024-04-19T02:16:10.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012699599999999999 2024-04-19T02:16:10.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:10.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269916+0000", 2024-04-19T02:16:10.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9280000000000002e-06 2024-04-19T02:16:10.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:10.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.279143+0000", 2024-04-19T02:16:10.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0092270129999999992 2024-04-19T02:16:10.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:10.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.279223+0000", 2024-04-19T02:16:10.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0050999999999996e-05 2024-04-19T02:16:10.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:10.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.279364+0000", 2024-04-19T02:16:10.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000140934 2024-04-19T02:16:10.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:10.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286189+0000", 2024-04-19T02:16:10.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.006825327 2024-04-19T02:16:10.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:10.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288791+0000", 2024-04-19T02:16:10.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026021500000000001 2024-04-19T02:16:10.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:10.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288822+0000", 2024-04-19T02:16:10.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0162999999999999e-05 2024-04-19T02:16:10.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:10.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288842+0000", 2024-04-19T02:16:10.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0644000000000001e-05 2024-04-19T02:16:10.029 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:10.029 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:10.029 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:10.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.030 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:10.030 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:16:10.030 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.734683359999998, 2024-04-19T02:16:10.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020307345000000001, 2024-04-19T02:16:10.030 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:10.030 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:10.030 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:10.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.030 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:10.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:16:10.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:10.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:10.031 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:16:10.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:10.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:10.031 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269791+0000", 2024-04-19T02:16:10.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:10.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:10.031 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269795+0000", 2024-04-19T02:16:10.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5619999999999999e-06 2024-04-19T02:16:10.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:10.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269802+0000", 2024-04-19T02:16:10.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8469999999999998e-06 2024-04-19T02:16:10.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:10.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269807+0000", 2024-04-19T02:16:10.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.707e-06 2024-04-19T02:16:10.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:10.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269950+0000", 2024-04-19T02:16:10.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000143313 2024-04-19T02:16:10.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:10.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269955+0000", 2024-04-19T02:16:10.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4029999999999998e-06 2024-04-19T02:16:10.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:10.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.283806+0000", 2024-04-19T02:16:10.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013850220999999999 2024-04-19T02:16:10.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:10.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.283896+0000", 2024-04-19T02:16:10.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0261999999999997e-05 2024-04-19T02:16:10.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:10.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284022+0000", 2024-04-19T02:16:10.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012641200000000001 2024-04-19T02:16:10.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:10.035 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289066+0000", 2024-04-19T02:16:10.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050438490000000004 2024-04-19T02:16:10.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.035 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:10.035 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290011+0000", 2024-04-19T02:16:10.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00094490700000000004 2024-04-19T02:16:10.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.035 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:10.035 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290054+0000", 2024-04-19T02:16:10.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.337e-05 2024-04-19T02:16:10.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.036 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:10.036 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290099+0000", 2024-04-19T02:16:10.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4987999999999997e-05 2024-04-19T02:16:10.036 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:10.036 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:10.036 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:10.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.036 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:10.036 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:16:10.036 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.734605430000002, 2024-04-19T02:16:10.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020331023, 2024-04-19T02:16:10.036 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:10.036 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:10.036 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:10.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:10.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:16:10.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:10.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:10.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:16:10.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:10.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:10.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269869+0000", 2024-04-19T02:16:10.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:10.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:10.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269873+0000", 2024-04-19T02:16:10.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0219999999999998e-06 2024-04-19T02:16:10.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:10.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269881+0000", 2024-04-19T02:16:10.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.79e-06 2024-04-19T02:16:10.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:10.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269887+0000", 2024-04-19T02:16:10.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7899999999999996e-06 2024-04-19T02:16:10.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:10.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269983+0000", 2024-04-19T02:16:10.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6057000000000005e-05 2024-04-19T02:16:10.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:10.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269986+0000", 2024-04-19T02:16:10.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9220000000000001e-06 2024-04-19T02:16:10.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:10.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284350+0000", 2024-04-19T02:16:10.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014364335000000001 2024-04-19T02:16:10.040 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.040 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:10.040 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284664+0000", 2024-04-19T02:16:10.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000313646 2024-04-19T02:16:10.040 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.040 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:10.040 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284794+0000", 2024-04-19T02:16:10.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129839 2024-04-19T02:16:10.040 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.040 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:10.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289107+0000", 2024-04-19T02:16:10.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0043127060000000004 2024-04-19T02:16:10.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:10.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290108+0000", 2024-04-19T02:16:10.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0010010590000000001 2024-04-19T02:16:10.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:10.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290144+0000", 2024-04-19T02:16:10.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6709999999999999e-05 2024-04-19T02:16:10.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.042 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:10.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290201+0000", 2024-04-19T02:16:10.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6654999999999999e-05 2024-04-19T02:16:10.042 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:10.042 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:10.042 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:10.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.042 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:10.042 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:16:10.042 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.734563088999998, 2024-04-19T02:16:10.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020507241999999998, 2024-04-19T02:16:10.042 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:10.043 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:10.043 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:10.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:10.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:16:10.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:10.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:10.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:16:10.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:10.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:10.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:16:10.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:10.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:10.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269915+0000", 2024-04-19T02:16:10.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.472e-06 2024-04-19T02:16:10.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:10.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269928+0000", 2024-04-19T02:16:10.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2979000000000001e-05 2024-04-19T02:16:10.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.045 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:10.045 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269935+0000", 2024-04-19T02:16:10.045 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8859999999999998e-06 2024-04-19T02:16:10.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.045 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:10.045 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270009+0000", 2024-04-19T02:16:10.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3429000000000005e-05 2024-04-19T02:16:10.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:10.046 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270013+0000", 2024-04-19T02:16:10.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2590000000000002e-06 2024-04-19T02:16:10.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:10.046 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285375+0000", 2024-04-19T02:16:10.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015362275999999999 2024-04-19T02:16:10.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:10.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285451+0000", 2024-04-19T02:16:10.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5338000000000003e-05 2024-04-19T02:16:10.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:10.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285562+0000", 2024-04-19T02:16:10.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000111285 2024-04-19T02:16:10.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:10.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289134+0000", 2024-04-19T02:16:10.048 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035719670000000001 2024-04-19T02:16:10.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.048 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:10.048 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290341+0000", 2024-04-19T02:16:10.048 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012074500000000001 2024-04-19T02:16:10.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.048 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:10.048 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290383+0000", 2024-04-19T02:16:10.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1386e-05 2024-04-19T02:16:10.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.049 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:10.049 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290419+0000", 2024-04-19T02:16:10.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6884000000000001e-05 2024-04-19T02:16:10.049 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:10.049 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:10.049 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:10.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.049 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:10.049 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269945+0000", 2024-04-19T02:16:10.049 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.734530507000002, 2024-04-19T02:16:10.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019709098000000001, 2024-04-19T02:16:10.050 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:10.050 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:10.050 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:10.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.050 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:10.050 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269945+0000", 2024-04-19T02:16:10.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:10.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.050 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:10.050 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269945+0000", 2024-04-19T02:16:10.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:10.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.051 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:10.051 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269944+0000", 2024-04-19T02:16:10.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:10.051 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.051 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:10.051 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269965+0000", 2024-04-19T02:16:10.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0803999999999999e-05 2024-04-19T02:16:10.051 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.051 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:10.051 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269973+0000", 2024-04-19T02:16:10.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3560000000000004e-06 2024-04-19T02:16:10.051 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:10.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269982+0000", 2024-04-19T02:16:10.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9600000000000006e-06 2024-04-19T02:16:10.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:10.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270014+0000", 2024-04-19T02:16:10.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2913000000000001e-05 2024-04-19T02:16:10.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:10.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270018+0000", 2024-04-19T02:16:10.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2200000000000001e-06 2024-04-19T02:16:10.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:10.053 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278999+0000", 2024-04-19T02:16:10.053 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0089818009999999993 2024-04-19T02:16:10.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.053 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:10.053 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.279088+0000", 2024-04-19T02:16:10.053 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8988999999999998e-05 2024-04-19T02:16:10.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.053 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:10.053 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.280160+0000", 2024-04-19T02:16:10.053 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001071572 2024-04-19T02:16:10.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.053 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:10.054 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288342+0000", 2024-04-19T02:16:10.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.008182468 2024-04-19T02:16:10.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.054 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:10.054 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289545+0000", 2024-04-19T02:16:10.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012026739999999999 2024-04-19T02:16:10.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.054 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:10.054 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289608+0000", 2024-04-19T02:16:10.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2904999999999995e-05 2024-04-19T02:16:10.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.054 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:10.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289654+0000", 2024-04-19T02:16:10.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5850000000000003e-05 2024-04-19T02:16:10.055 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:10.055 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:10.055 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:10.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.055 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:10.055 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:16:10.055 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.734484829000003, 2024-04-19T02:16:10.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022007204999999998, 2024-04-19T02:16:10.055 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:10.055 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:10.055 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:10.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.056 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:10.056 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:16:10.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:10.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.056 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:10.056 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:16:10.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:10.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.056 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:10.056 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269990+0000", 2024-04-19T02:16:10.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:10.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.057 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:10.057 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269999+0000", 2024-04-19T02:16:10.057 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9539999999999993e-06 2024-04-19T02:16:10.057 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.057 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:10.057 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270006+0000", 2024-04-19T02:16:10.057 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.216e-06 2024-04-19T02:16:10.057 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.057 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:10.057 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270012+0000", 2024-04-19T02:16:10.057 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5049999999999998e-06 2024-04-19T02:16:10.057 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.057 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:10.058 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270058+0000", 2024-04-19T02:16:10.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.634e-05 2024-04-19T02:16:10.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.058 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:10.058 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270064+0000", 2024-04-19T02:16:10.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0669999999999997e-06 2024-04-19T02:16:10.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.058 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:10.058 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287159+0000", 2024-04-19T02:16:10.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017095086999999998 2024-04-19T02:16:10.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.059 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:10.059 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287254+0000", 2024-04-19T02:16:10.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4716000000000006e-05 2024-04-19T02:16:10.059 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.059 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.059 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:10.059 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287389+0000", 2024-04-19T02:16:10.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013511900000000001 2024-04-19T02:16:10.059 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.059 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.059 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:10.059 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290481+0000", 2024-04-19T02:16:10.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030920169999999999 2024-04-19T02:16:10.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:10.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291931+0000", 2024-04-19T02:16:10.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001450118 2024-04-19T02:16:10.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:10.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291960+0000", 2024-04-19T02:16:10.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9096000000000001e-05 2024-04-19T02:16:10.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:10.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291998+0000", 2024-04-19T02:16:10.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7514e-05 2024-04-19T02:16:10.061 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:10.061 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:10.061 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:10.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.061 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:10.061 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:10.061 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.734424257999997, 2024-04-19T02:16:10.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020759494999999999, 2024-04-19T02:16:10.061 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:10.061 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:10.061 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:10.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.061 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:10.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:10.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:10.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.062 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:10.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:10.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:10.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.062 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:10.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:10.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:10.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.062 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:10.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270054+0000", 2024-04-19T02:16:10.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.27e-06 2024-04-19T02:16:10.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:10.063 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270061+0000", 2024-04-19T02:16:10.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1289999999999998e-06 2024-04-19T02:16:10.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:10.063 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270067+0000", 2024-04-19T02:16:10.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.207e-06 2024-04-19T02:16:10.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:10.063 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270105+0000", 2024-04-19T02:16:10.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7549999999999998e-05 2024-04-19T02:16:10.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.064 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.064 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:10.064 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270112+0000", 2024-04-19T02:16:10.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3200000000000002e-06 2024-04-19T02:16:10.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.064 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.064 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:10.064 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282454+0000", 2024-04-19T02:16:10.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012341569 2024-04-19T02:16:10.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.064 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.064 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:10.064 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282740+0000", 2024-04-19T02:16:10.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000286481 2024-04-19T02:16:10.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:10.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282879+0000", 2024-04-19T02:16:10.065 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013887799999999999 2024-04-19T02:16:10.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:10.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290325+0000", 2024-04-19T02:16:10.065 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074459779999999998 2024-04-19T02:16:10.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:10.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290759+0000", 2024-04-19T02:16:10.065 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000433688 2024-04-19T02:16:10.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:10.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290789+0000", 2024-04-19T02:16:10.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9960000000000001e-05 2024-04-19T02:16:10.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:10.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290811+0000", 2024-04-19T02:16:10.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1965999999999999e-05 2024-04-19T02:16:10.066 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:10.066 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:10.066 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:10.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.066 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:10.067 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270078+0000", 2024-04-19T02:16:10.067 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.734397805, 2024-04-19T02:16:10.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018194683, 2024-04-19T02:16:10.067 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:10.067 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:10.067 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:10.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.067 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:10.067 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270078+0000", 2024-04-19T02:16:10.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:10.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.067 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:10.067 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270078+0000", 2024-04-19T02:16:10.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:10.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:10.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270077+0000", 2024-04-19T02:16:10.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:10.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:10.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270080+0000", 2024-04-19T02:16:10.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8389999999999998e-06 2024-04-19T02:16:10.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:10.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270086+0000", 2024-04-19T02:16:10.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6160000000000001e-06 2024-04-19T02:16:10.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:10.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270091+0000", 2024-04-19T02:16:10.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1390000000000003e-06 2024-04-19T02:16:10.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:10.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270124+0000", 2024-04-19T02:16:10.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3359999999999999e-05 2024-04-19T02:16:10.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-04-19T02:16:10.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270127+0000", 2024-04-19T02:16:10.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.219e-06 2024-04-19T02:16:10.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.070 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:10.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.277938+0000", 2024-04-19T02:16:10.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0078111559999999997 2024-04-19T02:16:10.070 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.070 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.070 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:10.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278413+0000", 2024-04-19T02:16:10.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00047432600000000001 2024-04-19T02:16:10.070 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.070 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.070 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:10.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278540+0000", 2024-04-19T02:16:10.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012753299999999999 2024-04-19T02:16:10.070 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.070 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.071 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:10.071 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.283045+0000", 2024-04-19T02:16:10.071 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045051580000000004 2024-04-19T02:16:10.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.071 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:10.071 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288192+0000", 2024-04-19T02:16:10.071 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051468210000000002 2024-04-19T02:16:10.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.071 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:10.071 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288239+0000", 2024-04-19T02:16:10.071 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7089999999999998e-05 2024-04-19T02:16:10.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.072 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:10.072 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288272+0000", 2024-04-19T02:16:10.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2799999999999998e-05 2024-04-19T02:16:10.072 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:10.072 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:10.072 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:10.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.072 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:10.072 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:16:10.072 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.734374053000003, 2024-04-19T02:16:10.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020837887999999999, 2024-04-19T02:16:10.072 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:10.073 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:10.073 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:10.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:10.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:16:10.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:10.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:10.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:16:10.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:10.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:10.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:16:10.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:10.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:10.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270109+0000", 2024-04-19T02:16:10.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3110000000000006e-06 2024-04-19T02:16:10.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:10.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270117+0000", 2024-04-19T02:16:10.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0479999999999999e-06 2024-04-19T02:16:10.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:10.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270123+0000", 2024-04-19T02:16:10.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5500000000000002e-06 2024-04-19T02:16:10.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:10.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270150+0000", 2024-04-19T02:16:10.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7712000000000002e-05 2024-04-19T02:16:10.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:10.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270153+0000", 2024-04-19T02:16:10.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6089999999999999e-06 2024-04-19T02:16:10.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.076 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:10.076 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285958+0000", 2024-04-19T02:16:10.076 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015805274000000001 2024-04-19T02:16:10.076 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.076 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.076 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:10.076 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286126+0000", 2024-04-19T02:16:10.076 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016765700000000001 2024-04-19T02:16:10.076 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.076 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.076 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:10.076 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286296+0000", 2024-04-19T02:16:10.076 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017007 2024-04-19T02:16:10.076 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.077 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.077 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:10.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290426+0000", 2024-04-19T02:16:10.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041299839999999997 2024-04-19T02:16:10.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.077 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.077 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:10.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290867+0000", 2024-04-19T02:16:10.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00044083300000000001 2024-04-19T02:16:10.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.077 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.077 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:10.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290900+0000", 2024-04-19T02:16:10.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3380000000000002e-05 2024-04-19T02:16:10.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:10.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290939+0000", 2024-04-19T02:16:10.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8970000000000001e-05 2024-04-19T02:16:10.078 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:10.078 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:10.078 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:10.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.078 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:20 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:10.078 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270161+0000", 2024-04-19T02:16:10.079 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.734314363999999, 2024-04-19T02:16:10.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018061383, 2024-04-19T02:16:10.079 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:10.079 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:10.079 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:10.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.079 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:10.079 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270161+0000", 2024-04-19T02:16:10.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:10.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.079 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:10.079 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270161+0000", 2024-04-19T02:16:10.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:10.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.079 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:10.080 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270161+0000", 2024-04-19T02:16:10.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:10.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.080 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.080 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:10.080 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270164+0000", 2024-04-19T02:16:10.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3000000000000002e-06 2024-04-19T02:16:10.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.080 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.080 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:10.080 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270170+0000", 2024-04-19T02:16:10.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2310000000000001e-06 2024-04-19T02:16:10.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.080 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.081 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:10.081 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270180+0000", 2024-04-19T02:16:10.081 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9320000000000008e-06 2024-04-19T02:16:10.081 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.081 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:10.081 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270214+0000", 2024-04-19T02:16:10.081 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4048999999999999e-05 2024-04-19T02:16:10.081 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.081 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-04-19T02:16:10.081 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270220+0000", 2024-04-19T02:16:10.081 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7769999999999999e-06 2024-04-19T02:16:10.081 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.081 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:10.081 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.277220+0000", 2024-04-19T02:16:10.082 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0070006759999999999 2024-04-19T02:16:10.082 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.082 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:10.082 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.277341+0000", 2024-04-19T02:16:10.082 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120758 2024-04-19T02:16:10.082 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.082 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:10.082 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.277480+0000", 2024-04-19T02:16:10.082 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013903900000000001 2024-04-19T02:16:10.082 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.082 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:10.083 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282351+0000", 2024-04-19T02:16:10.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0048703110000000004 2024-04-19T02:16:10.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:10.083 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288147+0000", 2024-04-19T02:16:10.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0057962500000000002 2024-04-19T02:16:10.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:10.083 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288190+0000", 2024-04-19T02:16:10.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2998999999999999e-05 2024-04-19T02:16:10.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:10.084 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288222+0000", 2024-04-19T02:16:10.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2499999999999997e-05 2024-04-19T02:16:10.084 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:10.084 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:10.084 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:10.084 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.084 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.084 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:21 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:10.084 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:16:10.084 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.734285380999999, 2024-04-19T02:16:10.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020833187999999999, 2024-04-19T02:16:10.084 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:10.084 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:16:10.084 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:10.084 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.085 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:10.085 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:16:10.085 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:10.085 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.085 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.085 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:10.085 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:16:10.085 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:10.085 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.085 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.085 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:10.085 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270189+0000", 2024-04-19T02:16:10.085 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:10.085 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.085 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.086 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:10.086 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270192+0000", 2024-04-19T02:16:10.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7549999999999999e-06 2024-04-19T02:16:10.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.086 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:10.086 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270198+0000", 2024-04-19T02:16:10.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0859999999999998e-06 2024-04-19T02:16:10.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.086 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:10.086 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270204+0000", 2024-04-19T02:16:10.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1970000000000004e-06 2024-04-19T02:16:10.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.087 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:10.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270238+0000", 2024-04-19T02:16:10.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4282000000000001e-05 2024-04-19T02:16:10.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.087 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:10.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270240+0000", 2024-04-19T02:16:10.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3099999999999999e-06 2024-04-19T02:16:10.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.087 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:10.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287131+0000", 2024-04-19T02:16:10.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01689104 2024-04-19T02:16:10.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:10.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287262+0000", 2024-04-19T02:16:10.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130347 2024-04-19T02:16:10.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:10.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291023+0000", 2024-04-19T02:16:10.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037616350000000002 2024-04-19T02:16:10.088 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:10.088 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:10.088 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:10.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.088 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:2285 5.d 5:b310a433:::benchmark_data_smithi121_44835_object2284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:16:10.088 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:55.643557+0000", 2024-04-19T02:16:10.089 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 14.360918658999999, 2024-04-19T02:16:10.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018865537000000002, 2024-04-19T02:16:10.089 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:10.089 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:10.089 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:10.089 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:10.089 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:10.089 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 2285 2024-04-19T02:16:10.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.089 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:10.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:10.089 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643557+0000", 2024-04-19T02:16:10.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:10.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:10.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643557+0000", 2024-04-19T02:16:10.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:10.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:10.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643556+0000", 2024-04-19T02:16:10.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:10.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:10.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643625+0000", 2024-04-19T02:16:10.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9393000000000005e-05 2024-04-19T02:16:10.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.091 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:10.091 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643634+0000", 2024-04-19T02:16:10.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.14e-06 2024-04-19T02:16:10.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.091 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:10.091 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643640+0000", 2024-04-19T02:16:10.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.601e-06 2024-04-19T02:16:10.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.091 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:10.091 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643669+0000", 2024-04-19T02:16:10.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9292999999999999e-05 2024-04-19T02:16:10.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.092 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:10.092 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643760+0000", 2024-04-19T02:16:10.092 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0526999999999996e-05 2024-04-19T02:16:10.092 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.092 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.092 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:10.092 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643892+0000", 2024-04-19T02:16:10.092 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000131607 2024-04-19T02:16:10.092 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.092 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.092 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:10.092 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.649122+0000", 2024-04-19T02:16:10.092 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052308279999999999 2024-04-19T02:16:10.092 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.092 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.092 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:10.093 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.662321+0000", 2024-04-19T02:16:10.093 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013198774999999999 2024-04-19T02:16:10.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.093 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:10.093 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.662385+0000", 2024-04-19T02:16:10.093 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4261e-05 2024-04-19T02:16:10.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.093 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:10.093 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.662422+0000", 2024-04-19T02:16:10.093 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.676e-05 2024-04-19T02:16:10.093 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:10.093 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:10.093 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:10.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.094 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:16494 5.7 5:e2c19dca:::benchmark_data_smithi121_44835_object16493:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:10.094 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.871684+0000", 2024-04-19T02:16:10.094 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.132791726000001, 2024-04-19T02:16:10.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019343257999999999, 2024-04-19T02:16:10.094 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:10.094 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:10.094 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:10.094 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:10.094 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:10.094 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16494 2024-04-19T02:16:10.094 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.094 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:10.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.094 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:10.094 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871684+0000", 2024-04-19T02:16:10.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:10.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:10.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871684+0000", 2024-04-19T02:16:10.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:10.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:10.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871683+0000", 2024-04-19T02:16:10.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:10.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:10.096 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871762+0000", 2024-04-19T02:16:10.096 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8981999999999997e-05 2024-04-19T02:16:10.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.096 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:10.096 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871770+0000", 2024-04-19T02:16:10.096 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7060000000000004e-06 2024-04-19T02:16:10.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.096 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:10.096 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871776+0000", 2024-04-19T02:16:10.096 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4880000000000004e-06 2024-04-19T02:16:10.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:10.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.874098+0000", 2024-04-19T02:16:10.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0023215309999999999 2024-04-19T02:16:10.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:10.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.874245+0000", 2024-04-19T02:16:10.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014735599999999999 2024-04-19T02:16:10.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:10.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.874394+0000", 2024-04-19T02:16:10.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014848300000000001 2024-04-19T02:16:10.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.098 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:10.098 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.876474+0000", 2024-04-19T02:16:10.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020803060000000001 2024-04-19T02:16:10.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.098 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:10.098 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.890939+0000", 2024-04-19T02:16:10.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014464985 2024-04-19T02:16:10.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:10.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.890986+0000", 2024-04-19T02:16:10.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7321000000000003e-05 2024-04-19T02:16:10.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:10.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891027+0000", 2024-04-19T02:16:10.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0689999999999998e-05 2024-04-19T02:16:10.099 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:10.099 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:10.099 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:10.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.099 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:16519 5.f 5:fc30d3a1:::benchmark_data_smithi121_44835_object16518:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:10.099 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.880723+0000", 2024-04-19T02:16:10.100 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.123752603, 2024-04-19T02:16:10.100 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020492519000000001, 2024-04-19T02:16:10.100 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:10.100 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:10.100 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:10.100 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:10.100 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:10.100 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16519 2024-04-19T02:16:10.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.100 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:10.100 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.100 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:10.100 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880723+0000", 2024-04-19T02:16:10.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:10.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.101 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:10.101 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880723+0000", 2024-04-19T02:16:10.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:10.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.101 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:10.101 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880722+0000", 2024-04-19T02:16:10.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:10.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:10.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880794+0000", 2024-04-19T02:16:10.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1515999999999998e-05 2024-04-19T02:16:10.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:10.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880805+0000", 2024-04-19T02:16:10.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1353e-05 2024-04-19T02:16:10.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:10.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880812+0000", 2024-04-19T02:16:10.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1230000000000002e-06 2024-04-19T02:16:10.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:10.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.890954+0000", 2024-04-19T02:16:10.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010142253 2024-04-19T02:16:10.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:10.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891079+0000", 2024-04-19T02:16:10.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000124917 2024-04-19T02:16:10.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:10.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891218+0000", 2024-04-19T02:16:10.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000138715 2024-04-19T02:16:10.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:10.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.897321+0000", 2024-04-19T02:16:10.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0061026830000000002 2024-04-19T02:16:10.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:10.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901137+0000", 2024-04-19T02:16:10.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038161699999999998 2024-04-19T02:16:10.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:10.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901181+0000", 2024-04-19T02:16:10.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4362e-05 2024-04-19T02:16:10.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:10.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901215+0000", 2024-04-19T02:16:10.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3929e-05 2024-04-19T02:16:10.105 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:10.105 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:10.105 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:10.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.105 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:16520 5.f 5:f0474691:::benchmark_data_smithi121_44835_object16519:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:10.105 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.880833+0000", 2024-04-19T02:16:10.106 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.123642587999999, 2024-04-19T02:16:10.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020460160000000002, 2024-04-19T02:16:10.106 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:10.106 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:10.106 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:10.106 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:10.106 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:10.106 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16520 2024-04-19T02:16:10.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.106 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:10.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.106 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:10.106 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880833+0000", 2024-04-19T02:16:10.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:10.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:10.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880833+0000", 2024-04-19T02:16:10.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:10.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:10.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880832+0000", 2024-04-19T02:16:10.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:10.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:10.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880909+0000", 2024-04-19T02:16:10.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7095000000000006e-05 2024-04-19T02:16:10.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:10.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880919+0000", 2024-04-19T02:16:10.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8919999999999995e-06 2024-04-19T02:16:10.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:10.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880927+0000", 2024-04-19T02:16:10.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8809999999999996e-06 2024-04-19T02:16:10.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:10.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891901+0000", 2024-04-19T02:16:10.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010974263999999999 2024-04-19T02:16:10.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:10.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.892021+0000", 2024-04-19T02:16:10.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120074 2024-04-19T02:16:10.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:10.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.892165+0000", 2024-04-19T02:16:10.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014328600000000001 2024-04-19T02:16:10.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:10.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.897347+0000", 2024-04-19T02:16:10.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.005182603 2024-04-19T02:16:10.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.110 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:10.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901224+0000", 2024-04-19T02:16:10.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038767620000000002 2024-04-19T02:16:10.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.110 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:10.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901264+0000", 2024-04-19T02:16:10.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9579000000000002e-05 2024-04-19T02:16:10.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.110 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:10.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901293+0000", 2024-04-19T02:16:10.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9300999999999999e-05 2024-04-19T02:16:10.111 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:10.111 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:10.111 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:10.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.111 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:44167 5.7 5:ef4300c4:::benchmark_data_smithi121_44835_object44166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:10.111 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:09.853830+0000", 2024-04-19T02:16:10.111 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.150645104, 2024-04-19T02:16:10.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020082104, 2024-04-19T02:16:10.111 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:10.111 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:10.111 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:10.111 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:10.111 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:10.112 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 44167 2024-04-19T02:16:10.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.112 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:10.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:10.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853830+0000", 2024-04-19T02:16:10.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:10.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:10.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853830+0000", 2024-04-19T02:16:10.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:10.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:10.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853829+0000", 2024-04-19T02:16:10.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:10.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:10.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853863+0000", 2024-04-19T02:16:10.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3151999999999997e-05 2024-04-19T02:16:10.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:10.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853873+0000", 2024-04-19T02:16:10.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0366e-05 2024-04-19T02:16:10.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:10.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853881+0000", 2024-04-19T02:16:10.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6539999999999999e-06 2024-04-19T02:16:10.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.114 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:10.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.859162+0000", 2024-04-19T02:16:10.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052810740000000002 2024-04-19T02:16:10.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.114 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:10.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.859303+0000", 2024-04-19T02:16:10.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000140975 2024-04-19T02:16:10.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:10.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.859460+0000", 2024-04-19T02:16:10.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015754199999999999 2024-04-19T02:16:10.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:10.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.865142+0000", 2024-04-19T02:16:10.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0056819130000000002 2024-04-19T02:16:10.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:10.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.873828+0000", 2024-04-19T02:16:10.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0086861799999999999 2024-04-19T02:16:10.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:10.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.873871+0000", 2024-04-19T02:16:10.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2624999999999999e-05 2024-04-19T02:16:10.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:10.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.873912+0000", 2024-04-19T02:16:10.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1486000000000002e-05 2024-04-19T02:16:10.116 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:10.116 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:10.116 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:10.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.116 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:44177 5.f 5:f4abcea1:::benchmark_data_smithi121_44835_object44176:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:10.117 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:09.859309+0000", 2024-04-19T02:16:10.117 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.145166505, 2024-04-19T02:16:10.117 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018217437, 2024-04-19T02:16:10.117 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:10.117 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:10.117 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:10.117 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:10.117 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:10.117 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 44177 2024-04-19T02:16:10.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.117 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:10.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.117 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:10.117 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.859309+0000", 2024-04-19T02:16:10.117 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:10.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:10.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.859309+0000", 2024-04-19T02:16:10.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:10.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:10.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.859308+0000", 2024-04-19T02:16:10.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:10.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:10.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.859343+0000", 2024-04-19T02:16:10.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.468e-05 2024-04-19T02:16:10.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:10.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.859350+0000", 2024-04-19T02:16:10.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4229999999999999e-06 2024-04-19T02:16:10.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:10.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.859357+0000", 2024-04-19T02:16:10.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1420000000000004e-06 2024-04-19T02:16:10.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:10.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.865145+0000", 2024-04-19T02:16:10.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0057872920000000003 2024-04-19T02:16:10.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:10.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.865289+0000", 2024-04-19T02:16:10.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000144401 2024-04-19T02:16:10.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:10.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.865432+0000", 2024-04-19T02:16:10.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000143022 2024-04-19T02:16:10.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:10.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.867609+0000", 2024-04-19T02:16:10.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021771949999999998 2024-04-19T02:16:10.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:10.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.877443+0000", 2024-04-19T02:16:10.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0098340230000000008 2024-04-19T02:16:10.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:10.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.877488+0000", 2024-04-19T02:16:10.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4808999999999997e-05 2024-04-19T02:16:10.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:10.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:10.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:10.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.877526+0000", 2024-04-19T02:16:10.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8130999999999998e-05 2024-04-19T02:16:10.121 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:10.122 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:10.122 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:10.122 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:10.122 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:10.122 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:16:10.122 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T02:16:10.124 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 15 16 44573 44557 185.64 152.688 0.00525942 0.00538394 2024-04-19T02:16:10.124 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:10.124+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:10.125 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:16:10.224 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:10.225+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:10.228 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:16:10.296 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:16:10.296 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:16:10.296 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.296 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:45215 5.8 5:1e4f4df3:::benchmark_data_smithi121_44835_object45214:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:10.296 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:10.290898+0000", 2024-04-19T02:16:10.296 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0048402999999999996, 2024-04-19T02:16:10.296 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0048677010000000003, 2024-04-19T02:16:10.296 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:10.296 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:10.296 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:10.296 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:10.296 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:10.297 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 45215 2024-04-19T02:16:10.297 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.297 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:10.297 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.297 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:10.297 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.290898+0000", 2024-04-19T02:16:10.297 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:10.297 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.297 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.297 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:10.297 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.290898+0000", 2024-04-19T02:16:10.297 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:10.297 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.297 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.297 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:10.297 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.290897+0000", 2024-04-19T02:16:10.298 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:10.298 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.298 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.298 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:10.298 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.290988+0000", 2024-04-19T02:16:10.298 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.1308000000000001e-05 2024-04-19T02:16:10.298 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.298 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.298 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:10.298 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.291000+0000", 2024-04-19T02:16:10.298 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2428e-05 2024-04-19T02:16:10.298 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.298 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.298 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:10.299 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.291013+0000", 2024-04-19T02:16:10.299 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2551999999999999e-05 2024-04-19T02:16:10.299 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.299 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.299 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:10.302 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.291038+0000", 2024-04-19T02:16:10.302 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.5029999999999999e-05 2024-04-19T02:16:10.302 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.302 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.302 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:10.302 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.291120+0000", 2024-04-19T02:16:10.302 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2235000000000001e-05 2024-04-19T02:16:10.302 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.302 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.302 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:10.302 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.291202+0000", 2024-04-19T02:16:10.302 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.1262999999999998e-05 2024-04-19T02:16:10.302 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.303 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.303 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:10.303 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.294715+0000", 2024-04-19T02:16:10.303 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.003513076 2024-04-19T02:16:10.303 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:10.303 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:10.303 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:10.303 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.303 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.303 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:45216 5.9 e23/16 5:9945ca24:::benchmark_data_smithi121_44835_object45215:head v 23'2900, mlcod=23'2895)", 2024-04-19T02:16:10.303 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:10.291331+0000", 2024-04-19T02:16:10.303 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0044074270000000002, 2024-04-19T02:16:10.303 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0045306840000000001, 2024-04-19T02:16:10.303 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:10.303 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:16:10.304 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:10.304 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.304 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:10.304 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.291331+0000", 2024-04-19T02:16:10.304 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:10.304 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.304 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.304 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:10.304 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.291331+0000", 2024-04-19T02:16:10.304 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:10.304 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.304 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.304 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:10.304 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.291330+0000", 2024-04-19T02:16:10.305 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:10.305 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.305 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.305 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:10.305 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.291390+0000", 2024-04-19T02:16:10.305 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.9969000000000001e-05 2024-04-19T02:16:10.305 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.305 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.305 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:10.305 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.291397+0000", 2024-04-19T02:16:10.305 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.4559999999999997e-06 2024-04-19T02:16:10.305 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.305 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.305 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:10.305 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.291400+0000", 2024-04-19T02:16:10.306 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8530000000000002e-06 2024-04-19T02:16:10.306 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.306 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.306 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:10.306 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.291429+0000", 2024-04-19T02:16:10.306 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.8300999999999999e-05 2024-04-19T02:16:10.306 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.306 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.306 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:10.306 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.291441+0000", 2024-04-19T02:16:10.306 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1878e-05 2024-04-19T02:16:10.306 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:10.307 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:10.307 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:10.307 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.307 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.307 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:45222 5.e 5:75563771:::benchmark_data_smithi121_44835_object45221:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:10.307 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:10.293607+0000", 2024-04-19T02:16:10.307 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0021314120000000001, 2024-04-19T02:16:10.307 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0023249339999999999, 2024-04-19T02:16:10.307 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:10.307 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:10.307 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:10.307 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:10.307 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:10.307 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 45222 2024-04-19T02:16:10.307 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.308 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:10.308 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.308 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:10.308 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.293607+0000", 2024-04-19T02:16:10.308 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:10.308 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.308 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.308 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:10.308 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.293607+0000", 2024-04-19T02:16:10.308 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:10.308 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.308 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.308 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:10.308 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.293606+0000", 2024-04-19T02:16:10.308 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:10.309 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.309 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.309 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:10.309 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.293649+0000", 2024-04-19T02:16:10.309 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3636e-05 2024-04-19T02:16:10.309 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.309 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.309 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:10.309 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.293661+0000", 2024-04-19T02:16:10.309 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1167e-05 2024-04-19T02:16:10.309 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.309 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.309 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:10.309 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.293667+0000", 2024-04-19T02:16:10.310 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.1580000000000002e-06 2024-04-19T02:16:10.310 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.310 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.310 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:10.310 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.293706+0000", 2024-04-19T02:16:10.310 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8930000000000002e-05 2024-04-19T02:16:10.310 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.310 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.310 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:10.310 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.293852+0000", 2024-04-19T02:16:10.310 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000146539 2024-04-19T02:16:10.310 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.310 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.310 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:10.311 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.294001+0000", 2024-04-19T02:16:10.311 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014880199999999999 2024-04-19T02:16:10.311 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:10.311 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:10.311 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:10.311 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.311 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.311 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:45221 5.d e23/16 5:bd6a0fbf:::benchmark_data_smithi121_44835_object45220:head v 23'2819, mlcod=23'2816)", 2024-04-19T02:16:10.311 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:10.294752+0000", 2024-04-19T02:16:10.311 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.00098560700000000011, 2024-04-19T02:16:10.311 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001257385, 2024-04-19T02:16:10.311 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:10.311 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:16:10.311 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:10.311 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.312 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:10.312 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.294752+0000", 2024-04-19T02:16:10.312 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:10.312 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.312 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.312 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:10.312 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.294752+0000", 2024-04-19T02:16:10.312 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:10.312 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.312 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.312 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:10.312 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.294752+0000", 2024-04-19T02:16:10.312 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:10.313 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.313 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.313 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:10.313 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.294815+0000", 2024-04-19T02:16:10.313 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.3659999999999997e-05 2024-04-19T02:16:10.313 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.313 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.313 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:10.313 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.294833+0000", 2024-04-19T02:16:10.313 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.7688000000000001e-05 2024-04-19T02:16:10.313 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.313 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.313 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:10.313 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.294852+0000", 2024-04-19T02:16:10.313 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.8844000000000001e-05 2024-04-19T02:16:10.313 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.314 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.314 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:10.314 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.294877+0000", 2024-04-19T02:16:10.314 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.5457999999999999e-05 2024-04-19T02:16:10.314 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.314 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.314 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:10.314 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.294892+0000", 2024-04-19T02:16:10.314 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.4035e-05 2024-04-19T02:16:10.314 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:10.314 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:10.314 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:10.314 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.314 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.315 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:45223 5.f e23/16 5:f0d2ea2f:::benchmark_data_smithi121_44835_object45222:head v 23'2857, mlcod=23'2855)", 2024-04-19T02:16:10.315 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:10.294861+0000", 2024-04-19T02:16:10.315 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.00087663900000000002, 2024-04-19T02:16:10.315 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001206412, 2024-04-19T02:16:10.315 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:10.315 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:16:10.315 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:10.315 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.315 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:10.315 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.294861+0000", 2024-04-19T02:16:10.315 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:10.315 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.315 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.315 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:10.315 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.294861+0000", 2024-04-19T02:16:10.316 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:10.316 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.316 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.316 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:10.316 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.294861+0000", 2024-04-19T02:16:10.316 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:10.316 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.316 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.316 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:10.316 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.294888+0000", 2024-04-19T02:16:10.316 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.6999999999999999e-05 2024-04-19T02:16:10.316 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.316 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.316 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:10.316 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.294894+0000", 2024-04-19T02:16:10.316 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.1229999999999997e-06 2024-04-19T02:16:10.317 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.317 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.317 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:10.317 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.294899+0000", 2024-04-19T02:16:10.317 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.6090000000000003e-06 2024-04-19T02:16:10.317 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.317 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.317 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:10.317 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.294925+0000", 2024-04-19T02:16:10.317 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.641e-05 2024-04-19T02:16:10.317 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.317 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.317 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:10.317 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.294937+0000", 2024-04-19T02:16:10.317 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2029e-05 2024-04-19T02:16:10.318 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:10.318 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:10.318 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:10.318 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.318 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.318 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:45225 5.e 5:7db3da23:::benchmark_data_smithi121_44835_object45224:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:10.318 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:10.294977+0000", 2024-04-19T02:16:10.318 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.00076093199999999997, 2024-04-19T02:16:10.318 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0011512709999999999, 2024-04-19T02:16:10.318 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:10.318 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:10.318 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:10.318 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:10.318 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:10.319 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 45225 2024-04-19T02:16:10.319 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.319 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:10.319 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.319 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:10.319 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.294977+0000", 2024-04-19T02:16:10.319 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:10.319 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.319 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.319 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:10.319 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.294977+0000", 2024-04-19T02:16:10.319 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:10.319 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.319 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.319 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:10.319 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.294976+0000", 2024-04-19T02:16:10.320 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:10.320 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.320 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.320 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:10.320 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.295045+0000", 2024-04-19T02:16:10.320 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.8466000000000005e-05 2024-04-19T02:16:10.320 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.320 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.320 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:10.320 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.295054+0000", 2024-04-19T02:16:10.320 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.9290000000000004e-06 2024-04-19T02:16:10.320 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.320 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.320 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:10.320 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.295061+0000", 2024-04-19T02:16:10.321 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.5460000000000003e-06 2024-04-19T02:16:10.321 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.321 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.321 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:10.321 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.295338+0000", 2024-04-19T02:16:10.321 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000276335 2024-04-19T02:16:10.321 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.321 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.321 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:10.321 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.295462+0000", 2024-04-19T02:16:10.321 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012400399999999999 2024-04-19T02:16:10.321 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.321 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.321 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:10.321 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.295586+0000", 2024-04-19T02:16:10.322 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012440899999999999 2024-04-19T02:16:10.322 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:10.322 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:10.322 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:10.322 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.322 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.322 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:45226 5.0 5:060d0fd4:::benchmark_data_smithi121_44835_object45225:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:10.322 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:10.295403+0000", 2024-04-19T02:16:10.322 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.00033499499999999999, 2024-04-19T02:16:10.322 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00080713200000000001, 2024-04-19T02:16:10.322 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:10.322 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:10.322 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:10.322 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:10.322 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:10.323 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 45226 2024-04-19T02:16:10.323 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.323 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:10.323 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.323 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:10.323 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.295403+0000", 2024-04-19T02:16:10.323 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:10.323 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.323 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.323 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:10.323 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.295403+0000", 2024-04-19T02:16:10.323 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:10.323 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.323 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.323 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:10.324 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.295402+0000", 2024-04-19T02:16:10.324 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:10.324 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.324 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.324 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:10.324 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.295481+0000", 2024-04-19T02:16:10.324 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9269000000000003e-05 2024-04-19T02:16:10.324 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.324 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.324 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:10.324 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.295493+0000", 2024-04-19T02:16:10.324 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.154e-05 2024-04-19T02:16:10.324 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.324 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.324 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:10.325 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.295501+0000", 2024-04-19T02:16:10.325 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0209999999999999e-06 2024-04-19T02:16:10.325 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.325 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.325 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:10.325 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.295537+0000", 2024-04-19T02:16:10.325 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6340000000000001e-05 2024-04-19T02:16:10.325 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.325 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.325 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:10.325 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.295657+0000", 2024-04-19T02:16:10.325 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000119518 2024-04-19T02:16:10.325 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.325 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.325 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:10.325 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.295787+0000", 2024-04-19T02:16:10.326 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013051499999999999 2024-04-19T02:16:10.326 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:10.326 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:10.326 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:10.326 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.326 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.326 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:45202 5.e 5:71945d8f:::benchmark_data_smithi121_44835_object45201:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:10.326 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:10.285615+0000", 2024-04-19T02:16:10.326 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.010123320999999999, 2024-04-19T02:16:10.326 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010678771, 2024-04-19T02:16:10.326 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:10.326 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:10.326 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:10.326 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:10.327 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:10.327 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 45202 2024-04-19T02:16:10.327 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.327 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:10.327 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.327 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:10.327 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.285615+0000", 2024-04-19T02:16:10.327 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:10.327 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.327 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.327 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:10.327 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.285615+0000", 2024-04-19T02:16:10.327 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:10.327 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.327 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.328 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:10.328 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.285614+0000", 2024-04-19T02:16:10.328 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:10.328 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.328 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.328 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:10.328 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.285645+0000", 2024-04-19T02:16:10.328 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0692999999999999e-05 2024-04-19T02:16:10.328 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.328 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.328 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:10.328 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.285653+0000", 2024-04-19T02:16:10.328 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.6709999999999999e-06 2024-04-19T02:16:10.328 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.329 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.329 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:10.329 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.285659+0000", 2024-04-19T02:16:10.329 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.0220000000000001e-06 2024-04-19T02:16:10.329 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.329 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.329 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:10.329 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.288821+0000", 2024-04-19T02:16:10.329 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0031623490000000001 2024-04-19T02:16:10.329 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.329 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.329 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:10.329 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.288940+0000", 2024-04-19T02:16:10.329 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000119589 2024-04-19T02:16:10.330 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.330 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.330 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:10.330 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.289031+0000", 2024-04-19T02:16:10.330 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.1002999999999996e-05 2024-04-19T02:16:10.330 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.330 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.330 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:10.330 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.292220+0000", 2024-04-19T02:16:10.330 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.003188354 2024-04-19T02:16:10.330 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:10.330 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:10.330 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:10.330 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.331 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.331 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:45213 5.8 5:1a9ee5fb:::benchmark_data_smithi121_44835_object45212:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:10.331 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:10.289199+0000", 2024-04-19T02:16:10.331 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0065387350000000004, 2024-04-19T02:16:10.331 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.007188374, 2024-04-19T02:16:10.331 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:10.331 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:10.331 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:10.331 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:10.331 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:10.331 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 45213 2024-04-19T02:16:10.331 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.331 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:10.332 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.332 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:10.332 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.289199+0000", 2024-04-19T02:16:10.332 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:10.332 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.332 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.332 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:10.332 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.289199+0000", 2024-04-19T02:16:10.332 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:10.332 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.332 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.332 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:10.332 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.289198+0000", 2024-04-19T02:16:10.332 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:10.333 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.333 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.333 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:10.333 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.289247+0000", 2024-04-19T02:16:10.333 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8507000000000002e-05 2024-04-19T02:16:10.333 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.333 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.333 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:10.333 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.289258+0000", 2024-04-19T02:16:10.333 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1148000000000001e-05 2024-04-19T02:16:10.333 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.333 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.333 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:10.333 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.289266+0000", 2024-04-19T02:16:10.334 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9230000000000002e-06 2024-04-19T02:16:10.334 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.334 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.334 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:10.334 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.289304+0000", 2024-04-19T02:16:10.334 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8021000000000001e-05 2024-04-19T02:16:10.334 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.334 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.334 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:10.334 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.289424+0000", 2024-04-19T02:16:10.334 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012040999999999999 2024-04-19T02:16:10.334 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.334 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.334 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:10.335 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.289548+0000", 2024-04-19T02:16:10.335 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012403699999999999 2024-04-19T02:16:10.335 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.335 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.335 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:10.335 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.292472+0000", 2024-04-19T02:16:10.335 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0029235770000000001 2024-04-19T02:16:10.335 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.335 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.335 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:10.335 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.296346+0000", 2024-04-19T02:16:10.335 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.003873853 2024-04-19T02:16:10.335 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:10.336 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:10.336 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:10.336 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:10.296390+0000", 2024-04-19T02:16:10.336 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4443999999999997e-05 2024-04-19T02:16:10.336 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:10.336 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:10.336 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:10.336 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:10.336 INFO:teuthology.orchestra.run.smithi174.stdout: ], 2024-04-19T02:16:10.336 INFO:teuthology.orchestra.run.smithi174.stdout: "num_ops": 9 2024-04-19T02:16:10.336 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:16:10.338 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:16:10.339 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:10.338+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:10.383 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:16:10.403 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:16:10.423 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2: {} 2024-04-19T02:16:10.424 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:16:10.424 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:16:10.424 INFO:teuthology.orchestra.run.smithi121.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:16:10.438 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:10.439+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:10.442 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-19T02:16:10.443 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T02:16:10.443 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-04-19T02:16:10.443 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-19T02:16:10.443 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-19T02:16:10.443 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-04-19T02:16:10.539 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:10.540+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:10.540 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:10.540 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:10.555 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:16:10.618 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:16:10.618 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-19T02:16:10.619 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:16:10.640 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:10.641+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:10.741 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:10.742+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:10.766 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:10.766 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:10.780 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:16:10.842 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:10.843+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:10.943 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:10.943+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:10.962 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:10.963 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:10.979 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:16:11.015 INFO:teuthology.orchestra.run.smithi121.stderr:noscrub is unset 2024-04-19T02:16:11.026 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 16 16 47011 46995 183.56 152.375 0.00835376 0.00544519 2024-04-19T02:16:11.044 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:11.045+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:11.145 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:11.146+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:11.164 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:11.165 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:11.180 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:16:11.246 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:11.247+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:11.347 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:11.347+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:11.402 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:11.402 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:11.417 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:16:11.463 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:11.464+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:11.549 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:11.549+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:11.591 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:11.591 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:11.604 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:16:11.650 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:11.650+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:11.751 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:11.752+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:11.821 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:11.821 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:11.834 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:16:11.852 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:11.852+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:11.953 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:11.954+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:12.026 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 17 16 49412 49396 181.589 150.062 0.00983538 0.00550403 2024-04-19T02:16:12.049 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:12.049 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:12.053 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:12.054+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:12.064 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:16:12.155 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:12.155+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:12.242 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:12.242 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:12.256 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:16:12.257 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:12.257+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:12.357 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:12.357+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:12.426 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:12.426 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:12.436 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:16:12.439 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:16:12.457 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:12.458+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:12.558 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:12.559+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:12.584 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:16:12.604 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:16:12.624 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2: {} 2024-04-19T02:16:12.625 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:16:12.625 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:16:12.625 INFO:teuthology.orchestra.run.smithi121.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:16:12.655 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:16:12.655 INFO:teuthology.orchestra.run.smithi174.stdout: "size": 20, 2024-04-19T02:16:12.655 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 600, 2024-04-19T02:16:12.655 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:16:12.655 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.655 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:10 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:12.655 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269877+0000", 2024-04-19T02:16:12.655 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 43.384086289999999, 2024-04-19T02:16:12.656 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020732751000000001, 2024-04-19T02:16:12.656 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:12.656 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:12.656 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:12.656 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.656 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:12.656 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269877+0000", 2024-04-19T02:16:12.656 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:12.656 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.656 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.656 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:12.656 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269877+0000", 2024-04-19T02:16:12.656 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:12.656 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.657 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.657 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:12.657 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269875+0000", 2024-04-19T02:16:12.657 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:12.657 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.657 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.657 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:12.657 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269891+0000", 2024-04-19T02:16:12.657 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.5494000000000001e-05 2024-04-19T02:16:12.657 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.657 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.657 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:12.657 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269903+0000", 2024-04-19T02:16:12.657 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2003e-05 2024-04-19T02:16:12.658 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.658 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.658 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:12.658 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269914+0000", 2024-04-19T02:16:12.658 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0947e-05 2024-04-19T02:16:12.658 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.658 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.658 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:12.658 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269971+0000", 2024-04-19T02:16:12.658 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7036000000000001e-05 2024-04-19T02:16:12.658 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.658 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.658 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:16:12.659 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269979+0000", 2024-04-19T02:16:12.659 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.6660000000000008e-06 2024-04-19T02:16:12.659 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.659 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.659 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:12.659 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284891+0000", 2024-04-19T02:16:12.659 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014912584 2024-04-19T02:16:12.659 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.659 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.659 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:12.659 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285213+0000", 2024-04-19T02:16:12.659 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00032172199999999998 2024-04-19T02:16:12.659 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.659 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.659 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:12.660 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285357+0000", 2024-04-19T02:16:12.660 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014367899999999999 2024-04-19T02:16:12.660 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.660 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.660 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:12.660 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288883+0000", 2024-04-19T02:16:12.660 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0035268719999999999 2024-04-19T02:16:12.660 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.660 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.660 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:12.660 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290537+0000", 2024-04-19T02:16:12.660 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016537399999999999 2024-04-19T02:16:12.660 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.660 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.660 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:12.661 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290576+0000", 2024-04-19T02:16:12.661 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9266e-05 2024-04-19T02:16:12.661 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.661 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.661 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:12.661 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290609+0000", 2024-04-19T02:16:12.661 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2818000000000003e-05 2024-04-19T02:16:12.661 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:12.661 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:12.661 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:12.661 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.661 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.661 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:11 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:12.661 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:12.661 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 43.384033369000001, 2024-04-19T02:16:12.662 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020352748, 2024-04-19T02:16:12.662 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:12.662 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:12.662 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:12.662 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.662 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:12.662 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:12.662 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:12.662 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.662 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.662 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:12.662 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:12.662 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:12.662 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.663 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.663 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:12.663 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:12.663 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:12.663 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.663 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.663 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:12.663 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269933+0000", 2024-04-19T02:16:12.663 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2169999999999996e-06 2024-04-19T02:16:12.663 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.663 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.663 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:12.663 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269940+0000", 2024-04-19T02:16:12.663 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1500000000000002e-06 2024-04-19T02:16:12.664 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.664 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.664 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:12.664 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269948+0000", 2024-04-19T02:16:12.664 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.8690000000000004e-06 2024-04-19T02:16:12.664 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.664 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.664 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:12.664 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:16:12.664 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2994999999999997e-05 2024-04-19T02:16:12.664 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.664 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.664 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:16:12.664 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269997+0000", 2024-04-19T02:16:12.664 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.9020000000000004e-06 2024-04-19T02:16:12.665 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.665 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.665 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:12.665 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.282729+0000", 2024-04-19T02:16:12.665 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.012732537 2024-04-19T02:16:12.665 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.665 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.665 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:12.665 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.282838+0000", 2024-04-19T02:16:12.665 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000108298 2024-04-19T02:16:12.665 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.665 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.665 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:12.665 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.283002+0000", 2024-04-19T02:16:12.665 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00016466300000000001 2024-04-19T02:16:12.666 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.666 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.666 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:12.666 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288708+0000", 2024-04-19T02:16:12.666 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.005705066 2024-04-19T02:16:12.666 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.666 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.666 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:12.666 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290215+0000", 2024-04-19T02:16:12.666 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0015075010000000001 2024-04-19T02:16:12.666 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.666 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.666 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:12.666 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290259+0000", 2024-04-19T02:16:12.667 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3711999999999998e-05 2024-04-19T02:16:12.667 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.667 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.667 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:12.667 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290282+0000", 2024-04-19T02:16:12.667 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3458000000000001e-05 2024-04-19T02:16:12.667 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:12.667 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:12.667 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:12.667 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.667 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.667 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:14 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:12.667 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:12.667 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 43.383999578999997, 2024-04-19T02:16:12.668 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020137202, 2024-04-19T02:16:12.668 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:12.668 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:12.668 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:12.668 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.668 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:12.668 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:12.668 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:12.668 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.668 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.668 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:12.668 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:12.668 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:12.668 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.668 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.669 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:12.669 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:12.669 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:12.669 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.669 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.669 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:12.669 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269971+0000", 2024-04-19T02:16:12.669 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.5459999999999992e-06 2024-04-19T02:16:12.669 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.669 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.669 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:12.669 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269979+0000", 2024-04-19T02:16:12.669 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9130000000000003e-06 2024-04-19T02:16:12.669 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.670 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.670 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:12.670 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269986+0000", 2024-04-19T02:16:12.670 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.3779999999999998e-06 2024-04-19T02:16:12.670 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.670 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.670 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:12.670 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270030+0000", 2024-04-19T02:16:12.670 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3982e-05 2024-04-19T02:16:12.670 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.670 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.670 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:16:12.670 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270034+0000", 2024-04-19T02:16:12.670 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1779999999999996e-06 2024-04-19T02:16:12.670 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.671 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.671 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:12.671 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.277870+0000", 2024-04-19T02:16:12.671 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0078362150000000005 2024-04-19T02:16:12.671 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.671 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.671 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:12.671 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.278216+0000", 2024-04-19T02:16:12.671 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00034634999999999999 2024-04-19T02:16:12.671 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.671 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.671 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:12.671 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.278732+0000", 2024-04-19T02:16:12.671 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00051536099999999999 2024-04-19T02:16:12.672 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.672 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.672 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:12.672 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.287694+0000", 2024-04-19T02:16:12.672 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0089621019999999996 2024-04-19T02:16:12.672 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.672 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.672 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:12.672 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290026+0000", 2024-04-19T02:16:12.672 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0023323139999999998 2024-04-19T02:16:12.672 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.672 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.672 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:12.672 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290067+0000", 2024-04-19T02:16:12.672 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1043e-05 2024-04-19T02:16:12.673 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.673 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.673 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:12.673 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290100+0000", 2024-04-19T02:16:12.673 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3278999999999998e-05 2024-04-19T02:16:12.673 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:12.673 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:12.673 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:12.673 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.673 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.673 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:12.673 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:12.673 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 43.383967787000003, 2024-04-19T02:16:12.673 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020731702000000001, 2024-04-19T02:16:12.673 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:12.674 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:12.674 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:12.674 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.674 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:12.674 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:12.674 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:12.674 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.674 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.674 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:12.674 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:12.674 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:12.674 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.674 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.675 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:12.675 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:12.675 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:12.675 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.675 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.675 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:12.675 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269998+0000", 2024-04-19T02:16:12.675 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7100000000000001e-06 2024-04-19T02:16:12.675 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.675 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.675 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:12.675 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270005+0000", 2024-04-19T02:16:12.675 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.241e-06 2024-04-19T02:16:12.675 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.675 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.676 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:12.676 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270011+0000", 2024-04-19T02:16:12.676 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6279999999999999e-06 2024-04-19T02:16:12.676 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.676 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.676 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:12.676 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270046+0000", 2024-04-19T02:16:12.676 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5173999999999999e-05 2024-04-19T02:16:12.676 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.676 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.676 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:12.676 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:12.676 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0019999999999997e-06 2024-04-19T02:16:12.676 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.676 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.677 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:12.677 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285619+0000", 2024-04-19T02:16:12.677 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015567391 2024-04-19T02:16:12.677 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.677 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.677 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:12.677 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285671+0000", 2024-04-19T02:16:12.677 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2460999999999998e-05 2024-04-19T02:16:12.677 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.677 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.677 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:12.677 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285775+0000", 2024-04-19T02:16:12.677 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000103389 2024-04-19T02:16:12.677 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.677 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.678 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:12.678 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288934+0000", 2024-04-19T02:16:12.678 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0031595859999999998 2024-04-19T02:16:12.678 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.678 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.678 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:12.678 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290650+0000", 2024-04-19T02:16:12.678 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001716242 2024-04-19T02:16:12.678 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.678 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.678 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:12.678 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290692+0000", 2024-04-19T02:16:12.678 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1910999999999999e-05 2024-04-19T02:16:12.678 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.679 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.679 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:12.679 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290727+0000", 2024-04-19T02:16:12.679 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4412000000000002e-05 2024-04-19T02:16:12.679 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:12.679 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:12.679 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:12.679 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.679 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.679 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:12.679 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270019+0000", 2024-04-19T02:16:12.679 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 43.383944192000001, 2024-04-19T02:16:12.679 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020572014999999999, 2024-04-19T02:16:12.679 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:12.679 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:12.680 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:12.680 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.680 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:12.680 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270019+0000", 2024-04-19T02:16:12.680 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:12.680 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.680 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.680 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:12.680 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270019+0000", 2024-04-19T02:16:12.680 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:12.680 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.680 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.680 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:12.680 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270018+0000", 2024-04-19T02:16:12.680 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:12.681 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.681 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.681 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:12.681 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270021+0000", 2024-04-19T02:16:12.681 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0319999999999999e-06 2024-04-19T02:16:12.681 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.681 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.681 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:12.681 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270028+0000", 2024-04-19T02:16:12.681 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6189999999999996e-06 2024-04-19T02:16:12.681 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.681 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.681 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:12.681 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270035+0000", 2024-04-19T02:16:12.682 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1690000000000003e-06 2024-04-19T02:16:12.682 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.682 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.682 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:12.682 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270078+0000", 2024-04-19T02:16:12.682 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3061e-05 2024-04-19T02:16:12.682 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.682 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.682 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:12.682 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270082+0000", 2024-04-19T02:16:12.682 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4510000000000002e-06 2024-04-19T02:16:12.682 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.682 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.682 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:12.682 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284354+0000", 2024-04-19T02:16:12.683 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014271588999999999 2024-04-19T02:16:12.683 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.683 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.683 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:12.683 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284497+0000", 2024-04-19T02:16:12.683 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014335800000000001 2024-04-19T02:16:12.683 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.683 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.683 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:12.683 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284626+0000", 2024-04-19T02:16:12.683 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000128744 2024-04-19T02:16:12.683 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.683 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.683 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:12.684 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288844+0000", 2024-04-19T02:16:12.684 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00421807 2024-04-19T02:16:12.684 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.684 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.684 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:12.684 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290508+0000", 2024-04-19T02:16:12.684 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001663774 2024-04-19T02:16:12.684 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.684 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.684 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:12.684 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290556+0000", 2024-04-19T02:16:12.684 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.7599999999999998e-05 2024-04-19T02:16:12.684 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.684 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.684 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:12.685 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290591+0000", 2024-04-19T02:16:12.685 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5034999999999999e-05 2024-04-19T02:16:12.685 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:12.685 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:12.685 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:12.685 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.685 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.685 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:12.685 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:12.685 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 43.383921329000003, 2024-04-19T02:16:12.685 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020192280999999999, 2024-04-19T02:16:12.685 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:12.685 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:12.685 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:12.685 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.686 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:12.686 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:12.686 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:12.686 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.686 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.686 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:12.686 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:12.686 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:12.686 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.686 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.686 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:12.686 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:12.686 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:12.687 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.687 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.687 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:12.687 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270045+0000", 2024-04-19T02:16:12.687 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8680000000000001e-06 2024-04-19T02:16:12.687 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.687 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.687 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:12.687 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270052+0000", 2024-04-19T02:16:12.687 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.9999999999999999e-06 2024-04-19T02:16:12.687 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.687 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.688 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:12.688 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270056+0000", 2024-04-19T02:16:12.688 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4479999999999996e-06 2024-04-19T02:16:12.688 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.688 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.688 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:12.688 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270089+0000", 2024-04-19T02:16:12.688 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3071000000000002e-05 2024-04-19T02:16:12.688 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.688 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.688 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:12.688 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270092+0000", 2024-04-19T02:16:12.688 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9780000000000001e-06 2024-04-19T02:16:12.688 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.688 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.689 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:12.689 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.280632+0000", 2024-04-19T02:16:12.689 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010539712 2024-04-19T02:16:12.689 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.689 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.689 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:12.689 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.280743+0000", 2024-04-19T02:16:12.689 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000111048 2024-04-19T02:16:12.689 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.689 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.689 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:12.689 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.281531+0000", 2024-04-19T02:16:12.689 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00078738199999999999 2024-04-19T02:16:12.689 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.690 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.690 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:12.690 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.287949+0000", 2024-04-19T02:16:12.690 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0064185730000000003 2024-04-19T02:16:12.690 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.690 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.690 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:12.690 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290184+0000", 2024-04-19T02:16:12.690 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0022350849999999999 2024-04-19T02:16:12.690 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.690 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.690 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:12.690 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290209+0000", 2024-04-19T02:16:12.690 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4907000000000001e-05 2024-04-19T02:16:12.691 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.691 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.691 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:12.691 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290234+0000", 2024-04-19T02:16:12.691 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4666999999999999e-05 2024-04-19T02:16:12.691 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:12.691 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:12.691 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:12.691 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.691 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.691 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:19 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:12.691 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:12.691 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 43.383899863000003, 2024-04-19T02:16:12.691 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020818203, 2024-04-19T02:16:12.691 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:12.692 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:12.692 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:12.692 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.692 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:12.692 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:12.692 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:12.692 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.692 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.692 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:12.692 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:12.692 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:12.692 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.692 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.692 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:12.693 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:12.693 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:12.693 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.693 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.693 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:12.693 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270065+0000", 2024-04-19T02:16:12.693 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4310000000000001e-06 2024-04-19T02:16:12.693 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.693 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.693 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:12.693 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270070+0000", 2024-04-19T02:16:12.693 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2859999999999999e-06 2024-04-19T02:16:12.693 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.693 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.694 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:12.694 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270077+0000", 2024-04-19T02:16:12.694 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5270000000000004e-06 2024-04-19T02:16:12.694 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.694 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.694 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:12.694 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270107+0000", 2024-04-19T02:16:12.694 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0205999999999998e-05 2024-04-19T02:16:12.694 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.694 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.694 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:12.694 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270111+0000", 2024-04-19T02:16:12.694 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8650000000000003e-06 2024-04-19T02:16:12.695 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.695 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.695 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:12.695 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285936+0000", 2024-04-19T02:16:12.695 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015824677999999998 2024-04-19T02:16:12.695 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.695 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.695 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:12.695 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286007+0000", 2024-04-19T02:16:12.695 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1157999999999999e-05 2024-04-19T02:16:12.695 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.695 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.695 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:12.695 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286086+0000", 2024-04-19T02:16:12.695 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9084000000000004e-05 2024-04-19T02:16:12.696 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.696 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.696 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:12.696 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290740+0000", 2024-04-19T02:16:12.696 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0046543679999999999 2024-04-19T02:16:12.696 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.696 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.696 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:12.696 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290833+0000", 2024-04-19T02:16:12.696 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2551000000000002e-05 2024-04-19T02:16:12.696 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.696 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.696 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:12.696 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290859+0000", 2024-04-19T02:16:12.697 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.6696999999999999e-05 2024-04-19T02:16:12.697 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.697 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.697 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:12.697 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290881+0000", 2024-04-19T02:16:12.697 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1653000000000001e-05 2024-04-19T02:16:12.697 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:12.697 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:12.697 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:12.697 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.697 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.697 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:22 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:12.697 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270081+0000", 2024-04-19T02:16:12.697 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 43.383881588999998, 2024-04-19T02:16:12.698 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014566841000000001, 2024-04-19T02:16:12.698 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:12.698 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:16:12.698 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:12.698 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.698 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:12.698 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270081+0000", 2024-04-19T02:16:12.698 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:12.698 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.698 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.698 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:12.698 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270081+0000", 2024-04-19T02:16:12.698 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:12.698 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.699 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.699 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:12.699 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270081+0000", 2024-04-19T02:16:12.699 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:12.699 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.699 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.699 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:12.699 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270083+0000", 2024-04-19T02:16:12.699 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.21e-06 2024-04-19T02:16:12.699 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.699 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.699 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:12.699 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270100+0000", 2024-04-19T02:16:12.699 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.7045e-05 2024-04-19T02:16:12.699 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.700 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.700 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:12.700 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270106+0000", 2024-04-19T02:16:12.700 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.6710000000000004e-06 2024-04-19T02:16:12.700 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.700 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.700 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:12.700 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270134+0000", 2024-04-19T02:16:12.700 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.8192999999999999e-05 2024-04-19T02:16:12.700 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.700 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.700 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:16:12.700 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270137+0000", 2024-04-19T02:16:12.700 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.117e-06 2024-04-19T02:16:12.700 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.701 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.701 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:12.701 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.275452+0000", 2024-04-19T02:16:12.701 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0053144389999999998 2024-04-19T02:16:12.701 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.701 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.701 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:12.701 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.275576+0000", 2024-04-19T02:16:12.701 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012455800000000001 2024-04-19T02:16:12.701 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.701 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.701 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:12.701 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284648+0000", 2024-04-19T02:16:12.701 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0090719689999999992 2024-04-19T02:16:12.701 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:12.702 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:12.702 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:12.702 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.702 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.702 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:19174 5.4 5:2f42d48e:::benchmark_data_smithi121_44835_object19173:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:12.702 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:00.712766+0000", 2024-04-19T02:16:12.702 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 11.941196623, 2024-04-19T02:16:12.702 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016423842000000001, 2024-04-19T02:16:12.702 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:12.702 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:12.702 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:12.702 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:12.702 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:12.703 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 19174 2024-04-19T02:16:12.703 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.703 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:12.703 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.703 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:12.703 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.712766+0000", 2024-04-19T02:16:12.703 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:12.703 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.703 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.703 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:12.703 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.712766+0000", 2024-04-19T02:16:12.703 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:12.703 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.703 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.704 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:12.704 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.712765+0000", 2024-04-19T02:16:12.704 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:12.704 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.704 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.704 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:12.704 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.712876+0000", 2024-04-19T02:16:12.704 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000110543 2024-04-19T02:16:12.704 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.704 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.704 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:12.704 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.712887+0000", 2024-04-19T02:16:12.704 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1420000000000001e-05 2024-04-19T02:16:12.704 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.704 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.705 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:12.705 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.712896+0000", 2024-04-19T02:16:12.705 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.4330000000000004e-06 2024-04-19T02:16:12.705 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.705 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.705 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:12.705 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.712923+0000", 2024-04-19T02:16:12.705 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7070999999999999e-05 2024-04-19T02:16:12.705 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.705 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.705 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:12.705 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.713005+0000", 2024-04-19T02:16:12.705 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2279000000000003e-05 2024-04-19T02:16:12.705 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.705 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.706 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:12.706 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.713094+0000", 2024-04-19T02:16:12.706 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.9251000000000003e-05 2024-04-19T02:16:12.706 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.706 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.706 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:12.706 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.714553+0000", 2024-04-19T02:16:12.706 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0014587339999999999 2024-04-19T02:16:12.706 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.706 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.706 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:12.706 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.729110+0000", 2024-04-19T02:16:12.706 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014557037 2024-04-19T02:16:12.706 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.707 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.707 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:12.707 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.729158+0000", 2024-04-19T02:16:12.707 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.829e-05 2024-04-19T02:16:12.707 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.707 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.707 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:12.707 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.729190+0000", 2024-04-19T02:16:12.707 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1673e-05 2024-04-19T02:16:12.707 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:12.707 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:12.707 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:12.707 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.707 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.707 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:31117 5.8 5:1f785b1b:::benchmark_data_smithi121_44835_object31116:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-19T02:16:12.708 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:04.771679+0000", 2024-04-19T02:16:12.708 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 7.8822834689999999, 2024-04-19T02:16:12.708 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.013743966, 2024-04-19T02:16:12.708 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:12.708 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:12.708 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:12.708 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:12.708 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:12.708 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 31117 2024-04-19T02:16:12.708 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.708 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:12.708 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.708 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:12.708 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.771679+0000", 2024-04-19T02:16:12.709 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:12.709 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.709 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.709 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:12.709 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.771679+0000", 2024-04-19T02:16:12.709 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:12.709 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.709 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.709 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:12.709 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.771679+0000", 2024-04-19T02:16:12.709 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:12.709 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.709 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.709 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:12.709 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.771744+0000", 2024-04-19T02:16:12.710 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5049999999999996e-05 2024-04-19T02:16:12.710 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.710 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.710 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:12.710 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.771752+0000", 2024-04-19T02:16:12.710 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.3380000000000005e-06 2024-04-19T02:16:12.710 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.710 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.710 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:12.710 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.771759+0000", 2024-04-19T02:16:12.710 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.9800000000000001e-06 2024-04-19T02:16:12.710 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.710 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.710 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:12.711 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.773745+0000", 2024-04-19T02:16:12.711 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0019856769999999999 2024-04-19T02:16:12.711 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.711 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.711 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:12.711 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.773837+0000", 2024-04-19T02:16:12.711 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.1879000000000006e-05 2024-04-19T02:16:12.711 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.711 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.711 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:12.711 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.773983+0000", 2024-04-19T02:16:12.711 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000146389 2024-04-19T02:16:12.711 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.711 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.712 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:12.712 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.775410+0000", 2024-04-19T02:16:12.712 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001426901 2024-04-19T02:16:12.712 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.712 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.712 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:12.712 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.785345+0000", 2024-04-19T02:16:12.712 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0099350319999999999 2024-04-19T02:16:12.712 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.712 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.712 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:12.712 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.785388+0000", 2024-04-19T02:16:12.712 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2862999999999999e-05 2024-04-19T02:16:12.712 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.712 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.713 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:12.713 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.785423+0000", 2024-04-19T02:16:12.713 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5505e-05 2024-04-19T02:16:12.713 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:12.713 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:12.713 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:12.713 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.713 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.713 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:31625 5.e 5:7641e3a5:::benchmark_data_smithi121_44835_object31624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-19T02:16:12.713 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:04.957129+0000", 2024-04-19T02:16:12.713 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 7.6968339170000002, 2024-04-19T02:16:12.713 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015292867999999999, 2024-04-19T02:16:12.713 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:12.713 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:12.713 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:12.714 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:12.714 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:12.714 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 31625 2024-04-19T02:16:12.714 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.714 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:12.714 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.714 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:12.714 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.957129+0000", 2024-04-19T02:16:12.714 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:12.714 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.714 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.714 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:12.714 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.957129+0000", 2024-04-19T02:16:12.715 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:12.715 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.715 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.715 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:12.715 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.957128+0000", 2024-04-19T02:16:12.715 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:12.715 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.715 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.715 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:12.715 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.957150+0000", 2024-04-19T02:16:12.715 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1812999999999999e-05 2024-04-19T02:16:12.715 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.715 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.715 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:12.716 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.957155+0000", 2024-04-19T02:16:12.716 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0080000000000002e-06 2024-04-19T02:16:12.716 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.716 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.716 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:12.716 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.957159+0000", 2024-04-19T02:16:12.716 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2830000000000002e-06 2024-04-19T02:16:12.716 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.716 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.716 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:12.716 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.959584+0000", 2024-04-19T02:16:12.716 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0024255290000000001 2024-04-19T02:16:12.716 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.716 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.716 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:12.717 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.959676+0000", 2024-04-19T02:16:12.717 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.1434000000000006e-05 2024-04-19T02:16:12.717 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.717 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.717 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:12.717 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.959773+0000", 2024-04-19T02:16:12.717 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7866000000000001e-05 2024-04-19T02:16:12.717 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.717 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.717 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:12.717 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.965221+0000", 2024-04-19T02:16:12.717 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0054474190000000002 2024-04-19T02:16:12.717 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.717 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.718 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:12.718 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.972372+0000", 2024-04-19T02:16:12.718 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0071516829999999998 2024-04-19T02:16:12.718 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.718 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.718 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:12.718 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.972400+0000", 2024-04-19T02:16:12.718 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7946e-05 2024-04-19T02:16:12.718 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.718 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.718 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:12.718 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.972422+0000", 2024-04-19T02:16:12.718 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1319e-05 2024-04-19T02:16:12.718 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:12.718 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:12.719 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:12.719 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.719 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.719 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:31628 5.e 5:7a7a642b:::benchmark_data_smithi121_44835_object31627:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-19T02:16:12.719 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:04.958655+0000", 2024-04-19T02:16:12.719 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 7.695307723, 2024-04-19T02:16:12.719 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015118138999999999, 2024-04-19T02:16:12.719 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:12.719 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:12.719 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:12.719 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:12.719 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:12.719 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 31628 2024-04-19T02:16:12.719 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.719 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:12.720 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.720 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:12.720 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.958655+0000", 2024-04-19T02:16:12.720 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:12.720 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.720 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.720 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:12.720 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.958655+0000", 2024-04-19T02:16:12.720 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:12.720 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.720 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.720 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:12.720 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.958654+0000", 2024-04-19T02:16:12.720 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:12.720 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.721 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.721 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:12.721 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.958711+0000", 2024-04-19T02:16:12.721 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.6474999999999997e-05 2024-04-19T02:16:12.721 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.721 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.721 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:12.721 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.958720+0000", 2024-04-19T02:16:12.721 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.1779999999999992e-06 2024-04-19T02:16:12.721 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.721 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.721 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:12.721 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.958725+0000", 2024-04-19T02:16:12.721 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.101e-06 2024-04-19T02:16:12.722 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.722 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.722 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:12.722 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.962283+0000", 2024-04-19T02:16:12.722 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0035576340000000001 2024-04-19T02:16:12.722 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.722 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.722 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:12.722 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.962373+0000", 2024-04-19T02:16:12.722 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0124000000000007e-05 2024-04-19T02:16:12.722 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.722 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.722 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:12.723 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.962505+0000", 2024-04-19T02:16:12.723 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013171299999999999 2024-04-19T02:16:12.723 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.723 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.723 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:12.723 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.966039+0000", 2024-04-19T02:16:12.723 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.003534943 2024-04-19T02:16:12.723 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.723 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.723 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:12.723 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.973700+0000", 2024-04-19T02:16:12.723 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0076601359999999997 2024-04-19T02:16:12.723 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.723 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.724 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:12.724 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.973741+0000", 2024-04-19T02:16:12.724 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1267000000000003e-05 2024-04-19T02:16:12.724 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.724 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.724 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:12.724 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.973773+0000", 2024-04-19T02:16:12.724 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2363999999999997e-05 2024-04-19T02:16:12.724 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:12.724 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:12.724 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:12.724 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.724 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.724 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:31632 5.e 5:7c608c66:::benchmark_data_smithi121_44835_object31631:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-19T02:16:12.724 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:04.960320+0000", 2024-04-19T02:16:12.725 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 7.6936431350000003, 2024-04-19T02:16:12.725 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016282966999999999, 2024-04-19T02:16:12.725 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:12.725 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:12.725 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:12.725 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:12.725 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:12.725 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 31632 2024-04-19T02:16:12.725 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.725 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:12.725 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.725 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:12.725 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.960320+0000", 2024-04-19T02:16:12.725 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:12.726 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.726 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.726 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:12.726 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.960320+0000", 2024-04-19T02:16:12.726 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:12.726 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.726 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.726 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:12.726 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.960319+0000", 2024-04-19T02:16:12.726 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:12.726 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.726 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.726 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:12.726 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.960359+0000", 2024-04-19T02:16:12.726 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0120999999999998e-05 2024-04-19T02:16:12.727 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.727 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.727 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:12.727 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.960370+0000", 2024-04-19T02:16:12.727 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1124999999999999e-05 2024-04-19T02:16:12.727 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.727 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.727 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:12.727 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.960376+0000", 2024-04-19T02:16:12.727 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.6840000000000001e-06 2024-04-19T02:16:12.727 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.727 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.727 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:12.727 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.965241+0000", 2024-04-19T02:16:12.728 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0048651709999999997 2024-04-19T02:16:12.728 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.728 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.728 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:12.728 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.965330+0000", 2024-04-19T02:16:12.728 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.9345999999999995e-05 2024-04-19T02:16:12.728 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.728 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.728 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:12.728 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.965409+0000", 2024-04-19T02:16:12.728 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.8757000000000005e-05 2024-04-19T02:16:12.728 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.728 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.728 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:12.728 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.966312+0000", 2024-04-19T02:16:12.729 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00090340199999999998 2024-04-19T02:16:12.729 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.729 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.729 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:12.729 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.976537+0000", 2024-04-19T02:16:12.729 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010224680999999999 2024-04-19T02:16:12.729 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.729 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.729 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:12.729 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.976580+0000", 2024-04-19T02:16:12.729 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3234e-05 2024-04-19T02:16:12.729 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.729 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.729 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:12.729 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.976603+0000", 2024-04-19T02:16:12.730 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.2421000000000001e-05 2024-04-19T02:16:12.730 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:12.730 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:12.730 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:12.730 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.730 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.730 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:40284 5.8 5:1e312d43:::benchmark_data_smithi121_44835_object40283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:12.730 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:08.287007+0000", 2024-04-19T02:16:12.730 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 4.3669555390000001, 2024-04-19T02:16:12.730 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014162001, 2024-04-19T02:16:12.730 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:12.730 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:12.730 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:12.730 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:12.731 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:12.731 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 40284 2024-04-19T02:16:12.731 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.731 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:12.731 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.731 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:12.731 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.287007+0000", 2024-04-19T02:16:12.731 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:12.731 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.731 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.731 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:12.731 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.287007+0000", 2024-04-19T02:16:12.731 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:12.731 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.732 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.732 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:12.732 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.287007+0000", 2024-04-19T02:16:12.732 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:12.732 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.732 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.732 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:12.732 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.287043+0000", 2024-04-19T02:16:12.732 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6208000000000003e-05 2024-04-19T02:16:12.732 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.732 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.732 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:12.732 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.287054+0000", 2024-04-19T02:16:12.732 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0733e-05 2024-04-19T02:16:12.732 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.733 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.733 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:12.733 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.287060+0000", 2024-04-19T02:16:12.733 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.0780000000000001e-06 2024-04-19T02:16:12.733 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.733 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.733 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:12.733 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.287149+0000", 2024-04-19T02:16:12.733 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.9598000000000005e-05 2024-04-19T02:16:12.733 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.733 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.733 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:12.733 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.287261+0000", 2024-04-19T02:16:12.733 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000111353 2024-04-19T02:16:12.733 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.734 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.734 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:12.734 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.287389+0000", 2024-04-19T02:16:12.734 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000128684 2024-04-19T02:16:12.734 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.734 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.734 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:12.734 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.290293+0000", 2024-04-19T02:16:12.734 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0029040759999999998 2024-04-19T02:16:12.734 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.734 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.734 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:12.734 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.301115+0000", 2024-04-19T02:16:12.735 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010821498000000001 2024-04-19T02:16:12.735 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.735 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.735 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:12.735 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.301145+0000", 2024-04-19T02:16:12.735 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0074999999999999e-05 2024-04-19T02:16:12.735 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.735 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.735 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:12.735 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.301169+0000", 2024-04-19T02:16:12.735 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4260000000000002e-05 2024-04-19T02:16:12.735 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:12.735 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:12.735 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:12.735 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.736 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.736 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:40295 5.8 5:1b750b2f:::benchmark_data_smithi121_44835_object40294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:12.736 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:08.292569+0000", 2024-04-19T02:16:12.736 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 4.3613938890000004, 2024-04-19T02:16:12.736 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014369256, 2024-04-19T02:16:12.736 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:12.736 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:12.736 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:12.736 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:12.736 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:12.736 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 40295 2024-04-19T02:16:12.736 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.736 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:12.736 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.736 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:12.737 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.292569+0000", 2024-04-19T02:16:12.737 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:12.737 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.737 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.737 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:12.737 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.292569+0000", 2024-04-19T02:16:12.737 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:12.737 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.737 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.737 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:12.737 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.292569+0000", 2024-04-19T02:16:12.737 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:12.737 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.737 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.738 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:12.738 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.292729+0000", 2024-04-19T02:16:12.738 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00016024799999999999 2024-04-19T02:16:12.738 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.738 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.738 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:12.738 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.292734+0000", 2024-04-19T02:16:12.738 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.7899999999999999e-06 2024-04-19T02:16:12.738 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.738 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.738 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:12.738 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.292738+0000", 2024-04-19T02:16:12.738 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8409999999999999e-06 2024-04-19T02:16:12.738 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.738 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.739 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:12.739 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.293893+0000", 2024-04-19T02:16:12.739 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0011550390000000001 2024-04-19T02:16:12.739 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.739 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.739 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:12.739 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.293994+0000", 2024-04-19T02:16:12.739 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010097799999999999 2024-04-19T02:16:12.739 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.739 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.739 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:12.739 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.294124+0000", 2024-04-19T02:16:12.739 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012905100000000001 2024-04-19T02:16:12.739 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.739 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.740 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:12.740 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.296736+0000", 2024-04-19T02:16:12.740 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0026127920000000001 2024-04-19T02:16:12.740 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.740 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.740 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:12.740 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.306875+0000", 2024-04-19T02:16:12.740 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010138261000000001 2024-04-19T02:16:12.740 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.740 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.740 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:12.740 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.306915+0000", 2024-04-19T02:16:12.740 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0771e-05 2024-04-19T02:16:12.740 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.740 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.741 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:12.741 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.306938+0000", 2024-04-19T02:16:12.741 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.2827e-05 2024-04-19T02:16:12.741 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:12.741 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:12.741 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:12.741 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.741 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.741 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:40538 5.b 5:d3fc91d5:::benchmark_data_smithi121_44835_object40537:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:12.741 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:08.398560+0000", 2024-04-19T02:16:12.741 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 4.2554028309999996, 2024-04-19T02:16:12.741 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014904897, 2024-04-19T02:16:12.741 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:12.741 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:12.741 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:12.742 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:12.742 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:12.742 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 40538 2024-04-19T02:16:12.742 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.742 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:12.742 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.742 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:12.742 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.398560+0000", 2024-04-19T02:16:12.742 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:12.742 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.742 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.742 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:12.742 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.398560+0000", 2024-04-19T02:16:12.742 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:12.743 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.743 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.743 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:12.743 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.398560+0000", 2024-04-19T02:16:12.743 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:12.743 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.743 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.743 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:12.743 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.398604+0000", 2024-04-19T02:16:12.743 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4376000000000003e-05 2024-04-19T02:16:12.743 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.743 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.743 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:12.743 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.398611+0000", 2024-04-19T02:16:12.743 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.8970000000000002e-06 2024-04-19T02:16:12.743 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.744 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.744 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:12.744 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.398616+0000", 2024-04-19T02:16:12.744 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2660000000000001e-06 2024-04-19T02:16:12.744 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.744 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.744 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:12.744 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.400131+0000", 2024-04-19T02:16:12.744 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0015154089999999999 2024-04-19T02:16:12.744 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.744 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.744 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:12.744 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.400252+0000", 2024-04-19T02:16:12.744 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000120728 2024-04-19T02:16:12.744 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.745 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.745 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:12.745 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.400384+0000", 2024-04-19T02:16:12.745 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013187100000000001 2024-04-19T02:16:12.745 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.745 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.745 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:12.745 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.402978+0000", 2024-04-19T02:16:12.745 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.002593995 2024-04-19T02:16:12.745 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.745 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.745 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:12.745 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.413394+0000", 2024-04-19T02:16:12.745 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010416338000000001 2024-04-19T02:16:12.745 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.746 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.746 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:12.746 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.413431+0000", 2024-04-19T02:16:12.746 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6402000000000001e-05 2024-04-19T02:16:12.746 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.746 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.746 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:12.746 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:08.413465+0000", 2024-04-19T02:16:12.746 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4069000000000002e-05 2024-04-19T02:16:12.746 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:12.746 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:12.746 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:12.746 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.746 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.747 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:42710 5.4 5:2c02047b:::benchmark_data_smithi121_44835_object42709:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:12.747 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:09.265091+0000", 2024-04-19T02:16:12.747 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 3.388871387, 2024-04-19T02:16:12.747 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016523969999999999, 2024-04-19T02:16:12.747 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:12.747 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:12.747 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:12.747 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:12.747 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:12.747 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 42710 2024-04-19T02:16:12.747 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.747 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:12.747 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.747 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:12.747 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.265091+0000", 2024-04-19T02:16:12.748 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:12.748 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.748 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.748 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:12.748 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.265091+0000", 2024-04-19T02:16:12.748 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:12.748 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.748 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.748 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:12.748 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.265091+0000", 2024-04-19T02:16:12.748 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:12.748 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.748 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.748 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:12.749 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.265141+0000", 2024-04-19T02:16:12.749 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.9886000000000003e-05 2024-04-19T02:16:12.749 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.749 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.749 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:12.749 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.265148+0000", 2024-04-19T02:16:12.749 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3089999999999998e-06 2024-04-19T02:16:12.749 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.749 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.749 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:12.749 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.265152+0000", 2024-04-19T02:16:12.749 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.5730000000000001e-06 2024-04-19T02:16:12.749 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.749 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.749 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:12.750 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.266187+0000", 2024-04-19T02:16:12.750 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0010347080000000001 2024-04-19T02:16:12.750 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.750 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.750 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:12.750 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.266321+0000", 2024-04-19T02:16:12.750 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013432599999999999 2024-04-19T02:16:12.750 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.750 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.750 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:12.750 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.266452+0000", 2024-04-19T02:16:12.750 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013062600000000001 2024-04-19T02:16:12.750 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.750 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.750 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:12.751 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.267706+0000", 2024-04-19T02:16:12.751 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0012537609999999999 2024-04-19T02:16:12.751 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.751 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.751 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:12.751 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.281536+0000", 2024-04-19T02:16:12.751 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.01382972 2024-04-19T02:16:12.751 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.751 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.751 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:12.751 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.281571+0000", 2024-04-19T02:16:12.751 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5215000000000001e-05 2024-04-19T02:16:12.751 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.751 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.752 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:12.752 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.281615+0000", 2024-04-19T02:16:12.752 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4604000000000002e-05 2024-04-19T02:16:12.752 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:12.752 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:12.752 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:12.752 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.752 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.752 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:42721 5.8 5:1db37549:::benchmark_data_smithi121_44835_object42720:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:12.752 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:09.269081+0000", 2024-04-19T02:16:12.752 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 3.3848819479999999, 2024-04-19T02:16:12.752 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014948922999999999, 2024-04-19T02:16:12.752 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:12.752 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:12.752 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:12.752 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:12.753 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:12.753 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 42721 2024-04-19T02:16:12.753 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.753 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:12.753 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.753 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:12.753 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.269081+0000", 2024-04-19T02:16:12.753 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:12.753 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.753 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.753 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:12.753 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.269081+0000", 2024-04-19T02:16:12.753 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:12.754 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.754 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.754 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:12.754 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.269080+0000", 2024-04-19T02:16:12.754 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:12.754 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.754 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.754 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:12.754 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.269188+0000", 2024-04-19T02:16:12.754 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010776399999999999 2024-04-19T02:16:12.754 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.754 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.754 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:12.754 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.269197+0000", 2024-04-19T02:16:12.755 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0289999999999994e-06 2024-04-19T02:16:12.755 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.755 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.755 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:12.755 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.269202+0000", 2024-04-19T02:16:12.755 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2440000000000001e-06 2024-04-19T02:16:12.755 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.755 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.755 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:12.755 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.269230+0000", 2024-04-19T02:16:12.755 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7674e-05 2024-04-19T02:16:12.755 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.755 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.755 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:12.755 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.269310+0000", 2024-04-19T02:16:12.756 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0563999999999996e-05 2024-04-19T02:16:12.756 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.756 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.756 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:12.756 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.269394+0000", 2024-04-19T02:16:12.756 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.3059999999999994e-05 2024-04-19T02:16:12.756 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.756 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.756 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:12.756 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.270561+0000", 2024-04-19T02:16:12.756 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001167026 2024-04-19T02:16:12.756 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.756 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.756 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:12.756 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.283962+0000", 2024-04-19T02:16:12.757 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.013401708 2024-04-19T02:16:12.757 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.757 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.757 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:12.757 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.284007+0000", 2024-04-19T02:16:12.757 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4777000000000002e-05 2024-04-19T02:16:12.757 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.757 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.757 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:12.757 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.284030+0000", 2024-04-19T02:16:12.757 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.2739999999999999e-05 2024-04-19T02:16:12.757 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:12.757 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:12.757 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:12.757 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.758 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.758 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:42724 5.0 5:0d0b7b99:::benchmark_data_smithi121_44835_object42723:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:12.758 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:09.270595+0000", 2024-04-19T02:16:12.758 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 3.3833675699999999, 2024-04-19T02:16:12.758 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.018445754000000002, 2024-04-19T02:16:12.758 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:12.758 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:12.758 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:12.758 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:12.758 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:12.758 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 42724 2024-04-19T02:16:12.758 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.758 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:12.758 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.758 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:12.759 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.270595+0000", 2024-04-19T02:16:12.759 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:12.759 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.759 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.759 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:12.759 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.270595+0000", 2024-04-19T02:16:12.759 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:12.759 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.759 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.759 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:12.759 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.270595+0000", 2024-04-19T02:16:12.759 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:12.759 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.759 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.760 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:12.760 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.270634+0000", 2024-04-19T02:16:12.760 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9270000000000002e-05 2024-04-19T02:16:12.760 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.760 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.760 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:12.760 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.270640+0000", 2024-04-19T02:16:12.760 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.8139999999999997e-06 2024-04-19T02:16:12.760 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.760 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.760 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:12.760 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.270645+0000", 2024-04-19T02:16:12.760 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.729e-06 2024-04-19T02:16:12.760 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.761 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.761 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:12.761 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.270676+0000", 2024-04-19T02:16:12.761 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1390000000000003e-05 2024-04-19T02:16:12.761 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.761 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.761 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:12.761 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.270808+0000", 2024-04-19T02:16:12.761 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013151699999999999 2024-04-19T02:16:12.761 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.761 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.761 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:12.761 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.270944+0000", 2024-04-19T02:16:12.761 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013695999999999999 2024-04-19T02:16:12.762 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.762 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.762 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:12.762 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.272565+0000", 2024-04-19T02:16:12.762 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016207179999999999 2024-04-19T02:16:12.762 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.762 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.762 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:12.762 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.288992+0000", 2024-04-19T02:16:12.762 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016426356 2024-04-19T02:16:12.762 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.762 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.762 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:12.762 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.289021+0000", 2024-04-19T02:16:12.763 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9257000000000001e-05 2024-04-19T02:16:12.763 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.763 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.763 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:12.763 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.289041+0000", 2024-04-19T02:16:12.763 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.0177999999999999e-05 2024-04-19T02:16:12.763 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:12.763 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:12.763 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:12.763 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.763 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.763 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:42727 5.0 5:038511aa:::benchmark_data_smithi121_44835_object42726:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:12.763 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:09.274943+0000", 2024-04-19T02:16:12.763 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 3.3790193840000002, 2024-04-19T02:16:12.764 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014184255999999999, 2024-04-19T02:16:12.764 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:12.764 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:12.764 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:12.764 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:12.764 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:12.764 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 42727 2024-04-19T02:16:12.764 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.764 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:12.764 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.764 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:12.764 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.274943+0000", 2024-04-19T02:16:12.764 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:12.764 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.764 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.765 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:12.765 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.274943+0000", 2024-04-19T02:16:12.765 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:12.765 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.765 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.765 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:12.765 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.274943+0000", 2024-04-19T02:16:12.765 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:12.765 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.765 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.765 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:12.765 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.274964+0000", 2024-04-19T02:16:12.765 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.0428000000000002e-05 2024-04-19T02:16:12.765 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.765 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.766 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:12.766 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.274968+0000", 2024-04-19T02:16:12.766 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1699999999999999e-06 2024-04-19T02:16:12.766 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.766 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.766 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:12.766 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.274971+0000", 2024-04-19T02:16:12.766 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.236e-06 2024-04-19T02:16:12.766 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.766 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.766 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:12.766 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.275010+0000", 2024-04-19T02:16:12.766 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9100999999999997e-05 2024-04-19T02:16:12.766 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.767 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.767 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:12.767 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.275135+0000", 2024-04-19T02:16:12.767 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000125186 2024-04-19T02:16:12.767 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.767 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.767 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:12.767 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.275263+0000", 2024-04-19T02:16:12.767 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012745399999999999 2024-04-19T02:16:12.767 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.767 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.767 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:12.767 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.277426+0000", 2024-04-19T02:16:12.767 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0021632029999999998 2024-04-19T02:16:12.767 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.768 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.768 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:12.768 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.289076+0000", 2024-04-19T02:16:12.768 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.011650519999999999 2024-04-19T02:16:12.768 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.768 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.768 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:12.768 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.289106+0000", 2024-04-19T02:16:12.768 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9912000000000001e-05 2024-04-19T02:16:12.768 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:12.768 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:12.768 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:12.768 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.289128+0000", 2024-04-19T02:16:12.768 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1384000000000001e-05 2024-04-19T02:16:12.769 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:12.769 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:12.769 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:12.769 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:12.769 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:12.769 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:16:12.770 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:12.771+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:12.771 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:16:12.870 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:12.871+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:12.959 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-04-19T02:16:12.959 INFO:teuthology.orchestra.run.smithi177.stdout: "ops": [ 2024-04-19T02:16:12.959 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.960 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:51595 5.5 5:af50fd2e:::benchmark_data_smithi121_44835_object51594:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T02:16:12.960 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:12.949286+0000", 2024-04-19T02:16:12.960 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0094384619999999999, 2024-04-19T02:16:12.960 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0094691940000000002, 2024-04-19T02:16:12.960 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:12.960 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:12.960 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:12.960 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:12.960 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:12.960 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 51595 2024-04-19T02:16:12.960 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.960 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:12.960 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.960 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:12.961 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.949286+0000", 2024-04-19T02:16:12.961 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:12.961 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.961 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.961 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:12.961 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.949286+0000", 2024-04-19T02:16:12.961 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:12.961 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.961 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.961 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:12.961 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.949285+0000", 2024-04-19T02:16:12.961 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:12.961 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.961 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.962 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:12.962 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.949442+0000", 2024-04-19T02:16:12.962 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00015642999999999999 2024-04-19T02:16:12.962 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.962 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.962 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:12.962 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.949452+0000", 2024-04-19T02:16:12.962 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0496000000000001e-05 2024-04-19T02:16:12.962 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.962 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.962 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:12.962 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.949459+0000", 2024-04-19T02:16:12.962 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.2420000000000003e-06 2024-04-19T02:16:12.962 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.962 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.963 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:12.963 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.949493+0000", 2024-04-19T02:16:12.963 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.3865000000000002e-05 2024-04-19T02:16:12.963 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.963 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.963 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:12.963 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.949613+0000", 2024-04-19T02:16:12.963 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00011940800000000001 2024-04-19T02:16:12.963 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.963 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.963 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:12.963 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.949743+0000", 2024-04-19T02:16:12.963 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00013006000000000001 2024-04-19T02:16:12.963 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.964 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.964 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:12.964 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.954021+0000", 2024-04-19T02:16:12.964 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0042787759999999998 2024-04-19T02:16:12.964 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:12.964 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:12.964 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:12.964 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.964 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.964 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:51600 5.5 5:a63d741d:::benchmark_data_smithi121_44835_object51599:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T02:16:12.964 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:12.949724+0000", 2024-04-19T02:16:12.964 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0090001290000000008, 2024-04-19T02:16:12.964 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0091254379999999996, 2024-04-19T02:16:12.964 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:12.964 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:12.965 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:12.965 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:12.965 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:12.965 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 51600 2024-04-19T02:16:12.965 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.965 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:12.965 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.965 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:12.965 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.949724+0000", 2024-04-19T02:16:12.965 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:12.965 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.965 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.965 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:12.965 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.949724+0000", 2024-04-19T02:16:12.966 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:12.966 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.966 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.966 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:12.966 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.949724+0000", 2024-04-19T02:16:12.966 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:12.966 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.966 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.966 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:12.966 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.949881+0000", 2024-04-19T02:16:12.966 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000157627 2024-04-19T02:16:12.966 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.966 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.966 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:12.967 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.949896+0000", 2024-04-19T02:16:12.967 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.4854999999999999e-05 2024-04-19T02:16:12.967 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.967 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.967 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:12.967 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.949910+0000", 2024-04-19T02:16:12.967 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.3536999999999999e-05 2024-04-19T02:16:12.967 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.967 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.967 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:12.968 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.951284+0000", 2024-04-19T02:16:12.968 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.001374477 2024-04-19T02:16:12.968 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.968 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.968 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:12.968 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.951398+0000", 2024-04-19T02:16:12.968 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000114212 2024-04-19T02:16:12.968 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.968 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.968 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:12.968 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.951526+0000", 2024-04-19T02:16:12.968 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000127687 2024-04-19T02:16:12.968 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.968 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.968 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:12.969 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.954134+0000", 2024-04-19T02:16:12.969 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0026078609999999999 2024-04-19T02:16:12.969 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:12.969 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:12.969 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:12.969 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.969 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.969 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:51605 5.6 5:6c87125e:::benchmark_data_smithi121_44835_object51604:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T02:16:12.969 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:12.955547+0000", 2024-04-19T02:16:12.969 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0031776629999999998, 2024-04-19T02:16:12.969 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.003417116, 2024-04-19T02:16:12.969 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:12.969 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:12.969 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:12.969 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:12.970 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:12.970 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 51605 2024-04-19T02:16:12.970 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.970 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:12.970 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.970 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:12.970 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.955547+0000", 2024-04-19T02:16:12.970 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:12.970 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.970 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.970 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:12.970 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.955547+0000", 2024-04-19T02:16:12.970 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:12.970 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.971 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.971 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:12.971 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.955546+0000", 2024-04-19T02:16:12.971 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:12.971 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.971 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.971 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:12.971 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.955601+0000", 2024-04-19T02:16:12.971 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.5197e-05 2024-04-19T02:16:12.971 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.971 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.971 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:12.971 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.955613+0000", 2024-04-19T02:16:12.971 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.2510999999999999e-05 2024-04-19T02:16:12.971 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.972 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.972 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:12.972 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.955622+0000", 2024-04-19T02:16:12.972 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.1310000000000006e-06 2024-04-19T02:16:12.972 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.972 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.972 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:12.972 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.955663+0000", 2024-04-19T02:16:12.972 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.1386e-05 2024-04-19T02:16:12.972 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.972 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.972 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:12.972 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.955810+0000", 2024-04-19T02:16:12.972 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00014700100000000001 2024-04-19T02:16:12.972 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.973 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.973 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:12.973 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.955960+0000", 2024-04-19T02:16:12.973 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00015029400000000001 2024-04-19T02:16:12.973 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:12.973 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:12.973 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:12.973 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.973 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.973 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:51608 5.6 5:6a70cf82:::benchmark_data_smithi121_44835_object51607:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T02:16:12.973 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:12.956743+0000", 2024-04-19T02:16:12.973 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0019812240000000002, 2024-04-19T02:16:12.973 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.002306415, 2024-04-19T02:16:12.973 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:12.974 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "reached pg", 2024-04-19T02:16:12.974 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:12.974 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:12.974 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:12.974 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 51608 2024-04-19T02:16:12.974 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.974 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:12.974 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.974 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:12.974 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.956743+0000", 2024-04-19T02:16:12.974 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:12.974 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.974 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.974 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:12.975 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.956743+0000", 2024-04-19T02:16:12.975 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:12.975 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.975 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.975 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:12.975 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.956743+0000", 2024-04-19T02:16:12.975 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:12.975 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.975 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.975 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:12.975 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.956813+0000", 2024-04-19T02:16:12.975 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.0193999999999999e-05 2024-04-19T02:16:12.975 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.975 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.976 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:12.976 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.956821+0000", 2024-04-19T02:16:12.976 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.6750000000000008e-06 2024-04-19T02:16:12.976 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.976 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.976 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:12.976 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.956827+0000", 2024-04-19T02:16:12.976 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.1909999999999999e-06 2024-04-19T02:16:12.976 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.976 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.976 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:12.976 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.957677+0000", 2024-04-19T02:16:12.976 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00085077999999999998 2024-04-19T02:16:12.976 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:12.976 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:12.977 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:12.977 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.977 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.977 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:51610 5.5 5:a2f58540:::benchmark_data_smithi121_44835_object51609:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T02:16:12.977 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:12.956833+0000", 2024-04-19T02:16:12.977 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.00189174, 2024-04-19T02:16:12.977 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0022796539999999999, 2024-04-19T02:16:12.977 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:12.977 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:12.977 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:12.977 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:12.977 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:12.977 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 51610 2024-04-19T02:16:12.977 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.978 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:12.978 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.978 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:12.978 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.956833+0000", 2024-04-19T02:16:12.978 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:12.978 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.978 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.978 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:12.978 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.956833+0000", 2024-04-19T02:16:12.978 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:12.978 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.978 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.978 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:12.978 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.956832+0000", 2024-04-19T02:16:12.978 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:12.979 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.979 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.979 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:12.979 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.956909+0000", 2024-04-19T02:16:12.979 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.7076999999999994e-05 2024-04-19T02:16:12.979 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.979 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.979 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:12.979 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.956917+0000", 2024-04-19T02:16:12.979 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.3359999999999997e-06 2024-04-19T02:16:12.979 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.979 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.979 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:12.979 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.956920+0000", 2024-04-19T02:16:12.979 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.5839999999999999e-06 2024-04-19T02:16:12.980 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.980 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.980 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:12.980 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.956950+0000", 2024-04-19T02:16:12.980 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.9428e-05 2024-04-19T02:16:12.980 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.980 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.980 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:12.980 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.957057+0000", 2024-04-19T02:16:12.980 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000106814 2024-04-19T02:16:12.980 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.980 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.980 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:12.980 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.957179+0000", 2024-04-19T02:16:12.981 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012257899999999999 2024-04-19T02:16:12.981 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:12.981 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:12.981 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:12.981 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.981 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.981 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:51612 5.6 5.d3882a56 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T02:16:12.981 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:12.956926+0000", 2024-04-19T02:16:12.981 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.001798331, 2024-04-19T02:16:12.981 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0022466230000000001, 2024-04-19T02:16:12.981 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:12.981 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "queued for pg", 2024-04-19T02:16:12.981 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:12.981 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:12.981 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:12.982 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 51612 2024-04-19T02:16:12.982 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.982 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:12.982 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.982 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:12.982 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.956926+0000", 2024-04-19T02:16:12.982 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:12.982 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.982 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.982 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:12.982 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.956926+0000", 2024-04-19T02:16:12.982 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:12.982 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.982 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.982 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:12.983 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.956926+0000", 2024-04-19T02:16:12.983 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:12.983 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.983 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.983 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:12.983 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.957007+0000", 2024-04-19T02:16:12.983 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.0808000000000003e-05 2024-04-19T02:16:12.983 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.983 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.983 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:12.983 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.957018+0000", 2024-04-19T02:16:12.983 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.1277999999999999e-05 2024-04-19T02:16:12.983 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.983 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.983 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:12.984 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.957024+0000", 2024-04-19T02:16:12.984 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.7309999999999998e-06 2024-04-19T02:16:12.984 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:12.984 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:12.984 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:12.984 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.984 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.984 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:51606 5.0 e24/16 5:0b3378cf:::benchmark_data_smithi121_44835_object51605:head v 24'3150, mlcod=24'3147)", 2024-04-19T02:16:12.984 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:12.956965+0000", 2024-04-19T02:16:12.984 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0017597559999999999, 2024-04-19T02:16:12.984 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0022653460000000001, 2024-04-19T02:16:12.984 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:12.984 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:12.984 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:12.985 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.985 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:12.985 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.956965+0000", 2024-04-19T02:16:12.985 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:12.985 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.985 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.985 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:12.985 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.956965+0000", 2024-04-19T02:16:12.985 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:12.985 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.985 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.985 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:12.985 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.956964+0000", 2024-04-19T02:16:12.985 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:12.986 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.986 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.986 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:12.986 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.957045+0000", 2024-04-19T02:16:12.986 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.0830999999999999e-05 2024-04-19T02:16:12.986 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.986 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.986 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:12.986 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.957050+0000", 2024-04-19T02:16:12.986 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.3789999999999997e-06 2024-04-19T02:16:12.986 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.986 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.986 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:12.986 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.957054+0000", 2024-04-19T02:16:12.987 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.9920000000000001e-06 2024-04-19T02:16:12.987 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.987 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.987 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:12.987 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.957080+0000", 2024-04-19T02:16:12.987 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.5103999999999999e-05 2024-04-19T02:16:12.987 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.987 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.987 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:12.987 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.957096+0000", 2024-04-19T02:16:12.987 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.6739999999999999e-05 2024-04-19T02:16:12.987 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:12.987 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:12.987 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:12.988 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.988 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.988 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:51607 5.b e24/16 5:d47264d2:::benchmark_data_smithi121_44835_object51606:head v 24'3248, mlcod=24'3246)", 2024-04-19T02:16:12.988 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:12.957060+0000", 2024-04-19T02:16:12.988 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0016640400000000001, 2024-04-19T02:16:12.988 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0022336930000000001, 2024-04-19T02:16:12.988 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:12.988 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:12.988 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:12.988 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.988 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:12.988 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.957060+0000", 2024-04-19T02:16:12.988 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:12.988 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.989 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.989 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:12.989 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.957060+0000", 2024-04-19T02:16:12.989 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:12.989 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.989 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.989 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:12.989 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.957060+0000", 2024-04-19T02:16:12.989 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967296 2024-04-19T02:16:12.989 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.989 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.989 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:12.989 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.957091+0000", 2024-04-19T02:16:12.990 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.0324999999999998e-05 2024-04-19T02:16:12.990 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.990 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.990 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:12.990 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.957095+0000", 2024-04-19T02:16:12.990 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.0489999999999997e-06 2024-04-19T02:16:12.990 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.990 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.990 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:12.990 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.957098+0000", 2024-04-19T02:16:12.990 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.3400000000000002e-06 2024-04-19T02:16:12.990 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.990 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.990 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:12.990 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.957125+0000", 2024-04-19T02:16:12.991 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.6968999999999999e-05 2024-04-19T02:16:12.991 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.991 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.991 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:12.991 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.957150+0000", 2024-04-19T02:16:12.991 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.4765000000000001e-05 2024-04-19T02:16:12.991 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:12.991 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:12.991 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:12.991 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.991 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.991 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:51613 5.c 5:31a2a4ef:::benchmark_data_smithi121_44835_object51612:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T02:16:12.991 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:12.957286+0000", 2024-04-19T02:16:12.991 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0014384510000000001, 2024-04-19T02:16:12.992 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.002074776, 2024-04-19T02:16:12.992 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:12.992 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:12.992 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:12.992 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:12.992 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:12.992 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 51613 2024-04-19T02:16:12.992 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.992 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:12.992 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.992 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:12.992 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.957286+0000", 2024-04-19T02:16:12.992 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:12.992 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.992 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.992 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:12.993 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.957286+0000", 2024-04-19T02:16:12.993 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:12.993 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.993 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.993 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:12.993 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.957286+0000", 2024-04-19T02:16:12.993 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:12.993 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.993 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.993 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:12.993 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.957399+0000", 2024-04-19T02:16:12.993 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000113663 2024-04-19T02:16:12.993 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.993 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.993 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:12.994 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.957406+0000", 2024-04-19T02:16:12.994 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.9940000000000003e-06 2024-04-19T02:16:12.994 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.994 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.994 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:12.994 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.957410+0000", 2024-04-19T02:16:12.994 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.0199999999999996e-06 2024-04-19T02:16:12.994 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.994 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.994 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:12.994 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.957480+0000", 2024-04-19T02:16:12.994 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.9987999999999995e-05 2024-04-19T02:16:12.994 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.994 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.994 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:12.995 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.957568+0000", 2024-04-19T02:16:12.995 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.7565999999999995e-05 2024-04-19T02:16:12.995 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.995 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.995 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:12.995 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.957666+0000", 2024-04-19T02:16:12.995 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.8245000000000006e-05 2024-04-19T02:16:12.995 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:12.995 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:12.995 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:12.995 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.995 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.995 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:51615 5.6 5.abc35df6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T02:16:12.995 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:12.957418+0000", 2024-04-19T02:16:12.995 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0013065349999999999, 2024-04-19T02:16:12.996 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0020201279999999999, 2024-04-19T02:16:12.996 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:12.996 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "queued for pg", 2024-04-19T02:16:12.996 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:12.996 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:12.996 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:12.996 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 51615 2024-04-19T02:16:12.996 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.996 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:12.996 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.996 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:12.996 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.957418+0000", 2024-04-19T02:16:12.996 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:12.996 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.996 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.997 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:12.997 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.957418+0000", 2024-04-19T02:16:12.997 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:12.997 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.997 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.997 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:12.997 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.957417+0000", 2024-04-19T02:16:12.997 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:12.997 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.997 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.997 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:12.997 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.957464+0000", 2024-04-19T02:16:12.997 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.6993999999999998e-05 2024-04-19T02:16:12.997 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.997 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.998 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:12.998 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.957473+0000", 2024-04-19T02:16:12.998 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.4950000000000008e-06 2024-04-19T02:16:12.998 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.998 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.998 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:12.998 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.957479+0000", 2024-04-19T02:16:12.998 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.5929999999999996e-06 2024-04-19T02:16:12.998 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:12.998 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:12.998 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:12.998 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.998 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.998 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:51609 5.7 e24/16 5:edf25d1e:::benchmark_data_smithi121_44835_object51608:head v 24'3202, mlcod=24'3200)", 2024-04-19T02:16:12.999 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:12.957789+0000", 2024-04-19T02:16:12.999 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.00093550299999999996, 2024-04-19T02:16:12.999 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0017087630000000001, 2024-04-19T02:16:12.999 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:12.999 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:12.999 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:12.999 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.999 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:12.999 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.957789+0000", 2024-04-19T02:16:12.999 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:12.999 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:12.999 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:12.999 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:12.999 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.957789+0000", 2024-04-19T02:16:12.999 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.000 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.000 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.000 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:13.000 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.957789+0000", 2024-04-19T02:16:13.000 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:13.000 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.000 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.000 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:13.000 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.957832+0000", 2024-04-19T02:16:13.000 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.2769999999999999e-05 2024-04-19T02:16:13.000 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.000 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.000 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:13.000 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.957839+0000", 2024-04-19T02:16:13.000 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.9349999999999994e-06 2024-04-19T02:16:13.001 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.001 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.001 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:13.001 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.957844+0000", 2024-04-19T02:16:13.001 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.921e-06 2024-04-19T02:16:13.001 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.001 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.001 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:13.001 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.957884+0000", 2024-04-19T02:16:13.001 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.9900000000000001e-05 2024-04-19T02:16:13.001 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.001 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.001 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:13.001 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.957902+0000", 2024-04-19T02:16:13.002 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.8057999999999999e-05 2024-04-19T02:16:13.002 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.002 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:13.002 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.002 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.002 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.002 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:51611 5.0 e24/16 5:0685c877:::benchmark_data_smithi121_44835_object51610:head v 24'3151, mlcod=24'3147)", 2024-04-19T02:16:13.002 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:12.958080+0000", 2024-04-19T02:16:13.002 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.00064408900000000003, 2024-04-19T02:16:13.002 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.001489841, 2024-04-19T02:16:13.002 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:13.002 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:13.002 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:13.002 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.003 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:13.003 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.958080+0000", 2024-04-19T02:16:13.003 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.003 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.003 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.003 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:13.003 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.958080+0000", 2024-04-19T02:16:13.003 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.003 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.003 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.003 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:13.003 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.958080+0000", 2024-04-19T02:16:13.003 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:13.003 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.004 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.004 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:13.004 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.958138+0000", 2024-04-19T02:16:13.004 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.7942000000000002e-05 2024-04-19T02:16:13.004 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.004 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.004 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:13.004 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.958146+0000", 2024-04-19T02:16:13.004 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.4700000000000002e-06 2024-04-19T02:16:13.004 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.004 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.004 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:13.004 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.958152+0000", 2024-04-19T02:16:13.004 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.4859999999999997e-06 2024-04-19T02:16:13.004 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.005 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.005 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:13.005 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.958419+0000", 2024-04-19T02:16:13.005 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00026706599999999999 2024-04-19T02:16:13.005 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.005 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.005 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:13.005 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.958436+0000", 2024-04-19T02:16:13.005 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.7561e-05 2024-04-19T02:16:13.005 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.005 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:13.005 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.005 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.005 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.006 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop_reply(client.4549.0:51605 5.6 e24/16)", 2024-04-19T02:16:13.006 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:12.959187+0000", 2024-04-19T02:16:13.006 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4294967295.999537, 2024-04-19T02:16:13.006 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00045717700000000002, 2024-04-19T02:16:13.006 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:13.006 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "queued for pg", 2024-04-19T02:16:13.006 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:13.006 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.006 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:13.006 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.959187+0000", 2024-04-19T02:16:13.006 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.006 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.006 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.006 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:13.007 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.959187+0000", 2024-04-19T02:16:13.007 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.007 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.007 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.007 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:13.007 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.959187+0000", 2024-04-19T02:16:13.007 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:13.007 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.007 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.007 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:13.007 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.959191+0000", 2024-04-19T02:16:13.007 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.3780000000000003e-06 2024-04-19T02:16:13.007 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.007 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.007 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:13.008 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.959199+0000", 2024-04-19T02:16:13.008 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.2640000000000008e-06 2024-04-19T02:16:13.008 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.008 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.008 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:13.008 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.959206+0000", 2024-04-19T02:16:13.008 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.1460000000000001e-06 2024-04-19T02:16:13.008 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.008 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:13.008 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.008 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.008 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.008 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:51619 5.c 5:35942494:::benchmark_data_smithi121_44835_object51618:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T02:16:13.008 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:12.959444+0000", 2024-04-19T02:16:13.009 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4294967295.9992805, 2024-04-19T02:16:13.009 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000269583, 2024-04-19T02:16:13.009 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:13.009 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "reached pg", 2024-04-19T02:16:13.009 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:13.009 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:13.009 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:13.009 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 51619 2024-04-19T02:16:13.009 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.009 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:13.009 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.009 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:13.009 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.959444+0000", 2024-04-19T02:16:13.009 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.009 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.010 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.010 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:13.010 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.959444+0000", 2024-04-19T02:16:13.010 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.010 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.010 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.010 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:13.010 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.959443+0000", 2024-04-19T02:16:13.010 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:13.010 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.010 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.010 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:13.010 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.959590+0000", 2024-04-19T02:16:13.010 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00014682200000000001 2024-04-19T02:16:13.011 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.011 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.011 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:13.011 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.959597+0000", 2024-04-19T02:16:13.011 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.3390000000000004e-06 2024-04-19T02:16:13.011 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.011 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.011 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:13.011 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.959609+0000", 2024-04-19T02:16:13.011 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.1671999999999999e-05 2024-04-19T02:16:13.011 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.011 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.011 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:13.011 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.959650+0000", 2024-04-19T02:16:13.011 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.1006e-05 2024-04-19T02:16:13.012 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.012 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:13.012 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.012 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.012 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.012 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop_reply(client.4549.0:51613 5.c e24/16)", 2024-04-19T02:16:13.012 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:12.959624+0000", 2024-04-19T02:16:13.012 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4294967295.9991007, 2024-04-19T02:16:13.012 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000175885, 2024-04-19T02:16:13.012 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:13.012 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "queued for pg", 2024-04-19T02:16:13.012 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:13.012 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.012 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:13.012 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.959624+0000", 2024-04-19T02:16:13.013 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.013 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.013 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.013 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:13.013 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.959624+0000", 2024-04-19T02:16:13.013 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.013 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.013 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.013 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:13.013 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.959623+0000", 2024-04-19T02:16:13.013 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:13.013 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.013 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.014 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:13.014 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.959627+0000", 2024-04-19T02:16:13.014 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.2140000000000001e-06 2024-04-19T02:16:13.014 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.014 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.014 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:13.014 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.959631+0000", 2024-04-19T02:16:13.014 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.498e-06 2024-04-19T02:16:13.014 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.014 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.014 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:13.014 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.959635+0000", 2024-04-19T02:16:13.014 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.4759999999999998e-06 2024-04-19T02:16:13.014 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.014 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:13.015 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.015 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.015 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.015 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:51617 5.4 e24/16)", 2024-04-19T02:16:13.015 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:12.959615+0000", 2024-04-19T02:16:13.015 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4294967295.9991093, 2024-04-19T02:16:13.015 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00025314800000000002, 2024-04-19T02:16:13.015 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:13.015 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "queued for pg", 2024-04-19T02:16:13.015 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:13.015 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.015 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:13.015 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.959615+0000", 2024-04-19T02:16:13.015 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.016 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.016 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.016 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:13.016 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.959615+0000", 2024-04-19T02:16:13.016 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.016 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.016 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.016 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:13.016 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.959615+0000", 2024-04-19T02:16:13.016 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:13.016 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.016 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.016 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:13.016 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.959673+0000", 2024-04-19T02:16:13.017 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.8048999999999999e-05 2024-04-19T02:16:13.017 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.017 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.017 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:13.017 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.959683+0000", 2024-04-19T02:16:13.017 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.7070000000000004e-06 2024-04-19T02:16:13.017 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.017 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.017 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:13.017 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.959689+0000", 2024-04-19T02:16:13.017 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.4189999999999999e-06 2024-04-19T02:16:13.017 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.017 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:13.017 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.018 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.018 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.018 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:51614 5.7 e24/16 5:e1a4b32e:::benchmark_data_smithi121_44835_object51613:head v 24'3203, mlcod=24'3200)", 2024-04-19T02:16:13.018 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:12.959660+0000", 2024-04-19T02:16:13.018 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4294967295.999064, 2024-04-19T02:16:13.018 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000265837, 2024-04-19T02:16:13.018 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:13.018 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:13.018 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:13.018 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.018 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:13.018 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.959660+0000", 2024-04-19T02:16:13.018 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.018 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.019 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.019 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:13.019 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.959660+0000", 2024-04-19T02:16:13.019 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.019 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.019 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.019 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:13.019 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.959660+0000", 2024-04-19T02:16:13.019 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:13.019 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.019 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.019 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:13.019 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.959686+0000", 2024-04-19T02:16:13.020 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.6208999999999999e-05 2024-04-19T02:16:13.020 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.020 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.020 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:13.020 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.959692+0000", 2024-04-19T02:16:13.020 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.879e-06 2024-04-19T02:16:13.020 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.020 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.020 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:13.020 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.959696+0000", 2024-04-19T02:16:13.020 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.0899999999999998e-06 2024-04-19T02:16:13.020 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.020 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.020 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:13.020 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.959743+0000", 2024-04-19T02:16:13.021 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.6822e-05 2024-04-19T02:16:13.021 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.021 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.021 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:13.021 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.959761+0000", 2024-04-19T02:16:13.021 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.8371000000000001e-05 2024-04-19T02:16:13.021 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.021 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:13.021 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.021 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.021 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.021 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:51618 5.8 e24/16 5:1315645f:::benchmark_data_smithi121_44835_object51617:head v 24'3240, mlcod=24'3238)", 2024-04-19T02:16:13.021 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:12.959695+0000", 2024-04-19T02:16:13.021 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4294967295.9990292, 2024-04-19T02:16:13.021 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000306192, 2024-04-19T02:16:13.022 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:13.022 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:13.022 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:13.022 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.022 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:13.022 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.959695+0000", 2024-04-19T02:16:13.022 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.022 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.022 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.022 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:13.022 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.959695+0000", 2024-04-19T02:16:13.022 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.022 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.022 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.022 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:13.023 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.959695+0000", 2024-04-19T02:16:13.023 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:13.023 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.023 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.023 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:13.023 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.959738+0000", 2024-04-19T02:16:13.023 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.3099999999999997e-05 2024-04-19T02:16:13.023 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.023 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.023 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:13.023 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.959746+0000", 2024-04-19T02:16:13.023 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.4580000000000004e-06 2024-04-19T02:16:13.023 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.023 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.023 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:13.024 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.959751+0000", 2024-04-19T02:16:13.024 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.6699999999999999e-06 2024-04-19T02:16:13.024 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.024 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.024 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:13.024 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.959778+0000", 2024-04-19T02:16:13.024 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.7052000000000001e-05 2024-04-19T02:16:13.024 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.024 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.024 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:13.024 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:12.959798+0000", 2024-04-19T02:16:13.024 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.9573e-05 2024-04-19T02:16:13.024 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.024 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:13.024 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.025 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.025 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2024-04-19T02:16:13.025 INFO:teuthology.orchestra.run.smithi177.stdout: "num_ops": 18 2024-04-19T02:16:13.025 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-04-19T02:16:13.026 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:13.026+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:13.027 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:16:13.027 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T02:16:13.028 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 18 16 51780 51764 179.722 148 0.0090738 0.00556134 2024-04-19T02:16:13.126 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:13.127+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:13.205 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-04-19T02:16:13.205 INFO:teuthology.orchestra.run.smithi177.stdout: "ops": [], 2024-04-19T02:16:13.205 INFO:teuthology.orchestra.run.smithi177.stdout: "complaint_time": 30, 2024-04-19T02:16:13.205 INFO:teuthology.orchestra.run.smithi177.stdout: "num_blocked_ops": 0 2024-04-19T02:16:13.205 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-04-19T02:16:13.221 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:16:13.263 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:13.263+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:13.329 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:13.330+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:13.431 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:13.431+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:13.447 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-04-19T02:16:13.447 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 20, 2024-04-19T02:16:13.447 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 600, 2024-04-19T02:16:13.447 INFO:teuthology.orchestra.run.smithi177.stdout: "ops": [ 2024-04-19T02:16:13.447 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.447 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:13.448 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:29.270159+0000", 2024-04-19T02:16:13.448 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 44.175471850999998, 2024-04-19T02:16:13.448 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015837766999999999, 2024-04-19T02:16:13.448 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:13.448 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:13.448 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:13.448 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.448 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:13.448 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270159+0000", 2024-04-19T02:16:13.448 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.448 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.448 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.448 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:13.448 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270159+0000", 2024-04-19T02:16:13.449 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.449 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.449 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.449 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:13.449 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270158+0000", 2024-04-19T02:16:13.449 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:13.449 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.449 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.449 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:13.449 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270171+0000", 2024-04-19T02:16:13.449 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.3050999999999999e-05 2024-04-19T02:16:13.449 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.449 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.449 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:13.449 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270187+0000", 2024-04-19T02:16:13.450 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.6351999999999999e-05 2024-04-19T02:16:13.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.450 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.450 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:13.450 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270203+0000", 2024-04-19T02:16:13.450 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.6056e-05 2024-04-19T02:16:13.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.450 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.450 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:13.450 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.271261+0000", 2024-04-19T02:16:13.450 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0010576520000000001 2024-04-19T02:16:13.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.450 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.450 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:13.451 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.271385+0000", 2024-04-19T02:16:13.451 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012376800000000001 2024-04-19T02:16:13.451 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.451 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.451 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:13.451 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.271539+0000", 2024-04-19T02:16:13.451 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00015414000000000001 2024-04-19T02:16:13.451 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.451 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.451 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:13.451 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.275422+0000", 2024-04-19T02:16:13.451 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.003883507 2024-04-19T02:16:13.451 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.451 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.451 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:13.452 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.285870+0000", 2024-04-19T02:16:13.452 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.010447700000000001 2024-04-19T02:16:13.452 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.452 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.452 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:13.452 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.285947+0000", 2024-04-19T02:16:13.452 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.7429999999999996e-05 2024-04-19T02:16:13.452 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.452 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.452 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:13.452 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.285997+0000", 2024-04-19T02:16:13.452 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.9666999999999997e-05 2024-04-19T02:16:13.452 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.452 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:13.453 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.453 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.453 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.453 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:13.453 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:29.270219+0000", 2024-04-19T02:16:13.453 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 44.175412164999997, 2024-04-19T02:16:13.453 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015932135, 2024-04-19T02:16:13.453 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:13.453 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:13.453 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:13.453 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.453 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:13.453 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270219+0000", 2024-04-19T02:16:13.453 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.454 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.454 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.454 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:13.454 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270219+0000", 2024-04-19T02:16:13.454 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.454 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.454 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.454 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:13.454 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270218+0000", 2024-04-19T02:16:13.454 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:13.454 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.454 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.454 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:13.454 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270223+0000", 2024-04-19T02:16:13.455 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.6090000000000003e-06 2024-04-19T02:16:13.455 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.455 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.455 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:13.455 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270230+0000", 2024-04-19T02:16:13.455 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.9929999999999998e-06 2024-04-19T02:16:13.455 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.455 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.455 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:13.455 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270237+0000", 2024-04-19T02:16:13.455 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.9990000000000002e-06 2024-04-19T02:16:13.455 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.456 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.456 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:13.456 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.272960+0000", 2024-04-19T02:16:13.456 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0027234730000000001 2024-04-19T02:16:13.456 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.456 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.456 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:13.456 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.273062+0000", 2024-04-19T02:16:13.456 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000102043 2024-04-19T02:16:13.456 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.456 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.456 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:13.456 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.273578+0000", 2024-04-19T02:16:13.456 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00051574499999999996 2024-04-19T02:16:13.456 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.457 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.457 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:13.457 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.277063+0000", 2024-04-19T02:16:13.457 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0034846109999999999 2024-04-19T02:16:13.457 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.457 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.457 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:13.457 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286077+0000", 2024-04-19T02:16:13.457 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0090144509999999997 2024-04-19T02:16:13.457 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.457 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.457 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:13.457 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286115+0000", 2024-04-19T02:16:13.457 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.7710999999999999e-05 2024-04-19T02:16:13.457 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.458 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.458 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:13.458 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286151+0000", 2024-04-19T02:16:13.458 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6049e-05 2024-04-19T02:16:13.458 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.458 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:13.458 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.458 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.458 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.458 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(mds.0.3:16 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:13.458 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:29.270306+0000", 2024-04-19T02:16:13.458 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 44.175324729000003, 2024-04-19T02:16:13.458 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016306661, 2024-04-19T02:16:13.458 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:13.458 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:13.459 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:13.459 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.459 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:13.459 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270306+0000", 2024-04-19T02:16:13.459 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.459 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.459 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.459 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:13.459 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270306+0000", 2024-04-19T02:16:13.459 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.459 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.459 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.459 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:13.459 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270306+0000", 2024-04-19T02:16:13.460 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:13.460 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.460 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.460 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:13.460 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270310+0000", 2024-04-19T02:16:13.460 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.0990000000000001e-06 2024-04-19T02:16:13.460 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.460 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.460 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:13.460 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270317+0000", 2024-04-19T02:16:13.460 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.7100000000000001e-06 2024-04-19T02:16:13.460 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.460 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.460 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:13.460 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270324+0000", 2024-04-19T02:16:13.461 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.374e-06 2024-04-19T02:16:13.461 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.461 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.461 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:13.461 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.274312+0000", 2024-04-19T02:16:13.461 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0039885140000000003 2024-04-19T02:16:13.461 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.461 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.461 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:13.461 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.274737+0000", 2024-04-19T02:16:13.461 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00042410899999999999 2024-04-19T02:16:13.461 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.461 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.461 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:13.461 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.274893+0000", 2024-04-19T02:16:13.462 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00015594599999999999 2024-04-19T02:16:13.462 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.462 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.462 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:13.462 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.278597+0000", 2024-04-19T02:16:13.462 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0037046869999999999 2024-04-19T02:16:13.462 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.462 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.462 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:13.462 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286522+0000", 2024-04-19T02:16:13.462 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0079243809999999994 2024-04-19T02:16:13.462 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.462 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.463 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:13.463 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286576+0000", 2024-04-19T02:16:13.463 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.4728999999999997e-05 2024-04-19T02:16:13.463 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.463 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.463 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:13.463 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286613+0000", 2024-04-19T02:16:13.463 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6661e-05 2024-04-19T02:16:13.463 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.463 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:13.463 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.463 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.463 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.463 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(mds.0.3:18 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:13.463 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:29.270329+0000", 2024-04-19T02:16:13.464 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 44.175302242000001, 2024-04-19T02:16:13.464 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016172755, 2024-04-19T02:16:13.464 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:13.464 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:13.464 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:13.464 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.464 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:13.464 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270329+0000", 2024-04-19T02:16:13.464 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.464 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.464 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.464 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:13.464 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270329+0000", 2024-04-19T02:16:13.464 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.464 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.465 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.465 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:13.465 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270328+0000", 2024-04-19T02:16:13.465 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:13.465 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.465 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.465 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:13.465 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270331+0000", 2024-04-19T02:16:13.465 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.9629999999999998e-06 2024-04-19T02:16:13.465 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.465 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.465 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:13.465 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270338+0000", 2024-04-19T02:16:13.465 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.1410000000000002e-06 2024-04-19T02:16:13.465 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.466 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.466 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:13.466 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270344+0000", 2024-04-19T02:16:13.466 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.7410000000000003e-06 2024-04-19T02:16:13.466 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.466 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.466 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:13.466 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270418+0000", 2024-04-19T02:16:13.466 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.3598999999999998e-05 2024-04-19T02:16:13.466 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.466 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.466 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:13.466 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270623+0000", 2024-04-19T02:16:13.466 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00020499599999999999 2024-04-19T02:16:13.466 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.467 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.467 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:13.467 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.271086+0000", 2024-04-19T02:16:13.467 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00046345199999999999 2024-04-19T02:16:13.467 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.467 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.467 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:13.467 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.276220+0000", 2024-04-19T02:16:13.467 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0051338490000000002 2024-04-19T02:16:13.467 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.467 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.467 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:13.467 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286426+0000", 2024-04-19T02:16:13.467 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.010205982000000001 2024-04-19T02:16:13.467 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.468 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.468 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:13.468 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286461+0000", 2024-04-19T02:16:13.468 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.5280000000000001e-05 2024-04-19T02:16:13.468 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.468 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.468 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:13.468 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286502+0000", 2024-04-19T02:16:13.468 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.0102000000000003e-05 2024-04-19T02:16:13.468 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.468 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:13.468 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.468 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.468 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.468 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(mds.0.3:23 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:13.469 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:29.270358+0000", 2024-04-19T02:16:13.469 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 44.175273521000001, 2024-04-19T02:16:13.469 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016257511999999998, 2024-04-19T02:16:13.469 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:13.469 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:13.469 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:13.469 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.469 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:13.469 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270358+0000", 2024-04-19T02:16:13.469 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.469 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.469 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.469 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:13.469 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270358+0000", 2024-04-19T02:16:13.469 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.470 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.470 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.470 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:13.470 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270357+0000", 2024-04-19T02:16:13.470 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:13.470 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.470 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.470 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:13.470 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270360+0000", 2024-04-19T02:16:13.470 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.106e-06 2024-04-19T02:16:13.470 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.470 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.470 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:13.470 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270368+0000", 2024-04-19T02:16:13.470 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.6279999999999996e-06 2024-04-19T02:16:13.471 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.471 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.471 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:13.471 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270373+0000", 2024-04-19T02:16:13.471 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.1410000000000004e-06 2024-04-19T02:16:13.471 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.471 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.471 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:13.471 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.271505+0000", 2024-04-19T02:16:13.471 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0011319069999999999 2024-04-19T02:16:13.471 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.471 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.471 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:13.471 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.271652+0000", 2024-04-19T02:16:13.471 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00014698399999999999 2024-04-19T02:16:13.472 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.472 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.472 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:13.472 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286615+0000", 2024-04-19T02:16:13.472 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.014963156999999999 2024-04-19T02:16:13.472 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.472 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:13.472 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.472 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.472 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.472 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(mds.0.3:24 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:13.472 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:29.270411+0000", 2024-04-19T02:16:13.472 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 44.175220529000001, 2024-04-19T02:16:13.472 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016334762999999999, 2024-04-19T02:16:13.472 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:13.473 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:13.473 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:13.473 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.473 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:13.473 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270411+0000", 2024-04-19T02:16:13.473 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.473 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.473 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.473 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:13.473 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270411+0000", 2024-04-19T02:16:13.473 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.473 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.473 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.473 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:13.473 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270410+0000", 2024-04-19T02:16:13.474 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:13.474 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.474 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.474 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:13.474 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270413+0000", 2024-04-19T02:16:13.474 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.303e-06 2024-04-19T02:16:13.474 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.474 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.474 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:13.474 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270421+0000", 2024-04-19T02:16:13.474 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.3769999999999998e-06 2024-04-19T02:16:13.474 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.474 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.474 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:13.475 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270429+0000", 2024-04-19T02:16:13.475 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.6740000000000003e-06 2024-04-19T02:16:13.475 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.476 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.476 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:13.476 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.275527+0000", 2024-04-19T02:16:13.476 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0050975869999999998 2024-04-19T02:16:13.476 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.476 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.476 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:13.476 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.275946+0000", 2024-04-19T02:16:13.476 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00041882699999999998 2024-04-19T02:16:13.476 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.476 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.476 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:13.476 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286745+0000", 2024-04-19T02:16:13.476 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.010799477 2024-04-19T02:16:13.476 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.477 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:13.477 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.477 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.477 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.477 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:2290 5.5 5:a870a399:::benchmark_data_smithi121_44835_object2289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:16:13.477 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:55.645524+0000", 2024-04-19T02:16:13.477 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 17.800107179000001, 2024-04-19T02:16:13.477 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.018181836999999999, 2024-04-19T02:16:13.477 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:13.477 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:13.477 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:13.477 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:13.478 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:13.478 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 2290 2024-04-19T02:16:13.478 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.478 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:13.478 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.478 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:13.478 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645524+0000", 2024-04-19T02:16:13.478 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.478 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.478 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.478 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:13.478 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645524+0000", 2024-04-19T02:16:13.478 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.478 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.479 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.479 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:13.479 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645524+0000", 2024-04-19T02:16:13.479 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:13.479 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.479 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.479 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:13.479 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645603+0000", 2024-04-19T02:16:13.479 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.9983999999999999e-05 2024-04-19T02:16:13.479 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.479 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.479 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:13.479 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645609+0000", 2024-04-19T02:16:13.479 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.5500000000000002e-06 2024-04-19T02:16:13.479 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.480 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.480 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:13.480 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645613+0000", 2024-04-19T02:16:13.480 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.591e-06 2024-04-19T02:16:13.480 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.480 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.480 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:13.480 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645649+0000", 2024-04-19T02:16:13.480 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6769e-05 2024-04-19T02:16:13.480 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.480 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.480 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:13.480 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645765+0000", 2024-04-19T02:16:13.480 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00011593499999999999 2024-04-19T02:16:13.480 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.481 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.481 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:13.481 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645899+0000", 2024-04-19T02:16:13.481 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00013329499999999999 2024-04-19T02:16:13.481 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.481 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.481 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:13.481 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.649261+0000", 2024-04-19T02:16:13.481 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0033619639999999998 2024-04-19T02:16:13.481 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.481 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.481 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:13.481 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.663657+0000", 2024-04-19T02:16:13.481 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.014396137999999999 2024-04-19T02:16:13.481 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.482 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.482 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:13.482 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.663686+0000", 2024-04-19T02:16:13.482 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.8841999999999999e-05 2024-04-19T02:16:13.482 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.482 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.482 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:13.482 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.663706+0000", 2024-04-19T02:16:13.482 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.0108000000000001e-05 2024-04-19T02:16:13.482 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.482 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:13.482 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.482 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.482 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.482 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:2296 5.5 5:a5d39efa:::benchmark_data_smithi121_44835_object2295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:16:13.483 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:55.646720+0000", 2024-04-19T02:16:13.483 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 17.798911385, 2024-04-19T02:16:13.483 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.017072077000000001, 2024-04-19T02:16:13.483 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:13.483 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:13.483 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:13.483 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:13.483 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:13.483 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 2296 2024-04-19T02:16:13.483 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.483 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:13.483 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.483 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:13.483 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646720+0000", 2024-04-19T02:16:13.483 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.484 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.484 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.484 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:13.484 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646720+0000", 2024-04-19T02:16:13.484 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.484 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.484 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.484 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:13.484 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646719+0000", 2024-04-19T02:16:13.484 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:13.484 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.484 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.484 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:13.484 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646778+0000", 2024-04-19T02:16:13.485 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.9264e-05 2024-04-19T02:16:13.485 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.485 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.485 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:13.485 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646792+0000", 2024-04-19T02:16:13.485 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.3573e-05 2024-04-19T02:16:13.485 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.485 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.485 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:13.485 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646797+0000", 2024-04-19T02:16:13.485 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.3190000000000002e-06 2024-04-19T02:16:13.485 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.485 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.485 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:13.485 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646826+0000", 2024-04-19T02:16:13.486 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.8787999999999999e-05 2024-04-19T02:16:13.486 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.486 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.486 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:13.486 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646913+0000", 2024-04-19T02:16:13.486 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.7601000000000004e-05 2024-04-19T02:16:13.486 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.486 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.486 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:13.486 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646996+0000", 2024-04-19T02:16:13.486 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.2237000000000006e-05 2024-04-19T02:16:13.486 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.486 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.486 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:13.486 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.649533+0000", 2024-04-19T02:16:13.487 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.002537564 2024-04-19T02:16:13.487 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.487 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.487 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:13.487 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.663741+0000", 2024-04-19T02:16:13.487 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.014207322 2024-04-19T02:16:13.487 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.487 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.487 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:13.487 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.663771+0000", 2024-04-19T02:16:13.487 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.0324e-05 2024-04-19T02:16:13.487 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.487 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.487 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:13.488 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.663792+0000", 2024-04-19T02:16:13.488 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.0778999999999999e-05 2024-04-19T02:16:13.488 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.488 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:13.488 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.488 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.488 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.488 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:16497 5.c 5:3cb287d4:::benchmark_data_smithi121_44835_object16496:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:13.488 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:59.873454+0000", 2024-04-19T02:16:13.488 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 13.572177436, 2024-04-19T02:16:13.488 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.017103489999999999, 2024-04-19T02:16:13.488 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:13.488 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:13.488 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:13.488 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:13.489 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:13.489 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 16497 2024-04-19T02:16:13.489 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.489 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:13.489 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.489 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:13.489 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873454+0000", 2024-04-19T02:16:13.489 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.489 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.489 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.489 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:13.489 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873454+0000", 2024-04-19T02:16:13.489 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.489 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.489 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.490 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:13.490 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873453+0000", 2024-04-19T02:16:13.490 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:13.490 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.490 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.490 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:13.490 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873512+0000", 2024-04-19T02:16:13.490 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.8730999999999997e-05 2024-04-19T02:16:13.490 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.490 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.490 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:13.490 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873518+0000", 2024-04-19T02:16:13.490 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.9789999999999998e-06 2024-04-19T02:16:13.490 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.491 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.491 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:13.491 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873522+0000", 2024-04-19T02:16:13.491 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.0570000000000003e-06 2024-04-19T02:16:13.491 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.491 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.491 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:13.491 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873590+0000", 2024-04-19T02:16:13.491 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.8504999999999995e-05 2024-04-19T02:16:13.491 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.491 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.493 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:13.493 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873709+0000", 2024-04-19T02:16:13.493 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000118497 2024-04-19T02:16:13.493 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.493 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.493 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:13.493 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873881+0000", 2024-04-19T02:16:13.493 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000172129 2024-04-19T02:16:13.493 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.493 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.493 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:13.493 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.874627+0000", 2024-04-19T02:16:13.494 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00074580100000000004 2024-04-19T02:16:13.494 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.494 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.494 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:13.494 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.890478+0000", 2024-04-19T02:16:13.494 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015850672 2024-04-19T02:16:13.494 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.494 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.494 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:13.494 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.890522+0000", 2024-04-19T02:16:13.494 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.4376000000000003e-05 2024-04-19T02:16:13.494 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.494 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.495 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:13.495 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.890557+0000", 2024-04-19T02:16:13.495 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.5151999999999998e-05 2024-04-19T02:16:13.495 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.495 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:13.495 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.495 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.495 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.495 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:18635 5.c 5:3691d6fb:::benchmark_data_smithi121_44835_object18634:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:13.495 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:00.547499+0000", 2024-04-19T02:16:13.495 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 12.898132214, 2024-04-19T02:16:13.495 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015584394, 2024-04-19T02:16:13.495 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:13.495 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:13.495 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:13.496 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:13.496 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:13.496 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 18635 2024-04-19T02:16:13.496 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.496 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:13.496 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.496 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:13.496 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.547499+0000", 2024-04-19T02:16:13.496 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.496 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.496 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.496 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:13.496 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.547499+0000", 2024-04-19T02:16:13.496 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.497 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.497 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.497 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:13.497 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.547499+0000", 2024-04-19T02:16:13.497 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:13.497 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.497 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.497 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:13.497 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.547592+0000", 2024-04-19T02:16:13.497 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.3144000000000001e-05 2024-04-19T02:16:13.497 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.497 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.497 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:13.497 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.547598+0000", 2024-04-19T02:16:13.497 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.0390000000000001e-06 2024-04-19T02:16:13.497 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.498 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.498 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:13.498 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.547601+0000", 2024-04-19T02:16:13.498 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.5389999999999999e-06 2024-04-19T02:16:13.498 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.498 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.498 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:13.498 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.548268+0000", 2024-04-19T02:16:13.498 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00066695700000000003 2024-04-19T02:16:13.498 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.498 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.498 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:13.498 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.548384+0000", 2024-04-19T02:16:13.498 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000115562 2024-04-19T02:16:13.498 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.499 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.499 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:13.499 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.548510+0000", 2024-04-19T02:16:13.499 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012620900000000001 2024-04-19T02:16:13.499 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.499 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.499 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:13.499 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.549792+0000", 2024-04-19T02:16:13.499 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00128213 2024-04-19T02:16:13.499 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.499 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.499 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:13.499 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.563011+0000", 2024-04-19T02:16:13.499 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.013219244 2024-04-19T02:16:13.500 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.500 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.500 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:13.500 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.563050+0000", 2024-04-19T02:16:13.500 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.8448999999999997e-05 2024-04-19T02:16:13.500 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.500 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.500 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:13.500 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:00.563083+0000", 2024-04-19T02:16:13.500 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.3402000000000003e-05 2024-04-19T02:16:13.500 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.500 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:13.500 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.500 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.500 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.501 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:20553 5.5 5:a3f892a2:::benchmark_data_smithi121_44835_object20552:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:13.501 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:01.179670+0000", 2024-04-19T02:16:13.501 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 12.265960554999999, 2024-04-19T02:16:13.501 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.01588498, 2024-04-19T02:16:13.501 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:13.501 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:13.501 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:13.501 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:13.501 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:13.501 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 20553 2024-04-19T02:16:13.501 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.501 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:13.501 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.501 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:13.502 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.179670+0000", 2024-04-19T02:16:13.502 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.502 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.502 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.502 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:13.502 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.179670+0000", 2024-04-19T02:16:13.502 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.502 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.502 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.502 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:13.502 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.179670+0000", 2024-04-19T02:16:13.502 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:13.502 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.502 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.502 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:13.503 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.179698+0000", 2024-04-19T02:16:13.503 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.7849999999999999e-05 2024-04-19T02:16:13.503 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.503 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.503 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:13.503 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.179710+0000", 2024-04-19T02:16:13.503 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.1992e-05 2024-04-19T02:16:13.503 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.503 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.503 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:13.503 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.179717+0000", 2024-04-19T02:16:13.503 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.7400000000000004e-06 2024-04-19T02:16:13.503 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.503 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.503 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:13.504 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.179760+0000", 2024-04-19T02:16:13.504 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.2169999999999998e-05 2024-04-19T02:16:13.504 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.504 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.504 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:13.504 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.179876+0000", 2024-04-19T02:16:13.504 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000116972 2024-04-19T02:16:13.504 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.504 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.504 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:13.504 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.180055+0000", 2024-04-19T02:16:13.504 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00017899100000000001 2024-04-19T02:16:13.504 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.505 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.505 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:13.505 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.183338+0000", 2024-04-19T02:16:13.505 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0032824719999999998 2024-04-19T02:16:13.505 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.505 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.505 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:13.505 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.195464+0000", 2024-04-19T02:16:13.505 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.012126504999999999 2024-04-19T02:16:13.505 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.505 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.505 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:13.505 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.195516+0000", 2024-04-19T02:16:13.505 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.1622000000000001e-05 2024-04-19T02:16:13.505 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.506 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.506 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:13.506 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:01.195555+0000", 2024-04-19T02:16:13.506 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.9366999999999998e-05 2024-04-19T02:16:13.506 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.506 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:13.506 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.506 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.506 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.506 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:32982 5.c 5:34483e6c:::benchmark_data_smithi121_44835_object32981:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-19T02:16:13.506 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:05.451717+0000", 2024-04-19T02:16:13.506 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 7.9939141840000003, 2024-04-19T02:16:13.506 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015737741, 2024-04-19T02:16:13.507 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:13.507 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:13.507 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:13.507 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:13.507 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:13.507 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 32982 2024-04-19T02:16:13.507 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.507 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:13.507 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.507 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:13.507 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:05.451717+0000", 2024-04-19T02:16:13.507 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.507 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.507 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.507 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:13.508 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:05.451717+0000", 2024-04-19T02:16:13.508 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.508 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.508 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.508 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:13.508 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:05.451716+0000", 2024-04-19T02:16:13.508 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:13.508 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.508 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.508 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:13.508 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:05.451791+0000", 2024-04-19T02:16:13.508 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.5321999999999995e-05 2024-04-19T02:16:13.508 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.508 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.509 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:13.509 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:05.451800+0000", 2024-04-19T02:16:13.509 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.901e-06 2024-04-19T02:16:13.509 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.509 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.509 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:13.509 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:05.451807+0000", 2024-04-19T02:16:13.509 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.28e-06 2024-04-19T02:16:13.509 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.509 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.509 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:13.509 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:05.456226+0000", 2024-04-19T02:16:13.509 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0044192540000000001 2024-04-19T02:16:13.509 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.509 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.510 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:13.510 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:05.456313+0000", 2024-04-19T02:16:13.510 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.6729000000000003e-05 2024-04-19T02:16:13.510 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.510 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.510 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:13.510 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:05.456441+0000", 2024-04-19T02:16:13.510 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012880699999999999 2024-04-19T02:16:13.510 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.510 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.510 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:13.510 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:05.464380+0000", 2024-04-19T02:16:13.510 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0079384829999999997 2024-04-19T02:16:13.510 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.511 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.511 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:13.511 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:05.467375+0000", 2024-04-19T02:16:13.511 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0029951610000000001 2024-04-19T02:16:13.511 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.511 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.511 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:13.511 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:05.467416+0000", 2024-04-19T02:16:13.511 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.1325000000000002e-05 2024-04-19T02:16:13.511 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.511 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.511 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:13.511 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:05.467455+0000", 2024-04-19T02:16:13.511 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.8158999999999998e-05 2024-04-19T02:16:13.512 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.512 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:13.512 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.512 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.512 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.512 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:42115 5.6 5:61e6399d:::benchmark_data_smithi121_44835_object42114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:13.512 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:09.021513+0000", 2024-04-19T02:16:13.512 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4.4241177309999999, 2024-04-19T02:16:13.512 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015878396999999999, 2024-04-19T02:16:13.512 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:13.512 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:13.512 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:13.512 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:13.512 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:13.512 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 42115 2024-04-19T02:16:13.513 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.513 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:13.513 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.513 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:13.513 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.021513+0000", 2024-04-19T02:16:13.513 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.513 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.513 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.513 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:13.513 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.021513+0000", 2024-04-19T02:16:13.513 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.513 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.513 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.513 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:13.514 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.021512+0000", 2024-04-19T02:16:13.514 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:13.514 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.514 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.514 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:13.514 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.021539+0000", 2024-04-19T02:16:13.514 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.6383000000000001e-05 2024-04-19T02:16:13.514 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.514 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.514 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:13.514 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.021549+0000", 2024-04-19T02:16:13.514 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0115000000000001e-05 2024-04-19T02:16:13.514 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.514 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.515 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:13.515 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.021555+0000", 2024-04-19T02:16:13.515 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.3740000000000003e-06 2024-04-19T02:16:13.515 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.515 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.515 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:13.515 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.025711+0000", 2024-04-19T02:16:13.515 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0041556170000000003 2024-04-19T02:16:13.515 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.515 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.515 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:13.515 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.025885+0000", 2024-04-19T02:16:13.515 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00017444499999999999 2024-04-19T02:16:13.515 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.516 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.516 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:13.516 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.025981+0000", 2024-04-19T02:16:13.516 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.5427000000000006e-05 2024-04-19T02:16:13.516 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.516 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.516 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:13.516 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.034992+0000", 2024-04-19T02:16:13.516 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0090113309999999992 2024-04-19T02:16:13.516 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.516 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.516 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:13.516 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.037309+0000", 2024-04-19T02:16:13.516 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.002316519 2024-04-19T02:16:13.517 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.517 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.517 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:13.517 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.037357+0000", 2024-04-19T02:16:13.517 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.8528e-05 2024-04-19T02:16:13.517 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.517 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.517 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:13.517 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.037392+0000", 2024-04-19T02:16:13.517 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.4489999999999997e-05 2024-04-19T02:16:13.517 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.517 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:13.517 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.517 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.518 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.518 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:42294 5.6 5:600ebb50:::benchmark_data_smithi121_44835_object42293:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:13.518 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:09.092618+0000", 2024-04-19T02:16:13.518 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4.3530125489999998, 2024-04-19T02:16:13.518 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015594693, 2024-04-19T02:16:13.518 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:13.518 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:13.518 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:13.518 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:13.518 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:13.518 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 42294 2024-04-19T02:16:13.518 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.518 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:13.518 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.519 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:13.519 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.092618+0000", 2024-04-19T02:16:13.519 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.519 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.519 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.519 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:13.519 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.092618+0000", 2024-04-19T02:16:13.519 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.519 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.519 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.519 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:13.519 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.092618+0000", 2024-04-19T02:16:13.519 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:13.519 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.519 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.520 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:13.520 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.092676+0000", 2024-04-19T02:16:13.520 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.8301000000000003e-05 2024-04-19T02:16:13.520 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.520 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.520 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:13.520 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.092688+0000", 2024-04-19T02:16:13.520 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.2179e-05 2024-04-19T02:16:13.520 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.520 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.520 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:13.520 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.092696+0000", 2024-04-19T02:16:13.520 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.5460000000000003e-06 2024-04-19T02:16:13.520 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.521 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.521 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:13.521 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.093848+0000", 2024-04-19T02:16:13.521 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00115245 2024-04-19T02:16:13.521 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.521 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.521 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:13.521 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.093975+0000", 2024-04-19T02:16:13.521 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012678599999999999 2024-04-19T02:16:13.521 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.521 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.521 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:13.521 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.094116+0000", 2024-04-19T02:16:13.521 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00014102599999999999 2024-04-19T02:16:13.521 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.522 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.522 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:13.522 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.096305+0000", 2024-04-19T02:16:13.522 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0021888350000000001 2024-04-19T02:16:13.522 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.522 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.522 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:13.522 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.108141+0000", 2024-04-19T02:16:13.522 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.011835930999999999 2024-04-19T02:16:13.522 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.522 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.522 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:13.522 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.108179+0000", 2024-04-19T02:16:13.522 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.8722e-05 2024-04-19T02:16:13.523 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.523 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.523 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:13.523 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.108213+0000", 2024-04-19T02:16:13.523 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.3707000000000001e-05 2024-04-19T02:16:13.523 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.523 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:13.523 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.523 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.523 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.523 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:42714 5.c 5:32899b28:::benchmark_data_smithi121_44835_object42713:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:13.523 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:09.266429+0000", 2024-04-19T02:16:13.523 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4.1792024290000001, 2024-04-19T02:16:13.523 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.017445751999999998, 2024-04-19T02:16:13.523 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:13.524 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:13.524 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:13.524 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:13.524 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:13.524 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 42714 2024-04-19T02:16:13.524 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.524 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:13.524 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.524 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:13.524 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.266429+0000", 2024-04-19T02:16:13.524 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.524 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.524 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.524 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:13.524 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.266429+0000", 2024-04-19T02:16:13.525 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.525 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.525 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.525 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:13.525 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.266428+0000", 2024-04-19T02:16:13.525 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:13.525 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.525 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.525 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:13.525 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.266523+0000", 2024-04-19T02:16:13.525 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.4913000000000004e-05 2024-04-19T02:16:13.525 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.525 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.525 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:13.526 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.266535+0000", 2024-04-19T02:16:13.526 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.2187e-05 2024-04-19T02:16:13.526 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.526 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.526 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:13.526 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.266542+0000", 2024-04-19T02:16:13.526 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.7139999999999993e-06 2024-04-19T02:16:13.526 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.526 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.526 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:13.526 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.267446+0000", 2024-04-19T02:16:13.526 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00090385699999999999 2024-04-19T02:16:13.526 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.526 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.527 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:13.527 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.267570+0000", 2024-04-19T02:16:13.527 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012405599999999999 2024-04-19T02:16:13.527 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.527 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.527 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:13.527 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.267733+0000", 2024-04-19T02:16:13.527 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000162225 2024-04-19T02:16:13.527 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.527 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.527 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:13.527 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.275131+0000", 2024-04-19T02:16:13.527 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0073988639999999998 2024-04-19T02:16:13.527 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.528 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.528 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:13.528 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.283761+0000", 2024-04-19T02:16:13.528 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0086299989999999993 2024-04-19T02:16:13.528 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.528 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.528 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:13.528 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.283824+0000", 2024-04-19T02:16:13.528 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.2632000000000006e-05 2024-04-19T02:16:13.528 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.528 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.528 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:13.528 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.283874+0000", 2024-04-19T02:16:13.529 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.0290999999999997e-05 2024-04-19T02:16:13.529 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.529 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:13.529 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.529 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.529 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.529 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:42724 5.0 e23/16 5:0d0b7b99:::benchmark_data_smithi121_44835_object42723:head v 23'2565, mlcod=23'2563)", 2024-04-19T02:16:13.529 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:09.271090+0000", 2024-04-19T02:16:13.529 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4.1745410960000005, 2024-04-19T02:16:13.529 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016714757, 2024-04-19T02:16:13.529 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:13.529 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:13.529 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:13.530 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.530 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:13.530 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.271090+0000", 2024-04-19T02:16:13.530 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.530 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.530 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.530 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:13.530 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.271090+0000", 2024-04-19T02:16:13.530 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.530 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.530 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.530 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:13.530 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.271090+0000", 2024-04-19T02:16:13.530 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:13.531 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.531 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.531 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:13.531 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.271139+0000", 2024-04-19T02:16:13.531 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.9614999999999998e-05 2024-04-19T02:16:13.531 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.531 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.531 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:13.531 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.271147+0000", 2024-04-19T02:16:13.531 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.6960000000000005e-06 2024-04-19T02:16:13.531 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.531 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.531 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:13.531 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.271151+0000", 2024-04-19T02:16:13.531 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.3030000000000001e-06 2024-04-19T02:16:13.532 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.532 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.532 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:13.532 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.271179+0000", 2024-04-19T02:16:13.532 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.7971e-05 2024-04-19T02:16:13.532 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.532 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.532 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:13.532 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.271194+0000", 2024-04-19T02:16:13.532 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.4406999999999999e-05 2024-04-19T02:16:13.532 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.532 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.532 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:13.532 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.287772+0000", 2024-04-19T02:16:13.532 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016578275 2024-04-19T02:16:13.533 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.533 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.533 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:13.533 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.287805+0000", 2024-04-19T02:16:13.533 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.2914999999999999e-05 2024-04-19T02:16:13.533 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.533 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:13.533 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.533 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.533 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.533 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:43121 5.5 5:abed14ce:::benchmark_data_smithi121_44835_object43120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:13.533 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:09.429697+0000", 2024-04-19T02:16:13.533 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4.0159337470000001, 2024-04-19T02:16:13.533 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.017381669999999998, 2024-04-19T02:16:13.533 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:13.533 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:13.534 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:13.534 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:13.534 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:13.534 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 43121 2024-04-19T02:16:13.534 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.534 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:13.534 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.534 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:13.534 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.429697+0000", 2024-04-19T02:16:13.534 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.534 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.534 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.534 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:13.534 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.429697+0000", 2024-04-19T02:16:13.535 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.535 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.535 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.535 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:13.535 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.429697+0000", 2024-04-19T02:16:13.535 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:13.535 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.535 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.535 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:13.535 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.429798+0000", 2024-04-19T02:16:13.535 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000101228 2024-04-19T02:16:13.535 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.536 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.536 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:13.536 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.429808+0000", 2024-04-19T02:16:13.536 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.9080000000000007e-06 2024-04-19T02:16:13.536 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.536 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.536 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:13.536 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.429814+0000", 2024-04-19T02:16:13.536 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.7580000000000003e-06 2024-04-19T02:16:13.536 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.536 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.536 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:13.536 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.431378+0000", 2024-04-19T02:16:13.536 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0015631919999999999 2024-04-19T02:16:13.536 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.537 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.537 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:13.537 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.431471+0000", 2024-04-19T02:16:13.537 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.3595000000000001e-05 2024-04-19T02:16:13.537 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.537 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.537 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:13.537 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.431591+0000", 2024-04-19T02:16:13.537 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000119485 2024-04-19T02:16:13.537 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.537 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.537 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:13.537 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.435643+0000", 2024-04-19T02:16:13.537 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0040522500000000003 2024-04-19T02:16:13.537 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.537 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.538 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:13.538 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.447020+0000", 2024-04-19T02:16:13.538 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.011377152 2024-04-19T02:16:13.538 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.538 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.538 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:13.538 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.447054+0000", 2024-04-19T02:16:13.538 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.3558e-05 2024-04-19T02:16:13.538 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.538 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.538 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:13.538 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.447079+0000", 2024-04-19T02:16:13.538 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.5293999999999999e-05 2024-04-19T02:16:13.538 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.539 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:13.539 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.539 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.539 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.539 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:43692 5.3 5:c384a549:::benchmark_data_smithi121_44835_object43691:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:13.539 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:09.660580+0000", 2024-04-19T02:16:13.539 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 3.7850508080000003, 2024-04-19T02:16:13.539 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.017860674999999999, 2024-04-19T02:16:13.539 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:13.539 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:13.539 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:13.539 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:13.539 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:13.539 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 43692 2024-04-19T02:16:13.539 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.540 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:13.540 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.540 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:13.540 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.660580+0000", 2024-04-19T02:16:13.540 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.540 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.540 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.540 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:13.540 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.660580+0000", 2024-04-19T02:16:13.540 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.540 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.540 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.540 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:13.540 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.660580+0000", 2024-04-19T02:16:13.540 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:13.541 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.541 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.541 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:13.541 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.660665+0000", 2024-04-19T02:16:13.541 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.5135000000000004e-05 2024-04-19T02:16:13.541 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.541 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.541 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:13.541 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.660677+0000", 2024-04-19T02:16:13.541 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.2743e-05 2024-04-19T02:16:13.541 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.541 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.541 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:13.541 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.660684+0000", 2024-04-19T02:16:13.542 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.8040000000000004e-06 2024-04-19T02:16:13.542 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.542 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.542 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:13.542 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.665455+0000", 2024-04-19T02:16:13.542 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0047704419999999997 2024-04-19T02:16:13.542 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.542 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.542 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:13.542 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.665546+0000", 2024-04-19T02:16:13.542 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.1330999999999997e-05 2024-04-19T02:16:13.542 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.542 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.542 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:13.543 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.665632+0000", 2024-04-19T02:16:13.543 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.5995999999999995e-05 2024-04-19T02:16:13.543 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.543 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.543 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:13.543 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.670521+0000", 2024-04-19T02:16:13.543 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0048892299999999996 2024-04-19T02:16:13.543 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.543 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.543 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:13.543 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.678370+0000", 2024-04-19T02:16:13.543 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0078485880000000001 2024-04-19T02:16:13.543 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.543 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.544 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:13.544 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.678409+0000", 2024-04-19T02:16:13.544 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.9511000000000002e-05 2024-04-19T02:16:13.544 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.544 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.544 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:13.544 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.678441+0000", 2024-04-19T02:16:13.544 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.1615999999999997e-05 2024-04-19T02:16:13.544 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.544 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:13.544 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.544 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.544 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.544 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:45449 5.3 5:cfcb10e5:::benchmark_data_smithi121_44835_object45448:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:13.544 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:10.380289+0000", 2024-04-19T02:16:13.545 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 3.0653417510000001, 2024-04-19T02:16:13.545 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015477128, 2024-04-19T02:16:13.545 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:13.545 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:13.545 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:13.545 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:13.545 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:13.545 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 45449 2024-04-19T02:16:13.545 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.545 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:13.545 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.545 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:13.545 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:10.380289+0000", 2024-04-19T02:16:13.545 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.546 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.546 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.546 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:13.546 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:10.380289+0000", 2024-04-19T02:16:13.546 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.546 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.546 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.546 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:13.546 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:10.380288+0000", 2024-04-19T02:16:13.546 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:13.546 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.546 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.546 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:13.547 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:10.380957+0000", 2024-04-19T02:16:13.547 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00066826899999999998 2024-04-19T02:16:13.547 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.547 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.547 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:13.547 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:10.380968+0000", 2024-04-19T02:16:13.547 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.1283e-05 2024-04-19T02:16:13.547 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.547 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.547 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:13.547 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:10.380976+0000", 2024-04-19T02:16:13.547 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.1950000000000003e-06 2024-04-19T02:16:13.547 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.547 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.547 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:13.548 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:10.381017+0000", 2024-04-19T02:16:13.548 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.0685000000000001e-05 2024-04-19T02:16:13.548 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.548 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.548 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:13.548 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:10.381153+0000", 2024-04-19T02:16:13.548 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00013614599999999999 2024-04-19T02:16:13.548 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.548 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.548 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:13.548 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:10.381305+0000", 2024-04-19T02:16:13.548 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00015149200000000001 2024-04-19T02:16:13.548 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.548 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.548 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:13.549 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:10.383086+0000", 2024-04-19T02:16:13.549 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0017816430000000001 2024-04-19T02:16:13.549 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.549 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.549 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:13.549 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:10.395685+0000", 2024-04-19T02:16:13.549 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.012598696 2024-04-19T02:16:13.549 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.549 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.549 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:13.549 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:10.395730+0000", 2024-04-19T02:16:13.549 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.5321000000000002e-05 2024-04-19T02:16:13.549 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.549 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.549 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:13.550 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:10.395766+0000", 2024-04-19T02:16:13.550 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6193999999999999e-05 2024-04-19T02:16:13.550 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.550 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:13.550 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.550 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.550 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.550 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:52498 5.3 5:cd91eeff:::benchmark_data_smithi121_44835_object52497:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T02:16:13.550 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:13.338526+0000", 2024-04-19T02:16:13.550 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.10710513000000001, 2024-04-19T02:16:13.550 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016659635999999999, 2024-04-19T02:16:13.550 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:13.550 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:13.550 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:13.550 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:13.551 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:13.551 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 52498 2024-04-19T02:16:13.551 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.551 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:13.551 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.551 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:13.551 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:13.338526+0000", 2024-04-19T02:16:13.551 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.551 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.551 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.551 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:13.551 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:13.338526+0000", 2024-04-19T02:16:13.551 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:13.551 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.551 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.552 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:13.552 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:13.338525+0000", 2024-04-19T02:16:13.552 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:13.552 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.552 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.552 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:13.552 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:13.338581+0000", 2024-04-19T02:16:13.552 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.5986999999999998e-05 2024-04-19T02:16:13.552 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.552 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.552 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:13.552 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:13.338590+0000", 2024-04-19T02:16:13.552 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.3950000000000001e-06 2024-04-19T02:16:13.552 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.552 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.553 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:13.553 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:13.338595+0000", 2024-04-19T02:16:13.553 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.0080000000000002e-06 2024-04-19T02:16:13.553 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.553 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.553 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:13.553 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:13.341530+0000", 2024-04-19T02:16:13.553 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0029350729999999998 2024-04-19T02:16:13.553 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.553 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.553 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:13.553 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:13.341693+0000", 2024-04-19T02:16:13.553 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000163005 2024-04-19T02:16:13.553 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.553 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.554 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:13.554 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:13.341862+0000", 2024-04-19T02:16:13.554 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00016903600000000001 2024-04-19T02:16:13.554 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.554 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.554 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:13.554 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:13.346110+0000", 2024-04-19T02:16:13.554 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0042477089999999997 2024-04-19T02:16:13.554 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.554 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.554 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:13.554 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:13.355104+0000", 2024-04-19T02:16:13.554 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0089941959999999994 2024-04-19T02:16:13.554 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.555 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.555 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:13.555 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:13.355149+0000", 2024-04-19T02:16:13.555 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.5726999999999998e-05 2024-04-19T02:16:13.555 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:13.555 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:13.555 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:13.555 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:13.355186+0000", 2024-04-19T02:16:13.555 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6059999999999997e-05 2024-04-19T02:16:13.555 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.555 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:13.555 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.555 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:13.555 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:13.556 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-04-19T02:16:13.557 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:13.557+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:13.557 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:16:13.658 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:13.659+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:13.734 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:16:13.734 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:16:13.734 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.734 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:53419 5.d 5:b4e85032:::benchmark_data_smithi121_44835_object53418:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T02:16:13.734 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:13.725101+0000", 2024-04-19T02:16:13.734 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0088955670000000001, 2024-04-19T02:16:13.734 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0089213520000000004, 2024-04-19T02:16:13.735 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:13.735 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:13.735 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:13.735 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:13.735 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:13.735 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 53419 2024-04-19T02:16:13.735 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.735 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:13.735 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.735 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:13.735 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.725101+0000", 2024-04-19T02:16:13.735 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:13.735 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.736 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.736 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:13.736 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.725101+0000", 2024-04-19T02:16:13.736 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:13.736 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.736 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.736 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:13.736 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.725100+0000", 2024-04-19T02:16:13.736 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:13.736 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.736 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.736 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:13.736 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.725172+0000", 2024-04-19T02:16:13.736 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1679000000000003e-05 2024-04-19T02:16:13.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.737 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.737 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:13.737 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.725179+0000", 2024-04-19T02:16:13.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4999999999999996e-06 2024-04-19T02:16:13.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.737 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.737 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:13.737 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.725182+0000", 2024-04-19T02:16:13.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7890000000000001e-06 2024-04-19T02:16:13.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.737 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.737 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:13.737 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.729170+0000", 2024-04-19T02:16:13.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039874519999999998 2024-04-19T02:16:13.738 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.738 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:13.738 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.729268+0000", 2024-04-19T02:16:13.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8110999999999996e-05 2024-04-19T02:16:13.738 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.738 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:13.738 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.729350+0000", 2024-04-19T02:16:13.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2503999999999995e-05 2024-04-19T02:16:13.738 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.738 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:13.739 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.732041+0000", 2024-04-19T02:16:13.739 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026906130000000001 2024-04-19T02:16:13.739 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:13.739 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:13.739 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:13.739 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.739 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.739 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:53422 5.f 5:f73ad7d0:::benchmark_data_smithi121_44835_object53421:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T02:16:13.739 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:13.725186+0000", 2024-04-19T02:16:13.739 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0088103420000000005, 2024-04-19T02:16:13.739 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0089326389999999992, 2024-04-19T02:16:13.739 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:13.739 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:13.740 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:13.740 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:13.740 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:13.740 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 53422 2024-04-19T02:16:13.740 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.740 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:13.740 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.740 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:13.740 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.725186+0000", 2024-04-19T02:16:13.740 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:13.740 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.740 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.740 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:13.740 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.725186+0000", 2024-04-19T02:16:13.740 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:13.741 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.741 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:13.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.725186+0000", 2024-04-19T02:16:13.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:13.741 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.741 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:13.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.725302+0000", 2024-04-19T02:16:13.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000116839 2024-04-19T02:16:13.741 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.741 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:13.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.725308+0000", 2024-04-19T02:16:13.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.02e-06 2024-04-19T02:16:13.742 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.742 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.742 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:13.742 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.725312+0000", 2024-04-19T02:16:13.742 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6330000000000002e-06 2024-04-19T02:16:13.742 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.742 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.742 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:13.742 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.725358+0000", 2024-04-19T02:16:13.742 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5634999999999999e-05 2024-04-19T02:16:13.742 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.742 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.742 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:13.742 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.725497+0000", 2024-04-19T02:16:13.743 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013973699999999999 2024-04-19T02:16:13.743 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.743 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.743 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:13.743 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.725664+0000", 2024-04-19T02:16:13.743 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016689999999999999 2024-04-19T02:16:13.743 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.743 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.743 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:13.743 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.731631+0000", 2024-04-19T02:16:13.743 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0059667410000000002 2024-04-19T02:16:13.743 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:13.743 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:13.743 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:13.743 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.744 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4549.0:53421 5.c e24/16 5:3a32445a:::benchmark_data_smithi121_44835_object53420:head v 24'3266, mlcod=24'3264)", 2024-04-19T02:16:13.744 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:13.725573+0000", 2024-04-19T02:16:13.744 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0084232779999999993, 2024-04-19T02:16:13.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0086129689999999998, 2024-04-19T02:16:13.744 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:13.744 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:16:13.744 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:13.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:13.744 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.725573+0000", 2024-04-19T02:16:13.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:13.744 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:13.745 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.725573+0000", 2024-04-19T02:16:13.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:13.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.745 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:13.745 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.725572+0000", 2024-04-19T02:16:13.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:13.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.745 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:13.745 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.725665+0000", 2024-04-19T02:16:13.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2676999999999994e-05 2024-04-19T02:16:13.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.745 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:13.746 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.725676+0000", 2024-04-19T02:16:13.746 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1012999999999999e-05 2024-04-19T02:16:13.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.746 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:13.746 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.725682+0000", 2024-04-19T02:16:13.746 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6400000000000002e-06 2024-04-19T02:16:13.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.746 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:13.746 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.725727+0000", 2024-04-19T02:16:13.746 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5466000000000001e-05 2024-04-19T02:16:13.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.747 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:13.747 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.725742+0000", 2024-04-19T02:16:13.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5130000000000001e-05 2024-04-19T02:16:13.747 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:13.747 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:13.747 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:13.747 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.747 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:53423 5.7 5:e219cb41:::benchmark_data_smithi121_44835_object53422:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T02:16:13.747 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:13.726979+0000", 2024-04-19T02:16:13.747 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0070169910000000002, 2024-04-19T02:16:13.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0072733859999999997, 2024-04-19T02:16:13.747 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:13.747 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:13.747 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:13.748 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:13.748 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:13.748 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 53423 2024-04-19T02:16:13.748 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.748 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:13.748 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.748 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:13.748 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.726979+0000", 2024-04-19T02:16:13.748 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:13.748 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.748 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.748 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:13.748 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.726979+0000", 2024-04-19T02:16:13.748 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:13.748 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.749 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:13.749 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.726979+0000", 2024-04-19T02:16:13.749 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:13.749 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.749 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:13.749 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.727000+0000", 2024-04-19T02:16:13.749 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1522000000000002e-05 2024-04-19T02:16:13.749 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.749 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:13.749 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.727009+0000", 2024-04-19T02:16:13.749 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6300000000000004e-06 2024-04-19T02:16:13.749 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.750 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:13.750 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.727014+0000", 2024-04-19T02:16:13.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1379999999999998e-06 2024-04-19T02:16:13.750 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.750 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:13.750 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.727050+0000", 2024-04-19T02:16:13.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6294000000000002e-05 2024-04-19T02:16:13.750 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.750 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:13.750 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.727160+0000", 2024-04-19T02:16:13.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010982 2024-04-19T02:16:13.750 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.751 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:13.751 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.727240+0000", 2024-04-19T02:16:13.751 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0161999999999996e-05 2024-04-19T02:16:13.751 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.751 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:13.751 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.731597+0000", 2024-04-19T02:16:13.751 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0043570600000000003 2024-04-19T02:16:13.751 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:13.751 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:13.751 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:13.751 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.751 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:53425 5.2 5:4c3b22ad:::benchmark_data_smithi121_44835_object53424:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T02:16:13.752 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:13.727424+0000", 2024-04-19T02:16:13.752 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.006572044, 2024-04-19T02:16:13.752 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0069151880000000001, 2024-04-19T02:16:13.752 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:13.752 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:13.752 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:13.752 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:13.752 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:13.752 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 53425 2024-04-19T02:16:13.752 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.752 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:13.752 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.752 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:13.752 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.727424+0000", 2024-04-19T02:16:13.752 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:13.753 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.753 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.753 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:13.753 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.727424+0000", 2024-04-19T02:16:13.753 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:13.753 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.753 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.753 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:13.753 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.727424+0000", 2024-04-19T02:16:13.753 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:13.753 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.753 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.753 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:13.753 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.727524+0000", 2024-04-19T02:16:13.753 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100002 2024-04-19T02:16:13.754 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.754 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.754 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:13.754 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.727532+0000", 2024-04-19T02:16:13.754 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7260000000000008e-06 2024-04-19T02:16:13.754 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.754 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.754 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:13.754 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.727548+0000", 2024-04-19T02:16:13.754 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5733e-05 2024-04-19T02:16:13.754 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.754 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.754 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:13.754 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.727588+0000", 2024-04-19T02:16:13.754 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0120999999999998e-05 2024-04-19T02:16:13.755 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.755 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:13.755 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.727666+0000", 2024-04-19T02:16:13.755 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8207999999999994e-05 2024-04-19T02:16:13.755 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.755 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:13.755 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.727743+0000", 2024-04-19T02:16:13.755 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7171999999999999e-05 2024-04-19T02:16:13.755 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.755 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:13.755 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.731474+0000", 2024-04-19T02:16:13.755 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037304360000000002 2024-04-19T02:16:13.756 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:13.756 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:13.756 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:13.756 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.756 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.756 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:53426 5.f 5:f56f720f:::benchmark_data_smithi121_44835_object53425:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T02:16:13.756 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:13.727556+0000", 2024-04-19T02:16:13.756 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0064398939999999998, 2024-04-19T02:16:13.756 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0068465369999999998, 2024-04-19T02:16:13.756 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:13.756 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:13.757 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:13.757 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:13.757 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:13.757 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 53426 2024-04-19T02:16:13.757 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.757 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:13.757 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.757 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:13.757 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.727556+0000", 2024-04-19T02:16:13.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:13.758 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.758 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.758 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:13.758 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.727556+0000", 2024-04-19T02:16:13.758 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:13.758 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.758 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.758 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:13.758 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.727556+0000", 2024-04-19T02:16:13.758 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:13.758 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.758 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.758 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:13.758 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.727614+0000", 2024-04-19T02:16:13.759 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7734e-05 2024-04-19T02:16:13.759 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.759 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.759 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:13.759 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.727622+0000", 2024-04-19T02:16:13.759 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7860000000000002e-06 2024-04-19T02:16:13.759 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.759 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.759 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:13.759 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.727628+0000", 2024-04-19T02:16:13.759 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4600000000000002e-06 2024-04-19T02:16:13.759 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.759 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.759 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:13.760 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.728860+0000", 2024-04-19T02:16:13.760 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012323639999999999 2024-04-19T02:16:13.760 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.760 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.760 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:13.760 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.728988+0000", 2024-04-19T02:16:13.760 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012821299999999999 2024-04-19T02:16:13.760 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.760 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.760 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:13.760 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.729131+0000", 2024-04-19T02:16:13.760 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000142831 2024-04-19T02:16:13.760 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.760 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.761 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:13.761 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.732011+0000", 2024-04-19T02:16:13.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0028796270000000001 2024-04-19T02:16:13.761 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:13.761 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:13.761 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:13.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.761 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.761 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4549.0:53430 5.c e24/16 5:36654884:::benchmark_data_smithi121_44835_object53429:head v 24'3267, mlcod=24'3264)", 2024-04-19T02:16:13.761 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:13.729719+0000", 2024-04-19T02:16:13.761 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0042777010000000001, 2024-04-19T02:16:13.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047423359999999998, 2024-04-19T02:16:13.761 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:13.761 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:16:13.762 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:13.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.762 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:13.762 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.729719+0000", 2024-04-19T02:16:13.762 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:13.762 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.762 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:13.762 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.729719+0000", 2024-04-19T02:16:13.762 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:13.762 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.762 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:13.762 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.729718+0000", 2024-04-19T02:16:13.763 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:13.763 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.763 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.763 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:13.763 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.729778+0000", 2024-04-19T02:16:13.763 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0362000000000002e-05 2024-04-19T02:16:13.763 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.763 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.763 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:13.763 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.729787+0000", 2024-04-19T02:16:13.763 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7260000000000008e-06 2024-04-19T02:16:13.763 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.763 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.763 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:13.764 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.729794+0000", 2024-04-19T02:16:13.764 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5150000000000003e-06 2024-04-19T02:16:13.764 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.764 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.764 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:13.764 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.729826+0000", 2024-04-19T02:16:13.764 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1983000000000002e-05 2024-04-19T02:16:13.764 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.764 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.764 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:13.764 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.729839+0000", 2024-04-19T02:16:13.764 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3900000000000001e-05 2024-04-19T02:16:13.764 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:13.764 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:13.765 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:13.765 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.765 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.765 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:53431 5.9 5:9256d290:::benchmark_data_smithi121_44835_object53430:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T02:16:13.765 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:13.730344+0000", 2024-04-19T02:16:13.765 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.003652387, 2024-04-19T02:16:13.765 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00415643, 2024-04-19T02:16:13.765 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:13.765 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:13.765 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:13.765 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:13.765 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:13.765 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 53431 2024-04-19T02:16:13.765 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.765 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:13.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.766 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:13.766 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.730344+0000", 2024-04-19T02:16:13.766 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:13.766 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.766 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:13.766 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.730344+0000", 2024-04-19T02:16:13.766 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:13.766 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.766 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:13.766 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.730343+0000", 2024-04-19T02:16:13.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:13.767 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.767 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:13.767 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.730413+0000", 2024-04-19T02:16:13.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9963999999999996e-05 2024-04-19T02:16:13.767 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.767 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:13.767 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.730424+0000", 2024-04-19T02:16:13.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1133e-05 2024-04-19T02:16:13.767 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.768 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:13.768 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.730431+0000", 2024-04-19T02:16:13.768 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3329999999999999e-06 2024-04-19T02:16:13.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.768 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.768 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:13.768 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.730473+0000", 2024-04-19T02:16:13.768 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1672999999999999e-05 2024-04-19T02:16:13.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.768 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.768 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:13.768 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.730592+0000", 2024-04-19T02:16:13.768 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000118928 2024-04-19T02:16:13.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.768 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.769 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:13.769 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.730681+0000", 2024-04-19T02:16:13.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.933e-05 2024-04-19T02:16:13.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.769 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:13.769 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.734095+0000", 2024-04-19T02:16:13.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003413714 2024-04-19T02:16:13.769 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:13.769 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:13.769 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:13.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.769 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:53432 5.7 5:efa50127:::benchmark_data_smithi121_44835_object53431:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T02:16:13.770 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:13.730446+0000", 2024-04-19T02:16:13.770 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0035500610000000002, 2024-04-19T02:16:13.770 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041503859999999998, 2024-04-19T02:16:13.770 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:13.770 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:13.770 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:13.770 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:13.770 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:13.770 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 53432 2024-04-19T02:16:13.770 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.770 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:13.770 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.770 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:13.770 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.730446+0000", 2024-04-19T02:16:13.770 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:13.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.771 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:13.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.730446+0000", 2024-04-19T02:16:13.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:13.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:13.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.730446+0000", 2024-04-19T02:16:13.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:13.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:13.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.730515+0000", 2024-04-19T02:16:13.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9407999999999997e-05 2024-04-19T02:16:13.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:13.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.730524+0000", 2024-04-19T02:16:13.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8419999999999994e-06 2024-04-19T02:16:13.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:13.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.730532+0000", 2024-04-19T02:16:13.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8509999999999999e-06 2024-04-19T02:16:13.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:13.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.731654+0000", 2024-04-19T02:16:13.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0011221689999999999 2024-04-19T02:16:13.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:13.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.731786+0000", 2024-04-19T02:16:13.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000132108 2024-04-19T02:16:13.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.776 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:13.776 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.731924+0000", 2024-04-19T02:16:13.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013821800000000001 2024-04-19T02:16:13.776 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:13.776 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:13.776 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:13.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.776 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:53415 5.1 5:837369e1:::benchmark_data_smithi121_44835_object53414:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T02:16:13.776 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:13.721075+0000", 2024-04-19T02:16:13.776 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.012921049, 2024-04-19T02:16:13.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013637602, 2024-04-19T02:16:13.777 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:13.777 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:13.777 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:13.777 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:13.777 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:13.777 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 53415 2024-04-19T02:16:13.777 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.777 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:13.777 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.777 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:13.777 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.721075+0000", 2024-04-19T02:16:13.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:13.777 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.777 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:13.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.721075+0000", 2024-04-19T02:16:13.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:13.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:13.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.721075+0000", 2024-04-19T02:16:13.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:13.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:13.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.721152+0000", 2024-04-19T02:16:13.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6915999999999993e-05 2024-04-19T02:16:13.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:13.779 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.721159+0000", 2024-04-19T02:16:13.779 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2919999999999998e-06 2024-04-19T02:16:13.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:13.779 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.721165+0000", 2024-04-19T02:16:13.779 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0480000000000004e-06 2024-04-19T02:16:13.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:13.779 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.724599+0000", 2024-04-19T02:16:13.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0034344110000000001 2024-04-19T02:16:13.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.780 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:13.780 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.724749+0000", 2024-04-19T02:16:13.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000149746 2024-04-19T02:16:13.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.780 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:13.780 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.724884+0000", 2024-04-19T02:16:13.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013484799999999999 2024-04-19T02:16:13.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.780 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:13.780 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.728846+0000", 2024-04-19T02:16:13.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039625620000000002 2024-04-19T02:16:13.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.781 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:13.781 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.734673+0000", 2024-04-19T02:16:13.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0058262080000000003 2024-04-19T02:16:13.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:13.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:13.781 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:13.781 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.734715+0000", 2024-04-19T02:16:13.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2582e-05 2024-04-19T02:16:13.781 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:13.781 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:13.781 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:13.781 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:13.781 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-04-19T02:16:13.782 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 10 2024-04-19T02:16:13.782 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:16:13.783 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:13.784+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:13.784 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:16:13.884 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:13.884+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:13.984 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:13.985+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:13.999 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:16:13.999 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-04-19T02:16:14.000 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-04-19T02:16:14.000 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-04-19T02:16:14.000 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:16:14.014 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:16:14.025 INFO:teuthology.orchestra.run.smithi121.stderr:nodeep-scrub is unset 2024-04-19T02:16:14.026 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 19 16 54128 54112 177.986 146.75 0.00415925 0.00561549 2024-04-19T02:16:14.098 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:14.099+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:14.187 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:14.188+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:14.236 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:16:14.236 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-04-19T02:16:14.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-04-19T02:16:14.236 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:16:14.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.236 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:14.237 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269684+0000", 2024-04-19T02:16:14.237 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 44.964594531000003, 2024-04-19T02:16:14.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019077493000000001, 2024-04-19T02:16:14.237 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:14.237 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:14.237 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:14.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:14.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269684+0000", 2024-04-19T02:16:14.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:14.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:14.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269684+0000", 2024-04-19T02:16:14.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:14.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:14.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269684+0000", 2024-04-19T02:16:14.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:14.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:14.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269686+0000", 2024-04-19T02:16:14.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2740000000000002e-06 2024-04-19T02:16:14.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:14.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269690+0000", 2024-04-19T02:16:14.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8829999999999999e-06 2024-04-19T02:16:14.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:14.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269693+0000", 2024-04-19T02:16:14.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4199999999999999e-06 2024-04-19T02:16:14.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:14.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269875+0000", 2024-04-19T02:16:14.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018114800000000001 2024-04-19T02:16:14.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:14.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269880+0000", 2024-04-19T02:16:14.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5620000000000003e-06 2024-04-19T02:16:14.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:14.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278610+0000", 2024-04-19T02:16:14.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.008729423 2024-04-19T02:16:14.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:14.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278724+0000", 2024-04-19T02:16:14.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011428400000000001 2024-04-19T02:16:14.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:14.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278860+0000", 2024-04-19T02:16:14.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013601600000000001 2024-04-19T02:16:14.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:14.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282632+0000", 2024-04-19T02:16:14.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037722889999999999 2024-04-19T02:16:14.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:14.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288712+0000", 2024-04-19T02:16:14.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0060799599999999997 2024-04-19T02:16:14.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:14.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288742+0000", 2024-04-19T02:16:14.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0048000000000001e-05 2024-04-19T02:16:14.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:14.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288762+0000", 2024-04-19T02:16:14.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9482000000000001e-05 2024-04-19T02:16:14.243 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:14.243 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:14.243 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:14.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.243 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:12 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:14.243 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269696+0000", 2024-04-19T02:16:14.243 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 44.964582452999998, 2024-04-19T02:16:14.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018617073000000001, 2024-04-19T02:16:14.243 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:14.243 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:14.243 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:14.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:14.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269696+0000", 2024-04-19T02:16:14.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:14.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:14.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269696+0000", 2024-04-19T02:16:14.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:14.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:14.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269696+0000", 2024-04-19T02:16:14.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967296 2024-04-19T02:16:14.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:14.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269698+0000", 2024-04-19T02:16:14.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9570000000000001e-06 2024-04-19T02:16:14.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:14.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269702+0000", 2024-04-19T02:16:14.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2459999999999997e-06 2024-04-19T02:16:14.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:14.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269708+0000", 2024-04-19T02:16:14.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2709999999999998e-06 2024-04-19T02:16:14.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:14.246 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269749+0000", 2024-04-19T02:16:14.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0500000000000002e-05 2024-04-19T02:16:14.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-04-19T02:16:14.246 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269754+0000", 2024-04-19T02:16:14.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.502e-06 2024-04-19T02:16:14.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:14.246 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.277984+0000", 2024-04-19T02:16:14.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0082293049999999993 2024-04-19T02:16:14.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:14.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278489+0000", 2024-04-19T02:16:14.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00050499699999999998 2024-04-19T02:16:14.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:14.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278649+0000", 2024-04-19T02:16:14.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016012000000000001 2024-04-19T02:16:14.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:14.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286855+0000", 2024-04-19T02:16:14.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0082066139999999992 2024-04-19T02:16:14.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:14.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288248+0000", 2024-04-19T02:16:14.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001392838 2024-04-19T02:16:14.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:14.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288287+0000", 2024-04-19T02:16:14.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8516000000000002e-05 2024-04-19T02:16:14.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:14.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288313+0000", 2024-04-19T02:16:14.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6420000000000001e-05 2024-04-19T02:16:14.248 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:14.249 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:14.249 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:14.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.249 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:14.249 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269753+0000", 2024-04-19T02:16:14.249 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 44.964525148, 2024-04-19T02:16:14.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019088755999999998, 2024-04-19T02:16:14.249 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:14.249 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:14.249 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:14.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:14.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269753+0000", 2024-04-19T02:16:14.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:14.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:14.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269753+0000", 2024-04-19T02:16:14.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:14.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:14.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269753+0000", 2024-04-19T02:16:14.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:14.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:14.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269770+0000", 2024-04-19T02:16:14.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7150999999999999e-05 2024-04-19T02:16:14.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:14.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269779+0000", 2024-04-19T02:16:14.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4139999999999994e-06 2024-04-19T02:16:14.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:14.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269786+0000", 2024-04-19T02:16:14.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.537e-06 2024-04-19T02:16:14.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:14.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269913+0000", 2024-04-19T02:16:14.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012699599999999999 2024-04-19T02:16:14.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:14.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269916+0000", 2024-04-19T02:16:14.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9280000000000002e-06 2024-04-19T02:16:14.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:14.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.279143+0000", 2024-04-19T02:16:14.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0092270129999999992 2024-04-19T02:16:14.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:14.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.279223+0000", 2024-04-19T02:16:14.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0050999999999996e-05 2024-04-19T02:16:14.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:14.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.279364+0000", 2024-04-19T02:16:14.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000140934 2024-04-19T02:16:14.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:14.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286189+0000", 2024-04-19T02:16:14.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.006825327 2024-04-19T02:16:14.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:14.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288791+0000", 2024-04-19T02:16:14.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026021500000000001 2024-04-19T02:16:14.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:14.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288822+0000", 2024-04-19T02:16:14.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0162999999999999e-05 2024-04-19T02:16:14.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.255 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:14.255 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288842+0000", 2024-04-19T02:16:14.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0644000000000001e-05 2024-04-19T02:16:14.255 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:14.255 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:14.255 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:14.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.255 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:14.255 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:16:14.256 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 44.964486674, 2024-04-19T02:16:14.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020307345000000001, 2024-04-19T02:16:14.256 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:14.256 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:14.256 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:14.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:14.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:16:14.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:14.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:14.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:16:14.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:14.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:14.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269791+0000", 2024-04-19T02:16:14.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:14.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:14.258 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269795+0000", 2024-04-19T02:16:14.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5619999999999999e-06 2024-04-19T02:16:14.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:14.258 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269802+0000", 2024-04-19T02:16:14.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8469999999999998e-06 2024-04-19T02:16:14.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:14.258 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269807+0000", 2024-04-19T02:16:14.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.707e-06 2024-04-19T02:16:14.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:14.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269950+0000", 2024-04-19T02:16:14.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000143313 2024-04-19T02:16:14.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:14.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269955+0000", 2024-04-19T02:16:14.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4029999999999998e-06 2024-04-19T02:16:14.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:14.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.283806+0000", 2024-04-19T02:16:14.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013850220999999999 2024-04-19T02:16:14.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.260 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:14.260 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.283896+0000", 2024-04-19T02:16:14.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0261999999999997e-05 2024-04-19T02:16:14.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.260 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.260 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:14.260 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284022+0000", 2024-04-19T02:16:14.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012641200000000001 2024-04-19T02:16:14.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.260 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.260 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:14.260 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289066+0000", 2024-04-19T02:16:14.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050438490000000004 2024-04-19T02:16:14.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.260 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:14.261 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290011+0000", 2024-04-19T02:16:14.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00094490700000000004 2024-04-19T02:16:14.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:14.261 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290054+0000", 2024-04-19T02:16:14.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.337e-05 2024-04-19T02:16:14.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:14.261 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290099+0000", 2024-04-19T02:16:14.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4987999999999997e-05 2024-04-19T02:16:14.261 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:14.262 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:14.262 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:14.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.262 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:14.262 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:16:14.262 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 44.964408743999996, 2024-04-19T02:16:14.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020331023, 2024-04-19T02:16:14.262 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:14.262 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:14.262 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:14.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.262 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:14.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:16:14.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:14.263 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.263 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.263 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:14.263 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:16:14.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:14.263 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.263 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.263 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:14.263 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269869+0000", 2024-04-19T02:16:14.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:14.263 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.263 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.263 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:14.263 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269873+0000", 2024-04-19T02:16:14.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0219999999999998e-06 2024-04-19T02:16:14.264 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.264 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.264 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:14.264 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269881+0000", 2024-04-19T02:16:14.264 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.79e-06 2024-04-19T02:16:14.264 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.264 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.264 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:14.264 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269887+0000", 2024-04-19T02:16:14.264 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7899999999999996e-06 2024-04-19T02:16:14.264 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.264 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.264 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:14.264 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269983+0000", 2024-04-19T02:16:14.265 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6057000000000005e-05 2024-04-19T02:16:14.265 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.265 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:14.265 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269986+0000", 2024-04-19T02:16:14.265 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9220000000000001e-06 2024-04-19T02:16:14.265 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.265 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:14.265 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284350+0000", 2024-04-19T02:16:14.265 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014364335000000001 2024-04-19T02:16:14.265 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.265 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:14.265 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284664+0000", 2024-04-19T02:16:14.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000313646 2024-04-19T02:16:14.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.266 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:14.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284794+0000", 2024-04-19T02:16:14.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129839 2024-04-19T02:16:14.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.266 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:14.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289107+0000", 2024-04-19T02:16:14.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0043127060000000004 2024-04-19T02:16:14.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:14.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290108+0000", 2024-04-19T02:16:14.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0010010590000000001 2024-04-19T02:16:14.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:14.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290144+0000", 2024-04-19T02:16:14.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6709999999999999e-05 2024-04-19T02:16:14.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:14.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290201+0000", 2024-04-19T02:16:14.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6654999999999999e-05 2024-04-19T02:16:14.268 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:14.268 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:14.268 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:14.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.268 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.268 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:14.268 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:16:14.268 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 44.964366403, 2024-04-19T02:16:14.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020507241999999998, 2024-04-19T02:16:14.268 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:14.268 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:14.268 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:14.268 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.268 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:14.269 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:16:14.269 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:14.269 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.269 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:14.269 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:16:14.269 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:14.269 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.269 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:14.269 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:16:14.269 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:14.269 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:14.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269915+0000", 2024-04-19T02:16:14.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.472e-06 2024-04-19T02:16:14.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:14.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269928+0000", 2024-04-19T02:16:14.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2979000000000001e-05 2024-04-19T02:16:14.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:14.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269935+0000", 2024-04-19T02:16:14.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8859999999999998e-06 2024-04-19T02:16:14.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.271 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:14.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270009+0000", 2024-04-19T02:16:14.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3429000000000005e-05 2024-04-19T02:16:14.271 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.271 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:14.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270013+0000", 2024-04-19T02:16:14.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2590000000000002e-06 2024-04-19T02:16:14.271 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.271 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:14.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285375+0000", 2024-04-19T02:16:14.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015362275999999999 2024-04-19T02:16:14.271 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.272 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.272 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:14.272 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285451+0000", 2024-04-19T02:16:14.272 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5338000000000003e-05 2024-04-19T02:16:14.272 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.272 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.272 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:14.272 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285562+0000", 2024-04-19T02:16:14.272 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000111285 2024-04-19T02:16:14.272 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.272 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.272 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:14.272 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289134+0000", 2024-04-19T02:16:14.272 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035719670000000001 2024-04-19T02:16:14.272 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.273 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.273 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:14.273 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290341+0000", 2024-04-19T02:16:14.273 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012074500000000001 2024-04-19T02:16:14.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.273 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.273 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:14.273 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290383+0000", 2024-04-19T02:16:14.273 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1386e-05 2024-04-19T02:16:14.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.273 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.273 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:14.273 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290419+0000", 2024-04-19T02:16:14.273 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6884000000000001e-05 2024-04-19T02:16:14.273 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:14.274 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:14.274 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:14.274 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.274 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:14.274 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269945+0000", 2024-04-19T02:16:14.274 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 44.964333820999997, 2024-04-19T02:16:14.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019709098000000001, 2024-04-19T02:16:14.274 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:14.274 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:14.274 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:14.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:14.274 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269945+0000", 2024-04-19T02:16:14.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:14.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:14.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269945+0000", 2024-04-19T02:16:14.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:14.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:14.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269944+0000", 2024-04-19T02:16:14.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:14.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:14.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269965+0000", 2024-04-19T02:16:14.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0803999999999999e-05 2024-04-19T02:16:14.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:14.276 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269973+0000", 2024-04-19T02:16:14.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3560000000000004e-06 2024-04-19T02:16:14.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:14.276 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269982+0000", 2024-04-19T02:16:14.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9600000000000006e-06 2024-04-19T02:16:14.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:14.276 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270014+0000", 2024-04-19T02:16:14.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2913000000000001e-05 2024-04-19T02:16:14.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.277 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:14.277 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270018+0000", 2024-04-19T02:16:14.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2200000000000001e-06 2024-04-19T02:16:14.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.277 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:14.277 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278999+0000", 2024-04-19T02:16:14.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0089818009999999993 2024-04-19T02:16:14.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.277 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:14.277 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.279088+0000", 2024-04-19T02:16:14.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8988999999999998e-05 2024-04-19T02:16:14.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.278 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:14.278 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.280160+0000", 2024-04-19T02:16:14.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001071572 2024-04-19T02:16:14.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.278 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:14.278 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288342+0000", 2024-04-19T02:16:14.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.008182468 2024-04-19T02:16:14.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.278 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:14.278 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289545+0000", 2024-04-19T02:16:14.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012026739999999999 2024-04-19T02:16:14.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.279 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:14.279 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289608+0000", 2024-04-19T02:16:14.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2904999999999995e-05 2024-04-19T02:16:14.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.279 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:14.279 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289654+0000", 2024-04-19T02:16:14.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5850000000000003e-05 2024-04-19T02:16:14.279 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:14.279 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:14.279 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:14.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.280 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:14.280 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:16:14.280 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 44.964288142999997, 2024-04-19T02:16:14.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022007204999999998, 2024-04-19T02:16:14.280 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:14.280 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:14.280 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:14.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.280 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:14.280 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:16:14.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:14.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.280 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:14.281 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:16:14.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:14.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.281 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:14.281 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269990+0000", 2024-04-19T02:16:14.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:14.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.281 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:14.281 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269999+0000", 2024-04-19T02:16:14.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9539999999999993e-06 2024-04-19T02:16:14.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:14.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270006+0000", 2024-04-19T02:16:14.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.216e-06 2024-04-19T02:16:14.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:14.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270012+0000", 2024-04-19T02:16:14.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5049999999999998e-06 2024-04-19T02:16:14.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:14.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270058+0000", 2024-04-19T02:16:14.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.634e-05 2024-04-19T02:16:14.283 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.283 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:14.283 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270064+0000", 2024-04-19T02:16:14.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0669999999999997e-06 2024-04-19T02:16:14.283 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.283 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:14.283 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287159+0000", 2024-04-19T02:16:14.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017095086999999998 2024-04-19T02:16:14.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.284 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:14.284 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287254+0000", 2024-04-19T02:16:14.284 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4716000000000006e-05 2024-04-19T02:16:14.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.284 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:14.284 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287389+0000", 2024-04-19T02:16:14.284 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013511900000000001 2024-04-19T02:16:14.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:14.285 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290481+0000", 2024-04-19T02:16:14.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030920169999999999 2024-04-19T02:16:14.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:14.285 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291931+0000", 2024-04-19T02:16:14.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001450118 2024-04-19T02:16:14.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:14.285 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291960+0000", 2024-04-19T02:16:14.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9096000000000001e-05 2024-04-19T02:16:14.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.286 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:14.286 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291998+0000", 2024-04-19T02:16:14.286 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7514e-05 2024-04-19T02:16:14.286 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:14.286 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:14.286 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:14.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.287 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:14.287 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:14.287 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 44.964227571999999, 2024-04-19T02:16:14.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020759494999999999, 2024-04-19T02:16:14.287 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:14.287 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:14.287 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:14.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.287 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:14.287 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:14.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:14.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:14.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:14.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:14.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:14.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:14.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:14.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.289 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:14.289 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270054+0000", 2024-04-19T02:16:14.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.27e-06 2024-04-19T02:16:14.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.289 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:14.289 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270061+0000", 2024-04-19T02:16:14.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1289999999999998e-06 2024-04-19T02:16:14.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.290 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:14.290 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270067+0000", 2024-04-19T02:16:14.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.207e-06 2024-04-19T02:16:14.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.290 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:14.290 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270105+0000", 2024-04-19T02:16:14.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7549999999999998e-05 2024-04-19T02:16:14.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:14.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270112+0000", 2024-04-19T02:16:14.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3200000000000002e-06 2024-04-19T02:16:14.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:14.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282454+0000", 2024-04-19T02:16:14.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012341569 2024-04-19T02:16:14.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:14.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282740+0000", 2024-04-19T02:16:14.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000286481 2024-04-19T02:16:14.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.292 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:14.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282879+0000", 2024-04-19T02:16:14.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013887799999999999 2024-04-19T02:16:14.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.292 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:14.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290325+0000", 2024-04-19T02:16:14.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074459779999999998 2024-04-19T02:16:14.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.293 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:14.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290759+0000", 2024-04-19T02:16:14.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000433688 2024-04-19T02:16:14.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.293 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:14.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290789+0000", 2024-04-19T02:16:14.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9960000000000001e-05 2024-04-19T02:16:14.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:14.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290811+0000", 2024-04-19T02:16:14.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1965999999999999e-05 2024-04-19T02:16:14.294 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:14.294 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:14.294 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:14.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.295 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:14.295 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:16:14.295 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 44.964177366999998, 2024-04-19T02:16:14.295 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020837887999999999, 2024-04-19T02:16:14.295 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:14.295 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:14.295 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:14.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.295 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:14.295 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:16:14.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:14.296 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.296 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.296 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:14.296 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:16:14.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:14.296 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.296 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.296 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:14.296 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:16:14.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:14.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:14.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270109+0000", 2024-04-19T02:16:14.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3110000000000006e-06 2024-04-19T02:16:14.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:14.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270117+0000", 2024-04-19T02:16:14.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0479999999999999e-06 2024-04-19T02:16:14.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:14.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270123+0000", 2024-04-19T02:16:14.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5500000000000002e-06 2024-04-19T02:16:14.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:14.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270150+0000", 2024-04-19T02:16:14.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7712000000000002e-05 2024-04-19T02:16:14.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.299 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:14.299 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270153+0000", 2024-04-19T02:16:14.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6089999999999999e-06 2024-04-19T02:16:14.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.299 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:14.299 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285958+0000", 2024-04-19T02:16:14.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015805274000000001 2024-04-19T02:16:14.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.300 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:14.300 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286126+0000", 2024-04-19T02:16:14.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016765700000000001 2024-04-19T02:16:14.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.300 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:14.300 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286296+0000", 2024-04-19T02:16:14.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017007 2024-04-19T02:16:14.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:14.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290426+0000", 2024-04-19T02:16:14.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041299839999999997 2024-04-19T02:16:14.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:14.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290867+0000", 2024-04-19T02:16:14.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00044083300000000001 2024-04-19T02:16:14.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:14.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290900+0000", 2024-04-19T02:16:14.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3380000000000002e-05 2024-04-19T02:16:14.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:14.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290939+0000", 2024-04-19T02:16:14.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8970000000000001e-05 2024-04-19T02:16:14.302 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:14.302 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:14.302 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:14.303 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.303 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:21 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:14.303 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:16:14.303 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 44.964088695000001, 2024-04-19T02:16:14.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020833187999999999, 2024-04-19T02:16:14.303 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:14.303 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:16:14.303 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:14.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.303 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:14.304 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:16:14.304 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:14.304 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.304 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.304 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:14.304 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:16:14.304 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:14.304 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.304 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.304 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:14.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270189+0000", 2024-04-19T02:16:14.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:14.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:14.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270192+0000", 2024-04-19T02:16:14.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7549999999999999e-06 2024-04-19T02:16:14.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:14.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270198+0000", 2024-04-19T02:16:14.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0859999999999998e-06 2024-04-19T02:16:14.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:14.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270204+0000", 2024-04-19T02:16:14.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1970000000000004e-06 2024-04-19T02:16:14.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:14.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270238+0000", 2024-04-19T02:16:14.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4282000000000001e-05 2024-04-19T02:16:14.307 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.307 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:14.307 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270240+0000", 2024-04-19T02:16:14.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3099999999999999e-06 2024-04-19T02:16:14.307 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.307 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:14.307 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287131+0000", 2024-04-19T02:16:14.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01689104 2024-04-19T02:16:14.308 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.308 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.308 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:14.308 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287262+0000", 2024-04-19T02:16:14.308 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130347 2024-04-19T02:16:14.308 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.308 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.308 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:14.308 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291023+0000", 2024-04-19T02:16:14.308 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037616350000000002 2024-04-19T02:16:14.308 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:14.308 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:14.309 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:14.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.309 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.309 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:2285 5.d 5:b310a433:::benchmark_data_smithi121_44835_object2284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:16:14.309 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:55.643557+0000", 2024-04-19T02:16:14.309 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.590721973000001, 2024-04-19T02:16:14.309 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018865537000000002, 2024-04-19T02:16:14.309 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:14.309 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:14.309 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:14.309 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:14.310 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:14.310 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 2285 2024-04-19T02:16:14.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.310 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:14.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:14.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643557+0000", 2024-04-19T02:16:14.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:14.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:14.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643557+0000", 2024-04-19T02:16:14.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:14.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:14.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643556+0000", 2024-04-19T02:16:14.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:14.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:14.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643625+0000", 2024-04-19T02:16:14.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9393000000000005e-05 2024-04-19T02:16:14.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:14.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643634+0000", 2024-04-19T02:16:14.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.14e-06 2024-04-19T02:16:14.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:14.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643640+0000", 2024-04-19T02:16:14.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.601e-06 2024-04-19T02:16:14.313 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.313 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.313 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:14.313 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643669+0000", 2024-04-19T02:16:14.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9292999999999999e-05 2024-04-19T02:16:14.313 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.313 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.313 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:14.313 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643760+0000", 2024-04-19T02:16:14.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0526999999999996e-05 2024-04-19T02:16:14.314 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.314 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.314 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:14.314 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643892+0000", 2024-04-19T02:16:14.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000131607 2024-04-19T02:16:14.314 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.314 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.314 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:14.314 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.649122+0000", 2024-04-19T02:16:14.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052308279999999999 2024-04-19T02:16:14.314 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.314 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:14.315 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.662321+0000", 2024-04-19T02:16:14.315 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013198774999999999 2024-04-19T02:16:14.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:14.315 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.662385+0000", 2024-04-19T02:16:14.315 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4261e-05 2024-04-19T02:16:14.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:14.315 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.662422+0000", 2024-04-19T02:16:14.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.676e-05 2024-04-19T02:16:14.316 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:14.316 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:14.316 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:14.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.316 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:16494 5.7 5:e2c19dca:::benchmark_data_smithi121_44835_object16493:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:14.316 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.871684+0000", 2024-04-19T02:16:14.316 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 14.36259504, 2024-04-19T02:16:14.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019343257999999999, 2024-04-19T02:16:14.316 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:14.316 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:14.317 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:14.317 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:14.317 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:14.317 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16494 2024-04-19T02:16:14.317 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.317 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:14.317 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.317 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:14.317 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871684+0000", 2024-04-19T02:16:14.317 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:14.317 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.317 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.317 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:14.318 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871684+0000", 2024-04-19T02:16:14.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:14.318 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.318 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.318 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:14.318 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871683+0000", 2024-04-19T02:16:14.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:14.318 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.318 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.318 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:14.318 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871762+0000", 2024-04-19T02:16:14.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8981999999999997e-05 2024-04-19T02:16:14.318 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:14.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871770+0000", 2024-04-19T02:16:14.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7060000000000004e-06 2024-04-19T02:16:14.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:14.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871776+0000", 2024-04-19T02:16:14.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4880000000000004e-06 2024-04-19T02:16:14.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:14.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.874098+0000", 2024-04-19T02:16:14.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0023215309999999999 2024-04-19T02:16:14.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:14.320 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.874245+0000", 2024-04-19T02:16:14.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014735599999999999 2024-04-19T02:16:14.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:14.320 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.874394+0000", 2024-04-19T02:16:14.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014848300000000001 2024-04-19T02:16:14.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:14.320 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.876474+0000", 2024-04-19T02:16:14.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020803060000000001 2024-04-19T02:16:14.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:14.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.890939+0000", 2024-04-19T02:16:14.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014464985 2024-04-19T02:16:14.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:14.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.890986+0000", 2024-04-19T02:16:14.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7321000000000003e-05 2024-04-19T02:16:14.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:14.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891027+0000", 2024-04-19T02:16:14.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0689999999999998e-05 2024-04-19T02:16:14.322 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:14.322 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:14.322 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:14.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.322 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:16519 5.f 5:fc30d3a1:::benchmark_data_smithi121_44835_object16518:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:14.322 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.880723+0000", 2024-04-19T02:16:14.323 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 14.353555917, 2024-04-19T02:16:14.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020492519000000001, 2024-04-19T02:16:14.323 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:14.323 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:14.323 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:14.323 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:14.323 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:14.323 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16519 2024-04-19T02:16:14.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.323 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:14.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:14.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880723+0000", 2024-04-19T02:16:14.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:14.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:14.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880723+0000", 2024-04-19T02:16:14.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:14.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:14.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880722+0000", 2024-04-19T02:16:14.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:14.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:14.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880794+0000", 2024-04-19T02:16:14.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1515999999999998e-05 2024-04-19T02:16:14.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.326 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:14.326 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880805+0000", 2024-04-19T02:16:14.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1353e-05 2024-04-19T02:16:14.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.326 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:14.326 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880812+0000", 2024-04-19T02:16:14.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1230000000000002e-06 2024-04-19T02:16:14.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.327 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:14.327 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.890954+0000", 2024-04-19T02:16:14.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010142253 2024-04-19T02:16:14.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.327 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:14.327 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891079+0000", 2024-04-19T02:16:14.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000124917 2024-04-19T02:16:14.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.327 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:14.327 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891218+0000", 2024-04-19T02:16:14.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000138715 2024-04-19T02:16:14.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:14.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.897321+0000", 2024-04-19T02:16:14.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0061026830000000002 2024-04-19T02:16:14.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:14.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901137+0000", 2024-04-19T02:16:14.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038161699999999998 2024-04-19T02:16:14.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:14.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901181+0000", 2024-04-19T02:16:14.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4362e-05 2024-04-19T02:16:14.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:14.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901215+0000", 2024-04-19T02:16:14.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3929e-05 2024-04-19T02:16:14.329 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:14.329 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:14.329 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:14.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.329 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:16520 5.f 5:f0474691:::benchmark_data_smithi121_44835_object16519:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:14.329 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.880833+0000", 2024-04-19T02:16:14.329 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 14.353445902000001, 2024-04-19T02:16:14.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020460160000000002, 2024-04-19T02:16:14.329 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:14.330 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:14.330 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:14.330 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:14.330 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:14.330 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16520 2024-04-19T02:16:14.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.330 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:14.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:14.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880833+0000", 2024-04-19T02:16:14.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:14.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.331 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:14.331 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880833+0000", 2024-04-19T02:16:14.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:14.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.331 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:14.331 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880832+0000", 2024-04-19T02:16:14.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:14.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.331 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:14.331 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880909+0000", 2024-04-19T02:16:14.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7095000000000006e-05 2024-04-19T02:16:14.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.332 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:14.332 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880919+0000", 2024-04-19T02:16:14.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8919999999999995e-06 2024-04-19T02:16:14.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.332 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:14.332 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880927+0000", 2024-04-19T02:16:14.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8809999999999996e-06 2024-04-19T02:16:14.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.332 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:14.332 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891901+0000", 2024-04-19T02:16:14.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010974263999999999 2024-04-19T02:16:14.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:14.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.892021+0000", 2024-04-19T02:16:14.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120074 2024-04-19T02:16:14.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:14.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.892165+0000", 2024-04-19T02:16:14.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014328600000000001 2024-04-19T02:16:14.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:14.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.897347+0000", 2024-04-19T02:16:14.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.005182603 2024-04-19T02:16:14.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:14.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901224+0000", 2024-04-19T02:16:14.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038767620000000002 2024-04-19T02:16:14.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:14.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901264+0000", 2024-04-19T02:16:14.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9579000000000002e-05 2024-04-19T02:16:14.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:14.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901293+0000", 2024-04-19T02:16:14.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9300999999999999e-05 2024-04-19T02:16:14.335 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:14.335 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:14.335 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:14.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.335 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:44167 5.7 5:ef4300c4:::benchmark_data_smithi121_44835_object44166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:14.335 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:09.853830+0000", 2024-04-19T02:16:14.335 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.3804484180000003, 2024-04-19T02:16:14.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020082104, 2024-04-19T02:16:14.335 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:14.335 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:14.335 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:14.335 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:14.336 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:14.336 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 44167 2024-04-19T02:16:14.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.336 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:14.336 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.336 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:14.336 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853830+0000", 2024-04-19T02:16:14.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:14.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.336 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.336 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:14.336 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853830+0000", 2024-04-19T02:16:14.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:14.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.337 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.337 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:14.337 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853829+0000", 2024-04-19T02:16:14.337 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:14.337 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.337 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.337 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:14.337 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853863+0000", 2024-04-19T02:16:14.337 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3151999999999997e-05 2024-04-19T02:16:14.337 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.337 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.337 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:14.337 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853873+0000", 2024-04-19T02:16:14.337 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0366e-05 2024-04-19T02:16:14.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:14.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853881+0000", 2024-04-19T02:16:14.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6539999999999999e-06 2024-04-19T02:16:14.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:14.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.859162+0000", 2024-04-19T02:16:14.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052810740000000002 2024-04-19T02:16:14.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:14.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.859303+0000", 2024-04-19T02:16:14.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000140975 2024-04-19T02:16:14.339 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.339 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.339 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:14.339 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.859460+0000", 2024-04-19T02:16:14.339 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015754199999999999 2024-04-19T02:16:14.339 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.339 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.339 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:14.339 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.865142+0000", 2024-04-19T02:16:14.339 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0056819130000000002 2024-04-19T02:16:14.339 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.339 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.339 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:14.339 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.873828+0000", 2024-04-19T02:16:14.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0086861799999999999 2024-04-19T02:16:14.340 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.340 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:14.340 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.873871+0000", 2024-04-19T02:16:14.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2624999999999999e-05 2024-04-19T02:16:14.340 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.340 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:14.340 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.873912+0000", 2024-04-19T02:16:14.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1486000000000002e-05 2024-04-19T02:16:14.340 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:14.340 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:14.340 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:14.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.341 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.341 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:51990 5.f 5:f3e38436:::benchmark_data_smithi121_44835_object51989:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T02:16:14.341 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:13.115474+0000", 2024-04-19T02:16:14.341 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.118804489, 2024-04-19T02:16:14.341 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018801477, 2024-04-19T02:16:14.341 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:14.341 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:14.341 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:14.341 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:14.341 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:14.341 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 51990 2024-04-19T02:16:14.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.341 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:14.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.342 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:14.342 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.115474+0000", 2024-04-19T02:16:14.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:14.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.342 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:14.342 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.115474+0000", 2024-04-19T02:16:14.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:14.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.342 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:14.342 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.115473+0000", 2024-04-19T02:16:14.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:14.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:14.343 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.115570+0000", 2024-04-19T02:16:14.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6951000000000001e-05 2024-04-19T02:16:14.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:14.343 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.115576+0000", 2024-04-19T02:16:14.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8499999999999999e-06 2024-04-19T02:16:14.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:14.344 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.115581+0000", 2024-04-19T02:16:14.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4039999999999997e-06 2024-04-19T02:16:14.344 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:14.344 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.117248+0000", 2024-04-19T02:16:14.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001667349 2024-04-19T02:16:14.344 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:14.344 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.117340+0000", 2024-04-19T02:16:14.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1982000000000001e-05 2024-04-19T02:16:14.344 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:14.345 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.117423+0000", 2024-04-19T02:16:14.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2824999999999994e-05 2024-04-19T02:16:14.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.345 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:14.345 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.119873+0000", 2024-04-19T02:16:14.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0024502790000000001 2024-04-19T02:16:14.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.345 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:14.345 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.134198+0000", 2024-04-19T02:16:14.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014325361 2024-04-19T02:16:14.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.346 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:14.346 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.134243+0000", 2024-04-19T02:16:14.346 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4926000000000003e-05 2024-04-19T02:16:14.346 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.346 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:14.346 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.134276+0000", 2024-04-19T02:16:14.346 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.235e-05 2024-04-19T02:16:14.346 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:14.346 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:14.346 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:14.346 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.346 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:53042 5.f 5:f744ac14:::benchmark_data_smithi121_44835_object53041:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T02:16:14.347 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:13.560196+0000", 2024-04-19T02:16:14.347 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.674082599, 2024-04-19T02:16:14.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020122021, 2024-04-19T02:16:14.347 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:14.347 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:14.347 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:14.347 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:14.347 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:14.347 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 53042 2024-04-19T02:16:14.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.347 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:14.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.347 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:14.347 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560196+0000", 2024-04-19T02:16:14.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:14.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.348 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:14.348 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560196+0000", 2024-04-19T02:16:14.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:14.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.348 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:14.348 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560195+0000", 2024-04-19T02:16:14.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:14.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:14.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560255+0000", 2024-04-19T02:16:14.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9441000000000002e-05 2024-04-19T02:16:14.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:14.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560264+0000", 2024-04-19T02:16:14.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1130000000000007e-06 2024-04-19T02:16:14.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:14.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560271+0000", 2024-04-19T02:16:14.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9800000000000001e-06 2024-04-19T02:16:14.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:14.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560312+0000", 2024-04-19T02:16:14.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0828999999999998e-05 2024-04-19T02:16:14.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:14.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560456+0000", 2024-04-19T02:16:14.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014474799999999999 2024-04-19T02:16:14.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:14.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560591+0000", 2024-04-19T02:16:14.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013482699999999999 2024-04-19T02:16:14.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:14.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.564799+0000", 2024-04-19T02:16:14.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042080080000000001 2024-04-19T02:16:14.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:14.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580233+0000", 2024-04-19T02:16:14.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015433715000000001 2024-04-19T02:16:14.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:14.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580280+0000", 2024-04-19T02:16:14.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6465000000000003e-05 2024-04-19T02:16:14.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.352 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:14.352 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580318+0000", 2024-04-19T02:16:14.352 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8557999999999999e-05 2024-04-19T02:16:14.352 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:14.352 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:14.352 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:14.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.352 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:53044 5.7 5:ec8fd8f2:::benchmark_data_smithi121_44835_object53043:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T02:16:14.352 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:13.561281+0000", 2024-04-19T02:16:14.352 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.67299739700000005, 2024-04-19T02:16:14.352 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019133752, 2024-04-19T02:16:14.353 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:14.353 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:14.353 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:14.353 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:14.353 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:14.353 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 53044 2024-04-19T02:16:14.353 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.353 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:14.353 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.353 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:14.353 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.561281+0000", 2024-04-19T02:16:14.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:14.353 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.353 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.354 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:14.354 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.561281+0000", 2024-04-19T02:16:14.354 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:14.354 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.354 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.354 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:14.354 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.561270+0000", 2024-04-19T02:16:14.354 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999886 2024-04-19T02:16:14.354 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.354 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.354 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:14.354 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.561364+0000", 2024-04-19T02:16:14.354 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4721000000000003e-05 2024-04-19T02:16:14.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:14.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.561375+0000", 2024-04-19T02:16:14.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0900999999999999e-05 2024-04-19T02:16:14.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:14.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.561383+0000", 2024-04-19T02:16:14.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5460000000000003e-06 2024-04-19T02:16:14.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:14.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.562716+0000", 2024-04-19T02:16:14.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001333592 2024-04-19T02:16:14.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.356 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:14.356 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.562831+0000", 2024-04-19T02:16:14.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000114585 2024-04-19T02:16:14.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.356 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:14.356 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.562984+0000", 2024-04-19T02:16:14.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000152724 2024-04-19T02:16:14.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.356 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:14.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.571517+0000", 2024-04-19T02:16:14.357 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0085335199999999993 2024-04-19T02:16:14.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:14.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580332+0000", 2024-04-19T02:16:14.357 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0088147859999999998 2024-04-19T02:16:14.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:14.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580377+0000", 2024-04-19T02:16:14.357 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5293000000000002e-05 2024-04-19T02:16:14.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:14.358 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580415+0000", 2024-04-19T02:16:14.358 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7756999999999998e-05 2024-04-19T02:16:14.358 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:14.358 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:14.358 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:14.358 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.358 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.358 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:53407 5.d 5:b2c73a99:::benchmark_data_smithi121_44835_object53406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T02:16:14.358 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:13.715399+0000", 2024-04-19T02:16:14.358 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.51887981000000005, 2024-04-19T02:16:14.358 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018729579, 2024-04-19T02:16:14.358 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:14.358 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:14.358 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:14.359 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:14.359 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:14.359 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 53407 2024-04-19T02:16:14.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.359 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:14.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.359 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:14.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.715399+0000", 2024-04-19T02:16:14.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:14.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.359 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:14.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.715399+0000", 2024-04-19T02:16:14.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:14.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.360 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:14.360 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.715398+0000", 2024-04-19T02:16:14.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:14.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.360 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:14.360 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.715486+0000", 2024-04-19T02:16:14.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7865e-05 2024-04-19T02:16:14.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.360 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:14.361 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.715496+0000", 2024-04-19T02:16:14.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8349999999999999e-06 2024-04-19T02:16:14.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.361 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.361 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:14.361 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.715502+0000", 2024-04-19T02:16:14.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3369999999999996e-06 2024-04-19T02:16:14.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.361 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.361 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:14.361 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.723121+0000", 2024-04-19T02:16:14.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0076190479999999998 2024-04-19T02:16:14.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.361 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:14.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.723251+0000", 2024-04-19T02:16:14.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012975199999999999 2024-04-19T02:16:14.362 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:14.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.723388+0000", 2024-04-19T02:16:14.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000137398 2024-04-19T02:16:14.362 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:14.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.731564+0000", 2024-04-19T02:16:14.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0081755669999999999 2024-04-19T02:16:14.362 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.363 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:14.363 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.734060+0000", 2024-04-19T02:16:14.363 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002496547 2024-04-19T02:16:14.363 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.363 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.363 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:14.363 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.734105+0000", 2024-04-19T02:16:14.363 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4187999999999998e-05 2024-04-19T02:16:14.363 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:14.363 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:14.363 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:14.363 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.734128+0000", 2024-04-19T02:16:14.363 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3728999999999999e-05 2024-04-19T02:16:14.363 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:14.363 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:14.364 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:14.364 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:14.364 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:14.364 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:16:14.366 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:16:14.366 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:14.366+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:14.466 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:14.466+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:14.530 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:16:14.530 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:16:14.530 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.530 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:55318 5.e 5:73e2d7ef:::benchmark_data_smithi121_44835_object55317:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T02:16:14.530 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:14.523230+0000", 2024-04-19T02:16:14.530 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.007094136, 2024-04-19T02:16:14.530 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0071156309999999999, 2024-04-19T02:16:14.531 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:14.531 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:14.531 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:14.531 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:14.531 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:14.531 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 55318 2024-04-19T02:16:14.531 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.531 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:14.531 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.531 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:14.531 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.523230+0000", 2024-04-19T02:16:14.531 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:14.531 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.531 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.532 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:14.532 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.523230+0000", 2024-04-19T02:16:14.532 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:14.532 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.532 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.532 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:14.532 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.523230+0000", 2024-04-19T02:16:14.532 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:14.532 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.532 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.532 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:14.532 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.523338+0000", 2024-04-19T02:16:14.532 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000108708 2024-04-19T02:16:14.533 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.533 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.533 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:14.533 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.523346+0000", 2024-04-19T02:16:14.533 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0199999999999994e-06 2024-04-19T02:16:14.533 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.533 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.533 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:14.533 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.523354+0000", 2024-04-19T02:16:14.533 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.0899999999999999e-06 2024-04-19T02:16:14.533 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.533 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.534 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:14.534 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.525338+0000", 2024-04-19T02:16:14.534 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0019843759999999999 2024-04-19T02:16:14.534 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.534 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.534 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:14.534 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.525443+0000", 2024-04-19T02:16:14.534 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000105618 2024-04-19T02:16:14.534 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.534 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.534 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:14.534 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.525536+0000", 2024-04-19T02:16:14.534 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2009000000000006e-05 2024-04-19T02:16:14.535 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.535 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.535 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:14.535 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.527053+0000", 2024-04-19T02:16:14.535 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0015170030000000001 2024-04-19T02:16:14.535 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:14.535 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:14.535 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:14.535 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.535 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.535 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:55321 5.0 5:05670434:::benchmark_data_smithi121_44835_object55320:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T02:16:14.535 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:14.525740+0000", 2024-04-19T02:16:14.535 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0045840840000000004, 2024-04-19T02:16:14.536 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0046939440000000002, 2024-04-19T02:16:14.536 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:14.536 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:14.536 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:14.536 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:14.536 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:14.536 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 55321 2024-04-19T02:16:14.536 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.536 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:14.536 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.536 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:14.536 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.525740+0000", 2024-04-19T02:16:14.536 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:14.536 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.537 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.537 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:14.537 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.525740+0000", 2024-04-19T02:16:14.537 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:14.537 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.537 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.537 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:14.537 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.525739+0000", 2024-04-19T02:16:14.537 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:14.538 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.538 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.538 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:14.538 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.525844+0000", 2024-04-19T02:16:14.538 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010544600000000001 2024-04-19T02:16:14.538 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.538 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.538 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:14.538 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.525857+0000", 2024-04-19T02:16:14.538 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2387e-05 2024-04-19T02:16:14.538 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.538 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.539 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:14.539 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.525864+0000", 2024-04-19T02:16:14.539 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1230000000000002e-06 2024-04-19T02:16:14.539 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.539 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.539 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:14.539 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.525899+0000", 2024-04-19T02:16:14.539 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5268999999999997e-05 2024-04-19T02:16:14.539 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.539 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.539 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:14.539 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.525991+0000", 2024-04-19T02:16:14.539 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.1889000000000001e-05 2024-04-19T02:16:14.539 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.540 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.540 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:14.540 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.526124+0000", 2024-04-19T02:16:14.540 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000133368 2024-04-19T02:16:14.540 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:14.540 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:14.540 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:14.540 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.540 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.540 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:55323 5.b 5:d310cd1e:::benchmark_data_smithi121_44835_object55322:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T02:16:14.540 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:14.526961+0000", 2024-04-19T02:16:14.540 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0033635259999999999, 2024-04-19T02:16:14.541 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0035560729999999999, 2024-04-19T02:16:14.541 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:14.541 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:14.541 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:14.541 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:14.541 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:14.541 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 55323 2024-04-19T02:16:14.541 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.541 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:14.541 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.541 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:14.541 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.526961+0000", 2024-04-19T02:16:14.541 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:14.541 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.542 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.542 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:14.542 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.526961+0000", 2024-04-19T02:16:14.542 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:14.542 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.542 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.542 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:14.542 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.526960+0000", 2024-04-19T02:16:14.542 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:14.542 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.542 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.542 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:14.542 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.527023+0000", 2024-04-19T02:16:14.543 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.2977000000000004e-05 2024-04-19T02:16:14.543 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.543 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.543 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:14.543 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.527032+0000", 2024-04-19T02:16:14.543 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.6729999999999998e-06 2024-04-19T02:16:14.543 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.543 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.543 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:14.543 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.527039+0000", 2024-04-19T02:16:14.543 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.0450000000000003e-06 2024-04-19T02:16:14.543 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.543 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.543 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:14.543 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.527065+0000", 2024-04-19T02:16:14.544 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.6322e-05 2024-04-19T02:16:14.544 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.544 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.544 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:14.544 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.527159+0000", 2024-04-19T02:16:14.544 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3752999999999995e-05 2024-04-19T02:16:14.544 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.544 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.544 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:14.544 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.527267+0000", 2024-04-19T02:16:14.544 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000108502 2024-04-19T02:16:14.544 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:14.544 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:14.544 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:14.545 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.545 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.545 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:55326 5.e 5:7ce00369:::benchmark_data_smithi121_44835_object55325:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T02:16:14.545 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:14.528771+0000", 2024-04-19T02:16:14.545 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0015536619999999999, 2024-04-19T02:16:14.545 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0018349740000000001, 2024-04-19T02:16:14.545 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:14.545 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:14.545 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:14.545 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:14.545 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:14.545 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 55326 2024-04-19T02:16:14.545 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.545 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:14.545 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.546 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:14.546 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.528771+0000", 2024-04-19T02:16:14.546 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:14.546 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.546 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.546 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:14.546 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.528771+0000", 2024-04-19T02:16:14.546 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:14.546 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.546 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.546 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:14.546 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.528770+0000", 2024-04-19T02:16:14.546 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:14.547 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.547 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.547 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:14.547 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.528850+0000", 2024-04-19T02:16:14.547 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0160000000000005e-05 2024-04-19T02:16:14.547 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.547 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.547 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:14.547 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.528861+0000", 2024-04-19T02:16:14.547 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1014e-05 2024-04-19T02:16:14.547 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.547 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.547 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:14.547 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.528867+0000", 2024-04-19T02:16:14.547 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.8760000000000002e-06 2024-04-19T02:16:14.548 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.548 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.548 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:14.548 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.528889+0000", 2024-04-19T02:16:14.548 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.2038000000000001e-05 2024-04-19T02:16:14.548 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.548 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.548 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:14.548 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.528965+0000", 2024-04-19T02:16:14.548 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.5976999999999994e-05 2024-04-19T02:16:14.549 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.549 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.549 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:14.549 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.529073+0000", 2024-04-19T02:16:14.549 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000108033 2024-04-19T02:16:14.549 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:14.549 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:14.549 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:14.549 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.550 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.550 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:55327 5.8 5:1d13f5b9:::benchmark_data_smithi121_44835_object55326:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T02:16:14.550 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:14.528874+0000", 2024-04-19T02:16:14.550 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.001450404, 2024-04-19T02:16:14.550 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0018034430000000001, 2024-04-19T02:16:14.550 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:14.550 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:14.550 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:14.550 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:14.551 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:14.551 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 55327 2024-04-19T02:16:14.551 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.551 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:14.551 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.551 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:14.551 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.528874+0000", 2024-04-19T02:16:14.551 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:14.552 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.552 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.552 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:14.552 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.528874+0000", 2024-04-19T02:16:14.552 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:14.552 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.552 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.552 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:14.553 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.528874+0000", 2024-04-19T02:16:14.553 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:14.553 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.553 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.553 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:14.553 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.528913+0000", 2024-04-19T02:16:14.554 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9394999999999998e-05 2024-04-19T02:16:14.554 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.554 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.554 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:14.554 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.528918+0000", 2024-04-19T02:16:14.554 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0100000000000003e-06 2024-04-19T02:16:14.554 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.555 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.555 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:14.555 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.528922+0000", 2024-04-19T02:16:14.555 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6799999999999999e-06 2024-04-19T02:16:14.555 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.555 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.555 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:14.555 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.528944+0000", 2024-04-19T02:16:14.555 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.2052000000000002e-05 2024-04-19T02:16:14.556 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.556 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.556 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:14.556 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.529028+0000", 2024-04-19T02:16:14.556 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.4474999999999993e-05 2024-04-19T02:16:14.556 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.556 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.556 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:14.557 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.529107+0000", 2024-04-19T02:16:14.557 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9132000000000001e-05 2024-04-19T02:16:14.557 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:14.557 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:14.557 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:14.557 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.557 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.557 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:55328 5.b 5:de0eb7cd:::benchmark_data_smithi121_44835_object55327:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T02:16:14.557 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:14.528932+0000", 2024-04-19T02:16:14.558 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0013927939999999999, 2024-04-19T02:16:14.558 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001788745, 2024-04-19T02:16:14.558 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:14.558 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:14.558 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:14.558 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:14.559 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:14.559 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 55328 2024-04-19T02:16:14.559 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.559 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:14.559 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.560 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:14.560 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.528932+0000", 2024-04-19T02:16:14.560 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:14.560 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.560 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.560 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:14.560 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.528932+0000", 2024-04-19T02:16:14.561 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:14.561 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.561 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.561 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:14.561 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.528931+0000", 2024-04-19T02:16:14.561 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:14.561 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.561 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.561 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:14.562 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.528978+0000", 2024-04-19T02:16:14.562 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.6659000000000002e-05 2024-04-19T02:16:14.562 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.562 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.562 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:14.562 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.528982+0000", 2024-04-19T02:16:14.562 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4660000000000001e-06 2024-04-19T02:16:14.562 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.563 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.563 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:14.563 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.528987+0000", 2024-04-19T02:16:14.563 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.6650000000000002e-06 2024-04-19T02:16:14.563 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.563 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.563 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:14.563 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.529020+0000", 2024-04-19T02:16:14.564 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3445000000000003e-05 2024-04-19T02:16:14.564 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.564 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.564 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:14.564 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.529130+0000", 2024-04-19T02:16:14.564 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000109518 2024-04-19T02:16:14.564 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:14.564 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:14.564 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:14.565 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:14.529255+0000", 2024-04-19T02:16:14.565 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012482699999999999 2024-04-19T02:16:14.565 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:14.565 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:14.565 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:14.565 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:14.565 INFO:teuthology.orchestra.run.smithi174.stdout: ], 2024-04-19T02:16:14.565 INFO:teuthology.orchestra.run.smithi174.stdout: "num_ops": 6 2024-04-19T02:16:14.565 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:16:14.567 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:14.567+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:14.568 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:16:14.637 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:16:14.667 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:14.668+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:14.768 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:14.769+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:14.771 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:16:14.771 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [], 2024-04-19T02:16:14.772 INFO:teuthology.orchestra.run.smithi174.stdout: "complaint_time": 30, 2024-04-19T02:16:14.772 INFO:teuthology.orchestra.run.smithi174.stdout: "num_blocked_ops": 0 2024-04-19T02:16:14.772 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:16:14.786 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:16:14.790 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:16:14.811 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:16:14.831 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2: {} 2024-04-19T02:16:14.832 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:16:14.833 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:16:14.833 INFO:teuthology.orchestra.run.smithi121.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:16:14.869 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:14.870+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:14.970 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:14.970+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:14.988 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:14.988 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:15.001 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:16:15.026 INFO:tasks.radosbench.radosbench.0.smithi121.stdout:2024-04-19T02:16:15.028078+0000 min lat: 0.00120262 max lat: 0.0837821 avg lat: 0.00566405 2024-04-19T02:16:15.026 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-19T02:16:15.027 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 20 16 56488 56472 176.461 147.5 0.00318212 0.00566405 2024-04-19T02:16:15.072 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:15.073+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:15.174 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:15.173+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:15.184 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:15.184 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:15.199 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:16:15.273 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:15.274+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:15.374 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:15.374+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:15.424 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:15.424 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:15.440 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:16:15.475 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:15.476+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:15.576 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:15.577+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:15.625 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:15.625 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:15.634 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-19T02:16:15.634 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T02:16:15.634 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-04-19T02:16:15.634 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-19T02:16:15.634 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-19T02:16:15.635 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-04-19T02:16:15.640 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:16:15.677 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:15.677+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:15.778 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:15.778+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:15.803 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:16:15.804 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "" 2024-04-19T02:16:15.804 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:16:15.854 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:15.855 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:15.868 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:16:15.879 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:15.879+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:15.980 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:15.980+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:16.026 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 21 16 58679 58663 174.579 136.938 0.00667765 0.0057252 2024-04-19T02:16:16.038 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T02:16:16.078 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:16.079 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:16.081 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:16.082+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:16.093 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:16:16.182 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:16.182+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:16.283 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:16.284+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:16.303 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:16.303 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:16.317 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:16:16.385 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:16.385+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:16.485 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:16.485+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:16.488 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:16.488 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:16.502 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:16:16.587 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:16.587+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:16.687 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:16.688+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:16.708 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:16.708 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:16.721 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:16:16.805 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:16.805+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:16.846 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:16:16.889 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:16.890+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:16.922 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:16.922 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:16.935 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:16:16.991 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:16.992+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:16.996 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:16:17.016 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:16:17.026 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 22 16 60884 60868 172.907 137.812 0.00741041 0.00578085 2024-04-19T02:16:17.031 INFO:teuthology.orchestra.run.smithi121.stderr:noscrub is set 2024-04-19T02:16:17.037 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2: {} 2024-04-19T02:16:17.038 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:16:17.042 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:16:17.042 INFO:teuthology.orchestra.run.smithi121.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:16:17.092 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:17.092+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:17.118 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-04-19T02:16:17.119 INFO:teuthology.orchestra.run.smithi177.stdout: "ops": [ 2024-04-19T02:16:17.119 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.119 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:61045 5.6 5:6d841671:::benchmark_data_smithi121_44835_object61044:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:17.119 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:17.110201+0000", 2024-04-19T02:16:17.119 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0074602399999999999, 2024-04-19T02:16:17.119 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0074920230000000004, 2024-04-19T02:16:17.119 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:17.119 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:17.119 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:17.119 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:17.119 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:17.119 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 61045 2024-04-19T02:16:17.119 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.119 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:17.120 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.120 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:17.120 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.110201+0000", 2024-04-19T02:16:17.120 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.120 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.120 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.120 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:17.120 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.110201+0000", 2024-04-19T02:16:17.120 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.120 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.120 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.120 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:17.120 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.110200+0000", 2024-04-19T02:16:17.120 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:17.121 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.121 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.121 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:17.121 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.110251+0000", 2024-04-19T02:16:17.121 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.1056e-05 2024-04-19T02:16:17.121 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.121 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.121 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:17.121 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.110263+0000", 2024-04-19T02:16:17.121 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.1405e-05 2024-04-19T02:16:17.121 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.121 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.121 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:17.121 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.110268+0000", 2024-04-19T02:16:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.6919999999999999e-06 2024-04-19T02:16:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.110306+0000", 2024-04-19T02:16:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.8043999999999997e-05 2024-04-19T02:16:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.110447+0000", 2024-04-19T02:16:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00014121000000000001 2024-04-19T02:16:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.122 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.123 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:17.123 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.110601+0000", 2024-04-19T02:16:17.123 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00015328499999999999 2024-04-19T02:16:17.123 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.123 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.123 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:17.123 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.117036+0000", 2024-04-19T02:16:17.123 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.006435283 2024-04-19T02:16:17.123 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.123 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:17.123 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.123 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.123 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.124 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:61046 5.a 5:5b04aa26:::benchmark_data_smithi121_44835_object61045:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:17.124 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:17.110276+0000", 2024-04-19T02:16:17.124 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0073855730000000003, 2024-04-19T02:16:17.124 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0075187370000000002, 2024-04-19T02:16:17.124 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:17.124 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:17.124 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:17.124 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:17.124 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:17.124 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 61046 2024-04-19T02:16:17.124 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.124 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:17.124 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.124 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:17.125 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.110276+0000", 2024-04-19T02:16:17.125 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.125 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.125 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.125 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:17.125 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.110276+0000", 2024-04-19T02:16:17.125 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.125 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.125 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.125 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:17.125 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.110275+0000", 2024-04-19T02:16:17.125 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:17.125 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.125 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.125 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:17.126 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.110309+0000", 2024-04-19T02:16:17.126 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.4122999999999998e-05 2024-04-19T02:16:17.126 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.126 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.126 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:17.126 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.110316+0000", 2024-04-19T02:16:17.126 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.5050000000000004e-06 2024-04-19T02:16:17.126 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.126 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.126 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:17.126 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.110319+0000", 2024-04-19T02:16:17.126 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.5489999999999998e-06 2024-04-19T02:16:17.126 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.126 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.127 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:17.127 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.111540+0000", 2024-04-19T02:16:17.127 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.001220561 2024-04-19T02:16:17.127 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.127 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.127 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:17.127 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.111669+0000", 2024-04-19T02:16:17.127 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012939200000000001 2024-04-19T02:16:17.127 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.127 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.128 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:17.128 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.111800+0000", 2024-04-19T02:16:17.128 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00013059899999999999 2024-04-19T02:16:17.128 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.128 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.128 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:17.128 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.117173+0000", 2024-04-19T02:16:17.128 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0053730560000000002 2024-04-19T02:16:17.128 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.128 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:17.128 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.128 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.128 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.128 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:61048 5.6 5:68a6dda5:::benchmark_data_smithi121_44835_object61047:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:17.129 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:17.110324+0000", 2024-04-19T02:16:17.129 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0073372979999999999, 2024-04-19T02:16:17.129 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0075699290000000004, 2024-04-19T02:16:17.129 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:17.129 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:17.129 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:17.129 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:17.129 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:17.129 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 61048 2024-04-19T02:16:17.129 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.129 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:17.129 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.129 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:17.129 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.110324+0000", 2024-04-19T02:16:17.129 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.130 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.130 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.130 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:17.130 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.110324+0000", 2024-04-19T02:16:17.130 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.130 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.130 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.130 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:17.130 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.110323+0000", 2024-04-19T02:16:17.130 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:17.130 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.130 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.130 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:17.130 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.110371+0000", 2024-04-19T02:16:17.131 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.7679000000000002e-05 2024-04-19T02:16:17.131 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.131 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.131 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:17.131 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.110376+0000", 2024-04-19T02:16:17.131 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.8790000000000002e-06 2024-04-19T02:16:17.131 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.131 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.131 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:17.131 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.110380+0000", 2024-04-19T02:16:17.131 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.535e-06 2024-04-19T02:16:17.131 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.131 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.131 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:17.131 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.112356+0000", 2024-04-19T02:16:17.131 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0019766860000000001 2024-04-19T02:16:17.132 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.132 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.132 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:17.132 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.112476+0000", 2024-04-19T02:16:17.132 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000120017 2024-04-19T02:16:17.132 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.132 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.132 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:17.132 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.112603+0000", 2024-04-19T02:16:17.132 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000126694 2024-04-19T02:16:17.132 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.132 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.132 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:17.132 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.117069+0000", 2024-04-19T02:16:17.132 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0044658839999999998 2024-04-19T02:16:17.133 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.133 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:17.133 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.133 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.133 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.133 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:61049 5.6 5:63531abc:::benchmark_data_smithi121_44835_object61048:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:17.133 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:17.111604+0000", 2024-04-19T02:16:17.133 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0060575389999999998, 2024-04-19T02:16:17.133 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0063857860000000001, 2024-04-19T02:16:17.134 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:17.134 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:17.134 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:17.134 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:17.134 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:17.134 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 61049 2024-04-19T02:16:17.134 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.134 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:17.134 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.134 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:17.134 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.111604+0000", 2024-04-19T02:16:17.134 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.134 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.135 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.135 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:17.135 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.111604+0000", 2024-04-19T02:16:17.135 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.135 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.135 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.135 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:17.135 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.111603+0000", 2024-04-19T02:16:17.135 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:17.135 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.135 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.135 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:17.135 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.111667+0000", 2024-04-19T02:16:17.135 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.4066000000000006e-05 2024-04-19T02:16:17.135 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.135 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.136 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:17.136 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.111676+0000", 2024-04-19T02:16:17.136 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.5079999999999994e-06 2024-04-19T02:16:17.136 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.136 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.136 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:17.136 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.111683+0000", 2024-04-19T02:16:17.136 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.8229999999999997e-06 2024-04-19T02:16:17.136 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.136 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.136 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:17.136 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.114369+0000", 2024-04-19T02:16:17.136 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0026861659999999998 2024-04-19T02:16:17.136 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.137 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.137 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:17.137 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.114446+0000", 2024-04-19T02:16:17.137 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.6285999999999994e-05 2024-04-19T02:16:17.137 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.137 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.137 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:17.137 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.114539+0000", 2024-04-19T02:16:17.137 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.3653999999999995e-05 2024-04-19T02:16:17.137 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.137 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:17.137 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.137 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.137 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.138 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:61052 5.a 5:57faba8c:::benchmark_data_smithi121_44835_object61051:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:17.138 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:17.111796+0000", 2024-04-19T02:16:17.138 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0058654550000000003, 2024-04-19T02:16:17.138 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.006279766, 2024-04-19T02:16:17.138 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:17.138 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:17.138 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:17.138 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:17.138 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:17.139 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 61052 2024-04-19T02:16:17.139 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.139 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:17.139 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.139 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:17.139 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.111796+0000", 2024-04-19T02:16:17.139 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.139 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.139 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.139 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:17.139 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.111796+0000", 2024-04-19T02:16:17.139 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.139 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.139 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.139 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:17.139 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.111795+0000", 2024-04-19T02:16:17.140 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:17.140 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.140 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.140 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:17.140 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.111900+0000", 2024-04-19T02:16:17.140 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00010486500000000001 2024-04-19T02:16:17.140 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.140 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.140 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:17.140 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.111908+0000", 2024-04-19T02:16:17.140 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.2430000000000005e-06 2024-04-19T02:16:17.140 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.140 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.140 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:17.141 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.111916+0000", 2024-04-19T02:16:17.141 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.6580000000000002e-06 2024-04-19T02:16:17.141 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.141 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.141 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:17.141 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.114130+0000", 2024-04-19T02:16:17.141 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.002214705 2024-04-19T02:16:17.141 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.141 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.141 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:17.141 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.114244+0000", 2024-04-19T02:16:17.141 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000113139 2024-04-19T02:16:17.141 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.141 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.141 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:17.142 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.114328+0000", 2024-04-19T02:16:17.142 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.4804999999999999e-05 2024-04-19T02:16:17.142 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.142 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.142 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:17.142 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.117209+0000", 2024-04-19T02:16:17.142 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0028809769999999998 2024-04-19T02:16:17.142 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.142 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:17.142 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.142 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.142 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.142 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:61053 5.6 5:6339e493:::benchmark_data_smithi121_44835_object61052:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:17.142 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:17.112417+0000", 2024-04-19T02:16:17.142 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0052440999999999998, 2024-04-19T02:16:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0057371599999999998, 2024-04-19T02:16:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 61053 2024-04-19T02:16:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.112417+0000", 2024-04-19T02:16:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.143 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.144 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.144 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:17.144 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.112417+0000", 2024-04-19T02:16:17.144 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.144 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.144 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.144 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:17.144 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.112416+0000", 2024-04-19T02:16:17.144 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:17.144 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.144 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.144 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:17.144 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.112444+0000", 2024-04-19T02:16:17.144 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.7478999999999999e-05 2024-04-19T02:16:17.144 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.145 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.145 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:17.145 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.112451+0000", 2024-04-19T02:16:17.145 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.3749999999999997e-06 2024-04-19T02:16:17.145 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.145 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.145 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:17.145 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.112457+0000", 2024-04-19T02:16:17.145 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.7409999999999998e-06 2024-04-19T02:16:17.145 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.145 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.145 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:17.145 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.117094+0000", 2024-04-19T02:16:17.145 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0046368879999999996 2024-04-19T02:16:17.146 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.146 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.146 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:17.146 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.117195+0000", 2024-04-19T02:16:17.146 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000101272 2024-04-19T02:16:17.146 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.146 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.146 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:17.146 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.117285+0000", 2024-04-19T02:16:17.146 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.0347999999999996e-05 2024-04-19T02:16:17.146 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.146 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:17.146 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.147 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.147 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.147 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:61055 5.2 e26/16 5:48e990cc:::benchmark_data_smithi121_44835_object61054:head v 26'3843, mlcod=26'3841)", 2024-04-19T02:16:17.147 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:17.114073+0000", 2024-04-19T02:16:17.147 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0035880999999999999, 2024-04-19T02:16:17.147 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.004153337, 2024-04-19T02:16:17.147 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:17.147 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:17.147 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:17.147 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.147 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:17.147 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.114073+0000", 2024-04-19T02:16:17.147 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.147 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.147 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.148 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:17.148 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.114073+0000", 2024-04-19T02:16:17.148 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.148 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.148 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.148 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:17.148 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.114073+0000", 2024-04-19T02:16:17.148 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:17.148 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.148 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.148 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:17.148 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.114103+0000", 2024-04-19T02:16:17.148 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.0142999999999999e-05 2024-04-19T02:16:17.148 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.148 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.149 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:17.149 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.114110+0000", 2024-04-19T02:16:17.149 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.3799999999999996e-06 2024-04-19T02:16:17.149 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.149 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.149 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:17.149 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.114116+0000", 2024-04-19T02:16:17.149 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.6400000000000002e-06 2024-04-19T02:16:17.149 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.149 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.149 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:17.149 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.115569+0000", 2024-04-19T02:16:17.149 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.001452701 2024-04-19T02:16:17.149 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.149 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.150 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:17.150 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.115588+0000", 2024-04-19T02:16:17.150 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.9777999999999999e-05 2024-04-19T02:16:17.150 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.150 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:17.150 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.150 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.150 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.150 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:61058 5.a 5:59b2bf40:::benchmark_data_smithi121_44835_object61057:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:17.150 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:17.117201+0000", 2024-04-19T02:16:17.150 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.00046057599999999998, 2024-04-19T02:16:17.151 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.001086772, 2024-04-19T02:16:17.151 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:17.151 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:17.151 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:17.151 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:17.151 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:17.151 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 61058 2024-04-19T02:16:17.151 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.151 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:17.151 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.151 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:17.151 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.117201+0000", 2024-04-19T02:16:17.151 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.151 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.152 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.152 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:17.152 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.117201+0000", 2024-04-19T02:16:17.152 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.152 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.152 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.152 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:17.152 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.117200+0000", 2024-04-19T02:16:17.152 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:17.152 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.152 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.152 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:17.152 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.117311+0000", 2024-04-19T02:16:17.152 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000111783 2024-04-19T02:16:17.152 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.153 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.153 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:17.153 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.117321+0000", 2024-04-19T02:16:17.153 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0022e-05 2024-04-19T02:16:17.153 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.153 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.153 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:17.153 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.117327+0000", 2024-04-19T02:16:17.153 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.4920000000000001e-06 2024-04-19T02:16:17.153 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.153 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.153 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:17.153 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.117364+0000", 2024-04-19T02:16:17.153 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.7373000000000003e-05 2024-04-19T02:16:17.153 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.154 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.154 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:17.154 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.117504+0000", 2024-04-19T02:16:17.154 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000140142 2024-04-19T02:16:17.154 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.154 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.154 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:17.154 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.117601+0000", 2024-04-19T02:16:17.154 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.6941000000000006e-05 2024-04-19T02:16:17.154 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.154 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:17.154 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.154 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.154 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.155 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:61061 5.5 5:ad10272c:::benchmark_data_smithi121_44835_object61060:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:17.155 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:17.117336+0000", 2024-04-19T02:16:17.155 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.000325094, 2024-04-19T02:16:17.155 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0010233600000000001, 2024-04-19T02:16:17.155 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:17.155 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:17.155 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:17.155 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:17.155 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:17.155 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 61061 2024-04-19T02:16:17.155 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.155 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:17.155 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.155 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:17.155 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.117336+0000", 2024-04-19T02:16:17.156 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.156 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.156 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.156 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:17.156 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.117336+0000", 2024-04-19T02:16:17.156 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.156 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.156 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.156 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:17.156 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.117336+0000", 2024-04-19T02:16:17.156 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:17.156 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.156 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.156 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:17.156 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.117430+0000", 2024-04-19T02:16:17.157 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.4024000000000006e-05 2024-04-19T02:16:17.157 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.157 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.157 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:17.157 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.117439+0000", 2024-04-19T02:16:17.157 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.003e-06 2024-04-19T02:16:17.157 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.157 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.157 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:17.157 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.117444+0000", 2024-04-19T02:16:17.157 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.8429999999999998e-06 2024-04-19T02:16:17.157 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.157 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.157 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:17.157 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.117497+0000", 2024-04-19T02:16:17.158 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.2259000000000002e-05 2024-04-19T02:16:17.158 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.158 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.158 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:17.158 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.117636+0000", 2024-04-19T02:16:17.158 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00013905699999999999 2024-04-19T02:16:17.158 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.158 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.158 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:17.158 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.117808+0000", 2024-04-19T02:16:17.158 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000172731 2024-04-19T02:16:17.158 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.158 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:17.158 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.159 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.159 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.159 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop_reply(client.4549.0:61049 5.6 e26/16)", 2024-04-19T02:16:17.159 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:17.117475+0000", 2024-04-19T02:16:17.159 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.00018593, 2024-04-19T02:16:17.159 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00094962099999999999, 2024-04-19T02:16:17.159 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:17.159 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "queued for pg", 2024-04-19T02:16:17.159 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:17.159 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.159 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:17.159 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.117475+0000", 2024-04-19T02:16:17.159 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.159 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.159 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.159 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:17.160 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.117475+0000", 2024-04-19T02:16:17.160 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.160 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.160 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.160 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:17.160 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.117475+0000", 2024-04-19T02:16:17.160 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:17.160 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.160 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.160 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:17.160 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.117478+0000", 2024-04-19T02:16:17.160 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.7000000000000002e-06 2024-04-19T02:16:17.160 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.160 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.160 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:17.161 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.117485+0000", 2024-04-19T02:16:17.161 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.883e-06 2024-04-19T02:16:17.161 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.161 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.161 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:17.161 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.117492+0000", 2024-04-19T02:16:17.161 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.7649999999999996e-06 2024-04-19T02:16:17.161 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.161 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:17.161 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.161 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.161 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2024-04-19T02:16:17.161 INFO:teuthology.orchestra.run.smithi177.stdout: "num_ops": 10 2024-04-19T02:16:17.161 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-04-19T02:16:17.162 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:16:17.193 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:17.193+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:17.294 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:17.294+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:17.339 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-04-19T02:16:17.339 INFO:teuthology.orchestra.run.smithi177.stdout: "ops": [], 2024-04-19T02:16:17.339 INFO:teuthology.orchestra.run.smithi177.stdout: "complaint_time": 30, 2024-04-19T02:16:17.339 INFO:teuthology.orchestra.run.smithi177.stdout: "num_blocked_ops": 0 2024-04-19T02:16:17.339 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-04-19T02:16:17.356 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:16:17.395 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:17.395+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:17.494 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:17.495+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:17.546 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-04-19T02:16:17.546 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 20, 2024-04-19T02:16:17.546 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 600, 2024-04-19T02:16:17.546 INFO:teuthology.orchestra.run.smithi177.stdout: "ops": [ 2024-04-19T02:16:17.547 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.547 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(mds.0.3:16 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:17.547 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:29.270306+0000", 2024-04-19T02:16:17.547 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 48.274467604000002, 2024-04-19T02:16:17.547 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016306661, 2024-04-19T02:16:17.547 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:17.547 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:17.547 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:17.547 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.547 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:17.547 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270306+0000", 2024-04-19T02:16:17.547 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.547 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.547 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.548 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:17.548 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270306+0000", 2024-04-19T02:16:17.548 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.548 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.548 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.548 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:17.548 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270306+0000", 2024-04-19T02:16:17.548 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:17.548 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.548 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.548 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:17.549 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270310+0000", 2024-04-19T02:16:17.549 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.0990000000000001e-06 2024-04-19T02:16:17.549 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.549 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.549 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:17.549 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270317+0000", 2024-04-19T02:16:17.549 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.7100000000000001e-06 2024-04-19T02:16:17.549 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.549 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.549 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:17.549 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270324+0000", 2024-04-19T02:16:17.549 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.374e-06 2024-04-19T02:16:17.549 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.549 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.549 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:17.550 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.274312+0000", 2024-04-19T02:16:17.550 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0039885140000000003 2024-04-19T02:16:17.550 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.550 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.550 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:17.550 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.274737+0000", 2024-04-19T02:16:17.550 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00042410899999999999 2024-04-19T02:16:17.550 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.550 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.550 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:17.550 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.274893+0000", 2024-04-19T02:16:17.550 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00015594599999999999 2024-04-19T02:16:17.551 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.551 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.551 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:17.551 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.278597+0000", 2024-04-19T02:16:17.551 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0037046869999999999 2024-04-19T02:16:17.551 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.551 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.551 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:17.551 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286522+0000", 2024-04-19T02:16:17.551 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0079243809999999994 2024-04-19T02:16:17.551 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.551 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.551 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:17.551 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286576+0000", 2024-04-19T02:16:17.551 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.4728999999999997e-05 2024-04-19T02:16:17.551 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.552 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.552 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:17.552 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286613+0000", 2024-04-19T02:16:17.552 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6661e-05 2024-04-19T02:16:17.552 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.552 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:17.552 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.552 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.552 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.552 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(mds.0.3:23 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:17.552 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:29.270358+0000", 2024-04-19T02:16:17.552 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 48.274416395999999, 2024-04-19T02:16:17.552 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016257511999999998, 2024-04-19T02:16:17.552 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:17.553 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:17.553 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:17.553 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.553 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:17.553 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270358+0000", 2024-04-19T02:16:17.553 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.553 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.553 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.553 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:17.553 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270358+0000", 2024-04-19T02:16:17.553 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.553 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.553 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.553 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:17.554 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270357+0000", 2024-04-19T02:16:17.554 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:17.554 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.554 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.554 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:17.554 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270360+0000", 2024-04-19T02:16:17.554 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.106e-06 2024-04-19T02:16:17.554 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.554 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.554 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:17.554 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270368+0000", 2024-04-19T02:16:17.554 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.6279999999999996e-06 2024-04-19T02:16:17.555 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.555 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.555 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:17.555 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270373+0000", 2024-04-19T02:16:17.555 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.1410000000000004e-06 2024-04-19T02:16:17.555 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.555 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.555 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:17.555 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.271505+0000", 2024-04-19T02:16:17.555 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0011319069999999999 2024-04-19T02:16:17.555 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.555 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.555 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:17.555 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.271652+0000", 2024-04-19T02:16:17.555 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00014698399999999999 2024-04-19T02:16:17.556 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.556 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.556 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:17.556 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286615+0000", 2024-04-19T02:16:17.556 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.014963156999999999 2024-04-19T02:16:17.556 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.556 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:17.556 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.556 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.556 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.556 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(mds.0.3:24 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:17.556 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:29.270411+0000", 2024-04-19T02:16:17.556 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 48.274363403999999, 2024-04-19T02:16:17.556 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016334762999999999, 2024-04-19T02:16:17.556 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:17.557 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:17.557 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:17.557 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.557 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:17.557 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270411+0000", 2024-04-19T02:16:17.557 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.557 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.557 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.557 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:17.557 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270411+0000", 2024-04-19T02:16:17.557 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.557 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.557 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.557 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:17.557 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270410+0000", 2024-04-19T02:16:17.558 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:17.558 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.558 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.558 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:17.558 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270413+0000", 2024-04-19T02:16:17.558 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.303e-06 2024-04-19T02:16:17.558 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.558 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.558 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:17.558 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270421+0000", 2024-04-19T02:16:17.558 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.3769999999999998e-06 2024-04-19T02:16:17.558 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.558 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.558 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:17.558 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.270429+0000", 2024-04-19T02:16:17.559 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.6740000000000003e-06 2024-04-19T02:16:17.559 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.559 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.559 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:17.559 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.275527+0000", 2024-04-19T02:16:17.559 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0050975869999999998 2024-04-19T02:16:17.559 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.559 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.559 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:17.559 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.275946+0000", 2024-04-19T02:16:17.559 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00041882699999999998 2024-04-19T02:16:17.559 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.559 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:29.286745+0000", 2024-04-19T02:16:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.010799477 2024-04-19T02:16:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:2290 5.5 5:a870a399:::benchmark_data_smithi121_44835_object2289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:16:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:55.645524+0000", 2024-04-19T02:16:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 21.899250053999999, 2024-04-19T02:16:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.018181836999999999, 2024-04-19T02:16:17.560 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:17.561 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:17.561 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:17.561 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:17.561 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:17.561 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 2290 2024-04-19T02:16:17.561 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.561 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:17.561 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.561 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:17.561 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645524+0000", 2024-04-19T02:16:17.561 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.561 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.561 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.561 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:17.561 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645524+0000", 2024-04-19T02:16:17.561 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.562 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.562 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.562 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:17.562 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645524+0000", 2024-04-19T02:16:17.562 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:17.562 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.562 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.562 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:17.562 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645603+0000", 2024-04-19T02:16:17.562 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.9983999999999999e-05 2024-04-19T02:16:17.562 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.562 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.562 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:17.562 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645609+0000", 2024-04-19T02:16:17.563 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.5500000000000002e-06 2024-04-19T02:16:17.563 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.563 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.563 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:17.563 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645613+0000", 2024-04-19T02:16:17.563 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.591e-06 2024-04-19T02:16:17.563 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.563 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.563 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:17.563 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645649+0000", 2024-04-19T02:16:17.563 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6769e-05 2024-04-19T02:16:17.563 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.563 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.563 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:17.563 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645765+0000", 2024-04-19T02:16:17.564 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00011593499999999999 2024-04-19T02:16:17.564 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.564 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.564 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:17.564 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645899+0000", 2024-04-19T02:16:17.564 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00013329499999999999 2024-04-19T02:16:17.564 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.564 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.564 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:17.564 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.649261+0000", 2024-04-19T02:16:17.564 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0033619639999999998 2024-04-19T02:16:17.564 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.564 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.564 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:17.564 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.663657+0000", 2024-04-19T02:16:17.565 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.014396137999999999 2024-04-19T02:16:17.565 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.565 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.565 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:17.565 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.663686+0000", 2024-04-19T02:16:17.565 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.8841999999999999e-05 2024-04-19T02:16:17.565 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.565 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.565 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:17.565 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.663706+0000", 2024-04-19T02:16:17.565 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.0108000000000001e-05 2024-04-19T02:16:17.566 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.566 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:17.566 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.566 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.566 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.566 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:2296 5.5 5:a5d39efa:::benchmark_data_smithi121_44835_object2295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:16:17.566 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:55.646720+0000", 2024-04-19T02:16:17.566 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 21.898054259999999, 2024-04-19T02:16:17.566 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.017072077000000001, 2024-04-19T02:16:17.566 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:17.566 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:17.567 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:17.567 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:17.567 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:17.567 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 2296 2024-04-19T02:16:17.567 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.567 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:17.567 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.567 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:17.567 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646720+0000", 2024-04-19T02:16:17.567 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.567 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.567 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.567 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:17.567 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646720+0000", 2024-04-19T02:16:17.568 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.568 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.568 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.568 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:17.568 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646719+0000", 2024-04-19T02:16:17.568 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:17.568 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.568 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.568 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:17.568 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646778+0000", 2024-04-19T02:16:17.568 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.9264e-05 2024-04-19T02:16:17.568 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.568 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.569 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:17.569 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646792+0000", 2024-04-19T02:16:17.569 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.3573e-05 2024-04-19T02:16:17.569 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.569 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.569 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:17.569 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646797+0000", 2024-04-19T02:16:17.569 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.3190000000000002e-06 2024-04-19T02:16:17.569 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.569 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.569 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:17.569 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646826+0000", 2024-04-19T02:16:17.569 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.8787999999999999e-05 2024-04-19T02:16:17.569 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.570 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.570 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:17.570 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646913+0000", 2024-04-19T02:16:17.570 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.7601000000000004e-05 2024-04-19T02:16:17.570 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.570 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.570 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:17.570 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646996+0000", 2024-04-19T02:16:17.571 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.2237000000000006e-05 2024-04-19T02:16:17.571 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.571 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.571 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:17.571 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.649533+0000", 2024-04-19T02:16:17.571 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.002537564 2024-04-19T02:16:17.571 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.571 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.571 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:17.571 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.663741+0000", 2024-04-19T02:16:17.571 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.014207322 2024-04-19T02:16:17.571 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.571 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.571 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:17.572 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.663771+0000", 2024-04-19T02:16:17.572 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.0324e-05 2024-04-19T02:16:17.572 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.572 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.572 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:17.572 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.663792+0000", 2024-04-19T02:16:17.572 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.0778999999999999e-05 2024-04-19T02:16:17.572 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.572 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:17.573 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.573 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.573 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.573 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:16497 5.c 5:3cb287d4:::benchmark_data_smithi121_44835_object16496:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:17.573 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:59.873454+0000", 2024-04-19T02:16:17.573 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 17.671320310999999, 2024-04-19T02:16:17.573 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.017103489999999999, 2024-04-19T02:16:17.573 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:17.573 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:17.573 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:17.573 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:17.573 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:17.574 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 16497 2024-04-19T02:16:17.574 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.574 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:17.574 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.574 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:17.574 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873454+0000", 2024-04-19T02:16:17.574 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.574 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.574 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.574 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:17.574 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873454+0000", 2024-04-19T02:16:17.575 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.575 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.575 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.575 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:17.575 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873453+0000", 2024-04-19T02:16:17.575 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:17.575 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.575 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.575 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:17.575 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873512+0000", 2024-04-19T02:16:17.575 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.8730999999999997e-05 2024-04-19T02:16:17.576 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.576 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.576 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:17.576 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873518+0000", 2024-04-19T02:16:17.576 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.9789999999999998e-06 2024-04-19T02:16:17.576 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.576 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.576 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:17.576 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873522+0000", 2024-04-19T02:16:17.576 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.0570000000000003e-06 2024-04-19T02:16:17.577 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.577 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.577 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:17.577 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873590+0000", 2024-04-19T02:16:17.577 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.8504999999999995e-05 2024-04-19T02:16:17.577 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.578 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.578 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:17.578 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873709+0000", 2024-04-19T02:16:17.579 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000118497 2024-04-19T02:16:17.579 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.580 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.580 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:17.580 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873881+0000", 2024-04-19T02:16:17.580 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000172129 2024-04-19T02:16:17.580 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.580 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.580 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:17.580 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.874627+0000", 2024-04-19T02:16:17.580 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00074580100000000004 2024-04-19T02:16:17.580 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.580 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.580 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:17.580 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.890478+0000", 2024-04-19T02:16:17.580 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015850672 2024-04-19T02:16:17.580 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.890522+0000", 2024-04-19T02:16:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.4376000000000003e-05 2024-04-19T02:16:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.890557+0000", 2024-04-19T02:16:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.5151999999999998e-05 2024-04-19T02:16:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:17.581 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.582 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.582 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.582 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:42714 5.c 5:32899b28:::benchmark_data_smithi121_44835_object42713:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:17.582 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:09.266429+0000", 2024-04-19T02:16:17.582 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 8.2783453040000001, 2024-04-19T02:16:17.582 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.017445751999999998, 2024-04-19T02:16:17.582 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:17.582 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:17.582 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:17.583 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:17.583 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:17.583 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 42714 2024-04-19T02:16:17.583 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.584 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:17.584 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.584 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:17.584 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.266429+0000", 2024-04-19T02:16:17.584 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.584 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.584 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.584 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:17.585 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.266429+0000", 2024-04-19T02:16:17.585 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.585 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.585 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.585 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:17.585 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.266428+0000", 2024-04-19T02:16:17.585 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:17.585 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.585 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.585 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:17.585 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.266523+0000", 2024-04-19T02:16:17.585 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.4913000000000004e-05 2024-04-19T02:16:17.585 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.585 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.586 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:17.586 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.266535+0000", 2024-04-19T02:16:17.586 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.2187e-05 2024-04-19T02:16:17.586 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.586 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.586 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:17.586 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.266542+0000", 2024-04-19T02:16:17.586 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.7139999999999993e-06 2024-04-19T02:16:17.586 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.586 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.586 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:17.586 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.267446+0000", 2024-04-19T02:16:17.586 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00090385699999999999 2024-04-19T02:16:17.587 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.587 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.587 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:17.587 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.267570+0000", 2024-04-19T02:16:17.587 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012405599999999999 2024-04-19T02:16:17.587 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.587 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.587 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:17.587 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.267733+0000", 2024-04-19T02:16:17.587 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000162225 2024-04-19T02:16:17.587 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.587 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.587 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:17.587 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.275131+0000", 2024-04-19T02:16:17.588 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0073988639999999998 2024-04-19T02:16:17.588 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.588 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.588 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:17.588 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.283761+0000", 2024-04-19T02:16:17.588 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0086299989999999993 2024-04-19T02:16:17.588 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.588 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.588 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:17.588 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.283824+0000", 2024-04-19T02:16:17.588 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.2632000000000006e-05 2024-04-19T02:16:17.588 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.588 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.588 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:17.589 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.283874+0000", 2024-04-19T02:16:17.589 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.0290999999999997e-05 2024-04-19T02:16:17.589 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.589 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:17.589 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.589 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.589 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.589 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:42724 5.0 e23/16 5:0d0b7b99:::benchmark_data_smithi121_44835_object42723:head v 23'2565, mlcod=23'2563)", 2024-04-19T02:16:17.589 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:09.271090+0000", 2024-04-19T02:16:17.589 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 8.2736839710000005, 2024-04-19T02:16:17.589 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016714757, 2024-04-19T02:16:17.590 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:17.590 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:17.590 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:17.590 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.590 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:17.590 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.271090+0000", 2024-04-19T02:16:17.590 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.590 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.590 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.590 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:17.590 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.271090+0000", 2024-04-19T02:16:17.590 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.590 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.591 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.591 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:17.591 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.271090+0000", 2024-04-19T02:16:17.591 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:17.591 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.591 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.591 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:17.591 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.271139+0000", 2024-04-19T02:16:17.591 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.9614999999999998e-05 2024-04-19T02:16:17.591 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.591 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.591 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:17.591 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.271147+0000", 2024-04-19T02:16:17.592 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.6960000000000005e-06 2024-04-19T02:16:17.592 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.592 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.592 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:17.592 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.271151+0000", 2024-04-19T02:16:17.592 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.3030000000000001e-06 2024-04-19T02:16:17.592 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.592 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.592 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:17.592 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.271179+0000", 2024-04-19T02:16:17.592 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.7971e-05 2024-04-19T02:16:17.592 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.592 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.593 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:17.593 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.271194+0000", 2024-04-19T02:16:17.593 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.4406999999999999e-05 2024-04-19T02:16:17.593 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.593 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.593 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:17.593 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.287772+0000", 2024-04-19T02:16:17.593 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016578275 2024-04-19T02:16:17.593 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.593 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.593 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:17.593 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.287805+0000", 2024-04-19T02:16:17.593 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.2914999999999999e-05 2024-04-19T02:16:17.593 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.594 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:17.594 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.594 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.594 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.594 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:43121 5.5 5:abed14ce:::benchmark_data_smithi121_44835_object43120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:17.594 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:09.429697+0000", 2024-04-19T02:16:17.594 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 8.1150766220000001, 2024-04-19T02:16:17.594 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.017381669999999998, 2024-04-19T02:16:17.594 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:17.594 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:17.594 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:17.594 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:17.595 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:17.595 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 43121 2024-04-19T02:16:17.595 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.595 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:17.595 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.595 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:17.595 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.429697+0000", 2024-04-19T02:16:17.595 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.595 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.595 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.595 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:17.595 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.429697+0000", 2024-04-19T02:16:17.595 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.596 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.596 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.596 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:17.596 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.429697+0000", 2024-04-19T02:16:17.596 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:17.596 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.596 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.596 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:17.596 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.429798+0000", 2024-04-19T02:16:17.596 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000101228 2024-04-19T02:16:17.596 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.596 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.596 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:17.596 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.429808+0000", 2024-04-19T02:16:17.596 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.9080000000000007e-06 2024-04-19T02:16:17.596 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.597 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.597 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:17.597 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.429814+0000", 2024-04-19T02:16:17.597 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.7580000000000003e-06 2024-04-19T02:16:17.597 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.597 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.597 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:17.597 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.431378+0000", 2024-04-19T02:16:17.597 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0015631919999999999 2024-04-19T02:16:17.597 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.597 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.598 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:17.598 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.431471+0000", 2024-04-19T02:16:17.598 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.3595000000000001e-05 2024-04-19T02:16:17.598 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.598 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.598 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:17.598 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.431591+0000", 2024-04-19T02:16:17.598 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000119485 2024-04-19T02:16:17.598 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.598 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.598 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:17.598 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.435643+0000", 2024-04-19T02:16:17.598 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0040522500000000003 2024-04-19T02:16:17.598 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.599 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.599 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:17.599 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.447020+0000", 2024-04-19T02:16:17.599 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.011377152 2024-04-19T02:16:17.599 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.599 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.599 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:17.599 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.447054+0000", 2024-04-19T02:16:17.599 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.3558e-05 2024-04-19T02:16:17.599 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.599 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.599 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:17.599 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.447079+0000", 2024-04-19T02:16:17.600 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.5293999999999999e-05 2024-04-19T02:16:17.600 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.600 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:17.600 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.600 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.600 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.600 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:43692 5.3 5:c384a549:::benchmark_data_smithi121_44835_object43691:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:17.600 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:09.660580+0000", 2024-04-19T02:16:17.600 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 7.8841936830000003, 2024-04-19T02:16:17.600 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.017860674999999999, 2024-04-19T02:16:17.600 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:17.600 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:17.600 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:17.600 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 43692 2024-04-19T02:16:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.660580+0000", 2024-04-19T02:16:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.660580+0000", 2024-04-19T02:16:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.601 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.602 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.602 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:17.602 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.660580+0000", 2024-04-19T02:16:17.602 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:17.602 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.602 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.602 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:17.602 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.660665+0000", 2024-04-19T02:16:17.602 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.5135000000000004e-05 2024-04-19T02:16:17.602 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.602 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.602 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:17.603 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.660677+0000", 2024-04-19T02:16:17.603 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.2743e-05 2024-04-19T02:16:17.603 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.603 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.603 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:17.603 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.660684+0000", 2024-04-19T02:16:17.603 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.8040000000000004e-06 2024-04-19T02:16:17.603 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.603 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.603 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:17.603 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.665455+0000", 2024-04-19T02:16:17.603 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0047704419999999997 2024-04-19T02:16:17.603 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.603 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.604 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:17.604 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.665546+0000", 2024-04-19T02:16:17.604 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.1330999999999997e-05 2024-04-19T02:16:17.604 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.604 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.604 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:17.604 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.665632+0000", 2024-04-19T02:16:17.604 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.5995999999999995e-05 2024-04-19T02:16:17.604 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.604 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.604 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:17.604 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.670521+0000", 2024-04-19T02:16:17.604 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0048892299999999996 2024-04-19T02:16:17.605 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.605 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.605 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:17.605 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.678370+0000", 2024-04-19T02:16:17.605 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0078485880000000001 2024-04-19T02:16:17.605 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.605 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.605 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:17.605 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.678409+0000", 2024-04-19T02:16:17.605 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.9511000000000002e-05 2024-04-19T02:16:17.605 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.605 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.605 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:17.605 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.678441+0000", 2024-04-19T02:16:17.606 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.1615999999999997e-05 2024-04-19T02:16:17.606 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.606 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:17.606 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.606 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.606 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.606 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:52498 5.3 5:cd91eeff:::benchmark_data_smithi121_44835_object52497:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T02:16:17.606 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:13.338526+0000", 2024-04-19T02:16:17.606 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4.206248005, 2024-04-19T02:16:17.606 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016659635999999999, 2024-04-19T02:16:17.606 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:17.606 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:17.606 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:17.607 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:17.607 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:17.607 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 52498 2024-04-19T02:16:17.607 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.607 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:17.607 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.607 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:17.607 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:13.338526+0000", 2024-04-19T02:16:17.607 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.607 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.607 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.607 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:17.607 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:13.338526+0000", 2024-04-19T02:16:17.608 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.608 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.608 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.608 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:17.608 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:13.338525+0000", 2024-04-19T02:16:17.608 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:17.608 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.608 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.608 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:17.608 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:13.338581+0000", 2024-04-19T02:16:17.608 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.5986999999999998e-05 2024-04-19T02:16:17.608 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.608 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.608 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:17.609 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:13.338590+0000", 2024-04-19T02:16:17.609 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.3950000000000001e-06 2024-04-19T02:16:17.609 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.609 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.609 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:17.609 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:13.338595+0000", 2024-04-19T02:16:17.609 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.0080000000000002e-06 2024-04-19T02:16:17.609 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.609 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.609 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:17.609 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:13.341530+0000", 2024-04-19T02:16:17.609 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0029350729999999998 2024-04-19T02:16:17.609 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.610 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.610 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:17.610 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:13.341693+0000", 2024-04-19T02:16:17.610 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000163005 2024-04-19T02:16:17.610 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.610 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.610 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:17.610 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:13.341862+0000", 2024-04-19T02:16:17.610 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00016903600000000001 2024-04-19T02:16:17.610 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.610 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.610 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:17.610 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:13.346110+0000", 2024-04-19T02:16:17.611 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0042477089999999997 2024-04-19T02:16:17.611 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.611 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.611 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:17.611 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:13.355104+0000", 2024-04-19T02:16:17.611 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0089941959999999994 2024-04-19T02:16:17.611 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.611 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.611 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:17.611 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:13.355149+0000", 2024-04-19T02:16:17.611 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.5726999999999998e-05 2024-04-19T02:16:17.611 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.611 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.611 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:17.612 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:13.355186+0000", 2024-04-19T02:16:17.612 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6059999999999997e-05 2024-04-19T02:16:17.612 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.612 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:17.612 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.612 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.612 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.612 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:55865 5.6 5:603e2f36:::benchmark_data_smithi121_44835_object55864:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T02:16:17.612 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:14.753712+0000", 2024-04-19T02:16:17.612 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 2.7910623370000001, 2024-04-19T02:16:17.612 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016335288999999999, 2024-04-19T02:16:17.612 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:17.612 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:17.612 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:17.613 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:17.613 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:17.613 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 55865 2024-04-19T02:16:17.613 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.613 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:17.613 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.613 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:17.613 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:14.753712+0000", 2024-04-19T02:16:17.613 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.613 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.613 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.613 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:17.613 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:14.753712+0000", 2024-04-19T02:16:17.614 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.614 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.614 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.614 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:17.614 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:14.753711+0000", 2024-04-19T02:16:17.614 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:17.614 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.614 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.614 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:17.614 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:14.753774+0000", 2024-04-19T02:16:17.614 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.2996999999999993e-05 2024-04-19T02:16:17.614 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.614 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.614 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:17.615 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:14.753779+0000", 2024-04-19T02:16:17.615 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.6410000000000001e-06 2024-04-19T02:16:17.615 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.615 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.615 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:17.615 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:14.753782+0000", 2024-04-19T02:16:17.615 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.614e-06 2024-04-19T02:16:17.615 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.615 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.615 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:17.615 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:14.753821+0000", 2024-04-19T02:16:17.615 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.8050999999999999e-05 2024-04-19T02:16:17.615 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.615 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.616 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:17.616 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:14.753946+0000", 2024-04-19T02:16:17.616 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012568200000000001 2024-04-19T02:16:17.616 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.616 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.616 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:17.616 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:14.754069+0000", 2024-04-19T02:16:17.616 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012273899999999999 2024-04-19T02:16:17.616 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.616 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.616 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:17.616 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:14.763983+0000", 2024-04-19T02:16:17.616 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0099140540000000003 2024-04-19T02:16:17.616 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.617 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.617 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:17.617 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:14.769991+0000", 2024-04-19T02:16:17.617 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.006007999 2024-04-19T02:16:17.617 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.617 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.617 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:17.617 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:14.770025+0000", 2024-04-19T02:16:17.617 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.3963e-05 2024-04-19T02:16:17.617 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.617 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.617 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:17.617 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:14.770047+0000", 2024-04-19T02:16:17.617 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.1911000000000001e-05 2024-04-19T02:16:17.618 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.618 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:17.618 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.618 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.618 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.618 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:60906 5.c 5:3e19a5a3:::benchmark_data_smithi121_44835_object60905:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:17.618 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:17.043489+0000", 2024-04-19T02:16:17.618 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.50128510599999998, 2024-04-19T02:16:17.618 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.017397276999999999, 2024-04-19T02:16:17.618 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:17.618 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:17.618 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:17.619 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:17.619 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:17.619 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 60906 2024-04-19T02:16:17.619 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.619 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:17.619 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.619 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:17.619 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.043489+0000", 2024-04-19T02:16:17.619 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.619 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.619 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.619 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:17.619 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.043489+0000", 2024-04-19T02:16:17.619 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.619 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.619 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.620 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:17.620 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.043488+0000", 2024-04-19T02:16:17.620 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:17.620 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.620 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.620 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:17.620 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.043565+0000", 2024-04-19T02:16:17.620 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.7255999999999994e-05 2024-04-19T02:16:17.620 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.620 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.620 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:17.620 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.043574+0000", 2024-04-19T02:16:17.620 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.8640000000000002e-06 2024-04-19T02:16:17.620 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.620 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.621 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:17.621 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.043581+0000", 2024-04-19T02:16:17.621 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.374e-06 2024-04-19T02:16:17.621 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.621 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.621 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:17.621 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.052963+0000", 2024-04-19T02:16:17.621 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.009381113 2024-04-19T02:16:17.621 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.621 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.621 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:17.621 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.053086+0000", 2024-04-19T02:16:17.621 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012339600000000001 2024-04-19T02:16:17.621 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.053212+0000", 2024-04-19T02:16:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012636200000000001 2024-04-19T02:16:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.055950+0000", 2024-04-19T02:16:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0027377270000000001 2024-04-19T02:16:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:17.622 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.060804+0000", 2024-04-19T02:16:17.623 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0048543049999999997 2024-04-19T02:16:17.623 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.623 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.623 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:17.623 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.060858+0000", 2024-04-19T02:16:17.623 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.3161000000000001e-05 2024-04-19T02:16:17.623 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.623 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.623 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:17.623 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.060886+0000", 2024-04-19T02:16:17.623 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.8518e-05 2024-04-19T02:16:17.623 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.623 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:17.623 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.623 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.624 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.624 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:61256 5.c 5:3efbc762:::benchmark_data_smithi121_44835_object61255:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:17.624 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:17.204293+0000", 2024-04-19T02:16:17.624 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.340480483, 2024-04-19T02:16:17.624 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016495042000000001, 2024-04-19T02:16:17.624 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:17.624 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:17.624 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:17.624 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:17.624 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:17.624 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 61256 2024-04-19T02:16:17.624 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.624 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:17.624 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.625 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:17.625 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.204293+0000", 2024-04-19T02:16:17.625 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.625 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.625 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.625 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:17.625 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.204293+0000", 2024-04-19T02:16:17.625 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.625 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.625 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.625 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:17.625 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.204293+0000", 2024-04-19T02:16:17.625 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:17.625 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.625 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.626 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:17.626 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.204320+0000", 2024-04-19T02:16:17.626 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.7413999999999999e-05 2024-04-19T02:16:17.626 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.626 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.626 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:17.626 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.204328+0000", 2024-04-19T02:16:17.626 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.9640000000000003e-06 2024-04-19T02:16:17.627 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.627 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.627 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:17.627 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.204334+0000", 2024-04-19T02:16:17.627 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.4659999999999998e-06 2024-04-19T02:16:17.627 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.627 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.627 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:17.627 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.204850+0000", 2024-04-19T02:16:17.627 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00051670799999999995 2024-04-19T02:16:17.627 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.627 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.627 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:17.627 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.204993+0000", 2024-04-19T02:16:17.628 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000142788 2024-04-19T02:16:17.628 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.628 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.628 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:17.628 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.205134+0000", 2024-04-19T02:16:17.628 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00014047699999999999 2024-04-19T02:16:17.628 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.628 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.628 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:17.628 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.212603+0000", 2024-04-19T02:16:17.628 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0074690420000000004 2024-04-19T02:16:17.628 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.628 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.628 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:17.629 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.220699+0000", 2024-04-19T02:16:17.629 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0080966430000000006 2024-04-19T02:16:17.629 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.629 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.629 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:17.629 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.220731+0000", 2024-04-19T02:16:17.629 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.1677000000000002e-05 2024-04-19T02:16:17.629 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.629 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.629 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:17.629 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.220788+0000", 2024-04-19T02:16:17.629 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.7351e-05 2024-04-19T02:16:17.629 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.630 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:17.630 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.630 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.630 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.630 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:61625 5.6 5:678616b4:::benchmark_data_smithi121_44835_object61624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:17.630 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:17.383317+0000", 2024-04-19T02:16:17.630 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.16145701400000001, 2024-04-19T02:16:17.630 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016750592000000002, 2024-04-19T02:16:17.630 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:17.630 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:17.630 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:17.630 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:17.630 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:17.631 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 61625 2024-04-19T02:16:17.631 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.631 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:17.631 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.631 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:17.631 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.383317+0000", 2024-04-19T02:16:17.631 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.631 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.631 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.631 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:17.631 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.383317+0000", 2024-04-19T02:16:17.631 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.631 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.632 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.632 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:17.632 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.383316+0000", 2024-04-19T02:16:17.632 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:17.632 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.632 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.632 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:17.632 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.383372+0000", 2024-04-19T02:16:17.632 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.5627999999999997e-05 2024-04-19T02:16:17.632 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.632 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.632 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:17.632 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.383383+0000", 2024-04-19T02:16:17.633 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0647e-05 2024-04-19T02:16:17.633 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.633 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.633 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:17.633 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.383390+0000", 2024-04-19T02:16:17.633 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.9349999999999997e-06 2024-04-19T02:16:17.633 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.633 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.633 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:17.633 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.385707+0000", 2024-04-19T02:16:17.633 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0023169839999999998 2024-04-19T02:16:17.633 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.633 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.633 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:17.633 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.385838+0000", 2024-04-19T02:16:17.634 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00013168899999999999 2024-04-19T02:16:17.634 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.634 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.634 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:17.634 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.385987+0000", 2024-04-19T02:16:17.634 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000149083 2024-04-19T02:16:17.634 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.634 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.634 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:17.634 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.391405+0000", 2024-04-19T02:16:17.634 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0054181239999999999 2024-04-19T02:16:17.634 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.634 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.634 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:17.635 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.399987+0000", 2024-04-19T02:16:17.635 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0085818230000000006 2024-04-19T02:16:17.635 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.635 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.635 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:17.635 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.400032+0000", 2024-04-19T02:16:17.635 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.4551000000000001e-05 2024-04-19T02:16:17.635 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.635 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.635 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:17.635 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.400067+0000", 2024-04-19T02:16:17.635 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.5698999999999998e-05 2024-04-19T02:16:17.635 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.635 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:17.636 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.636 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.636 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.636 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:61670 5.3 5:c5549fc1:::benchmark_data_smithi121_44835_object61669:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:17.636 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:17.409188+0000", 2024-04-19T02:16:17.636 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.135585705, 2024-04-19T02:16:17.636 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.01869871, 2024-04-19T02:16:17.636 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:17.636 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:17.636 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:17.636 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:17.636 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:17.636 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 61670 2024-04-19T02:16:17.636 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.637 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:17.637 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.637 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:17.637 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409188+0000", 2024-04-19T02:16:17.637 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.637 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.637 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.637 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:17.637 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409188+0000", 2024-04-19T02:16:17.637 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.637 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.637 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.637 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:17.637 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409188+0000", 2024-04-19T02:16:17.637 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:17.637 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.638 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.638 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:17.638 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409220+0000", 2024-04-19T02:16:17.638 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.2746999999999997e-05 2024-04-19T02:16:17.638 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.638 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.638 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:17.638 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409232+0000", 2024-04-19T02:16:17.638 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.1430999999999999e-05 2024-04-19T02:16:17.638 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.638 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.638 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:17.638 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409238+0000", 2024-04-19T02:16:17.639 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.4160000000000001e-06 2024-04-19T02:16:17.639 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.639 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.639 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:17.639 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.414159+0000", 2024-04-19T02:16:17.639 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0049206850000000002 2024-04-19T02:16:17.639 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.639 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.639 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:17.639 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.414283+0000", 2024-04-19T02:16:17.639 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000124547 2024-04-19T02:16:17.639 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.639 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.639 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:17.640 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.414439+0000", 2024-04-19T02:16:17.640 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00015586699999999999 2024-04-19T02:16:17.640 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.640 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.640 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:17.640 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.421153+0000", 2024-04-19T02:16:17.640 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0067135229999999999 2024-04-19T02:16:17.640 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.640 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.640 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:17.640 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.427775+0000", 2024-04-19T02:16:17.640 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0066216640000000002 2024-04-19T02:16:17.640 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.640 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.640 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:17.641 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.427847+0000", 2024-04-19T02:16:17.641 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.2601000000000005e-05 2024-04-19T02:16:17.641 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.641 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.641 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:17.641 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.427887+0000", 2024-04-19T02:16:17.641 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.9789000000000001e-05 2024-04-19T02:16:17.641 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.641 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:17.641 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.641 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.641 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.641 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:61671 5.3 5:cab602a2:::benchmark_data_smithi121_44835_object61670:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:17.641 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:17.409258+0000", 2024-04-19T02:16:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.135516317, 2024-04-19T02:16:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.01870983, 2024-04-19T02:16:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 61671 2024-04-19T02:16:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:17.642 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409258+0000", 2024-04-19T02:16:17.643 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.643 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.643 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.643 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:17.643 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409258+0000", 2024-04-19T02:16:17.643 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.643 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.643 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.643 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:17.643 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409257+0000", 2024-04-19T02:16:17.643 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:17.643 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.643 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.643 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:17.644 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409353+0000", 2024-04-19T02:16:17.644 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.6365000000000003e-05 2024-04-19T02:16:17.644 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.644 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.644 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:17.644 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409362+0000", 2024-04-19T02:16:17.644 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.4500000000000004e-06 2024-04-19T02:16:17.644 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.644 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.644 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:17.644 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409382+0000", 2024-04-19T02:16:17.644 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.9707e-05 2024-04-19T02:16:17.644 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.644 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.645 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:17.645 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.416070+0000", 2024-04-19T02:16:17.645 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0066881889999999998 2024-04-19T02:16:17.645 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.645 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.645 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:17.645 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.416176+0000", 2024-04-19T02:16:17.645 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00010598 2024-04-19T02:16:17.645 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.645 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.645 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:17.645 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.416271+0000", 2024-04-19T02:16:17.645 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.4846999999999995e-05 2024-04-19T02:16:17.645 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.645 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.645 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:17.646 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.421187+0000", 2024-04-19T02:16:17.646 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0049165210000000001 2024-04-19T02:16:17.646 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.646 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.646 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:17.646 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.427894+0000", 2024-04-19T02:16:17.646 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.006706844 2024-04-19T02:16:17.646 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.646 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.646 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:17.646 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.427939+0000", 2024-04-19T02:16:17.646 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.4676999999999999e-05 2024-04-19T02:16:17.646 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.646 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.647 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:17.647 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.427967+0000", 2024-04-19T02:16:17.647 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.8770999999999999e-05 2024-04-19T02:16:17.647 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.647 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:17.647 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.647 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.647 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.647 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:61686 5.3 5:c9b3b45c:::benchmark_data_smithi121_44835_object61685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:17.647 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:17.415600+0000", 2024-04-19T02:16:17.647 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.12917363800000001, 2024-04-19T02:16:17.647 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.017118667000000001, 2024-04-19T02:16:17.648 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:17.648 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:17.648 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:17.648 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:17.648 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:17.648 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 61686 2024-04-19T02:16:17.648 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.648 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:17.648 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.648 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:17.648 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.415600+0000", 2024-04-19T02:16:17.648 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.648 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.648 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.648 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:17.648 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.415600+0000", 2024-04-19T02:16:17.649 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.649 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.649 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.649 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:17.649 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.415600+0000", 2024-04-19T02:16:17.649 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:17.649 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.649 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.649 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:17.649 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.415640+0000", 2024-04-19T02:16:17.649 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.0173999999999999e-05 2024-04-19T02:16:17.649 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.649 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.649 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:17.650 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.415648+0000", 2024-04-19T02:16:17.650 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.1650000000000006e-06 2024-04-19T02:16:17.650 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.650 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.650 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:17.650 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.415654+0000", 2024-04-19T02:16:17.650 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.5990000000000001e-06 2024-04-19T02:16:17.650 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.650 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.650 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:17.650 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.423743+0000", 2024-04-19T02:16:17.650 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0080896860000000004 2024-04-19T02:16:17.650 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.651 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.651 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:17.651 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.423861+0000", 2024-04-19T02:16:17.651 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000117761 2024-04-19T02:16:17.651 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.651 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.651 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:17.651 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.423994+0000", 2024-04-19T02:16:17.651 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000133079 2024-04-19T02:16:17.651 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.651 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.651 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:17.651 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.425869+0000", 2024-04-19T02:16:17.651 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.001875215 2024-04-19T02:16:17.651 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.651 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.652 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:17.652 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.432580+0000", 2024-04-19T02:16:17.652 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0067104010000000004 2024-04-19T02:16:17.652 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.652 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.652 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:17.652 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.432636+0000", 2024-04-19T02:16:17.652 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.6026999999999997e-05 2024-04-19T02:16:17.652 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.652 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.652 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:17.652 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.432719+0000", 2024-04-19T02:16:17.652 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.3049999999999999e-05 2024-04-19T02:16:17.652 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.653 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:17.653 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.653 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.653 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.653 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:61815 5.c 5:3ca8a794:::benchmark_data_smithi121_44835_object61814:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:17.653 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:17.482110+0000", 2024-04-19T02:16:17.653 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.062663791999999996, 2024-04-19T02:16:17.653 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.021577559999999999, 2024-04-19T02:16:17.653 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:17.653 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:17.653 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:17.653 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:17.653 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:17.653 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 61815 2024-04-19T02:16:17.653 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.653 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:17.654 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.654 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:17.654 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482110+0000", 2024-04-19T02:16:17.654 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.654 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.654 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.654 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:17.654 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482110+0000", 2024-04-19T02:16:17.654 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.654 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.654 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.654 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:17.654 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482109+0000", 2024-04-19T02:16:17.654 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:17.654 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.655 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.655 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:17.655 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482197+0000", 2024-04-19T02:16:17.655 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.7405999999999996e-05 2024-04-19T02:16:17.655 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.655 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.655 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:17.655 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482206+0000", 2024-04-19T02:16:17.655 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.0010000000000007e-06 2024-04-19T02:16:17.655 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.655 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.655 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:17.655 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482211+0000", 2024-04-19T02:16:17.655 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.4569999999999996e-06 2024-04-19T02:16:17.656 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.656 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.656 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:17.656 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.489465+0000", 2024-04-19T02:16:17.656 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.007253776 2024-04-19T02:16:17.656 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.656 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.656 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:17.656 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.489582+0000", 2024-04-19T02:16:17.656 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00011669500000000001 2024-04-19T02:16:17.656 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.656 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.656 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:17.656 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.489684+0000", 2024-04-19T02:16:17.656 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000102533 2024-04-19T02:16:17.656 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.656 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.657 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:17.657 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.491836+0000", 2024-04-19T02:16:17.657 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0021516759999999999 2024-04-19T02:16:17.657 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.657 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.657 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:17.657 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503615+0000", 2024-04-19T02:16:17.657 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.011778906 2024-04-19T02:16:17.657 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.657 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.657 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:17.657 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503652+0000", 2024-04-19T02:16:17.657 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6622999999999998e-05 2024-04-19T02:16:17.658 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.658 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.658 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:17.658 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503688+0000", 2024-04-19T02:16:17.658 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6127000000000002e-05 2024-04-19T02:16:17.658 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.658 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:17.658 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.658 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.658 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.658 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:61821 5.c 5:3f8142ef:::benchmark_data_smithi121_44835_object61820:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:17.658 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:17.484515+0000", 2024-04-19T02:16:17.658 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.060258957000000002, 2024-04-19T02:16:17.658 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.019268073, 2024-04-19T02:16:17.658 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:17.659 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:17.659 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:17.659 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:17.659 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:17.659 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 61821 2024-04-19T02:16:17.659 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.659 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:17.659 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.659 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:17.659 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.484515+0000", 2024-04-19T02:16:17.659 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.659 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.659 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.659 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:17.659 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.484515+0000", 2024-04-19T02:16:17.660 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:17.660 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.660 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.660 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:17.660 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.484514+0000", 2024-04-19T02:16:17.660 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:17.660 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.660 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.660 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:17.660 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.484612+0000", 2024-04-19T02:16:17.660 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.7962999999999997e-05 2024-04-19T02:16:17.660 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.660 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.660 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:17.661 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.484623+0000", 2024-04-19T02:16:17.661 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.1229999999999999e-05 2024-04-19T02:16:17.661 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.661 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.661 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:17.661 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.484629+0000", 2024-04-19T02:16:17.661 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.9549999999999997e-06 2024-04-19T02:16:17.661 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.661 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.661 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:17.661 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.491863+0000", 2024-04-19T02:16:17.661 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.007234178 2024-04-19T02:16:17.661 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.661 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.662 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:17.662 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.491976+0000", 2024-04-19T02:16:17.662 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000112613 2024-04-19T02:16:17.662 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.662 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.662 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:17.662 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.492073+0000", 2024-04-19T02:16:17.662 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.6961999999999998e-05 2024-04-19T02:16:17.662 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.662 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.662 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:17.662 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.496898+0000", 2024-04-19T02:16:17.662 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0048245299999999996 2024-04-19T02:16:17.662 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503695+0000", 2024-04-19T02:16:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0067978129999999998 2024-04-19T02:16:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503748+0000", 2024-04-19T02:16:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.2247000000000003e-05 2024-04-19T02:16:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503783+0000", 2024-04-19T02:16:17.663 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.5389999999999998e-05 2024-04-19T02:16:17.664 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.664 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:17.664 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.664 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:17.664 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:17.664 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-04-19T02:16:17.665 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:17.666+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:17.666 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:16:17.766 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:17.767+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:17.842 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:16:17.842 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:16:17.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.842 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4549.0:62571 5.6 e26/16 5:603b36c4:::benchmark_data_smithi121_44835_object62570:head v 26'3951, mlcod=26'3949)", 2024-04-19T02:16:17.842 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:17.841483+0000", 2024-04-19T02:16:17.843 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00039742500000000002, 2024-04-19T02:16:17.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00042129800000000002, 2024-04-19T02:16:17.843 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:17.843 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:16:17.843 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:17.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.843 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:17.843 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.841483+0000", 2024-04-19T02:16:17.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:17.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.843 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:17.843 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.841483+0000", 2024-04-19T02:16:17.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:17.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:17.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.841482+0000", 2024-04-19T02:16:17.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:17.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:17.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.841542+0000", 2024-04-19T02:16:17.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9642000000000003e-05 2024-04-19T02:16:17.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:17.845 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.841553+0000", 2024-04-19T02:16:17.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.077e-05 2024-04-19T02:16:17.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.845 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:17.845 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.841560+0000", 2024-04-19T02:16:17.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0999999999999998e-06 2024-04-19T02:16:17.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.845 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:17.845 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.841603+0000", 2024-04-19T02:16:17.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3006000000000001e-05 2024-04-19T02:16:17.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.846 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:17.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.841617+0000", 2024-04-19T02:16:17.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.466e-05 2024-04-19T02:16:17.846 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:17.846 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:17.846 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:17.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.846 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4549.0:62573 5.1 e26/16)", 2024-04-19T02:16:17.846 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:17.841801+0000", 2024-04-19T02:16:17.846 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 7.9405000000000003e-05, 2024-04-19T02:16:17.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000165086, 2024-04-19T02:16:17.846 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:17.846 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-04-19T02:16:17.846 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:17.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:17.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.841801+0000", 2024-04-19T02:16:17.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:17.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:17.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.841801+0000", 2024-04-19T02:16:17.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:17.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:17.848 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.841800+0000", 2024-04-19T02:16:17.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:17.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:17.848 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.841805+0000", 2024-04-19T02:16:17.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3880000000000002e-06 2024-04-19T02:16:17.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:17.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.841815+0000", 2024-04-19T02:16:17.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9010000000000006e-06 2024-04-19T02:16:17.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.849 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:17.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.841820+0000", 2024-04-19T02:16:17.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5910000000000003e-06 2024-04-19T02:16:17.849 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:17.849 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:17.849 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:17.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.849 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4549.0:62556 5.5 e26/16 5:a64b81e3:::benchmark_data_smithi121_44835_object62555:head v 26'3913, mlcod=26'3909)", 2024-04-19T02:16:17.849 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:17.829837+0000", 2024-04-19T02:16:17.850 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.012043004, 2024-04-19T02:16:17.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012177284999999999, 2024-04-19T02:16:17.850 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:17.850 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:16:17.850 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:17.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.850 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:17.850 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.829837+0000", 2024-04-19T02:16:17.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:17.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.850 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:17.850 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.829837+0000", 2024-04-19T02:16:17.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:17.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:17.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.829836+0000", 2024-04-19T02:16:17.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:17.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:17.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.829898+0000", 2024-04-19T02:16:17.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1890999999999994e-05 2024-04-19T02:16:17.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:17.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.829910+0000", 2024-04-19T02:16:17.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1181e-05 2024-04-19T02:16:17.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.852 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:17.852 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.829915+0000", 2024-04-19T02:16:17.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6860000000000003e-06 2024-04-19T02:16:17.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.852 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:17.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.832577+0000", 2024-04-19T02:16:17.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026618319999999998 2024-04-19T02:16:17.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:17.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.832599+0000", 2024-04-19T02:16:17.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1517000000000001e-05 2024-04-19T02:16:17.853 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:17.853 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:17.853 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:17.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.854 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:62558 5.1 5:8fc319c1:::benchmark_data_smithi121_44835_object62557:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:17.854 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:17.831120+0000", 2024-04-19T02:16:17.854 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.010760237000000001, 2024-04-19T02:16:17.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010959814999999999, 2024-04-19T02:16:17.854 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:17.854 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:17.854 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:17.854 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:17.854 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:17.854 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 62558 2024-04-19T02:16:17.854 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.854 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:17.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.855 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:17.855 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.831120+0000", 2024-04-19T02:16:17.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:17.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.855 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:17.855 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.831120+0000", 2024-04-19T02:16:17.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:17.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.855 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:17.855 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.831119+0000", 2024-04-19T02:16:17.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:17.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:17.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.831156+0000", 2024-04-19T02:16:17.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6959999999999998e-05 2024-04-19T02:16:17.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:17.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.831166+0000", 2024-04-19T02:16:17.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0254999999999999e-05 2024-04-19T02:16:17.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:17.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.831174+0000", 2024-04-19T02:16:17.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.259e-06 2024-04-19T02:16:17.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:17.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.831207+0000", 2024-04-19T02:16:17.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3043000000000002e-05 2024-04-19T02:16:17.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:17.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.831301+0000", 2024-04-19T02:16:17.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3800000000000003e-05 2024-04-19T02:16:17.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:17.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.831408+0000", 2024-04-19T02:16:17.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107614 2024-04-19T02:16:17.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:17.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.836354+0000", 2024-04-19T02:16:17.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0049452640000000004 2024-04-19T02:16:17.858 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:17.858 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:17.858 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:17.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.858 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:62560 5.7 5:ef9bc8d5:::benchmark_data_smithi121_44835_object62559:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:17.858 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:17.831230+0000", 2024-04-19T02:16:17.858 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.010650323, 2024-04-19T02:16:17.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010936058, 2024-04-19T02:16:17.859 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:17.859 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:17.859 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:17.859 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:17.859 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:17.859 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 62560 2024-04-19T02:16:17.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.859 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:17.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:17.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.831230+0000", 2024-04-19T02:16:17.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:17.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:17.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.831230+0000", 2024-04-19T02:16:17.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:17.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:17.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.831229+0000", 2024-04-19T02:16:17.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:17.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:17.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.831324+0000", 2024-04-19T02:16:17.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5191000000000004e-05 2024-04-19T02:16:17.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:17.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.831332+0000", 2024-04-19T02:16:17.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7540000000000006e-06 2024-04-19T02:16:17.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:17.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.831338+0000", 2024-04-19T02:16:17.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.913e-06 2024-04-19T02:16:17.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:17.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.831376+0000", 2024-04-19T02:16:17.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8220000000000003e-05 2024-04-19T02:16:17.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:17.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.831498+0000", 2024-04-19T02:16:17.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012165800000000001 2024-04-19T02:16:17.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:17.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.831679+0000", 2024-04-19T02:16:17.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018152000000000001 2024-04-19T02:16:17.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:17.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.836263+0000", 2024-04-19T02:16:17.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00458377 2024-04-19T02:16:17.863 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:17.863 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:17.863 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:17.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.863 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:62563 5.2 5:41d3fc4d:::benchmark_data_smithi121_44835_object62562:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:17.863 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:17.833976+0000", 2024-04-19T02:16:17.863 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0079043399999999993, 2024-04-19T02:16:17.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0082701879999999995, 2024-04-19T02:16:17.863 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:17.863 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:17.863 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:17.863 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:17.864 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:17.864 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 62563 2024-04-19T02:16:17.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.864 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:17.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:17.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.833976+0000", 2024-04-19T02:16:17.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:17.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:17.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.833976+0000", 2024-04-19T02:16:17.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:17.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:17.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.833975+0000", 2024-04-19T02:16:17.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:17.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:17.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.834031+0000", 2024-04-19T02:16:17.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6227999999999998e-05 2024-04-19T02:16:17.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:17.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.834045+0000", 2024-04-19T02:16:17.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3939e-05 2024-04-19T02:16:17.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:17.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.834055+0000", 2024-04-19T02:16:17.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0392e-05 2024-04-19T02:16:17.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:17.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.834088+0000", 2024-04-19T02:16:17.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2889999999999999e-05 2024-04-19T02:16:17.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:17.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.834174+0000", 2024-04-19T02:16:17.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.577e-05 2024-04-19T02:16:17.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.867 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:17.867 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.834264+0000", 2024-04-19T02:16:17.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0160000000000004e-05 2024-04-19T02:16:17.867 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:17.867 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:17.867 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:17.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.867 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:62566 5.9 5:964befd3:::benchmark_data_smithi121_44835_object62565:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:17.867 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:17.834970+0000", 2024-04-19T02:16:17.868 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.006910444, 2024-04-19T02:16:17.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0073505510000000003, 2024-04-19T02:16:17.868 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:17.868 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:17.868 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:17.868 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:17.868 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:17.868 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 62566 2024-04-19T02:16:17.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.868 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:17.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:17.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.834970+0000", 2024-04-19T02:16:17.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:17.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:17.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.834970+0000", 2024-04-19T02:16:17.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:17.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:17.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.834969+0000", 2024-04-19T02:16:17.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:17.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:17.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.835073+0000", 2024-04-19T02:16:17.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104628 2024-04-19T02:16:17.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:17.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.835087+0000", 2024-04-19T02:16:17.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3523000000000001e-05 2024-04-19T02:16:17.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:17.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.835097+0000", 2024-04-19T02:16:17.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0105000000000001e-05 2024-04-19T02:16:17.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:17.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.835134+0000", 2024-04-19T02:16:17.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6507999999999997e-05 2024-04-19T02:16:17.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:17.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.835257+0000", 2024-04-19T02:16:17.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000123495 2024-04-19T02:16:17.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:17.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.835404+0000", 2024-04-19T02:16:17.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014736400000000001 2024-04-19T02:16:17.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:17.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.837519+0000", 2024-04-19T02:16:17.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021149889999999998 2024-04-19T02:16:17.872 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:17.872 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:17.872 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:17.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.872 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4549.0:62567 5.c e26/16 5:3ee0ad6b:::benchmark_data_smithi121_44835_object62566:head v 26'3837, mlcod=26'3835)", 2024-04-19T02:16:17.872 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:17.835512+0000", 2024-04-19T02:16:17.872 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0063682490000000003, 2024-04-19T02:16:17.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0068869029999999998, 2024-04-19T02:16:17.873 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:17.873 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:16:17.873 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:17.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.873 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:17.873 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.835512+0000", 2024-04-19T02:16:17.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:17.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.873 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:17.873 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.835512+0000", 2024-04-19T02:16:17.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:17.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:17.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.835511+0000", 2024-04-19T02:16:17.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:17.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:17.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.835564+0000", 2024-04-19T02:16:17.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3020999999999999e-05 2024-04-19T02:16:17.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:17.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.835571+0000", 2024-04-19T02:16:17.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0230000000000004e-06 2024-04-19T02:16:17.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:17.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.835575+0000", 2024-04-19T02:16:17.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.844e-06 2024-04-19T02:16:17.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:17.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.835615+0000", 2024-04-19T02:16:17.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9279000000000001e-05 2024-04-19T02:16:17.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:17.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.835638+0000", 2024-04-19T02:16:17.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3978999999999999e-05 2024-04-19T02:16:17.876 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:17.876 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:17.876 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:17.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.876 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:62568 5.2 5:459589c0:::benchmark_data_smithi121_44835_object62567:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:17.876 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:17.836289+0000", 2024-04-19T02:16:17.876 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0055912720000000004, 2024-04-19T02:16:17.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0061717960000000002, 2024-04-19T02:16:17.876 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:17.876 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:17.876 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:17.877 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:17.877 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:17.877 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 62568 2024-04-19T02:16:17.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.877 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:17.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:17.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.836289+0000", 2024-04-19T02:16:17.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:17.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:17.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.836289+0000", 2024-04-19T02:16:17.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:17.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.878 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:17.878 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.836288+0000", 2024-04-19T02:16:17.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:17.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.878 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:17.878 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.836362+0000", 2024-04-19T02:16:17.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4494999999999997e-05 2024-04-19T02:16:17.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.878 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:17.878 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.836375+0000", 2024-04-19T02:16:17.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2306e-05 2024-04-19T02:16:17.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.879 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:17.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.836383+0000", 2024-04-19T02:16:17.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4139999999999994e-06 2024-04-19T02:16:17.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.879 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:17.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.838695+0000", 2024-04-19T02:16:17.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0023117960000000001 2024-04-19T02:16:17.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.880 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:17.880 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.838810+0000", 2024-04-19T02:16:17.880 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011519999999999999 2024-04-19T02:16:17.880 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.880 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.880 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:17.880 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.838898+0000", 2024-04-19T02:16:17.880 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7437999999999999e-05 2024-04-19T02:16:17.880 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:17.880 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:17.880 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:17.880 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.880 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.880 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:62569 5.d 5:b5c54ec6:::benchmark_data_smithi121_44835_object62568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:17.881 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:17.836441+0000", 2024-04-19T02:16:17.881 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0054393840000000002, 2024-04-19T02:16:17.881 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0060937259999999998, 2024-04-19T02:16:17.881 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:17.881 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:17.881 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:17.881 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:17.881 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:17.881 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 62569 2024-04-19T02:16:17.881 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.881 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:17.881 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.881 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:17.881 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.836441+0000", 2024-04-19T02:16:17.881 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:17.882 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.882 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.882 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:17.882 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.836441+0000", 2024-04-19T02:16:17.882 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:17.882 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.882 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.882 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:17.882 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.836440+0000", 2024-04-19T02:16:17.882 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:17.882 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.882 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.882 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:17.882 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.836530+0000", 2024-04-19T02:16:17.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0267999999999997e-05 2024-04-19T02:16:17.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:17.883 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.836541+0000", 2024-04-19T02:16:17.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0567999999999999e-05 2024-04-19T02:16:17.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:17.883 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.836548+0000", 2024-04-19T02:16:17.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9879999999999998e-06 2024-04-19T02:16:17.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.884 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:17.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.836581+0000", 2024-04-19T02:16:17.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3387999999999999e-05 2024-04-19T02:16:17.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.884 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:17.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.836679+0000", 2024-04-19T02:16:17.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7764999999999997e-05 2024-04-19T02:16:17.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.884 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:17.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.836767+0000", 2024-04-19T02:16:17.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7947000000000003e-05 2024-04-19T02:16:17.885 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:17.885 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:17.885 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:17.885 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.885 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:62572 5.7 5:edc409f7:::benchmark_data_smithi121_44835_object62571:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:17.885 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:17.836739+0000", 2024-04-19T02:16:17.885 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0051407830000000003, 2024-04-19T02:16:17.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0058755810000000004, 2024-04-19T02:16:17.885 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:17.885 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:17.885 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:17.885 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:17.885 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:17.885 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 62572 2024-04-19T02:16:17.886 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.886 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:17.886 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.886 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:17.886 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.836739+0000", 2024-04-19T02:16:17.886 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:17.886 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.886 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.886 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:17.886 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.836739+0000", 2024-04-19T02:16:17.886 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:17.886 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.886 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:17.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.836739+0000", 2024-04-19T02:16:17.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:17.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:17.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.836909+0000", 2024-04-19T02:16:17.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000169937 2024-04-19T02:16:17.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:17.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.836919+0000", 2024-04-19T02:16:17.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0295000000000001e-05 2024-04-19T02:16:17.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.888 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:17.888 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.836926+0000", 2024-04-19T02:16:17.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.503e-06 2024-04-19T02:16:17.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.888 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:17.888 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.836960+0000", 2024-04-19T02:16:17.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3176999999999998e-05 2024-04-19T02:16:17.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.888 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:17.888 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.837100+0000", 2024-04-19T02:16:17.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000140779 2024-04-19T02:16:17.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.889 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.889 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:17.889 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.837215+0000", 2024-04-19T02:16:17.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000114898 2024-04-19T02:16:17.889 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:17.889 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:17.889 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:17.889 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.889 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.889 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4549.0:62570 5.5 e26/16 5:aa51eb91:::benchmark_data_smithi121_44835_object62569:head v 26'3914, mlcod=26'3910)", 2024-04-19T02:16:17.889 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:17.836990+0000", 2024-04-19T02:16:17.889 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0048898020000000004, 2024-04-19T02:16:17.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0056946590000000004, 2024-04-19T02:16:17.889 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:17.890 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:16:17.890 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:17.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.890 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:17.890 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.836990+0000", 2024-04-19T02:16:17.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:17.890 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.890 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:17.890 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.836990+0000", 2024-04-19T02:16:17.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:17.890 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:17.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.836990+0000", 2024-04-19T02:16:17.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:17.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:17.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.837093+0000", 2024-04-19T02:16:17.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000103173 2024-04-19T02:16:17.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:17.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.837103+0000", 2024-04-19T02:16:17.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8660000000000001e-06 2024-04-19T02:16:17.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:17.892 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.837110+0000", 2024-04-19T02:16:17.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8040000000000004e-06 2024-04-19T02:16:17.892 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:17.892 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.837202+0000", 2024-04-19T02:16:17.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2427000000000001e-05 2024-04-19T02:16:17.892 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:17.892 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.837220+0000", 2024-04-19T02:16:17.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7628000000000001e-05 2024-04-19T02:16:17.893 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:17.893 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:17.893 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:17.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.893 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:62573 5.1 5:83a26652:::benchmark_data_smithi121_44835_object62572:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:17.893 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:17.837361+0000", 2024-04-19T02:16:17.893 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0045193669999999998, 2024-04-19T02:16:17.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0053857740000000003, 2024-04-19T02:16:17.893 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:17.893 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:17.893 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:17.894 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:17.894 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:17.894 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 62573 2024-04-19T02:16:17.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.894 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:17.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.894 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:17.894 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.837361+0000", 2024-04-19T02:16:17.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:17.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.894 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:17.894 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.837361+0000", 2024-04-19T02:16:17.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:17.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:17.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.837360+0000", 2024-04-19T02:16:17.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:17.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:17.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.837507+0000", 2024-04-19T02:16:17.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000146744 2024-04-19T02:16:17.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:17.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.837514+0000", 2024-04-19T02:16:17.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6960000000000005e-06 2024-04-19T02:16:17.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:17.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.837520+0000", 2024-04-19T02:16:17.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.947e-06 2024-04-19T02:16:17.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:17.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.837548+0000", 2024-04-19T02:16:17.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7603999999999999e-05 2024-04-19T02:16:17.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:17.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.837672+0000", 2024-04-19T02:16:17.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012385599999999999 2024-04-19T02:16:17.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:17.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.837807+0000", 2024-04-19T02:16:17.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013498899999999999 2024-04-19T02:16:17.897 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:17.897 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:17.897 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:17.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.897 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4549.0:62569 5.d e26/16)", 2024-04-19T02:16:17.897 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:17.838568+0000", 2024-04-19T02:16:17.897 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0033117039999999999, 2024-04-19T02:16:17.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042442720000000003, 2024-04-19T02:16:17.897 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:17.898 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-04-19T02:16:17.898 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:17.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.898 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:17.898 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.838568+0000", 2024-04-19T02:16:17.898 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:17.898 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.898 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:17.898 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.838568+0000", 2024-04-19T02:16:17.898 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:17.898 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.898 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:17.899 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.838568+0000", 2024-04-19T02:16:17.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:17.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.899 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:17.899 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.838572+0000", 2024-04-19T02:16:17.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.794e-06 2024-04-19T02:16:17.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.899 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:17.899 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.838579+0000", 2024-04-19T02:16:17.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5859999999999999e-06 2024-04-19T02:16:17.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.899 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:17.899 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.838589+0000", 2024-04-19T02:16:17.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4259999999999992e-06 2024-04-19T02:16:17.900 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:17.900 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:17.900 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:17.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.900 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4549.0:62563 5.2 e26/16)", 2024-04-19T02:16:17.900 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:17.838641+0000", 2024-04-19T02:16:17.900 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.003238814, 2024-04-19T02:16:17.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042313419999999999, 2024-04-19T02:16:17.900 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:17.900 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-04-19T02:16:17.900 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:17.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:17.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.838641+0000", 2024-04-19T02:16:17.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:17.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:17.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.838641+0000", 2024-04-19T02:16:17.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:17.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:17.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.838641+0000", 2024-04-19T02:16:17.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:17.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:17.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.838645+0000", 2024-04-19T02:16:17.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6299999999999997e-06 2024-04-19T02:16:17.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:17.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.838656+0000", 2024-04-19T02:16:17.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0702e-05 2024-04-19T02:16:17.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:17.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.838663+0000", 2024-04-19T02:16:17.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1720000000000001e-06 2024-04-19T02:16:17.902 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:17.903 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:17.903 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:17.903 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.903 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.903 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4549.0:62572 5.7 e26/16)", 2024-04-19T02:16:17.903 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:17.841375+0000", 2024-04-19T02:16:17.903 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00050557200000000003, 2024-04-19T02:16:17.903 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0015397729999999999, 2024-04-19T02:16:17.903 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:17.903 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-04-19T02:16:17.903 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:17.903 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.903 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:17.903 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.841375+0000", 2024-04-19T02:16:17.903 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:17.904 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.904 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.904 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:17.904 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.841375+0000", 2024-04-19T02:16:17.904 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:17.904 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.904 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.904 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:17.904 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.841374+0000", 2024-04-19T02:16:17.904 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:17.904 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.904 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.904 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:17.904 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.841379+0000", 2024-04-19T02:16:17.904 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5870000000000003e-06 2024-04-19T02:16:17.905 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.905 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.905 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:17.905 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.841390+0000", 2024-04-19T02:16:17.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1021e-05 2024-04-19T02:16:17.905 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:17.905 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:17.905 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:17.905 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:17.841413+0000", 2024-04-19T02:16:17.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3425999999999999e-05 2024-04-19T02:16:17.905 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:17.905 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:17.905 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:17.905 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:17.905 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-04-19T02:16:17.906 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 16 2024-04-19T02:16:17.906 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:16:17.907 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:16:17.908 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:17.908+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:18.008 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:18.008+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:18.027 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 23 16 62992 62976 171.117 131.75 0.00774382 0.00584146 2024-04-19T02:16:18.108 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:18.108+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:18.126 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:16:18.126 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-04-19T02:16:18.126 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-04-19T02:16:18.126 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-04-19T02:16:18.126 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:16:18.141 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:16:18.210 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:18.210+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:18.310 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:18.311+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:18.317 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:16:18.317 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-04-19T02:16:18.317 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-04-19T02:16:18.317 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:16:18.317 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.317 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:18.317 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269684+0000", 2024-04-19T02:16:18.318 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 49.046567684000003, 2024-04-19T02:16:18.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019077493000000001, 2024-04-19T02:16:18.318 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:18.318 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:18.318 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:18.318 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.318 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:18.318 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269684+0000", 2024-04-19T02:16:18.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:18.318 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.318 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.318 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:18.318 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269684+0000", 2024-04-19T02:16:18.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:18.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:18.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269684+0000", 2024-04-19T02:16:18.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:18.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:18.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269686+0000", 2024-04-19T02:16:18.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2740000000000002e-06 2024-04-19T02:16:18.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:18.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269690+0000", 2024-04-19T02:16:18.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8829999999999999e-06 2024-04-19T02:16:18.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:18.320 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269693+0000", 2024-04-19T02:16:18.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4199999999999999e-06 2024-04-19T02:16:18.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:18.320 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269875+0000", 2024-04-19T02:16:18.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018114800000000001 2024-04-19T02:16:18.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:18.320 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269880+0000", 2024-04-19T02:16:18.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5620000000000003e-06 2024-04-19T02:16:18.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:18.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278610+0000", 2024-04-19T02:16:18.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.008729423 2024-04-19T02:16:18.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:18.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278724+0000", 2024-04-19T02:16:18.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011428400000000001 2024-04-19T02:16:18.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:18.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278860+0000", 2024-04-19T02:16:18.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013601600000000001 2024-04-19T02:16:18.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.322 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:18.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282632+0000", 2024-04-19T02:16:18.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037722889999999999 2024-04-19T02:16:18.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.322 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:18.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288712+0000", 2024-04-19T02:16:18.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0060799599999999997 2024-04-19T02:16:18.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.322 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:18.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288742+0000", 2024-04-19T02:16:18.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0048000000000001e-05 2024-04-19T02:16:18.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:18.323 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288762+0000", 2024-04-19T02:16:18.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9482000000000001e-05 2024-04-19T02:16:18.323 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:18.323 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:18.323 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:18.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.323 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:12 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:18.323 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269696+0000", 2024-04-19T02:16:18.323 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 49.046555605999998, 2024-04-19T02:16:18.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018617073000000001, 2024-04-19T02:16:18.323 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:18.323 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:18.324 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:18.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:18.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269696+0000", 2024-04-19T02:16:18.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:18.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:18.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269696+0000", 2024-04-19T02:16:18.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:18.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:18.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269696+0000", 2024-04-19T02:16:18.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967296 2024-04-19T02:16:18.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:18.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269698+0000", 2024-04-19T02:16:18.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9570000000000001e-06 2024-04-19T02:16:18.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:18.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269702+0000", 2024-04-19T02:16:18.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2459999999999997e-06 2024-04-19T02:16:18.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:18.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269708+0000", 2024-04-19T02:16:18.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2709999999999998e-06 2024-04-19T02:16:18.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.326 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:18.326 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269749+0000", 2024-04-19T02:16:18.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0500000000000002e-05 2024-04-19T02:16:18.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.326 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-04-19T02:16:18.326 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269754+0000", 2024-04-19T02:16:18.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.502e-06 2024-04-19T02:16:18.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.326 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:18.326 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.277984+0000", 2024-04-19T02:16:18.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0082293049999999993 2024-04-19T02:16:18.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.327 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:18.327 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278489+0000", 2024-04-19T02:16:18.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00050499699999999998 2024-04-19T02:16:18.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.327 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:18.327 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278649+0000", 2024-04-19T02:16:18.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016012000000000001 2024-04-19T02:16:18.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.327 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:18.327 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286855+0000", 2024-04-19T02:16:18.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0082066139999999992 2024-04-19T02:16:18.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:18.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288248+0000", 2024-04-19T02:16:18.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001392838 2024-04-19T02:16:18.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:18.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288287+0000", 2024-04-19T02:16:18.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8516000000000002e-05 2024-04-19T02:16:18.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:18.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288313+0000", 2024-04-19T02:16:18.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6420000000000001e-05 2024-04-19T02:16:18.329 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:18.329 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:18.329 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:18.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.329 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:18.329 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269753+0000", 2024-04-19T02:16:18.329 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 49.046498301, 2024-04-19T02:16:18.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019088755999999998, 2024-04-19T02:16:18.329 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:18.329 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:18.329 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:18.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:18.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269753+0000", 2024-04-19T02:16:18.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:18.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:18.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269753+0000", 2024-04-19T02:16:18.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:18.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:18.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269753+0000", 2024-04-19T02:16:18.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:18.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.331 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:18.331 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269770+0000", 2024-04-19T02:16:18.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7150999999999999e-05 2024-04-19T02:16:18.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.331 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:18.331 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269779+0000", 2024-04-19T02:16:18.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4139999999999994e-06 2024-04-19T02:16:18.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.331 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:18.331 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269786+0000", 2024-04-19T02:16:18.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.537e-06 2024-04-19T02:16:18.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.332 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:18.332 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269913+0000", 2024-04-19T02:16:18.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012699599999999999 2024-04-19T02:16:18.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.332 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:18.332 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269916+0000", 2024-04-19T02:16:18.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9280000000000002e-06 2024-04-19T02:16:18.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.332 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:18.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.279143+0000", 2024-04-19T02:16:18.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0092270129999999992 2024-04-19T02:16:18.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:18.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.279223+0000", 2024-04-19T02:16:18.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0050999999999996e-05 2024-04-19T02:16:18.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:18.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.279364+0000", 2024-04-19T02:16:18.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000140934 2024-04-19T02:16:18.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:18.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286189+0000", 2024-04-19T02:16:18.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.006825327 2024-04-19T02:16:18.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:18.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288791+0000", 2024-04-19T02:16:18.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026021500000000001 2024-04-19T02:16:18.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:18.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288822+0000", 2024-04-19T02:16:18.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0162999999999999e-05 2024-04-19T02:16:18.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.335 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:18.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288842+0000", 2024-04-19T02:16:18.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0644000000000001e-05 2024-04-19T02:16:18.335 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:18.335 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:18.335 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:18.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.335 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:18.335 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:16:18.335 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 49.046459827, 2024-04-19T02:16:18.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020307345000000001, 2024-04-19T02:16:18.335 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:18.335 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:18.335 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:18.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.336 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:18.336 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:16:18.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:18.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.336 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.336 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:18.336 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:16:18.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:18.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.336 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.336 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:18.336 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269791+0000", 2024-04-19T02:16:18.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:18.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.337 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.337 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:18.337 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269795+0000", 2024-04-19T02:16:18.337 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5619999999999999e-06 2024-04-19T02:16:18.337 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.337 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.337 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:18.337 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269802+0000", 2024-04-19T02:16:18.337 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8469999999999998e-06 2024-04-19T02:16:18.337 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.337 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.337 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:18.337 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269807+0000", 2024-04-19T02:16:18.337 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.707e-06 2024-04-19T02:16:18.337 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:18.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269950+0000", 2024-04-19T02:16:18.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000143313 2024-04-19T02:16:18.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:18.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269955+0000", 2024-04-19T02:16:18.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4029999999999998e-06 2024-04-19T02:16:18.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:18.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.283806+0000", 2024-04-19T02:16:18.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013850220999999999 2024-04-19T02:16:18.339 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.339 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.339 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:18.339 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.283896+0000", 2024-04-19T02:16:18.339 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0261999999999997e-05 2024-04-19T02:16:18.339 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.339 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.339 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:18.339 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284022+0000", 2024-04-19T02:16:18.339 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012641200000000001 2024-04-19T02:16:18.339 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.339 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.339 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:18.339 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289066+0000", 2024-04-19T02:16:18.339 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050438490000000004 2024-04-19T02:16:18.340 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.340 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:18.340 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290011+0000", 2024-04-19T02:16:18.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00094490700000000004 2024-04-19T02:16:18.340 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.340 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:18.340 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290054+0000", 2024-04-19T02:16:18.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.337e-05 2024-04-19T02:16:18.340 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.340 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:18.340 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290099+0000", 2024-04-19T02:16:18.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4987999999999997e-05 2024-04-19T02:16:18.341 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:18.341 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:18.341 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:18.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.341 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.341 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:18.341 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:16:18.341 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 49.046381897000003, 2024-04-19T02:16:18.341 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020331023, 2024-04-19T02:16:18.341 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:18.341 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:18.341 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:18.341 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.341 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:18.341 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:16:18.341 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:18.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.342 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:18.342 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:16:18.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:18.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.342 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:18.342 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269869+0000", 2024-04-19T02:16:18.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:18.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.342 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:18.342 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269873+0000", 2024-04-19T02:16:18.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0219999999999998e-06 2024-04-19T02:16:18.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:18.343 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269881+0000", 2024-04-19T02:16:18.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.79e-06 2024-04-19T02:16:18.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:18.343 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269887+0000", 2024-04-19T02:16:18.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7899999999999996e-06 2024-04-19T02:16:18.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:18.343 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269983+0000", 2024-04-19T02:16:18.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6057000000000005e-05 2024-04-19T02:16:18.344 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:18.344 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269986+0000", 2024-04-19T02:16:18.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9220000000000001e-06 2024-04-19T02:16:18.344 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:18.344 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284350+0000", 2024-04-19T02:16:18.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014364335000000001 2024-04-19T02:16:18.344 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:18.344 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284664+0000", 2024-04-19T02:16:18.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000313646 2024-04-19T02:16:18.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.345 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:18.345 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284794+0000", 2024-04-19T02:16:18.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129839 2024-04-19T02:16:18.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.345 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:18.345 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289107+0000", 2024-04-19T02:16:18.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0043127060000000004 2024-04-19T02:16:18.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.345 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:18.345 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290108+0000", 2024-04-19T02:16:18.346 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0010010590000000001 2024-04-19T02:16:18.346 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.346 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:18.346 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290144+0000", 2024-04-19T02:16:18.346 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6709999999999999e-05 2024-04-19T02:16:18.346 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.346 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:18.346 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290201+0000", 2024-04-19T02:16:18.346 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6654999999999999e-05 2024-04-19T02:16:18.346 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:18.346 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:18.346 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:18.346 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.347 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:18.347 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:16:18.347 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 49.046339556, 2024-04-19T02:16:18.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020507241999999998, 2024-04-19T02:16:18.347 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:18.347 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:18.347 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:18.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.347 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:18.347 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:16:18.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:18.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.348 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:18.348 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:16:18.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:18.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.348 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:18.348 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:16:18.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:18.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.348 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:18.348 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269915+0000", 2024-04-19T02:16:18.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.472e-06 2024-04-19T02:16:18.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.348 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:18.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269928+0000", 2024-04-19T02:16:18.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2979000000000001e-05 2024-04-19T02:16:18.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:18.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269935+0000", 2024-04-19T02:16:18.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8859999999999998e-06 2024-04-19T02:16:18.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:18.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270009+0000", 2024-04-19T02:16:18.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3429000000000005e-05 2024-04-19T02:16:18.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:18.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270013+0000", 2024-04-19T02:16:18.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2590000000000002e-06 2024-04-19T02:16:18.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:18.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285375+0000", 2024-04-19T02:16:18.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015362275999999999 2024-04-19T02:16:18.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:18.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285451+0000", 2024-04-19T02:16:18.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5338000000000003e-05 2024-04-19T02:16:18.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:18.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285562+0000", 2024-04-19T02:16:18.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000111285 2024-04-19T02:16:18.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:18.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289134+0000", 2024-04-19T02:16:18.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035719670000000001 2024-04-19T02:16:18.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:18.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290341+0000", 2024-04-19T02:16:18.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012074500000000001 2024-04-19T02:16:18.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.352 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:18.352 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290383+0000", 2024-04-19T02:16:18.352 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1386e-05 2024-04-19T02:16:18.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.352 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:18.352 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290419+0000", 2024-04-19T02:16:18.352 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6884000000000001e-05 2024-04-19T02:16:18.352 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:18.352 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:18.352 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:18.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.353 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:18.353 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269945+0000", 2024-04-19T02:16:18.353 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 49.046306973999997, 2024-04-19T02:16:18.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019709098000000001, 2024-04-19T02:16:18.353 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:18.353 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:18.353 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:18.353 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.353 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:18.353 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269945+0000", 2024-04-19T02:16:18.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:18.353 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.353 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.353 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:18.353 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269945+0000", 2024-04-19T02:16:18.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:18.354 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.354 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.354 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:18.354 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269944+0000", 2024-04-19T02:16:18.354 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:18.354 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.354 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.354 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:18.354 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269965+0000", 2024-04-19T02:16:18.354 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0803999999999999e-05 2024-04-19T02:16:18.354 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.354 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.354 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:18.354 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269973+0000", 2024-04-19T02:16:18.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3560000000000004e-06 2024-04-19T02:16:18.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:18.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269982+0000", 2024-04-19T02:16:18.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9600000000000006e-06 2024-04-19T02:16:18.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:18.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270014+0000", 2024-04-19T02:16:18.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2913000000000001e-05 2024-04-19T02:16:18.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:18.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270018+0000", 2024-04-19T02:16:18.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2200000000000001e-06 2024-04-19T02:16:18.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.356 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:18.356 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278999+0000", 2024-04-19T02:16:18.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0089818009999999993 2024-04-19T02:16:18.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.356 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:18.356 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.279088+0000", 2024-04-19T02:16:18.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8988999999999998e-05 2024-04-19T02:16:18.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.356 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:18.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.280160+0000", 2024-04-19T02:16:18.357 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001071572 2024-04-19T02:16:18.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:18.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288342+0000", 2024-04-19T02:16:18.357 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.008182468 2024-04-19T02:16:18.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:18.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289545+0000", 2024-04-19T02:16:18.357 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012026739999999999 2024-04-19T02:16:18.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.358 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.358 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:18.358 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289608+0000", 2024-04-19T02:16:18.358 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2904999999999995e-05 2024-04-19T02:16:18.358 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.358 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.358 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:18.358 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289654+0000", 2024-04-19T02:16:18.358 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5850000000000003e-05 2024-04-19T02:16:18.358 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:18.358 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:18.358 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:18.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.359 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:18.359 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:16:18.359 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 49.046261295999997, 2024-04-19T02:16:18.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022007204999999998, 2024-04-19T02:16:18.359 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:18.359 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:18.359 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:18.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.359 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:18.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:16:18.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:18.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.359 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:18.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:16:18.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:18.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.360 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:18.360 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269990+0000", 2024-04-19T02:16:18.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:18.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.360 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:18.360 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269999+0000", 2024-04-19T02:16:18.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9539999999999993e-06 2024-04-19T02:16:18.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.360 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:18.361 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270006+0000", 2024-04-19T02:16:18.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.216e-06 2024-04-19T02:16:18.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.361 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.361 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:18.361 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270012+0000", 2024-04-19T02:16:18.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5049999999999998e-06 2024-04-19T02:16:18.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.361 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.361 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:18.361 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270058+0000", 2024-04-19T02:16:18.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.634e-05 2024-04-19T02:16:18.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.361 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:18.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270064+0000", 2024-04-19T02:16:18.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0669999999999997e-06 2024-04-19T02:16:18.362 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:18.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287159+0000", 2024-04-19T02:16:18.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017095086999999998 2024-04-19T02:16:18.362 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:18.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287254+0000", 2024-04-19T02:16:18.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4716000000000006e-05 2024-04-19T02:16:18.363 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.363 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.363 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:18.363 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287389+0000", 2024-04-19T02:16:18.363 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013511900000000001 2024-04-19T02:16:18.363 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.363 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.363 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:18.363 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290481+0000", 2024-04-19T02:16:18.363 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030920169999999999 2024-04-19T02:16:18.363 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.363 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.363 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:18.363 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291931+0000", 2024-04-19T02:16:18.364 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001450118 2024-04-19T02:16:18.364 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.364 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.364 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:18.364 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291960+0000", 2024-04-19T02:16:18.364 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9096000000000001e-05 2024-04-19T02:16:18.364 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.364 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.364 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:18.364 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291998+0000", 2024-04-19T02:16:18.364 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7514e-05 2024-04-19T02:16:18.364 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:18.364 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:18.364 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:18.365 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.365 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.365 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:18.365 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:18.365 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 49.046200724999998, 2024-04-19T02:16:18.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020759494999999999, 2024-04-19T02:16:18.365 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:18.365 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:18.365 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:18.365 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.365 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:18.365 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:18.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:18.365 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:18.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:18.366 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:18.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:18.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:18.366 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:18.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:18.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270054+0000", 2024-04-19T02:16:18.366 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.27e-06 2024-04-19T02:16:18.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.367 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.367 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:18.367 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270061+0000", 2024-04-19T02:16:18.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1289999999999998e-06 2024-04-19T02:16:18.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.367 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.367 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:18.367 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270067+0000", 2024-04-19T02:16:18.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.207e-06 2024-04-19T02:16:18.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.367 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.367 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:18.367 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270105+0000", 2024-04-19T02:16:18.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7549999999999998e-05 2024-04-19T02:16:18.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.368 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.368 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:18.368 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270112+0000", 2024-04-19T02:16:18.368 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3200000000000002e-06 2024-04-19T02:16:18.368 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.368 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.368 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:18.368 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282454+0000", 2024-04-19T02:16:18.368 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012341569 2024-04-19T02:16:18.368 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.368 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.368 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:18.368 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282740+0000", 2024-04-19T02:16:18.369 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000286481 2024-04-19T02:16:18.369 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.369 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.369 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:18.369 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282879+0000", 2024-04-19T02:16:18.369 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013887799999999999 2024-04-19T02:16:18.369 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.369 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.369 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:18.369 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290325+0000", 2024-04-19T02:16:18.369 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074459779999999998 2024-04-19T02:16:18.369 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.369 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.369 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:18.369 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290759+0000", 2024-04-19T02:16:18.370 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000433688 2024-04-19T02:16:18.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.370 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:18.370 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290789+0000", 2024-04-19T02:16:18.370 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9960000000000001e-05 2024-04-19T02:16:18.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.370 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:18.370 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290811+0000", 2024-04-19T02:16:18.370 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1965999999999999e-05 2024-04-19T02:16:18.370 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:18.370 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:18.370 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:18.371 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.371 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.371 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:18.371 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:16:18.371 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 49.046150519999998, 2024-04-19T02:16:18.371 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020837887999999999, 2024-04-19T02:16:18.371 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:18.371 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:18.371 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:18.371 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.371 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:18.371 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:16:18.371 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:18.371 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.371 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.372 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:18.372 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:16:18.372 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:18.372 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.372 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.372 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:18.372 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:16:18.372 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:18.372 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.372 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.372 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:18.372 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270109+0000", 2024-04-19T02:16:18.372 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3110000000000006e-06 2024-04-19T02:16:18.372 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.372 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.372 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:18.373 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270117+0000", 2024-04-19T02:16:18.373 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0479999999999999e-06 2024-04-19T02:16:18.373 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.373 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.373 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:18.373 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270123+0000", 2024-04-19T02:16:18.373 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5500000000000002e-06 2024-04-19T02:16:18.373 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.373 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.373 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:18.373 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270150+0000", 2024-04-19T02:16:18.373 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7712000000000002e-05 2024-04-19T02:16:18.373 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.373 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.373 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:18.374 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270153+0000", 2024-04-19T02:16:18.374 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6089999999999999e-06 2024-04-19T02:16:18.374 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.374 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.374 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:18.374 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285958+0000", 2024-04-19T02:16:18.374 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015805274000000001 2024-04-19T02:16:18.374 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.374 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.374 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:18.374 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286126+0000", 2024-04-19T02:16:18.374 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016765700000000001 2024-04-19T02:16:18.374 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.375 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:18.375 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286296+0000", 2024-04-19T02:16:18.375 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017007 2024-04-19T02:16:18.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.375 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:18.375 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290426+0000", 2024-04-19T02:16:18.375 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041299839999999997 2024-04-19T02:16:18.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.375 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:18.375 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290867+0000", 2024-04-19T02:16:18.375 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00044083300000000001 2024-04-19T02:16:18.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.376 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.376 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:18.376 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290900+0000", 2024-04-19T02:16:18.376 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3380000000000002e-05 2024-04-19T02:16:18.376 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.376 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.376 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:18.376 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290939+0000", 2024-04-19T02:16:18.376 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8970000000000001e-05 2024-04-19T02:16:18.376 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:18.376 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:18.376 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:18.376 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.376 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.376 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:21 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:18.377 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:16:18.377 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 49.046061848000001, 2024-04-19T02:16:18.377 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020833187999999999, 2024-04-19T02:16:18.377 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:18.377 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:16:18.377 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:18.377 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.377 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:18.377 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:16:18.377 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:18.377 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.377 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.377 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:18.377 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:16:18.377 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:18.377 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.378 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:18.378 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270189+0000", 2024-04-19T02:16:18.378 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:18.378 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.378 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:18.378 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270192+0000", 2024-04-19T02:16:18.378 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7549999999999999e-06 2024-04-19T02:16:18.378 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.378 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:18.378 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270198+0000", 2024-04-19T02:16:18.378 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0859999999999998e-06 2024-04-19T02:16:18.378 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.379 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.379 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:18.379 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270204+0000", 2024-04-19T02:16:18.379 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1970000000000004e-06 2024-04-19T02:16:18.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.379 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.379 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:18.379 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270238+0000", 2024-04-19T02:16:18.379 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4282000000000001e-05 2024-04-19T02:16:18.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.379 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.379 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:18.379 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270240+0000", 2024-04-19T02:16:18.379 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3099999999999999e-06 2024-04-19T02:16:18.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.379 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.380 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:18.380 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287131+0000", 2024-04-19T02:16:18.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01689104 2024-04-19T02:16:18.380 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.380 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.380 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:18.380 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287262+0000", 2024-04-19T02:16:18.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130347 2024-04-19T02:16:18.380 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.380 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.380 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:18.380 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291023+0000", 2024-04-19T02:16:18.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037616350000000002 2024-04-19T02:16:18.380 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:18.380 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:18.380 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:18.381 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.381 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.381 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:2285 5.d 5:b310a433:::benchmark_data_smithi121_44835_object2284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:16:18.381 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:55.643557+0000", 2024-04-19T02:16:18.381 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.672695126000001, 2024-04-19T02:16:18.381 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018865537000000002, 2024-04-19T02:16:18.381 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:18.381 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:18.381 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:18.381 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:18.381 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:18.381 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 2285 2024-04-19T02:16:18.381 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.381 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:18.381 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.382 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:18.382 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643557+0000", 2024-04-19T02:16:18.382 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:18.382 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.382 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.382 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:18.382 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643557+0000", 2024-04-19T02:16:18.382 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:18.382 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.382 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.382 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:18.382 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643556+0000", 2024-04-19T02:16:18.382 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:18.382 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.383 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.383 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:18.383 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643625+0000", 2024-04-19T02:16:18.383 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9393000000000005e-05 2024-04-19T02:16:18.383 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.383 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.383 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:18.383 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643634+0000", 2024-04-19T02:16:18.383 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.14e-06 2024-04-19T02:16:18.383 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.383 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.383 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:18.383 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643640+0000", 2024-04-19T02:16:18.383 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.601e-06 2024-04-19T02:16:18.384 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.384 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.384 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:18.384 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643669+0000", 2024-04-19T02:16:18.384 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9292999999999999e-05 2024-04-19T02:16:18.384 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.384 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.384 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:18.384 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643760+0000", 2024-04-19T02:16:18.384 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0526999999999996e-05 2024-04-19T02:16:18.384 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.384 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.384 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:18.384 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643892+0000", 2024-04-19T02:16:18.385 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000131607 2024-04-19T02:16:18.385 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.385 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.385 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:18.385 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.649122+0000", 2024-04-19T02:16:18.385 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052308279999999999 2024-04-19T02:16:18.385 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.385 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.385 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:18.385 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.662321+0000", 2024-04-19T02:16:18.385 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013198774999999999 2024-04-19T02:16:18.385 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.385 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.385 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:18.385 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.662385+0000", 2024-04-19T02:16:18.386 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4261e-05 2024-04-19T02:16:18.386 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.386 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.386 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:18.386 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.662422+0000", 2024-04-19T02:16:18.386 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.676e-05 2024-04-19T02:16:18.386 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:18.386 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:18.386 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:18.386 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.386 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.386 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:16494 5.7 5:e2c19dca:::benchmark_data_smithi121_44835_object16493:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:18.386 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.871684+0000", 2024-04-19T02:16:18.387 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.444568192999999, 2024-04-19T02:16:18.387 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019343257999999999, 2024-04-19T02:16:18.387 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:18.387 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:18.387 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:18.387 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:18.387 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:18.387 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16494 2024-04-19T02:16:18.387 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.387 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:18.387 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.387 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:18.387 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871684+0000", 2024-04-19T02:16:18.387 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:18.388 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.388 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.388 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:18.388 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871684+0000", 2024-04-19T02:16:18.388 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:18.388 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.388 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.388 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:18.388 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871683+0000", 2024-04-19T02:16:18.388 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:18.388 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.388 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.388 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:18.388 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871762+0000", 2024-04-19T02:16:18.389 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8981999999999997e-05 2024-04-19T02:16:18.389 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.389 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.389 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:18.389 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871770+0000", 2024-04-19T02:16:18.389 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7060000000000004e-06 2024-04-19T02:16:18.389 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.389 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.389 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:18.389 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871776+0000", 2024-04-19T02:16:18.389 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4880000000000004e-06 2024-04-19T02:16:18.389 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.389 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.390 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:18.390 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.874098+0000", 2024-04-19T02:16:18.390 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0023215309999999999 2024-04-19T02:16:18.390 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.390 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.390 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:18.390 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.874245+0000", 2024-04-19T02:16:18.390 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014735599999999999 2024-04-19T02:16:18.390 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.390 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.390 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:18.390 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.874394+0000", 2024-04-19T02:16:18.391 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014848300000000001 2024-04-19T02:16:18.391 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.391 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.391 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:18.391 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.876474+0000", 2024-04-19T02:16:18.391 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020803060000000001 2024-04-19T02:16:18.391 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.391 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.391 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:18.391 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.890939+0000", 2024-04-19T02:16:18.391 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014464985 2024-04-19T02:16:18.391 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.391 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.391 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:18.392 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.890986+0000", 2024-04-19T02:16:18.392 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7321000000000003e-05 2024-04-19T02:16:18.392 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.392 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.392 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:18.392 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891027+0000", 2024-04-19T02:16:18.392 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0689999999999998e-05 2024-04-19T02:16:18.392 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:18.392 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:18.392 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:18.392 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.392 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.392 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:16519 5.f 5:fc30d3a1:::benchmark_data_smithi121_44835_object16518:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:18.392 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.880723+0000", 2024-04-19T02:16:18.393 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.435529070000001, 2024-04-19T02:16:18.393 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020492519000000001, 2024-04-19T02:16:18.393 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:18.393 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:18.393 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:18.393 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:18.393 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:18.393 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16519 2024-04-19T02:16:18.393 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.393 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:18.393 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.393 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:18.393 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880723+0000", 2024-04-19T02:16:18.393 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:18.393 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.394 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.394 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:18.394 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880723+0000", 2024-04-19T02:16:18.394 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:18.394 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.394 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.394 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:18.394 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880722+0000", 2024-04-19T02:16:18.394 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:18.394 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.394 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.394 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:18.394 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880794+0000", 2024-04-19T02:16:18.394 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1515999999999998e-05 2024-04-19T02:16:18.394 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.395 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:18.395 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880805+0000", 2024-04-19T02:16:18.395 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1353e-05 2024-04-19T02:16:18.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.395 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:18.395 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880812+0000", 2024-04-19T02:16:18.395 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1230000000000002e-06 2024-04-19T02:16:18.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.395 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:18.395 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.890954+0000", 2024-04-19T02:16:18.395 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010142253 2024-04-19T02:16:18.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.396 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:18.396 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891079+0000", 2024-04-19T02:16:18.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000124917 2024-04-19T02:16:18.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.396 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:18.396 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891218+0000", 2024-04-19T02:16:18.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000138715 2024-04-19T02:16:18.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.396 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:18.396 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.897321+0000", 2024-04-19T02:16:18.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0061026830000000002 2024-04-19T02:16:18.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.397 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:18.397 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901137+0000", 2024-04-19T02:16:18.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038161699999999998 2024-04-19T02:16:18.397 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.397 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.397 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:18.397 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901181+0000", 2024-04-19T02:16:18.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4362e-05 2024-04-19T02:16:18.397 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.397 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.397 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:18.397 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901215+0000", 2024-04-19T02:16:18.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3929e-05 2024-04-19T02:16:18.397 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:18.398 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:18.398 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:18.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.398 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:16520 5.f 5:f0474691:::benchmark_data_smithi121_44835_object16519:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:18.398 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.880833+0000", 2024-04-19T02:16:18.398 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.435419055000001, 2024-04-19T02:16:18.398 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020460160000000002, 2024-04-19T02:16:18.398 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:18.398 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:18.398 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:18.398 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:18.398 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:18.398 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16520 2024-04-19T02:16:18.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.399 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:18.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.399 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:18.399 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880833+0000", 2024-04-19T02:16:18.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:18.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.399 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:18.399 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880833+0000", 2024-04-19T02:16:18.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:18.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.399 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:18.399 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880832+0000", 2024-04-19T02:16:18.400 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:18.400 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.400 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.400 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:18.400 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880909+0000", 2024-04-19T02:16:18.400 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7095000000000006e-05 2024-04-19T02:16:18.400 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.400 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.400 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:18.400 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880919+0000", 2024-04-19T02:16:18.400 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8919999999999995e-06 2024-04-19T02:16:18.400 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.400 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.400 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:18.400 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880927+0000", 2024-04-19T02:16:18.401 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8809999999999996e-06 2024-04-19T02:16:18.401 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.401 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.401 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:18.401 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891901+0000", 2024-04-19T02:16:18.401 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010974263999999999 2024-04-19T02:16:18.401 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.401 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.401 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:18.401 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.892021+0000", 2024-04-19T02:16:18.401 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120074 2024-04-19T02:16:18.401 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.401 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.401 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:18.401 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.892165+0000", 2024-04-19T02:16:18.402 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014328600000000001 2024-04-19T02:16:18.402 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.402 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.402 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:18.402 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.897347+0000", 2024-04-19T02:16:18.402 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.005182603 2024-04-19T02:16:18.402 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.402 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.402 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:18.402 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901224+0000", 2024-04-19T02:16:18.402 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038767620000000002 2024-04-19T02:16:18.402 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.402 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.402 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:18.402 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901264+0000", 2024-04-19T02:16:18.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9579000000000002e-05 2024-04-19T02:16:18.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:18.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901293+0000", 2024-04-19T02:16:18.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9300999999999999e-05 2024-04-19T02:16:18.403 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:18.403 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:18.403 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:18.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.403 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:44167 5.7 5:ef4300c4:::benchmark_data_smithi121_44835_object44166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:18.403 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:09.853830+0000", 2024-04-19T02:16:18.403 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.4624215710000001, 2024-04-19T02:16:18.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020082104, 2024-04-19T02:16:18.404 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:18.404 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:18.404 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:18.404 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:18.404 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:18.404 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 44167 2024-04-19T02:16:18.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.404 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:18.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:18.404 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853830+0000", 2024-04-19T02:16:18.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:18.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:18.405 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853830+0000", 2024-04-19T02:16:18.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:18.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.405 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.405 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:18.405 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853829+0000", 2024-04-19T02:16:18.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:18.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.405 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.405 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:18.405 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853863+0000", 2024-04-19T02:16:18.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3151999999999997e-05 2024-04-19T02:16:18.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.405 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.405 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:18.406 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853873+0000", 2024-04-19T02:16:18.406 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0366e-05 2024-04-19T02:16:18.406 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.406 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:18.406 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853881+0000", 2024-04-19T02:16:18.406 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6539999999999999e-06 2024-04-19T02:16:18.406 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.406 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:18.406 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.859162+0000", 2024-04-19T02:16:18.406 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052810740000000002 2024-04-19T02:16:18.406 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.407 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:18.407 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.859303+0000", 2024-04-19T02:16:18.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000140975 2024-04-19T02:16:18.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.407 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:18.407 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.859460+0000", 2024-04-19T02:16:18.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015754199999999999 2024-04-19T02:16:18.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.407 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:18.407 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.865142+0000", 2024-04-19T02:16:18.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0056819130000000002 2024-04-19T02:16:18.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.408 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:18.408 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.873828+0000", 2024-04-19T02:16:18.408 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0086861799999999999 2024-04-19T02:16:18.408 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.408 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.408 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:18.408 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.873871+0000", 2024-04-19T02:16:18.408 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2624999999999999e-05 2024-04-19T02:16:18.408 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.408 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.408 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:18.409 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.873912+0000", 2024-04-19T02:16:18.409 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1486000000000002e-05 2024-04-19T02:16:18.409 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:18.409 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:18.409 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:18.409 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.409 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.409 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:51990 5.f 5:f3e38436:::benchmark_data_smithi121_44835_object51989:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T02:16:18.409 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:13.115474+0000", 2024-04-19T02:16:18.409 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.2007776420000003, 2024-04-19T02:16:18.409 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018801477, 2024-04-19T02:16:18.410 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:18.410 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:18.410 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:18.410 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:18.410 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:18.410 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 51990 2024-04-19T02:16:18.410 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.410 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:18.410 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.410 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:18.410 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.115474+0000", 2024-04-19T02:16:18.410 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:18.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.411 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:18.411 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.115474+0000", 2024-04-19T02:16:18.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:18.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.411 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:18.411 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.115473+0000", 2024-04-19T02:16:18.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:18.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.411 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:18.411 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.115570+0000", 2024-04-19T02:16:18.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6951000000000001e-05 2024-04-19T02:16:18.412 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.412 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:18.412 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.115576+0000", 2024-04-19T02:16:18.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8499999999999999e-06 2024-04-19T02:16:18.412 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.412 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:18.412 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.115581+0000", 2024-04-19T02:16:18.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4039999999999997e-06 2024-04-19T02:16:18.412 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.412 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:18.412 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.117248+0000", 2024-04-19T02:16:18.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001667349 2024-04-19T02:16:18.413 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.413 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.413 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:18.413 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.117340+0000", 2024-04-19T02:16:18.413 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1982000000000001e-05 2024-04-19T02:16:18.413 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.413 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.413 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:18.413 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.117423+0000", 2024-04-19T02:16:18.413 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2824999999999994e-05 2024-04-19T02:16:18.413 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.413 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.413 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:18.413 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.119873+0000", 2024-04-19T02:16:18.413 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0024502790000000001 2024-04-19T02:16:18.414 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.414 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.414 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:18.414 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.134198+0000", 2024-04-19T02:16:18.414 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014325361 2024-04-19T02:16:18.414 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.414 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.414 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:18.414 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.134243+0000", 2024-04-19T02:16:18.414 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4926000000000003e-05 2024-04-19T02:16:18.414 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.414 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.414 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:18.414 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.134276+0000", 2024-04-19T02:16:18.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.235e-05 2024-04-19T02:16:18.415 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:18.415 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:18.415 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:18.415 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.415 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.415 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:53042 5.f 5:f744ac14:::benchmark_data_smithi121_44835_object53041:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T02:16:18.415 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:13.560196+0000", 2024-04-19T02:16:18.415 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.756055752, 2024-04-19T02:16:18.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020122021, 2024-04-19T02:16:18.415 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:18.415 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:18.415 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:18.415 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:18.415 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:18.416 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 53042 2024-04-19T02:16:18.416 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.416 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:18.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.416 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:18.416 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560196+0000", 2024-04-19T02:16:18.416 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:18.416 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.416 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:18.416 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560196+0000", 2024-04-19T02:16:18.416 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:18.416 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.417 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:18.417 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560195+0000", 2024-04-19T02:16:18.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:18.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.417 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.417 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:18.417 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560255+0000", 2024-04-19T02:16:18.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9441000000000002e-05 2024-04-19T02:16:18.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.417 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.417 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:18.417 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560264+0000", 2024-04-19T02:16:18.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1130000000000007e-06 2024-04-19T02:16:18.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.417 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.418 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:18.418 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560271+0000", 2024-04-19T02:16:18.418 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9800000000000001e-06 2024-04-19T02:16:18.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.418 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:18.418 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560312+0000", 2024-04-19T02:16:18.418 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0828999999999998e-05 2024-04-19T02:16:18.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.418 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:18.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560456+0000", 2024-04-19T02:16:18.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014474799999999999 2024-04-19T02:16:18.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:18.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560591+0000", 2024-04-19T02:16:18.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013482699999999999 2024-04-19T02:16:18.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:18.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.564799+0000", 2024-04-19T02:16:18.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042080080000000001 2024-04-19T02:16:18.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.420 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:18.420 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580233+0000", 2024-04-19T02:16:18.420 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015433715000000001 2024-04-19T02:16:18.420 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.420 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.420 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:18.420 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580280+0000", 2024-04-19T02:16:18.420 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6465000000000003e-05 2024-04-19T02:16:18.420 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.420 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.420 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:18.420 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580318+0000", 2024-04-19T02:16:18.420 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8557999999999999e-05 2024-04-19T02:16:18.421 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:18.421 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:18.421 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:18.421 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.421 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.421 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:53044 5.7 5:ec8fd8f2:::benchmark_data_smithi121_44835_object53043:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T02:16:18.421 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:13.561281+0000", 2024-04-19T02:16:18.421 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.7549705500000004, 2024-04-19T02:16:18.421 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019133752, 2024-04-19T02:16:18.421 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:18.421 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:18.421 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:18.422 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:18.422 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:18.422 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 53044 2024-04-19T02:16:18.422 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.422 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:18.422 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.422 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:18.422 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.561281+0000", 2024-04-19T02:16:18.422 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:18.423 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.423 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.423 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:18.423 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.561281+0000", 2024-04-19T02:16:18.423 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:18.423 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.423 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.423 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:18.423 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.561270+0000", 2024-04-19T02:16:18.423 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999886 2024-04-19T02:16:18.424 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.424 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.424 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:18.424 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.561364+0000", 2024-04-19T02:16:18.424 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4721000000000003e-05 2024-04-19T02:16:18.424 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.424 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.424 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:18.424 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.561375+0000", 2024-04-19T02:16:18.424 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0900999999999999e-05 2024-04-19T02:16:18.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:18.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.561383+0000", 2024-04-19T02:16:18.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5460000000000003e-06 2024-04-19T02:16:18.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:18.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.562716+0000", 2024-04-19T02:16:18.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001333592 2024-04-19T02:16:18.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:18.426 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.562831+0000", 2024-04-19T02:16:18.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000114585 2024-04-19T02:16:18.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:18.426 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.562984+0000", 2024-04-19T02:16:18.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000152724 2024-04-19T02:16:18.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.427 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.427 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:18.427 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.571517+0000", 2024-04-19T02:16:18.427 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0085335199999999993 2024-04-19T02:16:18.427 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.427 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.427 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:18.427 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580332+0000", 2024-04-19T02:16:18.427 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0088147859999999998 2024-04-19T02:16:18.427 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.428 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.428 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:18.428 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580377+0000", 2024-04-19T02:16:18.428 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5293000000000002e-05 2024-04-19T02:16:18.428 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.428 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.428 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:18.428 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580415+0000", 2024-04-19T02:16:18.428 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7756999999999998e-05 2024-04-19T02:16:18.428 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:18.428 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:18.428 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:18.428 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.429 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.429 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:53407 5.d 5:b2c73a99:::benchmark_data_smithi121_44835_object53406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T02:16:18.429 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:13.715399+0000", 2024-04-19T02:16:18.429 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.6008529630000004, 2024-04-19T02:16:18.429 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018729579, 2024-04-19T02:16:18.429 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:18.429 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:18.429 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:18.429 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:18.429 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:18.429 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 53407 2024-04-19T02:16:18.429 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.430 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:18.430 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.430 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:18.430 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.715399+0000", 2024-04-19T02:16:18.430 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:18.430 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.430 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.430 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:18.430 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.715399+0000", 2024-04-19T02:16:18.430 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:18.430 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.431 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.431 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:18.431 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.715398+0000", 2024-04-19T02:16:18.431 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:18.431 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.431 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.431 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:18.431 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.715486+0000", 2024-04-19T02:16:18.431 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7865e-05 2024-04-19T02:16:18.431 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.431 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.431 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:18.432 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.715496+0000", 2024-04-19T02:16:18.432 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8349999999999999e-06 2024-04-19T02:16:18.432 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.432 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.432 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:18.432 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.715502+0000", 2024-04-19T02:16:18.432 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3369999999999996e-06 2024-04-19T02:16:18.432 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.432 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.432 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:18.432 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.723121+0000", 2024-04-19T02:16:18.432 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0076190479999999998 2024-04-19T02:16:18.433 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.433 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.433 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:18.433 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.723251+0000", 2024-04-19T02:16:18.433 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012975199999999999 2024-04-19T02:16:18.433 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.433 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.433 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:18.433 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.723388+0000", 2024-04-19T02:16:18.433 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000137398 2024-04-19T02:16:18.433 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.433 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.434 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:18.434 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.731564+0000", 2024-04-19T02:16:18.434 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0081755669999999999 2024-04-19T02:16:18.434 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.434 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.434 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:18.434 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.734060+0000", 2024-04-19T02:16:18.434 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002496547 2024-04-19T02:16:18.434 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.434 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.434 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:18.434 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.734105+0000", 2024-04-19T02:16:18.435 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4187999999999998e-05 2024-04-19T02:16:18.435 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:18.435 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:18.435 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:18.435 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.734128+0000", 2024-04-19T02:16:18.435 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3728999999999999e-05 2024-04-19T02:16:18.435 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:18.435 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:18.435 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:18.435 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:18.435 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:18.435 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:16:18.437 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:18.437+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:18.438 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:16:18.537 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:18.538+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:18.609 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:16:18.609 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:16:18.609 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:18.609 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:64274 5.b 5:da37bf14:::benchmark_data_smithi121_44835_object64273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:18.609 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:18.606607+0000", 2024-04-19T02:16:18.609 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0034080920000000002, 2024-04-19T02:16:18.609 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0034312600000000002, 2024-04-19T02:16:18.609 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:18.609 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:18.609 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:18.609 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:18.610 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:18.610 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 64274 2024-04-19T02:16:18.610 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:18.610 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:18.610 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:18.610 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:18.610 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.606607+0000", 2024-04-19T02:16:18.610 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:18.610 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:18.610 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:18.610 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:18.610 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.606607+0000", 2024-04-19T02:16:18.610 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:18.611 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:18.611 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:18.611 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:18.611 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.606606+0000", 2024-04-19T02:16:18.611 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:18.611 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:18.611 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:18.611 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:18.611 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.606678+0000", 2024-04-19T02:16:18.611 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1496999999999997e-05 2024-04-19T02:16:18.611 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:18.611 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:18.611 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:18.611 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.606687+0000", 2024-04-19T02:16:18.611 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0049999999999993e-06 2024-04-19T02:16:18.612 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:18.612 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:18.612 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:18.612 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.606695+0000", 2024-04-19T02:16:18.612 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2139999999999996e-06 2024-04-19T02:16:18.612 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:18.612 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:18.612 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:18.612 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.606733+0000", 2024-04-19T02:16:18.612 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8334999999999998e-05 2024-04-19T02:16:18.612 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:18.612 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:18.612 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:18.612 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.606865+0000", 2024-04-19T02:16:18.613 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013173699999999999 2024-04-19T02:16:18.613 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:18.613 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:18.613 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:18.613 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.607009+0000", 2024-04-19T02:16:18.613 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014399700000000001 2024-04-19T02:16:18.613 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:18.613 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:18.613 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:18.613 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.609647+0000", 2024-04-19T02:16:18.613 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00263795 2024-04-19T02:16:18.613 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:18.613 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:18.613 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:18.613 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:18.614 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:18.614 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:64277 5.4 5:27017ab0:::benchmark_data_smithi121_44835_object64276:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:18.614 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:18.608663+0000", 2024-04-19T02:16:18.614 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0013518670000000001, 2024-04-19T02:16:18.614 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0014366159999999999, 2024-04-19T02:16:18.614 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:18.614 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:18.614 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:18.614 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:18.614 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:18.614 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 64277 2024-04-19T02:16:18.614 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:18.614 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:18.614 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:18.615 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:18.615 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.608663+0000", 2024-04-19T02:16:18.615 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:18.615 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:18.615 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:18.615 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:18.615 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.608663+0000", 2024-04-19T02:16:18.615 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:18.615 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:18.615 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:18.615 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:18.615 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.608662+0000", 2024-04-19T02:16:18.615 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:18.615 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:18.615 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:18.616 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:18.616 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.608719+0000", 2024-04-19T02:16:18.616 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.6598999999999998e-05 2024-04-19T02:16:18.616 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:18.616 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:18.616 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:18.616 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.608728+0000", 2024-04-19T02:16:18.616 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2059999999999996e-06 2024-04-19T02:16:18.616 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:18.616 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:18.616 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:18.616 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.608733+0000", 2024-04-19T02:16:18.616 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.4829999999999999e-06 2024-04-19T02:16:18.616 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:18.616 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:18.617 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:18.617 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.608775+0000", 2024-04-19T02:16:18.617 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1162000000000003e-05 2024-04-19T02:16:18.617 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:18.617 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:18.617 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:18.617 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.608857+0000", 2024-04-19T02:16:18.617 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2848000000000004e-05 2024-04-19T02:16:18.617 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:18.617 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:18.617 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:18.617 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.608945+0000", 2024-04-19T02:16:18.617 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.7183999999999997e-05 2024-04-19T02:16:18.617 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:18.617 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:18.618 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:18.618 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:18.618 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:18.618 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:64278 5.8 5:1668c1af:::benchmark_data_smithi121_44835_object64277:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:18.618 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:18.609958+0000", 2024-04-19T02:16:18.618 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 5.6858999999999999e-05, 2024-04-19T02:16:18.618 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000186214, 2024-04-19T02:16:18.618 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:18.618 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "reached pg", 2024-04-19T02:16:18.618 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:18.618 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:18.618 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:18.618 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 64278 2024-04-19T02:16:18.618 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:18.618 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:18.619 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:18.619 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:18.619 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.609958+0000", 2024-04-19T02:16:18.619 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:18.619 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:18.619 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:18.619 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:18.619 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.609958+0000", 2024-04-19T02:16:18.619 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:18.619 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:18.619 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:18.619 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:18.619 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.609957+0000", 2024-04-19T02:16:18.619 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:18.619 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:18.619 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:18.620 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:18.620 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.609996+0000", 2024-04-19T02:16:18.620 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9273000000000002e-05 2024-04-19T02:16:18.620 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:18.620 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:18.620 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:18.620 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.610009+0000", 2024-04-19T02:16:18.620 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2366e-05 2024-04-19T02:16:18.620 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:18.620 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:18.620 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:18.620 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.610015+0000", 2024-04-19T02:16:18.620 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6329999999999999e-06 2024-04-19T02:16:18.620 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:18.621 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:18.621 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:18.621 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.610054+0000", 2024-04-19T02:16:18.621 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8991e-05 2024-04-19T02:16:18.621 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:18.621 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:18.621 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:18.621 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:18.621 INFO:teuthology.orchestra.run.smithi174.stdout: ], 2024-04-19T02:16:18.621 INFO:teuthology.orchestra.run.smithi174.stdout: "num_ops": 3 2024-04-19T02:16:18.621 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:16:18.624 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:16:18.668 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:18.668+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:18.739 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:18.739+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:18.792 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:16:18.792 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [], 2024-04-19T02:16:18.792 INFO:teuthology.orchestra.run.smithi174.stdout: "complaint_time": 30, 2024-04-19T02:16:18.792 INFO:teuthology.orchestra.run.smithi174.stdout: "num_blocked_ops": 0 2024-04-19T02:16:18.792 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:16:18.806 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:16:18.848 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:18.848+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:18.940 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:18.941+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:19.017 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:16:19.018 INFO:teuthology.orchestra.run.smithi174.stdout: "size": 20, 2024-04-19T02:16:19.018 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 600, 2024-04-19T02:16:19.018 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:16:19.018 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.018 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:10 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:19.018 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269877+0000", 2024-04-19T02:16:19.018 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 49.745894344, 2024-04-19T02:16:19.018 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020732751000000001, 2024-04-19T02:16:19.018 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:19.018 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:19.018 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:19.018 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.019 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:19.019 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269877+0000", 2024-04-19T02:16:19.019 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:19.019 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.019 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.019 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:19.019 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269877+0000", 2024-04-19T02:16:19.019 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:19.019 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.019 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.019 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:19.019 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269875+0000", 2024-04-19T02:16:19.019 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:19.019 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.020 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.020 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:19.020 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269891+0000", 2024-04-19T02:16:19.020 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.5494000000000001e-05 2024-04-19T02:16:19.020 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.020 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.020 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:19.020 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269903+0000", 2024-04-19T02:16:19.020 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2003e-05 2024-04-19T02:16:19.020 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.020 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.020 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:19.020 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269914+0000", 2024-04-19T02:16:19.021 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0947e-05 2024-04-19T02:16:19.021 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.021 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.021 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:19.021 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269971+0000", 2024-04-19T02:16:19.021 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7036000000000001e-05 2024-04-19T02:16:19.021 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.021 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.021 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:16:19.021 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269979+0000", 2024-04-19T02:16:19.021 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.6660000000000008e-06 2024-04-19T02:16:19.021 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.021 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.021 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:19.021 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284891+0000", 2024-04-19T02:16:19.022 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014912584 2024-04-19T02:16:19.022 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.022 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.022 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:19.022 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285213+0000", 2024-04-19T02:16:19.022 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00032172199999999998 2024-04-19T02:16:19.022 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.022 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.022 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:19.023 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285357+0000", 2024-04-19T02:16:19.023 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014367899999999999 2024-04-19T02:16:19.023 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.023 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.023 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:19.023 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288883+0000", 2024-04-19T02:16:19.023 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0035268719999999999 2024-04-19T02:16:19.023 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.023 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.023 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:19.023 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290537+0000", 2024-04-19T02:16:19.023 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016537399999999999 2024-04-19T02:16:19.023 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.024 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.024 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:19.024 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290576+0000", 2024-04-19T02:16:19.024 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9266e-05 2024-04-19T02:16:19.024 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.024 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.024 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:19.024 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290609+0000", 2024-04-19T02:16:19.024 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2818000000000003e-05 2024-04-19T02:16:19.024 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:19.024 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:19.024 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:19.024 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.024 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.024 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:11 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:19.025 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:19.025 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 49.745841423000002, 2024-04-19T02:16:19.025 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020352748, 2024-04-19T02:16:19.025 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:19.025 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:19.025 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:19.025 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.025 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:19.025 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:19.025 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:19.025 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.025 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.025 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:19.025 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:19.025 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:19.026 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.026 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.026 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:19.026 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:19.026 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:19.026 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.026 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.026 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:19.026 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269933+0000", 2024-04-19T02:16:19.026 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2169999999999996e-06 2024-04-19T02:16:19.026 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.026 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.026 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:19.026 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269940+0000", 2024-04-19T02:16:19.027 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1500000000000002e-06 2024-04-19T02:16:19.027 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.027 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.027 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:19.027 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269948+0000", 2024-04-19T02:16:19.027 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.8690000000000004e-06 2024-04-19T02:16:19.027 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.027 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.027 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:19.027 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:16:19.027 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2994999999999997e-05 2024-04-19T02:16:19.027 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.027 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.028 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:16:19.028 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269997+0000", 2024-04-19T02:16:19.028 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.9020000000000004e-06 2024-04-19T02:16:19.028 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.028 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.028 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:19.028 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.282729+0000", 2024-04-19T02:16:19.028 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.012732537 2024-04-19T02:16:19.028 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.028 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.028 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:19.028 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.282838+0000", 2024-04-19T02:16:19.028 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000108298 2024-04-19T02:16:19.028 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.028 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.029 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:19.029 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.283002+0000", 2024-04-19T02:16:19.029 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00016466300000000001 2024-04-19T02:16:19.029 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.029 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.029 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:19.029 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288708+0000", 2024-04-19T02:16:19.029 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.005705066 2024-04-19T02:16:19.029 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.029 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.029 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:19.029 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290215+0000", 2024-04-19T02:16:19.029 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0015075010000000001 2024-04-19T02:16:19.029 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.030 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.030 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:19.030 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290259+0000", 2024-04-19T02:16:19.030 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3711999999999998e-05 2024-04-19T02:16:19.030 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.030 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.030 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:19.030 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290282+0000", 2024-04-19T02:16:19.030 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3458000000000001e-05 2024-04-19T02:16:19.030 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:19.030 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:19.030 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:19.030 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.031 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.031 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:14 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:19.031 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:19.031 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 49.745807632999998, 2024-04-19T02:16:19.031 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020137202, 2024-04-19T02:16:19.031 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:19.031 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:19.031 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:19.031 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.031 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:19.031 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:19.031 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:19.031 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.031 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.032 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:19.032 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:19.032 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:19.032 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.032 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.032 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:19.032 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:19.032 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:19.032 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.032 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.032 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:19.032 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269971+0000", 2024-04-19T02:16:19.033 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.5459999999999992e-06 2024-04-19T02:16:19.033 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.033 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.033 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:19.033 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269979+0000", 2024-04-19T02:16:19.033 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9130000000000003e-06 2024-04-19T02:16:19.033 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.033 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.033 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:19.033 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269986+0000", 2024-04-19T02:16:19.033 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.3779999999999998e-06 2024-04-19T02:16:19.034 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.034 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.034 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:19.034 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270030+0000", 2024-04-19T02:16:19.034 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3982e-05 2024-04-19T02:16:19.034 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.034 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.034 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:16:19.034 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270034+0000", 2024-04-19T02:16:19.034 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1779999999999996e-06 2024-04-19T02:16:19.034 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.034 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.034 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:19.034 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.277870+0000", 2024-04-19T02:16:19.035 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0078362150000000005 2024-04-19T02:16:19.035 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.035 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.035 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:19.035 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.278216+0000", 2024-04-19T02:16:19.035 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00034634999999999999 2024-04-19T02:16:19.035 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.035 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.035 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:19.035 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.278732+0000", 2024-04-19T02:16:19.035 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00051536099999999999 2024-04-19T02:16:19.035 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.035 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.035 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:19.035 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.287694+0000", 2024-04-19T02:16:19.036 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0089621019999999996 2024-04-19T02:16:19.036 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.036 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.036 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:19.036 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290026+0000", 2024-04-19T02:16:19.036 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0023323139999999998 2024-04-19T02:16:19.036 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.036 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.036 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:19.036 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290067+0000", 2024-04-19T02:16:19.036 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1043e-05 2024-04-19T02:16:19.036 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.036 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.036 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:19.036 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290100+0000", 2024-04-19T02:16:19.037 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3278999999999998e-05 2024-04-19T02:16:19.037 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:19.037 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:19.037 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:19.037 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.037 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.037 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:19.037 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:19.037 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 49.745775840999997, 2024-04-19T02:16:19.037 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020731702000000001, 2024-04-19T02:16:19.037 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:19.037 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:19.038 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:19.038 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.038 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:19.038 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:19.038 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:19.038 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.038 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.038 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:19.038 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:19.038 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:19.038 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.039 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.039 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:19.039 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:19.039 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:19.039 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.039 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.039 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:19.039 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269998+0000", 2024-04-19T02:16:19.039 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7100000000000001e-06 2024-04-19T02:16:19.039 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.039 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.039 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:19.039 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270005+0000", 2024-04-19T02:16:19.039 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.241e-06 2024-04-19T02:16:19.040 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.040 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.040 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:19.040 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270011+0000", 2024-04-19T02:16:19.040 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6279999999999999e-06 2024-04-19T02:16:19.040 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.040 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.040 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:19.040 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270046+0000", 2024-04-19T02:16:19.040 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5173999999999999e-05 2024-04-19T02:16:19.040 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.040 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.040 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:19.040 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:19.040 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0019999999999997e-06 2024-04-19T02:16:19.040 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.041 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.041 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:19.041 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285619+0000", 2024-04-19T02:16:19.041 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015567391 2024-04-19T02:16:19.041 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.041 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.041 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:19.041 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285671+0000", 2024-04-19T02:16:19.041 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2460999999999998e-05 2024-04-19T02:16:19.041 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.041 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.041 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:19.041 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285775+0000", 2024-04-19T02:16:19.041 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000103389 2024-04-19T02:16:19.041 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.042 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.042 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:19.042 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288934+0000", 2024-04-19T02:16:19.042 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0031595859999999998 2024-04-19T02:16:19.042 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.042 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.042 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:19.042 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290650+0000", 2024-04-19T02:16:19.042 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001716242 2024-04-19T02:16:19.042 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.042 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.042 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:19.042 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290692+0000", 2024-04-19T02:16:19.042 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1910999999999999e-05 2024-04-19T02:16:19.043 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.043 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.043 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:19.043 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290727+0000", 2024-04-19T02:16:19.043 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4412000000000002e-05 2024-04-19T02:16:19.043 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:19.043 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:19.043 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:19.044 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.044 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.044 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:19.044 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270019+0000", 2024-04-19T02:16:19.044 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 49.745752246000002, 2024-04-19T02:16:19.044 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020572014999999999, 2024-04-19T02:16:19.044 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:19.044 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:19.044 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:19.044 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.044 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:19.044 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270019+0000", 2024-04-19T02:16:19.044 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:19.044 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.045 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.045 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:19.045 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270019+0000", 2024-04-19T02:16:19.045 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:19.045 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.045 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.045 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:19.045 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270018+0000", 2024-04-19T02:16:19.045 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:19.045 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.045 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.045 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:19.045 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270021+0000", 2024-04-19T02:16:19.045 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0319999999999999e-06 2024-04-19T02:16:19.046 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.046 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.046 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:19.046 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270028+0000", 2024-04-19T02:16:19.046 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6189999999999996e-06 2024-04-19T02:16:19.046 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.046 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.046 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:19.046 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270035+0000", 2024-04-19T02:16:19.046 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1690000000000003e-06 2024-04-19T02:16:19.046 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.046 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.046 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:19.046 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270078+0000", 2024-04-19T02:16:19.047 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3061e-05 2024-04-19T02:16:19.047 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.047 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.047 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:19.047 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270082+0000", 2024-04-19T02:16:19.047 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4510000000000002e-06 2024-04-19T02:16:19.047 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.047 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.047 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:19.047 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284354+0000", 2024-04-19T02:16:19.047 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014271588999999999 2024-04-19T02:16:19.047 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.047 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.047 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:19.048 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284497+0000", 2024-04-19T02:16:19.048 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014335800000000001 2024-04-19T02:16:19.048 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.048 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.048 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:19.048 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284626+0000", 2024-04-19T02:16:19.048 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000128744 2024-04-19T02:16:19.048 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.048 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.048 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:19.048 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288844+0000", 2024-04-19T02:16:19.048 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00421807 2024-04-19T02:16:19.048 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.048 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.048 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:19.048 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290508+0000", 2024-04-19T02:16:19.049 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001663774 2024-04-19T02:16:19.049 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.049 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.049 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:19.049 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290556+0000", 2024-04-19T02:16:19.049 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.7599999999999998e-05 2024-04-19T02:16:19.049 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.049 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.049 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:19.049 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290591+0000", 2024-04-19T02:16:19.049 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5034999999999999e-05 2024-04-19T02:16:19.049 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:19.049 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:19.049 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:19.049 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.050 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.050 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:19.050 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:19.050 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 49.745729382999997, 2024-04-19T02:16:19.050 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020192280999999999, 2024-04-19T02:16:19.050 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:19.050 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:19.050 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:19.050 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.050 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:19.050 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:19.050 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:19.050 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.050 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.051 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:19.051 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:19.051 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:19.051 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.051 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.051 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:19.051 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:19.051 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:19.051 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.051 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.051 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:19.051 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270045+0000", 2024-04-19T02:16:19.051 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8680000000000001e-06 2024-04-19T02:16:19.052 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.052 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.052 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:19.052 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270052+0000", 2024-04-19T02:16:19.052 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.9999999999999999e-06 2024-04-19T02:16:19.052 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.052 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.052 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:19.052 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270056+0000", 2024-04-19T02:16:19.052 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4479999999999996e-06 2024-04-19T02:16:19.052 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.052 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.052 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:19.052 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270089+0000", 2024-04-19T02:16:19.052 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3071000000000002e-05 2024-04-19T02:16:19.053 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.053 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.053 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:19.053 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270092+0000", 2024-04-19T02:16:19.053 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9780000000000001e-06 2024-04-19T02:16:19.053 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.053 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.053 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:19.053 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.280632+0000", 2024-04-19T02:16:19.053 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010539712 2024-04-19T02:16:19.053 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.054 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.054 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:19.054 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.280743+0000", 2024-04-19T02:16:19.054 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000111048 2024-04-19T02:16:19.054 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.054 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.054 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:19.054 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.281531+0000", 2024-04-19T02:16:19.054 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00078738199999999999 2024-04-19T02:16:19.054 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.054 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.054 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:19.054 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.287949+0000", 2024-04-19T02:16:19.055 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0064185730000000003 2024-04-19T02:16:19.055 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.055 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.055 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:19.055 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290184+0000", 2024-04-19T02:16:19.055 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0022350849999999999 2024-04-19T02:16:19.055 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.055 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.055 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:19.055 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290209+0000", 2024-04-19T02:16:19.055 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4907000000000001e-05 2024-04-19T02:16:19.055 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.055 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.055 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:19.055 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290234+0000", 2024-04-19T02:16:19.056 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4666999999999999e-05 2024-04-19T02:16:19.056 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:19.056 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:19.056 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:19.056 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.056 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.056 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:19 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:19.056 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:19.056 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 49.745707916999997, 2024-04-19T02:16:19.056 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020818203, 2024-04-19T02:16:19.056 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:19.056 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:19.056 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:19.056 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.056 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:19.056 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:19.057 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:19.057 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.057 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.057 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:19.057 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:19.057 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:19.057 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.057 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.057 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:19.057 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:19.057 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:19.057 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.057 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.058 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:19.058 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270065+0000", 2024-04-19T02:16:19.058 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4310000000000001e-06 2024-04-19T02:16:19.058 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.058 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.058 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:19.058 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270070+0000", 2024-04-19T02:16:19.058 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2859999999999999e-06 2024-04-19T02:16:19.058 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.058 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.058 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:19.058 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270077+0000", 2024-04-19T02:16:19.059 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5270000000000004e-06 2024-04-19T02:16:19.059 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.059 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.059 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:19.059 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270107+0000", 2024-04-19T02:16:19.059 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0205999999999998e-05 2024-04-19T02:16:19.059 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.059 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.059 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:19.059 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270111+0000", 2024-04-19T02:16:19.059 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8650000000000003e-06 2024-04-19T02:16:19.059 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.059 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.059 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:19.059 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285936+0000", 2024-04-19T02:16:19.060 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015824677999999998 2024-04-19T02:16:19.060 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.060 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.060 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:19.060 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286007+0000", 2024-04-19T02:16:19.060 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1157999999999999e-05 2024-04-19T02:16:19.060 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.060 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.060 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:19.061 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286086+0000", 2024-04-19T02:16:19.061 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9084000000000004e-05 2024-04-19T02:16:19.061 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.061 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.061 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:19.061 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290740+0000", 2024-04-19T02:16:19.061 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0046543679999999999 2024-04-19T02:16:19.061 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.061 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.061 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:19.061 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290833+0000", 2024-04-19T02:16:19.061 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2551000000000002e-05 2024-04-19T02:16:19.061 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.061 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.062 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:19.062 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290859+0000", 2024-04-19T02:16:19.062 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.6696999999999999e-05 2024-04-19T02:16:19.062 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.062 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.062 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:19.062 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290881+0000", 2024-04-19T02:16:19.062 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1653000000000001e-05 2024-04-19T02:16:19.062 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:19.062 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:19.063 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:19.063 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.063 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.063 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:19174 5.4 5:2f42d48e:::benchmark_data_smithi121_44835_object19173:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:19.063 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:00.712766+0000", 2024-04-19T02:16:19.063 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 18.303004677000001, 2024-04-19T02:16:19.063 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016423842000000001, 2024-04-19T02:16:19.063 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:19.063 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:19.063 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:19.064 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:19.064 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:19.064 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 19174 2024-04-19T02:16:19.064 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.064 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:19.064 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.064 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:19.065 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.712766+0000", 2024-04-19T02:16:19.065 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:19.065 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.065 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.065 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:19.065 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.712766+0000", 2024-04-19T02:16:19.065 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:19.066 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.066 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.066 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:19.066 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.712765+0000", 2024-04-19T02:16:19.066 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:19.066 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.067 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.067 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:19.067 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.712876+0000", 2024-04-19T02:16:19.067 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000110543 2024-04-19T02:16:19.067 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.067 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.067 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:19.068 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.712887+0000", 2024-04-19T02:16:19.068 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1420000000000001e-05 2024-04-19T02:16:19.068 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.068 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.068 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:19.068 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.712896+0000", 2024-04-19T02:16:19.069 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.4330000000000004e-06 2024-04-19T02:16:19.069 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.069 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.069 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:19.069 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.712923+0000", 2024-04-19T02:16:19.069 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7070999999999999e-05 2024-04-19T02:16:19.069 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.070 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.070 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:19.070 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.713005+0000", 2024-04-19T02:16:19.070 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2279000000000003e-05 2024-04-19T02:16:19.070 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.070 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.071 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:19.071 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.713094+0000", 2024-04-19T02:16:19.071 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.9251000000000003e-05 2024-04-19T02:16:19.071 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.071 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.071 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:19.072 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.714553+0000", 2024-04-19T02:16:19.072 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0014587339999999999 2024-04-19T02:16:19.072 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.072 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.072 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:19.072 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.729110+0000", 2024-04-19T02:16:19.073 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014557037 2024-04-19T02:16:19.073 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.073 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.073 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:19.073 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.729158+0000", 2024-04-19T02:16:19.074 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.829e-05 2024-04-19T02:16:19.074 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.074 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.074 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:19.074 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.729190+0000", 2024-04-19T02:16:19.074 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1673e-05 2024-04-19T02:16:19.075 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:19.075 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:19.075 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:19.075 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.075 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.076 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:31632 5.e 5:7c608c66:::benchmark_data_smithi121_44835_object31631:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-19T02:16:19.076 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:04.960320+0000", 2024-04-19T02:16:19.076 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 14.055451188999999, 2024-04-19T02:16:19.076 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016282966999999999, 2024-04-19T02:16:19.076 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:19.076 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:19.077 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:19.077 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:19.077 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:19.077 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 31632 2024-04-19T02:16:19.077 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.077 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:19.077 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.078 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:19.078 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.960320+0000", 2024-04-19T02:16:19.078 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:19.078 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.078 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.079 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:19.079 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.960320+0000", 2024-04-19T02:16:19.079 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:19.079 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.079 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.079 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:19.079 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.960319+0000", 2024-04-19T02:16:19.079 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:19.079 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.079 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.080 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:19.080 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.960359+0000", 2024-04-19T02:16:19.080 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0120999999999998e-05 2024-04-19T02:16:19.080 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.080 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.080 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:19.080 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.960370+0000", 2024-04-19T02:16:19.082 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1124999999999999e-05 2024-04-19T02:16:19.082 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.082 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.082 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:19.083 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.960376+0000", 2024-04-19T02:16:19.083 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.6840000000000001e-06 2024-04-19T02:16:19.083 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.083 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.083 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:19.083 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.965241+0000", 2024-04-19T02:16:19.084 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0048651709999999997 2024-04-19T02:16:19.084 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.084 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.084 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:19.084 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.965330+0000", 2024-04-19T02:16:19.084 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.9345999999999995e-05 2024-04-19T02:16:19.085 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.085 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.085 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:19.085 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.965409+0000", 2024-04-19T02:16:19.085 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.8757000000000005e-05 2024-04-19T02:16:19.085 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.086 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.086 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:19.086 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.966312+0000", 2024-04-19T02:16:19.086 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00090340199999999998 2024-04-19T02:16:19.086 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.086 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.087 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:19.087 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.976537+0000", 2024-04-19T02:16:19.087 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010224680999999999 2024-04-19T02:16:19.087 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.087 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.088 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:19.088 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.976580+0000", 2024-04-19T02:16:19.088 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3234e-05 2024-04-19T02:16:19.088 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.088 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.088 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:19.089 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.976603+0000", 2024-04-19T02:16:19.089 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.2421000000000001e-05 2024-04-19T02:16:19.089 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:19.089 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:19.089 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:19.089 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.090 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.090 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:42710 5.4 5:2c02047b:::benchmark_data_smithi121_44835_object42709:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:19.090 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:09.265091+0000", 2024-04-19T02:16:19.090 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 9.7506794409999991, 2024-04-19T02:16:19.090 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016523969999999999, 2024-04-19T02:16:19.090 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:19.091 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:19.091 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:19.091 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:19.091 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:19.091 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 42710 2024-04-19T02:16:19.091 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.092 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:19.092 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.092 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:19.092 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.265091+0000", 2024-04-19T02:16:19.092 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:19.092 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.093 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.093 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:19.093 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.265091+0000", 2024-04-19T02:16:19.093 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:19.093 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.093 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.094 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:19.094 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.265091+0000", 2024-04-19T02:16:19.094 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:19.095 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.095 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.095 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:19.095 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.265141+0000", 2024-04-19T02:16:19.095 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.9886000000000003e-05 2024-04-19T02:16:19.095 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.095 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.096 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:19.096 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.265148+0000", 2024-04-19T02:16:19.096 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3089999999999998e-06 2024-04-19T02:16:19.096 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.097 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.097 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:19.097 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.265152+0000", 2024-04-19T02:16:19.097 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.5730000000000001e-06 2024-04-19T02:16:19.097 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.097 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.098 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:19.098 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.266187+0000", 2024-04-19T02:16:19.098 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0010347080000000001 2024-04-19T02:16:19.098 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.098 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.098 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:19.099 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.266321+0000", 2024-04-19T02:16:19.099 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013432599999999999 2024-04-19T02:16:19.099 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.099 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.099 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:19.100 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.266452+0000", 2024-04-19T02:16:19.100 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013062600000000001 2024-04-19T02:16:19.100 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.100 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.101 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:19.101 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.267706+0000", 2024-04-19T02:16:19.101 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0012537609999999999 2024-04-19T02:16:19.101 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.101 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.101 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:19.101 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.281536+0000", 2024-04-19T02:16:19.101 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.01382972 2024-04-19T02:16:19.101 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.102 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.103 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:19.103 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.281571+0000", 2024-04-19T02:16:19.103 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5215000000000001e-05 2024-04-19T02:16:19.103 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.103 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.103 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:19.103 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.281615+0000", 2024-04-19T02:16:19.103 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4604000000000002e-05 2024-04-19T02:16:19.104 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:19.104 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:19.104 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:19.104 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.104 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.104 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:42724 5.0 5:0d0b7b99:::benchmark_data_smithi121_44835_object42723:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:19.104 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:09.270595+0000", 2024-04-19T02:16:19.104 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 9.7451756239999998, 2024-04-19T02:16:19.105 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.018445754000000002, 2024-04-19T02:16:19.105 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:19.105 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:19.105 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:19.105 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:19.105 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:19.106 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 42724 2024-04-19T02:16:19.106 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.106 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:19.106 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.106 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:19.106 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.270595+0000", 2024-04-19T02:16:19.106 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:19.107 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.107 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.107 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:19.107 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.270595+0000", 2024-04-19T02:16:19.107 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:19.107 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.107 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.107 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:19.107 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.270595+0000", 2024-04-19T02:16:19.108 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:19.108 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.108 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.108 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:19.108 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.270634+0000", 2024-04-19T02:16:19.108 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9270000000000002e-05 2024-04-19T02:16:19.108 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.108 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.108 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:19.108 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.270640+0000", 2024-04-19T02:16:19.108 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.8139999999999997e-06 2024-04-19T02:16:19.108 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.108 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.108 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:19.109 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.270645+0000", 2024-04-19T02:16:19.109 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.729e-06 2024-04-19T02:16:19.109 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.109 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.109 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:19.109 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.270676+0000", 2024-04-19T02:16:19.109 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1390000000000003e-05 2024-04-19T02:16:19.109 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.109 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.109 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:19.109 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.270808+0000", 2024-04-19T02:16:19.109 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013151699999999999 2024-04-19T02:16:19.109 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.110 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.110 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:19.110 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.270944+0000", 2024-04-19T02:16:19.110 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013695999999999999 2024-04-19T02:16:19.110 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.110 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.110 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:19.110 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.272565+0000", 2024-04-19T02:16:19.111 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016207179999999999 2024-04-19T02:16:19.111 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.111 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.111 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:19.111 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.288992+0000", 2024-04-19T02:16:19.111 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016426356 2024-04-19T02:16:19.111 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.111 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.112 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:19.112 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.289021+0000", 2024-04-19T02:16:19.112 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9257000000000001e-05 2024-04-19T02:16:19.112 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.112 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.112 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:19.112 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.289041+0000", 2024-04-19T02:16:19.112 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.0177999999999999e-05 2024-04-19T02:16:19.112 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:19.113 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:19.113 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:19.113 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.113 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.113 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:60896 5.4 5:2b0faee3:::benchmark_data_smithi121_44835_object60895:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:19.113 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:17.036092+0000", 2024-04-19T02:16:19.113 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 1.9796785300000002, 2024-04-19T02:16:19.114 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.018033583999999998, 2024-04-19T02:16:19.114 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:19.114 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:19.114 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:19.114 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:19.115 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:19.115 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 60896 2024-04-19T02:16:19.115 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.115 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:19.115 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.115 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:19.116 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.036092+0000", 2024-04-19T02:16:19.116 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:19.116 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.116 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.116 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:19.116 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.036092+0000", 2024-04-19T02:16:19.116 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:19.116 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.116 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.116 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:19.116 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.036092+0000", 2024-04-19T02:16:19.116 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:19.116 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.117 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.117 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:19.117 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.036210+0000", 2024-04-19T02:16:19.117 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011790000000000001 2024-04-19T02:16:19.117 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.117 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.117 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:19.117 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.036219+0000", 2024-04-19T02:16:19.117 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0829999999999993e-06 2024-04-19T02:16:19.117 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.117 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.117 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:19.117 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.036223+0000", 2024-04-19T02:16:19.118 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3869999999999997e-06 2024-04-19T02:16:19.118 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.118 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.118 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:19.118 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.036258+0000", 2024-04-19T02:16:19.118 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5281999999999999e-05 2024-04-19T02:16:19.118 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.118 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.118 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:19.118 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.036265+0000", 2024-04-19T02:16:19.118 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.1759999999999998e-06 2024-04-19T02:16:19.118 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.119 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.119 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:19.119 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.041984+0000", 2024-04-19T02:16:19.119 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0057195459999999998 2024-04-19T02:16:19.119 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.119 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.119 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:19.119 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.042102+0000", 2024-04-19T02:16:19.119 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000117507 2024-04-19T02:16:19.119 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.119 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.119 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:19.119 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.042217+0000", 2024-04-19T02:16:19.119 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011525 2024-04-19T02:16:19.120 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.120 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.120 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:19.120 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.044194+0000", 2024-04-19T02:16:19.120 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0019774530000000001 2024-04-19T02:16:19.120 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.120 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.120 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:19.120 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.054075+0000", 2024-04-19T02:16:19.120 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0098801619999999996 2024-04-19T02:16:19.120 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.120 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.120 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:19.121 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.054102+0000", 2024-04-19T02:16:19.121 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7580999999999999e-05 2024-04-19T02:16:19.121 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.121 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.121 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:19.121 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.054126+0000", 2024-04-19T02:16:19.121 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3816999999999999e-05 2024-04-19T02:16:19.121 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:19.121 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:19.121 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:19.121 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.121 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.121 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:61012 5.4 5:2eb475d7:::benchmark_data_smithi121_44835_object61011:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:19.121 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:17.090763+0000", 2024-04-19T02:16:19.121 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 1.9250082630000001, 2024-04-19T02:16:19.122 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016140597999999999, 2024-04-19T02:16:19.122 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:19.122 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:19.122 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:19.122 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:19.122 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:19.122 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 61012 2024-04-19T02:16:19.122 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.122 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:19.122 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.122 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:19.122 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.090763+0000", 2024-04-19T02:16:19.122 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:19.122 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.123 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.123 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:19.123 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.090763+0000", 2024-04-19T02:16:19.123 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:19.123 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.123 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.123 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:19.123 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.090762+0000", 2024-04-19T02:16:19.123 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:19.123 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.123 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.123 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:19.123 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.090825+0000", 2024-04-19T02:16:19.123 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.3163000000000005e-05 2024-04-19T02:16:19.123 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.123 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.124 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:19.124 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.090832+0000", 2024-04-19T02:16:19.124 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1709999999999996e-06 2024-04-19T02:16:19.124 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.124 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.124 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:19.124 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.090837+0000", 2024-04-19T02:16:19.124 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.7820000000000001e-06 2024-04-19T02:16:19.124 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.124 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.124 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:19.124 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.091325+0000", 2024-04-19T02:16:19.124 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00048796100000000003 2024-04-19T02:16:19.124 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.124 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.125 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:19.125 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.091413+0000", 2024-04-19T02:16:19.125 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.7830000000000004e-05 2024-04-19T02:16:19.125 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.125 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.125 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:19.125 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.091495+0000", 2024-04-19T02:16:19.125 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.1755000000000006e-05 2024-04-19T02:16:19.125 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.125 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.125 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:19.125 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.093717+0000", 2024-04-19T02:16:19.125 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.002222487 2024-04-19T02:16:19.125 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.125 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.126 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:19.126 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.106822+0000", 2024-04-19T02:16:19.126 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.013104985 2024-04-19T02:16:19.126 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.126 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.126 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:19.126 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.106867+0000", 2024-04-19T02:16:19.126 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4631e-05 2024-04-19T02:16:19.126 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.126 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.126 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:19.126 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.106903+0000", 2024-04-19T02:16:19.126 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6531e-05 2024-04-19T02:16:19.127 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:19.127 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:19.127 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:19.127 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.127 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.127 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:61282 5.4 5:2fadfcf7:::benchmark_data_smithi121_44835_object61281:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:19.127 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:17.218467+0000", 2024-04-19T02:16:19.127 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 1.797303576, 2024-04-19T02:16:19.127 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016694759999999999, 2024-04-19T02:16:19.127 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:19.127 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:19.127 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:19.127 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:19.127 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:19.128 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 61282 2024-04-19T02:16:19.128 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.128 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:19.128 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.128 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:19.128 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.218467+0000", 2024-04-19T02:16:19.128 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:19.128 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.128 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.128 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:19.128 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.218467+0000", 2024-04-19T02:16:19.128 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:19.128 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.128 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.128 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:19.129 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.218467+0000", 2024-04-19T02:16:19.129 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:19.129 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.129 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.129 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:19.129 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.218554+0000", 2024-04-19T02:16:19.129 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.7457e-05 2024-04-19T02:16:19.129 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.129 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.129 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:19.129 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.218561+0000", 2024-04-19T02:16:19.129 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3459999999999996e-06 2024-04-19T02:16:19.129 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.129 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.130 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:19.130 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.218566+0000", 2024-04-19T02:16:19.130 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2729999999999996e-06 2024-04-19T02:16:19.130 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.130 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.130 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:19.130 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.218607+0000", 2024-04-19T02:16:19.130 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1520999999999998e-05 2024-04-19T02:16:19.130 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.130 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.130 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:19.130 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.218740+0000", 2024-04-19T02:16:19.130 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013284700000000001 2024-04-19T02:16:19.130 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.131 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.131 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:19.131 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.218875+0000", 2024-04-19T02:16:19.131 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000135351 2024-04-19T02:16:19.131 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.131 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.131 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:19.131 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.220761+0000", 2024-04-19T02:16:19.131 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001885308 2024-04-19T02:16:19.131 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.131 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.131 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:19.131 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.235083+0000", 2024-04-19T02:16:19.131 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014322021000000001 2024-04-19T02:16:19.131 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.132 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.132 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:19.132 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.235128+0000", 2024-04-19T02:16:19.132 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.5673999999999997e-05 2024-04-19T02:16:19.132 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.132 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.132 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:19.132 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.235162+0000", 2024-04-19T02:16:19.132 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3710000000000001e-05 2024-04-19T02:16:19.132 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:19.132 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:19.132 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:19.132 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.132 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.133 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:61609 5.b 5:db1b645f:::benchmark_data_smithi121_44835_object61608:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:19.133 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:17.374769+0000", 2024-04-19T02:16:19.133 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 1.6410023069999999, 2024-04-19T02:16:19.133 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015724794, 2024-04-19T02:16:19.133 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:19.133 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:19.133 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:19.133 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:19.133 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:19.133 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 61609 2024-04-19T02:16:19.133 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.133 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:19.133 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.133 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:19.134 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.374769+0000", 2024-04-19T02:16:19.134 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:19.134 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.134 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.134 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:19.134 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.374769+0000", 2024-04-19T02:16:19.134 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:19.134 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.134 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.134 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:19.134 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.374766+0000", 2024-04-19T02:16:19.134 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999971 2024-04-19T02:16:19.134 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.134 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.135 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:19.135 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.374834+0000", 2024-04-19T02:16:19.135 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.8188999999999994e-05 2024-04-19T02:16:19.135 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.135 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.135 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:19.135 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.374839+0000", 2024-04-19T02:16:19.135 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.3430000000000003e-06 2024-04-19T02:16:19.135 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.135 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.135 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:19.135 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.374843+0000", 2024-04-19T02:16:19.135 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.817e-06 2024-04-19T02:16:19.135 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.136 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.136 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:19.136 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.379061+0000", 2024-04-19T02:16:19.136 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0042176330000000001 2024-04-19T02:16:19.136 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.136 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.136 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:19.136 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.379143+0000", 2024-04-19T02:16:19.136 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2508000000000004e-05 2024-04-19T02:16:19.136 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.136 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.136 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:19.136 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.379224+0000", 2024-04-19T02:16:19.136 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.1225999999999998e-05 2024-04-19T02:16:19.136 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.137 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.137 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:19.137 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.380670+0000", 2024-04-19T02:16:19.137 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0014457249999999999 2024-04-19T02:16:19.137 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.137 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.137 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:19.137 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.390420+0000", 2024-04-19T02:16:19.137 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0097497980000000005 2024-04-19T02:16:19.137 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.137 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.137 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:19.137 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.390464+0000", 2024-04-19T02:16:19.137 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3838999999999998e-05 2024-04-19T02:16:19.138 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.138 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.138 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:19.138 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.390493+0000", 2024-04-19T02:16:19.138 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9634000000000001e-05 2024-04-19T02:16:19.138 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:19.138 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:19.138 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:19.138 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.138 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.138 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:62720 5.e 5:7cb1d759:::benchmark_data_smithi121_44835_object62719:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:19.138 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:17.908658+0000", 2024-04-19T02:16:19.138 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 1.1071129529999999, 2024-04-19T02:16:19.138 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.017978524999999999, 2024-04-19T02:16:19.139 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:19.139 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:19.139 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:19.139 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:19.139 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:19.139 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 62720 2024-04-19T02:16:19.139 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.139 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:19.139 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.139 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:19.139 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.908658+0000", 2024-04-19T02:16:19.139 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:19.139 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.139 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.139 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:19.140 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.908658+0000", 2024-04-19T02:16:19.140 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:19.140 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.140 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.140 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:19.140 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.908657+0000", 2024-04-19T02:16:19.140 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:19.140 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.140 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.140 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:19.140 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.908718+0000", 2024-04-19T02:16:19.140 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.1202000000000001e-05 2024-04-19T02:16:19.140 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.140 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.140 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:19.141 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.908727+0000", 2024-04-19T02:16:19.141 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.7569999999999993e-06 2024-04-19T02:16:19.141 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.141 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.141 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:19.141 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.908734+0000", 2024-04-19T02:16:19.141 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.5140000000000004e-06 2024-04-19T02:16:19.141 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.141 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.141 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:19.141 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.913299+0000", 2024-04-19T02:16:19.141 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0045644580000000004 2024-04-19T02:16:19.141 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.141 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.141 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:19.142 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.913401+0000", 2024-04-19T02:16:19.142 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000101752 2024-04-19T02:16:19.142 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.142 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.142 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:19.142 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.913488+0000", 2024-04-19T02:16:19.142 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.7638000000000004e-05 2024-04-19T02:16:19.142 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.142 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.142 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:19.142 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.917152+0000", 2024-04-19T02:16:19.142 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0036635439999999999 2024-04-19T02:16:19.142 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.142 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.143 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:19.143 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.926554+0000", 2024-04-19T02:16:19.143 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0094018309999999994 2024-04-19T02:16:19.143 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.143 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.143 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:19.143 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.926604+0000", 2024-04-19T02:16:19.143 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0349000000000002e-05 2024-04-19T02:16:19.143 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.143 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.143 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:19.143 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.926636+0000", 2024-04-19T02:16:19.143 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2546999999999999e-05 2024-04-19T02:16:19.143 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:19.143 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:19.143 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:19.144 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.144 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.144 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:63397 5.8 5:18dd0e55:::benchmark_data_smithi121_44835_object63396:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:19.144 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:18.208493+0000", 2024-04-19T02:16:19.144 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.80727762000000003, 2024-04-19T02:16:19.144 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015430911, 2024-04-19T02:16:19.144 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:19.144 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:19.144 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:19.144 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:19.144 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:19.144 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 63397 2024-04-19T02:16:19.144 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.144 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:19.144 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.145 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:19.145 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.208493+0000", 2024-04-19T02:16:19.145 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:19.145 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.145 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.145 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:19.145 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.208493+0000", 2024-04-19T02:16:19.145 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:19.145 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.145 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.145 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:19.145 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.208493+0000", 2024-04-19T02:16:19.146 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:19.146 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.146 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.146 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:19.146 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.208563+0000", 2024-04-19T02:16:19.146 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.0428999999999999e-05 2024-04-19T02:16:19.146 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.146 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.146 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:19.146 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.208571+0000", 2024-04-19T02:16:19.146 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.52e-06 2024-04-19T02:16:19.146 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.146 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.147 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:19.147 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.208577+0000", 2024-04-19T02:16:19.147 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6200000000000001e-06 2024-04-19T02:16:19.147 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.147 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.147 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:19.147 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.210940+0000", 2024-04-19T02:16:19.147 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0023628799999999999 2024-04-19T02:16:19.147 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.147 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.147 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:19.147 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.211060+0000", 2024-04-19T02:16:19.147 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012032900000000001 2024-04-19T02:16:19.147 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.147 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.148 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:19.148 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.211206+0000", 2024-04-19T02:16:19.148 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014560500000000001 2024-04-19T02:16:19.148 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.148 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.148 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:19.148 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.214862+0000", 2024-04-19T02:16:19.148 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0036563440000000002 2024-04-19T02:16:19.148 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.148 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.148 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:19.148 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.223855+0000", 2024-04-19T02:16:19.148 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0089927229999999993 2024-04-19T02:16:19.148 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.149 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.149 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:19.149 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.223894+0000", 2024-04-19T02:16:19.149 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9141999999999999e-05 2024-04-19T02:16:19.149 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.149 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.149 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:19.149 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.223924+0000", 2024-04-19T02:16:19.149 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9896999999999999e-05 2024-04-19T02:16:19.149 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:19.149 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:19.149 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:19.149 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.149 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.149 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:63808 5.8 5:1b67bd69:::benchmark_data_smithi121_44835_object63807:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:19.149 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:18.396522+0000", 2024-04-19T02:16:19.150 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.61924891100000001, 2024-04-19T02:16:19.150 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016466654000000001, 2024-04-19T02:16:19.150 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:19.150 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:19.150 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:19.150 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:19.150 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:19.150 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 63808 2024-04-19T02:16:19.150 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.150 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:19.150 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.150 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:19.150 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.396522+0000", 2024-04-19T02:16:19.150 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:19.151 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.151 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.151 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:19.151 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.396522+0000", 2024-04-19T02:16:19.151 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:19.151 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.151 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.151 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:19.151 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.396522+0000", 2024-04-19T02:16:19.151 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:19.151 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.151 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.151 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:19.151 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.396594+0000", 2024-04-19T02:16:19.151 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1971999999999995e-05 2024-04-19T02:16:19.152 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.152 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.152 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:19.152 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.396598+0000", 2024-04-19T02:16:19.152 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1869999999999999e-06 2024-04-19T02:16:19.152 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.152 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.152 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:19.152 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.396601+0000", 2024-04-19T02:16:19.152 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.574e-06 2024-04-19T02:16:19.152 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.152 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.152 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:19.152 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.399860+0000", 2024-04-19T02:16:19.152 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0032583970000000001 2024-04-19T02:16:19.152 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.153 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.153 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:19.153 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.399941+0000", 2024-04-19T02:16:19.153 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.1163999999999997e-05 2024-04-19T02:16:19.153 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.153 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.153 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:19.153 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.400073+0000", 2024-04-19T02:16:19.153 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000131896 2024-04-19T02:16:19.153 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.153 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.153 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:19.153 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.404509+0000", 2024-04-19T02:16:19.153 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0044362270000000001 2024-04-19T02:16:19.154 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.154 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.154 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:19.154 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.412921+0000", 2024-04-19T02:16:19.154 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0084118390000000008 2024-04-19T02:16:19.154 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.154 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.154 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:19.154 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.412952+0000", 2024-04-19T02:16:19.154 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0797999999999999e-05 2024-04-19T02:16:19.154 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.154 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.154 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:19.154 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.412989+0000", 2024-04-19T02:16:19.154 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6934999999999998e-05 2024-04-19T02:16:19.155 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:19.155 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:19.155 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:19.155 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.155 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.155 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:63809 5.0 5:0a9105c3:::benchmark_data_smithi121_44835_object63808:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:19.155 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:18.396605+0000", 2024-04-19T02:16:19.155 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.61916584500000005, 2024-04-19T02:16:19.155 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016519550000000001, 2024-04-19T02:16:19.155 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:19.155 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:19.155 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:19.155 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:19.155 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:19.156 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 63809 2024-04-19T02:16:19.156 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.156 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:19.156 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.156 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:19.156 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.396605+0000", 2024-04-19T02:16:19.156 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:19.156 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.156 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.156 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:19.156 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.396605+0000", 2024-04-19T02:16:19.156 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:19.156 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.156 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.156 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:19.157 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.396605+0000", 2024-04-19T02:16:19.157 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:19.157 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.157 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.157 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:19.157 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.396644+0000", 2024-04-19T02:16:19.157 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8946000000000003e-05 2024-04-19T02:16:19.157 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.157 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.157 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:19.157 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.396649+0000", 2024-04-19T02:16:19.157 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.3290000000000001e-06 2024-04-19T02:16:19.157 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.157 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.157 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:19.158 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.396653+0000", 2024-04-19T02:16:19.158 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7100000000000001e-06 2024-04-19T02:16:19.158 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.158 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.158 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:19.158 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.399849+0000", 2024-04-19T02:16:19.158 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0031966249999999998 2024-04-19T02:16:19.158 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.158 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.158 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:19.158 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.399936+0000", 2024-04-19T02:16:19.158 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.7149000000000002e-05 2024-04-19T02:16:19.158 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.158 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.158 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:19.159 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.400017+0000", 2024-04-19T02:16:19.159 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0655999999999995e-05 2024-04-19T02:16:19.159 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.159 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.159 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:19.159 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.404512+0000", 2024-04-19T02:16:19.159 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0044944640000000001 2024-04-19T02:16:19.159 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.159 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.159 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:19.159 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.413045+0000", 2024-04-19T02:16:19.159 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0085334190000000004 2024-04-19T02:16:19.160 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.160 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.160 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:19.160 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.413086+0000", 2024-04-19T02:16:19.160 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1229000000000001e-05 2024-04-19T02:16:19.160 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.160 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.160 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:19.160 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.413125+0000", 2024-04-19T02:16:19.160 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8359000000000003e-05 2024-04-19T02:16:19.160 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:19.160 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:19.160 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:19.161 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.161 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.161 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:63933 5.e 5:7761bd09:::benchmark_data_smithi121_44835_object63932:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:19.161 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:18.451582+0000", 2024-04-19T02:16:19.161 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.56418858100000002, 2024-04-19T02:16:19.161 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.017963553, 2024-04-19T02:16:19.161 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:19.161 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:19.161 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:19.161 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:19.161 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:19.161 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 63933 2024-04-19T02:16:19.161 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.161 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:19.161 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.162 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:19.162 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.451582+0000", 2024-04-19T02:16:19.162 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:19.162 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.162 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.162 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:19.162 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.451582+0000", 2024-04-19T02:16:19.162 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:19.162 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.162 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.162 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:19.162 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.451581+0000", 2024-04-19T02:16:19.162 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:19.163 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.163 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.163 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:19.163 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.451663+0000", 2024-04-19T02:16:19.163 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.1151999999999998e-05 2024-04-19T02:16:19.163 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.163 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.163 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:19.163 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.451672+0000", 2024-04-19T02:16:19.163 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0250000000000008e-06 2024-04-19T02:16:19.163 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.163 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.163 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:19.163 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.451682+0000", 2024-04-19T02:16:19.163 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0135e-05 2024-04-19T02:16:19.164 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.164 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.164 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:19.164 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.453236+0000", 2024-04-19T02:16:19.164 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0015544910000000001 2024-04-19T02:16:19.164 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.164 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.164 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:19.164 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.453380+0000", 2024-04-19T02:16:19.164 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000143428 2024-04-19T02:16:19.164 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.164 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.164 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:19.164 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.453538+0000", 2024-04-19T02:16:19.164 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000158011 2024-04-19T02:16:19.165 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.165 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.165 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:19.165 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.456104+0000", 2024-04-19T02:16:19.165 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0025666539999999998 2024-04-19T02:16:19.165 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.165 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.165 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:19.165 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.469453+0000", 2024-04-19T02:16:19.165 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.013349145999999999 2024-04-19T02:16:19.165 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.165 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.165 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:19.165 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.469504+0000", 2024-04-19T02:16:19.166 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0900999999999999e-05 2024-04-19T02:16:19.166 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:19.166 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:19.166 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:19.166 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.469546+0000", 2024-04-19T02:16:19.166 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1430999999999997e-05 2024-04-19T02:16:19.166 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:19.166 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:19.166 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:19.166 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:19.166 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:19.166 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:16:19.167 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T02:16:19.167 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:16:19.168 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 24 16 65205 65189 169.75 138.312 0.00623532 0.00588808 2024-04-19T02:16:19.170 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:16:19.170 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:19.168+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:19.268 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:19.268+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:19.322 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:16:19.342 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:16:19.353 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-04-19T02:16:19.353 INFO:teuthology.orchestra.run.smithi177.stdout: "ops": [ 2024-04-19T02:16:19.353 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.353 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:65879 5.8 e26/16 5:10b00bb6:::benchmark_data_smithi121_44835_object65878:head v 26'4144, mlcod=26'4141)", 2024-04-19T02:16:19.353 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:19.349244+0000", 2024-04-19T02:16:19.353 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0038433579999999998, 2024-04-19T02:16:19.353 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0038678089999999998, 2024-04-19T02:16:19.353 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:19.354 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:19.354 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:19.354 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.354 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:19.354 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.349244+0000", 2024-04-19T02:16:19.354 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:19.354 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.354 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.354 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:19.354 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.349244+0000", 2024-04-19T02:16:19.354 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:19.354 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.354 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.354 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:19.354 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.349243+0000", 2024-04-19T02:16:19.355 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:19.355 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.355 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.355 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:19.355 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.349300+0000", 2024-04-19T02:16:19.355 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.6724000000000001e-05 2024-04-19T02:16:19.355 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.355 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.355 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:19.355 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.349308+0000", 2024-04-19T02:16:19.355 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.8760000000000005e-06 2024-04-19T02:16:19.355 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.355 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.355 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:19.356 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.349314+0000", 2024-04-19T02:16:19.356 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.9869999999999996e-06 2024-04-19T02:16:19.356 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.356 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.356 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:19.356 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.349351+0000", 2024-04-19T02:16:19.356 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.7734999999999997e-05 2024-04-19T02:16:19.356 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.356 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.356 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:19.356 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.349371+0000", 2024-04-19T02:16:19.356 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.9959999999999999e-05 2024-04-19T02:16:19.356 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:19.356 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:19.357 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:19.357 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.357 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.357 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:65880 5.c 5:3c5c3ebc:::benchmark_data_smithi121_44835_object65879:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:19.357 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:19.350674+0000", 2024-04-19T02:16:19.357 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0024125029999999999, 2024-04-19T02:16:19.357 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0025294430000000001, 2024-04-19T02:16:19.357 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:19.357 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:19.357 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:19.357 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:19.357 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:19.357 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 65880 2024-04-19T02:16:19.357 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.358 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:19.358 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.358 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:19.358 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.350674+0000", 2024-04-19T02:16:19.358 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:19.358 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.358 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.358 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:19.358 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.350674+0000", 2024-04-19T02:16:19.358 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:19.358 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.358 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.358 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:19.358 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.350673+0000", 2024-04-19T02:16:19.359 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:19.359 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.359 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.359 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:19.359 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.350705+0000", 2024-04-19T02:16:19.359 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.1180000000000003e-05 2024-04-19T02:16:19.359 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.359 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.359 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:19.359 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.350726+0000", 2024-04-19T02:16:19.359 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.145e-05 2024-04-19T02:16:19.359 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.359 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.359 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:19.359 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.350738+0000", 2024-04-19T02:16:19.360 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.2424e-05 2024-04-19T02:16:19.360 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.360 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.360 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:19.360 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.350950+0000", 2024-04-19T02:16:19.360 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00021160800000000001 2024-04-19T02:16:19.360 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.360 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.360 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:19.360 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.351084+0000", 2024-04-19T02:16:19.360 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00013373399999999999 2024-04-19T02:16:19.360 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.360 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.360 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:19.360 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.351228+0000", 2024-04-19T02:16:19.361 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000144697 2024-04-19T02:16:19.361 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:19.361 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:19.361 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:19.361 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.361 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.361 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:65883 5.3 5:c32d0ef1:::benchmark_data_smithi121_44835_object65882:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:19.361 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:19.350752+0000", 2024-04-19T02:16:19.361 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0023345100000000001, 2024-04-19T02:16:19.361 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0025115889999999998, 2024-04-19T02:16:19.361 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:19.361 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:19.361 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:19.362 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:19.362 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:19.362 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 65883 2024-04-19T02:16:19.362 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.362 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:19.362 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.362 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:19.362 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.350752+0000", 2024-04-19T02:16:19.362 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:19.362 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.362 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.362 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:19.362 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.350752+0000", 2024-04-19T02:16:19.362 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:19.363 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.363 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.363 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:19.363 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.350752+0000", 2024-04-19T02:16:19.363 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:19.363 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.363 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.363 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:19.363 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.350784+0000", 2024-04-19T02:16:19.363 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.2654000000000003e-05 2024-04-19T02:16:19.363 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.363 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.363 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:19.363 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.350796+0000", 2024-04-19T02:16:19.363 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.1267000000000001e-05 2024-04-19T02:16:19.364 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.364 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.364 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:19.364 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.350802+0000", 2024-04-19T02:16:19.364 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.4470000000000003e-06 2024-04-19T02:16:19.364 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.364 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.364 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:19.364 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.350843+0000", 2024-04-19T02:16:19.364 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.0457000000000002e-05 2024-04-19T02:16:19.364 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.364 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.364 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:19.365 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.350974+0000", 2024-04-19T02:16:19.365 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00013176600000000001 2024-04-19T02:16:19.365 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.365 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.365 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:19.365 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.351092+0000", 2024-04-19T02:16:19.365 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000117691 2024-04-19T02:16:19.365 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:19.365 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:19.365 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:19.365 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.365 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.365 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop_reply(client.4549.0:65869 5.c e26/16)", 2024-04-19T02:16:19.365 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:19.350827+0000", 2024-04-19T02:16:19.366 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0022600350000000001, 2024-04-19T02:16:19.366 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.002479555, 2024-04-19T02:16:19.366 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:19.366 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "queued for pg", 2024-04-19T02:16:19.366 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:19.366 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.366 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:19.366 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.350827+0000", 2024-04-19T02:16:19.366 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:19.366 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.366 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.366 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:19.366 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.350827+0000", 2024-04-19T02:16:19.366 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:19.367 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.367 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.367 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:19.367 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.350826+0000", 2024-04-19T02:16:19.367 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:19.367 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.367 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.367 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:19.367 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.350830+0000", 2024-04-19T02:16:19.367 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.1130000000000003e-06 2024-04-19T02:16:19.367 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.367 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.367 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:19.367 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.350838+0000", 2024-04-19T02:16:19.367 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.9910000000000002e-06 2024-04-19T02:16:19.368 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.368 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.368 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:19.368 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.350844+0000", 2024-04-19T02:16:19.368 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.835e-06 2024-04-19T02:16:19.368 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:19.368 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:19.368 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:19.368 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.368 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.368 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:65881 5.2 e26/16 5:44a3ce2c:::benchmark_data_smithi121_44835_object65880:head v 26'4142, mlcod=26'4140)", 2024-04-19T02:16:19.368 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:19.350850+0000", 2024-04-19T02:16:19.368 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0022368700000000002, 2024-04-19T02:16:19.368 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0024851700000000001, 2024-04-19T02:16:19.368 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:19.369 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:19.369 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:19.369 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.369 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:19.369 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.350850+0000", 2024-04-19T02:16:19.369 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:19.369 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.369 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.369 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:19.369 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.350850+0000", 2024-04-19T02:16:19.369 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:19.369 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.369 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.369 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:19.369 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.350850+0000", 2024-04-19T02:16:19.370 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:19.370 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.370 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.370 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:19.370 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.350885+0000", 2024-04-19T02:16:19.370 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.5549999999999997e-05 2024-04-19T02:16:19.370 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.370 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.370 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:19.370 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.350893+0000", 2024-04-19T02:16:19.370 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.554e-06 2024-04-19T02:16:19.370 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.370 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.370 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:19.370 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.350898+0000", 2024-04-19T02:16:19.371 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.2089999999999996e-06 2024-04-19T02:16:19.371 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.371 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.371 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:19.371 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.350974+0000", 2024-04-19T02:16:19.371 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.6057999999999996e-05 2024-04-19T02:16:19.371 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.371 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.371 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:19.371 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.350993+0000", 2024-04-19T02:16:19.371 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.9236e-05 2024-04-19T02:16:19.371 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:19.371 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:19.371 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:19.371 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.372 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.372 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:65884 5.3 5.749502c3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:19.372 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:19.351035+0000", 2024-04-19T02:16:19.372 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0020514410000000002, 2024-04-19T02:16:19.372 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0023319180000000001, 2024-04-19T02:16:19.372 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:19.372 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "queued for pg", 2024-04-19T02:16:19.372 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:19.372 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:19.372 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:19.372 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 65884 2024-04-19T02:16:19.372 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.372 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:19.372 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.372 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:19.373 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.351035+0000", 2024-04-19T02:16:19.373 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:19.373 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.373 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.373 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:19.373 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.351035+0000", 2024-04-19T02:16:19.373 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:19.373 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.373 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.373 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:19.373 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.351035+0000", 2024-04-19T02:16:19.373 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:19.373 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.373 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.373 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:19.373 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.351107+0000", 2024-04-19T02:16:19.374 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.1809000000000003e-05 2024-04-19T02:16:19.374 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.374 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.374 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:19.374 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.351117+0000", 2024-04-19T02:16:19.374 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0827e-05 2024-04-19T02:16:19.374 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.374 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.374 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:19.374 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.351126+0000", 2024-04-19T02:16:19.374 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.4419999999999998e-06 2024-04-19T02:16:19.374 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:19.374 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:19.374 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:19.375 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.375 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.375 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:65885 5.c 5.ab16106c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:19.375 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:19.351135+0000", 2024-04-19T02:16:19.375 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0019517079999999999, 2024-04-19T02:16:19.375 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0022621519999999999, 2024-04-19T02:16:19.375 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:19.375 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "queued for pg", 2024-04-19T02:16:19.375 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:19.375 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:19.375 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:19.375 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 65885 2024-04-19T02:16:19.375 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.375 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:19.376 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.376 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:19.376 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.351135+0000", 2024-04-19T02:16:19.376 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:19.376 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.376 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.376 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:19.376 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.351135+0000", 2024-04-19T02:16:19.376 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:19.376 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.376 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.376 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:19.376 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.351135+0000", 2024-04-19T02:16:19.377 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:19.377 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.377 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.377 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:19.377 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.351163+0000", 2024-04-19T02:16:19.377 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.8157000000000002e-05 2024-04-19T02:16:19.377 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.377 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.377 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:19.377 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.351170+0000", 2024-04-19T02:16:19.377 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.2919999999999998e-06 2024-04-19T02:16:19.377 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.377 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.377 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:19.377 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.351176+0000", 2024-04-19T02:16:19.377 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.3380000000000001e-06 2024-04-19T02:16:19.378 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:19.378 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:19.378 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:19.378 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.378 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.378 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:65886 5.a 5:54203afc:::benchmark_data_smithi121_44835_object65885:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:19.378 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:19.351183+0000", 2024-04-19T02:16:19.378 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.00190368, 2024-04-19T02:16:19.378 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0022465649999999998, 2024-04-19T02:16:19.378 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:19.378 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:19.378 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:19.378 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:19.378 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:19.379 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 65886 2024-04-19T02:16:19.379 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.379 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:19.379 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.379 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:19.379 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.351183+0000", 2024-04-19T02:16:19.379 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:19.379 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.379 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.379 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:19.379 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.351183+0000", 2024-04-19T02:16:19.379 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:19.379 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.380 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.380 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:19.380 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.351183+0000", 2024-04-19T02:16:19.380 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:19.380 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.380 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.380 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:19.380 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.351213+0000", 2024-04-19T02:16:19.380 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.0537999999999998e-05 2024-04-19T02:16:19.380 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.380 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.381 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:19.381 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.351221+0000", 2024-04-19T02:16:19.381 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.8480000000000001e-06 2024-04-19T02:16:19.381 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.381 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.381 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:19.381 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.351227+0000", 2024-04-19T02:16:19.381 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.5339999999999999e-06 2024-04-19T02:16:19.381 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.381 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.381 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:19.381 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.352900+0000", 2024-04-19T02:16:19.381 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00167358 2024-04-19T02:16:19.381 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.382 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.382 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:19.382 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.353003+0000", 2024-04-19T02:16:19.382 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00010317799999999999 2024-04-19T02:16:19.382 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.382 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.382 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:19.382 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.353089+0000", 2024-04-19T02:16:19.382 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.5382000000000003e-05 2024-04-19T02:16:19.382 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:19.382 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:19.382 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:19.382 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.382 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.382 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:65869 5.c 5:325ca015:::benchmark_data_smithi121_44835_object65868:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:19.383 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:19.343846+0000", 2024-04-19T02:16:19.383 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0092409180000000007, 2024-04-19T02:16:19.383 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0096284590000000007, 2024-04-19T02:16:19.383 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:19.383 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:19.383 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:19.383 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:19.383 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:19.383 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 65869 2024-04-19T02:16:19.383 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.383 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:19.383 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.383 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:19.383 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.343846+0000", 2024-04-19T02:16:19.383 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:19.384 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.384 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.384 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:19.384 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.343846+0000", 2024-04-19T02:16:19.384 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:19.384 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.384 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.384 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:19.384 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.343845+0000", 2024-04-19T02:16:19.384 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:19.384 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.384 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.384 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:19.384 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.343942+0000", 2024-04-19T02:16:19.384 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.6769999999999997e-05 2024-04-19T02:16:19.385 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.385 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.385 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:19.385 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.343951+0000", 2024-04-19T02:16:19.385 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.3720000000000005e-06 2024-04-19T02:16:19.385 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.385 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.385 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:19.385 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.343956+0000", 2024-04-19T02:16:19.385 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.6969999999999998e-06 2024-04-19T02:16:19.385 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.385 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.385 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:19.385 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.346113+0000", 2024-04-19T02:16:19.385 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0021568189999999999 2024-04-19T02:16:19.385 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.386 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.386 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:19.386 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.346268+0000", 2024-04-19T02:16:19.386 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000154582 2024-04-19T02:16:19.386 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.386 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.386 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:19.386 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.346424+0000", 2024-04-19T02:16:19.386 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00015648699999999999 2024-04-19T02:16:19.386 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:19.386 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:19.386 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:19.386 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.386 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.387 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:65871 5.a 5:54e4a96d:::benchmark_data_smithi121_44835_object65870:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:19.387 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:19.345659+0000", 2024-04-19T02:16:19.387 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0074276409999999996, 2024-04-19T02:16:19.387 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0078576800000000006, 2024-04-19T02:16:19.387 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:19.387 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:19.387 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:19.387 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:19.387 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:19.387 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 65871 2024-04-19T02:16:19.387 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.387 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:19.387 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.387 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:19.387 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.345659+0000", 2024-04-19T02:16:19.388 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:19.388 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.388 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.388 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:19.388 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.345659+0000", 2024-04-19T02:16:19.388 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:19.388 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.388 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.388 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:19.388 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.345659+0000", 2024-04-19T02:16:19.388 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:19.388 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.388 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.388 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:19.389 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.345719+0000", 2024-04-19T02:16:19.389 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.0241000000000001e-05 2024-04-19T02:16:19.389 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.389 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.389 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:19.389 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.345727+0000", 2024-04-19T02:16:19.389 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.3610000000000001e-06 2024-04-19T02:16:19.389 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.389 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.389 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:19.389 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.345733+0000", 2024-04-19T02:16:19.389 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.48e-06 2024-04-19T02:16:19.389 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.389 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.389 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:19.390 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.346115+0000", 2024-04-19T02:16:19.390 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00038261000000000002 2024-04-19T02:16:19.390 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.390 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.390 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:19.390 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.346212+0000", 2024-04-19T02:16:19.390 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.6601999999999994e-05 2024-04-19T02:16:19.390 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.390 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.390 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:19.390 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.346340+0000", 2024-04-19T02:16:19.390 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012792700000000001 2024-04-19T02:16:19.390 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.390 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.390 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:19.391 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.349234+0000", 2024-04-19T02:16:19.391 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0028937210000000001 2024-04-19T02:16:19.391 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:19.391 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:19.391 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:19.391 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.391 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.391 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:65875 5.8 e26/16 5:19943572:::benchmark_data_smithi121_44835_object65874:head v 26'4143, mlcod=26'4141)", 2024-04-19T02:16:19.391 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:19.346987+0000", 2024-04-19T02:16:19.391 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0060997079999999997, 2024-04-19T02:16:19.391 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0065739309999999999, 2024-04-19T02:16:19.392 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:19.392 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:19.392 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:19.392 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.392 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:19.392 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.346987+0000", 2024-04-19T02:16:19.392 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:19.392 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.392 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.392 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:19.392 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.346987+0000", 2024-04-19T02:16:19.392 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:19.393 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.393 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.393 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:19.393 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.346987+0000", 2024-04-19T02:16:19.393 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:19.393 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.393 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.393 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:19.393 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.347043+0000", 2024-04-19T02:16:19.393 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.6685999999999999e-05 2024-04-19T02:16:19.393 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.394 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.394 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:19.394 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.347052+0000", 2024-04-19T02:16:19.394 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.2539999999999992e-06 2024-04-19T02:16:19.394 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.394 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.394 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:19.394 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.347056+0000", 2024-04-19T02:16:19.394 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.5460000000000002e-06 2024-04-19T02:16:19.394 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.394 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.395 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:19.395 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.347086+0000", 2024-04-19T02:16:19.395 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.9572000000000001e-05 2024-04-19T02:16:19.395 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.395 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.395 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:19.395 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.347098+0000", 2024-04-19T02:16:19.395 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.2659e-05 2024-04-19T02:16:19.395 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:19.395 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:19.395 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:19.395 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.395 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.395 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:65874 5.7 e26/16 5:e93675a0:::benchmark_data_smithi121_44835_object65873:head v 26'4137, mlcod=26'4134)", 2024-04-19T02:16:19.396 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:19.347126+0000", 2024-04-19T02:16:19.396 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0059610890000000001, 2024-04-19T02:16:19.396 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0064757979999999996, 2024-04-19T02:16:19.396 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:19.396 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:19.396 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:19.396 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.396 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:19.396 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.347126+0000", 2024-04-19T02:16:19.396 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:19.397 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.397 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.397 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:19.397 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.347126+0000", 2024-04-19T02:16:19.397 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:19.397 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.397 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.397 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:19.397 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.347125+0000", 2024-04-19T02:16:19.397 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:19.397 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.397 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.397 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:19.398 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.347202+0000", 2024-04-19T02:16:19.398 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.6970000000000003e-05 2024-04-19T02:16:19.398 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.398 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.398 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:19.398 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.347213+0000", 2024-04-19T02:16:19.398 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.058e-05 2024-04-19T02:16:19.398 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.398 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.398 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:19.398 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.347220+0000", 2024-04-19T02:16:19.398 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.3170000000000004e-06 2024-04-19T02:16:19.398 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.398 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.399 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:19.399 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.347253+0000", 2024-04-19T02:16:19.399 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.3365999999999999e-05 2024-04-19T02:16:19.399 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.399 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.399 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:19.399 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.347274+0000", 2024-04-19T02:16:19.399 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.0335000000000001e-05 2024-04-19T02:16:19.399 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:19.399 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:19.399 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:19.399 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.400 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.400 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:65876 5.0 e26/16 5:0386038e:::benchmark_data_smithi121_44835_object65875:head v 26'4024, mlcod=26'4022)", 2024-04-19T02:16:19.400 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:19.347168+0000", 2024-04-19T02:16:19.400 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0059192150000000002, 2024-04-19T02:16:19.400 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0064872719999999997, 2024-04-19T02:16:19.400 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:19.400 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:19.400 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:19.400 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.400 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:19.400 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.347168+0000", 2024-04-19T02:16:19.401 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:19.401 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.401 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.401 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:19.401 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.347168+0000", 2024-04-19T02:16:19.401 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:19.401 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.401 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.401 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:19.401 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.347167+0000", 2024-04-19T02:16:19.401 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:19.401 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.402 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.402 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:19.402 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.347247+0000", 2024-04-19T02:16:19.402 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.9425999999999995e-05 2024-04-19T02:16:19.402 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.402 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.402 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:19.402 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.347255+0000", 2024-04-19T02:16:19.402 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.9780000000000005e-06 2024-04-19T02:16:19.402 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.402 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.402 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:19.402 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.347260+0000", 2024-04-19T02:16:19.402 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.4999999999999999e-06 2024-04-19T02:16:19.402 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.403 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.403 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:19.403 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.348712+0000", 2024-04-19T02:16:19.403 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00145214 2024-04-19T02:16:19.403 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.403 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.403 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:19.403 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.348732+0000", 2024-04-19T02:16:19.403 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.0089999999999999e-05 2024-04-19T02:16:19.403 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:19.403 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:19.403 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:19.403 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.403 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.403 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:65877 5.1 e26/16 5:85e3459a:::benchmark_data_smithi121_44835_object65876:head v 26'4003, mlcod=26'4001)", 2024-04-19T02:16:19.404 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:19.347454+0000", 2024-04-19T02:16:19.404 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0056329839999999997, 2024-04-19T02:16:19.404 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0062560970000000004, 2024-04-19T02:16:19.404 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:19.404 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:19.404 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:19.404 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.404 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:19.404 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.347454+0000", 2024-04-19T02:16:19.404 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:19.404 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.404 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.404 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:19.404 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.347454+0000", 2024-04-19T02:16:19.404 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:19.405 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.405 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.405 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:19.405 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.347453+0000", 2024-04-19T02:16:19.405 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:19.405 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.405 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.405 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:19.405 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.347526+0000", 2024-04-19T02:16:19.405 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.3069000000000001e-05 2024-04-19T02:16:19.405 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.405 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.405 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:19.405 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.347535+0000", 2024-04-19T02:16:19.405 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.1540000000000002e-06 2024-04-19T02:16:19.405 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.406 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.406 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:19.406 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.347540+0000", 2024-04-19T02:16:19.406 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.3380000000000004e-06 2024-04-19T02:16:19.406 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.406 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.406 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:19.406 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.347571+0000", 2024-04-19T02:16:19.406 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.1211000000000003e-05 2024-04-19T02:16:19.406 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.406 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.406 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:19.406 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.347590+0000", 2024-04-19T02:16:19.406 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.8732999999999998e-05 2024-04-19T02:16:19.406 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:19.407 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:19.407 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:19.407 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.407 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.407 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:65878 5.e e26/16 5:7a7bfc30:::benchmark_data_smithi121_44835_object65877:head v 26'4085, mlcod=26'4083)", 2024-04-19T02:16:19.407 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:19.348732+0000", 2024-04-19T02:16:19.407 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.004354826, 2024-04-19T02:16:19.407 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0050179279999999996, 2024-04-19T02:16:19.407 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:19.407 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:19.407 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:19.407 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.408 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:19.408 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.348732+0000", 2024-04-19T02:16:19.408 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:19.408 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.408 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.408 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:19.408 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.348732+0000", 2024-04-19T02:16:19.408 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:19.408 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.408 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.408 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:19.408 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.348732+0000", 2024-04-19T02:16:19.408 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:19.408 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.408 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.409 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:19.409 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.348784+0000", 2024-04-19T02:16:19.409 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.2417000000000003e-05 2024-04-19T02:16:19.409 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.409 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.409 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:19.409 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.348792+0000", 2024-04-19T02:16:19.409 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.4989999999999994e-06 2024-04-19T02:16:19.409 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.409 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.409 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:19.409 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.348799+0000", 2024-04-19T02:16:19.409 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.6930000000000001e-06 2024-04-19T02:16:19.409 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.409 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.410 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:19.410 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.348828+0000", 2024-04-19T02:16:19.410 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.9043e-05 2024-04-19T02:16:19.410 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:19.410 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:19.410 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:19.410 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.348844+0000", 2024-04-19T02:16:19.410 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.6019999999999999e-05 2024-04-19T02:16:19.410 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:19.410 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:19.410 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:19.410 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:19.410 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2024-04-19T02:16:19.411 INFO:teuthology.orchestra.run.smithi177.stdout: "num_ops": 15 2024-04-19T02:16:19.411 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-04-19T02:16:19.412 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2: {} 2024-04-19T02:16:19.412 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:19.412+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:19.413 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:16:19.414 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:16:19.414 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:16:19.414 INFO:teuthology.orchestra.run.smithi121.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:16:19.512 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:19.513+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:19.602 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:19.602 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:19.614 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:19.614+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:19.617 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:16:19.715 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:19.716+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:19.816 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:19.816+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:19.849 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:19.849 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:19.863 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:16:19.917 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:19.918+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:20.018 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:20.019+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:20.027 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 25 16 67330 67314 168.272 132.812 0.00278037 0.00593958 2024-04-19T02:16:20.033 INFO:teuthology.orchestra.run.smithi121.stderr:nodeep-scrub is set 2024-04-19T02:16:20.037 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:20.037 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:20.052 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:16:20.136 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:20.137+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:20.220 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:20.220+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:20.272 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:20.272 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:20.288 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:16:20.320 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:20.321+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:20.422 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:20.422+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:20.510 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:20.510 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:20.521 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:16:20.523 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:20.523+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:20.623 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:20.624+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:20.681 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:20.681 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:20.696 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:16:20.741 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:20.741+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:20.822 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-19T02:16:20.822 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T02:16:20.822 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-04-19T02:16:20.822 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-19T02:16:20.825 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:20.826+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:20.869 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:20.869 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:20.885 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:16:20.927 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:20.928+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:21.027 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 26 16 69550 69534 167.136 138.75 0.00543611 0.00598078 2024-04-19T02:16:21.027 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:21.027+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:21.101 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:21.101 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:21.115 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:16:21.127 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:21.128+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:21.167 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:16:21.167 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-04-19T02:16:21.167 INFO:teuthology.orchestra.run.smithi121.stdout: "epoch": 27, 2024-04-19T02:16:21.167 INFO:teuthology.orchestra.run.smithi121.stdout: "fsid": "f6ab5dd0-bb9f-4b48-a9fc-4728c7955ca8", 2024-04-19T02:16:21.167 INFO:teuthology.orchestra.run.smithi121.stdout: "created": "2024-04-19T02:15:13.539846+0000", 2024-04-19T02:16:21.167 INFO:teuthology.orchestra.run.smithi121.stdout: "modified": "2024-04-19T02:16:20.023933+0000", 2024-04-19T02:16:21.167 INFO:teuthology.orchestra.run.smithi121.stdout: "last_up_change": "2024-04-19T02:15:22.519568+0000", 2024-04-19T02:16:21.167 INFO:teuthology.orchestra.run.smithi121.stdout: "last_in_change": "2024-04-19T02:15:15.482624+0000", 2024-04-19T02:16:21.167 INFO:teuthology.orchestra.run.smithi121.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-19T02:16:21.167 INFO:teuthology.orchestra.run.smithi121.stdout: "flags_num": 5806080, 2024-04-19T02:16:21.168 INFO:teuthology.orchestra.run.smithi121.stdout: "flags_set": [ 2024-04-19T02:16:21.168 INFO:teuthology.orchestra.run.smithi121.stdout: "nodeep-scrub", 2024-04-19T02:16:21.168 INFO:teuthology.orchestra.run.smithi121.stdout: "noscrub", 2024-04-19T02:16:21.168 INFO:teuthology.orchestra.run.smithi121.stdout: "pglog_hardlimit", 2024-04-19T02:16:21.168 INFO:teuthology.orchestra.run.smithi121.stdout: "purged_snapdirs", 2024-04-19T02:16:21.168 INFO:teuthology.orchestra.run.smithi121.stdout: "recovery_deletes", 2024-04-19T02:16:21.168 INFO:teuthology.orchestra.run.smithi121.stdout: "sortbitwise" 2024-04-19T02:16:21.168 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-04-19T02:16:21.168 INFO:teuthology.orchestra.run.smithi121.stdout: "crush_version": 4, 2024-04-19T02:16:21.168 INFO:teuthology.orchestra.run.smithi121.stdout: "full_ratio": 0.94999998807907104, 2024-04-19T02:16:21.168 INFO:teuthology.orchestra.run.smithi121.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-19T02:16:21.168 INFO:teuthology.orchestra.run.smithi121.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-19T02:16:21.168 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_snapshot": "", 2024-04-19T02:16:21.168 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_max": 5, 2024-04-19T02:16:21.169 INFO:teuthology.orchestra.run.smithi121.stdout: "max_osd": 3, 2024-04-19T02:16:21.169 INFO:teuthology.orchestra.run.smithi121.stdout: "require_min_compat_client": "luminous", 2024-04-19T02:16:21.169 INFO:teuthology.orchestra.run.smithi121.stdout: "min_compat_client": "jewel", 2024-04-19T02:16:21.169 INFO:teuthology.orchestra.run.smithi121.stdout: "require_osd_release": "reef", 2024-04-19T02:16:21.169 INFO:teuthology.orchestra.run.smithi121.stdout: "allow_crimson": false, 2024-04-19T02:16:21.169 INFO:teuthology.orchestra.run.smithi121.stdout: "pools": [ 2024-04-19T02:16:21.169 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:21.169 INFO:teuthology.orchestra.run.smithi121.stdout: "pool": 1, 2024-04-19T02:16:21.169 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_name": ".mgr", 2024-04-19T02:16:21.169 INFO:teuthology.orchestra.run.smithi121.stdout: "create_time": "2024-04-19T02:15:22.776125+0000", 2024-04-19T02:16:21.169 INFO:teuthology.orchestra.run.smithi121.stdout: "flags": 1, 2024-04-19T02:16:21.169 INFO:teuthology.orchestra.run.smithi121.stdout: "flags_names": "hashpspool", 2024-04-19T02:16:21.169 INFO:teuthology.orchestra.run.smithi121.stdout: "type": 1, 2024-04-19T02:16:21.169 INFO:teuthology.orchestra.run.smithi121.stdout: "size": 2, 2024-04-19T02:16:21.170 INFO:teuthology.orchestra.run.smithi121.stdout: "min_size": 1, 2024-04-19T02:16:21.170 INFO:teuthology.orchestra.run.smithi121.stdout: "crush_rule": 0, 2024-04-19T02:16:21.170 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_count": 0, 2024-04-19T02:16:21.170 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_target": 0, 2024-04-19T02:16:21.170 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T02:16:21.170 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T02:16:21.170 INFO:teuthology.orchestra.run.smithi121.stdout: "object_hash": 2, 2024-04-19T02:16:21.170 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_autoscale_mode": "off", 2024-04-19T02:16:21.170 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num": 1, 2024-04-19T02:16:21.170 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_placement_num": 1, 2024-04-19T02:16:21.170 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_placement_num_target": 1, 2024-04-19T02:16:21.170 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_target": 1, 2024-04-19T02:16:21.170 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_pending": 1, 2024-04-19T02:16:21.170 INFO:teuthology.orchestra.run.smithi121.stdout: "last_pg_merge_meta": { 2024-04-19T02:16:21.171 INFO:teuthology.orchestra.run.smithi121.stdout: "source_pgid": "0.0", 2024-04-19T02:16:21.171 INFO:teuthology.orchestra.run.smithi121.stdout: "ready_epoch": 0, 2024-04-19T02:16:21.171 INFO:teuthology.orchestra.run.smithi121.stdout: "last_epoch_started": 0, 2024-04-19T02:16:21.171 INFO:teuthology.orchestra.run.smithi121.stdout: "last_epoch_clean": 0, 2024-04-19T02:16:21.171 INFO:teuthology.orchestra.run.smithi121.stdout: "source_version": "0'0", 2024-04-19T02:16:21.171 INFO:teuthology.orchestra.run.smithi121.stdout: "target_version": "0'0" 2024-04-19T02:16:21.171 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:21.171 INFO:teuthology.orchestra.run.smithi121.stdout: "last_change": "11", 2024-04-19T02:16:21.171 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend": "0", 2024-04-19T02:16:21.171 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T02:16:21.171 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T02:16:21.171 INFO:teuthology.orchestra.run.smithi121.stdout: "auid": 0, 2024-04-19T02:16:21.171 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_mode": "selfmanaged", 2024-04-19T02:16:21.171 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_seq": 0, 2024-04-19T02:16:21.172 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_epoch": 0, 2024-04-19T02:16:21.172 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_snaps": [], 2024-04-19T02:16:21.172 INFO:teuthology.orchestra.run.smithi121.stdout: "removed_snaps": "[]", 2024-04-19T02:16:21.172 INFO:teuthology.orchestra.run.smithi121.stdout: "quota_max_bytes": 0, 2024-04-19T02:16:21.172 INFO:teuthology.orchestra.run.smithi121.stdout: "quota_max_objects": 0, 2024-04-19T02:16:21.172 INFO:teuthology.orchestra.run.smithi121.stdout: "tiers": [], 2024-04-19T02:16:21.172 INFO:teuthology.orchestra.run.smithi121.stdout: "tier_of": -1, 2024-04-19T02:16:21.172 INFO:teuthology.orchestra.run.smithi121.stdout: "read_tier": -1, 2024-04-19T02:16:21.172 INFO:teuthology.orchestra.run.smithi121.stdout: "write_tier": -1, 2024-04-19T02:16:21.172 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_mode": "none", 2024-04-19T02:16:21.172 INFO:teuthology.orchestra.run.smithi121.stdout: "target_max_bytes": 0, 2024-04-19T02:16:21.172 INFO:teuthology.orchestra.run.smithi121.stdout: "target_max_objects": 0, 2024-04-19T02:16:21.172 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T02:16:21.172 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T02:16:21.172 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T02:16:21.173 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_min_flush_age": 0, 2024-04-19T02:16:21.173 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_min_evict_age": 0, 2024-04-19T02:16:21.173 INFO:teuthology.orchestra.run.smithi121.stdout: "erasure_code_profile": "", 2024-04-19T02:16:21.173 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_params": { 2024-04-19T02:16:21.173 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "none" 2024-04-19T02:16:21.173 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:21.173 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_period": 0, 2024-04-19T02:16:21.173 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_count": 0, 2024-04-19T02:16:21.173 INFO:teuthology.orchestra.run.smithi121.stdout: "use_gmt_hitset": true, 2024-04-19T02:16:21.173 INFO:teuthology.orchestra.run.smithi121.stdout: "min_read_recency_for_promote": 0, 2024-04-19T02:16:21.173 INFO:teuthology.orchestra.run.smithi121.stdout: "min_write_recency_for_promote": 0, 2024-04-19T02:16:21.173 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T02:16:21.173 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_search_last_n": 0, 2024-04-19T02:16:21.173 INFO:teuthology.orchestra.run.smithi121.stdout: "grade_table": [], 2024-04-19T02:16:21.173 INFO:teuthology.orchestra.run.smithi121.stdout: "stripe_width": 0, 2024-04-19T02:16:21.174 INFO:teuthology.orchestra.run.smithi121.stdout: "expected_num_objects": 0, 2024-04-19T02:16:21.174 INFO:teuthology.orchestra.run.smithi121.stdout: "fast_read": false, 2024-04-19T02:16:21.174 INFO:teuthology.orchestra.run.smithi121.stdout: "options": { 2024-04-19T02:16:21.174 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_max": 32, 2024-04-19T02:16:21.174 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_min": 1 2024-04-19T02:16:21.174 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:21.174 INFO:teuthology.orchestra.run.smithi121.stdout: "application_metadata": { 2024-04-19T02:16:21.174 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": {} 2024-04-19T02:16:21.174 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:21.174 INFO:teuthology.orchestra.run.smithi121.stdout: "read_balance": { 2024-04-19T02:16:21.174 INFO:teuthology.orchestra.run.smithi121.stdout: "score_acting": 2.9900000095367432, 2024-04-19T02:16:21.174 INFO:teuthology.orchestra.run.smithi121.stdout: "score_stable": 2.9900000095367432, 2024-04-19T02:16:21.174 INFO:teuthology.orchestra.run.smithi121.stdout: "optimal_score": 0.67000001668930054, 2024-04-19T02:16:21.174 INFO:teuthology.orchestra.run.smithi121.stdout: "raw_score_acting": 2, 2024-04-19T02:16:21.175 INFO:teuthology.orchestra.run.smithi121.stdout: "raw_score_stable": 2, 2024-04-19T02:16:21.175 INFO:teuthology.orchestra.run.smithi121.stdout: "primary_affinity_weighted": 0.90409350395202637, 2024-04-19T02:16:21.175 INFO:teuthology.orchestra.run.smithi121.stdout: "average_primary_affinity": 0.89999997615814209, 2024-04-19T02:16:21.175 INFO:teuthology.orchestra.run.smithi121.stdout: "average_primary_affinity_weighted": 0.89999997615814209 2024-04-19T02:16:21.175 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:21.175 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:21.175 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:21.175 INFO:teuthology.orchestra.run.smithi121.stdout: "pool": 2, 2024-04-19T02:16:21.175 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_name": "rbd", 2024-04-19T02:16:21.175 INFO:teuthology.orchestra.run.smithi121.stdout: "create_time": "2024-04-19T02:15:23.264005+0000", 2024-04-19T02:16:21.175 INFO:teuthology.orchestra.run.smithi121.stdout: "flags": 1, 2024-04-19T02:16:21.175 INFO:teuthology.orchestra.run.smithi121.stdout: "flags_names": "hashpspool", 2024-04-19T02:16:21.175 INFO:teuthology.orchestra.run.smithi121.stdout: "type": 1, 2024-04-19T02:16:21.175 INFO:teuthology.orchestra.run.smithi121.stdout: "size": 2, 2024-04-19T02:16:21.176 INFO:teuthology.orchestra.run.smithi121.stdout: "min_size": 1, 2024-04-19T02:16:21.176 INFO:teuthology.orchestra.run.smithi121.stdout: "crush_rule": 0, 2024-04-19T02:16:21.176 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_count": 0, 2024-04-19T02:16:21.176 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_target": 0, 2024-04-19T02:16:21.176 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T02:16:21.176 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T02:16:21.176 INFO:teuthology.orchestra.run.smithi121.stdout: "object_hash": 2, 2024-04-19T02:16:21.176 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_autoscale_mode": "off", 2024-04-19T02:16:21.176 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num": 8, 2024-04-19T02:16:21.176 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_placement_num": 8, 2024-04-19T02:16:21.176 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_placement_num_target": 8, 2024-04-19T02:16:21.176 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_target": 8, 2024-04-19T02:16:21.176 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_pending": 8, 2024-04-19T02:16:21.176 INFO:teuthology.orchestra.run.smithi121.stdout: "last_pg_merge_meta": { 2024-04-19T02:16:21.177 INFO:teuthology.orchestra.run.smithi121.stdout: "source_pgid": "0.0", 2024-04-19T02:16:21.177 INFO:teuthology.orchestra.run.smithi121.stdout: "ready_epoch": 0, 2024-04-19T02:16:21.177 INFO:teuthology.orchestra.run.smithi121.stdout: "last_epoch_started": 0, 2024-04-19T02:16:21.177 INFO:teuthology.orchestra.run.smithi121.stdout: "last_epoch_clean": 0, 2024-04-19T02:16:21.177 INFO:teuthology.orchestra.run.smithi121.stdout: "source_version": "0'0", 2024-04-19T02:16:21.177 INFO:teuthology.orchestra.run.smithi121.stdout: "target_version": "0'0" 2024-04-19T02:16:21.177 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:21.177 INFO:teuthology.orchestra.run.smithi121.stdout: "last_change": "11", 2024-04-19T02:16:21.177 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend": "0", 2024-04-19T02:16:21.177 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T02:16:21.177 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T02:16:21.177 INFO:teuthology.orchestra.run.smithi121.stdout: "auid": 0, 2024-04-19T02:16:21.177 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_mode": "selfmanaged", 2024-04-19T02:16:21.177 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_seq": 0, 2024-04-19T02:16:21.177 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_epoch": 0, 2024-04-19T02:16:21.178 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_snaps": [], 2024-04-19T02:16:21.178 INFO:teuthology.orchestra.run.smithi121.stdout: "removed_snaps": "[]", 2024-04-19T02:16:21.178 INFO:teuthology.orchestra.run.smithi121.stdout: "quota_max_bytes": 0, 2024-04-19T02:16:21.178 INFO:teuthology.orchestra.run.smithi121.stdout: "quota_max_objects": 0, 2024-04-19T02:16:21.178 INFO:teuthology.orchestra.run.smithi121.stdout: "tiers": [], 2024-04-19T02:16:21.178 INFO:teuthology.orchestra.run.smithi121.stdout: "tier_of": -1, 2024-04-19T02:16:21.178 INFO:teuthology.orchestra.run.smithi121.stdout: "read_tier": -1, 2024-04-19T02:16:21.178 INFO:teuthology.orchestra.run.smithi121.stdout: "write_tier": -1, 2024-04-19T02:16:21.178 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_mode": "none", 2024-04-19T02:16:21.178 INFO:teuthology.orchestra.run.smithi121.stdout: "target_max_bytes": 0, 2024-04-19T02:16:21.178 INFO:teuthology.orchestra.run.smithi121.stdout: "target_max_objects": 0, 2024-04-19T02:16:21.178 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T02:16:21.178 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T02:16:21.178 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T02:16:21.179 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_min_flush_age": 0, 2024-04-19T02:16:21.179 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_min_evict_age": 0, 2024-04-19T02:16:21.179 INFO:teuthology.orchestra.run.smithi121.stdout: "erasure_code_profile": "", 2024-04-19T02:16:21.179 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_params": { 2024-04-19T02:16:21.179 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "none" 2024-04-19T02:16:21.179 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:21.179 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_period": 0, 2024-04-19T02:16:21.179 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_count": 0, 2024-04-19T02:16:21.179 INFO:teuthology.orchestra.run.smithi121.stdout: "use_gmt_hitset": true, 2024-04-19T02:16:21.179 INFO:teuthology.orchestra.run.smithi121.stdout: "min_read_recency_for_promote": 0, 2024-04-19T02:16:21.179 INFO:teuthology.orchestra.run.smithi121.stdout: "min_write_recency_for_promote": 0, 2024-04-19T02:16:21.179 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T02:16:21.179 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_search_last_n": 0, 2024-04-19T02:16:21.179 INFO:teuthology.orchestra.run.smithi121.stdout: "grade_table": [], 2024-04-19T02:16:21.179 INFO:teuthology.orchestra.run.smithi121.stdout: "stripe_width": 0, 2024-04-19T02:16:21.180 INFO:teuthology.orchestra.run.smithi121.stdout: "expected_num_objects": 0, 2024-04-19T02:16:21.180 INFO:teuthology.orchestra.run.smithi121.stdout: "fast_read": false, 2024-04-19T02:16:21.180 INFO:teuthology.orchestra.run.smithi121.stdout: "options": {}, 2024-04-19T02:16:21.180 INFO:teuthology.orchestra.run.smithi121.stdout: "application_metadata": { 2024-04-19T02:16:21.180 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd": {} 2024-04-19T02:16:21.180 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:21.180 INFO:teuthology.orchestra.run.smithi121.stdout: "read_balance": { 2024-04-19T02:16:21.180 INFO:teuthology.orchestra.run.smithi121.stdout: "score_acting": 1.5, 2024-04-19T02:16:21.180 INFO:teuthology.orchestra.run.smithi121.stdout: "score_stable": 1.5, 2024-04-19T02:16:21.180 INFO:teuthology.orchestra.run.smithi121.stdout: "optimal_score": 1, 2024-04-19T02:16:21.180 INFO:teuthology.orchestra.run.smithi121.stdout: "raw_score_acting": 1.5, 2024-04-19T02:16:21.180 INFO:teuthology.orchestra.run.smithi121.stdout: "raw_score_stable": 1.5, 2024-04-19T02:16:21.180 INFO:teuthology.orchestra.run.smithi121.stdout: "primary_affinity_weighted": 0.90409350395202637, 2024-04-19T02:16:21.181 INFO:teuthology.orchestra.run.smithi121.stdout: "average_primary_affinity": 0.89999997615814209, 2024-04-19T02:16:21.181 INFO:teuthology.orchestra.run.smithi121.stdout: "average_primary_affinity_weighted": 0.89999997615814209 2024-04-19T02:16:21.181 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:21.181 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:21.181 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:21.181 INFO:teuthology.orchestra.run.smithi121.stdout: "pool": 3, 2024-04-19T02:16:21.181 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_name": "cephfs_metadata", 2024-04-19T02:16:21.181 INFO:teuthology.orchestra.run.smithi121.stdout: "create_time": "2024-04-19T02:15:27.675087+0000", 2024-04-19T02:16:21.181 INFO:teuthology.orchestra.run.smithi121.stdout: "flags": 1, 2024-04-19T02:16:21.181 INFO:teuthology.orchestra.run.smithi121.stdout: "flags_names": "hashpspool", 2024-04-19T02:16:21.181 INFO:teuthology.orchestra.run.smithi121.stdout: "type": 1, 2024-04-19T02:16:21.181 INFO:teuthology.orchestra.run.smithi121.stdout: "size": 2, 2024-04-19T02:16:21.181 INFO:teuthology.orchestra.run.smithi121.stdout: "min_size": 1, 2024-04-19T02:16:21.181 INFO:teuthology.orchestra.run.smithi121.stdout: "crush_rule": 0, 2024-04-19T02:16:21.181 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_count": 0, 2024-04-19T02:16:21.182 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_target": 0, 2024-04-19T02:16:21.182 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T02:16:21.182 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T02:16:21.182 INFO:teuthology.orchestra.run.smithi121.stdout: "object_hash": 2, 2024-04-19T02:16:21.182 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_autoscale_mode": "off", 2024-04-19T02:16:21.182 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num": 32, 2024-04-19T02:16:21.182 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_placement_num": 32, 2024-04-19T02:16:21.182 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_placement_num_target": 32, 2024-04-19T02:16:21.182 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_target": 32, 2024-04-19T02:16:21.182 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_pending": 32, 2024-04-19T02:16:21.182 INFO:teuthology.orchestra.run.smithi121.stdout: "last_pg_merge_meta": { 2024-04-19T02:16:21.182 INFO:teuthology.orchestra.run.smithi121.stdout: "source_pgid": "0.0", 2024-04-19T02:16:21.182 INFO:teuthology.orchestra.run.smithi121.stdout: "ready_epoch": 0, 2024-04-19T02:16:21.182 INFO:teuthology.orchestra.run.smithi121.stdout: "last_epoch_started": 0, 2024-04-19T02:16:21.183 INFO:teuthology.orchestra.run.smithi121.stdout: "last_epoch_clean": 0, 2024-04-19T02:16:21.183 INFO:teuthology.orchestra.run.smithi121.stdout: "source_version": "0'0", 2024-04-19T02:16:21.183 INFO:teuthology.orchestra.run.smithi121.stdout: "target_version": "0'0" 2024-04-19T02:16:21.183 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:21.183 INFO:teuthology.orchestra.run.smithi121.stdout: "last_change": "14", 2024-04-19T02:16:21.183 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend": "0", 2024-04-19T02:16:21.183 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T02:16:21.183 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T02:16:21.183 INFO:teuthology.orchestra.run.smithi121.stdout: "auid": 0, 2024-04-19T02:16:21.183 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_mode": "selfmanaged", 2024-04-19T02:16:21.183 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_seq": 0, 2024-04-19T02:16:21.183 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_epoch": 0, 2024-04-19T02:16:21.183 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_snaps": [], 2024-04-19T02:16:21.183 INFO:teuthology.orchestra.run.smithi121.stdout: "removed_snaps": "[]", 2024-04-19T02:16:21.183 INFO:teuthology.orchestra.run.smithi121.stdout: "quota_max_bytes": 0, 2024-04-19T02:16:21.184 INFO:teuthology.orchestra.run.smithi121.stdout: "quota_max_objects": 0, 2024-04-19T02:16:21.184 INFO:teuthology.orchestra.run.smithi121.stdout: "tiers": [], 2024-04-19T02:16:21.184 INFO:teuthology.orchestra.run.smithi121.stdout: "tier_of": -1, 2024-04-19T02:16:21.184 INFO:teuthology.orchestra.run.smithi121.stdout: "read_tier": -1, 2024-04-19T02:16:21.184 INFO:teuthology.orchestra.run.smithi121.stdout: "write_tier": -1, 2024-04-19T02:16:21.184 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_mode": "none", 2024-04-19T02:16:21.184 INFO:teuthology.orchestra.run.smithi121.stdout: "target_max_bytes": 0, 2024-04-19T02:16:21.184 INFO:teuthology.orchestra.run.smithi121.stdout: "target_max_objects": 0, 2024-04-19T02:16:21.184 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T02:16:21.184 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T02:16:21.184 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T02:16:21.184 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_min_flush_age": 0, 2024-04-19T02:16:21.184 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_min_evict_age": 0, 2024-04-19T02:16:21.185 INFO:teuthology.orchestra.run.smithi121.stdout: "erasure_code_profile": "", 2024-04-19T02:16:21.185 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_params": { 2024-04-19T02:16:21.185 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "none" 2024-04-19T02:16:21.185 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:21.185 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_period": 0, 2024-04-19T02:16:21.185 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_count": 0, 2024-04-19T02:16:21.185 INFO:teuthology.orchestra.run.smithi121.stdout: "use_gmt_hitset": true, 2024-04-19T02:16:21.185 INFO:teuthology.orchestra.run.smithi121.stdout: "min_read_recency_for_promote": 0, 2024-04-19T02:16:21.185 INFO:teuthology.orchestra.run.smithi121.stdout: "min_write_recency_for_promote": 0, 2024-04-19T02:16:21.185 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T02:16:21.185 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_search_last_n": 0, 2024-04-19T02:16:21.185 INFO:teuthology.orchestra.run.smithi121.stdout: "grade_table": [], 2024-04-19T02:16:21.185 INFO:teuthology.orchestra.run.smithi121.stdout: "stripe_width": 0, 2024-04-19T02:16:21.185 INFO:teuthology.orchestra.run.smithi121.stdout: "expected_num_objects": 0, 2024-04-19T02:16:21.185 INFO:teuthology.orchestra.run.smithi121.stdout: "fast_read": false, 2024-04-19T02:16:21.186 INFO:teuthology.orchestra.run.smithi121.stdout: "options": { 2024-04-19T02:16:21.186 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_autoscale_bias": 4, 2024-04-19T02:16:21.186 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_min": 16, 2024-04-19T02:16:21.186 INFO:teuthology.orchestra.run.smithi121.stdout: "recovery_priority": 5 2024-04-19T02:16:21.186 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:21.186 INFO:teuthology.orchestra.run.smithi121.stdout: "application_metadata": { 2024-04-19T02:16:21.186 INFO:teuthology.orchestra.run.smithi121.stdout: "cephfs": { 2024-04-19T02:16:21.186 INFO:teuthology.orchestra.run.smithi121.stdout: "metadata": "cephfs" 2024-04-19T02:16:21.186 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:21.186 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:21.186 INFO:teuthology.orchestra.run.smithi121.stdout: "read_balance": { 2024-04-19T02:16:21.186 INFO:teuthology.orchestra.run.smithi121.stdout: "score_acting": 1.2200000286102295, 2024-04-19T02:16:21.186 INFO:teuthology.orchestra.run.smithi121.stdout: "score_stable": 1.2200000286102295, 2024-04-19T02:16:21.186 INFO:teuthology.orchestra.run.smithi121.stdout: "optimal_score": 1, 2024-04-19T02:16:21.187 INFO:teuthology.orchestra.run.smithi121.stdout: "raw_score_acting": 1.2200000286102295, 2024-04-19T02:16:21.187 INFO:teuthology.orchestra.run.smithi121.stdout: "raw_score_stable": 1.2200000286102295, 2024-04-19T02:16:21.187 INFO:teuthology.orchestra.run.smithi121.stdout: "primary_affinity_weighted": 0.90409350395202637, 2024-04-19T02:16:21.187 INFO:teuthology.orchestra.run.smithi121.stdout: "average_primary_affinity": 0.89999997615814209, 2024-04-19T02:16:21.187 INFO:teuthology.orchestra.run.smithi121.stdout: "average_primary_affinity_weighted": 0.89999997615814209 2024-04-19T02:16:21.187 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:21.187 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:21.187 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:21.187 INFO:teuthology.orchestra.run.smithi121.stdout: "pool": 4, 2024-04-19T02:16:21.187 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_name": "cephfs_data", 2024-04-19T02:16:21.187 INFO:teuthology.orchestra.run.smithi121.stdout: "create_time": "2024-04-19T02:15:28.232224+0000", 2024-04-19T02:16:21.187 INFO:teuthology.orchestra.run.smithi121.stdout: "flags": 1, 2024-04-19T02:16:21.187 INFO:teuthology.orchestra.run.smithi121.stdout: "flags_names": "hashpspool", 2024-04-19T02:16:21.187 INFO:teuthology.orchestra.run.smithi121.stdout: "type": 1, 2024-04-19T02:16:21.187 INFO:teuthology.orchestra.run.smithi121.stdout: "size": 2, 2024-04-19T02:16:21.188 INFO:teuthology.orchestra.run.smithi121.stdout: "min_size": 1, 2024-04-19T02:16:21.188 INFO:teuthology.orchestra.run.smithi121.stdout: "crush_rule": 0, 2024-04-19T02:16:21.188 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_count": 0, 2024-04-19T02:16:21.188 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_target": 0, 2024-04-19T02:16:21.188 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T02:16:21.188 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T02:16:21.188 INFO:teuthology.orchestra.run.smithi121.stdout: "object_hash": 2, 2024-04-19T02:16:21.188 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_autoscale_mode": "off", 2024-04-19T02:16:21.188 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num": 64, 2024-04-19T02:16:21.189 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_placement_num": 64, 2024-04-19T02:16:21.189 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_placement_num_target": 64, 2024-04-19T02:16:21.189 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_target": 64, 2024-04-19T02:16:21.189 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_pending": 64, 2024-04-19T02:16:21.189 INFO:teuthology.orchestra.run.smithi121.stdout: "last_pg_merge_meta": { 2024-04-19T02:16:21.189 INFO:teuthology.orchestra.run.smithi121.stdout: "source_pgid": "0.0", 2024-04-19T02:16:21.189 INFO:teuthology.orchestra.run.smithi121.stdout: "ready_epoch": 0, 2024-04-19T02:16:21.189 INFO:teuthology.orchestra.run.smithi121.stdout: "last_epoch_started": 0, 2024-04-19T02:16:21.189 INFO:teuthology.orchestra.run.smithi121.stdout: "last_epoch_clean": 0, 2024-04-19T02:16:21.189 INFO:teuthology.orchestra.run.smithi121.stdout: "source_version": "0'0", 2024-04-19T02:16:21.189 INFO:teuthology.orchestra.run.smithi121.stdout: "target_version": "0'0" 2024-04-19T02:16:21.189 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:21.189 INFO:teuthology.orchestra.run.smithi121.stdout: "last_change": "15", 2024-04-19T02:16:21.189 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend": "0", 2024-04-19T02:16:21.190 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T02:16:21.190 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T02:16:21.190 INFO:teuthology.orchestra.run.smithi121.stdout: "auid": 0, 2024-04-19T02:16:21.190 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_mode": "selfmanaged", 2024-04-19T02:16:21.190 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_seq": 0, 2024-04-19T02:16:21.190 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_epoch": 0, 2024-04-19T02:16:21.190 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_snaps": [], 2024-04-19T02:16:21.190 INFO:teuthology.orchestra.run.smithi121.stdout: "removed_snaps": "[]", 2024-04-19T02:16:21.190 INFO:teuthology.orchestra.run.smithi121.stdout: "quota_max_bytes": 0, 2024-04-19T02:16:21.190 INFO:teuthology.orchestra.run.smithi121.stdout: "quota_max_objects": 0, 2024-04-19T02:16:21.190 INFO:teuthology.orchestra.run.smithi121.stdout: "tiers": [], 2024-04-19T02:16:21.190 INFO:teuthology.orchestra.run.smithi121.stdout: "tier_of": -1, 2024-04-19T02:16:21.190 INFO:teuthology.orchestra.run.smithi121.stdout: "read_tier": -1, 2024-04-19T02:16:21.190 INFO:teuthology.orchestra.run.smithi121.stdout: "write_tier": -1, 2024-04-19T02:16:21.191 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_mode": "none", 2024-04-19T02:16:21.191 INFO:teuthology.orchestra.run.smithi121.stdout: "target_max_bytes": 0, 2024-04-19T02:16:21.191 INFO:teuthology.orchestra.run.smithi121.stdout: "target_max_objects": 0, 2024-04-19T02:16:21.191 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T02:16:21.191 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T02:16:21.191 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T02:16:21.191 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_min_flush_age": 0, 2024-04-19T02:16:21.191 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_min_evict_age": 0, 2024-04-19T02:16:21.191 INFO:teuthology.orchestra.run.smithi121.stdout: "erasure_code_profile": "", 2024-04-19T02:16:21.191 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_params": { 2024-04-19T02:16:21.191 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "none" 2024-04-19T02:16:21.191 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:21.191 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_period": 0, 2024-04-19T02:16:21.191 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_count": 0, 2024-04-19T02:16:21.191 INFO:teuthology.orchestra.run.smithi121.stdout: "use_gmt_hitset": true, 2024-04-19T02:16:21.192 INFO:teuthology.orchestra.run.smithi121.stdout: "min_read_recency_for_promote": 0, 2024-04-19T02:16:21.192 INFO:teuthology.orchestra.run.smithi121.stdout: "min_write_recency_for_promote": 0, 2024-04-19T02:16:21.192 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T02:16:21.192 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_search_last_n": 0, 2024-04-19T02:16:21.192 INFO:teuthology.orchestra.run.smithi121.stdout: "grade_table": [], 2024-04-19T02:16:21.192 INFO:teuthology.orchestra.run.smithi121.stdout: "stripe_width": 0, 2024-04-19T02:16:21.192 INFO:teuthology.orchestra.run.smithi121.stdout: "expected_num_objects": 0, 2024-04-19T02:16:21.192 INFO:teuthology.orchestra.run.smithi121.stdout: "fast_read": false, 2024-04-19T02:16:21.192 INFO:teuthology.orchestra.run.smithi121.stdout: "options": { 2024-04-19T02:16:21.192 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_min": 64, 2024-04-19T02:16:21.192 INFO:teuthology.orchestra.run.smithi121.stdout: "target_size_ratio": 0.89999997615814209 2024-04-19T02:16:21.192 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:21.192 INFO:teuthology.orchestra.run.smithi121.stdout: "application_metadata": { 2024-04-19T02:16:21.192 INFO:teuthology.orchestra.run.smithi121.stdout: "cephfs": { 2024-04-19T02:16:21.192 INFO:teuthology.orchestra.run.smithi121.stdout: "data": "cephfs" 2024-04-19T02:16:21.192 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:21.193 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:21.193 INFO:teuthology.orchestra.run.smithi121.stdout: "read_balance": { 2024-04-19T02:16:21.193 INFO:teuthology.orchestra.run.smithi121.stdout: "score_acting": 1.1699999570846558, 2024-04-19T02:16:21.193 INFO:teuthology.orchestra.run.smithi121.stdout: "score_stable": 1.1699999570846558, 2024-04-19T02:16:21.193 INFO:teuthology.orchestra.run.smithi121.stdout: "optimal_score": 1, 2024-04-19T02:16:21.193 INFO:teuthology.orchestra.run.smithi121.stdout: "raw_score_acting": 1.1699999570846558, 2024-04-19T02:16:21.193 INFO:teuthology.orchestra.run.smithi121.stdout: "raw_score_stable": 1.1699999570846558, 2024-04-19T02:16:21.193 INFO:teuthology.orchestra.run.smithi121.stdout: "primary_affinity_weighted": 0.90409350395202637, 2024-04-19T02:16:21.193 INFO:teuthology.orchestra.run.smithi121.stdout: "average_primary_affinity": 0.89999997615814209, 2024-04-19T02:16:21.193 INFO:teuthology.orchestra.run.smithi121.stdout: "average_primary_affinity_weighted": 0.89999997615814209 2024-04-19T02:16:21.193 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:21.193 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:21.193 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:21.193 INFO:teuthology.orchestra.run.smithi121.stdout: "pool": 5, 2024-04-19T02:16:21.194 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_name": "unique_pool_0", 2024-04-19T02:16:21.194 INFO:teuthology.orchestra.run.smithi121.stdout: "create_time": "2024-04-19T02:15:52.929114+0000", 2024-04-19T02:16:21.194 INFO:teuthology.orchestra.run.smithi121.stdout: "flags": 1, 2024-04-19T02:16:21.194 INFO:teuthology.orchestra.run.smithi121.stdout: "flags_names": "hashpspool", 2024-04-19T02:16:21.194 INFO:teuthology.orchestra.run.smithi121.stdout: "type": 1, 2024-04-19T02:16:21.194 INFO:teuthology.orchestra.run.smithi121.stdout: "size": 2, 2024-04-19T02:16:21.194 INFO:teuthology.orchestra.run.smithi121.stdout: "min_size": 1, 2024-04-19T02:16:21.194 INFO:teuthology.orchestra.run.smithi121.stdout: "crush_rule": 0, 2024-04-19T02:16:21.194 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_count": 0, 2024-04-19T02:16:21.194 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_target": 0, 2024-04-19T02:16:21.194 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T02:16:21.194 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T02:16:21.194 INFO:teuthology.orchestra.run.smithi121.stdout: "object_hash": 2, 2024-04-19T02:16:21.194 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_autoscale_mode": "off", 2024-04-19T02:16:21.195 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num": 16, 2024-04-19T02:16:21.195 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_placement_num": 16, 2024-04-19T02:16:21.195 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_placement_num_target": 16, 2024-04-19T02:16:21.195 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_target": 16, 2024-04-19T02:16:21.195 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_pending": 16, 2024-04-19T02:16:21.195 INFO:teuthology.orchestra.run.smithi121.stdout: "last_pg_merge_meta": { 2024-04-19T02:16:21.195 INFO:teuthology.orchestra.run.smithi121.stdout: "source_pgid": "0.0", 2024-04-19T02:16:21.195 INFO:teuthology.orchestra.run.smithi121.stdout: "ready_epoch": 0, 2024-04-19T02:16:21.195 INFO:teuthology.orchestra.run.smithi121.stdout: "last_epoch_started": 0, 2024-04-19T02:16:21.195 INFO:teuthology.orchestra.run.smithi121.stdout: "last_epoch_clean": 0, 2024-04-19T02:16:21.195 INFO:teuthology.orchestra.run.smithi121.stdout: "source_version": "0'0", 2024-04-19T02:16:21.195 INFO:teuthology.orchestra.run.smithi121.stdout: "target_version": "0'0" 2024-04-19T02:16:21.195 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:21.195 INFO:teuthology.orchestra.run.smithi121.stdout: "last_change": "18", 2024-04-19T02:16:21.195 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend": "0", 2024-04-19T02:16:21.195 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T02:16:21.196 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T02:16:21.196 INFO:teuthology.orchestra.run.smithi121.stdout: "auid": 0, 2024-04-19T02:16:21.196 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_mode": "selfmanaged", 2024-04-19T02:16:21.196 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_seq": 0, 2024-04-19T02:16:21.196 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_epoch": 0, 2024-04-19T02:16:21.196 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_snaps": [], 2024-04-19T02:16:21.196 INFO:teuthology.orchestra.run.smithi121.stdout: "removed_snaps": "[]", 2024-04-19T02:16:21.196 INFO:teuthology.orchestra.run.smithi121.stdout: "quota_max_bytes": 0, 2024-04-19T02:16:21.196 INFO:teuthology.orchestra.run.smithi121.stdout: "quota_max_objects": 0, 2024-04-19T02:16:21.196 INFO:teuthology.orchestra.run.smithi121.stdout: "tiers": [], 2024-04-19T02:16:21.196 INFO:teuthology.orchestra.run.smithi121.stdout: "tier_of": -1, 2024-04-19T02:16:21.196 INFO:teuthology.orchestra.run.smithi121.stdout: "read_tier": -1, 2024-04-19T02:16:21.196 INFO:teuthology.orchestra.run.smithi121.stdout: "write_tier": -1, 2024-04-19T02:16:21.196 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_mode": "none", 2024-04-19T02:16:21.196 INFO:teuthology.orchestra.run.smithi121.stdout: "target_max_bytes": 0, 2024-04-19T02:16:21.196 INFO:teuthology.orchestra.run.smithi121.stdout: "target_max_objects": 0, 2024-04-19T02:16:21.197 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T02:16:21.197 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T02:16:21.197 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T02:16:21.197 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_min_flush_age": 0, 2024-04-19T02:16:21.197 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_min_evict_age": 0, 2024-04-19T02:16:21.197 INFO:teuthology.orchestra.run.smithi121.stdout: "erasure_code_profile": "", 2024-04-19T02:16:21.197 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_params": { 2024-04-19T02:16:21.197 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "none" 2024-04-19T02:16:21.197 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:21.197 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_period": 0, 2024-04-19T02:16:21.197 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_count": 0, 2024-04-19T02:16:21.197 INFO:teuthology.orchestra.run.smithi121.stdout: "use_gmt_hitset": true, 2024-04-19T02:16:21.197 INFO:teuthology.orchestra.run.smithi121.stdout: "min_read_recency_for_promote": 0, 2024-04-19T02:16:21.197 INFO:teuthology.orchestra.run.smithi121.stdout: "min_write_recency_for_promote": 0, 2024-04-19T02:16:21.198 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T02:16:21.198 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_search_last_n": 0, 2024-04-19T02:16:21.198 INFO:teuthology.orchestra.run.smithi121.stdout: "grade_table": [], 2024-04-19T02:16:21.198 INFO:teuthology.orchestra.run.smithi121.stdout: "stripe_width": 0, 2024-04-19T02:16:21.198 INFO:teuthology.orchestra.run.smithi121.stdout: "expected_num_objects": 0, 2024-04-19T02:16:21.198 INFO:teuthology.orchestra.run.smithi121.stdout: "fast_read": false, 2024-04-19T02:16:21.198 INFO:teuthology.orchestra.run.smithi121.stdout: "options": {}, 2024-04-19T02:16:21.198 INFO:teuthology.orchestra.run.smithi121.stdout: "application_metadata": { 2024-04-19T02:16:21.198 INFO:teuthology.orchestra.run.smithi121.stdout: "rados": {} 2024-04-19T02:16:21.198 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:21.198 INFO:teuthology.orchestra.run.smithi121.stdout: "read_balance": { 2024-04-19T02:16:21.198 INFO:teuthology.orchestra.run.smithi121.stdout: "score_acting": 1.1299999952316284, 2024-04-19T02:16:21.198 INFO:teuthology.orchestra.run.smithi121.stdout: "score_stable": 1.1299999952316284, 2024-04-19T02:16:21.198 INFO:teuthology.orchestra.run.smithi121.stdout: "optimal_score": 1, 2024-04-19T02:16:21.198 INFO:teuthology.orchestra.run.smithi121.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-19T02:16:21.199 INFO:teuthology.orchestra.run.smithi121.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-19T02:16:21.199 INFO:teuthology.orchestra.run.smithi121.stdout: "primary_affinity_weighted": 0.90409350395202637, 2024-04-19T02:16:21.199 INFO:teuthology.orchestra.run.smithi121.stdout: "average_primary_affinity": 0.89999997615814209, 2024-04-19T02:16:21.199 INFO:teuthology.orchestra.run.smithi121.stdout: "average_primary_affinity_weighted": 0.89999997615814209 2024-04-19T02:16:21.199 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:21.199 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:21.199 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-04-19T02:16:21.199 INFO:teuthology.orchestra.run.smithi121.stdout: "osds": [ 2024-04-19T02:16:21.199 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:21.199 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": 0, 2024-04-19T02:16:21.199 INFO:teuthology.orchestra.run.smithi121.stdout: "uuid": "88cb15f3-271c-43d5-af51-1cd26b8ed13c", 2024-04-19T02:16:21.199 INFO:teuthology.orchestra.run.smithi121.stdout: "up": 1, 2024-04-19T02:16:21.199 INFO:teuthology.orchestra.run.smithi121.stdout: "in": 1, 2024-04-19T02:16:21.200 INFO:teuthology.orchestra.run.smithi121.stdout: "weight": 1, 2024-04-19T02:16:21.200 INFO:teuthology.orchestra.run.smithi121.stdout: "primary_affinity": 1, 2024-04-19T02:16:21.200 INFO:teuthology.orchestra.run.smithi121.stdout: "last_clean_begin": 0, 2024-04-19T02:16:21.200 INFO:teuthology.orchestra.run.smithi121.stdout: "last_clean_end": 0, 2024-04-19T02:16:21.200 INFO:teuthology.orchestra.run.smithi121.stdout: "up_from": 8, 2024-04-19T02:16:21.200 INFO:teuthology.orchestra.run.smithi121.stdout: "up_thru": 16, 2024-04-19T02:16:21.200 INFO:teuthology.orchestra.run.smithi121.stdout: "down_at": 0, 2024-04-19T02:16:21.200 INFO:teuthology.orchestra.run.smithi121.stdout: "lost_at": 0, 2024-04-19T02:16:21.200 INFO:teuthology.orchestra.run.smithi121.stdout: "public_addrs": { 2024-04-19T02:16:21.200 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:16:21.200 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:21.200 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:16:21.200 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.153:6800", 2024-04-19T02:16:21.200 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41347 2024-04-19T02:16:21.200 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:21.201 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:21.201 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:16:21.201 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.153:6801", 2024-04-19T02:16:21.201 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41347 2024-04-19T02:16:21.201 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:21.201 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:16:21.201 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:21.201 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_addrs": { 2024-04-19T02:16:21.201 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:16:21.201 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:21.201 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:16:21.201 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.153:6802", 2024-04-19T02:16:21.201 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41347 2024-04-19T02:16:21.201 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:21.201 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:21.201 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:16:21.202 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.153:6803", 2024-04-19T02:16:21.202 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41347 2024-04-19T02:16:21.202 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:21.202 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:16:21.202 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:21.202 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_back_addrs": { 2024-04-19T02:16:21.202 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:16:21.202 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:21.202 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:16:21.202 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.153:6806", 2024-04-19T02:16:21.202 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41347 2024-04-19T02:16:21.202 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:21.202 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:21.202 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:16:21.202 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.153:6807", 2024-04-19T02:16:21.203 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41347 2024-04-19T02:16:21.203 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:21.203 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:16:21.203 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:21.203 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_front_addrs": { 2024-04-19T02:16:21.203 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:16:21.203 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:21.203 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:16:21.203 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.153:6804", 2024-04-19T02:16:21.203 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41347 2024-04-19T02:16:21.203 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:21.203 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:21.203 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:16:21.203 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.153:6805", 2024-04-19T02:16:21.204 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41347 2024-04-19T02:16:21.204 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:21.204 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:16:21.204 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:21.204 INFO:teuthology.orchestra.run.smithi121.stdout: "public_addr": "172.21.15.153:6801/41347", 2024-04-19T02:16:21.204 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_addr": "172.21.15.153:6803/41347", 2024-04-19T02:16:21.204 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_back_addr": "172.21.15.153:6807/41347", 2024-04-19T02:16:21.204 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_front_addr": "172.21.15.153:6805/41347", 2024-04-19T02:16:21.204 INFO:teuthology.orchestra.run.smithi121.stdout: "state": [ 2024-04-19T02:16:21.204 INFO:teuthology.orchestra.run.smithi121.stdout: "exists", 2024-04-19T02:16:21.204 INFO:teuthology.orchestra.run.smithi121.stdout: "up" 2024-04-19T02:16:21.204 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:16:21.204 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:21.204 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:21.204 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": 1, 2024-04-19T02:16:21.205 INFO:teuthology.orchestra.run.smithi121.stdout: "uuid": "2674869a-db01-4d9f-a496-9fb3851b5b21", 2024-04-19T02:16:21.205 INFO:teuthology.orchestra.run.smithi121.stdout: "up": 1, 2024-04-19T02:16:21.205 INFO:teuthology.orchestra.run.smithi121.stdout: "in": 1, 2024-04-19T02:16:21.205 INFO:teuthology.orchestra.run.smithi121.stdout: "weight": 1, 2024-04-19T02:16:21.205 INFO:teuthology.orchestra.run.smithi121.stdout: "primary_affinity": 0.7122802734375, 2024-04-19T02:16:21.205 INFO:teuthology.orchestra.run.smithi121.stdout: "last_clean_begin": 0, 2024-04-19T02:16:21.205 INFO:teuthology.orchestra.run.smithi121.stdout: "last_clean_end": 0, 2024-04-19T02:16:21.205 INFO:teuthology.orchestra.run.smithi121.stdout: "up_from": 8, 2024-04-19T02:16:21.205 INFO:teuthology.orchestra.run.smithi121.stdout: "up_thru": 16, 2024-04-19T02:16:21.205 INFO:teuthology.orchestra.run.smithi121.stdout: "down_at": 0, 2024-04-19T02:16:21.205 INFO:teuthology.orchestra.run.smithi121.stdout: "lost_at": 0, 2024-04-19T02:16:21.205 INFO:teuthology.orchestra.run.smithi121.stdout: "public_addrs": { 2024-04-19T02:16:21.205 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:16:21.205 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:21.205 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:16:21.206 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.174:6800", 2024-04-19T02:16:21.206 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41380 2024-04-19T02:16:21.206 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:21.206 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:21.206 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:16:21.206 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.174:6801", 2024-04-19T02:16:21.206 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41380 2024-04-19T02:16:21.206 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:21.206 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:16:21.206 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:21.206 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_addrs": { 2024-04-19T02:16:21.206 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:16:21.206 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:21.206 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:16:21.206 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.174:6802", 2024-04-19T02:16:21.207 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41380 2024-04-19T02:16:21.207 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:21.207 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:21.207 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:16:21.207 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.174:6803", 2024-04-19T02:16:21.207 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41380 2024-04-19T02:16:21.207 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:21.207 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:16:21.207 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:21.207 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_back_addrs": { 2024-04-19T02:16:21.207 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:16:21.207 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:21.207 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:16:21.207 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.174:6806", 2024-04-19T02:16:21.207 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41380 2024-04-19T02:16:21.208 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:21.208 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:21.208 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:16:21.208 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.174:6807", 2024-04-19T02:16:21.208 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41380 2024-04-19T02:16:21.208 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:21.208 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:16:21.208 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:21.208 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_front_addrs": { 2024-04-19T02:16:21.208 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:16:21.208 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:21.208 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:16:21.208 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.174:6804", 2024-04-19T02:16:21.208 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41380 2024-04-19T02:16:21.209 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:21.209 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:21.209 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:16:21.209 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.174:6805", 2024-04-19T02:16:21.209 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41380 2024-04-19T02:16:21.209 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:21.209 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:16:21.209 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:21.209 INFO:teuthology.orchestra.run.smithi121.stdout: "public_addr": "172.21.15.174:6801/41380", 2024-04-19T02:16:21.209 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_addr": "172.21.15.174:6803/41380", 2024-04-19T02:16:21.209 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_back_addr": "172.21.15.174:6807/41380", 2024-04-19T02:16:21.209 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_front_addr": "172.21.15.174:6805/41380", 2024-04-19T02:16:21.209 INFO:teuthology.orchestra.run.smithi121.stdout: "state": [ 2024-04-19T02:16:21.209 INFO:teuthology.orchestra.run.smithi121.stdout: "exists", 2024-04-19T02:16:21.209 INFO:teuthology.orchestra.run.smithi121.stdout: "up" 2024-04-19T02:16:21.210 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:16:21.210 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:21.210 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:21.210 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": 2, 2024-04-19T02:16:21.210 INFO:teuthology.orchestra.run.smithi121.stdout: "uuid": "712ad943-2f98-49d9-aabe-f66b509be633", 2024-04-19T02:16:21.210 INFO:teuthology.orchestra.run.smithi121.stdout: "up": 1, 2024-04-19T02:16:21.210 INFO:teuthology.orchestra.run.smithi121.stdout: "in": 1, 2024-04-19T02:16:21.210 INFO:teuthology.orchestra.run.smithi121.stdout: "weight": 1, 2024-04-19T02:16:21.210 INFO:teuthology.orchestra.run.smithi121.stdout: "primary_affinity": 1, 2024-04-19T02:16:21.210 INFO:teuthology.orchestra.run.smithi121.stdout: "last_clean_begin": 0, 2024-04-19T02:16:21.211 INFO:teuthology.orchestra.run.smithi121.stdout: "last_clean_end": 0, 2024-04-19T02:16:21.211 INFO:teuthology.orchestra.run.smithi121.stdout: "up_from": 8, 2024-04-19T02:16:21.211 INFO:teuthology.orchestra.run.smithi121.stdout: "up_thru": 16, 2024-04-19T02:16:21.211 INFO:teuthology.orchestra.run.smithi121.stdout: "down_at": 0, 2024-04-19T02:16:21.211 INFO:teuthology.orchestra.run.smithi121.stdout: "lost_at": 0, 2024-04-19T02:16:21.212 INFO:teuthology.orchestra.run.smithi121.stdout: "public_addrs": { 2024-04-19T02:16:21.212 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:16:21.212 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:21.212 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:16:21.212 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.177:6800", 2024-04-19T02:16:21.212 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41508 2024-04-19T02:16:21.212 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:21.212 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:21.212 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:16:21.212 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.177:6801", 2024-04-19T02:16:21.213 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41508 2024-04-19T02:16:21.213 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:21.213 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:16:21.213 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:21.213 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_addrs": { 2024-04-19T02:16:21.213 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:16:21.213 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:21.213 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:16:21.213 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.177:6802", 2024-04-19T02:16:21.213 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41508 2024-04-19T02:16:21.213 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:21.213 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:21.213 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:16:21.213 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.177:6803", 2024-04-19T02:16:21.214 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41508 2024-04-19T02:16:21.214 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:21.214 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:16:21.214 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:21.214 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_back_addrs": { 2024-04-19T02:16:21.214 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:16:21.214 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:21.214 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:16:21.214 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.177:6806", 2024-04-19T02:16:21.214 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41508 2024-04-19T02:16:21.214 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:21.214 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:21.214 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:16:21.214 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.177:6807", 2024-04-19T02:16:21.215 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41508 2024-04-19T02:16:21.215 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:21.215 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:16:21.215 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:21.215 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_front_addrs": { 2024-04-19T02:16:21.215 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:16:21.215 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:21.215 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:16:21.215 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.177:6804", 2024-04-19T02:16:21.215 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41508 2024-04-19T02:16:21.215 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:21.215 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:21.215 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:16:21.215 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.177:6805", 2024-04-19T02:16:21.215 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41508 2024-04-19T02:16:21.215 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:21.216 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:16:21.216 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:21.216 INFO:teuthology.orchestra.run.smithi121.stdout: "public_addr": "172.21.15.177:6801/41508", 2024-04-19T02:16:21.216 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_addr": "172.21.15.177:6803/41508", 2024-04-19T02:16:21.216 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_back_addr": "172.21.15.177:6807/41508", 2024-04-19T02:16:21.216 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_front_addr": "172.21.15.177:6805/41508", 2024-04-19T02:16:21.216 INFO:teuthology.orchestra.run.smithi121.stdout: "state": [ 2024-04-19T02:16:21.216 INFO:teuthology.orchestra.run.smithi121.stdout: "exists", 2024-04-19T02:16:21.216 INFO:teuthology.orchestra.run.smithi121.stdout: "up" 2024-04-19T02:16:21.216 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:16:21.216 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:21.216 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-04-19T02:16:21.216 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_xinfo": [ 2024-04-19T02:16:21.216 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:21.216 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": 0, 2024-04-19T02:16:21.216 INFO:teuthology.orchestra.run.smithi121.stdout: "down_stamp": "0.000000", 2024-04-19T02:16:21.217 INFO:teuthology.orchestra.run.smithi121.stdout: "laggy_probability": 0, 2024-04-19T02:16:21.217 INFO:teuthology.orchestra.run.smithi121.stdout: "laggy_interval": 0, 2024-04-19T02:16:21.217 INFO:teuthology.orchestra.run.smithi121.stdout: "features": 4540138322906710015, 2024-04-19T02:16:21.217 INFO:teuthology.orchestra.run.smithi121.stdout: "old_weight": 0, 2024-04-19T02:16:21.217 INFO:teuthology.orchestra.run.smithi121.stdout: "last_purged_snaps_scrub": "2024-04-19T02:15:20.495280+0000", 2024-04-19T02:16:21.217 INFO:teuthology.orchestra.run.smithi121.stdout: "dead_epoch": 0 2024-04-19T02:16:21.217 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:21.217 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:21.217 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": 1, 2024-04-19T02:16:21.217 INFO:teuthology.orchestra.run.smithi121.stdout: "down_stamp": "0.000000", 2024-04-19T02:16:21.217 INFO:teuthology.orchestra.run.smithi121.stdout: "laggy_probability": 0, 2024-04-19T02:16:21.217 INFO:teuthology.orchestra.run.smithi121.stdout: "laggy_interval": 0, 2024-04-19T02:16:21.217 INFO:teuthology.orchestra.run.smithi121.stdout: "features": 4540138322906710015, 2024-04-19T02:16:21.217 INFO:teuthology.orchestra.run.smithi121.stdout: "old_weight": 0, 2024-04-19T02:16:21.218 INFO:teuthology.orchestra.run.smithi121.stdout: "last_purged_snaps_scrub": "2024-04-19T02:15:20.594553+0000", 2024-04-19T02:16:21.218 INFO:teuthology.orchestra.run.smithi121.stdout: "dead_epoch": 0 2024-04-19T02:16:21.218 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:21.218 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:21.218 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": 2, 2024-04-19T02:16:21.218 INFO:teuthology.orchestra.run.smithi121.stdout: "down_stamp": "0.000000", 2024-04-19T02:16:21.218 INFO:teuthology.orchestra.run.smithi121.stdout: "laggy_probability": 0, 2024-04-19T02:16:21.218 INFO:teuthology.orchestra.run.smithi121.stdout: "laggy_interval": 0, 2024-04-19T02:16:21.218 INFO:teuthology.orchestra.run.smithi121.stdout: "features": 4540138322906710015, 2024-04-19T02:16:21.218 INFO:teuthology.orchestra.run.smithi121.stdout: "old_weight": 0, 2024-04-19T02:16:21.218 INFO:teuthology.orchestra.run.smithi121.stdout: "last_purged_snaps_scrub": "2024-04-19T02:15:20.524253+0000", 2024-04-19T02:16:21.218 INFO:teuthology.orchestra.run.smithi121.stdout: "dead_epoch": 0 2024-04-19T02:16:21.218 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:21.218 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-04-19T02:16:21.218 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_upmap": [], 2024-04-19T02:16:21.219 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_upmap_items": [], 2024-04-19T02:16:21.219 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_upmap_primaries": [], 2024-04-19T02:16:21.219 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_temp": [], 2024-04-19T02:16:21.219 INFO:teuthology.orchestra.run.smithi121.stdout: "primary_temp": [], 2024-04-19T02:16:21.219 INFO:teuthology.orchestra.run.smithi121.stdout: "blocklist": {}, 2024-04-19T02:16:21.219 INFO:teuthology.orchestra.run.smithi121.stdout: "range_blocklist": {}, 2024-04-19T02:16:21.219 INFO:teuthology.orchestra.run.smithi121.stdout: "erasure_code_profiles": { 2024-04-19T02:16:21.219 INFO:teuthology.orchestra.run.smithi121.stdout: "default": { 2024-04-19T02:16:21.219 INFO:teuthology.orchestra.run.smithi121.stdout: "crush-failure-domain": "osd", 2024-04-19T02:16:21.219 INFO:teuthology.orchestra.run.smithi121.stdout: "k": "2", 2024-04-19T02:16:21.219 INFO:teuthology.orchestra.run.smithi121.stdout: "m": "1", 2024-04-19T02:16:21.219 INFO:teuthology.orchestra.run.smithi121.stdout: "plugin": "jerasure", 2024-04-19T02:16:21.219 INFO:teuthology.orchestra.run.smithi121.stdout: "technique": "reed_sol_van" 2024-04-19T02:16:21.219 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:21.219 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:21.220 INFO:teuthology.orchestra.run.smithi121.stdout: "removed_snaps_queue": [], 2024-04-19T02:16:21.220 INFO:teuthology.orchestra.run.smithi121.stdout: "new_removed_snaps": [], 2024-04-19T02:16:21.220 INFO:teuthology.orchestra.run.smithi121.stdout: "new_purged_snaps": [], 2024-04-19T02:16:21.220 INFO:teuthology.orchestra.run.smithi121.stdout: "crush_node_flags": {}, 2024-04-19T02:16:21.220 INFO:teuthology.orchestra.run.smithi121.stdout: "device_class_flags": {}, 2024-04-19T02:16:21.220 INFO:teuthology.orchestra.run.smithi121.stdout: "stretch_mode": { 2024-04-19T02:16:21.220 INFO:teuthology.orchestra.run.smithi121.stdout: "stretch_mode_enabled": false, 2024-04-19T02:16:21.220 INFO:teuthology.orchestra.run.smithi121.stdout: "stretch_bucket_count": 0, 2024-04-19T02:16:21.220 INFO:teuthology.orchestra.run.smithi121.stdout: "degraded_stretch_mode": 0, 2024-04-19T02:16:21.220 INFO:teuthology.orchestra.run.smithi121.stdout: "recovering_stretch_mode": 0, 2024-04-19T02:16:21.220 INFO:teuthology.orchestra.run.smithi121.stdout: "stretch_mode_bucket": 0 2024-04-19T02:16:21.220 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:21.220 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-04-19T02:16:21.223 INFO:tasks.thrashosds.thrasher:j is {'epoch': 27, 'fsid': 'f6ab5dd0-bb9f-4b48-a9fc-4728c7955ca8', 'created': '2024-04-19T02:15:13.539846+0000', 'modified': '2024-04-19T02:16:20.023933+0000', 'last_up_change': '2024-04-19T02:15:22.519568+0000', 'last_in_change': '2024-04-19T02:15:15.482624+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-19T02:15:22.776125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9040935039520264, 'average_primary_affinity': 0.8999999761581421, 'average_primary_affinity_weighted': 0.8999999761581421}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-19T02:15:23.264005+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9040935039520264, 'average_primary_affinity': 0.8999999761581421, 'average_primary_affinity_weighted': 0.8999999761581421}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-19T02:15:27.675087+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.2200000286102295, 'score_stable': 1.2200000286102295, 'optimal_score': 1, 'raw_score_acting': 1.2200000286102295, 'raw_score_stable': 1.2200000286102295, 'primary_affinity_weighted': 0.9040935039520264, 'average_primary_affinity': 0.8999999761581421, 'average_primary_affinity_weighted': 0.8999999761581421}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-19T02:15:28.232224+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1699999570846558, 'score_stable': 1.1699999570846558, 'optimal_score': 1, 'raw_score_acting': 1.1699999570846558, 'raw_score_stable': 1.1699999570846558, 'primary_affinity_weighted': 0.9040935039520264, 'average_primary_affinity': 0.8999999761581421, 'average_primary_affinity_weighted': 0.8999999761581421}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2024-04-19T02:15:52.929114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 0.9040935039520264, 'average_primary_affinity': 0.8999999761581421, 'average_primary_affinity_weighted': 0.8999999761581421}}], 'osds': [{'osd': 0, 'uuid': '88cb15f3-271c-43d5-af51-1cd26b8ed13c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6800', 'nonce': 41347}, {'type': 'v1', 'addr': '172.21.15.153:6801', 'nonce': 41347}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6802', 'nonce': 41347}, {'type': 'v1', 'addr': '172.21.15.153:6803', 'nonce': 41347}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6806', 'nonce': 41347}, {'type': 'v1', 'addr': '172.21.15.153:6807', 'nonce': 41347}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6804', 'nonce': 41347}, {'type': 'v1', 'addr': '172.21.15.153:6805', 'nonce': 41347}]}, 'public_addr': '172.21.15.153:6801/41347', 'cluster_addr': '172.21.15.153:6803/41347', 'heartbeat_back_addr': '172.21.15.153:6807/41347', 'heartbeat_front_addr': '172.21.15.153:6805/41347', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '2674869a-db01-4d9f-a496-9fb3851b5b21', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.7122802734375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6800', 'nonce': 41380}, {'type': 'v1', 'addr': '172.21.15.174:6801', 'nonce': 41380}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6802', 'nonce': 41380}, {'type': 'v1', 'addr': '172.21.15.174:6803', 'nonce': 41380}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6806', 'nonce': 41380}, {'type': 'v1', 'addr': '172.21.15.174:6807', 'nonce': 41380}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6804', 'nonce': 41380}, {'type': 'v1', 'addr': '172.21.15.174:6805', 'nonce': 41380}]}, 'public_addr': '172.21.15.174:6801/41380', 'cluster_addr': '172.21.15.174:6803/41380', 'heartbeat_back_addr': '172.21.15.174:6807/41380', 'heartbeat_front_addr': '172.21.15.174:6805/41380', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '712ad943-2f98-49d9-aabe-f66b509be633', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6800', 'nonce': 41508}, {'type': 'v1', 'addr': '172.21.15.177:6801', 'nonce': 41508}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6802', 'nonce': 41508}, {'type': 'v1', 'addr': '172.21.15.177:6803', 'nonce': 41508}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6806', 'nonce': 41508}, {'type': 'v1', 'addr': '172.21.15.177:6807', 'nonce': 41508}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6804', 'nonce': 41508}, {'type': 'v1', 'addr': '172.21.15.177:6805', 'nonce': 41508}]}, 'public_addr': '172.21.15.177:6801/41508', 'cluster_addr': '172.21.15.177:6803/41508', 'heartbeat_back_addr': '172.21.15.177:6807/41508', 'heartbeat_front_addr': '172.21.15.177:6805/41508', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-19T02:15:20.495280+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-19T02:15:20.594553+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-19T02:15:20.524253+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-19T02:16:21.223 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:16:21.228 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:21.229+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:21.299 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:21.299 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:21.315 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:16:21.329 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:21.330+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:21.416 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:16:21.429 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:21.430+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:21.498 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:21.498 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:21.515 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:16:21.530 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:21.531+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:21.573 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:16:21.590 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:16:21.594 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-04-19T02:16:21.594 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:16:21.603 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2024-04-19T02:16:20.747560+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4089645914,"num_objects":62418,"num_object_clones":0,"num_object_copies":124836,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62418,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":62642,"num_write_kb":3996690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":59790,"ondisk_log_size":59790,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":242,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":8059688,"kb_used_data":7835912,"kb_used_omap":4,"kb_used_meta":223739,"kb_avail":275055832,"statfs":{"total":289910292480,"available":281657171968,"internally_reserved":0,"allocated":8023973888,"data_stored":8023407742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":229109074},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":736690176,"num_objects":11241,"num_object_clones":0,"num_object_copies":22482,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11241,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11241,"num_write_kb":719424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.726344"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.030661+0000","last_change":"2024-04-19T02:15:29.280412+0000","last_active":"2024-04-19T02:16:14.030661+0000","last_peered":"2024-04-19T02:16:14.030661+0000","last_clean":"2024-04-19T02:16:14.030661+0000","last_became_active":"2024-04-19T02:15:29.278762+0000","last_became_peered":"2024-04-19T02:15:29.278762+0000","last_unstale":"2024-04-19T02:16:14.030661+0000","last_undegraded":"2024-04-19T02:16:14.030661+0000","last_fullsized":"2024-04-19T02:16:14.030661+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:45.301675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.028983+0000","last_change":"2024-04-19T02:15:29.284695+0000","last_active":"2024-04-19T02:16:14.028983+0000","last_peered":"2024-04-19T02:16:14.028983+0000","last_clean":"2024-04-19T02:16:14.028983+0000","last_became_active":"2024-04-19T02:15:29.283468+0000","last_became_peered":"2024-04-19T02:15:29.283468+0000","last_unstale":"2024-04-19T02:16:14.028983+0000","last_undegraded":"2024-04-19T02:16:14.028983+0000","last_fullsized":"2024-04-19T02:16:14.028983+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.384881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.025567+0000","last_change":"2024-04-19T02:15:29.286709+0000","last_active":"2024-04-19T02:16:14.025567+0000","last_peered":"2024-04-19T02:16:14.025567+0000","last_clean":"2024-04-19T02:16:14.025567+0000","last_became_active":"2024-04-19T02:15:29.286169+0000","last_became_peered":"2024-04-19T02:15:29.286169+0000","last_unstale":"2024-04-19T02:16:14.025567+0000","last_undegraded":"2024-04-19T02:16:14.025567+0000","last_fullsized":"2024-04-19T02:16:14.025567+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:58.741466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.025367+0000","last_change":"2024-04-19T02:15:29.280131+0000","last_active":"2024-04-19T02:16:14.025367+0000","last_peered":"2024-04-19T02:16:14.025367+0000","last_clean":"2024-04-19T02:16:14.025367+0000","last_became_active":"2024-04-19T02:15:29.279388+0000","last_became_peered":"2024-04-19T02:15:29.279388+0000","last_unstale":"2024-04-19T02:16:14.025367+0000","last_undegraded":"2024-04-19T02:16:14.025367+0000","last_fullsized":"2024-04-19T02:16:14.025367+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:36:48.819486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.028679+0000","last_change":"2024-04-19T02:15:53.955892+0000","last_active":"2024-04-19T02:16:14.028679+0000","last_peered":"2024-04-19T02:16:14.028679+0000","last_clean":"2024-04-19T02:16:14.028679+0000","last_became_active":"2024-04-19T02:15:53.955553+0000","last_became_peered":"2024-04-19T02:15:53.955553+0000","last_unstale":"2024-04-19T02:16:14.028679+0000","last_undegraded":"2024-04-19T02:16:14.028679+0000","last_fullsized":"2024-04-19T02:16:14.028679+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:45:39.791209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.024996+0000","last_change":"2024-04-19T02:15:29.283908+0000","last_active":"2024-04-19T02:16:14.024996+0000","last_peered":"2024-04-19T02:16:14.024996+0000","last_clean":"2024-04-19T02:16:14.024996+0000","last_became_active":"2024-04-19T02:15:29.281729+0000","last_became_peered":"2024-04-19T02:15:29.281729+0000","last_unstale":"2024-04-19T02:16:14.024996+0000","last_undegraded":"2024-04-19T02:16:14.024996+0000","last_fullsized":"2024-04-19T02:16:14.024996+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:03:15.383476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.024851+0000","last_change":"2024-04-19T02:15:29.281253+0000","last_active":"2024-04-19T02:16:14.024851+0000","last_peered":"2024-04-19T02:16:14.024851+0000","last_clean":"2024-04-19T02:16:14.024851+0000","last_became_active":"2024-04-19T02:15:29.279951+0000","last_became_peered":"2024-04-19T02:15:29.279951+0000","last_unstale":"2024-04-19T02:16:14.024851+0000","last_undegraded":"2024-04-19T02:16:14.024851+0000","last_fullsized":"2024-04-19T02:16:14.024851+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.024725+0000","last_change":"2024-04-19T02:15:29.283952+0000","last_active":"2024-04-19T02:16:14.024725+0000","last_peered":"2024-04-19T02:16:14.024725+0000","last_clean":"2024-04-19T02:16:14.024725+0000","last_became_active":"2024-04-19T02:15:29.282721+0000","last_became_peered":"2024-04-19T02:15:29.282721+0000","last_unstale":"2024-04-19T02:16:14.024725+0000","last_undegraded":"2024-04-19T02:16:14.024725+0000","last_fullsized":"2024-04-19T02:16:14.024725+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:45.301675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.028191+0000","last_change":"2024-04-19T02:15:29.282150+0000","last_active":"2024-04-19T02:16:14.028191+0000","last_peered":"2024-04-19T02:16:14.028191+0000","last_clean":"2024-04-19T02:16:14.028191+0000","last_became_active":"2024-04-19T02:15:29.281538+0000","last_became_peered":"2024-04-19T02:15:29.281538+0000","last_unstale":"2024-04-19T02:16:14.028191+0000","last_undegraded":"2024-04-19T02:16:14.028191+0000","last_fullsized":"2024-04-19T02:16:14.028191+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.029339+0000","last_change":"2024-04-19T02:15:29.284098+0000","last_active":"2024-04-19T02:16:14.029339+0000","last_peered":"2024-04-19T02:16:14.029339+0000","last_clean":"2024-04-19T02:16:14.029339+0000","last_became_active":"2024-04-19T02:15:29.282114+0000","last_became_peered":"2024-04-19T02:15:29.282114+0000","last_unstale":"2024-04-19T02:16:14.029339+0000","last_undegraded":"2024-04-19T02:16:14.029339+0000","last_fullsized":"2024-04-19T02:16:14.029339+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:16.568764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.025439+0000","last_change":"2024-04-19T02:15:29.280606+0000","last_active":"2024-04-19T02:16:14.025439+0000","last_peered":"2024-04-19T02:16:14.025439+0000","last_clean":"2024-04-19T02:16:14.025439+0000","last_became_active":"2024-04-19T02:15:29.280151+0000","last_became_peered":"2024-04-19T02:15:29.280151+0000","last_unstale":"2024-04-19T02:16:14.025439+0000","last_undegraded":"2024-04-19T02:16:14.025439+0000","last_fullsized":"2024-04-19T02:16:14.025439+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:26:22.452488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.025184+0000","last_change":"2024-04-19T02:15:53.958876+0000","last_active":"2024-04-19T02:16:14.025184+0000","last_peered":"2024-04-19T02:16:14.025184+0000","last_clean":"2024-04-19T02:16:14.025184+0000","last_became_active":"2024-04-19T02:15:53.958626+0000","last_became_peered":"2024-04-19T02:15:53.958626+0000","last_unstale":"2024-04-19T02:16:14.025184+0000","last_undegraded":"2024-04-19T02:16:14.025184+0000","last_fullsized":"2024-04-19T02:16:14.025184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:23:57.044018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.028484+0000","last_change":"2024-04-19T02:15:53.956801+0000","last_active":"2024-04-19T02:16:14.028484+0000","last_peered":"2024-04-19T02:16:14.028484+0000","last_clean":"2024-04-19T02:16:14.028484+0000","last_became_active":"2024-04-19T02:15:53.956620+0000","last_became_peered":"2024-04-19T02:15:53.956620+0000","last_unstale":"2024-04-19T02:16:14.028484+0000","last_undegraded":"2024-04-19T02:16:14.028484+0000","last_fullsized":"2024-04-19T02:16:14.028484+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:57:05.843101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.025365+0000","last_change":"2024-04-19T02:15:29.284262+0000","last_active":"2024-04-19T02:16:14.025365+0000","last_peered":"2024-04-19T02:16:14.025365+0000","last_clean":"2024-04-19T02:16:14.025365+0000","last_became_active":"2024-04-19T02:15:29.283121+0000","last_became_peered":"2024-04-19T02:15:29.283121+0000","last_unstale":"2024-04-19T02:16:14.025365+0000","last_undegraded":"2024-04-19T02:16:14.025365+0000","last_fullsized":"2024-04-19T02:16:14.025365+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.024914+0000","last_change":"2024-04-19T02:15:29.285139+0000","last_active":"2024-04-19T02:16:14.024914+0000","last_peered":"2024-04-19T02:16:14.024914+0000","last_clean":"2024-04-19T02:16:14.024914+0000","last_became_active":"2024-04-19T02:15:29.284649+0000","last_became_peered":"2024-04-19T02:15:29.284649+0000","last_unstale":"2024-04-19T02:16:14.024914+0000","last_undegraded":"2024-04-19T02:16:14.024914+0000","last_fullsized":"2024-04-19T02:16:14.024914+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.024745+0000","last_change":"2024-04-19T02:15:29.283648+0000","last_active":"2024-04-19T02:16:14.024745+0000","last_peered":"2024-04-19T02:16:14.024745+0000","last_clean":"2024-04-19T02:16:14.024745+0000","last_became_active":"2024-04-19T02:15:29.281606+0000","last_became_peered":"2024-04-19T02:15:29.281606+0000","last_unstale":"2024-04-19T02:16:14.024745+0000","last_undegraded":"2024-04-19T02:16:14.024745+0000","last_fullsized":"2024-04-19T02:16:14.024745+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.028359+0000","last_change":"2024-04-19T02:15:29.278673+0000","last_active":"2024-04-19T02:16:14.028359+0000","last_peered":"2024-04-19T02:16:14.028359+0000","last_clean":"2024-04-19T02:16:14.028359+0000","last_became_active":"2024-04-19T02:15:29.277699+0000","last_became_peered":"2024-04-19T02:15:29.277699+0000","last_unstale":"2024-04-19T02:16:14.028359+0000","last_undegraded":"2024-04-19T02:16:14.028359+0000","last_fullsized":"2024-04-19T02:16:14.028359+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.029457+0000","last_change":"2024-04-19T02:15:29.283341+0000","last_active":"2024-04-19T02:16:14.029457+0000","last_peered":"2024-04-19T02:16:14.029457+0000","last_clean":"2024-04-19T02:16:14.029457+0000","last_became_active":"2024-04-19T02:15:29.281591+0000","last_became_peered":"2024-04-19T02:15:29.281591+0000","last_unstale":"2024-04-19T02:16:14.029457+0000","last_undegraded":"2024-04-19T02:16:14.029457+0000","last_fullsized":"2024-04-19T02:16:14.029457+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:34.593754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.028428+0000","last_change":"2024-04-19T02:15:29.282110+0000","last_active":"2024-04-19T02:16:14.028428+0000","last_peered":"2024-04-19T02:16:14.028428+0000","last_clean":"2024-04-19T02:16:14.028428+0000","last_became_active":"2024-04-19T02:15:29.281716+0000","last_became_peered":"2024-04-19T02:15:29.281716+0000","last_unstale":"2024-04-19T02:16:14.028428+0000","last_undegraded":"2024-04-19T02:16:14.028428+0000","last_fullsized":"2024-04-19T02:16:14.028428+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.025324+0000","last_change":"2024-04-19T02:15:29.285237+0000","last_active":"2024-04-19T02:16:14.025324+0000","last_peered":"2024-04-19T02:16:14.025324+0000","last_clean":"2024-04-19T02:16:14.025324+0000","last_became_active":"2024-04-19T02:15:29.282790+0000","last_became_peered":"2024-04-19T02:15:29.282790+0000","last_unstale":"2024-04-19T02:16:14.025324+0000","last_undegraded":"2024-04-19T02:16:14.025324+0000","last_fullsized":"2024-04-19T02:16:14.025324+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.025589+0000","last_change":"2024-04-19T02:15:29.282609+0000","last_active":"2024-04-19T02:16:14.025589+0000","last_peered":"2024-04-19T02:16:14.025589+0000","last_clean":"2024-04-19T02:16:14.025589+0000","last_became_active":"2024-04-19T02:15:29.281665+0000","last_became_peered":"2024-04-19T02:15:29.281665+0000","last_unstale":"2024-04-19T02:16:14.025589+0000","last_undegraded":"2024-04-19T02:16:14.025589+0000","last_fullsized":"2024-04-19T02:16:14.025589+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.384881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.024862+0000","last_change":"2024-04-19T02:15:53.955813+0000","last_active":"2024-04-19T02:16:14.024862+0000","last_peered":"2024-04-19T02:16:14.024862+0000","last_clean":"2024-04-19T02:16:14.024862+0000","last_became_active":"2024-04-19T02:15:53.955614+0000","last_became_peered":"2024-04-19T02:15:53.955614+0000","last_unstale":"2024-04-19T02:16:14.024862+0000","last_undegraded":"2024-04-19T02:16:14.024862+0000","last_fullsized":"2024-04-19T02:16:14.024862+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:58:03.192647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.027899+0000","last_change":"2024-04-19T02:15:29.277109+0000","last_active":"2024-04-19T02:16:14.027899+0000","last_peered":"2024-04-19T02:16:14.027899+0000","last_clean":"2024-04-19T02:16:14.027899+0000","last_became_active":"2024-04-19T02:15:29.275417+0000","last_became_peered":"2024-04-19T02:15:29.275417+0000","last_unstale":"2024-04-19T02:16:14.027899+0000","last_undegraded":"2024-04-19T02:16:14.027899+0000","last_fullsized":"2024-04-19T02:16:14.027899+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.028716+0000","last_change":"2024-04-19T02:15:29.283266+0000","last_active":"2024-04-19T02:16:14.028716+0000","last_peered":"2024-04-19T02:16:14.028716+0000","last_clean":"2024-04-19T02:16:14.028716+0000","last_became_active":"2024-04-19T02:15:29.281505+0000","last_became_peered":"2024-04-19T02:15:29.281505+0000","last_unstale":"2024-04-19T02:16:14.028716+0000","last_undegraded":"2024-04-19T02:16:14.028716+0000","last_fullsized":"2024-04-19T02:16:14.028716+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.030639+0000","last_change":"2024-04-19T02:15:29.278084+0000","last_active":"2024-04-19T02:16:14.030639+0000","last_peered":"2024-04-19T02:16:14.030639+0000","last_clean":"2024-04-19T02:16:14.030639+0000","last_became_active":"2024-04-19T02:15:29.276952+0000","last_became_peered":"2024-04-19T02:15:29.276952+0000","last_unstale":"2024-04-19T02:16:14.030639+0000","last_undegraded":"2024-04-19T02:16:14.030639+0000","last_fullsized":"2024-04-19T02:16:14.030639+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.028574+0000","last_change":"2024-04-19T02:15:29.279904+0000","last_active":"2024-04-19T02:16:14.028574+0000","last_peered":"2024-04-19T02:16:14.028574+0000","last_clean":"2024-04-19T02:16:14.028574+0000","last_became_active":"2024-04-19T02:15:29.278938+0000","last_became_peered":"2024-04-19T02:15:29.278938+0000","last_unstale":"2024-04-19T02:16:14.028574+0000","last_undegraded":"2024-04-19T02:16:14.028574+0000","last_fullsized":"2024-04-19T02:16:14.028574+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.025466+0000","last_change":"2024-04-19T02:15:29.287389+0000","last_active":"2024-04-19T02:16:14.025466+0000","last_peered":"2024-04-19T02:16:14.025466+0000","last_clean":"2024-04-19T02:16:14.025466+0000","last_became_active":"2024-04-19T02:15:29.286431+0000","last_became_peered":"2024-04-19T02:15:29.286431+0000","last_unstale":"2024-04-19T02:16:14.025466+0000","last_undegraded":"2024-04-19T02:16:14.025466+0000","last_fullsized":"2024-04-19T02:16:14.025466+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:58:30.117887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.030629+0000","last_change":"2024-04-19T02:15:53.959207+0000","last_active":"2024-04-19T02:16:14.030629+0000","last_peered":"2024-04-19T02:16:14.030629+0000","last_clean":"2024-04-19T02:16:14.030629+0000","last_became_active":"2024-04-19T02:15:53.959007+0000","last_became_peered":"2024-04-19T02:15:53.959007+0000","last_unstale":"2024-04-19T02:16:14.030629+0000","last_undegraded":"2024-04-19T02:16:14.030629+0000","last_fullsized":"2024-04-19T02:16:14.030629+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:08:21.065077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.029186+0000","last_change":"2024-04-19T02:15:29.281792+0000","last_active":"2024-04-19T02:16:14.029186+0000","last_peered":"2024-04-19T02:16:14.029186+0000","last_clean":"2024-04-19T02:16:14.029186+0000","last_became_active":"2024-04-19T02:15:29.280479+0000","last_became_peered":"2024-04-19T02:15:29.280479+0000","last_unstale":"2024-04-19T02:16:14.029186+0000","last_undegraded":"2024-04-19T02:16:14.029186+0000","last_fullsized":"2024-04-19T02:16:14.029186+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.027999+0000","last_change":"2024-04-19T02:15:28.888778+0000","last_active":"2024-04-19T02:16:14.027999+0000","last_peered":"2024-04-19T02:16:14.027999+0000","last_clean":"2024-04-19T02:16:14.027999+0000","last_became_active":"2024-04-19T02:15:28.888543+0000","last_became_peered":"2024-04-19T02:15:28.888543+0000","last_unstale":"2024-04-19T02:16:14.027999+0000","last_undegraded":"2024-04-19T02:16:14.027999+0000","last_fullsized":"2024-04-19T02:16:14.027999+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:43:51.221619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.028393+0000","last_change":"2024-04-19T02:15:29.279986+0000","last_active":"2024-04-19T02:16:14.028393+0000","last_peered":"2024-04-19T02:16:14.028393+0000","last_clean":"2024-04-19T02:16:14.028393+0000","last_became_active":"2024-04-19T02:15:29.279690+0000","last_became_peered":"2024-04-19T02:15:29.279690+0000","last_unstale":"2024-04-19T02:16:14.028393+0000","last_undegraded":"2024-04-19T02:16:14.028393+0000","last_fullsized":"2024-04-19T02:16:14.028393+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.027697+0000","last_change":"2024-04-19T02:15:28.890463+0000","last_active":"2024-04-19T02:16:14.027697+0000","last_peered":"2024-04-19T02:16:14.027697+0000","last_clean":"2024-04-19T02:16:14.027697+0000","last_became_active":"2024-04-19T02:15:28.889777+0000","last_became_peered":"2024-04-19T02:15:28.889777+0000","last_unstale":"2024-04-19T02:16:14.027697+0000","last_undegraded":"2024-04-19T02:16:14.027697+0000","last_fullsized":"2024-04-19T02:16:14.027697+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:58:21.520250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.030585+0000","last_change":"2024-04-19T02:15:29.280879+0000","last_active":"2024-04-19T02:16:14.030585+0000","last_peered":"2024-04-19T02:16:14.030585+0000","last_clean":"2024-04-19T02:16:14.030585+0000","last_became_active":"2024-04-19T02:15:29.279314+0000","last_became_peered":"2024-04-19T02:15:29.279314+0000","last_unstale":"2024-04-19T02:16:14.030585+0000","last_undegraded":"2024-04-19T02:16:14.030585+0000","last_fullsized":"2024-04-19T02:16:14.030585+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.028638+0000","last_change":"2024-04-19T02:15:28.891867+0000","last_active":"2024-04-19T02:16:14.028638+0000","last_peered":"2024-04-19T02:16:14.028638+0000","last_clean":"2024-04-19T02:16:14.028638+0000","last_became_active":"2024-04-19T02:15:28.890806+0000","last_became_peered":"2024-04-19T02:15:28.890806+0000","last_unstale":"2024-04-19T02:16:14.028638+0000","last_undegraded":"2024-04-19T02:16:14.028638+0000","last_fullsized":"2024-04-19T02:16:14.028638+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:57.946581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.027616+0000","last_change":"2024-04-19T02:15:29.278148+0000","last_active":"2024-04-19T02:16:14.027616+0000","last_peered":"2024-04-19T02:16:14.027616+0000","last_clean":"2024-04-19T02:16:14.027616+0000","last_became_active":"2024-04-19T02:15:29.277402+0000","last_became_peered":"2024-04-19T02:15:29.277402+0000","last_unstale":"2024-04-19T02:16:14.027616+0000","last_undegraded":"2024-04-19T02:16:14.027616+0000","last_fullsized":"2024-04-19T02:16:14.027616+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.025276+0000","last_change":"2024-04-19T02:15:28.892905+0000","last_active":"2024-04-19T02:16:14.025276+0000","last_peered":"2024-04-19T02:16:14.025276+0000","last_clean":"2024-04-19T02:16:14.025276+0000","last_became_active":"2024-04-19T02:15:28.892541+0000","last_became_peered":"2024-04-19T02:15:28.892541+0000","last_unstale":"2024-04-19T02:16:14.025276+0000","last_undegraded":"2024-04-19T02:16:14.025276+0000","last_fullsized":"2024-04-19T02:16:14.025276+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:33.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.028075+0000","last_change":"2024-04-19T02:15:29.278810+0000","last_active":"2024-04-19T02:16:14.028075+0000","last_peered":"2024-04-19T02:16:14.028075+0000","last_clean":"2024-04-19T02:16:14.028075+0000","last_became_active":"2024-04-19T02:15:29.278093+0000","last_became_peered":"2024-04-19T02:15:29.278093+0000","last_unstale":"2024-04-19T02:16:14.028075+0000","last_undegraded":"2024-04-19T02:16:14.028075+0000","last_fullsized":"2024-04-19T02:16:14.028075+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:34.883207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.029007+0000","last_change":"2024-04-19T02:15:28.892937+0000","last_active":"2024-04-19T02:16:14.029007+0000","last_peered":"2024-04-19T02:16:14.029007+0000","last_clean":"2024-04-19T02:16:14.029007+0000","last_became_active":"2024-04-19T02:15:28.891440+0000","last_became_peered":"2024-04-19T02:15:28.891440+0000","last_unstale":"2024-04-19T02:16:14.029007+0000","last_undegraded":"2024-04-19T02:16:14.029007+0000","last_fullsized":"2024-04-19T02:16:14.029007+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.030549+0000","last_change":"2024-04-19T02:15:29.278404+0000","last_active":"2024-04-19T02:16:14.030549+0000","last_peered":"2024-04-19T02:16:14.030549+0000","last_clean":"2024-04-19T02:16:14.030549+0000","last_became_active":"2024-04-19T02:15:29.277460+0000","last_became_peered":"2024-04-19T02:15:29.277460+0000","last_unstale":"2024-04-19T02:16:14.030549+0000","last_undegraded":"2024-04-19T02:16:14.030549+0000","last_fullsized":"2024-04-19T02:16:14.030549+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.025279+0000","last_change":"2024-04-19T02:15:28.891097+0000","last_active":"2024-04-19T02:16:14.025279+0000","last_peered":"2024-04-19T02:16:14.025279+0000","last_clean":"2024-04-19T02:16:14.025279+0000","last_became_active":"2024-04-19T02:15:28.890795+0000","last_became_peered":"2024-04-19T02:15:28.890795+0000","last_unstale":"2024-04-19T02:16:14.025279+0000","last_undegraded":"2024-04-19T02:16:14.025279+0000","last_fullsized":"2024-04-19T02:16:14.025279+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.025952+0000","last_change":"2024-04-19T02:15:29.278546+0000","last_active":"2024-04-19T02:16:14.025952+0000","last_peered":"2024-04-19T02:16:14.025952+0000","last_clean":"2024-04-19T02:16:14.025952+0000","last_became_active":"2024-04-19T02:15:29.277547+0000","last_became_peered":"2024-04-19T02:15:29.277547+0000","last_unstale":"2024-04-19T02:16:14.025952+0000","last_undegraded":"2024-04-19T02:16:14.025952+0000","last_fullsized":"2024-04-19T02:16:14.025952+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.025880+0000","last_change":"2024-04-19T02:15:28.892977+0000","last_active":"2024-04-19T02:16:14.025880+0000","last_peered":"2024-04-19T02:16:14.025880+0000","last_clean":"2024-04-19T02:16:14.025880+0000","last_became_active":"2024-04-19T02:15:28.892636+0000","last_became_peered":"2024-04-19T02:15:28.892636+0000","last_unstale":"2024-04-19T02:16:14.025880+0000","last_undegraded":"2024-04-19T02:16:14.025880+0000","last_fullsized":"2024-04-19T02:16:14.025880+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:43:51.221619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.028455+0000","last_change":"2024-04-19T02:15:53.955655+0000","last_active":"2024-04-19T02:16:14.028455+0000","last_peered":"2024-04-19T02:16:14.028455+0000","last_clean":"2024-04-19T02:16:14.028455+0000","last_became_active":"2024-04-19T02:15:53.955382+0000","last_became_peered":"2024-04-19T02:15:53.955382+0000","last_unstale":"2024-04-19T02:16:14.028455+0000","last_undegraded":"2024-04-19T02:16:14.028455+0000","last_fullsized":"2024-04-19T02:16:14.028455+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:48.239260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.030591+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:16:14.030591+0000","last_peered":"2024-04-19T02:16:14.030591+0000","last_clean":"2024-04-19T02:16:14.030591+0000","last_became_active":"2024-04-19T02:15:28.890751+0000","last_became_peered":"2024-04-19T02:15:28.890751+0000","last_unstale":"2024-04-19T02:16:14.030591+0000","last_undegraded":"2024-04-19T02:16:14.030591+0000","last_fullsized":"2024-04-19T02:16:14.030591+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.028016+0000","last_change":"2024-04-19T02:15:53.957865+0000","last_active":"2024-04-19T02:16:14.028016+0000","last_peered":"2024-04-19T02:16:14.028016+0000","last_clean":"2024-04-19T02:16:14.028016+0000","last_became_active":"2024-04-19T02:15:53.957627+0000","last_became_peered":"2024-04-19T02:15:53.957627+0000","last_unstale":"2024-04-19T02:16:14.028016+0000","last_undegraded":"2024-04-19T02:16:14.028016+0000","last_fullsized":"2024-04-19T02:16:14.028016+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:16:45.799016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.028522+0000","last_change":"2024-04-19T02:15:28.892934+0000","last_active":"2024-04-19T02:16:14.028522+0000","last_peered":"2024-04-19T02:16:14.028522+0000","last_clean":"2024-04-19T02:16:14.028522+0000","last_became_active":"2024-04-19T02:15:28.891879+0000","last_became_peered":"2024-04-19T02:15:28.891879+0000","last_unstale":"2024-04-19T02:16:14.028522+0000","last_undegraded":"2024-04-19T02:16:14.028522+0000","last_fullsized":"2024-04-19T02:16:14.028522+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:10:12.514798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.028490+0000","last_change":"2024-04-19T02:15:29.279685+0000","last_active":"2024-04-19T02:16:14.028490+0000","last_peered":"2024-04-19T02:16:14.028490+0000","last_clean":"2024-04-19T02:16:14.028490+0000","last_became_active":"2024-04-19T02:15:29.278810+0000","last_became_peered":"2024-04-19T02:15:29.278810+0000","last_unstale":"2024-04-19T02:16:14.028490+0000","last_undegraded":"2024-04-19T02:16:14.028490+0000","last_fullsized":"2024-04-19T02:16:14.028490+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.024925+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:16:14.024925+0000","last_peered":"2024-04-19T02:16:14.024925+0000","last_clean":"2024-04-19T02:16:14.024925+0000","last_became_active":"2024-04-19T02:15:28.890882+0000","last_became_peered":"2024-04-19T02:15:28.890882+0000","last_unstale":"2024-04-19T02:16:14.024925+0000","last_undegraded":"2024-04-19T02:16:14.024925+0000","last_fullsized":"2024-04-19T02:16:14.024925+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:31.673938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.028880+0000","last_change":"2024-04-19T02:15:29.284258+0000","last_active":"2024-04-19T02:16:14.028880+0000","last_peered":"2024-04-19T02:16:14.028880+0000","last_clean":"2024-04-19T02:16:14.028880+0000","last_became_active":"2024-04-19T02:15:29.283995+0000","last_became_peered":"2024-04-19T02:15:29.283995+0000","last_unstale":"2024-04-19T02:16:14.028880+0000","last_undegraded":"2024-04-19T02:16:14.028880+0000","last_fullsized":"2024-04-19T02:16:14.028880+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:35.941308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"26'4011","reported_seq":4029,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-19T02:16:17.763250+0000","last_change":"2024-04-19T02:15:53.956977+0000","last_active":"2024-04-19T02:16:17.763250+0000","last_peered":"2024-04-19T02:16:17.763250+0000","last_clean":"2024-04-19T02:16:17.763250+0000","last_became_active":"2024-04-19T02:15:53.956730+0000","last_became_peered":"2024-04-19T02:15:53.956730+0000","last_unstale":"2024-04-19T02:16:17.763250+0000","last_undegraded":"2024-04-19T02:16:17.763250+0000","last_fullsized":"2024-04-19T02:16:17.763250+0000","mapping_epoch":16,"log_start":"19'300","ondisk_log_start":"19'300","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3711,"log_dups_size":0,"ondisk_log_size":3711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:56:46.323499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262864896,"num_objects":4011,"num_object_clones":0,"num_object_copies":8022,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4011,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4011,"num_write_kb":256704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.026056+0000","last_change":"2024-04-19T02:15:28.890265+0000","last_active":"2024-04-19T02:16:14.026056+0000","last_peered":"2024-04-19T02:16:14.026056+0000","last_clean":"2024-04-19T02:16:14.026056+0000","last_became_active":"2024-04-19T02:15:28.890004+0000","last_became_peered":"2024-04-19T02:15:28.890004+0000","last_unstale":"2024-04-19T02:16:14.026056+0000","last_undegraded":"2024-04-19T02:16:14.026056+0000","last_fullsized":"2024-04-19T02:16:14.026056+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:02.517101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.028392+0000","last_change":"2024-04-19T02:15:29.285529+0000","last_active":"2024-04-19T02:16:14.028392+0000","last_peered":"2024-04-19T02:16:14.028392+0000","last_clean":"2024-04-19T02:16:14.028392+0000","last_became_active":"2024-04-19T02:15:29.285197+0000","last_became_peered":"2024-04-19T02:15:29.285197+0000","last_unstale":"2024-04-19T02:16:14.028392+0000","last_undegraded":"2024-04-19T02:16:14.028392+0000","last_fullsized":"2024-04-19T02:16:14.028392+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"26'3898","reported_seq":3916,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-19T02:16:17.753682+0000","last_change":"2024-04-19T02:15:53.958523+0000","last_active":"2024-04-19T02:16:17.753682+0000","last_peered":"2024-04-19T02:16:17.753682+0000","last_clean":"2024-04-19T02:16:17.753682+0000","last_became_active":"2024-04-19T02:15:53.957627+0000","last_became_peered":"2024-04-19T02:15:53.957627+0000","last_unstale":"2024-04-19T02:16:17.753682+0000","last_undegraded":"2024-04-19T02:16:17.753682+0000","last_fullsized":"2024-04-19T02:16:17.753682+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3898,"log_dups_size":0,"ondisk_log_size":3898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:59:55.120296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":255459328,"num_objects":3898,"num_object_clones":0,"num_object_copies":7796,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3898,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3898,"num_write_kb":249472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.028959+0000","last_change":"2024-04-19T02:15:28.893902+0000","last_active":"2024-04-19T02:16:14.028959+0000","last_peered":"2024-04-19T02:16:14.028959+0000","last_clean":"2024-04-19T02:16:14.028959+0000","last_became_active":"2024-04-19T02:15:28.893231+0000","last_became_peered":"2024-04-19T02:15:28.893231+0000","last_unstale":"2024-04-19T02:16:14.028959+0000","last_undegraded":"2024-04-19T02:16:14.028959+0000","last_fullsized":"2024-04-19T02:16:14.028959+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:23.658442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.028639+0000","last_change":"2024-04-19T02:15:29.282874+0000","last_active":"2024-04-19T02:16:14.028639+0000","last_peered":"2024-04-19T02:16:14.028639+0000","last_clean":"2024-04-19T02:16:14.028639+0000","last_became_active":"2024-04-19T02:15:29.281675+0000","last_became_peered":"2024-04-19T02:15:29.281675+0000","last_unstale":"2024-04-19T02:16:14.028639+0000","last_undegraded":"2024-04-19T02:16:14.028639+0000","last_fullsized":"2024-04-19T02:16:14.028639+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:35.941308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"26'3868","reported_seq":3886,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-19T02:16:17.750277+0000","last_change":"2024-04-19T02:15:53.958324+0000","last_active":"2024-04-19T02:16:17.750277+0000","last_peered":"2024-04-19T02:16:17.750277+0000","last_clean":"2024-04-19T02:16:17.750277+0000","last_became_active":"2024-04-19T02:15:53.957392+0000","last_became_peered":"2024-04-19T02:15:53.957392+0000","last_unstale":"2024-04-19T02:16:17.750277+0000","last_undegraded":"2024-04-19T02:16:17.750277+0000","last_fullsized":"2024-04-19T02:16:17.750277+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3868,"log_dups_size":0,"ondisk_log_size":3868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:12:58.132969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":253493248,"num_objects":3868,"num_object_clones":0,"num_object_copies":7736,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3868,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3868,"num_write_kb":247552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.025499+0000","last_change":"2024-04-19T02:15:28.891234+0000","last_active":"2024-04-19T02:16:14.025499+0000","last_peered":"2024-04-19T02:16:14.025499+0000","last_clean":"2024-04-19T02:16:14.025499+0000","last_became_active":"2024-04-19T02:15:28.890881+0000","last_became_peered":"2024-04-19T02:15:28.890881+0000","last_unstale":"2024-04-19T02:16:14.025499+0000","last_undegraded":"2024-04-19T02:16:14.025499+0000","last_fullsized":"2024-04-19T02:16:14.025499+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.025604+0000","last_change":"2024-04-19T02:15:29.281937+0000","last_active":"2024-04-19T02:16:14.025604+0000","last_peered":"2024-04-19T02:16:14.025604+0000","last_clean":"2024-04-19T02:16:14.025604+0000","last_became_active":"2024-04-19T02:15:29.280727+0000","last_became_peered":"2024-04-19T02:15:29.280727+0000","last_unstale":"2024-04-19T02:16:14.025604+0000","last_undegraded":"2024-04-19T02:16:14.025604+0000","last_fullsized":"2024-04-19T02:16:14.025604+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"26'3943","reported_seq":3961,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-19T02:16:17.745682+0000","last_change":"2024-04-19T02:15:53.959099+0000","last_active":"2024-04-19T02:16:17.745682+0000","last_peered":"2024-04-19T02:16:17.745682+0000","last_clean":"2024-04-19T02:16:17.745682+0000","last_became_active":"2024-04-19T02:15:53.958885+0000","last_became_peered":"2024-04-19T02:15:53.958885+0000","last_unstale":"2024-04-19T02:16:17.745682+0000","last_undegraded":"2024-04-19T02:16:17.745682+0000","last_fullsized":"2024-04-19T02:16:17.745682+0000","mapping_epoch":16,"log_start":"19'400","ondisk_log_start":"19'400","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3543,"log_dups_size":0,"ondisk_log_size":3543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:53:26.969927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":258408448,"num_objects":3943,"num_object_clones":0,"num_object_copies":7886,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3943,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3943,"num_write_kb":252352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.025098+0000","last_change":"2024-04-19T02:15:28.892767+0000","last_active":"2024-04-19T02:16:14.025098+0000","last_peered":"2024-04-19T02:16:14.025098+0000","last_clean":"2024-04-19T02:16:14.025098+0000","last_became_active":"2024-04-19T02:15:28.892235+0000","last_became_peered":"2024-04-19T02:15:28.892235+0000","last_unstale":"2024-04-19T02:16:14.025098+0000","last_undegraded":"2024-04-19T02:16:14.025098+0000","last_fullsized":"2024-04-19T02:16:14.025098+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:37.690735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.028891+0000","last_change":"2024-04-19T02:15:29.279857+0000","last_active":"2024-04-19T02:16:14.028891+0000","last_peered":"2024-04-19T02:16:14.028891+0000","last_clean":"2024-04-19T02:16:14.028891+0000","last_became_active":"2024-04-19T02:15:29.279536+0000","last_became_peered":"2024-04-19T02:15:29.279536+0000","last_unstale":"2024-04-19T02:16:14.028891+0000","last_undegraded":"2024-04-19T02:16:14.028891+0000","last_fullsized":"2024-04-19T02:16:14.028891+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:00.191179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"26'3892","reported_seq":3910,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-19T02:16:17.743867+0000","last_change":"2024-04-19T02:15:53.957261+0000","last_active":"2024-04-19T02:16:17.743867+0000","last_peered":"2024-04-19T02:16:17.743867+0000","last_clean":"2024-04-19T02:16:17.743867+0000","last_became_active":"2024-04-19T02:15:53.957092+0000","last_became_peered":"2024-04-19T02:15:53.957092+0000","last_unstale":"2024-04-19T02:16:17.743867+0000","last_undegraded":"2024-04-19T02:16:17.743867+0000","last_fullsized":"2024-04-19T02:16:17.743867+0000","mapping_epoch":16,"log_start":"18'100","ondisk_log_start":"18'100","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3792,"log_dups_size":0,"ondisk_log_size":3792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:54:15.544923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":255066112,"num_objects":3892,"num_object_clones":0,"num_object_copies":7784,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3892,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3892,"num_write_kb":249088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.028827+0000","last_change":"2024-04-19T02:15:28.891611+0000","last_active":"2024-04-19T02:16:14.028827+0000","last_peered":"2024-04-19T02:16:14.028827+0000","last_clean":"2024-04-19T02:16:14.028827+0000","last_became_active":"2024-04-19T02:15:28.890914+0000","last_became_peered":"2024-04-19T02:15:28.890914+0000","last_unstale":"2024-04-19T02:16:14.028827+0000","last_undegraded":"2024-04-19T02:16:14.028827+0000","last_fullsized":"2024-04-19T02:16:14.028827+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:37.690735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.025140+0000","last_change":"2024-04-19T02:15:29.285774+0000","last_active":"2024-04-19T02:16:14.025140+0000","last_peered":"2024-04-19T02:16:14.025140+0000","last_clean":"2024-04-19T02:16:14.025140+0000","last_became_active":"2024-04-19T02:15:29.284705+0000","last_became_peered":"2024-04-19T02:15:29.284705+0000","last_unstale":"2024-04-19T02:16:14.025140+0000","last_undegraded":"2024-04-19T02:16:14.025140+0000","last_fullsized":"2024-04-19T02:16:14.025140+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"26'3826","reported_seq":3844,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-19T02:16:17.747938+0000","last_change":"2024-04-19T02:15:53.955286+0000","last_active":"2024-04-19T02:16:17.747938+0000","last_peered":"2024-04-19T02:16:17.747938+0000","last_clean":"2024-04-19T02:16:17.747938+0000","last_became_active":"2024-04-19T02:15:53.955026+0000","last_became_peered":"2024-04-19T02:15:53.955026+0000","last_unstale":"2024-04-19T02:16:17.747938+0000","last_undegraded":"2024-04-19T02:16:17.747938+0000","last_fullsized":"2024-04-19T02:16:17.747938+0000","mapping_epoch":16,"log_start":"18'200","ondisk_log_start":"18'200","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3626,"log_dups_size":0,"ondisk_log_size":3626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:05:48.594301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":250740736,"num_objects":3826,"num_object_clones":0,"num_object_copies":7652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3826,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3826,"num_write_kb":244864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.025059+0000","last_change":"2024-04-19T02:15:28.892873+0000","last_active":"2024-04-19T02:16:14.025059+0000","last_peered":"2024-04-19T02:16:14.025059+0000","last_clean":"2024-04-19T02:16:14.025059+0000","last_became_active":"2024-04-19T02:15:28.892487+0000","last_became_peered":"2024-04-19T02:15:28.892487+0000","last_unstale":"2024-04-19T02:16:14.025059+0000","last_undegraded":"2024-04-19T02:16:14.025059+0000","last_fullsized":"2024-04-19T02:16:14.025059+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:35.412837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.025881+0000","last_change":"2024-04-19T02:15:29.285019+0000","last_active":"2024-04-19T02:16:14.025881+0000","last_peered":"2024-04-19T02:16:14.025881+0000","last_clean":"2024-04-19T02:16:14.025881+0000","last_became_active":"2024-04-19T02:15:29.284650+0000","last_became_peered":"2024-04-19T02:15:29.284650+0000","last_unstale":"2024-04-19T02:16:14.025881+0000","last_undegraded":"2024-04-19T02:16:14.025881+0000","last_fullsized":"2024-04-19T02:16:14.025881+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"26'3927","reported_seq":3945,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-19T02:16:17.759902+0000","last_change":"2024-04-19T02:15:53.957403+0000","last_active":"2024-04-19T02:16:17.759902+0000","last_peered":"2024-04-19T02:16:17.759902+0000","last_clean":"2024-04-19T02:16:17.759902+0000","last_became_active":"2024-04-19T02:15:53.957190+0000","last_became_peered":"2024-04-19T02:15:53.957190+0000","last_unstale":"2024-04-19T02:16:17.759902+0000","last_undegraded":"2024-04-19T02:16:17.759902+0000","last_fullsized":"2024-04-19T02:16:17.759902+0000","mapping_epoch":16,"log_start":"18'200","ondisk_log_start":"18'200","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3727,"log_dups_size":0,"ondisk_log_size":3727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:07:12.817884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":257359872,"num_objects":3927,"num_object_clones":0,"num_object_copies":7854,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3927,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3927,"num_write_kb":251328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.024786+0000","last_change":"2024-04-19T02:15:53.956839+0000","last_active":"2024-04-19T02:16:14.024786+0000","last_peered":"2024-04-19T02:16:14.024786+0000","last_clean":"2024-04-19T02:16:14.024786+0000","last_became_active":"2024-04-19T02:15:53.956630+0000","last_became_peered":"2024-04-19T02:15:53.956630+0000","last_unstale":"2024-04-19T02:16:14.024786+0000","last_undegraded":"2024-04-19T02:16:14.024786+0000","last_fullsized":"2024-04-19T02:16:14.024786+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:47.229730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.025351+0000","last_change":"2024-04-19T02:15:29.287190+0000","last_active":"2024-04-19T02:16:14.025351+0000","last_peered":"2024-04-19T02:16:14.025351+0000","last_clean":"2024-04-19T02:16:14.025351+0000","last_became_active":"2024-04-19T02:15:29.286606+0000","last_became_peered":"2024-04-19T02:15:29.286606+0000","last_unstale":"2024-04-19T02:16:14.025351+0000","last_undegraded":"2024-04-19T02:16:14.025351+0000","last_fullsized":"2024-04-19T02:16:14.025351+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:28.387062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"26'3864","reported_seq":3882,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-19T02:16:17.750628+0000","last_change":"2024-04-19T02:15:53.958448+0000","last_active":"2024-04-19T02:16:17.750628+0000","last_peered":"2024-04-19T02:16:17.750628+0000","last_clean":"2024-04-19T02:16:17.750628+0000","last_became_active":"2024-04-19T02:15:53.957595+0000","last_became_peered":"2024-04-19T02:15:53.957595+0000","last_unstale":"2024-04-19T02:16:17.750628+0000","last_undegraded":"2024-04-19T02:16:17.750628+0000","last_fullsized":"2024-04-19T02:16:17.750628+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3864,"log_dups_size":0,"ondisk_log_size":3864,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:26:31.855319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":253231104,"num_objects":3864,"num_object_clones":0,"num_object_copies":7728,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3864,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3864,"num_write_kb":247296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.028616+0000","last_change":"2024-04-19T02:15:28.894121+0000","last_active":"2024-04-19T02:16:14.028616+0000","last_peered":"2024-04-19T02:16:14.028616+0000","last_clean":"2024-04-19T02:16:14.028616+0000","last_became_active":"2024-04-19T02:15:28.893902+0000","last_became_peered":"2024-04-19T02:15:28.893902+0000","last_unstale":"2024-04-19T02:16:14.028616+0000","last_undegraded":"2024-04-19T02:16:14.028616+0000","last_fullsized":"2024-04-19T02:16:14.028616+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:10:35.146583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.028563+0000","last_change":"2024-04-19T02:15:29.282870+0000","last_active":"2024-04-19T02:16:14.028563+0000","last_peered":"2024-04-19T02:16:14.028563+0000","last_clean":"2024-04-19T02:16:14.028563+0000","last_became_active":"2024-04-19T02:15:29.281873+0000","last_became_peered":"2024-04-19T02:15:29.281873+0000","last_unstale":"2024-04-19T02:16:14.028563+0000","last_undegraded":"2024-04-19T02:16:14.028563+0000","last_fullsized":"2024-04-19T02:16:14.028563+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"26'4000","reported_seq":4016,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-19T02:16:17.736115+0000","last_change":"2024-04-19T02:15:53.955498+0000","last_active":"2024-04-19T02:16:17.736115+0000","last_peered":"2024-04-19T02:16:17.736115+0000","last_clean":"2024-04-19T02:16:17.736115+0000","last_became_active":"2024-04-19T02:15:53.954910+0000","last_became_peered":"2024-04-19T02:15:53.954910+0000","last_unstale":"2024-04-19T02:16:17.736115+0000","last_undegraded":"2024-04-19T02:16:17.736115+0000","last_fullsized":"2024-04-19T02:16:17.736115+0000","mapping_epoch":16,"log_start":"19'400","ondisk_log_start":"19'400","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3600,"log_dups_size":0,"ondisk_log_size":3600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:58:27.262672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144000,"num_objects":4000,"num_object_clones":0,"num_object_copies":8000,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4000,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4000,"num_write_kb":256000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.028978+0000","last_change":"2024-04-19T02:15:24.527061+0000","last_active":"2024-04-19T02:16:14.028978+0000","last_peered":"2024-04-19T02:16:14.028978+0000","last_clean":"2024-04-19T02:16:14.028978+0000","last_became_active":"2024-04-19T02:15:24.526757+0000","last_became_peered":"2024-04-19T02:15:24.526757+0000","last_unstale":"2024-04-19T02:16:14.028978+0000","last_undegraded":"2024-04-19T02:16:14.028978+0000","last_fullsized":"2024-04-19T02:16:14.028978+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:17:13.649077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.025659+0000","last_change":"2024-04-19T02:15:28.892766+0000","last_active":"2024-04-19T02:16:14.025659+0000","last_peered":"2024-04-19T02:16:14.025659+0000","last_clean":"2024-04-19T02:16:14.025659+0000","last_became_active":"2024-04-19T02:15:28.892396+0000","last_became_peered":"2024-04-19T02:15:28.892396+0000","last_unstale":"2024-04-19T02:16:14.025659+0000","last_undegraded":"2024-04-19T02:16:14.025659+0000","last_fullsized":"2024-04-19T02:16:14.025659+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:57.946581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.028827+0000","last_change":"2024-04-19T02:15:29.277922+0000","last_active":"2024-04-19T02:16:14.028827+0000","last_peered":"2024-04-19T02:16:14.028827+0000","last_clean":"2024-04-19T02:16:14.028827+0000","last_became_active":"2024-04-19T02:15:29.276968+0000","last_became_peered":"2024-04-19T02:15:29.276968+0000","last_unstale":"2024-04-19T02:16:14.028827+0000","last_undegraded":"2024-04-19T02:16:14.028827+0000","last_fullsized":"2024-04-19T02:16:14.028827+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"26'3902","reported_seq":3920,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-19T02:16:17.743984+0000","last_change":"2024-04-19T02:15:53.955228+0000","last_active":"2024-04-19T02:16:17.743984+0000","last_peered":"2024-04-19T02:16:17.743984+0000","last_clean":"2024-04-19T02:16:17.743984+0000","last_became_active":"2024-04-19T02:15:53.954960+0000","last_became_peered":"2024-04-19T02:15:53.954960+0000","last_unstale":"2024-04-19T02:16:17.743984+0000","last_undegraded":"2024-04-19T02:16:17.743984+0000","last_fullsized":"2024-04-19T02:16:17.743984+0000","mapping_epoch":16,"log_start":"19'300","ondisk_log_start":"19'300","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3602,"log_dups_size":0,"ondisk_log_size":3602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:46:07.409922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":255721472,"num_objects":3902,"num_object_clones":0,"num_object_copies":7804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3902,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3902,"num_write_kb":249728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.025278+0000","last_change":"2024-04-19T02:15:24.530933+0000","last_active":"2024-04-19T02:16:14.025278+0000","last_peered":"2024-04-19T02:16:14.025278+0000","last_clean":"2024-04-19T02:16:14.025278+0000","last_became_active":"2024-04-19T02:15:24.530550+0000","last_became_peered":"2024-04-19T02:15:24.530550+0000","last_unstale":"2024-04-19T02:16:14.025278+0000","last_undegraded":"2024-04-19T02:16:14.025278+0000","last_fullsized":"2024-04-19T02:16:14.025278+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:18:15.194321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.025679+0000","last_change":"2024-04-19T02:15:28.893062+0000","last_active":"2024-04-19T02:16:14.025679+0000","last_peered":"2024-04-19T02:16:14.025679+0000","last_clean":"2024-04-19T02:16:14.025679+0000","last_became_active":"2024-04-19T02:15:28.892798+0000","last_became_peered":"2024-04-19T02:15:28.892798+0000","last_unstale":"2024-04-19T02:16:14.025679+0000","last_undegraded":"2024-04-19T02:16:14.025679+0000","last_fullsized":"2024-04-19T02:16:14.025679+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:53.170180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.028697+0000","last_change":"2024-04-19T02:15:29.278294+0000","last_active":"2024-04-19T02:16:14.028697+0000","last_peered":"2024-04-19T02:16:14.028697+0000","last_clean":"2024-04-19T02:16:14.028697+0000","last_became_active":"2024-04-19T02:15:29.277536+0000","last_became_peered":"2024-04-19T02:15:29.277536+0000","last_unstale":"2024-04-19T02:16:14.028697+0000","last_undegraded":"2024-04-19T02:16:14.028697+0000","last_fullsized":"2024-04-19T02:16:14.028697+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"26'3941","reported_seq":3959,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-19T02:16:17.746483+0000","last_change":"2024-04-19T02:15:53.956251+0000","last_active":"2024-04-19T02:16:17.746483+0000","last_peered":"2024-04-19T02:16:17.746483+0000","last_clean":"2024-04-19T02:16:17.746483+0000","last_became_active":"2024-04-19T02:15:53.955886+0000","last_became_peered":"2024-04-19T02:15:53.955886+0000","last_unstale":"2024-04-19T02:16:17.746483+0000","last_undegraded":"2024-04-19T02:16:17.746483+0000","last_fullsized":"2024-04-19T02:16:17.746483+0000","mapping_epoch":16,"log_start":"19'400","ondisk_log_start":"19'400","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3541,"log_dups_size":0,"ondisk_log_size":3541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:38:38.586906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":258277376,"num_objects":3941,"num_object_clones":0,"num_object_copies":7882,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3941,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3941,"num_write_kb":252224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.027897+0000","last_change":"2024-04-19T02:15:24.527048+0000","last_active":"2024-04-19T02:16:14.027897+0000","last_peered":"2024-04-19T02:16:14.027897+0000","last_clean":"2024-04-19T02:16:14.027897+0000","last_became_active":"2024-04-19T02:15:24.526790+0000","last_became_peered":"2024-04-19T02:15:24.526790+0000","last_unstale":"2024-04-19T02:16:14.027897+0000","last_undegraded":"2024-04-19T02:16:14.027897+0000","last_fullsized":"2024-04-19T02:16:14.027897+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.024629+0000","last_change":"2024-04-19T02:15:53.956945+0000","last_active":"2024-04-19T02:16:14.024629+0000","last_peered":"2024-04-19T02:16:14.024629+0000","last_clean":"2024-04-19T02:16:14.024629+0000","last_became_active":"2024-04-19T02:15:53.956719+0000","last_became_peered":"2024-04-19T02:15:53.956719+0000","last_unstale":"2024-04-19T02:16:14.024629+0000","last_undegraded":"2024-04-19T02:16:14.024629+0000","last_fullsized":"2024-04-19T02:16:14.024629+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:00:37.754624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.028707+0000","last_change":"2024-04-19T02:15:29.282663+0000","last_active":"2024-04-19T02:16:14.028707+0000","last_peered":"2024-04-19T02:16:14.028707+0000","last_clean":"2024-04-19T02:16:14.028707+0000","last_became_active":"2024-04-19T02:15:29.282217+0000","last_became_peered":"2024-04-19T02:15:29.282217+0000","last_unstale":"2024-04-19T02:16:14.028707+0000","last_undegraded":"2024-04-19T02:16:14.028707+0000","last_fullsized":"2024-04-19T02:16:14.028707+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"26'3888","reported_seq":3906,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-19T02:16:17.750750+0000","last_change":"2024-04-19T02:15:53.958264+0000","last_active":"2024-04-19T02:16:17.750750+0000","last_peered":"2024-04-19T02:16:17.750750+0000","last_clean":"2024-04-19T02:16:17.750750+0000","last_became_active":"2024-04-19T02:15:53.956689+0000","last_became_peered":"2024-04-19T02:15:53.956689+0000","last_unstale":"2024-04-19T02:16:17.750750+0000","last_undegraded":"2024-04-19T02:16:17.750750+0000","last_fullsized":"2024-04-19T02:16:17.750750+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3888,"log_dups_size":0,"ondisk_log_size":3888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:24:32.928594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254803968,"num_objects":3888,"num_object_clones":0,"num_object_copies":7776,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3888,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3888,"num_write_kb":248832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.025860+0000","last_change":"2024-04-19T02:15:24.530924+0000","last_active":"2024-04-19T02:16:14.025860+0000","last_peered":"2024-04-19T02:16:14.025860+0000","last_clean":"2024-04-19T02:16:14.025860+0000","last_became_active":"2024-04-19T02:15:24.530551+0000","last_became_peered":"2024-04-19T02:15:24.530551+0000","last_unstale":"2024-04-19T02:16:14.025860+0000","last_undegraded":"2024-04-19T02:16:14.025860+0000","last_fullsized":"2024-04-19T02:16:14.025860+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:30.576946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":221,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.024828+0000","last_change":"2024-04-19T02:15:24.533634+0000","last_active":"2024-04-19T02:16:14.024828+0000","last_peered":"2024-04-19T02:16:14.024828+0000","last_clean":"2024-04-19T02:16:14.024828+0000","last_became_active":"2024-04-19T02:15:24.533420+0000","last_became_peered":"2024-04-19T02:15:24.533420+0000","last_unstale":"2024-04-19T02:16:14.024828+0000","last_undegraded":"2024-04-19T02:16:14.024828+0000","last_fullsized":"2024-04-19T02:16:14.024828+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.030494+0000","last_change":"2024-04-19T02:15:28.890244+0000","last_active":"2024-04-19T02:16:14.030494+0000","last_peered":"2024-04-19T02:16:14.030494+0000","last_clean":"2024-04-19T02:16:14.030494+0000","last_became_active":"2024-04-19T02:15:28.889831+0000","last_became_peered":"2024-04-19T02:15:28.889831+0000","last_unstale":"2024-04-19T02:16:14.030494+0000","last_undegraded":"2024-04-19T02:16:14.030494+0000","last_fullsized":"2024-04-19T02:16:14.030494+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.025670+0000","last_change":"2024-04-19T02:15:29.285015+0000","last_active":"2024-04-19T02:16:14.025670+0000","last_peered":"2024-04-19T02:16:14.025670+0000","last_clean":"2024-04-19T02:16:14.025670+0000","last_became_active":"2024-04-19T02:15:29.284164+0000","last_became_peered":"2024-04-19T02:15:29.284164+0000","last_unstale":"2024-04-19T02:16:14.025670+0000","last_undegraded":"2024-04-19T02:16:14.025670+0000","last_fullsized":"2024-04-19T02:16:14.025670+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:36.987844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"26'3912","reported_seq":3929,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-19T02:16:17.777067+0000","last_change":"2024-04-19T02:15:53.956463+0000","last_active":"2024-04-19T02:16:17.777067+0000","last_peered":"2024-04-19T02:16:17.777067+0000","last_clean":"2024-04-19T02:16:17.777067+0000","last_became_active":"2024-04-19T02:15:53.955819+0000","last_became_peered":"2024-04-19T02:15:53.955819+0000","last_unstale":"2024-04-19T02:16:17.777067+0000","last_undegraded":"2024-04-19T02:16:17.777067+0000","last_fullsized":"2024-04-19T02:16:17.777067+0000","mapping_epoch":16,"log_start":"18'200","ondisk_log_start":"18'200","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3712,"log_dups_size":0,"ondisk_log_size":3712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:46:07.409922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":256376832,"num_objects":3912,"num_object_clones":0,"num_object_copies":7824,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3912,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3912,"num_write_kb":250368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.024826+0000","last_change":"2024-04-19T02:15:24.533912+0000","last_active":"2024-04-19T02:16:14.024826+0000","last_peered":"2024-04-19T02:16:14.024826+0000","last_clean":"2024-04-19T02:16:14.024826+0000","last_became_active":"2024-04-19T02:15:24.533580+0000","last_became_peered":"2024-04-19T02:15:24.533580+0000","last_unstale":"2024-04-19T02:16:14.024826+0000","last_undegraded":"2024-04-19T02:16:14.024826+0000","last_fullsized":"2024-04-19T02:16:14.024826+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:45.045477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.027805+0000","last_change":"2024-04-19T02:15:28.891889+0000","last_active":"2024-04-19T02:16:14.027805+0000","last_peered":"2024-04-19T02:16:14.027805+0000","last_clean":"2024-04-19T02:16:14.027805+0000","last_became_active":"2024-04-19T02:15:28.890919+0000","last_became_peered":"2024-04-19T02:15:28.890919+0000","last_unstale":"2024-04-19T02:16:14.027805+0000","last_undegraded":"2024-04-19T02:16:14.027805+0000","last_fullsized":"2024-04-19T02:16:14.027805+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:35.412837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.028237+0000","last_change":"2024-04-19T02:15:53.957881+0000","last_active":"2024-04-19T02:16:14.028237+0000","last_peered":"2024-04-19T02:16:14.028237+0000","last_clean":"2024-04-19T02:16:14.028237+0000","last_became_active":"2024-04-19T02:15:53.957657+0000","last_became_peered":"2024-04-19T02:15:53.957657+0000","last_unstale":"2024-04-19T02:16:14.028237+0000","last_undegraded":"2024-04-19T02:16:14.028237+0000","last_fullsized":"2024-04-19T02:16:14.028237+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:46.921714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"26'3923","reported_seq":3940,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-19T02:16:17.765884+0000","last_change":"2024-04-19T02:15:53.955068+0000","last_active":"2024-04-19T02:16:17.765884+0000","last_peered":"2024-04-19T02:16:17.765884+0000","last_clean":"2024-04-19T02:16:17.765884+0000","last_became_active":"2024-04-19T02:15:53.954721+0000","last_became_peered":"2024-04-19T02:15:53.954721+0000","last_unstale":"2024-04-19T02:16:17.765884+0000","last_undegraded":"2024-04-19T02:16:17.765884+0000","last_fullsized":"2024-04-19T02:16:17.765884+0000","mapping_epoch":16,"log_start":"18'200","ondisk_log_start":"18'200","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3723,"log_dups_size":0,"ondisk_log_size":3723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:18:29.742535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":257097728,"num_objects":3923,"num_object_clones":0,"num_object_copies":7846,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3923,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3923,"num_write_kb":251072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.028160+0000","last_change":"2024-04-19T02:15:53.959105+0000","last_active":"2024-04-19T02:16:14.028160+0000","last_peered":"2024-04-19T02:16:14.028160+0000","last_clean":"2024-04-19T02:16:14.028160+0000","last_became_active":"2024-04-19T02:15:53.958836+0000","last_became_peered":"2024-04-19T02:15:53.958836+0000","last_unstale":"2024-04-19T02:16:14.028160+0000","last_undegraded":"2024-04-19T02:16:14.028160+0000","last_fullsized":"2024-04-19T02:16:14.028160+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:18:00.321514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.028695+0000","last_change":"2024-04-19T02:15:28.892125+0000","last_active":"2024-04-19T02:16:14.028695+0000","last_peered":"2024-04-19T02:16:14.028695+0000","last_clean":"2024-04-19T02:16:14.028695+0000","last_became_active":"2024-04-19T02:15:28.891300+0000","last_became_peered":"2024-04-19T02:15:28.891300+0000","last_unstale":"2024-04-19T02:16:14.028695+0000","last_undegraded":"2024-04-19T02:16:14.028695+0000","last_fullsized":"2024-04-19T02:16:14.028695+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.030499+0000","last_change":"2024-04-19T02:15:29.281694+0000","last_active":"2024-04-19T02:16:14.030499+0000","last_peered":"2024-04-19T02:16:14.030499+0000","last_clean":"2024-04-19T02:16:14.030499+0000","last_became_active":"2024-04-19T02:15:29.280519+0000","last_became_peered":"2024-04-19T02:15:29.280519+0000","last_unstale":"2024-04-19T02:16:14.030499+0000","last_undegraded":"2024-04-19T02:16:14.030499+0000","last_fullsized":"2024-04-19T02:16:14.030499+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:50.890545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"26'3810","reported_seq":3828,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-19T02:16:17.758731+0000","last_change":"2024-04-19T02:15:53.955079+0000","last_active":"2024-04-19T02:16:17.758731+0000","last_peered":"2024-04-19T02:16:17.758731+0000","last_clean":"2024-04-19T02:16:17.758731+0000","last_became_active":"2024-04-19T02:15:53.954767+0000","last_became_peered":"2024-04-19T02:15:53.954767+0000","last_unstale":"2024-04-19T02:16:17.758731+0000","last_undegraded":"2024-04-19T02:16:17.758731+0000","last_fullsized":"2024-04-19T02:16:17.758731+0000","mapping_epoch":16,"log_start":"18'100","ondisk_log_start":"18'100","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3710,"log_dups_size":0,"ondisk_log_size":3710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:17:09.869041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":249692160,"num_objects":3810,"num_object_clones":0,"num_object_copies":7620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3810,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3810,"num_write_kb":243840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.028378+0000","last_change":"2024-04-19T02:15:28.891702+0000","last_active":"2024-04-19T02:16:14.028378+0000","last_peered":"2024-04-19T02:16:14.028378+0000","last_clean":"2024-04-19T02:16:14.028378+0000","last_became_active":"2024-04-19T02:15:28.890743+0000","last_became_peered":"2024-04-19T02:15:28.890743+0000","last_unstale":"2024-04-19T02:16:14.028378+0000","last_undegraded":"2024-04-19T02:16:14.028378+0000","last_fullsized":"2024-04-19T02:16:14.028378+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.028488+0000","last_change":"2024-04-19T02:15:24.526845+0000","last_active":"2024-04-19T02:16:14.028488+0000","last_peered":"2024-04-19T02:16:14.028488+0000","last_clean":"2024-04-19T02:16:14.028488+0000","last_became_active":"2024-04-19T02:15:24.526500+0000","last_became_peered":"2024-04-19T02:15:24.526500+0000","last_unstale":"2024-04-19T02:16:14.028488+0000","last_undegraded":"2024-04-19T02:16:14.028488+0000","last_fullsized":"2024-04-19T02:16:14.028488+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:16.883355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.027588+0000","last_change":"2024-04-19T02:15:29.278686+0000","last_active":"2024-04-19T02:16:14.027588+0000","last_peered":"2024-04-19T02:16:14.027588+0000","last_clean":"2024-04-19T02:16:14.027588+0000","last_became_active":"2024-04-19T02:15:29.278108+0000","last_became_peered":"2024-04-19T02:15:29.278108+0000","last_unstale":"2024-04-19T02:16:14.027588+0000","last_undegraded":"2024-04-19T02:16:14.027588+0000","last_fullsized":"2024-04-19T02:16:14.027588+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:34.593754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"26'3789","reported_seq":3807,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-19T02:16:17.747031+0000","last_change":"2024-04-19T02:15:53.957269+0000","last_active":"2024-04-19T02:16:17.747031+0000","last_peered":"2024-04-19T02:16:17.747031+0000","last_clean":"2024-04-19T02:16:17.747031+0000","last_became_active":"2024-04-19T02:15:53.956554+0000","last_became_peered":"2024-04-19T02:15:53.956554+0000","last_unstale":"2024-04-19T02:16:17.747031+0000","last_undegraded":"2024-04-19T02:16:17.747031+0000","last_fullsized":"2024-04-19T02:16:17.747031+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3789,"log_dups_size":0,"ondisk_log_size":3789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:29:38.789719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":248315904,"num_objects":3789,"num_object_clones":0,"num_object_copies":7578,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3789,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3789,"num_write_kb":242496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.026051+0000","last_change":"2024-04-19T02:15:24.533777+0000","last_active":"2024-04-19T02:16:14.026051+0000","last_peered":"2024-04-19T02:16:14.026051+0000","last_clean":"2024-04-19T02:16:14.026051+0000","last_became_active":"2024-04-19T02:15:24.533436+0000","last_became_peered":"2024-04-19T02:15:24.533436+0000","last_unstale":"2024-04-19T02:16:14.026051+0000","last_undegraded":"2024-04-19T02:16:14.026051+0000","last_fullsized":"2024-04-19T02:16:14.026051+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:53:25.922418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.028346+0000","last_change":"2024-04-19T02:15:28.891370+0000","last_active":"2024-04-19T02:16:14.028346+0000","last_peered":"2024-04-19T02:16:14.028346+0000","last_clean":"2024-04-19T02:16:14.028346+0000","last_became_active":"2024-04-19T02:15:28.890702+0000","last_became_peered":"2024-04-19T02:15:28.890702+0000","last_unstale":"2024-04-19T02:16:14.028346+0000","last_undegraded":"2024-04-19T02:16:14.028346+0000","last_fullsized":"2024-04-19T02:16:14.028346+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:33.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.028537+0000","last_change":"2024-04-19T02:15:29.282244+0000","last_active":"2024-04-19T02:16:14.028537+0000","last_peered":"2024-04-19T02:16:14.028537+0000","last_clean":"2024-04-19T02:16:14.028537+0000","last_became_active":"2024-04-19T02:15:29.280366+0000","last_became_peered":"2024-04-19T02:15:29.280366+0000","last_unstale":"2024-04-19T02:16:14.028537+0000","last_undegraded":"2024-04-19T02:16:14.028537+0000","last_fullsized":"2024-04-19T02:16:14.028537+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.030591+0000","last_change":"2024-04-19T02:15:28.893027+0000","last_active":"2024-04-19T02:16:14.030591+0000","last_peered":"2024-04-19T02:16:14.030591+0000","last_clean":"2024-04-19T02:16:14.030591+0000","last_became_active":"2024-04-19T02:15:28.892695+0000","last_became_peered":"2024-04-19T02:15:28.892695+0000","last_unstale":"2024-04-19T02:16:14.030591+0000","last_undegraded":"2024-04-19T02:16:14.030591+0000","last_fullsized":"2024-04-19T02:16:14.030591+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.029398+0000","last_change":"2024-04-19T02:15:29.283155+0000","last_active":"2024-04-19T02:16:14.029398+0000","last_peered":"2024-04-19T02:16:14.029398+0000","last_clean":"2024-04-19T02:16:14.029398+0000","last_became_active":"2024-04-19T02:15:29.281407+0000","last_became_peered":"2024-04-19T02:15:29.281407+0000","last_unstale":"2024-04-19T02:16:14.029398+0000","last_undegraded":"2024-04-19T02:16:14.029398+0000","last_fullsized":"2024-04-19T02:16:14.029398+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.025238+0000","last_change":"2024-04-19T02:15:28.893067+0000","last_active":"2024-04-19T02:16:14.025238+0000","last_peered":"2024-04-19T02:16:14.025238+0000","last_clean":"2024-04-19T02:16:14.025238+0000","last_became_active":"2024-04-19T02:15:28.892781+0000","last_became_peered":"2024-04-19T02:15:28.892781+0000","last_unstale":"2024-04-19T02:16:14.025238+0000","last_undegraded":"2024-04-19T02:16:14.025238+0000","last_fullsized":"2024-04-19T02:16:14.025238+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:54:15.590143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.025674+0000","last_change":"2024-04-19T02:15:29.281279+0000","last_active":"2024-04-19T02:16:14.025674+0000","last_peered":"2024-04-19T02:16:14.025674+0000","last_clean":"2024-04-19T02:16:14.025674+0000","last_became_active":"2024-04-19T02:15:29.279360+0000","last_became_peered":"2024-04-19T02:15:29.279360+0000","last_unstale":"2024-04-19T02:16:14.025674+0000","last_undegraded":"2024-04-19T02:16:14.025674+0000","last_fullsized":"2024-04-19T02:16:14.025674+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.029096+0000","last_change":"2024-04-19T02:15:28.893239+0000","last_active":"2024-04-19T02:16:14.029096+0000","last_peered":"2024-04-19T02:16:14.029096+0000","last_clean":"2024-04-19T02:16:14.029096+0000","last_became_active":"2024-04-19T02:15:28.892881+0000","last_became_peered":"2024-04-19T02:15:28.892881+0000","last_unstale":"2024-04-19T02:16:14.029096+0000","last_undegraded":"2024-04-19T02:16:14.029096+0000","last_fullsized":"2024-04-19T02:16:14.029096+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.025132+0000","last_change":"2024-04-19T02:15:29.281652+0000","last_active":"2024-04-19T02:16:14.025132+0000","last_peered":"2024-04-19T02:16:14.025132+0000","last_clean":"2024-04-19T02:16:14.025132+0000","last_became_active":"2024-04-19T02:15:29.281175+0000","last_became_peered":"2024-04-19T02:15:29.281175+0000","last_unstale":"2024-04-19T02:16:14.025132+0000","last_undegraded":"2024-04-19T02:16:14.025132+0000","last_fullsized":"2024-04-19T02:16:14.025132+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:16.568764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.028582+0000","last_change":"2024-04-19T02:15:28.892058+0000","last_active":"2024-04-19T02:16:14.028582+0000","last_peered":"2024-04-19T02:16:14.028582+0000","last_clean":"2024-04-19T02:16:14.028582+0000","last_became_active":"2024-04-19T02:15:28.890877+0000","last_became_peered":"2024-04-19T02:15:28.890877+0000","last_unstale":"2024-04-19T02:16:14.028582+0000","last_undegraded":"2024-04-19T02:16:14.028582+0000","last_fullsized":"2024-04-19T02:16:14.028582+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:53.170180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.028679+0000","last_change":"2024-04-19T02:15:29.278810+0000","last_active":"2024-04-19T02:16:14.028679+0000","last_peered":"2024-04-19T02:16:14.028679+0000","last_clean":"2024-04-19T02:16:14.028679+0000","last_became_active":"2024-04-19T02:15:29.277913+0000","last_became_peered":"2024-04-19T02:15:29.277913+0000","last_unstale":"2024-04-19T02:16:14.028679+0000","last_undegraded":"2024-04-19T02:16:14.028679+0000","last_fullsized":"2024-04-19T02:16:14.028679+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:24.082666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.028828+0000","last_change":"2024-04-19T02:15:28.889132+0000","last_active":"2024-04-19T02:16:14.028828+0000","last_peered":"2024-04-19T02:16:14.028828+0000","last_clean":"2024-04-19T02:16:14.028828+0000","last_became_active":"2024-04-19T02:15:28.888926+0000","last_became_peered":"2024-04-19T02:15:28.888926+0000","last_unstale":"2024-04-19T02:16:14.028828+0000","last_undegraded":"2024-04-19T02:16:14.028828+0000","last_fullsized":"2024-04-19T02:16:14.028828+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.024992+0000","last_change":"2024-04-19T02:15:29.282776+0000","last_active":"2024-04-19T02:16:14.024992+0000","last_peered":"2024-04-19T02:16:14.024992+0000","last_clean":"2024-04-19T02:16:14.024992+0000","last_became_active":"2024-04-19T02:15:29.279382+0000","last_became_peered":"2024-04-19T02:15:29.279382+0000","last_unstale":"2024-04-19T02:16:14.024992+0000","last_undegraded":"2024-04-19T02:16:14.024992+0000","last_fullsized":"2024-04-19T02:16:14.024992+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.024913+0000","last_change":"2024-04-19T02:15:29.283537+0000","last_active":"2024-04-19T02:16:14.024913+0000","last_peered":"2024-04-19T02:16:14.024913+0000","last_clean":"2024-04-19T02:16:14.024913+0000","last_became_active":"2024-04-19T02:15:29.281801+0000","last_became_peered":"2024-04-19T02:15:29.281801+0000","last_unstale":"2024-04-19T02:16:14.024913+0000","last_undegraded":"2024-04-19T02:16:14.024913+0000","last_fullsized":"2024-04-19T02:16:14.024913+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.027810+0000","last_change":"2024-04-19T02:15:29.281560+0000","last_active":"2024-04-19T02:16:14.027810+0000","last_peered":"2024-04-19T02:16:14.027810+0000","last_clean":"2024-04-19T02:16:14.027810+0000","last_became_active":"2024-04-19T02:15:29.281261+0000","last_became_peered":"2024-04-19T02:15:29.281261+0000","last_unstale":"2024-04-19T02:16:14.027810+0000","last_undegraded":"2024-04-19T02:16:14.027810+0000","last_fullsized":"2024-04-19T02:16:14.027810+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.024754+0000","last_change":"2024-04-19T02:15:53.955913+0000","last_active":"2024-04-19T02:16:14.024754+0000","last_peered":"2024-04-19T02:16:14.024754+0000","last_clean":"2024-04-19T02:16:14.024754+0000","last_became_active":"2024-04-19T02:15:53.955676+0000","last_became_peered":"2024-04-19T02:15:53.955676+0000","last_unstale":"2024-04-19T02:16:14.024754+0000","last_undegraded":"2024-04-19T02:16:14.024754+0000","last_fullsized":"2024-04-19T02:16:14.024754+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:53:02.899902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.028971+0000","last_change":"2024-04-19T02:15:29.278702+0000","last_active":"2024-04-19T02:16:14.028971+0000","last_peered":"2024-04-19T02:16:14.028971+0000","last_clean":"2024-04-19T02:16:14.028971+0000","last_became_active":"2024-04-19T02:15:29.277756+0000","last_became_peered":"2024-04-19T02:15:29.277756+0000","last_unstale":"2024-04-19T02:16:14.028971+0000","last_undegraded":"2024-04-19T02:16:14.028971+0000","last_fullsized":"2024-04-19T02:16:14.028971+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-19T02:16:14.029465+0000","last_change":"2024-04-19T02:15:29.277568+0000","last_active":"2024-04-19T02:16:14.029465+0000","last_peered":"2024-04-19T02:16:14.029465+0000","last_clean":"2024-04-19T02:16:14.029465+0000","last_became_active":"2024-04-19T02:15:29.276725+0000","last_became_peered":"2024-04-19T02:15:29.276725+0000","last_unstale":"2024-04-19T02:16:14.029465+0000","last_undegraded":"2024-04-19T02:16:14.029465+0000","last_fullsized":"2024-04-19T02:16:14.029465+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":4089053184,"num_objects":62394,"num_object_clones":0,"num_object_copies":124788,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62394,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62394,"num_write_kb":3993216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8179417088,"data_stored":8179417088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":59594,"ondisk_log_size":59594,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738381,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3282200,"kb_used_data":3201036,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":91089640,"statfs":{"total":96636764160,"available":93275791360,"internally_reserved":0,"allocated":3277860864,"data_stored":3277684645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":83098054},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.17399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.21099999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738382,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2528884,"kb_used_data":2453480,"kb_used_omap":1,"kb_used_meta":75390,"kb_avail":91842956,"statfs":{"total":96636764160,"available":94047186944,"internally_reserved":0,"allocated":2512363520,"data_stored":2512160919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77199814},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.191}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3360000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738381,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2248604,"kb_used_data":2181396,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":92123236,"statfs":{"total":96636764160,"available":94334193664,"internally_reserved":0,"allocated":2233749504,"data_stored":2233562178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68811206},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2566389760,"data_stored":2566389760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2298871808,"data_stored":2298871808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3314155520,"data_stored":3314155520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:16:21.608 INFO:tasks.thrashosds.thrasher:Setting 5.1 to [1, 2] 2024-04-19T02:16:21.608 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '5.1', '1', '2'] 2024-04-19T02:16:21.608 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 5.1 1 2 2024-04-19T02:16:21.615 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2: {} 2024-04-19T02:16:21.615 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:16:21.615 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:16:21.615 INFO:teuthology.orchestra.run.smithi121.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:16:21.631 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:21.632+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:21.732 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:21.733+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:21.738 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-04-19T02:16:21.738 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 20, 2024-04-19T02:16:21.738 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 600, 2024-04-19T02:16:21.738 INFO:teuthology.orchestra.run.smithi177.stdout: "ops": [ 2024-04-19T02:16:21.738 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.738 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:2290 5.5 5:a870a399:::benchmark_data_smithi121_44835_object2289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:16:21.738 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:55.645524+0000", 2024-04-19T02:16:21.738 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 26.091952065000001, 2024-04-19T02:16:21.739 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.018181836999999999, 2024-04-19T02:16:21.739 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:21.739 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:21.739 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:21.739 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:21.739 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:21.739 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 2290 2024-04-19T02:16:21.739 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.739 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:21.739 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.739 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:21.739 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645524+0000", 2024-04-19T02:16:21.739 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:21.739 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.740 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.740 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:21.740 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645524+0000", 2024-04-19T02:16:21.740 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:21.740 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.740 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.740 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:21.740 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645524+0000", 2024-04-19T02:16:21.740 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:21.740 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.740 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.740 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:21.740 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645603+0000", 2024-04-19T02:16:21.740 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.9983999999999999e-05 2024-04-19T02:16:21.740 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.741 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.741 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:21.741 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645609+0000", 2024-04-19T02:16:21.741 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.5500000000000002e-06 2024-04-19T02:16:21.741 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.741 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.741 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:21.741 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645613+0000", 2024-04-19T02:16:21.741 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.591e-06 2024-04-19T02:16:21.741 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.741 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.741 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:21.741 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645649+0000", 2024-04-19T02:16:21.741 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6769e-05 2024-04-19T02:16:21.741 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.742 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.742 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:21.742 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645765+0000", 2024-04-19T02:16:21.742 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00011593499999999999 2024-04-19T02:16:21.742 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.742 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.742 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:21.742 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645899+0000", 2024-04-19T02:16:21.742 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00013329499999999999 2024-04-19T02:16:21.742 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.742 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.742 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:21.742 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.649261+0000", 2024-04-19T02:16:21.742 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0033619639999999998 2024-04-19T02:16:21.742 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.743 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.743 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:21.743 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.663657+0000", 2024-04-19T02:16:21.743 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.014396137999999999 2024-04-19T02:16:21.743 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.743 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.743 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:21.743 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.663686+0000", 2024-04-19T02:16:21.743 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.8841999999999999e-05 2024-04-19T02:16:21.743 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.743 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.743 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:21.743 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.663706+0000", 2024-04-19T02:16:21.743 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.0108000000000001e-05 2024-04-19T02:16:21.743 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:21.744 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:21.744 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:21.744 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.744 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.744 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:2296 5.5 5:a5d39efa:::benchmark_data_smithi121_44835_object2295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:16:21.744 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:55.646720+0000", 2024-04-19T02:16:21.744 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 26.090756271, 2024-04-19T02:16:21.744 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.017072077000000001, 2024-04-19T02:16:21.744 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:21.744 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:21.744 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:21.744 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:21.744 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:21.744 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 2296 2024-04-19T02:16:21.744 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.744 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:21.745 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.745 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:21.745 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646720+0000", 2024-04-19T02:16:21.745 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:21.745 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.745 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.745 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:21.745 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646720+0000", 2024-04-19T02:16:21.745 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:21.745 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.745 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.745 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:21.745 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646719+0000", 2024-04-19T02:16:21.745 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:21.745 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.745 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.746 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:21.746 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646778+0000", 2024-04-19T02:16:21.746 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.9264e-05 2024-04-19T02:16:21.746 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.746 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.746 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:21.746 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646792+0000", 2024-04-19T02:16:21.746 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.3573e-05 2024-04-19T02:16:21.746 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.746 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.746 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:21.746 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646797+0000", 2024-04-19T02:16:21.746 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.3190000000000002e-06 2024-04-19T02:16:21.746 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.746 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.746 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:21.747 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646826+0000", 2024-04-19T02:16:21.747 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.8787999999999999e-05 2024-04-19T02:16:21.747 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.747 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.747 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:21.747 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646913+0000", 2024-04-19T02:16:21.747 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.7601000000000004e-05 2024-04-19T02:16:21.747 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.747 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.747 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:21.747 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646996+0000", 2024-04-19T02:16:21.747 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.2237000000000006e-05 2024-04-19T02:16:21.747 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.747 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.747 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:21.748 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.649533+0000", 2024-04-19T02:16:21.748 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.002537564 2024-04-19T02:16:21.748 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.748 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.748 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:21.748 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.663741+0000", 2024-04-19T02:16:21.748 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.014207322 2024-04-19T02:16:21.748 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.748 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.748 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:21.748 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.663771+0000", 2024-04-19T02:16:21.748 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.0324e-05 2024-04-19T02:16:21.748 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.748 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.748 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:21.748 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.663792+0000", 2024-04-19T02:16:21.749 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.0778999999999999e-05 2024-04-19T02:16:21.749 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:21.749 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:21.749 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:21.749 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.749 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.749 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:16497 5.c 5:3cb287d4:::benchmark_data_smithi121_44835_object16496:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:21.749 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:59.873454+0000", 2024-04-19T02:16:21.749 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 21.864022322, 2024-04-19T02:16:21.749 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.017103489999999999, 2024-04-19T02:16:21.749 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:21.749 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:21.749 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:21.749 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:21.749 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:21.749 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 16497 2024-04-19T02:16:21.750 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.750 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:21.750 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.750 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:21.750 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873454+0000", 2024-04-19T02:16:21.750 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:21.750 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.750 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.750 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:21.750 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873454+0000", 2024-04-19T02:16:21.750 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:21.750 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.750 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.751 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:21.751 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873453+0000", 2024-04-19T02:16:21.751 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:21.751 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.751 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.751 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:21.751 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873512+0000", 2024-04-19T02:16:21.751 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.8730999999999997e-05 2024-04-19T02:16:21.751 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.751 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.751 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:21.751 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873518+0000", 2024-04-19T02:16:21.751 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.9789999999999998e-06 2024-04-19T02:16:21.751 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.751 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.751 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:21.752 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873522+0000", 2024-04-19T02:16:21.752 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.0570000000000003e-06 2024-04-19T02:16:21.752 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.752 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.752 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:21.752 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873590+0000", 2024-04-19T02:16:21.752 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.8504999999999995e-05 2024-04-19T02:16:21.752 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.752 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.752 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:21.752 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873709+0000", 2024-04-19T02:16:21.752 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000118497 2024-04-19T02:16:21.752 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.752 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.752 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:21.752 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873881+0000", 2024-04-19T02:16:21.753 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000172129 2024-04-19T02:16:21.753 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.753 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.753 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:21.753 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.874627+0000", 2024-04-19T02:16:21.753 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00074580100000000004 2024-04-19T02:16:21.753 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.753 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.753 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:21.753 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.890478+0000", 2024-04-19T02:16:21.753 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015850672 2024-04-19T02:16:21.753 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.753 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.753 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:21.753 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.890522+0000", 2024-04-19T02:16:21.754 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.4376000000000003e-05 2024-04-19T02:16:21.754 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.754 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.754 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:21.754 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.890557+0000", 2024-04-19T02:16:21.754 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.5151999999999998e-05 2024-04-19T02:16:21.754 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:21.754 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:21.754 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:21.754 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.754 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.754 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:42714 5.c 5:32899b28:::benchmark_data_smithi121_44835_object42713:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:21.754 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:09.266429+0000", 2024-04-19T02:16:21.754 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 12.471047315, 2024-04-19T02:16:21.754 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.017445751999999998, 2024-04-19T02:16:21.755 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:21.755 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:21.755 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:21.755 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:21.755 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:21.755 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 42714 2024-04-19T02:16:21.755 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.755 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:21.755 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.755 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:21.755 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.266429+0000", 2024-04-19T02:16:21.755 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:21.755 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.755 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.755 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:21.756 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.266429+0000", 2024-04-19T02:16:21.756 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:21.756 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.756 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.756 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:21.756 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.266428+0000", 2024-04-19T02:16:21.756 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:21.756 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.756 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.756 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:21.756 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.266523+0000", 2024-04-19T02:16:21.756 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.4913000000000004e-05 2024-04-19T02:16:21.756 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.756 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.756 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:21.756 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.266535+0000", 2024-04-19T02:16:21.757 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.2187e-05 2024-04-19T02:16:21.757 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.757 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.757 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:21.757 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.266542+0000", 2024-04-19T02:16:21.757 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.7139999999999993e-06 2024-04-19T02:16:21.757 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.757 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.757 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:21.757 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.267446+0000", 2024-04-19T02:16:21.757 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00090385699999999999 2024-04-19T02:16:21.757 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.757 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.757 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:21.757 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.267570+0000", 2024-04-19T02:16:21.758 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012405599999999999 2024-04-19T02:16:21.758 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.758 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.758 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:21.758 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.267733+0000", 2024-04-19T02:16:21.758 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000162225 2024-04-19T02:16:21.758 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.758 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.758 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:21.758 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.275131+0000", 2024-04-19T02:16:21.758 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0073988639999999998 2024-04-19T02:16:21.758 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.758 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.758 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:21.758 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.283761+0000", 2024-04-19T02:16:21.759 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0086299989999999993 2024-04-19T02:16:21.759 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.759 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.759 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:21.759 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.283824+0000", 2024-04-19T02:16:21.759 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.2632000000000006e-05 2024-04-19T02:16:21.759 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.759 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.759 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:21.759 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.283874+0000", 2024-04-19T02:16:21.759 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.0290999999999997e-05 2024-04-19T02:16:21.759 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:21.759 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:21.759 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:21.759 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.759 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.760 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:42724 5.0 e23/16 5:0d0b7b99:::benchmark_data_smithi121_44835_object42723:head v 23'2565, mlcod=23'2563)", 2024-04-19T02:16:21.760 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:09.271090+0000", 2024-04-19T02:16:21.760 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 12.466385982, 2024-04-19T02:16:21.760 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016714757, 2024-04-19T02:16:21.760 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:21.760 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:21.760 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:21.760 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.760 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:21.760 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.271090+0000", 2024-04-19T02:16:21.760 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:21.760 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.760 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.760 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:21.760 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.271090+0000", 2024-04-19T02:16:21.761 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:21.761 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.761 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.761 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:21.761 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.271090+0000", 2024-04-19T02:16:21.761 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:21.761 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.761 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.761 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:21.761 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.271139+0000", 2024-04-19T02:16:21.761 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.9614999999999998e-05 2024-04-19T02:16:21.761 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.761 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.761 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:21.762 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.271147+0000", 2024-04-19T02:16:21.762 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.6960000000000005e-06 2024-04-19T02:16:21.762 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.762 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.762 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:21.762 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.271151+0000", 2024-04-19T02:16:21.762 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.3030000000000001e-06 2024-04-19T02:16:21.762 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.762 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.762 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:21.762 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.271179+0000", 2024-04-19T02:16:21.762 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.7971e-05 2024-04-19T02:16:21.762 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.762 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.762 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:21.763 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.271194+0000", 2024-04-19T02:16:21.763 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.4406999999999999e-05 2024-04-19T02:16:21.763 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.763 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.763 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:21.763 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.287772+0000", 2024-04-19T02:16:21.763 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016578275 2024-04-19T02:16:21.763 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.763 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.763 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:21.763 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.287805+0000", 2024-04-19T02:16:21.763 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.2914999999999999e-05 2024-04-19T02:16:21.763 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:21.763 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:21.763 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:21.764 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.764 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.764 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:43121 5.5 5:abed14ce:::benchmark_data_smithi121_44835_object43120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:21.764 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:09.429697+0000", 2024-04-19T02:16:21.764 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 12.307778633, 2024-04-19T02:16:21.764 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.017381669999999998, 2024-04-19T02:16:21.764 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:21.764 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:21.764 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:21.764 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:21.764 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:21.764 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 43121 2024-04-19T02:16:21.764 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.764 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:21.764 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.765 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:21.765 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.429697+0000", 2024-04-19T02:16:21.765 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:21.765 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.765 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.765 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:21.765 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.429697+0000", 2024-04-19T02:16:21.765 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:21.765 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.765 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.765 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:21.765 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.429697+0000", 2024-04-19T02:16:21.765 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:21.765 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.765 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.765 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:21.766 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.429798+0000", 2024-04-19T02:16:21.766 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000101228 2024-04-19T02:16:21.766 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.766 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.766 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:21.766 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.429808+0000", 2024-04-19T02:16:21.766 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.9080000000000007e-06 2024-04-19T02:16:21.766 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.766 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.766 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:21.766 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.429814+0000", 2024-04-19T02:16:21.766 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.7580000000000003e-06 2024-04-19T02:16:21.766 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.766 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.766 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:21.767 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.431378+0000", 2024-04-19T02:16:21.767 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0015631919999999999 2024-04-19T02:16:21.767 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.767 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.767 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:21.767 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.431471+0000", 2024-04-19T02:16:21.767 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.3595000000000001e-05 2024-04-19T02:16:21.767 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.767 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.767 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:21.767 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.431591+0000", 2024-04-19T02:16:21.767 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000119485 2024-04-19T02:16:21.767 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.767 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.767 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:21.768 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.435643+0000", 2024-04-19T02:16:21.768 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0040522500000000003 2024-04-19T02:16:21.768 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.768 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.768 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:21.768 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.447020+0000", 2024-04-19T02:16:21.768 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.011377152 2024-04-19T02:16:21.768 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.768 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.768 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:21.768 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.447054+0000", 2024-04-19T02:16:21.768 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.3558e-05 2024-04-19T02:16:21.768 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.768 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.768 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:21.769 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.447079+0000", 2024-04-19T02:16:21.769 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.5293999999999999e-05 2024-04-19T02:16:21.769 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:21.769 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:21.769 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:21.769 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.769 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.769 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:43692 5.3 5:c384a549:::benchmark_data_smithi121_44835_object43691:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:21.769 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:09.660580+0000", 2024-04-19T02:16:21.769 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 12.076895693999999, 2024-04-19T02:16:21.769 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.017860674999999999, 2024-04-19T02:16:21.769 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:21.769 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:21.769 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:21.769 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:21.770 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:21.770 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 43692 2024-04-19T02:16:21.770 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.770 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:21.770 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.770 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:21.770 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.660580+0000", 2024-04-19T02:16:21.770 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:21.770 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.770 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.770 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:21.770 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.660580+0000", 2024-04-19T02:16:21.770 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:21.770 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.771 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.771 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:21.771 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.660580+0000", 2024-04-19T02:16:21.771 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:21.771 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.771 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.771 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:21.771 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.660665+0000", 2024-04-19T02:16:21.771 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.5135000000000004e-05 2024-04-19T02:16:21.771 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.771 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.771 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:21.771 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.660677+0000", 2024-04-19T02:16:21.771 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.2743e-05 2024-04-19T02:16:21.771 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.772 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.772 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:21.772 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.660684+0000", 2024-04-19T02:16:21.772 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.8040000000000004e-06 2024-04-19T02:16:21.772 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.772 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.772 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:21.772 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.665455+0000", 2024-04-19T02:16:21.772 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0047704419999999997 2024-04-19T02:16:21.772 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.772 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.772 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:21.772 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.665546+0000", 2024-04-19T02:16:21.772 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.1330999999999997e-05 2024-04-19T02:16:21.772 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.773 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.773 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:21.773 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.665632+0000", 2024-04-19T02:16:21.773 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.5995999999999995e-05 2024-04-19T02:16:21.773 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.773 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.773 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:21.773 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.670521+0000", 2024-04-19T02:16:21.773 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0048892299999999996 2024-04-19T02:16:21.773 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.773 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.773 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:21.773 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.678370+0000", 2024-04-19T02:16:21.773 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0078485880000000001 2024-04-19T02:16:21.773 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.773 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.774 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:21.774 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.678409+0000", 2024-04-19T02:16:21.774 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.9511000000000002e-05 2024-04-19T02:16:21.774 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.774 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.774 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:21.774 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.678441+0000", 2024-04-19T02:16:21.774 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.1615999999999997e-05 2024-04-19T02:16:21.774 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:21.774 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:21.774 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:21.774 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.774 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.774 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:52498 5.3 5:cd91eeff:::benchmark_data_smithi121_44835_object52497:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T02:16:21.775 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:13.338526+0000", 2024-04-19T02:16:21.775 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 8.3989500160000006, 2024-04-19T02:16:21.775 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016659635999999999, 2024-04-19T02:16:21.775 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:21.775 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:21.775 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:21.775 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:21.775 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:21.775 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 52498 2024-04-19T02:16:21.775 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.775 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:21.775 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.775 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:21.775 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:13.338526+0000", 2024-04-19T02:16:21.775 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:21.776 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.776 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.776 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:21.776 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:13.338526+0000", 2024-04-19T02:16:21.776 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:21.776 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.776 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.776 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:21.776 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:13.338525+0000", 2024-04-19T02:16:21.776 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:21.776 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.776 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.776 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:21.776 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:13.338581+0000", 2024-04-19T02:16:21.776 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.5986999999999998e-05 2024-04-19T02:16:21.777 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.777 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.777 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:21.777 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:13.338590+0000", 2024-04-19T02:16:21.777 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.3950000000000001e-06 2024-04-19T02:16:21.777 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.777 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.777 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:21.777 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:13.338595+0000", 2024-04-19T02:16:21.777 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.0080000000000002e-06 2024-04-19T02:16:21.777 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.777 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.777 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:21.777 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:13.341530+0000", 2024-04-19T02:16:21.777 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0029350729999999998 2024-04-19T02:16:21.777 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.778 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.778 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:21.778 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:13.341693+0000", 2024-04-19T02:16:21.778 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000163005 2024-04-19T02:16:21.778 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.778 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.778 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:21.778 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:13.341862+0000", 2024-04-19T02:16:21.778 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00016903600000000001 2024-04-19T02:16:21.778 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.778 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.778 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:21.778 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:13.346110+0000", 2024-04-19T02:16:21.778 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0042477089999999997 2024-04-19T02:16:21.778 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.779 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.779 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:21.779 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:13.355104+0000", 2024-04-19T02:16:21.779 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0089941959999999994 2024-04-19T02:16:21.779 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.779 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.779 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:21.779 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:13.355149+0000", 2024-04-19T02:16:21.779 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.5726999999999998e-05 2024-04-19T02:16:21.779 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.779 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.779 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:21.779 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:13.355186+0000", 2024-04-19T02:16:21.779 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6059999999999997e-05 2024-04-19T02:16:21.779 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:21.780 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:21.780 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:21.780 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.780 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.780 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:60906 5.c 5:3e19a5a3:::benchmark_data_smithi121_44835_object60905:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:21.780 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:17.043489+0000", 2024-04-19T02:16:21.780 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4.6939871169999998, 2024-04-19T02:16:21.780 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.017397276999999999, 2024-04-19T02:16:21.780 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:21.780 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:21.780 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:21.780 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:21.780 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:21.780 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 60906 2024-04-19T02:16:21.780 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.781 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:21.781 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.781 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:21.781 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.043489+0000", 2024-04-19T02:16:21.781 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:21.781 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.781 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.781 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:21.781 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.043489+0000", 2024-04-19T02:16:21.781 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:21.781 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.781 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.781 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:21.781 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.043488+0000", 2024-04-19T02:16:21.781 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:21.781 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.782 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.782 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:21.782 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.043565+0000", 2024-04-19T02:16:21.782 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.7255999999999994e-05 2024-04-19T02:16:21.782 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.782 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.782 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:21.782 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.043574+0000", 2024-04-19T02:16:21.782 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.8640000000000002e-06 2024-04-19T02:16:21.782 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.782 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.782 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:21.782 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.043581+0000", 2024-04-19T02:16:21.782 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.374e-06 2024-04-19T02:16:21.783 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.783 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.783 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:21.783 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.052963+0000", 2024-04-19T02:16:21.783 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.009381113 2024-04-19T02:16:21.783 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.783 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.783 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:21.783 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.053086+0000", 2024-04-19T02:16:21.783 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012339600000000001 2024-04-19T02:16:21.783 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.783 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.783 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:21.783 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.053212+0000", 2024-04-19T02:16:21.783 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012636200000000001 2024-04-19T02:16:21.784 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.784 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.784 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:21.784 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.055950+0000", 2024-04-19T02:16:21.784 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0027377270000000001 2024-04-19T02:16:21.784 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.784 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.784 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:21.784 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.060804+0000", 2024-04-19T02:16:21.784 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0048543049999999997 2024-04-19T02:16:21.784 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.784 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.784 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:21.784 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.060858+0000", 2024-04-19T02:16:21.784 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.3161000000000001e-05 2024-04-19T02:16:21.785 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.785 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.785 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:21.785 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.060886+0000", 2024-04-19T02:16:21.785 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.8518e-05 2024-04-19T02:16:21.785 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:21.785 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:21.785 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:21.785 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.785 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.785 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:61256 5.c 5:3efbc762:::benchmark_data_smithi121_44835_object61255:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:21.785 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:17.204293+0000", 2024-04-19T02:16:21.785 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4.5331824940000001, 2024-04-19T02:16:21.785 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016495042000000001, 2024-04-19T02:16:21.785 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:21.785 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:21.786 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:21.786 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:21.786 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:21.786 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 61256 2024-04-19T02:16:21.786 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.786 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:21.786 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.786 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:21.786 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.204293+0000", 2024-04-19T02:16:21.786 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:21.786 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.786 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.786 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:21.786 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.204293+0000", 2024-04-19T02:16:21.787 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:21.787 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.787 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.787 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:21.787 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.204293+0000", 2024-04-19T02:16:21.787 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:21.787 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.787 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.787 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:21.787 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.204320+0000", 2024-04-19T02:16:21.787 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.7413999999999999e-05 2024-04-19T02:16:21.787 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.787 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.787 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:21.787 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.204328+0000", 2024-04-19T02:16:21.788 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.9640000000000003e-06 2024-04-19T02:16:21.788 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.788 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.788 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:21.788 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.204334+0000", 2024-04-19T02:16:21.788 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.4659999999999998e-06 2024-04-19T02:16:21.788 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.788 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.788 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:21.788 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.204850+0000", 2024-04-19T02:16:21.788 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00051670799999999995 2024-04-19T02:16:21.788 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.788 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.788 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:21.789 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.204993+0000", 2024-04-19T02:16:21.789 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000142788 2024-04-19T02:16:21.789 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.789 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.789 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:21.789 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.205134+0000", 2024-04-19T02:16:21.789 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00014047699999999999 2024-04-19T02:16:21.789 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.789 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.789 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:21.789 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.212603+0000", 2024-04-19T02:16:21.789 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0074690420000000004 2024-04-19T02:16:21.789 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.789 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.789 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:21.790 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.220699+0000", 2024-04-19T02:16:21.790 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0080966430000000006 2024-04-19T02:16:21.790 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.790 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.790 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:21.790 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.220731+0000", 2024-04-19T02:16:21.790 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.1677000000000002e-05 2024-04-19T02:16:21.790 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.790 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.790 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:21.790 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.220788+0000", 2024-04-19T02:16:21.790 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.7351e-05 2024-04-19T02:16:21.790 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:21.790 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:21.790 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:21.791 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.791 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.791 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:61625 5.6 5:678616b4:::benchmark_data_smithi121_44835_object61624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:21.791 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:17.383317+0000", 2024-04-19T02:16:21.791 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4.3541590250000004, 2024-04-19T02:16:21.791 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016750592000000002, 2024-04-19T02:16:21.791 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:21.791 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:21.791 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:21.791 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:21.791 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:21.791 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 61625 2024-04-19T02:16:21.791 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.791 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:21.791 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.792 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:21.792 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.383317+0000", 2024-04-19T02:16:21.792 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:21.792 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.792 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.792 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:21.792 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.383317+0000", 2024-04-19T02:16:21.792 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:21.792 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.792 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.792 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:21.792 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.383316+0000", 2024-04-19T02:16:21.792 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:21.792 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.792 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.792 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:21.793 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.383372+0000", 2024-04-19T02:16:21.793 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.5627999999999997e-05 2024-04-19T02:16:21.793 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.793 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.793 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:21.793 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.383383+0000", 2024-04-19T02:16:21.793 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0647e-05 2024-04-19T02:16:21.793 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.793 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.793 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:21.793 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.383390+0000", 2024-04-19T02:16:21.793 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.9349999999999997e-06 2024-04-19T02:16:21.793 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.793 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.793 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:21.793 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.385707+0000", 2024-04-19T02:16:21.794 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0023169839999999998 2024-04-19T02:16:21.794 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.794 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.794 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:21.794 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.385838+0000", 2024-04-19T02:16:21.794 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00013168899999999999 2024-04-19T02:16:21.794 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.794 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.794 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:21.794 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.385987+0000", 2024-04-19T02:16:21.794 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000149083 2024-04-19T02:16:21.794 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.794 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.794 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:21.794 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.391405+0000", 2024-04-19T02:16:21.795 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0054181239999999999 2024-04-19T02:16:21.795 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.795 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.795 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:21.795 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.399987+0000", 2024-04-19T02:16:21.795 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0085818230000000006 2024-04-19T02:16:21.795 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.795 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.795 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:21.795 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.400032+0000", 2024-04-19T02:16:21.795 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.4551000000000001e-05 2024-04-19T02:16:21.795 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.795 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.795 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:21.795 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.400067+0000", 2024-04-19T02:16:21.795 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.5698999999999998e-05 2024-04-19T02:16:21.796 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:21.796 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:21.796 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:21.796 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.796 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.796 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:61670 5.3 5:c5549fc1:::benchmark_data_smithi121_44835_object61669:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:21.796 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:17.409188+0000", 2024-04-19T02:16:21.796 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4.3282877160000002, 2024-04-19T02:16:21.796 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.01869871, 2024-04-19T02:16:21.796 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:21.796 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:21.796 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:21.796 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:21.796 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:21.796 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 61670 2024-04-19T02:16:21.797 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.797 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:21.797 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.797 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:21.797 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409188+0000", 2024-04-19T02:16:21.797 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:21.797 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.797 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.797 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:21.797 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409188+0000", 2024-04-19T02:16:21.797 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:21.797 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.797 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.797 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:21.797 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409188+0000", 2024-04-19T02:16:21.797 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:21.798 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.798 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.798 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:21.798 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409220+0000", 2024-04-19T02:16:21.798 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.2746999999999997e-05 2024-04-19T02:16:21.798 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.798 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.798 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:21.798 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409232+0000", 2024-04-19T02:16:21.798 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.1430999999999999e-05 2024-04-19T02:16:21.798 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.798 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.798 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:21.798 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409238+0000", 2024-04-19T02:16:21.799 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.4160000000000001e-06 2024-04-19T02:16:21.799 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.799 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.799 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:21.799 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.414159+0000", 2024-04-19T02:16:21.799 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0049206850000000002 2024-04-19T02:16:21.799 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.799 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.799 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:21.799 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.414283+0000", 2024-04-19T02:16:21.799 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000124547 2024-04-19T02:16:21.799 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.799 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.799 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:21.799 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.414439+0000", 2024-04-19T02:16:21.800 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00015586699999999999 2024-04-19T02:16:21.800 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.800 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.800 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:21.800 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.421153+0000", 2024-04-19T02:16:21.800 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0067135229999999999 2024-04-19T02:16:21.800 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.800 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.800 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:21.800 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.427775+0000", 2024-04-19T02:16:21.800 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0066216640000000002 2024-04-19T02:16:21.800 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.800 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.800 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:21.800 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.427847+0000", 2024-04-19T02:16:21.801 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.2601000000000005e-05 2024-04-19T02:16:21.801 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.801 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.801 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:21.801 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.427887+0000", 2024-04-19T02:16:21.801 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.9789000000000001e-05 2024-04-19T02:16:21.801 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:21.801 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:21.801 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:21.801 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.801 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.801 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:61671 5.3 5:cab602a2:::benchmark_data_smithi121_44835_object61670:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:21.801 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:17.409258+0000", 2024-04-19T02:16:21.801 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4.3282183280000002, 2024-04-19T02:16:21.801 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.01870983, 2024-04-19T02:16:21.801 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:21.802 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:21.802 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:21.802 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:21.802 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:21.802 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 61671 2024-04-19T02:16:21.802 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.802 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:21.802 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.802 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:21.802 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409258+0000", 2024-04-19T02:16:21.802 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:21.802 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.802 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.802 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:21.802 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409258+0000", 2024-04-19T02:16:21.803 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:21.803 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.803 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.803 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:21.803 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409257+0000", 2024-04-19T02:16:21.803 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:21.803 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.803 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.803 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:21.803 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409353+0000", 2024-04-19T02:16:21.803 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.6365000000000003e-05 2024-04-19T02:16:21.803 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.803 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.803 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:21.803 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409362+0000", 2024-04-19T02:16:21.804 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.4500000000000004e-06 2024-04-19T02:16:21.804 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.804 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.804 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:21.804 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409382+0000", 2024-04-19T02:16:21.804 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.9707e-05 2024-04-19T02:16:21.804 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.804 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.804 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:21.804 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.416070+0000", 2024-04-19T02:16:21.804 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0066881889999999998 2024-04-19T02:16:21.804 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.804 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.804 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:21.804 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.416176+0000", 2024-04-19T02:16:21.804 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00010598 2024-04-19T02:16:21.805 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.805 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.805 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:21.805 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.416271+0000", 2024-04-19T02:16:21.805 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.4846999999999995e-05 2024-04-19T02:16:21.805 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.805 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.805 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:21.805 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.421187+0000", 2024-04-19T02:16:21.805 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0049165210000000001 2024-04-19T02:16:21.805 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.805 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.805 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:21.805 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.427894+0000", 2024-04-19T02:16:21.805 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.006706844 2024-04-19T02:16:21.805 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.806 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.806 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:21.806 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.427939+0000", 2024-04-19T02:16:21.806 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.4676999999999999e-05 2024-04-19T02:16:21.806 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.806 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.806 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:21.806 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.427967+0000", 2024-04-19T02:16:21.806 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.8770999999999999e-05 2024-04-19T02:16:21.806 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:21.806 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:21.806 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:21.806 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.806 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.806 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:61686 5.3 5:c9b3b45c:::benchmark_data_smithi121_44835_object61685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:21.807 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:17.415600+0000", 2024-04-19T02:16:21.807 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4.3218756489999999, 2024-04-19T02:16:21.807 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.017118667000000001, 2024-04-19T02:16:21.807 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:21.807 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:21.807 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:21.807 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:21.807 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:21.807 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 61686 2024-04-19T02:16:21.807 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.807 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:21.807 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.807 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:21.807 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.415600+0000", 2024-04-19T02:16:21.807 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:21.807 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.808 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.808 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:21.808 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.415600+0000", 2024-04-19T02:16:21.808 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:21.808 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.808 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.808 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:21.808 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.415600+0000", 2024-04-19T02:16:21.808 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:21.808 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.808 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.808 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:21.808 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.415640+0000", 2024-04-19T02:16:21.808 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.0173999999999999e-05 2024-04-19T02:16:21.808 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.809 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.809 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:21.809 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.415648+0000", 2024-04-19T02:16:21.809 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.1650000000000006e-06 2024-04-19T02:16:21.809 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.809 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.809 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:21.809 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.415654+0000", 2024-04-19T02:16:21.809 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.5990000000000001e-06 2024-04-19T02:16:21.809 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.809 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.809 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:21.809 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.423743+0000", 2024-04-19T02:16:21.810 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0080896860000000004 2024-04-19T02:16:21.810 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.810 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.810 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:21.810 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.423861+0000", 2024-04-19T02:16:21.810 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000117761 2024-04-19T02:16:21.810 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.810 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.810 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:21.810 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.423994+0000", 2024-04-19T02:16:21.810 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000133079 2024-04-19T02:16:21.810 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.810 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.810 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:21.810 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.425869+0000", 2024-04-19T02:16:21.811 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.001875215 2024-04-19T02:16:21.811 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.811 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.811 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:21.811 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.432580+0000", 2024-04-19T02:16:21.811 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0067104010000000004 2024-04-19T02:16:21.811 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.811 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.811 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:21.811 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.432636+0000", 2024-04-19T02:16:21.811 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.6026999999999997e-05 2024-04-19T02:16:21.811 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.811 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.811 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:21.811 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.432719+0000", 2024-04-19T02:16:21.811 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.3049999999999999e-05 2024-04-19T02:16:21.812 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:21.812 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:21.812 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:21.812 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.812 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.812 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:61815 5.c 5:3ca8a794:::benchmark_data_smithi121_44835_object61814:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:21.812 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:17.482110+0000", 2024-04-19T02:16:21.812 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4.2553658030000001, 2024-04-19T02:16:21.812 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.021577559999999999, 2024-04-19T02:16:21.812 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:21.812 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:21.812 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:21.812 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:21.812 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:21.813 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 61815 2024-04-19T02:16:21.813 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.813 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:21.813 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.813 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:21.813 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482110+0000", 2024-04-19T02:16:21.813 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:21.813 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.813 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.813 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:21.813 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482110+0000", 2024-04-19T02:16:21.813 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:21.813 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.813 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.813 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:21.813 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482109+0000", 2024-04-19T02:16:21.814 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:21.814 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.814 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.814 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:21.814 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482197+0000", 2024-04-19T02:16:21.814 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.7405999999999996e-05 2024-04-19T02:16:21.814 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.814 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.814 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:21.814 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482206+0000", 2024-04-19T02:16:21.814 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.0010000000000007e-06 2024-04-19T02:16:21.814 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.814 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.814 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:21.815 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482211+0000", 2024-04-19T02:16:21.815 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.4569999999999996e-06 2024-04-19T02:16:21.815 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.815 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.815 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:21.815 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.489465+0000", 2024-04-19T02:16:21.815 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.007253776 2024-04-19T02:16:21.815 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.815 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.815 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:21.815 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.489582+0000", 2024-04-19T02:16:21.815 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00011669500000000001 2024-04-19T02:16:21.815 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.815 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.815 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:21.815 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.489684+0000", 2024-04-19T02:16:21.816 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000102533 2024-04-19T02:16:21.816 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.816 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.816 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:21.816 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.491836+0000", 2024-04-19T02:16:21.816 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0021516759999999999 2024-04-19T02:16:21.816 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.816 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.816 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:21.816 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503615+0000", 2024-04-19T02:16:21.816 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.011778906 2024-04-19T02:16:21.816 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.816 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.816 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:21.816 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503652+0000", 2024-04-19T02:16:21.817 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6622999999999998e-05 2024-04-19T02:16:21.817 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.817 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.817 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:21.817 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503688+0000", 2024-04-19T02:16:21.817 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6127000000000002e-05 2024-04-19T02:16:21.817 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:21.817 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:21.817 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:21.817 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.817 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.817 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:61821 5.c 5:3f8142ef:::benchmark_data_smithi121_44835_object61820:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:21.817 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:17.484515+0000", 2024-04-19T02:16:21.817 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4.252960968, 2024-04-19T02:16:21.817 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.019268073, 2024-04-19T02:16:21.817 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:21.818 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:21.818 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:21.818 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:21.818 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:21.818 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 61821 2024-04-19T02:16:21.818 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.818 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:21.818 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.818 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:21.818 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.484515+0000", 2024-04-19T02:16:21.818 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:21.818 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.818 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.818 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:21.819 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.484515+0000", 2024-04-19T02:16:21.819 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:21.819 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.819 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.819 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:21.819 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.484514+0000", 2024-04-19T02:16:21.819 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:21.819 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.819 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.819 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:21.819 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.484612+0000", 2024-04-19T02:16:21.819 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.7962999999999997e-05 2024-04-19T02:16:21.819 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.819 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.819 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:21.820 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.484623+0000", 2024-04-19T02:16:21.820 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.1229999999999999e-05 2024-04-19T02:16:21.820 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.820 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.820 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:21.820 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.484629+0000", 2024-04-19T02:16:21.820 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.9549999999999997e-06 2024-04-19T02:16:21.820 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.820 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.820 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:21.820 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.491863+0000", 2024-04-19T02:16:21.820 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.007234178 2024-04-19T02:16:21.820 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.820 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.820 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:21.821 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.491976+0000", 2024-04-19T02:16:21.821 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000112613 2024-04-19T02:16:21.821 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.821 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.821 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:21.821 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.492073+0000", 2024-04-19T02:16:21.821 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.6961999999999998e-05 2024-04-19T02:16:21.821 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.821 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.821 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:21.821 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.496898+0000", 2024-04-19T02:16:21.821 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0048245299999999996 2024-04-19T02:16:21.821 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.821 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.821 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:21.821 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503695+0000", 2024-04-19T02:16:21.822 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0067978129999999998 2024-04-19T02:16:21.822 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.822 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.822 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:21.822 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503748+0000", 2024-04-19T02:16:21.822 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.2247000000000003e-05 2024-04-19T02:16:21.822 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.822 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.822 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:21.822 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503783+0000", 2024-04-19T02:16:21.822 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.5389999999999998e-05 2024-04-19T02:16:21.822 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:21.822 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:21.822 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:21.823 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.823 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.823 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:62556 5.5 5:a64b81e3:::benchmark_data_smithi121_44835_object62555:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:21.823 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:17.828374+0000", 2024-04-19T02:16:21.823 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 3.9091014400000001, 2024-04-19T02:16:21.823 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.017677288999999999, 2024-04-19T02:16:21.823 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:21.823 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:21.823 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:21.823 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:21.823 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:21.823 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 62556 2024-04-19T02:16:21.823 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.823 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:21.823 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.823 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:21.824 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.828374+0000", 2024-04-19T02:16:21.824 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:21.824 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.824 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.824 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:21.824 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.828374+0000", 2024-04-19T02:16:21.824 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:21.824 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.824 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.824 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:21.824 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.828374+0000", 2024-04-19T02:16:21.824 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:21.824 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.824 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.824 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:21.825 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.828446+0000", 2024-04-19T02:16:21.825 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.2627999999999996e-05 2024-04-19T02:16:21.825 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.825 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.825 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:21.825 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.828456+0000", 2024-04-19T02:16:21.825 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.9760000000000007e-06 2024-04-19T02:16:21.825 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.825 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.825 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:21.825 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.828463+0000", 2024-04-19T02:16:21.825 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.2099999999999996e-06 2024-04-19T02:16:21.825 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.825 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.825 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:21.825 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.829519+0000", 2024-04-19T02:16:21.826 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0010554620000000001 2024-04-19T02:16:21.826 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.826 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.826 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:21.826 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.829668+0000", 2024-04-19T02:16:21.826 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00014902000000000001 2024-04-19T02:16:21.826 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.826 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.826 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:21.826 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.829777+0000", 2024-04-19T02:16:21.826 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00010912 2024-04-19T02:16:21.826 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.826 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.826 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:21.827 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.836242+0000", 2024-04-19T02:16:21.827 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0064650020000000001 2024-04-19T02:16:21.827 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.827 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.827 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:21.827 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.845967+0000", 2024-04-19T02:16:21.827 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0097252299999999996 2024-04-19T02:16:21.827 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.827 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.827 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:21.827 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.846014+0000", 2024-04-19T02:16:21.827 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.7215000000000001e-05 2024-04-19T02:16:21.827 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.827 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.827 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:21.827 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.846052+0000", 2024-04-19T02:16:21.828 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.7401000000000003e-05 2024-04-19T02:16:21.828 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:21.828 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:21.828 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:21.828 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.828 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.828 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:64937 5.3 5:c3b9af9e:::benchmark_data_smithi121_44835_object64936:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:21.828 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:18.906703+0000", 2024-04-19T02:16:21.828 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 2.8307726899999999, 2024-04-19T02:16:21.828 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016748455999999998, 2024-04-19T02:16:21.828 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:21.828 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:21.828 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:21.828 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:21.828 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:21.829 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 64937 2024-04-19T02:16:21.829 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.829 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:21.829 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.829 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:21.829 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:18.906703+0000", 2024-04-19T02:16:21.829 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:21.829 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.829 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.829 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:21.829 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:18.906703+0000", 2024-04-19T02:16:21.829 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:21.829 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.829 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.829 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:21.829 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:18.906703+0000", 2024-04-19T02:16:21.830 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:21.830 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.830 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.830 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:21.830 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:18.906817+0000", 2024-04-19T02:16:21.830 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00011491499999999999 2024-04-19T02:16:21.830 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.830 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.830 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:21.830 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:18.906825+0000", 2024-04-19T02:16:21.830 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.9549999999999992e-06 2024-04-19T02:16:21.830 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.830 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.830 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:21.830 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:18.906831+0000", 2024-04-19T02:16:21.831 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.6860000000000003e-06 2024-04-19T02:16:21.831 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.831 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.831 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:21.831 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:18.910580+0000", 2024-04-19T02:16:21.831 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0037491870000000002 2024-04-19T02:16:21.831 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.831 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.831 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:21.831 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:18.910682+0000", 2024-04-19T02:16:21.831 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000101691 2024-04-19T02:16:21.831 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.831 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.831 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:21.831 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:18.910773+0000", 2024-04-19T02:16:21.831 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.0913000000000002e-05 2024-04-19T02:16:21.832 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.832 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.832 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:21.832 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:18.914162+0000", 2024-04-19T02:16:21.832 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0033893629999999998 2024-04-19T02:16:21.832 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.832 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.832 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:21.832 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:18.923398+0000", 2024-04-19T02:16:21.832 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0092357180000000004 2024-04-19T02:16:21.832 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.832 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.832 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:21.832 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:18.923429+0000", 2024-04-19T02:16:21.832 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.0738999999999998e-05 2024-04-19T02:16:21.832 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.833 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.833 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:21.833 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:18.923452+0000", 2024-04-19T02:16:21.833 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.2942000000000002e-05 2024-04-19T02:16:21.833 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:21.833 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:21.833 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:21.833 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.833 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.833 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:64947 5.5 5:aee16a88:::benchmark_data_smithi121_44835_object64946:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:21.833 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:18.911746+0000", 2024-04-19T02:16:21.833 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 2.825730031, 2024-04-19T02:16:21.833 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016543809, 2024-04-19T02:16:21.833 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:21.833 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:21.834 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:21.834 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:21.834 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:21.834 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 64947 2024-04-19T02:16:21.834 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.834 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:21.834 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.834 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:21.834 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:18.911746+0000", 2024-04-19T02:16:21.834 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:21.834 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.834 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.834 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:21.834 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:18.911746+0000", 2024-04-19T02:16:21.834 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:21.835 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.835 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.835 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:21.835 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:18.911745+0000", 2024-04-19T02:16:21.835 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:21.835 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.835 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.835 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:21.835 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:18.911805+0000", 2024-04-19T02:16:21.835 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.9778999999999998e-05 2024-04-19T02:16:21.835 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.835 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.835 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:21.835 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:18.911816+0000", 2024-04-19T02:16:21.835 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0879e-05 2024-04-19T02:16:21.835 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.836 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.836 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:21.836 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:18.911823+0000", 2024-04-19T02:16:21.836 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.8340000000000001e-06 2024-04-19T02:16:21.836 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.836 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.836 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:21.836 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:18.911850+0000", 2024-04-19T02:16:21.836 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.7039999999999999e-05 2024-04-19T02:16:21.836 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.836 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.836 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:21.836 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:18.911953+0000", 2024-04-19T02:16:21.836 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00010302999999999999 2024-04-19T02:16:21.836 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.836 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.837 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:21.837 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:18.912048+0000", 2024-04-19T02:16:21.837 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.4914000000000006e-05 2024-04-19T02:16:21.837 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.837 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.837 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:21.837 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:18.916447+0000", 2024-04-19T02:16:21.837 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0043994220000000001 2024-04-19T02:16:21.837 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.837 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.837 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:21.837 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:18.928230+0000", 2024-04-19T02:16:21.837 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.011783365000000001 2024-04-19T02:16:21.837 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.837 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.838 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:21.838 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:18.928263+0000", 2024-04-19T02:16:21.838 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.2988999999999999e-05 2024-04-19T02:16:21.838 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.838 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.838 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:21.838 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:18.928290+0000", 2024-04-19T02:16:21.838 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.641e-05 2024-04-19T02:16:21.838 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:21.838 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:21.838 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:21.838 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.838 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.838 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:65702 5.0 e26/16 5:0e2d52f5:::benchmark_data_smithi121_44835_object65701:head v 26'4014, mlcod=26'4011)", 2024-04-19T02:16:21.838 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:19.259434+0000", 2024-04-19T02:16:21.839 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 2.4780423640000002, 2024-04-19T02:16:21.839 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.017340475000000001, 2024-04-19T02:16:21.839 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:21.839 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:21.839 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:21.839 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.839 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:21.839 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.259434+0000", 2024-04-19T02:16:21.839 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:21.839 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.839 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.839 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:21.839 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.259434+0000", 2024-04-19T02:16:21.839 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:21.839 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.840 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.840 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:21.840 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.259433+0000", 2024-04-19T02:16:21.840 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:21.840 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.840 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.840 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:21.840 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.259491+0000", 2024-04-19T02:16:21.840 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.8285999999999997e-05 2024-04-19T02:16:21.840 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.840 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.840 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:21.840 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.259502+0000", 2024-04-19T02:16:21.840 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0429e-05 2024-04-19T02:16:21.840 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.841 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.841 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:21.841 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.259508+0000", 2024-04-19T02:16:21.841 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.8880000000000002e-06 2024-04-19T02:16:21.841 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.841 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.841 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:21.841 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.261885+0000", 2024-04-19T02:16:21.841 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.002377213 2024-04-19T02:16:21.841 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.841 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.841 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:21.841 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.261901+0000", 2024-04-19T02:16:21.841 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.5891000000000001e-05 2024-04-19T02:16:21.841 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.841 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.842 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:21.842 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.276735+0000", 2024-04-19T02:16:21.842 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.014834003 2024-04-19T02:16:21.842 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:21.842 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:21.842 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:21.842 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.276774+0000", 2024-04-19T02:16:21.842 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.9286000000000003e-05 2024-04-19T02:16:21.842 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:21.842 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:21.842 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:21.842 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:21.842 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:21.842 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-04-19T02:16:21.844 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:21.844+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:21.844 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:16:21.944 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:21.945+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:22.017 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:16:22.017 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:16:22.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.017 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4549.0:71653 5.5 e27/16 5:ad028b55:::benchmark_data_smithi121_44835_object71652:head v 27'4511, mlcod=27'4509)", 2024-04-19T02:16:22.018 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:22.011518+0000", 2024-04-19T02:16:22.018 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0060408129999999999, 2024-04-19T02:16:22.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0060703370000000003, 2024-04-19T02:16:22.018 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:22.018 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:16:22.018 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:22.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:22.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.011518+0000", 2024-04-19T02:16:22.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:22.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.011518+0000", 2024-04-19T02:16:22.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:22.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.011518+0000", 2024-04-19T02:16:22.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:22.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:22.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.011579+0000", 2024-04-19T02:16:22.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0603000000000002e-05 2024-04-19T02:16:22.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.020 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:22.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.011592+0000", 2024-04-19T02:16:22.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.306e-05 2024-04-19T02:16:22.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.020 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:22.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.011597+0000", 2024-04-19T02:16:22.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7429999999999999e-06 2024-04-19T02:16:22.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.020 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:22.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.012832+0000", 2024-04-19T02:16:22.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012342950000000001 2024-04-19T02:16:22.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:22.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.012849+0000", 2024-04-19T02:16:22.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7651000000000001e-05 2024-04-19T02:16:22.021 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.021 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:22.021 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.021 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:71657 5.2 5:41bfab04:::benchmark_data_smithi121_44835_object71656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T02:16:22.021 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:22.013202+0000", 2024-04-19T02:16:22.021 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0043575940000000002, 2024-04-19T02:16:22.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0044599619999999996, 2024-04-19T02:16:22.021 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:22.022 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:22.022 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:22.022 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:22.022 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:22.022 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 71657 2024-04-19T02:16:22.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.022 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:22.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.022 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:22.022 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.013202+0000", 2024-04-19T02:16:22.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:22.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.013202+0000", 2024-04-19T02:16:22.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:22.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.013200+0000", 2024-04-19T02:16:22.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:22.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:22.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.013232+0000", 2024-04-19T02:16:22.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1229000000000002e-05 2024-04-19T02:16:22.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:22.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.013258+0000", 2024-04-19T02:16:22.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6381e-05 2024-04-19T02:16:22.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:22.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.013268+0000", 2024-04-19T02:16:22.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7839999999999998e-06 2024-04-19T02:16:22.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:22.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.013305+0000", 2024-04-19T02:16:22.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6996999999999998e-05 2024-04-19T02:16:22.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:22.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.013422+0000", 2024-04-19T02:16:22.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000116925 2024-04-19T02:16:22.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:22.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.013807+0000", 2024-04-19T02:16:22.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00038529599999999998 2024-04-19T02:16:22.025 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.025 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:22.025 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.026 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:71658 5.f 5:f964081e:::benchmark_data_smithi121_44835_object71657:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T02:16:22.026 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:22.013280+0000", 2024-04-19T02:16:22.026 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0042794720000000003, 2024-04-19T02:16:22.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0044609949999999997, 2024-04-19T02:16:22.026 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:22.026 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:22.026 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:22.026 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:22.026 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:22.026 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 71658 2024-04-19T02:16:22.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.026 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:22.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:22.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.013280+0000", 2024-04-19T02:16:22.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:22.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.013280+0000", 2024-04-19T02:16:22.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:22.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.013279+0000", 2024-04-19T02:16:22.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:22.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:22.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.013309+0000", 2024-04-19T02:16:22.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9652e-05 2024-04-19T02:16:22.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:22.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.013317+0000", 2024-04-19T02:16:22.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4630000000000001e-06 2024-04-19T02:16:22.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:22.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.013323+0000", 2024-04-19T02:16:22.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1770000000000003e-06 2024-04-19T02:16:22.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:22.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.013356+0000", 2024-04-19T02:16:22.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2728999999999998e-05 2024-04-19T02:16:22.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:22.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.013468+0000", 2024-04-19T02:16:22.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000111576 2024-04-19T02:16:22.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:22.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.013606+0000", 2024-04-19T02:16:22.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013817899999999999 2024-04-19T02:16:22.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.030 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:22.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.016539+0000", 2024-04-19T02:16:22.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002932914 2024-04-19T02:16:22.030 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.030 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:22.030 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.030 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:71659 5.d 5:bea80110:::benchmark_data_smithi121_44835_object71658:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T02:16:22.030 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:22.013569+0000", 2024-04-19T02:16:22.030 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0039906209999999998, 2024-04-19T02:16:22.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042532059999999998, 2024-04-19T02:16:22.031 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:22.031 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:22.031 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:22.031 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:22.031 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:22.031 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 71659 2024-04-19T02:16:22.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.031 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:22.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:22.031 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.013569+0000", 2024-04-19T02:16:22.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:22.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.013569+0000", 2024-04-19T02:16:22.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:22.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.013568+0000", 2024-04-19T02:16:22.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:22.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:22.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.013631+0000", 2024-04-19T02:16:22.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2810000000000003e-05 2024-04-19T02:16:22.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:22.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.013641+0000", 2024-04-19T02:16:22.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0128e-05 2024-04-19T02:16:22.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:22.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.013651+0000", 2024-04-19T02:16:22.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0498e-05 2024-04-19T02:16:22.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:22.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.013688+0000", 2024-04-19T02:16:22.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6683000000000001e-05 2024-04-19T02:16:22.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:22.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.013806+0000", 2024-04-19T02:16:22.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117899 2024-04-19T02:16:22.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:22.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.013952+0000", 2024-04-19T02:16:22.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014571399999999999 2024-04-19T02:16:22.034 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.034 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:22.034 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.035 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:71662 5.d 5:b31efe2c:::benchmark_data_smithi121_44835_object71661:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T02:16:22.035 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:22.016621+0000", 2024-04-19T02:16:22.035 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00093866999999999996, 2024-04-19T02:16:22.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012772720000000001, 2024-04-19T02:16:22.035 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:22.035 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:22.035 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:22.035 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:22.035 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:22.035 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 71662 2024-04-19T02:16:22.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.035 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:22.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.035 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:22.036 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.016621+0000", 2024-04-19T02:16:22.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.036 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:22.036 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.016621+0000", 2024-04-19T02:16:22.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:22.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.016620+0000", 2024-04-19T02:16:22.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:22.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:22.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.016678+0000", 2024-04-19T02:16:22.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7809999999999997e-05 2024-04-19T02:16:22.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:22.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.016688+0000", 2024-04-19T02:16:22.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0159e-05 2024-04-19T02:16:22.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:22.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.016696+0000", 2024-04-19T02:16:22.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3620000000000006e-06 2024-04-19T02:16:22.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:22.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.016724+0000", 2024-04-19T02:16:22.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8096999999999999e-05 2024-04-19T02:16:22.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:22.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.016814+0000", 2024-04-19T02:16:22.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0255999999999998e-05 2024-04-19T02:16:22.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:22.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.016902+0000", 2024-04-19T02:16:22.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7415000000000002e-05 2024-04-19T02:16:22.039 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.039 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:22.039 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.039 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:71663 5.7 5:e8db6ffe:::benchmark_data_smithi121_44835_object71662:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T02:16:22.040 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:22.016705+0000", 2024-04-19T02:16:22.040 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00085379599999999998, 2024-04-19T02:16:22.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012693369999999999, 2024-04-19T02:16:22.040 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:22.040 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:22.040 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:22.040 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:22.040 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:22.040 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 71663 2024-04-19T02:16:22.040 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.040 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:22.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.040 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:22.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.016705+0000", 2024-04-19T02:16:22.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:22.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.016705+0000", 2024-04-19T02:16:22.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:22.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.016705+0000", 2024-04-19T02:16:22.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:22.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.042 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:22.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.016742+0000", 2024-04-19T02:16:22.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6684999999999999e-05 2024-04-19T02:16:22.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.042 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:22.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.016749+0000", 2024-04-19T02:16:22.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5950000000000001e-06 2024-04-19T02:16:22.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.042 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:22.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.016756+0000", 2024-04-19T02:16:22.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5019999999999998e-06 2024-04-19T02:16:22.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:22.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.016782+0000", 2024-04-19T02:16:22.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5939e-05 2024-04-19T02:16:22.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:22.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.016867+0000", 2024-04-19T02:16:22.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5674999999999995e-05 2024-04-19T02:16:22.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:22.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.016954+0000", 2024-04-19T02:16:22.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6676999999999997e-05 2024-04-19T02:16:22.044 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.044 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:22.044 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.044 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4549.0:71659 5.d e27/16)", 2024-04-19T02:16:22.044 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:22.016826+0000", 2024-04-19T02:16:22.044 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00073291399999999998, 2024-04-19T02:16:22.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012165349999999999, 2024-04-19T02:16:22.044 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:22.044 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-04-19T02:16:22.044 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:22.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:22.045 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.016826+0000", 2024-04-19T02:16:22.045 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.045 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:22.045 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.016826+0000", 2024-04-19T02:16:22.045 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.045 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:22.045 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.016826+0000", 2024-04-19T02:16:22.045 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:22.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:22.046 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.016829+0000", 2024-04-19T02:16:22.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4750000000000002e-06 2024-04-19T02:16:22.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:22.046 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.016836+0000", 2024-04-19T02:16:22.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8889999999999996e-06 2024-04-19T02:16:22.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:22.046 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.016841+0000", 2024-04-19T02:16:22.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1510000000000003e-06 2024-04-19T02:16:22.046 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.047 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:22.047 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.047 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4549.0:71661 5.3 e27/16 5:c4956f73:::benchmark_data_smithi121_44835_object71660:head v 27'4571, mlcod=27'4569)", 2024-04-19T02:16:22.047 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:22.016940+0000", 2024-04-19T02:16:22.047 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00061882199999999999, 2024-04-19T02:16:22.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001152728, 2024-04-19T02:16:22.047 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:22.047 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:16:22.047 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:22.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:22.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.016940+0000", 2024-04-19T02:16:22.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.048 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:22.048 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.016940+0000", 2024-04-19T02:16:22.048 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.048 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:22.048 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.016940+0000", 2024-04-19T02:16:22.048 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:22.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.048 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:22.048 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.017000+0000", 2024-04-19T02:16:22.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0367e-05 2024-04-19T02:16:22.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.049 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:22.049 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.017008+0000", 2024-04-19T02:16:22.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9359999999999999e-06 2024-04-19T02:16:22.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.049 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:22.049 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.017015+0000", 2024-04-19T02:16:22.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6290000000000004e-06 2024-04-19T02:16:22.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.049 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:22.049 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.017056+0000", 2024-04-19T02:16:22.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1025000000000001e-05 2024-04-19T02:16:22.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.050 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:22.050 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.017077+0000", 2024-04-19T02:16:22.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0786000000000001e-05 2024-04-19T02:16:22.050 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.050 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:22.050 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.050 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4549.0:71664 5.c e27/16 5:3c6c3a7b:::benchmark_data_smithi121_44835_object71663:head v 27'4411, mlcod=27'4409)", 2024-04-19T02:16:22.050 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:22.017209+0000", 2024-04-19T02:16:22.050 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00035058300000000001, 2024-04-19T02:16:22.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00094363699999999999, 2024-04-19T02:16:22.051 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:22.051 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:16:22.051 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:22.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.051 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:22.051 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.017209+0000", 2024-04-19T02:16:22.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.051 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.051 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:22.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.017209+0000", 2024-04-19T02:16:22.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:22.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.017208+0000", 2024-04-19T02:16:22.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:22.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:22.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.017278+0000", 2024-04-19T02:16:22.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0190000000000004e-05 2024-04-19T02:16:22.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.053 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:22.053 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.017287+0000", 2024-04-19T02:16:22.053 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7229999999999993e-06 2024-04-19T02:16:22.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.053 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:22.053 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.017292+0000", 2024-04-19T02:16:22.053 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2109999999999997e-06 2024-04-19T02:16:22.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.053 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:22.053 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.017324+0000", 2024-04-19T02:16:22.053 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1316999999999998e-05 2024-04-19T02:16:22.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.054 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:22.054 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:22.017343+0000", 2024-04-19T02:16:22.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9216e-05 2024-04-19T02:16:22.054 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.054 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:22.054 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.054 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.054 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-04-19T02:16:22.054 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 9 2024-04-19T02:16:22.054 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:16:22.055 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T02:16:22.056 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 27 16 71687 71671 165.892 133.562 0.00397378 0.00602533 2024-04-19T02:16:22.057 INFO:teuthology.orchestra.run.smithi121.stderr:set 5.1 pg_upmap mapping to [1,2] 2024-04-19T02:16:22.058 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:16:22.058 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:22.056+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:22.156 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:22.157+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:22.240 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:16:22.240 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-04-19T02:16:22.240 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-04-19T02:16:22.240 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-04-19T02:16:22.240 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:16:22.250 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:16:22.257 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:22.258+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:22.358 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:22.359+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:22.378 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:16:22.378 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-04-19T02:16:22.378 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-04-19T02:16:22.378 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:16:22.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.378 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:22.378 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269684+0000", 2024-04-19T02:16:22.378 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 53.107335587999998, 2024-04-19T02:16:22.378 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019077493000000001, 2024-04-19T02:16:22.378 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:22.378 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:22.379 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:22.379 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.379 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:22.379 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269684+0000", 2024-04-19T02:16:22.379 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.379 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.379 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:22.379 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269684+0000", 2024-04-19T02:16:22.379 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.379 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.379 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:22.379 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269684+0000", 2024-04-19T02:16:22.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:22.380 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.380 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.380 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:22.380 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269686+0000", 2024-04-19T02:16:22.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2740000000000002e-06 2024-04-19T02:16:22.380 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.380 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.380 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:22.380 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269690+0000", 2024-04-19T02:16:22.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8829999999999999e-06 2024-04-19T02:16:22.380 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.380 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.380 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:22.380 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269693+0000", 2024-04-19T02:16:22.381 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4199999999999999e-06 2024-04-19T02:16:22.381 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.381 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.381 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:22.381 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269875+0000", 2024-04-19T02:16:22.381 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018114800000000001 2024-04-19T02:16:22.381 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.381 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.381 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:22.381 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269880+0000", 2024-04-19T02:16:22.381 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5620000000000003e-06 2024-04-19T02:16:22.381 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.381 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.381 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:22.381 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278610+0000", 2024-04-19T02:16:22.382 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.008729423 2024-04-19T02:16:22.382 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.382 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.382 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:22.382 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278724+0000", 2024-04-19T02:16:22.382 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011428400000000001 2024-04-19T02:16:22.382 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.382 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.382 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:22.382 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278860+0000", 2024-04-19T02:16:22.382 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013601600000000001 2024-04-19T02:16:22.382 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.382 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.382 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:22.383 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282632+0000", 2024-04-19T02:16:22.383 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037722889999999999 2024-04-19T02:16:22.383 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.383 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.383 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:22.383 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288712+0000", 2024-04-19T02:16:22.383 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0060799599999999997 2024-04-19T02:16:22.383 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.383 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.383 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:22.383 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288742+0000", 2024-04-19T02:16:22.383 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0048000000000001e-05 2024-04-19T02:16:22.383 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.383 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.383 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:22.384 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288762+0000", 2024-04-19T02:16:22.384 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9482000000000001e-05 2024-04-19T02:16:22.384 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.384 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:22.384 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.384 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.384 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.384 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:22.384 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269753+0000", 2024-04-19T02:16:22.384 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 53.107266205000002, 2024-04-19T02:16:22.384 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019088755999999998, 2024-04-19T02:16:22.384 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:22.384 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:22.384 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:22.384 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.385 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:22.385 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269753+0000", 2024-04-19T02:16:22.385 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.385 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.385 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.385 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:22.385 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269753+0000", 2024-04-19T02:16:22.385 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.385 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.385 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.385 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:22.385 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269753+0000", 2024-04-19T02:16:22.385 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:22.385 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.385 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.386 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:22.386 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269770+0000", 2024-04-19T02:16:22.386 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7150999999999999e-05 2024-04-19T02:16:22.386 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.386 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.386 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:22.386 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269779+0000", 2024-04-19T02:16:22.386 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4139999999999994e-06 2024-04-19T02:16:22.386 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.386 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.386 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:22.386 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269786+0000", 2024-04-19T02:16:22.386 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.537e-06 2024-04-19T02:16:22.386 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.386 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.387 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:22.387 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269913+0000", 2024-04-19T02:16:22.387 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012699599999999999 2024-04-19T02:16:22.387 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.387 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.387 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:22.387 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269916+0000", 2024-04-19T02:16:22.387 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9280000000000002e-06 2024-04-19T02:16:22.387 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.387 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.387 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:22.387 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.279143+0000", 2024-04-19T02:16:22.387 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0092270129999999992 2024-04-19T02:16:22.387 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.387 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.388 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:22.388 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.279223+0000", 2024-04-19T02:16:22.388 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0050999999999996e-05 2024-04-19T02:16:22.388 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.388 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.388 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:22.388 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.279364+0000", 2024-04-19T02:16:22.388 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000140934 2024-04-19T02:16:22.388 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.388 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.388 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:22.388 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286189+0000", 2024-04-19T02:16:22.388 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.006825327 2024-04-19T02:16:22.388 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.388 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.389 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:22.389 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288791+0000", 2024-04-19T02:16:22.389 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026021500000000001 2024-04-19T02:16:22.389 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.389 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.389 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:22.389 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288822+0000", 2024-04-19T02:16:22.389 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0162999999999999e-05 2024-04-19T02:16:22.389 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.389 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.389 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:22.389 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288842+0000", 2024-04-19T02:16:22.389 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0644000000000001e-05 2024-04-19T02:16:22.389 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.389 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:22.390 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.390 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.390 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.390 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:22.390 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:16:22.390 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 53.107227731000002, 2024-04-19T02:16:22.390 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020307345000000001, 2024-04-19T02:16:22.390 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:22.390 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:22.390 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:22.390 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.390 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:22.390 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:16:22.390 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.394 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.394 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.394 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:22.394 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:16:22.394 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.395 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:22.395 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269791+0000", 2024-04-19T02:16:22.395 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:22.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.395 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:22.395 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269795+0000", 2024-04-19T02:16:22.395 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5619999999999999e-06 2024-04-19T02:16:22.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.395 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:22.395 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269802+0000", 2024-04-19T02:16:22.395 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8469999999999998e-06 2024-04-19T02:16:22.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.396 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:22.396 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269807+0000", 2024-04-19T02:16:22.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.707e-06 2024-04-19T02:16:22.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.396 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:22.396 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269950+0000", 2024-04-19T02:16:22.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000143313 2024-04-19T02:16:22.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.396 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:22.396 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269955+0000", 2024-04-19T02:16:22.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4029999999999998e-06 2024-04-19T02:16:22.397 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.397 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.397 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:22.397 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.283806+0000", 2024-04-19T02:16:22.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013850220999999999 2024-04-19T02:16:22.397 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.397 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.397 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:22.397 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.283896+0000", 2024-04-19T02:16:22.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0261999999999997e-05 2024-04-19T02:16:22.397 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.397 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.397 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:22.397 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284022+0000", 2024-04-19T02:16:22.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012641200000000001 2024-04-19T02:16:22.397 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:22.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289066+0000", 2024-04-19T02:16:22.398 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050438490000000004 2024-04-19T02:16:22.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:22.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290011+0000", 2024-04-19T02:16:22.398 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00094490700000000004 2024-04-19T02:16:22.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:22.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290054+0000", 2024-04-19T02:16:22.398 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.337e-05 2024-04-19T02:16:22.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.399 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:22.399 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290099+0000", 2024-04-19T02:16:22.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4987999999999997e-05 2024-04-19T02:16:22.399 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.399 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:22.399 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.399 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:22.399 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:16:22.399 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 53.107149800999998, 2024-04-19T02:16:22.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020331023, 2024-04-19T02:16:22.399 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:22.400 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:22.400 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:22.400 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.400 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:22.400 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:16:22.400 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.400 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.400 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.400 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:22.400 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:16:22.400 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.400 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.400 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.400 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:22.400 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269869+0000", 2024-04-19T02:16:22.400 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:22.401 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.401 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.401 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:22.401 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269873+0000", 2024-04-19T02:16:22.401 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0219999999999998e-06 2024-04-19T02:16:22.401 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.401 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.401 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:22.401 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269881+0000", 2024-04-19T02:16:22.401 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.79e-06 2024-04-19T02:16:22.401 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.401 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.401 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:22.401 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269887+0000", 2024-04-19T02:16:22.401 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7899999999999996e-06 2024-04-19T02:16:22.402 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.402 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.402 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:22.402 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269983+0000", 2024-04-19T02:16:22.402 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6057000000000005e-05 2024-04-19T02:16:22.402 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.402 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.402 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:22.402 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269986+0000", 2024-04-19T02:16:22.402 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9220000000000001e-06 2024-04-19T02:16:22.402 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.402 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.402 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:22.402 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284350+0000", 2024-04-19T02:16:22.402 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014364335000000001 2024-04-19T02:16:22.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:22.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284664+0000", 2024-04-19T02:16:22.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000313646 2024-04-19T02:16:22.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:22.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284794+0000", 2024-04-19T02:16:22.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129839 2024-04-19T02:16:22.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:22.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289107+0000", 2024-04-19T02:16:22.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0043127060000000004 2024-04-19T02:16:22.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:22.404 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290108+0000", 2024-04-19T02:16:22.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0010010590000000001 2024-04-19T02:16:22.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:22.404 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290144+0000", 2024-04-19T02:16:22.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6709999999999999e-05 2024-04-19T02:16:22.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:22.404 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290201+0000", 2024-04-19T02:16:22.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6654999999999999e-05 2024-04-19T02:16:22.404 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.405 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:22.405 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.405 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.405 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:22.405 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:16:22.405 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 53.107107460000002, 2024-04-19T02:16:22.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020507241999999998, 2024-04-19T02:16:22.405 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:22.405 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:22.405 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:22.405 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.405 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:22.405 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:16:22.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.406 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:22.406 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:16:22.406 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.406 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.406 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:22.406 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:16:22.406 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:22.406 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.406 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:22.406 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269915+0000", 2024-04-19T02:16:22.406 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.472e-06 2024-04-19T02:16:22.406 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.407 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:22.407 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269928+0000", 2024-04-19T02:16:22.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2979000000000001e-05 2024-04-19T02:16:22.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.407 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:22.407 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269935+0000", 2024-04-19T02:16:22.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8859999999999998e-06 2024-04-19T02:16:22.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.407 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:22.407 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270009+0000", 2024-04-19T02:16:22.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3429000000000005e-05 2024-04-19T02:16:22.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.408 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.408 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:22.408 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270013+0000", 2024-04-19T02:16:22.408 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2590000000000002e-06 2024-04-19T02:16:22.408 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.408 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.408 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:22.408 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285375+0000", 2024-04-19T02:16:22.408 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015362275999999999 2024-04-19T02:16:22.408 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.408 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.408 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:22.408 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285451+0000", 2024-04-19T02:16:22.408 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5338000000000003e-05 2024-04-19T02:16:22.408 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.409 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.409 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:22.409 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285562+0000", 2024-04-19T02:16:22.409 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000111285 2024-04-19T02:16:22.409 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.409 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.409 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:22.409 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289134+0000", 2024-04-19T02:16:22.409 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035719670000000001 2024-04-19T02:16:22.409 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.409 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.409 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:22.409 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290341+0000", 2024-04-19T02:16:22.409 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012074500000000001 2024-04-19T02:16:22.409 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.410 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.410 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:22.410 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290383+0000", 2024-04-19T02:16:22.410 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1386e-05 2024-04-19T02:16:22.410 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.410 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.410 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:22.410 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290419+0000", 2024-04-19T02:16:22.410 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6884000000000001e-05 2024-04-19T02:16:22.410 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.410 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:22.410 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.410 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.410 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.410 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:22.411 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269945+0000", 2024-04-19T02:16:22.411 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 53.107074877999999, 2024-04-19T02:16:22.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019709098000000001, 2024-04-19T02:16:22.411 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:22.411 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:22.411 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:22.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.411 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:22.411 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269945+0000", 2024-04-19T02:16:22.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.411 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:22.411 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269945+0000", 2024-04-19T02:16:22.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.412 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.412 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:22.412 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269944+0000", 2024-04-19T02:16:22.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:22.412 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.412 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:22.412 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269965+0000", 2024-04-19T02:16:22.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0803999999999999e-05 2024-04-19T02:16:22.412 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.412 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:22.412 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269973+0000", 2024-04-19T02:16:22.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3560000000000004e-06 2024-04-19T02:16:22.412 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.413 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.413 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:22.413 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269982+0000", 2024-04-19T02:16:22.413 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9600000000000006e-06 2024-04-19T02:16:22.413 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.413 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.413 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:22.413 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270014+0000", 2024-04-19T02:16:22.413 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2913000000000001e-05 2024-04-19T02:16:22.413 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.413 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.413 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:22.413 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270018+0000", 2024-04-19T02:16:22.413 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2200000000000001e-06 2024-04-19T02:16:22.414 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.414 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.414 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:22.414 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278999+0000", 2024-04-19T02:16:22.414 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0089818009999999993 2024-04-19T02:16:22.414 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.414 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.414 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:22.414 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.279088+0000", 2024-04-19T02:16:22.414 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8988999999999998e-05 2024-04-19T02:16:22.414 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.414 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.414 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:22.414 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.280160+0000", 2024-04-19T02:16:22.414 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001071572 2024-04-19T02:16:22.415 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.415 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.415 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:22.415 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288342+0000", 2024-04-19T02:16:22.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.008182468 2024-04-19T02:16:22.415 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.415 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.415 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:22.415 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289545+0000", 2024-04-19T02:16:22.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012026739999999999 2024-04-19T02:16:22.415 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.415 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.415 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:22.415 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289608+0000", 2024-04-19T02:16:22.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2904999999999995e-05 2024-04-19T02:16:22.416 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.416 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:22.416 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289654+0000", 2024-04-19T02:16:22.416 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5850000000000003e-05 2024-04-19T02:16:22.416 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.416 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:22.416 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.416 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.416 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:22.416 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:16:22.416 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 53.107029199999999, 2024-04-19T02:16:22.416 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022007204999999998, 2024-04-19T02:16:22.416 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:22.417 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:22.417 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:22.417 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.417 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:22.417 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:16:22.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.417 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.417 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:22.417 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:16:22.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.417 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.417 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:22.417 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269990+0000", 2024-04-19T02:16:22.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:22.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.418 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:22.418 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269999+0000", 2024-04-19T02:16:22.418 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9539999999999993e-06 2024-04-19T02:16:22.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.418 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:22.418 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270006+0000", 2024-04-19T02:16:22.418 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.216e-06 2024-04-19T02:16:22.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.418 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:22.418 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270012+0000", 2024-04-19T02:16:22.418 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5049999999999998e-06 2024-04-19T02:16:22.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:22.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270058+0000", 2024-04-19T02:16:22.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.634e-05 2024-04-19T02:16:22.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:22.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270064+0000", 2024-04-19T02:16:22.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0669999999999997e-06 2024-04-19T02:16:22.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:22.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287159+0000", 2024-04-19T02:16:22.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017095086999999998 2024-04-19T02:16:22.420 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.420 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.420 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:22.420 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287254+0000", 2024-04-19T02:16:22.420 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4716000000000006e-05 2024-04-19T02:16:22.420 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.420 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.420 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:22.420 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287389+0000", 2024-04-19T02:16:22.420 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013511900000000001 2024-04-19T02:16:22.420 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.420 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.420 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:22.420 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290481+0000", 2024-04-19T02:16:22.420 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030920169999999999 2024-04-19T02:16:22.421 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.421 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.421 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:22.421 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291931+0000", 2024-04-19T02:16:22.421 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001450118 2024-04-19T02:16:22.421 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.421 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.421 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:22.421 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291960+0000", 2024-04-19T02:16:22.421 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9096000000000001e-05 2024-04-19T02:16:22.421 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.421 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.421 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:22.421 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291998+0000", 2024-04-19T02:16:22.421 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7514e-05 2024-04-19T02:16:22.422 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.422 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:22.422 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.422 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.422 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.422 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:22.422 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:22.422 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 53.106968629000001, 2024-04-19T02:16:22.422 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020759494999999999, 2024-04-19T02:16:22.422 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:22.422 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:22.422 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:22.422 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.422 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:22.422 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:22.423 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.423 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.423 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.423 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:22.423 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:22.423 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.423 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.423 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.423 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:22.423 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:22.423 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:22.423 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.423 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.423 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:22.423 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270054+0000", 2024-04-19T02:16:22.424 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.27e-06 2024-04-19T02:16:22.424 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.424 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.424 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:22.424 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270061+0000", 2024-04-19T02:16:22.424 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1289999999999998e-06 2024-04-19T02:16:22.424 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.424 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.424 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:22.424 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270067+0000", 2024-04-19T02:16:22.424 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.207e-06 2024-04-19T02:16:22.424 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.424 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.424 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:22.424 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270105+0000", 2024-04-19T02:16:22.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7549999999999998e-05 2024-04-19T02:16:22.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:22.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270112+0000", 2024-04-19T02:16:22.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3200000000000002e-06 2024-04-19T02:16:22.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:22.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282454+0000", 2024-04-19T02:16:22.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012341569 2024-04-19T02:16:22.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:22.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282740+0000", 2024-04-19T02:16:22.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000286481 2024-04-19T02:16:22.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:22.426 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282879+0000", 2024-04-19T02:16:22.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013887799999999999 2024-04-19T02:16:22.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:22.426 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290325+0000", 2024-04-19T02:16:22.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074459779999999998 2024-04-19T02:16:22.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:22.426 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290759+0000", 2024-04-19T02:16:22.427 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000433688 2024-04-19T02:16:22.427 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.427 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.427 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:22.427 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290789+0000", 2024-04-19T02:16:22.427 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9960000000000001e-05 2024-04-19T02:16:22.427 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.427 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.427 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:22.427 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290811+0000", 2024-04-19T02:16:22.427 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1965999999999999e-05 2024-04-19T02:16:22.427 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.427 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:22.427 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.427 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.428 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.428 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:22.428 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:16:22.428 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 53.106918424, 2024-04-19T02:16:22.428 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020837887999999999, 2024-04-19T02:16:22.428 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:22.428 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:22.428 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:22.428 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.428 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:22.428 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:16:22.428 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.428 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.428 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.428 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:22.428 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:16:22.429 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.429 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.429 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.429 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:22.429 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:16:22.429 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:22.429 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.429 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.429 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:22.429 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270109+0000", 2024-04-19T02:16:22.429 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3110000000000006e-06 2024-04-19T02:16:22.429 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.429 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.429 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:22.429 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270117+0000", 2024-04-19T02:16:22.430 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0479999999999999e-06 2024-04-19T02:16:22.430 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.430 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.430 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:22.430 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270123+0000", 2024-04-19T02:16:22.430 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5500000000000002e-06 2024-04-19T02:16:22.430 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.430 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.430 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:22.430 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270150+0000", 2024-04-19T02:16:22.430 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7712000000000002e-05 2024-04-19T02:16:22.430 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.430 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.430 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:22.430 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270153+0000", 2024-04-19T02:16:22.431 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6089999999999999e-06 2024-04-19T02:16:22.431 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.431 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.431 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:22.431 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285958+0000", 2024-04-19T02:16:22.431 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015805274000000001 2024-04-19T02:16:22.431 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.431 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.431 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:22.431 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286126+0000", 2024-04-19T02:16:22.431 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016765700000000001 2024-04-19T02:16:22.431 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.431 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.431 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:22.431 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286296+0000", 2024-04-19T02:16:22.431 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017007 2024-04-19T02:16:22.432 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.432 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.432 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:22.432 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290426+0000", 2024-04-19T02:16:22.432 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041299839999999997 2024-04-19T02:16:22.432 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.432 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.432 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:22.432 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290867+0000", 2024-04-19T02:16:22.432 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00044083300000000001 2024-04-19T02:16:22.432 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.432 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.432 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:22.432 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290900+0000", 2024-04-19T02:16:22.433 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3380000000000002e-05 2024-04-19T02:16:22.433 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.433 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.433 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:22.433 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290939+0000", 2024-04-19T02:16:22.433 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8970000000000001e-05 2024-04-19T02:16:22.433 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.433 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:22.433 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.433 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.433 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.433 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:21 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:22.433 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:16:22.433 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 53.106829752000003, 2024-04-19T02:16:22.433 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020833187999999999, 2024-04-19T02:16:22.433 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:22.434 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:16:22.434 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:22.434 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.434 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:22.434 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:16:22.434 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.434 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.434 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.434 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:22.434 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:16:22.434 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.434 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.434 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.434 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:22.435 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270189+0000", 2024-04-19T02:16:22.435 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:22.435 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.435 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.435 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:22.435 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270192+0000", 2024-04-19T02:16:22.435 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7549999999999999e-06 2024-04-19T02:16:22.435 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.435 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.435 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:22.435 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270198+0000", 2024-04-19T02:16:22.435 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0859999999999998e-06 2024-04-19T02:16:22.435 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.435 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.435 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:22.435 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270204+0000", 2024-04-19T02:16:22.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1970000000000004e-06 2024-04-19T02:16:22.436 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.436 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.436 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:22.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270238+0000", 2024-04-19T02:16:22.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4282000000000001e-05 2024-04-19T02:16:22.436 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.436 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.436 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:22.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270240+0000", 2024-04-19T02:16:22.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3099999999999999e-06 2024-04-19T02:16:22.436 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.436 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.436 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:22.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287131+0000", 2024-04-19T02:16:22.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01689104 2024-04-19T02:16:22.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.437 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.437 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:22.437 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287262+0000", 2024-04-19T02:16:22.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130347 2024-04-19T02:16:22.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.437 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.437 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:22.437 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291023+0000", 2024-04-19T02:16:22.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037616350000000002 2024-04-19T02:16:22.437 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.437 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:22.437 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.437 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.438 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:2285 5.d 5:b310a433:::benchmark_data_smithi121_44835_object2284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:16:22.438 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:55.643557+0000", 2024-04-19T02:16:22.438 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.733463029999999, 2024-04-19T02:16:22.438 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018865537000000002, 2024-04-19T02:16:22.438 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:22.438 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:22.438 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:22.438 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:22.438 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:22.438 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 2285 2024-04-19T02:16:22.438 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.438 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:22.438 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.438 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:22.438 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643557+0000", 2024-04-19T02:16:22.439 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.439 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.439 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.439 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:22.439 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643557+0000", 2024-04-19T02:16:22.439 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.439 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.439 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.439 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:22.439 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643556+0000", 2024-04-19T02:16:22.439 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:22.439 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.439 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.439 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:22.439 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643625+0000", 2024-04-19T02:16:22.439 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9393000000000005e-05 2024-04-19T02:16:22.440 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.440 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.440 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:22.440 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643634+0000", 2024-04-19T02:16:22.440 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.14e-06 2024-04-19T02:16:22.440 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.440 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.440 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:22.440 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643640+0000", 2024-04-19T02:16:22.440 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.601e-06 2024-04-19T02:16:22.440 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.440 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.440 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:22.440 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643669+0000", 2024-04-19T02:16:22.440 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9292999999999999e-05 2024-04-19T02:16:22.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.441 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:22.441 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643760+0000", 2024-04-19T02:16:22.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0526999999999996e-05 2024-04-19T02:16:22.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.441 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:22.441 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643892+0000", 2024-04-19T02:16:22.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000131607 2024-04-19T02:16:22.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.441 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:22.441 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.649122+0000", 2024-04-19T02:16:22.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052308279999999999 2024-04-19T02:16:22.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.442 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:22.442 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.662321+0000", 2024-04-19T02:16:22.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013198774999999999 2024-04-19T02:16:22.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.442 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:22.442 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.662385+0000", 2024-04-19T02:16:22.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4261e-05 2024-04-19T02:16:22.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.442 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:22.442 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.662422+0000", 2024-04-19T02:16:22.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.676e-05 2024-04-19T02:16:22.442 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.443 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:22.443 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.443 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:16494 5.7 5:e2c19dca:::benchmark_data_smithi121_44835_object16493:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:22.443 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.871684+0000", 2024-04-19T02:16:22.443 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.505336097000001, 2024-04-19T02:16:22.443 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019343257999999999, 2024-04-19T02:16:22.443 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:22.443 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:22.443 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:22.443 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:22.443 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:22.443 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16494 2024-04-19T02:16:22.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.443 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:22.444 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.444 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:22.444 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871684+0000", 2024-04-19T02:16:22.444 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.444 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.444 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.444 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:22.444 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871684+0000", 2024-04-19T02:16:22.444 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.444 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.444 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.444 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:22.444 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871683+0000", 2024-04-19T02:16:22.444 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:22.444 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.445 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.445 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:22.445 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871762+0000", 2024-04-19T02:16:22.445 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8981999999999997e-05 2024-04-19T02:16:22.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.445 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.445 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:22.445 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871770+0000", 2024-04-19T02:16:22.445 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7060000000000004e-06 2024-04-19T02:16:22.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.445 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.445 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:22.445 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871776+0000", 2024-04-19T02:16:22.445 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4880000000000004e-06 2024-04-19T02:16:22.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.446 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:22.446 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.874098+0000", 2024-04-19T02:16:22.446 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0023215309999999999 2024-04-19T02:16:22.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.446 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:22.446 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.874245+0000", 2024-04-19T02:16:22.446 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014735599999999999 2024-04-19T02:16:22.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.446 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:22.446 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.874394+0000", 2024-04-19T02:16:22.446 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014848300000000001 2024-04-19T02:16:22.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:22.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.876474+0000", 2024-04-19T02:16:22.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020803060000000001 2024-04-19T02:16:22.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:22.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.890939+0000", 2024-04-19T02:16:22.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014464985 2024-04-19T02:16:22.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:22.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.890986+0000", 2024-04-19T02:16:22.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7321000000000003e-05 2024-04-19T02:16:22.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.448 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:22.448 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891027+0000", 2024-04-19T02:16:22.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0689999999999998e-05 2024-04-19T02:16:22.448 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.448 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:22.448 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.448 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:16519 5.f 5:fc30d3a1:::benchmark_data_smithi121_44835_object16518:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:22.448 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.880723+0000", 2024-04-19T02:16:22.448 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.496296974, 2024-04-19T02:16:22.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020492519000000001, 2024-04-19T02:16:22.448 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:22.448 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:22.448 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:22.449 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:22.449 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:22.449 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16519 2024-04-19T02:16:22.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.449 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:22.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.449 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:22.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880723+0000", 2024-04-19T02:16:22.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.449 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:22.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880723+0000", 2024-04-19T02:16:22.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.450 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:22.450 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880722+0000", 2024-04-19T02:16:22.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:22.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.450 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:22.450 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880794+0000", 2024-04-19T02:16:22.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1515999999999998e-05 2024-04-19T02:16:22.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.450 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:22.450 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880805+0000", 2024-04-19T02:16:22.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1353e-05 2024-04-19T02:16:22.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.451 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:22.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880812+0000", 2024-04-19T02:16:22.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1230000000000002e-06 2024-04-19T02:16:22.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.451 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:22.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.890954+0000", 2024-04-19T02:16:22.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010142253 2024-04-19T02:16:22.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.451 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:22.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891079+0000", 2024-04-19T02:16:22.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000124917 2024-04-19T02:16:22.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:22.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891218+0000", 2024-04-19T02:16:22.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000138715 2024-04-19T02:16:22.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:22.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.897321+0000", 2024-04-19T02:16:22.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0061026830000000002 2024-04-19T02:16:22.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:22.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901137+0000", 2024-04-19T02:16:22.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038161699999999998 2024-04-19T02:16:22.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:22.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901181+0000", 2024-04-19T02:16:22.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4362e-05 2024-04-19T02:16:22.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:22.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901215+0000", 2024-04-19T02:16:22.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3929e-05 2024-04-19T02:16:22.453 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.453 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:22.453 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.453 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:16520 5.f 5:f0474691:::benchmark_data_smithi121_44835_object16519:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:22.454 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.880833+0000", 2024-04-19T02:16:22.454 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.496186958999999, 2024-04-19T02:16:22.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020460160000000002, 2024-04-19T02:16:22.454 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:22.454 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:22.454 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:22.454 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:22.454 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:22.454 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16520 2024-04-19T02:16:22.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.454 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:22.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.454 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:22.454 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880833+0000", 2024-04-19T02:16:22.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:22.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880833+0000", 2024-04-19T02:16:22.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:22.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880832+0000", 2024-04-19T02:16:22.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:22.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:22.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880909+0000", 2024-04-19T02:16:22.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7095000000000006e-05 2024-04-19T02:16:22.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:22.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880919+0000", 2024-04-19T02:16:22.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8919999999999995e-06 2024-04-19T02:16:22.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:22.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880927+0000", 2024-04-19T02:16:22.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8809999999999996e-06 2024-04-19T02:16:22.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:22.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891901+0000", 2024-04-19T02:16:22.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010974263999999999 2024-04-19T02:16:22.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:22.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.892021+0000", 2024-04-19T02:16:22.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120074 2024-04-19T02:16:22.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:22.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.892165+0000", 2024-04-19T02:16:22.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014328600000000001 2024-04-19T02:16:22.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:22.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.897347+0000", 2024-04-19T02:16:22.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.005182603 2024-04-19T02:16:22.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.458 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:22.458 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901224+0000", 2024-04-19T02:16:22.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038767620000000002 2024-04-19T02:16:22.458 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.458 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:22.458 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901264+0000", 2024-04-19T02:16:22.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9579000000000002e-05 2024-04-19T02:16:22.458 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.458 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:22.458 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901293+0000", 2024-04-19T02:16:22.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9300999999999999e-05 2024-04-19T02:16:22.459 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.459 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:22.459 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.459 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:44167 5.7 5:ef4300c4:::benchmark_data_smithi121_44835_object44166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:22.459 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:09.853830+0000", 2024-04-19T02:16:22.459 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 12.523189475000001, 2024-04-19T02:16:22.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020082104, 2024-04-19T02:16:22.459 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:22.459 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:22.459 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:22.459 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:22.460 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:22.460 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 44167 2024-04-19T02:16:22.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.460 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:22.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:22.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853830+0000", 2024-04-19T02:16:22.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:22.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853830+0000", 2024-04-19T02:16:22.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:22.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853829+0000", 2024-04-19T02:16:22.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:22.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:22.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853863+0000", 2024-04-19T02:16:22.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3151999999999997e-05 2024-04-19T02:16:22.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:22.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853873+0000", 2024-04-19T02:16:22.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0366e-05 2024-04-19T02:16:22.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.462 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:22.462 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853881+0000", 2024-04-19T02:16:22.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6539999999999999e-06 2024-04-19T02:16:22.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.462 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:22.462 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.859162+0000", 2024-04-19T02:16:22.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052810740000000002 2024-04-19T02:16:22.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.462 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:22.462 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.859303+0000", 2024-04-19T02:16:22.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000140975 2024-04-19T02:16:22.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.463 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:22.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.859460+0000", 2024-04-19T02:16:22.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015754199999999999 2024-04-19T02:16:22.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.463 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:22.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.865142+0000", 2024-04-19T02:16:22.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0056819130000000002 2024-04-19T02:16:22.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.463 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:22.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.873828+0000", 2024-04-19T02:16:22.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0086861799999999999 2024-04-19T02:16:22.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:22.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.873871+0000", 2024-04-19T02:16:22.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2624999999999999e-05 2024-04-19T02:16:22.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:22.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.873912+0000", 2024-04-19T02:16:22.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1486000000000002e-05 2024-04-19T02:16:22.464 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.464 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:22.464 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.464 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:51990 5.f 5:f3e38436:::benchmark_data_smithi121_44835_object51989:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T02:16:22.464 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:13.115474+0000", 2024-04-19T02:16:22.465 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 9.2615455460000007, 2024-04-19T02:16:22.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018801477, 2024-04-19T02:16:22.465 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:22.465 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:22.465 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:22.465 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:22.465 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:22.465 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 51990 2024-04-19T02:16:22.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.465 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:22.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:22.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.115474+0000", 2024-04-19T02:16:22.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:22.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.115474+0000", 2024-04-19T02:16:22.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:22.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.115473+0000", 2024-04-19T02:16:22.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:22.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:22.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.115570+0000", 2024-04-19T02:16:22.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6951000000000001e-05 2024-04-19T02:16:22.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:22.467 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.115576+0000", 2024-04-19T02:16:22.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8499999999999999e-06 2024-04-19T02:16:22.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:22.467 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.115581+0000", 2024-04-19T02:16:22.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4039999999999997e-06 2024-04-19T02:16:22.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:22.467 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.117248+0000", 2024-04-19T02:16:22.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001667349 2024-04-19T02:16:22.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.468 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:22.468 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.117340+0000", 2024-04-19T02:16:22.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1982000000000001e-05 2024-04-19T02:16:22.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.468 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:22.468 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.117423+0000", 2024-04-19T02:16:22.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2824999999999994e-05 2024-04-19T02:16:22.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.468 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:22.468 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.119873+0000", 2024-04-19T02:16:22.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0024502790000000001 2024-04-19T02:16:22.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:22.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.134198+0000", 2024-04-19T02:16:22.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014325361 2024-04-19T02:16:22.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:22.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.134243+0000", 2024-04-19T02:16:22.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4926000000000003e-05 2024-04-19T02:16:22.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:22.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.134276+0000", 2024-04-19T02:16:22.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.235e-05 2024-04-19T02:16:22.470 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.470 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:22.470 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.470 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:53042 5.f 5:f744ac14:::benchmark_data_smithi121_44835_object53041:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T02:16:22.470 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:13.560196+0000", 2024-04-19T02:16:22.470 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.8168236560000004, 2024-04-19T02:16:22.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020122021, 2024-04-19T02:16:22.470 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:22.470 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:22.470 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:22.470 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:22.470 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:22.470 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 53042 2024-04-19T02:16:22.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.471 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:22.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.471 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:22.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560196+0000", 2024-04-19T02:16:22.471 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.471 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:22.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560196+0000", 2024-04-19T02:16:22.471 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:22.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560195+0000", 2024-04-19T02:16:22.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:22.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:22.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560255+0000", 2024-04-19T02:16:22.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9441000000000002e-05 2024-04-19T02:16:22.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:22.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560264+0000", 2024-04-19T02:16:22.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1130000000000007e-06 2024-04-19T02:16:22.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:22.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560271+0000", 2024-04-19T02:16:22.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9800000000000001e-06 2024-04-19T02:16:22.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:22.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560312+0000", 2024-04-19T02:16:22.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0828999999999998e-05 2024-04-19T02:16:22.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:22.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560456+0000", 2024-04-19T02:16:22.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014474799999999999 2024-04-19T02:16:22.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.474 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:22.474 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560591+0000", 2024-04-19T02:16:22.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013482699999999999 2024-04-19T02:16:22.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.474 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:22.474 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.564799+0000", 2024-04-19T02:16:22.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042080080000000001 2024-04-19T02:16:22.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.474 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:22.474 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580233+0000", 2024-04-19T02:16:22.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015433715000000001 2024-04-19T02:16:22.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:22.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580280+0000", 2024-04-19T02:16:22.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6465000000000003e-05 2024-04-19T02:16:22.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:22.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580318+0000", 2024-04-19T02:16:22.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8557999999999999e-05 2024-04-19T02:16:22.475 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.475 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:22.475 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.476 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:53044 5.7 5:ec8fd8f2:::benchmark_data_smithi121_44835_object53043:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T02:16:22.476 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:13.561281+0000", 2024-04-19T02:16:22.476 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.8157384539999999, 2024-04-19T02:16:22.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019133752, 2024-04-19T02:16:22.476 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:22.476 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:22.476 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:22.476 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:22.476 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:22.476 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 53044 2024-04-19T02:16:22.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.476 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:22.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:22.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.561281+0000", 2024-04-19T02:16:22.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:22.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.561281+0000", 2024-04-19T02:16:22.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:22.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.561270+0000", 2024-04-19T02:16:22.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999886 2024-04-19T02:16:22.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:22.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.561364+0000", 2024-04-19T02:16:22.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4721000000000003e-05 2024-04-19T02:16:22.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:22.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.561375+0000", 2024-04-19T02:16:22.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0900999999999999e-05 2024-04-19T02:16:22.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:22.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.561383+0000", 2024-04-19T02:16:22.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5460000000000003e-06 2024-04-19T02:16:22.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:22.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.562716+0000", 2024-04-19T02:16:22.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001333592 2024-04-19T02:16:22.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:22.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.562831+0000", 2024-04-19T02:16:22.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000114585 2024-04-19T02:16:22.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:22.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.562984+0000", 2024-04-19T02:16:22.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000152724 2024-04-19T02:16:22.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:22.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.571517+0000", 2024-04-19T02:16:22.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0085335199999999993 2024-04-19T02:16:22.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:22.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580332+0000", 2024-04-19T02:16:22.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0088147859999999998 2024-04-19T02:16:22.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:22.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580377+0000", 2024-04-19T02:16:22.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5293000000000002e-05 2024-04-19T02:16:22.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:22.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580415+0000", 2024-04-19T02:16:22.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7756999999999998e-05 2024-04-19T02:16:22.481 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.481 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:22.481 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.481 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:53407 5.d 5:b2c73a99:::benchmark_data_smithi121_44835_object53406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T02:16:22.481 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:13.715399+0000", 2024-04-19T02:16:22.481 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.6616208669999999, 2024-04-19T02:16:22.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018729579, 2024-04-19T02:16:22.481 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:22.481 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:22.481 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:22.481 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:22.481 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:22.481 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 53407 2024-04-19T02:16:22.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.482 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:22.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:22.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.715399+0000", 2024-04-19T02:16:22.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:22.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.715399+0000", 2024-04-19T02:16:22.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:22.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.715398+0000", 2024-04-19T02:16:22.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:22.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:22.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.715486+0000", 2024-04-19T02:16:22.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7865e-05 2024-04-19T02:16:22.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:22.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.715496+0000", 2024-04-19T02:16:22.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8349999999999999e-06 2024-04-19T02:16:22.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.484 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:22.484 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.715502+0000", 2024-04-19T02:16:22.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3369999999999996e-06 2024-04-19T02:16:22.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.484 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:22.484 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.723121+0000", 2024-04-19T02:16:22.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0076190479999999998 2024-04-19T02:16:22.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.484 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:22.484 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.723251+0000", 2024-04-19T02:16:22.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012975199999999999 2024-04-19T02:16:22.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:22.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.723388+0000", 2024-04-19T02:16:22.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000137398 2024-04-19T02:16:22.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:22.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.731564+0000", 2024-04-19T02:16:22.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0081755669999999999 2024-04-19T02:16:22.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:22.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.734060+0000", 2024-04-19T02:16:22.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002496547 2024-04-19T02:16:22.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:22.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.734105+0000", 2024-04-19T02:16:22.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4187999999999998e-05 2024-04-19T02:16:22.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:22.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.734128+0000", 2024-04-19T02:16:22.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3728999999999999e-05 2024-04-19T02:16:22.486 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.486 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:22.486 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.486 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:65494 5.2 5:4db622bd:::benchmark_data_smithi121_44835_object65493:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:22.487 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:19.159347+0000", 2024-04-19T02:16:22.487 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.2176725209999999, 2024-04-19T02:16:22.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018998787999999999, 2024-04-19T02:16:22.487 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:22.487 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:22.487 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:22.487 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:22.487 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:22.487 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 65494 2024-04-19T02:16:22.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.487 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:22.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:22.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:19.159347+0000", 2024-04-19T02:16:22.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:22.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:19.159347+0000", 2024-04-19T02:16:22.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:22.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:22.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:19.159346+0000", 2024-04-19T02:16:22.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:22.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:22.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:19.159415+0000", 2024-04-19T02:16:22.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8224000000000003e-05 2024-04-19T02:16:22.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:22.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:19.159425+0000", 2024-04-19T02:16:22.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0311e-05 2024-04-19T02:16:22.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:22.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:19.159432+0000", 2024-04-19T02:16:22.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.374e-06 2024-04-19T02:16:22.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:22.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:19.161543+0000", 2024-04-19T02:16:22.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021110790000000001 2024-04-19T02:16:22.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:22.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:19.161677+0000", 2024-04-19T02:16:22.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013341000000000001 2024-04-19T02:16:22.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:22.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:19.161779+0000", 2024-04-19T02:16:22.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102427 2024-04-19T02:16:22.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:22.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:19.166040+0000", 2024-04-19T02:16:22.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042609259999999999 2024-04-19T02:16:22.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:22.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:19.178287+0000", 2024-04-19T02:16:22.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012247348 2024-04-19T02:16:22.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:22.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:19.178320+0000", 2024-04-19T02:16:22.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2464e-05 2024-04-19T02:16:22.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:22.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:22.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:22.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:19.178346+0000", 2024-04-19T02:16:22.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6072999999999999e-05 2024-04-19T02:16:22.491 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.492 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:22.492 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.492 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:22.492 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:22.492 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:16:22.493 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:22.494+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:22.494 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:16:22.594 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:22.595+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:22.622 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:16:22.622 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [], 2024-04-19T02:16:22.622 INFO:teuthology.orchestra.run.smithi174.stdout: "num_ops": 0 2024-04-19T02:16:22.622 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:16:22.632 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:16:22.695 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:22.695+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:22.758 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:16:22.758 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [], 2024-04-19T02:16:22.758 INFO:teuthology.orchestra.run.smithi174.stdout: "complaint_time": 30, 2024-04-19T02:16:22.758 INFO:teuthology.orchestra.run.smithi174.stdout: "num_blocked_ops": 0 2024-04-19T02:16:22.758 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:16:22.768 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:16:22.796 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:22.797+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:22.897 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:22.897+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:22.937 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:16:22.938 INFO:teuthology.orchestra.run.smithi174.stdout: "size": 20, 2024-04-19T02:16:22.938 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 600, 2024-04-19T02:16:22.938 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:16:22.938 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.938 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:10 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:22.938 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269877+0000", 2024-04-19T02:16:22.938 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 53.666502866999998, 2024-04-19T02:16:22.938 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020732751000000001, 2024-04-19T02:16:22.938 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:22.938 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:22.938 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:22.938 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.939 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:22.939 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269877+0000", 2024-04-19T02:16:22.939 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:22.939 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.939 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.939 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:22.939 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269877+0000", 2024-04-19T02:16:22.939 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:22.939 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.939 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.939 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:22.939 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269875+0000", 2024-04-19T02:16:22.939 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:22.939 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.939 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.940 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:22.940 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269891+0000", 2024-04-19T02:16:22.940 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.5494000000000001e-05 2024-04-19T02:16:22.940 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.940 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.940 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:22.940 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269903+0000", 2024-04-19T02:16:22.940 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2003e-05 2024-04-19T02:16:22.940 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.940 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.940 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:22.940 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269914+0000", 2024-04-19T02:16:22.940 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0947e-05 2024-04-19T02:16:22.940 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.940 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.941 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:22.941 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269971+0000", 2024-04-19T02:16:22.941 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7036000000000001e-05 2024-04-19T02:16:22.941 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.941 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.941 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:16:22.941 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269979+0000", 2024-04-19T02:16:22.941 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.6660000000000008e-06 2024-04-19T02:16:22.941 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.941 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.941 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:22.941 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284891+0000", 2024-04-19T02:16:22.941 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014912584 2024-04-19T02:16:22.941 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.941 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.942 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:22.942 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285213+0000", 2024-04-19T02:16:22.942 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00032172199999999998 2024-04-19T02:16:22.942 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.942 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.942 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:22.942 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285357+0000", 2024-04-19T02:16:22.942 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014367899999999999 2024-04-19T02:16:22.942 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.943 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.943 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:22.943 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288883+0000", 2024-04-19T02:16:22.943 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0035268719999999999 2024-04-19T02:16:22.943 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.943 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.943 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:22.943 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290537+0000", 2024-04-19T02:16:22.943 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016537399999999999 2024-04-19T02:16:22.943 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.943 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.943 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:22.943 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290576+0000", 2024-04-19T02:16:22.943 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9266e-05 2024-04-19T02:16:22.943 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.943 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.944 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:22.944 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290609+0000", 2024-04-19T02:16:22.944 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2818000000000003e-05 2024-04-19T02:16:22.944 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:22.944 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:22.944 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:22.944 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.944 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.944 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:11 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:22.944 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:22.944 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 53.666449946, 2024-04-19T02:16:22.944 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020352748, 2024-04-19T02:16:22.944 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:22.944 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:22.945 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:22.945 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.945 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:22.945 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:22.945 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:22.945 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.945 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.945 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:22.945 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:22.945 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:22.945 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.945 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.945 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:22.945 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:22.945 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:22.946 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.946 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.946 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:22.946 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269933+0000", 2024-04-19T02:16:22.946 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2169999999999996e-06 2024-04-19T02:16:22.946 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.946 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.946 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:22.946 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269940+0000", 2024-04-19T02:16:22.946 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1500000000000002e-06 2024-04-19T02:16:22.946 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.946 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.946 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:22.946 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269948+0000", 2024-04-19T02:16:22.946 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.8690000000000004e-06 2024-04-19T02:16:22.947 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.947 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.947 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:22.947 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:16:22.947 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2994999999999997e-05 2024-04-19T02:16:22.947 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.947 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.947 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:16:22.947 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269997+0000", 2024-04-19T02:16:22.947 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.9020000000000004e-06 2024-04-19T02:16:22.947 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.947 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.947 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:22.947 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.282729+0000", 2024-04-19T02:16:22.947 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.012732537 2024-04-19T02:16:22.947 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.948 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.948 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:22.948 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.282838+0000", 2024-04-19T02:16:22.948 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000108298 2024-04-19T02:16:22.948 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.948 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.948 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:22.948 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.283002+0000", 2024-04-19T02:16:22.948 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00016466300000000001 2024-04-19T02:16:22.948 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.948 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.948 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:22.949 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288708+0000", 2024-04-19T02:16:22.949 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.005705066 2024-04-19T02:16:22.949 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.949 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.949 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:22.949 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290215+0000", 2024-04-19T02:16:22.949 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0015075010000000001 2024-04-19T02:16:22.949 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.949 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.949 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:22.949 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290259+0000", 2024-04-19T02:16:22.949 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3711999999999998e-05 2024-04-19T02:16:22.949 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.949 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.950 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:22.950 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290282+0000", 2024-04-19T02:16:22.950 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3458000000000001e-05 2024-04-19T02:16:22.950 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:22.950 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:22.950 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:22.950 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.950 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.950 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:14 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:22.950 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:22.950 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 53.666416155999997, 2024-04-19T02:16:22.950 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020137202, 2024-04-19T02:16:22.950 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:22.950 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:22.950 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:22.951 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.951 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:22.951 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:22.951 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:22.951 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.951 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.951 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:22.951 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:22.951 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:22.951 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.951 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.951 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:22.951 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:22.951 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:22.951 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.952 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.952 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:22.952 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269971+0000", 2024-04-19T02:16:22.952 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.5459999999999992e-06 2024-04-19T02:16:22.952 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.952 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.952 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:22.952 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269979+0000", 2024-04-19T02:16:22.952 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9130000000000003e-06 2024-04-19T02:16:22.952 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.952 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.952 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:22.952 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269986+0000", 2024-04-19T02:16:22.952 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.3779999999999998e-06 2024-04-19T02:16:22.953 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.953 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.953 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:22.953 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270030+0000", 2024-04-19T02:16:22.953 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3982e-05 2024-04-19T02:16:22.953 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.953 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.953 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:16:22.953 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270034+0000", 2024-04-19T02:16:22.953 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1779999999999996e-06 2024-04-19T02:16:22.953 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.953 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.953 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:22.953 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.277870+0000", 2024-04-19T02:16:22.953 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0078362150000000005 2024-04-19T02:16:22.953 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.954 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.954 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:22.954 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.278216+0000", 2024-04-19T02:16:22.954 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00034634999999999999 2024-04-19T02:16:22.954 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.954 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.954 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:22.954 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.278732+0000", 2024-04-19T02:16:22.954 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00051536099999999999 2024-04-19T02:16:22.954 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.954 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.954 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:22.954 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.287694+0000", 2024-04-19T02:16:22.954 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0089621019999999996 2024-04-19T02:16:22.955 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.955 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.955 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:22.955 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290026+0000", 2024-04-19T02:16:22.955 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0023323139999999998 2024-04-19T02:16:22.955 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.955 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.955 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:22.955 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290067+0000", 2024-04-19T02:16:22.955 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1043e-05 2024-04-19T02:16:22.955 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.955 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.955 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:22.955 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290100+0000", 2024-04-19T02:16:22.955 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3278999999999998e-05 2024-04-19T02:16:22.955 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:22.956 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:22.956 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:22.956 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.956 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.956 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:22.956 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:22.956 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 53.666384364000002, 2024-04-19T02:16:22.956 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020731702000000001, 2024-04-19T02:16:22.956 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:22.956 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:22.956 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:22.956 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.956 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:22.956 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:22.956 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:22.957 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.957 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.957 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:22.957 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:22.957 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:22.957 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.957 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.957 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:22.957 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:22.957 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:22.957 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.957 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.957 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:22.957 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269998+0000", 2024-04-19T02:16:22.957 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7100000000000001e-06 2024-04-19T02:16:22.957 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.958 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.958 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:22.958 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270005+0000", 2024-04-19T02:16:22.958 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.241e-06 2024-04-19T02:16:22.958 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.958 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.958 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:22.958 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270011+0000", 2024-04-19T02:16:22.958 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6279999999999999e-06 2024-04-19T02:16:22.958 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.958 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.958 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:22.958 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270046+0000", 2024-04-19T02:16:22.958 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5173999999999999e-05 2024-04-19T02:16:22.959 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.959 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.959 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:22.959 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:22.959 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0019999999999997e-06 2024-04-19T02:16:22.959 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.959 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.959 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:22.959 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285619+0000", 2024-04-19T02:16:22.959 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015567391 2024-04-19T02:16:22.959 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.959 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.959 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:22.959 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285671+0000", 2024-04-19T02:16:22.960 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2460999999999998e-05 2024-04-19T02:16:22.960 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.960 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.960 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:22.960 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285775+0000", 2024-04-19T02:16:22.960 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000103389 2024-04-19T02:16:22.960 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.960 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.960 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:22.960 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288934+0000", 2024-04-19T02:16:22.960 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0031595859999999998 2024-04-19T02:16:22.960 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.960 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.960 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:22.960 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290650+0000", 2024-04-19T02:16:22.960 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001716242 2024-04-19T02:16:22.961 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.961 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.961 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:22.961 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290692+0000", 2024-04-19T02:16:22.961 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1910999999999999e-05 2024-04-19T02:16:22.961 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.961 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.961 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:22.961 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290727+0000", 2024-04-19T02:16:22.961 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4412000000000002e-05 2024-04-19T02:16:22.961 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:22.961 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:22.961 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:22.961 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.961 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.961 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:22.962 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270019+0000", 2024-04-19T02:16:22.962 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 53.666360769000001, 2024-04-19T02:16:22.962 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020572014999999999, 2024-04-19T02:16:22.962 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:22.962 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:22.962 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:22.962 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.962 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:22.962 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270019+0000", 2024-04-19T02:16:22.962 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:22.962 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.962 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.962 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:22.962 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270019+0000", 2024-04-19T02:16:22.962 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:22.963 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.963 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.963 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:22.963 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270018+0000", 2024-04-19T02:16:22.963 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:22.963 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.963 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.963 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:22.963 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270021+0000", 2024-04-19T02:16:22.963 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0319999999999999e-06 2024-04-19T02:16:22.963 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.963 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.963 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:22.964 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270028+0000", 2024-04-19T02:16:22.964 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6189999999999996e-06 2024-04-19T02:16:22.964 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.964 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.964 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:22.964 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270035+0000", 2024-04-19T02:16:22.964 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1690000000000003e-06 2024-04-19T02:16:22.964 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.964 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.964 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:22.964 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270078+0000", 2024-04-19T02:16:22.964 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3061e-05 2024-04-19T02:16:22.964 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.964 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.964 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:22.965 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270082+0000", 2024-04-19T02:16:22.965 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4510000000000002e-06 2024-04-19T02:16:22.965 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.965 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.965 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:22.965 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284354+0000", 2024-04-19T02:16:22.965 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014271588999999999 2024-04-19T02:16:22.965 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.965 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.965 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:22.965 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284497+0000", 2024-04-19T02:16:22.966 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014335800000000001 2024-04-19T02:16:22.966 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.966 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.966 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:22.966 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284626+0000", 2024-04-19T02:16:22.966 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000128744 2024-04-19T02:16:22.966 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.966 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.966 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:22.966 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288844+0000", 2024-04-19T02:16:22.966 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00421807 2024-04-19T02:16:22.966 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.966 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.966 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:22.967 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290508+0000", 2024-04-19T02:16:22.967 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001663774 2024-04-19T02:16:22.967 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.967 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.967 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:22.967 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290556+0000", 2024-04-19T02:16:22.967 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.7599999999999998e-05 2024-04-19T02:16:22.967 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.967 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.967 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:22.967 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290591+0000", 2024-04-19T02:16:22.967 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5034999999999999e-05 2024-04-19T02:16:22.967 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:22.967 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:22.967 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:22.967 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.968 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.968 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:22.968 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:22.968 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 53.666337906000003, 2024-04-19T02:16:22.968 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020192280999999999, 2024-04-19T02:16:22.968 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:22.968 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:22.968 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:22.968 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.968 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:22.968 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:22.968 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:22.968 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.968 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.968 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:22.968 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:22.969 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:22.969 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.969 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.969 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:22.969 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:22.969 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:22.969 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.969 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.969 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:22.969 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270045+0000", 2024-04-19T02:16:22.969 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8680000000000001e-06 2024-04-19T02:16:22.969 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.969 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.969 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:22.969 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270052+0000", 2024-04-19T02:16:22.970 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.9999999999999999e-06 2024-04-19T02:16:22.970 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.970 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.970 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:22.970 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270056+0000", 2024-04-19T02:16:22.970 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4479999999999996e-06 2024-04-19T02:16:22.970 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.970 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.970 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:22.970 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270089+0000", 2024-04-19T02:16:22.970 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3071000000000002e-05 2024-04-19T02:16:22.970 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.970 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.970 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:22.970 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270092+0000", 2024-04-19T02:16:22.971 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9780000000000001e-06 2024-04-19T02:16:22.971 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.971 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.971 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:22.971 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.280632+0000", 2024-04-19T02:16:22.971 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010539712 2024-04-19T02:16:22.971 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.971 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.971 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:22.971 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.280743+0000", 2024-04-19T02:16:22.971 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000111048 2024-04-19T02:16:22.971 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.971 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.972 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:22.972 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.281531+0000", 2024-04-19T02:16:22.972 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00078738199999999999 2024-04-19T02:16:22.972 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.972 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.972 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:22.972 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.287949+0000", 2024-04-19T02:16:22.972 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0064185730000000003 2024-04-19T02:16:22.972 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.972 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.972 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:22.972 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290184+0000", 2024-04-19T02:16:22.972 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0022350849999999999 2024-04-19T02:16:22.973 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.973 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.973 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:22.973 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290209+0000", 2024-04-19T02:16:22.973 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4907000000000001e-05 2024-04-19T02:16:22.973 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.973 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.973 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:22.973 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290234+0000", 2024-04-19T02:16:22.973 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4666999999999999e-05 2024-04-19T02:16:22.973 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:22.973 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:22.973 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:22.973 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.973 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.973 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:19 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:22.974 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:22.974 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 53.666316440000003, 2024-04-19T02:16:22.974 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020818203, 2024-04-19T02:16:22.974 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:22.974 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:22.974 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:22.974 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.974 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:22.974 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:22.974 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:22.974 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.974 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.974 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:22.974 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:22.974 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:22.975 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.975 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.975 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:22.975 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:22.975 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:22.975 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.975 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.975 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:22.975 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270065+0000", 2024-04-19T02:16:22.975 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4310000000000001e-06 2024-04-19T02:16:22.975 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.975 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.975 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:22.975 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270070+0000", 2024-04-19T02:16:22.975 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2859999999999999e-06 2024-04-19T02:16:22.975 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.976 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.976 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:22.976 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270077+0000", 2024-04-19T02:16:22.976 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5270000000000004e-06 2024-04-19T02:16:22.976 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.976 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.976 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:22.976 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270107+0000", 2024-04-19T02:16:22.976 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0205999999999998e-05 2024-04-19T02:16:22.976 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.976 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.976 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:22.976 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270111+0000", 2024-04-19T02:16:22.976 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8650000000000003e-06 2024-04-19T02:16:22.976 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.977 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.977 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:22.977 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285936+0000", 2024-04-19T02:16:22.977 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015824677999999998 2024-04-19T02:16:22.977 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.977 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.977 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:22.977 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286007+0000", 2024-04-19T02:16:22.977 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1157999999999999e-05 2024-04-19T02:16:22.977 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.977 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.977 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:22.977 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286086+0000", 2024-04-19T02:16:22.977 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9084000000000004e-05 2024-04-19T02:16:22.977 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.977 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.978 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:22.978 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290740+0000", 2024-04-19T02:16:22.978 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0046543679999999999 2024-04-19T02:16:22.978 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.978 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.978 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:22.978 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290833+0000", 2024-04-19T02:16:22.978 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2551000000000002e-05 2024-04-19T02:16:22.978 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.978 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.978 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:22.978 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290859+0000", 2024-04-19T02:16:22.978 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.6696999999999999e-05 2024-04-19T02:16:22.978 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.978 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.979 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:22.979 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290881+0000", 2024-04-19T02:16:22.979 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1653000000000001e-05 2024-04-19T02:16:22.979 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:22.979 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:22.979 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:22.979 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.979 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.979 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:19174 5.4 5:2f42d48e:::benchmark_data_smithi121_44835_object19173:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:22.979 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:00.712766+0000", 2024-04-19T02:16:22.979 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 22.223613199999999, 2024-04-19T02:16:22.979 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016423842000000001, 2024-04-19T02:16:22.979 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:22.979 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:22.979 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:22.979 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:22.980 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:22.980 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 19174 2024-04-19T02:16:22.980 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.980 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:22.980 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.980 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:22.980 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.712766+0000", 2024-04-19T02:16:22.980 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:22.980 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.980 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.980 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:22.980 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.712766+0000", 2024-04-19T02:16:22.980 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:22.980 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.980 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.981 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:22.981 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.712765+0000", 2024-04-19T02:16:22.981 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:22.981 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.981 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.981 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:22.981 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.712876+0000", 2024-04-19T02:16:22.981 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000110543 2024-04-19T02:16:22.981 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.981 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.981 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:22.981 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.712887+0000", 2024-04-19T02:16:22.981 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1420000000000001e-05 2024-04-19T02:16:22.981 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.981 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.981 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:22.982 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.712896+0000", 2024-04-19T02:16:22.982 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.4330000000000004e-06 2024-04-19T02:16:22.982 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.982 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.982 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:22.982 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.712923+0000", 2024-04-19T02:16:22.982 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7070999999999999e-05 2024-04-19T02:16:22.982 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.982 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.982 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:22.983 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.713005+0000", 2024-04-19T02:16:22.983 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2279000000000003e-05 2024-04-19T02:16:22.983 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.983 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.983 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:22.983 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.713094+0000", 2024-04-19T02:16:22.983 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.9251000000000003e-05 2024-04-19T02:16:22.983 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.983 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.983 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:22.983 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.714553+0000", 2024-04-19T02:16:22.983 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0014587339999999999 2024-04-19T02:16:22.983 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.983 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.983 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:22.984 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.729110+0000", 2024-04-19T02:16:22.984 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014557037 2024-04-19T02:16:22.984 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.984 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.984 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:22.984 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.729158+0000", 2024-04-19T02:16:22.984 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.829e-05 2024-04-19T02:16:22.984 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.984 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.984 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:22.984 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.729190+0000", 2024-04-19T02:16:22.984 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1673e-05 2024-04-19T02:16:22.984 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:22.984 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:22.984 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:22.984 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.985 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.985 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:31632 5.e 5:7c608c66:::benchmark_data_smithi121_44835_object31631:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-19T02:16:22.985 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:04.960320+0000", 2024-04-19T02:16:22.985 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 17.976059712000001, 2024-04-19T02:16:22.985 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016282966999999999, 2024-04-19T02:16:22.985 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:22.985 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:22.985 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:22.985 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:22.985 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:22.985 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 31632 2024-04-19T02:16:22.985 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.985 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:22.985 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.985 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:22.986 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.960320+0000", 2024-04-19T02:16:22.986 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:22.986 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.986 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.986 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:22.986 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.960320+0000", 2024-04-19T02:16:22.986 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:22.986 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.986 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.986 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:22.986 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.960319+0000", 2024-04-19T02:16:22.986 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:22.986 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.986 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.986 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:22.986 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.960359+0000", 2024-04-19T02:16:22.987 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0120999999999998e-05 2024-04-19T02:16:22.987 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.987 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.987 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:22.987 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.960370+0000", 2024-04-19T02:16:22.987 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1124999999999999e-05 2024-04-19T02:16:22.987 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.987 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.987 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:22.987 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.960376+0000", 2024-04-19T02:16:22.987 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.6840000000000001e-06 2024-04-19T02:16:22.987 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.987 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.987 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:22.987 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.965241+0000", 2024-04-19T02:16:22.987 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0048651709999999997 2024-04-19T02:16:22.988 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.988 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.988 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:22.988 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.965330+0000", 2024-04-19T02:16:22.988 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.9345999999999995e-05 2024-04-19T02:16:22.988 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.988 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.988 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:22.988 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.965409+0000", 2024-04-19T02:16:22.988 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.8757000000000005e-05 2024-04-19T02:16:22.988 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.988 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.988 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:22.988 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.966312+0000", 2024-04-19T02:16:22.988 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00090340199999999998 2024-04-19T02:16:22.988 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.989 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.989 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:22.989 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.976537+0000", 2024-04-19T02:16:22.989 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010224680999999999 2024-04-19T02:16:22.989 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.989 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.989 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:22.989 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.976580+0000", 2024-04-19T02:16:22.989 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3234e-05 2024-04-19T02:16:22.989 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.989 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.989 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:22.989 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.976603+0000", 2024-04-19T02:16:22.989 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.2421000000000001e-05 2024-04-19T02:16:22.989 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:22.990 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:22.990 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:22.990 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.990 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.990 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:42710 5.4 5:2c02047b:::benchmark_data_smithi121_44835_object42709:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:22.990 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:09.265091+0000", 2024-04-19T02:16:22.990 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 13.671287963999999, 2024-04-19T02:16:22.990 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016523969999999999, 2024-04-19T02:16:22.990 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:22.990 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:22.990 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:22.990 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:22.990 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:22.990 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 42710 2024-04-19T02:16:22.990 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.991 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:22.991 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.991 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:22.991 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.265091+0000", 2024-04-19T02:16:22.991 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:22.991 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.991 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.991 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:22.991 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.265091+0000", 2024-04-19T02:16:22.991 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:22.991 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.991 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.991 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:22.991 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.265091+0000", 2024-04-19T02:16:22.991 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:22.991 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.992 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.992 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:22.992 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.265141+0000", 2024-04-19T02:16:22.992 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.9886000000000003e-05 2024-04-19T02:16:22.992 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.992 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.992 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:22.992 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.265148+0000", 2024-04-19T02:16:22.992 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3089999999999998e-06 2024-04-19T02:16:22.992 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.992 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.992 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:22.992 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.265152+0000", 2024-04-19T02:16:22.992 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.5730000000000001e-06 2024-04-19T02:16:22.992 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.993 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.993 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:22.993 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.266187+0000", 2024-04-19T02:16:22.993 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0010347080000000001 2024-04-19T02:16:22.993 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.993 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.993 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:22.993 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.266321+0000", 2024-04-19T02:16:22.993 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013432599999999999 2024-04-19T02:16:22.993 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.993 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.993 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:22.993 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.266452+0000", 2024-04-19T02:16:22.993 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013062600000000001 2024-04-19T02:16:22.993 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.993 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.994 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:22.994 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.267706+0000", 2024-04-19T02:16:22.994 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0012537609999999999 2024-04-19T02:16:22.994 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.994 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.994 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:22.994 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.281536+0000", 2024-04-19T02:16:22.994 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.01382972 2024-04-19T02:16:22.994 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.994 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.994 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:22.994 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.281571+0000", 2024-04-19T02:16:22.994 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5215000000000001e-05 2024-04-19T02:16:22.994 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.994 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.995 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:22.995 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.281615+0000", 2024-04-19T02:16:22.995 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4604000000000002e-05 2024-04-19T02:16:22.995 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:22.995 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:22.995 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:22.995 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.995 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.995 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:42724 5.0 5:0d0b7b99:::benchmark_data_smithi121_44835_object42723:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:22.995 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:09.270595+0000", 2024-04-19T02:16:22.995 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 13.665784147, 2024-04-19T02:16:22.995 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.018445754000000002, 2024-04-19T02:16:22.995 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:22.995 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:22.995 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:22.995 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:22.996 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:22.996 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 42724 2024-04-19T02:16:22.996 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.996 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:22.996 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.996 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:22.996 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.270595+0000", 2024-04-19T02:16:22.996 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:22.996 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.996 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.996 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:22.996 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.270595+0000", 2024-04-19T02:16:22.996 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:22.997 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.997 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.997 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:22.997 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.270595+0000", 2024-04-19T02:16:22.997 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:22.997 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.997 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.997 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:22.997 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.270634+0000", 2024-04-19T02:16:22.997 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9270000000000002e-05 2024-04-19T02:16:22.997 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.997 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.997 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:22.997 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.270640+0000", 2024-04-19T02:16:22.997 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.8139999999999997e-06 2024-04-19T02:16:22.997 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.998 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.998 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:22.998 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.270645+0000", 2024-04-19T02:16:22.998 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.729e-06 2024-04-19T02:16:22.998 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.998 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.998 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:22.998 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.270676+0000", 2024-04-19T02:16:22.998 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1390000000000003e-05 2024-04-19T02:16:22.998 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.998 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.998 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:22.998 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.270808+0000", 2024-04-19T02:16:22.998 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013151699999999999 2024-04-19T02:16:22.998 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.999 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.999 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:22.999 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.270944+0000", 2024-04-19T02:16:22.999 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013695999999999999 2024-04-19T02:16:22.999 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.999 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.999 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:22.999 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.272565+0000", 2024-04-19T02:16:22.999 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016207179999999999 2024-04-19T02:16:22.999 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.999 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:22.999 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:22.999 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.288992+0000", 2024-04-19T02:16:22.999 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016426356 2024-04-19T02:16:22.999 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:22.999 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.000 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:23.000 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.289021+0000", 2024-04-19T02:16:23.000 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9257000000000001e-05 2024-04-19T02:16:23.000 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.000 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.000 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:23.000 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.289041+0000", 2024-04-19T02:16:23.000 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.0177999999999999e-05 2024-04-19T02:16:23.000 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:23.000 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:23.000 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:23.000 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.000 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.000 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:60896 5.4 5:2b0faee3:::benchmark_data_smithi121_44835_object60895:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:23.000 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:17.036092+0000", 2024-04-19T02:16:23.000 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 5.9002870529999996, 2024-04-19T02:16:23.001 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.018033583999999998, 2024-04-19T02:16:23.001 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:23.001 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:23.001 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:23.001 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:23.001 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:23.001 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 60896 2024-04-19T02:16:23.001 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.001 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:23.001 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.001 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:23.001 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.036092+0000", 2024-04-19T02:16:23.001 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:23.001 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.001 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.002 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:23.002 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.036092+0000", 2024-04-19T02:16:23.002 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:23.002 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.002 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.002 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:23.002 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.036092+0000", 2024-04-19T02:16:23.002 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:23.002 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.002 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.002 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:23.002 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.036210+0000", 2024-04-19T02:16:23.002 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011790000000000001 2024-04-19T02:16:23.002 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.002 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.003 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:23.003 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.036219+0000", 2024-04-19T02:16:23.003 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0829999999999993e-06 2024-04-19T02:16:23.003 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.003 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.003 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:23.003 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.036223+0000", 2024-04-19T02:16:23.003 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3869999999999997e-06 2024-04-19T02:16:23.003 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.003 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.003 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:23.003 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.036258+0000", 2024-04-19T02:16:23.003 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5281999999999999e-05 2024-04-19T02:16:23.003 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.003 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.004 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:23.004 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.036265+0000", 2024-04-19T02:16:23.004 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.1759999999999998e-06 2024-04-19T02:16:23.004 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.004 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.004 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:23.004 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.041984+0000", 2024-04-19T02:16:23.004 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0057195459999999998 2024-04-19T02:16:23.004 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.004 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.004 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:23.004 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.042102+0000", 2024-04-19T02:16:23.004 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000117507 2024-04-19T02:16:23.004 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.004 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.004 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:23.005 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.042217+0000", 2024-04-19T02:16:23.005 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011525 2024-04-19T02:16:23.005 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.005 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.005 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:23.005 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.044194+0000", 2024-04-19T02:16:23.005 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0019774530000000001 2024-04-19T02:16:23.005 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.005 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.005 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:23.005 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.054075+0000", 2024-04-19T02:16:23.005 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0098801619999999996 2024-04-19T02:16:23.005 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.005 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.005 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:23.006 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.054102+0000", 2024-04-19T02:16:23.006 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7580999999999999e-05 2024-04-19T02:16:23.006 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.006 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.006 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:23.006 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.054126+0000", 2024-04-19T02:16:23.006 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3816999999999999e-05 2024-04-19T02:16:23.006 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:23.006 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:23.006 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:23.006 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.006 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.006 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:61012 5.4 5:2eb475d7:::benchmark_data_smithi121_44835_object61011:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:23.006 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:17.090763+0000", 2024-04-19T02:16:23.007 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 5.8456167859999999, 2024-04-19T02:16:23.007 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016140597999999999, 2024-04-19T02:16:23.007 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:23.007 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:23.007 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:23.007 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:23.007 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:23.007 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 61012 2024-04-19T02:16:23.007 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.007 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:23.007 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.007 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:23.007 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.090763+0000", 2024-04-19T02:16:23.007 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:23.007 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.008 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.008 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:23.008 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.090763+0000", 2024-04-19T02:16:23.008 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:23.008 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.008 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.008 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:23.008 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.090762+0000", 2024-04-19T02:16:23.008 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:23.008 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.008 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.008 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:23.008 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.090825+0000", 2024-04-19T02:16:23.008 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.3163000000000005e-05 2024-04-19T02:16:23.009 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.009 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.009 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:23.009 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.090832+0000", 2024-04-19T02:16:23.009 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1709999999999996e-06 2024-04-19T02:16:23.009 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.009 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.009 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:23.009 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.090837+0000", 2024-04-19T02:16:23.009 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.7820000000000001e-06 2024-04-19T02:16:23.009 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.009 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.009 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:23.009 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.091325+0000", 2024-04-19T02:16:23.009 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00048796100000000003 2024-04-19T02:16:23.009 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.010 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.010 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:23.010 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.091413+0000", 2024-04-19T02:16:23.010 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.7830000000000004e-05 2024-04-19T02:16:23.010 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.010 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.010 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:23.010 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.091495+0000", 2024-04-19T02:16:23.010 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.1755000000000006e-05 2024-04-19T02:16:23.010 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.010 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.010 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:23.010 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.093717+0000", 2024-04-19T02:16:23.010 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.002222487 2024-04-19T02:16:23.011 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.011 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.011 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:23.011 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.106822+0000", 2024-04-19T02:16:23.011 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.013104985 2024-04-19T02:16:23.011 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.011 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.011 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:23.011 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.106867+0000", 2024-04-19T02:16:23.011 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4631e-05 2024-04-19T02:16:23.011 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.011 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.011 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:23.011 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.106903+0000", 2024-04-19T02:16:23.011 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6531e-05 2024-04-19T02:16:23.012 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:23.012 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:23.012 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:23.012 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.012 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.012 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:61282 5.4 5:2fadfcf7:::benchmark_data_smithi121_44835_object61281:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:23.012 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:17.218467+0000", 2024-04-19T02:16:23.012 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 5.7179120990000003, 2024-04-19T02:16:23.012 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016694759999999999, 2024-04-19T02:16:23.012 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:23.012 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:23.012 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:23.012 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:23.012 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:23.012 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 61282 2024-04-19T02:16:23.013 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.013 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:23.013 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.013 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:23.013 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.218467+0000", 2024-04-19T02:16:23.013 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:23.013 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.013 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.013 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:23.013 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.218467+0000", 2024-04-19T02:16:23.013 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:23.013 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.013 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.013 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:23.013 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.218467+0000", 2024-04-19T02:16:23.014 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:23.014 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.014 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.014 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:23.014 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.218554+0000", 2024-04-19T02:16:23.014 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.7457e-05 2024-04-19T02:16:23.014 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.014 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.014 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:23.014 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.218561+0000", 2024-04-19T02:16:23.014 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3459999999999996e-06 2024-04-19T02:16:23.014 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.014 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.014 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:23.015 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.218566+0000", 2024-04-19T02:16:23.015 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2729999999999996e-06 2024-04-19T02:16:23.015 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.015 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.015 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:23.015 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.218607+0000", 2024-04-19T02:16:23.015 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1520999999999998e-05 2024-04-19T02:16:23.015 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.015 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.015 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:23.015 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.218740+0000", 2024-04-19T02:16:23.015 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013284700000000001 2024-04-19T02:16:23.015 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.015 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.015 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:23.016 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.218875+0000", 2024-04-19T02:16:23.016 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000135351 2024-04-19T02:16:23.016 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.016 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.016 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:23.016 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.220761+0000", 2024-04-19T02:16:23.016 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001885308 2024-04-19T02:16:23.016 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.016 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.016 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:23.016 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.235083+0000", 2024-04-19T02:16:23.016 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014322021000000001 2024-04-19T02:16:23.016 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.016 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.016 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:23.017 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.235128+0000", 2024-04-19T02:16:23.017 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.5673999999999997e-05 2024-04-19T02:16:23.017 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.017 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.017 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:23.017 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.235162+0000", 2024-04-19T02:16:23.017 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3710000000000001e-05 2024-04-19T02:16:23.017 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:23.017 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:23.017 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:23.017 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.017 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.017 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:62720 5.e 5:7cb1d759:::benchmark_data_smithi121_44835_object62719:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:23.017 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:17.908658+0000", 2024-04-19T02:16:23.017 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 5.027721476, 2024-04-19T02:16:23.017 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.017978524999999999, 2024-04-19T02:16:23.018 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:23.018 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:23.018 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:23.018 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:23.018 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:23.018 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 62720 2024-04-19T02:16:23.018 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.018 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:23.018 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.018 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:23.018 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.908658+0000", 2024-04-19T02:16:23.018 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:23.018 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.018 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.019 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:23.019 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.908658+0000", 2024-04-19T02:16:23.019 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:23.019 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.019 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.019 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:23.019 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.908657+0000", 2024-04-19T02:16:23.019 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:23.019 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.019 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.019 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:23.019 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.908718+0000", 2024-04-19T02:16:23.019 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.1202000000000001e-05 2024-04-19T02:16:23.019 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.019 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.019 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:23.020 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.908727+0000", 2024-04-19T02:16:23.020 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.7569999999999993e-06 2024-04-19T02:16:23.020 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.020 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.020 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:23.020 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.908734+0000", 2024-04-19T02:16:23.020 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.5140000000000004e-06 2024-04-19T02:16:23.020 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.020 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.020 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:23.020 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.913299+0000", 2024-04-19T02:16:23.020 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0045644580000000004 2024-04-19T02:16:23.020 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.020 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.020 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:23.021 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.913401+0000", 2024-04-19T02:16:23.021 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000101752 2024-04-19T02:16:23.021 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.021 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.021 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:23.021 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.913488+0000", 2024-04-19T02:16:23.021 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.7638000000000004e-05 2024-04-19T02:16:23.021 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.021 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.021 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:23.021 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.917152+0000", 2024-04-19T02:16:23.021 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0036635439999999999 2024-04-19T02:16:23.021 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.021 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.021 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:23.022 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.926554+0000", 2024-04-19T02:16:23.022 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0094018309999999994 2024-04-19T02:16:23.022 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.022 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.022 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:23.022 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.926604+0000", 2024-04-19T02:16:23.022 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0349000000000002e-05 2024-04-19T02:16:23.022 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.022 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.022 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:23.022 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.926636+0000", 2024-04-19T02:16:23.022 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2546999999999999e-05 2024-04-19T02:16:23.022 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:23.022 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:23.022 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:23.023 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.023 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.023 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:63808 5.8 5:1b67bd69:::benchmark_data_smithi121_44835_object63807:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:23.023 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:18.396522+0000", 2024-04-19T02:16:23.023 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 4.539857434, 2024-04-19T02:16:23.023 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016466654000000001, 2024-04-19T02:16:23.023 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:23.023 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:23.023 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:23.023 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:23.023 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:23.023 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 63808 2024-04-19T02:16:23.023 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.023 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:23.023 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.024 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:23.024 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.396522+0000", 2024-04-19T02:16:23.024 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:23.024 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.024 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.024 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:23.024 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.396522+0000", 2024-04-19T02:16:23.024 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:23.024 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.024 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.024 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:23.024 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.396522+0000", 2024-04-19T02:16:23.024 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:23.024 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.024 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.025 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:23.025 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.396594+0000", 2024-04-19T02:16:23.025 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1971999999999995e-05 2024-04-19T02:16:23.025 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.025 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.025 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:23.025 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.396598+0000", 2024-04-19T02:16:23.025 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1869999999999999e-06 2024-04-19T02:16:23.025 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.025 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.025 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:23.025 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.396601+0000", 2024-04-19T02:16:23.025 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.574e-06 2024-04-19T02:16:23.025 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.025 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.026 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:23.026 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.399860+0000", 2024-04-19T02:16:23.026 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0032583970000000001 2024-04-19T02:16:23.026 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.026 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.026 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:23.026 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.399941+0000", 2024-04-19T02:16:23.026 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.1163999999999997e-05 2024-04-19T02:16:23.026 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.026 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.026 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:23.026 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.400073+0000", 2024-04-19T02:16:23.026 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000131896 2024-04-19T02:16:23.026 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.027 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.027 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:23.027 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.404509+0000", 2024-04-19T02:16:23.027 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0044362270000000001 2024-04-19T02:16:23.027 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.027 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.027 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:23.027 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.412921+0000", 2024-04-19T02:16:23.027 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0084118390000000008 2024-04-19T02:16:23.027 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.027 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.027 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:23.027 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.412952+0000", 2024-04-19T02:16:23.027 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0797999999999999e-05 2024-04-19T02:16:23.027 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.028 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.028 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:23.028 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.412989+0000", 2024-04-19T02:16:23.028 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6934999999999998e-05 2024-04-19T02:16:23.028 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:23.028 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:23.028 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:23.028 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.028 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.028 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:63809 5.0 5:0a9105c3:::benchmark_data_smithi121_44835_object63808:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:23.028 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:18.396605+0000", 2024-04-19T02:16:23.028 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 4.5397743679999998, 2024-04-19T02:16:23.028 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016519550000000001, 2024-04-19T02:16:23.028 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:23.028 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:23.028 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:23.029 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:23.029 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:23.029 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 63809 2024-04-19T02:16:23.029 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.029 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:23.029 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.029 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:23.029 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.396605+0000", 2024-04-19T02:16:23.029 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:23.029 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.029 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.029 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:23.029 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.396605+0000", 2024-04-19T02:16:23.029 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:23.029 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.030 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.030 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:23.030 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.396605+0000", 2024-04-19T02:16:23.030 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:23.030 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.030 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.030 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:23.030 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.396644+0000", 2024-04-19T02:16:23.030 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8946000000000003e-05 2024-04-19T02:16:23.030 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.030 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.030 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:23.030 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.396649+0000", 2024-04-19T02:16:23.030 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.3290000000000001e-06 2024-04-19T02:16:23.031 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.031 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.031 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:23.031 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.396653+0000", 2024-04-19T02:16:23.031 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7100000000000001e-06 2024-04-19T02:16:23.031 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.031 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.031 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:23.031 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.399849+0000", 2024-04-19T02:16:23.031 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0031966249999999998 2024-04-19T02:16:23.031 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.031 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.031 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:23.031 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.399936+0000", 2024-04-19T02:16:23.031 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.7149000000000002e-05 2024-04-19T02:16:23.031 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.032 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.032 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:23.032 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.400017+0000", 2024-04-19T02:16:23.032 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0655999999999995e-05 2024-04-19T02:16:23.032 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.032 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.032 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:23.032 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.404512+0000", 2024-04-19T02:16:23.032 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0044944640000000001 2024-04-19T02:16:23.032 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.032 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.032 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:23.032 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.413045+0000", 2024-04-19T02:16:23.032 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0085334190000000004 2024-04-19T02:16:23.032 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.033 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.033 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:23.033 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.413086+0000", 2024-04-19T02:16:23.033 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1229000000000001e-05 2024-04-19T02:16:23.033 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.033 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.033 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:23.033 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.413125+0000", 2024-04-19T02:16:23.033 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8359000000000003e-05 2024-04-19T02:16:23.033 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:23.033 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:23.033 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:23.033 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.033 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.033 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:63933 5.e 5:7761bd09:::benchmark_data_smithi121_44835_object63932:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:23.034 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:18.451582+0000", 2024-04-19T02:16:23.034 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 4.4847971040000001, 2024-04-19T02:16:23.034 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.017963553, 2024-04-19T02:16:23.034 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:23.034 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:23.034 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:23.034 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:23.034 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:23.034 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 63933 2024-04-19T02:16:23.034 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.034 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:23.034 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.034 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:23.034 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.451582+0000", 2024-04-19T02:16:23.035 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:23.035 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.035 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.035 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:23.035 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.451582+0000", 2024-04-19T02:16:23.035 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:23.035 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.035 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.035 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:23.035 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.451581+0000", 2024-04-19T02:16:23.035 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:23.035 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.035 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.035 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:23.035 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.451663+0000", 2024-04-19T02:16:23.036 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.1151999999999998e-05 2024-04-19T02:16:23.036 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.036 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.036 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:23.036 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.451672+0000", 2024-04-19T02:16:23.036 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0250000000000008e-06 2024-04-19T02:16:23.036 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.036 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.036 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:23.036 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.451682+0000", 2024-04-19T02:16:23.036 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0135e-05 2024-04-19T02:16:23.036 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.036 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.036 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:23.036 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.453236+0000", 2024-04-19T02:16:23.036 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0015544910000000001 2024-04-19T02:16:23.037 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.037 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.037 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:23.037 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.453380+0000", 2024-04-19T02:16:23.037 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000143428 2024-04-19T02:16:23.037 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.037 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.037 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:23.037 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.453538+0000", 2024-04-19T02:16:23.037 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000158011 2024-04-19T02:16:23.037 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.037 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.037 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:23.037 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.456104+0000", 2024-04-19T02:16:23.037 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0025666539999999998 2024-04-19T02:16:23.038 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.038 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.038 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:23.038 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.469453+0000", 2024-04-19T02:16:23.038 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.013349145999999999 2024-04-19T02:16:23.038 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.038 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.038 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:23.038 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.469504+0000", 2024-04-19T02:16:23.038 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0900999999999999e-05 2024-04-19T02:16:23.038 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.038 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.038 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:23.038 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.469546+0000", 2024-04-19T02:16:23.038 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1430999999999997e-05 2024-04-19T02:16:23.038 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:23.039 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:23.039 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:23.039 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.039 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.039 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:65702 5.0 5:0e2d52f5:::benchmark_data_smithi121_44835_object65701:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:23.039 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:19.257242+0000", 2024-04-19T02:16:23.039 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 3.6791374289999998, 2024-04-19T02:16:23.039 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.019747843000000001, 2024-04-19T02:16:23.039 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:23.039 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:23.039 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:23.039 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:23.039 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:23.039 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 65702 2024-04-19T02:16:23.039 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.040 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:23.040 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.040 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:23.040 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.257242+0000", 2024-04-19T02:16:23.040 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:23.040 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.040 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.040 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:23.040 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.257242+0000", 2024-04-19T02:16:23.040 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:23.040 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.040 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.040 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:23.040 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.257241+0000", 2024-04-19T02:16:23.040 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:23.041 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.041 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.041 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:23.041 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.257345+0000", 2024-04-19T02:16:23.041 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010439599999999999 2024-04-19T02:16:23.041 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.041 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.041 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:23.041 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.257356+0000", 2024-04-19T02:16:23.041 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0291e-05 2024-04-19T02:16:23.041 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.041 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.041 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:23.041 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.257363+0000", 2024-04-19T02:16:23.041 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.0299999999999996e-06 2024-04-19T02:16:23.041 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.042 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.042 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:23.042 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.258992+0000", 2024-04-19T02:16:23.042 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016295509999999999 2024-04-19T02:16:23.042 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.042 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.042 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:23.042 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.259114+0000", 2024-04-19T02:16:23.042 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000121234 2024-04-19T02:16:23.042 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.042 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.042 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:23.042 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.259253+0000", 2024-04-19T02:16:23.042 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013916300000000001 2024-04-19T02:16:23.042 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.043 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.043 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:23.043 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.260819+0000", 2024-04-19T02:16:23.043 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0015664190000000001 2024-04-19T02:16:23.043 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.043 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.043 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:23.043 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.276908+0000", 2024-04-19T02:16:23.043 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016089157 2024-04-19T02:16:23.043 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.043 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.043 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:23.043 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.276954+0000", 2024-04-19T02:16:23.043 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.5642000000000001e-05 2024-04-19T02:16:23.043 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.043 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.044 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:23.044 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.276990+0000", 2024-04-19T02:16:23.044 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5852999999999997e-05 2024-04-19T02:16:23.044 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:23.044 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:23.044 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:23.044 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.044 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.044 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:65712 5.8 5:1078fb7c:::benchmark_data_smithi121_44835_object65711:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:23.044 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:19.263441+0000", 2024-04-19T02:16:23.044 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 3.672937981, 2024-04-19T02:16:23.044 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.017398141999999998, 2024-04-19T02:16:23.044 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:23.044 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:23.044 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:23.045 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:23.045 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:23.045 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 65712 2024-04-19T02:16:23.045 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.045 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:23.045 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.045 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:23.045 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.263441+0000", 2024-04-19T02:16:23.045 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:23.045 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.045 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.045 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:23.045 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.263441+0000", 2024-04-19T02:16:23.045 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:23.045 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.045 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.046 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:23.046 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.263441+0000", 2024-04-19T02:16:23.046 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:23.046 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.046 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.046 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:23.046 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.263506+0000", 2024-04-19T02:16:23.046 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.4629999999999996e-05 2024-04-19T02:16:23.046 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.046 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.046 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:23.046 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.263511+0000", 2024-04-19T02:16:23.046 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.6489999999999996e-06 2024-04-19T02:16:23.046 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.046 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.046 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:23.047 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.263515+0000", 2024-04-19T02:16:23.047 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3239999999999999e-06 2024-04-19T02:16:23.047 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.047 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.047 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:23.047 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.264981+0000", 2024-04-19T02:16:23.047 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0014662480000000001 2024-04-19T02:16:23.047 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.047 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.047 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:23.047 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.265070+0000", 2024-04-19T02:16:23.047 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.9083000000000001e-05 2024-04-19T02:16:23.047 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.047 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.047 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:23.048 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.265153+0000", 2024-04-19T02:16:23.048 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.3599999999999999e-05 2024-04-19T02:16:23.048 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.048 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.048 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:23.048 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.268487+0000", 2024-04-19T02:16:23.048 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0033332180000000002 2024-04-19T02:16:23.048 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.048 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.048 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:23.048 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.280793+0000", 2024-04-19T02:16:23.048 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.012306713 2024-04-19T02:16:23.048 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.048 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.048 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:23.048 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.280821+0000", 2024-04-19T02:16:23.049 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7206999999999999e-05 2024-04-19T02:16:23.049 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:23.049 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:23.049 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:23.049 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.280840+0000", 2024-04-19T02:16:23.049 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.8901000000000001e-05 2024-04-19T02:16:23.049 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:23.049 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:23.049 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:23.049 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:23.049 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:23.049 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:16:23.050 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 28 16 71959 71943 160.574 17 0.00277717 0.0060253 2024-04-19T02:16:23.051 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:16:23.051 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:23.051+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:23.062 INFO:teuthology.orchestra.run.smithi121.stderr:noscrub is unset 2024-04-19T02:16:23.151 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:23.153+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:23.184 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-04-19T02:16:23.184 INFO:teuthology.orchestra.run.smithi177.stdout: "ops": [ 2024-04-19T02:16:23.184 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.184 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:71881 5.1 5.826d7741 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-19T02:16:23.184 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:22.125332+0000", 2024-04-19T02:16:23.184 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 1.0587539960000001, 2024-04-19T02:16:23.184 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0587793889999999, 2024-04-19T02:16:23.184 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:23.185 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for peered", 2024-04-19T02:16:23.185 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:23.185 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:23.185 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:23.185 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 71881 2024-04-19T02:16:23.185 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.185 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:23.185 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.185 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:23.185 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.125332+0000", 2024-04-19T02:16:23.185 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.185 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.185 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.185 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:23.185 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.125332+0000", 2024-04-19T02:16:23.186 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.186 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.186 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.186 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:23.186 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.125332+0000", 2024-04-19T02:16:23.186 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:23.186 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.186 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.186 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:23.186 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.125418+0000", 2024-04-19T02:16:23.186 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.5923999999999999e-05 2024-04-19T02:16:23.186 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.186 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.186 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:23.187 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.125426+0000", 2024-04-19T02:16:23.187 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.3059999999999998e-06 2024-04-19T02:16:23.187 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.187 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.187 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:23.187 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.125433+0000", 2024-04-19T02:16:23.187 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.4900000000000003e-06 2024-04-19T02:16:23.187 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.187 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.187 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:23.187 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.125487+0000", 2024-04-19T02:16:23.187 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.3776999999999997e-05 2024-04-19T02:16:23.187 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.187 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.187 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for peered", 2024-04-19T02:16:23.188 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.125495+0000", 2024-04-19T02:16:23.188 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.6410000000000002e-06 2024-04-19T02:16:23.188 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.188 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.188 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:23.188 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:23.058747+0000", 2024-04-19T02:16:23.188 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.93325233699999999 2024-04-19T02:16:23.188 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.188 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.188 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for peered", 2024-04-19T02:16:23.188 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:23.058756+0000", 2024-04-19T02:16:23.188 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.5450000000000003e-06 2024-04-19T02:16:23.188 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.188 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:23.188 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.189 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.189 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.189 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:71959 5.1 5.f8b3b391 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-19T02:16:23.189 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:22.208270+0000", 2024-04-19T02:16:23.189 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.97581661099999994, 2024-04-19T02:16:23.189 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.97589288799999996, 2024-04-19T02:16:23.189 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:23.189 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for peered", 2024-04-19T02:16:23.189 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:23.189 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:23.189 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:23.189 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 71959 2024-04-19T02:16:23.189 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.189 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:23.189 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.190 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:23.190 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.208270+0000", 2024-04-19T02:16:23.190 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.190 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.190 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.190 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:23.190 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.208270+0000", 2024-04-19T02:16:23.190 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.190 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.190 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.190 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:23.190 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.208269+0000", 2024-04-19T02:16:23.190 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:23.190 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.191 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.191 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:23.191 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.208297+0000", 2024-04-19T02:16:23.191 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.8087999999999999e-05 2024-04-19T02:16:23.191 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.191 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.191 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:23.191 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.208307+0000", 2024-04-19T02:16:23.191 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.4949999999999997e-06 2024-04-19T02:16:23.191 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.191 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.191 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:23.191 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.208315+0000", 2024-04-19T02:16:23.191 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.5830000000000007e-06 2024-04-19T02:16:23.191 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.192 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.192 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:23.192 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.208347+0000", 2024-04-19T02:16:23.192 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.1906999999999998e-05 2024-04-19T02:16:23.192 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.192 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.192 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for peered", 2024-04-19T02:16:23.192 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.208353+0000", 2024-04-19T02:16:23.192 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.9739999999999999e-06 2024-04-19T02:16:23.192 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.192 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.192 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:23.192 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:23.059032+0000", 2024-04-19T02:16:23.192 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.85067860200000001 2024-04-19T02:16:23.193 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.193 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.193 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for peered", 2024-04-19T02:16:23.193 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:23.059036+0000", 2024-04-19T02:16:23.193 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.9190000000000001e-06 2024-04-19T02:16:23.193 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.193 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:23.193 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.193 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.193 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.193 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:71823 5.1 5.9683c4d1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-19T02:16:23.193 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:22.091087+0000", 2024-04-19T02:16:23.193 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 1.092998997, 2024-04-19T02:16:23.193 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0931174459999999, 2024-04-19T02:16:23.193 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:23.194 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for peered", 2024-04-19T02:16:23.194 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:23.194 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:23.194 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:23.194 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 71823 2024-04-19T02:16:23.194 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.194 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:23.194 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.194 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:23.194 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.091087+0000", 2024-04-19T02:16:23.194 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.194 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.194 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.194 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:23.194 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.091087+0000", 2024-04-19T02:16:23.195 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.195 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.195 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.195 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:23.195 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.091087+0000", 2024-04-19T02:16:23.195 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:23.195 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.195 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.195 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:23.195 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.091301+0000", 2024-04-19T02:16:23.195 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00021393200000000001 2024-04-19T02:16:23.195 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.195 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.195 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:23.195 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.091308+0000", 2024-04-19T02:16:23.196 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.3429999999999998e-06 2024-04-19T02:16:23.196 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.196 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.196 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:23.196 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.091313+0000", 2024-04-19T02:16:23.196 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.6569999999999996e-06 2024-04-19T02:16:23.196 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.196 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.196 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:23.196 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.091341+0000", 2024-04-19T02:16:23.196 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.826e-05 2024-04-19T02:16:23.196 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.196 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.196 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for peered", 2024-04-19T02:16:23.196 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.091346+0000", 2024-04-19T02:16:23.197 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.1970000000000004e-06 2024-04-19T02:16:23.197 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.197 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.197 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:23.197 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:23.058670+0000", 2024-04-19T02:16:23.197 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.96732358399999996 2024-04-19T02:16:23.197 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.197 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.197 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for peered", 2024-04-19T02:16:23.197 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:23.058680+0000", 2024-04-19T02:16:23.197 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0508e-05 2024-04-19T02:16:23.197 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.197 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:23.197 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.198 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.198 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.198 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:71908 5.1 5.c407e361 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-19T02:16:23.198 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:22.140455+0000", 2024-04-19T02:16:23.198 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 1.0436311439999999, 2024-04-19T02:16:23.198 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0438101259999999, 2024-04-19T02:16:23.198 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:23.198 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for peered", 2024-04-19T02:16:23.198 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:23.198 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:23.198 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:23.198 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 71908 2024-04-19T02:16:23.198 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.198 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:23.199 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.199 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:23.199 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.140455+0000", 2024-04-19T02:16:23.199 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.199 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.199 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.199 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:23.199 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.140455+0000", 2024-04-19T02:16:23.199 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.199 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.199 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.199 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:23.199 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.140455+0000", 2024-04-19T02:16:23.199 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:23.199 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.200 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.200 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:23.200 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.140505+0000", 2024-04-19T02:16:23.200 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.0096000000000003e-05 2024-04-19T02:16:23.200 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.200 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.200 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:23.200 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.140515+0000", 2024-04-19T02:16:23.200 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0339999999999999e-05 2024-04-19T02:16:23.200 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.200 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.200 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:23.200 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.140522+0000", 2024-04-19T02:16:23.200 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.0530000000000001e-06 2024-04-19T02:16:23.200 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.201 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.201 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:23.201 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.140558+0000", 2024-04-19T02:16:23.201 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6083e-05 2024-04-19T02:16:23.201 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.201 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.201 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for peered", 2024-04-19T02:16:23.201 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.140566+0000", 2024-04-19T02:16:23.201 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.8669999999999994e-06 2024-04-19T02:16:23.201 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.201 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.201 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:23.201 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:23.058843+0000", 2024-04-19T02:16:23.201 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.91827684099999995 2024-04-19T02:16:23.202 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.202 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.202 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for peered", 2024-04-19T02:16:23.202 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:23.058847+0000", 2024-04-19T02:16:23.202 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.963e-06 2024-04-19T02:16:23.202 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.202 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:23.202 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.202 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.202 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.202 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:71884 5.1 5.56fb1221 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-19T02:16:23.202 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:22.126163+0000", 2024-04-19T02:16:23.202 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 1.0579232629999999, 2024-04-19T02:16:23.202 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0581451289999999, 2024-04-19T02:16:23.202 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:23.203 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for peered", 2024-04-19T02:16:23.203 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:23.203 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:23.203 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:23.203 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 71884 2024-04-19T02:16:23.203 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.203 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:23.203 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.203 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:23.203 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.126163+0000", 2024-04-19T02:16:23.203 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.203 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.203 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.203 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:23.203 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.126163+0000", 2024-04-19T02:16:23.204 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.204 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.204 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.204 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:23.204 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.126163+0000", 2024-04-19T02:16:23.204 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:23.204 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.204 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.204 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:23.204 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.126240+0000", 2024-04-19T02:16:23.204 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.7315000000000001e-05 2024-04-19T02:16:23.204 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.204 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.204 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:23.204 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.126248+0000", 2024-04-19T02:16:23.205 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.0339999999999997e-06 2024-04-19T02:16:23.205 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.205 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.205 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:23.205 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.126255+0000", 2024-04-19T02:16:23.205 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.7190000000000004e-06 2024-04-19T02:16:23.205 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.205 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.205 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:23.205 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.126296+0000", 2024-04-19T02:16:23.205 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.1121999999999997e-05 2024-04-19T02:16:23.205 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.205 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.205 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for peered", 2024-04-19T02:16:23.205 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.126304+0000", 2024-04-19T02:16:23.206 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.8890000000000002e-06 2024-04-19T02:16:23.206 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.206 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.206 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:23.206 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:23.058779+0000", 2024-04-19T02:16:23.206 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.932475477 2024-04-19T02:16:23.206 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.206 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.206 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for peered", 2024-04-19T02:16:23.206 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:23.058783+0000", 2024-04-19T02:16:23.206 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.0790000000000002e-06 2024-04-19T02:16:23.206 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.206 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:23.206 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.206 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.207 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.207 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:71741 5.1 5.2ea29b71 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e28)", 2024-04-19T02:16:23.207 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:22.057791+0000", 2024-04-19T02:16:23.207 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 1.126295504, 2024-04-19T02:16:23.207 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.126561299, 2024-04-19T02:16:23.207 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:23.207 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for peered", 2024-04-19T02:16:23.207 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:23.207 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:23.207 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:23.207 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 71741 2024-04-19T02:16:23.207 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.207 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:23.207 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.207 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:23.208 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.057791+0000", 2024-04-19T02:16:23.208 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.208 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.208 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.208 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:23.208 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.057791+0000", 2024-04-19T02:16:23.208 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.208 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.208 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.208 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:23.208 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.057790+0000", 2024-04-19T02:16:23.208 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:23.208 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.208 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.208 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:23.208 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.058217+0000", 2024-04-19T02:16:23.209 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000427546 2024-04-19T02:16:23.209 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.209 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.209 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:23.209 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.058228+0000", 2024-04-19T02:16:23.209 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0302999999999999e-05 2024-04-19T02:16:23.209 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.209 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.209 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:23.209 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.058237+0000", 2024-04-19T02:16:23.209 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.867e-06 2024-04-19T02:16:23.209 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.209 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.209 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:23.209 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.059193+0000", 2024-04-19T02:16:23.209 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00095665400000000003 2024-04-19T02:16:23.210 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.210 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.210 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for peered", 2024-04-19T02:16:23.210 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.059203+0000", 2024-04-19T02:16:23.210 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.2909999999999996e-06 2024-04-19T02:16:23.210 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.210 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.210 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:23.210 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:23.058425+0000", 2024-04-19T02:16:23.210 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.99922277500000001 2024-04-19T02:16:23.210 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.210 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.210 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for peered", 2024-04-19T02:16:23.210 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:23.058440+0000", 2024-04-19T02:16:23.210 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.453e-05 2024-04-19T02:16:23.211 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.211 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:23.211 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.211 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.211 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.211 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:71916 5.1 5.ab346181 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-19T02:16:23.211 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:22.146478+0000", 2024-04-19T02:16:23.211 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 1.037608281, 2024-04-19T02:16:23.211 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0379177820000001, 2024-04-19T02:16:23.211 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:23.211 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for peered", 2024-04-19T02:16:23.211 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:23.211 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:23.211 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:23.211 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 71916 2024-04-19T02:16:23.212 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.212 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:23.212 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.212 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:23.212 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.146478+0000", 2024-04-19T02:16:23.212 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.212 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.212 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.212 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:23.212 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.146478+0000", 2024-04-19T02:16:23.212 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.212 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.212 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.212 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:23.212 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.146478+0000", 2024-04-19T02:16:23.213 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:23.213 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.213 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.213 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:23.213 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.146542+0000", 2024-04-19T02:16:23.213 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.4153999999999996e-05 2024-04-19T02:16:23.213 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.213 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.213 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:23.213 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.146558+0000", 2024-04-19T02:16:23.213 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.6124999999999999e-05 2024-04-19T02:16:23.213 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.213 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.213 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:23.213 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.146571+0000", 2024-04-19T02:16:23.213 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.3057000000000001e-05 2024-04-19T02:16:23.214 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.214 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.214 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:23.214 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.146621+0000", 2024-04-19T02:16:23.214 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.9647000000000001e-05 2024-04-19T02:16:23.214 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.214 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.214 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for peered", 2024-04-19T02:16:23.214 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.146631+0000", 2024-04-19T02:16:23.214 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0003999999999999e-05 2024-04-19T02:16:23.214 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.214 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.214 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:23.214 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:23.058880+0000", 2024-04-19T02:16:23.214 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.91224942499999995 2024-04-19T02:16:23.215 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.215 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.215 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for peered", 2024-04-19T02:16:23.215 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:23.058888+0000", 2024-04-19T02:16:23.215 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.4460000000000001e-06 2024-04-19T02:16:23.215 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.215 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:23.215 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.215 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.215 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.215 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:71810 5.1 5.c561411 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-19T02:16:23.215 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:22.083490+0000", 2024-04-19T02:16:23.215 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 1.100596328, 2024-04-19T02:16:23.215 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.100948061, 2024-04-19T02:16:23.215 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:23.215 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for peered", 2024-04-19T02:16:23.216 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:23.216 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:23.216 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:23.216 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 71810 2024-04-19T02:16:23.216 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.216 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:23.216 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.216 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:23.216 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.083490+0000", 2024-04-19T02:16:23.216 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.216 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.216 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.216 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:23.216 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.083490+0000", 2024-04-19T02:16:23.216 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.217 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.217 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.217 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:23.217 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.083490+0000", 2024-04-19T02:16:23.217 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:23.217 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.217 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.217 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:23.217 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.083565+0000", 2024-04-19T02:16:23.217 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.5520999999999997e-05 2024-04-19T02:16:23.217 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.217 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.217 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:23.217 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.083575+0000", 2024-04-19T02:16:23.217 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.8700000000000004e-06 2024-04-19T02:16:23.217 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.218 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.218 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:23.218 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.083582+0000", 2024-04-19T02:16:23.218 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.2529999999999998e-06 2024-04-19T02:16:23.218 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.218 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.218 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:23.218 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.083633+0000", 2024-04-19T02:16:23.218 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.0810000000000003e-05 2024-04-19T02:16:23.218 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.218 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.218 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for peered", 2024-04-19T02:16:23.218 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.083642+0000", 2024-04-19T02:16:23.218 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.9749999999999996e-06 2024-04-19T02:16:23.218 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.219 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.219 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:23.219 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:23.058522+0000", 2024-04-19T02:16:23.219 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.97488012700000004 2024-04-19T02:16:23.219 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.219 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.219 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for peered", 2024-04-19T02:16:23.219 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:23.058531+0000", 2024-04-19T02:16:23.219 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.3039999999999994e-06 2024-04-19T02:16:23.219 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.219 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:23.219 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.219 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.219 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.219 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:71918 5.1 5.7ba92e11 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-19T02:16:23.219 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:22.146916+0000", 2024-04-19T02:16:23.220 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 1.0371706919999999, 2024-04-19T02:16:23.220 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0375647290000001, 2024-04-19T02:16:23.220 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:23.220 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for peered", 2024-04-19T02:16:23.220 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:23.220 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:23.220 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:23.220 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 71918 2024-04-19T02:16:23.220 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.220 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:23.220 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.220 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:23.220 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.146916+0000", 2024-04-19T02:16:23.220 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.220 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.221 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.221 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:23.221 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.146916+0000", 2024-04-19T02:16:23.221 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.221 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.221 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.221 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:23.221 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.146915+0000", 2024-04-19T02:16:23.221 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:23.221 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.221 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.221 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:23.221 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.146968+0000", 2024-04-19T02:16:23.221 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.2590000000000003e-05 2024-04-19T02:16:23.221 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.221 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.222 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:23.222 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.146973+0000", 2024-04-19T02:16:23.222 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.9180000000000002e-06 2024-04-19T02:16:23.222 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.222 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.222 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:23.222 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.146976+0000", 2024-04-19T02:16:23.222 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.5590000000000001e-06 2024-04-19T02:16:23.222 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.222 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.222 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:23.222 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.147015+0000", 2024-04-19T02:16:23.222 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.8343000000000002e-05 2024-04-19T02:16:23.222 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.222 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.223 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for peered", 2024-04-19T02:16:23.223 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.147024+0000", 2024-04-19T02:16:23.223 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.4040000000000001e-06 2024-04-19T02:16:23.223 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.223 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.223 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:23.223 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:23.058912+0000", 2024-04-19T02:16:23.223 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.91188782899999998 2024-04-19T02:16:23.223 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.223 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.223 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for peered", 2024-04-19T02:16:23.223 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:23.058916+0000", 2024-04-19T02:16:23.223 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.2080000000000002e-06 2024-04-19T02:16:23.223 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.223 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:23.224 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.224 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.224 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.224 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:71895 5.1 5.248668a1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-19T02:16:23.224 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:22.133053+0000", 2024-04-19T02:16:23.224 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 1.0510336950000001, 2024-04-19T02:16:23.224 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0514704610000001, 2024-04-19T02:16:23.224 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:23.224 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for peered", 2024-04-19T02:16:23.224 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:23.224 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:23.224 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:23.224 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 71895 2024-04-19T02:16:23.224 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.225 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:23.225 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.225 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:23.225 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.133053+0000", 2024-04-19T02:16:23.225 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.225 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.225 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.225 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:23.225 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.133053+0000", 2024-04-19T02:16:23.225 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.225 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.225 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.225 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:23.225 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.133052+0000", 2024-04-19T02:16:23.225 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:23.226 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.226 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.226 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:23.226 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.133114+0000", 2024-04-19T02:16:23.226 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.1631000000000007e-05 2024-04-19T02:16:23.226 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.226 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.226 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:23.226 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.133122+0000", 2024-04-19T02:16:23.226 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.7439999999999996e-06 2024-04-19T02:16:23.226 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.226 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.226 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:23.226 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.133129+0000", 2024-04-19T02:16:23.226 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.4019999999999999e-06 2024-04-19T02:16:23.227 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.227 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.227 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:23.227 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.133171+0000", 2024-04-19T02:16:23.227 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.2298000000000001e-05 2024-04-19T02:16:23.227 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.227 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.227 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for peered", 2024-04-19T02:16:23.227 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.133182+0000", 2024-04-19T02:16:23.227 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0641e-05 2024-04-19T02:16:23.227 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.227 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.227 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:23.227 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:23.058812+0000", 2024-04-19T02:16:23.227 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.92562978299999998 2024-04-19T02:16:23.228 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.228 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.228 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for peered", 2024-04-19T02:16:23.228 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:23.058820+0000", 2024-04-19T02:16:23.228 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.1980000000000001e-06 2024-04-19T02:16:23.228 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.228 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:23.228 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.228 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.228 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.228 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:71924 5.1 5.43343611 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-19T02:16:23.228 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:22.152303+0000", 2024-04-19T02:16:23.228 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 1.0317833860000001, 2024-04-19T02:16:23.228 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0322775099999999, 2024-04-19T02:16:23.228 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:23.229 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for peered", 2024-04-19T02:16:23.229 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:23.229 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:23.229 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:23.229 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 71924 2024-04-19T02:16:23.229 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.229 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:23.229 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.229 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:23.229 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.152303+0000", 2024-04-19T02:16:23.229 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.229 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.229 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.229 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:23.229 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.152303+0000", 2024-04-19T02:16:23.230 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.230 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.230 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.230 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:23.230 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.152303+0000", 2024-04-19T02:16:23.230 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:23.230 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.230 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.230 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:23.230 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.152388+0000", 2024-04-19T02:16:23.230 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.4803999999999996e-05 2024-04-19T02:16:23.230 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.230 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.230 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:23.230 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.152393+0000", 2024-04-19T02:16:23.231 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.3959999999999997e-06 2024-04-19T02:16:23.231 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.231 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.231 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:23.231 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.152396+0000", 2024-04-19T02:16:23.231 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.3569999999999998e-06 2024-04-19T02:16:23.231 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.231 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.231 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:23.231 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.152428+0000", 2024-04-19T02:16:23.231 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.2178999999999998e-05 2024-04-19T02:16:23.231 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.231 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.231 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for peered", 2024-04-19T02:16:23.231 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.152435+0000", 2024-04-19T02:16:23.232 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.1920000000000002e-06 2024-04-19T02:16:23.232 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.232 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.232 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:23.232 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:23.058945+0000", 2024-04-19T02:16:23.232 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.90650991000000003 2024-04-19T02:16:23.232 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.232 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.232 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for peered", 2024-04-19T02:16:23.232 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:23.058953+0000", 2024-04-19T02:16:23.232 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.3899999999999993e-06 2024-04-19T02:16:23.232 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.232 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:23.232 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.232 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.232 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.233 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:71926 5.1 5.5db607d1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-19T02:16:23.233 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:22.155274+0000", 2024-04-19T02:16:23.233 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 1.0288125589999999, 2024-04-19T02:16:23.233 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0293473630000001, 2024-04-19T02:16:23.233 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:23.233 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for peered", 2024-04-19T02:16:23.233 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:23.233 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:23.233 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:23.233 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 71926 2024-04-19T02:16:23.233 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.233 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:23.233 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.233 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:23.233 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.155274+0000", 2024-04-19T02:16:23.234 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.234 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.234 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.234 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:23.234 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.155274+0000", 2024-04-19T02:16:23.234 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.234 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.234 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.234 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:23.234 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.155273+0000", 2024-04-19T02:16:23.234 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:23.234 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.234 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.234 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:23.234 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.155339+0000", 2024-04-19T02:16:23.235 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.5718999999999999e-05 2024-04-19T02:16:23.235 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.235 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.235 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:23.235 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.155346+0000", 2024-04-19T02:16:23.235 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.4880000000000004e-06 2024-04-19T02:16:23.235 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.235 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.235 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:23.235 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.155350+0000", 2024-04-19T02:16:23.235 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.9430000000000002e-06 2024-04-19T02:16:23.235 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.235 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.235 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:23.235 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.155382+0000", 2024-04-19T02:16:23.235 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.2252000000000002e-05 2024-04-19T02:16:23.236 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.236 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.236 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for peered", 2024-04-19T02:16:23.236 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.155389+0000", 2024-04-19T02:16:23.236 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.0530000000000001e-06 2024-04-19T02:16:23.236 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.236 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.236 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:23.236 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:23.058976+0000", 2024-04-19T02:16:23.236 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.90358700400000003 2024-04-19T02:16:23.236 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.236 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.236 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for peered", 2024-04-19T02:16:23.236 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:23.058980+0000", 2024-04-19T02:16:23.237 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.1289999999999998e-06 2024-04-19T02:16:23.237 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.237 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:23.237 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.237 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.237 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.237 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:71820 5.1 5.2faabeb1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-19T02:16:23.237 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:22.089517+0000", 2024-04-19T02:16:23.237 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 1.0945693169999999, 2024-04-19T02:16:23.237 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0951471770000001, 2024-04-19T02:16:23.237 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:23.237 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for peered", 2024-04-19T02:16:23.237 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:23.237 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:23.237 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:23.238 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 71820 2024-04-19T02:16:23.238 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.238 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:23.238 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.238 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:23.238 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.089517+0000", 2024-04-19T02:16:23.238 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.238 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.238 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.238 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:23.238 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.089517+0000", 2024-04-19T02:16:23.238 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.238 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.238 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.238 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:23.239 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.089516+0000", 2024-04-19T02:16:23.239 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:23.239 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.239 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.239 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:23.239 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.089613+0000", 2024-04-19T02:16:23.239 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.6658999999999997e-05 2024-04-19T02:16:23.239 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.239 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.239 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:23.239 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.089623+0000", 2024-04-19T02:16:23.239 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.5200000000000003e-06 2024-04-19T02:16:23.239 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.239 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.239 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:23.240 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.089628+0000", 2024-04-19T02:16:23.240 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.524e-06 2024-04-19T02:16:23.240 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.240 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.240 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:23.240 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.089676+0000", 2024-04-19T02:16:23.240 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.7639999999999998e-05 2024-04-19T02:16:23.240 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.240 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.240 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for peered", 2024-04-19T02:16:23.240 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.089687+0000", 2024-04-19T02:16:23.240 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0857e-05 2024-04-19T02:16:23.240 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.240 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.240 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:23.241 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:23.058567+0000", 2024-04-19T02:16:23.241 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.96888024500000003 2024-04-19T02:16:23.241 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.241 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.241 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for peered", 2024-04-19T02:16:23.241 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:23.058571+0000", 2024-04-19T02:16:23.241 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.5739999999999997e-06 2024-04-19T02:16:23.241 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.241 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:23.241 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.241 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.241 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.241 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:71957 5.1 5.1142eb41 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-19T02:16:23.241 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:22.203185+0000", 2024-04-19T02:16:23.241 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.98090128200000004, 2024-04-19T02:16:23.242 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.98151919799999998, 2024-04-19T02:16:23.242 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:23.242 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for peered", 2024-04-19T02:16:23.242 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:23.242 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:23.242 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:23.242 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 71957 2024-04-19T02:16:23.242 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.242 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:23.242 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.242 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:23.242 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.203185+0000", 2024-04-19T02:16:23.242 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.242 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.242 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.243 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:23.243 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.203185+0000", 2024-04-19T02:16:23.243 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.243 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.243 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.243 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:23.243 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.203185+0000", 2024-04-19T02:16:23.243 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:23.243 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.243 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.243 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:23.243 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.203241+0000", 2024-04-19T02:16:23.243 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.6635000000000002e-05 2024-04-19T02:16:23.243 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.243 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.244 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:23.244 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.203248+0000", 2024-04-19T02:16:23.244 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.114e-06 2024-04-19T02:16:23.244 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.244 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.244 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:23.244 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.203255+0000", 2024-04-19T02:16:23.244 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.3099999999999997e-06 2024-04-19T02:16:23.244 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.244 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.244 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:23.244 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.203288+0000", 2024-04-19T02:16:23.244 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.3277e-05 2024-04-19T02:16:23.244 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.244 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.244 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for peered", 2024-04-19T02:16:23.245 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.203296+0000", 2024-04-19T02:16:23.245 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.405e-06 2024-04-19T02:16:23.245 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.245 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.245 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:23.245 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:23.059008+0000", 2024-04-19T02:16:23.245 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.85571154100000002 2024-04-19T02:16:23.245 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.245 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.245 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for peered", 2024-04-19T02:16:23.245 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:23.059016+0000", 2024-04-19T02:16:23.245 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.7800000000000001e-06 2024-04-19T02:16:23.245 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.245 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:23.245 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.246 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.246 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.246 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:71791 5.1 5.8987e9b1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-19T02:16:23.246 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:22.077219+0000", 2024-04-19T02:16:23.246 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 1.1068679299999999, 2024-04-19T02:16:23.246 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.1075255550000001, 2024-04-19T02:16:23.246 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:23.246 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for peered", 2024-04-19T02:16:23.246 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:23.246 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:23.246 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:23.247 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 71791 2024-04-19T02:16:23.247 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.247 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:23.247 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.247 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:23.247 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.077219+0000", 2024-04-19T02:16:23.247 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.247 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.247 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.247 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:23.247 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.077219+0000", 2024-04-19T02:16:23.247 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.247 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.247 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.247 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:23.248 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.077218+0000", 2024-04-19T02:16:23.248 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:23.248 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.248 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.248 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:23.248 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.077265+0000", 2024-04-19T02:16:23.248 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.6625999999999997e-05 2024-04-19T02:16:23.248 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.248 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.248 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:23.248 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.077270+0000", 2024-04-19T02:16:23.248 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.9470000000000002e-06 2024-04-19T02:16:23.248 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.248 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.248 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:23.249 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.077274+0000", 2024-04-19T02:16:23.249 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.262e-06 2024-04-19T02:16:23.249 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.249 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.249 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:23.249 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.077316+0000", 2024-04-19T02:16:23.249 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.2347e-05 2024-04-19T02:16:23.249 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.249 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.249 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for peered", 2024-04-19T02:16:23.249 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.077323+0000", 2024-04-19T02:16:23.249 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.3289999999999999e-06 2024-04-19T02:16:23.249 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.249 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.250 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:23.250 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:23.058480+0000", 2024-04-19T02:16:23.250 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.98115712499999996 2024-04-19T02:16:23.250 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.250 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.250 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for peered", 2024-04-19T02:16:23.250 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:23.058486+0000", 2024-04-19T02:16:23.250 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.3829999999999997e-06 2024-04-19T02:16:23.250 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.250 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:23.250 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.250 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.250 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.250 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:71847 5.1 5.ea58f391 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-19T02:16:23.251 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:22.106003+0000", 2024-04-19T02:16:23.251 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 1.0780835289999999, 2024-04-19T02:16:23.251 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.078783662, 2024-04-19T02:16:23.251 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:23.251 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for peered", 2024-04-19T02:16:23.251 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:23.251 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:23.251 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:23.251 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 71847 2024-04-19T02:16:23.251 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.251 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:23.251 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.251 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:23.251 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.106003+0000", 2024-04-19T02:16:23.252 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.252 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.252 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.252 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:23.252 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.106003+0000", 2024-04-19T02:16:23.252 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.252 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.252 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.252 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:23.252 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.106002+0000", 2024-04-19T02:16:23.252 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:23.252 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.252 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.252 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:23.252 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.106068+0000", 2024-04-19T02:16:23.252 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.6266000000000006e-05 2024-04-19T02:16:23.253 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.253 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.253 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:23.253 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.106079+0000", 2024-04-19T02:16:23.253 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0709e-05 2024-04-19T02:16:23.253 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.253 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.253 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:23.253 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.106086+0000", 2024-04-19T02:16:23.253 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.9489999999999999e-06 2024-04-19T02:16:23.253 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.253 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.253 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:23.253 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.106127+0000", 2024-04-19T02:16:23.253 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.1313999999999998e-05 2024-04-19T02:16:23.254 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.254 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.254 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for peered", 2024-04-19T02:16:23.254 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:22.106133+0000", 2024-04-19T02:16:23.254 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.0190000000000003e-06 2024-04-19T02:16:23.254 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.254 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.254 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:23.254 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:23.058712+0000", 2024-04-19T02:16:23.254 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.95257915599999998 2024-04-19T02:16:23.254 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.254 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.254 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for peered", 2024-04-19T02:16:23.255 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:23.058718+0000", 2024-04-19T02:16:23.255 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.4369999999999998e-06 2024-04-19T02:16:23.255 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.255 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:23.255 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.255 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.255 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2024-04-19T02:16:23.255 INFO:teuthology.orchestra.run.smithi177.stdout: "num_ops": 16 2024-04-19T02:16:23.255 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-04-19T02:16:23.256 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:23.257+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:23.257 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:16:23.357 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:23.357+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:23.383 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-04-19T02:16:23.383 INFO:teuthology.orchestra.run.smithi177.stdout: "ops": [], 2024-04-19T02:16:23.383 INFO:teuthology.orchestra.run.smithi177.stdout: "complaint_time": 30, 2024-04-19T02:16:23.384 INFO:teuthology.orchestra.run.smithi177.stdout: "num_blocked_ops": 0 2024-04-19T02:16:23.384 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-04-19T02:16:23.393 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:16:23.458 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:23.457+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:23.523 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-04-19T02:16:23.523 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 20, 2024-04-19T02:16:23.523 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 600, 2024-04-19T02:16:23.523 INFO:teuthology.orchestra.run.smithi177.stdout: "ops": [ 2024-04-19T02:16:23.523 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.523 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:2290 5.5 5:a870a399:::benchmark_data_smithi121_44835_object2289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:16:23.523 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:55.645524+0000", 2024-04-19T02:16:23.523 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 27.875670683999999, 2024-04-19T02:16:23.523 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.018181836999999999, 2024-04-19T02:16:23.523 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:23.523 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:23.523 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:23.524 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:23.524 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:23.524 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 2290 2024-04-19T02:16:23.524 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.524 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:23.524 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.524 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:23.524 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645524+0000", 2024-04-19T02:16:23.524 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.524 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.524 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.524 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:23.524 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645524+0000", 2024-04-19T02:16:23.524 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.525 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.525 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.525 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:23.525 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645524+0000", 2024-04-19T02:16:23.525 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:23.525 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.525 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.525 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:23.525 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645603+0000", 2024-04-19T02:16:23.525 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.9983999999999999e-05 2024-04-19T02:16:23.525 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.525 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.525 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:23.525 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645609+0000", 2024-04-19T02:16:23.525 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.5500000000000002e-06 2024-04-19T02:16:23.526 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.526 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.526 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:23.526 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645613+0000", 2024-04-19T02:16:23.526 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.591e-06 2024-04-19T02:16:23.526 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.526 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.526 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:23.526 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645649+0000", 2024-04-19T02:16:23.526 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6769e-05 2024-04-19T02:16:23.526 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.526 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.526 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:23.526 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645765+0000", 2024-04-19T02:16:23.526 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00011593499999999999 2024-04-19T02:16:23.527 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.527 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.527 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:23.527 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645899+0000", 2024-04-19T02:16:23.527 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00013329499999999999 2024-04-19T02:16:23.527 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.527 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.527 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:23.527 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.649261+0000", 2024-04-19T02:16:23.527 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0033619639999999998 2024-04-19T02:16:23.527 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.527 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.527 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:23.527 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.663657+0000", 2024-04-19T02:16:23.527 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.014396137999999999 2024-04-19T02:16:23.528 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.528 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.528 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:23.528 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.663686+0000", 2024-04-19T02:16:23.528 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.8841999999999999e-05 2024-04-19T02:16:23.528 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.528 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.528 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:23.528 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.663706+0000", 2024-04-19T02:16:23.528 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.0108000000000001e-05 2024-04-19T02:16:23.528 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.528 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:23.528 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.528 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.528 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.529 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:2296 5.5 5:a5d39efa:::benchmark_data_smithi121_44835_object2295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:16:23.529 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:55.646720+0000", 2024-04-19T02:16:23.529 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 27.874474889999998, 2024-04-19T02:16:23.529 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.017072077000000001, 2024-04-19T02:16:23.529 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:23.529 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:23.529 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:23.529 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:23.529 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:23.529 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 2296 2024-04-19T02:16:23.529 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.529 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:23.529 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.529 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:23.529 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646720+0000", 2024-04-19T02:16:23.530 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.530 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.530 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.530 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:23.530 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646720+0000", 2024-04-19T02:16:23.530 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.530 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.530 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.530 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:23.530 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646719+0000", 2024-04-19T02:16:23.530 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:23.530 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.530 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.530 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:23.530 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646778+0000", 2024-04-19T02:16:23.531 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.9264e-05 2024-04-19T02:16:23.531 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.531 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.531 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:23.531 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646792+0000", 2024-04-19T02:16:23.531 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.3573e-05 2024-04-19T02:16:23.531 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.531 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.531 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:23.531 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646797+0000", 2024-04-19T02:16:23.531 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.3190000000000002e-06 2024-04-19T02:16:23.531 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.531 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.531 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:23.531 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646826+0000", 2024-04-19T02:16:23.532 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.8787999999999999e-05 2024-04-19T02:16:23.532 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.532 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.532 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:23.532 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646913+0000", 2024-04-19T02:16:23.532 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.7601000000000004e-05 2024-04-19T02:16:23.532 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.532 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.532 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:23.532 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.646996+0000", 2024-04-19T02:16:23.532 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.2237000000000006e-05 2024-04-19T02:16:23.532 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.532 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.532 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:23.532 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.649533+0000", 2024-04-19T02:16:23.533 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.002537564 2024-04-19T02:16:23.533 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.533 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.533 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:23.533 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.663741+0000", 2024-04-19T02:16:23.533 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.014207322 2024-04-19T02:16:23.533 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.533 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.533 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:23.533 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.663771+0000", 2024-04-19T02:16:23.533 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.0324e-05 2024-04-19T02:16:23.533 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.533 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.533 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:23.533 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.663792+0000", 2024-04-19T02:16:23.534 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.0778999999999999e-05 2024-04-19T02:16:23.534 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.534 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:23.534 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.534 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.534 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.534 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:16497 5.c 5:3cb287d4:::benchmark_data_smithi121_44835_object16496:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:23.534 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:59.873454+0000", 2024-04-19T02:16:23.534 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 23.647740940999999, 2024-04-19T02:16:23.534 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.017103489999999999, 2024-04-19T02:16:23.534 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:23.534 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:23.534 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:23.534 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:23.534 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:23.535 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 16497 2024-04-19T02:16:23.535 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.535 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:23.535 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.535 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:23.535 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873454+0000", 2024-04-19T02:16:23.535 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.535 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.535 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.535 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:23.535 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873454+0000", 2024-04-19T02:16:23.535 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.535 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.535 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.536 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:23.536 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873453+0000", 2024-04-19T02:16:23.536 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:23.536 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.536 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.536 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:23.536 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873512+0000", 2024-04-19T02:16:23.536 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.8730999999999997e-05 2024-04-19T02:16:23.536 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.536 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.536 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:23.536 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873518+0000", 2024-04-19T02:16:23.536 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.9789999999999998e-06 2024-04-19T02:16:23.536 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.536 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.537 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:23.537 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873522+0000", 2024-04-19T02:16:23.537 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.0570000000000003e-06 2024-04-19T02:16:23.537 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.537 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.537 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:23.537 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873590+0000", 2024-04-19T02:16:23.537 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.8504999999999995e-05 2024-04-19T02:16:23.537 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.537 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.537 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:23.537 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873709+0000", 2024-04-19T02:16:23.537 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000118497 2024-04-19T02:16:23.537 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.538 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.538 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:23.538 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.873881+0000", 2024-04-19T02:16:23.538 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000172129 2024-04-19T02:16:23.538 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.538 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.538 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:23.538 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.874627+0000", 2024-04-19T02:16:23.538 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00074580100000000004 2024-04-19T02:16:23.538 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.538 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.538 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:23.538 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.890478+0000", 2024-04-19T02:16:23.538 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015850672 2024-04-19T02:16:23.538 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.539 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.539 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:23.539 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.890522+0000", 2024-04-19T02:16:23.539 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.4376000000000003e-05 2024-04-19T02:16:23.539 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.539 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.539 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:23.539 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:59.890557+0000", 2024-04-19T02:16:23.539 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.5151999999999998e-05 2024-04-19T02:16:23.539 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.539 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:23.539 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.539 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.539 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.539 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:42714 5.c 5:32899b28:::benchmark_data_smithi121_44835_object42713:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:23.540 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:09.266429+0000", 2024-04-19T02:16:23.540 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 14.254765934, 2024-04-19T02:16:23.540 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.017445751999999998, 2024-04-19T02:16:23.540 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:23.540 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:23.540 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:23.540 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:23.540 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:23.540 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 42714 2024-04-19T02:16:23.540 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.540 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:23.540 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.540 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:23.540 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.266429+0000", 2024-04-19T02:16:23.541 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.541 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.541 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.541 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:23.541 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.266429+0000", 2024-04-19T02:16:23.541 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.541 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.541 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.541 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:23.541 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.266428+0000", 2024-04-19T02:16:23.541 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:23.541 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.541 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.541 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:23.541 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.266523+0000", 2024-04-19T02:16:23.542 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.4913000000000004e-05 2024-04-19T02:16:23.542 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.542 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.542 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:23.542 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.266535+0000", 2024-04-19T02:16:23.542 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.2187e-05 2024-04-19T02:16:23.542 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.542 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.542 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:23.542 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.266542+0000", 2024-04-19T02:16:23.542 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.7139999999999993e-06 2024-04-19T02:16:23.542 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.542 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.542 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:23.543 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.267446+0000", 2024-04-19T02:16:23.543 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00090385699999999999 2024-04-19T02:16:23.543 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.543 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.543 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:23.543 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.267570+0000", 2024-04-19T02:16:23.543 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012405599999999999 2024-04-19T02:16:23.543 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.543 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.543 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:23.543 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.267733+0000", 2024-04-19T02:16:23.543 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000162225 2024-04-19T02:16:23.543 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.543 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.543 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:23.544 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.275131+0000", 2024-04-19T02:16:23.544 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0073988639999999998 2024-04-19T02:16:23.544 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.544 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.544 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:23.544 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.283761+0000", 2024-04-19T02:16:23.544 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0086299989999999993 2024-04-19T02:16:23.544 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.544 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.544 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:23.544 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.283824+0000", 2024-04-19T02:16:23.544 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.2632000000000006e-05 2024-04-19T02:16:23.544 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.544 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.544 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:23.545 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.283874+0000", 2024-04-19T02:16:23.545 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.0290999999999997e-05 2024-04-19T02:16:23.545 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.545 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:23.545 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.545 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.545 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.545 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:42724 5.0 e23/16 5:0d0b7b99:::benchmark_data_smithi121_44835_object42723:head v 23'2565, mlcod=23'2563)", 2024-04-19T02:16:23.545 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:09.271090+0000", 2024-04-19T02:16:23.545 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 14.250104601, 2024-04-19T02:16:23.545 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016714757, 2024-04-19T02:16:23.545 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:23.545 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:23.545 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:23.545 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.546 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:23.546 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.271090+0000", 2024-04-19T02:16:23.546 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.546 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.546 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.546 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:23.546 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.271090+0000", 2024-04-19T02:16:23.546 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.546 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.546 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.546 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:23.546 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.271090+0000", 2024-04-19T02:16:23.546 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:23.546 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.546 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.547 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:23.547 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.271139+0000", 2024-04-19T02:16:23.547 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.9614999999999998e-05 2024-04-19T02:16:23.547 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.547 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.547 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:23.547 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.271147+0000", 2024-04-19T02:16:23.547 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.6960000000000005e-06 2024-04-19T02:16:23.547 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.547 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.547 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:23.547 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.271151+0000", 2024-04-19T02:16:23.547 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.3030000000000001e-06 2024-04-19T02:16:23.547 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.547 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.548 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:23.548 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.271179+0000", 2024-04-19T02:16:23.548 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.7971e-05 2024-04-19T02:16:23.548 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.548 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.548 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:23.548 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.271194+0000", 2024-04-19T02:16:23.548 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.4406999999999999e-05 2024-04-19T02:16:23.548 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.548 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.548 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:23.548 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.287772+0000", 2024-04-19T02:16:23.548 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016578275 2024-04-19T02:16:23.548 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.549 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.549 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:23.549 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.287805+0000", 2024-04-19T02:16:23.549 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.2914999999999999e-05 2024-04-19T02:16:23.549 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.549 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:23.549 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.549 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.549 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.549 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:43121 5.5 5:abed14ce:::benchmark_data_smithi121_44835_object43120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:23.549 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:09.429697+0000", 2024-04-19T02:16:23.549 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 14.091497252, 2024-04-19T02:16:23.549 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.017381669999999998, 2024-04-19T02:16:23.549 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:23.549 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:23.550 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:23.550 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:23.550 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:23.550 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 43121 2024-04-19T02:16:23.550 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.550 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:23.550 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.550 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:23.550 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.429697+0000", 2024-04-19T02:16:23.550 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.550 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.550 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.550 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:23.550 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.429697+0000", 2024-04-19T02:16:23.551 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.551 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.551 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.551 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:23.551 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.429697+0000", 2024-04-19T02:16:23.551 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:23.551 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.551 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.551 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:23.551 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.429798+0000", 2024-04-19T02:16:23.551 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000101228 2024-04-19T02:16:23.551 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.551 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.551 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:23.551 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.429808+0000", 2024-04-19T02:16:23.552 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.9080000000000007e-06 2024-04-19T02:16:23.552 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.552 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.552 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:23.552 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.429814+0000", 2024-04-19T02:16:23.552 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.7580000000000003e-06 2024-04-19T02:16:23.552 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.552 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.552 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:23.552 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.431378+0000", 2024-04-19T02:16:23.552 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0015631919999999999 2024-04-19T02:16:23.552 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.552 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.552 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:23.552 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.431471+0000", 2024-04-19T02:16:23.553 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.3595000000000001e-05 2024-04-19T02:16:23.553 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.553 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.553 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:23.553 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.431591+0000", 2024-04-19T02:16:23.553 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000119485 2024-04-19T02:16:23.553 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.553 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.553 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:23.553 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.435643+0000", 2024-04-19T02:16:23.553 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0040522500000000003 2024-04-19T02:16:23.553 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.553 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.553 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:23.553 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.447020+0000", 2024-04-19T02:16:23.554 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.011377152 2024-04-19T02:16:23.554 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.554 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.554 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:23.554 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.447054+0000", 2024-04-19T02:16:23.554 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.3558e-05 2024-04-19T02:16:23.554 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.554 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.554 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:23.554 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.447079+0000", 2024-04-19T02:16:23.554 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.5293999999999999e-05 2024-04-19T02:16:23.554 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.554 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:23.554 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.555 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.555 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.555 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:43692 5.3 5:c384a549:::benchmark_data_smithi121_44835_object43691:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:23.555 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:09.660580+0000", 2024-04-19T02:16:23.555 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 13.860614312999999, 2024-04-19T02:16:23.555 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.017860674999999999, 2024-04-19T02:16:23.555 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:23.555 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:23.555 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:23.555 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:23.555 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:23.555 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 43692 2024-04-19T02:16:23.555 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.555 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:23.555 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.556 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:23.556 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.660580+0000", 2024-04-19T02:16:23.556 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.556 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.556 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.556 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:23.556 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.660580+0000", 2024-04-19T02:16:23.556 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.556 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.556 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.556 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:23.556 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.660580+0000", 2024-04-19T02:16:23.556 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:23.556 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.556 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.557 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:23.557 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.660665+0000", 2024-04-19T02:16:23.557 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.5135000000000004e-05 2024-04-19T02:16:23.557 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.557 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.557 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:23.557 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.660677+0000", 2024-04-19T02:16:23.557 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.2743e-05 2024-04-19T02:16:23.557 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.557 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.557 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:23.557 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.660684+0000", 2024-04-19T02:16:23.557 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.8040000000000004e-06 2024-04-19T02:16:23.557 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.557 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.557 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:23.558 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.665455+0000", 2024-04-19T02:16:23.558 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0047704419999999997 2024-04-19T02:16:23.558 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.558 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.558 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:23.558 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.665546+0000", 2024-04-19T02:16:23.558 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.1330999999999997e-05 2024-04-19T02:16:23.558 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.558 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.558 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:23.558 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.665632+0000", 2024-04-19T02:16:23.558 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.5995999999999995e-05 2024-04-19T02:16:23.558 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.558 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.558 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:23.559 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.670521+0000", 2024-04-19T02:16:23.559 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0048892299999999996 2024-04-19T02:16:23.559 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.559 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.559 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:23.559 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.678370+0000", 2024-04-19T02:16:23.559 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0078485880000000001 2024-04-19T02:16:23.559 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.559 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.559 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:23.559 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.678409+0000", 2024-04-19T02:16:23.559 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.9511000000000002e-05 2024-04-19T02:16:23.559 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.559 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.559 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:23.560 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:09.678441+0000", 2024-04-19T02:16:23.560 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.1615999999999997e-05 2024-04-19T02:16:23.560 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.560 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:23.560 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.560 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.560 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.560 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:52498 5.3 5:cd91eeff:::benchmark_data_smithi121_44835_object52497:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T02:16:23.560 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:13.338526+0000", 2024-04-19T02:16:23.560 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 10.182668635000001, 2024-04-19T02:16:23.560 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016659635999999999, 2024-04-19T02:16:23.560 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:23.560 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:23.560 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:23.560 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:23.561 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:23.561 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 52498 2024-04-19T02:16:23.561 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.561 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:23.561 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.561 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:23.561 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:13.338526+0000", 2024-04-19T02:16:23.561 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.561 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.561 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.561 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:23.561 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:13.338526+0000", 2024-04-19T02:16:23.561 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.561 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.561 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.562 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:23.562 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:13.338525+0000", 2024-04-19T02:16:23.562 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:23.562 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.562 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.562 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:23.562 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:13.338581+0000", 2024-04-19T02:16:23.562 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.5986999999999998e-05 2024-04-19T02:16:23.562 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.562 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.562 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:23.562 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:13.338590+0000", 2024-04-19T02:16:23.562 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.3950000000000001e-06 2024-04-19T02:16:23.562 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.563 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.563 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:23.563 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:13.338595+0000", 2024-04-19T02:16:23.563 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.0080000000000002e-06 2024-04-19T02:16:23.563 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.563 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.563 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:23.563 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:13.341530+0000", 2024-04-19T02:16:23.563 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0029350729999999998 2024-04-19T02:16:23.563 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.563 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.563 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:23.563 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:13.341693+0000", 2024-04-19T02:16:23.563 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000163005 2024-04-19T02:16:23.563 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.564 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.564 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:23.564 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:13.341862+0000", 2024-04-19T02:16:23.564 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00016903600000000001 2024-04-19T02:16:23.564 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.564 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.564 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:23.564 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:13.346110+0000", 2024-04-19T02:16:23.564 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0042477089999999997 2024-04-19T02:16:23.564 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.564 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.564 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:23.564 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:13.355104+0000", 2024-04-19T02:16:23.564 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0089941959999999994 2024-04-19T02:16:23.564 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.565 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.565 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:23.565 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:13.355149+0000", 2024-04-19T02:16:23.565 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.5726999999999998e-05 2024-04-19T02:16:23.565 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.565 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.565 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:23.565 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:13.355186+0000", 2024-04-19T02:16:23.565 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6059999999999997e-05 2024-04-19T02:16:23.565 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.565 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:23.565 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.565 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.565 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.565 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:60906 5.c 5:3e19a5a3:::benchmark_data_smithi121_44835_object60905:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:23.566 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:17.043489+0000", 2024-04-19T02:16:23.566 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 6.4777057359999999, 2024-04-19T02:16:23.566 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.017397276999999999, 2024-04-19T02:16:23.566 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:23.566 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:23.566 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:23.566 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:23.566 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:23.566 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 60906 2024-04-19T02:16:23.566 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.566 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:23.566 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.566 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:23.566 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.043489+0000", 2024-04-19T02:16:23.567 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.567 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.567 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.567 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:23.567 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.043489+0000", 2024-04-19T02:16:23.567 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.567 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.567 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.567 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:23.567 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.043488+0000", 2024-04-19T02:16:23.567 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:23.567 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.567 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.567 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:23.567 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.043565+0000", 2024-04-19T02:16:23.568 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.7255999999999994e-05 2024-04-19T02:16:23.568 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.568 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.568 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:23.568 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.043574+0000", 2024-04-19T02:16:23.568 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.8640000000000002e-06 2024-04-19T02:16:23.568 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.568 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.568 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:23.568 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.043581+0000", 2024-04-19T02:16:23.568 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.374e-06 2024-04-19T02:16:23.568 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.568 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.568 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:23.569 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.052963+0000", 2024-04-19T02:16:23.569 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.009381113 2024-04-19T02:16:23.569 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.569 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.569 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:23.569 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.053086+0000", 2024-04-19T02:16:23.569 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012339600000000001 2024-04-19T02:16:23.569 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.569 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.569 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:23.569 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.053212+0000", 2024-04-19T02:16:23.569 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012636200000000001 2024-04-19T02:16:23.569 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.569 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.569 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:23.570 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.055950+0000", 2024-04-19T02:16:23.570 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0027377270000000001 2024-04-19T02:16:23.570 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.570 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.570 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:23.570 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.060804+0000", 2024-04-19T02:16:23.570 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0048543049999999997 2024-04-19T02:16:23.570 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.570 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.570 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:23.570 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.060858+0000", 2024-04-19T02:16:23.570 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.3161000000000001e-05 2024-04-19T02:16:23.570 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.570 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.570 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:23.571 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.060886+0000", 2024-04-19T02:16:23.571 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.8518e-05 2024-04-19T02:16:23.571 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.571 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:23.571 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.571 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.571 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.571 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:61625 5.6 5:678616b4:::benchmark_data_smithi121_44835_object61624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:23.571 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:17.383317+0000", 2024-04-19T02:16:23.571 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 6.1378776439999996, 2024-04-19T02:16:23.571 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016750592000000002, 2024-04-19T02:16:23.571 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:23.571 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:23.571 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:23.571 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:23.572 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:23.572 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 61625 2024-04-19T02:16:23.572 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.572 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:23.572 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.572 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:23.572 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.383317+0000", 2024-04-19T02:16:23.572 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.572 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.572 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.572 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:23.572 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.383317+0000", 2024-04-19T02:16:23.572 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.572 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.572 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.573 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:23.573 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.383316+0000", 2024-04-19T02:16:23.573 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:23.573 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.573 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.573 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:23.573 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.383372+0000", 2024-04-19T02:16:23.573 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.5627999999999997e-05 2024-04-19T02:16:23.573 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.573 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.573 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:23.573 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.383383+0000", 2024-04-19T02:16:23.573 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0647e-05 2024-04-19T02:16:23.573 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.573 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.574 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:23.574 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.383390+0000", 2024-04-19T02:16:23.574 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.9349999999999997e-06 2024-04-19T02:16:23.574 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.574 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.574 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:23.574 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.385707+0000", 2024-04-19T02:16:23.574 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0023169839999999998 2024-04-19T02:16:23.574 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.574 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.574 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:23.574 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.385838+0000", 2024-04-19T02:16:23.574 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00013168899999999999 2024-04-19T02:16:23.574 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.574 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.575 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:23.575 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.385987+0000", 2024-04-19T02:16:23.575 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000149083 2024-04-19T02:16:23.575 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.575 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.575 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:23.575 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.391405+0000", 2024-04-19T02:16:23.575 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0054181239999999999 2024-04-19T02:16:23.575 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.575 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.575 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:23.575 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.399987+0000", 2024-04-19T02:16:23.575 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0085818230000000006 2024-04-19T02:16:23.575 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.576 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.576 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:23.576 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.400032+0000", 2024-04-19T02:16:23.576 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.4551000000000001e-05 2024-04-19T02:16:23.576 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.576 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.576 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:23.576 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.400067+0000", 2024-04-19T02:16:23.576 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.5698999999999998e-05 2024-04-19T02:16:23.576 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.576 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:23.576 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.576 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.576 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.576 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:61670 5.3 5:c5549fc1:::benchmark_data_smithi121_44835_object61669:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:23.576 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:17.409188+0000", 2024-04-19T02:16:23.577 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 6.1120063350000002, 2024-04-19T02:16:23.577 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.01869871, 2024-04-19T02:16:23.577 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:23.577 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:23.577 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:23.577 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:23.577 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:23.577 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 61670 2024-04-19T02:16:23.577 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.577 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:23.577 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.577 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:23.577 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409188+0000", 2024-04-19T02:16:23.577 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.578 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.578 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.578 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:23.578 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409188+0000", 2024-04-19T02:16:23.578 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.578 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.578 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.578 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:23.578 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409188+0000", 2024-04-19T02:16:23.578 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:23.578 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.578 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.578 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:23.578 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409220+0000", 2024-04-19T02:16:23.578 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.2746999999999997e-05 2024-04-19T02:16:23.579 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.579 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.579 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:23.579 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409232+0000", 2024-04-19T02:16:23.579 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.1430999999999999e-05 2024-04-19T02:16:23.579 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.579 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.579 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:23.579 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409238+0000", 2024-04-19T02:16:23.579 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.4160000000000001e-06 2024-04-19T02:16:23.579 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.579 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.579 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:23.579 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.414159+0000", 2024-04-19T02:16:23.579 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0049206850000000002 2024-04-19T02:16:23.580 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.580 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.580 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:23.580 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.414283+0000", 2024-04-19T02:16:23.580 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000124547 2024-04-19T02:16:23.580 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.580 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.580 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:23.580 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.414439+0000", 2024-04-19T02:16:23.580 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00015586699999999999 2024-04-19T02:16:23.580 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.580 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.580 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:23.580 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.421153+0000", 2024-04-19T02:16:23.580 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0067135229999999999 2024-04-19T02:16:23.581 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.581 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.581 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:23.581 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.427775+0000", 2024-04-19T02:16:23.581 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0066216640000000002 2024-04-19T02:16:23.581 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.581 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.581 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:23.581 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.427847+0000", 2024-04-19T02:16:23.581 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.2601000000000005e-05 2024-04-19T02:16:23.581 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.581 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.581 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:23.581 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.427887+0000", 2024-04-19T02:16:23.581 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.9789000000000001e-05 2024-04-19T02:16:23.582 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.582 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:23.582 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.582 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.582 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.582 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:61671 5.3 5:cab602a2:::benchmark_data_smithi121_44835_object61670:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:23.582 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:17.409258+0000", 2024-04-19T02:16:23.582 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 6.1119369470000002, 2024-04-19T02:16:23.582 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.01870983, 2024-04-19T02:16:23.582 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:23.582 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:23.582 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:23.582 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:23.582 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:23.583 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 61671 2024-04-19T02:16:23.583 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.583 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:23.583 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.583 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:23.583 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409258+0000", 2024-04-19T02:16:23.583 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.583 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.583 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.583 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:23.583 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409258+0000", 2024-04-19T02:16:23.583 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.583 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.583 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.584 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:23.584 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409257+0000", 2024-04-19T02:16:23.584 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:23.584 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.584 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.584 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:23.584 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409353+0000", 2024-04-19T02:16:23.584 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.6365000000000003e-05 2024-04-19T02:16:23.584 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.584 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.584 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:23.584 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409362+0000", 2024-04-19T02:16:23.584 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.4500000000000004e-06 2024-04-19T02:16:23.584 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.584 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.585 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:23.585 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409382+0000", 2024-04-19T02:16:23.585 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.9707e-05 2024-04-19T02:16:23.585 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.585 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.585 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:23.585 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.416070+0000", 2024-04-19T02:16:23.585 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0066881889999999998 2024-04-19T02:16:23.585 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.585 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.585 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:23.585 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.416176+0000", 2024-04-19T02:16:23.585 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00010598 2024-04-19T02:16:23.586 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.586 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.586 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:23.586 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.416271+0000", 2024-04-19T02:16:23.586 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.4846999999999995e-05 2024-04-19T02:16:23.586 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.586 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.586 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:23.586 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.421187+0000", 2024-04-19T02:16:23.586 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0049165210000000001 2024-04-19T02:16:23.586 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.586 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.586 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:23.586 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.427894+0000", 2024-04-19T02:16:23.587 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.006706844 2024-04-19T02:16:23.587 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.587 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.587 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:23.587 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.427939+0000", 2024-04-19T02:16:23.587 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.4676999999999999e-05 2024-04-19T02:16:23.587 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.587 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.587 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:23.587 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.427967+0000", 2024-04-19T02:16:23.587 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.8770999999999999e-05 2024-04-19T02:16:23.587 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.587 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:23.587 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.587 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.588 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.588 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:61686 5.3 5:c9b3b45c:::benchmark_data_smithi121_44835_object61685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:23.588 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:17.415600+0000", 2024-04-19T02:16:23.588 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 6.1055942679999999, 2024-04-19T02:16:23.588 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.017118667000000001, 2024-04-19T02:16:23.588 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:23.588 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:23.588 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:23.588 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:23.588 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:23.588 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 61686 2024-04-19T02:16:23.588 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.588 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:23.588 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.589 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:23.589 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.415600+0000", 2024-04-19T02:16:23.589 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.589 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.589 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.589 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:23.589 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.415600+0000", 2024-04-19T02:16:23.589 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.589 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.589 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.589 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:23.589 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.415600+0000", 2024-04-19T02:16:23.589 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:23.589 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.589 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.590 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:23.590 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.415640+0000", 2024-04-19T02:16:23.590 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.0173999999999999e-05 2024-04-19T02:16:23.590 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.590 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.590 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:23.590 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.415648+0000", 2024-04-19T02:16:23.590 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.1650000000000006e-06 2024-04-19T02:16:23.590 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.590 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.590 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:23.590 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.415654+0000", 2024-04-19T02:16:23.590 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.5990000000000001e-06 2024-04-19T02:16:23.590 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.591 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.591 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:23.591 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.423743+0000", 2024-04-19T02:16:23.591 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0080896860000000004 2024-04-19T02:16:23.591 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.591 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.591 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:23.591 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.423861+0000", 2024-04-19T02:16:23.591 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000117761 2024-04-19T02:16:23.591 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.591 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.591 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:23.591 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.423994+0000", 2024-04-19T02:16:23.591 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000133079 2024-04-19T02:16:23.591 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.591 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.592 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:23.592 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.425869+0000", 2024-04-19T02:16:23.592 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.001875215 2024-04-19T02:16:23.592 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.592 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.592 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:23.592 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.432580+0000", 2024-04-19T02:16:23.592 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0067104010000000004 2024-04-19T02:16:23.592 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.592 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.592 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:23.592 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.432636+0000", 2024-04-19T02:16:23.592 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.6026999999999997e-05 2024-04-19T02:16:23.592 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.592 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.593 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:23.593 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.432719+0000", 2024-04-19T02:16:23.593 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.3049999999999999e-05 2024-04-19T02:16:23.593 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.593 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:23.593 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.593 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.593 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.593 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:61815 5.c 5:3ca8a794:::benchmark_data_smithi121_44835_object61814:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:23.593 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:17.482110+0000", 2024-04-19T02:16:23.594 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 6.0390844220000002, 2024-04-19T02:16:23.594 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.021577559999999999, 2024-04-19T02:16:23.594 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:23.594 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:23.594 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:23.594 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:23.594 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:23.594 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 61815 2024-04-19T02:16:23.594 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.594 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:23.594 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.594 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:23.594 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482110+0000", 2024-04-19T02:16:23.594 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.594 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.595 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.595 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:23.595 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482110+0000", 2024-04-19T02:16:23.595 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.595 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.595 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.595 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:23.595 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482109+0000", 2024-04-19T02:16:23.595 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:23.595 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.595 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.595 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:23.595 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482197+0000", 2024-04-19T02:16:23.595 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.7405999999999996e-05 2024-04-19T02:16:23.596 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.596 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.596 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:23.596 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482206+0000", 2024-04-19T02:16:23.596 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.0010000000000007e-06 2024-04-19T02:16:23.596 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.596 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.596 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:23.596 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482211+0000", 2024-04-19T02:16:23.596 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.4569999999999996e-06 2024-04-19T02:16:23.596 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.596 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.597 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:23.597 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.489465+0000", 2024-04-19T02:16:23.597 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.007253776 2024-04-19T02:16:23.597 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.597 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.597 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:23.597 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.489582+0000", 2024-04-19T02:16:23.597 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00011669500000000001 2024-04-19T02:16:23.597 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.597 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.597 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:23.598 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.489684+0000", 2024-04-19T02:16:23.598 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000102533 2024-04-19T02:16:23.598 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.598 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.598 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:23.598 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.491836+0000", 2024-04-19T02:16:23.598 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0021516759999999999 2024-04-19T02:16:23.598 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.598 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.598 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:23.598 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503615+0000", 2024-04-19T02:16:23.598 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.011778906 2024-04-19T02:16:23.599 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.599 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.599 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:23.599 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503652+0000", 2024-04-19T02:16:23.599 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6622999999999998e-05 2024-04-19T02:16:23.599 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.599 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.599 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:23.599 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503688+0000", 2024-04-19T02:16:23.599 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6127000000000002e-05 2024-04-19T02:16:23.599 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.599 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:23.599 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.600 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.600 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.600 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:61821 5.c 5:3f8142ef:::benchmark_data_smithi121_44835_object61820:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:23.600 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:17.484515+0000", 2024-04-19T02:16:23.600 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 6.0366795870000001, 2024-04-19T02:16:23.600 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.019268073, 2024-04-19T02:16:23.600 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:23.600 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:23.600 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:23.600 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:23.600 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:23.600 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 61821 2024-04-19T02:16:23.601 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.601 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:23.601 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.601 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:23.601 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.484515+0000", 2024-04-19T02:16:23.601 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.601 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.601 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.601 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:23.601 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.484515+0000", 2024-04-19T02:16:23.601 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.601 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.601 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.602 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:23.602 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.484514+0000", 2024-04-19T02:16:23.602 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:23.602 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.602 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.602 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:23.602 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.484612+0000", 2024-04-19T02:16:23.602 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.7962999999999997e-05 2024-04-19T02:16:23.602 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.602 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.602 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:23.602 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.484623+0000", 2024-04-19T02:16:23.602 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.1229999999999999e-05 2024-04-19T02:16:23.603 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.603 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.603 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:23.603 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.484629+0000", 2024-04-19T02:16:23.603 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.9549999999999997e-06 2024-04-19T02:16:23.603 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.603 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.603 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:23.603 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.491863+0000", 2024-04-19T02:16:23.603 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.007234178 2024-04-19T02:16:23.603 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.604 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.604 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:23.604 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.491976+0000", 2024-04-19T02:16:23.604 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000112613 2024-04-19T02:16:23.604 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.604 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.604 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:23.604 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.492073+0000", 2024-04-19T02:16:23.604 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.6961999999999998e-05 2024-04-19T02:16:23.604 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.604 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.605 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:23.605 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.496898+0000", 2024-04-19T02:16:23.605 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0048245299999999996 2024-04-19T02:16:23.605 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.605 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.605 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:23.605 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503695+0000", 2024-04-19T02:16:23.605 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0067978129999999998 2024-04-19T02:16:23.605 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.605 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.605 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:23.605 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503748+0000", 2024-04-19T02:16:23.605 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.2247000000000003e-05 2024-04-19T02:16:23.606 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.606 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.606 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:23.606 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503783+0000", 2024-04-19T02:16:23.606 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.5389999999999998e-05 2024-04-19T02:16:23.606 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.606 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:23.606 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.606 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.606 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.606 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:62556 5.5 5:a64b81e3:::benchmark_data_smithi121_44835_object62555:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:23.606 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:17.828374+0000", 2024-04-19T02:16:23.606 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 5.6928200589999998, 2024-04-19T02:16:23.607 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.017677288999999999, 2024-04-19T02:16:23.607 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:23.607 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:23.607 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:23.607 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:23.607 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:23.607 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 62556 2024-04-19T02:16:23.607 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.607 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:23.607 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.607 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:23.607 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.828374+0000", 2024-04-19T02:16:23.607 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.608 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.608 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.608 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:23.608 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.828374+0000", 2024-04-19T02:16:23.608 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.608 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.608 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.608 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:23.608 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.828374+0000", 2024-04-19T02:16:23.608 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:23.608 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.608 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.608 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:23.609 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.828446+0000", 2024-04-19T02:16:23.609 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.2627999999999996e-05 2024-04-19T02:16:23.609 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.609 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.609 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:23.609 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.828456+0000", 2024-04-19T02:16:23.609 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.9760000000000007e-06 2024-04-19T02:16:23.609 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.609 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.609 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:23.609 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.828463+0000", 2024-04-19T02:16:23.609 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.2099999999999996e-06 2024-04-19T02:16:23.609 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.610 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.610 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:23.610 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.829519+0000", 2024-04-19T02:16:23.610 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0010554620000000001 2024-04-19T02:16:23.610 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.610 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.610 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:23.610 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.829668+0000", 2024-04-19T02:16:23.610 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00014902000000000001 2024-04-19T02:16:23.610 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.610 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.610 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:23.611 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.829777+0000", 2024-04-19T02:16:23.611 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00010912 2024-04-19T02:16:23.611 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.611 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.611 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:23.611 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.836242+0000", 2024-04-19T02:16:23.611 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0064650020000000001 2024-04-19T02:16:23.611 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.611 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.611 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:23.611 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.845967+0000", 2024-04-19T02:16:23.611 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0097252299999999996 2024-04-19T02:16:23.611 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.612 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.612 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:23.612 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.846014+0000", 2024-04-19T02:16:23.612 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.7215000000000001e-05 2024-04-19T02:16:23.612 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.612 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.612 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:23.612 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.846052+0000", 2024-04-19T02:16:23.612 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.7401000000000003e-05 2024-04-19T02:16:23.612 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.612 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:23.612 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.612 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.613 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.613 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:64937 5.3 5:c3b9af9e:::benchmark_data_smithi121_44835_object64936:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:23.613 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:18.906703+0000", 2024-04-19T02:16:23.613 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4.6144913089999999, 2024-04-19T02:16:23.613 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016748455999999998, 2024-04-19T02:16:23.613 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:23.613 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:23.613 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:23.613 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:23.613 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:23.613 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 64937 2024-04-19T02:16:23.613 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.613 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:23.613 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.614 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:23.614 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:18.906703+0000", 2024-04-19T02:16:23.614 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.614 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.614 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.614 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:23.614 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:18.906703+0000", 2024-04-19T02:16:23.614 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.614 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.614 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.615 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:23.615 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:18.906703+0000", 2024-04-19T02:16:23.615 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:23.615 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.615 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.615 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:23.615 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:18.906817+0000", 2024-04-19T02:16:23.615 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00011491499999999999 2024-04-19T02:16:23.615 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.615 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.615 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:23.615 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:18.906825+0000", 2024-04-19T02:16:23.616 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.9549999999999992e-06 2024-04-19T02:16:23.616 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.616 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.616 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:23.616 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:18.906831+0000", 2024-04-19T02:16:23.616 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.6860000000000003e-06 2024-04-19T02:16:23.616 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.616 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.616 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:23.616 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:18.910580+0000", 2024-04-19T02:16:23.616 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0037491870000000002 2024-04-19T02:16:23.616 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.616 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.617 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:23.617 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:18.910682+0000", 2024-04-19T02:16:23.617 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000101691 2024-04-19T02:16:23.617 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.617 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.617 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:23.617 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:18.910773+0000", 2024-04-19T02:16:23.617 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.0913000000000002e-05 2024-04-19T02:16:23.617 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.617 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.617 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:23.617 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:18.914162+0000", 2024-04-19T02:16:23.617 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0033893629999999998 2024-04-19T02:16:23.618 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.618 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.618 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:23.618 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:18.923398+0000", 2024-04-19T02:16:23.618 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0092357180000000004 2024-04-19T02:16:23.618 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.618 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.618 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:23.618 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:18.923429+0000", 2024-04-19T02:16:23.618 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.0738999999999998e-05 2024-04-19T02:16:23.618 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.618 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.619 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:23.619 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:18.923452+0000", 2024-04-19T02:16:23.619 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.2942000000000002e-05 2024-04-19T02:16:23.619 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.619 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:23.619 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.619 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.619 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.619 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:64947 5.5 5:aee16a88:::benchmark_data_smithi121_44835_object64946:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:23.619 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:18.911746+0000", 2024-04-19T02:16:23.619 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4.60944865, 2024-04-19T02:16:23.619 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016543809, 2024-04-19T02:16:23.619 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:23.620 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:23.620 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:23.620 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:23.620 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:23.620 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 64947 2024-04-19T02:16:23.620 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.620 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:23.620 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.620 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:23.620 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:18.911746+0000", 2024-04-19T02:16:23.620 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.620 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.621 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.621 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:23.621 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:18.911746+0000", 2024-04-19T02:16:23.621 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.621 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.621 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.621 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:23.621 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:18.911745+0000", 2024-04-19T02:16:23.621 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:23.621 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.621 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.621 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:23.622 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:18.911805+0000", 2024-04-19T02:16:23.622 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.9778999999999998e-05 2024-04-19T02:16:23.622 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.622 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.622 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:23.622 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:18.911816+0000", 2024-04-19T02:16:23.622 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0879e-05 2024-04-19T02:16:23.622 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.622 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.622 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:23.622 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:18.911823+0000", 2024-04-19T02:16:23.622 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.8340000000000001e-06 2024-04-19T02:16:23.623 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.623 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.623 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:23.623 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:18.911850+0000", 2024-04-19T02:16:23.623 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.7039999999999999e-05 2024-04-19T02:16:23.623 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.623 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.623 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:23.623 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:18.911953+0000", 2024-04-19T02:16:23.623 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00010302999999999999 2024-04-19T02:16:23.623 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.623 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.623 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:23.624 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:18.912048+0000", 2024-04-19T02:16:23.624 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.4914000000000006e-05 2024-04-19T02:16:23.624 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.624 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.624 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:23.624 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:18.916447+0000", 2024-04-19T02:16:23.624 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0043994220000000001 2024-04-19T02:16:23.624 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.624 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.624 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:23.624 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:18.928230+0000", 2024-04-19T02:16:23.624 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.011783365000000001 2024-04-19T02:16:23.624 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.625 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.625 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:23.625 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:18.928263+0000", 2024-04-19T02:16:23.625 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.2988999999999999e-05 2024-04-19T02:16:23.625 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.625 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.625 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:23.625 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:18.928290+0000", 2024-04-19T02:16:23.625 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.641e-05 2024-04-19T02:16:23.625 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.625 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:23.625 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.626 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.626 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.626 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:65702 5.0 e26/16 5:0e2d52f5:::benchmark_data_smithi121_44835_object65701:head v 26'4014, mlcod=26'4011)", 2024-04-19T02:16:23.626 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:19.259434+0000", 2024-04-19T02:16:23.626 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4.2617609830000003, 2024-04-19T02:16:23.626 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.017340475000000001, 2024-04-19T02:16:23.626 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:23.626 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:23.626 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:23.626 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.626 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:23.626 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.259434+0000", 2024-04-19T02:16:23.627 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.627 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.627 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.627 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:23.627 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.259434+0000", 2024-04-19T02:16:23.627 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.627 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.627 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.627 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:23.627 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.259433+0000", 2024-04-19T02:16:23.627 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:23.627 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.628 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.628 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:23.628 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.259491+0000", 2024-04-19T02:16:23.628 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.8285999999999997e-05 2024-04-19T02:16:23.628 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.628 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.628 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:23.628 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.259502+0000", 2024-04-19T02:16:23.628 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0429e-05 2024-04-19T02:16:23.628 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.628 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.628 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:23.629 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.259508+0000", 2024-04-19T02:16:23.629 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.8880000000000002e-06 2024-04-19T02:16:23.629 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.629 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.629 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:23.629 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.261885+0000", 2024-04-19T02:16:23.629 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.002377213 2024-04-19T02:16:23.629 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.629 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.629 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:23.629 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.261901+0000", 2024-04-19T02:16:23.629 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.5891000000000001e-05 2024-04-19T02:16:23.630 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.630 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.630 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:23.630 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.276735+0000", 2024-04-19T02:16:23.630 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.014834003 2024-04-19T02:16:23.630 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.630 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.630 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:23.630 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:19.276774+0000", 2024-04-19T02:16:23.630 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.9286000000000003e-05 2024-04-19T02:16:23.630 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.630 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:23.631 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.631 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.631 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.631 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:71422 5.2 e27/16 5:420ecdae:::benchmark_data_smithi121_44835_object71421:head v 27'4488, mlcod=27'4486)", 2024-04-19T02:16:23.631 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:21.901921+0000", 2024-04-19T02:16:23.631 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 1.6192734020000001, 2024-04-19T02:16:23.631 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.017258334, 2024-04-19T02:16:23.631 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:23.631 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:23.631 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:23.631 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.631 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:23.632 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:21.901921+0000", 2024-04-19T02:16:23.632 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.632 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.632 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.632 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:23.632 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:21.901921+0000", 2024-04-19T02:16:23.632 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:23.632 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.632 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.632 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:23.632 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:21.901921+0000", 2024-04-19T02:16:23.632 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:23.632 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.633 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.633 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:23.633 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:21.901981+0000", 2024-04-19T02:16:23.633 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.0235000000000002e-05 2024-04-19T02:16:23.633 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.633 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.633 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:23.633 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:21.901988+0000", 2024-04-19T02:16:23.633 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.5020000000000003e-06 2024-04-19T02:16:23.633 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.633 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.633 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:23.634 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:21.901993+0000", 2024-04-19T02:16:23.634 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.3579999999999996e-06 2024-04-19T02:16:23.634 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.634 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.634 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:23.634 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:21.902024+0000", 2024-04-19T02:16:23.634 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.1158000000000002e-05 2024-04-19T02:16:23.634 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.634 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.634 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:23.634 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:21.902043+0000", 2024-04-19T02:16:23.634 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.8892000000000001e-05 2024-04-19T02:16:23.634 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.635 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.635 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:23.635 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:21.919137+0000", 2024-04-19T02:16:23.635 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.017094572999999998 2024-04-19T02:16:23.635 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:23.635 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:23.635 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:23.635 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:21.919179+0000", 2024-04-19T02:16:23.635 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.2163999999999998e-05 2024-04-19T02:16:23.635 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.635 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:23.635 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.635 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:23.636 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:23.636 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-04-19T02:16:23.636 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:16:23.638 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:23.637+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:23.638 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:16:23.738 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:23.737+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:23.780 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:16:23.781 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-04-19T02:16:23.781 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-04-19T02:16:23.781 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:16:23.790 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:16:23.791 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:16:23.811 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:16:23.829 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2: {} 2024-04-19T02:16:23.831 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:16:23.831 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:16:23.831 INFO:teuthology.orchestra.run.smithi121.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:16:23.839 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:23.839+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:23.917 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:23.917 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:23.926 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:16:23.940 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:23.940+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:24.027 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 29 16 71959 71943 155.037 0 - 0.0060253 2024-04-19T02:16:24.041 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:24.041+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:24.052 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:24.052 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:24.063 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:16:24.141 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:24.142+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:24.238 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:24.238 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:24.242 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:24.242+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:24.252 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:16:24.343 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:24.344+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:24.444 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:24.445+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:24.463 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:24.463 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:24.477 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:16:24.545 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:24.545+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:24.646 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:24.647+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:24.693 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:24.693 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:24.708 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:16:24.746 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:24.747+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:24.847 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:24.847+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:24.899 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:24.899 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:24.912 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:16:24.948 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:24.948+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:25.027 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 30 16 73828 73812 153.762 58.4062 0.00601883 0.00650062 2024-04-19T02:16:25.048 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:25.048+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:25.076 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T02:16:25.102 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:25.103 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:25.120 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:16:25.160 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:25.160+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:25.250 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:25.251+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:25.351 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:25.351 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:25.351 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:25.351+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:25.365 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:16:25.454 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:25.452+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:25.534 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:25.534 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:25.549 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:16:25.592 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:25.593+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:25.654 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:25.653+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:25.721 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:25.721 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:25.735 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:16:25.755 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:25.755+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:25.843 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:16:25.855 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:25.856+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:25.947 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:25.947 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:25.956 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:25.957+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:25.961 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:16:25.994 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:16:26.014 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:16:26.027 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 31 16 75942 75926 153.064 132.125 0.00683725 0.00653008 2024-04-19T02:16:26.035 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2: {} 2024-04-19T02:16:26.036 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:16:26.036 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:16:26.036 INFO:teuthology.orchestra.run.smithi121.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:16:26.057 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:26.056+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:26.081 INFO:teuthology.orchestra.run.smithi121.stderr:nodeep-scrub is unset 2024-04-19T02:16:26.140 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:16:26.140 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:16:26.140 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.140 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:76171 5.0 5:0f23c6e1:::benchmark_data_smithi121_44835_object76170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:26.140 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:26.136602+0000", 2024-04-19T02:16:26.140 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0032720520000000001, 2024-04-19T02:16:26.140 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0033019709999999999, 2024-04-19T02:16:26.140 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:26.140 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:26.140 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:26.140 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:26.140 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:26.141 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 76171 2024-04-19T02:16:26.141 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.141 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:26.141 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.141 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:26.141 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.136602+0000", 2024-04-19T02:16:26.141 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.141 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.141 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.141 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:26.141 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.136602+0000", 2024-04-19T02:16:26.141 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.142 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.142 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.142 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:26.142 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.136601+0000", 2024-04-19T02:16:26.142 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:26.142 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.142 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.143 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:26.143 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.136631+0000", 2024-04-19T02:16:26.143 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0222999999999998e-05 2024-04-19T02:16:26.143 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.143 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.143 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:26.143 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.136641+0000", 2024-04-19T02:16:26.143 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0151e-05 2024-04-19T02:16:26.143 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.144 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.144 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:26.144 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.136648+0000", 2024-04-19T02:16:26.144 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5429999999999999e-06 2024-04-19T02:16:26.144 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.144 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.144 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:26.144 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.136679+0000", 2024-04-19T02:16:26.145 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1516000000000001e-05 2024-04-19T02:16:26.145 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.145 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.145 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:26.145 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.136784+0000", 2024-04-19T02:16:26.145 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000104831 2024-04-19T02:16:26.145 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.145 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.146 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:26.146 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.136868+0000", 2024-04-19T02:16:26.146 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.3752999999999996e-05 2024-04-19T02:16:26.146 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.146 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.146 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:26.147 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.138999+0000", 2024-04-19T02:16:26.147 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0021314149999999998 2024-04-19T02:16:26.147 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.147 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:26.147 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.147 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.147 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.148 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:76174 5.8 5:105fe2f0:::benchmark_data_smithi121_44835_object76173:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:26.148 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:26.138279+0000", 2024-04-19T02:16:26.148 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0015944069999999999, 2024-04-19T02:16:26.148 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001732045, 2024-04-19T02:16:26.148 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:26.149 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:26.149 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:26.149 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:26.149 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:26.149 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 76174 2024-04-19T02:16:26.149 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.150 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:26.150 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.150 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:26.150 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.138279+0000", 2024-04-19T02:16:26.150 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.150 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.151 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.151 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:26.151 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.138279+0000", 2024-04-19T02:16:26.151 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.151 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.151 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.152 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:26.152 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.138278+0000", 2024-04-19T02:16:26.152 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:26.152 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.152 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.152 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:26.153 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.138329+0000", 2024-04-19T02:16:26.153 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0460000000000001e-05 2024-04-19T02:16:26.153 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.153 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.153 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:26.153 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.138342+0000", 2024-04-19T02:16:26.155 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2729e-05 2024-04-19T02:16:26.156 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.156 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.156 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:26.156 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.138351+0000", 2024-04-19T02:16:26.156 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.4399999999999994e-06 2024-04-19T02:16:26.156 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.156 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.156 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:26.156 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.138382+0000", 2024-04-19T02:16:26.156 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0651999999999997e-05 2024-04-19T02:16:26.156 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.156 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.156 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:26.157 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.138470+0000", 2024-04-19T02:16:26.157 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.8731000000000001e-05 2024-04-19T02:16:26.157 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.157 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.157 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:26.157 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.138602+0000", 2024-04-19T02:16:26.157 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013184000000000001 2024-04-19T02:16:26.158 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.158 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:26.158 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.158 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.158 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.158 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:76175 5.4 5.a5547d34 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:26.158 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:26.138489+0000", 2024-04-19T02:16:26.158 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0013842870000000001, 2024-04-19T02:16:26.158 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001603511, 2024-04-19T02:16:26.158 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:26.158 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "queued for pg", 2024-04-19T02:16:26.158 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:26.158 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:26.158 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:26.159 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 76175 2024-04-19T02:16:26.159 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.159 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:26.159 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.159 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:26.159 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.138489+0000", 2024-04-19T02:16:26.159 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.159 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.159 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.159 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:26.159 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.138489+0000", 2024-04-19T02:16:26.159 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.159 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.159 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.159 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:26.159 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.138489+0000", 2024-04-19T02:16:26.160 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:26.160 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.160 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.160 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:26.160 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.138560+0000", 2024-04-19T02:16:26.160 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1457000000000004e-05 2024-04-19T02:16:26.160 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.160 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.160 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:26.160 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.138570+0000", 2024-04-19T02:16:26.160 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.5899999999999997e-06 2024-04-19T02:16:26.160 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.160 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.160 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:26.161 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.138577+0000", 2024-04-19T02:16:26.161 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1840000000000002e-06 2024-04-19T02:16:26.161 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.161 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:26.161 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.161 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.161 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.161 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop_reply(client.4549.0:76165 5.4 e31/16)", 2024-04-19T02:16:26.161 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:26.140028+0000", 2024-04-19T02:16:26.161 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 4294967295.9998455, 2024-04-19T02:16:26.161 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000118866, 2024-04-19T02:16:26.161 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:26.161 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "queued for pg", 2024-04-19T02:16:26.161 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:26.161 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.162 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:26.162 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.140028+0000", 2024-04-19T02:16:26.162 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.162 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.162 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.162 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:26.162 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.140028+0000", 2024-04-19T02:16:26.162 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.162 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.162 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.162 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:26.162 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.140028+0000", 2024-04-19T02:16:26.162 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:26.163 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.163 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.163 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:26.163 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.140031+0000", 2024-04-19T02:16:26.163 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2770000000000001e-06 2024-04-19T02:16:26.163 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.163 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.163 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:26.163 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.140050+0000", 2024-04-19T02:16:26.163 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.8879999999999999e-05 2024-04-19T02:16:26.163 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.163 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.163 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:26.163 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.140056+0000", 2024-04-19T02:16:26.164 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.6030000000000004e-06 2024-04-19T02:16:26.164 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.164 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:26.164 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.164 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.164 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.164 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop_reply(client.4549.0:76168 5.4 e31/16)", 2024-04-19T02:16:26.164 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:26.140062+0000", 2024-04-19T02:16:26.164 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 4294967295.9998116, 2024-04-19T02:16:26.164 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013664499999999999, 2024-04-19T02:16:26.164 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:26.164 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "queued for pg", 2024-04-19T02:16:26.164 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:26.164 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.165 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:26.165 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.140062+0000", 2024-04-19T02:16:26.165 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.165 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.165 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.165 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:26.165 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.140062+0000", 2024-04-19T02:16:26.165 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.165 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.165 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.165 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:26.165 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.140062+0000", 2024-04-19T02:16:26.165 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967296 2024-04-19T02:16:26.165 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.166 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.166 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:26.166 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.140064+0000", 2024-04-19T02:16:26.166 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.759e-06 2024-04-19T02:16:26.166 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.166 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.166 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:26.166 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.140070+0000", 2024-04-19T02:16:26.166 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.8850000000000004e-06 2024-04-19T02:16:26.166 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.166 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.166 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:26.166 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.140073+0000", 2024-04-19T02:16:26.166 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.642e-06 2024-04-19T02:16:26.167 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.167 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:26.167 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.167 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.167 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.167 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:76176 5.1 e31/29 5:88edecbb:::benchmark_data_smithi121_44835_object76175:head v 31'4649, mlcod=31'4647)", 2024-04-19T02:16:26.167 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:26.140162+0000", 2024-04-19T02:16:26.167 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 4294967295.999712, 2024-04-19T02:16:26.167 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000102336, 2024-04-19T02:16:26.167 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:26.167 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:16:26.167 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:26.167 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.168 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:26.168 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.140162+0000", 2024-04-19T02:16:26.168 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.168 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.168 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.168 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:26.168 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.140162+0000", 2024-04-19T02:16:26.168 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.168 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.168 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.168 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:26.169 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.140161+0000", 2024-04-19T02:16:26.169 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:26.169 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.169 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.169 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:26.169 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.140166+0000", 2024-04-19T02:16:26.169 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.9880000000000004e-06 2024-04-19T02:16:26.169 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.169 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.169 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:26.169 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.140173+0000", 2024-04-19T02:16:26.169 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.99e-06 2024-04-19T02:16:26.169 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.169 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.170 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:26.170 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.140178+0000", 2024-04-19T02:16:26.170 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.4430000000000002e-06 2024-04-19T02:16:26.170 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.170 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.170 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:26.170 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.140217+0000", 2024-04-19T02:16:26.170 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8107e-05 2024-04-19T02:16:26.170 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.170 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.170 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:26.170 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.140241+0000", 2024-04-19T02:16:26.170 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4508999999999999e-05 2024-04-19T02:16:26.171 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.171 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:26.171 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.171 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.171 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.171 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:76158 5.8 5:1909012b:::benchmark_data_smithi121_44835_object76157:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:26.171 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:26.130131+0000", 2024-04-19T02:16:26.171 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0097426279999999997, 2024-04-19T02:16:26.171 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010206662, 2024-04-19T02:16:26.171 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:26.171 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:26.171 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:26.171 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:26.171 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:26.172 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 76158 2024-04-19T02:16:26.172 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.172 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:26.172 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.172 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:26.172 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.130131+0000", 2024-04-19T02:16:26.172 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.172 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.172 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.172 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:26.172 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.130131+0000", 2024-04-19T02:16:26.172 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.172 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.173 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.173 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:26.173 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.130131+0000", 2024-04-19T02:16:26.173 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:26.173 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.173 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.173 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:26.173 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.130171+0000", 2024-04-19T02:16:26.173 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0805e-05 2024-04-19T02:16:26.173 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.173 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.173 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:26.173 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.130177+0000", 2024-04-19T02:16:26.173 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.8819999999999998e-06 2024-04-19T02:16:26.174 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.174 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.174 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:26.174 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.130181+0000", 2024-04-19T02:16:26.174 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6679999999999999e-06 2024-04-19T02:16:26.174 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.174 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.174 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:26.174 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.131918+0000", 2024-04-19T02:16:26.174 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0017368869999999999 2024-04-19T02:16:26.174 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.174 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.174 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:26.174 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.132033+0000", 2024-04-19T02:16:26.175 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011543 2024-04-19T02:16:26.175 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.175 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.175 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:26.175 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.132192+0000", 2024-04-19T02:16:26.175 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00015865000000000001 2024-04-19T02:16:26.175 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.175 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.175 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:26.175 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.135700+0000", 2024-04-19T02:16:26.175 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0035082170000000001 2024-04-19T02:16:26.175 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.175 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:26.175 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.176 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.176 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.176 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:76165 5.4 5:2c7f17a9:::benchmark_data_smithi121_44835_object76164:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:26.176 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:26.133250+0000", 2024-04-19T02:16:26.176 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0066240910000000004, 2024-04-19T02:16:26.176 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0071762609999999998, 2024-04-19T02:16:26.176 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:26.176 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:26.176 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:26.176 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:26.176 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:26.176 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 76165 2024-04-19T02:16:26.176 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.176 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:26.177 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.177 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:26.177 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.133250+0000", 2024-04-19T02:16:26.177 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.177 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.177 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.177 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:26.177 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.133250+0000", 2024-04-19T02:16:26.177 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.177 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.177 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.177 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:26.177 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.133249+0000", 2024-04-19T02:16:26.177 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:26.177 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.178 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.178 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:26.178 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.133352+0000", 2024-04-19T02:16:26.178 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000103019 2024-04-19T02:16:26.178 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.178 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.178 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:26.178 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.133361+0000", 2024-04-19T02:16:26.178 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0680000000000003e-06 2024-04-19T02:16:26.178 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.178 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.178 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:26.179 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.133367+0000", 2024-04-19T02:16:26.179 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5440000000000004e-06 2024-04-19T02:16:26.179 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.179 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.179 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:26.179 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.133411+0000", 2024-04-19T02:16:26.179 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3800000000000001e-05 2024-04-19T02:16:26.179 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.179 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.179 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:26.179 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.133537+0000", 2024-04-19T02:16:26.179 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012553 2024-04-19T02:16:26.179 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.179 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.179 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:26.180 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.133682+0000", 2024-04-19T02:16:26.180 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014514500000000001 2024-04-19T02:16:26.180 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.180 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:26.180 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.180 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.180 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.180 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:76168 5.4 5:25291011:::benchmark_data_smithi121_44835_object76167:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:26.180 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:26.133379+0000", 2024-04-19T02:16:26.180 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0064944419999999996, 2024-04-19T02:16:26.180 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0071336400000000001, 2024-04-19T02:16:26.180 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:26.180 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:26.180 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:26.180 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:26.181 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:26.181 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 76168 2024-04-19T02:16:26.181 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.181 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:26.181 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.181 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:26.181 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.133379+0000", 2024-04-19T02:16:26.181 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.181 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.181 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.181 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:26.181 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.133379+0000", 2024-04-19T02:16:26.181 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.182 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.182 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.182 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:26.182 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.133379+0000", 2024-04-19T02:16:26.182 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:26.182 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.182 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.182 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:26.182 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.133405+0000", 2024-04-19T02:16:26.182 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.6278000000000001e-05 2024-04-19T02:16:26.182 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.182 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.182 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:26.182 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.133413+0000", 2024-04-19T02:16:26.183 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.7519999999999996e-06 2024-04-19T02:16:26.183 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.183 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.183 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:26.183 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.133419+0000", 2024-04-19T02:16:26.183 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.0510000000000002e-06 2024-04-19T02:16:26.183 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.183 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.183 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:26.183 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.135840+0000", 2024-04-19T02:16:26.183 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0024208810000000002 2024-04-19T02:16:26.183 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.183 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.183 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:26.183 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.135935+0000", 2024-04-19T02:16:26.184 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.5142999999999994e-05 2024-04-19T02:16:26.184 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.184 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.184 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:26.184 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.136038+0000", 2024-04-19T02:16:26.184 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000103111 2024-04-19T02:16:26.184 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.184 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:26.184 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.184 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.184 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.184 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:76169 5.4 5:2f7118b7:::benchmark_data_smithi121_44835_object76168:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:26.184 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:26.135440+0000", 2024-04-19T02:16:26.184 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0044339030000000003, 2024-04-19T02:16:26.185 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0051205620000000004, 2024-04-19T02:16:26.185 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:26.185 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:26.185 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:26.185 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:26.185 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:26.185 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 76169 2024-04-19T02:16:26.185 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.185 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:26.185 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.185 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:26.185 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.135440+0000", 2024-04-19T02:16:26.185 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.185 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.185 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.186 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:26.186 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.135440+0000", 2024-04-19T02:16:26.186 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.186 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.186 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.186 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:26.186 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.135438+0000", 2024-04-19T02:16:26.186 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:26.186 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.186 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.186 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:26.186 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.135484+0000", 2024-04-19T02:16:26.186 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.5290000000000002e-05 2024-04-19T02:16:26.186 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.186 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.187 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:26.187 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.135496+0000", 2024-04-19T02:16:26.187 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2716e-05 2024-04-19T02:16:26.187 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.187 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.187 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:26.187 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.135505+0000", 2024-04-19T02:16:26.187 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.3110000000000006e-06 2024-04-19T02:16:26.187 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.187 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.187 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:26.187 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.137778+0000", 2024-04-19T02:16:26.187 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0022733480000000001 2024-04-19T02:16:26.188 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.188 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.188 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:26.188 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.137901+0000", 2024-04-19T02:16:26.188 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012330500000000001 2024-04-19T02:16:26.188 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.188 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.188 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:26.188 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.138033+0000", 2024-04-19T02:16:26.188 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013191200000000001 2024-04-19T02:16:26.188 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.188 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:26.188 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.188 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.189 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.189 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:76170 5.4 5:2bf4697f:::benchmark_data_smithi121_44835_object76169:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:26.189 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:26.136455+0000", 2024-04-19T02:16:26.189 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0034186210000000002, 2024-04-19T02:16:26.189 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0041501300000000001, 2024-04-19T02:16:26.189 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:26.189 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:26.189 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:26.189 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:26.189 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:26.189 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 76170 2024-04-19T02:16:26.189 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.189 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:26.189 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.189 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:26.190 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.136455+0000", 2024-04-19T02:16:26.190 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.190 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.190 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.190 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:26.190 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.136455+0000", 2024-04-19T02:16:26.190 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.190 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.190 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.190 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:26.190 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.136454+0000", 2024-04-19T02:16:26.190 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:26.190 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.191 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.191 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:26.191 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.136565+0000", 2024-04-19T02:16:26.191 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000110878 2024-04-19T02:16:26.191 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.191 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.191 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:26.191 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.136578+0000", 2024-04-19T02:16:26.191 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.3353000000000001e-05 2024-04-19T02:16:26.191 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.191 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.191 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:26.191 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.136588+0000", 2024-04-19T02:16:26.191 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.5170000000000005e-06 2024-04-19T02:16:26.191 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.192 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.192 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:26.192 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.139775+0000", 2024-04-19T02:16:26.192 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0031874640000000001 2024-04-19T02:16:26.192 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.192 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.192 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:26.192 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.139860+0000", 2024-04-19T02:16:26.192 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.5068999999999995e-05 2024-04-19T02:16:26.192 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.192 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.192 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:26.192 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.139944+0000", 2024-04-19T02:16:26.192 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.4074999999999997e-05 2024-04-19T02:16:26.192 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.192 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:26.193 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.193 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.193 INFO:teuthology.orchestra.run.smithi174.stdout: ], 2024-04-19T02:16:26.193 INFO:teuthology.orchestra.run.smithi174.stdout: "num_ops": 11 2024-04-19T02:16:26.193 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:16:26.195 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:16:26.195 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:26.194+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:26.295 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:26.295+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:26.399 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:26.396+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:26.404 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:16:26.405 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [], 2024-04-19T02:16:26.405 INFO:teuthology.orchestra.run.smithi174.stdout: "complaint_time": 30, 2024-04-19T02:16:26.405 INFO:teuthology.orchestra.run.smithi174.stdout: "num_blocked_ops": 0 2024-04-19T02:16:26.405 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:16:26.419 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:16:26.498 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:26.499+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:26.599 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:26.599+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:26.631 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:16:26.631 INFO:teuthology.orchestra.run.smithi174.stdout: "size": 20, 2024-04-19T02:16:26.631 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 600, 2024-04-19T02:16:26.632 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:16:26.632 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.632 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:10 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:26.632 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269877+0000", 2024-04-19T02:16:26.632 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 57.360418162000002, 2024-04-19T02:16:26.632 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020732751000000001, 2024-04-19T02:16:26.632 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:26.632 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:26.632 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:26.632 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.632 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:26.632 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269877+0000", 2024-04-19T02:16:26.632 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.632 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.632 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.633 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:26.633 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269877+0000", 2024-04-19T02:16:26.633 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.633 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.633 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.633 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:26.633 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269875+0000", 2024-04-19T02:16:26.633 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:26.633 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.633 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.633 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:26.633 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269891+0000", 2024-04-19T02:16:26.633 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.5494000000000001e-05 2024-04-19T02:16:26.633 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.634 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.634 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:26.634 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269903+0000", 2024-04-19T02:16:26.634 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2003e-05 2024-04-19T02:16:26.634 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.634 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.634 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:26.634 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269914+0000", 2024-04-19T02:16:26.634 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0947e-05 2024-04-19T02:16:26.634 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.634 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.634 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:26.634 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269971+0000", 2024-04-19T02:16:26.634 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7036000000000001e-05 2024-04-19T02:16:26.634 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.635 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.635 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:16:26.635 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269979+0000", 2024-04-19T02:16:26.635 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.6660000000000008e-06 2024-04-19T02:16:26.635 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.635 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.635 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:26.635 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284891+0000", 2024-04-19T02:16:26.635 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014912584 2024-04-19T02:16:26.635 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.635 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.636 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:26.636 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285213+0000", 2024-04-19T02:16:26.636 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00032172199999999998 2024-04-19T02:16:26.636 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.636 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.636 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:26.636 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285357+0000", 2024-04-19T02:16:26.636 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014367899999999999 2024-04-19T02:16:26.636 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.636 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.636 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:26.636 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288883+0000", 2024-04-19T02:16:26.636 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0035268719999999999 2024-04-19T02:16:26.636 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.636 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.637 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:26.637 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290537+0000", 2024-04-19T02:16:26.637 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016537399999999999 2024-04-19T02:16:26.637 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.637 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.637 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:26.637 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290576+0000", 2024-04-19T02:16:26.637 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9266e-05 2024-04-19T02:16:26.637 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.637 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.637 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:26.637 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290609+0000", 2024-04-19T02:16:26.637 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2818000000000003e-05 2024-04-19T02:16:26.637 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.637 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:26.638 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.638 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.638 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.638 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:11 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:26.638 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:26.638 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 57.360365240999997, 2024-04-19T02:16:26.638 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020352748, 2024-04-19T02:16:26.638 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:26.638 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:26.638 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:26.638 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.638 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:26.638 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:26.638 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.639 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.639 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.639 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:26.639 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:26.639 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.639 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.639 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.639 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:26.639 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:26.639 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:26.640 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.640 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.640 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:26.640 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269933+0000", 2024-04-19T02:16:26.640 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2169999999999996e-06 2024-04-19T02:16:26.640 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.640 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.640 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:26.640 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269940+0000", 2024-04-19T02:16:26.641 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1500000000000002e-06 2024-04-19T02:16:26.641 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.641 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.641 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:26.641 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269948+0000", 2024-04-19T02:16:26.641 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.8690000000000004e-06 2024-04-19T02:16:26.641 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.641 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.641 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:26.641 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:16:26.641 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2994999999999997e-05 2024-04-19T02:16:26.641 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.641 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.641 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:16:26.641 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269997+0000", 2024-04-19T02:16:26.642 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.9020000000000004e-06 2024-04-19T02:16:26.642 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.642 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.642 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:26.642 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.282729+0000", 2024-04-19T02:16:26.642 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.012732537 2024-04-19T02:16:26.642 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.642 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.642 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:26.642 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.282838+0000", 2024-04-19T02:16:26.642 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000108298 2024-04-19T02:16:26.642 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.642 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.642 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:26.642 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.283002+0000", 2024-04-19T02:16:26.643 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00016466300000000001 2024-04-19T02:16:26.643 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.643 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.643 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:26.643 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288708+0000", 2024-04-19T02:16:26.643 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.005705066 2024-04-19T02:16:26.643 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.643 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.643 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:26.643 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290215+0000", 2024-04-19T02:16:26.643 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0015075010000000001 2024-04-19T02:16:26.643 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.643 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.643 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:26.643 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290259+0000", 2024-04-19T02:16:26.644 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3711999999999998e-05 2024-04-19T02:16:26.644 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.644 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.644 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:26.644 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290282+0000", 2024-04-19T02:16:26.644 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3458000000000001e-05 2024-04-19T02:16:26.644 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.644 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:26.644 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.644 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.644 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.644 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:14 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:26.644 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:26.644 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 57.360331451, 2024-04-19T02:16:26.644 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020137202, 2024-04-19T02:16:26.645 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:26.645 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:26.645 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:26.645 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.645 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:26.645 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:26.645 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.645 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.646 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.646 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:26.646 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:26.646 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.646 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.646 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.646 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:26.646 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:26.646 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:26.646 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.646 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.646 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:26.646 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269971+0000", 2024-04-19T02:16:26.646 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.5459999999999992e-06 2024-04-19T02:16:26.647 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.647 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.647 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:26.647 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269979+0000", 2024-04-19T02:16:26.647 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9130000000000003e-06 2024-04-19T02:16:26.647 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.647 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.647 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:26.647 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269986+0000", 2024-04-19T02:16:26.647 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.3779999999999998e-06 2024-04-19T02:16:26.647 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.647 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.647 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:26.647 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270030+0000", 2024-04-19T02:16:26.647 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3982e-05 2024-04-19T02:16:26.648 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.648 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.648 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:16:26.648 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270034+0000", 2024-04-19T02:16:26.648 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1779999999999996e-06 2024-04-19T02:16:26.648 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.648 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.648 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:26.648 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.277870+0000", 2024-04-19T02:16:26.648 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0078362150000000005 2024-04-19T02:16:26.648 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.648 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.648 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:26.648 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.278216+0000", 2024-04-19T02:16:26.649 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00034634999999999999 2024-04-19T02:16:26.649 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.649 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.649 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:26.649 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.278732+0000", 2024-04-19T02:16:26.649 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00051536099999999999 2024-04-19T02:16:26.649 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.649 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.649 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:26.649 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.287694+0000", 2024-04-19T02:16:26.649 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0089621019999999996 2024-04-19T02:16:26.649 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.649 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.649 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:26.650 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290026+0000", 2024-04-19T02:16:26.650 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0023323139999999998 2024-04-19T02:16:26.650 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.650 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.650 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:26.650 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290067+0000", 2024-04-19T02:16:26.650 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1043e-05 2024-04-19T02:16:26.650 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.650 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.650 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:26.650 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290100+0000", 2024-04-19T02:16:26.650 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3278999999999998e-05 2024-04-19T02:16:26.651 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.651 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:26.651 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.651 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.651 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.651 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:26.651 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:26.651 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 57.360299658999999, 2024-04-19T02:16:26.651 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020731702000000001, 2024-04-19T02:16:26.652 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:26.652 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:26.652 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:26.652 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.652 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:26.652 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:26.652 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.652 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.652 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.652 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:26.652 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:26.652 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.652 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.652 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.653 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:26.653 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:26.653 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:26.653 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.653 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.653 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:26.653 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269998+0000", 2024-04-19T02:16:26.653 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7100000000000001e-06 2024-04-19T02:16:26.653 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.653 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.653 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:26.653 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270005+0000", 2024-04-19T02:16:26.654 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.241e-06 2024-04-19T02:16:26.654 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.654 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.654 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:26.654 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270011+0000", 2024-04-19T02:16:26.654 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6279999999999999e-06 2024-04-19T02:16:26.654 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.654 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.654 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:26.654 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270046+0000", 2024-04-19T02:16:26.654 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5173999999999999e-05 2024-04-19T02:16:26.654 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.655 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.655 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:26.655 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:26.655 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0019999999999997e-06 2024-04-19T02:16:26.655 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.655 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.655 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:26.656 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285619+0000", 2024-04-19T02:16:26.656 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015567391 2024-04-19T02:16:26.656 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.656 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.656 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:26.656 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285671+0000", 2024-04-19T02:16:26.656 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2460999999999998e-05 2024-04-19T02:16:26.656 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.656 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.656 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:26.656 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285775+0000", 2024-04-19T02:16:26.656 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000103389 2024-04-19T02:16:26.656 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.656 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.656 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:26.657 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288934+0000", 2024-04-19T02:16:26.657 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0031595859999999998 2024-04-19T02:16:26.657 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.657 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.657 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:26.657 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290650+0000", 2024-04-19T02:16:26.657 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001716242 2024-04-19T02:16:26.657 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.657 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.657 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:26.657 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290692+0000", 2024-04-19T02:16:26.658 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1910999999999999e-05 2024-04-19T02:16:26.658 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.658 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.658 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:26.658 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290727+0000", 2024-04-19T02:16:26.658 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4412000000000002e-05 2024-04-19T02:16:26.658 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.658 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:26.658 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.658 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.658 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.659 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:26.659 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270019+0000", 2024-04-19T02:16:26.659 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 57.360276063999997, 2024-04-19T02:16:26.659 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020572014999999999, 2024-04-19T02:16:26.659 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:26.659 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:26.659 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:26.659 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.659 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:26.659 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270019+0000", 2024-04-19T02:16:26.659 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.659 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.660 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.660 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:26.660 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270019+0000", 2024-04-19T02:16:26.660 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.660 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.660 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.660 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:26.660 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270018+0000", 2024-04-19T02:16:26.660 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:26.660 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.660 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.660 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:26.660 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270021+0000", 2024-04-19T02:16:26.660 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0319999999999999e-06 2024-04-19T02:16:26.660 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.661 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.661 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:26.661 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270028+0000", 2024-04-19T02:16:26.661 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6189999999999996e-06 2024-04-19T02:16:26.661 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.661 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.661 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:26.661 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270035+0000", 2024-04-19T02:16:26.661 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1690000000000003e-06 2024-04-19T02:16:26.661 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.662 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.662 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:26.662 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270078+0000", 2024-04-19T02:16:26.662 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3061e-05 2024-04-19T02:16:26.662 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.662 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.662 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:26.662 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270082+0000", 2024-04-19T02:16:26.662 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4510000000000002e-06 2024-04-19T02:16:26.662 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.662 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.662 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:26.663 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284354+0000", 2024-04-19T02:16:26.663 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014271588999999999 2024-04-19T02:16:26.663 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.663 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.663 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:26.663 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284497+0000", 2024-04-19T02:16:26.663 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014335800000000001 2024-04-19T02:16:26.663 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.663 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.663 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:26.663 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284626+0000", 2024-04-19T02:16:26.663 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000128744 2024-04-19T02:16:26.663 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.663 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.664 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:26.664 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288844+0000", 2024-04-19T02:16:26.664 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00421807 2024-04-19T02:16:26.664 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.664 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.664 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:26.664 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290508+0000", 2024-04-19T02:16:26.664 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001663774 2024-04-19T02:16:26.664 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.664 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.664 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:26.664 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290556+0000", 2024-04-19T02:16:26.664 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.7599999999999998e-05 2024-04-19T02:16:26.664 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.664 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.664 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:26.665 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290591+0000", 2024-04-19T02:16:26.665 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5034999999999999e-05 2024-04-19T02:16:26.665 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.665 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:26.665 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.665 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.665 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.665 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:26.665 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:26.665 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 57.360253200999999, 2024-04-19T02:16:26.665 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020192280999999999, 2024-04-19T02:16:26.665 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:26.665 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:26.665 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:26.665 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.666 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:26.666 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:26.666 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.666 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.666 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.666 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:26.666 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:26.666 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.666 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.666 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.666 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:26.666 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:26.666 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:26.666 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.666 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.667 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:26.667 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270045+0000", 2024-04-19T02:16:26.667 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8680000000000001e-06 2024-04-19T02:16:26.667 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.667 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.667 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:26.667 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270052+0000", 2024-04-19T02:16:26.667 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.9999999999999999e-06 2024-04-19T02:16:26.667 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.667 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.667 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:26.667 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270056+0000", 2024-04-19T02:16:26.667 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4479999999999996e-06 2024-04-19T02:16:26.667 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.667 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.668 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:26.668 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270089+0000", 2024-04-19T02:16:26.668 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3071000000000002e-05 2024-04-19T02:16:26.668 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.668 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.668 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:26.668 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270092+0000", 2024-04-19T02:16:26.668 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9780000000000001e-06 2024-04-19T02:16:26.668 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.668 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.668 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:26.668 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.280632+0000", 2024-04-19T02:16:26.669 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010539712 2024-04-19T02:16:26.669 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.669 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.669 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:26.669 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.280743+0000", 2024-04-19T02:16:26.669 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000111048 2024-04-19T02:16:26.669 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.670 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.670 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:26.670 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.281531+0000", 2024-04-19T02:16:26.670 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00078738199999999999 2024-04-19T02:16:26.670 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.670 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.670 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:26.670 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.287949+0000", 2024-04-19T02:16:26.670 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0064185730000000003 2024-04-19T02:16:26.670 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.670 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.670 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:26.671 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290184+0000", 2024-04-19T02:16:26.671 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0022350849999999999 2024-04-19T02:16:26.671 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.671 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.671 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:26.671 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290209+0000", 2024-04-19T02:16:26.671 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4907000000000001e-05 2024-04-19T02:16:26.671 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.671 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.671 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:26.671 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290234+0000", 2024-04-19T02:16:26.671 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4666999999999999e-05 2024-04-19T02:16:26.672 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.672 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:26.672 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.672 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.672 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.672 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:19 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:26.672 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:26.672 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 57.360231734999999, 2024-04-19T02:16:26.672 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020818203, 2024-04-19T02:16:26.673 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:26.673 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:26.673 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:26.673 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.673 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:26.673 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:26.673 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.673 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.673 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.673 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:26.673 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:26.673 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.673 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.673 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.674 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:26.674 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:26.674 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:26.674 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.674 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.674 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:26.674 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270065+0000", 2024-04-19T02:16:26.674 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4310000000000001e-06 2024-04-19T02:16:26.674 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.674 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.674 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:26.674 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270070+0000", 2024-04-19T02:16:26.674 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2859999999999999e-06 2024-04-19T02:16:26.674 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.674 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.675 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:26.675 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270077+0000", 2024-04-19T02:16:26.675 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5270000000000004e-06 2024-04-19T02:16:26.675 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.675 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.675 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:26.675 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270107+0000", 2024-04-19T02:16:26.675 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0205999999999998e-05 2024-04-19T02:16:26.675 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.675 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.676 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:26.676 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270111+0000", 2024-04-19T02:16:26.676 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8650000000000003e-06 2024-04-19T02:16:26.676 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.676 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.676 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:26.676 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285936+0000", 2024-04-19T02:16:26.676 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015824677999999998 2024-04-19T02:16:26.676 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.676 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.677 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:26.677 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286007+0000", 2024-04-19T02:16:26.677 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1157999999999999e-05 2024-04-19T02:16:26.677 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.677 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.677 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:26.677 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286086+0000", 2024-04-19T02:16:26.677 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9084000000000004e-05 2024-04-19T02:16:26.677 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.677 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.677 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:26.677 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290740+0000", 2024-04-19T02:16:26.677 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0046543679999999999 2024-04-19T02:16:26.677 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.677 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.678 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:26.678 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290833+0000", 2024-04-19T02:16:26.678 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2551000000000002e-05 2024-04-19T02:16:26.678 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.678 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.678 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:26.678 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290859+0000", 2024-04-19T02:16:26.678 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.6696999999999999e-05 2024-04-19T02:16:26.678 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.678 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.678 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:26.678 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290881+0000", 2024-04-19T02:16:26.678 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1653000000000001e-05 2024-04-19T02:16:26.678 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.679 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:26.679 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.679 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.679 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.679 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:19174 5.4 5:2f42d48e:::benchmark_data_smithi121_44835_object19173:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:26.679 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:00.712766+0000", 2024-04-19T02:16:26.679 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 25.917528494999999, 2024-04-19T02:16:26.679 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016423842000000001, 2024-04-19T02:16:26.679 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:26.679 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:26.679 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:26.679 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:26.679 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:26.679 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 19174 2024-04-19T02:16:26.679 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.679 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:26.680 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.680 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:26.680 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.712766+0000", 2024-04-19T02:16:26.680 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.680 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.680 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.680 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:26.680 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.712766+0000", 2024-04-19T02:16:26.680 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.680 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.680 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.681 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:26.681 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.712765+0000", 2024-04-19T02:16:26.681 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:26.681 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.681 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.681 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:26.681 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.712876+0000", 2024-04-19T02:16:26.681 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000110543 2024-04-19T02:16:26.681 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.681 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.681 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:26.681 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.712887+0000", 2024-04-19T02:16:26.681 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1420000000000001e-05 2024-04-19T02:16:26.681 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.681 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.682 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:26.682 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.712896+0000", 2024-04-19T02:16:26.682 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.4330000000000004e-06 2024-04-19T02:16:26.682 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.682 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.682 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:26.682 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.712923+0000", 2024-04-19T02:16:26.682 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7070999999999999e-05 2024-04-19T02:16:26.682 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.682 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.682 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:26.682 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.713005+0000", 2024-04-19T02:16:26.682 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2279000000000003e-05 2024-04-19T02:16:26.682 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.683 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.683 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:26.683 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.713094+0000", 2024-04-19T02:16:26.683 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.9251000000000003e-05 2024-04-19T02:16:26.683 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.683 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.683 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:26.683 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.714553+0000", 2024-04-19T02:16:26.684 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0014587339999999999 2024-04-19T02:16:26.684 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.684 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.684 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:26.684 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.729110+0000", 2024-04-19T02:16:26.684 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014557037 2024-04-19T02:16:26.684 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.684 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.684 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:26.684 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.729158+0000", 2024-04-19T02:16:26.684 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.829e-05 2024-04-19T02:16:26.684 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.684 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.684 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:26.684 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:00.729190+0000", 2024-04-19T02:16:26.685 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1673e-05 2024-04-19T02:16:26.685 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.685 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:26.685 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.685 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.685 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.685 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:31632 5.e 5:7c608c66:::benchmark_data_smithi121_44835_object31631:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-19T02:16:26.685 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:04.960320+0000", 2024-04-19T02:16:26.685 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 21.669975007000001, 2024-04-19T02:16:26.685 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016282966999999999, 2024-04-19T02:16:26.685 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:26.685 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:26.685 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:26.685 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:26.686 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:26.686 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 31632 2024-04-19T02:16:26.686 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.686 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:26.686 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.686 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:26.686 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.960320+0000", 2024-04-19T02:16:26.686 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.686 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.686 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.686 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:26.686 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.960320+0000", 2024-04-19T02:16:26.686 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.686 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.686 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.687 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:26.687 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.960319+0000", 2024-04-19T02:16:26.687 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:26.687 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.687 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.687 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:26.687 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.960359+0000", 2024-04-19T02:16:26.687 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0120999999999998e-05 2024-04-19T02:16:26.687 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.687 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.687 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:26.687 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.960370+0000", 2024-04-19T02:16:26.687 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1124999999999999e-05 2024-04-19T02:16:26.687 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.687 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.688 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:26.688 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.960376+0000", 2024-04-19T02:16:26.688 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.6840000000000001e-06 2024-04-19T02:16:26.688 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.688 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.688 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:26.688 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.965241+0000", 2024-04-19T02:16:26.688 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0048651709999999997 2024-04-19T02:16:26.688 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.688 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.688 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:26.688 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.965330+0000", 2024-04-19T02:16:26.688 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.9345999999999995e-05 2024-04-19T02:16:26.688 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.688 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.689 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:26.689 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.965409+0000", 2024-04-19T02:16:26.689 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.8757000000000005e-05 2024-04-19T02:16:26.689 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.689 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.689 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:26.689 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.966312+0000", 2024-04-19T02:16:26.689 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00090340199999999998 2024-04-19T02:16:26.689 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.689 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.689 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:26.689 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.976537+0000", 2024-04-19T02:16:26.689 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010224680999999999 2024-04-19T02:16:26.689 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.689 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.690 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:26.690 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.976580+0000", 2024-04-19T02:16:26.690 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3234e-05 2024-04-19T02:16:26.690 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.690 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.690 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:26.690 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:04.976603+0000", 2024-04-19T02:16:26.690 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.2421000000000001e-05 2024-04-19T02:16:26.690 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.690 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:26.690 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.690 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.690 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.690 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:42710 5.4 5:2c02047b:::benchmark_data_smithi121_44835_object42709:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:26.691 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:09.265091+0000", 2024-04-19T02:16:26.691 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 17.365203259000001, 2024-04-19T02:16:26.691 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016523969999999999, 2024-04-19T02:16:26.691 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:26.691 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:26.691 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:26.691 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:26.691 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:26.691 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 42710 2024-04-19T02:16:26.691 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.691 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:26.691 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.692 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:26.692 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.265091+0000", 2024-04-19T02:16:26.692 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.692 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.692 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.692 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:26.692 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.265091+0000", 2024-04-19T02:16:26.692 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.692 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.692 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.692 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:26.692 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.265091+0000", 2024-04-19T02:16:26.692 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:26.692 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.693 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.693 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:26.693 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.265141+0000", 2024-04-19T02:16:26.693 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.9886000000000003e-05 2024-04-19T02:16:26.693 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.693 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.693 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:26.693 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.265148+0000", 2024-04-19T02:16:26.693 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3089999999999998e-06 2024-04-19T02:16:26.693 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.693 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.693 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:26.693 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.265152+0000", 2024-04-19T02:16:26.694 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.5730000000000001e-06 2024-04-19T02:16:26.694 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.694 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.694 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:26.694 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.266187+0000", 2024-04-19T02:16:26.694 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0010347080000000001 2024-04-19T02:16:26.694 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.694 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.695 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:26.695 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.266321+0000", 2024-04-19T02:16:26.695 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013432599999999999 2024-04-19T02:16:26.695 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.695 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.695 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:26.695 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.266452+0000", 2024-04-19T02:16:26.695 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013062600000000001 2024-04-19T02:16:26.695 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.695 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.695 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:26.695 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.267706+0000", 2024-04-19T02:16:26.695 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0012537609999999999 2024-04-19T02:16:26.695 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.695 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.696 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:26.696 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.281536+0000", 2024-04-19T02:16:26.696 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.01382972 2024-04-19T02:16:26.696 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.696 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.696 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:26.696 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.281571+0000", 2024-04-19T02:16:26.696 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5215000000000001e-05 2024-04-19T02:16:26.696 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.696 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.696 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:26.696 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.281615+0000", 2024-04-19T02:16:26.696 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4604000000000002e-05 2024-04-19T02:16:26.696 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.697 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:26.697 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.697 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.697 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.697 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:42724 5.0 5:0d0b7b99:::benchmark_data_smithi121_44835_object42723:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:26.697 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:09.270595+0000", 2024-04-19T02:16:26.697 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 17.359699442, 2024-04-19T02:16:26.697 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.018445754000000002, 2024-04-19T02:16:26.697 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:26.697 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:26.697 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:26.697 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:26.697 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:26.697 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 42724 2024-04-19T02:16:26.697 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.698 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:26.698 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.698 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:26.698 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.270595+0000", 2024-04-19T02:16:26.698 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.698 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.698 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.698 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:26.698 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.270595+0000", 2024-04-19T02:16:26.698 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.698 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.698 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.698 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:26.698 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.270595+0000", 2024-04-19T02:16:26.698 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:26.699 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.699 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.699 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:26.699 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.270634+0000", 2024-04-19T02:16:26.699 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9270000000000002e-05 2024-04-19T02:16:26.699 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.699 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.699 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:26.699 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.270640+0000", 2024-04-19T02:16:26.699 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.8139999999999997e-06 2024-04-19T02:16:26.699 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.699 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.699 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:26.699 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.270645+0000", 2024-04-19T02:16:26.699 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.729e-06 2024-04-19T02:16:26.700 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.700 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.700 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:26.700 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.270676+0000", 2024-04-19T02:16:26.700 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1390000000000003e-05 2024-04-19T02:16:26.700 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.700 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.700 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:26.700 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.270808+0000", 2024-04-19T02:16:26.700 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013151699999999999 2024-04-19T02:16:26.700 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.700 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.700 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:26.700 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.270944+0000", 2024-04-19T02:16:26.700 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013695999999999999 2024-04-19T02:16:26.701 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.701 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.701 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:26.701 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.272565+0000", 2024-04-19T02:16:26.701 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016207179999999999 2024-04-19T02:16:26.701 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.701 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.701 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:26.701 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.288992+0000", 2024-04-19T02:16:26.702 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016426356 2024-04-19T02:16:26.702 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.702 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.702 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:26.702 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.289021+0000", 2024-04-19T02:16:26.702 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9257000000000001e-05 2024-04-19T02:16:26.702 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.702 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.702 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:26.702 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.289041+0000", 2024-04-19T02:16:26.702 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.0177999999999999e-05 2024-04-19T02:16:26.702 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.702 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:26.702 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.702 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.703 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.703 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:60896 5.4 5:2b0faee3:::benchmark_data_smithi121_44835_object60895:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:26.703 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:17.036092+0000", 2024-04-19T02:16:26.703 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 9.5942023479999996, 2024-04-19T02:16:26.703 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.018033583999999998, 2024-04-19T02:16:26.703 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:26.703 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:26.703 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:26.703 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:26.703 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:26.703 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 60896 2024-04-19T02:16:26.703 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.703 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:26.704 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.704 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:26.704 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.036092+0000", 2024-04-19T02:16:26.704 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.704 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.704 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.704 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:26.704 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.036092+0000", 2024-04-19T02:16:26.704 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.704 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.704 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.704 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:26.704 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.036092+0000", 2024-04-19T02:16:26.705 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:26.705 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.705 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.705 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:26.705 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.036210+0000", 2024-04-19T02:16:26.705 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011790000000000001 2024-04-19T02:16:26.705 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.705 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.705 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:26.706 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.036219+0000", 2024-04-19T02:16:26.706 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0829999999999993e-06 2024-04-19T02:16:26.706 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.706 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.706 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:26.706 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.036223+0000", 2024-04-19T02:16:26.706 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3869999999999997e-06 2024-04-19T02:16:26.706 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.706 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.706 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:26.706 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.036258+0000", 2024-04-19T02:16:26.706 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5281999999999999e-05 2024-04-19T02:16:26.706 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.707 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.707 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:26.707 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.036265+0000", 2024-04-19T02:16:26.707 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.1759999999999998e-06 2024-04-19T02:16:26.707 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.707 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.707 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:26.707 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.041984+0000", 2024-04-19T02:16:26.707 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0057195459999999998 2024-04-19T02:16:26.707 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.707 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.707 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:26.708 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.042102+0000", 2024-04-19T02:16:26.708 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000117507 2024-04-19T02:16:26.708 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.708 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.708 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:26.708 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.042217+0000", 2024-04-19T02:16:26.708 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011525 2024-04-19T02:16:26.708 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.708 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.708 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:26.708 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.044194+0000", 2024-04-19T02:16:26.708 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0019774530000000001 2024-04-19T02:16:26.708 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.708 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.708 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:26.709 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.054075+0000", 2024-04-19T02:16:26.709 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0098801619999999996 2024-04-19T02:16:26.709 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.709 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.709 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:26.709 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.054102+0000", 2024-04-19T02:16:26.709 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7580999999999999e-05 2024-04-19T02:16:26.709 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.709 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.709 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:26.709 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.054126+0000", 2024-04-19T02:16:26.709 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3816999999999999e-05 2024-04-19T02:16:26.709 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.709 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:26.709 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.710 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.710 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.710 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:61282 5.4 5:2fadfcf7:::benchmark_data_smithi121_44835_object61281:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:26.710 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:17.218467+0000", 2024-04-19T02:16:26.710 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 9.4118273939999995, 2024-04-19T02:16:26.710 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016694759999999999, 2024-04-19T02:16:26.710 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:26.710 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:26.710 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:26.710 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:26.710 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:26.710 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 61282 2024-04-19T02:16:26.711 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.711 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:26.711 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.711 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:26.711 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.218467+0000", 2024-04-19T02:16:26.711 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.711 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.711 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.711 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:26.711 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.218467+0000", 2024-04-19T02:16:26.711 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.711 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.711 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.711 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:26.711 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.218467+0000", 2024-04-19T02:16:26.712 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:26.712 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.712 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.712 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:26.712 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.218554+0000", 2024-04-19T02:16:26.712 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.7457e-05 2024-04-19T02:16:26.712 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.712 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.712 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:26.712 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.218561+0000", 2024-04-19T02:16:26.712 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3459999999999996e-06 2024-04-19T02:16:26.712 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.712 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.712 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:26.713 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.218566+0000", 2024-04-19T02:16:26.713 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2729999999999996e-06 2024-04-19T02:16:26.713 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.713 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.713 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:26.713 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.218607+0000", 2024-04-19T02:16:26.713 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1520999999999998e-05 2024-04-19T02:16:26.713 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.713 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.713 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:26.713 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.218740+0000", 2024-04-19T02:16:26.713 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013284700000000001 2024-04-19T02:16:26.713 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.713 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.713 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:26.713 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.218875+0000", 2024-04-19T02:16:26.714 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000135351 2024-04-19T02:16:26.714 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.714 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.714 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:26.714 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.220761+0000", 2024-04-19T02:16:26.714 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001885308 2024-04-19T02:16:26.714 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.714 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.714 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:26.714 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.235083+0000", 2024-04-19T02:16:26.714 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014322021000000001 2024-04-19T02:16:26.715 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.715 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.715 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:26.715 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.235128+0000", 2024-04-19T02:16:26.715 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.5673999999999997e-05 2024-04-19T02:16:26.715 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.715 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.715 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:26.715 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.235162+0000", 2024-04-19T02:16:26.715 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3710000000000001e-05 2024-04-19T02:16:26.715 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.716 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:26.716 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.716 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.716 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.716 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:62720 5.e 5:7cb1d759:::benchmark_data_smithi121_44835_object62719:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:26.716 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:17.908658+0000", 2024-04-19T02:16:26.716 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 8.721636771, 2024-04-19T02:16:26.716 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.017978524999999999, 2024-04-19T02:16:26.716 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:26.716 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:26.716 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:26.717 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:26.717 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:26.717 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 62720 2024-04-19T02:16:26.717 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.717 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:26.717 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.717 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:26.717 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.908658+0000", 2024-04-19T02:16:26.717 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.717 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.717 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.717 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:26.717 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.908658+0000", 2024-04-19T02:16:26.717 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.717 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.718 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.718 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:26.718 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.908657+0000", 2024-04-19T02:16:26.718 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:26.718 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.718 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.718 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:26.718 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.908718+0000", 2024-04-19T02:16:26.718 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.1202000000000001e-05 2024-04-19T02:16:26.718 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.718 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.719 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:26.719 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.908727+0000", 2024-04-19T02:16:26.719 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.7569999999999993e-06 2024-04-19T02:16:26.719 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.719 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.719 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:26.719 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.908734+0000", 2024-04-19T02:16:26.719 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.5140000000000004e-06 2024-04-19T02:16:26.719 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.719 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.719 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:26.719 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.913299+0000", 2024-04-19T02:16:26.719 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0045644580000000004 2024-04-19T02:16:26.719 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.720 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.720 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:26.720 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.913401+0000", 2024-04-19T02:16:26.720 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000101752 2024-04-19T02:16:26.720 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.720 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.720 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:26.720 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.913488+0000", 2024-04-19T02:16:26.720 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.7638000000000004e-05 2024-04-19T02:16:26.720 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.720 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.720 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:26.720 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.917152+0000", 2024-04-19T02:16:26.720 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0036635439999999999 2024-04-19T02:16:26.721 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.721 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.721 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:26.721 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.926554+0000", 2024-04-19T02:16:26.721 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0094018309999999994 2024-04-19T02:16:26.721 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.721 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.721 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:26.721 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.926604+0000", 2024-04-19T02:16:26.721 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0349000000000002e-05 2024-04-19T02:16:26.721 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.721 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.721 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:26.721 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.926636+0000", 2024-04-19T02:16:26.722 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2546999999999999e-05 2024-04-19T02:16:26.722 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.722 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:26.722 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.722 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.722 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.722 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:63808 5.8 5:1b67bd69:::benchmark_data_smithi121_44835_object63807:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:26.722 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:18.396522+0000", 2024-04-19T02:16:26.722 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 8.233772729, 2024-04-19T02:16:26.723 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016466654000000001, 2024-04-19T02:16:26.723 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:26.723 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:26.723 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:26.723 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:26.723 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:26.723 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 63808 2024-04-19T02:16:26.723 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.723 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:26.723 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.723 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:26.724 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.396522+0000", 2024-04-19T02:16:26.724 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.724 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.724 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.724 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:26.724 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.396522+0000", 2024-04-19T02:16:26.724 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.724 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.724 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.724 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:26.724 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.396522+0000", 2024-04-19T02:16:26.724 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:26.724 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.725 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.725 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:26.725 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.396594+0000", 2024-04-19T02:16:26.725 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1971999999999995e-05 2024-04-19T02:16:26.725 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.725 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.725 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:26.725 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.396598+0000", 2024-04-19T02:16:26.725 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1869999999999999e-06 2024-04-19T02:16:26.725 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.725 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.725 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:26.725 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.396601+0000", 2024-04-19T02:16:26.725 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.574e-06 2024-04-19T02:16:26.726 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.726 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.726 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:26.726 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.399860+0000", 2024-04-19T02:16:26.726 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0032583970000000001 2024-04-19T02:16:26.726 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.726 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.726 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:26.726 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.399941+0000", 2024-04-19T02:16:26.727 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.1163999999999997e-05 2024-04-19T02:16:26.727 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.727 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.727 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:26.727 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.400073+0000", 2024-04-19T02:16:26.727 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000131896 2024-04-19T02:16:26.727 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.727 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.727 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:26.727 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.404509+0000", 2024-04-19T02:16:26.727 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0044362270000000001 2024-04-19T02:16:26.727 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.727 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.728 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:26.728 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.412921+0000", 2024-04-19T02:16:26.728 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0084118390000000008 2024-04-19T02:16:26.728 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.728 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.728 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:26.728 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.412952+0000", 2024-04-19T02:16:26.728 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0797999999999999e-05 2024-04-19T02:16:26.728 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.728 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.728 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:26.728 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.412989+0000", 2024-04-19T02:16:26.728 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6934999999999998e-05 2024-04-19T02:16:26.728 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.728 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:26.728 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.729 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.729 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.729 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:63809 5.0 5:0a9105c3:::benchmark_data_smithi121_44835_object63808:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:26.729 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:18.396605+0000", 2024-04-19T02:16:26.729 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 8.2336896629999998, 2024-04-19T02:16:26.729 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016519550000000001, 2024-04-19T02:16:26.729 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:26.729 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:26.729 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:26.729 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:26.729 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:26.729 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 63809 2024-04-19T02:16:26.729 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.729 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:26.730 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.730 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:26.730 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.396605+0000", 2024-04-19T02:16:26.730 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.730 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.730 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.730 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:26.730 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.396605+0000", 2024-04-19T02:16:26.730 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.730 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.730 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.730 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:26.730 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.396605+0000", 2024-04-19T02:16:26.730 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:26.731 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.731 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.731 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:26.731 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.396644+0000", 2024-04-19T02:16:26.731 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8946000000000003e-05 2024-04-19T02:16:26.731 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.731 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.731 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:26.732 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.396649+0000", 2024-04-19T02:16:26.732 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.3290000000000001e-06 2024-04-19T02:16:26.732 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.732 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.732 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:26.732 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.396653+0000", 2024-04-19T02:16:26.732 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7100000000000001e-06 2024-04-19T02:16:26.732 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.732 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.732 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:26.732 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.399849+0000", 2024-04-19T02:16:26.732 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0031966249999999998 2024-04-19T02:16:26.733 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.733 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.733 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:26.733 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.399936+0000", 2024-04-19T02:16:26.733 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.7149000000000002e-05 2024-04-19T02:16:26.733 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.733 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.733 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:26.733 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.400017+0000", 2024-04-19T02:16:26.733 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0655999999999995e-05 2024-04-19T02:16:26.733 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.733 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.734 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:26.734 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.404512+0000", 2024-04-19T02:16:26.734 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0044944640000000001 2024-04-19T02:16:26.734 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.734 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.734 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:26.734 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.413045+0000", 2024-04-19T02:16:26.734 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0085334190000000004 2024-04-19T02:16:26.734 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.734 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.734 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:26.734 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.413086+0000", 2024-04-19T02:16:26.734 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1229000000000001e-05 2024-04-19T02:16:26.734 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.735 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.735 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:26.735 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.413125+0000", 2024-04-19T02:16:26.735 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8359000000000003e-05 2024-04-19T02:16:26.735 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.735 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:26.735 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.735 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.735 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.735 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:63933 5.e 5:7761bd09:::benchmark_data_smithi121_44835_object63932:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:26.735 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:18.451582+0000", 2024-04-19T02:16:26.735 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 8.1787123990000001, 2024-04-19T02:16:26.735 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.017963553, 2024-04-19T02:16:26.735 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:26.735 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:26.736 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:26.736 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:26.736 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:26.736 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 63933 2024-04-19T02:16:26.736 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.736 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:26.736 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.736 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:26.736 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.451582+0000", 2024-04-19T02:16:26.737 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.737 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.737 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.737 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:26.737 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.451582+0000", 2024-04-19T02:16:26.737 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.737 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.737 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.738 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:26.738 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.451581+0000", 2024-04-19T02:16:26.738 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:26.738 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.738 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.738 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:26.738 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.451663+0000", 2024-04-19T02:16:26.738 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.1151999999999998e-05 2024-04-19T02:16:26.738 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.738 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.738 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:26.738 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.451672+0000", 2024-04-19T02:16:26.738 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0250000000000008e-06 2024-04-19T02:16:26.739 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.739 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.739 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:26.739 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.451682+0000", 2024-04-19T02:16:26.739 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0135e-05 2024-04-19T02:16:26.739 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.739 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.739 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:26.739 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.453236+0000", 2024-04-19T02:16:26.739 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0015544910000000001 2024-04-19T02:16:26.739 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.740 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.740 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:26.740 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.453380+0000", 2024-04-19T02:16:26.740 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000143428 2024-04-19T02:16:26.740 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.740 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.740 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:26.740 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.453538+0000", 2024-04-19T02:16:26.740 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000158011 2024-04-19T02:16:26.740 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.740 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.740 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:26.740 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.456104+0000", 2024-04-19T02:16:26.741 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0025666539999999998 2024-04-19T02:16:26.741 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.741 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.741 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:26.741 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.469453+0000", 2024-04-19T02:16:26.741 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.013349145999999999 2024-04-19T02:16:26.741 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.741 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.741 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:26.741 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.469504+0000", 2024-04-19T02:16:26.741 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0900999999999999e-05 2024-04-19T02:16:26.741 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.741 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.741 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:26.741 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:18.469546+0000", 2024-04-19T02:16:26.742 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1430999999999997e-05 2024-04-19T02:16:26.742 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.742 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:26.742 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.742 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.742 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.742 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:65702 5.0 5:0e2d52f5:::benchmark_data_smithi121_44835_object65701:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:26.742 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:19.257242+0000", 2024-04-19T02:16:26.742 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 7.3730527239999999, 2024-04-19T02:16:26.742 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.019747843000000001, 2024-04-19T02:16:26.742 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:26.742 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:26.742 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:26.742 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:26.743 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:26.743 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 65702 2024-04-19T02:16:26.743 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.743 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:26.743 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.743 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:26.743 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.257242+0000", 2024-04-19T02:16:26.743 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.743 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.743 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.743 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:26.743 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.257242+0000", 2024-04-19T02:16:26.743 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.743 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.743 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.744 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:26.744 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.257241+0000", 2024-04-19T02:16:26.744 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:26.744 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.744 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.744 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:26.744 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.257345+0000", 2024-04-19T02:16:26.744 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010439599999999999 2024-04-19T02:16:26.744 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.744 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.744 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:26.744 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.257356+0000", 2024-04-19T02:16:26.745 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0291e-05 2024-04-19T02:16:26.745 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.745 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.745 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:26.745 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.257363+0000", 2024-04-19T02:16:26.745 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.0299999999999996e-06 2024-04-19T02:16:26.745 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.745 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.745 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:26.745 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.258992+0000", 2024-04-19T02:16:26.745 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016295509999999999 2024-04-19T02:16:26.745 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.745 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.745 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:26.745 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.259114+0000", 2024-04-19T02:16:26.746 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000121234 2024-04-19T02:16:26.746 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.746 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.746 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:26.746 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.259253+0000", 2024-04-19T02:16:26.746 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013916300000000001 2024-04-19T02:16:26.746 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.746 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.746 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:26.746 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.260819+0000", 2024-04-19T02:16:26.746 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0015664190000000001 2024-04-19T02:16:26.746 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.746 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.747 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:26.747 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.276908+0000", 2024-04-19T02:16:26.747 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016089157 2024-04-19T02:16:26.747 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.747 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.747 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:26.747 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.276954+0000", 2024-04-19T02:16:26.747 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.5642000000000001e-05 2024-04-19T02:16:26.747 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.747 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.747 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:26.747 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.276990+0000", 2024-04-19T02:16:26.747 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5852999999999997e-05 2024-04-19T02:16:26.747 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.747 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:26.748 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.748 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.748 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.748 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:65712 5.8 5:1078fb7c:::benchmark_data_smithi121_44835_object65711:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:26.748 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:19.263441+0000", 2024-04-19T02:16:26.748 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 7.3668532759999996, 2024-04-19T02:16:26.748 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.017398141999999998, 2024-04-19T02:16:26.749 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:26.749 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:26.749 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:26.749 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:26.749 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:26.749 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 65712 2024-04-19T02:16:26.749 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.749 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:26.749 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.749 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:26.749 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.263441+0000", 2024-04-19T02:16:26.749 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.749 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.749 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.749 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:26.750 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.263441+0000", 2024-04-19T02:16:26.750 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.750 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.750 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.750 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:26.750 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.263441+0000", 2024-04-19T02:16:26.750 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:26.750 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.750 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.750 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:26.750 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.263506+0000", 2024-04-19T02:16:26.750 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.4629999999999996e-05 2024-04-19T02:16:26.750 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.751 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.751 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:26.751 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.263511+0000", 2024-04-19T02:16:26.751 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.6489999999999996e-06 2024-04-19T02:16:26.751 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.751 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.751 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:26.751 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.263515+0000", 2024-04-19T02:16:26.751 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3239999999999999e-06 2024-04-19T02:16:26.751 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.751 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.751 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:26.751 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.264981+0000", 2024-04-19T02:16:26.751 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0014662480000000001 2024-04-19T02:16:26.752 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.752 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.752 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:26.752 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.265070+0000", 2024-04-19T02:16:26.752 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.9083000000000001e-05 2024-04-19T02:16:26.752 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.752 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.752 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:26.752 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.265153+0000", 2024-04-19T02:16:26.752 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.3599999999999999e-05 2024-04-19T02:16:26.752 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.753 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.753 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:26.753 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.268487+0000", 2024-04-19T02:16:26.753 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0033332180000000002 2024-04-19T02:16:26.753 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.753 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.753 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:26.753 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.280793+0000", 2024-04-19T02:16:26.754 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.012306713 2024-04-19T02:16:26.754 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.754 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.754 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:26.754 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.280821+0000", 2024-04-19T02:16:26.754 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7206999999999999e-05 2024-04-19T02:16:26.755 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.755 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.755 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:26.755 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.280840+0000", 2024-04-19T02:16:26.755 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.8901000000000001e-05 2024-04-19T02:16:26.755 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.756 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:26.756 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.756 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.756 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.756 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:76207 5.0 5:0a9218e5:::benchmark_data_smithi121_44835_object76206:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:26.757 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:26.152533+0000", 2024-04-19T02:16:26.757 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.477761887, 2024-04-19T02:16:26.757 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016649480000000001, 2024-04-19T02:16:26.757 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:26.757 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:26.757 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:26.758 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:26.758 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:26.758 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 76207 2024-04-19T02:16:26.758 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.758 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:26.758 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.759 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:26.759 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.152533+0000", 2024-04-19T02:16:26.759 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.759 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.759 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.760 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:26.760 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.152533+0000", 2024-04-19T02:16:26.760 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:26.760 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.760 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.760 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:26.761 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.152532+0000", 2024-04-19T02:16:26.761 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:26.761 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.761 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.761 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:26.761 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.152608+0000", 2024-04-19T02:16:26.762 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.6159e-05 2024-04-19T02:16:26.762 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.762 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.762 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:26.762 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.152617+0000", 2024-04-19T02:16:26.762 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.6030000000000005e-06 2024-04-19T02:16:26.763 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.763 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.763 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:26.763 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.152623+0000", 2024-04-19T02:16:26.763 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.4679999999999997e-06 2024-04-19T02:16:26.763 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.764 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.764 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:26.764 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.155011+0000", 2024-04-19T02:16:26.764 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.002387424 2024-04-19T02:16:26.764 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.764 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.765 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:26.765 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.155137+0000", 2024-04-19T02:16:26.765 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000126229 2024-04-19T02:16:26.765 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.765 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.765 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:26.766 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.155298+0000", 2024-04-19T02:16:26.766 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00016097099999999999 2024-04-19T02:16:26.766 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.766 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.766 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:26.767 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.158956+0000", 2024-04-19T02:16:26.767 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0036580660000000002 2024-04-19T02:16:26.767 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.767 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.767 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:26.767 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.169091+0000", 2024-04-19T02:16:26.768 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010134647 2024-04-19T02:16:26.768 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.768 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.768 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:26.768 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.169140+0000", 2024-04-19T02:16:26.769 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.9299999999999999e-05 2024-04-19T02:16:26.769 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:26.769 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:26.769 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:26.769 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.169182+0000", 2024-04-19T02:16:26.769 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2419000000000002e-05 2024-04-19T02:16:26.770 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.770 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:26.770 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.770 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:26.770 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:26.770 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:16:26.773 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:16:26.774 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:26.772+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:26.873 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:26.873+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:26.960 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-04-19T02:16:26.960 INFO:teuthology.orchestra.run.smithi177.stdout: "ops": [ 2024-04-19T02:16:26.960 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.960 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:77911 5.1 5:8942a574:::benchmark_data_smithi121_44835_object77910:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:26.960 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:26.951869+0000", 2024-04-19T02:16:26.960 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0072301420000000002, 2024-04-19T02:16:26.960 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0072510439999999999, 2024-04-19T02:16:26.960 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:26.960 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:26.960 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:26.960 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:26.961 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:26.961 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 77911 2024-04-19T02:16:26.961 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.961 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:26.961 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.961 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:26.961 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.951869+0000", 2024-04-19T02:16:26.961 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:26.961 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.961 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.961 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:26.961 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.951869+0000", 2024-04-19T02:16:26.961 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:26.961 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.962 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.962 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:26.962 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.951867+0000", 2024-04-19T02:16:26.962 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:26.962 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.962 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.962 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:26.962 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.951934+0000", 2024-04-19T02:16:26.962 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.6444000000000003e-05 2024-04-19T02:16:26.962 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.962 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.962 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:26.962 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.951944+0000", 2024-04-19T02:16:26.963 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.9399999999999997e-06 2024-04-19T02:16:26.963 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.963 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.963 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:26.963 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.951951+0000", 2024-04-19T02:16:26.963 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.5580000000000003e-06 2024-04-19T02:16:26.963 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.963 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.963 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:26.963 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.952691+0000", 2024-04-19T02:16:26.963 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00073915600000000004 2024-04-19T02:16:26.963 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.963 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.963 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:26.963 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.952810+0000", 2024-04-19T02:16:26.964 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000119416 2024-04-19T02:16:26.964 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.964 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.964 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:26.964 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.953024+0000", 2024-04-19T02:16:26.964 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00021447 2024-04-19T02:16:26.964 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:26.964 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:26.964 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:26.964 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.964 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.964 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:77915 5.1 5:83b1d070:::benchmark_data_smithi121_44835_object77914:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:26.964 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:26.952346+0000", 2024-04-19T02:16:26.964 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0067531220000000003, 2024-04-19T02:16:26.964 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0068348790000000003, 2024-04-19T02:16:26.965 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:26.965 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:26.965 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:26.965 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:26.965 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:26.965 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 77915 2024-04-19T02:16:26.965 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.965 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:26.965 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.966 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:26.966 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.952346+0000", 2024-04-19T02:16:26.966 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:26.966 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.966 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.966 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:26.966 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.952346+0000", 2024-04-19T02:16:26.966 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:26.966 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.966 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.966 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:26.966 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.952345+0000", 2024-04-19T02:16:26.966 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:26.967 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.967 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.967 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:26.967 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.952423+0000", 2024-04-19T02:16:26.967 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.8199000000000001e-05 2024-04-19T02:16:26.967 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.967 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.967 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:26.967 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.952433+0000", 2024-04-19T02:16:26.967 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.0680000000000003e-06 2024-04-19T02:16:26.967 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.967 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.967 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:26.967 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.952439+0000", 2024-04-19T02:16:26.968 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.2210000000000002e-06 2024-04-19T02:16:26.968 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.968 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.968 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:26.968 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.956004+0000", 2024-04-19T02:16:26.968 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0035653450000000001 2024-04-19T02:16:26.968 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.968 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.968 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:26.968 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.956145+0000", 2024-04-19T02:16:26.968 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000141323 2024-04-19T02:16:26.968 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.968 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.968 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:26.968 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.956313+0000", 2024-04-19T02:16:26.969 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00016799499999999999 2024-04-19T02:16:26.969 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:26.969 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:26.969 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:26.969 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.969 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.969 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:77916 5.3 5:c7552ec7:::benchmark_data_smithi121_44835_object77915:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:26.969 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:26.952453+0000", 2024-04-19T02:16:26.969 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0066463549999999996, 2024-04-19T02:16:26.969 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0067722650000000004, 2024-04-19T02:16:26.969 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:26.969 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:26.969 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:26.969 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:26.970 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:26.970 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 77916 2024-04-19T02:16:26.970 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.970 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:26.970 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.970 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:26.970 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.952453+0000", 2024-04-19T02:16:26.970 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:26.970 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.970 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.970 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:26.970 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.952453+0000", 2024-04-19T02:16:26.970 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:26.971 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.971 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.971 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:26.971 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.952452+0000", 2024-04-19T02:16:26.971 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:26.971 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.971 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.971 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:26.971 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.952480+0000", 2024-04-19T02:16:26.972 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.7517000000000001e-05 2024-04-19T02:16:26.972 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.972 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.972 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:26.972 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.952488+0000", 2024-04-19T02:16:26.972 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.4819999999999994e-06 2024-04-19T02:16:26.972 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.972 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.972 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:26.972 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.952494+0000", 2024-04-19T02:16:26.973 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.1530000000000002e-06 2024-04-19T02:16:26.973 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.973 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.973 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:26.973 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.952536+0000", 2024-04-19T02:16:26.973 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.1888999999999998e-05 2024-04-19T02:16:26.973 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.973 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.973 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:26.973 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.952682+0000", 2024-04-19T02:16:26.974 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00014615599999999999 2024-04-19T02:16:26.974 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.974 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.974 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:26.974 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.952810+0000", 2024-04-19T02:16:26.974 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012763799999999999 2024-04-19T02:16:26.975 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.975 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.975 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:26.975 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.957064+0000", 2024-04-19T02:16:26.975 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0042536880000000003 2024-04-19T02:16:26.975 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:26.975 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:26.975 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:26.977 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.977 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.977 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:77918 5.a 5:52db7d60:::benchmark_data_smithi121_44835_object77917:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:26.977 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:26.952543+0000", 2024-04-19T02:16:26.977 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0065563080000000003, 2024-04-19T02:16:26.977 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0067291340000000003, 2024-04-19T02:16:26.977 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:26.977 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:26.977 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:26.978 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:26.978 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:26.978 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 77918 2024-04-19T02:16:26.978 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.978 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:26.978 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.978 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:26.978 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.952543+0000", 2024-04-19T02:16:26.978 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:26.978 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.978 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.978 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:26.978 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.952543+0000", 2024-04-19T02:16:26.979 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:26.979 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.979 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.979 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:26.979 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.952542+0000", 2024-04-19T02:16:26.979 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:26.979 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.979 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.979 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:26.979 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.952629+0000", 2024-04-19T02:16:26.979 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.6947999999999995e-05 2024-04-19T02:16:26.979 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.979 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.979 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:26.979 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.952637+0000", 2024-04-19T02:16:26.980 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.5310000000000004e-06 2024-04-19T02:16:26.980 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.980 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.980 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:26.980 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.952643+0000", 2024-04-19T02:16:26.980 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.1820000000000003e-06 2024-04-19T02:16:26.980 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.980 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.980 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:26.980 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.952691+0000", 2024-04-19T02:16:26.980 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.8158999999999997e-05 2024-04-19T02:16:26.980 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.980 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.980 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:26.981 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.952830+0000", 2024-04-19T02:16:26.981 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00013940099999999999 2024-04-19T02:16:26.981 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.981 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.981 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:26.981 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.952973+0000", 2024-04-19T02:16:26.981 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000142671 2024-04-19T02:16:26.981 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.981 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.981 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:26.981 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.958086+0000", 2024-04-19T02:16:26.981 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0051127719999999998 2024-04-19T02:16:26.981 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:26.981 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:26.981 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:26.982 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.982 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.982 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:77920 5.6 5:6200427a:::benchmark_data_smithi121_44835_object77919:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:26.982 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:26.952687+0000", 2024-04-19T02:16:26.982 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0064116609999999999, 2024-04-19T02:16:26.982 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0066301629999999997, 2024-04-19T02:16:26.982 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:26.982 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:26.982 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:26.982 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:26.982 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:26.982 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 77920 2024-04-19T02:16:26.982 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.983 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:26.983 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.983 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:26.983 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.952687+0000", 2024-04-19T02:16:26.983 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:26.983 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.983 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.983 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:26.983 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.952687+0000", 2024-04-19T02:16:26.983 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:26.983 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.983 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.983 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:26.983 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.952687+0000", 2024-04-19T02:16:26.983 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:26.984 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.984 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.984 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:26.984 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.952835+0000", 2024-04-19T02:16:26.984 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00014796399999999999 2024-04-19T02:16:26.984 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.984 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.984 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:26.984 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.952843+0000", 2024-04-19T02:16:26.984 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.5110000000000003e-06 2024-04-19T02:16:26.984 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.984 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.984 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:26.984 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.952852+0000", 2024-04-19T02:16:26.984 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.3620000000000006e-06 2024-04-19T02:16:26.985 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.985 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.985 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:26.985 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.952920+0000", 2024-04-19T02:16:26.985 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.8555999999999999e-05 2024-04-19T02:16:26.985 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.985 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.986 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:26.986 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.953039+0000", 2024-04-19T02:16:26.986 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00011845000000000001 2024-04-19T02:16:26.986 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.986 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.986 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:26.986 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.953175+0000", 2024-04-19T02:16:26.986 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000135933 2024-04-19T02:16:26.986 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.986 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.987 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:26.987 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.958614+0000", 2024-04-19T02:16:26.987 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0054391630000000003 2024-04-19T02:16:26.987 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:26.987 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:26.987 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:26.987 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.987 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.987 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:77913 5.0 e31/16 5:0fd7fe14:::benchmark_data_smithi121_44835_object77912:head v 31'4780, mlcod=31'4778)", 2024-04-19T02:16:26.988 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:26.953877+0000", 2024-04-19T02:16:26.988 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.005221626, 2024-04-19T02:16:26.988 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0054842459999999999, 2024-04-19T02:16:26.988 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:26.988 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:26.988 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:26.988 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.988 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:26.988 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.953877+0000", 2024-04-19T02:16:26.988 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:26.988 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.988 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.988 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:26.989 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.953877+0000", 2024-04-19T02:16:26.989 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:26.989 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.989 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.989 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:26.989 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.953877+0000", 2024-04-19T02:16:26.989 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:26.989 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.989 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.989 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:26.990 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.953909+0000", 2024-04-19T02:16:26.990 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.2116000000000002e-05 2024-04-19T02:16:26.990 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.990 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.990 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:26.990 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.953919+0000", 2024-04-19T02:16:26.990 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0166999999999999e-05 2024-04-19T02:16:26.990 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.990 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.990 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:26.990 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.953926+0000", 2024-04-19T02:16:26.990 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.4740000000000002e-06 2024-04-19T02:16:26.990 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.990 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.991 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:26.991 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.953979+0000", 2024-04-19T02:16:26.991 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.3773999999999997e-05 2024-04-19T02:16:26.991 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.991 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.991 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:26.991 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.954002+0000", 2024-04-19T02:16:26.991 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.2898999999999999e-05 2024-04-19T02:16:26.991 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:26.991 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:26.991 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:26.991 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.991 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.991 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:77917 5.8 e31/16 5:1a1aed42:::benchmark_data_smithi121_44835_object77916:head v 31'4918, mlcod=31'4915)", 2024-04-19T02:16:26.992 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:26.953935+0000", 2024-04-19T02:16:26.992 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.00516388, 2024-04-19T02:16:26.992 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0054616999999999999, 2024-04-19T02:16:26.992 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:26.992 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:26.992 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:26.992 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.992 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:26.992 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.953935+0000", 2024-04-19T02:16:26.992 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:26.993 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.993 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.993 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:26.993 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.953935+0000", 2024-04-19T02:16:26.993 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:26.993 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.993 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.993 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:26.993 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.953935+0000", 2024-04-19T02:16:26.993 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:26.993 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.993 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.993 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:26.993 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.953963+0000", 2024-04-19T02:16:26.993 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.7832999999999999e-05 2024-04-19T02:16:26.994 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.994 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.994 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:26.994 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.953969+0000", 2024-04-19T02:16:26.994 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.9839999999999998e-06 2024-04-19T02:16:26.994 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.994 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.994 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:26.994 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.953973+0000", 2024-04-19T02:16:26.994 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.3189999999999996e-06 2024-04-19T02:16:26.994 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.994 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.995 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:26.995 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.954886+0000", 2024-04-19T02:16:26.995 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00091292299999999995 2024-04-19T02:16:26.995 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.995 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.995 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:26.995 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.954905+0000", 2024-04-19T02:16:26.995 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.8612000000000001e-05 2024-04-19T02:16:26.995 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:26.995 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:26.995 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:26.995 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.995 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.995 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:77919 5.b e31/16 5:d36a3202:::benchmark_data_smithi121_44835_object77918:head v 31'4817, mlcod=31'4814)", 2024-04-19T02:16:26.995 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:26.953977+0000", 2024-04-19T02:16:26.996 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0051218490000000004, 2024-04-19T02:16:26.996 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0054526380000000001, 2024-04-19T02:16:26.996 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:26.996 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:26.996 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:26.996 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.996 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:26.996 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.953977+0000", 2024-04-19T02:16:26.996 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:26.996 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.996 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.996 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:26.996 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.953977+0000", 2024-04-19T02:16:26.996 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:26.996 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.997 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.997 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:26.997 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.953977+0000", 2024-04-19T02:16:26.997 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967296 2024-04-19T02:16:26.997 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.997 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.997 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:26.997 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.954008+0000", 2024-04-19T02:16:26.997 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.0654999999999997e-05 2024-04-19T02:16:26.997 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.997 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.998 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:26.998 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.954013+0000", 2024-04-19T02:16:26.998 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.3720000000000004e-06 2024-04-19T02:16:26.998 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.998 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.998 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:26.998 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.954017+0000", 2024-04-19T02:16:26.998 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.9009999999999996e-06 2024-04-19T02:16:26.999 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.999 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.999 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:26.999 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.954978+0000", 2024-04-19T02:16:26.999 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00096069199999999997 2024-04-19T02:16:26.999 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:26.999 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:26.999 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:26.999 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.954995+0000", 2024-04-19T02:16:26.999 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.7479e-05 2024-04-19T02:16:26.999 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:26.999 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:26.999 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:26.999 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.000 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.000 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:77914 5.7 e31/16 5:ebd1dff4:::benchmark_data_smithi121_44835_object77913:head v 31'4937, mlcod=31'4934)", 2024-04-19T02:16:27.000 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:26.954902+0000", 2024-04-19T02:16:27.000 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0041974940000000004, 2024-04-19T02:16:27.000 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0045611569999999997, 2024-04-19T02:16:27.000 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:27.000 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:27.000 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:27.000 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.000 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:27.000 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.954902+0000", 2024-04-19T02:16:27.000 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:27.000 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.000 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.000 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:27.001 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.954902+0000", 2024-04-19T02:16:27.001 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:27.001 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.001 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.001 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:27.001 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.954901+0000", 2024-04-19T02:16:27.001 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:27.001 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.001 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.001 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:27.001 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.954933+0000", 2024-04-19T02:16:27.001 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.2159000000000002e-05 2024-04-19T02:16:27.001 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.001 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.001 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:27.002 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.954942+0000", 2024-04-19T02:16:27.002 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.3229999999999998e-06 2024-04-19T02:16:27.002 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.002 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.002 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:27.002 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.954948+0000", 2024-04-19T02:16:27.002 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.4459999999999998e-06 2024-04-19T02:16:27.002 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.002 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.002 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:27.002 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.954981+0000", 2024-04-19T02:16:27.003 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.3293000000000001e-05 2024-04-19T02:16:27.003 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.003 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.003 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:27.003 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.955002+0000", 2024-04-19T02:16:27.003 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.1021000000000001e-05 2024-04-19T02:16:27.003 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.003 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:27.003 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.003 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.003 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.003 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:77921 5.1 5:810d2a6e:::benchmark_data_smithi121_44835_object77920:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:27.003 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:26.954993+0000", 2024-04-19T02:16:27.003 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0041065930000000004, 2024-04-19T02:16:27.003 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0045069200000000002, 2024-04-19T02:16:27.004 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:27.004 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:27.004 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:27.004 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:27.004 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:27.004 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 77921 2024-04-19T02:16:27.004 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.004 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:27.004 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.004 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:27.004 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.954993+0000", 2024-04-19T02:16:27.004 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:27.004 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.004 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.004 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:27.005 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.954993+0000", 2024-04-19T02:16:27.005 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:27.005 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.005 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.005 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:27.005 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.954992+0000", 2024-04-19T02:16:27.005 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:27.005 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.005 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.005 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:27.005 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.955016+0000", 2024-04-19T02:16:27.005 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.3907999999999999e-05 2024-04-19T02:16:27.005 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.005 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.005 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:27.006 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.955025+0000", 2024-04-19T02:16:27.006 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.7019999999999996e-06 2024-04-19T02:16:27.006 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.006 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.006 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:27.006 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.955032+0000", 2024-04-19T02:16:27.006 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.6680000000000004e-06 2024-04-19T02:16:27.006 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.006 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.006 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:27.006 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.957907+0000", 2024-04-19T02:16:27.006 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0028747040000000001 2024-04-19T02:16:27.006 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.007 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.007 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:27.007 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.958045+0000", 2024-04-19T02:16:27.007 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00013806499999999999 2024-04-19T02:16:27.007 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.007 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.007 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:27.007 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.958156+0000", 2024-04-19T02:16:27.007 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000111661 2024-04-19T02:16:27.007 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.007 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:27.007 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.007 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.008 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.008 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:77922 5.6 5:6abd23d6:::benchmark_data_smithi121_44835_object77921:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:27.008 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:26.955418+0000", 2024-04-19T02:16:27.008 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0036806719999999999, 2024-04-19T02:16:27.008 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0041622400000000002, 2024-04-19T02:16:27.008 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:27.008 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:27.008 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:27.008 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:27.008 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:27.009 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 77922 2024-04-19T02:16:27.009 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.009 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:27.009 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.009 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:27.009 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.955418+0000", 2024-04-19T02:16:27.009 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:27.009 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.009 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.009 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:27.009 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.955418+0000", 2024-04-19T02:16:27.010 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:27.010 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.010 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.010 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:27.010 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.955418+0000", 2024-04-19T02:16:27.010 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:27.010 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.010 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.010 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:27.010 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.955551+0000", 2024-04-19T02:16:27.010 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00013353700000000001 2024-04-19T02:16:27.010 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.011 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.011 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:27.011 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.955561+0000", 2024-04-19T02:16:27.011 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.7699999999999996e-06 2024-04-19T02:16:27.011 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.012 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.012 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:27.012 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.955568+0000", 2024-04-19T02:16:27.012 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.5980000000000002e-06 2024-04-19T02:16:27.012 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.012 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.012 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:27.012 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.956974+0000", 2024-04-19T02:16:27.012 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0014066180000000001 2024-04-19T02:16:27.012 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.012 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.012 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:27.012 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.957087+0000", 2024-04-19T02:16:27.012 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000112784 2024-04-19T02:16:27.012 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.013 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.013 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:27.013 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.957183+0000", 2024-04-19T02:16:27.013 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.5922999999999996e-05 2024-04-19T02:16:27.013 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.013 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:27.013 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.013 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.013 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.013 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "MOSDPGPushReply(5.1 31/29 [PushReplyOp(5:81b0defc:::benchmark_data_smithi121_44835_object42544:head)])", 2024-04-19T02:16:27.013 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:26.957919+0000", 2024-04-19T02:16:27.013 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0011804020000000001, 2024-04-19T02:16:27.013 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.001720329, 2024-04-19T02:16:27.013 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:27.014 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "queued for pg", 2024-04-19T02:16:27.014 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:27.014 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.014 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:27.014 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.957919+0000", 2024-04-19T02:16:27.014 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:27.014 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.014 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.014 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:27.014 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.957919+0000", 2024-04-19T02:16:27.014 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:27.014 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.014 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.014 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:27.015 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.957918+0000", 2024-04-19T02:16:27.015 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:27.015 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.015 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.015 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:27.015 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.957923+0000", 2024-04-19T02:16:27.015 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.8389999999999997e-06 2024-04-19T02:16:27.015 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.015 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.015 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:27.015 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.957931+0000", 2024-04-19T02:16:27.015 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.1410000000000005e-06 2024-04-19T02:16:27.015 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.015 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.016 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:27.016 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.957938+0000", 2024-04-19T02:16:27.016 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.5690000000000001e-06 2024-04-19T02:16:27.016 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.016 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:27.016 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.016 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.016 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.016 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:77924 5.b e31/16 5:dafec056:::benchmark_data_smithi121_44835_object77923:head v 31'4818, mlcod=31'4815)", 2024-04-19T02:16:27.016 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:26.958610+0000", 2024-04-19T02:16:27.016 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.00048947699999999999, 2024-04-19T02:16:27.016 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.001069298, 2024-04-19T02:16:27.016 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:27.016 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:27.016 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:27.017 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.017 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:27.017 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.958610+0000", 2024-04-19T02:16:27.017 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:27.017 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.017 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.017 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:27.017 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.958610+0000", 2024-04-19T02:16:27.017 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:27.017 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.017 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.017 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:27.017 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.958609+0000", 2024-04-19T02:16:27.017 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:27.017 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.018 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.018 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:27.018 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.958659+0000", 2024-04-19T02:16:27.018 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.9629999999999997e-05 2024-04-19T02:16:27.018 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.018 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.018 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:27.018 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.958671+0000", 2024-04-19T02:16:27.018 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.1918e-05 2024-04-19T02:16:27.018 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.018 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.018 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:27.018 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.958678+0000", 2024-04-19T02:16:27.018 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.7950000000000008e-06 2024-04-19T02:16:27.019 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.019 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.019 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:27.019 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.958721+0000", 2024-04-19T02:16:27.019 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.2580000000000002e-05 2024-04-19T02:16:27.019 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.019 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.019 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:27.019 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.958742+0000", 2024-04-19T02:16:27.019 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.1174000000000001e-05 2024-04-19T02:16:27.019 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.020 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:27.020 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.020 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.020 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.020 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:77927 5.4 e31/16 5:248e86ab:::benchmark_data_smithi121_44835_object77926:head v 31'4831, mlcod=31'4829)", 2024-04-19T02:16:27.020 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:26.959486+0000", 2024-04-19T02:16:27.020 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4294967295.9996138, 2024-04-19T02:16:27.020 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00025858400000000002, 2024-04-19T02:16:27.020 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:27.020 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:27.020 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:27.020 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.020 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:27.021 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.959486+0000", 2024-04-19T02:16:27.021 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:27.021 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.021 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.021 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:27.021 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.959486+0000", 2024-04-19T02:16:27.021 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:27.021 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.021 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.021 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:27.021 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.959485+0000", 2024-04-19T02:16:27.021 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:27.021 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.021 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.021 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:27.022 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.959535+0000", 2024-04-19T02:16:27.022 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.9811000000000001e-05 2024-04-19T02:16:27.022 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.022 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.022 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:27.022 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.959544+0000", 2024-04-19T02:16:27.022 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.8850000000000005e-06 2024-04-19T02:16:27.022 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.022 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.022 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:27.022 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.959552+0000", 2024-04-19T02:16:27.022 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.3140000000000004e-06 2024-04-19T02:16:27.022 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.023 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.023 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:27.023 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.959586+0000", 2024-04-19T02:16:27.023 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.3869999999999999e-05 2024-04-19T02:16:27.023 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.023 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.023 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:27.023 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.959599+0000", 2024-04-19T02:16:27.023 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.2574e-05 2024-04-19T02:16:27.023 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.023 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:27.023 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.023 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.023 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2024-04-19T02:16:27.023 INFO:teuthology.orchestra.run.smithi177.stdout: "num_ops": 14 2024-04-19T02:16:27.024 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-04-19T02:16:27.025 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:27.026+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:27.026 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:16:27.027 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 32 16 78072 78056 152.441 133.125 0.0088656 0.00655728 2024-04-19T02:16:27.067 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-19T02:16:27.067 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T02:16:27.067 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-04-19T02:16:27.067 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-19T02:16:27.126 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:27.126+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:27.226 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:27.227+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:27.250 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-04-19T02:16:27.250 INFO:teuthology.orchestra.run.smithi177.stdout: "ops": [], 2024-04-19T02:16:27.250 INFO:teuthology.orchestra.run.smithi177.stdout: "complaint_time": 30, 2024-04-19T02:16:27.250 INFO:teuthology.orchestra.run.smithi177.stdout: "num_blocked_ops": 0 2024-04-19T02:16:27.250 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-04-19T02:16:27.263 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:16:27.328 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:27.328+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:27.407 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:16:27.407 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-04-19T02:16:27.408 INFO:teuthology.orchestra.run.smithi121.stdout: "epoch": 31, 2024-04-19T02:16:27.408 INFO:teuthology.orchestra.run.smithi121.stdout: "fsid": "f6ab5dd0-bb9f-4b48-a9fc-4728c7955ca8", 2024-04-19T02:16:27.408 INFO:teuthology.orchestra.run.smithi121.stdout: "created": "2024-04-19T02:15:13.539846+0000", 2024-04-19T02:16:27.408 INFO:teuthology.orchestra.run.smithi121.stdout: "modified": "2024-04-19T02:16:26.068602+0000", 2024-04-19T02:16:27.408 INFO:teuthology.orchestra.run.smithi121.stdout: "last_up_change": "2024-04-19T02:15:22.519568+0000", 2024-04-19T02:16:27.408 INFO:teuthology.orchestra.run.smithi121.stdout: "last_in_change": "2024-04-19T02:15:15.482624+0000", 2024-04-19T02:16:27.408 INFO:teuthology.orchestra.run.smithi121.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-19T02:16:27.408 INFO:teuthology.orchestra.run.smithi121.stdout: "flags_num": 5799936, 2024-04-19T02:16:27.408 INFO:teuthology.orchestra.run.smithi121.stdout: "flags_set": [ 2024-04-19T02:16:27.408 INFO:teuthology.orchestra.run.smithi121.stdout: "pglog_hardlimit", 2024-04-19T02:16:27.408 INFO:teuthology.orchestra.run.smithi121.stdout: "purged_snapdirs", 2024-04-19T02:16:27.408 INFO:teuthology.orchestra.run.smithi121.stdout: "recovery_deletes", 2024-04-19T02:16:27.408 INFO:teuthology.orchestra.run.smithi121.stdout: "sortbitwise" 2024-04-19T02:16:27.408 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-04-19T02:16:27.408 INFO:teuthology.orchestra.run.smithi121.stdout: "crush_version": 4, 2024-04-19T02:16:27.409 INFO:teuthology.orchestra.run.smithi121.stdout: "full_ratio": 0.94999998807907104, 2024-04-19T02:16:27.409 INFO:teuthology.orchestra.run.smithi121.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-19T02:16:27.409 INFO:teuthology.orchestra.run.smithi121.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-19T02:16:27.409 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_snapshot": "", 2024-04-19T02:16:27.409 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_max": 5, 2024-04-19T02:16:27.409 INFO:teuthology.orchestra.run.smithi121.stdout: "max_osd": 3, 2024-04-19T02:16:27.409 INFO:teuthology.orchestra.run.smithi121.stdout: "require_min_compat_client": "luminous", 2024-04-19T02:16:27.409 INFO:teuthology.orchestra.run.smithi121.stdout: "min_compat_client": "luminous", 2024-04-19T02:16:27.409 INFO:teuthology.orchestra.run.smithi121.stdout: "require_osd_release": "reef", 2024-04-19T02:16:27.409 INFO:teuthology.orchestra.run.smithi121.stdout: "allow_crimson": false, 2024-04-19T02:16:27.409 INFO:teuthology.orchestra.run.smithi121.stdout: "pools": [ 2024-04-19T02:16:27.409 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:27.409 INFO:teuthology.orchestra.run.smithi121.stdout: "pool": 1, 2024-04-19T02:16:27.409 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_name": ".mgr", 2024-04-19T02:16:27.409 INFO:teuthology.orchestra.run.smithi121.stdout: "create_time": "2024-04-19T02:15:22.776125+0000", 2024-04-19T02:16:27.410 INFO:teuthology.orchestra.run.smithi121.stdout: "flags": 1, 2024-04-19T02:16:27.410 INFO:teuthology.orchestra.run.smithi121.stdout: "flags_names": "hashpspool", 2024-04-19T02:16:27.410 INFO:teuthology.orchestra.run.smithi121.stdout: "type": 1, 2024-04-19T02:16:27.410 INFO:teuthology.orchestra.run.smithi121.stdout: "size": 2, 2024-04-19T02:16:27.410 INFO:teuthology.orchestra.run.smithi121.stdout: "min_size": 1, 2024-04-19T02:16:27.410 INFO:teuthology.orchestra.run.smithi121.stdout: "crush_rule": 0, 2024-04-19T02:16:27.410 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_count": 0, 2024-04-19T02:16:27.410 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_target": 0, 2024-04-19T02:16:27.410 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T02:16:27.410 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T02:16:27.410 INFO:teuthology.orchestra.run.smithi121.stdout: "object_hash": 2, 2024-04-19T02:16:27.410 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_autoscale_mode": "off", 2024-04-19T02:16:27.410 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num": 1, 2024-04-19T02:16:27.410 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_placement_num": 1, 2024-04-19T02:16:27.411 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_placement_num_target": 1, 2024-04-19T02:16:27.411 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_target": 1, 2024-04-19T02:16:27.411 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_pending": 1, 2024-04-19T02:16:27.411 INFO:teuthology.orchestra.run.smithi121.stdout: "last_pg_merge_meta": { 2024-04-19T02:16:27.411 INFO:teuthology.orchestra.run.smithi121.stdout: "source_pgid": "0.0", 2024-04-19T02:16:27.411 INFO:teuthology.orchestra.run.smithi121.stdout: "ready_epoch": 0, 2024-04-19T02:16:27.411 INFO:teuthology.orchestra.run.smithi121.stdout: "last_epoch_started": 0, 2024-04-19T02:16:27.411 INFO:teuthology.orchestra.run.smithi121.stdout: "last_epoch_clean": 0, 2024-04-19T02:16:27.411 INFO:teuthology.orchestra.run.smithi121.stdout: "source_version": "0'0", 2024-04-19T02:16:27.411 INFO:teuthology.orchestra.run.smithi121.stdout: "target_version": "0'0" 2024-04-19T02:16:27.411 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:27.411 INFO:teuthology.orchestra.run.smithi121.stdout: "last_change": "11", 2024-04-19T02:16:27.411 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend": "0", 2024-04-19T02:16:27.411 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T02:16:27.411 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T02:16:27.412 INFO:teuthology.orchestra.run.smithi121.stdout: "auid": 0, 2024-04-19T02:16:27.412 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_mode": "selfmanaged", 2024-04-19T02:16:27.412 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_seq": 0, 2024-04-19T02:16:27.412 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_epoch": 0, 2024-04-19T02:16:27.412 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_snaps": [], 2024-04-19T02:16:27.412 INFO:teuthology.orchestra.run.smithi121.stdout: "removed_snaps": "[]", 2024-04-19T02:16:27.412 INFO:teuthology.orchestra.run.smithi121.stdout: "quota_max_bytes": 0, 2024-04-19T02:16:27.412 INFO:teuthology.orchestra.run.smithi121.stdout: "quota_max_objects": 0, 2024-04-19T02:16:27.412 INFO:teuthology.orchestra.run.smithi121.stdout: "tiers": [], 2024-04-19T02:16:27.412 INFO:teuthology.orchestra.run.smithi121.stdout: "tier_of": -1, 2024-04-19T02:16:27.412 INFO:teuthology.orchestra.run.smithi121.stdout: "read_tier": -1, 2024-04-19T02:16:27.412 INFO:teuthology.orchestra.run.smithi121.stdout: "write_tier": -1, 2024-04-19T02:16:27.412 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_mode": "none", 2024-04-19T02:16:27.412 INFO:teuthology.orchestra.run.smithi121.stdout: "target_max_bytes": 0, 2024-04-19T02:16:27.412 INFO:teuthology.orchestra.run.smithi121.stdout: "target_max_objects": 0, 2024-04-19T02:16:27.413 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T02:16:27.413 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T02:16:27.413 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T02:16:27.413 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_min_flush_age": 0, 2024-04-19T02:16:27.413 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_min_evict_age": 0, 2024-04-19T02:16:27.413 INFO:teuthology.orchestra.run.smithi121.stdout: "erasure_code_profile": "", 2024-04-19T02:16:27.413 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_params": { 2024-04-19T02:16:27.413 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "none" 2024-04-19T02:16:27.413 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:27.413 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_period": 0, 2024-04-19T02:16:27.413 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_count": 0, 2024-04-19T02:16:27.413 INFO:teuthology.orchestra.run.smithi121.stdout: "use_gmt_hitset": true, 2024-04-19T02:16:27.413 INFO:teuthology.orchestra.run.smithi121.stdout: "min_read_recency_for_promote": 0, 2024-04-19T02:16:27.413 INFO:teuthology.orchestra.run.smithi121.stdout: "min_write_recency_for_promote": 0, 2024-04-19T02:16:27.414 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T02:16:27.414 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_search_last_n": 0, 2024-04-19T02:16:27.414 INFO:teuthology.orchestra.run.smithi121.stdout: "grade_table": [], 2024-04-19T02:16:27.414 INFO:teuthology.orchestra.run.smithi121.stdout: "stripe_width": 0, 2024-04-19T02:16:27.414 INFO:teuthology.orchestra.run.smithi121.stdout: "expected_num_objects": 0, 2024-04-19T02:16:27.414 INFO:teuthology.orchestra.run.smithi121.stdout: "fast_read": false, 2024-04-19T02:16:27.414 INFO:teuthology.orchestra.run.smithi121.stdout: "options": { 2024-04-19T02:16:27.414 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_max": 32, 2024-04-19T02:16:27.414 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_min": 1 2024-04-19T02:16:27.414 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:27.414 INFO:teuthology.orchestra.run.smithi121.stdout: "application_metadata": { 2024-04-19T02:16:27.414 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": {} 2024-04-19T02:16:27.414 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:27.414 INFO:teuthology.orchestra.run.smithi121.stdout: "read_balance": { 2024-04-19T02:16:27.414 INFO:teuthology.orchestra.run.smithi121.stdout: "score_acting": 2.9900000095367432, 2024-04-19T02:16:27.415 INFO:teuthology.orchestra.run.smithi121.stdout: "score_stable": 2.9900000095367432, 2024-04-19T02:16:27.415 INFO:teuthology.orchestra.run.smithi121.stdout: "optimal_score": 0.67000001668930054, 2024-04-19T02:16:27.415 INFO:teuthology.orchestra.run.smithi121.stdout: "raw_score_acting": 2, 2024-04-19T02:16:27.415 INFO:teuthology.orchestra.run.smithi121.stdout: "raw_score_stable": 2, 2024-04-19T02:16:27.415 INFO:teuthology.orchestra.run.smithi121.stdout: "primary_affinity_weighted": 0.90409350395202637, 2024-04-19T02:16:27.415 INFO:teuthology.orchestra.run.smithi121.stdout: "average_primary_affinity": 0.89999997615814209, 2024-04-19T02:16:27.415 INFO:teuthology.orchestra.run.smithi121.stdout: "average_primary_affinity_weighted": 0.89999997615814209 2024-04-19T02:16:27.415 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:27.415 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:27.415 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:27.415 INFO:teuthology.orchestra.run.smithi121.stdout: "pool": 2, 2024-04-19T02:16:27.415 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_name": "rbd", 2024-04-19T02:16:27.415 INFO:teuthology.orchestra.run.smithi121.stdout: "create_time": "2024-04-19T02:15:23.264005+0000", 2024-04-19T02:16:27.415 INFO:teuthology.orchestra.run.smithi121.stdout: "flags": 1, 2024-04-19T02:16:27.415 INFO:teuthology.orchestra.run.smithi121.stdout: "flags_names": "hashpspool", 2024-04-19T02:16:27.416 INFO:teuthology.orchestra.run.smithi121.stdout: "type": 1, 2024-04-19T02:16:27.416 INFO:teuthology.orchestra.run.smithi121.stdout: "size": 2, 2024-04-19T02:16:27.416 INFO:teuthology.orchestra.run.smithi121.stdout: "min_size": 1, 2024-04-19T02:16:27.416 INFO:teuthology.orchestra.run.smithi121.stdout: "crush_rule": 0, 2024-04-19T02:16:27.416 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_count": 0, 2024-04-19T02:16:27.416 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_target": 0, 2024-04-19T02:16:27.416 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T02:16:27.416 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T02:16:27.416 INFO:teuthology.orchestra.run.smithi121.stdout: "object_hash": 2, 2024-04-19T02:16:27.416 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_autoscale_mode": "off", 2024-04-19T02:16:27.416 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num": 8, 2024-04-19T02:16:27.416 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_placement_num": 8, 2024-04-19T02:16:27.416 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_placement_num_target": 8, 2024-04-19T02:16:27.416 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_target": 8, 2024-04-19T02:16:27.417 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_pending": 8, 2024-04-19T02:16:27.417 INFO:teuthology.orchestra.run.smithi121.stdout: "last_pg_merge_meta": { 2024-04-19T02:16:27.417 INFO:teuthology.orchestra.run.smithi121.stdout: "source_pgid": "0.0", 2024-04-19T02:16:27.417 INFO:teuthology.orchestra.run.smithi121.stdout: "ready_epoch": 0, 2024-04-19T02:16:27.417 INFO:teuthology.orchestra.run.smithi121.stdout: "last_epoch_started": 0, 2024-04-19T02:16:27.417 INFO:teuthology.orchestra.run.smithi121.stdout: "last_epoch_clean": 0, 2024-04-19T02:16:27.417 INFO:teuthology.orchestra.run.smithi121.stdout: "source_version": "0'0", 2024-04-19T02:16:27.417 INFO:teuthology.orchestra.run.smithi121.stdout: "target_version": "0'0" 2024-04-19T02:16:27.417 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:27.417 INFO:teuthology.orchestra.run.smithi121.stdout: "last_change": "11", 2024-04-19T02:16:27.417 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend": "0", 2024-04-19T02:16:27.417 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T02:16:27.417 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T02:16:27.417 INFO:teuthology.orchestra.run.smithi121.stdout: "auid": 0, 2024-04-19T02:16:27.417 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_mode": "selfmanaged", 2024-04-19T02:16:27.417 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_seq": 0, 2024-04-19T02:16:27.418 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_epoch": 0, 2024-04-19T02:16:27.418 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_snaps": [], 2024-04-19T02:16:27.418 INFO:teuthology.orchestra.run.smithi121.stdout: "removed_snaps": "[]", 2024-04-19T02:16:27.418 INFO:teuthology.orchestra.run.smithi121.stdout: "quota_max_bytes": 0, 2024-04-19T02:16:27.418 INFO:teuthology.orchestra.run.smithi121.stdout: "quota_max_objects": 0, 2024-04-19T02:16:27.418 INFO:teuthology.orchestra.run.smithi121.stdout: "tiers": [], 2024-04-19T02:16:27.418 INFO:teuthology.orchestra.run.smithi121.stdout: "tier_of": -1, 2024-04-19T02:16:27.418 INFO:teuthology.orchestra.run.smithi121.stdout: "read_tier": -1, 2024-04-19T02:16:27.418 INFO:teuthology.orchestra.run.smithi121.stdout: "write_tier": -1, 2024-04-19T02:16:27.418 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_mode": "none", 2024-04-19T02:16:27.418 INFO:teuthology.orchestra.run.smithi121.stdout: "target_max_bytes": 0, 2024-04-19T02:16:27.418 INFO:teuthology.orchestra.run.smithi121.stdout: "target_max_objects": 0, 2024-04-19T02:16:27.418 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T02:16:27.418 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T02:16:27.419 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T02:16:27.419 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_min_flush_age": 0, 2024-04-19T02:16:27.419 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_min_evict_age": 0, 2024-04-19T02:16:27.419 INFO:teuthology.orchestra.run.smithi121.stdout: "erasure_code_profile": "", 2024-04-19T02:16:27.419 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_params": { 2024-04-19T02:16:27.419 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "none" 2024-04-19T02:16:27.419 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:27.419 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_period": 0, 2024-04-19T02:16:27.419 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_count": 0, 2024-04-19T02:16:27.419 INFO:teuthology.orchestra.run.smithi121.stdout: "use_gmt_hitset": true, 2024-04-19T02:16:27.419 INFO:teuthology.orchestra.run.smithi121.stdout: "min_read_recency_for_promote": 0, 2024-04-19T02:16:27.419 INFO:teuthology.orchestra.run.smithi121.stdout: "min_write_recency_for_promote": 0, 2024-04-19T02:16:27.419 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T02:16:27.419 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_search_last_n": 0, 2024-04-19T02:16:27.419 INFO:teuthology.orchestra.run.smithi121.stdout: "grade_table": [], 2024-04-19T02:16:27.420 INFO:teuthology.orchestra.run.smithi121.stdout: "stripe_width": 0, 2024-04-19T02:16:27.420 INFO:teuthology.orchestra.run.smithi121.stdout: "expected_num_objects": 0, 2024-04-19T02:16:27.420 INFO:teuthology.orchestra.run.smithi121.stdout: "fast_read": false, 2024-04-19T02:16:27.420 INFO:teuthology.orchestra.run.smithi121.stdout: "options": {}, 2024-04-19T02:16:27.420 INFO:teuthology.orchestra.run.smithi121.stdout: "application_metadata": { 2024-04-19T02:16:27.420 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd": {} 2024-04-19T02:16:27.420 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:27.420 INFO:teuthology.orchestra.run.smithi121.stdout: "read_balance": { 2024-04-19T02:16:27.420 INFO:teuthology.orchestra.run.smithi121.stdout: "score_acting": 1.5, 2024-04-19T02:16:27.420 INFO:teuthology.orchestra.run.smithi121.stdout: "score_stable": 1.5, 2024-04-19T02:16:27.420 INFO:teuthology.orchestra.run.smithi121.stdout: "optimal_score": 1, 2024-04-19T02:16:27.420 INFO:teuthology.orchestra.run.smithi121.stdout: "raw_score_acting": 1.5, 2024-04-19T02:16:27.420 INFO:teuthology.orchestra.run.smithi121.stdout: "raw_score_stable": 1.5, 2024-04-19T02:16:27.420 INFO:teuthology.orchestra.run.smithi121.stdout: "primary_affinity_weighted": 0.90409350395202637, 2024-04-19T02:16:27.420 INFO:teuthology.orchestra.run.smithi121.stdout: "average_primary_affinity": 0.89999997615814209, 2024-04-19T02:16:27.421 INFO:teuthology.orchestra.run.smithi121.stdout: "average_primary_affinity_weighted": 0.89999997615814209 2024-04-19T02:16:27.421 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:27.421 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:27.421 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:27.421 INFO:teuthology.orchestra.run.smithi121.stdout: "pool": 3, 2024-04-19T02:16:27.421 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_name": "cephfs_metadata", 2024-04-19T02:16:27.421 INFO:teuthology.orchestra.run.smithi121.stdout: "create_time": "2024-04-19T02:15:27.675087+0000", 2024-04-19T02:16:27.421 INFO:teuthology.orchestra.run.smithi121.stdout: "flags": 1, 2024-04-19T02:16:27.421 INFO:teuthology.orchestra.run.smithi121.stdout: "flags_names": "hashpspool", 2024-04-19T02:16:27.421 INFO:teuthology.orchestra.run.smithi121.stdout: "type": 1, 2024-04-19T02:16:27.421 INFO:teuthology.orchestra.run.smithi121.stdout: "size": 2, 2024-04-19T02:16:27.421 INFO:teuthology.orchestra.run.smithi121.stdout: "min_size": 1, 2024-04-19T02:16:27.421 INFO:teuthology.orchestra.run.smithi121.stdout: "crush_rule": 0, 2024-04-19T02:16:27.421 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_count": 0, 2024-04-19T02:16:27.421 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_target": 0, 2024-04-19T02:16:27.422 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T02:16:27.422 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T02:16:27.422 INFO:teuthology.orchestra.run.smithi121.stdout: "object_hash": 2, 2024-04-19T02:16:27.422 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_autoscale_mode": "off", 2024-04-19T02:16:27.422 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num": 32, 2024-04-19T02:16:27.422 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_placement_num": 32, 2024-04-19T02:16:27.422 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_placement_num_target": 32, 2024-04-19T02:16:27.422 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_target": 32, 2024-04-19T02:16:27.422 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_pending": 32, 2024-04-19T02:16:27.422 INFO:teuthology.orchestra.run.smithi121.stdout: "last_pg_merge_meta": { 2024-04-19T02:16:27.422 INFO:teuthology.orchestra.run.smithi121.stdout: "source_pgid": "0.0", 2024-04-19T02:16:27.422 INFO:teuthology.orchestra.run.smithi121.stdout: "ready_epoch": 0, 2024-04-19T02:16:27.422 INFO:teuthology.orchestra.run.smithi121.stdout: "last_epoch_started": 0, 2024-04-19T02:16:27.422 INFO:teuthology.orchestra.run.smithi121.stdout: "last_epoch_clean": 0, 2024-04-19T02:16:27.422 INFO:teuthology.orchestra.run.smithi121.stdout: "source_version": "0'0", 2024-04-19T02:16:27.423 INFO:teuthology.orchestra.run.smithi121.stdout: "target_version": "0'0" 2024-04-19T02:16:27.423 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:27.423 INFO:teuthology.orchestra.run.smithi121.stdout: "last_change": "14", 2024-04-19T02:16:27.423 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend": "0", 2024-04-19T02:16:27.423 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T02:16:27.423 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T02:16:27.423 INFO:teuthology.orchestra.run.smithi121.stdout: "auid": 0, 2024-04-19T02:16:27.423 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_mode": "selfmanaged", 2024-04-19T02:16:27.423 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_seq": 0, 2024-04-19T02:16:27.423 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_epoch": 0, 2024-04-19T02:16:27.423 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_snaps": [], 2024-04-19T02:16:27.423 INFO:teuthology.orchestra.run.smithi121.stdout: "removed_snaps": "[]", 2024-04-19T02:16:27.423 INFO:teuthology.orchestra.run.smithi121.stdout: "quota_max_bytes": 0, 2024-04-19T02:16:27.423 INFO:teuthology.orchestra.run.smithi121.stdout: "quota_max_objects": 0, 2024-04-19T02:16:27.424 INFO:teuthology.orchestra.run.smithi121.stdout: "tiers": [], 2024-04-19T02:16:27.424 INFO:teuthology.orchestra.run.smithi121.stdout: "tier_of": -1, 2024-04-19T02:16:27.424 INFO:teuthology.orchestra.run.smithi121.stdout: "read_tier": -1, 2024-04-19T02:16:27.424 INFO:teuthology.orchestra.run.smithi121.stdout: "write_tier": -1, 2024-04-19T02:16:27.424 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_mode": "none", 2024-04-19T02:16:27.424 INFO:teuthology.orchestra.run.smithi121.stdout: "target_max_bytes": 0, 2024-04-19T02:16:27.424 INFO:teuthology.orchestra.run.smithi121.stdout: "target_max_objects": 0, 2024-04-19T02:16:27.424 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T02:16:27.424 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T02:16:27.424 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T02:16:27.424 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_min_flush_age": 0, 2024-04-19T02:16:27.424 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_min_evict_age": 0, 2024-04-19T02:16:27.424 INFO:teuthology.orchestra.run.smithi121.stdout: "erasure_code_profile": "", 2024-04-19T02:16:27.424 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_params": { 2024-04-19T02:16:27.424 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "none" 2024-04-19T02:16:27.425 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:27.425 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_period": 0, 2024-04-19T02:16:27.425 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_count": 0, 2024-04-19T02:16:27.425 INFO:teuthology.orchestra.run.smithi121.stdout: "use_gmt_hitset": true, 2024-04-19T02:16:27.425 INFO:teuthology.orchestra.run.smithi121.stdout: "min_read_recency_for_promote": 0, 2024-04-19T02:16:27.425 INFO:teuthology.orchestra.run.smithi121.stdout: "min_write_recency_for_promote": 0, 2024-04-19T02:16:27.425 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T02:16:27.425 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_search_last_n": 0, 2024-04-19T02:16:27.425 INFO:teuthology.orchestra.run.smithi121.stdout: "grade_table": [], 2024-04-19T02:16:27.425 INFO:teuthology.orchestra.run.smithi121.stdout: "stripe_width": 0, 2024-04-19T02:16:27.425 INFO:teuthology.orchestra.run.smithi121.stdout: "expected_num_objects": 0, 2024-04-19T02:16:27.425 INFO:teuthology.orchestra.run.smithi121.stdout: "fast_read": false, 2024-04-19T02:16:27.425 INFO:teuthology.orchestra.run.smithi121.stdout: "options": { 2024-04-19T02:16:27.425 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_autoscale_bias": 4, 2024-04-19T02:16:27.425 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_min": 16, 2024-04-19T02:16:27.426 INFO:teuthology.orchestra.run.smithi121.stdout: "recovery_priority": 5 2024-04-19T02:16:27.426 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:27.426 INFO:teuthology.orchestra.run.smithi121.stdout: "application_metadata": { 2024-04-19T02:16:27.426 INFO:teuthology.orchestra.run.smithi121.stdout: "cephfs": { 2024-04-19T02:16:27.426 INFO:teuthology.orchestra.run.smithi121.stdout: "metadata": "cephfs" 2024-04-19T02:16:27.426 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:27.427 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:27.427 INFO:teuthology.orchestra.run.smithi121.stdout: "read_balance": { 2024-04-19T02:16:27.427 INFO:teuthology.orchestra.run.smithi121.stdout: "score_acting": 1.2200000286102295, 2024-04-19T02:16:27.427 INFO:teuthology.orchestra.run.smithi121.stdout: "score_stable": 1.2200000286102295, 2024-04-19T02:16:27.427 INFO:teuthology.orchestra.run.smithi121.stdout: "optimal_score": 1, 2024-04-19T02:16:27.427 INFO:teuthology.orchestra.run.smithi121.stdout: "raw_score_acting": 1.2200000286102295, 2024-04-19T02:16:27.427 INFO:teuthology.orchestra.run.smithi121.stdout: "raw_score_stable": 1.2200000286102295, 2024-04-19T02:16:27.428 INFO:teuthology.orchestra.run.smithi121.stdout: "primary_affinity_weighted": 0.90409350395202637, 2024-04-19T02:16:27.428 INFO:teuthology.orchestra.run.smithi121.stdout: "average_primary_affinity": 0.89999997615814209, 2024-04-19T02:16:27.428 INFO:teuthology.orchestra.run.smithi121.stdout: "average_primary_affinity_weighted": 0.89999997615814209 2024-04-19T02:16:27.428 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:27.428 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:27.428 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:27.428 INFO:teuthology.orchestra.run.smithi121.stdout: "pool": 4, 2024-04-19T02:16:27.428 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_name": "cephfs_data", 2024-04-19T02:16:27.429 INFO:teuthology.orchestra.run.smithi121.stdout: "create_time": "2024-04-19T02:15:28.232224+0000", 2024-04-19T02:16:27.429 INFO:teuthology.orchestra.run.smithi121.stdout: "flags": 1, 2024-04-19T02:16:27.429 INFO:teuthology.orchestra.run.smithi121.stdout: "flags_names": "hashpspool", 2024-04-19T02:16:27.429 INFO:teuthology.orchestra.run.smithi121.stdout: "type": 1, 2024-04-19T02:16:27.429 INFO:teuthology.orchestra.run.smithi121.stdout: "size": 2, 2024-04-19T02:16:27.429 INFO:teuthology.orchestra.run.smithi121.stdout: "min_size": 1, 2024-04-19T02:16:27.429 INFO:teuthology.orchestra.run.smithi121.stdout: "crush_rule": 0, 2024-04-19T02:16:27.429 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_count": 0, 2024-04-19T02:16:27.430 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_target": 0, 2024-04-19T02:16:27.430 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T02:16:27.430 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T02:16:27.430 INFO:teuthology.orchestra.run.smithi121.stdout: "object_hash": 2, 2024-04-19T02:16:27.430 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_autoscale_mode": "off", 2024-04-19T02:16:27.430 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num": 64, 2024-04-19T02:16:27.430 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_placement_num": 64, 2024-04-19T02:16:27.430 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_placement_num_target": 64, 2024-04-19T02:16:27.431 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_target": 64, 2024-04-19T02:16:27.431 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_pending": 64, 2024-04-19T02:16:27.431 INFO:teuthology.orchestra.run.smithi121.stdout: "last_pg_merge_meta": { 2024-04-19T02:16:27.431 INFO:teuthology.orchestra.run.smithi121.stdout: "source_pgid": "0.0", 2024-04-19T02:16:27.431 INFO:teuthology.orchestra.run.smithi121.stdout: "ready_epoch": 0, 2024-04-19T02:16:27.431 INFO:teuthology.orchestra.run.smithi121.stdout: "last_epoch_started": 0, 2024-04-19T02:16:27.431 INFO:teuthology.orchestra.run.smithi121.stdout: "last_epoch_clean": 0, 2024-04-19T02:16:27.431 INFO:teuthology.orchestra.run.smithi121.stdout: "source_version": "0'0", 2024-04-19T02:16:27.432 INFO:teuthology.orchestra.run.smithi121.stdout: "target_version": "0'0" 2024-04-19T02:16:27.432 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:27.432 INFO:teuthology.orchestra.run.smithi121.stdout: "last_change": "15", 2024-04-19T02:16:27.432 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend": "0", 2024-04-19T02:16:27.432 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T02:16:27.432 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T02:16:27.432 INFO:teuthology.orchestra.run.smithi121.stdout: "auid": 0, 2024-04-19T02:16:27.432 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_mode": "selfmanaged", 2024-04-19T02:16:27.433 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_seq": 0, 2024-04-19T02:16:27.433 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_epoch": 0, 2024-04-19T02:16:27.433 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_snaps": [], 2024-04-19T02:16:27.433 INFO:teuthology.orchestra.run.smithi121.stdout: "removed_snaps": "[]", 2024-04-19T02:16:27.433 INFO:teuthology.orchestra.run.smithi121.stdout: "quota_max_bytes": 0, 2024-04-19T02:16:27.433 INFO:teuthology.orchestra.run.smithi121.stdout: "quota_max_objects": 0, 2024-04-19T02:16:27.433 INFO:teuthology.orchestra.run.smithi121.stdout: "tiers": [], 2024-04-19T02:16:27.433 INFO:teuthology.orchestra.run.smithi121.stdout: "tier_of": -1, 2024-04-19T02:16:27.433 INFO:teuthology.orchestra.run.smithi121.stdout: "read_tier": -1, 2024-04-19T02:16:27.434 INFO:teuthology.orchestra.run.smithi121.stdout: "write_tier": -1, 2024-04-19T02:16:27.434 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_mode": "none", 2024-04-19T02:16:27.434 INFO:teuthology.orchestra.run.smithi121.stdout: "target_max_bytes": 0, 2024-04-19T02:16:27.434 INFO:teuthology.orchestra.run.smithi121.stdout: "target_max_objects": 0, 2024-04-19T02:16:27.434 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T02:16:27.434 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T02:16:27.434 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T02:16:27.434 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_min_flush_age": 0, 2024-04-19T02:16:27.434 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_min_evict_age": 0, 2024-04-19T02:16:27.434 INFO:teuthology.orchestra.run.smithi121.stdout: "erasure_code_profile": "", 2024-04-19T02:16:27.434 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_params": { 2024-04-19T02:16:27.434 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "none" 2024-04-19T02:16:27.434 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:27.434 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_period": 0, 2024-04-19T02:16:27.435 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_count": 0, 2024-04-19T02:16:27.435 INFO:teuthology.orchestra.run.smithi121.stdout: "use_gmt_hitset": true, 2024-04-19T02:16:27.435 INFO:teuthology.orchestra.run.smithi121.stdout: "min_read_recency_for_promote": 0, 2024-04-19T02:16:27.435 INFO:teuthology.orchestra.run.smithi121.stdout: "min_write_recency_for_promote": 0, 2024-04-19T02:16:27.435 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T02:16:27.435 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_search_last_n": 0, 2024-04-19T02:16:27.435 INFO:teuthology.orchestra.run.smithi121.stdout: "grade_table": [], 2024-04-19T02:16:27.435 INFO:teuthology.orchestra.run.smithi121.stdout: "stripe_width": 0, 2024-04-19T02:16:27.435 INFO:teuthology.orchestra.run.smithi121.stdout: "expected_num_objects": 0, 2024-04-19T02:16:27.435 INFO:teuthology.orchestra.run.smithi121.stdout: "fast_read": false, 2024-04-19T02:16:27.435 INFO:teuthology.orchestra.run.smithi121.stdout: "options": { 2024-04-19T02:16:27.435 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_min": 64, 2024-04-19T02:16:27.435 INFO:teuthology.orchestra.run.smithi121.stdout: "target_size_ratio": 0.89999997615814209 2024-04-19T02:16:27.435 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:27.436 INFO:teuthology.orchestra.run.smithi121.stdout: "application_metadata": { 2024-04-19T02:16:27.436 INFO:teuthology.orchestra.run.smithi121.stdout: "cephfs": { 2024-04-19T02:16:27.436 INFO:teuthology.orchestra.run.smithi121.stdout: "data": "cephfs" 2024-04-19T02:16:27.436 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:27.436 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:27.436 INFO:teuthology.orchestra.run.smithi121.stdout: "read_balance": { 2024-04-19T02:16:27.436 INFO:teuthology.orchestra.run.smithi121.stdout: "score_acting": 1.1699999570846558, 2024-04-19T02:16:27.436 INFO:teuthology.orchestra.run.smithi121.stdout: "score_stable": 1.1699999570846558, 2024-04-19T02:16:27.436 INFO:teuthology.orchestra.run.smithi121.stdout: "optimal_score": 1, 2024-04-19T02:16:27.436 INFO:teuthology.orchestra.run.smithi121.stdout: "raw_score_acting": 1.1699999570846558, 2024-04-19T02:16:27.436 INFO:teuthology.orchestra.run.smithi121.stdout: "raw_score_stable": 1.1699999570846558, 2024-04-19T02:16:27.436 INFO:teuthology.orchestra.run.smithi121.stdout: "primary_affinity_weighted": 0.90409350395202637, 2024-04-19T02:16:27.436 INFO:teuthology.orchestra.run.smithi121.stdout: "average_primary_affinity": 0.89999997615814209, 2024-04-19T02:16:27.436 INFO:teuthology.orchestra.run.smithi121.stdout: "average_primary_affinity_weighted": 0.89999997615814209 2024-04-19T02:16:27.436 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:27.437 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:27.437 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:27.437 INFO:teuthology.orchestra.run.smithi121.stdout: "pool": 5, 2024-04-19T02:16:27.437 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_name": "unique_pool_0", 2024-04-19T02:16:27.437 INFO:teuthology.orchestra.run.smithi121.stdout: "create_time": "2024-04-19T02:15:52.929114+0000", 2024-04-19T02:16:27.437 INFO:teuthology.orchestra.run.smithi121.stdout: "flags": 1, 2024-04-19T02:16:27.437 INFO:teuthology.orchestra.run.smithi121.stdout: "flags_names": "hashpspool", 2024-04-19T02:16:27.437 INFO:teuthology.orchestra.run.smithi121.stdout: "type": 1, 2024-04-19T02:16:27.437 INFO:teuthology.orchestra.run.smithi121.stdout: "size": 2, 2024-04-19T02:16:27.437 INFO:teuthology.orchestra.run.smithi121.stdout: "min_size": 1, 2024-04-19T02:16:27.437 INFO:teuthology.orchestra.run.smithi121.stdout: "crush_rule": 0, 2024-04-19T02:16:27.437 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_count": 0, 2024-04-19T02:16:27.437 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_target": 0, 2024-04-19T02:16:27.437 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T02:16:27.437 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T02:16:27.438 INFO:teuthology.orchestra.run.smithi121.stdout: "object_hash": 2, 2024-04-19T02:16:27.438 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_autoscale_mode": "off", 2024-04-19T02:16:27.438 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num": 16, 2024-04-19T02:16:27.438 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_placement_num": 16, 2024-04-19T02:16:27.438 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_placement_num_target": 16, 2024-04-19T02:16:27.438 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_target": 16, 2024-04-19T02:16:27.438 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_pending": 16, 2024-04-19T02:16:27.438 INFO:teuthology.orchestra.run.smithi121.stdout: "last_pg_merge_meta": { 2024-04-19T02:16:27.438 INFO:teuthology.orchestra.run.smithi121.stdout: "source_pgid": "0.0", 2024-04-19T02:16:27.438 INFO:teuthology.orchestra.run.smithi121.stdout: "ready_epoch": 0, 2024-04-19T02:16:27.439 INFO:teuthology.orchestra.run.smithi121.stdout: "last_epoch_started": 0, 2024-04-19T02:16:27.439 INFO:teuthology.orchestra.run.smithi121.stdout: "last_epoch_clean": 0, 2024-04-19T02:16:27.439 INFO:teuthology.orchestra.run.smithi121.stdout: "source_version": "0'0", 2024-04-19T02:16:27.439 INFO:teuthology.orchestra.run.smithi121.stdout: "target_version": "0'0" 2024-04-19T02:16:27.439 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:27.439 INFO:teuthology.orchestra.run.smithi121.stdout: "last_change": "18", 2024-04-19T02:16:27.440 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend": "0", 2024-04-19T02:16:27.440 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T02:16:27.440 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T02:16:27.440 INFO:teuthology.orchestra.run.smithi121.stdout: "auid": 0, 2024-04-19T02:16:27.440 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_mode": "selfmanaged", 2024-04-19T02:16:27.440 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_seq": 0, 2024-04-19T02:16:27.441 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_epoch": 0, 2024-04-19T02:16:27.441 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_snaps": [], 2024-04-19T02:16:27.441 INFO:teuthology.orchestra.run.smithi121.stdout: "removed_snaps": "[]", 2024-04-19T02:16:27.441 INFO:teuthology.orchestra.run.smithi121.stdout: "quota_max_bytes": 0, 2024-04-19T02:16:27.441 INFO:teuthology.orchestra.run.smithi121.stdout: "quota_max_objects": 0, 2024-04-19T02:16:27.441 INFO:teuthology.orchestra.run.smithi121.stdout: "tiers": [], 2024-04-19T02:16:27.441 INFO:teuthology.orchestra.run.smithi121.stdout: "tier_of": -1, 2024-04-19T02:16:27.442 INFO:teuthology.orchestra.run.smithi121.stdout: "read_tier": -1, 2024-04-19T02:16:27.442 INFO:teuthology.orchestra.run.smithi121.stdout: "write_tier": -1, 2024-04-19T02:16:27.442 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_mode": "none", 2024-04-19T02:16:27.442 INFO:teuthology.orchestra.run.smithi121.stdout: "target_max_bytes": 0, 2024-04-19T02:16:27.442 INFO:teuthology.orchestra.run.smithi121.stdout: "target_max_objects": 0, 2024-04-19T02:16:27.443 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T02:16:27.443 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T02:16:27.443 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T02:16:27.443 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_min_flush_age": 0, 2024-04-19T02:16:27.443 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_min_evict_age": 0, 2024-04-19T02:16:27.443 INFO:teuthology.orchestra.run.smithi121.stdout: "erasure_code_profile": "", 2024-04-19T02:16:27.443 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_params": { 2024-04-19T02:16:27.443 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "none" 2024-04-19T02:16:27.444 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:27.444 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_period": 0, 2024-04-19T02:16:27.444 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_count": 0, 2024-04-19T02:16:27.444 INFO:teuthology.orchestra.run.smithi121.stdout: "use_gmt_hitset": true, 2024-04-19T02:16:27.444 INFO:teuthology.orchestra.run.smithi121.stdout: "min_read_recency_for_promote": 0, 2024-04-19T02:16:27.444 INFO:teuthology.orchestra.run.smithi121.stdout: "min_write_recency_for_promote": 0, 2024-04-19T02:16:27.445 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T02:16:27.445 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_search_last_n": 0, 2024-04-19T02:16:27.445 INFO:teuthology.orchestra.run.smithi121.stdout: "grade_table": [], 2024-04-19T02:16:27.445 INFO:teuthology.orchestra.run.smithi121.stdout: "stripe_width": 0, 2024-04-19T02:16:27.445 INFO:teuthology.orchestra.run.smithi121.stdout: "expected_num_objects": 0, 2024-04-19T02:16:27.445 INFO:teuthology.orchestra.run.smithi121.stdout: "fast_read": false, 2024-04-19T02:16:27.446 INFO:teuthology.orchestra.run.smithi121.stdout: "options": {}, 2024-04-19T02:16:27.446 INFO:teuthology.orchestra.run.smithi121.stdout: "application_metadata": { 2024-04-19T02:16:27.446 INFO:teuthology.orchestra.run.smithi121.stdout: "rados": {} 2024-04-19T02:16:27.446 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:27.446 INFO:teuthology.orchestra.run.smithi121.stdout: "read_balance": { 2024-04-19T02:16:27.447 INFO:teuthology.orchestra.run.smithi121.stdout: "score_acting": 1.1299999952316284, 2024-04-19T02:16:27.447 INFO:teuthology.orchestra.run.smithi121.stdout: "score_stable": 1.1299999952316284, 2024-04-19T02:16:27.447 INFO:teuthology.orchestra.run.smithi121.stdout: "optimal_score": 1, 2024-04-19T02:16:27.447 INFO:teuthology.orchestra.run.smithi121.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-19T02:16:27.447 INFO:teuthology.orchestra.run.smithi121.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-19T02:16:27.447 INFO:teuthology.orchestra.run.smithi121.stdout: "primary_affinity_weighted": 0.90409350395202637, 2024-04-19T02:16:27.448 INFO:teuthology.orchestra.run.smithi121.stdout: "average_primary_affinity": 0.89999997615814209, 2024-04-19T02:16:27.448 INFO:teuthology.orchestra.run.smithi121.stdout: "average_primary_affinity_weighted": 0.89999997615814209 2024-04-19T02:16:27.448 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:27.448 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:27.448 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-04-19T02:16:27.448 INFO:teuthology.orchestra.run.smithi121.stdout: "osds": [ 2024-04-19T02:16:27.449 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:27.449 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": 0, 2024-04-19T02:16:27.449 INFO:teuthology.orchestra.run.smithi121.stdout: "uuid": "88cb15f3-271c-43d5-af51-1cd26b8ed13c", 2024-04-19T02:16:27.449 INFO:teuthology.orchestra.run.smithi121.stdout: "up": 1, 2024-04-19T02:16:27.449 INFO:teuthology.orchestra.run.smithi121.stdout: "in": 1, 2024-04-19T02:16:27.449 INFO:teuthology.orchestra.run.smithi121.stdout: "weight": 1, 2024-04-19T02:16:27.450 INFO:teuthology.orchestra.run.smithi121.stdout: "primary_affinity": 1, 2024-04-19T02:16:27.450 INFO:teuthology.orchestra.run.smithi121.stdout: "last_clean_begin": 0, 2024-04-19T02:16:27.450 INFO:teuthology.orchestra.run.smithi121.stdout: "last_clean_end": 0, 2024-04-19T02:16:27.450 INFO:teuthology.orchestra.run.smithi121.stdout: "up_from": 8, 2024-04-19T02:16:27.450 INFO:teuthology.orchestra.run.smithi121.stdout: "up_thru": 16, 2024-04-19T02:16:27.451 INFO:teuthology.orchestra.run.smithi121.stdout: "down_at": 0, 2024-04-19T02:16:27.451 INFO:teuthology.orchestra.run.smithi121.stdout: "lost_at": 0, 2024-04-19T02:16:27.451 INFO:teuthology.orchestra.run.smithi121.stdout: "public_addrs": { 2024-04-19T02:16:27.451 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:16:27.451 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:27.451 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:16:27.452 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.153:6800", 2024-04-19T02:16:27.452 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41347 2024-04-19T02:16:27.452 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:27.452 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:27.453 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:16:27.453 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.153:6801", 2024-04-19T02:16:27.453 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41347 2024-04-19T02:16:27.453 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:27.453 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:16:27.453 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:27.453 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_addrs": { 2024-04-19T02:16:27.454 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:16:27.454 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:27.454 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:16:27.454 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.153:6802", 2024-04-19T02:16:27.454 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41347 2024-04-19T02:16:27.454 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:27.455 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:27.455 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:16:27.455 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.153:6803", 2024-04-19T02:16:27.455 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41347 2024-04-19T02:16:27.455 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:27.456 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:16:27.456 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:27.456 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_back_addrs": { 2024-04-19T02:16:27.456 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:16:27.456 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:27.456 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:16:27.456 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.153:6806", 2024-04-19T02:16:27.457 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41347 2024-04-19T02:16:27.457 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:27.457 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:27.457 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:16:27.457 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.153:6807", 2024-04-19T02:16:27.458 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41347 2024-04-19T02:16:27.458 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:27.458 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:16:27.458 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:27.458 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_front_addrs": { 2024-04-19T02:16:27.458 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:16:27.458 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:27.459 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:16:27.459 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.153:6804", 2024-04-19T02:16:27.459 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41347 2024-04-19T02:16:27.459 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:27.459 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:27.459 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:16:27.459 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.153:6805", 2024-04-19T02:16:27.459 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41347 2024-04-19T02:16:27.459 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:27.459 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:16:27.459 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:27.460 INFO:teuthology.orchestra.run.smithi121.stdout: "public_addr": "172.21.15.153:6801/41347", 2024-04-19T02:16:27.460 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_addr": "172.21.15.153:6803/41347", 2024-04-19T02:16:27.460 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_back_addr": "172.21.15.153:6807/41347", 2024-04-19T02:16:27.460 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_front_addr": "172.21.15.153:6805/41347", 2024-04-19T02:16:27.460 INFO:teuthology.orchestra.run.smithi121.stdout: "state": [ 2024-04-19T02:16:27.460 INFO:teuthology.orchestra.run.smithi121.stdout: "exists", 2024-04-19T02:16:27.460 INFO:teuthology.orchestra.run.smithi121.stdout: "up" 2024-04-19T02:16:27.460 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:16:27.460 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:27.460 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:27.460 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": 1, 2024-04-19T02:16:27.461 INFO:teuthology.orchestra.run.smithi121.stdout: "uuid": "2674869a-db01-4d9f-a496-9fb3851b5b21", 2024-04-19T02:16:27.461 INFO:teuthology.orchestra.run.smithi121.stdout: "up": 1, 2024-04-19T02:16:27.461 INFO:teuthology.orchestra.run.smithi121.stdout: "in": 1, 2024-04-19T02:16:27.461 INFO:teuthology.orchestra.run.smithi121.stdout: "weight": 1, 2024-04-19T02:16:27.461 INFO:teuthology.orchestra.run.smithi121.stdout: "primary_affinity": 0.7122802734375, 2024-04-19T02:16:27.461 INFO:teuthology.orchestra.run.smithi121.stdout: "last_clean_begin": 0, 2024-04-19T02:16:27.461 INFO:teuthology.orchestra.run.smithi121.stdout: "last_clean_end": 0, 2024-04-19T02:16:27.461 INFO:teuthology.orchestra.run.smithi121.stdout: "up_from": 8, 2024-04-19T02:16:27.461 INFO:teuthology.orchestra.run.smithi121.stdout: "up_thru": 16, 2024-04-19T02:16:27.461 INFO:teuthology.orchestra.run.smithi121.stdout: "down_at": 0, 2024-04-19T02:16:27.461 INFO:teuthology.orchestra.run.smithi121.stdout: "lost_at": 0, 2024-04-19T02:16:27.462 INFO:teuthology.orchestra.run.smithi121.stdout: "public_addrs": { 2024-04-19T02:16:27.462 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:16:27.462 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:27.462 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:16:27.462 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.174:6800", 2024-04-19T02:16:27.462 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41380 2024-04-19T02:16:27.462 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:27.462 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:27.463 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:16:27.463 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.174:6801", 2024-04-19T02:16:27.463 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41380 2024-04-19T02:16:27.463 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:27.463 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:16:27.463 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:27.463 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_addrs": { 2024-04-19T02:16:27.463 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:16:27.464 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:27.464 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:16:27.464 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.174:6802", 2024-04-19T02:16:27.464 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41380 2024-04-19T02:16:27.464 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:27.464 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:27.464 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:16:27.464 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.174:6803", 2024-04-19T02:16:27.465 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41380 2024-04-19T02:16:27.465 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:27.465 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:16:27.465 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:27.465 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_back_addrs": { 2024-04-19T02:16:27.465 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:16:27.465 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:27.465 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:16:27.466 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.174:6806", 2024-04-19T02:16:27.466 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41380 2024-04-19T02:16:27.466 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:27.466 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:27.466 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:16:27.466 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.174:6807", 2024-04-19T02:16:27.467 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41380 2024-04-19T02:16:27.467 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:27.467 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:16:27.467 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:27.467 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_front_addrs": { 2024-04-19T02:16:27.467 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:16:27.467 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:27.467 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:16:27.467 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.174:6804", 2024-04-19T02:16:27.468 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41380 2024-04-19T02:16:27.468 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:27.468 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:27.469 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:16:27.470 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.174:6805", 2024-04-19T02:16:27.470 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41380 2024-04-19T02:16:27.470 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:27.470 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:16:27.470 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:27.470 INFO:teuthology.orchestra.run.smithi121.stdout: "public_addr": "172.21.15.174:6801/41380", 2024-04-19T02:16:27.471 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_addr": "172.21.15.174:6803/41380", 2024-04-19T02:16:27.471 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_back_addr": "172.21.15.174:6807/41380", 2024-04-19T02:16:27.471 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_front_addr": "172.21.15.174:6805/41380", 2024-04-19T02:16:27.471 INFO:teuthology.orchestra.run.smithi121.stdout: "state": [ 2024-04-19T02:16:27.471 INFO:teuthology.orchestra.run.smithi121.stdout: "exists", 2024-04-19T02:16:27.471 INFO:teuthology.orchestra.run.smithi121.stdout: "up" 2024-04-19T02:16:27.471 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:16:27.472 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:27.472 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:27.472 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": 2, 2024-04-19T02:16:27.472 INFO:teuthology.orchestra.run.smithi121.stdout: "uuid": "712ad943-2f98-49d9-aabe-f66b509be633", 2024-04-19T02:16:27.472 INFO:teuthology.orchestra.run.smithi121.stdout: "up": 1, 2024-04-19T02:16:27.472 INFO:teuthology.orchestra.run.smithi121.stdout: "in": 1, 2024-04-19T02:16:27.472 INFO:teuthology.orchestra.run.smithi121.stdout: "weight": 1, 2024-04-19T02:16:27.472 INFO:teuthology.orchestra.run.smithi121.stdout: "primary_affinity": 1, 2024-04-19T02:16:27.472 INFO:teuthology.orchestra.run.smithi121.stdout: "last_clean_begin": 0, 2024-04-19T02:16:27.473 INFO:teuthology.orchestra.run.smithi121.stdout: "last_clean_end": 0, 2024-04-19T02:16:27.473 INFO:teuthology.orchestra.run.smithi121.stdout: "up_from": 8, 2024-04-19T02:16:27.473 INFO:teuthology.orchestra.run.smithi121.stdout: "up_thru": 29, 2024-04-19T02:16:27.473 INFO:teuthology.orchestra.run.smithi121.stdout: "down_at": 0, 2024-04-19T02:16:27.473 INFO:teuthology.orchestra.run.smithi121.stdout: "lost_at": 0, 2024-04-19T02:16:27.473 INFO:teuthology.orchestra.run.smithi121.stdout: "public_addrs": { 2024-04-19T02:16:27.474 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:16:27.474 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:27.474 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:16:27.474 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.177:6800", 2024-04-19T02:16:27.474 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41508 2024-04-19T02:16:27.474 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:27.474 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:27.475 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:16:27.475 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.177:6801", 2024-04-19T02:16:27.475 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41508 2024-04-19T02:16:27.475 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:27.475 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:16:27.475 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:27.476 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_addrs": { 2024-04-19T02:16:27.476 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:16:27.476 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:27.476 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:16:27.476 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.177:6802", 2024-04-19T02:16:27.476 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41508 2024-04-19T02:16:27.476 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:27.476 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:27.476 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:16:27.476 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.177:6803", 2024-04-19T02:16:27.476 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41508 2024-04-19T02:16:27.476 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:27.477 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:16:27.477 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:27.477 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_back_addrs": { 2024-04-19T02:16:27.477 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:16:27.477 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:27.477 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:16:27.477 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.177:6806", 2024-04-19T02:16:27.477 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41508 2024-04-19T02:16:27.477 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:27.477 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:27.477 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:16:27.477 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.177:6807", 2024-04-19T02:16:27.477 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41508 2024-04-19T02:16:27.477 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:27.477 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:16:27.477 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:27.478 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_front_addrs": { 2024-04-19T02:16:27.478 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:16:27.478 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:27.478 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:16:27.478 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.177:6804", 2024-04-19T02:16:27.478 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41508 2024-04-19T02:16:27.478 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:27.478 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:27.478 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:16:27.478 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.177:6805", 2024-04-19T02:16:27.478 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41508 2024-04-19T02:16:27.478 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:27.478 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:16:27.479 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:27.479 INFO:teuthology.orchestra.run.smithi121.stdout: "public_addr": "172.21.15.177:6801/41508", 2024-04-19T02:16:27.479 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_addr": "172.21.15.177:6803/41508", 2024-04-19T02:16:27.479 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_back_addr": "172.21.15.177:6807/41508", 2024-04-19T02:16:27.479 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_front_addr": "172.21.15.177:6805/41508", 2024-04-19T02:16:27.479 INFO:teuthology.orchestra.run.smithi121.stdout: "state": [ 2024-04-19T02:16:27.479 INFO:teuthology.orchestra.run.smithi121.stdout: "exists", 2024-04-19T02:16:27.479 INFO:teuthology.orchestra.run.smithi121.stdout: "up" 2024-04-19T02:16:27.479 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:16:27.479 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:27.479 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-04-19T02:16:27.479 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_xinfo": [ 2024-04-19T02:16:27.479 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:27.479 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": 0, 2024-04-19T02:16:27.479 INFO:teuthology.orchestra.run.smithi121.stdout: "down_stamp": "0.000000", 2024-04-19T02:16:27.480 INFO:teuthology.orchestra.run.smithi121.stdout: "laggy_probability": 0, 2024-04-19T02:16:27.480 INFO:teuthology.orchestra.run.smithi121.stdout: "laggy_interval": 0, 2024-04-19T02:16:27.480 INFO:teuthology.orchestra.run.smithi121.stdout: "features": 4540138322906710015, 2024-04-19T02:16:27.480 INFO:teuthology.orchestra.run.smithi121.stdout: "old_weight": 0, 2024-04-19T02:16:27.480 INFO:teuthology.orchestra.run.smithi121.stdout: "last_purged_snaps_scrub": "2024-04-19T02:15:20.495280+0000", 2024-04-19T02:16:27.480 INFO:teuthology.orchestra.run.smithi121.stdout: "dead_epoch": 0 2024-04-19T02:16:27.480 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:27.480 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:27.480 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": 1, 2024-04-19T02:16:27.480 INFO:teuthology.orchestra.run.smithi121.stdout: "down_stamp": "0.000000", 2024-04-19T02:16:27.480 INFO:teuthology.orchestra.run.smithi121.stdout: "laggy_probability": 0, 2024-04-19T02:16:27.480 INFO:teuthology.orchestra.run.smithi121.stdout: "laggy_interval": 0, 2024-04-19T02:16:27.480 INFO:teuthology.orchestra.run.smithi121.stdout: "features": 4540138322906710015, 2024-04-19T02:16:27.480 INFO:teuthology.orchestra.run.smithi121.stdout: "old_weight": 0, 2024-04-19T02:16:27.480 INFO:teuthology.orchestra.run.smithi121.stdout: "last_purged_snaps_scrub": "2024-04-19T02:15:20.594553+0000", 2024-04-19T02:16:27.481 INFO:teuthology.orchestra.run.smithi121.stdout: "dead_epoch": 0 2024-04-19T02:16:27.481 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:27.481 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:27.481 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": 2, 2024-04-19T02:16:27.481 INFO:teuthology.orchestra.run.smithi121.stdout: "down_stamp": "0.000000", 2024-04-19T02:16:27.481 INFO:teuthology.orchestra.run.smithi121.stdout: "laggy_probability": 0, 2024-04-19T02:16:27.481 INFO:teuthology.orchestra.run.smithi121.stdout: "laggy_interval": 0, 2024-04-19T02:16:27.481 INFO:teuthology.orchestra.run.smithi121.stdout: "features": 4540138322906710015, 2024-04-19T02:16:27.481 INFO:teuthology.orchestra.run.smithi121.stdout: "old_weight": 0, 2024-04-19T02:16:27.481 INFO:teuthology.orchestra.run.smithi121.stdout: "last_purged_snaps_scrub": "2024-04-19T02:15:20.524253+0000", 2024-04-19T02:16:27.482 INFO:teuthology.orchestra.run.smithi121.stdout: "dead_epoch": 0 2024-04-19T02:16:27.482 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:27.482 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-04-19T02:16:27.482 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_upmap": [ 2024-04-19T02:16:27.482 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:27.482 INFO:teuthology.orchestra.run.smithi121.stdout: "pgid": "5.1", 2024-04-19T02:16:27.483 INFO:teuthology.orchestra.run.smithi121.stdout: "osds": [ 2024-04-19T02:16:27.483 INFO:teuthology.orchestra.run.smithi121.stdout: 1, 2024-04-19T02:16:27.483 INFO:teuthology.orchestra.run.smithi121.stdout: 2 2024-04-19T02:16:27.483 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:16:27.483 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:27.484 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-04-19T02:16:27.484 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_upmap_items": [], 2024-04-19T02:16:27.484 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_upmap_primaries": [], 2024-04-19T02:16:27.484 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_temp": [ 2024-04-19T02:16:27.484 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:16:27.484 INFO:teuthology.orchestra.run.smithi121.stdout: "pgid": "5.1", 2024-04-19T02:16:27.485 INFO:teuthology.orchestra.run.smithi121.stdout: "osds": [ 2024-04-19T02:16:27.485 INFO:teuthology.orchestra.run.smithi121.stdout: 2, 2024-04-19T02:16:27.485 INFO:teuthology.orchestra.run.smithi121.stdout: 0 2024-04-19T02:16:27.485 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:16:27.485 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:27.485 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-04-19T02:16:27.486 INFO:teuthology.orchestra.run.smithi121.stdout: "primary_temp": [], 2024-04-19T02:16:27.486 INFO:teuthology.orchestra.run.smithi121.stdout: "blocklist": {}, 2024-04-19T02:16:27.486 INFO:teuthology.orchestra.run.smithi121.stdout: "range_blocklist": {}, 2024-04-19T02:16:27.486 INFO:teuthology.orchestra.run.smithi121.stdout: "erasure_code_profiles": { 2024-04-19T02:16:27.486 INFO:teuthology.orchestra.run.smithi121.stdout: "default": { 2024-04-19T02:16:27.486 INFO:teuthology.orchestra.run.smithi121.stdout: "crush-failure-domain": "osd", 2024-04-19T02:16:27.488 INFO:teuthology.orchestra.run.smithi121.stdout: "k": "2", 2024-04-19T02:16:27.488 INFO:teuthology.orchestra.run.smithi121.stdout: "m": "1", 2024-04-19T02:16:27.488 INFO:teuthology.orchestra.run.smithi121.stdout: "plugin": "jerasure", 2024-04-19T02:16:27.488 INFO:teuthology.orchestra.run.smithi121.stdout: "technique": "reed_sol_van" 2024-04-19T02:16:27.488 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:27.488 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:16:27.489 INFO:teuthology.orchestra.run.smithi121.stdout: "removed_snaps_queue": [], 2024-04-19T02:16:27.489 INFO:teuthology.orchestra.run.smithi121.stdout: "new_removed_snaps": [], 2024-04-19T02:16:27.489 INFO:teuthology.orchestra.run.smithi121.stdout: "new_purged_snaps": [], 2024-04-19T02:16:27.489 INFO:teuthology.orchestra.run.smithi121.stdout: "crush_node_flags": {}, 2024-04-19T02:16:27.489 INFO:teuthology.orchestra.run.smithi121.stdout: "device_class_flags": {}, 2024-04-19T02:16:27.489 INFO:teuthology.orchestra.run.smithi121.stdout: "stretch_mode": { 2024-04-19T02:16:27.490 INFO:teuthology.orchestra.run.smithi121.stdout: "stretch_mode_enabled": false, 2024-04-19T02:16:27.490 INFO:teuthology.orchestra.run.smithi121.stdout: "stretch_bucket_count": 0, 2024-04-19T02:16:27.490 INFO:teuthology.orchestra.run.smithi121.stdout: "degraded_stretch_mode": 0, 2024-04-19T02:16:27.490 INFO:teuthology.orchestra.run.smithi121.stdout: "recovering_stretch_mode": 0, 2024-04-19T02:16:27.490 INFO:teuthology.orchestra.run.smithi121.stdout: "stretch_mode_bucket": 0 2024-04-19T02:16:27.490 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:16:27.491 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-04-19T02:16:27.494 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:27.492+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:27.496 INFO:tasks.thrashosds.thrasher:j is {'epoch': 31, 'fsid': 'f6ab5dd0-bb9f-4b48-a9fc-4728c7955ca8', 'created': '2024-04-19T02:15:13.539846+0000', 'modified': '2024-04-19T02:16:26.068602+0000', 'last_up_change': '2024-04-19T02:15:22.519568+0000', 'last_in_change': '2024-04-19T02:15:15.482624+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-19T02:15:22.776125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9040935039520264, 'average_primary_affinity': 0.8999999761581421, 'average_primary_affinity_weighted': 0.8999999761581421}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-19T02:15:23.264005+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9040935039520264, 'average_primary_affinity': 0.8999999761581421, 'average_primary_affinity_weighted': 0.8999999761581421}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-19T02:15:27.675087+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.2200000286102295, 'score_stable': 1.2200000286102295, 'optimal_score': 1, 'raw_score_acting': 1.2200000286102295, 'raw_score_stable': 1.2200000286102295, 'primary_affinity_weighted': 0.9040935039520264, 'average_primary_affinity': 0.8999999761581421, 'average_primary_affinity_weighted': 0.8999999761581421}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-19T02:15:28.232224+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1699999570846558, 'score_stable': 1.1699999570846558, 'optimal_score': 1, 'raw_score_acting': 1.1699999570846558, 'raw_score_stable': 1.1699999570846558, 'primary_affinity_weighted': 0.9040935039520264, 'average_primary_affinity': 0.8999999761581421, 'average_primary_affinity_weighted': 0.8999999761581421}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2024-04-19T02:15:52.929114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 0.9040935039520264, 'average_primary_affinity': 0.8999999761581421, 'average_primary_affinity_weighted': 0.8999999761581421}}], 'osds': [{'osd': 0, 'uuid': '88cb15f3-271c-43d5-af51-1cd26b8ed13c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6800', 'nonce': 41347}, {'type': 'v1', 'addr': '172.21.15.153:6801', 'nonce': 41347}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6802', 'nonce': 41347}, {'type': 'v1', 'addr': '172.21.15.153:6803', 'nonce': 41347}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6806', 'nonce': 41347}, {'type': 'v1', 'addr': '172.21.15.153:6807', 'nonce': 41347}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6804', 'nonce': 41347}, {'type': 'v1', 'addr': '172.21.15.153:6805', 'nonce': 41347}]}, 'public_addr': '172.21.15.153:6801/41347', 'cluster_addr': '172.21.15.153:6803/41347', 'heartbeat_back_addr': '172.21.15.153:6807/41347', 'heartbeat_front_addr': '172.21.15.153:6805/41347', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '2674869a-db01-4d9f-a496-9fb3851b5b21', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.7122802734375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6800', 'nonce': 41380}, {'type': 'v1', 'addr': '172.21.15.174:6801', 'nonce': 41380}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6802', 'nonce': 41380}, {'type': 'v1', 'addr': '172.21.15.174:6803', 'nonce': 41380}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6806', 'nonce': 41380}, {'type': 'v1', 'addr': '172.21.15.174:6807', 'nonce': 41380}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6804', 'nonce': 41380}, {'type': 'v1', 'addr': '172.21.15.174:6805', 'nonce': 41380}]}, 'public_addr': '172.21.15.174:6801/41380', 'cluster_addr': '172.21.15.174:6803/41380', 'heartbeat_back_addr': '172.21.15.174:6807/41380', 'heartbeat_front_addr': '172.21.15.174:6805/41380', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '712ad943-2f98-49d9-aabe-f66b509be633', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 29, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6800', 'nonce': 41508}, {'type': 'v1', 'addr': '172.21.15.177:6801', 'nonce': 41508}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6802', 'nonce': 41508}, {'type': 'v1', 'addr': '172.21.15.177:6803', 'nonce': 41508}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6806', 'nonce': 41508}, {'type': 'v1', 'addr': '172.21.15.177:6807', 'nonce': 41508}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6804', 'nonce': 41508}, {'type': 'v1', 'addr': '172.21.15.177:6805', 'nonce': 41508}]}, 'public_addr': '172.21.15.177:6801/41508', 'cluster_addr': '172.21.15.177:6803/41508', 'heartbeat_back_addr': '172.21.15.177:6807/41508', 'heartbeat_front_addr': '172.21.15.177:6805/41508', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-19T02:15:20.495280+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-19T02:15:20.594553+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-19T02:15:20.524253+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '5.1', 'osds': [1, 2]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [{'pgid': '5.1', 'osds': [2, 0]}], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-19T02:16:27.497 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:16:27.498 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-04-19T02:16:27.498 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 20, 2024-04-19T02:16:27.498 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 600, 2024-04-19T02:16:27.498 INFO:teuthology.orchestra.run.smithi177.stdout: "ops": [ 2024-04-19T02:16:27.499 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.499 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:2290 5.5 5:a870a399:::benchmark_data_smithi121_44835_object2289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:16:27.499 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:15:55.645524+0000", 2024-04-19T02:16:27.499 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 31.810802094, 2024-04-19T02:16:27.499 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.018181836999999999, 2024-04-19T02:16:27.499 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:27.500 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:27.500 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:27.500 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:27.500 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:27.500 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 2290 2024-04-19T02:16:27.500 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.501 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:27.501 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.501 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:27.501 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645524+0000", 2024-04-19T02:16:27.502 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:27.502 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.502 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.502 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:27.502 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645524+0000", 2024-04-19T02:16:27.503 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:27.503 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.503 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.503 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:27.503 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645524+0000", 2024-04-19T02:16:27.503 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:27.504 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.504 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.505 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:27.505 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645603+0000", 2024-04-19T02:16:27.505 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.9983999999999999e-05 2024-04-19T02:16:27.505 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.505 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.505 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:27.505 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645609+0000", 2024-04-19T02:16:27.505 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.5500000000000002e-06 2024-04-19T02:16:27.505 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.505 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.505 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:27.505 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645613+0000", 2024-04-19T02:16:27.505 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.591e-06 2024-04-19T02:16:27.506 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.506 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.506 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:27.506 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645649+0000", 2024-04-19T02:16:27.506 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6769e-05 2024-04-19T02:16:27.506 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.506 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.506 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:27.506 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645765+0000", 2024-04-19T02:16:27.506 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00011593499999999999 2024-04-19T02:16:27.506 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.506 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.506 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:27.507 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.645899+0000", 2024-04-19T02:16:27.507 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00013329499999999999 2024-04-19T02:16:27.507 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.507 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.507 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:27.507 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.649261+0000", 2024-04-19T02:16:27.507 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0033619639999999998 2024-04-19T02:16:27.507 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.507 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.507 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:27.507 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.663657+0000", 2024-04-19T02:16:27.507 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.014396137999999999 2024-04-19T02:16:27.507 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.507 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.507 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:27.508 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.663686+0000", 2024-04-19T02:16:27.508 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.8841999999999999e-05 2024-04-19T02:16:27.508 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.508 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.508 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:27.508 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:15:55.663706+0000", 2024-04-19T02:16:27.508 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.0108000000000001e-05 2024-04-19T02:16:27.508 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.508 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:27.508 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.508 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.508 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.508 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:61670 5.3 5:c5549fc1:::benchmark_data_smithi121_44835_object61669:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:27.508 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:17.409188+0000", 2024-04-19T02:16:27.509 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 10.047137745000001, 2024-04-19T02:16:27.509 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.01869871, 2024-04-19T02:16:27.509 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:27.509 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:27.509 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:27.509 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:27.509 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:27.509 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 61670 2024-04-19T02:16:27.509 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.509 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:27.509 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.509 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:27.509 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409188+0000", 2024-04-19T02:16:27.509 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:27.510 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.510 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.510 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:27.510 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409188+0000", 2024-04-19T02:16:27.510 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:27.510 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.510 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.510 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:27.510 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409188+0000", 2024-04-19T02:16:27.510 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:27.510 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.510 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.510 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:27.510 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409220+0000", 2024-04-19T02:16:27.511 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.2746999999999997e-05 2024-04-19T02:16:27.511 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.511 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.511 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:27.511 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409232+0000", 2024-04-19T02:16:27.511 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.1430999999999999e-05 2024-04-19T02:16:27.511 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.511 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.511 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:27.511 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409238+0000", 2024-04-19T02:16:27.511 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.4160000000000001e-06 2024-04-19T02:16:27.511 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.511 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.512 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:27.512 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.414159+0000", 2024-04-19T02:16:27.512 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0049206850000000002 2024-04-19T02:16:27.512 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.512 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.512 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:27.512 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.414283+0000", 2024-04-19T02:16:27.512 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000124547 2024-04-19T02:16:27.512 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.512 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.512 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:27.512 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.414439+0000", 2024-04-19T02:16:27.512 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00015586699999999999 2024-04-19T02:16:27.512 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.513 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.513 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:27.513 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.421153+0000", 2024-04-19T02:16:27.513 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0067135229999999999 2024-04-19T02:16:27.513 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.513 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.513 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:27.513 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.427775+0000", 2024-04-19T02:16:27.513 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0066216640000000002 2024-04-19T02:16:27.513 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.513 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.513 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:27.513 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.427847+0000", 2024-04-19T02:16:27.513 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.2601000000000005e-05 2024-04-19T02:16:27.513 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.514 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.514 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:27.514 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.427887+0000", 2024-04-19T02:16:27.514 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.9789000000000001e-05 2024-04-19T02:16:27.514 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.514 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:27.514 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.514 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.514 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.514 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:61671 5.3 5:cab602a2:::benchmark_data_smithi121_44835_object61670:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:27.514 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:17.409258+0000", 2024-04-19T02:16:27.514 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 10.047068357000001, 2024-04-19T02:16:27.514 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.01870983, 2024-04-19T02:16:27.514 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:27.514 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:27.515 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:27.515 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:27.515 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:27.515 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 61671 2024-04-19T02:16:27.515 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.515 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:27.515 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.515 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:27.515 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409258+0000", 2024-04-19T02:16:27.515 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:27.515 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.515 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.515 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:27.515 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409258+0000", 2024-04-19T02:16:27.515 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:27.516 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.516 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.516 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:27.516 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409257+0000", 2024-04-19T02:16:27.516 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:27.516 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.516 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.516 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:27.516 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409353+0000", 2024-04-19T02:16:27.516 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.6365000000000003e-05 2024-04-19T02:16:27.516 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.516 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.516 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:27.516 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409362+0000", 2024-04-19T02:16:27.516 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.4500000000000004e-06 2024-04-19T02:16:27.517 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.517 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.517 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:27.517 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409382+0000", 2024-04-19T02:16:27.517 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.9707e-05 2024-04-19T02:16:27.517 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.517 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.517 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:27.517 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.416070+0000", 2024-04-19T02:16:27.517 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0066881889999999998 2024-04-19T02:16:27.517 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.517 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.517 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:27.517 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.416176+0000", 2024-04-19T02:16:27.517 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00010598 2024-04-19T02:16:27.518 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.518 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.518 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:27.518 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.416271+0000", 2024-04-19T02:16:27.518 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.4846999999999995e-05 2024-04-19T02:16:27.518 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.518 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.518 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:27.518 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.421187+0000", 2024-04-19T02:16:27.518 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0049165210000000001 2024-04-19T02:16:27.518 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.518 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.518 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:27.518 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.427894+0000", 2024-04-19T02:16:27.519 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.006706844 2024-04-19T02:16:27.519 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.519 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.519 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:27.519 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.427939+0000", 2024-04-19T02:16:27.519 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.4676999999999999e-05 2024-04-19T02:16:27.519 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.519 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.519 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:27.519 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.427967+0000", 2024-04-19T02:16:27.519 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.8770999999999999e-05 2024-04-19T02:16:27.519 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.519 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:27.519 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.519 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.520 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.520 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:61815 5.c 5:3ca8a794:::benchmark_data_smithi121_44835_object61814:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:27.520 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:17.482110+0000", 2024-04-19T02:16:27.520 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 9.9742158320000005, 2024-04-19T02:16:27.520 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.021577559999999999, 2024-04-19T02:16:27.520 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:27.520 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:27.520 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:27.520 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:27.520 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:27.520 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 61815 2024-04-19T02:16:27.520 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.520 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:27.520 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.520 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:27.521 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482110+0000", 2024-04-19T02:16:27.521 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:27.521 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.521 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.521 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:27.521 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482110+0000", 2024-04-19T02:16:27.521 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:27.521 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.521 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.521 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:27.521 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482109+0000", 2024-04-19T02:16:27.521 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:27.521 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.521 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.522 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:27.522 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482197+0000", 2024-04-19T02:16:27.522 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.7405999999999996e-05 2024-04-19T02:16:27.522 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.522 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.522 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:27.522 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482206+0000", 2024-04-19T02:16:27.522 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.0010000000000007e-06 2024-04-19T02:16:27.522 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.522 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.522 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:27.522 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482211+0000", 2024-04-19T02:16:27.522 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.4569999999999996e-06 2024-04-19T02:16:27.523 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.523 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.523 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:27.523 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.489465+0000", 2024-04-19T02:16:27.523 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.007253776 2024-04-19T02:16:27.523 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.523 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.523 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:27.523 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.489582+0000", 2024-04-19T02:16:27.523 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00011669500000000001 2024-04-19T02:16:27.523 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.523 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.523 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:27.523 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.489684+0000", 2024-04-19T02:16:27.524 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000102533 2024-04-19T02:16:27.524 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.524 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.524 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:27.524 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.491836+0000", 2024-04-19T02:16:27.524 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0021516759999999999 2024-04-19T02:16:27.524 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.524 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.524 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:27.524 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503615+0000", 2024-04-19T02:16:27.524 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.011778906 2024-04-19T02:16:27.524 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.524 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.524 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:27.525 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503652+0000", 2024-04-19T02:16:27.525 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6622999999999998e-05 2024-04-19T02:16:27.525 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.525 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.525 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:27.525 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503688+0000", 2024-04-19T02:16:27.525 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6127000000000002e-05 2024-04-19T02:16:27.525 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.525 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:27.525 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.525 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.525 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.525 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:61821 5.c 5:3f8142ef:::benchmark_data_smithi121_44835_object61820:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:27.525 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:17.484515+0000", 2024-04-19T02:16:27.525 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 9.9718109970000004, 2024-04-19T02:16:27.526 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.019268073, 2024-04-19T02:16:27.526 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:27.526 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:27.526 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:27.526 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:27.526 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:27.526 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 61821 2024-04-19T02:16:27.526 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.526 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:27.526 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.526 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:27.526 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.484515+0000", 2024-04-19T02:16:27.526 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:27.526 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.527 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.527 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:27.527 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.484515+0000", 2024-04-19T02:16:27.527 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:27.527 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.527 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.527 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:27.527 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.484514+0000", 2024-04-19T02:16:27.527 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:27.527 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.527 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.527 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:27.527 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.484612+0000", 2024-04-19T02:16:27.527 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.7962999999999997e-05 2024-04-19T02:16:27.528 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.528 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.528 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:27.528 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.484623+0000", 2024-04-19T02:16:27.528 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.1229999999999999e-05 2024-04-19T02:16:27.528 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.528 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.528 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:27.528 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.484629+0000", 2024-04-19T02:16:27.528 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.9549999999999997e-06 2024-04-19T02:16:27.528 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.528 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.528 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:27.528 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.491863+0000", 2024-04-19T02:16:27.528 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.007234178 2024-04-19T02:16:27.529 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.529 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.529 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:27.529 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.491976+0000", 2024-04-19T02:16:27.529 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000112613 2024-04-19T02:16:27.529 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.529 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.529 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:27.529 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.492073+0000", 2024-04-19T02:16:27.529 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.6961999999999998e-05 2024-04-19T02:16:27.529 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.529 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.529 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:27.529 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.496898+0000", 2024-04-19T02:16:27.530 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0048245299999999996 2024-04-19T02:16:27.530 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.530 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.530 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:27.530 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503695+0000", 2024-04-19T02:16:27.530 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0067978129999999998 2024-04-19T02:16:27.530 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.530 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.530 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:27.530 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503748+0000", 2024-04-19T02:16:27.530 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.2247000000000003e-05 2024-04-19T02:16:27.530 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.530 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.530 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:27.531 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503783+0000", 2024-04-19T02:16:27.531 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.5389999999999998e-05 2024-04-19T02:16:27.531 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.531 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:27.531 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.531 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.531 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.531 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:78011 5.5 5:a93aae72:::benchmark_data_smithi121_44835_object78010:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:27.531 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:26.996439+0000", 2024-04-19T02:16:27.531 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.45988699900000002, 2024-04-19T02:16:27.531 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.018711576000000001, 2024-04-19T02:16:27.531 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:27.531 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:27.531 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:27.531 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:27.532 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:27.532 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 78011 2024-04-19T02:16:27.532 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.532 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:27.532 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.532 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:27.532 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.996439+0000", 2024-04-19T02:16:27.532 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:27.532 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.532 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.532 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:27.532 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.996439+0000", 2024-04-19T02:16:27.532 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:27.532 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.533 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.533 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:27.533 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.996438+0000", 2024-04-19T02:16:27.533 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:27.533 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.533 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.533 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:27.533 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.996497+0000", 2024-04-19T02:16:27.533 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.8585000000000002e-05 2024-04-19T02:16:27.533 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.533 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.533 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:27.533 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.996508+0000", 2024-04-19T02:16:27.533 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.1409999999999999e-05 2024-04-19T02:16:27.534 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.534 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.534 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:27.534 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.996516+0000", 2024-04-19T02:16:27.534 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.1019999999999997e-06 2024-04-19T02:16:27.534 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.534 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.534 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:27.534 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.998055+0000", 2024-04-19T02:16:27.534 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.001538336 2024-04-19T02:16:27.534 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.534 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.534 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:27.534 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.998170+0000", 2024-04-19T02:16:27.534 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000115722 2024-04-19T02:16:27.535 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.535 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.535 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:27.535 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.998339+0000", 2024-04-19T02:16:27.535 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00016885500000000001 2024-04-19T02:16:27.535 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.535 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.535 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:27.535 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.003741+0000", 2024-04-19T02:16:27.535 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0054015269999999997 2024-04-19T02:16:27.535 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.535 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.535 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:27.535 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.015092+0000", 2024-04-19T02:16:27.535 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.011351037 2024-04-19T02:16:27.536 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.536 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.536 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:27.536 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.015124+0000", 2024-04-19T02:16:27.536 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.2109e-05 2024-04-19T02:16:27.536 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.536 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.536 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:27.536 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.015151+0000", 2024-04-19T02:16:27.536 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.6642999999999999e-05 2024-04-19T02:16:27.536 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.536 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:27.536 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.536 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.537 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.537 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:78170 5.1 5:8b9c8e45:::benchmark_data_smithi121_44835_object78169:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:27.537 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.078784+0000", 2024-04-19T02:16:27.537 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.37754154400000001, 2024-04-19T02:16:27.537 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.019726264, 2024-04-19T02:16:27.537 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:27.537 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:27.537 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:27.537 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:27.537 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:27.537 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 78170 2024-04-19T02:16:27.537 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.537 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:27.537 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.537 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:27.538 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.078784+0000", 2024-04-19T02:16:27.538 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:27.538 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.538 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.538 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:27.538 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.078784+0000", 2024-04-19T02:16:27.538 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:27.538 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.538 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.538 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:27.538 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.078784+0000", 2024-04-19T02:16:27.538 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:27.538 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.538 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.538 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:27.539 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.078887+0000", 2024-04-19T02:16:27.539 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000103305 2024-04-19T02:16:27.539 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.539 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.539 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:27.539 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.078895+0000", 2024-04-19T02:16:27.539 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.4409999999999993e-06 2024-04-19T02:16:27.539 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.539 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.539 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:27.539 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.078902+0000", 2024-04-19T02:16:27.539 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.9990000000000002e-06 2024-04-19T02:16:27.539 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.539 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.539 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:27.540 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.080865+0000", 2024-04-19T02:16:27.540 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0019620169999999999 2024-04-19T02:16:27.540 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.540 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.540 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:27.540 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.080997+0000", 2024-04-19T02:16:27.540 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00013229100000000001 2024-04-19T02:16:27.540 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.540 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.540 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:27.540 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.081163+0000", 2024-04-19T02:16:27.540 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00016632300000000001 2024-04-19T02:16:27.540 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.540 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.540 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:27.541 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.087215+0000", 2024-04-19T02:16:27.541 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0060522600000000003 2024-04-19T02:16:27.541 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.541 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.541 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:27.541 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.087261+0000", 2024-04-19T02:16:27.541 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.5788999999999998e-05 2024-04-19T02:16:27.541 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.541 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.541 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:27.541 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.098357+0000", 2024-04-19T02:16:27.541 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.011095571 2024-04-19T02:16:27.541 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.541 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.541 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:27.542 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.098407+0000", 2024-04-19T02:16:27.542 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.9821000000000003e-05 2024-04-19T02:16:27.542 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.542 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.542 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:27.542 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.098511+0000", 2024-04-19T02:16:27.542 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000104101 2024-04-19T02:16:27.542 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.542 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:27.542 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.542 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.542 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.542 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:78173 5.1 5:836bdddd:::benchmark_data_smithi121_44835_object78172:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:27.542 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.079379+0000", 2024-04-19T02:16:27.543 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.37694721399999997, 2024-04-19T02:16:27.543 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.019339773000000001, 2024-04-19T02:16:27.543 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:27.543 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:27.543 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:27.543 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:27.543 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:27.543 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 78173 2024-04-19T02:16:27.543 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.543 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:27.543 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.543 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:27.543 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.079379+0000", 2024-04-19T02:16:27.544 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:27.544 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.544 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.544 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:27.544 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.079379+0000", 2024-04-19T02:16:27.544 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:27.544 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.544 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.544 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:27.544 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.079378+0000", 2024-04-19T02:16:27.544 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:27.544 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.544 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.544 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:27.544 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.079500+0000", 2024-04-19T02:16:27.545 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000122411 2024-04-19T02:16:27.545 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.545 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.545 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:27.545 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.079509+0000", 2024-04-19T02:16:27.545 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.7490000000000004e-06 2024-04-19T02:16:27.545 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.545 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.545 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:27.545 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.079516+0000", 2024-04-19T02:16:27.545 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.6120000000000004e-06 2024-04-19T02:16:27.545 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.545 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.545 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:27.546 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.083107+0000", 2024-04-19T02:16:27.546 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.003590963 2024-04-19T02:16:27.546 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.546 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.546 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:27.546 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.083265+0000", 2024-04-19T02:16:27.546 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000157944 2024-04-19T02:16:27.546 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.546 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.546 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:27.546 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.083467+0000", 2024-04-19T02:16:27.546 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000202129 2024-04-19T02:16:27.546 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.547 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.547 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:27.547 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.087305+0000", 2024-04-19T02:16:27.547 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0038381679999999999 2024-04-19T02:16:27.547 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.547 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.547 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:27.547 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.089566+0000", 2024-04-19T02:16:27.547 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0022616009999999998 2024-04-19T02:16:27.547 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.547 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.547 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:27.547 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.098555+0000", 2024-04-19T02:16:27.547 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0089888090000000004 2024-04-19T02:16:27.548 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.548 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.548 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:27.548 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.098619+0000", 2024-04-19T02:16:27.548 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.3555999999999999e-05 2024-04-19T02:16:27.548 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.548 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.548 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:27.548 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.098719+0000", 2024-04-19T02:16:27.548 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.9674999999999997e-05 2024-04-19T02:16:27.548 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.548 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:27.548 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.548 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.549 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.549 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:78179 5.1 5:8073daef:::benchmark_data_smithi121_44835_object78178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:27.549 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.080866+0000", 2024-04-19T02:16:27.549 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.37545999499999999, 2024-04-19T02:16:27.549 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.018012330999999999, 2024-04-19T02:16:27.549 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:27.549 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:27.549 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:27.549 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:27.549 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:27.549 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 78179 2024-04-19T02:16:27.549 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.549 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:27.549 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.550 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:27.550 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.080866+0000", 2024-04-19T02:16:27.550 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:27.550 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.550 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.550 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:27.550 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.080866+0000", 2024-04-19T02:16:27.550 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:27.550 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.550 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.550 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:27.550 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.080865+0000", 2024-04-19T02:16:27.550 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:27.550 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.551 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.551 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:27.551 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.080919+0000", 2024-04-19T02:16:27.551 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.3606999999999997e-05 2024-04-19T02:16:27.551 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.551 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.551 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:27.551 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.080931+0000", 2024-04-19T02:16:27.551 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.219e-05 2024-04-19T02:16:27.551 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.551 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.551 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:27.551 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.080940+0000", 2024-04-19T02:16:27.551 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.0999999999999993e-06 2024-04-19T02:16:27.552 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.552 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.552 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:27.552 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.085070+0000", 2024-04-19T02:16:27.552 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0041296670000000001 2024-04-19T02:16:27.552 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.552 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.552 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:27.552 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.085210+0000", 2024-04-19T02:16:27.552 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00014093299999999999 2024-04-19T02:16:27.552 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.552 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.552 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:27.552 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.085384+0000", 2024-04-19T02:16:27.552 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00017349999999999999 2024-04-19T02:16:27.553 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.553 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.553 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:27.553 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.087346+0000", 2024-04-19T02:16:27.553 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0019623430000000001 2024-04-19T02:16:27.553 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.553 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.553 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:27.553 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.091676+0000", 2024-04-19T02:16:27.553 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0043291919999999999 2024-04-19T02:16:27.553 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.553 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.553 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:27.553 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.098759+0000", 2024-04-19T02:16:27.553 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0070834649999999997 2024-04-19T02:16:27.554 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.554 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.554 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:27.554 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.098799+0000", 2024-04-19T02:16:27.554 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.0116e-05 2024-04-19T02:16:27.554 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.554 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.554 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:27.554 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.098878+0000", 2024-04-19T02:16:27.554 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.9178999999999995e-05 2024-04-19T02:16:27.554 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.554 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:27.554 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.554 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.555 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.555 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:78224 5.4 e31/16 5:26e797d5:::benchmark_data_smithi121_44835_object78223:head v 31'4845, mlcod=31'4843)", 2024-04-19T02:16:27.555 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.108876+0000", 2024-04-19T02:16:27.555 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.34744975099999997, 2024-04-19T02:16:27.555 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.018917363999999999, 2024-04-19T02:16:27.555 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:27.555 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:27.555 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:27.555 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.555 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:27.555 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.108876+0000", 2024-04-19T02:16:27.555 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:27.555 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.555 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.555 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:27.556 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.108876+0000", 2024-04-19T02:16:27.556 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:27.556 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.556 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.556 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:27.556 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.108876+0000", 2024-04-19T02:16:27.556 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:27.556 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.556 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.556 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:27.556 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.108914+0000", 2024-04-19T02:16:27.556 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.8603999999999998e-05 2024-04-19T02:16:27.556 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.556 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.557 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:27.557 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.108923+0000", 2024-04-19T02:16:27.557 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.0359999999999995e-06 2024-04-19T02:16:27.557 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.557 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.557 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:27.557 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.108929+0000", 2024-04-19T02:16:27.557 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.2329999999999997e-06 2024-04-19T02:16:27.557 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.557 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.557 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:27.557 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.108958+0000", 2024-04-19T02:16:27.557 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.9456999999999999e-05 2024-04-19T02:16:27.557 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.557 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.558 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:27.558 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.108978+0000", 2024-04-19T02:16:27.558 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.9619999999999998e-05 2024-04-19T02:16:27.558 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.558 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.558 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:27.558 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.127760+0000", 2024-04-19T02:16:27.558 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.018782507 2024-04-19T02:16:27.558 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.558 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.558 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:27.558 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.127794+0000", 2024-04-19T02:16:27.558 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.3349999999999997e-05 2024-04-19T02:16:27.558 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.558 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:27.559 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.559 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.559 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.559 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:78247 5.c 5:3efb1468:::benchmark_data_smithi121_44835_object78246:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:27.559 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.116347+0000", 2024-04-19T02:16:27.559 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.33997877700000001, 2024-04-19T02:16:27.559 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.032194436999999999, 2024-04-19T02:16:27.559 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:27.559 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:27.559 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:27.559 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:27.559 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:27.559 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 78247 2024-04-19T02:16:27.559 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.559 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:27.560 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.560 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:27.560 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116347+0000", 2024-04-19T02:16:27.560 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:27.560 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.560 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.560 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:27.560 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116347+0000", 2024-04-19T02:16:27.560 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:27.560 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.560 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.560 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:27.560 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116346+0000", 2024-04-19T02:16:27.560 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:27.560 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.561 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.561 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:27.561 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116370+0000", 2024-04-19T02:16:27.561 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.3892000000000001e-05 2024-04-19T02:16:27.561 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.561 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.561 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:27.561 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116385+0000", 2024-04-19T02:16:27.561 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.5162e-05 2024-04-19T02:16:27.561 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.561 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.561 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:27.561 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116394+0000", 2024-04-19T02:16:27.561 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.8000000000000004e-06 2024-04-19T02:16:27.561 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.562 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.562 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:27.562 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124856+0000", 2024-04-19T02:16:27.562 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0084622169999999993 2024-04-19T02:16:27.562 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.562 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.562 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:27.562 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124966+0000", 2024-04-19T02:16:27.562 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000109747 2024-04-19T02:16:27.562 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.562 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.562 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:27.562 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125216+0000", 2024-04-19T02:16:27.562 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000249545 2024-04-19T02:16:27.562 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.563 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.563 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:27.563 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.131713+0000", 2024-04-19T02:16:27.563 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0064972370000000003 2024-04-19T02:16:27.563 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.563 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.563 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:27.563 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148323+0000", 2024-04-19T02:16:27.563 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016609641000000001 2024-04-19T02:16:27.563 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.563 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.563 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:27.563 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148359+0000", 2024-04-19T02:16:27.563 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6412000000000003e-05 2024-04-19T02:16:27.563 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.564 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.564 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:27.564 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148542+0000", 2024-04-19T02:16:27.564 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00018265600000000001 2024-04-19T02:16:27.564 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.564 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:27.564 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.564 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.564 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.564 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:78248 5.c 5:30b7cc74:::benchmark_data_smithi121_44835_object78247:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:27.564 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.116471+0000", 2024-04-19T02:16:27.564 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.33985527599999998, 2024-04-19T02:16:27.564 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.032127452000000001, 2024-04-19T02:16:27.564 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:27.565 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:27.565 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:27.565 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:27.565 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:27.565 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 78248 2024-04-19T02:16:27.565 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.565 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:27.565 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.565 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:27.565 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116471+0000", 2024-04-19T02:16:27.565 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:27.565 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.565 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.565 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:27.565 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116471+0000", 2024-04-19T02:16:27.566 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:27.566 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.566 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.566 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:27.566 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116470+0000", 2024-04-19T02:16:27.566 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:27.566 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.566 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.566 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:27.566 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116496+0000", 2024-04-19T02:16:27.566 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.5517e-05 2024-04-19T02:16:27.566 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.566 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.566 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:27.567 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116505+0000", 2024-04-19T02:16:27.567 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.9250000000000007e-06 2024-04-19T02:16:27.567 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.567 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.567 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:27.567 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116516+0000", 2024-04-19T02:16:27.567 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.012e-05 2024-04-19T02:16:27.567 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.567 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.567 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:27.567 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.127803+0000", 2024-04-19T02:16:27.567 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.011287523000000001 2024-04-19T02:16:27.567 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.567 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.567 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:27.567 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.127932+0000", 2024-04-19T02:16:27.568 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012848499999999999 2024-04-19T02:16:27.568 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.568 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.568 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:27.568 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128022+0000", 2024-04-19T02:16:27.568 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.0890000000000006e-05 2024-04-19T02:16:27.568 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.568 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.568 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:27.568 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.131909+0000", 2024-04-19T02:16:27.568 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0038864609999999999 2024-04-19T02:16:27.568 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.568 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.568 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:27.569 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148552+0000", 2024-04-19T02:16:27.569 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016643162999999999 2024-04-19T02:16:27.569 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.569 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.569 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:27.569 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148577+0000", 2024-04-19T02:16:27.569 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.5333999999999998e-05 2024-04-19T02:16:27.569 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.569 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.569 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:27.569 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148598+0000", 2024-04-19T02:16:27.569 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.0687999999999999e-05 2024-04-19T02:16:27.569 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.569 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:27.569 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.570 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.570 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.570 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:78258 5.a 5:549070de:::benchmark_data_smithi121_44835_object78257:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:27.570 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.124295+0000", 2024-04-19T02:16:27.570 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.33203073, 2024-04-19T02:16:27.570 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020189543000000001, 2024-04-19T02:16:27.570 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:27.570 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:27.570 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:27.570 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:27.570 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:27.570 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 78258 2024-04-19T02:16:27.570 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.570 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:27.571 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.571 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:27.571 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124295+0000", 2024-04-19T02:16:27.571 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:27.571 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.571 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.571 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:27.571 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124295+0000", 2024-04-19T02:16:27.571 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:27.571 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.571 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.571 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:27.571 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124294+0000", 2024-04-19T02:16:27.571 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:27.571 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.572 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.572 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:27.572 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124358+0000", 2024-04-19T02:16:27.572 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.4040000000000003e-05 2024-04-19T02:16:27.572 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.572 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.572 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:27.572 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124374+0000", 2024-04-19T02:16:27.572 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.5291e-05 2024-04-19T02:16:27.572 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.572 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.572 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:27.572 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124383+0000", 2024-04-19T02:16:27.572 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.8360000000000004e-06 2024-04-19T02:16:27.572 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.573 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.573 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:27.573 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124908+0000", 2024-04-19T02:16:27.573 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00052415700000000003 2024-04-19T02:16:27.573 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.573 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.573 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:27.573 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125023+0000", 2024-04-19T02:16:27.573 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00011506999999999999 2024-04-19T02:16:27.573 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.573 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.573 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:27.573 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125182+0000", 2024-04-19T02:16:27.574 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00015942500000000001 2024-04-19T02:16:27.574 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.574 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.574 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:27.574 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.129505+0000", 2024-04-19T02:16:27.574 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0043225080000000001 2024-04-19T02:16:27.574 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.574 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.574 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:27.574 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.144379+0000", 2024-04-19T02:16:27.574 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.014874263 2024-04-19T02:16:27.574 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.574 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.574 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:27.575 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.144444+0000", 2024-04-19T02:16:27.575 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.5451999999999996e-05 2024-04-19T02:16:27.575 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.575 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.575 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:27.575 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.144485+0000", 2024-04-19T02:16:27.575 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.0426999999999998e-05 2024-04-19T02:16:27.575 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.575 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:27.575 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.575 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.575 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.575 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:78259 5.4 e31/16 5:2aa344b2:::benchmark_data_smithi121_44835_object78258:head v 31'4849, mlcod=31'4843)", 2024-04-19T02:16:27.576 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.125675+0000", 2024-04-19T02:16:27.576 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.33065085799999999, 2024-04-19T02:16:27.576 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.022419326, 2024-04-19T02:16:27.576 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:27.576 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:27.576 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:27.576 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.576 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:27.576 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125675+0000", 2024-04-19T02:16:27.576 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:27.576 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.576 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.576 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:27.576 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125675+0000", 2024-04-19T02:16:27.577 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:27.577 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.577 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.577 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:27.577 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125674+0000", 2024-04-19T02:16:27.577 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:27.577 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.577 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.577 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:27.577 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125723+0000", 2024-04-19T02:16:27.577 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.8998000000000001e-05 2024-04-19T02:16:27.577 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.577 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.577 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:27.577 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125733+0000", 2024-04-19T02:16:27.578 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.1379999999999996e-06 2024-04-19T02:16:27.578 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.578 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.578 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:27.578 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125740+0000", 2024-04-19T02:16:27.578 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.0779999999999998e-06 2024-04-19T02:16:27.578 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.578 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.578 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:27.578 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.129589+0000", 2024-04-19T02:16:27.578 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0038488910000000001 2024-04-19T02:16:27.578 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.578 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.578 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:27.579 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.129605+0000", 2024-04-19T02:16:27.579 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.6877000000000001e-05 2024-04-19T02:16:27.579 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.579 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.579 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:27.579 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148057+0000", 2024-04-19T02:16:27.579 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.018451624 2024-04-19T02:16:27.579 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.579 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.579 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:27.579 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148094+0000", 2024-04-19T02:16:27.579 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.7327999999999999e-05 2024-04-19T02:16:27.579 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.579 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:27.580 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.580 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.580 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.580 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:78263 5.1 5:8e231862:::benchmark_data_smithi121_44835_object78262:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:27.580 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.128154+0000", 2024-04-19T02:16:27.580 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.32817167200000003, 2024-04-19T02:16:27.580 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020882214, 2024-04-19T02:16:27.580 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:27.580 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:27.580 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:27.580 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:27.580 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:27.580 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 78263 2024-04-19T02:16:27.580 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.581 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:27.581 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.581 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:27.581 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128154+0000", 2024-04-19T02:16:27.581 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:27.581 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.581 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.581 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:27.581 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128154+0000", 2024-04-19T02:16:27.581 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:27.581 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.581 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.581 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:27.581 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128153+0000", 2024-04-19T02:16:27.581 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:27.582 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.582 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.582 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:27.582 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128246+0000", 2024-04-19T02:16:27.582 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.302e-05 2024-04-19T02:16:27.582 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.582 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.582 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:27.582 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128263+0000", 2024-04-19T02:16:27.582 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.6753e-05 2024-04-19T02:16:27.582 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.582 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.582 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:27.583 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128271+0000", 2024-04-19T02:16:27.583 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.2290000000000003e-06 2024-04-19T02:16:27.583 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.583 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.583 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:27.583 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128459+0000", 2024-04-19T02:16:27.583 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00018772 2024-04-19T02:16:27.583 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.583 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.583 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:27.583 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128574+0000", 2024-04-19T02:16:27.583 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00011437700000000001 2024-04-19T02:16:27.583 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.583 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.584 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:27.584 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128696+0000", 2024-04-19T02:16:27.584 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000122831 2024-04-19T02:16:27.584 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.584 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.584 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:27.584 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.130816+0000", 2024-04-19T02:16:27.584 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0021196750000000001 2024-04-19T02:16:27.584 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.584 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.584 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:27.584 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.131859+0000", 2024-04-19T02:16:27.584 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0010434419999999999 2024-04-19T02:16:27.584 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.584 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.585 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:27.585 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148848+0000", 2024-04-19T02:16:27.585 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016988712 2024-04-19T02:16:27.585 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.585 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.585 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:27.585 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148905+0000", 2024-04-19T02:16:27.585 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.6722999999999999e-05 2024-04-19T02:16:27.585 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.585 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.585 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:27.585 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.149036+0000", 2024-04-19T02:16:27.585 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000131567 2024-04-19T02:16:27.585 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.585 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:27.586 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.586 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.586 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.586 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:78267 5.7 e31/16 5:e0f79750:::benchmark_data_smithi121_44835_object78266:head v 31'4957, mlcod=31'4955)", 2024-04-19T02:16:27.586 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.130415+0000", 2024-04-19T02:16:27.586 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.32591058000000001, 2024-04-19T02:16:27.586 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.018014663, 2024-04-19T02:16:27.586 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:27.586 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:27.586 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:27.586 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.586 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:27.586 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.130415+0000", 2024-04-19T02:16:27.586 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:27.586 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.587 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.587 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:27.587 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.130415+0000", 2024-04-19T02:16:27.587 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:27.587 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.587 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.587 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:27.587 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.130415+0000", 2024-04-19T02:16:27.587 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:27.587 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.587 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.587 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:27.587 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.130475+0000", 2024-04-19T02:16:27.587 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.0112000000000003e-05 2024-04-19T02:16:27.588 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.588 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.588 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:27.588 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.130482+0000", 2024-04-19T02:16:27.588 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.3529999999999997e-06 2024-04-19T02:16:27.588 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.588 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.588 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:27.588 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.130487+0000", 2024-04-19T02:16:27.588 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.3449999999999999e-06 2024-04-19T02:16:27.588 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.588 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.588 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:27.588 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.130534+0000", 2024-04-19T02:16:27.588 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.7126999999999998e-05 2024-04-19T02:16:27.589 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.589 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.589 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:27.589 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.130553+0000", 2024-04-19T02:16:27.589 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.9337000000000001e-05 2024-04-19T02:16:27.589 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.589 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.589 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:27.589 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148397+0000", 2024-04-19T02:16:27.589 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.017843678000000002 2024-04-19T02:16:27.589 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.589 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.589 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:27.589 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148430+0000", 2024-04-19T02:16:27.589 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.3213000000000002e-05 2024-04-19T02:16:27.590 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.590 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:27.590 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.590 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.590 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.590 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:78271 5.4 e31/16 5:2982d7a6:::benchmark_data_smithi121_44835_object78270:head v 31'4850, mlcod=31'4847)", 2024-04-19T02:16:27.590 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.132554+0000", 2024-04-19T02:16:27.590 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.32377213799999999, 2024-04-19T02:16:27.590 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020294946000000001, 2024-04-19T02:16:27.590 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:27.590 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:27.590 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:27.590 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.590 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:27.591 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132554+0000", 2024-04-19T02:16:27.591 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:27.591 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.591 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.591 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:27.591 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132554+0000", 2024-04-19T02:16:27.591 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:27.591 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.591 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.591 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:27.591 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132553+0000", 2024-04-19T02:16:27.591 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:27.591 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.591 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.592 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:27.592 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132615+0000", 2024-04-19T02:16:27.592 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.1772000000000004e-05 2024-04-19T02:16:27.592 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.592 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.592 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:27.592 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132620+0000", 2024-04-19T02:16:27.592 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.0939999999999998e-06 2024-04-19T02:16:27.592 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.592 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.592 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:27.592 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132624+0000", 2024-04-19T02:16:27.592 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.2229999999999999e-06 2024-04-19T02:16:27.593 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.593 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.593 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:27.593 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132649+0000", 2024-04-19T02:16:27.593 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.5352000000000001e-05 2024-04-19T02:16:27.593 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.593 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.593 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:27.593 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132661+0000", 2024-04-19T02:16:27.593 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.1851999999999999e-05 2024-04-19T02:16:27.593 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.593 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.593 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:27.594 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.152820+0000", 2024-04-19T02:16:27.594 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020159369999999999 2024-04-19T02:16:27.594 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.594 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.594 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:27.594 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.152849+0000", 2024-04-19T02:16:27.594 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.868e-05 2024-04-19T02:16:27.594 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.594 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:27.594 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.594 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.594 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.594 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:78272 5.4 e31/16 5:273e819a:::benchmark_data_smithi121_44835_object78271:head v 31'4851, mlcod=31'4847)", 2024-04-19T02:16:27.594 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.134397+0000", 2024-04-19T02:16:27.594 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.32192896599999998, 2024-04-19T02:16:27.595 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.018541730999999999, 2024-04-19T02:16:27.595 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:27.595 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:27.595 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:27.595 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.595 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:27.595 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.134397+0000", 2024-04-19T02:16:27.595 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:27.595 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.595 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.595 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:27.595 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.134397+0000", 2024-04-19T02:16:27.595 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:27.595 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.596 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.596 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:27.596 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.134396+0000", 2024-04-19T02:16:27.596 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:27.596 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.596 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.596 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:27.596 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.134453+0000", 2024-04-19T02:16:27.596 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.6858999999999999e-05 2024-04-19T02:16:27.596 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.596 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.596 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:27.596 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.134460+0000", 2024-04-19T02:16:27.596 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.7390000000000002e-06 2024-04-19T02:16:27.596 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.596 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.597 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:27.597 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.134465+0000", 2024-04-19T02:16:27.597 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.5419999999999999e-06 2024-04-19T02:16:27.597 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.597 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.597 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:27.597 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.144083+0000", 2024-04-19T02:16:27.597 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0096182320000000009 2024-04-19T02:16:27.597 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.597 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.597 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:27.597 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.144104+0000", 2024-04-19T02:16:27.597 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.1458999999999999e-05 2024-04-19T02:16:27.597 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.597 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.598 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:27.598 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.152859+0000", 2024-04-19T02:16:27.598 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0087549889999999995 2024-04-19T02:16:27.598 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.598 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.598 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:27.598 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.152939+0000", 2024-04-19T02:16:27.598 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.9432999999999997e-05 2024-04-19T02:16:27.598 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.598 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:27.598 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.598 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.598 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.599 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:78807 5.3 5:c0963eed:::benchmark_data_smithi121_44835_object78806:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:27.599 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.397845+0000", 2024-04-19T02:16:27.599 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.058480599000000001, 2024-04-19T02:16:27.599 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.018482620000000002, 2024-04-19T02:16:27.599 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:27.599 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:27.599 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:27.599 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:27.599 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:27.599 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 78807 2024-04-19T02:16:27.599 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.599 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:27.599 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.599 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:27.599 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.397845+0000", 2024-04-19T02:16:27.600 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:27.600 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.600 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.600 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:27.600 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.397845+0000", 2024-04-19T02:16:27.600 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:27.600 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.600 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.600 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:27.600 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.397844+0000", 2024-04-19T02:16:27.600 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:27.600 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.600 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.600 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:27.601 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.397933+0000", 2024-04-19T02:16:27.601 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.9047000000000003e-05 2024-04-19T02:16:27.601 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.601 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.601 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:27.601 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.397942+0000", 2024-04-19T02:16:27.601 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.2600000000000005e-06 2024-04-19T02:16:27.601 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.601 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.601 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:27.601 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.397946+0000", 2024-04-19T02:16:27.601 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.6909999999999996e-06 2024-04-19T02:16:27.601 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.601 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.601 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:27.601 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.397969+0000", 2024-04-19T02:16:27.602 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.2595999999999998e-05 2024-04-19T02:16:27.602 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.602 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.602 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:27.602 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.398081+0000", 2024-04-19T02:16:27.602 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000112346 2024-04-19T02:16:27.602 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.602 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.602 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:27.602 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.398230+0000", 2024-04-19T02:16:27.602 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00014856 2024-04-19T02:16:27.602 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.602 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.602 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:27.603 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.404114+0000", 2024-04-19T02:16:27.603 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0058837780000000001 2024-04-19T02:16:27.603 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.603 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.603 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:27.603 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.416266+0000", 2024-04-19T02:16:27.603 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.012152733000000001 2024-04-19T02:16:27.603 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.603 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.603 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:27.603 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.416295+0000", 2024-04-19T02:16:27.603 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.8687000000000002e-05 2024-04-19T02:16:27.603 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.603 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.604 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:27.604 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.416328+0000", 2024-04-19T02:16:27.604 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.3042e-05 2024-04-19T02:16:27.604 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.604 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:27.604 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.604 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.604 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.604 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:78810 5.3 5:cc85a237:::benchmark_data_smithi121_44835_object78809:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:27.604 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.398037+0000", 2024-04-19T02:16:27.604 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.058289362999999997, 2024-04-19T02:16:27.604 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.018347557, 2024-04-19T02:16:27.604 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:27.604 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:27.605 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:27.605 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:27.605 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:27.605 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 78810 2024-04-19T02:16:27.605 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.605 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:27.605 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.605 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:27.605 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.398037+0000", 2024-04-19T02:16:27.605 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:27.605 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.605 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.605 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:27.605 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.398037+0000", 2024-04-19T02:16:27.606 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:27.606 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.606 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.606 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:27.606 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.398036+0000", 2024-04-19T02:16:27.606 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:27.606 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.606 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.606 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:27.606 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.398079+0000", 2024-04-19T02:16:27.606 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.3176999999999997e-05 2024-04-19T02:16:27.606 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.606 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.606 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:27.607 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.398089+0000", 2024-04-19T02:16:27.607 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.9119999999999993e-06 2024-04-19T02:16:27.607 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.607 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.607 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:27.607 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.398094+0000", 2024-04-19T02:16:27.607 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.8539999999999996e-06 2024-04-19T02:16:27.607 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.607 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.607 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:27.607 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.401008+0000", 2024-04-19T02:16:27.607 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0029137159999999998 2024-04-19T02:16:27.607 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.607 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.607 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:27.608 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.401130+0000", 2024-04-19T02:16:27.608 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000121919 2024-04-19T02:16:27.608 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.608 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.608 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:27.608 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.401231+0000", 2024-04-19T02:16:27.608 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000101498 2024-04-19T02:16:27.608 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.608 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.608 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:27.608 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.416155+0000", 2024-04-19T02:16:27.608 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.014923954 2024-04-19T02:16:27.608 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.608 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.609 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:27.609 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.416333+0000", 2024-04-19T02:16:27.609 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000177629 2024-04-19T02:16:27.609 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.609 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.609 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:27.609 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.416356+0000", 2024-04-19T02:16:27.609 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.3533999999999999e-05 2024-04-19T02:16:27.609 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:27.609 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:27.609 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:27.609 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.416384+0000", 2024-04-19T02:16:27.609 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.7725e-05 2024-04-19T02:16:27.609 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.609 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:27.610 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.610 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:27.610 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:27.610 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-04-19T02:16:27.610 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:16:27.612 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:27.611+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:27.712 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:27.713+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:27.788 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:16:27.788 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:16:27.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.788 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4549.0:79618 5.5 e31/16 5:a7a5fefd:::benchmark_data_smithi121_44835_object79617:head v 31'5009, mlcod=31'5006)", 2024-04-19T02:16:27.788 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:27.785775+0000", 2024-04-19T02:16:27.788 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0025554240000000002, 2024-04-19T02:16:27.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0025777629999999998, 2024-04-19T02:16:27.789 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:27.789 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:16:27.789 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:27.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:27.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.785775+0000", 2024-04-19T02:16:27.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:27.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:27.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.785775+0000", 2024-04-19T02:16:27.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:27.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.790 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:27.790 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.785775+0000", 2024-04-19T02:16:27.790 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:27.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.790 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:27.790 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.785831+0000", 2024-04-19T02:16:27.790 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6109000000000001e-05 2024-04-19T02:16:27.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.790 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:27.791 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.785838+0000", 2024-04-19T02:16:27.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2490000000000004e-06 2024-04-19T02:16:27.791 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.791 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.791 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:27.791 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.785844+0000", 2024-04-19T02:16:27.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7910000000000001e-06 2024-04-19T02:16:27.791 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.791 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.791 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:27.791 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.785899+0000", 2024-04-19T02:16:27.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5531000000000001e-05 2024-04-19T02:16:27.791 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.791 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.791 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:27.792 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.785918+0000", 2024-04-19T02:16:27.792 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8896999999999999e-05 2024-04-19T02:16:27.792 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:27.792 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:27.792 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:27.792 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.792 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.792 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:79619 5.d 5:bfce48f3:::benchmark_data_smithi121_44835_object79618:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:27.792 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:27.786046+0000", 2024-04-19T02:16:27.792 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0022848870000000002, 2024-04-19T02:16:27.792 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0023768819999999999, 2024-04-19T02:16:27.792 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:27.792 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:27.793 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:27.793 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:27.793 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:27.793 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 79619 2024-04-19T02:16:27.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.793 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:27.793 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.793 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:27.793 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.786046+0000", 2024-04-19T02:16:27.793 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:27.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.793 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.793 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:27.794 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.786046+0000", 2024-04-19T02:16:27.794 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:27.794 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.794 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.794 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:27.794 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.786045+0000", 2024-04-19T02:16:27.794 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:27.794 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.794 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.794 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:27.794 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.786143+0000", 2024-04-19T02:16:27.794 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7936999999999994e-05 2024-04-19T02:16:27.794 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.794 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.795 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:27.795 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.786170+0000", 2024-04-19T02:16:27.795 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7506999999999999e-05 2024-04-19T02:16:27.795 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.795 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.795 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:27.795 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.786178+0000", 2024-04-19T02:16:27.795 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7610000000000007e-06 2024-04-19T02:16:27.795 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.795 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.795 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:27.795 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.787736+0000", 2024-04-19T02:16:27.795 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001558186 2024-04-19T02:16:27.795 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.796 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.796 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:27.796 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.787812+0000", 2024-04-19T02:16:27.796 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5681999999999998e-05 2024-04-19T02:16:27.796 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.796 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.796 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:27.796 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.787903+0000", 2024-04-19T02:16:27.796 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1037000000000003e-05 2024-04-19T02:16:27.796 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:27.796 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:27.796 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:27.796 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.796 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.797 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:79623 5.d 5.d72669cd (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:27.797 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:27.787607+0000", 2024-04-19T02:16:27.797 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00072353300000000005, 2024-04-19T02:16:27.797 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00089022400000000001, 2024-04-19T02:16:27.797 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:27.797 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-04-19T02:16:27.797 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:27.797 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:27.797 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:27.797 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 79623 2024-04-19T02:16:27.797 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.797 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:27.797 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.798 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:27.798 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.787607+0000", 2024-04-19T02:16:27.798 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:27.798 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.798 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.798 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:27.798 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.787607+0000", 2024-04-19T02:16:27.798 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:27.798 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.798 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.798 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:27.798 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.787606+0000", 2024-04-19T02:16:27.798 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:27.798 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.799 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.799 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:27.799 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.787722+0000", 2024-04-19T02:16:27.799 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000115715 2024-04-19T02:16:27.799 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.799 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.799 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:27.799 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.787733+0000", 2024-04-19T02:16:27.799 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1191e-05 2024-04-19T02:16:27.799 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.799 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.799 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:27.799 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.787741+0000", 2024-04-19T02:16:27.799 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4340000000000003e-06 2024-04-19T02:16:27.800 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:27.800 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:27.800 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:27.800 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.800 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.800 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4549.0:79620 5.c e31/16 5:34d2ad35:::benchmark_data_smithi121_44835_object79619:head v 31'4925, mlcod=31'4922)", 2024-04-19T02:16:27.800 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:27.787857+0000", 2024-04-19T02:16:27.800 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00047369399999999998, 2024-04-19T02:16:27.800 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00069751700000000004, 2024-04-19T02:16:27.800 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:27.800 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:16:27.800 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:27.800 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.801 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:27.801 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.787857+0000", 2024-04-19T02:16:27.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:27.801 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.801 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:27.801 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.787857+0000", 2024-04-19T02:16:27.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:27.801 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.801 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:27.801 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.787856+0000", 2024-04-19T02:16:27.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:27.801 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.802 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:27.802 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.787921+0000", 2024-04-19T02:16:27.802 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4401999999999998e-05 2024-04-19T02:16:27.802 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.802 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.802 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:27.802 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.787930+0000", 2024-04-19T02:16:27.802 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5310000000000007e-06 2024-04-19T02:16:27.802 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.802 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.802 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:27.802 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.787938+0000", 2024-04-19T02:16:27.802 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5209999999999997e-06 2024-04-19T02:16:27.802 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.803 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.803 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:27.803 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.787984+0000", 2024-04-19T02:16:27.803 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6490999999999999e-05 2024-04-19T02:16:27.803 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.803 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.803 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:27.803 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.788004+0000", 2024-04-19T02:16:27.803 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9510000000000001e-05 2024-04-19T02:16:27.803 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:27.803 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:27.803 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:27.803 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.803 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.803 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:79626 5.9 5.b493a4b9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:27.804 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:27.788057+0000", 2024-04-19T02:16:27.804 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00027317200000000002, 2024-04-19T02:16:27.804 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000564114, 2024-04-19T02:16:27.804 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:27.804 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-04-19T02:16:27.804 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:27.804 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:27.804 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:27.804 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 79626 2024-04-19T02:16:27.804 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.804 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:27.804 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.804 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:27.804 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.788057+0000", 2024-04-19T02:16:27.805 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:27.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.805 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.805 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:27.805 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.788057+0000", 2024-04-19T02:16:27.805 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:27.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.805 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.805 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:27.805 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.788056+0000", 2024-04-19T02:16:27.805 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:27.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.805 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.805 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:27.805 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.788131+0000", 2024-04-19T02:16:27.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4679999999999996e-05 2024-04-19T02:16:27.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.806 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:27.806 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.788143+0000", 2024-04-19T02:16:27.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1749000000000001e-05 2024-04-19T02:16:27.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.806 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:27.806 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.788159+0000", 2024-04-19T02:16:27.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6169000000000001e-05 2024-04-19T02:16:27.806 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:27.806 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:27.806 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:27.807 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.807 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.807 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4549.0:79621 5.5 e31/16)", 2024-04-19T02:16:27.807 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:27.788329+0000", 2024-04-19T02:16:27.807 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.491e-06, 2024-04-19T02:16:27.807 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00034289999999999999, 2024-04-19T02:16:27.807 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:27.807 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-04-19T02:16:27.807 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:27.807 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.807 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:27.807 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.788329+0000", 2024-04-19T02:16:27.807 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:27.807 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.807 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.808 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:27.808 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.788329+0000", 2024-04-19T02:16:27.808 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:27.808 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.808 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.808 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:27.808 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.788328+0000", 2024-04-19T02:16:27.808 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:27.808 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.808 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.808 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:27.808 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.788400+0000", 2024-04-19T02:16:27.808 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1586000000000002e-05 2024-04-19T02:16:27.808 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.809 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.809 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:27.809 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.788410+0000", 2024-04-19T02:16:27.809 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8819999999999996e-06 2024-04-19T02:16:27.809 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.809 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.809 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:27.809 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.788417+0000", 2024-04-19T02:16:27.809 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8070000000000002e-06 2024-04-19T02:16:27.809 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:27.809 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:27.809 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:27.809 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.809 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.809 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4549.0:79625 5.3 e31/16 5:c0875270:::benchmark_data_smithi121_44835_object79624:head v 31'5060, mlcod=31'5058)", 2024-04-19T02:16:27.810 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:27.788424+0000", 2024-04-19T02:16:27.810 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9999061, 2024-04-19T02:16:27.810 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00029564499999999998, 2024-04-19T02:16:27.810 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:27.810 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:16:27.810 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:27.810 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.810 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:27.810 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.788424+0000", 2024-04-19T02:16:27.810 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:27.810 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.810 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.810 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:27.810 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.788424+0000", 2024-04-19T02:16:27.810 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:27.811 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.811 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:27.811 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.788424+0000", 2024-04-19T02:16:27.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:27.811 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.811 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:27.811 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.788460+0000", 2024-04-19T02:16:27.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5816999999999999e-05 2024-04-19T02:16:27.811 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.811 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:27.811 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.788466+0000", 2024-04-19T02:16:27.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8499999999999999e-06 2024-04-19T02:16:27.812 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.812 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.812 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:27.812 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.788469+0000", 2024-04-19T02:16:27.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.551e-06 2024-04-19T02:16:27.812 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.812 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.812 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:27.812 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.788506+0000", 2024-04-19T02:16:27.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6971000000000002e-05 2024-04-19T02:16:27.812 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.812 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:27.813 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.788524+0000", 2024-04-19T02:16:27.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8400999999999999e-05 2024-04-19T02:16:27.813 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:27.813 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:27.813 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:27.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.813 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:79613 5.d 5:b1574173:::benchmark_data_smithi121_44835_object79612:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:27.813 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:27.781787+0000", 2024-04-19T02:16:27.813 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0065437610000000004, 2024-04-19T02:16:27.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0069963869999999997, 2024-04-19T02:16:27.813 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:27.813 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:27.813 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:27.813 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:27.814 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:27.814 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 79613 2024-04-19T02:16:27.814 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.814 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:27.814 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.814 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:27.814 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.781787+0000", 2024-04-19T02:16:27.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:27.814 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.814 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.814 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:27.814 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.781787+0000", 2024-04-19T02:16:27.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:27.815 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.815 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.815 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:27.815 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.781786+0000", 2024-04-19T02:16:27.815 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:27.815 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.815 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.815 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:27.815 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.781853+0000", 2024-04-19T02:16:27.815 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7136000000000002e-05 2024-04-19T02:16:27.815 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.815 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.815 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:27.815 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.781863+0000", 2024-04-19T02:16:27.815 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0190000000000001e-05 2024-04-19T02:16:27.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:27.816 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.781871+0000", 2024-04-19T02:16:27.816 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6240000000000002e-06 2024-04-19T02:16:27.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:27.816 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.783274+0000", 2024-04-19T02:16:27.816 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014027620000000001 2024-04-19T02:16:27.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:27.816 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.783386+0000", 2024-04-19T02:16:27.816 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000112494 2024-04-19T02:16:27.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.817 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:27.817 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.783518+0000", 2024-04-19T02:16:27.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013193300000000001 2024-04-19T02:16:27.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.817 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:27.817 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.787720+0000", 2024-04-19T02:16:27.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042023390000000002 2024-04-19T02:16:27.817 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:27.817 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:27.817 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:27.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.818 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:79615 5.7 5:e90af7cb:::benchmark_data_smithi121_44835_object79614:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:27.818 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:27.783609+0000", 2024-04-19T02:16:27.818 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0047215879999999997, 2024-04-19T02:16:27.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052601100000000001, 2024-04-19T02:16:27.818 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:27.818 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:27.818 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:27.818 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:27.818 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:27.818 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 79615 2024-04-19T02:16:27.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.818 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:27.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:27.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.783609+0000", 2024-04-19T02:16:27.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:27.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:27.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.783609+0000", 2024-04-19T02:16:27.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:27.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:27.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.783608+0000", 2024-04-19T02:16:27.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:27.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:27.820 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.783636+0000", 2024-04-19T02:16:27.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8098000000000001e-05 2024-04-19T02:16:27.820 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.820 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:27.820 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.783645+0000", 2024-04-19T02:16:27.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4089999999999992e-06 2024-04-19T02:16:27.820 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.820 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:27.820 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.783653+0000", 2024-04-19T02:16:27.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1600000000000001e-06 2024-04-19T02:16:27.820 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.820 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:27.821 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.787327+0000", 2024-04-19T02:16:27.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0036746169999999998 2024-04-19T02:16:27.821 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.821 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:27.821 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.787453+0000", 2024-04-19T02:16:27.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012574799999999999 2024-04-19T02:16:27.821 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:27.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:27.821 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:27.821 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.787601+0000", 2024-04-19T02:16:27.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014758100000000001 2024-04-19T02:16:27.821 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:27.821 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:27.821 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:27.822 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:27.822 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-04-19T02:16:27.822 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 9 2024-04-19T02:16:27.822 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:16:27.823 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:16:27.824 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:27.823+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:27.925 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:27.924+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:27.957 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:16:27.959 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-04-19T02:16:27.969 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-04-19T02:16:26.748547+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4715514714,"num_objects":71968,"num_object_clones":0,"num_object_copies":143936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71968,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":72192,"num_write_kb":4607890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60740,"ondisk_log_size":60740,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":242,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":9407288,"kb_used_data":9183504,"kb_used_omap":4,"kb_used_meta":223739,"kb_avail":273708232,"statfs":{"total":289910292480,"available":280277229568,"internally_reserved":0,"allocated":9403908096,"data_stored":9403295872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":229109074},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,7,5,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":625868800,"num_objects":9550,"num_object_clones":0,"num_object_copies":19100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9550,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9550,"num_write_kb":611200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.697195"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.034994+0000","last_change":"2024-04-19T02:15:29.280412+0000","last_active":"2024-04-19T02:16:20.034994+0000","last_peered":"2024-04-19T02:16:20.034994+0000","last_clean":"2024-04-19T02:16:20.034994+0000","last_became_active":"2024-04-19T02:15:29.278762+0000","last_became_peered":"2024-04-19T02:15:29.278762+0000","last_unstale":"2024-04-19T02:16:20.034994+0000","last_undegraded":"2024-04-19T02:16:20.034994+0000","last_fullsized":"2024-04-19T02:16:20.034994+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:45.301675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.034556+0000","last_change":"2024-04-19T02:15:29.284695+0000","last_active":"2024-04-19T02:16:20.034556+0000","last_peered":"2024-04-19T02:16:20.034556+0000","last_clean":"2024-04-19T02:16:20.034556+0000","last_became_active":"2024-04-19T02:15:29.283468+0000","last_became_peered":"2024-04-19T02:15:29.283468+0000","last_unstale":"2024-04-19T02:16:20.034556+0000","last_undegraded":"2024-04-19T02:16:20.034556+0000","last_fullsized":"2024-04-19T02:16:20.034556+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.384881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.038695+0000","last_change":"2024-04-19T02:15:29.286709+0000","last_active":"2024-04-19T02:16:20.038695+0000","last_peered":"2024-04-19T02:16:20.038695+0000","last_clean":"2024-04-19T02:16:20.038695+0000","last_became_active":"2024-04-19T02:15:29.286169+0000","last_became_peered":"2024-04-19T02:15:29.286169+0000","last_unstale":"2024-04-19T02:16:20.038695+0000","last_undegraded":"2024-04-19T02:16:20.038695+0000","last_fullsized":"2024-04-19T02:16:20.038695+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:58.741466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.038373+0000","last_change":"2024-04-19T02:15:29.280131+0000","last_active":"2024-04-19T02:16:20.038373+0000","last_peered":"2024-04-19T02:16:20.038373+0000","last_clean":"2024-04-19T02:16:20.038373+0000","last_became_active":"2024-04-19T02:15:29.279388+0000","last_became_peered":"2024-04-19T02:15:29.279388+0000","last_unstale":"2024-04-19T02:16:20.038373+0000","last_undegraded":"2024-04-19T02:16:20.038373+0000","last_fullsized":"2024-04-19T02:16:20.038373+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:36:48.819486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.036384+0000","last_change":"2024-04-19T02:15:53.955892+0000","last_active":"2024-04-19T02:16:20.036384+0000","last_peered":"2024-04-19T02:16:20.036384+0000","last_clean":"2024-04-19T02:16:20.036384+0000","last_became_active":"2024-04-19T02:15:53.955553+0000","last_became_peered":"2024-04-19T02:15:53.955553+0000","last_unstale":"2024-04-19T02:16:20.036384+0000","last_undegraded":"2024-04-19T02:16:20.036384+0000","last_fullsized":"2024-04-19T02:16:20.036384+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:45:39.791209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.038194+0000","last_change":"2024-04-19T02:15:29.283908+0000","last_active":"2024-04-19T02:16:20.038194+0000","last_peered":"2024-04-19T02:16:20.038194+0000","last_clean":"2024-04-19T02:16:20.038194+0000","last_became_active":"2024-04-19T02:15:29.281729+0000","last_became_peered":"2024-04-19T02:15:29.281729+0000","last_unstale":"2024-04-19T02:16:20.038194+0000","last_undegraded":"2024-04-19T02:16:20.038194+0000","last_fullsized":"2024-04-19T02:16:20.038194+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:03:15.383476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.037835+0000","last_change":"2024-04-19T02:15:29.281253+0000","last_active":"2024-04-19T02:16:20.037835+0000","last_peered":"2024-04-19T02:16:20.037835+0000","last_clean":"2024-04-19T02:16:20.037835+0000","last_became_active":"2024-04-19T02:15:29.279951+0000","last_became_peered":"2024-04-19T02:15:29.279951+0000","last_unstale":"2024-04-19T02:16:20.037835+0000","last_undegraded":"2024-04-19T02:16:20.037835+0000","last_fullsized":"2024-04-19T02:16:20.037835+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.037368+0000","last_change":"2024-04-19T02:15:29.283952+0000","last_active":"2024-04-19T02:16:20.037368+0000","last_peered":"2024-04-19T02:16:20.037368+0000","last_clean":"2024-04-19T02:16:20.037368+0000","last_became_active":"2024-04-19T02:15:29.282721+0000","last_became_peered":"2024-04-19T02:15:29.282721+0000","last_unstale":"2024-04-19T02:16:20.037368+0000","last_undegraded":"2024-04-19T02:16:20.037368+0000","last_fullsized":"2024-04-19T02:16:20.037368+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:45.301675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.036616+0000","last_change":"2024-04-19T02:15:29.282150+0000","last_active":"2024-04-19T02:16:20.036616+0000","last_peered":"2024-04-19T02:16:20.036616+0000","last_clean":"2024-04-19T02:16:20.036616+0000","last_became_active":"2024-04-19T02:15:29.281538+0000","last_became_peered":"2024-04-19T02:15:29.281538+0000","last_unstale":"2024-04-19T02:16:20.036616+0000","last_undegraded":"2024-04-19T02:16:20.036616+0000","last_fullsized":"2024-04-19T02:16:20.036616+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.034663+0000","last_change":"2024-04-19T02:15:29.284098+0000","last_active":"2024-04-19T02:16:20.034663+0000","last_peered":"2024-04-19T02:16:20.034663+0000","last_clean":"2024-04-19T02:16:20.034663+0000","last_became_active":"2024-04-19T02:15:29.282114+0000","last_became_peered":"2024-04-19T02:15:29.282114+0000","last_unstale":"2024-04-19T02:16:20.034663+0000","last_undegraded":"2024-04-19T02:16:20.034663+0000","last_fullsized":"2024-04-19T02:16:20.034663+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:16.568764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.038563+0000","last_change":"2024-04-19T02:15:29.280606+0000","last_active":"2024-04-19T02:16:20.038563+0000","last_peered":"2024-04-19T02:16:20.038563+0000","last_clean":"2024-04-19T02:16:20.038563+0000","last_became_active":"2024-04-19T02:15:29.280151+0000","last_became_peered":"2024-04-19T02:15:29.280151+0000","last_unstale":"2024-04-19T02:16:20.038563+0000","last_undegraded":"2024-04-19T02:16:20.038563+0000","last_fullsized":"2024-04-19T02:16:20.038563+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:26:22.452488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.038080+0000","last_change":"2024-04-19T02:15:53.958876+0000","last_active":"2024-04-19T02:16:20.038080+0000","last_peered":"2024-04-19T02:16:20.038080+0000","last_clean":"2024-04-19T02:16:20.038080+0000","last_became_active":"2024-04-19T02:15:53.958626+0000","last_became_peered":"2024-04-19T02:15:53.958626+0000","last_unstale":"2024-04-19T02:16:20.038080+0000","last_undegraded":"2024-04-19T02:16:20.038080+0000","last_fullsized":"2024-04-19T02:16:20.038080+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:23:57.044018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.036131+0000","last_change":"2024-04-19T02:15:53.956801+0000","last_active":"2024-04-19T02:16:20.036131+0000","last_peered":"2024-04-19T02:16:20.036131+0000","last_clean":"2024-04-19T02:16:20.036131+0000","last_became_active":"2024-04-19T02:15:53.956620+0000","last_became_peered":"2024-04-19T02:15:53.956620+0000","last_unstale":"2024-04-19T02:16:20.036131+0000","last_undegraded":"2024-04-19T02:16:20.036131+0000","last_fullsized":"2024-04-19T02:16:20.036131+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:57:05.843101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.038410+0000","last_change":"2024-04-19T02:15:29.284262+0000","last_active":"2024-04-19T02:16:20.038410+0000","last_peered":"2024-04-19T02:16:20.038410+0000","last_clean":"2024-04-19T02:16:20.038410+0000","last_became_active":"2024-04-19T02:15:29.283121+0000","last_became_peered":"2024-04-19T02:15:29.283121+0000","last_unstale":"2024-04-19T02:16:20.038410+0000","last_undegraded":"2024-04-19T02:16:20.038410+0000","last_fullsized":"2024-04-19T02:16:20.038410+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.037906+0000","last_change":"2024-04-19T02:15:29.285139+0000","last_active":"2024-04-19T02:16:20.037906+0000","last_peered":"2024-04-19T02:16:20.037906+0000","last_clean":"2024-04-19T02:16:20.037906+0000","last_became_active":"2024-04-19T02:15:29.284649+0000","last_became_peered":"2024-04-19T02:15:29.284649+0000","last_unstale":"2024-04-19T02:16:20.037906+0000","last_undegraded":"2024-04-19T02:16:20.037906+0000","last_fullsized":"2024-04-19T02:16:20.037906+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.037412+0000","last_change":"2024-04-19T02:15:29.283648+0000","last_active":"2024-04-19T02:16:20.037412+0000","last_peered":"2024-04-19T02:16:20.037412+0000","last_clean":"2024-04-19T02:16:20.037412+0000","last_became_active":"2024-04-19T02:15:29.281606+0000","last_became_peered":"2024-04-19T02:15:29.281606+0000","last_unstale":"2024-04-19T02:16:20.037412+0000","last_undegraded":"2024-04-19T02:16:20.037412+0000","last_fullsized":"2024-04-19T02:16:20.037412+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.036616+0000","last_change":"2024-04-19T02:15:29.278673+0000","last_active":"2024-04-19T02:16:20.036616+0000","last_peered":"2024-04-19T02:16:20.036616+0000","last_clean":"2024-04-19T02:16:20.036616+0000","last_became_active":"2024-04-19T02:15:29.277699+0000","last_became_peered":"2024-04-19T02:15:29.277699+0000","last_unstale":"2024-04-19T02:16:20.036616+0000","last_undegraded":"2024-04-19T02:16:20.036616+0000","last_fullsized":"2024-04-19T02:16:20.036616+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.034710+0000","last_change":"2024-04-19T02:15:29.283341+0000","last_active":"2024-04-19T02:16:20.034710+0000","last_peered":"2024-04-19T02:16:20.034710+0000","last_clean":"2024-04-19T02:16:20.034710+0000","last_became_active":"2024-04-19T02:15:29.281591+0000","last_became_peered":"2024-04-19T02:15:29.281591+0000","last_unstale":"2024-04-19T02:16:20.034710+0000","last_undegraded":"2024-04-19T02:16:20.034710+0000","last_fullsized":"2024-04-19T02:16:20.034710+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:34.593754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.036406+0000","last_change":"2024-04-19T02:15:29.282110+0000","last_active":"2024-04-19T02:16:20.036406+0000","last_peered":"2024-04-19T02:16:20.036406+0000","last_clean":"2024-04-19T02:16:20.036406+0000","last_became_active":"2024-04-19T02:15:29.281716+0000","last_became_peered":"2024-04-19T02:15:29.281716+0000","last_unstale":"2024-04-19T02:16:20.036406+0000","last_undegraded":"2024-04-19T02:16:20.036406+0000","last_fullsized":"2024-04-19T02:16:20.036406+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.038338+0000","last_change":"2024-04-19T02:15:29.285237+0000","last_active":"2024-04-19T02:16:20.038338+0000","last_peered":"2024-04-19T02:16:20.038338+0000","last_clean":"2024-04-19T02:16:20.038338+0000","last_became_active":"2024-04-19T02:15:29.282790+0000","last_became_peered":"2024-04-19T02:15:29.282790+0000","last_unstale":"2024-04-19T02:16:20.038338+0000","last_undegraded":"2024-04-19T02:16:20.038338+0000","last_fullsized":"2024-04-19T02:16:20.038338+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.037899+0000","last_change":"2024-04-19T02:15:29.282609+0000","last_active":"2024-04-19T02:16:20.037899+0000","last_peered":"2024-04-19T02:16:20.037899+0000","last_clean":"2024-04-19T02:16:20.037899+0000","last_became_active":"2024-04-19T02:15:29.281665+0000","last_became_peered":"2024-04-19T02:15:29.281665+0000","last_unstale":"2024-04-19T02:16:20.037899+0000","last_undegraded":"2024-04-19T02:16:20.037899+0000","last_fullsized":"2024-04-19T02:16:20.037899+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.384881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.038065+0000","last_change":"2024-04-19T02:15:53.955813+0000","last_active":"2024-04-19T02:16:20.038065+0000","last_peered":"2024-04-19T02:16:20.038065+0000","last_clean":"2024-04-19T02:16:20.038065+0000","last_became_active":"2024-04-19T02:15:53.955614+0000","last_became_peered":"2024-04-19T02:15:53.955614+0000","last_unstale":"2024-04-19T02:16:20.038065+0000","last_undegraded":"2024-04-19T02:16:20.038065+0000","last_fullsized":"2024-04-19T02:16:20.038065+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:58:03.192647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.035886+0000","last_change":"2024-04-19T02:15:29.277109+0000","last_active":"2024-04-19T02:16:20.035886+0000","last_peered":"2024-04-19T02:16:20.035886+0000","last_clean":"2024-04-19T02:16:20.035886+0000","last_became_active":"2024-04-19T02:15:29.275417+0000","last_became_peered":"2024-04-19T02:15:29.275417+0000","last_unstale":"2024-04-19T02:16:20.035886+0000","last_undegraded":"2024-04-19T02:16:20.035886+0000","last_fullsized":"2024-04-19T02:16:20.035886+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.035154+0000","last_change":"2024-04-19T02:15:29.283266+0000","last_active":"2024-04-19T02:16:20.035154+0000","last_peered":"2024-04-19T02:16:20.035154+0000","last_clean":"2024-04-19T02:16:20.035154+0000","last_became_active":"2024-04-19T02:15:29.281505+0000","last_became_peered":"2024-04-19T02:15:29.281505+0000","last_unstale":"2024-04-19T02:16:20.035154+0000","last_undegraded":"2024-04-19T02:16:20.035154+0000","last_fullsized":"2024-04-19T02:16:20.035154+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.034910+0000","last_change":"2024-04-19T02:15:29.278084+0000","last_active":"2024-04-19T02:16:20.034910+0000","last_peered":"2024-04-19T02:16:20.034910+0000","last_clean":"2024-04-19T02:16:20.034910+0000","last_became_active":"2024-04-19T02:15:29.276952+0000","last_became_peered":"2024-04-19T02:15:29.276952+0000","last_unstale":"2024-04-19T02:16:20.034910+0000","last_undegraded":"2024-04-19T02:16:20.034910+0000","last_fullsized":"2024-04-19T02:16:20.034910+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.036524+0000","last_change":"2024-04-19T02:15:29.279904+0000","last_active":"2024-04-19T02:16:20.036524+0000","last_peered":"2024-04-19T02:16:20.036524+0000","last_clean":"2024-04-19T02:16:20.036524+0000","last_became_active":"2024-04-19T02:15:29.278938+0000","last_became_peered":"2024-04-19T02:15:29.278938+0000","last_unstale":"2024-04-19T02:16:20.036524+0000","last_undegraded":"2024-04-19T02:16:20.036524+0000","last_fullsized":"2024-04-19T02:16:20.036524+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.038621+0000","last_change":"2024-04-19T02:15:29.287389+0000","last_active":"2024-04-19T02:16:20.038621+0000","last_peered":"2024-04-19T02:16:20.038621+0000","last_clean":"2024-04-19T02:16:20.038621+0000","last_became_active":"2024-04-19T02:15:29.286431+0000","last_became_peered":"2024-04-19T02:15:29.286431+0000","last_unstale":"2024-04-19T02:16:20.038621+0000","last_undegraded":"2024-04-19T02:16:20.038621+0000","last_fullsized":"2024-04-19T02:16:20.038621+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:58:30.117887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.036255+0000","last_change":"2024-04-19T02:15:53.959207+0000","last_active":"2024-04-19T02:16:20.036255+0000","last_peered":"2024-04-19T02:16:20.036255+0000","last_clean":"2024-04-19T02:16:20.036255+0000","last_became_active":"2024-04-19T02:15:53.959007+0000","last_became_peered":"2024-04-19T02:15:53.959007+0000","last_unstale":"2024-04-19T02:16:20.036255+0000","last_undegraded":"2024-04-19T02:16:20.036255+0000","last_fullsized":"2024-04-19T02:16:20.036255+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:08:21.065077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.036345+0000","last_change":"2024-04-19T02:15:29.281792+0000","last_active":"2024-04-19T02:16:20.036345+0000","last_peered":"2024-04-19T02:16:20.036345+0000","last_clean":"2024-04-19T02:16:20.036345+0000","last_became_active":"2024-04-19T02:15:29.280479+0000","last_became_peered":"2024-04-19T02:15:29.280479+0000","last_unstale":"2024-04-19T02:16:20.036345+0000","last_undegraded":"2024-04-19T02:16:20.036345+0000","last_fullsized":"2024-04-19T02:16:20.036345+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.035921+0000","last_change":"2024-04-19T02:15:28.888778+0000","last_active":"2024-04-19T02:16:20.035921+0000","last_peered":"2024-04-19T02:16:20.035921+0000","last_clean":"2024-04-19T02:16:20.035921+0000","last_became_active":"2024-04-19T02:15:28.888543+0000","last_became_peered":"2024-04-19T02:15:28.888543+0000","last_unstale":"2024-04-19T02:16:20.035921+0000","last_undegraded":"2024-04-19T02:16:20.035921+0000","last_fullsized":"2024-04-19T02:16:20.035921+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:43:51.221619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.036342+0000","last_change":"2024-04-19T02:15:29.279986+0000","last_active":"2024-04-19T02:16:20.036342+0000","last_peered":"2024-04-19T02:16:20.036342+0000","last_clean":"2024-04-19T02:16:20.036342+0000","last_became_active":"2024-04-19T02:15:29.279690+0000","last_became_peered":"2024-04-19T02:15:29.279690+0000","last_unstale":"2024-04-19T02:16:20.036342+0000","last_undegraded":"2024-04-19T02:16:20.036342+0000","last_fullsized":"2024-04-19T02:16:20.036342+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.037329+0000","last_change":"2024-04-19T02:15:28.890463+0000","last_active":"2024-04-19T02:16:20.037329+0000","last_peered":"2024-04-19T02:16:20.037329+0000","last_clean":"2024-04-19T02:16:20.037329+0000","last_became_active":"2024-04-19T02:15:28.889777+0000","last_became_peered":"2024-04-19T02:15:28.889777+0000","last_unstale":"2024-04-19T02:16:20.037329+0000","last_undegraded":"2024-04-19T02:16:20.037329+0000","last_fullsized":"2024-04-19T02:16:20.037329+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:58:21.520250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.034830+0000","last_change":"2024-04-19T02:15:29.280879+0000","last_active":"2024-04-19T02:16:20.034830+0000","last_peered":"2024-04-19T02:16:20.034830+0000","last_clean":"2024-04-19T02:16:20.034830+0000","last_became_active":"2024-04-19T02:15:29.279314+0000","last_became_peered":"2024-04-19T02:15:29.279314+0000","last_unstale":"2024-04-19T02:16:20.034830+0000","last_undegraded":"2024-04-19T02:16:20.034830+0000","last_fullsized":"2024-04-19T02:16:20.034830+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.036950+0000","last_change":"2024-04-19T02:15:28.891867+0000","last_active":"2024-04-19T02:16:20.036950+0000","last_peered":"2024-04-19T02:16:20.036950+0000","last_clean":"2024-04-19T02:16:20.036950+0000","last_became_active":"2024-04-19T02:15:28.890806+0000","last_became_peered":"2024-04-19T02:15:28.890806+0000","last_unstale":"2024-04-19T02:16:20.036950+0000","last_undegraded":"2024-04-19T02:16:20.036950+0000","last_fullsized":"2024-04-19T02:16:20.036950+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:57.946581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.037220+0000","last_change":"2024-04-19T02:15:29.278148+0000","last_active":"2024-04-19T02:16:20.037220+0000","last_peered":"2024-04-19T02:16:20.037220+0000","last_clean":"2024-04-19T02:16:20.037220+0000","last_became_active":"2024-04-19T02:15:29.277402+0000","last_became_peered":"2024-04-19T02:15:29.277402+0000","last_unstale":"2024-04-19T02:16:20.037220+0000","last_undegraded":"2024-04-19T02:16:20.037220+0000","last_fullsized":"2024-04-19T02:16:20.037220+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.038410+0000","last_change":"2024-04-19T02:15:28.892905+0000","last_active":"2024-04-19T02:16:20.038410+0000","last_peered":"2024-04-19T02:16:20.038410+0000","last_clean":"2024-04-19T02:16:20.038410+0000","last_became_active":"2024-04-19T02:15:28.892541+0000","last_became_peered":"2024-04-19T02:15:28.892541+0000","last_unstale":"2024-04-19T02:16:20.038410+0000","last_undegraded":"2024-04-19T02:16:20.038410+0000","last_fullsized":"2024-04-19T02:16:20.038410+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:33.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.036028+0000","last_change":"2024-04-19T02:15:29.278810+0000","last_active":"2024-04-19T02:16:20.036028+0000","last_peered":"2024-04-19T02:16:20.036028+0000","last_clean":"2024-04-19T02:16:20.036028+0000","last_became_active":"2024-04-19T02:15:29.278093+0000","last_became_peered":"2024-04-19T02:15:29.278093+0000","last_unstale":"2024-04-19T02:16:20.036028+0000","last_undegraded":"2024-04-19T02:16:20.036028+0000","last_fullsized":"2024-04-19T02:16:20.036028+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:34.883207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.035179+0000","last_change":"2024-04-19T02:15:28.892937+0000","last_active":"2024-04-19T02:16:20.035179+0000","last_peered":"2024-04-19T02:16:20.035179+0000","last_clean":"2024-04-19T02:16:20.035179+0000","last_became_active":"2024-04-19T02:15:28.891440+0000","last_became_peered":"2024-04-19T02:15:28.891440+0000","last_unstale":"2024-04-19T02:16:20.035179+0000","last_undegraded":"2024-04-19T02:16:20.035179+0000","last_fullsized":"2024-04-19T02:16:20.035179+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.036064+0000","last_change":"2024-04-19T02:15:29.278404+0000","last_active":"2024-04-19T02:16:20.036064+0000","last_peered":"2024-04-19T02:16:20.036064+0000","last_clean":"2024-04-19T02:16:20.036064+0000","last_became_active":"2024-04-19T02:15:29.277460+0000","last_became_peered":"2024-04-19T02:15:29.277460+0000","last_unstale":"2024-04-19T02:16:20.036064+0000","last_undegraded":"2024-04-19T02:16:20.036064+0000","last_fullsized":"2024-04-19T02:16:20.036064+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.038287+0000","last_change":"2024-04-19T02:15:28.891097+0000","last_active":"2024-04-19T02:16:20.038287+0000","last_peered":"2024-04-19T02:16:20.038287+0000","last_clean":"2024-04-19T02:16:20.038287+0000","last_became_active":"2024-04-19T02:15:28.890795+0000","last_became_peered":"2024-04-19T02:15:28.890795+0000","last_unstale":"2024-04-19T02:16:20.038287+0000","last_undegraded":"2024-04-19T02:16:20.038287+0000","last_fullsized":"2024-04-19T02:16:20.038287+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.038202+0000","last_change":"2024-04-19T02:15:29.278546+0000","last_active":"2024-04-19T02:16:20.038202+0000","last_peered":"2024-04-19T02:16:20.038202+0000","last_clean":"2024-04-19T02:16:20.038202+0000","last_became_active":"2024-04-19T02:15:29.277547+0000","last_became_peered":"2024-04-19T02:15:29.277547+0000","last_unstale":"2024-04-19T02:16:20.038202+0000","last_undegraded":"2024-04-19T02:16:20.038202+0000","last_fullsized":"2024-04-19T02:16:20.038202+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.038108+0000","last_change":"2024-04-19T02:15:28.892977+0000","last_active":"2024-04-19T02:16:20.038108+0000","last_peered":"2024-04-19T02:16:20.038108+0000","last_clean":"2024-04-19T02:16:20.038108+0000","last_became_active":"2024-04-19T02:15:28.892636+0000","last_became_peered":"2024-04-19T02:15:28.892636+0000","last_unstale":"2024-04-19T02:16:20.038108+0000","last_undegraded":"2024-04-19T02:16:20.038108+0000","last_fullsized":"2024-04-19T02:16:20.038108+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:43:51.221619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.036297+0000","last_change":"2024-04-19T02:15:53.955655+0000","last_active":"2024-04-19T02:16:20.036297+0000","last_peered":"2024-04-19T02:16:20.036297+0000","last_clean":"2024-04-19T02:16:20.036297+0000","last_became_active":"2024-04-19T02:15:53.955382+0000","last_became_peered":"2024-04-19T02:15:53.955382+0000","last_unstale":"2024-04-19T02:16:20.036297+0000","last_undegraded":"2024-04-19T02:16:20.036297+0000","last_fullsized":"2024-04-19T02:16:20.036297+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:48.239260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.036209+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:16:20.036209+0000","last_peered":"2024-04-19T02:16:20.036209+0000","last_clean":"2024-04-19T02:16:20.036209+0000","last_became_active":"2024-04-19T02:15:28.890751+0000","last_became_peered":"2024-04-19T02:15:28.890751+0000","last_unstale":"2024-04-19T02:16:20.036209+0000","last_undegraded":"2024-04-19T02:16:20.036209+0000","last_fullsized":"2024-04-19T02:16:20.036209+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.036048+0000","last_change":"2024-04-19T02:15:53.957865+0000","last_active":"2024-04-19T02:16:20.036048+0000","last_peered":"2024-04-19T02:16:20.036048+0000","last_clean":"2024-04-19T02:16:20.036048+0000","last_became_active":"2024-04-19T02:15:53.957627+0000","last_became_peered":"2024-04-19T02:15:53.957627+0000","last_unstale":"2024-04-19T02:16:20.036048+0000","last_undegraded":"2024-04-19T02:16:20.036048+0000","last_fullsized":"2024-04-19T02:16:20.036048+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:16:45.799016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.034193+0000","last_change":"2024-04-19T02:15:28.892934+0000","last_active":"2024-04-19T02:16:20.034193+0000","last_peered":"2024-04-19T02:16:20.034193+0000","last_clean":"2024-04-19T02:16:20.034193+0000","last_became_active":"2024-04-19T02:15:28.891879+0000","last_became_peered":"2024-04-19T02:15:28.891879+0000","last_unstale":"2024-04-19T02:16:20.034193+0000","last_undegraded":"2024-04-19T02:16:20.034193+0000","last_fullsized":"2024-04-19T02:16:20.034193+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:10:12.514798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.036441+0000","last_change":"2024-04-19T02:15:29.279685+0000","last_active":"2024-04-19T02:16:20.036441+0000","last_peered":"2024-04-19T02:16:20.036441+0000","last_clean":"2024-04-19T02:16:20.036441+0000","last_became_active":"2024-04-19T02:15:29.278810+0000","last_became_peered":"2024-04-19T02:15:29.278810+0000","last_unstale":"2024-04-19T02:16:20.036441+0000","last_undegraded":"2024-04-19T02:16:20.036441+0000","last_fullsized":"2024-04-19T02:16:20.036441+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.037563+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:16:20.037563+0000","last_peered":"2024-04-19T02:16:20.037563+0000","last_clean":"2024-04-19T02:16:20.037563+0000","last_became_active":"2024-04-19T02:15:28.890882+0000","last_became_peered":"2024-04-19T02:15:28.890882+0000","last_unstale":"2024-04-19T02:16:20.037563+0000","last_undegraded":"2024-04-19T02:16:20.037563+0000","last_fullsized":"2024-04-19T02:16:20.037563+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:31.673938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.037149+0000","last_change":"2024-04-19T02:15:29.284258+0000","last_active":"2024-04-19T02:16:20.037149+0000","last_peered":"2024-04-19T02:16:20.037149+0000","last_clean":"2024-04-19T02:16:20.037149+0000","last_became_active":"2024-04-19T02:15:29.283995+0000","last_became_peered":"2024-04-19T02:15:29.283995+0000","last_unstale":"2024-04-19T02:16:20.037149+0000","last_undegraded":"2024-04-19T02:16:20.037149+0000","last_fullsized":"2024-04-19T02:16:20.037149+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:35.941308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"28'4569","reported_seq":4589,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-19T02:16:22.120766+0000","last_change":"2024-04-19T02:15:53.956977+0000","last_active":"2024-04-19T02:16:22.120766+0000","last_peered":"2024-04-19T02:16:22.120766+0000","last_clean":"2024-04-19T02:16:22.120766+0000","last_became_active":"2024-04-19T02:15:53.956730+0000","last_became_peered":"2024-04-19T02:15:53.956730+0000","last_unstale":"2024-04-19T02:16:22.120766+0000","last_undegraded":"2024-04-19T02:16:22.120766+0000","last_fullsized":"2024-04-19T02:16:22.120766+0000","mapping_epoch":16,"log_start":"19'800","ondisk_log_start":"19'800","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3769,"log_dups_size":0,"ondisk_log_size":3769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:56:46.323499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":299433984,"num_objects":4569,"num_object_clones":0,"num_object_copies":9138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4569,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":292416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.040302+0000","last_change":"2024-04-19T02:15:28.890265+0000","last_active":"2024-04-19T02:16:20.040302+0000","last_peered":"2024-04-19T02:16:20.040302+0000","last_clean":"2024-04-19T02:16:20.040302+0000","last_became_active":"2024-04-19T02:15:28.890004+0000","last_became_peered":"2024-04-19T02:15:28.890004+0000","last_unstale":"2024-04-19T02:16:20.040302+0000","last_undegraded":"2024-04-19T02:16:20.040302+0000","last_fullsized":"2024-04-19T02:16:20.040302+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:02.517101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.035003+0000","last_change":"2024-04-19T02:15:29.285529+0000","last_active":"2024-04-19T02:16:20.035003+0000","last_peered":"2024-04-19T02:16:20.035003+0000","last_clean":"2024-04-19T02:16:20.035003+0000","last_became_active":"2024-04-19T02:15:29.285197+0000","last_became_peered":"2024-04-19T02:15:29.285197+0000","last_unstale":"2024-04-19T02:16:20.035003+0000","last_undegraded":"2024-04-19T02:16:20.035003+0000","last_fullsized":"2024-04-19T02:16:20.035003+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"28'4543","reported_seq":4563,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-19T02:16:22.152018+0000","last_change":"2024-04-19T02:15:53.958523+0000","last_active":"2024-04-19T02:16:22.152018+0000","last_peered":"2024-04-19T02:16:22.152018+0000","last_clean":"2024-04-19T02:16:22.152018+0000","last_became_active":"2024-04-19T02:15:53.957627+0000","last_became_peered":"2024-04-19T02:15:53.957627+0000","last_unstale":"2024-04-19T02:16:22.152018+0000","last_undegraded":"2024-04-19T02:16:22.152018+0000","last_fullsized":"2024-04-19T02:16:22.152018+0000","mapping_epoch":16,"log_start":"19'500","ondisk_log_start":"19'500","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":4043,"log_dups_size":0,"ondisk_log_size":4043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:59:55.120296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297730048,"num_objects":4543,"num_object_clones":0,"num_object_copies":9086,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4543,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4543,"num_write_kb":290752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.034565+0000","last_change":"2024-04-19T02:15:28.893902+0000","last_active":"2024-04-19T02:16:20.034565+0000","last_peered":"2024-04-19T02:16:20.034565+0000","last_clean":"2024-04-19T02:16:20.034565+0000","last_became_active":"2024-04-19T02:15:28.893231+0000","last_became_peered":"2024-04-19T02:15:28.893231+0000","last_unstale":"2024-04-19T02:16:20.034565+0000","last_undegraded":"2024-04-19T02:16:20.034565+0000","last_fullsized":"2024-04-19T02:16:20.034565+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:23.658442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.034346+0000","last_change":"2024-04-19T02:15:29.282874+0000","last_active":"2024-04-19T02:16:20.034346+0000","last_peered":"2024-04-19T02:16:20.034346+0000","last_clean":"2024-04-19T02:16:20.034346+0000","last_became_active":"2024-04-19T02:15:29.281675+0000","last_became_peered":"2024-04-19T02:15:29.281675+0000","last_unstale":"2024-04-19T02:16:20.034346+0000","last_undegraded":"2024-04-19T02:16:20.034346+0000","last_fullsized":"2024-04-19T02:16:20.034346+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:35.941308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"28'4482","reported_seq":4502,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-19T02:16:22.173329+0000","last_change":"2024-04-19T02:15:53.958324+0000","last_active":"2024-04-19T02:16:22.173329+0000","last_peered":"2024-04-19T02:16:22.173329+0000","last_clean":"2024-04-19T02:16:22.173329+0000","last_became_active":"2024-04-19T02:15:53.957392+0000","last_became_peered":"2024-04-19T02:15:53.957392+0000","last_unstale":"2024-04-19T02:16:22.173329+0000","last_undegraded":"2024-04-19T02:16:22.173329+0000","last_fullsized":"2024-04-19T02:16:22.173329+0000","mapping_epoch":16,"log_start":"19'500","ondisk_log_start":"19'500","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3982,"log_dups_size":0,"ondisk_log_size":3982,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:12:58.132969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":293732352,"num_objects":4482,"num_object_clones":0,"num_object_copies":8964,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4482,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4482,"num_write_kb":286848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.038641+0000","last_change":"2024-04-19T02:15:28.891234+0000","last_active":"2024-04-19T02:16:20.038641+0000","last_peered":"2024-04-19T02:16:20.038641+0000","last_clean":"2024-04-19T02:16:20.038641+0000","last_became_active":"2024-04-19T02:15:28.890881+0000","last_became_peered":"2024-04-19T02:15:28.890881+0000","last_unstale":"2024-04-19T02:16:20.038641+0000","last_undegraded":"2024-04-19T02:16:20.038641+0000","last_fullsized":"2024-04-19T02:16:20.038641+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.038316+0000","last_change":"2024-04-19T02:15:29.281937+0000","last_active":"2024-04-19T02:16:20.038316+0000","last_peered":"2024-04-19T02:16:20.038316+0000","last_clean":"2024-04-19T02:16:20.038316+0000","last_became_active":"2024-04-19T02:15:29.280727+0000","last_became_peered":"2024-04-19T02:15:29.280727+0000","last_unstale":"2024-04-19T02:16:20.038316+0000","last_undegraded":"2024-04-19T02:16:20.038316+0000","last_fullsized":"2024-04-19T02:16:20.038316+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"28'4559","reported_seq":4579,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-19T02:16:22.179179+0000","last_change":"2024-04-19T02:15:53.959099+0000","last_active":"2024-04-19T02:16:22.179179+0000","last_peered":"2024-04-19T02:16:22.179179+0000","last_clean":"2024-04-19T02:16:22.179179+0000","last_became_active":"2024-04-19T02:15:53.958885+0000","last_became_peered":"2024-04-19T02:15:53.958885+0000","last_unstale":"2024-04-19T02:16:22.179179+0000","last_undegraded":"2024-04-19T02:16:22.179179+0000","last_fullsized":"2024-04-19T02:16:22.179179+0000","mapping_epoch":16,"log_start":"20'1000","ondisk_log_start":"20'1000","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3559,"log_dups_size":0,"ondisk_log_size":3559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:53:26.969927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":298778624,"num_objects":4559,"num_object_clones":0,"num_object_copies":9118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4559,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4559,"num_write_kb":291776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.037872+0000","last_change":"2024-04-19T02:15:28.892767+0000","last_active":"2024-04-19T02:16:20.037872+0000","last_peered":"2024-04-19T02:16:20.037872+0000","last_clean":"2024-04-19T02:16:20.037872+0000","last_became_active":"2024-04-19T02:15:28.892235+0000","last_became_peered":"2024-04-19T02:15:28.892235+0000","last_unstale":"2024-04-19T02:16:20.037872+0000","last_undegraded":"2024-04-19T02:16:20.037872+0000","last_fullsized":"2024-04-19T02:16:20.037872+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:37.690735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.036697+0000","last_change":"2024-04-19T02:15:29.279857+0000","last_active":"2024-04-19T02:16:20.036697+0000","last_peered":"2024-04-19T02:16:20.036697+0000","last_clean":"2024-04-19T02:16:20.036697+0000","last_became_active":"2024-04-19T02:15:29.279536+0000","last_became_peered":"2024-04-19T02:15:29.279536+0000","last_unstale":"2024-04-19T02:16:20.036697+0000","last_undegraded":"2024-04-19T02:16:20.036697+0000","last_fullsized":"2024-04-19T02:16:20.036697+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:00.191179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"28'4489","reported_seq":4509,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-19T02:16:22.176426+0000","last_change":"2024-04-19T02:15:53.957261+0000","last_active":"2024-04-19T02:16:22.176426+0000","last_peered":"2024-04-19T02:16:22.176426+0000","last_clean":"2024-04-19T02:16:22.176426+0000","last_became_active":"2024-04-19T02:15:53.957092+0000","last_became_peered":"2024-04-19T02:15:53.957092+0000","last_unstale":"2024-04-19T02:16:22.176426+0000","last_undegraded":"2024-04-19T02:16:22.176426+0000","last_fullsized":"2024-04-19T02:16:22.176426+0000","mapping_epoch":16,"log_start":"19'700","ondisk_log_start":"19'700","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3789,"log_dups_size":0,"ondisk_log_size":3789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:54:15.544923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":294191104,"num_objects":4489,"num_object_clones":0,"num_object_copies":8978,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4489,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4489,"num_write_kb":287296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.036527+0000","last_change":"2024-04-19T02:15:28.891611+0000","last_active":"2024-04-19T02:16:20.036527+0000","last_peered":"2024-04-19T02:16:20.036527+0000","last_clean":"2024-04-19T02:16:20.036527+0000","last_became_active":"2024-04-19T02:15:28.890914+0000","last_became_peered":"2024-04-19T02:15:28.890914+0000","last_unstale":"2024-04-19T02:16:20.036527+0000","last_undegraded":"2024-04-19T02:16:20.036527+0000","last_fullsized":"2024-04-19T02:16:20.036527+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:37.690735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.038254+0000","last_change":"2024-04-19T02:15:29.285774+0000","last_active":"2024-04-19T02:16:20.038254+0000","last_peered":"2024-04-19T02:16:20.038254+0000","last_clean":"2024-04-19T02:16:20.038254+0000","last_became_active":"2024-04-19T02:15:29.284705+0000","last_became_peered":"2024-04-19T02:15:29.284705+0000","last_unstale":"2024-04-19T02:16:20.038254+0000","last_undegraded":"2024-04-19T02:16:20.038254+0000","last_fullsized":"2024-04-19T02:16:20.038254+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"28'4433","reported_seq":4453,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-19T02:16:22.154369+0000","last_change":"2024-04-19T02:15:53.955286+0000","last_active":"2024-04-19T02:16:22.154369+0000","last_peered":"2024-04-19T02:16:22.154369+0000","last_clean":"2024-04-19T02:16:22.154369+0000","last_became_active":"2024-04-19T02:15:53.955026+0000","last_became_peered":"2024-04-19T02:15:53.955026+0000","last_unstale":"2024-04-19T02:16:22.154369+0000","last_undegraded":"2024-04-19T02:16:22.154369+0000","last_fullsized":"2024-04-19T02:16:22.154369+0000","mapping_epoch":16,"log_start":"20'900","ondisk_log_start":"20'900","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3533,"log_dups_size":0,"ondisk_log_size":3533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:05:48.594301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":290521088,"num_objects":4433,"num_object_clones":0,"num_object_copies":8866,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4433,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4433,"num_write_kb":283712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.038226+0000","last_change":"2024-04-19T02:15:28.892873+0000","last_active":"2024-04-19T02:16:20.038226+0000","last_peered":"2024-04-19T02:16:20.038226+0000","last_clean":"2024-04-19T02:16:20.038226+0000","last_became_active":"2024-04-19T02:15:28.892487+0000","last_became_peered":"2024-04-19T02:15:28.892487+0000","last_unstale":"2024-04-19T02:16:20.038226+0000","last_undegraded":"2024-04-19T02:16:20.038226+0000","last_fullsized":"2024-04-19T02:16:20.038226+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:35.412837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.038782+0000","last_change":"2024-04-19T02:15:29.285019+0000","last_active":"2024-04-19T02:16:20.038782+0000","last_peered":"2024-04-19T02:16:20.038782+0000","last_clean":"2024-04-19T02:16:20.038782+0000","last_became_active":"2024-04-19T02:15:29.284650+0000","last_became_peered":"2024-04-19T02:15:29.284650+0000","last_unstale":"2024-04-19T02:16:20.038782+0000","last_undegraded":"2024-04-19T02:16:20.038782+0000","last_fullsized":"2024-04-19T02:16:20.038782+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"28'4496","reported_seq":4516,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-19T02:16:22.186495+0000","last_change":"2024-04-19T02:15:53.957403+0000","last_active":"2024-04-19T02:16:22.186495+0000","last_peered":"2024-04-19T02:16:22.186495+0000","last_clean":"2024-04-19T02:16:22.186495+0000","last_became_active":"2024-04-19T02:15:53.957190+0000","last_became_peered":"2024-04-19T02:15:53.957190+0000","last_unstale":"2024-04-19T02:16:22.186495+0000","last_undegraded":"2024-04-19T02:16:22.186495+0000","last_fullsized":"2024-04-19T02:16:22.186495+0000","mapping_epoch":16,"log_start":"19'700","ondisk_log_start":"19'700","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3796,"log_dups_size":0,"ondisk_log_size":3796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:07:12.817884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":294649856,"num_objects":4496,"num_object_clones":0,"num_object_copies":8992,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4496,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4496,"num_write_kb":287744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.037762+0000","last_change":"2024-04-19T02:15:53.956839+0000","last_active":"2024-04-19T02:16:20.037762+0000","last_peered":"2024-04-19T02:16:20.037762+0000","last_clean":"2024-04-19T02:16:20.037762+0000","last_became_active":"2024-04-19T02:15:53.956630+0000","last_became_peered":"2024-04-19T02:15:53.956630+0000","last_unstale":"2024-04-19T02:16:20.037762+0000","last_undegraded":"2024-04-19T02:16:20.037762+0000","last_fullsized":"2024-04-19T02:16:20.037762+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:47.229730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.038499+0000","last_change":"2024-04-19T02:15:29.287190+0000","last_active":"2024-04-19T02:16:20.038499+0000","last_peered":"2024-04-19T02:16:20.038499+0000","last_clean":"2024-04-19T02:16:20.038499+0000","last_became_active":"2024-04-19T02:15:29.286606+0000","last_became_peered":"2024-04-19T02:15:29.286606+0000","last_unstale":"2024-04-19T02:16:20.038499+0000","last_undegraded":"2024-04-19T02:16:20.038499+0000","last_fullsized":"2024-04-19T02:16:20.038499+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:28.387062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"28'4440","reported_seq":4460,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-19T02:16:22.145370+0000","last_change":"2024-04-19T02:15:53.958448+0000","last_active":"2024-04-19T02:16:22.145370+0000","last_peered":"2024-04-19T02:16:22.145370+0000","last_clean":"2024-04-19T02:16:22.145370+0000","last_became_active":"2024-04-19T02:15:53.957595+0000","last_became_peered":"2024-04-19T02:15:53.957595+0000","last_unstale":"2024-04-19T02:16:22.145370+0000","last_undegraded":"2024-04-19T02:16:22.145370+0000","last_fullsized":"2024-04-19T02:16:22.145370+0000","mapping_epoch":16,"log_start":"19'400","ondisk_log_start":"19'400","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":4040,"log_dups_size":0,"ondisk_log_size":4040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:26:31.855319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":290979840,"num_objects":4440,"num_object_clones":0,"num_object_copies":8880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4440,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4440,"num_write_kb":284160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.035109+0000","last_change":"2024-04-19T02:15:28.894121+0000","last_active":"2024-04-19T02:16:20.035109+0000","last_peered":"2024-04-19T02:16:20.035109+0000","last_clean":"2024-04-19T02:16:20.035109+0000","last_became_active":"2024-04-19T02:15:28.893902+0000","last_became_peered":"2024-04-19T02:15:28.893902+0000","last_unstale":"2024-04-19T02:16:20.035109+0000","last_undegraded":"2024-04-19T02:16:20.035109+0000","last_fullsized":"2024-04-19T02:16:20.035109+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:10:35.146583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.036703+0000","last_change":"2024-04-19T02:15:29.282870+0000","last_active":"2024-04-19T02:16:20.036703+0000","last_peered":"2024-04-19T02:16:20.036703+0000","last_clean":"2024-04-19T02:16:20.036703+0000","last_became_active":"2024-04-19T02:15:29.281873+0000","last_became_peered":"2024-04-19T02:15:29.281873+0000","last_unstale":"2024-04-19T02:16:20.036703+0000","last_undegraded":"2024-04-19T02:16:20.036703+0000","last_fullsized":"2024-04-19T02:16:20.036703+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"28'4589","reported_seq":4609,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-19T02:16:22.189921+0000","last_change":"2024-04-19T02:15:53.955498+0000","last_active":"2024-04-19T02:16:22.189921+0000","last_peered":"2024-04-19T02:16:22.189921+0000","last_clean":"2024-04-19T02:16:22.189921+0000","last_became_active":"2024-04-19T02:15:53.954910+0000","last_became_peered":"2024-04-19T02:15:53.954910+0000","last_unstale":"2024-04-19T02:16:22.189921+0000","last_undegraded":"2024-04-19T02:16:22.189921+0000","last_fullsized":"2024-04-19T02:16:22.189921+0000","mapping_epoch":16,"log_start":"20'1000","ondisk_log_start":"20'1000","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3589,"log_dups_size":0,"ondisk_log_size":3589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:58:27.262672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":300744704,"num_objects":4589,"num_object_clones":0,"num_object_copies":9178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4589,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4589,"num_write_kb":293696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.037004+0000","last_change":"2024-04-19T02:15:24.527061+0000","last_active":"2024-04-19T02:16:20.037004+0000","last_peered":"2024-04-19T02:16:20.037004+0000","last_clean":"2024-04-19T02:16:20.037004+0000","last_became_active":"2024-04-19T02:15:24.526757+0000","last_became_peered":"2024-04-19T02:15:24.526757+0000","last_unstale":"2024-04-19T02:16:20.037004+0000","last_undegraded":"2024-04-19T02:16:20.037004+0000","last_fullsized":"2024-04-19T02:16:20.037004+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:17:13.649077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.038715+0000","last_change":"2024-04-19T02:15:28.892766+0000","last_active":"2024-04-19T02:16:20.038715+0000","last_peered":"2024-04-19T02:16:20.038715+0000","last_clean":"2024-04-19T02:16:20.038715+0000","last_became_active":"2024-04-19T02:15:28.892396+0000","last_became_peered":"2024-04-19T02:15:28.892396+0000","last_unstale":"2024-04-19T02:16:20.038715+0000","last_undegraded":"2024-04-19T02:16:20.038715+0000","last_fullsized":"2024-04-19T02:16:20.038715+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:57.946581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.034577+0000","last_change":"2024-04-19T02:15:29.277922+0000","last_active":"2024-04-19T02:16:20.034577+0000","last_peered":"2024-04-19T02:16:20.034577+0000","last_clean":"2024-04-19T02:16:20.034577+0000","last_became_active":"2024-04-19T02:15:29.276968+0000","last_became_peered":"2024-04-19T02:15:29.276968+0000","last_unstale":"2024-04-19T02:16:20.034577+0000","last_undegraded":"2024-04-19T02:16:20.034577+0000","last_fullsized":"2024-04-19T02:16:20.034577+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"28'4527","reported_seq":4547,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-19T02:16:22.194900+0000","last_change":"2024-04-19T02:15:53.955228+0000","last_active":"2024-04-19T02:16:22.194900+0000","last_peered":"2024-04-19T02:16:22.194900+0000","last_clean":"2024-04-19T02:16:22.194900+0000","last_became_active":"2024-04-19T02:15:53.954960+0000","last_became_peered":"2024-04-19T02:15:53.954960+0000","last_unstale":"2024-04-19T02:16:22.194900+0000","last_undegraded":"2024-04-19T02:16:22.194900+0000","last_fullsized":"2024-04-19T02:16:22.194900+0000","mapping_epoch":16,"log_start":"20'900","ondisk_log_start":"20'900","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3627,"log_dups_size":0,"ondisk_log_size":3627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:46:07.409922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":296681472,"num_objects":4527,"num_object_clones":0,"num_object_copies":9054,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4527,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4527,"num_write_kb":289728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.038392+0000","last_change":"2024-04-19T02:15:24.530933+0000","last_active":"2024-04-19T02:16:20.038392+0000","last_peered":"2024-04-19T02:16:20.038392+0000","last_clean":"2024-04-19T02:16:20.038392+0000","last_became_active":"2024-04-19T02:15:24.530550+0000","last_became_peered":"2024-04-19T02:15:24.530550+0000","last_unstale":"2024-04-19T02:16:20.038392+0000","last_undegraded":"2024-04-19T02:16:20.038392+0000","last_fullsized":"2024-04-19T02:16:20.038392+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:18:15.194321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.038008+0000","last_change":"2024-04-19T02:15:28.893062+0000","last_active":"2024-04-19T02:16:20.038008+0000","last_peered":"2024-04-19T02:16:20.038008+0000","last_clean":"2024-04-19T02:16:20.038008+0000","last_became_active":"2024-04-19T02:15:28.892798+0000","last_became_peered":"2024-04-19T02:15:28.892798+0000","last_unstale":"2024-04-19T02:16:20.038008+0000","last_undegraded":"2024-04-19T02:16:20.038008+0000","last_fullsized":"2024-04-19T02:16:20.038008+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:53.170180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.037084+0000","last_change":"2024-04-19T02:15:29.278294+0000","last_active":"2024-04-19T02:16:20.037084+0000","last_peered":"2024-04-19T02:16:20.037084+0000","last_clean":"2024-04-19T02:16:20.037084+0000","last_became_active":"2024-04-19T02:15:29.277536+0000","last_became_peered":"2024-04-19T02:15:29.277536+0000","last_unstale":"2024-04-19T02:16:20.037084+0000","last_undegraded":"2024-04-19T02:16:20.037084+0000","last_fullsized":"2024-04-19T02:16:20.037084+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"28'4510","reported_seq":4530,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-19T02:16:22.133277+0000","last_change":"2024-04-19T02:15:53.956251+0000","last_active":"2024-04-19T02:16:22.133277+0000","last_peered":"2024-04-19T02:16:22.133277+0000","last_clean":"2024-04-19T02:16:22.133277+0000","last_became_active":"2024-04-19T02:15:53.955886+0000","last_became_peered":"2024-04-19T02:15:53.955886+0000","last_unstale":"2024-04-19T02:16:22.133277+0000","last_undegraded":"2024-04-19T02:16:22.133277+0000","last_fullsized":"2024-04-19T02:16:22.133277+0000","mapping_epoch":16,"log_start":"20'900","ondisk_log_start":"20'900","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3610,"log_dups_size":0,"ondisk_log_size":3610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:38:38.586906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":295567360,"num_objects":4510,"num_object_clones":0,"num_object_copies":9020,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4510,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4510,"num_write_kb":288640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.035835+0000","last_change":"2024-04-19T02:15:24.527048+0000","last_active":"2024-04-19T02:16:20.035835+0000","last_peered":"2024-04-19T02:16:20.035835+0000","last_clean":"2024-04-19T02:16:20.035835+0000","last_became_active":"2024-04-19T02:15:24.526790+0000","last_became_peered":"2024-04-19T02:15:24.526790+0000","last_unstale":"2024-04-19T02:16:20.035835+0000","last_undegraded":"2024-04-19T02:16:20.035835+0000","last_fullsized":"2024-04-19T02:16:20.035835+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.037276+0000","last_change":"2024-04-19T02:15:53.956945+0000","last_active":"2024-04-19T02:16:20.037276+0000","last_peered":"2024-04-19T02:16:20.037276+0000","last_clean":"2024-04-19T02:16:20.037276+0000","last_became_active":"2024-04-19T02:15:53.956719+0000","last_became_peered":"2024-04-19T02:15:53.956719+0000","last_unstale":"2024-04-19T02:16:20.037276+0000","last_undegraded":"2024-04-19T02:16:20.037276+0000","last_fullsized":"2024-04-19T02:16:20.037276+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:00:37.754624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.037035+0000","last_change":"2024-04-19T02:15:29.282663+0000","last_active":"2024-04-19T02:16:20.037035+0000","last_peered":"2024-04-19T02:16:20.037035+0000","last_clean":"2024-04-19T02:16:20.037035+0000","last_became_active":"2024-04-19T02:15:29.282217+0000","last_became_peered":"2024-04-19T02:15:29.282217+0000","last_unstale":"2024-04-19T02:16:20.037035+0000","last_undegraded":"2024-04-19T02:16:20.037035+0000","last_fullsized":"2024-04-19T02:16:20.037035+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"28'4465","reported_seq":4485,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-19T02:16:22.157670+0000","last_change":"2024-04-19T02:15:53.958264+0000","last_active":"2024-04-19T02:16:22.157670+0000","last_peered":"2024-04-19T02:16:22.157670+0000","last_clean":"2024-04-19T02:16:22.157670+0000","last_became_active":"2024-04-19T02:15:53.956689+0000","last_became_peered":"2024-04-19T02:15:53.956689+0000","last_unstale":"2024-04-19T02:16:22.157670+0000","last_undegraded":"2024-04-19T02:16:22.157670+0000","last_fullsized":"2024-04-19T02:16:22.157670+0000","mapping_epoch":16,"log_start":"19'500","ondisk_log_start":"19'500","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3965,"log_dups_size":0,"ondisk_log_size":3965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:24:32.928594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":292618240,"num_objects":4465,"num_object_clones":0,"num_object_copies":8930,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4465,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4465,"num_write_kb":285760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.038050+0000","last_change":"2024-04-19T02:15:24.530924+0000","last_active":"2024-04-19T02:16:20.038050+0000","last_peered":"2024-04-19T02:16:20.038050+0000","last_clean":"2024-04-19T02:16:20.038050+0000","last_became_active":"2024-04-19T02:15:24.530551+0000","last_became_peered":"2024-04-19T02:15:24.530551+0000","last_unstale":"2024-04-19T02:16:20.038050+0000","last_undegraded":"2024-04-19T02:16:20.038050+0000","last_fullsized":"2024-04-19T02:16:20.038050+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:30.576946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":223,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.037450+0000","last_change":"2024-04-19T02:15:24.533634+0000","last_active":"2024-04-19T02:16:20.037450+0000","last_peered":"2024-04-19T02:16:20.037450+0000","last_clean":"2024-04-19T02:16:20.037450+0000","last_became_active":"2024-04-19T02:15:24.533420+0000","last_became_peered":"2024-04-19T02:15:24.533420+0000","last_unstale":"2024-04-19T02:16:20.037450+0000","last_undegraded":"2024-04-19T02:16:20.037450+0000","last_fullsized":"2024-04-19T02:16:20.037450+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.035955+0000","last_change":"2024-04-19T02:15:28.890244+0000","last_active":"2024-04-19T02:16:20.035955+0000","last_peered":"2024-04-19T02:16:20.035955+0000","last_clean":"2024-04-19T02:16:20.035955+0000","last_became_active":"2024-04-19T02:15:28.889831+0000","last_became_peered":"2024-04-19T02:15:28.889831+0000","last_unstale":"2024-04-19T02:16:20.035955+0000","last_undegraded":"2024-04-19T02:16:20.035955+0000","last_fullsized":"2024-04-19T02:16:20.035955+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.038762+0000","last_change":"2024-04-19T02:15:29.285015+0000","last_active":"2024-04-19T02:16:20.038762+0000","last_peered":"2024-04-19T02:16:20.038762+0000","last_clean":"2024-04-19T02:16:20.038762+0000","last_became_active":"2024-04-19T02:15:29.284164+0000","last_became_peered":"2024-04-19T02:15:29.284164+0000","last_unstale":"2024-04-19T02:16:20.038762+0000","last_undegraded":"2024-04-19T02:16:20.038762+0000","last_fullsized":"2024-04-19T02:16:20.038762+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:36.987844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"28'4533","reported_seq":4553,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-19T02:16:22.181020+0000","last_change":"2024-04-19T02:15:53.956463+0000","last_active":"2024-04-19T02:16:22.181020+0000","last_peered":"2024-04-19T02:16:22.181020+0000","last_clean":"2024-04-19T02:16:22.181020+0000","last_became_active":"2024-04-19T02:15:53.955819+0000","last_became_peered":"2024-04-19T02:15:53.955819+0000","last_unstale":"2024-04-19T02:16:22.181020+0000","last_undegraded":"2024-04-19T02:16:22.181020+0000","last_fullsized":"2024-04-19T02:16:22.181020+0000","mapping_epoch":16,"log_start":"19'800","ondisk_log_start":"19'800","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3733,"log_dups_size":0,"ondisk_log_size":3733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:46:07.409922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297074688,"num_objects":4533,"num_object_clones":0,"num_object_copies":9066,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4533,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4533,"num_write_kb":290112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.037482+0000","last_change":"2024-04-19T02:15:24.533912+0000","last_active":"2024-04-19T02:16:20.037482+0000","last_peered":"2024-04-19T02:16:20.037482+0000","last_clean":"2024-04-19T02:16:20.037482+0000","last_became_active":"2024-04-19T02:15:24.533580+0000","last_became_peered":"2024-04-19T02:15:24.533580+0000","last_unstale":"2024-04-19T02:16:20.037482+0000","last_undegraded":"2024-04-19T02:16:20.037482+0000","last_fullsized":"2024-04-19T02:16:20.037482+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:45.045477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.035753+0000","last_change":"2024-04-19T02:15:28.891889+0000","last_active":"2024-04-19T02:16:20.035753+0000","last_peered":"2024-04-19T02:16:20.035753+0000","last_clean":"2024-04-19T02:16:20.035753+0000","last_became_active":"2024-04-19T02:15:28.890919+0000","last_became_peered":"2024-04-19T02:15:28.890919+0000","last_unstale":"2024-04-19T02:16:20.035753+0000","last_undegraded":"2024-04-19T02:16:20.035753+0000","last_fullsized":"2024-04-19T02:16:20.035753+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:35.412837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.036154+0000","last_change":"2024-04-19T02:15:53.957881+0000","last_active":"2024-04-19T02:16:20.036154+0000","last_peered":"2024-04-19T02:16:20.036154+0000","last_clean":"2024-04-19T02:16:20.036154+0000","last_became_active":"2024-04-19T02:15:53.957657+0000","last_became_peered":"2024-04-19T02:15:53.957657+0000","last_unstale":"2024-04-19T02:16:20.036154+0000","last_undegraded":"2024-04-19T02:16:20.036154+0000","last_fullsized":"2024-04-19T02:16:20.036154+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:46.921714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"28'4519","reported_seq":4539,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-19T02:16:22.162367+0000","last_change":"2024-04-19T02:15:53.955068+0000","last_active":"2024-04-19T02:16:22.162367+0000","last_peered":"2024-04-19T02:16:22.162367+0000","last_clean":"2024-04-19T02:16:22.162367+0000","last_became_active":"2024-04-19T02:15:53.954721+0000","last_became_peered":"2024-04-19T02:15:53.954721+0000","last_unstale":"2024-04-19T02:16:22.162367+0000","last_undegraded":"2024-04-19T02:16:22.162367+0000","last_fullsized":"2024-04-19T02:16:22.162367+0000","mapping_epoch":16,"log_start":"19'800","ondisk_log_start":"19'800","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3719,"log_dups_size":0,"ondisk_log_size":3719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:18:29.742535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":296157184,"num_objects":4519,"num_object_clones":0,"num_object_copies":9038,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4519,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4519,"num_write_kb":289216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.036272+0000","last_change":"2024-04-19T02:15:53.959105+0000","last_active":"2024-04-19T02:16:20.036272+0000","last_peered":"2024-04-19T02:16:20.036272+0000","last_clean":"2024-04-19T02:16:20.036272+0000","last_became_active":"2024-04-19T02:15:53.958836+0000","last_became_peered":"2024-04-19T02:15:53.958836+0000","last_unstale":"2024-04-19T02:16:20.036272+0000","last_undegraded":"2024-04-19T02:16:20.036272+0000","last_fullsized":"2024-04-19T02:16:20.036272+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:18:00.321514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.036682+0000","last_change":"2024-04-19T02:15:28.892125+0000","last_active":"2024-04-19T02:16:20.036682+0000","last_peered":"2024-04-19T02:16:20.036682+0000","last_clean":"2024-04-19T02:16:20.036682+0000","last_became_active":"2024-04-19T02:15:28.891300+0000","last_became_peered":"2024-04-19T02:15:28.891300+0000","last_unstale":"2024-04-19T02:16:20.036682+0000","last_undegraded":"2024-04-19T02:16:20.036682+0000","last_fullsized":"2024-04-19T02:16:20.036682+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.036348+0000","last_change":"2024-04-19T02:15:29.281694+0000","last_active":"2024-04-19T02:16:20.036348+0000","last_peered":"2024-04-19T02:16:20.036348+0000","last_clean":"2024-04-19T02:16:20.036348+0000","last_became_active":"2024-04-19T02:15:29.280519+0000","last_became_peered":"2024-04-19T02:15:29.280519+0000","last_unstale":"2024-04-19T02:16:20.036348+0000","last_undegraded":"2024-04-19T02:16:20.036348+0000","last_fullsized":"2024-04-19T02:16:20.036348+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:50.890545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"27'4366","reported_seq":4386,"reported_epoch":28,"state":"unknown","last_fresh":"2024-04-19T02:16:22.059111+0000","last_change":"2024-04-19T02:16:22.763466+0000","last_active":"2024-04-19T02:16:22.059111+0000","last_peered":"2024-04-19T02:16:22.050311+0000","last_clean":"2024-04-19T02:16:22.050311+0000","last_became_active":"2024-04-19T02:15:53.954767+0000","last_became_peered":"2024-04-19T02:15:53.954767+0000","last_unstale":"2024-04-19T02:16:22.059111+0000","last_undegraded":"2024-04-19T02:16:22.059111+0000","last_fullsized":"2024-04-19T02:16:22.059111+0000","mapping_epoch":28,"log_start":"19'600","ondisk_log_start":"19'600","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3766,"log_dups_size":0,"ondisk_log_size":3766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:23:28.454690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286130176,"num_objects":4366,"num_object_clones":0,"num_object_copies":8732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4366,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4366,"num_write_kb":279424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.036714+0000","last_change":"2024-04-19T02:15:28.891702+0000","last_active":"2024-04-19T02:16:20.036714+0000","last_peered":"2024-04-19T02:16:20.036714+0000","last_clean":"2024-04-19T02:16:20.036714+0000","last_became_active":"2024-04-19T02:15:28.890743+0000","last_became_peered":"2024-04-19T02:15:28.890743+0000","last_unstale":"2024-04-19T02:16:20.036714+0000","last_undegraded":"2024-04-19T02:16:20.036714+0000","last_fullsized":"2024-04-19T02:16:20.036714+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.036425+0000","last_change":"2024-04-19T02:15:24.526845+0000","last_active":"2024-04-19T02:16:20.036425+0000","last_peered":"2024-04-19T02:16:20.036425+0000","last_clean":"2024-04-19T02:16:20.036425+0000","last_became_active":"2024-04-19T02:15:24.526500+0000","last_became_peered":"2024-04-19T02:15:24.526500+0000","last_unstale":"2024-04-19T02:16:20.036425+0000","last_undegraded":"2024-04-19T02:16:20.036425+0000","last_fullsized":"2024-04-19T02:16:20.036425+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:16.883355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.037743+0000","last_change":"2024-04-19T02:15:29.278686+0000","last_active":"2024-04-19T02:16:20.037743+0000","last_peered":"2024-04-19T02:16:20.037743+0000","last_clean":"2024-04-19T02:16:20.037743+0000","last_became_active":"2024-04-19T02:15:29.278108+0000","last_became_peered":"2024-04-19T02:15:29.278108+0000","last_unstale":"2024-04-19T02:16:20.037743+0000","last_undegraded":"2024-04-19T02:16:20.037743+0000","last_fullsized":"2024-04-19T02:16:20.037743+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:34.593754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"28'4424","reported_seq":4444,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-19T02:16:22.140463+0000","last_change":"2024-04-19T02:15:53.957269+0000","last_active":"2024-04-19T02:16:22.140463+0000","last_peered":"2024-04-19T02:16:22.140463+0000","last_clean":"2024-04-19T02:16:22.140463+0000","last_became_active":"2024-04-19T02:15:53.956554+0000","last_became_peered":"2024-04-19T02:15:53.956554+0000","last_unstale":"2024-04-19T02:16:22.140463+0000","last_undegraded":"2024-04-19T02:16:22.140463+0000","last_fullsized":"2024-04-19T02:16:22.140463+0000","mapping_epoch":16,"log_start":"19'400","ondisk_log_start":"19'400","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":4024,"log_dups_size":0,"ondisk_log_size":4024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:29:38.789719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289931264,"num_objects":4424,"num_object_clones":0,"num_object_copies":8848,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4424,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4424,"num_write_kb":283136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.040350+0000","last_change":"2024-04-19T02:15:24.533777+0000","last_active":"2024-04-19T02:16:20.040350+0000","last_peered":"2024-04-19T02:16:20.040350+0000","last_clean":"2024-04-19T02:16:20.040350+0000","last_became_active":"2024-04-19T02:15:24.533436+0000","last_became_peered":"2024-04-19T02:15:24.533436+0000","last_unstale":"2024-04-19T02:16:20.040350+0000","last_undegraded":"2024-04-19T02:16:20.040350+0000","last_fullsized":"2024-04-19T02:16:20.040350+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:53:25.922418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.036251+0000","last_change":"2024-04-19T02:15:28.891370+0000","last_active":"2024-04-19T02:16:20.036251+0000","last_peered":"2024-04-19T02:16:20.036251+0000","last_clean":"2024-04-19T02:16:20.036251+0000","last_became_active":"2024-04-19T02:15:28.890702+0000","last_became_peered":"2024-04-19T02:15:28.890702+0000","last_unstale":"2024-04-19T02:16:20.036251+0000","last_undegraded":"2024-04-19T02:16:20.036251+0000","last_fullsized":"2024-04-19T02:16:20.036251+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:33.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.034276+0000","last_change":"2024-04-19T02:15:29.282244+0000","last_active":"2024-04-19T02:16:20.034276+0000","last_peered":"2024-04-19T02:16:20.034276+0000","last_clean":"2024-04-19T02:16:20.034276+0000","last_became_active":"2024-04-19T02:15:29.280366+0000","last_became_peered":"2024-04-19T02:15:29.280366+0000","last_unstale":"2024-04-19T02:16:20.034276+0000","last_undegraded":"2024-04-19T02:16:20.034276+0000","last_fullsized":"2024-04-19T02:16:20.034276+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.036398+0000","last_change":"2024-04-19T02:15:28.893027+0000","last_active":"2024-04-19T02:16:20.036398+0000","last_peered":"2024-04-19T02:16:20.036398+0000","last_clean":"2024-04-19T02:16:20.036398+0000","last_became_active":"2024-04-19T02:15:28.892695+0000","last_became_peered":"2024-04-19T02:15:28.892695+0000","last_unstale":"2024-04-19T02:16:20.036398+0000","last_undegraded":"2024-04-19T02:16:20.036398+0000","last_fullsized":"2024-04-19T02:16:20.036398+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.034403+0000","last_change":"2024-04-19T02:15:29.283155+0000","last_active":"2024-04-19T02:16:20.034403+0000","last_peered":"2024-04-19T02:16:20.034403+0000","last_clean":"2024-04-19T02:16:20.034403+0000","last_became_active":"2024-04-19T02:15:29.281407+0000","last_became_peered":"2024-04-19T02:15:29.281407+0000","last_unstale":"2024-04-19T02:16:20.034403+0000","last_undegraded":"2024-04-19T02:16:20.034403+0000","last_fullsized":"2024-04-19T02:16:20.034403+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.038175+0000","last_change":"2024-04-19T02:15:28.893067+0000","last_active":"2024-04-19T02:16:20.038175+0000","last_peered":"2024-04-19T02:16:20.038175+0000","last_clean":"2024-04-19T02:16:20.038175+0000","last_became_active":"2024-04-19T02:15:28.892781+0000","last_became_peered":"2024-04-19T02:15:28.892781+0000","last_unstale":"2024-04-19T02:16:20.038175+0000","last_undegraded":"2024-04-19T02:16:20.038175+0000","last_fullsized":"2024-04-19T02:16:20.038175+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:54:15.590143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.037979+0000","last_change":"2024-04-19T02:15:29.281279+0000","last_active":"2024-04-19T02:16:20.037979+0000","last_peered":"2024-04-19T02:16:20.037979+0000","last_clean":"2024-04-19T02:16:20.037979+0000","last_became_active":"2024-04-19T02:15:29.279360+0000","last_became_peered":"2024-04-19T02:15:29.279360+0000","last_unstale":"2024-04-19T02:16:20.037979+0000","last_undegraded":"2024-04-19T02:16:20.037979+0000","last_fullsized":"2024-04-19T02:16:20.037979+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.035306+0000","last_change":"2024-04-19T02:15:28.893239+0000","last_active":"2024-04-19T02:16:20.035306+0000","last_peered":"2024-04-19T02:16:20.035306+0000","last_clean":"2024-04-19T02:16:20.035306+0000","last_became_active":"2024-04-19T02:15:28.892881+0000","last_became_peered":"2024-04-19T02:15:28.892881+0000","last_unstale":"2024-04-19T02:16:20.035306+0000","last_undegraded":"2024-04-19T02:16:20.035306+0000","last_fullsized":"2024-04-19T02:16:20.035306+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.038284+0000","last_change":"2024-04-19T02:15:29.281652+0000","last_active":"2024-04-19T02:16:20.038284+0000","last_peered":"2024-04-19T02:16:20.038284+0000","last_clean":"2024-04-19T02:16:20.038284+0000","last_became_active":"2024-04-19T02:15:29.281175+0000","last_became_peered":"2024-04-19T02:15:29.281175+0000","last_unstale":"2024-04-19T02:16:20.038284+0000","last_undegraded":"2024-04-19T02:16:20.038284+0000","last_fullsized":"2024-04-19T02:16:20.038284+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:16.568764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.036514+0000","last_change":"2024-04-19T02:15:28.892058+0000","last_active":"2024-04-19T02:16:20.036514+0000","last_peered":"2024-04-19T02:16:20.036514+0000","last_clean":"2024-04-19T02:16:20.036514+0000","last_became_active":"2024-04-19T02:15:28.890877+0000","last_became_peered":"2024-04-19T02:15:28.890877+0000","last_unstale":"2024-04-19T02:16:20.036514+0000","last_undegraded":"2024-04-19T02:16:20.036514+0000","last_fullsized":"2024-04-19T02:16:20.036514+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:53.170180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.034475+0000","last_change":"2024-04-19T02:15:29.278810+0000","last_active":"2024-04-19T02:16:20.034475+0000","last_peered":"2024-04-19T02:16:20.034475+0000","last_clean":"2024-04-19T02:16:20.034475+0000","last_became_active":"2024-04-19T02:15:29.277913+0000","last_became_peered":"2024-04-19T02:15:29.277913+0000","last_unstale":"2024-04-19T02:16:20.034475+0000","last_undegraded":"2024-04-19T02:16:20.034475+0000","last_fullsized":"2024-04-19T02:16:20.034475+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:24.082666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.036969+0000","last_change":"2024-04-19T02:15:28.889132+0000","last_active":"2024-04-19T02:16:20.036969+0000","last_peered":"2024-04-19T02:16:20.036969+0000","last_clean":"2024-04-19T02:16:20.036969+0000","last_became_active":"2024-04-19T02:15:28.888926+0000","last_became_peered":"2024-04-19T02:15:28.888926+0000","last_unstale":"2024-04-19T02:16:20.036969+0000","last_undegraded":"2024-04-19T02:16:20.036969+0000","last_fullsized":"2024-04-19T02:16:20.036969+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.037602+0000","last_change":"2024-04-19T02:15:29.282776+0000","last_active":"2024-04-19T02:16:20.037602+0000","last_peered":"2024-04-19T02:16:20.037602+0000","last_clean":"2024-04-19T02:16:20.037602+0000","last_became_active":"2024-04-19T02:15:29.279382+0000","last_became_peered":"2024-04-19T02:15:29.279382+0000","last_unstale":"2024-04-19T02:16:20.037602+0000","last_undegraded":"2024-04-19T02:16:20.037602+0000","last_fullsized":"2024-04-19T02:16:20.037602+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.037525+0000","last_change":"2024-04-19T02:15:29.283537+0000","last_active":"2024-04-19T02:16:20.037525+0000","last_peered":"2024-04-19T02:16:20.037525+0000","last_clean":"2024-04-19T02:16:20.037525+0000","last_became_active":"2024-04-19T02:15:29.281801+0000","last_became_peered":"2024-04-19T02:15:29.281801+0000","last_unstale":"2024-04-19T02:16:20.037525+0000","last_undegraded":"2024-04-19T02:16:20.037525+0000","last_fullsized":"2024-04-19T02:16:20.037525+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.035797+0000","last_change":"2024-04-19T02:15:29.281560+0000","last_active":"2024-04-19T02:16:20.035797+0000","last_peered":"2024-04-19T02:16:20.035797+0000","last_clean":"2024-04-19T02:16:20.035797+0000","last_became_active":"2024-04-19T02:15:29.281261+0000","last_became_peered":"2024-04-19T02:15:29.281261+0000","last_unstale":"2024-04-19T02:16:20.035797+0000","last_undegraded":"2024-04-19T02:16:20.035797+0000","last_fullsized":"2024-04-19T02:16:20.035797+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.037509+0000","last_change":"2024-04-19T02:15:53.955913+0000","last_active":"2024-04-19T02:16:20.037509+0000","last_peered":"2024-04-19T02:16:20.037509+0000","last_clean":"2024-04-19T02:16:20.037509+0000","last_became_active":"2024-04-19T02:15:53.955676+0000","last_became_peered":"2024-04-19T02:15:53.955676+0000","last_unstale":"2024-04-19T02:16:20.037509+0000","last_undegraded":"2024-04-19T02:16:20.037509+0000","last_fullsized":"2024-04-19T02:16:20.037509+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:53:02.899902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.036905+0000","last_change":"2024-04-19T02:15:29.278702+0000","last_active":"2024-04-19T02:16:20.036905+0000","last_peered":"2024-04-19T02:16:20.036905+0000","last_clean":"2024-04-19T02:16:20.036905+0000","last_became_active":"2024-04-19T02:15:29.277756+0000","last_became_peered":"2024-04-19T02:15:29.277756+0000","last_unstale":"2024-04-19T02:16:20.036905+0000","last_undegraded":"2024-04-19T02:16:20.036905+0000","last_fullsized":"2024-04-19T02:16:20.036905+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-19T02:16:20.034423+0000","last_change":"2024-04-19T02:15:29.277568+0000","last_active":"2024-04-19T02:16:20.034423+0000","last_peered":"2024-04-19T02:16:20.034423+0000","last_clean":"2024-04-19T02:16:20.034423+0000","last_became_active":"2024-04-19T02:15:29.276725+0000","last_became_peered":"2024-04-19T02:15:29.276725+0000","last_unstale":"2024-04-19T02:16:20.034423+0000","last_undegraded":"2024-04-19T02:16:20.034423+0000","last_fullsized":"2024-04-19T02:16:20.034423+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":4714921984,"num_objects":71944,"num_object_clones":0,"num_object_copies":143888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71944,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71944,"num_write_kb":4604416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":9429843968,"data_stored":9429843968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60544,"ondisk_log_size":60544,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738382,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3818416,"kb_used_data":3737252,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":90553424,"statfs":{"total":96636764160,"available":92726706176,"internally_reserved":0,"allocated":3826946048,"data_stored":3826754489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":83098054},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,7,5,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.19}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23300000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738383,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2953936,"kb_used_data":2878528,"kb_used_omap":1,"kb_used_meta":75390,"kb_avail":91417904,"statfs":{"total":96636764160,"available":93611933696,"internally_reserved":0,"allocated":2947612672,"data_stored":2947394731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77199814},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]}]},{"osd":1,"up_from":8,"seq":34359738382,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2634936,"kb_used_data":2567724,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":91736904,"statfs":{"total":96636764160,"available":93938589696,"internally_reserved":0,"allocated":2629349376,"data_stored":2629146652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68811206},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2951151616,"data_stored":2951151616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2652045312,"data_stored":2652045312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3826647040,"data_stored":3826647040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:16:27.980 INFO:tasks.thrashosds.thrasher:Setting 4.36 to [0, 1] 2024-04-19T02:16:27.980 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '4.36', '0', '1'] 2024-04-19T02:16:27.981 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 4.36 0 1 2024-04-19T02:16:28.024 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:28.025+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:28.027 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 33 16 80140 80124 151.738 129.25 0.0070783 0.0065877 2024-04-19T02:16:28.035 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:16:28.035 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-04-19T02:16:28.035 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-04-19T02:16:28.035 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-04-19T02:16:28.035 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:16:28.047 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:16:28.049 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:16:28.094 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T02:16:28.125 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:28.125+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:28.214 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:16:28.226 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:28.227+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:28.236 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:16:28.255 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2: {} 2024-04-19T02:16:28.257 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:16:28.257 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:16:28.257 INFO:teuthology.orchestra.run.smithi121.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:16:28.260 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:28.260 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:28.274 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:16:28.328 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:28.328+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:28.429 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:28.429+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:28.449 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:28.449 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:28.464 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:16:28.529 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:28.530+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:28.630 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:28.631+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:28.633 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:28.633 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:28.647 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:16:28.731 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:28.731+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:28.830 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:28.830 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:28.831 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:28.832+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:28.843 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:16:28.932 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:28.933+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:29.028 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 34 16 82234 82218 151.124 130.875 0.00920089 0.00661431 2024-04-19T02:16:29.033 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:29.033 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:29.033 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:29.033+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:29.048 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:16:29.087 INFO:teuthology.orchestra.run.smithi121.stderr:noscrub is set 2024-04-19T02:16:29.088 INFO:teuthology.orchestra.run.smithi121.stderr:set 4.36 pg_upmap mapping to [0,1] 2024-04-19T02:16:29.134 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:29.135+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:29.234 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:29.234 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:29.235 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:29.235+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:29.250 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:16:29.336 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:29.337+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:29.436 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:29.437+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:29.438 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:29.438 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:29.453 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:16:29.537 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:29.537+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:29.621 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:29.621 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:29.635 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:16:29.638 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:29.638+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:29.738 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:29.739+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:29.804 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:29.804 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:29.817 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:16:29.860 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:29.860+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:29.940 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:29.940+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:29.984 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:29.984 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:30.000 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:16:30.027 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 35 16 84270 84254 150.442 127.25 0.00633759 0.00664464 2024-04-19T02:16:30.042 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:30.041+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:30.143 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:30.142+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:30.176 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:30.176 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:30.190 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:16:30.243 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:30.243+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:30.269 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:16:30.346 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:30.346+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:30.363 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:30.364 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:30.378 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:16:30.415 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:16:30.436 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:16:30.446 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:30.446+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:30.458 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2: {} 2024-04-19T02:16:30.459 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:16:30.459 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:16:30.459 INFO:teuthology.orchestra.run.smithi121.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:16:30.546 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:30.547+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:30.594 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:16:30.594 INFO:teuthology.orchestra.run.smithi174.stdout: "size": 20, 2024-04-19T02:16:30.594 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 600, 2024-04-19T02:16:30.594 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:16:30.594 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.594 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:10 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:30.594 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269877+0000", 2024-04-19T02:16:30.594 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 61.321977128999997, 2024-04-19T02:16:30.594 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020732751000000001, 2024-04-19T02:16:30.594 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:30.595 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:30.595 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:30.595 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.595 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:30.595 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269877+0000", 2024-04-19T02:16:30.595 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:30.595 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.595 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.595 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:30.595 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269877+0000", 2024-04-19T02:16:30.595 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:30.595 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.595 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.595 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:30.595 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269875+0000", 2024-04-19T02:16:30.596 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:30.596 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.596 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.596 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:30.596 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269891+0000", 2024-04-19T02:16:30.596 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.5494000000000001e-05 2024-04-19T02:16:30.596 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.596 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.596 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:30.596 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269903+0000", 2024-04-19T02:16:30.596 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2003e-05 2024-04-19T02:16:30.596 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.596 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.596 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:30.597 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269914+0000", 2024-04-19T02:16:30.597 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0947e-05 2024-04-19T02:16:30.597 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.597 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.597 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:30.597 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269971+0000", 2024-04-19T02:16:30.597 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7036000000000001e-05 2024-04-19T02:16:30.597 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.597 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.597 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:16:30.597 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269979+0000", 2024-04-19T02:16:30.597 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.6660000000000008e-06 2024-04-19T02:16:30.597 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.597 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.598 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:30.598 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284891+0000", 2024-04-19T02:16:30.598 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014912584 2024-04-19T02:16:30.598 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.598 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.598 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:30.598 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285213+0000", 2024-04-19T02:16:30.598 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00032172199999999998 2024-04-19T02:16:30.598 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.598 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.598 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:30.598 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285357+0000", 2024-04-19T02:16:30.598 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014367899999999999 2024-04-19T02:16:30.598 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.599 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.599 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:30.599 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288883+0000", 2024-04-19T02:16:30.599 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0035268719999999999 2024-04-19T02:16:30.599 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.599 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.599 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:30.599 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290537+0000", 2024-04-19T02:16:30.599 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016537399999999999 2024-04-19T02:16:30.599 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.599 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.599 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:30.599 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290576+0000", 2024-04-19T02:16:30.599 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9266e-05 2024-04-19T02:16:30.600 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.600 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.600 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:30.600 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290609+0000", 2024-04-19T02:16:30.600 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2818000000000003e-05 2024-04-19T02:16:30.600 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:30.600 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:30.600 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:30.600 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.600 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.600 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:11 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:30.600 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:30.600 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 61.321924207999999, 2024-04-19T02:16:30.600 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020352748, 2024-04-19T02:16:30.601 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:30.601 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:30.601 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:30.601 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.601 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:30.601 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:30.601 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:30.601 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.601 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.601 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:30.601 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:30.601 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:30.601 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.602 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.602 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:30.602 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:30.602 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:30.602 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.602 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.602 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:30.602 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269933+0000", 2024-04-19T02:16:30.602 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2169999999999996e-06 2024-04-19T02:16:30.602 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.602 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.602 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:30.602 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269940+0000", 2024-04-19T02:16:30.602 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1500000000000002e-06 2024-04-19T02:16:30.603 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.603 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.603 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:30.603 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269948+0000", 2024-04-19T02:16:30.603 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.8690000000000004e-06 2024-04-19T02:16:30.603 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.603 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.603 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:30.603 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:16:30.603 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2994999999999997e-05 2024-04-19T02:16:30.603 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.603 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.603 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:16:30.603 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269997+0000", 2024-04-19T02:16:30.604 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.9020000000000004e-06 2024-04-19T02:16:30.604 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.604 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.604 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:30.604 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.282729+0000", 2024-04-19T02:16:30.604 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.012732537 2024-04-19T02:16:30.604 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.604 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.604 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:30.604 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.282838+0000", 2024-04-19T02:16:30.604 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000108298 2024-04-19T02:16:30.604 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.604 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.604 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:30.605 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.283002+0000", 2024-04-19T02:16:30.605 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00016466300000000001 2024-04-19T02:16:30.605 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.605 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.605 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:30.605 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288708+0000", 2024-04-19T02:16:30.605 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.005705066 2024-04-19T02:16:30.605 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.605 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.605 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:30.605 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290215+0000", 2024-04-19T02:16:30.605 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0015075010000000001 2024-04-19T02:16:30.605 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.605 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.606 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:30.606 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290259+0000", 2024-04-19T02:16:30.606 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3711999999999998e-05 2024-04-19T02:16:30.606 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.606 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.606 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:30.606 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290282+0000", 2024-04-19T02:16:30.606 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3458000000000001e-05 2024-04-19T02:16:30.606 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:30.606 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:30.606 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:30.606 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.607 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.607 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:14 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:30.607 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:30.607 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 61.321890418000002, 2024-04-19T02:16:30.607 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020137202, 2024-04-19T02:16:30.607 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:30.607 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:30.607 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:30.607 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.607 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:30.607 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:30.607 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:30.607 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.607 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.608 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:30.608 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:30.608 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:30.608 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.608 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.608 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:30.608 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:30.608 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:30.608 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.608 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.608 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:30.608 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269971+0000", 2024-04-19T02:16:30.608 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.5459999999999992e-06 2024-04-19T02:16:30.608 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.609 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.609 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:30.609 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269979+0000", 2024-04-19T02:16:30.609 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9130000000000003e-06 2024-04-19T02:16:30.609 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.609 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.609 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:30.609 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269986+0000", 2024-04-19T02:16:30.609 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.3779999999999998e-06 2024-04-19T02:16:30.609 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.609 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.609 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:30.609 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270030+0000", 2024-04-19T02:16:30.610 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3982e-05 2024-04-19T02:16:30.610 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.610 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.610 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:16:30.610 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270034+0000", 2024-04-19T02:16:30.610 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1779999999999996e-06 2024-04-19T02:16:30.610 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.610 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.610 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:30.610 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.277870+0000", 2024-04-19T02:16:30.610 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0078362150000000005 2024-04-19T02:16:30.610 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.610 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.611 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:30.611 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.278216+0000", 2024-04-19T02:16:30.611 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00034634999999999999 2024-04-19T02:16:30.611 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.611 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.611 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:30.611 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.278732+0000", 2024-04-19T02:16:30.611 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00051536099999999999 2024-04-19T02:16:30.611 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.611 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.611 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:30.611 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.287694+0000", 2024-04-19T02:16:30.611 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0089621019999999996 2024-04-19T02:16:30.611 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.611 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.612 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:30.612 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290026+0000", 2024-04-19T02:16:30.612 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0023323139999999998 2024-04-19T02:16:30.612 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.612 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.612 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:30.612 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290067+0000", 2024-04-19T02:16:30.612 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1043e-05 2024-04-19T02:16:30.612 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.612 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.612 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:30.612 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290100+0000", 2024-04-19T02:16:30.612 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3278999999999998e-05 2024-04-19T02:16:30.613 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:30.613 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:30.613 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:30.613 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.613 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.613 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:30.613 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:30.613 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 61.321858626000001, 2024-04-19T02:16:30.613 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020731702000000001, 2024-04-19T02:16:30.613 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:30.613 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:30.613 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:30.613 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.613 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:30.614 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:30.614 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:30.614 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.614 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.614 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:30.614 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:30.614 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:30.614 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.614 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.614 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:30.614 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:30.614 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:30.614 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.614 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.614 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:30.615 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269998+0000", 2024-04-19T02:16:30.615 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7100000000000001e-06 2024-04-19T02:16:30.615 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.615 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.615 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:30.615 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270005+0000", 2024-04-19T02:16:30.615 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.241e-06 2024-04-19T02:16:30.615 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.615 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.615 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:30.615 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270011+0000", 2024-04-19T02:16:30.615 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6279999999999999e-06 2024-04-19T02:16:30.615 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.615 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.615 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:30.616 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270046+0000", 2024-04-19T02:16:30.616 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5173999999999999e-05 2024-04-19T02:16:30.616 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.616 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.616 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:30.616 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:30.616 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0019999999999997e-06 2024-04-19T02:16:30.616 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.616 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.616 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:30.616 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285619+0000", 2024-04-19T02:16:30.617 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015567391 2024-04-19T02:16:30.617 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.617 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.617 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:30.617 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285671+0000", 2024-04-19T02:16:30.617 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2460999999999998e-05 2024-04-19T02:16:30.617 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.617 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.617 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:30.617 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285775+0000", 2024-04-19T02:16:30.618 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000103389 2024-04-19T02:16:30.618 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.618 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.618 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:30.618 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288934+0000", 2024-04-19T02:16:30.618 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0031595859999999998 2024-04-19T02:16:30.618 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.618 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.618 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:30.618 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290650+0000", 2024-04-19T02:16:30.618 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001716242 2024-04-19T02:16:30.618 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.618 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.619 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:30.619 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290692+0000", 2024-04-19T02:16:30.619 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1910999999999999e-05 2024-04-19T02:16:30.619 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.619 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.619 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:30.619 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290727+0000", 2024-04-19T02:16:30.619 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4412000000000002e-05 2024-04-19T02:16:30.619 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:30.619 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:30.619 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:30.619 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.619 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.619 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:30.620 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270019+0000", 2024-04-19T02:16:30.620 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 61.321835030999999, 2024-04-19T02:16:30.620 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020572014999999999, 2024-04-19T02:16:30.620 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:30.620 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:30.620 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:30.620 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.620 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:30.620 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270019+0000", 2024-04-19T02:16:30.620 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:30.620 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.620 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.620 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:30.620 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270019+0000", 2024-04-19T02:16:30.620 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:30.621 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.621 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.621 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:30.621 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270018+0000", 2024-04-19T02:16:30.621 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:30.621 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.621 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.621 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:30.621 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270021+0000", 2024-04-19T02:16:30.621 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0319999999999999e-06 2024-04-19T02:16:30.621 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.621 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.621 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:30.621 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270028+0000", 2024-04-19T02:16:30.622 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6189999999999996e-06 2024-04-19T02:16:30.622 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.622 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.622 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:30.622 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270035+0000", 2024-04-19T02:16:30.622 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1690000000000003e-06 2024-04-19T02:16:30.622 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.622 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.622 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:30.622 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270078+0000", 2024-04-19T02:16:30.622 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3061e-05 2024-04-19T02:16:30.622 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.622 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.623 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:30.623 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270082+0000", 2024-04-19T02:16:30.623 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4510000000000002e-06 2024-04-19T02:16:30.623 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.623 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.623 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:30.623 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284354+0000", 2024-04-19T02:16:30.623 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014271588999999999 2024-04-19T02:16:30.623 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.623 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.623 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:30.623 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284497+0000", 2024-04-19T02:16:30.623 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014335800000000001 2024-04-19T02:16:30.624 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.624 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.624 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:30.624 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284626+0000", 2024-04-19T02:16:30.624 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000128744 2024-04-19T02:16:30.624 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.624 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.624 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:30.624 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288844+0000", 2024-04-19T02:16:30.624 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00421807 2024-04-19T02:16:30.624 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.624 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.624 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:30.625 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290508+0000", 2024-04-19T02:16:30.625 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001663774 2024-04-19T02:16:30.625 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.625 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.625 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:30.625 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290556+0000", 2024-04-19T02:16:30.625 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.7599999999999998e-05 2024-04-19T02:16:30.625 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.625 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.625 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:30.625 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290591+0000", 2024-04-19T02:16:30.625 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5034999999999999e-05 2024-04-19T02:16:30.625 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:30.625 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:30.625 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:30.626 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.626 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.626 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:30.626 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:30.626 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 61.321812168000001, 2024-04-19T02:16:30.626 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020192280999999999, 2024-04-19T02:16:30.626 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:30.626 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:30.626 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:30.626 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.626 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:30.626 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:30.626 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:30.626 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.627 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.627 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:30.627 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:30.627 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:30.627 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.627 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.627 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:30.627 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:30.627 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:30.627 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.627 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.627 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:30.627 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270045+0000", 2024-04-19T02:16:30.627 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8680000000000001e-06 2024-04-19T02:16:30.627 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.627 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.628 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:30.628 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270052+0000", 2024-04-19T02:16:30.628 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.9999999999999999e-06 2024-04-19T02:16:30.628 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.628 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.628 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:30.628 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270056+0000", 2024-04-19T02:16:30.628 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4479999999999996e-06 2024-04-19T02:16:30.628 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.628 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.628 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:30.628 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270089+0000", 2024-04-19T02:16:30.628 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3071000000000002e-05 2024-04-19T02:16:30.628 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.628 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.628 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:30.629 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270092+0000", 2024-04-19T02:16:30.629 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9780000000000001e-06 2024-04-19T02:16:30.629 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.629 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.629 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:30.629 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.280632+0000", 2024-04-19T02:16:30.629 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010539712 2024-04-19T02:16:30.629 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.629 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.629 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:30.629 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.280743+0000", 2024-04-19T02:16:30.629 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000111048 2024-04-19T02:16:30.629 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.629 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.629 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:30.630 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.281531+0000", 2024-04-19T02:16:30.630 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00078738199999999999 2024-04-19T02:16:30.630 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.630 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.630 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:30.630 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.287949+0000", 2024-04-19T02:16:30.630 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0064185730000000003 2024-04-19T02:16:30.630 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.630 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.630 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:30.630 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290184+0000", 2024-04-19T02:16:30.630 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0022350849999999999 2024-04-19T02:16:30.630 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.630 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.631 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:30.631 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290209+0000", 2024-04-19T02:16:30.631 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4907000000000001e-05 2024-04-19T02:16:30.631 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.631 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.631 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:30.631 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290234+0000", 2024-04-19T02:16:30.631 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4666999999999999e-05 2024-04-19T02:16:30.631 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:30.631 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:30.631 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:30.631 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.631 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.631 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:19 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:30.631 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:30.632 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 61.321790702000001, 2024-04-19T02:16:30.632 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020818203, 2024-04-19T02:16:30.632 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:30.632 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:30.632 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:30.632 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.632 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:30.632 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:30.632 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:30.632 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.632 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.632 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:30.632 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:30.632 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:30.632 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.632 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.632 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:30.633 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:30.633 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:30.633 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.633 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.633 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:30.633 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270065+0000", 2024-04-19T02:16:30.633 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4310000000000001e-06 2024-04-19T02:16:30.633 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.633 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.633 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:30.633 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270070+0000", 2024-04-19T02:16:30.633 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2859999999999999e-06 2024-04-19T02:16:30.633 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.633 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.634 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:30.634 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270077+0000", 2024-04-19T02:16:30.634 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5270000000000004e-06 2024-04-19T02:16:30.634 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.634 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.634 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:30.634 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270107+0000", 2024-04-19T02:16:30.634 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0205999999999998e-05 2024-04-19T02:16:30.634 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.634 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.634 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:30.634 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270111+0000", 2024-04-19T02:16:30.634 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8650000000000003e-06 2024-04-19T02:16:30.635 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.635 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.635 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:30.635 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285936+0000", 2024-04-19T02:16:30.635 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015824677999999998 2024-04-19T02:16:30.635 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.635 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.635 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:30.635 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286007+0000", 2024-04-19T02:16:30.635 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1157999999999999e-05 2024-04-19T02:16:30.635 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.635 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.635 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:30.635 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286086+0000", 2024-04-19T02:16:30.636 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9084000000000004e-05 2024-04-19T02:16:30.636 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.636 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.636 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:30.636 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290740+0000", 2024-04-19T02:16:30.636 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0046543679999999999 2024-04-19T02:16:30.636 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.636 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.636 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:30.636 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290833+0000", 2024-04-19T02:16:30.636 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2551000000000002e-05 2024-04-19T02:16:30.636 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.636 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.636 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:30.636 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290859+0000", 2024-04-19T02:16:30.637 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.6696999999999999e-05 2024-04-19T02:16:30.637 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.637 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.637 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:30.637 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290881+0000", 2024-04-19T02:16:30.637 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1653000000000001e-05 2024-04-19T02:16:30.637 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:30.637 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:30.637 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:30.637 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.637 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.637 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:42724 5.0 5:0d0b7b99:::benchmark_data_smithi121_44835_object42723:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:30.637 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:09.270595+0000", 2024-04-19T02:16:30.637 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 21.321258408999999, 2024-04-19T02:16:30.637 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.018445754000000002, 2024-04-19T02:16:30.638 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:30.638 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:30.638 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:30.638 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:30.638 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:30.638 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 42724 2024-04-19T02:16:30.638 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.638 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:30.638 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.638 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:30.638 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.270595+0000", 2024-04-19T02:16:30.638 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:30.638 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.638 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.639 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:30.639 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.270595+0000", 2024-04-19T02:16:30.639 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:30.639 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.639 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.639 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:30.639 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.270595+0000", 2024-04-19T02:16:30.639 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:30.639 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.639 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.639 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:30.639 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.270634+0000", 2024-04-19T02:16:30.639 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9270000000000002e-05 2024-04-19T02:16:30.639 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.639 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.639 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:30.639 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.270640+0000", 2024-04-19T02:16:30.640 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.8139999999999997e-06 2024-04-19T02:16:30.640 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.640 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.640 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:30.640 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.270645+0000", 2024-04-19T02:16:30.640 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.729e-06 2024-04-19T02:16:30.640 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.640 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.640 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:30.640 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.270676+0000", 2024-04-19T02:16:30.640 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1390000000000003e-05 2024-04-19T02:16:30.640 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.640 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.640 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:30.640 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.270808+0000", 2024-04-19T02:16:30.640 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013151699999999999 2024-04-19T02:16:30.641 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.641 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.641 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:30.641 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.270944+0000", 2024-04-19T02:16:30.641 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013695999999999999 2024-04-19T02:16:30.641 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.641 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.641 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:30.641 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.272565+0000", 2024-04-19T02:16:30.641 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016207179999999999 2024-04-19T02:16:30.641 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.641 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.641 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:30.641 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.288992+0000", 2024-04-19T02:16:30.641 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016426356 2024-04-19T02:16:30.641 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.641 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.642 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:30.642 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.289021+0000", 2024-04-19T02:16:30.642 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9257000000000001e-05 2024-04-19T02:16:30.642 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.642 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.642 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:30.642 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:09.289041+0000", 2024-04-19T02:16:30.642 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.0177999999999999e-05 2024-04-19T02:16:30.642 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:30.642 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:30.642 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:30.642 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.642 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.642 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:60896 5.4 5:2b0faee3:::benchmark_data_smithi121_44835_object60895:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:30.642 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:17.036092+0000", 2024-04-19T02:16:30.643 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 13.555761315, 2024-04-19T02:16:30.643 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.018033583999999998, 2024-04-19T02:16:30.643 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:30.643 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:30.643 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:30.643 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:30.643 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:30.643 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 60896 2024-04-19T02:16:30.643 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.643 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:30.643 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.643 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:30.643 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.036092+0000", 2024-04-19T02:16:30.643 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:30.643 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.643 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.644 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:30.644 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.036092+0000", 2024-04-19T02:16:30.644 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:30.644 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.644 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.644 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:30.644 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.036092+0000", 2024-04-19T02:16:30.644 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:30.644 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.644 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.644 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:30.644 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.036210+0000", 2024-04-19T02:16:30.644 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011790000000000001 2024-04-19T02:16:30.644 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.644 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.644 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:30.644 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.036219+0000", 2024-04-19T02:16:30.645 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0829999999999993e-06 2024-04-19T02:16:30.645 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.645 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.645 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:30.645 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.036223+0000", 2024-04-19T02:16:30.645 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3869999999999997e-06 2024-04-19T02:16:30.645 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.645 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.645 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:30.645 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.036258+0000", 2024-04-19T02:16:30.645 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5281999999999999e-05 2024-04-19T02:16:30.645 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.645 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.645 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:30.645 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.036265+0000", 2024-04-19T02:16:30.645 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.1759999999999998e-06 2024-04-19T02:16:30.646 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.646 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.646 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:30.646 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.041984+0000", 2024-04-19T02:16:30.646 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0057195459999999998 2024-04-19T02:16:30.646 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.646 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.646 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:30.646 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.042102+0000", 2024-04-19T02:16:30.646 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000117507 2024-04-19T02:16:30.646 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.646 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.646 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:30.647 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.042217+0000", 2024-04-19T02:16:30.647 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011525 2024-04-19T02:16:30.647 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.647 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.647 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:30.647 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.044194+0000", 2024-04-19T02:16:30.647 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0019774530000000001 2024-04-19T02:16:30.647 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.647 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.647 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:30.647 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.054075+0000", 2024-04-19T02:16:30.647 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0098801619999999996 2024-04-19T02:16:30.647 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.647 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.648 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:30.648 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.054102+0000", 2024-04-19T02:16:30.648 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7580999999999999e-05 2024-04-19T02:16:30.648 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.648 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.648 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:30.648 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.054126+0000", 2024-04-19T02:16:30.648 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3816999999999999e-05 2024-04-19T02:16:30.648 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:30.648 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:30.648 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:30.648 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.648 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.648 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:62720 5.e 5:7cb1d759:::benchmark_data_smithi121_44835_object62719:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:30.648 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:17.908658+0000", 2024-04-19T02:16:30.649 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 12.683195738, 2024-04-19T02:16:30.649 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.017978524999999999, 2024-04-19T02:16:30.649 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:30.649 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:30.649 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:30.649 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:30.649 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:30.649 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 62720 2024-04-19T02:16:30.649 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.649 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:30.649 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.649 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:30.649 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.908658+0000", 2024-04-19T02:16:30.649 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:30.649 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.650 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.650 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:30.650 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.908658+0000", 2024-04-19T02:16:30.650 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:30.650 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.650 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.650 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:30.650 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.908657+0000", 2024-04-19T02:16:30.650 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:30.650 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.650 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.650 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:30.650 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.908718+0000", 2024-04-19T02:16:30.650 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.1202000000000001e-05 2024-04-19T02:16:30.651 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.651 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.651 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:30.651 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.908727+0000", 2024-04-19T02:16:30.651 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.7569999999999993e-06 2024-04-19T02:16:30.651 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.651 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.651 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:30.651 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.908734+0000", 2024-04-19T02:16:30.651 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.5140000000000004e-06 2024-04-19T02:16:30.651 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.651 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.651 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:30.652 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.913299+0000", 2024-04-19T02:16:30.652 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0045644580000000004 2024-04-19T02:16:30.652 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.652 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.652 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:30.652 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.913401+0000", 2024-04-19T02:16:30.652 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000101752 2024-04-19T02:16:30.652 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.652 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.652 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:30.652 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.913488+0000", 2024-04-19T02:16:30.652 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.7638000000000004e-05 2024-04-19T02:16:30.652 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.652 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.653 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:30.653 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.917152+0000", 2024-04-19T02:16:30.653 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0036635439999999999 2024-04-19T02:16:30.653 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.653 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.653 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:30.653 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.926554+0000", 2024-04-19T02:16:30.653 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0094018309999999994 2024-04-19T02:16:30.653 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.653 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.653 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:30.653 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.926604+0000", 2024-04-19T02:16:30.653 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0349000000000002e-05 2024-04-19T02:16:30.653 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.654 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.654 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:30.654 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:17.926636+0000", 2024-04-19T02:16:30.654 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2546999999999999e-05 2024-04-19T02:16:30.654 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:30.654 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:30.654 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:30.654 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.654 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.654 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:65702 5.0 5:0e2d52f5:::benchmark_data_smithi121_44835_object65701:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:30.654 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:19.257242+0000", 2024-04-19T02:16:30.654 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 11.334611690999999, 2024-04-19T02:16:30.654 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.019747843000000001, 2024-04-19T02:16:30.654 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:30.655 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:30.655 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:30.655 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:30.655 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:30.655 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 65702 2024-04-19T02:16:30.655 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.655 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:30.655 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.655 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:30.655 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.257242+0000", 2024-04-19T02:16:30.655 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:30.656 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.656 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.656 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:30.656 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.257242+0000", 2024-04-19T02:16:30.656 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:30.656 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.656 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.656 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:30.656 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.257241+0000", 2024-04-19T02:16:30.656 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:30.656 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.656 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.656 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:30.656 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.257345+0000", 2024-04-19T02:16:30.656 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010439599999999999 2024-04-19T02:16:30.657 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.657 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.657 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:30.657 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.257356+0000", 2024-04-19T02:16:30.657 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0291e-05 2024-04-19T02:16:30.657 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.657 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.657 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:30.657 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.257363+0000", 2024-04-19T02:16:30.657 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.0299999999999996e-06 2024-04-19T02:16:30.657 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.657 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.657 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:30.657 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.258992+0000", 2024-04-19T02:16:30.657 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016295509999999999 2024-04-19T02:16:30.657 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.658 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.658 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:30.658 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.259114+0000", 2024-04-19T02:16:30.658 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000121234 2024-04-19T02:16:30.658 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.658 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.658 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:30.658 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.259253+0000", 2024-04-19T02:16:30.658 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013916300000000001 2024-04-19T02:16:30.658 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.658 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.658 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:30.658 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.260819+0000", 2024-04-19T02:16:30.658 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0015664190000000001 2024-04-19T02:16:30.658 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.659 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.659 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:30.659 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.276908+0000", 2024-04-19T02:16:30.659 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016089157 2024-04-19T02:16:30.659 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.659 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.659 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:30.659 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.276954+0000", 2024-04-19T02:16:30.659 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.5642000000000001e-05 2024-04-19T02:16:30.659 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.659 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.659 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:30.659 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:19.276990+0000", 2024-04-19T02:16:30.659 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5852999999999997e-05 2024-04-19T02:16:30.659 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:30.660 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:30.660 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:30.660 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.660 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.660 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:77621 5.8 5:181e11e0:::benchmark_data_smithi121_44835_object77620:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:30.660 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:26.805140+0000", 2024-04-19T02:16:30.660 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 3.7867136000000001, 2024-04-19T02:16:30.660 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020068342999999999, 2024-04-19T02:16:30.660 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:30.660 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:30.660 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:30.660 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:30.660 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:30.660 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 77621 2024-04-19T02:16:30.660 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.660 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:30.661 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.661 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:30.661 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805140+0000", 2024-04-19T02:16:30.661 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:30.661 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.661 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.661 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:30.661 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805140+0000", 2024-04-19T02:16:30.661 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:30.661 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.661 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.661 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:30.661 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805139+0000", 2024-04-19T02:16:30.661 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:30.661 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.662 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.662 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:30.662 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805222+0000", 2024-04-19T02:16:30.662 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2762999999999993e-05 2024-04-19T02:16:30.662 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.662 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.662 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:30.662 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805236+0000", 2024-04-19T02:16:30.662 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.4134000000000001e-05 2024-04-19T02:16:30.662 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.662 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.662 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:30.662 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805244+0000", 2024-04-19T02:16:30.662 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.7030000000000006e-06 2024-04-19T02:16:30.662 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.663 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.663 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:30.663 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.810339+0000", 2024-04-19T02:16:30.663 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0050948180000000001 2024-04-19T02:16:30.663 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.663 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.663 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:30.663 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.810449+0000", 2024-04-19T02:16:30.663 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010992 2024-04-19T02:16:30.663 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.663 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.663 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:30.663 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.810588+0000", 2024-04-19T02:16:30.663 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000139054 2024-04-19T02:16:30.663 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.663 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.664 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:30.664 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.817087+0000", 2024-04-19T02:16:30.664 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0064989540000000004 2024-04-19T02:16:30.664 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.664 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.664 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:30.664 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.825120+0000", 2024-04-19T02:16:30.664 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0080331859999999995 2024-04-19T02:16:30.664 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.664 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.664 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:30.664 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.825168+0000", 2024-04-19T02:16:30.664 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8538000000000002e-05 2024-04-19T02:16:30.664 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.664 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.665 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:30.665 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.825208+0000", 2024-04-19T02:16:30.665 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9974e-05 2024-04-19T02:16:30.665 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:30.665 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:30.665 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:30.665 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.665 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.665 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:77622 5.8 5:166fbe77:::benchmark_data_smithi121_44835_object77621:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:30.665 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:16:30.665 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 3.7862937649999999, 2024-04-19T02:16:30.665 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.021784694, 2024-04-19T02:16:30.665 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:30.665 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:30.666 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:30.666 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:30.666 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:30.666 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 77622 2024-04-19T02:16:30.666 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.666 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:30.666 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.666 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:30.666 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:16:30.666 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:30.666 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.666 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.666 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:30.666 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:16:30.667 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:30.667 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.667 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.667 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:30.667 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805559+0000", 2024-04-19T02:16:30.667 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:30.667 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.667 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.667 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:30.667 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805659+0000", 2024-04-19T02:16:30.667 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.9908000000000006e-05 2024-04-19T02:16:30.667 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.667 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.667 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:30.668 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805668+0000", 2024-04-19T02:16:30.668 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2129999999999997e-06 2024-04-19T02:16:30.668 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.668 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.668 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:30.668 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805673+0000", 2024-04-19T02:16:30.668 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0370000000000002e-06 2024-04-19T02:16:30.668 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.668 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.668 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:30.668 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812022+0000", 2024-04-19T02:16:30.668 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0063483239999999998 2024-04-19T02:16:30.668 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.668 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.669 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:30.669 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812129+0000", 2024-04-19T02:16:30.669 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010744200000000001 2024-04-19T02:16:30.669 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.669 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.669 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:30.669 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812252+0000", 2024-04-19T02:16:30.669 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000122519 2024-04-19T02:16:30.669 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.669 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.669 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:30.669 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.820979+0000", 2024-04-19T02:16:30.670 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0087272740000000001 2024-04-19T02:16:30.670 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.670 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.670 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:30.670 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827270+0000", 2024-04-19T02:16:30.670 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0062906239999999999 2024-04-19T02:16:30.670 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.670 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.670 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:30.670 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827309+0000", 2024-04-19T02:16:30.670 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9678999999999997e-05 2024-04-19T02:16:30.670 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.671 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.671 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:30.671 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827345+0000", 2024-04-19T02:16:30.671 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5308000000000001e-05 2024-04-19T02:16:30.671 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:30.671 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:30.671 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:30.671 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.671 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.671 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:77623 5.8 5:1ac4372b:::benchmark_data_smithi121_44835_object77622:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:30.671 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:26.807355+0000", 2024-04-19T02:16:30.671 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 3.7844991220000002, 2024-04-19T02:16:30.671 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020092922999999999, 2024-04-19T02:16:30.671 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:30.672 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:30.672 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:30.672 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:30.672 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:30.672 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 77623 2024-04-19T02:16:30.672 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.672 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:30.672 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.672 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:30.672 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.807355+0000", 2024-04-19T02:16:30.672 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:30.672 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.672 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.672 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:30.672 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.807355+0000", 2024-04-19T02:16:30.672 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:30.673 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.673 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.673 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:30.673 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.807353+0000", 2024-04-19T02:16:30.673 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:30.673 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.673 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.673 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:30.673 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.807433+0000", 2024-04-19T02:16:30.673 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9938999999999995e-05 2024-04-19T02:16:30.673 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.673 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.673 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:30.673 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.807443+0000", 2024-04-19T02:16:30.674 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0193e-05 2024-04-19T02:16:30.674 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.674 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.674 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:30.674 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.807451+0000", 2024-04-19T02:16:30.674 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.204e-06 2024-04-19T02:16:30.674 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.674 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.674 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:30.674 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.814228+0000", 2024-04-19T02:16:30.674 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0067777740000000003 2024-04-19T02:16:30.674 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.674 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.674 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:30.675 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.814355+0000", 2024-04-19T02:16:30.675 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012678400000000001 2024-04-19T02:16:30.675 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.675 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.675 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:30.675 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.814439+0000", 2024-04-19T02:16:30.675 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.3752999999999996e-05 2024-04-19T02:16:30.675 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.675 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.675 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:30.675 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.823137+0000", 2024-04-19T02:16:30.675 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0086980159999999994 2024-04-19T02:16:30.675 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.675 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.675 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:30.676 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827390+0000", 2024-04-19T02:16:30.676 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0042527659999999998 2024-04-19T02:16:30.676 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.676 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.676 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:30.676 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827426+0000", 2024-04-19T02:16:30.676 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5809000000000002e-05 2024-04-19T02:16:30.676 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.676 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.676 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:30.676 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827447+0000", 2024-04-19T02:16:30.676 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1892999999999999e-05 2024-04-19T02:16:30.676 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:30.676 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:30.676 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:30.676 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.677 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.677 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78224 5.4 5:26e797d5:::benchmark_data_smithi121_44835_object78223:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:30.677 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:16:30.677 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 3.4852915659999999, 2024-04-19T02:16:30.677 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.021471998999999999, 2024-04-19T02:16:30.677 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:30.677 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:30.677 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:30.677 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:30.677 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:30.677 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78224 2024-04-19T02:16:30.677 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.677 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:30.677 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.678 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:30.678 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:16:30.678 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:30.678 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.678 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.678 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:30.678 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:16:30.678 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:30.678 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.678 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.678 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:30.678 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106561+0000", 2024-04-19T02:16:30.678 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:30.678 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.679 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.679 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:30.679 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106630+0000", 2024-04-19T02:16:30.679 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.8553999999999994e-05 2024-04-19T02:16:30.679 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.679 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.679 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:30.679 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106644+0000", 2024-04-19T02:16:30.679 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.4651000000000001e-05 2024-04-19T02:16:30.679 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.679 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.679 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:30.679 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106653+0000", 2024-04-19T02:16:30.679 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.6719999999999993e-06 2024-04-19T02:16:30.680 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.680 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.680 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:30.680 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106693+0000", 2024-04-19T02:16:30.680 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9978999999999998e-05 2024-04-19T02:16:30.680 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.680 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.680 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:30.680 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106840+0000", 2024-04-19T02:16:30.680 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0001473 2024-04-19T02:16:30.680 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.680 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.680 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:30.680 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106971+0000", 2024-04-19T02:16:30.681 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013051499999999999 2024-04-19T02:16:30.681 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.681 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.681 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:30.681 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.109047+0000", 2024-04-19T02:16:30.681 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.002076002 2024-04-19T02:16:30.681 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.681 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.681 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:30.681 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.127967+0000", 2024-04-19T02:16:30.681 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.018919780000000001 2024-04-19T02:16:30.681 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.681 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.681 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:30.681 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128004+0000", 2024-04-19T02:16:30.682 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7719000000000003e-05 2024-04-19T02:16:30.682 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.682 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.682 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:30.682 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128034+0000", 2024-04-19T02:16:30.682 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9651000000000001e-05 2024-04-19T02:16:30.682 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:30.682 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:30.682 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:30.682 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.682 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.682 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78259 5.4 5:2aa344b2:::benchmark_data_smithi121_44835_object78258:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:30.682 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:16:30.682 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 3.4665964969999998, 2024-04-19T02:16:30.683 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022934350999999999, 2024-04-19T02:16:30.683 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:30.683 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:30.683 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:30.683 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:30.683 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:30.683 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78259 2024-04-19T02:16:30.683 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.683 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:30.683 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.683 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:30.683 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:16:30.683 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:30.684 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.684 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.684 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:30.684 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:16:30.684 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:30.684 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.684 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.684 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:30.684 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125256+0000", 2024-04-19T02:16:30.684 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:30.684 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.684 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.684 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:30.684 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125347+0000", 2024-04-19T02:16:30.685 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0470000000000006e-05 2024-04-19T02:16:30.685 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.685 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.685 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:30.685 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125358+0000", 2024-04-19T02:16:30.685 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1764e-05 2024-04-19T02:16:30.685 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.685 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.685 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:30.685 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125364+0000", 2024-04-19T02:16:30.685 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7189999999999998e-06 2024-04-19T02:16:30.685 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.685 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.685 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:30.685 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125391+0000", 2024-04-19T02:16:30.686 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7270000000000001e-05 2024-04-19T02:16:30.686 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.686 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.686 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:30.686 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125471+0000", 2024-04-19T02:16:30.686 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9209999999999995e-05 2024-04-19T02:16:30.686 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.686 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.686 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:30.686 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125559+0000", 2024-04-19T02:16:30.686 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.8689000000000004e-05 2024-04-19T02:16:30.686 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.687 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.687 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:30.687 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128164+0000", 2024-04-19T02:16:30.687 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0026050270000000002 2024-04-19T02:16:30.687 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.687 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.687 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:30.687 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148139+0000", 2024-04-19T02:16:30.687 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.019975050000000001 2024-04-19T02:16:30.687 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.687 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.687 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:30.687 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148169+0000", 2024-04-19T02:16:30.688 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0001e-05 2024-04-19T02:16:30.688 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.688 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.688 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:30.688 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148191+0000", 2024-04-19T02:16:30.688 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.2104999999999999e-05 2024-04-19T02:16:30.688 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:30.688 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:30.688 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:30.688 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.688 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.688 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78271 5.4 5:2982d7a6:::benchmark_data_smithi121_44835_object78270:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:30.688 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:16:30.688 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 3.4597332669999998, 2024-04-19T02:16:30.689 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020841755999999999, 2024-04-19T02:16:30.689 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:30.689 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:30.689 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:30.689 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:30.689 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:30.689 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78271 2024-04-19T02:16:30.689 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.689 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:30.689 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.689 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:30.689 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:16:30.689 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:30.689 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.690 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.690 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:30.690 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:16:30.690 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:30.690 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.690 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.690 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:30.690 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132119+0000", 2024-04-19T02:16:30.690 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:30.690 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.690 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.690 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:30.690 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132185+0000", 2024-04-19T02:16:30.690 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5994000000000005e-05 2024-04-19T02:16:30.690 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.691 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.691 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:30.691 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132197+0000", 2024-04-19T02:16:30.691 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2091e-05 2024-04-19T02:16:30.691 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.691 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.691 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:30.691 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132206+0000", 2024-04-19T02:16:30.691 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.5099999999999998e-06 2024-04-19T02:16:30.691 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.691 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.691 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:30.691 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132242+0000", 2024-04-19T02:16:30.691 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5663000000000001e-05 2024-04-19T02:16:30.691 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.691 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.691 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:30.692 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132335+0000", 2024-04-19T02:16:30.692 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3275000000000004e-05 2024-04-19T02:16:30.692 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.692 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.692 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:30.692 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132432+0000", 2024-04-19T02:16:30.692 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7571000000000005e-05 2024-04-19T02:16:30.692 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.692 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.692 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:30.692 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.136706+0000", 2024-04-19T02:16:30.692 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0042738170000000001 2024-04-19T02:16:30.692 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.692 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.692 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:30.692 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152909+0000", 2024-04-19T02:16:30.692 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016202415000000001 2024-04-19T02:16:30.693 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.693 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.693 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:30.693 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152938+0000", 2024-04-19T02:16:30.693 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9740999999999999e-05 2024-04-19T02:16:30.693 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.693 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.693 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:30.693 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152962+0000", 2024-04-19T02:16:30.693 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3659000000000002e-05 2024-04-19T02:16:30.693 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:30.693 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:30.693 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:30.693 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.693 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.694 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78272 5.4 5:273e819a:::benchmark_data_smithi121_44835_object78271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:30.694 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:16:30.694 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 3.4592442239999999, 2024-04-19T02:16:30.694 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022180163999999999, 2024-04-19T02:16:30.694 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:30.694 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:30.694 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:30.694 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:30.694 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:30.694 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78272 2024-04-19T02:16:30.694 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.694 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:30.694 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.694 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:30.695 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:16:30.695 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:30.695 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.695 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.695 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:30.695 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:16:30.695 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:30.695 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.695 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.695 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:30.695 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:16:30.695 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:30.695 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.695 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.695 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:30.695 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132690+0000", 2024-04-19T02:16:30.696 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0963000000000004e-05 2024-04-19T02:16:30.696 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.696 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.696 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:30.696 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132703+0000", 2024-04-19T02:16:30.696 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.3072e-05 2024-04-19T02:16:30.696 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.696 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.696 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:30.696 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132710+0000", 2024-04-19T02:16:30.696 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3100000000000003e-06 2024-04-19T02:16:30.696 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.696 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.696 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:30.696 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134005+0000", 2024-04-19T02:16:30.696 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001294513 2024-04-19T02:16:30.697 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.697 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.697 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:30.697 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134139+0000", 2024-04-19T02:16:30.697 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000134447 2024-04-19T02:16:30.697 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.697 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.697 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:30.697 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134284+0000", 2024-04-19T02:16:30.697 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014514399999999999 2024-04-19T02:16:30.697 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.697 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.697 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:30.697 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.139622+0000", 2024-04-19T02:16:30.697 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0053373830000000002 2024-04-19T02:16:30.697 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.697 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.698 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:30.698 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154737+0000", 2024-04-19T02:16:30.698 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015115195999999999 2024-04-19T02:16:30.698 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.698 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.698 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:30.698 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154768+0000", 2024-04-19T02:16:30.698 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0824999999999997e-05 2024-04-19T02:16:30.698 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.698 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.698 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:30.698 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154790+0000", 2024-04-19T02:16:30.698 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1999000000000001e-05 2024-04-19T02:16:30.698 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:30.698 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:30.699 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:30.699 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.699 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.699 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78865 5.4 5:2abefe97:::benchmark_data_smithi121_44835_object78864:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:30.699 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.427133+0000", 2024-04-19T02:16:30.699 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 3.164720763, 2024-04-19T02:16:30.699 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020107725999999999, 2024-04-19T02:16:30.699 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:30.699 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:30.699 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:30.699 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:30.699 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:30.700 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78865 2024-04-19T02:16:30.700 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.700 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:30.700 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.700 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:30.700 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.427133+0000", 2024-04-19T02:16:30.700 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:30.700 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.700 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.700 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:30.700 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.427133+0000", 2024-04-19T02:16:30.700 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:30.700 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.700 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.700 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:30.701 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.427132+0000", 2024-04-19T02:16:30.701 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:30.701 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.701 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.701 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:30.701 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.427196+0000", 2024-04-19T02:16:30.701 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.3866000000000001e-05 2024-04-19T02:16:30.701 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.701 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.701 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:30.701 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.427205+0000", 2024-04-19T02:16:30.701 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.6810000000000004e-06 2024-04-19T02:16:30.701 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.701 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.701 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:30.701 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.427210+0000", 2024-04-19T02:16:30.701 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.6110000000000001e-06 2024-04-19T02:16:30.702 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.702 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.702 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:30.702 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.431822+0000", 2024-04-19T02:16:30.702 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0046120110000000001 2024-04-19T02:16:30.702 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.702 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.702 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:30.702 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.431952+0000", 2024-04-19T02:16:30.702 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000129474 2024-04-19T02:16:30.702 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.702 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.702 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:30.702 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.432087+0000", 2024-04-19T02:16:30.702 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013454 2024-04-19T02:16:30.703 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.703 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.703 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:30.703 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.439095+0000", 2024-04-19T02:16:30.703 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0070082160000000003 2024-04-19T02:16:30.703 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.703 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.703 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:30.703 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.447183+0000", 2024-04-19T02:16:30.703 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0080887690000000009 2024-04-19T02:16:30.703 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.703 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.703 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:30.703 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.447214+0000", 2024-04-19T02:16:30.703 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0131999999999999e-05 2024-04-19T02:16:30.704 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.704 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.704 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:30.704 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.447241+0000", 2024-04-19T02:16:30.704 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.6974999999999998e-05 2024-04-19T02:16:30.704 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:30.704 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:30.704 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:30.704 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.704 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.704 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78866 5.4 5:2e4f6a65:::benchmark_data_smithi121_44835_object78865:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:30.704 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.429130+0000", 2024-04-19T02:16:30.704 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 3.1627233750000001, 2024-04-19T02:16:30.704 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.018769728999999999, 2024-04-19T02:16:30.705 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:30.705 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:30.705 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:30.705 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:30.705 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:30.705 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78866 2024-04-19T02:16:30.705 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.705 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:30.705 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.705 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:30.705 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.429130+0000", 2024-04-19T02:16:30.705 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:30.705 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.705 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.705 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:30.706 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.429130+0000", 2024-04-19T02:16:30.706 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:30.706 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.706 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.706 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:30.706 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.429129+0000", 2024-04-19T02:16:30.706 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:30.706 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.706 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.706 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:30.706 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.429177+0000", 2024-04-19T02:16:30.706 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.7287000000000003e-05 2024-04-19T02:16:30.706 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.706 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.706 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:30.706 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.429186+0000", 2024-04-19T02:16:30.707 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.5410000000000006e-06 2024-04-19T02:16:30.707 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.707 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.707 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:30.707 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.429192+0000", 2024-04-19T02:16:30.707 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7570000000000001e-06 2024-04-19T02:16:30.707 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.707 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.707 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:30.707 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.433574+0000", 2024-04-19T02:16:30.707 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0043824290000000002 2024-04-19T02:16:30.707 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.707 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.707 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:30.707 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.433665+0000", 2024-04-19T02:16:30.707 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0228000000000004e-05 2024-04-19T02:16:30.707 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.708 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.708 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:30.708 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.433749+0000", 2024-04-19T02:16:30.708 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.4349000000000002e-05 2024-04-19T02:16:30.708 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.708 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.708 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:30.708 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.439101+0000", 2024-04-19T02:16:30.708 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0053519639999999999 2024-04-19T02:16:30.708 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.708 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.708 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:30.708 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.447824+0000", 2024-04-19T02:16:30.708 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.008722769 2024-04-19T02:16:30.708 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.708 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.708 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:30.709 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.447865+0000", 2024-04-19T02:16:30.709 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1628000000000002e-05 2024-04-19T02:16:30.709 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:30.709 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:30.709 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:30.709 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.447900+0000", 2024-04-19T02:16:30.709 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4625999999999997e-05 2024-04-19T02:16:30.709 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:30.709 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:30.709 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:30.709 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:30.709 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:30.709 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:16:30.711 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:16:30.712 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:30.711+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:30.811 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:30.812+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:30.899 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-04-19T02:16:30.899 INFO:teuthology.orchestra.run.smithi177.stdout: "ops": [ 2024-04-19T02:16:30.899 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:30.899 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:86094 5.a 5:5649097e:::benchmark_data_smithi121_44835_object86093:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T02:16:30.899 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:30.891583+0000", 2024-04-19T02:16:30.899 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0082006679999999995, 2024-04-19T02:16:30.899 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0082221599999999992, 2024-04-19T02:16:30.899 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:30.899 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:30.900 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:30.900 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:30.900 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:30.900 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 86094 2024-04-19T02:16:30.900 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:30.900 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:30.900 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:30.900 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:30.900 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.891583+0000", 2024-04-19T02:16:30.900 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:30.900 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:30.900 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:30.900 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:30.900 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.891583+0000", 2024-04-19T02:16:30.900 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:30.901 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:30.901 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:30.901 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:30.901 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.891582+0000", 2024-04-19T02:16:30.901 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:30.901 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:30.901 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:30.901 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:30.901 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.891700+0000", 2024-04-19T02:16:30.901 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00011832600000000001 2024-04-19T02:16:30.901 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:30.901 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:30.901 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:30.901 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.891711+0000", 2024-04-19T02:16:30.901 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0848e-05 2024-04-19T02:16:30.902 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:30.902 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:30.902 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:30.902 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.891720+0000", 2024-04-19T02:16:30.902 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.2140000000000002e-06 2024-04-19T02:16:30.902 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:30.902 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:30.902 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:30.902 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.891758+0000", 2024-04-19T02:16:30.902 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.7800999999999999e-05 2024-04-19T02:16:30.902 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:30.902 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:30.902 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:30.902 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.891878+0000", 2024-04-19T02:16:30.902 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012031000000000001 2024-04-19T02:16:30.903 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:30.903 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:30.903 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:30.903 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.892018+0000", 2024-04-19T02:16:30.903 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00013954000000000001 2024-04-19T02:16:30.903 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:30.903 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:30.903 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:30.903 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.897290+0000", 2024-04-19T02:16:30.903 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.005272232 2024-04-19T02:16:30.903 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:30.903 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:30.903 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:30.903 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:30.903 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:30.904 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:86102 5.6 5:60d41f8c:::benchmark_data_smithi121_44835_object86101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T02:16:30.904 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:30.894480+0000", 2024-04-19T02:16:30.904 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0053029360000000003, 2024-04-19T02:16:30.904 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0053882599999999998, 2024-04-19T02:16:30.904 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:30.904 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:30.904 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:30.904 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:30.904 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:30.904 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 86102 2024-04-19T02:16:30.904 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:30.904 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:30.904 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:30.904 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:30.904 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.894480+0000", 2024-04-19T02:16:30.904 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:30.905 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:30.905 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:30.905 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:30.905 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.894480+0000", 2024-04-19T02:16:30.905 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:30.905 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:30.905 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:30.905 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:30.905 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.894480+0000", 2024-04-19T02:16:30.905 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:30.905 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:30.905 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:30.905 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:30.905 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.894549+0000", 2024-04-19T02:16:30.905 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.9858999999999996e-05 2024-04-19T02:16:30.906 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:30.906 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:30.906 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:30.906 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.894562+0000", 2024-04-19T02:16:30.906 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.2271e-05 2024-04-19T02:16:30.906 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:30.906 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:30.906 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:30.906 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.894570+0000", 2024-04-19T02:16:30.906 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.055e-06 2024-04-19T02:16:30.906 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:30.906 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:30.906 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:30.906 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.895858+0000", 2024-04-19T02:16:30.906 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0012882 2024-04-19T02:16:30.907 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:30.907 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:30.907 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:30.907 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.895946+0000", 2024-04-19T02:16:30.907 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.8282999999999995e-05 2024-04-19T02:16:30.907 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:30.907 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:30.907 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:30.907 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.896054+0000", 2024-04-19T02:16:30.907 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000107967 2024-04-19T02:16:30.907 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:30.907 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:30.907 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:30.907 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.899568+0000", 2024-04-19T02:16:30.908 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0035137200000000001 2024-04-19T02:16:30.908 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:30.908 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:30.908 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:30.908 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:30.908 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:30.908 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:86105 5.e e33/16 5:7f86867e:::benchmark_data_smithi121_44835_object86104:head v 33'5317, mlcod=33'5314)", 2024-04-19T02:16:30.908 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:30.896728+0000", 2024-04-19T02:16:30.908 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.003055458, 2024-04-19T02:16:30.908 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.003189791, 2024-04-19T02:16:30.908 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:30.908 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:30.908 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:30.908 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:30.908 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:30.909 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.896728+0000", 2024-04-19T02:16:30.909 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:30.909 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:30.909 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:30.909 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:30.909 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.896728+0000", 2024-04-19T02:16:30.909 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:30.909 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:30.909 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:30.909 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:30.909 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.896727+0000", 2024-04-19T02:16:30.909 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:30.909 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:30.909 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:30.909 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:30.910 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.896792+0000", 2024-04-19T02:16:30.910 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.4821999999999997e-05 2024-04-19T02:16:30.910 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:30.910 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:30.910 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:30.910 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.896801+0000", 2024-04-19T02:16:30.910 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.0799999999999995e-06 2024-04-19T02:16:30.910 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:30.910 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:30.910 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:30.910 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.896807+0000", 2024-04-19T02:16:30.910 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.0560000000000001e-06 2024-04-19T02:16:30.910 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:30.910 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:30.911 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:30.911 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.897876+0000", 2024-04-19T02:16:30.911 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0010685219999999999 2024-04-19T02:16:30.911 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:30.911 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:30.911 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:30.911 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.897893+0000", 2024-04-19T02:16:30.911 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.7105e-05 2024-04-19T02:16:30.911 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:30.911 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:30.911 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:30.911 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:30.911 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:30.911 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:86106 5.1 5:89c2964c:::benchmark_data_smithi121_44835_object86105:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T02:16:30.912 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:30.897753+0000", 2024-04-19T02:16:30.912 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0020307799999999998, 2024-04-19T02:16:30.912 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0022032050000000002, 2024-04-19T02:16:30.912 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:30.912 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:30.912 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:30.912 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:30.912 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:30.912 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 86106 2024-04-19T02:16:30.912 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:30.912 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:30.912 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:30.912 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:30.912 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.897753+0000", 2024-04-19T02:16:30.913 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:30.913 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:30.913 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:30.913 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:30.913 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.897753+0000", 2024-04-19T02:16:30.913 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:30.913 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:30.913 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:30.913 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:30.913 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.897752+0000", 2024-04-19T02:16:30.913 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:30.913 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:30.913 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:30.913 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:30.913 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.897804+0000", 2024-04-19T02:16:30.914 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.2607e-05 2024-04-19T02:16:30.914 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:30.914 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:30.914 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:30.914 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.897821+0000", 2024-04-19T02:16:30.914 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.6492000000000001e-05 2024-04-19T02:16:30.914 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:30.914 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:30.914 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:30.914 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.897831+0000", 2024-04-19T02:16:30.914 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0254999999999999e-05 2024-04-19T02:16:30.914 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:30.914 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:30.914 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:30.915 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.897883+0000", 2024-04-19T02:16:30.915 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.2308999999999997e-05 2024-04-19T02:16:30.915 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:30.915 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:30.915 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:30.915 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.898028+0000", 2024-04-19T02:16:30.915 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00014448799999999999 2024-04-19T02:16:30.915 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:30.915 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:30.915 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:30.915 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.898203+0000", 2024-04-19T02:16:30.915 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000175107 2024-04-19T02:16:30.915 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:30.915 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:30.915 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:30.915 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:30.916 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:30.916 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:86107 5.c 5:37bb136a:::benchmark_data_smithi121_44835_object86106:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T02:16:30.916 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:30.898103+0000", 2024-04-19T02:16:30.916 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.001680239, 2024-04-19T02:16:30.916 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0019118430000000001, 2024-04-19T02:16:30.916 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:30.916 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:30.916 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:30.916 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:30.916 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:30.916 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 86107 2024-04-19T02:16:30.916 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:30.916 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:30.916 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:30.916 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:30.917 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.898103+0000", 2024-04-19T02:16:30.917 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:30.917 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:30.917 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:30.917 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:30.917 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.898103+0000", 2024-04-19T02:16:30.917 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:30.917 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:30.917 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:30.917 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:30.917 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.898102+0000", 2024-04-19T02:16:30.917 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:30.917 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:30.917 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:30.917 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:30.917 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.898166+0000", 2024-04-19T02:16:30.918 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.3548999999999998e-05 2024-04-19T02:16:30.918 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:30.918 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:30.918 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:30.918 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.898179+0000", 2024-04-19T02:16:30.918 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.2661e-05 2024-04-19T02:16:30.918 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:30.918 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:30.918 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:30.918 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.898186+0000", 2024-04-19T02:16:30.918 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.7020000000000001e-06 2024-04-19T02:16:30.918 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:30.918 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:30.918 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:30.919 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.898219+0000", 2024-04-19T02:16:30.919 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.2660000000000002e-05 2024-04-19T02:16:30.919 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:30.919 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:30.919 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:30.919 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.898317+0000", 2024-04-19T02:16:30.919 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.7946e-05 2024-04-19T02:16:30.919 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:30.919 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:30.919 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:30.919 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.898414+0000", 2024-04-19T02:16:30.919 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.7036999999999999e-05 2024-04-19T02:16:30.919 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:30.919 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:30.920 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:30.920 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:30.920 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2024-04-19T02:16:30.920 INFO:teuthology.orchestra.run.smithi177.stdout: "num_ops": 5 2024-04-19T02:16:30.920 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-04-19T02:16:30.921 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:30.921+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:30.922 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:16:31.022 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:31.022+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:31.028 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 36 16 86377 86361 149.92 131.688 0.0107108 0.00666734 2024-04-19T02:16:31.102 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T02:16:31.111 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-04-19T02:16:31.111 INFO:teuthology.orchestra.run.smithi177.stdout: "ops": [], 2024-04-19T02:16:31.111 INFO:teuthology.orchestra.run.smithi177.stdout: "complaint_time": 30, 2024-04-19T02:16:31.111 INFO:teuthology.orchestra.run.smithi177.stdout: "num_blocked_ops": 0 2024-04-19T02:16:31.111 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-04-19T02:16:31.123 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:31.124+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:31.128 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:16:31.224 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:31.224+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:31.325 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:31.326+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:31.353 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-04-19T02:16:31.354 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 20, 2024-04-19T02:16:31.354 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 600, 2024-04-19T02:16:31.354 INFO:teuthology.orchestra.run.smithi177.stdout: "ops": [ 2024-04-19T02:16:31.354 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.354 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:61670 5.3 5:c5549fc1:::benchmark_data_smithi121_44835_object61669:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:31.354 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:17.409188+0000", 2024-04-19T02:16:31.354 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 13.943558384999999, 2024-04-19T02:16:31.354 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.01869871, 2024-04-19T02:16:31.354 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:31.354 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:31.354 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:31.354 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:31.355 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:31.355 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 61670 2024-04-19T02:16:31.355 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.355 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:31.355 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.355 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:31.355 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409188+0000", 2024-04-19T02:16:31.355 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:31.355 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.355 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.355 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:31.356 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409188+0000", 2024-04-19T02:16:31.356 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:31.356 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.356 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.356 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:31.356 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409188+0000", 2024-04-19T02:16:31.356 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:31.356 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.356 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.356 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:31.356 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409220+0000", 2024-04-19T02:16:31.356 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.2746999999999997e-05 2024-04-19T02:16:31.357 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.357 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.358 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:31.358 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409232+0000", 2024-04-19T02:16:31.358 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.1430999999999999e-05 2024-04-19T02:16:31.358 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.358 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.358 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:31.358 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409238+0000", 2024-04-19T02:16:31.358 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.4160000000000001e-06 2024-04-19T02:16:31.358 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.358 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.358 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:31.359 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.414159+0000", 2024-04-19T02:16:31.359 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0049206850000000002 2024-04-19T02:16:31.359 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.359 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.359 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:31.359 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.414283+0000", 2024-04-19T02:16:31.359 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000124547 2024-04-19T02:16:31.359 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.359 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.359 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:31.359 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.414439+0000", 2024-04-19T02:16:31.359 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00015586699999999999 2024-04-19T02:16:31.360 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.360 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.360 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:31.360 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.421153+0000", 2024-04-19T02:16:31.360 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0067135229999999999 2024-04-19T02:16:31.360 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.360 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.360 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:31.360 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.427775+0000", 2024-04-19T02:16:31.360 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0066216640000000002 2024-04-19T02:16:31.360 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.360 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.361 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:31.361 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.427847+0000", 2024-04-19T02:16:31.361 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.2601000000000005e-05 2024-04-19T02:16:31.361 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.361 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.361 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:31.361 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.427887+0000", 2024-04-19T02:16:31.361 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.9789000000000001e-05 2024-04-19T02:16:31.361 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:31.361 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:31.361 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:31.361 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.361 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.362 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:61671 5.3 5:cab602a2:::benchmark_data_smithi121_44835_object61670:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:31.362 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:17.409258+0000", 2024-04-19T02:16:31.362 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 13.943488996999999, 2024-04-19T02:16:31.362 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.01870983, 2024-04-19T02:16:31.362 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:31.362 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:31.362 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:31.362 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:31.362 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:31.362 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 61671 2024-04-19T02:16:31.362 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.362 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:31.362 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.363 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:31.363 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409258+0000", 2024-04-19T02:16:31.363 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:31.363 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.363 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.363 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:31.363 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409258+0000", 2024-04-19T02:16:31.363 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:31.363 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.363 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.364 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:31.364 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409257+0000", 2024-04-19T02:16:31.364 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:31.364 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.364 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.364 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:31.364 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409353+0000", 2024-04-19T02:16:31.364 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.6365000000000003e-05 2024-04-19T02:16:31.364 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.364 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.364 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:31.364 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409362+0000", 2024-04-19T02:16:31.365 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.4500000000000004e-06 2024-04-19T02:16:31.365 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.365 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.365 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:31.365 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.409382+0000", 2024-04-19T02:16:31.365 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.9707e-05 2024-04-19T02:16:31.365 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.365 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.365 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:31.366 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.416070+0000", 2024-04-19T02:16:31.366 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0066881889999999998 2024-04-19T02:16:31.366 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.366 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.366 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:31.366 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.416176+0000", 2024-04-19T02:16:31.367 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00010598 2024-04-19T02:16:31.367 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.367 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.367 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:31.367 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.416271+0000", 2024-04-19T02:16:31.367 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.4846999999999995e-05 2024-04-19T02:16:31.367 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.368 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.368 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:31.368 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.421187+0000", 2024-04-19T02:16:31.368 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0049165210000000001 2024-04-19T02:16:31.368 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.368 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.369 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:31.369 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.427894+0000", 2024-04-19T02:16:31.369 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.006706844 2024-04-19T02:16:31.369 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.369 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.369 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:31.370 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.427939+0000", 2024-04-19T02:16:31.370 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.4676999999999999e-05 2024-04-19T02:16:31.370 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.370 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.370 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:31.370 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.427967+0000", 2024-04-19T02:16:31.371 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.8770999999999999e-05 2024-04-19T02:16:31.371 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:31.371 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:31.371 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:31.371 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.371 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.372 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:61815 5.c 5:3ca8a794:::benchmark_data_smithi121_44835_object61814:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:31.372 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:17.482110+0000", 2024-04-19T02:16:31.372 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 13.870636471999999, 2024-04-19T02:16:31.372 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.021577559999999999, 2024-04-19T02:16:31.372 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:31.372 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:31.372 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:31.373 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:31.373 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:31.373 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 61815 2024-04-19T02:16:31.373 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.373 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:31.373 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.374 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:31.374 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482110+0000", 2024-04-19T02:16:31.374 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:31.374 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.374 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.374 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:31.375 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482110+0000", 2024-04-19T02:16:31.375 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:31.375 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.375 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.375 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:31.376 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482109+0000", 2024-04-19T02:16:31.376 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:31.376 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.376 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.376 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:31.376 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482197+0000", 2024-04-19T02:16:31.376 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.7405999999999996e-05 2024-04-19T02:16:31.376 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.377 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.377 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:31.377 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482206+0000", 2024-04-19T02:16:31.377 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.0010000000000007e-06 2024-04-19T02:16:31.377 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.377 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.377 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:31.378 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482211+0000", 2024-04-19T02:16:31.378 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.4569999999999996e-06 2024-04-19T02:16:31.378 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.378 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.378 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:31.378 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.489465+0000", 2024-04-19T02:16:31.379 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.007253776 2024-04-19T02:16:31.379 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.379 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.379 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:31.379 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.489582+0000", 2024-04-19T02:16:31.379 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00011669500000000001 2024-04-19T02:16:31.380 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.380 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.380 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:31.380 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.489684+0000", 2024-04-19T02:16:31.380 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000102533 2024-04-19T02:16:31.380 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.381 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.381 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:31.381 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.491836+0000", 2024-04-19T02:16:31.381 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0021516759999999999 2024-04-19T02:16:31.381 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.381 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.382 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:31.382 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503615+0000", 2024-04-19T02:16:31.382 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.011778906 2024-04-19T02:16:31.382 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.382 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.382 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:31.382 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503652+0000", 2024-04-19T02:16:31.383 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6622999999999998e-05 2024-04-19T02:16:31.383 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.383 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.383 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:31.383 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503688+0000", 2024-04-19T02:16:31.383 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6127000000000002e-05 2024-04-19T02:16:31.383 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:31.383 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:31.383 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:31.383 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.383 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.383 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:61821 5.c 5:3f8142ef:::benchmark_data_smithi121_44835_object61820:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:31.383 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:17.484515+0000", 2024-04-19T02:16:31.383 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 13.868231636999999, 2024-04-19T02:16:31.383 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.019268073, 2024-04-19T02:16:31.384 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:31.384 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:31.384 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:31.384 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:31.384 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:31.384 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 61821 2024-04-19T02:16:31.384 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.384 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:31.384 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.384 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:31.384 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.484515+0000", 2024-04-19T02:16:31.384 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:31.384 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.384 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.384 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:31.385 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.484515+0000", 2024-04-19T02:16:31.385 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:31.385 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.385 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.385 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:31.385 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.484514+0000", 2024-04-19T02:16:31.385 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:31.385 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.385 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.385 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:31.385 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.484612+0000", 2024-04-19T02:16:31.385 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.7962999999999997e-05 2024-04-19T02:16:31.385 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.385 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.386 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:31.386 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.484623+0000", 2024-04-19T02:16:31.386 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.1229999999999999e-05 2024-04-19T02:16:31.386 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.386 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.386 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:31.386 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.484629+0000", 2024-04-19T02:16:31.386 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.9549999999999997e-06 2024-04-19T02:16:31.386 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.386 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.386 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:31.386 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.491863+0000", 2024-04-19T02:16:31.386 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.007234178 2024-04-19T02:16:31.386 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.386 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.387 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:31.387 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.491976+0000", 2024-04-19T02:16:31.387 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000112613 2024-04-19T02:16:31.387 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.387 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.387 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:31.387 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.492073+0000", 2024-04-19T02:16:31.387 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.6961999999999998e-05 2024-04-19T02:16:31.387 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.387 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.387 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:31.387 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.496898+0000", 2024-04-19T02:16:31.387 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0048245299999999996 2024-04-19T02:16:31.387 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.387 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.388 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:31.388 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503695+0000", 2024-04-19T02:16:31.388 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0067978129999999998 2024-04-19T02:16:31.388 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.388 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.388 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:31.388 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503748+0000", 2024-04-19T02:16:31.388 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.2247000000000003e-05 2024-04-19T02:16:31.388 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.388 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.388 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:31.388 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503783+0000", 2024-04-19T02:16:31.388 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.5389999999999998e-05 2024-04-19T02:16:31.388 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:31.388 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:31.389 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:31.389 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.389 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.389 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:78011 5.5 5:a93aae72:::benchmark_data_smithi121_44835_object78010:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:31.389 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:26.996439+0000", 2024-04-19T02:16:31.389 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4.3563076389999997, 2024-04-19T02:16:31.389 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.018711576000000001, 2024-04-19T02:16:31.389 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:31.389 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:31.389 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:31.389 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:31.389 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:31.389 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 78011 2024-04-19T02:16:31.389 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.389 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:31.390 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.390 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:31.390 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.996439+0000", 2024-04-19T02:16:31.390 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:31.390 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.390 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.390 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:31.390 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.996439+0000", 2024-04-19T02:16:31.390 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:31.390 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.390 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.390 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:31.390 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.996438+0000", 2024-04-19T02:16:31.390 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:31.390 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.391 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.391 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:31.391 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.996497+0000", 2024-04-19T02:16:31.391 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.8585000000000002e-05 2024-04-19T02:16:31.391 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.391 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.391 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:31.391 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.996508+0000", 2024-04-19T02:16:31.391 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.1409999999999999e-05 2024-04-19T02:16:31.391 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.391 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.391 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:31.391 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.996516+0000", 2024-04-19T02:16:31.391 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.1019999999999997e-06 2024-04-19T02:16:31.391 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.392 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.392 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:31.392 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.998055+0000", 2024-04-19T02:16:31.392 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.001538336 2024-04-19T02:16:31.392 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.392 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.392 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:31.392 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.998170+0000", 2024-04-19T02:16:31.392 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000115722 2024-04-19T02:16:31.392 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.392 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.392 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:31.392 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:26.998339+0000", 2024-04-19T02:16:31.392 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00016885500000000001 2024-04-19T02:16:31.393 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.393 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.393 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:31.393 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.003741+0000", 2024-04-19T02:16:31.393 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0054015269999999997 2024-04-19T02:16:31.393 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.393 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.393 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:31.393 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.015092+0000", 2024-04-19T02:16:31.393 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.011351037 2024-04-19T02:16:31.393 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.393 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.393 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:31.393 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.015124+0000", 2024-04-19T02:16:31.394 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.2109e-05 2024-04-19T02:16:31.394 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.394 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.394 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:31.394 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.015151+0000", 2024-04-19T02:16:31.394 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.6642999999999999e-05 2024-04-19T02:16:31.394 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:31.394 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:31.394 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:31.394 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.394 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.394 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:78170 5.1 5:8b9c8e45:::benchmark_data_smithi121_44835_object78169:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:31.394 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.078784+0000", 2024-04-19T02:16:31.394 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4.2739621840000002, 2024-04-19T02:16:31.394 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.019726264, 2024-04-19T02:16:31.395 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:31.395 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:31.395 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:31.395 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:31.395 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:31.395 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 78170 2024-04-19T02:16:31.395 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.395 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:31.395 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.395 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:31.395 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.078784+0000", 2024-04-19T02:16:31.395 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:31.395 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.395 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.395 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:31.395 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.078784+0000", 2024-04-19T02:16:31.396 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:31.396 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.396 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.396 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:31.396 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.078784+0000", 2024-04-19T02:16:31.396 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:31.396 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.396 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.396 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:31.396 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.078887+0000", 2024-04-19T02:16:31.396 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000103305 2024-04-19T02:16:31.396 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.396 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.396 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:31.396 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.078895+0000", 2024-04-19T02:16:31.397 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.4409999999999993e-06 2024-04-19T02:16:31.397 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.397 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.397 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:31.397 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.078902+0000", 2024-04-19T02:16:31.397 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.9990000000000002e-06 2024-04-19T02:16:31.397 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.397 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.397 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:31.397 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.080865+0000", 2024-04-19T02:16:31.397 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0019620169999999999 2024-04-19T02:16:31.397 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.397 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.397 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:31.397 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.080997+0000", 2024-04-19T02:16:31.397 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00013229100000000001 2024-04-19T02:16:31.398 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.398 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.398 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:31.398 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.081163+0000", 2024-04-19T02:16:31.398 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00016632300000000001 2024-04-19T02:16:31.398 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.398 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.398 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:31.398 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.087215+0000", 2024-04-19T02:16:31.398 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0060522600000000003 2024-04-19T02:16:31.398 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.398 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.398 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:31.398 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.087261+0000", 2024-04-19T02:16:31.399 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.5788999999999998e-05 2024-04-19T02:16:31.399 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.399 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.399 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:31.399 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.098357+0000", 2024-04-19T02:16:31.399 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.011095571 2024-04-19T02:16:31.399 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.399 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.399 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:31.399 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.098407+0000", 2024-04-19T02:16:31.399 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.9821000000000003e-05 2024-04-19T02:16:31.399 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.399 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.399 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:31.399 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.098511+0000", 2024-04-19T02:16:31.399 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000104101 2024-04-19T02:16:31.400 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:31.400 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:31.400 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:31.400 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.400 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.400 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:78173 5.1 5:836bdddd:::benchmark_data_smithi121_44835_object78172:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:31.400 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.079379+0000", 2024-04-19T02:16:31.400 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4.273367854, 2024-04-19T02:16:31.400 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.019339773000000001, 2024-04-19T02:16:31.400 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:31.400 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:31.400 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:31.400 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:31.400 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:31.400 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 78173 2024-04-19T02:16:31.401 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.401 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:31.401 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.401 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:31.401 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.079379+0000", 2024-04-19T02:16:31.401 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:31.401 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.401 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.401 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:31.401 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.079379+0000", 2024-04-19T02:16:31.401 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:31.401 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.401 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.401 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:31.401 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.079378+0000", 2024-04-19T02:16:31.402 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:31.402 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.402 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.402 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:31.402 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.079500+0000", 2024-04-19T02:16:31.402 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000122411 2024-04-19T02:16:31.402 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.402 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.402 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:31.402 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.079509+0000", 2024-04-19T02:16:31.402 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.7490000000000004e-06 2024-04-19T02:16:31.402 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.402 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.402 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:31.402 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.079516+0000", 2024-04-19T02:16:31.403 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.6120000000000004e-06 2024-04-19T02:16:31.403 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.403 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.403 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:31.403 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.083107+0000", 2024-04-19T02:16:31.403 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.003590963 2024-04-19T02:16:31.403 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.403 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.403 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:31.403 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.083265+0000", 2024-04-19T02:16:31.403 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000157944 2024-04-19T02:16:31.403 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.403 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.403 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:31.403 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.083467+0000", 2024-04-19T02:16:31.403 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000202129 2024-04-19T02:16:31.404 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.404 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.404 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:31.404 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.087305+0000", 2024-04-19T02:16:31.404 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0038381679999999999 2024-04-19T02:16:31.404 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.404 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.404 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:31.404 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.089566+0000", 2024-04-19T02:16:31.404 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0022616009999999998 2024-04-19T02:16:31.404 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.404 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.404 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:31.404 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.098555+0000", 2024-04-19T02:16:31.404 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0089888090000000004 2024-04-19T02:16:31.405 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.405 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.405 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:31.405 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.098619+0000", 2024-04-19T02:16:31.405 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.3555999999999999e-05 2024-04-19T02:16:31.405 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.405 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.405 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:31.405 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.098719+0000", 2024-04-19T02:16:31.405 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.9674999999999997e-05 2024-04-19T02:16:31.405 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:31.405 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:31.405 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:31.405 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.406 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.406 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:78224 5.4 e31/16 5:26e797d5:::benchmark_data_smithi121_44835_object78223:head v 31'4845, mlcod=31'4843)", 2024-04-19T02:16:31.406 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.108876+0000", 2024-04-19T02:16:31.406 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4.2438703909999997, 2024-04-19T02:16:31.406 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.018917363999999999, 2024-04-19T02:16:31.406 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:31.406 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:31.406 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:31.406 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.406 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:31.406 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.108876+0000", 2024-04-19T02:16:31.406 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:31.406 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.406 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.407 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:31.407 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.108876+0000", 2024-04-19T02:16:31.407 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:31.407 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.407 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.407 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:31.407 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.108876+0000", 2024-04-19T02:16:31.407 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:31.407 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.407 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.407 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:31.407 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.108914+0000", 2024-04-19T02:16:31.407 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.8603999999999998e-05 2024-04-19T02:16:31.407 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.407 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.408 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:31.408 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.108923+0000", 2024-04-19T02:16:31.408 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.0359999999999995e-06 2024-04-19T02:16:31.408 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.408 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.408 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:31.408 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.108929+0000", 2024-04-19T02:16:31.408 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.2329999999999997e-06 2024-04-19T02:16:31.408 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.408 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.408 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:31.408 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.108958+0000", 2024-04-19T02:16:31.408 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.9456999999999999e-05 2024-04-19T02:16:31.408 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.408 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.409 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:31.409 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.108978+0000", 2024-04-19T02:16:31.409 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.9619999999999998e-05 2024-04-19T02:16:31.409 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.409 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.409 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:31.409 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.127760+0000", 2024-04-19T02:16:31.409 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.018782507 2024-04-19T02:16:31.409 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.409 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.409 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:31.409 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.127794+0000", 2024-04-19T02:16:31.409 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.3349999999999997e-05 2024-04-19T02:16:31.409 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:31.409 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:31.410 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:31.410 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.410 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.410 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:78247 5.c 5:3efb1468:::benchmark_data_smithi121_44835_object78246:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:31.410 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.116347+0000", 2024-04-19T02:16:31.410 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4.2363994170000003, 2024-04-19T02:16:31.410 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.032194436999999999, 2024-04-19T02:16:31.410 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:31.410 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:31.410 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:31.410 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:31.410 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:31.410 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 78247 2024-04-19T02:16:31.410 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.410 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:31.411 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.411 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:31.411 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116347+0000", 2024-04-19T02:16:31.411 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:31.411 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.411 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.411 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:31.411 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116347+0000", 2024-04-19T02:16:31.411 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:31.411 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.411 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.411 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:31.411 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116346+0000", 2024-04-19T02:16:31.411 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:31.411 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.412 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.412 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:31.412 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116370+0000", 2024-04-19T02:16:31.412 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.3892000000000001e-05 2024-04-19T02:16:31.412 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.412 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.412 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:31.412 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116385+0000", 2024-04-19T02:16:31.412 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.5162e-05 2024-04-19T02:16:31.412 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.412 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.412 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:31.412 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116394+0000", 2024-04-19T02:16:31.412 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.8000000000000004e-06 2024-04-19T02:16:31.413 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.413 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.413 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:31.413 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124856+0000", 2024-04-19T02:16:31.413 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0084622169999999993 2024-04-19T02:16:31.413 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.413 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.413 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:31.413 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124966+0000", 2024-04-19T02:16:31.413 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000109747 2024-04-19T02:16:31.413 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.413 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.413 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:31.413 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125216+0000", 2024-04-19T02:16:31.413 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000249545 2024-04-19T02:16:31.414 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.414 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.414 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:31.414 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.131713+0000", 2024-04-19T02:16:31.414 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0064972370000000003 2024-04-19T02:16:31.414 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.414 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.414 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:31.414 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148323+0000", 2024-04-19T02:16:31.414 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016609641000000001 2024-04-19T02:16:31.414 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.414 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.414 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:31.414 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148359+0000", 2024-04-19T02:16:31.414 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6412000000000003e-05 2024-04-19T02:16:31.415 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.415 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.415 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:31.415 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148542+0000", 2024-04-19T02:16:31.415 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00018265600000000001 2024-04-19T02:16:31.415 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:31.415 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:31.415 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:31.415 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.415 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.415 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:78248 5.c 5:30b7cc74:::benchmark_data_smithi121_44835_object78247:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:31.415 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.116471+0000", 2024-04-19T02:16:31.415 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4.2362759160000003, 2024-04-19T02:16:31.415 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.032127452000000001, 2024-04-19T02:16:31.415 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:31.415 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:31.416 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:31.416 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:31.416 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:31.416 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 78248 2024-04-19T02:16:31.416 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.416 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:31.416 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.416 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:31.416 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116471+0000", 2024-04-19T02:16:31.416 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:31.416 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.416 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.416 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:31.416 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116471+0000", 2024-04-19T02:16:31.417 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:31.417 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.417 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.417 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:31.417 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116470+0000", 2024-04-19T02:16:31.417 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:31.417 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.417 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.417 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:31.417 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116496+0000", 2024-04-19T02:16:31.417 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.5517e-05 2024-04-19T02:16:31.417 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.417 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.417 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:31.417 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116505+0000", 2024-04-19T02:16:31.418 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.9250000000000007e-06 2024-04-19T02:16:31.418 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.418 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.418 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:31.418 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116516+0000", 2024-04-19T02:16:31.418 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.012e-05 2024-04-19T02:16:31.418 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.418 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.418 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:31.418 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.127803+0000", 2024-04-19T02:16:31.418 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.011287523000000001 2024-04-19T02:16:31.418 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.418 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.418 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:31.419 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.127932+0000", 2024-04-19T02:16:31.419 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012848499999999999 2024-04-19T02:16:31.419 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.419 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.419 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:31.419 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128022+0000", 2024-04-19T02:16:31.419 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.0890000000000006e-05 2024-04-19T02:16:31.419 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.419 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.419 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:31.419 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.131909+0000", 2024-04-19T02:16:31.419 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0038864609999999999 2024-04-19T02:16:31.419 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.419 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.420 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:31.420 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148552+0000", 2024-04-19T02:16:31.420 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016643162999999999 2024-04-19T02:16:31.420 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.420 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.420 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:31.420 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148577+0000", 2024-04-19T02:16:31.420 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.5333999999999998e-05 2024-04-19T02:16:31.420 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.420 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.420 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:31.420 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148598+0000", 2024-04-19T02:16:31.420 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.0687999999999999e-05 2024-04-19T02:16:31.420 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:31.420 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:31.421 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:31.421 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.421 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.421 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:78258 5.a 5:549070de:::benchmark_data_smithi121_44835_object78257:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:31.421 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.124295+0000", 2024-04-19T02:16:31.421 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4.2284513700000002, 2024-04-19T02:16:31.421 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020189543000000001, 2024-04-19T02:16:31.421 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:31.421 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:31.421 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:31.421 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:31.421 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:31.421 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 78258 2024-04-19T02:16:31.421 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.422 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:31.422 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.422 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:31.422 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124295+0000", 2024-04-19T02:16:31.422 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:31.422 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.422 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.422 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:31.422 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124295+0000", 2024-04-19T02:16:31.422 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:31.422 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.422 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.422 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:31.422 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124294+0000", 2024-04-19T02:16:31.422 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:31.423 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.423 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.423 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:31.423 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124358+0000", 2024-04-19T02:16:31.423 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.4040000000000003e-05 2024-04-19T02:16:31.423 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.423 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.423 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:31.423 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124374+0000", 2024-04-19T02:16:31.423 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.5291e-05 2024-04-19T02:16:31.423 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.423 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.423 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:31.423 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124383+0000", 2024-04-19T02:16:31.423 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.8360000000000004e-06 2024-04-19T02:16:31.424 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.424 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.424 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:31.424 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124908+0000", 2024-04-19T02:16:31.424 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00052415700000000003 2024-04-19T02:16:31.424 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.424 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.424 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:31.424 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125023+0000", 2024-04-19T02:16:31.424 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00011506999999999999 2024-04-19T02:16:31.424 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.424 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.424 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:31.424 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125182+0000", 2024-04-19T02:16:31.424 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00015942500000000001 2024-04-19T02:16:31.425 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.425 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.425 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:31.425 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.129505+0000", 2024-04-19T02:16:31.425 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0043225080000000001 2024-04-19T02:16:31.425 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.425 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.425 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:31.425 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.144379+0000", 2024-04-19T02:16:31.425 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.014874263 2024-04-19T02:16:31.425 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.425 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.425 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:31.425 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.144444+0000", 2024-04-19T02:16:31.425 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.5451999999999996e-05 2024-04-19T02:16:31.425 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.426 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.426 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:31.426 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.144485+0000", 2024-04-19T02:16:31.426 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.0426999999999998e-05 2024-04-19T02:16:31.426 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:31.426 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:31.426 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:31.426 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.426 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.426 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:78259 5.4 e31/16 5:2aa344b2:::benchmark_data_smithi121_44835_object78258:head v 31'4849, mlcod=31'4843)", 2024-04-19T02:16:31.426 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.125675+0000", 2024-04-19T02:16:31.426 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4.2270714979999999, 2024-04-19T02:16:31.426 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.022419326, 2024-04-19T02:16:31.426 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:31.427 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:31.427 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:31.427 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.427 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:31.427 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125675+0000", 2024-04-19T02:16:31.427 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:31.427 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.427 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.427 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:31.427 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125675+0000", 2024-04-19T02:16:31.427 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:31.427 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.427 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.427 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:31.427 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125674+0000", 2024-04-19T02:16:31.427 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:31.428 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.428 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.428 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:31.428 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125723+0000", 2024-04-19T02:16:31.428 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.8998000000000001e-05 2024-04-19T02:16:31.428 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.428 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.428 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:31.428 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125733+0000", 2024-04-19T02:16:31.428 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.1379999999999996e-06 2024-04-19T02:16:31.428 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.428 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.428 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:31.428 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125740+0000", 2024-04-19T02:16:31.428 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.0779999999999998e-06 2024-04-19T02:16:31.428 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.429 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.429 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:31.429 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.129589+0000", 2024-04-19T02:16:31.429 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0038488910000000001 2024-04-19T02:16:31.429 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.429 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.429 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:31.429 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.129605+0000", 2024-04-19T02:16:31.429 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.6877000000000001e-05 2024-04-19T02:16:31.429 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.429 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.429 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:31.429 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148057+0000", 2024-04-19T02:16:31.429 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.018451624 2024-04-19T02:16:31.429 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.430 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.430 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:31.430 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148094+0000", 2024-04-19T02:16:31.430 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.7327999999999999e-05 2024-04-19T02:16:31.430 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:31.430 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:31.430 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:31.430 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.430 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.430 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:78263 5.1 5:8e231862:::benchmark_data_smithi121_44835_object78262:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:31.430 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.128154+0000", 2024-04-19T02:16:31.430 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4.2245923120000004, 2024-04-19T02:16:31.430 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020882214, 2024-04-19T02:16:31.430 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:31.431 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:31.431 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:31.431 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:31.431 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:31.431 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 78263 2024-04-19T02:16:31.431 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.431 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:31.431 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.431 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:31.431 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128154+0000", 2024-04-19T02:16:31.431 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:31.431 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.431 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.431 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:31.431 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128154+0000", 2024-04-19T02:16:31.432 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:31.432 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.432 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.432 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:31.432 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128153+0000", 2024-04-19T02:16:31.432 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:31.432 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.432 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.432 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:31.432 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128246+0000", 2024-04-19T02:16:31.432 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.302e-05 2024-04-19T02:16:31.432 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.432 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.432 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:31.432 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128263+0000", 2024-04-19T02:16:31.433 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.6753e-05 2024-04-19T02:16:31.433 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.433 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.433 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:31.433 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128271+0000", 2024-04-19T02:16:31.433 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.2290000000000003e-06 2024-04-19T02:16:31.433 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.433 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.433 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:31.433 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128459+0000", 2024-04-19T02:16:31.433 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00018772 2024-04-19T02:16:31.433 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.433 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.433 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:31.433 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128574+0000", 2024-04-19T02:16:31.434 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00011437700000000001 2024-04-19T02:16:31.434 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.434 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.434 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:31.434 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128696+0000", 2024-04-19T02:16:31.434 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000122831 2024-04-19T02:16:31.434 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.434 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.434 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:31.434 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.130816+0000", 2024-04-19T02:16:31.434 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0021196750000000001 2024-04-19T02:16:31.434 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.434 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.434 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:31.434 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.131859+0000", 2024-04-19T02:16:31.434 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0010434419999999999 2024-04-19T02:16:31.435 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.435 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.435 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:31.435 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148848+0000", 2024-04-19T02:16:31.435 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016988712 2024-04-19T02:16:31.435 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.435 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.435 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:31.435 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148905+0000", 2024-04-19T02:16:31.435 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.6722999999999999e-05 2024-04-19T02:16:31.435 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.435 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.435 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:31.435 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.149036+0000", 2024-04-19T02:16:31.435 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000131567 2024-04-19T02:16:31.436 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:31.436 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:31.436 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:31.436 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.436 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.436 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:78271 5.4 e31/16 5:2982d7a6:::benchmark_data_smithi121_44835_object78270:head v 31'4850, mlcod=31'4847)", 2024-04-19T02:16:31.436 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.132554+0000", 2024-04-19T02:16:31.436 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4.2201927780000004, 2024-04-19T02:16:31.436 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020294946000000001, 2024-04-19T02:16:31.436 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:31.436 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:31.436 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:31.436 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.436 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:31.436 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132554+0000", 2024-04-19T02:16:31.437 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:31.437 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.437 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.437 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:31.437 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132554+0000", 2024-04-19T02:16:31.437 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:31.437 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.437 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.437 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:31.437 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132553+0000", 2024-04-19T02:16:31.437 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:31.437 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.437 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.437 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:31.437 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132615+0000", 2024-04-19T02:16:31.437 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.1772000000000004e-05 2024-04-19T02:16:31.438 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.438 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.438 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:31.438 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132620+0000", 2024-04-19T02:16:31.438 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.0939999999999998e-06 2024-04-19T02:16:31.438 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.438 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.438 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:31.438 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132624+0000", 2024-04-19T02:16:31.438 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.2229999999999999e-06 2024-04-19T02:16:31.438 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.438 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.438 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:31.438 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132649+0000", 2024-04-19T02:16:31.439 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.5352000000000001e-05 2024-04-19T02:16:31.439 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.439 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.439 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:31.439 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132661+0000", 2024-04-19T02:16:31.439 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.1851999999999999e-05 2024-04-19T02:16:31.439 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.439 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.439 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:31.439 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.152820+0000", 2024-04-19T02:16:31.439 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020159369999999999 2024-04-19T02:16:31.439 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.439 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.439 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:31.439 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.152849+0000", 2024-04-19T02:16:31.439 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.868e-05 2024-04-19T02:16:31.440 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:31.440 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:31.440 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:31.440 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.440 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.440 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:78272 5.4 e31/16 5:273e819a:::benchmark_data_smithi121_44835_object78271:head v 31'4851, mlcod=31'4847)", 2024-04-19T02:16:31.440 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.134397+0000", 2024-04-19T02:16:31.440 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4.2183496060000003, 2024-04-19T02:16:31.440 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.018541730999999999, 2024-04-19T02:16:31.440 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:31.440 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:31.440 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:31.440 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.440 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:31.441 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.134397+0000", 2024-04-19T02:16:31.441 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:31.441 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.441 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.441 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:31.441 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.134397+0000", 2024-04-19T02:16:31.441 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:31.441 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.441 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.441 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:31.441 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.134396+0000", 2024-04-19T02:16:31.441 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:31.441 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.441 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.441 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:31.441 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.134453+0000", 2024-04-19T02:16:31.442 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.6858999999999999e-05 2024-04-19T02:16:31.442 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.442 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.442 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:31.442 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.134460+0000", 2024-04-19T02:16:31.442 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.7390000000000002e-06 2024-04-19T02:16:31.442 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.442 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.442 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:31.442 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.134465+0000", 2024-04-19T02:16:31.442 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.5419999999999999e-06 2024-04-19T02:16:31.442 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.442 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.442 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:31.442 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.144083+0000", 2024-04-19T02:16:31.443 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0096182320000000009 2024-04-19T02:16:31.443 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.443 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.443 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:31.443 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.144104+0000", 2024-04-19T02:16:31.443 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.1458999999999999e-05 2024-04-19T02:16:31.443 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.443 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.443 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:31.443 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.152859+0000", 2024-04-19T02:16:31.443 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0087549889999999995 2024-04-19T02:16:31.443 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.443 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.443 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:31.444 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.152939+0000", 2024-04-19T02:16:31.444 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.9432999999999997e-05 2024-04-19T02:16:31.444 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:31.444 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:31.444 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:31.444 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.444 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.444 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:78807 5.3 5:c0963eed:::benchmark_data_smithi121_44835_object78806:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:31.444 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.397845+0000", 2024-04-19T02:16:31.444 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 3.9549012389999998, 2024-04-19T02:16:31.444 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.018482620000000002, 2024-04-19T02:16:31.444 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:31.444 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:31.444 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:31.445 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:31.445 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:31.445 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 78807 2024-04-19T02:16:31.445 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.445 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:31.445 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.445 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:31.445 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.397845+0000", 2024-04-19T02:16:31.445 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:31.445 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.445 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.445 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:31.445 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.397845+0000", 2024-04-19T02:16:31.445 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:31.445 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.446 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.446 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:31.446 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.397844+0000", 2024-04-19T02:16:31.446 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:31.446 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.446 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.446 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:31.446 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.397933+0000", 2024-04-19T02:16:31.446 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.9047000000000003e-05 2024-04-19T02:16:31.446 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.446 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.446 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:31.446 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.397942+0000", 2024-04-19T02:16:31.447 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.2600000000000005e-06 2024-04-19T02:16:31.447 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.447 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.447 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:31.447 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.397946+0000", 2024-04-19T02:16:31.447 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.6909999999999996e-06 2024-04-19T02:16:31.447 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.447 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.447 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:31.447 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.397969+0000", 2024-04-19T02:16:31.447 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.2595999999999998e-05 2024-04-19T02:16:31.447 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.447 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.447 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:31.447 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.398081+0000", 2024-04-19T02:16:31.448 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000112346 2024-04-19T02:16:31.448 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.448 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.448 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:31.448 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.398230+0000", 2024-04-19T02:16:31.448 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00014856 2024-04-19T02:16:31.448 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.448 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.448 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:31.448 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.404114+0000", 2024-04-19T02:16:31.448 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0058837780000000001 2024-04-19T02:16:31.448 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.448 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.448 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:31.449 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.416266+0000", 2024-04-19T02:16:31.449 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.012152733000000001 2024-04-19T02:16:31.449 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.449 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.449 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:31.449 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.416295+0000", 2024-04-19T02:16:31.449 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.8687000000000002e-05 2024-04-19T02:16:31.449 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.449 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.449 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:31.449 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.416328+0000", 2024-04-19T02:16:31.449 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.3042e-05 2024-04-19T02:16:31.449 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:31.449 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:31.449 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:31.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.450 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.450 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:80412 5.1 5:873f59a4:::benchmark_data_smithi121_44835_object80411:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:31.450 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:28.161025+0000", 2024-04-19T02:16:31.450 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 3.191721324, 2024-04-19T02:16:31.450 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.01889393, 2024-04-19T02:16:31.450 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:31.450 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:31.450 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:31.450 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:31.450 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:31.450 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 80412 2024-04-19T02:16:31.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.450 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:31.451 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.451 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:31.451 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:28.161025+0000", 2024-04-19T02:16:31.451 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:31.451 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.451 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.451 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:31.451 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:28.161025+0000", 2024-04-19T02:16:31.451 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:31.451 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.451 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.451 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:31.451 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:28.161025+0000", 2024-04-19T02:16:31.451 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:31.451 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.452 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.452 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:31.452 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:28.161067+0000", 2024-04-19T02:16:31.452 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.2055999999999998e-05 2024-04-19T02:16:31.452 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.452 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.452 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:31.452 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:28.161074+0000", 2024-04-19T02:16:31.452 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.8129999999999996e-06 2024-04-19T02:16:31.452 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.452 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.452 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:31.452 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:28.161080+0000", 2024-04-19T02:16:31.452 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.9320000000000001e-06 2024-04-19T02:16:31.453 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.453 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.453 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:31.453 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:28.163605+0000", 2024-04-19T02:16:31.453 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.002524274 2024-04-19T02:16:31.453 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.453 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.453 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:31.453 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:28.163753+0000", 2024-04-19T02:16:31.453 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00014783299999999999 2024-04-19T02:16:31.453 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.453 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.453 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:31.453 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:28.163920+0000", 2024-04-19T02:16:31.453 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00016714900000000001 2024-04-19T02:16:31.454 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.454 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.454 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:31.454 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:28.165845+0000", 2024-04-19T02:16:31.454 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.001925225 2024-04-19T02:16:31.454 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.454 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.454 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:31.454 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:28.168567+0000", 2024-04-19T02:16:31.454 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0027220299999999998 2024-04-19T02:16:31.454 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.454 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.454 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:31.455 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:28.179769+0000", 2024-04-19T02:16:31.455 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.011201789 2024-04-19T02:16:31.455 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.455 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.455 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:31.455 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:28.179815+0000", 2024-04-19T02:16:31.455 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.6653000000000002e-05 2024-04-19T02:16:31.455 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.455 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.455 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:31.455 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:28.179919+0000", 2024-04-19T02:16:31.455 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000103823 2024-04-19T02:16:31.455 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:31.455 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:31.455 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:31.456 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.456 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.456 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:85867 5.a 5:563068d5:::benchmark_data_smithi121_44835_object85866:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T02:16:31.456 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:30.772002+0000", 2024-04-19T02:16:31.456 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.58074508000000002, 2024-04-19T02:16:31.456 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.019372292999999999, 2024-04-19T02:16:31.456 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:31.456 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:31.456 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:31.456 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:31.456 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:31.456 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 85867 2024-04-19T02:16:31.456 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.457 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:31.457 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.457 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:31.457 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.772002+0000", 2024-04-19T02:16:31.457 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:31.457 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.457 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.457 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:31.457 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.772002+0000", 2024-04-19T02:16:31.457 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:31.457 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.457 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.457 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:31.457 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.772001+0000", 2024-04-19T02:16:31.457 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:31.457 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.458 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.458 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:31.458 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.772035+0000", 2024-04-19T02:16:31.458 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.3995000000000002e-05 2024-04-19T02:16:31.458 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.458 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.458 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:31.458 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.772042+0000", 2024-04-19T02:16:31.458 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.3039999999999999e-06 2024-04-19T02:16:31.458 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.458 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.458 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:31.458 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.772049+0000", 2024-04-19T02:16:31.458 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.635e-06 2024-04-19T02:16:31.459 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.459 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.459 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:31.459 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.779360+0000", 2024-04-19T02:16:31.459 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0073112510000000004 2024-04-19T02:16:31.459 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.459 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.459 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:31.459 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.779504+0000", 2024-04-19T02:16:31.459 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000143378 2024-04-19T02:16:31.459 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.459 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.459 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:31.459 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.779625+0000", 2024-04-19T02:16:31.459 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000121903 2024-04-19T02:16:31.459 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.460 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.460 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:31.460 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.781522+0000", 2024-04-19T02:16:31.460 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0018965430000000001 2024-04-19T02:16:31.460 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.460 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.460 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:31.460 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.791290+0000", 2024-04-19T02:16:31.460 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0097679289999999998 2024-04-19T02:16:31.460 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.460 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.460 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:31.460 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.791338+0000", 2024-04-19T02:16:31.460 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.8387999999999998e-05 2024-04-19T02:16:31.461 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.461 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.461 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:31.461 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.791374+0000", 2024-04-19T02:16:31.461 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.5462e-05 2024-04-19T02:16:31.461 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:31.461 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:31.461 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:31.461 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.461 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.461 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:85866 5.2 e33/16 5:48b1d46d:::benchmark_data_smithi121_44835_object85865:head v 33'5378, mlcod=33'5375)", 2024-04-19T02:16:31.461 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:30.772427+0000", 2024-04-19T02:16:31.461 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.58031974900000005, 2024-04-19T02:16:31.461 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.018977936000000001, 2024-04-19T02:16:31.461 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:31.462 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:31.462 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:31.462 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.462 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:31.462 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.772427+0000", 2024-04-19T02:16:31.462 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:31.462 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.462 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.462 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:31.462 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.772427+0000", 2024-04-19T02:16:31.462 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:31.462 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.462 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.463 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:31.463 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.772426+0000", 2024-04-19T02:16:31.463 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:31.463 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.463 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.463 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:31.463 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.772495+0000", 2024-04-19T02:16:31.463 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.8614000000000004e-05 2024-04-19T02:16:31.463 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.463 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.463 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:31.463 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.772503+0000", 2024-04-19T02:16:31.463 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.9070000000000007e-06 2024-04-19T02:16:31.463 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.464 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.464 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:31.464 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.772508+0000", 2024-04-19T02:16:31.464 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.5679999999999999e-06 2024-04-19T02:16:31.464 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.464 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.464 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:31.464 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.779318+0000", 2024-04-19T02:16:31.464 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0068099359999999999 2024-04-19T02:16:31.464 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.464 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.464 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:31.464 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.779331+0000", 2024-04-19T02:16:31.464 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.3105000000000001e-05 2024-04-19T02:16:31.464 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.465 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.465 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:31.465 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.791378+0000", 2024-04-19T02:16:31.465 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.012046509 2024-04-19T02:16:31.465 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.465 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.465 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:31.465 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.791405+0000", 2024-04-19T02:16:31.465 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.6849e-05 2024-04-19T02:16:31.465 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:31.465 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:31.465 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:31.465 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.465 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.466 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:86809 5.1 5:87590d07:::benchmark_data_smithi121_44835_object86808:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T02:16:31.466 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:31.248111+0000", 2024-04-19T02:16:31.466 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.10463536599999999, 2024-04-19T02:16:31.466 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.019434132999999999, 2024-04-19T02:16:31.466 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:31.466 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:31.466 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:31.466 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:31.466 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:31.466 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 86809 2024-04-19T02:16:31.466 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.466 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:31.466 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.466 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:31.466 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.248111+0000", 2024-04-19T02:16:31.467 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:31.467 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.467 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.467 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:31.467 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.248111+0000", 2024-04-19T02:16:31.467 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:31.467 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.467 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.467 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:31.467 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.248111+0000", 2024-04-19T02:16:31.467 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:31.467 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.467 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.467 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:31.467 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.248181+0000", 2024-04-19T02:16:31.468 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.0698999999999995e-05 2024-04-19T02:16:31.468 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.468 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.468 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:31.468 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.248191+0000", 2024-04-19T02:16:31.468 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.3170000000000008e-06 2024-04-19T02:16:31.468 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.468 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.468 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:31.468 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.248197+0000", 2024-04-19T02:16:31.468 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.1279999999999996e-06 2024-04-19T02:16:31.468 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.468 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.468 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:31.468 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.256815+0000", 2024-04-19T02:16:31.469 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0086187390000000003 2024-04-19T02:16:31.469 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.469 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.469 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:31.469 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.256968+0000", 2024-04-19T02:16:31.469 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000152795 2024-04-19T02:16:31.469 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.469 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.469 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:31.469 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.257125+0000", 2024-04-19T02:16:31.469 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000156391 2024-04-19T02:16:31.469 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.469 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.469 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:31.469 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.264616+0000", 2024-04-19T02:16:31.470 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0074914789999999997 2024-04-19T02:16:31.470 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.470 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.470 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:31.470 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.264658+0000", 2024-04-19T02:16:31.470 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.2026e-05 2024-04-19T02:16:31.470 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.470 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.470 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:31.470 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.267383+0000", 2024-04-19T02:16:31.470 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0027250120000000002 2024-04-19T02:16:31.470 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.470 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.470 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:31.470 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.267438+0000", 2024-04-19T02:16:31.471 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.4784999999999998e-05 2024-04-19T02:16:31.471 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:31.471 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:31.471 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:31.471 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.267545+0000", 2024-04-19T02:16:31.471 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000107382 2024-04-19T02:16:31.471 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:31.471 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:31.471 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:31.471 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:31.471 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:31.471 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-04-19T02:16:31.473 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:31.472+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:31.473 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:16:31.575 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:31.575+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:31.640 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:16:31.640 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:16:31.640 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.640 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:87564 5.d 5:b449ca9b:::benchmark_data_smithi121_44835_object87563:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T02:16:31.640 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:31.636162+0000", 2024-04-19T02:16:31.640 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0045978049999999999, 2024-04-19T02:16:31.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0046202539999999999, 2024-04-19T02:16:31.640 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:31.641 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:31.641 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:31.641 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:31.641 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:31.641 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 87564 2024-04-19T02:16:31.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.641 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:31.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:31.641 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.636162+0000", 2024-04-19T02:16:31.641 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:31.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:31.642 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.636162+0000", 2024-04-19T02:16:31.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:31.642 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.642 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:31.642 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.636161+0000", 2024-04-19T02:16:31.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:31.642 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.642 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:31.642 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.636342+0000", 2024-04-19T02:16:31.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018060400000000001 2024-04-19T02:16:31.642 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.642 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:31.642 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.636350+0000", 2024-04-19T02:16:31.643 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2330000000000006e-06 2024-04-19T02:16:31.643 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.643 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.643 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:31.643 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.636372+0000", 2024-04-19T02:16:31.643 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2650000000000002e-05 2024-04-19T02:16:31.643 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.643 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.643 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:31.643 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.636397+0000", 2024-04-19T02:16:31.643 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.442e-05 2024-04-19T02:16:31.643 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.643 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.643 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:31.643 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.636493+0000", 2024-04-19T02:16:31.643 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6366000000000005e-05 2024-04-19T02:16:31.643 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.644 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:31.644 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.636588+0000", 2024-04-19T02:16:31.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4637999999999998e-05 2024-04-19T02:16:31.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.644 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:31.644 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.639008+0000", 2024-04-19T02:16:31.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002420284 2024-04-19T02:16:31.644 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:31.644 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:31.644 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:31.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.644 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4549.0:87565 5.1 e33/29 5:8269bc80:::benchmark_data_smithi121_44835_object87564:head v 33'5323, mlcod=33'5321)", 2024-04-19T02:16:31.645 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:31.636699+0000", 2024-04-19T02:16:31.645 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0040607320000000001, 2024-04-19T02:16:31.645 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041361999999999996, 2024-04-19T02:16:31.645 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:31.645 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:16:31.645 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:31.645 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.645 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:31.645 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.636699+0000", 2024-04-19T02:16:31.645 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:31.645 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.645 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.645 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:31.645 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.636699+0000", 2024-04-19T02:16:31.645 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:31.646 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.646 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:31.646 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.636698+0000", 2024-04-19T02:16:31.646 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:31.646 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.646 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:31.646 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.636785+0000", 2024-04-19T02:16:31.646 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6730000000000005e-05 2024-04-19T02:16:31.646 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.646 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:31.646 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.636795+0000", 2024-04-19T02:16:31.646 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9189999999999994e-06 2024-04-19T02:16:31.647 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.647 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.647 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:31.647 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.636802+0000", 2024-04-19T02:16:31.647 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6320000000000002e-06 2024-04-19T02:16:31.647 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.647 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.647 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:31.647 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.636831+0000", 2024-04-19T02:16:31.647 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9043e-05 2024-04-19T02:16:31.647 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.647 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.647 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:31.647 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.636847+0000", 2024-04-19T02:16:31.647 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6535e-05 2024-04-19T02:16:31.648 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:31.648 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:31.648 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:31.648 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.648 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.648 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4549.0:87566 5.6 e33/16 5:688df39b:::benchmark_data_smithi121_44835_object87565:head v 33'5477, mlcod=33'5475)", 2024-04-19T02:16:31.648 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:31.636946+0000", 2024-04-19T02:16:31.648 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.003813505, 2024-04-19T02:16:31.648 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039246510000000004, 2024-04-19T02:16:31.648 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:31.648 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:16:31.648 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:31.648 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.648 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:31.649 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.636946+0000", 2024-04-19T02:16:31.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:31.649 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.649 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.649 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:31.649 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.636946+0000", 2024-04-19T02:16:31.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:31.649 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.649 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.649 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:31.649 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.636946+0000", 2024-04-19T02:16:31.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:31.649 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.649 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.649 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:31.650 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.637058+0000", 2024-04-19T02:16:31.650 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011212799999999999 2024-04-19T02:16:31.650 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.650 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.650 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:31.650 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.637065+0000", 2024-04-19T02:16:31.650 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4240000000000004e-06 2024-04-19T02:16:31.650 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.650 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.650 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:31.650 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.637071+0000", 2024-04-19T02:16:31.650 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.446e-06 2024-04-19T02:16:31.650 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.650 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:31.651 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.637102+0000", 2024-04-19T02:16:31.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1687999999999999e-05 2024-04-19T02:16:31.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:31.651 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.637120+0000", 2024-04-19T02:16:31.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7475000000000001e-05 2024-04-19T02:16:31.651 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:31.651 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:31.651 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:31.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.651 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:87570 5.f 5:f4a7db2a:::benchmark_data_smithi121_44835_object87569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T02:16:31.651 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:31.636943+0000", 2024-04-19T02:16:31.652 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0038161969999999999, 2024-04-19T02:16:31.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039645360000000003, 2024-04-19T02:16:31.652 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:31.652 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:31.652 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:31.652 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:31.652 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:31.652 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 87570 2024-04-19T02:16:31.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.652 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:31.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:31.652 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.636943+0000", 2024-04-19T02:16:31.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:31.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.653 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:31.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.636943+0000", 2024-04-19T02:16:31.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:31.653 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.653 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:31.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.636943+0000", 2024-04-19T02:16:31.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:31.653 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.653 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:31.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.637054+0000", 2024-04-19T02:16:31.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000111659 2024-04-19T02:16:31.654 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.654 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.654 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:31.654 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.637067+0000", 2024-04-19T02:16:31.654 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2397e-05 2024-04-19T02:16:31.654 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.654 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.654 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:31.654 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.637074+0000", 2024-04-19T02:16:31.654 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3239999999999997e-06 2024-04-19T02:16:31.654 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.654 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.654 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:31.654 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.637115+0000", 2024-04-19T02:16:31.655 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1066000000000003e-05 2024-04-19T02:16:31.655 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.655 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.655 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:31.655 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.637258+0000", 2024-04-19T02:16:31.655 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014286600000000001 2024-04-19T02:16:31.655 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.655 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.655 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:31.655 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.637421+0000", 2024-04-19T02:16:31.655 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000162647 2024-04-19T02:16:31.655 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:31.655 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:31.655 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:31.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.656 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.656 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4549.0:87569 5.c e33/16 5:3cf03883:::benchmark_data_smithi121_44835_object87568:head v 33'5404, mlcod=33'5402)", 2024-04-19T02:16:31.656 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:31.638182+0000", 2024-04-19T02:16:31.656 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0025774119999999998, 2024-04-19T02:16:31.656 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027680510000000001, 2024-04-19T02:16:31.656 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:31.656 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:16:31.656 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:31.656 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.656 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:31.656 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.638182+0000", 2024-04-19T02:16:31.656 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:31.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.656 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.657 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:31.657 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.638182+0000", 2024-04-19T02:16:31.657 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:31.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.657 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.657 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:31.657 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.638182+0000", 2024-04-19T02:16:31.657 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:31.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.657 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.657 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:31.657 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.638242+0000", 2024-04-19T02:16:31.657 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0618999999999997e-05 2024-04-19T02:16:31.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.657 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.657 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:31.657 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.638253+0000", 2024-04-19T02:16:31.658 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0265000000000001e-05 2024-04-19T02:16:31.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.658 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.658 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:31.658 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.638258+0000", 2024-04-19T02:16:31.658 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8540000000000002e-06 2024-04-19T02:16:31.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.658 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.658 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:31.658 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.638299+0000", 2024-04-19T02:16:31.658 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0865000000000003e-05 2024-04-19T02:16:31.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.658 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.658 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:31.658 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.638319+0000", 2024-04-19T02:16:31.659 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9381e-05 2024-04-19T02:16:31.659 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:31.659 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:31.659 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:31.659 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.659 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.659 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4549.0:87572 5.6 e33/16)", 2024-04-19T02:16:31.659 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:31.638920+0000", 2024-04-19T02:16:31.659 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.001839823, 2024-04-19T02:16:31.659 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020619789999999998, 2024-04-19T02:16:31.659 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:31.659 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-04-19T02:16:31.659 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:31.659 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.660 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:31.660 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.638920+0000", 2024-04-19T02:16:31.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:31.660 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.660 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:31.660 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.638920+0000", 2024-04-19T02:16:31.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:31.660 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.660 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:31.660 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.638919+0000", 2024-04-19T02:16:31.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:31.660 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.661 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:31.661 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.638978+0000", 2024-04-19T02:16:31.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8604000000000003e-05 2024-04-19T02:16:31.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.661 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.661 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:31.661 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.638986+0000", 2024-04-19T02:16:31.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0749999999999998e-06 2024-04-19T02:16:31.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.661 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.661 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:31.661 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.638992+0000", 2024-04-19T02:16:31.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3740000000000003e-06 2024-04-19T02:16:31.661 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:31.661 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:31.661 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:31.662 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.662 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.662 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4549.0:87571 5.1 e33/29 5:899b5313:::benchmark_data_smithi121_44835_object87570:head v 33'5324, mlcod=33'5321)", 2024-04-19T02:16:31.662 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:31.639047+0000", 2024-04-19T02:16:31.662 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0017127209999999999, 2024-04-19T02:16:31.662 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019619569999999999, 2024-04-19T02:16:31.662 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:31.662 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:16:31.662 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:31.662 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.662 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:31.662 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.639047+0000", 2024-04-19T02:16:31.662 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:31.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:31.663 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.639047+0000", 2024-04-19T02:16:31.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:31.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:31.663 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.639046+0000", 2024-04-19T02:16:31.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:31.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:31.663 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.639121+0000", 2024-04-19T02:16:31.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4538999999999999e-05 2024-04-19T02:16:31.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.664 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:31.664 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.639127+0000", 2024-04-19T02:16:31.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2129999999999996e-06 2024-04-19T02:16:31.664 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.664 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.664 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:31.664 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.639132+0000", 2024-04-19T02:16:31.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0000000000000004e-06 2024-04-19T02:16:31.664 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.664 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.664 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:31.664 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.639156+0000", 2024-04-19T02:16:31.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4280000000000001e-05 2024-04-19T02:16:31.664 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.665 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.665 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:31.665 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.639171+0000", 2024-04-19T02:16:31.665 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4398e-05 2024-04-19T02:16:31.665 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:31.665 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:31.665 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:31.665 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.665 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.665 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:87574 5.d 5:bc3b6676:::benchmark_data_smithi121_44835_object87573:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T02:16:31.665 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:31.639390+0000", 2024-04-19T02:16:31.665 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0013694779999999999, 2024-04-19T02:16:31.665 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0016542919999999999, 2024-04-19T02:16:31.665 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:31.665 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:31.666 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:31.666 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:31.666 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:31.666 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 87574 2024-04-19T02:16:31.666 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.666 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:31.666 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.666 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:31.666 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.639390+0000", 2024-04-19T02:16:31.666 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:31.666 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.666 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.666 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:31.666 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.639390+0000", 2024-04-19T02:16:31.667 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:31.667 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.667 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.667 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:31.667 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.639389+0000", 2024-04-19T02:16:31.667 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:31.667 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.667 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.667 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:31.667 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.639497+0000", 2024-04-19T02:16:31.667 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010755 2024-04-19T02:16:31.667 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.667 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.667 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:31.667 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.639507+0000", 2024-04-19T02:16:31.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0462000000000001e-05 2024-04-19T02:16:31.668 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:31.668 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.639515+0000", 2024-04-19T02:16:31.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2709999999999992e-06 2024-04-19T02:16:31.668 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:31.668 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.639562+0000", 2024-04-19T02:16:31.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6201e-05 2024-04-19T02:16:31.668 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:31.668 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.639707+0000", 2024-04-19T02:16:31.669 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014545500000000001 2024-04-19T02:16:31.669 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.669 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.669 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:31.669 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.639860+0000", 2024-04-19T02:16:31.669 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015321900000000001 2024-04-19T02:16:31.669 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:31.669 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:31.669 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:31.669 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.669 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.669 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4549.0:87570 5.f e33/16)", 2024-04-19T02:16:31.669 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:31.640074+0000", 2024-04-19T02:16:31.669 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00068575799999999996, 2024-04-19T02:16:31.669 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001014259, 2024-04-19T02:16:31.670 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:31.670 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-04-19T02:16:31.670 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:31.670 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.670 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:31.670 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.640074+0000", 2024-04-19T02:16:31.670 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:31.670 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.670 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.670 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:31.670 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.640074+0000", 2024-04-19T02:16:31.670 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:31.670 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.670 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.670 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:31.671 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.640073+0000", 2024-04-19T02:16:31.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:31.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.671 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:31.671 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.640077+0000", 2024-04-19T02:16:31.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5470000000000001e-06 2024-04-19T02:16:31.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.671 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:31.671 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.640084+0000", 2024-04-19T02:16:31.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3329999999999999e-06 2024-04-19T02:16:31.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:31.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:31.671 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:31.672 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:31.640089+0000", 2024-04-19T02:16:31.672 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4959999999999998e-06 2024-04-19T02:16:31.672 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:31.672 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:31.672 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:31.672 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:31.672 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-04-19T02:16:31.672 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 9 2024-04-19T02:16:31.672 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:16:31.673 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:16:31.674 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:31.674+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:31.775 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:31.775+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:31.875 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:31.876+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:31.879 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:16:31.879 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-04-19T02:16:31.879 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-04-19T02:16:31.879 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-04-19T02:16:31.879 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:16:31.893 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:16:31.976 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:31.976+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:32.028 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 37 16 88362 88346 149.221 124.062 0.0040448 0.00669869 2024-04-19T02:16:32.076 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:32.077+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:32.100 INFO:teuthology.orchestra.run.smithi121.stderr:nodeep-scrub is set 2024-04-19T02:16:32.111 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:16:32.111 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-04-19T02:16:32.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-04-19T02:16:32.111 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:16:32.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.111 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:32.112 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269684+0000", 2024-04-19T02:16:32.112 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 62.840164213999998, 2024-04-19T02:16:32.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019077493000000001, 2024-04-19T02:16:32.112 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:32.112 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:32.112 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:32.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:32.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269684+0000", 2024-04-19T02:16:32.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:32.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:32.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269684+0000", 2024-04-19T02:16:32.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:32.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:32.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269684+0000", 2024-04-19T02:16:32.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:32.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:32.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269686+0000", 2024-04-19T02:16:32.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2740000000000002e-06 2024-04-19T02:16:32.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:32.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269690+0000", 2024-04-19T02:16:32.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8829999999999999e-06 2024-04-19T02:16:32.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.114 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:32.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269693+0000", 2024-04-19T02:16:32.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4199999999999999e-06 2024-04-19T02:16:32.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.114 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:32.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269875+0000", 2024-04-19T02:16:32.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018114800000000001 2024-04-19T02:16:32.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.114 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:32.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269880+0000", 2024-04-19T02:16:32.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5620000000000003e-06 2024-04-19T02:16:32.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:32.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278610+0000", 2024-04-19T02:16:32.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.008729423 2024-04-19T02:16:32.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:32.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278724+0000", 2024-04-19T02:16:32.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011428400000000001 2024-04-19T02:16:32.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:32.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278860+0000", 2024-04-19T02:16:32.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013601600000000001 2024-04-19T02:16:32.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:32.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282632+0000", 2024-04-19T02:16:32.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037722889999999999 2024-04-19T02:16:32.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:32.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288712+0000", 2024-04-19T02:16:32.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0060799599999999997 2024-04-19T02:16:32.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:32.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288742+0000", 2024-04-19T02:16:32.117 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0048000000000001e-05 2024-04-19T02:16:32.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.117 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:32.117 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288762+0000", 2024-04-19T02:16:32.117 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9482000000000001e-05 2024-04-19T02:16:32.117 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:32.117 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:32.117 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:32.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.117 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:32.117 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269753+0000", 2024-04-19T02:16:32.117 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 62.840094831000002, 2024-04-19T02:16:32.117 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019088755999999998, 2024-04-19T02:16:32.118 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:32.118 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:32.118 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:32.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:32.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269753+0000", 2024-04-19T02:16:32.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:32.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:32.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269753+0000", 2024-04-19T02:16:32.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:32.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:32.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269753+0000", 2024-04-19T02:16:32.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:32.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:32.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269770+0000", 2024-04-19T02:16:32.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7150999999999999e-05 2024-04-19T02:16:32.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:32.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269779+0000", 2024-04-19T02:16:32.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4139999999999994e-06 2024-04-19T02:16:32.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:32.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269786+0000", 2024-04-19T02:16:32.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.537e-06 2024-04-19T02:16:32.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:32.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269913+0000", 2024-04-19T02:16:32.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012699599999999999 2024-04-19T02:16:32.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:32.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269916+0000", 2024-04-19T02:16:32.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9280000000000002e-06 2024-04-19T02:16:32.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:32.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.279143+0000", 2024-04-19T02:16:32.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0092270129999999992 2024-04-19T02:16:32.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:32.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.279223+0000", 2024-04-19T02:16:32.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0050999999999996e-05 2024-04-19T02:16:32.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:32.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.279364+0000", 2024-04-19T02:16:32.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000140934 2024-04-19T02:16:32.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:32.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286189+0000", 2024-04-19T02:16:32.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.006825327 2024-04-19T02:16:32.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:32.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288791+0000", 2024-04-19T02:16:32.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026021500000000001 2024-04-19T02:16:32.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:32.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288822+0000", 2024-04-19T02:16:32.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0162999999999999e-05 2024-04-19T02:16:32.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:32.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288842+0000", 2024-04-19T02:16:32.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0644000000000001e-05 2024-04-19T02:16:32.123 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:32.123 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:32.123 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:32.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.123 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:32.123 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:16:32.123 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 62.840056357000002, 2024-04-19T02:16:32.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020307345000000001, 2024-04-19T02:16:32.123 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:32.124 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:32.124 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:32.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:32.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:16:32.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:32.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:32.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:16:32.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:32.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:32.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269791+0000", 2024-04-19T02:16:32.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:32.125 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.125 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.125 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:32.125 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269795+0000", 2024-04-19T02:16:32.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5619999999999999e-06 2024-04-19T02:16:32.125 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.125 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.125 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:32.125 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269802+0000", 2024-04-19T02:16:32.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8469999999999998e-06 2024-04-19T02:16:32.125 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.125 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.125 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:32.126 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269807+0000", 2024-04-19T02:16:32.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.707e-06 2024-04-19T02:16:32.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.126 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:32.126 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269950+0000", 2024-04-19T02:16:32.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000143313 2024-04-19T02:16:32.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.126 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:32.126 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269955+0000", 2024-04-19T02:16:32.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4029999999999998e-06 2024-04-19T02:16:32.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.126 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:32.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.283806+0000", 2024-04-19T02:16:32.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013850220999999999 2024-04-19T02:16:32.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:32.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.283896+0000", 2024-04-19T02:16:32.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0261999999999997e-05 2024-04-19T02:16:32.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:32.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284022+0000", 2024-04-19T02:16:32.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012641200000000001 2024-04-19T02:16:32.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:32.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289066+0000", 2024-04-19T02:16:32.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050438490000000004 2024-04-19T02:16:32.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:32.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290011+0000", 2024-04-19T02:16:32.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00094490700000000004 2024-04-19T02:16:32.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:32.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290054+0000", 2024-04-19T02:16:32.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.337e-05 2024-04-19T02:16:32.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:32.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290099+0000", 2024-04-19T02:16:32.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4987999999999997e-05 2024-04-19T02:16:32.129 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:32.129 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:32.129 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:32.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.129 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:32.129 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:16:32.129 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 62.839978426999998, 2024-04-19T02:16:32.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020331023, 2024-04-19T02:16:32.129 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:32.129 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:32.129 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:32.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.129 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:32.130 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:16:32.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:32.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.130 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:32.130 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:16:32.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:32.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.130 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:32.130 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269869+0000", 2024-04-19T02:16:32.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:32.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:32.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269873+0000", 2024-04-19T02:16:32.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0219999999999998e-06 2024-04-19T02:16:32.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:32.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269881+0000", 2024-04-19T02:16:32.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.79e-06 2024-04-19T02:16:32.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:32.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269887+0000", 2024-04-19T02:16:32.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7899999999999996e-06 2024-04-19T02:16:32.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.132 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:32.132 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269983+0000", 2024-04-19T02:16:32.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6057000000000005e-05 2024-04-19T02:16:32.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.132 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:32.132 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269986+0000", 2024-04-19T02:16:32.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9220000000000001e-06 2024-04-19T02:16:32.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.132 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:32.132 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284350+0000", 2024-04-19T02:16:32.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014364335000000001 2024-04-19T02:16:32.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.133 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:32.133 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284664+0000", 2024-04-19T02:16:32.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000313646 2024-04-19T02:16:32.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.133 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:32.133 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284794+0000", 2024-04-19T02:16:32.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129839 2024-04-19T02:16:32.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.133 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:32.133 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289107+0000", 2024-04-19T02:16:32.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0043127060000000004 2024-04-19T02:16:32.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:32.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290108+0000", 2024-04-19T02:16:32.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0010010590000000001 2024-04-19T02:16:32.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:32.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290144+0000", 2024-04-19T02:16:32.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6709999999999999e-05 2024-04-19T02:16:32.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:32.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290201+0000", 2024-04-19T02:16:32.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6654999999999999e-05 2024-04-19T02:16:32.134 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:32.135 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:32.135 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:32.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.135 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:32.135 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:16:32.135 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 62.839936086000002, 2024-04-19T02:16:32.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020507241999999998, 2024-04-19T02:16:32.135 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:32.135 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:32.135 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:32.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:32.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:16:32.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:32.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.136 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:32.136 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:16:32.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:32.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.136 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:32.136 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:16:32.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:32.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.136 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:32.136 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269915+0000", 2024-04-19T02:16:32.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.472e-06 2024-04-19T02:16:32.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:32.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269928+0000", 2024-04-19T02:16:32.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2979000000000001e-05 2024-04-19T02:16:32.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:32.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269935+0000", 2024-04-19T02:16:32.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8859999999999998e-06 2024-04-19T02:16:32.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:32.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270009+0000", 2024-04-19T02:16:32.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3429000000000005e-05 2024-04-19T02:16:32.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.138 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:32.138 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270013+0000", 2024-04-19T02:16:32.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2590000000000002e-06 2024-04-19T02:16:32.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.138 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:32.138 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285375+0000", 2024-04-19T02:16:32.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015362275999999999 2024-04-19T02:16:32.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.138 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:32.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285451+0000", 2024-04-19T02:16:32.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5338000000000003e-05 2024-04-19T02:16:32.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:32.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285562+0000", 2024-04-19T02:16:32.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000111285 2024-04-19T02:16:32.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:32.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289134+0000", 2024-04-19T02:16:32.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035719670000000001 2024-04-19T02:16:32.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:32.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290341+0000", 2024-04-19T02:16:32.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012074500000000001 2024-04-19T02:16:32.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:32.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290383+0000", 2024-04-19T02:16:32.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1386e-05 2024-04-19T02:16:32.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:32.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290419+0000", 2024-04-19T02:16:32.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6884000000000001e-05 2024-04-19T02:16:32.140 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:32.140 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:32.140 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:32.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.141 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:32.141 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269945+0000", 2024-04-19T02:16:32.141 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 62.839903503999999, 2024-04-19T02:16:32.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019709098000000001, 2024-04-19T02:16:32.141 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:32.141 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:32.141 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:32.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:32.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269945+0000", 2024-04-19T02:16:32.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:32.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.142 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:32.142 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269945+0000", 2024-04-19T02:16:32.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:32.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.142 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:32.142 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269944+0000", 2024-04-19T02:16:32.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:32.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.142 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:32.142 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269965+0000", 2024-04-19T02:16:32.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0803999999999999e-05 2024-04-19T02:16:32.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.143 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:32.143 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269973+0000", 2024-04-19T02:16:32.143 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3560000000000004e-06 2024-04-19T02:16:32.143 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.143 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.143 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:32.143 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269982+0000", 2024-04-19T02:16:32.143 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9600000000000006e-06 2024-04-19T02:16:32.143 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.143 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.143 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:32.143 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270014+0000", 2024-04-19T02:16:32.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2913000000000001e-05 2024-04-19T02:16:32.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.144 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:32.144 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270018+0000", 2024-04-19T02:16:32.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2200000000000001e-06 2024-04-19T02:16:32.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.144 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:32.144 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278999+0000", 2024-04-19T02:16:32.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0089818009999999993 2024-04-19T02:16:32.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:32.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.279088+0000", 2024-04-19T02:16:32.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8988999999999998e-05 2024-04-19T02:16:32.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:32.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.280160+0000", 2024-04-19T02:16:32.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001071572 2024-04-19T02:16:32.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:32.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288342+0000", 2024-04-19T02:16:32.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.008182468 2024-04-19T02:16:32.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:32.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289545+0000", 2024-04-19T02:16:32.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012026739999999999 2024-04-19T02:16:32.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:32.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289608+0000", 2024-04-19T02:16:32.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2904999999999995e-05 2024-04-19T02:16:32.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:32.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289654+0000", 2024-04-19T02:16:32.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5850000000000003e-05 2024-04-19T02:16:32.147 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:32.147 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:32.147 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:32.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.147 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:32.147 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:16:32.147 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 62.839857825999999, 2024-04-19T02:16:32.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022007204999999998, 2024-04-19T02:16:32.147 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:32.147 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:32.147 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:32.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.147 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:32.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:16:32.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:32.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:32.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:16:32.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:32.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:32.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269990+0000", 2024-04-19T02:16:32.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:32.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:32.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269999+0000", 2024-04-19T02:16:32.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9539999999999993e-06 2024-04-19T02:16:32.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:32.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270006+0000", 2024-04-19T02:16:32.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.216e-06 2024-04-19T02:16:32.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:32.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270012+0000", 2024-04-19T02:16:32.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5049999999999998e-06 2024-04-19T02:16:32.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:32.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270058+0000", 2024-04-19T02:16:32.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.634e-05 2024-04-19T02:16:32.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:32.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270064+0000", 2024-04-19T02:16:32.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0669999999999997e-06 2024-04-19T02:16:32.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:32.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287159+0000", 2024-04-19T02:16:32.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017095086999999998 2024-04-19T02:16:32.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:32.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287254+0000", 2024-04-19T02:16:32.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4716000000000006e-05 2024-04-19T02:16:32.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:32.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287389+0000", 2024-04-19T02:16:32.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013511900000000001 2024-04-19T02:16:32.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:32.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290481+0000", 2024-04-19T02:16:32.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030920169999999999 2024-04-19T02:16:32.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:32.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291931+0000", 2024-04-19T02:16:32.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001450118 2024-04-19T02:16:32.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:32.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291960+0000", 2024-04-19T02:16:32.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9096000000000001e-05 2024-04-19T02:16:32.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:32.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291998+0000", 2024-04-19T02:16:32.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7514e-05 2024-04-19T02:16:32.152 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:32.153 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:32.153 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:32.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.153 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:32.153 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:32.153 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 62.839797255000001, 2024-04-19T02:16:32.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020759494999999999, 2024-04-19T02:16:32.153 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:32.153 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:32.153 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:32.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:32.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:32.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:32.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:32.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:32.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:32.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:32.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:32.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:32.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:32.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270054+0000", 2024-04-19T02:16:32.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.27e-06 2024-04-19T02:16:32.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:32.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270061+0000", 2024-04-19T02:16:32.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1289999999999998e-06 2024-04-19T02:16:32.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:32.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270067+0000", 2024-04-19T02:16:32.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.207e-06 2024-04-19T02:16:32.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:32.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270105+0000", 2024-04-19T02:16:32.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7549999999999998e-05 2024-04-19T02:16:32.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:32.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270112+0000", 2024-04-19T02:16:32.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3200000000000002e-06 2024-04-19T02:16:32.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:32.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282454+0000", 2024-04-19T02:16:32.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012341569 2024-04-19T02:16:32.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:32.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282740+0000", 2024-04-19T02:16:32.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000286481 2024-04-19T02:16:32.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:32.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282879+0000", 2024-04-19T02:16:32.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013887799999999999 2024-04-19T02:16:32.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:32.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290325+0000", 2024-04-19T02:16:32.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074459779999999998 2024-04-19T02:16:32.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:32.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290759+0000", 2024-04-19T02:16:32.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000433688 2024-04-19T02:16:32.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:32.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290789+0000", 2024-04-19T02:16:32.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9960000000000001e-05 2024-04-19T02:16:32.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:32.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290811+0000", 2024-04-19T02:16:32.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1965999999999999e-05 2024-04-19T02:16:32.158 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:32.159 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:32.159 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:32.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.159 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:32.159 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:16:32.159 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 62.83974705, 2024-04-19T02:16:32.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020837887999999999, 2024-04-19T02:16:32.159 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:32.159 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:32.159 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:32.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:32.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:16:32.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:32.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:32.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:16:32.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:32.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:32.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:16:32.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:32.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:32.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270109+0000", 2024-04-19T02:16:32.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3110000000000006e-06 2024-04-19T02:16:32.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:32.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270117+0000", 2024-04-19T02:16:32.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0479999999999999e-06 2024-04-19T02:16:32.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:32.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270123+0000", 2024-04-19T02:16:32.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5500000000000002e-06 2024-04-19T02:16:32.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:32.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270150+0000", 2024-04-19T02:16:32.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7712000000000002e-05 2024-04-19T02:16:32.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:32.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270153+0000", 2024-04-19T02:16:32.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6089999999999999e-06 2024-04-19T02:16:32.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:32.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285958+0000", 2024-04-19T02:16:32.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015805274000000001 2024-04-19T02:16:32.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:32.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286126+0000", 2024-04-19T02:16:32.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016765700000000001 2024-04-19T02:16:32.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:32.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286296+0000", 2024-04-19T02:16:32.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017007 2024-04-19T02:16:32.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:32.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290426+0000", 2024-04-19T02:16:32.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041299839999999997 2024-04-19T02:16:32.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.164 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:32.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290867+0000", 2024-04-19T02:16:32.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00044083300000000001 2024-04-19T02:16:32.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.164 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:32.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290900+0000", 2024-04-19T02:16:32.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3380000000000002e-05 2024-04-19T02:16:32.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.164 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:32.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290939+0000", 2024-04-19T02:16:32.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8970000000000001e-05 2024-04-19T02:16:32.164 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:32.165 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:32.165 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:32.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.165 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:21 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:32.165 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:16:32.165 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 62.839658378000003, 2024-04-19T02:16:32.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020833187999999999, 2024-04-19T02:16:32.165 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:32.165 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:16:32.165 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:32.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:32.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:16:32.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:32.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:32.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:16:32.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:32.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:32.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270189+0000", 2024-04-19T02:16:32.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:32.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:32.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270192+0000", 2024-04-19T02:16:32.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7549999999999999e-06 2024-04-19T02:16:32.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:32.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270198+0000", 2024-04-19T02:16:32.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0859999999999998e-06 2024-04-19T02:16:32.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:32.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270204+0000", 2024-04-19T02:16:32.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1970000000000004e-06 2024-04-19T02:16:32.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:32.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270238+0000", 2024-04-19T02:16:32.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4282000000000001e-05 2024-04-19T02:16:32.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:32.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270240+0000", 2024-04-19T02:16:32.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3099999999999999e-06 2024-04-19T02:16:32.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:32.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287131+0000", 2024-04-19T02:16:32.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01689104 2024-04-19T02:16:32.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:32.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287262+0000", 2024-04-19T02:16:32.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130347 2024-04-19T02:16:32.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:32.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291023+0000", 2024-04-19T02:16:32.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037616350000000002 2024-04-19T02:16:32.171 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:32.171 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:32.171 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:32.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.171 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:2285 5.d 5:b310a433:::benchmark_data_smithi121_44835_object2284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-19T02:16:32.171 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:55.643557+0000", 2024-04-19T02:16:32.172 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 36.466291656000003, 2024-04-19T02:16:32.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018865537000000002, 2024-04-19T02:16:32.172 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:32.172 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:32.172 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:32.172 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:32.172 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:32.172 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 2285 2024-04-19T02:16:32.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.172 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:32.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:32.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643557+0000", 2024-04-19T02:16:32.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:32.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:32.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643557+0000", 2024-04-19T02:16:32.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:32.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:32.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643556+0000", 2024-04-19T02:16:32.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:32.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:32.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643625+0000", 2024-04-19T02:16:32.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9393000000000005e-05 2024-04-19T02:16:32.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.174 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:32.174 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643634+0000", 2024-04-19T02:16:32.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.14e-06 2024-04-19T02:16:32.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.174 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:32.174 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643640+0000", 2024-04-19T02:16:32.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.601e-06 2024-04-19T02:16:32.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.174 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:32.174 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643669+0000", 2024-04-19T02:16:32.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9292999999999999e-05 2024-04-19T02:16:32.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:32.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643760+0000", 2024-04-19T02:16:32.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0526999999999996e-05 2024-04-19T02:16:32.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:32.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.643892+0000", 2024-04-19T02:16:32.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000131607 2024-04-19T02:16:32.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:32.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.649122+0000", 2024-04-19T02:16:32.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052308279999999999 2024-04-19T02:16:32.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:32.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.662321+0000", 2024-04-19T02:16:32.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013198774999999999 2024-04-19T02:16:32.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:32.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.662385+0000", 2024-04-19T02:16:32.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4261e-05 2024-04-19T02:16:32.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:32.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:55.662422+0000", 2024-04-19T02:16:32.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.676e-05 2024-04-19T02:16:32.176 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:32.176 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:32.176 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:32.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.177 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:16494 5.7 5:e2c19dca:::benchmark_data_smithi121_44835_object16493:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:32.177 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.871684+0000", 2024-04-19T02:16:32.177 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.238164722999997, 2024-04-19T02:16:32.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019343257999999999, 2024-04-19T02:16:32.177 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:32.177 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:32.177 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:32.177 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:32.177 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:32.177 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16494 2024-04-19T02:16:32.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.177 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:32.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:32.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871684+0000", 2024-04-19T02:16:32.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:32.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:32.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871684+0000", 2024-04-19T02:16:32.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:32.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:32.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871683+0000", 2024-04-19T02:16:32.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:32.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:32.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871762+0000", 2024-04-19T02:16:32.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8981999999999997e-05 2024-04-19T02:16:32.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:32.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871770+0000", 2024-04-19T02:16:32.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7060000000000004e-06 2024-04-19T02:16:32.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:32.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871776+0000", 2024-04-19T02:16:32.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4880000000000004e-06 2024-04-19T02:16:32.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:32.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.874098+0000", 2024-04-19T02:16:32.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0023215309999999999 2024-04-19T02:16:32.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:32.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.874245+0000", 2024-04-19T02:16:32.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014735599999999999 2024-04-19T02:16:32.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:32.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.874394+0000", 2024-04-19T02:16:32.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014848300000000001 2024-04-19T02:16:32.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:32.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.876474+0000", 2024-04-19T02:16:32.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020803060000000001 2024-04-19T02:16:32.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:32.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.890939+0000", 2024-04-19T02:16:32.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014464985 2024-04-19T02:16:32.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:32.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.890986+0000", 2024-04-19T02:16:32.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7321000000000003e-05 2024-04-19T02:16:32.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:32.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891027+0000", 2024-04-19T02:16:32.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0689999999999998e-05 2024-04-19T02:16:32.182 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:32.182 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:32.182 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:32.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.182 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:16519 5.f 5:fc30d3a1:::benchmark_data_smithi121_44835_object16518:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:32.182 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.880723+0000", 2024-04-19T02:16:32.182 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.229125600000003, 2024-04-19T02:16:32.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020492519000000001, 2024-04-19T02:16:32.183 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:32.183 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:32.183 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:32.183 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:32.183 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:32.183 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16519 2024-04-19T02:16:32.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.183 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:32.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:32.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880723+0000", 2024-04-19T02:16:32.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:32.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:32.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880723+0000", 2024-04-19T02:16:32.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:32.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:32.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880722+0000", 2024-04-19T02:16:32.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:32.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:32.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880794+0000", 2024-04-19T02:16:32.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1515999999999998e-05 2024-04-19T02:16:32.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:32.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880805+0000", 2024-04-19T02:16:32.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1353e-05 2024-04-19T02:16:32.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:32.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880812+0000", 2024-04-19T02:16:32.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1230000000000002e-06 2024-04-19T02:16:32.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:32.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.890954+0000", 2024-04-19T02:16:32.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010142253 2024-04-19T02:16:32.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:32.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891079+0000", 2024-04-19T02:16:32.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000124917 2024-04-19T02:16:32.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:32.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891218+0000", 2024-04-19T02:16:32.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000138715 2024-04-19T02:16:32.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:32.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.897321+0000", 2024-04-19T02:16:32.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0061026830000000002 2024-04-19T02:16:32.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:32.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901137+0000", 2024-04-19T02:16:32.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038161699999999998 2024-04-19T02:16:32.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:32.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901181+0000", 2024-04-19T02:16:32.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4362e-05 2024-04-19T02:16:32.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:32.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901215+0000", 2024-04-19T02:16:32.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3929e-05 2024-04-19T02:16:32.187 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:32.187 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:32.187 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:32.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.188 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:16520 5.f 5:f0474691:::benchmark_data_smithi121_44835_object16519:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:32.188 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.880833+0000", 2024-04-19T02:16:32.188 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.229015584999999, 2024-04-19T02:16:32.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020460160000000002, 2024-04-19T02:16:32.188 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:32.188 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:32.188 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:32.188 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:32.188 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:32.188 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16520 2024-04-19T02:16:32.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.188 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:32.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:32.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880833+0000", 2024-04-19T02:16:32.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:32.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:32.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880833+0000", 2024-04-19T02:16:32.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:32.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:32.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880832+0000", 2024-04-19T02:16:32.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:32.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:32.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880909+0000", 2024-04-19T02:16:32.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7095000000000006e-05 2024-04-19T02:16:32.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:32.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880919+0000", 2024-04-19T02:16:32.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8919999999999995e-06 2024-04-19T02:16:32.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:32.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880927+0000", 2024-04-19T02:16:32.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8809999999999996e-06 2024-04-19T02:16:32.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:32.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891901+0000", 2024-04-19T02:16:32.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010974263999999999 2024-04-19T02:16:32.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:32.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.892021+0000", 2024-04-19T02:16:32.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120074 2024-04-19T02:16:32.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:32.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.892165+0000", 2024-04-19T02:16:32.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014328600000000001 2024-04-19T02:16:32.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:32.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.897347+0000", 2024-04-19T02:16:32.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.005182603 2024-04-19T02:16:32.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:32.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901224+0000", 2024-04-19T02:16:32.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038767620000000002 2024-04-19T02:16:32.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:32.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901264+0000", 2024-04-19T02:16:32.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9579000000000002e-05 2024-04-19T02:16:32.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:32.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901293+0000", 2024-04-19T02:16:32.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9300999999999999e-05 2024-04-19T02:16:32.193 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:32.193 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:32.193 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:32.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.193 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:44167 5.7 5:ef4300c4:::benchmark_data_smithi121_44835_object44166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:32.193 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:09.853830+0000", 2024-04-19T02:16:32.193 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.256018100999999, 2024-04-19T02:16:32.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020082104, 2024-04-19T02:16:32.193 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:32.193 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:32.193 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:32.193 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:32.194 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:32.194 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 44167 2024-04-19T02:16:32.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.194 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:32.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:32.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853830+0000", 2024-04-19T02:16:32.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:32.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:32.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853830+0000", 2024-04-19T02:16:32.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:32.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:32.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853829+0000", 2024-04-19T02:16:32.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:32.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:32.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853863+0000", 2024-04-19T02:16:32.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3151999999999997e-05 2024-04-19T02:16:32.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:32.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853873+0000", 2024-04-19T02:16:32.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0366e-05 2024-04-19T02:16:32.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:32.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853881+0000", 2024-04-19T02:16:32.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6539999999999999e-06 2024-04-19T02:16:32.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:32.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.859162+0000", 2024-04-19T02:16:32.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052810740000000002 2024-04-19T02:16:32.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:32.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.859303+0000", 2024-04-19T02:16:32.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000140975 2024-04-19T02:16:32.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:32.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.859460+0000", 2024-04-19T02:16:32.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015754199999999999 2024-04-19T02:16:32.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:32.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.865142+0000", 2024-04-19T02:16:32.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0056819130000000002 2024-04-19T02:16:32.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:32.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.873828+0000", 2024-04-19T02:16:32.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0086861799999999999 2024-04-19T02:16:32.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:32.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.873871+0000", 2024-04-19T02:16:32.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2624999999999999e-05 2024-04-19T02:16:32.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:32.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.873912+0000", 2024-04-19T02:16:32.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1486000000000002e-05 2024-04-19T02:16:32.198 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:32.198 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:32.198 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:32.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.198 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:53042 5.f 5:f744ac14:::benchmark_data_smithi121_44835_object53041:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T02:16:32.199 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:13.560196+0000", 2024-04-19T02:16:32.199 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.549652282, 2024-04-19T02:16:32.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020122021, 2024-04-19T02:16:32.199 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:32.199 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:32.199 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:32.199 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:32.199 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:32.199 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 53042 2024-04-19T02:16:32.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.199 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:32.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:32.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560196+0000", 2024-04-19T02:16:32.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:32.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:32.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560196+0000", 2024-04-19T02:16:32.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:32.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:32.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560195+0000", 2024-04-19T02:16:32.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:32.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:32.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560255+0000", 2024-04-19T02:16:32.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9441000000000002e-05 2024-04-19T02:16:32.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:32.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560264+0000", 2024-04-19T02:16:32.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1130000000000007e-06 2024-04-19T02:16:32.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:32.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560271+0000", 2024-04-19T02:16:32.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9800000000000001e-06 2024-04-19T02:16:32.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:32.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560312+0000", 2024-04-19T02:16:32.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0828999999999998e-05 2024-04-19T02:16:32.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:32.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560456+0000", 2024-04-19T02:16:32.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014474799999999999 2024-04-19T02:16:32.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:32.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560591+0000", 2024-04-19T02:16:32.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013482699999999999 2024-04-19T02:16:32.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:32.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.564799+0000", 2024-04-19T02:16:32.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042080080000000001 2024-04-19T02:16:32.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:32.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580233+0000", 2024-04-19T02:16:32.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015433715000000001 2024-04-19T02:16:32.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:32.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580280+0000", 2024-04-19T02:16:32.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6465000000000003e-05 2024-04-19T02:16:32.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:32.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580318+0000", 2024-04-19T02:16:32.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8557999999999999e-05 2024-04-19T02:16:32.204 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:32.204 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:32.204 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:32.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.204 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:53044 5.7 5:ec8fd8f2:::benchmark_data_smithi121_44835_object53043:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T02:16:32.204 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:13.561281+0000", 2024-04-19T02:16:32.204 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.548567080000002, 2024-04-19T02:16:32.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019133752, 2024-04-19T02:16:32.204 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:32.204 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:32.204 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:32.204 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:32.204 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:32.204 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 53044 2024-04-19T02:16:32.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.205 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:32.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:32.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.561281+0000", 2024-04-19T02:16:32.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:32.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:32.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.561281+0000", 2024-04-19T02:16:32.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:32.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:32.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.561270+0000", 2024-04-19T02:16:32.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999886 2024-04-19T02:16:32.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:32.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.561364+0000", 2024-04-19T02:16:32.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4721000000000003e-05 2024-04-19T02:16:32.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:32.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.561375+0000", 2024-04-19T02:16:32.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0900999999999999e-05 2024-04-19T02:16:32.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:32.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.561383+0000", 2024-04-19T02:16:32.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5460000000000003e-06 2024-04-19T02:16:32.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:32.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.562716+0000", 2024-04-19T02:16:32.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001333592 2024-04-19T02:16:32.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:32.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.562831+0000", 2024-04-19T02:16:32.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000114585 2024-04-19T02:16:32.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:32.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.562984+0000", 2024-04-19T02:16:32.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000152724 2024-04-19T02:16:32.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:32.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.571517+0000", 2024-04-19T02:16:32.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0085335199999999993 2024-04-19T02:16:32.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:32.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580332+0000", 2024-04-19T02:16:32.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0088147859999999998 2024-04-19T02:16:32.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:32.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580377+0000", 2024-04-19T02:16:32.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5293000000000002e-05 2024-04-19T02:16:32.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:32.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580415+0000", 2024-04-19T02:16:32.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7756999999999998e-05 2024-04-19T02:16:32.209 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:32.209 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:32.209 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:32.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.209 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:65494 5.2 5:4db622bd:::benchmark_data_smithi121_44835_object65493:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:32.209 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:19.159347+0000", 2024-04-19T02:16:32.209 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 12.950501147000001, 2024-04-19T02:16:32.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018998787999999999, 2024-04-19T02:16:32.210 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:32.210 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:32.210 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:32.210 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:32.210 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:32.210 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 65494 2024-04-19T02:16:32.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.210 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:32.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:32.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:19.159347+0000", 2024-04-19T02:16:32.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:32.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:32.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:19.159347+0000", 2024-04-19T02:16:32.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:32.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:32.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:19.159346+0000", 2024-04-19T02:16:32.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:32.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:32.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:19.159415+0000", 2024-04-19T02:16:32.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8224000000000003e-05 2024-04-19T02:16:32.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:32.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:19.159425+0000", 2024-04-19T02:16:32.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0311e-05 2024-04-19T02:16:32.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:32.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:19.159432+0000", 2024-04-19T02:16:32.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.374e-06 2024-04-19T02:16:32.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:32.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:19.161543+0000", 2024-04-19T02:16:32.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021110790000000001 2024-04-19T02:16:32.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:32.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:19.161677+0000", 2024-04-19T02:16:32.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013341000000000001 2024-04-19T02:16:32.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:32.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:19.161779+0000", 2024-04-19T02:16:32.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102427 2024-04-19T02:16:32.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:32.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:19.166040+0000", 2024-04-19T02:16:32.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042609259999999999 2024-04-19T02:16:32.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:32.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:19.178287+0000", 2024-04-19T02:16:32.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012247348 2024-04-19T02:16:32.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:32.214 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:19.178320+0000", 2024-04-19T02:16:32.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2464e-05 2024-04-19T02:16:32.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:32.214 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:19.178346+0000", 2024-04-19T02:16:32.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6072999999999999e-05 2024-04-19T02:16:32.214 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:32.214 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:32.214 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:32.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.215 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:79057 5.2 5:4990ff39:::benchmark_data_smithi121_44835_object79056:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:32.215 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:27.522643+0000", 2024-04-19T02:16:32.215 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.5872057809999998, 2024-04-19T02:16:32.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019061741, 2024-04-19T02:16:32.215 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:32.215 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:32.215 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:32.215 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:32.215 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:32.215 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 79057 2024-04-19T02:16:32.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.215 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:32.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:32.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.522643+0000", 2024-04-19T02:16:32.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:32.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:32.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.522643+0000", 2024-04-19T02:16:32.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:32.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:32.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.522642+0000", 2024-04-19T02:16:32.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:32.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:32.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.522704+0000", 2024-04-19T02:16:32.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2681999999999994e-05 2024-04-19T02:16:32.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:32.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.522712+0000", 2024-04-19T02:16:32.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3300000000000001e-06 2024-04-19T02:16:32.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:32.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.522717+0000", 2024-04-19T02:16:32.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8550000000000001e-06 2024-04-19T02:16:32.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:32.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.527576+0000", 2024-04-19T02:16:32.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0048591219999999996 2024-04-19T02:16:32.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:32.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.527687+0000", 2024-04-19T02:16:32.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000111195 2024-04-19T02:16:32.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:32.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.527824+0000", 2024-04-19T02:16:32.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013702699999999999 2024-04-19T02:16:32.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:32.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.531409+0000", 2024-04-19T02:16:32.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035849229999999998 2024-04-19T02:16:32.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:32.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.541654+0000", 2024-04-19T02:16:32.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010245532 2024-04-19T02:16:32.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:32.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.541683+0000", 2024-04-19T02:16:32.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8481999999999999e-05 2024-04-19T02:16:32.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:32.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:27.541704+0000", 2024-04-19T02:16:32.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1362999999999999e-05 2024-04-19T02:16:32.220 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:32.220 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:32.220 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:32.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.220 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:85866 5.2 5:48b1d46d:::benchmark_data_smithi121_44835_object85865:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T02:16:32.220 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:30.771909+0000", 2024-04-19T02:16:32.220 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.3379390099999999, 2024-04-19T02:16:32.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020516216, 2024-04-19T02:16:32.220 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:32.220 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:32.220 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:32.221 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:32.221 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:32.221 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 85866 2024-04-19T02:16:32.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.221 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:32.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:32.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771909+0000", 2024-04-19T02:16:32.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:32.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:32.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771909+0000", 2024-04-19T02:16:32.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:32.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:32.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771909+0000", 2024-04-19T02:16:32.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:32.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:32.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771952+0000", 2024-04-19T02:16:32.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2660000000000002e-05 2024-04-19T02:16:32.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:32.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771959+0000", 2024-04-19T02:16:32.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7670000000000003e-06 2024-04-19T02:16:32.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.223 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:32.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771966+0000", 2024-04-19T02:16:32.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.905e-06 2024-04-19T02:16:32.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.223 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:32.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771999+0000", 2024-04-19T02:16:32.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2360999999999997e-05 2024-04-19T02:16:32.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.223 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:32.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.772133+0000", 2024-04-19T02:16:32.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013398699999999999 2024-04-19T02:16:32.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:32.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.772280+0000", 2024-04-19T02:16:32.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000147198 2024-04-19T02:16:32.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:32.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.774312+0000", 2024-04-19T02:16:32.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020325339999999999 2024-04-19T02:16:32.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:32.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.792370+0000", 2024-04-19T02:16:32.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018057321000000001 2024-04-19T02:16:32.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:32.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.792403+0000", 2024-04-19T02:16:32.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3247000000000002e-05 2024-04-19T02:16:32.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:32.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:32.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:32.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.792426+0000", 2024-04-19T02:16:32.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2697999999999999e-05 2024-04-19T02:16:32.225 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:32.225 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:32.225 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:32.225 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:32.225 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:32.226 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:16:32.227 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:32.227+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:32.228 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:16:32.328 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:32.328+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:32.399 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:16:32.399 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:16:32.400 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.400 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:89109 5.4 5:22a48ae8:::benchmark_data_smithi121_44835_object89108:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T02:16:32.400 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:32.392988+0000", 2024-04-19T02:16:32.400 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0073707360000000001, 2024-04-19T02:16:32.400 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0073908929999999999, 2024-04-19T02:16:32.400 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:32.400 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:32.400 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:32.400 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:32.400 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:32.400 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 89109 2024-04-19T02:16:32.400 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.400 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:32.400 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.401 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:32.401 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:32.392988+0000", 2024-04-19T02:16:32.401 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:32.401 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.401 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.401 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:32.401 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:32.392988+0000", 2024-04-19T02:16:32.401 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:32.401 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.401 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.401 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:32.401 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:32.392987+0000", 2024-04-19T02:16:32.401 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:32.401 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.401 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.402 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:32.402 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:32.393094+0000", 2024-04-19T02:16:32.402 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000106531 2024-04-19T02:16:32.402 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.402 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.402 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:32.402 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:32.393103+0000", 2024-04-19T02:16:32.402 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.1800000000000002e-06 2024-04-19T02:16:32.402 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.402 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.402 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:32.402 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:32.393110+0000", 2024-04-19T02:16:32.402 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.0190000000000001e-06 2024-04-19T02:16:32.402 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.403 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.403 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:32.403 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:32.393147+0000", 2024-04-19T02:16:32.403 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7174e-05 2024-04-19T02:16:32.403 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.403 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.403 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:32.403 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:32.393278+0000", 2024-04-19T02:16:32.403 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000130529 2024-04-19T02:16:32.403 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.403 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.403 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:32.403 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:32.393430+0000", 2024-04-19T02:16:32.403 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00015221700000000001 2024-04-19T02:16:32.403 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.404 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.404 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:32.404 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:32.398331+0000", 2024-04-19T02:16:32.404 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0049015830000000002 2024-04-19T02:16:32.404 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:32.404 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:32.404 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:32.404 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.404 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.404 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:89111 5.e 5:758d7080:::benchmark_data_smithi121_44835_object89110:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T02:16:32.404 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:32.394153+0000", 2024-04-19T02:16:32.404 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.006205739, 2024-04-19T02:16:32.404 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0062803809999999998, 2024-04-19T02:16:32.404 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:32.404 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:32.405 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:32.405 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:32.405 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:32.405 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 89111 2024-04-19T02:16:32.405 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.405 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:32.405 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.405 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:32.405 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:32.394153+0000", 2024-04-19T02:16:32.405 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:32.405 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.405 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.405 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:32.405 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:32.394153+0000", 2024-04-19T02:16:32.405 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:32.406 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.406 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.406 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:32.406 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:32.394152+0000", 2024-04-19T02:16:32.406 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:32.406 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.406 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.406 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:32.406 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:32.394205+0000", 2024-04-19T02:16:32.406 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2760000000000003e-05 2024-04-19T02:16:32.406 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.406 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.406 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:32.406 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:32.394213+0000", 2024-04-19T02:16:32.407 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.1049999999999995e-06 2024-04-19T02:16:32.407 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.407 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.407 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:32.407 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:32.394218+0000", 2024-04-19T02:16:32.407 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.1139999999999997e-06 2024-04-19T02:16:32.407 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.407 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.407 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:32.407 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:32.394251+0000", 2024-04-19T02:16:32.407 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2178999999999998e-05 2024-04-19T02:16:32.407 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.407 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.407 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:32.407 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:32.394343+0000", 2024-04-19T02:16:32.408 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2349999999999995e-05 2024-04-19T02:16:32.408 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.408 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.408 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:32.408 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:32.394431+0000", 2024-04-19T02:16:32.408 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.8434000000000001e-05 2024-04-19T02:16:32.408 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.408 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.408 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:32.408 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:32.398728+0000", 2024-04-19T02:16:32.408 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0042967370000000001 2024-04-19T02:16:32.408 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:32.408 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:32.408 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:32.408 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.408 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.409 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:89115 5.4 5:2fdc7463:::benchmark_data_smithi121_44835_object89114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T02:16:32.409 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:32.395607+0000", 2024-04-19T02:16:32.409 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0047515500000000002, 2024-04-19T02:16:32.409 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.004874878, 2024-04-19T02:16:32.409 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:32.409 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:32.409 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:32.409 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:32.409 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:32.409 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 89115 2024-04-19T02:16:32.409 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.409 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:32.409 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.409 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:32.409 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:32.395607+0000", 2024-04-19T02:16:32.410 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:32.410 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.410 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.410 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:32.410 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:32.395607+0000", 2024-04-19T02:16:32.410 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:32.410 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.410 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.410 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:32.410 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:32.395607+0000", 2024-04-19T02:16:32.410 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:32.410 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.410 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.410 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:32.411 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:32.395700+0000", 2024-04-19T02:16:32.411 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3381000000000006e-05 2024-04-19T02:16:32.411 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.411 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.411 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:32.411 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:32.395717+0000", 2024-04-19T02:16:32.411 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.6588000000000001e-05 2024-04-19T02:16:32.411 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.411 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.411 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:32.411 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:32.395722+0000", 2024-04-19T02:16:32.411 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.3480000000000003e-06 2024-04-19T02:16:32.411 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.411 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.411 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:32.412 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:32.395759+0000", 2024-04-19T02:16:32.412 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6949999999999997e-05 2024-04-19T02:16:32.412 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.412 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.412 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:32.412 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:32.395887+0000", 2024-04-19T02:16:32.412 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012829900000000001 2024-04-19T02:16:32.412 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.412 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.412 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:32.412 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:32.396033+0000", 2024-04-19T02:16:32.412 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000145351 2024-04-19T02:16:32.412 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.412 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.412 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:32.413 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:32.398764+0000", 2024-04-19T02:16:32.413 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0027319050000000002 2024-04-19T02:16:32.413 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:32.413 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:32.413 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:32.413 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.413 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.413 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:89116 5.e 5:7fc01f22:::benchmark_data_smithi121_44835_object89115:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T02:16:32.413 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:32.396695+0000", 2024-04-19T02:16:32.413 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0036634509999999999, 2024-04-19T02:16:32.413 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.003841733, 2024-04-19T02:16:32.413 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:32.413 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:32.413 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:32.413 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:32.414 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:32.414 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 89116 2024-04-19T02:16:32.414 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.414 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:32.414 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.414 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:32.414 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:32.396695+0000", 2024-04-19T02:16:32.414 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:32.414 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.414 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.414 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:32.414 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:32.396695+0000", 2024-04-19T02:16:32.414 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:32.414 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.414 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.415 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:32.415 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:32.396695+0000", 2024-04-19T02:16:32.415 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:32.415 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.415 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.415 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:32.415 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:32.396751+0000", 2024-04-19T02:16:32.415 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.6119000000000003e-05 2024-04-19T02:16:32.415 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.415 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.415 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:32.415 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:32.396760+0000", 2024-04-19T02:16:32.415 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.4110000000000002e-06 2024-04-19T02:16:32.415 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.415 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.415 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:32.416 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:32.396765+0000", 2024-04-19T02:16:32.416 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0649999999999998e-06 2024-04-19T02:16:32.416 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.416 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.416 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:32.416 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:32.396792+0000", 2024-04-19T02:16:32.416 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.6645e-05 2024-04-19T02:16:32.416 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.416 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.416 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:32.416 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:32.396870+0000", 2024-04-19T02:16:32.416 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.7569000000000002e-05 2024-04-19T02:16:32.416 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.416 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.416 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:32.417 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:32.396956+0000", 2024-04-19T02:16:32.417 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.6903999999999993e-05 2024-04-19T02:16:32.417 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.417 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.417 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:32.417 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:32.398791+0000", 2024-04-19T02:16:32.417 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0018348629999999999 2024-04-19T02:16:32.417 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:32.417 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:32.417 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:32.417 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.417 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.417 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:89121 5.8 5:1c5c1fcc:::benchmark_data_smithi121_44835_object89120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T02:16:32.417 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:32.398125+0000", 2024-04-19T02:16:32.417 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0022343039999999999, 2024-04-19T02:16:32.417 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0024763070000000001, 2024-04-19T02:16:32.418 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:32.418 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:32.418 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:32.418 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:32.418 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:32.418 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 89121 2024-04-19T02:16:32.418 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.418 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:32.418 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.418 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:32.418 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:32.398125+0000", 2024-04-19T02:16:32.418 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:32.418 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.418 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.418 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:32.419 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:32.398125+0000", 2024-04-19T02:16:32.419 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:32.419 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.419 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.419 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:32.419 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:32.398124+0000", 2024-04-19T02:16:32.419 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:32.419 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.419 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.419 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:32.419 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:32.398200+0000", 2024-04-19T02:16:32.419 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.6091e-05 2024-04-19T02:16:32.419 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.419 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.419 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:32.420 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:32.398208+0000", 2024-04-19T02:16:32.420 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2300000000000008e-06 2024-04-19T02:16:32.420 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.420 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.420 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:32.420 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:32.398213+0000", 2024-04-19T02:16:32.420 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2769999999999996e-06 2024-04-19T02:16:32.420 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.420 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.420 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:32.420 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:32.398264+0000", 2024-04-19T02:16:32.420 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0587999999999997e-05 2024-04-19T02:16:32.420 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.420 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.420 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:32.420 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:32.398401+0000", 2024-04-19T02:16:32.421 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013658400000000001 2024-04-19T02:16:32.421 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.421 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.421 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:32.421 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:32.398552+0000", 2024-04-19T02:16:32.421 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00015157199999999999 2024-04-19T02:16:32.421 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:32.421 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:32.421 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:32.421 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:32.400559+0000", 2024-04-19T02:16:32.421 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0020071009999999999 2024-04-19T02:16:32.421 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:32.421 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:32.421 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:32.421 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:32.421 INFO:teuthology.orchestra.run.smithi174.stdout: ], 2024-04-19T02:16:32.422 INFO:teuthology.orchestra.run.smithi174.stdout: "num_ops": 5 2024-04-19T02:16:32.422 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:16:32.423 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:16:32.428 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:32.428+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:32.470 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:16:32.529 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:32.529+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:32.619 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:16:32.629 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:32.629+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:32.638 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:16:32.639 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:32.639 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:32.653 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:16:32.658 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2: {} 2024-04-19T02:16:32.659 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:16:32.659 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:16:32.659 INFO:teuthology.orchestra.run.smithi121.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:16:32.730 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:32.730+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:32.823 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:32.823 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:32.831 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:32.832+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:32.837 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:16:32.932 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:32.933+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:33.028 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 38 16 90417 90401 148.674 128.438 0.00720884 0.00672325 2024-04-19T02:16:33.033 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:33.034+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:33.041 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:33.041 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:33.056 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:16:33.134 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:33.135+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:33.235 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:33.236+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:33.279 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:33.280 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:33.296 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:16:33.336 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:33.336+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:33.437 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:33.437+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:33.526 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:33.526 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:33.537 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:33.537+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:33.540 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:16:33.639 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:33.639+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:33.704 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:33.704 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:33.718 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:16:33.761 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:33.761+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:33.841 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:33.841+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:33.887 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:33.888 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:33.903 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:16:33.941 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:33.942+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:34.028 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 39 16 92388 92372 148.02 123.188 0.00292603 0.00675334 2024-04-19T02:16:34.042 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:34.042+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:34.103 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-19T02:16:34.103 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-19T02:16:34.114 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:34.114 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:34.129 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:16:34.143 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:34.143+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:34.229 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T02:16:34.244 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:34.244+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:34.302 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:34.302 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:34.316 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:16:34.345 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:34.346+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:34.446 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:34.446+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:34.491 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:34.492 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:34.507 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:16:34.549 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:34.549+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:34.671 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:16:34.690 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:34.649+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:34.699 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:34.699 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:34.709 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:16:34.750 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:34.750+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:34.817 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:16:34.838 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:16:34.851 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:34.852+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:34.858 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2: {} 2024-04-19T02:16:34.859 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:16:34.859 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:16:34.860 INFO:teuthology.orchestra.run.smithi121.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:16:34.900 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-04-19T02:16:34.901 INFO:teuthology.orchestra.run.smithi177.stdout: "ops": [ 2024-04-19T02:16:34.901 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.901 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:94051 5.a 5:5e348402:::benchmark_data_smithi121_44835_object94050:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T02:16:34.901 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:34.891389+0000", 2024-04-19T02:16:34.901 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0095521270000000005, 2024-04-19T02:16:34.901 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0095841569999999994, 2024-04-19T02:16:34.901 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:34.901 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:34.901 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:34.901 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:34.901 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:34.901 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 94051 2024-04-19T02:16:34.901 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.902 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:34.902 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.902 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:34.902 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.891389+0000", 2024-04-19T02:16:34.902 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:34.902 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.902 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.902 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:34.902 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.891389+0000", 2024-04-19T02:16:34.902 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:34.902 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.902 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.902 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:34.902 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.891388+0000", 2024-04-19T02:16:34.903 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:34.903 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.903 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.903 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:34.903 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.891452+0000", 2024-04-19T02:16:34.903 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.3763999999999995e-05 2024-04-19T02:16:34.903 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.903 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.903 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:34.903 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.891474+0000", 2024-04-19T02:16:34.903 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.2195999999999999e-05 2024-04-19T02:16:34.903 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.903 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.903 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:34.903 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.891482+0000", 2024-04-19T02:16:34.904 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.7579999999999992e-06 2024-04-19T02:16:34.904 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.904 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.904 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:34.904 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.895784+0000", 2024-04-19T02:16:34.904 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0043023460000000003 2024-04-19T02:16:34.904 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.904 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.904 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:34.904 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.895903+0000", 2024-04-19T02:16:34.904 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00011817800000000001 2024-04-19T02:16:34.904 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.904 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.904 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:34.905 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.896049+0000", 2024-04-19T02:16:34.905 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00014669699999999999 2024-04-19T02:16:34.905 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.905 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.905 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:34.905 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.898873+0000", 2024-04-19T02:16:34.905 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0028242390000000001 2024-04-19T02:16:34.905 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:34.905 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:34.905 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:34.905 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.905 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.905 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:94056 5.1 5:81dfa11f:::benchmark_data_smithi121_44835_object94055:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T02:16:34.905 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:34.893328+0000", 2024-04-19T02:16:34.905 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0076131460000000003, 2024-04-19T02:16:34.906 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0077421529999999999, 2024-04-19T02:16:34.906 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:34.906 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:34.906 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:34.906 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:34.906 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:34.906 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 94056 2024-04-19T02:16:34.906 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.906 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:34.906 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.907 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:34.907 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.893328+0000", 2024-04-19T02:16:34.907 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:34.907 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.907 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.907 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:34.907 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.893328+0000", 2024-04-19T02:16:34.907 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:34.907 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.907 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.907 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:34.907 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.893328+0000", 2024-04-19T02:16:34.907 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:34.907 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.907 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.908 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:34.908 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.893354+0000", 2024-04-19T02:16:34.908 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.6767e-05 2024-04-19T02:16:34.908 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.908 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.908 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:34.908 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.893359+0000", 2024-04-19T02:16:34.908 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.95e-06 2024-04-19T02:16:34.908 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.908 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.908 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:34.908 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.893364+0000", 2024-04-19T02:16:34.908 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.9269999999999996e-06 2024-04-19T02:16:34.908 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.908 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.909 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:34.909 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.893424+0000", 2024-04-19T02:16:34.909 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.9713000000000002e-05 2024-04-19T02:16:34.909 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.909 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.909 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:34.909 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.893545+0000", 2024-04-19T02:16:34.909 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000120875 2024-04-19T02:16:34.909 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.909 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.909 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:34.909 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.893696+0000", 2024-04-19T02:16:34.909 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00015091700000000001 2024-04-19T02:16:34.909 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.909 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.910 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:34.910 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.896750+0000", 2024-04-19T02:16:34.910 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.003054087 2024-04-19T02:16:34.910 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.910 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.910 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:34.910 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.898612+0000", 2024-04-19T02:16:34.910 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0018618949999999999 2024-04-19T02:16:34.910 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:34.910 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:34.910 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:34.910 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.910 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.910 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:94058 5.e e34/16 5:734a1257:::benchmark_data_smithi121_44835_object94057:head v 34'5833, mlcod=34'5830)", 2024-04-19T02:16:34.911 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:34.897813+0000", 2024-04-19T02:16:34.911 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0031283639999999998, 2024-04-19T02:16:34.911 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0033254719999999999, 2024-04-19T02:16:34.911 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:34.911 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:34.911 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:34.911 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.911 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:34.912 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.897813+0000", 2024-04-19T02:16:34.912 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:34.912 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.912 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.912 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:34.912 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.897813+0000", 2024-04-19T02:16:34.912 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:34.912 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.912 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.912 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:34.912 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.897812+0000", 2024-04-19T02:16:34.912 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:34.912 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.912 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.912 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:34.913 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.897879+0000", 2024-04-19T02:16:34.913 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.6381e-05 2024-04-19T02:16:34.913 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.913 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.913 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:34.913 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.897886+0000", 2024-04-19T02:16:34.913 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.1690000000000003e-06 2024-04-19T02:16:34.913 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.913 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.913 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:34.913 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.897891+0000", 2024-04-19T02:16:34.913 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.1580000000000004e-06 2024-04-19T02:16:34.913 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.913 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.913 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:34.914 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.897922+0000", 2024-04-19T02:16:34.914 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.0973000000000003e-05 2024-04-19T02:16:34.914 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.914 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.914 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:34.914 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.897935+0000", 2024-04-19T02:16:34.914 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.2398000000000001e-05 2024-04-19T02:16:34.914 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:34.914 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:34.914 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:34.914 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.914 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.914 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:94061 5.c 5:3a101f03:::benchmark_data_smithi121_44835_object94060:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T02:16:34.914 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:34.898890+0000", 2024-04-19T02:16:34.915 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.002051415, 2024-04-19T02:16:34.915 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0022857419999999999, 2024-04-19T02:16:34.915 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:34.915 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:34.915 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:34.915 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:34.915 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:34.915 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 94061 2024-04-19T02:16:34.915 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.915 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:34.915 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.915 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:34.915 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.898890+0000", 2024-04-19T02:16:34.915 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:34.915 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.916 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.916 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:34.916 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.898890+0000", 2024-04-19T02:16:34.916 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:34.916 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.916 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.916 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:34.916 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.898889+0000", 2024-04-19T02:16:34.916 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:34.916 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.916 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.916 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:34.916 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.898995+0000", 2024-04-19T02:16:34.916 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000106121 2024-04-19T02:16:34.916 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.917 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.917 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:34.917 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.899005+0000", 2024-04-19T02:16:34.917 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.5449999999999992e-06 2024-04-19T02:16:34.917 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.917 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.917 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:34.917 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.899013+0000", 2024-04-19T02:16:34.917 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.6589999999999996e-06 2024-04-19T02:16:34.917 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.917 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.917 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:34.917 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.899053+0000", 2024-04-19T02:16:34.917 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.0006999999999998e-05 2024-04-19T02:16:34.917 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.917 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.918 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:34.918 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.899185+0000", 2024-04-19T02:16:34.918 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00013135499999999999 2024-04-19T02:16:34.918 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.918 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.918 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:34.918 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.899342+0000", 2024-04-19T02:16:34.918 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00015732699999999999 2024-04-19T02:16:34.918 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:34.918 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:34.918 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:34.918 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.918 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.918 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:94063 5.1 5:83d90621:::benchmark_data_smithi121_44835_object94062:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T02:16:34.919 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:34.899023+0000", 2024-04-19T02:16:34.919 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.001917925, 2024-04-19T02:16:34.919 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.002195238, 2024-04-19T02:16:34.919 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:34.919 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:34.919 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:34.919 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:34.919 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:34.919 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 94063 2024-04-19T02:16:34.919 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.919 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:34.919 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.919 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:34.919 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.899023+0000", 2024-04-19T02:16:34.919 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:34.920 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.920 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.920 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:34.920 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.899023+0000", 2024-04-19T02:16:34.920 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:34.920 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.920 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.920 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:34.920 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.899023+0000", 2024-04-19T02:16:34.920 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:34.920 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.920 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.920 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:34.920 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.899047+0000", 2024-04-19T02:16:34.920 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.4219e-05 2024-04-19T02:16:34.920 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.921 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.921 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:34.921 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.899053+0000", 2024-04-19T02:16:34.921 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.2199999999999997e-06 2024-04-19T02:16:34.921 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.921 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.921 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:34.921 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.899057+0000", 2024-04-19T02:16:34.921 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.743e-06 2024-04-19T02:16:34.921 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.922 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.922 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:34.922 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.899087+0000", 2024-04-19T02:16:34.922 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.0448000000000001e-05 2024-04-19T02:16:34.922 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.922 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.922 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:34.922 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.899185+0000", 2024-04-19T02:16:34.922 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.7388999999999999e-05 2024-04-19T02:16:34.922 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.922 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.922 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:34.922 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.899343+0000", 2024-04-19T02:16:34.922 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000158472 2024-04-19T02:16:34.923 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:34.923 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:34.923 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:34.923 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.923 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.923 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:94062 5.7 e34/16 5:e7d9a010:::benchmark_data_smithi121_44835_object94061:head v 34'5904, mlcod=34'5902)", 2024-04-19T02:16:34.923 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:34.899301+0000", 2024-04-19T02:16:34.923 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0016399819999999999, 2024-04-19T02:16:34.923 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0019578429999999999, 2024-04-19T02:16:34.923 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:34.923 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:34.923 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:34.923 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.923 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:34.923 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.899301+0000", 2024-04-19T02:16:34.924 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:34.924 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.924 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.924 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:34.924 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.899301+0000", 2024-04-19T02:16:34.924 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:34.924 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.924 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.924 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:34.924 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.899301+0000", 2024-04-19T02:16:34.924 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:34.924 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.924 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.924 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:34.924 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.899363+0000", 2024-04-19T02:16:34.925 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.1896999999999994e-05 2024-04-19T02:16:34.925 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.925 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.925 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:34.925 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.899369+0000", 2024-04-19T02:16:34.925 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.348e-06 2024-04-19T02:16:34.925 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.925 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.925 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:34.925 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.899374+0000", 2024-04-19T02:16:34.925 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.2850000000000002e-06 2024-04-19T02:16:34.925 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.925 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.925 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:34.925 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.899405+0000", 2024-04-19T02:16:34.926 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.1337000000000002e-05 2024-04-19T02:16:34.926 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.926 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.926 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:34.927 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.899428+0000", 2024-04-19T02:16:34.927 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.2237000000000001e-05 2024-04-19T02:16:34.927 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:34.927 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:34.927 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:34.927 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.927 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.927 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:94060 5.b e34/16 5:d9429466:::benchmark_data_smithi121_44835_object94059:head v 34'5830, mlcod=34'5827)", 2024-04-19T02:16:34.927 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:34.899723+0000", 2024-04-19T02:16:34.927 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0012180190000000001, 2024-04-19T02:16:34.927 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.001569286, 2024-04-19T02:16:34.927 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:34.928 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:34.928 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:34.928 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.928 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:34.928 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.899723+0000", 2024-04-19T02:16:34.928 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:34.928 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.928 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.928 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:34.928 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.899723+0000", 2024-04-19T02:16:34.928 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:34.928 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.928 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.928 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:34.928 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.899723+0000", 2024-04-19T02:16:34.929 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:34.929 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.929 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.929 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:34.929 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.899752+0000", 2024-04-19T02:16:34.929 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.9496999999999999e-05 2024-04-19T02:16:34.929 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.929 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.929 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:34.929 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.899762+0000", 2024-04-19T02:16:34.929 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.8689999999999999e-06 2024-04-19T02:16:34.929 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.929 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.929 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:34.929 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.899768+0000", 2024-04-19T02:16:34.930 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.9909999999999999e-06 2024-04-19T02:16:34.930 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.930 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.930 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:34.930 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.899798+0000", 2024-04-19T02:16:34.930 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.0210999999999999e-05 2024-04-19T02:16:34.930 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.930 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.930 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:34.930 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.899820+0000", 2024-04-19T02:16:34.930 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.1475e-05 2024-04-19T02:16:34.930 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:34.930 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:34.930 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:34.930 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.931 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.931 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:94065 5.5 5:af6716a1:::benchmark_data_smithi121_44835_object94064:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T02:16:34.931 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:34.899681+0000", 2024-04-19T02:16:34.931 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.001259832, 2024-04-19T02:16:34.931 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0016616440000000001, 2024-04-19T02:16:34.931 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:34.931 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:34.931 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:34.931 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:34.931 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:34.931 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 94065 2024-04-19T02:16:34.931 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.931 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:34.931 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.931 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:34.932 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.899681+0000", 2024-04-19T02:16:34.932 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:34.932 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.932 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.932 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:34.932 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.899681+0000", 2024-04-19T02:16:34.932 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:34.932 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.932 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.932 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:34.932 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.899681+0000", 2024-04-19T02:16:34.932 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:34.932 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.932 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.932 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:34.933 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.899758+0000", 2024-04-19T02:16:34.933 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.7206000000000006e-05 2024-04-19T02:16:34.933 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.933 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.933 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:34.933 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.899767+0000", 2024-04-19T02:16:34.933 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.5629999999999998e-06 2024-04-19T02:16:34.933 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.933 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.933 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:34.933 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.899774+0000", 2024-04-19T02:16:34.933 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.0589999999999997e-06 2024-04-19T02:16:34.933 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.933 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.934 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:34.934 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.899810+0000", 2024-04-19T02:16:34.934 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.5642999999999997e-05 2024-04-19T02:16:34.934 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.934 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.934 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:34.934 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.899939+0000", 2024-04-19T02:16:34.934 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000129107 2024-04-19T02:16:34.934 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.934 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.934 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:34.934 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.900078+0000", 2024-04-19T02:16:34.934 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00013914 2024-04-19T02:16:34.934 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:34.935 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:34.935 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:34.935 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.935 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.935 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:94069 5.7 e34/16 5:e0f6eef1:::benchmark_data_smithi121_44835_object94068:head v 34'5905, mlcod=34'5902)", 2024-04-19T02:16:34.935 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:34.901223+0000", 2024-04-19T02:16:34.935 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4294967295.9997187, 2024-04-19T02:16:34.935 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00016824400000000001, 2024-04-19T02:16:34.935 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:34.935 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:34.935 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:34.935 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.935 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:34.935 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.901223+0000", 2024-04-19T02:16:34.935 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:34.935 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.936 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.936 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:34.936 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.901223+0000", 2024-04-19T02:16:34.936 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:34.936 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.936 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.936 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:34.936 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.901222+0000", 2024-04-19T02:16:34.936 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:34.936 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.936 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.936 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:34.936 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.901278+0000", 2024-04-19T02:16:34.936 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.5801000000000003e-05 2024-04-19T02:16:34.936 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.937 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.937 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:34.937 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.901286+0000", 2024-04-19T02:16:34.937 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.8150000000000006e-06 2024-04-19T02:16:34.937 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.937 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.937 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:34.937 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.901292+0000", 2024-04-19T02:16:34.937 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.6440000000000003e-06 2024-04-19T02:16:34.937 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.937 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.937 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:34.937 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.901329+0000", 2024-04-19T02:16:34.937 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6384000000000003e-05 2024-04-19T02:16:34.937 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:34.937 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:34.938 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:34.938 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.901349+0000", 2024-04-19T02:16:34.938 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.0176000000000001e-05 2024-04-19T02:16:34.938 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:34.938 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:34.938 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:34.938 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:34.938 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2024-04-19T02:16:34.938 INFO:teuthology.orchestra.run.smithi177.stdout: "num_ops": 9 2024-04-19T02:16:34.938 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-04-19T02:16:34.939 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:16:34.951 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:34.951+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:35.028 INFO:tasks.radosbench.radosbench.0.smithi121.stdout:2024-04-19T02:16:35.029840+0000 min lat: 0.00120262 max lat: 2.06929 avg lat: 0.00678464 2024-04-19T02:16:35.028 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-19T02:16:35.028 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 40 16 94311 94295 147.324 120.188 0.0107028 0.00678464 2024-04-19T02:16:35.052 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:35.053+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:35.109 INFO:teuthology.orchestra.run.smithi121.stderr:noscrub is unset 2024-04-19T02:16:35.109 INFO:teuthology.orchestra.run.smithi121.stderr:reweighted osd.0 to 1 (10000) 2024-04-19T02:16:35.122 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-19T02:16:35.153 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:35.154+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:35.159 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-04-19T02:16:35.159 INFO:teuthology.orchestra.run.smithi177.stdout: "ops": [], 2024-04-19T02:16:35.159 INFO:teuthology.orchestra.run.smithi177.stdout: "complaint_time": 30, 2024-04-19T02:16:35.159 INFO:teuthology.orchestra.run.smithi177.stdout: "num_blocked_ops": 0 2024-04-19T02:16:35.159 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-04-19T02:16:35.174 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:16:35.255 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:35.254+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:35.354 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:35.355+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:35.362 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-04-19T02:16:35.362 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 20, 2024-04-19T02:16:35.362 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 600, 2024-04-19T02:16:35.362 INFO:teuthology.orchestra.run.smithi177.stdout: "ops": [ 2024-04-19T02:16:35.362 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.362 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:61815 5.c 5:3ca8a794:::benchmark_data_smithi121_44835_object61814:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:35.362 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:17.482110+0000", 2024-04-19T02:16:35.362 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 17.878280978999999, 2024-04-19T02:16:35.362 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.021577559999999999, 2024-04-19T02:16:35.362 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:35.363 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:35.363 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:35.363 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:35.363 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:35.363 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 61815 2024-04-19T02:16:35.363 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.363 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:35.363 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.363 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:35.363 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482110+0000", 2024-04-19T02:16:35.363 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:35.363 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.363 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.363 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:35.363 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482110+0000", 2024-04-19T02:16:35.364 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:35.364 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.364 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.364 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:35.364 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482109+0000", 2024-04-19T02:16:35.364 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:35.364 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.364 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.364 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:35.364 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482197+0000", 2024-04-19T02:16:35.364 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.7405999999999996e-05 2024-04-19T02:16:35.364 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.364 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.365 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:35.365 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482206+0000", 2024-04-19T02:16:35.365 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.0010000000000007e-06 2024-04-19T02:16:35.365 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.365 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.365 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:35.365 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482211+0000", 2024-04-19T02:16:35.365 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.4569999999999996e-06 2024-04-19T02:16:35.365 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.365 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.365 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:35.365 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.489465+0000", 2024-04-19T02:16:35.365 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.007253776 2024-04-19T02:16:35.365 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.365 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.366 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:35.366 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.489582+0000", 2024-04-19T02:16:35.366 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00011669500000000001 2024-04-19T02:16:35.366 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.366 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.366 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:35.366 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.489684+0000", 2024-04-19T02:16:35.366 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000102533 2024-04-19T02:16:35.366 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.366 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.366 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:35.366 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.491836+0000", 2024-04-19T02:16:35.366 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0021516759999999999 2024-04-19T02:16:35.366 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.367 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.367 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:35.367 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503615+0000", 2024-04-19T02:16:35.367 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.011778906 2024-04-19T02:16:35.367 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.367 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.367 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:35.367 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503652+0000", 2024-04-19T02:16:35.367 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6622999999999998e-05 2024-04-19T02:16:35.367 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.367 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.367 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:35.367 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503688+0000", 2024-04-19T02:16:35.367 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6127000000000002e-05 2024-04-19T02:16:35.367 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:35.368 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:35.368 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:35.368 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.368 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.368 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:61821 5.c 5:3f8142ef:::benchmark_data_smithi121_44835_object61820:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:35.368 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:17.484515+0000", 2024-04-19T02:16:35.368 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 17.875876143999999, 2024-04-19T02:16:35.368 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.019268073, 2024-04-19T02:16:35.368 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:35.368 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:35.368 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:35.368 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:35.368 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:35.368 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 61821 2024-04-19T02:16:35.368 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.369 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:35.369 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.369 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:35.369 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.484515+0000", 2024-04-19T02:16:35.369 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:35.369 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.369 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.369 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:35.369 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.484515+0000", 2024-04-19T02:16:35.369 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:35.369 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.369 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.369 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:35.369 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.484514+0000", 2024-04-19T02:16:35.370 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:35.370 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.370 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.370 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:35.370 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.484612+0000", 2024-04-19T02:16:35.370 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.7962999999999997e-05 2024-04-19T02:16:35.370 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.370 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.370 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:35.370 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.484623+0000", 2024-04-19T02:16:35.370 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.1229999999999999e-05 2024-04-19T02:16:35.370 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.370 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.370 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:35.370 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.484629+0000", 2024-04-19T02:16:35.371 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.9549999999999997e-06 2024-04-19T02:16:35.371 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.371 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.371 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:35.371 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.491863+0000", 2024-04-19T02:16:35.371 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.007234178 2024-04-19T02:16:35.371 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.371 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.371 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:35.371 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.491976+0000", 2024-04-19T02:16:35.371 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000112613 2024-04-19T02:16:35.371 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.371 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.371 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:35.371 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.492073+0000", 2024-04-19T02:16:35.372 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.6961999999999998e-05 2024-04-19T02:16:35.372 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.372 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.372 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:35.372 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.496898+0000", 2024-04-19T02:16:35.372 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0048245299999999996 2024-04-19T02:16:35.372 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.372 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.372 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:35.372 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503695+0000", 2024-04-19T02:16:35.372 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0067978129999999998 2024-04-19T02:16:35.372 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.372 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.372 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:35.373 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503748+0000", 2024-04-19T02:16:35.373 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.2247000000000003e-05 2024-04-19T02:16:35.373 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.373 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.373 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:35.373 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503783+0000", 2024-04-19T02:16:35.373 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.5389999999999998e-05 2024-04-19T02:16:35.373 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:35.373 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:35.373 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:35.373 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.373 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.373 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:78170 5.1 5:8b9c8e45:::benchmark_data_smithi121_44835_object78169:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:35.373 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.078784+0000", 2024-04-19T02:16:35.373 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 8.2816066910000004, 2024-04-19T02:16:35.373 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.019726264, 2024-04-19T02:16:35.374 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:35.374 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:35.374 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:35.374 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:35.374 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:35.374 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 78170 2024-04-19T02:16:35.374 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.374 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:35.374 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.374 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:35.374 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.078784+0000", 2024-04-19T02:16:35.374 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:35.374 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.374 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.374 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:35.375 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.078784+0000", 2024-04-19T02:16:35.375 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:35.375 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.375 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.375 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:35.375 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.078784+0000", 2024-04-19T02:16:35.375 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:35.375 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.375 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.375 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:35.375 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.078887+0000", 2024-04-19T02:16:35.375 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000103305 2024-04-19T02:16:35.375 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.375 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.376 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:35.376 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.078895+0000", 2024-04-19T02:16:35.376 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.4409999999999993e-06 2024-04-19T02:16:35.376 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.376 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.376 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:35.376 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.078902+0000", 2024-04-19T02:16:35.376 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.9990000000000002e-06 2024-04-19T02:16:35.376 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.376 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.376 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:35.376 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.080865+0000", 2024-04-19T02:16:35.376 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0019620169999999999 2024-04-19T02:16:35.376 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.376 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.376 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:35.377 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.080997+0000", 2024-04-19T02:16:35.377 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00013229100000000001 2024-04-19T02:16:35.377 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.377 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.377 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:35.377 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.081163+0000", 2024-04-19T02:16:35.377 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00016632300000000001 2024-04-19T02:16:35.377 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.377 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.377 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:35.377 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.087215+0000", 2024-04-19T02:16:35.377 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0060522600000000003 2024-04-19T02:16:35.377 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.377 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.377 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:35.378 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.087261+0000", 2024-04-19T02:16:35.378 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.5788999999999998e-05 2024-04-19T02:16:35.378 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.378 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.378 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:35.378 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.098357+0000", 2024-04-19T02:16:35.378 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.011095571 2024-04-19T02:16:35.378 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.378 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.378 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:35.378 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.098407+0000", 2024-04-19T02:16:35.378 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.9821000000000003e-05 2024-04-19T02:16:35.378 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.378 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.378 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:35.379 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.098511+0000", 2024-04-19T02:16:35.379 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000104101 2024-04-19T02:16:35.379 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:35.379 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:35.379 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:35.379 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.379 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.379 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:78173 5.1 5:836bdddd:::benchmark_data_smithi121_44835_object78172:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:35.379 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.079379+0000", 2024-04-19T02:16:35.379 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 8.2810123610000002, 2024-04-19T02:16:35.379 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.019339773000000001, 2024-04-19T02:16:35.379 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:35.379 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:35.379 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:35.379 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:35.380 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:35.380 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 78173 2024-04-19T02:16:35.380 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.380 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:35.380 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.380 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:35.380 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.079379+0000", 2024-04-19T02:16:35.380 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:35.380 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.380 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.380 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:35.380 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.079379+0000", 2024-04-19T02:16:35.380 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:35.380 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.380 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.380 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:35.381 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.079378+0000", 2024-04-19T02:16:35.381 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:35.381 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.381 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.381 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:35.381 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.079500+0000", 2024-04-19T02:16:35.381 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000122411 2024-04-19T02:16:35.381 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.381 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.381 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:35.381 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.079509+0000", 2024-04-19T02:16:35.381 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.7490000000000004e-06 2024-04-19T02:16:35.381 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.381 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.381 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:35.382 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.079516+0000", 2024-04-19T02:16:35.382 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.6120000000000004e-06 2024-04-19T02:16:35.382 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.382 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.382 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:35.382 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.083107+0000", 2024-04-19T02:16:35.382 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.003590963 2024-04-19T02:16:35.382 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.382 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.382 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:35.382 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.083265+0000", 2024-04-19T02:16:35.382 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000157944 2024-04-19T02:16:35.382 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.382 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.383 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:35.383 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.083467+0000", 2024-04-19T02:16:35.383 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000202129 2024-04-19T02:16:35.383 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.383 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.383 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:35.383 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.087305+0000", 2024-04-19T02:16:35.383 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0038381679999999999 2024-04-19T02:16:35.383 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.383 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.383 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:35.383 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.089566+0000", 2024-04-19T02:16:35.383 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0022616009999999998 2024-04-19T02:16:35.383 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.383 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.383 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:35.384 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.098555+0000", 2024-04-19T02:16:35.384 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0089888090000000004 2024-04-19T02:16:35.384 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.384 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.384 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:35.384 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.098619+0000", 2024-04-19T02:16:35.384 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.3555999999999999e-05 2024-04-19T02:16:35.384 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.384 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.384 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:35.384 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.098719+0000", 2024-04-19T02:16:35.384 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.9674999999999997e-05 2024-04-19T02:16:35.384 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:35.384 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:35.384 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:35.385 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.385 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.385 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:78247 5.c 5:3efb1468:::benchmark_data_smithi121_44835_object78246:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:35.385 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.116347+0000", 2024-04-19T02:16:35.385 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 8.2440439239999996, 2024-04-19T02:16:35.385 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.032194436999999999, 2024-04-19T02:16:35.385 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:35.385 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:35.385 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:35.385 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:35.385 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:35.385 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 78247 2024-04-19T02:16:35.385 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.385 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:35.385 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.386 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:35.386 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116347+0000", 2024-04-19T02:16:35.386 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:35.386 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.386 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.386 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:35.386 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116347+0000", 2024-04-19T02:16:35.386 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:35.386 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.386 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.386 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:35.386 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116346+0000", 2024-04-19T02:16:35.386 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:35.386 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.386 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.387 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:35.387 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116370+0000", 2024-04-19T02:16:35.387 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.3892000000000001e-05 2024-04-19T02:16:35.387 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.387 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.387 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:35.387 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116385+0000", 2024-04-19T02:16:35.387 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.5162e-05 2024-04-19T02:16:35.387 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.387 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.387 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:35.387 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116394+0000", 2024-04-19T02:16:35.387 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.8000000000000004e-06 2024-04-19T02:16:35.387 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.387 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.388 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:35.388 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124856+0000", 2024-04-19T02:16:35.388 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0084622169999999993 2024-04-19T02:16:35.388 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.388 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.388 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:35.388 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124966+0000", 2024-04-19T02:16:35.388 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000109747 2024-04-19T02:16:35.388 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.388 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.388 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:35.388 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125216+0000", 2024-04-19T02:16:35.388 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000249545 2024-04-19T02:16:35.388 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.389 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.389 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:35.389 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.131713+0000", 2024-04-19T02:16:35.389 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0064972370000000003 2024-04-19T02:16:35.389 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.389 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.389 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:35.389 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148323+0000", 2024-04-19T02:16:35.389 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016609641000000001 2024-04-19T02:16:35.389 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.389 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.389 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:35.389 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148359+0000", 2024-04-19T02:16:35.389 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6412000000000003e-05 2024-04-19T02:16:35.389 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.390 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.390 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:35.390 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148542+0000", 2024-04-19T02:16:35.390 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00018265600000000001 2024-04-19T02:16:35.390 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:35.390 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:35.390 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:35.390 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.390 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.390 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:78248 5.c 5:30b7cc74:::benchmark_data_smithi121_44835_object78247:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:35.390 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.116471+0000", 2024-04-19T02:16:35.390 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 8.2439204230000005, 2024-04-19T02:16:35.390 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.032127452000000001, 2024-04-19T02:16:35.390 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:35.391 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:35.391 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:35.391 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:35.391 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:35.391 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 78248 2024-04-19T02:16:35.391 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.391 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:35.391 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.391 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:35.391 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116471+0000", 2024-04-19T02:16:35.391 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:35.391 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.391 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.391 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:35.391 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116471+0000", 2024-04-19T02:16:35.392 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:35.392 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.392 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.392 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:35.392 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116470+0000", 2024-04-19T02:16:35.392 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:35.392 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.392 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.392 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:35.392 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116496+0000", 2024-04-19T02:16:35.392 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.5517e-05 2024-04-19T02:16:35.392 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.392 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.392 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:35.392 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116505+0000", 2024-04-19T02:16:35.393 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.9250000000000007e-06 2024-04-19T02:16:35.393 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.393 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.393 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:35.393 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116516+0000", 2024-04-19T02:16:35.393 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.012e-05 2024-04-19T02:16:35.393 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.393 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.393 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:35.393 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.127803+0000", 2024-04-19T02:16:35.393 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.011287523000000001 2024-04-19T02:16:35.393 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.393 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.393 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:35.393 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.127932+0000", 2024-04-19T02:16:35.394 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012848499999999999 2024-04-19T02:16:35.394 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.394 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.394 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:35.394 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128022+0000", 2024-04-19T02:16:35.394 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.0890000000000006e-05 2024-04-19T02:16:35.394 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.394 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.394 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:35.394 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.131909+0000", 2024-04-19T02:16:35.394 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0038864609999999999 2024-04-19T02:16:35.394 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.394 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.394 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:35.395 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148552+0000", 2024-04-19T02:16:35.395 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016643162999999999 2024-04-19T02:16:35.395 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.395 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.395 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:35.395 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148577+0000", 2024-04-19T02:16:35.395 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.5333999999999998e-05 2024-04-19T02:16:35.395 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.395 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.395 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:35.395 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148598+0000", 2024-04-19T02:16:35.395 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.0687999999999999e-05 2024-04-19T02:16:35.395 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:35.395 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:35.395 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:35.396 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.396 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.396 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:78258 5.a 5:549070de:::benchmark_data_smithi121_44835_object78257:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:35.396 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.124295+0000", 2024-04-19T02:16:35.396 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 8.2360958770000003, 2024-04-19T02:16:35.396 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020189543000000001, 2024-04-19T02:16:35.396 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:35.396 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:35.396 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:35.396 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:35.396 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:35.396 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 78258 2024-04-19T02:16:35.396 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.396 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:35.396 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.396 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:35.397 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124295+0000", 2024-04-19T02:16:35.397 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:35.397 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.397 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.397 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:35.397 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124295+0000", 2024-04-19T02:16:35.397 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:35.397 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.397 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.397 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:35.397 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124294+0000", 2024-04-19T02:16:35.397 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:35.397 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.397 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.397 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:35.398 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124358+0000", 2024-04-19T02:16:35.398 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.4040000000000003e-05 2024-04-19T02:16:35.398 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.398 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.398 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:35.398 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124374+0000", 2024-04-19T02:16:35.398 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.5291e-05 2024-04-19T02:16:35.398 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.398 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.398 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:35.398 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124383+0000", 2024-04-19T02:16:35.398 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.8360000000000004e-06 2024-04-19T02:16:35.398 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.398 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.399 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:35.399 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124908+0000", 2024-04-19T02:16:35.399 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00052415700000000003 2024-04-19T02:16:35.399 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.399 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.399 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:35.399 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125023+0000", 2024-04-19T02:16:35.399 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00011506999999999999 2024-04-19T02:16:35.399 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.399 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.399 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:35.399 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125182+0000", 2024-04-19T02:16:35.399 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00015942500000000001 2024-04-19T02:16:35.399 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.399 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.400 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:35.400 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.129505+0000", 2024-04-19T02:16:35.400 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0043225080000000001 2024-04-19T02:16:35.400 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.400 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.400 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:35.400 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.144379+0000", 2024-04-19T02:16:35.400 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.014874263 2024-04-19T02:16:35.400 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.400 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.400 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:35.400 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.144444+0000", 2024-04-19T02:16:35.400 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.5451999999999996e-05 2024-04-19T02:16:35.400 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.400 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.401 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:35.401 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.144485+0000", 2024-04-19T02:16:35.401 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.0426999999999998e-05 2024-04-19T02:16:35.401 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:35.401 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:35.401 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:35.401 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.401 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.401 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:78259 5.4 e31/16 5:2aa344b2:::benchmark_data_smithi121_44835_object78258:head v 31'4849, mlcod=31'4843)", 2024-04-19T02:16:35.401 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.125675+0000", 2024-04-19T02:16:35.401 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 8.2347160049999992, 2024-04-19T02:16:35.401 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.022419326, 2024-04-19T02:16:35.401 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:35.402 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:35.402 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:35.402 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.402 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:35.402 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125675+0000", 2024-04-19T02:16:35.402 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:35.402 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.402 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.402 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:35.402 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125675+0000", 2024-04-19T02:16:35.402 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:35.402 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.402 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.402 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:35.403 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125674+0000", 2024-04-19T02:16:35.403 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:35.403 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.403 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.403 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:35.403 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125723+0000", 2024-04-19T02:16:35.403 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.8998000000000001e-05 2024-04-19T02:16:35.403 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.403 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.403 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:35.403 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125733+0000", 2024-04-19T02:16:35.403 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.1379999999999996e-06 2024-04-19T02:16:35.403 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.403 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.404 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:35.404 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125740+0000", 2024-04-19T02:16:35.404 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.0779999999999998e-06 2024-04-19T02:16:35.404 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.404 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.404 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:35.404 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.129589+0000", 2024-04-19T02:16:35.404 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0038488910000000001 2024-04-19T02:16:35.404 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.404 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.404 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:35.404 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.129605+0000", 2024-04-19T02:16:35.404 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.6877000000000001e-05 2024-04-19T02:16:35.404 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.404 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.405 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:35.405 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148057+0000", 2024-04-19T02:16:35.405 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.018451624 2024-04-19T02:16:35.405 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.405 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.405 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:35.405 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148094+0000", 2024-04-19T02:16:35.405 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.7327999999999999e-05 2024-04-19T02:16:35.405 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:35.405 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:35.405 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:35.405 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.405 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.405 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:78263 5.1 5:8e231862:::benchmark_data_smithi121_44835_object78262:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:35.406 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.128154+0000", 2024-04-19T02:16:35.406 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 8.2322368190000006, 2024-04-19T02:16:35.406 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020882214, 2024-04-19T02:16:35.406 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:35.406 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:35.406 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:35.406 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:35.406 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:35.406 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 78263 2024-04-19T02:16:35.406 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.406 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:35.406 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.406 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:35.406 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128154+0000", 2024-04-19T02:16:35.407 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:35.407 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.407 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.407 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:35.407 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128154+0000", 2024-04-19T02:16:35.407 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:35.407 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.407 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.407 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:35.407 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128153+0000", 2024-04-19T02:16:35.407 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:35.407 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.407 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.407 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:35.407 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128246+0000", 2024-04-19T02:16:35.408 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.302e-05 2024-04-19T02:16:35.408 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.408 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.408 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:35.408 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128263+0000", 2024-04-19T02:16:35.408 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.6753e-05 2024-04-19T02:16:35.408 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.408 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.408 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:35.408 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128271+0000", 2024-04-19T02:16:35.408 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.2290000000000003e-06 2024-04-19T02:16:35.408 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.408 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.408 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:35.409 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128459+0000", 2024-04-19T02:16:35.409 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00018772 2024-04-19T02:16:35.409 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.409 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.409 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:35.409 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128574+0000", 2024-04-19T02:16:35.409 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00011437700000000001 2024-04-19T02:16:35.409 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.409 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.409 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:35.409 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128696+0000", 2024-04-19T02:16:35.409 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000122831 2024-04-19T02:16:35.409 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.409 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.410 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:35.410 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.130816+0000", 2024-04-19T02:16:35.410 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0021196750000000001 2024-04-19T02:16:35.410 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.410 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.410 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:35.410 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.131859+0000", 2024-04-19T02:16:35.410 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0010434419999999999 2024-04-19T02:16:35.410 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.410 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.410 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:35.410 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148848+0000", 2024-04-19T02:16:35.410 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016988712 2024-04-19T02:16:35.410 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.410 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.411 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:35.411 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148905+0000", 2024-04-19T02:16:35.411 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.6722999999999999e-05 2024-04-19T02:16:35.411 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.411 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.411 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:35.411 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.149036+0000", 2024-04-19T02:16:35.411 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000131567 2024-04-19T02:16:35.411 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:35.411 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:35.411 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:35.411 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.411 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.411 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:78271 5.4 e31/16 5:2982d7a6:::benchmark_data_smithi121_44835_object78270:head v 31'4850, mlcod=31'4847)", 2024-04-19T02:16:35.411 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.132554+0000", 2024-04-19T02:16:35.412 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 8.2278372849999997, 2024-04-19T02:16:35.412 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020294946000000001, 2024-04-19T02:16:35.412 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:35.412 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:35.412 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:35.412 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.412 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:35.412 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132554+0000", 2024-04-19T02:16:35.412 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:35.412 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.412 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.412 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:35.412 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132554+0000", 2024-04-19T02:16:35.412 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:35.413 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.413 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.413 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:35.413 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132553+0000", 2024-04-19T02:16:35.413 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:35.413 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.413 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.413 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:35.413 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132615+0000", 2024-04-19T02:16:35.413 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.1772000000000004e-05 2024-04-19T02:16:35.413 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.413 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.413 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:35.413 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132620+0000", 2024-04-19T02:16:35.413 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.0939999999999998e-06 2024-04-19T02:16:35.414 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.414 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.414 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:35.414 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132624+0000", 2024-04-19T02:16:35.414 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.2229999999999999e-06 2024-04-19T02:16:35.414 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.414 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.414 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:35.414 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132649+0000", 2024-04-19T02:16:35.414 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.5352000000000001e-05 2024-04-19T02:16:35.414 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.414 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.414 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:35.414 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132661+0000", 2024-04-19T02:16:35.415 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.1851999999999999e-05 2024-04-19T02:16:35.415 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.415 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.415 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:35.415 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.152820+0000", 2024-04-19T02:16:35.415 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020159369999999999 2024-04-19T02:16:35.415 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.415 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.415 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:35.415 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.152849+0000", 2024-04-19T02:16:35.415 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.868e-05 2024-04-19T02:16:35.415 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:35.415 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:35.415 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:35.416 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.416 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.416 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:85867 5.a 5:563068d5:::benchmark_data_smithi121_44835_object85866:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T02:16:35.416 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:30.772002+0000", 2024-04-19T02:16:35.416 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4.588389587, 2024-04-19T02:16:35.416 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.019372292999999999, 2024-04-19T02:16:35.416 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:35.416 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:35.416 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:35.416 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:35.416 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:35.416 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 85867 2024-04-19T02:16:35.416 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.416 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:35.416 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.417 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:35.417 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.772002+0000", 2024-04-19T02:16:35.417 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:35.417 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.417 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.417 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:35.417 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.772002+0000", 2024-04-19T02:16:35.417 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:35.417 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.417 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.417 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:35.417 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.772001+0000", 2024-04-19T02:16:35.417 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:35.417 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.417 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.418 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:35.418 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.772035+0000", 2024-04-19T02:16:35.418 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.3995000000000002e-05 2024-04-19T02:16:35.418 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.418 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.418 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:35.418 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.772042+0000", 2024-04-19T02:16:35.418 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.3039999999999999e-06 2024-04-19T02:16:35.418 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.418 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.418 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:35.418 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.772049+0000", 2024-04-19T02:16:35.418 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.635e-06 2024-04-19T02:16:35.418 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.419 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.419 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:35.419 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.779360+0000", 2024-04-19T02:16:35.419 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0073112510000000004 2024-04-19T02:16:35.419 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.419 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.419 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:35.419 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.779504+0000", 2024-04-19T02:16:35.419 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000143378 2024-04-19T02:16:35.419 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.419 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.419 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:35.419 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.779625+0000", 2024-04-19T02:16:35.419 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000121903 2024-04-19T02:16:35.419 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.420 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.420 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:35.420 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.781522+0000", 2024-04-19T02:16:35.420 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0018965430000000001 2024-04-19T02:16:35.420 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.420 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.420 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:35.420 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.791290+0000", 2024-04-19T02:16:35.420 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0097679289999999998 2024-04-19T02:16:35.420 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.420 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.420 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:35.420 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.791338+0000", 2024-04-19T02:16:35.420 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.8387999999999998e-05 2024-04-19T02:16:35.420 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.421 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.421 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:35.421 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:30.791374+0000", 2024-04-19T02:16:35.421 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.5462e-05 2024-04-19T02:16:35.421 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:35.421 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:35.421 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:35.421 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.421 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.421 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:86809 5.1 5:87590d07:::benchmark_data_smithi121_44835_object86808:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T02:16:35.421 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:31.248111+0000", 2024-04-19T02:16:35.421 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4.1122798730000003, 2024-04-19T02:16:35.421 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.019434132999999999, 2024-04-19T02:16:35.421 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:35.421 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:35.422 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:35.422 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:35.422 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:35.422 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 86809 2024-04-19T02:16:35.422 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.422 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:35.422 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.422 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:35.422 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.248111+0000", 2024-04-19T02:16:35.422 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:35.422 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.422 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.422 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:35.423 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.248111+0000", 2024-04-19T02:16:35.423 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:35.423 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.423 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.423 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:35.423 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.248111+0000", 2024-04-19T02:16:35.423 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:35.423 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.423 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.423 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:35.423 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.248181+0000", 2024-04-19T02:16:35.423 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.0698999999999995e-05 2024-04-19T02:16:35.423 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.423 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.423 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:35.424 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.248191+0000", 2024-04-19T02:16:35.424 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.3170000000000008e-06 2024-04-19T02:16:35.424 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.424 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.424 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:35.424 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.248197+0000", 2024-04-19T02:16:35.424 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.1279999999999996e-06 2024-04-19T02:16:35.424 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.424 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.424 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:35.424 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.256815+0000", 2024-04-19T02:16:35.424 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0086187390000000003 2024-04-19T02:16:35.424 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.425 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.425 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:35.425 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.256968+0000", 2024-04-19T02:16:35.425 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000152795 2024-04-19T02:16:35.425 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.425 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.425 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:35.425 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.257125+0000", 2024-04-19T02:16:35.425 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000156391 2024-04-19T02:16:35.425 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.425 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.425 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:35.425 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.264616+0000", 2024-04-19T02:16:35.425 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0074914789999999997 2024-04-19T02:16:35.425 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.426 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.426 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:35.426 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.264658+0000", 2024-04-19T02:16:35.426 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.2026e-05 2024-04-19T02:16:35.426 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.426 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.426 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:35.426 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.267383+0000", 2024-04-19T02:16:35.426 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0027250120000000002 2024-04-19T02:16:35.426 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.426 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.426 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:35.426 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.267438+0000", 2024-04-19T02:16:35.427 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.4784999999999998e-05 2024-04-19T02:16:35.427 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.427 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.427 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:35.427 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.267545+0000", 2024-04-19T02:16:35.427 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000107382 2024-04-19T02:16:35.427 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:35.427 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:35.427 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:35.427 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.427 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.427 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:87963 5.3 5:c47b3227:::benchmark_data_smithi121_44835_object87962:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T02:16:35.427 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:31.833755+0000", 2024-04-19T02:16:35.427 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 3.5266361640000001, 2024-04-19T02:16:35.428 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.019779005999999998, 2024-04-19T02:16:35.428 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:35.428 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:35.428 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:35.428 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:35.428 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:35.428 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 87963 2024-04-19T02:16:35.428 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.428 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:35.428 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.428 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:35.428 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.833755+0000", 2024-04-19T02:16:35.428 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:35.428 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.428 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.429 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:35.429 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.833755+0000", 2024-04-19T02:16:35.429 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:35.429 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.429 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.429 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:35.429 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.833754+0000", 2024-04-19T02:16:35.429 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:35.429 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.429 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.429 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:35.429 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.833881+0000", 2024-04-19T02:16:35.429 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000126785 2024-04-19T02:16:35.429 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.429 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.430 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:35.430 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.833890+0000", 2024-04-19T02:16:35.430 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.0110000000000006e-06 2024-04-19T02:16:35.430 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.430 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.430 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:35.430 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.833897+0000", 2024-04-19T02:16:35.430 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.5309999999999998e-06 2024-04-19T02:16:35.430 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.430 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.430 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:35.430 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.842658+0000", 2024-04-19T02:16:35.430 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0087616929999999992 2024-04-19T02:16:35.430 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.431 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.431 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:35.431 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.842749+0000", 2024-04-19T02:16:35.431 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.0556999999999994e-05 2024-04-19T02:16:35.431 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.431 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.431 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:35.431 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.842832+0000", 2024-04-19T02:16:35.431 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.2696999999999998e-05 2024-04-19T02:16:35.431 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.431 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.431 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:35.431 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.844494+0000", 2024-04-19T02:16:35.431 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0016623429999999999 2024-04-19T02:16:35.432 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.432 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.432 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:35.432 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.853446+0000", 2024-04-19T02:16:35.432 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0089523499999999995 2024-04-19T02:16:35.432 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.432 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.432 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:35.432 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.853495+0000", 2024-04-19T02:16:35.432 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.8847999999999997e-05 2024-04-19T02:16:35.432 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.432 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.432 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:35.432 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.853534+0000", 2024-04-19T02:16:35.432 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.8829999999999999e-05 2024-04-19T02:16:35.433 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:35.433 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:35.433 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:35.433 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.433 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.433 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:94191 5.c 5:3155c784:::benchmark_data_smithi121_44835_object94190:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T02:16:35.433 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:34.963381+0000", 2024-04-19T02:16:35.433 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.39700960000000002, 2024-04-19T02:16:35.433 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.021414343999999998, 2024-04-19T02:16:35.433 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:35.433 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:35.433 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:35.433 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:35.433 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:35.433 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 94191 2024-04-19T02:16:35.434 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.434 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:35.434 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.434 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:35.434 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.963381+0000", 2024-04-19T02:16:35.434 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:35.434 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.434 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.434 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:35.434 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.963381+0000", 2024-04-19T02:16:35.434 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:35.434 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.434 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.434 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:35.434 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.963381+0000", 2024-04-19T02:16:35.435 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:35.435 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.435 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.435 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:35.435 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.963457+0000", 2024-04-19T02:16:35.435 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.5827000000000004e-05 2024-04-19T02:16:35.435 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.435 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.435 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:35.435 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.963465+0000", 2024-04-19T02:16:35.435 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.2800000000000003e-06 2024-04-19T02:16:35.435 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.435 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.435 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:35.435 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.963470+0000", 2024-04-19T02:16:35.436 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.2310000000000004e-06 2024-04-19T02:16:35.436 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.436 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.436 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:35.436 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.969469+0000", 2024-04-19T02:16:35.436 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0059987169999999998 2024-04-19T02:16:35.436 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.436 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.436 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:35.436 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.969594+0000", 2024-04-19T02:16:35.436 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012517299999999999 2024-04-19T02:16:35.436 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.436 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.436 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:35.436 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.969759+0000", 2024-04-19T02:16:35.436 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00016459999999999999 2024-04-19T02:16:35.437 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.437 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.437 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:35.437 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.975130+0000", 2024-04-19T02:16:35.437 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0053717410000000002 2024-04-19T02:16:35.437 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.437 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.437 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:35.437 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.984704+0000", 2024-04-19T02:16:35.437 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.009573715 2024-04-19T02:16:35.437 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.437 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.437 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:35.437 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.984758+0000", 2024-04-19T02:16:35.437 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.4039000000000002e-05 2024-04-19T02:16:35.438 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.438 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.438 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:35.438 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.984796+0000", 2024-04-19T02:16:35.438 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.7619e-05 2024-04-19T02:16:35.438 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:35.438 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:35.438 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:35.438 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.438 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.438 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:94471 5.6 5:641302c2:::benchmark_data_smithi121_44835_object94470:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:35.438 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:35.112592+0000", 2024-04-19T02:16:35.438 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.24779953599999999, 2024-04-19T02:16:35.438 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.023525194999999999, 2024-04-19T02:16:35.438 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:35.439 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:35.439 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:35.439 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:35.439 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:35.439 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 94471 2024-04-19T02:16:35.439 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.439 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:35.439 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.439 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:35.439 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.112592+0000", 2024-04-19T02:16:35.439 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:35.439 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.439 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.439 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:35.439 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.112592+0000", 2024-04-19T02:16:35.440 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:35.440 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.440 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.440 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:35.440 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.112591+0000", 2024-04-19T02:16:35.440 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:35.440 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.440 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.440 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:35.440 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.112621+0000", 2024-04-19T02:16:35.440 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.0701999999999998e-05 2024-04-19T02:16:35.440 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.440 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.440 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:35.440 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.112631+0000", 2024-04-19T02:16:35.441 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.3209999999999994e-06 2024-04-19T02:16:35.441 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.441 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.441 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:35.441 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.112638+0000", 2024-04-19T02:16:35.441 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.187e-06 2024-04-19T02:16:35.441 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.441 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.441 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:35.441 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.113893+0000", 2024-04-19T02:16:35.441 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0012553390000000001 2024-04-19T02:16:35.441 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.441 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.441 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:35.441 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.114012+0000", 2024-04-19T02:16:35.441 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000118638 2024-04-19T02:16:35.442 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.442 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.442 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:35.442 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.114151+0000", 2024-04-19T02:16:35.442 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00013928700000000001 2024-04-19T02:16:35.442 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.442 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.442 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:35.442 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.120607+0000", 2024-04-19T02:16:35.442 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0064559179999999997 2024-04-19T02:16:35.442 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.442 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.442 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:35.442 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136026+0000", 2024-04-19T02:16:35.443 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015418762000000001 2024-04-19T02:16:35.443 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.443 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.443 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:35.443 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136084+0000", 2024-04-19T02:16:35.443 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.8245000000000002e-05 2024-04-19T02:16:35.443 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.443 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.443 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:35.443 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136117+0000", 2024-04-19T02:16:35.443 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.2616000000000001e-05 2024-04-19T02:16:35.443 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:35.443 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:35.443 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:35.443 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.443 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.444 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:94468 5.2 e34/16 5:4f406431:::benchmark_data_smithi121_44835_object94467:head v 34'5918, mlcod=34'5914)", 2024-04-19T02:16:35.444 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:35.113059+0000", 2024-04-19T02:16:35.444 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.247332253, 2024-04-19T02:16:35.444 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.022987177000000001, 2024-04-19T02:16:35.444 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:35.444 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:35.444 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:35.444 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.444 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:35.444 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.113059+0000", 2024-04-19T02:16:35.444 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:35.444 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.444 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.444 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:35.444 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.113059+0000", 2024-04-19T02:16:35.445 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:35.445 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.445 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.445 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:35.445 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.113058+0000", 2024-04-19T02:16:35.445 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:35.445 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.445 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.445 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:35.445 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.113103+0000", 2024-04-19T02:16:35.445 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.4159000000000002e-05 2024-04-19T02:16:35.445 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.445 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.446 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:35.446 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.113110+0000", 2024-04-19T02:16:35.446 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.1049999999999997e-06 2024-04-19T02:16:35.446 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.446 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.446 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:35.446 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.113115+0000", 2024-04-19T02:16:35.446 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.3229999999999997e-06 2024-04-19T02:16:35.446 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.446 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.446 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:35.446 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.114338+0000", 2024-04-19T02:16:35.446 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.001223179 2024-04-19T02:16:35.446 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.446 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.447 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:35.447 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.114355+0000", 2024-04-19T02:16:35.447 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.6963999999999999e-05 2024-04-19T02:16:35.447 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.447 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.447 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:35.447 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136011+0000", 2024-04-19T02:16:35.447 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.021656102999999999 2024-04-19T02:16:35.447 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.447 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.447 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:35.447 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136046+0000", 2024-04-19T02:16:35.447 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.4802999999999999e-05 2024-04-19T02:16:35.447 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:35.447 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:35.448 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:35.448 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.448 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.448 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:94473 5.6 5:6db36ce7:::benchmark_data_smithi121_44835_object94472:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:35.448 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:35.116069+0000", 2024-04-19T02:16:35.448 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.24432215600000001, 2024-04-19T02:16:35.448 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020111038000000001, 2024-04-19T02:16:35.448 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:35.448 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:35.448 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:35.448 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:35.448 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:35.448 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 94473 2024-04-19T02:16:35.448 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.448 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:35.449 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.449 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:35.449 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116069+0000", 2024-04-19T02:16:35.449 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:35.449 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.449 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.449 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:35.449 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116069+0000", 2024-04-19T02:16:35.449 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:35.449 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.449 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.449 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:35.449 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116067+0000", 2024-04-19T02:16:35.449 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:35.449 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.450 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.450 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:35.450 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116096+0000", 2024-04-19T02:16:35.450 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.9034e-05 2024-04-19T02:16:35.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.450 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.450 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:35.450 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116107+0000", 2024-04-19T02:16:35.450 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0543000000000001e-05 2024-04-19T02:16:35.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.450 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.450 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:35.450 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116115+0000", 2024-04-19T02:16:35.450 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.8860000000000004e-06 2024-04-19T02:16:35.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.451 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.451 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:35.451 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116281+0000", 2024-04-19T02:16:35.451 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00016668100000000001 2024-04-19T02:16:35.451 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.451 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.451 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:35.451 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116394+0000", 2024-04-19T02:16:35.451 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000112138 2024-04-19T02:16:35.451 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.451 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.451 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:35.451 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116502+0000", 2024-04-19T02:16:35.451 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000108513 2024-04-19T02:16:35.451 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.452 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.452 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:35.452 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.120647+0000", 2024-04-19T02:16:35.452 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0041448459999999998 2024-04-19T02:16:35.452 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.452 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.452 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:35.452 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136124+0000", 2024-04-19T02:16:35.452 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015476678000000001 2024-04-19T02:16:35.452 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.452 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.452 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:35.452 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136149+0000", 2024-04-19T02:16:35.452 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.5412999999999999e-05 2024-04-19T02:16:35.453 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.453 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.453 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:35.453 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136180+0000", 2024-04-19T02:16:35.453 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.0970999999999999e-05 2024-04-19T02:16:35.453 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:35.453 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:35.453 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:35.453 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.453 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.453 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:94472 5.2 e35/16 5:45b7e9be:::benchmark_data_smithi121_44835_object94471:head v 35'5919, mlcod=34'5914)", 2024-04-19T02:16:35.453 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:35.116129+0000", 2024-04-19T02:16:35.453 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.24426182299999999, 2024-04-19T02:16:35.453 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.019945311, 2024-04-19T02:16:35.453 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:35.454 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:35.454 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:35.454 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.454 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:35.454 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116129+0000", 2024-04-19T02:16:35.454 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:35.454 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.454 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.454 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:35.454 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116129+0000", 2024-04-19T02:16:35.454 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:35.454 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.454 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.454 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:35.454 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116129+0000", 2024-04-19T02:16:35.455 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:35.455 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.455 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.455 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:35.455 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116149+0000", 2024-04-19T02:16:35.455 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.9874999999999999e-05 2024-04-19T02:16:35.455 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.455 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.455 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:35.455 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116153+0000", 2024-04-19T02:16:35.455 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.7190000000000001e-06 2024-04-19T02:16:35.455 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.455 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.455 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:35.455 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116157+0000", 2024-04-19T02:16:35.456 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.3100000000000001e-06 2024-04-19T02:16:35.456 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.456 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.456 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:35.456 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116250+0000", 2024-04-19T02:16:35.456 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.3022999999999993e-05 2024-04-19T02:16:35.456 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.456 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.456 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:35.456 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116267+0000", 2024-04-19T02:16:35.456 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.685e-05 2024-04-19T02:16:35.456 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.456 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.456 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:35.456 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136051+0000", 2024-04-19T02:16:35.457 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.019784748000000001 2024-04-19T02:16:35.457 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.457 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.457 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:35.457 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136075+0000", 2024-04-19T02:16:35.457 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.3332e-05 2024-04-19T02:16:35.457 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:35.457 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:35.457 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:35.457 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.457 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.457 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:94474 5.0 e35/16 5:047423ee:::benchmark_data_smithi121_44835_object94473:head v 35'5800, mlcod=34'5798)", 2024-04-19T02:16:35.457 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:35.117319+0000", 2024-04-19T02:16:35.457 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.2430725, 2024-04-19T02:16:35.457 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.019071771000000001, 2024-04-19T02:16:35.458 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:35.458 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:35.458 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:35.458 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.458 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:35.458 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.117319+0000", 2024-04-19T02:16:35.458 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:35.458 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.458 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.458 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:35.458 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.117319+0000", 2024-04-19T02:16:35.458 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:35.458 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.458 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.458 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:35.459 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.117318+0000", 2024-04-19T02:16:35.459 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:35.459 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.459 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.459 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:35.459 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.117371+0000", 2024-04-19T02:16:35.459 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.3117e-05 2024-04-19T02:16:35.459 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.459 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.459 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:35.459 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.117382+0000", 2024-04-19T02:16:35.459 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.1270000000000001e-05 2024-04-19T02:16:35.459 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.459 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.459 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:35.460 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.117389+0000", 2024-04-19T02:16:35.460 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.7499999999999997e-06 2024-04-19T02:16:35.460 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.460 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.460 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:35.460 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.117430+0000", 2024-04-19T02:16:35.460 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.1127000000000001e-05 2024-04-19T02:16:35.460 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.460 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.460 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:35.460 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.117450+0000", 2024-04-19T02:16:35.460 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.0188000000000001e-05 2024-04-19T02:16:35.460 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.460 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.460 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:35.460 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136360+0000", 2024-04-19T02:16:35.461 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.018909183 2024-04-19T02:16:35.461 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.461 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.461 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:35.461 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136390+0000", 2024-04-19T02:16:35.461 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.0809000000000003e-05 2024-04-19T02:16:35.461 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:35.461 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:35.461 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:35.461 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.461 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.461 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:94581 5.b e35/16 5:dc86d6e9:::benchmark_data_smithi121_44835_object94580:head v 35'5875, mlcod=35'5872)", 2024-04-19T02:16:35.461 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:35.181295+0000", 2024-04-19T02:16:35.461 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.179096215, 2024-04-19T02:16:35.461 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.02078327, 2024-04-19T02:16:35.462 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:35.462 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:35.462 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:35.462 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.462 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:35.462 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.181295+0000", 2024-04-19T02:16:35.462 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:35.462 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.462 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.462 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:35.462 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.181295+0000", 2024-04-19T02:16:35.462 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:35.462 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.462 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.462 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:35.463 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.181294+0000", 2024-04-19T02:16:35.463 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:35.463 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.463 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.463 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:35.463 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.181321+0000", 2024-04-19T02:16:35.463 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.6588999999999999e-05 2024-04-19T02:16:35.463 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.463 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.463 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:35.463 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.181329+0000", 2024-04-19T02:16:35.463 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.9289999999999998e-06 2024-04-19T02:16:35.463 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.463 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.463 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:35.464 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.181334+0000", 2024-04-19T02:16:35.464 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.2789999999999998e-06 2024-04-19T02:16:35.464 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.464 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.464 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:35.464 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.186093+0000", 2024-04-19T02:16:35.464 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0047585509999999998 2024-04-19T02:16:35.464 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.464 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.464 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:35.464 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.186111+0000", 2024-04-19T02:16:35.464 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.7901e-05 2024-04-19T02:16:35.464 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.464 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.464 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:35.465 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.202037+0000", 2024-04-19T02:16:35.465 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015926020999999999 2024-04-19T02:16:35.465 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:35.465 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:35.465 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:35.465 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.202078+0000", 2024-04-19T02:16:35.465 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.1424999999999997e-05 2024-04-19T02:16:35.465 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:35.465 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:35.465 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:35.465 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:35.465 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:35.465 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-04-19T02:16:35.467 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:35.467+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:35.467 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:16:35.568 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:35.568+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:35.640 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:16:35.640 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:16:35.640 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:35.641 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:95448 5.f 5:f96ef2fe:::benchmark_data_smithi121_44835_object95447:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:35.641 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:35.636014+0000", 2024-04-19T02:16:35.641 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0052497819999999997, 2024-04-19T02:16:35.641 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052744209999999996, 2024-04-19T02:16:35.641 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:35.641 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:35.641 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:35.641 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:35.641 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:35.641 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 95448 2024-04-19T02:16:35.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:35.641 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:35.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:35.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:35.641 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.636014+0000", 2024-04-19T02:16:35.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:35.642 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:35.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:35.642 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:35.642 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.636014+0000", 2024-04-19T02:16:35.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:35.642 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:35.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:35.642 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:35.642 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.636014+0000", 2024-04-19T02:16:35.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:35.642 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:35.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:35.642 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:35.642 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.636039+0000", 2024-04-19T02:16:35.643 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5417000000000001e-05 2024-04-19T02:16:35.643 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:35.643 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:35.643 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:35.643 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.636050+0000", 2024-04-19T02:16:35.643 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.134e-05 2024-04-19T02:16:35.643 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:35.643 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:35.643 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:35.643 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.636056+0000", 2024-04-19T02:16:35.643 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1430000000000003e-06 2024-04-19T02:16:35.643 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:35.643 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:35.643 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:35.643 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.636088+0000", 2024-04-19T02:16:35.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1457000000000001e-05 2024-04-19T02:16:35.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:35.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:35.644 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:35.644 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.636176+0000", 2024-04-19T02:16:35.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8437999999999996e-05 2024-04-19T02:16:35.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:35.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:35.644 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:35.644 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.636271+0000", 2024-04-19T02:16:35.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5099999999999994e-05 2024-04-19T02:16:35.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:35.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:35.644 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:35.644 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.640910+0000", 2024-04-19T02:16:35.645 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.004638255 2024-04-19T02:16:35.645 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:35.645 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:35.645 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:35.645 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:35.645 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:35.645 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:95452 5.9 5:93ce506d:::benchmark_data_smithi121_44835_object95451:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:35.645 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:35.637013+0000", 2024-04-19T02:16:35.645 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0042508939999999999, 2024-04-19T02:16:35.645 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0043345750000000002, 2024-04-19T02:16:35.645 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:35.645 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:35.645 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:35.645 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:35.645 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:35.645 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 95452 2024-04-19T02:16:35.646 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:35.646 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:35.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:35.646 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:35.646 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.637013+0000", 2024-04-19T02:16:35.646 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:35.646 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:35.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:35.646 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:35.646 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.637013+0000", 2024-04-19T02:16:35.646 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:35.646 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:35.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:35.646 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:35.646 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.637013+0000", 2024-04-19T02:16:35.647 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:35.647 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:35.647 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:35.647 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:35.647 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.637049+0000", 2024-04-19T02:16:35.647 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6677000000000001e-05 2024-04-19T02:16:35.647 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:35.647 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:35.647 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:35.647 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.637060+0000", 2024-04-19T02:16:35.647 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.084e-05 2024-04-19T02:16:35.647 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:35.647 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:35.647 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:35.647 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.637066+0000", 2024-04-19T02:16:35.648 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6849999999999998e-06 2024-04-19T02:16:35.648 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:35.648 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:35.648 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:35.648 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.637427+0000", 2024-04-19T02:16:35.648 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000361066 2024-04-19T02:16:35.648 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:35.648 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:35.648 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:35.648 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.637579+0000", 2024-04-19T02:16:35.648 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015170200000000001 2024-04-19T02:16:35.648 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:35.648 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:35.648 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:35.648 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.637737+0000", 2024-04-19T02:16:35.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015855700000000001 2024-04-19T02:16:35.649 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:35.649 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:35.649 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:35.649 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.641197+0000", 2024-04-19T02:16:35.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003459883 2024-04-19T02:16:35.649 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:35.649 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:35.649 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:35.649 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:35.649 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:35.649 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:95453 5.d 5:b4030eb3:::benchmark_data_smithi121_44835_object95452:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:35.649 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:35.637073+0000", 2024-04-19T02:16:35.649 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0041915290000000003, 2024-04-19T02:16:35.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0043232280000000001, 2024-04-19T02:16:35.650 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:35.650 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:35.650 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:35.650 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:35.650 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:35.650 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 95453 2024-04-19T02:16:35.650 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:35.650 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:35.650 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:35.650 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:35.650 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.637073+0000", 2024-04-19T02:16:35.650 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:35.650 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:35.650 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:35.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:35.651 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.637073+0000", 2024-04-19T02:16:35.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:35.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:35.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:35.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:35.651 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.637072+0000", 2024-04-19T02:16:35.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:35.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:35.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:35.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:35.651 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.637110+0000", 2024-04-19T02:16:35.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7784000000000003e-05 2024-04-19T02:16:35.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:35.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:35.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:35.652 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.637116+0000", 2024-04-19T02:16:35.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8819999999999998e-06 2024-04-19T02:16:35.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:35.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:35.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:35.652 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.637120+0000", 2024-04-19T02:16:35.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7400000000000002e-06 2024-04-19T02:16:35.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:35.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:35.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:35.652 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.637156+0000", 2024-04-19T02:16:35.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5871000000000003e-05 2024-04-19T02:16:35.653 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:35.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:35.653 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:35.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.637287+0000", 2024-04-19T02:16:35.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013092299999999999 2024-04-19T02:16:35.653 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:35.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:35.653 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:35.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.637431+0000", 2024-04-19T02:16:35.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014477000000000001 2024-04-19T02:16:35.653 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:35.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:35.653 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:35.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.641180+0000", 2024-04-19T02:16:35.654 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037486379999999999 2024-04-19T02:16:35.654 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:35.654 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:35.654 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:35.654 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:35.654 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:35.654 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4549.0:95442 5.9 e35/16)", 2024-04-19T02:16:35.654 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:35.641409+0000", 2024-04-19T02:16:35.654 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9998555, 2024-04-19T02:16:35.654 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3702999999999999e-05, 2024-04-19T02:16:35.654 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:35.654 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-04-19T02:16:35.654 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:35.654 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:35.654 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:35.655 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.641409+0000", 2024-04-19T02:16:35.655 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:35.655 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:35.655 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:35.655 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:35.655 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.641409+0000", 2024-04-19T02:16:35.655 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:35.655 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:35.655 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:35.655 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:35.655 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.641408+0000", 2024-04-19T02:16:35.655 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:35.655 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:35.655 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:35.655 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:35.656 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.641412+0000", 2024-04-19T02:16:35.656 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5229999999999997e-06 2024-04-19T02:16:35.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:35.656 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:35.656 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:35.656 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.641421+0000", 2024-04-19T02:16:35.656 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3119999999999994e-06 2024-04-19T02:16:35.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:35.656 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:35.656 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:35.656 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.641428+0000", 2024-04-19T02:16:35.656 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8549999999999996e-06 2024-04-19T02:16:35.657 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:35.657 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:35.657 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:35.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:35.657 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:35.657 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:95442 5.9 5:9e771b5e:::benchmark_data_smithi121_44835_object95441:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:35.657 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:35.632592+0000", 2024-04-19T02:16:35.657 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0086724379999999993, 2024-04-19T02:16:35.657 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0088888149999999996, 2024-04-19T02:16:35.658 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:35.658 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:35.658 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:35.658 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:35.658 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:35.658 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 95442 2024-04-19T02:16:35.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:35.658 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:35.658 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:35.658 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:35.658 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.632592+0000", 2024-04-19T02:16:35.658 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:35.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:35.658 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:35.658 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:35.659 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.632592+0000", 2024-04-19T02:16:35.659 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:35.659 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:35.659 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:35.659 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:35.659 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.632591+0000", 2024-04-19T02:16:35.659 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:35.659 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:35.659 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:35.659 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:35.659 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.632653+0000", 2024-04-19T02:16:35.659 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2094999999999994e-05 2024-04-19T02:16:35.659 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:35.659 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:35.659 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:35.660 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.632661+0000", 2024-04-19T02:16:35.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2959999999999999e-06 2024-04-19T02:16:35.660 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:35.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:35.660 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:35.660 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.632667+0000", 2024-04-19T02:16:35.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.339e-06 2024-04-19T02:16:35.660 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:35.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:35.660 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:35.660 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.632711+0000", 2024-04-19T02:16:35.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3863999999999999e-05 2024-04-19T02:16:35.660 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:35.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:35.660 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:35.661 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.632858+0000", 2024-04-19T02:16:35.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014768299999999999 2024-04-19T02:16:35.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:35.661 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:35.661 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:35.661 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.633021+0000", 2024-04-19T02:16:35.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000162683 2024-04-19T02:16:35.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:35.661 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:35.661 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:35.661 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.639227+0000", 2024-04-19T02:16:35.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0062064190000000003 2024-04-19T02:16:35.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:35.661 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:35.661 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:35.661 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.641485+0000", 2024-04-19T02:16:35.662 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022576749999999998 2024-04-19T02:16:35.662 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:35.662 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:35.662 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:35.662 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:35.662 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-04-19T02:16:35.662 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 5 2024-04-19T02:16:35.662 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:16:35.663 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:16:35.668 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:35.668+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:35.769 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:35.769+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:35.833 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:16:35.833 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-04-19T02:16:35.833 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-04-19T02:16:35.833 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-04-19T02:16:35.834 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:16:35.848 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:16:35.869 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:35.870+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:35.970 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:35.970+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:36.012 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:16:36.012 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-04-19T02:16:36.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-04-19T02:16:36.013 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:16:36.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.013 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:36.013 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269684+0000", 2024-04-19T02:16:36.013 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 66.741451202999997, 2024-04-19T02:16:36.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019077493000000001, 2024-04-19T02:16:36.013 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:36.013 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:36.013 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:36.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:36.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269684+0000", 2024-04-19T02:16:36.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:36.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:36.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269684+0000", 2024-04-19T02:16:36.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:36.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:36.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269684+0000", 2024-04-19T02:16:36.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:36.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:36.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269686+0000", 2024-04-19T02:16:36.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2740000000000002e-06 2024-04-19T02:16:36.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:36.015 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269690+0000", 2024-04-19T02:16:36.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8829999999999999e-06 2024-04-19T02:16:36.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:36.015 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269693+0000", 2024-04-19T02:16:36.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4199999999999999e-06 2024-04-19T02:16:36.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:36.015 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269875+0000", 2024-04-19T02:16:36.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018114800000000001 2024-04-19T02:16:36.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:36.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269880+0000", 2024-04-19T02:16:36.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5620000000000003e-06 2024-04-19T02:16:36.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:36.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278610+0000", 2024-04-19T02:16:36.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.008729423 2024-04-19T02:16:36.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:36.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278724+0000", 2024-04-19T02:16:36.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011428400000000001 2024-04-19T02:16:36.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.017 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:36.017 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278860+0000", 2024-04-19T02:16:36.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013601600000000001 2024-04-19T02:16:36.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.017 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:36.017 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282632+0000", 2024-04-19T02:16:36.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037722889999999999 2024-04-19T02:16:36.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.017 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:36.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288712+0000", 2024-04-19T02:16:36.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0060799599999999997 2024-04-19T02:16:36.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:36.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288742+0000", 2024-04-19T02:16:36.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0048000000000001e-05 2024-04-19T02:16:36.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:36.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288762+0000", 2024-04-19T02:16:36.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9482000000000001e-05 2024-04-19T02:16:36.018 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:36.018 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:36.018 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:36.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.019 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:36.019 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269753+0000", 2024-04-19T02:16:36.019 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 66.741381820000001, 2024-04-19T02:16:36.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019088755999999998, 2024-04-19T02:16:36.019 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:36.019 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:36.019 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:36.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:36.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269753+0000", 2024-04-19T02:16:36.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:36.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.020 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:36.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269753+0000", 2024-04-19T02:16:36.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:36.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.020 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:36.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269753+0000", 2024-04-19T02:16:36.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:36.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.020 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:36.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269770+0000", 2024-04-19T02:16:36.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7150999999999999e-05 2024-04-19T02:16:36.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:36.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269779+0000", 2024-04-19T02:16:36.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4139999999999994e-06 2024-04-19T02:16:36.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:36.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269786+0000", 2024-04-19T02:16:36.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.537e-06 2024-04-19T02:16:36.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:36.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269913+0000", 2024-04-19T02:16:36.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012699599999999999 2024-04-19T02:16:36.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.022 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:36.022 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269916+0000", 2024-04-19T02:16:36.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9280000000000002e-06 2024-04-19T02:16:36.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.022 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:36.022 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.279143+0000", 2024-04-19T02:16:36.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0092270129999999992 2024-04-19T02:16:36.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.022 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:36.022 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.279223+0000", 2024-04-19T02:16:36.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0050999999999996e-05 2024-04-19T02:16:36.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:36.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.279364+0000", 2024-04-19T02:16:36.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000140934 2024-04-19T02:16:36.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:36.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286189+0000", 2024-04-19T02:16:36.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.006825327 2024-04-19T02:16:36.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:36.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288791+0000", 2024-04-19T02:16:36.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026021500000000001 2024-04-19T02:16:36.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:36.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288822+0000", 2024-04-19T02:16:36.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0162999999999999e-05 2024-04-19T02:16:36.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:36.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288842+0000", 2024-04-19T02:16:36.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0644000000000001e-05 2024-04-19T02:16:36.024 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:36.024 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:36.024 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:36.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.024 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:36.024 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:16:36.025 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 66.741343345999994, 2024-04-19T02:16:36.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020307345000000001, 2024-04-19T02:16:36.025 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:36.025 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:36.025 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:36.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:36.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:16:36.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:36.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:36.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:16:36.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:36.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.026 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:36.026 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269791+0000", 2024-04-19T02:16:36.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:36.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.026 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:36.026 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269795+0000", 2024-04-19T02:16:36.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5619999999999999e-06 2024-04-19T02:16:36.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.026 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:36.026 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269802+0000", 2024-04-19T02:16:36.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8469999999999998e-06 2024-04-19T02:16:36.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:36.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269807+0000", 2024-04-19T02:16:36.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.707e-06 2024-04-19T02:16:36.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:36.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269950+0000", 2024-04-19T02:16:36.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000143313 2024-04-19T02:16:36.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:36.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269955+0000", 2024-04-19T02:16:36.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4029999999999998e-06 2024-04-19T02:16:36.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:36.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.283806+0000", 2024-04-19T02:16:36.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013850220999999999 2024-04-19T02:16:36.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:36.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.283896+0000", 2024-04-19T02:16:36.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0261999999999997e-05 2024-04-19T02:16:36.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:36.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284022+0000", 2024-04-19T02:16:36.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012641200000000001 2024-04-19T02:16:36.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:36.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289066+0000", 2024-04-19T02:16:36.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050438490000000004 2024-04-19T02:16:36.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:36.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290011+0000", 2024-04-19T02:16:36.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00094490700000000004 2024-04-19T02:16:36.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:36.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290054+0000", 2024-04-19T02:16:36.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.337e-05 2024-04-19T02:16:36.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.030 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:36.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290099+0000", 2024-04-19T02:16:36.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4987999999999997e-05 2024-04-19T02:16:36.030 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:36.030 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:36.030 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:36.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.030 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:36.030 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:16:36.030 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 66.741265416000005, 2024-04-19T02:16:36.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020331023, 2024-04-19T02:16:36.031 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:36.031 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:36.031 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:36.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:36.031 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:16:36.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:36.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:36.031 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:16:36.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:36.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:36.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269869+0000", 2024-04-19T02:16:36.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:36.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:36.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269873+0000", 2024-04-19T02:16:36.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0219999999999998e-06 2024-04-19T02:16:36.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:36.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269881+0000", 2024-04-19T02:16:36.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.79e-06 2024-04-19T02:16:36.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:36.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269887+0000", 2024-04-19T02:16:36.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7899999999999996e-06 2024-04-19T02:16:36.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:36.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269983+0000", 2024-04-19T02:16:36.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6057000000000005e-05 2024-04-19T02:16:36.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:36.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269986+0000", 2024-04-19T02:16:36.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9220000000000001e-06 2024-04-19T02:16:36.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:36.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284350+0000", 2024-04-19T02:16:36.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014364335000000001 2024-04-19T02:16:36.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:36.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284664+0000", 2024-04-19T02:16:36.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000313646 2024-04-19T02:16:36.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:36.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284794+0000", 2024-04-19T02:16:36.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129839 2024-04-19T02:16:36.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.035 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:36.035 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289107+0000", 2024-04-19T02:16:36.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0043127060000000004 2024-04-19T02:16:36.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.035 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:36.035 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290108+0000", 2024-04-19T02:16:36.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0010010590000000001 2024-04-19T02:16:36.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.035 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:36.035 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290144+0000", 2024-04-19T02:16:36.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6709999999999999e-05 2024-04-19T02:16:36.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.036 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:36.036 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290201+0000", 2024-04-19T02:16:36.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6654999999999999e-05 2024-04-19T02:16:36.036 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:36.036 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:36.036 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:36.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.036 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:36.036 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:16:36.036 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 66.741223074999994, 2024-04-19T02:16:36.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020507241999999998, 2024-04-19T02:16:36.036 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:36.036 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:36.037 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:36.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:36.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:16:36.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:36.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:36.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:16:36.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:36.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:36.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:16:36.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:36.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:36.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269915+0000", 2024-04-19T02:16:36.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.472e-06 2024-04-19T02:16:36.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:36.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269928+0000", 2024-04-19T02:16:36.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2979000000000001e-05 2024-04-19T02:16:36.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:36.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269935+0000", 2024-04-19T02:16:36.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8859999999999998e-06 2024-04-19T02:16:36.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:36.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270009+0000", 2024-04-19T02:16:36.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3429000000000005e-05 2024-04-19T02:16:36.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:36.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270013+0000", 2024-04-19T02:16:36.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2590000000000002e-06 2024-04-19T02:16:36.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:36.040 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285375+0000", 2024-04-19T02:16:36.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015362275999999999 2024-04-19T02:16:36.040 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.040 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:36.040 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285451+0000", 2024-04-19T02:16:36.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5338000000000003e-05 2024-04-19T02:16:36.040 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.040 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:36.040 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285562+0000", 2024-04-19T02:16:36.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000111285 2024-04-19T02:16:36.040 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.040 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:36.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289134+0000", 2024-04-19T02:16:36.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035719670000000001 2024-04-19T02:16:36.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:36.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290341+0000", 2024-04-19T02:16:36.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012074500000000001 2024-04-19T02:16:36.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:36.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290383+0000", 2024-04-19T02:16:36.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1386e-05 2024-04-19T02:16:36.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:36.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290419+0000", 2024-04-19T02:16:36.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6884000000000001e-05 2024-04-19T02:16:36.042 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:36.042 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:36.042 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:36.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.042 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:36.042 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269945+0000", 2024-04-19T02:16:36.042 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 66.741190493000005, 2024-04-19T02:16:36.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019709098000000001, 2024-04-19T02:16:36.042 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:36.042 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:36.043 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:36.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:36.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269945+0000", 2024-04-19T02:16:36.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:36.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:36.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269945+0000", 2024-04-19T02:16:36.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:36.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:36.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269944+0000", 2024-04-19T02:16:36.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:36.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:36.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269965+0000", 2024-04-19T02:16:36.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0803999999999999e-05 2024-04-19T02:16:36.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:36.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269973+0000", 2024-04-19T02:16:36.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3560000000000004e-06 2024-04-19T02:16:36.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:36.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269982+0000", 2024-04-19T02:16:36.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9600000000000006e-06 2024-04-19T02:16:36.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.045 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:36.045 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270014+0000", 2024-04-19T02:16:36.045 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2913000000000001e-05 2024-04-19T02:16:36.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.045 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:36.045 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270018+0000", 2024-04-19T02:16:36.045 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2200000000000001e-06 2024-04-19T02:16:36.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.045 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:36.045 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278999+0000", 2024-04-19T02:16:36.045 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0089818009999999993 2024-04-19T02:16:36.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:36.046 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.279088+0000", 2024-04-19T02:16:36.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8988999999999998e-05 2024-04-19T02:16:36.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:36.046 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.280160+0000", 2024-04-19T02:16:36.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001071572 2024-04-19T02:16:36.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:36.046 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288342+0000", 2024-04-19T02:16:36.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.008182468 2024-04-19T02:16:36.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:36.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289545+0000", 2024-04-19T02:16:36.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012026739999999999 2024-04-19T02:16:36.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:36.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289608+0000", 2024-04-19T02:16:36.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2904999999999995e-05 2024-04-19T02:16:36.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:36.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289654+0000", 2024-04-19T02:16:36.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5850000000000003e-05 2024-04-19T02:16:36.047 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:36.047 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:36.048 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:36.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.048 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:36.048 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:16:36.048 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 66.741144814999998, 2024-04-19T02:16:36.048 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022007204999999998, 2024-04-19T02:16:36.048 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:36.048 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:36.048 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:36.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.048 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:36.048 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:16:36.048 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:36.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.048 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:36.049 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:16:36.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:36.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.049 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:36.049 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269990+0000", 2024-04-19T02:16:36.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:36.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.049 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:36.049 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269999+0000", 2024-04-19T02:16:36.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9539999999999993e-06 2024-04-19T02:16:36.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.049 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:36.050 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270006+0000", 2024-04-19T02:16:36.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.216e-06 2024-04-19T02:16:36.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.050 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:36.050 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270012+0000", 2024-04-19T02:16:36.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5049999999999998e-06 2024-04-19T02:16:36.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.050 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:36.050 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270058+0000", 2024-04-19T02:16:36.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.634e-05 2024-04-19T02:16:36.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.051 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:36.051 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270064+0000", 2024-04-19T02:16:36.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0669999999999997e-06 2024-04-19T02:16:36.051 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.051 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:36.051 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287159+0000", 2024-04-19T02:16:36.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017095086999999998 2024-04-19T02:16:36.051 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.051 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:36.051 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287254+0000", 2024-04-19T02:16:36.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4716000000000006e-05 2024-04-19T02:16:36.051 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:36.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287389+0000", 2024-04-19T02:16:36.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013511900000000001 2024-04-19T02:16:36.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:36.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290481+0000", 2024-04-19T02:16:36.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030920169999999999 2024-04-19T02:16:36.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:36.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291931+0000", 2024-04-19T02:16:36.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001450118 2024-04-19T02:16:36.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:36.053 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291960+0000", 2024-04-19T02:16:36.053 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9096000000000001e-05 2024-04-19T02:16:36.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.053 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:36.053 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291998+0000", 2024-04-19T02:16:36.053 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7514e-05 2024-04-19T02:16:36.053 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:36.053 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:36.053 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:36.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.053 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:36.053 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:36.054 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 66.741084244000007, 2024-04-19T02:16:36.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020759494999999999, 2024-04-19T02:16:36.054 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:36.054 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:36.054 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:36.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.054 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:36.054 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:36.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:36.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.054 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:36.054 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:36.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:36.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.055 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:36.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:36.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:36.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.055 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:36.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270054+0000", 2024-04-19T02:16:36.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.27e-06 2024-04-19T02:16:36.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.055 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:36.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270061+0000", 2024-04-19T02:16:36.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1289999999999998e-06 2024-04-19T02:16:36.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.056 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:36.056 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270067+0000", 2024-04-19T02:16:36.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.207e-06 2024-04-19T02:16:36.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.056 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:36.056 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270105+0000", 2024-04-19T02:16:36.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7549999999999998e-05 2024-04-19T02:16:36.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.056 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:36.056 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270112+0000", 2024-04-19T02:16:36.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3200000000000002e-06 2024-04-19T02:16:36.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.056 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:36.056 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282454+0000", 2024-04-19T02:16:36.057 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012341569 2024-04-19T02:16:36.057 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.057 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:36.057 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282740+0000", 2024-04-19T02:16:36.057 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000286481 2024-04-19T02:16:36.057 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.057 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:36.057 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282879+0000", 2024-04-19T02:16:36.057 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013887799999999999 2024-04-19T02:16:36.057 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.057 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:36.057 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290325+0000", 2024-04-19T02:16:36.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074459779999999998 2024-04-19T02:16:36.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.058 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:36.058 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290759+0000", 2024-04-19T02:16:36.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000433688 2024-04-19T02:16:36.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.058 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:36.058 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290789+0000", 2024-04-19T02:16:36.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9960000000000001e-05 2024-04-19T02:16:36.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.058 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:36.058 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290811+0000", 2024-04-19T02:16:36.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1965999999999999e-05 2024-04-19T02:16:36.059 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:36.059 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:36.059 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:36.059 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.059 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.059 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:36.059 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:16:36.059 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 66.741034038999999, 2024-04-19T02:16:36.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020837887999999999, 2024-04-19T02:16:36.059 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:36.059 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:36.059 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:36.059 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.059 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:36.059 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:16:36.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:36.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:36.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:16:36.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:36.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:36.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:16:36.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:36.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:36.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270109+0000", 2024-04-19T02:16:36.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3110000000000006e-06 2024-04-19T02:16:36.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.061 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:36.061 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270117+0000", 2024-04-19T02:16:36.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0479999999999999e-06 2024-04-19T02:16:36.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.061 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:36.061 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270123+0000", 2024-04-19T02:16:36.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5500000000000002e-06 2024-04-19T02:16:36.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.061 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:36.061 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270150+0000", 2024-04-19T02:16:36.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7712000000000002e-05 2024-04-19T02:16:36.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.062 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:36.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270153+0000", 2024-04-19T02:16:36.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6089999999999999e-06 2024-04-19T02:16:36.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.062 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:36.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285958+0000", 2024-04-19T02:16:36.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015805274000000001 2024-04-19T02:16:36.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.062 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:36.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286126+0000", 2024-04-19T02:16:36.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016765700000000001 2024-04-19T02:16:36.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:36.063 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286296+0000", 2024-04-19T02:16:36.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017007 2024-04-19T02:16:36.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:36.063 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290426+0000", 2024-04-19T02:16:36.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041299839999999997 2024-04-19T02:16:36.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:36.063 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290867+0000", 2024-04-19T02:16:36.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00044083300000000001 2024-04-19T02:16:36.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.064 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.064 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:36.064 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290900+0000", 2024-04-19T02:16:36.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3380000000000002e-05 2024-04-19T02:16:36.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.064 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.064 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:36.064 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290939+0000", 2024-04-19T02:16:36.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8970000000000001e-05 2024-04-19T02:16:36.064 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:36.064 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:36.064 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:36.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.064 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.065 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:21 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:36.065 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:16:36.065 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 66.740945366999995, 2024-04-19T02:16:36.065 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020833187999999999, 2024-04-19T02:16:36.065 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:36.065 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:16:36.065 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:36.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:36.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:16:36.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:36.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:36.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:16:36.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:36.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:36.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270189+0000", 2024-04-19T02:16:36.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:36.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:36.067 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270192+0000", 2024-04-19T02:16:36.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7549999999999999e-06 2024-04-19T02:16:36.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.067 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:36.067 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270198+0000", 2024-04-19T02:16:36.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0859999999999998e-06 2024-04-19T02:16:36.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.067 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:36.067 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270204+0000", 2024-04-19T02:16:36.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1970000000000004e-06 2024-04-19T02:16:36.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:36.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270238+0000", 2024-04-19T02:16:36.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4282000000000001e-05 2024-04-19T02:16:36.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:36.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270240+0000", 2024-04-19T02:16:36.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3099999999999999e-06 2024-04-19T02:16:36.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:36.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287131+0000", 2024-04-19T02:16:36.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01689104 2024-04-19T02:16:36.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:36.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287262+0000", 2024-04-19T02:16:36.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130347 2024-04-19T02:16:36.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:36.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291023+0000", 2024-04-19T02:16:36.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037616350000000002 2024-04-19T02:16:36.069 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:36.069 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:36.069 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:36.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.069 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:16494 5.7 5:e2c19dca:::benchmark_data_smithi121_44835_object16493:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:36.070 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.871684+0000", 2024-04-19T02:16:36.070 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 36.139451712000003, 2024-04-19T02:16:36.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019343257999999999, 2024-04-19T02:16:36.070 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:36.070 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:36.070 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:36.070 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:36.070 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:36.070 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16494 2024-04-19T02:16:36.070 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.070 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:36.070 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.070 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:36.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871684+0000", 2024-04-19T02:16:36.071 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:36.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.071 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:36.071 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871684+0000", 2024-04-19T02:16:36.071 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:36.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.071 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:36.071 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871683+0000", 2024-04-19T02:16:36.071 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:36.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.071 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:36.072 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871762+0000", 2024-04-19T02:16:36.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8981999999999997e-05 2024-04-19T02:16:36.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.072 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:36.072 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871770+0000", 2024-04-19T02:16:36.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7060000000000004e-06 2024-04-19T02:16:36.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.072 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:36.072 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871776+0000", 2024-04-19T02:16:36.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4880000000000004e-06 2024-04-19T02:16:36.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:36.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.874098+0000", 2024-04-19T02:16:36.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0023215309999999999 2024-04-19T02:16:36.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:36.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.874245+0000", 2024-04-19T02:16:36.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014735599999999999 2024-04-19T02:16:36.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:36.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.874394+0000", 2024-04-19T02:16:36.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014848300000000001 2024-04-19T02:16:36.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:36.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.876474+0000", 2024-04-19T02:16:36.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020803060000000001 2024-04-19T02:16:36.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:36.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.890939+0000", 2024-04-19T02:16:36.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014464985 2024-04-19T02:16:36.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:36.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.890986+0000", 2024-04-19T02:16:36.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7321000000000003e-05 2024-04-19T02:16:36.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:36.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891027+0000", 2024-04-19T02:16:36.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0689999999999998e-05 2024-04-19T02:16:36.075 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:36.075 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:36.075 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:36.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.075 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:16519 5.f 5:fc30d3a1:::benchmark_data_smithi121_44835_object16518:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:36.075 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.880723+0000", 2024-04-19T02:16:36.075 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 36.130412589000002, 2024-04-19T02:16:36.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020492519000000001, 2024-04-19T02:16:36.075 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:36.076 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:36.076 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:36.076 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:36.076 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:36.076 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16519 2024-04-19T02:16:36.076 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.076 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:36.076 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.076 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:36.076 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880723+0000", 2024-04-19T02:16:36.076 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:36.076 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.076 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.076 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:36.076 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880723+0000", 2024-04-19T02:16:36.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:36.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.077 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.077 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:36.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880722+0000", 2024-04-19T02:16:36.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:36.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.077 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.077 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:36.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880794+0000", 2024-04-19T02:16:36.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1515999999999998e-05 2024-04-19T02:16:36.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.077 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.077 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:36.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880805+0000", 2024-04-19T02:16:36.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1353e-05 2024-04-19T02:16:36.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:36.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880812+0000", 2024-04-19T02:16:36.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1230000000000002e-06 2024-04-19T02:16:36.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:36.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.890954+0000", 2024-04-19T02:16:36.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010142253 2024-04-19T02:16:36.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:36.079 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891079+0000", 2024-04-19T02:16:36.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000124917 2024-04-19T02:16:36.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.079 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:36.079 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891218+0000", 2024-04-19T02:16:36.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000138715 2024-04-19T02:16:36.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.079 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:36.079 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.897321+0000", 2024-04-19T02:16:36.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0061026830000000002 2024-04-19T02:16:36.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.079 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:36.079 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901137+0000", 2024-04-19T02:16:36.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038161699999999998 2024-04-19T02:16:36.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.080 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.080 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:36.080 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901181+0000", 2024-04-19T02:16:36.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4362e-05 2024-04-19T02:16:36.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.080 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.080 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:36.080 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901215+0000", 2024-04-19T02:16:36.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3929e-05 2024-04-19T02:16:36.080 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:36.080 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:36.081 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:36.081 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.081 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:16520 5.f 5:f0474691:::benchmark_data_smithi121_44835_object16519:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:36.081 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.880833+0000", 2024-04-19T02:16:36.081 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 36.130302573999998, 2024-04-19T02:16:36.081 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020460160000000002, 2024-04-19T02:16:36.081 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:36.081 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:36.081 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:36.081 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:36.081 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:36.081 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16520 2024-04-19T02:16:36.081 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.081 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:36.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.082 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:36.082 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880833+0000", 2024-04-19T02:16:36.082 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:36.082 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.082 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:36.082 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880833+0000", 2024-04-19T02:16:36.082 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:36.082 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.082 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:36.082 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880832+0000", 2024-04-19T02:16:36.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:36.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:36.083 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880909+0000", 2024-04-19T02:16:36.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7095000000000006e-05 2024-04-19T02:16:36.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:36.083 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880919+0000", 2024-04-19T02:16:36.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8919999999999995e-06 2024-04-19T02:16:36.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:36.083 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880927+0000", 2024-04-19T02:16:36.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8809999999999996e-06 2024-04-19T02:16:36.084 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.084 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.084 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:36.084 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891901+0000", 2024-04-19T02:16:36.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010974263999999999 2024-04-19T02:16:36.084 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.084 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.084 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:36.084 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.892021+0000", 2024-04-19T02:16:36.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120074 2024-04-19T02:16:36.084 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.084 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.084 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:36.085 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.892165+0000", 2024-04-19T02:16:36.085 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014328600000000001 2024-04-19T02:16:36.085 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.085 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.085 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:36.085 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.897347+0000", 2024-04-19T02:16:36.085 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.005182603 2024-04-19T02:16:36.085 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.085 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.085 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:36.085 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901224+0000", 2024-04-19T02:16:36.085 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038767620000000002 2024-04-19T02:16:36.085 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.085 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.085 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:36.086 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901264+0000", 2024-04-19T02:16:36.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9579000000000002e-05 2024-04-19T02:16:36.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.086 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:36.086 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901293+0000", 2024-04-19T02:16:36.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9300999999999999e-05 2024-04-19T02:16:36.086 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:36.086 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:36.086 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:36.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.086 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:44167 5.7 5:ef4300c4:::benchmark_data_smithi121_44835_object44166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:36.086 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:09.853830+0000", 2024-04-19T02:16:36.087 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.157305090000001, 2024-04-19T02:16:36.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020082104, 2024-04-19T02:16:36.087 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:36.087 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:36.087 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:36.087 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:36.087 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:36.087 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 44167 2024-04-19T02:16:36.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.087 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:36.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.087 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:36.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853830+0000", 2024-04-19T02:16:36.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:36.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:36.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853830+0000", 2024-04-19T02:16:36.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:36.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:36.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853829+0000", 2024-04-19T02:16:36.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:36.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:36.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853863+0000", 2024-04-19T02:16:36.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3151999999999997e-05 2024-04-19T02:16:36.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:36.089 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853873+0000", 2024-04-19T02:16:36.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0366e-05 2024-04-19T02:16:36.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:36.089 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853881+0000", 2024-04-19T02:16:36.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6539999999999999e-06 2024-04-19T02:16:36.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:36.089 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.859162+0000", 2024-04-19T02:16:36.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052810740000000002 2024-04-19T02:16:36.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:36.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.859303+0000", 2024-04-19T02:16:36.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000140975 2024-04-19T02:16:36.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:36.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.859460+0000", 2024-04-19T02:16:36.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015754199999999999 2024-04-19T02:16:36.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.091 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:36.091 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.865142+0000", 2024-04-19T02:16:36.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0056819130000000002 2024-04-19T02:16:36.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.091 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:36.091 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.873828+0000", 2024-04-19T02:16:36.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0086861799999999999 2024-04-19T02:16:36.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.091 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:36.091 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.873871+0000", 2024-04-19T02:16:36.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2624999999999999e-05 2024-04-19T02:16:36.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.092 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.092 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:36.092 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.873912+0000", 2024-04-19T02:16:36.092 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1486000000000002e-05 2024-04-19T02:16:36.092 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:36.092 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:36.092 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:36.092 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.092 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.092 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:53042 5.f 5:f744ac14:::benchmark_data_smithi121_44835_object53041:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T02:16:36.092 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:13.560196+0000", 2024-04-19T02:16:36.092 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.450939270999999, 2024-04-19T02:16:36.092 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020122021, 2024-04-19T02:16:36.092 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:36.092 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:36.093 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:36.093 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:36.093 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:36.093 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 53042 2024-04-19T02:16:36.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.093 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:36.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.093 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:36.093 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560196+0000", 2024-04-19T02:16:36.093 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:36.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.093 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:36.093 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560196+0000", 2024-04-19T02:16:36.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:36.094 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.094 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:36.094 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560195+0000", 2024-04-19T02:16:36.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:36.094 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.094 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:36.094 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560255+0000", 2024-04-19T02:16:36.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9441000000000002e-05 2024-04-19T02:16:36.094 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.094 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:36.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560264+0000", 2024-04-19T02:16:36.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1130000000000007e-06 2024-04-19T02:16:36.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:36.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560271+0000", 2024-04-19T02:16:36.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9800000000000001e-06 2024-04-19T02:16:36.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:36.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560312+0000", 2024-04-19T02:16:36.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0828999999999998e-05 2024-04-19T02:16:36.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:36.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560456+0000", 2024-04-19T02:16:36.096 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014474799999999999 2024-04-19T02:16:36.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.096 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:36.096 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560591+0000", 2024-04-19T02:16:36.096 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013482699999999999 2024-04-19T02:16:36.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.096 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:36.096 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.564799+0000", 2024-04-19T02:16:36.096 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042080080000000001 2024-04-19T02:16:36.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.096 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:36.096 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580233+0000", 2024-04-19T02:16:36.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015433715000000001 2024-04-19T02:16:36.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:36.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580280+0000", 2024-04-19T02:16:36.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6465000000000003e-05 2024-04-19T02:16:36.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:36.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580318+0000", 2024-04-19T02:16:36.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8557999999999999e-05 2024-04-19T02:16:36.097 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:36.097 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:36.097 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:36.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.098 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:53044 5.7 5:ec8fd8f2:::benchmark_data_smithi121_44835_object53043:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T02:16:36.098 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:13.561281+0000", 2024-04-19T02:16:36.098 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.449854069000001, 2024-04-19T02:16:36.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019133752, 2024-04-19T02:16:36.098 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:36.098 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:36.098 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:36.098 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:36.098 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:36.098 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 53044 2024-04-19T02:16:36.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.098 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:36.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:36.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.561281+0000", 2024-04-19T02:16:36.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:36.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:36.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.561281+0000", 2024-04-19T02:16:36.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:36.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:36.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.561270+0000", 2024-04-19T02:16:36.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999886 2024-04-19T02:16:36.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.100 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:36.100 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.561364+0000", 2024-04-19T02:16:36.100 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4721000000000003e-05 2024-04-19T02:16:36.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.100 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.100 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:36.100 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.561375+0000", 2024-04-19T02:16:36.100 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0900999999999999e-05 2024-04-19T02:16:36.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.100 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.100 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:36.100 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.561383+0000", 2024-04-19T02:16:36.100 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5460000000000003e-06 2024-04-19T02:16:36.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.100 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.101 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:36.101 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.562716+0000", 2024-04-19T02:16:36.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001333592 2024-04-19T02:16:36.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.101 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:36.101 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.562831+0000", 2024-04-19T02:16:36.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000114585 2024-04-19T02:16:36.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.101 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:36.101 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.562984+0000", 2024-04-19T02:16:36.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000152724 2024-04-19T02:16:36.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:36.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.571517+0000", 2024-04-19T02:16:36.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0085335199999999993 2024-04-19T02:16:36.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:36.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580332+0000", 2024-04-19T02:16:36.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0088147859999999998 2024-04-19T02:16:36.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:36.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580377+0000", 2024-04-19T02:16:36.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5293000000000002e-05 2024-04-19T02:16:36.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:36.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580415+0000", 2024-04-19T02:16:36.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7756999999999998e-05 2024-04-19T02:16:36.103 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:36.103 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:36.103 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:36.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.103 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:85866 5.2 5:48b1d46d:::benchmark_data_smithi121_44835_object85865:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T02:16:36.103 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:30.771909+0000", 2024-04-19T02:16:36.103 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.2392259990000003, 2024-04-19T02:16:36.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020516216, 2024-04-19T02:16:36.103 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:36.103 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:36.103 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:36.104 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:36.104 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:36.104 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 85866 2024-04-19T02:16:36.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.104 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:36.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:36.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771909+0000", 2024-04-19T02:16:36.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:36.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:36.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771909+0000", 2024-04-19T02:16:36.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:36.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:36.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771909+0000", 2024-04-19T02:16:36.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:36.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:36.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771952+0000", 2024-04-19T02:16:36.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2660000000000002e-05 2024-04-19T02:16:36.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.106 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:36.106 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771959+0000", 2024-04-19T02:16:36.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7670000000000003e-06 2024-04-19T02:16:36.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.106 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:36.106 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771966+0000", 2024-04-19T02:16:36.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.905e-06 2024-04-19T02:16:36.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.106 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:36.106 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771999+0000", 2024-04-19T02:16:36.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2360999999999997e-05 2024-04-19T02:16:36.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:36.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.772133+0000", 2024-04-19T02:16:36.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013398699999999999 2024-04-19T02:16:36.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:36.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.772280+0000", 2024-04-19T02:16:36.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000147198 2024-04-19T02:16:36.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:36.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.774312+0000", 2024-04-19T02:16:36.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020325339999999999 2024-04-19T02:16:36.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:36.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.792370+0000", 2024-04-19T02:16:36.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018057321000000001 2024-04-19T02:16:36.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:36.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.792403+0000", 2024-04-19T02:16:36.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3247000000000002e-05 2024-04-19T02:16:36.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:36.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.792426+0000", 2024-04-19T02:16:36.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2697999999999999e-05 2024-04-19T02:16:36.109 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:36.109 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:36.109 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:36.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.109 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:94438 5.7 5:eb242aac:::benchmark_data_smithi121_44835_object94437:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T02:16:36.109 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:35.095629+0000", 2024-04-19T02:16:36.109 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.91550597600000005, 2024-04-19T02:16:36.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019240869000000001, 2024-04-19T02:16:36.109 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:36.109 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:36.109 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:36.109 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:36.109 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:36.109 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 94438 2024-04-19T02:16:36.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.110 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:36.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.110 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:36.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.095629+0000", 2024-04-19T02:16:36.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:36.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.110 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:36.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.095629+0000", 2024-04-19T02:16:36.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:36.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:36.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.095628+0000", 2024-04-19T02:16:36.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:36.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:36.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.095652+0000", 2024-04-19T02:16:36.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3819999999999999e-05 2024-04-19T02:16:36.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:36.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.095660+0000", 2024-04-19T02:16:36.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0919999999999998e-06 2024-04-19T02:16:36.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:36.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.095665+0000", 2024-04-19T02:16:36.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2950000000000004e-06 2024-04-19T02:16:36.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:36.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.095686+0000", 2024-04-19T02:16:36.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1392000000000001e-05 2024-04-19T02:16:36.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:36.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.095791+0000", 2024-04-19T02:16:36.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010500100000000001 2024-04-19T02:16:36.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:36.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.095878+0000", 2024-04-19T02:16:36.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6674000000000004e-05 2024-04-19T02:16:36.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:36.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.097633+0000", 2024-04-19T02:16:36.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017547369999999999 2024-04-19T02:16:36.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:36.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.114800+0000", 2024-04-19T02:16:36.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017167449000000001 2024-04-19T02:16:36.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.114 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:36.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.114848+0000", 2024-04-19T02:16:36.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8096999999999997e-05 2024-04-19T02:16:36.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.114 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:36.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.114870+0000", 2024-04-19T02:16:36.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2158999999999999e-05 2024-04-19T02:16:36.114 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:36.114 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:36.114 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:36.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.114 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:94468 5.2 5:4f406431:::benchmark_data_smithi121_44835_object94467:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T02:16:36.114 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:16:36.115 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.89970618499999999, 2024-04-19T02:16:36.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024835144999999999, 2024-04-19T02:16:36.115 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:36.115 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:36.115 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:36.115 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:36.115 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:36.115 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 94468 2024-04-19T02:16:36.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.115 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:36.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:36.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:16:36.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:36.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:36.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:16:36.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:36.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:36.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:16:36.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:36.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:36.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111498+0000", 2024-04-19T02:16:36.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9529000000000005e-05 2024-04-19T02:16:36.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.117 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:36.117 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111506+0000", 2024-04-19T02:16:36.117 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9030000000000004e-06 2024-04-19T02:16:36.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.117 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:36.117 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111513+0000", 2024-04-19T02:16:36.117 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8759999999999999e-06 2024-04-19T02:16:36.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.117 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:36.117 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112466+0000", 2024-04-19T02:16:36.117 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00095318499999999995 2024-04-19T02:16:36.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:36.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112590+0000", 2024-04-19T02:16:36.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012380900000000001 2024-04-19T02:16:36.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:36.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112728+0000", 2024-04-19T02:16:36.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013753800000000001 2024-04-19T02:16:36.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:36.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115064+0000", 2024-04-19T02:16:36.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002336819 2024-04-19T02:16:36.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:36.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136207+0000", 2024-04-19T02:16:36.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021142942000000001 2024-04-19T02:16:36.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:36.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136241+0000", 2024-04-19T02:16:36.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3577000000000001e-05 2024-04-19T02:16:36.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:36.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136264+0000", 2024-04-19T02:16:36.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3421000000000002e-05 2024-04-19T02:16:36.119 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:36.120 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:36.120 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:36.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.120 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:94472 5.2 5:45b7e9be:::benchmark_data_smithi121_44835_object94471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:36.120 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:16:36.120 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.89605965399999998, 2024-04-19T02:16:36.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021273843000000001, 2024-04-19T02:16:36.120 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:36.120 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:36.120 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:36.120 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:36.120 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:36.120 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 94472 2024-04-19T02:16:36.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.121 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:36.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:36.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:16:36.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:36.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:36.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:16:36.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:36.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:36.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115075+0000", 2024-04-19T02:16:36.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:36.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:36.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115161+0000", 2024-04-19T02:16:36.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6632000000000007e-05 2024-04-19T02:16:36.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:36.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115171+0000", 2024-04-19T02:16:36.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2969999999999992e-06 2024-04-19T02:16:36.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:36.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115178+0000", 2024-04-19T02:16:36.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7610000000000007e-06 2024-04-19T02:16:36.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.123 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:36.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115213+0000", 2024-04-19T02:16:36.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5000999999999999e-05 2024-04-19T02:16:36.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.123 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:36.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115303+0000", 2024-04-19T02:16:36.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9791999999999997e-05 2024-04-19T02:16:36.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:36.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115391+0000", 2024-04-19T02:16:36.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7559000000000007e-05 2024-04-19T02:16:36.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:36.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.117894+0000", 2024-04-19T02:16:36.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002503496 2024-04-19T02:16:36.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:36.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136297+0000", 2024-04-19T02:16:36.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018402335999999998 2024-04-19T02:16:36.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.125 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:36.125 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136327+0000", 2024-04-19T02:16:36.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0534999999999998e-05 2024-04-19T02:16:36.125 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:36.125 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:36.125 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:36.125 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136350+0000", 2024-04-19T02:16:36.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2427999999999999e-05 2024-04-19T02:16:36.125 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:36.125 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:36.125 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:36.125 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:36.125 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:36.125 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:16:36.127 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 41 16 96231 96215 146.657 120 0.0056528 0.00681578 2024-04-19T02:16:36.127 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:36.127+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:36.128 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:16:36.129 INFO:teuthology.orchestra.run.smithi121.stderr:reweighted osd.1 to 1 (10000) 2024-04-19T02:16:36.129 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-19T02:16:36.228 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:36.228+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:36.302 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:16:36.302 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:16:36.302 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.302 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:96749 5.e 5:79c379bf:::benchmark_data_smithi121_44835_object96748:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-19T02:16:36.302 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:36.300588+0000", 2024-04-19T02:16:36.302 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0022433679999999999, 2024-04-19T02:16:36.302 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.002265497, 2024-04-19T02:16:36.302 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:36.303 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:36.303 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:36.303 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:36.303 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:36.303 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 96749 2024-04-19T02:16:36.303 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.303 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:36.303 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.303 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:36.303 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.300588+0000", 2024-04-19T02:16:36.303 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:36.303 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.303 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.303 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:36.304 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.300588+0000", 2024-04-19T02:16:36.304 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:36.304 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.304 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.304 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:36.304 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.300587+0000", 2024-04-19T02:16:36.304 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:36.304 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.304 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.304 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:36.304 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.300628+0000", 2024-04-19T02:16:36.304 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0664999999999998e-05 2024-04-19T02:16:36.304 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.304 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.304 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:36.305 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.300643+0000", 2024-04-19T02:16:36.305 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.5180999999999999e-05 2024-04-19T02:16:36.305 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.305 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.305 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:36.305 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.300652+0000", 2024-04-19T02:16:36.305 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.1880000000000008e-06 2024-04-19T02:16:36.305 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.305 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.305 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:36.305 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.300722+0000", 2024-04-19T02:16:36.305 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.0063999999999999e-05 2024-04-19T02:16:36.305 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.305 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.305 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:36.305 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.300852+0000", 2024-04-19T02:16:36.306 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000129703 2024-04-19T02:16:36.306 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.306 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.306 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:36.306 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.301012+0000", 2024-04-19T02:16:36.306 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00015987999999999999 2024-04-19T02:16:36.306 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:36.306 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:36.306 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:36.306 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.306 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.306 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:96751 5.0 5:0dddf4f2:::benchmark_data_smithi121_44835_object96750:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-19T02:16:36.306 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:36.301057+0000", 2024-04-19T02:16:36.306 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0017743069999999999, 2024-04-19T02:16:36.307 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0018470279999999999, 2024-04-19T02:16:36.307 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:36.307 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:36.307 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:36.307 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:36.307 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:36.307 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 96751 2024-04-19T02:16:36.307 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.307 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:36.307 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.307 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:36.307 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.301057+0000", 2024-04-19T02:16:36.307 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:36.307 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.307 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.308 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:36.308 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.301057+0000", 2024-04-19T02:16:36.308 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:36.308 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.308 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.308 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:36.308 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.301056+0000", 2024-04-19T02:16:36.308 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:36.308 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.308 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.308 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:36.308 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.301113+0000", 2024-04-19T02:16:36.308 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.6892999999999999e-05 2024-04-19T02:16:36.308 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.308 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.309 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:36.309 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.301124+0000", 2024-04-19T02:16:36.309 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1411e-05 2024-04-19T02:16:36.309 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.309 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.309 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:36.309 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.301132+0000", 2024-04-19T02:16:36.309 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.6510000000000001e-06 2024-04-19T02:16:36.309 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.309 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.309 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:36.309 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.301164+0000", 2024-04-19T02:16:36.309 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2234999999999999e-05 2024-04-19T02:16:36.309 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.309 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.310 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:36.310 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.301247+0000", 2024-04-19T02:16:36.310 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2891000000000003e-05 2024-04-19T02:16:36.310 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.310 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.310 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:36.310 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.301330+0000", 2024-04-19T02:16:36.310 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2845999999999999e-05 2024-04-19T02:16:36.310 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:36.310 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:36.310 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:36.310 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.310 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.310 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:96748 5.d e36/16 5:b50d8244:::benchmark_data_smithi121_44835_object96747:head v 36'6072, mlcod=36'6069)", 2024-04-19T02:16:36.310 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:36.301329+0000", 2024-04-19T02:16:36.311 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0015018329999999999, 2024-04-19T02:16:36.311 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016168020000000001, 2024-04-19T02:16:36.311 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:36.311 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:16:36.311 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:36.311 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.311 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:36.311 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.301329+0000", 2024-04-19T02:16:36.311 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:36.311 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.311 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.311 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:36.311 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.301329+0000", 2024-04-19T02:16:36.311 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:36.311 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.312 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.312 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:36.312 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.301329+0000", 2024-04-19T02:16:36.312 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:36.312 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.312 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.312 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:36.312 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.301382+0000", 2024-04-19T02:16:36.312 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.3365000000000002e-05 2024-04-19T02:16:36.312 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.312 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.312 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:36.312 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.301388+0000", 2024-04-19T02:16:36.312 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.2260000000000002e-06 2024-04-19T02:16:36.312 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.313 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.313 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:36.313 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.301392+0000", 2024-04-19T02:16:36.313 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9550000000000002e-06 2024-04-19T02:16:36.313 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.313 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.313 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:36.313 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.301429+0000", 2024-04-19T02:16:36.313 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6925999999999998e-05 2024-04-19T02:16:36.313 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.313 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.313 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:36.313 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.301450+0000", 2024-04-19T02:16:36.313 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.0696999999999999e-05 2024-04-19T02:16:36.314 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:36.314 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:36.314 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:36.314 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.314 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.314 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "MOSDPGPush(5.1 36/29 [PushOp(5:86440b67:::benchmark_data_smithi121_44835_object70736:head, version: 27'4303, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(5:86440b67:::benchmark_data_smithi121_44835_object70736:head@27'4303, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-04-19T02:16:36.314 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:36.302117+0000", 2024-04-19T02:16:36.314 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.00071418800000000004, 2024-04-19T02:16:36.314 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00087730000000000002, 2024-04-19T02:16:36.314 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:36.314 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:16:36.314 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:36.314 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.314 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:36.315 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.302117+0000", 2024-04-19T02:16:36.315 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:36.315 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.315 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.315 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:36.315 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.302117+0000", 2024-04-19T02:16:36.315 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:36.315 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.315 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.315 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:36.315 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.302117+0000", 2024-04-19T02:16:36.315 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:36.315 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.315 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.315 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:36.316 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.302183+0000", 2024-04-19T02:16:36.316 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6520999999999995e-05 2024-04-19T02:16:36.316 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.316 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.316 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:36.316 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.302194+0000", 2024-04-19T02:16:36.316 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1008e-05 2024-04-19T02:16:36.316 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.316 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.316 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:36.316 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.302204+0000", 2024-04-19T02:16:36.316 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.9420000000000007e-06 2024-04-19T02:16:36.316 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.316 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.316 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:36.317 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.302262+0000", 2024-04-19T02:16:36.317 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.8366999999999999e-05 2024-04-19T02:16:36.317 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.317 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.317 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:36.317 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.302275+0000", 2024-04-19T02:16:36.317 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2446000000000001e-05 2024-04-19T02:16:36.317 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:36.317 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:36.317 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:36.317 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.317 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.317 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "pg_backfill(progress 5.1 e 36/36 lb 5:8643f5e4:::benchmark_data_smithi121_44835_object45434:head)", 2024-04-19T02:16:36.317 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:36.302214+0000", 2024-04-19T02:16:36.317 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.00061722000000000003, 2024-04-19T02:16:36.318 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00081351600000000002, 2024-04-19T02:16:36.318 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:36.318 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "queued for pg", 2024-04-19T02:16:36.318 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:36.318 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.318 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:36.318 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.302214+0000", 2024-04-19T02:16:36.318 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:36.318 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.318 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.318 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:36.318 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.302214+0000", 2024-04-19T02:16:36.318 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:36.318 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.319 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.319 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:36.319 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.302214+0000", 2024-04-19T02:16:36.319 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:36.319 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.319 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.319 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:36.319 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.302219+0000", 2024-04-19T02:16:36.319 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.8130000000000001e-06 2024-04-19T02:16:36.319 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.319 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.319 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:36.319 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.302230+0000", 2024-04-19T02:16:36.319 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0142999999999999e-05 2024-04-19T02:16:36.319 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.320 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.320 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:36.320 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.302235+0000", 2024-04-19T02:16:36.320 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.6110000000000001e-06 2024-04-19T02:16:36.320 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:36.320 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:36.320 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:36.320 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:36.320 INFO:teuthology.orchestra.run.smithi174.stdout: ], 2024-04-19T02:16:36.320 INFO:teuthology.orchestra.run.smithi174.stdout: "num_ops": 5 2024-04-19T02:16:36.320 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:16:36.321 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:16:36.363 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:36.363+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:36.429 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:36.429+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:36.525 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:16:36.526 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [], 2024-04-19T02:16:36.526 INFO:teuthology.orchestra.run.smithi174.stdout: "complaint_time": 30, 2024-04-19T02:16:36.526 INFO:teuthology.orchestra.run.smithi174.stdout: "num_blocked_ops": 0 2024-04-19T02:16:36.526 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:16:36.531 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:36.531+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:36.540 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:16:36.630 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:36.631+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:36.731 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:36.731+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:36.759 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:16:36.759 INFO:teuthology.orchestra.run.smithi174.stdout: "size": 20, 2024-04-19T02:16:36.759 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 600, 2024-04-19T02:16:36.759 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:16:36.759 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.759 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:10 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:36.759 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269877+0000", 2024-04-19T02:16:36.759 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 67.487144487999998, 2024-04-19T02:16:36.759 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020732751000000001, 2024-04-19T02:16:36.759 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:36.759 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:36.759 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:36.759 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.760 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:36.760 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269877+0000", 2024-04-19T02:16:36.760 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:36.760 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.760 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.760 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:36.760 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269877+0000", 2024-04-19T02:16:36.760 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:36.760 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.760 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.760 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:36.760 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269875+0000", 2024-04-19T02:16:36.760 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:36.760 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.760 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.761 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:36.761 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269891+0000", 2024-04-19T02:16:36.761 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.5494000000000001e-05 2024-04-19T02:16:36.761 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.761 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.761 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:36.761 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269903+0000", 2024-04-19T02:16:36.761 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2003e-05 2024-04-19T02:16:36.761 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.761 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.761 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:36.761 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269914+0000", 2024-04-19T02:16:36.761 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0947e-05 2024-04-19T02:16:36.761 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.761 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.762 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:36.762 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269971+0000", 2024-04-19T02:16:36.762 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7036000000000001e-05 2024-04-19T02:16:36.762 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.762 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.762 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:16:36.762 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269979+0000", 2024-04-19T02:16:36.762 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.6660000000000008e-06 2024-04-19T02:16:36.762 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.762 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.762 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:36.762 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284891+0000", 2024-04-19T02:16:36.762 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014912584 2024-04-19T02:16:36.763 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.763 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.763 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:36.763 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285213+0000", 2024-04-19T02:16:36.763 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00032172199999999998 2024-04-19T02:16:36.763 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.763 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.763 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:36.763 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285357+0000", 2024-04-19T02:16:36.763 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014367899999999999 2024-04-19T02:16:36.763 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.763 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.763 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:36.763 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288883+0000", 2024-04-19T02:16:36.763 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0035268719999999999 2024-04-19T02:16:36.764 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.764 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.764 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:36.764 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290537+0000", 2024-04-19T02:16:36.764 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016537399999999999 2024-04-19T02:16:36.764 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.764 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.764 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:36.764 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290576+0000", 2024-04-19T02:16:36.764 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9266e-05 2024-04-19T02:16:36.764 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.764 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.764 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:36.764 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290609+0000", 2024-04-19T02:16:36.764 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2818000000000003e-05 2024-04-19T02:16:36.765 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:36.765 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:36.765 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:36.765 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.765 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.765 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:11 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:36.765 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:36.765 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 67.487091566999993, 2024-04-19T02:16:36.765 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020352748, 2024-04-19T02:16:36.765 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:36.765 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:36.765 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:36.765 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.765 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:36.765 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:36.766 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:36.766 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.766 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.766 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:36.766 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:36.766 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:36.766 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.766 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.766 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:36.766 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:36.766 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:36.766 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.766 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.766 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:36.766 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269933+0000", 2024-04-19T02:16:36.767 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2169999999999996e-06 2024-04-19T02:16:36.767 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.767 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.767 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:36.767 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269940+0000", 2024-04-19T02:16:36.767 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1500000000000002e-06 2024-04-19T02:16:36.767 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.767 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.767 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:36.767 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269948+0000", 2024-04-19T02:16:36.767 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.8690000000000004e-06 2024-04-19T02:16:36.767 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.767 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.767 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:36.767 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:16:36.767 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2994999999999997e-05 2024-04-19T02:16:36.768 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.768 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.768 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:16:36.768 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269997+0000", 2024-04-19T02:16:36.768 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.9020000000000004e-06 2024-04-19T02:16:36.768 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.768 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.768 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:36.768 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.282729+0000", 2024-04-19T02:16:36.768 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.012732537 2024-04-19T02:16:36.768 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.768 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.768 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:36.768 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.282838+0000", 2024-04-19T02:16:36.768 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000108298 2024-04-19T02:16:36.769 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.769 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.769 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:36.769 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.283002+0000", 2024-04-19T02:16:36.769 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00016466300000000001 2024-04-19T02:16:36.769 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.769 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.769 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:36.769 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288708+0000", 2024-04-19T02:16:36.769 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.005705066 2024-04-19T02:16:36.769 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.769 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.769 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:36.769 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290215+0000", 2024-04-19T02:16:36.769 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0015075010000000001 2024-04-19T02:16:36.770 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.770 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.770 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:36.770 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290259+0000", 2024-04-19T02:16:36.770 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3711999999999998e-05 2024-04-19T02:16:36.770 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.770 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.770 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:36.770 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290282+0000", 2024-04-19T02:16:36.770 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3458000000000001e-05 2024-04-19T02:16:36.770 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:36.770 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:36.770 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:36.770 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.771 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.771 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:14 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:36.771 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:36.771 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 67.487057777000004, 2024-04-19T02:16:36.771 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020137202, 2024-04-19T02:16:36.771 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:36.771 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:36.771 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:36.771 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.771 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:36.771 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:36.772 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:36.772 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.772 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.772 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:36.772 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:36.772 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:36.772 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.773 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.773 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:36.773 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:36.773 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:36.773 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.773 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.773 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:36.773 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269971+0000", 2024-04-19T02:16:36.773 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.5459999999999992e-06 2024-04-19T02:16:36.773 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.773 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.773 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:36.773 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269979+0000", 2024-04-19T02:16:36.773 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9130000000000003e-06 2024-04-19T02:16:36.774 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.774 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.774 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:36.774 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269986+0000", 2024-04-19T02:16:36.774 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.3779999999999998e-06 2024-04-19T02:16:36.774 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.774 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.774 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:36.774 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270030+0000", 2024-04-19T02:16:36.774 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3982e-05 2024-04-19T02:16:36.774 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.774 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.774 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:16:36.774 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270034+0000", 2024-04-19T02:16:36.775 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1779999999999996e-06 2024-04-19T02:16:36.775 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.775 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.775 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:36.775 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.277870+0000", 2024-04-19T02:16:36.775 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0078362150000000005 2024-04-19T02:16:36.775 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.775 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.775 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:36.775 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.278216+0000", 2024-04-19T02:16:36.775 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00034634999999999999 2024-04-19T02:16:36.775 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.775 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.775 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:36.775 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.278732+0000", 2024-04-19T02:16:36.776 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00051536099999999999 2024-04-19T02:16:36.776 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.776 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.776 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:36.776 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.287694+0000", 2024-04-19T02:16:36.776 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0089621019999999996 2024-04-19T02:16:36.776 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.776 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.776 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:36.776 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290026+0000", 2024-04-19T02:16:36.776 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0023323139999999998 2024-04-19T02:16:36.776 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.776 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.776 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:36.777 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290067+0000", 2024-04-19T02:16:36.777 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1043e-05 2024-04-19T02:16:36.777 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.777 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.777 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:36.777 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290100+0000", 2024-04-19T02:16:36.777 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3278999999999998e-05 2024-04-19T02:16:36.777 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:36.777 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:36.777 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:36.777 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.777 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.777 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:36.777 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:36.777 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 67.487025985000002, 2024-04-19T02:16:36.778 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020731702000000001, 2024-04-19T02:16:36.778 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:36.778 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:36.778 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:36.778 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.778 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:36.778 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:36.778 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:36.778 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.778 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.778 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:36.778 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:36.778 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:36.779 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.779 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.779 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:36.779 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:36.779 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:36.779 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.779 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.779 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:36.779 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269998+0000", 2024-04-19T02:16:36.779 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7100000000000001e-06 2024-04-19T02:16:36.779 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.779 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.779 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:36.779 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270005+0000", 2024-04-19T02:16:36.779 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.241e-06 2024-04-19T02:16:36.780 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.780 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.780 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:36.780 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270011+0000", 2024-04-19T02:16:36.780 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6279999999999999e-06 2024-04-19T02:16:36.780 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.780 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.780 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:36.780 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270046+0000", 2024-04-19T02:16:36.780 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5173999999999999e-05 2024-04-19T02:16:36.780 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.780 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.780 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:36.780 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:36.780 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0019999999999997e-06 2024-04-19T02:16:36.781 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.781 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.781 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:36.781 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285619+0000", 2024-04-19T02:16:36.781 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015567391 2024-04-19T02:16:36.781 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.781 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.781 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:36.781 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285671+0000", 2024-04-19T02:16:36.781 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2460999999999998e-05 2024-04-19T02:16:36.781 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.781 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.781 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:36.781 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285775+0000", 2024-04-19T02:16:36.781 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000103389 2024-04-19T02:16:36.781 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.782 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.782 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:36.782 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288934+0000", 2024-04-19T02:16:36.782 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0031595859999999998 2024-04-19T02:16:36.782 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.782 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.782 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:36.782 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290650+0000", 2024-04-19T02:16:36.782 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001716242 2024-04-19T02:16:36.782 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.782 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.782 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:36.782 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290692+0000", 2024-04-19T02:16:36.783 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1910999999999999e-05 2024-04-19T02:16:36.783 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.783 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.783 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:36.783 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290727+0000", 2024-04-19T02:16:36.783 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4412000000000002e-05 2024-04-19T02:16:36.783 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:36.783 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:36.783 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:36.783 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.783 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.783 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:36.783 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270019+0000", 2024-04-19T02:16:36.783 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 67.487002390000001, 2024-04-19T02:16:36.784 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020572014999999999, 2024-04-19T02:16:36.784 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:36.784 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:36.784 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:36.784 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.784 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:36.784 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270019+0000", 2024-04-19T02:16:36.784 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:36.784 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.784 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.784 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:36.784 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270019+0000", 2024-04-19T02:16:36.784 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:36.784 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.784 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.785 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:36.785 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270018+0000", 2024-04-19T02:16:36.785 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:36.785 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.785 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.785 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:36.785 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270021+0000", 2024-04-19T02:16:36.785 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0319999999999999e-06 2024-04-19T02:16:36.785 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.785 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.785 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:36.785 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270028+0000", 2024-04-19T02:16:36.785 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6189999999999996e-06 2024-04-19T02:16:36.785 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.786 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.786 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:36.786 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270035+0000", 2024-04-19T02:16:36.786 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1690000000000003e-06 2024-04-19T02:16:36.786 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.786 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.786 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:36.786 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270078+0000", 2024-04-19T02:16:36.786 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3061e-05 2024-04-19T02:16:36.786 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.786 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.786 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:36.786 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270082+0000", 2024-04-19T02:16:36.786 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4510000000000002e-06 2024-04-19T02:16:36.787 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.787 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.787 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:36.787 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284354+0000", 2024-04-19T02:16:36.787 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014271588999999999 2024-04-19T02:16:36.787 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.787 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.787 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:36.787 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284497+0000", 2024-04-19T02:16:36.787 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014335800000000001 2024-04-19T02:16:36.787 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.787 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.787 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:36.787 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284626+0000", 2024-04-19T02:16:36.788 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000128744 2024-04-19T02:16:36.788 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.788 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.788 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:36.788 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288844+0000", 2024-04-19T02:16:36.788 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00421807 2024-04-19T02:16:36.788 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.788 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.788 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:36.788 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290508+0000", 2024-04-19T02:16:36.788 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001663774 2024-04-19T02:16:36.788 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.788 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.788 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:36.788 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290556+0000", 2024-04-19T02:16:36.789 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.7599999999999998e-05 2024-04-19T02:16:36.789 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.789 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.789 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:36.789 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290591+0000", 2024-04-19T02:16:36.789 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5034999999999999e-05 2024-04-19T02:16:36.789 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:36.789 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:36.789 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:36.789 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.789 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.789 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:36.789 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:36.789 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 67.486979527000003, 2024-04-19T02:16:36.789 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020192280999999999, 2024-04-19T02:16:36.790 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:36.790 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:36.790 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:36.790 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.790 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:36.790 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:36.790 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:36.790 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.790 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.790 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:36.790 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:36.790 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:36.790 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.790 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.791 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:36.791 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:36.791 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:36.791 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.791 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.791 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:36.791 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270045+0000", 2024-04-19T02:16:36.791 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8680000000000001e-06 2024-04-19T02:16:36.791 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.791 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.791 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:36.791 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270052+0000", 2024-04-19T02:16:36.791 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.9999999999999999e-06 2024-04-19T02:16:36.791 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.791 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.791 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:36.792 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270056+0000", 2024-04-19T02:16:36.792 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4479999999999996e-06 2024-04-19T02:16:36.792 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.792 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.792 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:36.792 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270089+0000", 2024-04-19T02:16:36.792 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3071000000000002e-05 2024-04-19T02:16:36.792 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.792 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.792 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:36.792 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270092+0000", 2024-04-19T02:16:36.792 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9780000000000001e-06 2024-04-19T02:16:36.792 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.792 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.793 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:36.793 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.280632+0000", 2024-04-19T02:16:36.793 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010539712 2024-04-19T02:16:36.793 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.793 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.793 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:36.793 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.280743+0000", 2024-04-19T02:16:36.793 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000111048 2024-04-19T02:16:36.793 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.793 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.793 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:36.793 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.281531+0000", 2024-04-19T02:16:36.793 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00078738199999999999 2024-04-19T02:16:36.793 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.794 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.794 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:36.794 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.287949+0000", 2024-04-19T02:16:36.794 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0064185730000000003 2024-04-19T02:16:36.794 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.794 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.794 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:36.794 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290184+0000", 2024-04-19T02:16:36.794 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0022350849999999999 2024-04-19T02:16:36.795 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.795 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.795 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:36.795 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290209+0000", 2024-04-19T02:16:36.795 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4907000000000001e-05 2024-04-19T02:16:36.795 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.795 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.795 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:36.795 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290234+0000", 2024-04-19T02:16:36.795 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4666999999999999e-05 2024-04-19T02:16:36.795 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:36.795 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:36.795 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:36.795 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.796 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.796 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:19 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:36.796 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:36.796 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 67.486958060999996, 2024-04-19T02:16:36.796 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020818203, 2024-04-19T02:16:36.796 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:36.796 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:36.796 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:36.796 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.796 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:36.796 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:36.796 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:36.796 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.797 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.797 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:36.797 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:36.797 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:36.797 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.797 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.797 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:36.797 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:36.797 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:36.797 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.797 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.797 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:36.797 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270065+0000", 2024-04-19T02:16:36.797 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4310000000000001e-06 2024-04-19T02:16:36.797 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.797 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.798 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:36.798 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270070+0000", 2024-04-19T02:16:36.798 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2859999999999999e-06 2024-04-19T02:16:36.798 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.798 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.798 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:36.798 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270077+0000", 2024-04-19T02:16:36.798 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5270000000000004e-06 2024-04-19T02:16:36.798 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.798 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.798 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:36.799 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270107+0000", 2024-04-19T02:16:36.799 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0205999999999998e-05 2024-04-19T02:16:36.799 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.799 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.799 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:36.799 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270111+0000", 2024-04-19T02:16:36.799 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8650000000000003e-06 2024-04-19T02:16:36.799 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.799 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.799 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:36.799 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285936+0000", 2024-04-19T02:16:36.799 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015824677999999998 2024-04-19T02:16:36.799 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.799 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.799 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:36.800 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286007+0000", 2024-04-19T02:16:36.800 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1157999999999999e-05 2024-04-19T02:16:36.800 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.800 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.800 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:36.800 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286086+0000", 2024-04-19T02:16:36.800 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9084000000000004e-05 2024-04-19T02:16:36.800 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.800 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.800 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:36.800 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290740+0000", 2024-04-19T02:16:36.800 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0046543679999999999 2024-04-19T02:16:36.800 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.800 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.801 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:36.801 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290833+0000", 2024-04-19T02:16:36.801 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2551000000000002e-05 2024-04-19T02:16:36.801 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.801 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.801 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:36.801 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290859+0000", 2024-04-19T02:16:36.801 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.6696999999999999e-05 2024-04-19T02:16:36.801 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.801 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.801 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:36.801 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290881+0000", 2024-04-19T02:16:36.801 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1653000000000001e-05 2024-04-19T02:16:36.801 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:36.801 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:36.802 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:36.802 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.802 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.802 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:77621 5.8 5:181e11e0:::benchmark_data_smithi121_44835_object77620:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:36.802 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:26.805140+0000", 2024-04-19T02:16:36.802 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 9.9518809590000004, 2024-04-19T02:16:36.802 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020068342999999999, 2024-04-19T02:16:36.802 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:36.802 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:36.802 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:36.802 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:36.802 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:36.802 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 77621 2024-04-19T02:16:36.802 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.803 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:36.803 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.803 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:36.803 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805140+0000", 2024-04-19T02:16:36.803 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:36.803 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.803 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.803 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:36.803 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805140+0000", 2024-04-19T02:16:36.803 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:36.803 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.803 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.803 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:36.803 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805139+0000", 2024-04-19T02:16:36.803 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:36.804 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.804 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.804 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:36.804 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805222+0000", 2024-04-19T02:16:36.804 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2762999999999993e-05 2024-04-19T02:16:36.804 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.804 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.804 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:36.804 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805236+0000", 2024-04-19T02:16:36.804 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.4134000000000001e-05 2024-04-19T02:16:36.804 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.804 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.804 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:36.804 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805244+0000", 2024-04-19T02:16:36.804 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.7030000000000006e-06 2024-04-19T02:16:36.805 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.805 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.805 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:36.805 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.810339+0000", 2024-04-19T02:16:36.805 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0050948180000000001 2024-04-19T02:16:36.805 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.805 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.805 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:36.805 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.810449+0000", 2024-04-19T02:16:36.805 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010992 2024-04-19T02:16:36.805 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.805 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.805 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:36.805 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.810588+0000", 2024-04-19T02:16:36.806 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000139054 2024-04-19T02:16:36.806 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.806 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.806 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:36.806 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.817087+0000", 2024-04-19T02:16:36.806 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0064989540000000004 2024-04-19T02:16:36.806 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.806 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.806 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:36.806 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.825120+0000", 2024-04-19T02:16:36.806 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0080331859999999995 2024-04-19T02:16:36.806 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.806 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.806 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:36.806 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.825168+0000", 2024-04-19T02:16:36.807 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8538000000000002e-05 2024-04-19T02:16:36.807 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.807 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.807 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:36.807 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.825208+0000", 2024-04-19T02:16:36.807 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9974e-05 2024-04-19T02:16:36.807 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:36.807 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:36.807 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:36.807 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.807 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.807 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:77622 5.8 5:166fbe77:::benchmark_data_smithi121_44835_object77621:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:36.807 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:16:36.807 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 9.9514611239999997, 2024-04-19T02:16:36.807 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.021784694, 2024-04-19T02:16:36.808 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:36.808 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:36.808 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:36.808 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:36.808 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:36.808 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 77622 2024-04-19T02:16:36.808 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.808 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:36.808 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.808 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:36.808 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:16:36.808 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:36.808 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.809 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.809 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:36.809 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:16:36.809 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:36.809 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.809 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.809 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:36.809 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805559+0000", 2024-04-19T02:16:36.809 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:36.809 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.809 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.809 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:36.809 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805659+0000", 2024-04-19T02:16:36.809 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.9908000000000006e-05 2024-04-19T02:16:36.809 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.810 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.810 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:36.810 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805668+0000", 2024-04-19T02:16:36.810 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2129999999999997e-06 2024-04-19T02:16:36.810 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.810 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.810 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:36.810 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805673+0000", 2024-04-19T02:16:36.810 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0370000000000002e-06 2024-04-19T02:16:36.810 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.810 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.810 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:36.810 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812022+0000", 2024-04-19T02:16:36.810 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0063483239999999998 2024-04-19T02:16:36.811 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.811 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.811 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:36.811 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812129+0000", 2024-04-19T02:16:36.811 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010744200000000001 2024-04-19T02:16:36.811 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.811 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.811 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:36.811 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812252+0000", 2024-04-19T02:16:36.811 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000122519 2024-04-19T02:16:36.811 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.811 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.811 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:36.811 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.820979+0000", 2024-04-19T02:16:36.811 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0087272740000000001 2024-04-19T02:16:36.812 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.812 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.812 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:36.812 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827270+0000", 2024-04-19T02:16:36.812 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0062906239999999999 2024-04-19T02:16:36.812 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.812 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.812 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:36.812 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827309+0000", 2024-04-19T02:16:36.812 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9678999999999997e-05 2024-04-19T02:16:36.812 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.812 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.812 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:36.812 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827345+0000", 2024-04-19T02:16:36.813 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5308000000000001e-05 2024-04-19T02:16:36.813 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:36.813 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:36.813 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:36.813 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.813 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.813 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:77623 5.8 5:1ac4372b:::benchmark_data_smithi121_44835_object77622:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:36.813 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:26.807355+0000", 2024-04-19T02:16:36.813 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 9.9496664809999995, 2024-04-19T02:16:36.813 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020092922999999999, 2024-04-19T02:16:36.813 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:36.813 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:36.813 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:36.813 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:36.813 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:36.814 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 77623 2024-04-19T02:16:36.814 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.814 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:36.814 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.814 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:36.814 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.807355+0000", 2024-04-19T02:16:36.814 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:36.814 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.814 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.814 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:36.814 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.807355+0000", 2024-04-19T02:16:36.814 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:36.814 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.814 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.815 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:36.815 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.807353+0000", 2024-04-19T02:16:36.815 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:36.815 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.815 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.815 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:36.815 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.807433+0000", 2024-04-19T02:16:36.815 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9938999999999995e-05 2024-04-19T02:16:36.815 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.815 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.815 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:36.815 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.807443+0000", 2024-04-19T02:16:36.815 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0193e-05 2024-04-19T02:16:36.815 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.816 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.816 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:36.816 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.807451+0000", 2024-04-19T02:16:36.816 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.204e-06 2024-04-19T02:16:36.816 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.816 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.816 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:36.816 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.814228+0000", 2024-04-19T02:16:36.816 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0067777740000000003 2024-04-19T02:16:36.816 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.816 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.816 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:36.816 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.814355+0000", 2024-04-19T02:16:36.816 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012678400000000001 2024-04-19T02:16:36.816 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.817 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.817 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:36.817 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.814439+0000", 2024-04-19T02:16:36.817 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.3752999999999996e-05 2024-04-19T02:16:36.817 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.817 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.817 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:36.817 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.823137+0000", 2024-04-19T02:16:36.817 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0086980159999999994 2024-04-19T02:16:36.817 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.817 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.817 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:36.817 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827390+0000", 2024-04-19T02:16:36.817 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0042527659999999998 2024-04-19T02:16:36.817 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.818 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.818 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:36.818 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827426+0000", 2024-04-19T02:16:36.818 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5809000000000002e-05 2024-04-19T02:16:36.818 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.818 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.818 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:36.818 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827447+0000", 2024-04-19T02:16:36.818 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1892999999999999e-05 2024-04-19T02:16:36.818 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:36.818 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:36.818 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:36.818 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.818 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.818 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78224 5.4 5:26e797d5:::benchmark_data_smithi121_44835_object78223:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:36.819 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:16:36.819 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 9.6504589250000006, 2024-04-19T02:16:36.819 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.021471998999999999, 2024-04-19T02:16:36.819 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:36.819 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:36.819 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:36.819 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:36.819 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:36.819 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78224 2024-04-19T02:16:36.819 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.819 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:36.819 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.819 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:36.819 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:16:36.820 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:36.820 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.820 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.820 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:36.820 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:16:36.820 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:36.820 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.820 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.820 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:36.820 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106561+0000", 2024-04-19T02:16:36.820 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:36.820 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.820 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.820 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:36.820 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106630+0000", 2024-04-19T02:16:36.821 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.8553999999999994e-05 2024-04-19T02:16:36.821 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.821 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.821 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:36.821 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106644+0000", 2024-04-19T02:16:36.821 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.4651000000000001e-05 2024-04-19T02:16:36.821 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.821 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.821 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:36.821 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106653+0000", 2024-04-19T02:16:36.821 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.6719999999999993e-06 2024-04-19T02:16:36.821 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.821 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.821 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:36.821 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106693+0000", 2024-04-19T02:16:36.821 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9978999999999998e-05 2024-04-19T02:16:36.822 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.822 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.822 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:36.822 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106840+0000", 2024-04-19T02:16:36.822 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0001473 2024-04-19T02:16:36.822 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.822 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.822 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:36.822 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106971+0000", 2024-04-19T02:16:36.822 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013051499999999999 2024-04-19T02:16:36.822 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.822 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.822 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:36.822 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.109047+0000", 2024-04-19T02:16:36.822 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.002076002 2024-04-19T02:16:36.823 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.823 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.823 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:36.823 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.127967+0000", 2024-04-19T02:16:36.823 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.018919780000000001 2024-04-19T02:16:36.823 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.823 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.823 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:36.823 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128004+0000", 2024-04-19T02:16:36.823 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7719000000000003e-05 2024-04-19T02:16:36.823 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.823 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.823 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:36.823 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128034+0000", 2024-04-19T02:16:36.823 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9651000000000001e-05 2024-04-19T02:16:36.824 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:36.824 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:36.824 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:36.824 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.824 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.824 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78259 5.4 5:2aa344b2:::benchmark_data_smithi121_44835_object78258:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:36.824 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:16:36.824 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 9.6317638559999992, 2024-04-19T02:16:36.824 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022934350999999999, 2024-04-19T02:16:36.824 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:36.824 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:36.824 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:36.824 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:36.824 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:36.824 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78259 2024-04-19T02:16:36.825 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.825 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:36.825 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.825 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:36.825 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:16:36.825 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:36.825 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.825 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.825 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:36.825 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:16:36.825 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:36.825 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.825 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.825 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:36.825 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125256+0000", 2024-04-19T02:16:36.826 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:36.826 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.826 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.826 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:36.826 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125347+0000", 2024-04-19T02:16:36.826 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0470000000000006e-05 2024-04-19T02:16:36.826 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.826 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.826 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:36.826 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125358+0000", 2024-04-19T02:16:36.826 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1764e-05 2024-04-19T02:16:36.826 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.826 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.826 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:36.827 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125364+0000", 2024-04-19T02:16:36.827 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7189999999999998e-06 2024-04-19T02:16:36.827 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.827 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.827 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:36.827 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125391+0000", 2024-04-19T02:16:36.827 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7270000000000001e-05 2024-04-19T02:16:36.827 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.827 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.827 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:36.827 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125471+0000", 2024-04-19T02:16:36.827 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9209999999999995e-05 2024-04-19T02:16:36.827 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.827 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.827 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:36.827 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125559+0000", 2024-04-19T02:16:36.828 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.8689000000000004e-05 2024-04-19T02:16:36.828 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.828 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.828 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:36.828 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128164+0000", 2024-04-19T02:16:36.828 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0026050270000000002 2024-04-19T02:16:36.828 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.828 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.828 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:36.828 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148139+0000", 2024-04-19T02:16:36.828 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.019975050000000001 2024-04-19T02:16:36.828 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.828 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.828 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:36.828 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148169+0000", 2024-04-19T02:16:36.828 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0001e-05 2024-04-19T02:16:36.828 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.829 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.829 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:36.829 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148191+0000", 2024-04-19T02:16:36.829 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.2104999999999999e-05 2024-04-19T02:16:36.829 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:36.829 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:36.829 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:36.829 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.829 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.829 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78271 5.4 5:2982d7a6:::benchmark_data_smithi121_44835_object78270:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:36.829 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:16:36.829 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 9.6249006260000005, 2024-04-19T02:16:36.829 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020841755999999999, 2024-04-19T02:16:36.830 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:36.830 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:36.830 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:36.830 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:36.830 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:36.830 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78271 2024-04-19T02:16:36.830 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.830 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:36.830 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.830 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:36.830 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:16:36.830 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:36.830 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.830 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.830 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:36.831 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:16:36.831 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:36.831 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.831 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.831 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:36.831 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132119+0000", 2024-04-19T02:16:36.831 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:36.831 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.831 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.831 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:36.831 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132185+0000", 2024-04-19T02:16:36.831 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5994000000000005e-05 2024-04-19T02:16:36.831 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.831 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.831 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:36.832 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132197+0000", 2024-04-19T02:16:36.832 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2091e-05 2024-04-19T02:16:36.832 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.832 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.832 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:36.832 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132206+0000", 2024-04-19T02:16:36.832 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.5099999999999998e-06 2024-04-19T02:16:36.832 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.832 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.832 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:36.832 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132242+0000", 2024-04-19T02:16:36.832 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5663000000000001e-05 2024-04-19T02:16:36.832 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.832 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.833 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:36.833 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132335+0000", 2024-04-19T02:16:36.833 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3275000000000004e-05 2024-04-19T02:16:36.833 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.833 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.833 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:36.833 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132432+0000", 2024-04-19T02:16:36.833 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7571000000000005e-05 2024-04-19T02:16:36.833 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.833 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.833 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:36.833 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.136706+0000", 2024-04-19T02:16:36.833 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0042738170000000001 2024-04-19T02:16:36.833 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.833 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.834 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:36.834 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152909+0000", 2024-04-19T02:16:36.834 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016202415000000001 2024-04-19T02:16:36.834 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.834 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.834 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:36.834 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152938+0000", 2024-04-19T02:16:36.834 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9740999999999999e-05 2024-04-19T02:16:36.834 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.834 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.834 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:36.834 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152962+0000", 2024-04-19T02:16:36.835 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3659000000000002e-05 2024-04-19T02:16:36.835 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:36.835 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:36.835 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:36.835 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.835 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.835 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78272 5.4 5:273e819a:::benchmark_data_smithi121_44835_object78271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:36.835 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:16:36.835 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 9.6244115830000005, 2024-04-19T02:16:36.835 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022180163999999999, 2024-04-19T02:16:36.835 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:36.835 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:36.835 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:36.835 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:36.835 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:36.836 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78272 2024-04-19T02:16:36.836 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.836 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:36.836 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.836 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:36.836 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:16:36.836 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:36.836 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.836 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.836 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:36.836 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:16:36.836 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:36.836 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.836 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.836 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:36.836 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:16:36.837 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:36.837 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.837 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.837 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:36.837 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132690+0000", 2024-04-19T02:16:36.837 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0963000000000004e-05 2024-04-19T02:16:36.837 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.837 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.837 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:36.837 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132703+0000", 2024-04-19T02:16:36.837 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.3072e-05 2024-04-19T02:16:36.837 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.837 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.837 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:36.837 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132710+0000", 2024-04-19T02:16:36.837 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3100000000000003e-06 2024-04-19T02:16:36.838 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.838 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.838 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:36.838 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134005+0000", 2024-04-19T02:16:36.838 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001294513 2024-04-19T02:16:36.838 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.838 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.838 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:36.838 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134139+0000", 2024-04-19T02:16:36.838 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000134447 2024-04-19T02:16:36.838 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.838 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.838 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:36.838 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134284+0000", 2024-04-19T02:16:36.839 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014514399999999999 2024-04-19T02:16:36.839 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.839 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.839 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:36.839 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.139622+0000", 2024-04-19T02:16:36.839 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0053373830000000002 2024-04-19T02:16:36.839 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.839 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.839 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:36.839 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154737+0000", 2024-04-19T02:16:36.839 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015115195999999999 2024-04-19T02:16:36.839 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.839 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.839 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:36.839 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154768+0000", 2024-04-19T02:16:36.839 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0824999999999997e-05 2024-04-19T02:16:36.840 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.840 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.840 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:36.840 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154790+0000", 2024-04-19T02:16:36.840 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1999000000000001e-05 2024-04-19T02:16:36.840 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:36.840 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:36.840 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:36.840 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.840 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.840 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78865 5.4 5:2abefe97:::benchmark_data_smithi121_44835_object78864:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:36.840 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.427133+0000", 2024-04-19T02:16:36.840 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 9.3298881219999998, 2024-04-19T02:16:36.840 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020107725999999999, 2024-04-19T02:16:36.840 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:36.840 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:36.841 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:36.841 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:36.841 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:36.841 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78865 2024-04-19T02:16:36.841 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.841 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:36.841 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.841 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:36.841 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.427133+0000", 2024-04-19T02:16:36.841 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:36.841 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.841 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.841 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:36.841 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.427133+0000", 2024-04-19T02:16:36.842 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:36.842 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.842 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.842 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:36.842 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.427132+0000", 2024-04-19T02:16:36.842 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:36.842 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.842 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.842 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:36.842 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.427196+0000", 2024-04-19T02:16:36.842 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.3866000000000001e-05 2024-04-19T02:16:36.842 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.842 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.842 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:36.843 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.427205+0000", 2024-04-19T02:16:36.843 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.6810000000000004e-06 2024-04-19T02:16:36.843 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.843 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.843 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:36.843 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.427210+0000", 2024-04-19T02:16:36.843 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.6110000000000001e-06 2024-04-19T02:16:36.843 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.843 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.843 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:36.843 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.431822+0000", 2024-04-19T02:16:36.843 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0046120110000000001 2024-04-19T02:16:36.843 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.843 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.844 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:36.844 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.431952+0000", 2024-04-19T02:16:36.844 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000129474 2024-04-19T02:16:36.844 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.844 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.844 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:36.844 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.432087+0000", 2024-04-19T02:16:36.844 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013454 2024-04-19T02:16:36.844 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.844 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.844 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:36.844 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.439095+0000", 2024-04-19T02:16:36.844 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0070082160000000003 2024-04-19T02:16:36.844 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.844 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.844 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:36.844 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.447183+0000", 2024-04-19T02:16:36.845 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0080887690000000009 2024-04-19T02:16:36.845 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.845 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.845 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:36.845 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.447214+0000", 2024-04-19T02:16:36.845 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0131999999999999e-05 2024-04-19T02:16:36.845 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.845 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.845 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:36.845 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.447241+0000", 2024-04-19T02:16:36.845 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.6974999999999998e-05 2024-04-19T02:16:36.845 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:36.845 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:36.845 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:36.845 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.846 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.846 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:94475 5.e 5:7a360208:::benchmark_data_smithi121_44835_object94474:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:36.846 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:35.118023+0000", 2024-04-19T02:16:36.846 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 1.6389976429999999, 2024-04-19T02:16:36.846 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020591993999999999, 2024-04-19T02:16:36.846 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:36.846 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:36.846 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:36.846 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:36.846 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:36.846 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 94475 2024-04-19T02:16:36.846 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.846 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:36.846 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.846 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:36.847 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118023+0000", 2024-04-19T02:16:36.847 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:36.847 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.847 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.847 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:36.847 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118023+0000", 2024-04-19T02:16:36.847 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:36.847 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.847 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.847 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:36.847 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118023+0000", 2024-04-19T02:16:36.847 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:36.847 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.848 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.848 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:36.848 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118041+0000", 2024-04-19T02:16:36.848 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.8689999999999999e-05 2024-04-19T02:16:36.848 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.848 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.848 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:36.848 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118049+0000", 2024-04-19T02:16:36.848 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.5939999999999996e-06 2024-04-19T02:16:36.848 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.848 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.848 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:36.848 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118053+0000", 2024-04-19T02:16:36.848 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2080000000000002e-06 2024-04-19T02:16:36.848 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.849 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.849 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:36.849 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118093+0000", 2024-04-19T02:16:36.849 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9634e-05 2024-04-19T02:16:36.849 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.849 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.849 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:36.849 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118191+0000", 2024-04-19T02:16:36.849 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.8272999999999999e-05 2024-04-19T02:16:36.849 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.849 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.849 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:36.849 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118280+0000", 2024-04-19T02:16:36.849 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.8702999999999994e-05 2024-04-19T02:16:36.849 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.850 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.850 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:36.850 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.124833+0000", 2024-04-19T02:16:36.850 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0065528180000000002 2024-04-19T02:16:36.850 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.850 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.850 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:36.850 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.138520+0000", 2024-04-19T02:16:36.850 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.013686959 2024-04-19T02:16:36.850 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.850 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.850 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:36.850 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.138577+0000", 2024-04-19T02:16:36.850 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7689000000000003e-05 2024-04-19T02:16:36.851 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.851 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.851 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:36.851 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.138615+0000", 2024-04-19T02:16:36.851 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8016999999999999e-05 2024-04-19T02:16:36.851 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:36.851 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:36.851 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:36.851 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.851 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.851 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:94481 5.e 5:7b2fbebf:::benchmark_data_smithi121_44835_object94480:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:36.851 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:16:36.851 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 1.635775266, 2024-04-19T02:16:36.851 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020897846000000001, 2024-04-19T02:16:36.851 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:36.852 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:36.852 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:36.852 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:36.852 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:36.852 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 94481 2024-04-19T02:16:36.852 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.852 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:36.852 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.852 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:36.852 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:16:36.852 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:36.852 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.852 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.852 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:36.852 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:16:36.853 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:36.853 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.853 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.853 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:36.853 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121245+0000", 2024-04-19T02:16:36.853 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:36.853 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.853 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.853 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:36.853 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121273+0000", 2024-04-19T02:16:36.853 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7250000000000002e-05 2024-04-19T02:16:36.853 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.853 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.853 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:36.854 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121277+0000", 2024-04-19T02:16:36.854 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2860000000000001e-06 2024-04-19T02:16:36.854 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.854 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.854 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:36.854 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121280+0000", 2024-04-19T02:16:36.854 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2739999999999999e-06 2024-04-19T02:16:36.854 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.854 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.854 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:36.854 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121320+0000", 2024-04-19T02:16:36.854 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9879000000000002e-05 2024-04-19T02:16:36.854 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.855 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.855 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:36.855 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121448+0000", 2024-04-19T02:16:36.855 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012748800000000001 2024-04-19T02:16:36.855 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.855 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.855 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:36.855 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121595+0000", 2024-04-19T02:16:36.855 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014741299999999999 2024-04-19T02:16:36.855 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.855 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.855 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:36.855 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.127776+0000", 2024-04-19T02:16:36.855 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0061811360000000003 2024-04-19T02:16:36.855 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.856 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.856 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:36.856 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142073+0000", 2024-04-19T02:16:36.856 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014296959999999999 2024-04-19T02:16:36.856 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.856 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.856 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:36.856 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142106+0000", 2024-04-19T02:16:36.856 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3348e-05 2024-04-19T02:16:36.856 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.856 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.856 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:36.857 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142144+0000", 2024-04-19T02:16:36.857 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7153000000000002e-05 2024-04-19T02:16:36.857 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:36.857 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:36.857 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:36.857 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.857 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.857 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:94581 5.b 5:dc86d6e9:::benchmark_data_smithi121_44835_object94580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:36.857 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:16:36.857 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 1.5768406929999998, 2024-04-19T02:16:36.857 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022099711000000001, 2024-04-19T02:16:36.857 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:36.857 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:36.857 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:36.857 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:36.858 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:36.858 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 94581 2024-04-19T02:16:36.858 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.858 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:36.858 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.858 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:36.858 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:16:36.858 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:36.858 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.858 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.858 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:36.858 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:16:36.858 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:36.858 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.859 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.859 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:36.859 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:16:36.859 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:36.859 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.859 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.859 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:36.859 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180253+0000", 2024-04-19T02:16:36.859 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3163000000000004e-05 2024-04-19T02:16:36.859 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.859 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.859 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:36.859 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180266+0000", 2024-04-19T02:16:36.859 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2886e-05 2024-04-19T02:16:36.860 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.860 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.860 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:36.860 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180273+0000", 2024-04-19T02:16:36.860 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.4059999999999999e-06 2024-04-19T02:16:36.860 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.860 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.860 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:36.860 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180646+0000", 2024-04-19T02:16:36.860 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00037283999999999999 2024-04-19T02:16:36.860 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.860 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.860 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:36.860 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180774+0000", 2024-04-19T02:16:36.860 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012793799999999999 2024-04-19T02:16:36.860 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.861 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.861 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:36.861 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180920+0000", 2024-04-19T02:16:36.861 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000146692 2024-04-19T02:16:36.861 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.861 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.861 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:36.861 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.183344+0000", 2024-04-19T02:16:36.861 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0024231669999999999 2024-04-19T02:16:36.861 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.861 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.861 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:36.861 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202196+0000", 2024-04-19T02:16:36.861 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.018852384 2024-04-19T02:16:36.862 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.862 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.862 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:36.862 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202241+0000", 2024-04-19T02:16:36.862 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4923999999999999e-05 2024-04-19T02:16:36.862 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.862 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.862 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:36.862 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202280+0000", 2024-04-19T02:16:36.862 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9096e-05 2024-04-19T02:16:36.862 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:36.862 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:36.862 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:36.862 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.862 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.863 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:96356 5.0 5:0a661b39:::benchmark_data_smithi121_44835_object96355:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:36.863 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:16:36.863 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.66362785099999999, 2024-04-19T02:16:36.863 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020955516, 2024-04-19T02:16:36.863 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:36.863 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:36.863 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:36.863 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:36.863 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:36.863 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 96356 2024-04-19T02:16:36.863 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.863 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:36.863 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.863 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:36.864 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:16:36.864 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:36.864 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.864 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.864 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:36.864 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:16:36.864 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:36.864 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.864 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.864 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:36.864 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:16:36.864 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:36.864 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.864 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.865 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:36.865 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093455+0000", 2024-04-19T02:16:36.865 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.2205000000000005e-05 2024-04-19T02:16:36.865 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.865 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.865 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:36.865 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093464+0000", 2024-04-19T02:16:36.865 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3910000000000004e-06 2024-04-19T02:16:36.865 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.865 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.865 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:36.865 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093469+0000", 2024-04-19T02:16:36.865 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.7249999999999997e-06 2024-04-19T02:16:36.865 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.865 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.866 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:36.866 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099643+0000", 2024-04-19T02:16:36.866 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0061743359999999999 2024-04-19T02:16:36.866 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.866 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.866 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:36.866 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099774+0000", 2024-04-19T02:16:36.866 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013050599999999999 2024-04-19T02:16:36.866 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.866 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.866 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:36.866 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099917+0000", 2024-04-19T02:16:36.866 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000143187 2024-04-19T02:16:36.866 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.867 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.867 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:36.867 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.105432+0000", 2024-04-19T02:16:36.867 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.005514873 2024-04-19T02:16:36.867 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.867 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.867 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:36.867 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114264+0000", 2024-04-19T02:16:36.867 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.008831752 2024-04-19T02:16:36.867 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.867 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.867 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:36.867 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114300+0000", 2024-04-19T02:16:36.867 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6582000000000003e-05 2024-04-19T02:16:36.867 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.867 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.868 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:36.868 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114349+0000", 2024-04-19T02:16:36.868 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8579999999999999e-05 2024-04-19T02:16:36.868 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:36.868 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:36.868 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:36.868 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.868 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.868 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:96357 5.0 5:00efce8b:::benchmark_data_smithi121_44835_object96356:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:36.868 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:16:36.868 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.66354817300000002, 2024-04-19T02:16:36.868 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020937471999999999, 2024-04-19T02:16:36.868 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:36.868 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:36.869 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:36.869 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:36.869 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:36.869 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 96357 2024-04-19T02:16:36.869 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.869 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:36.869 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.869 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:36.869 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:16:36.869 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:36.869 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.869 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.869 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:36.870 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:16:36.870 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:36.870 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.870 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.870 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:36.870 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093472+0000", 2024-04-19T02:16:36.870 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:36.870 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.870 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.870 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:36.870 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093513+0000", 2024-04-19T02:16:36.870 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0213000000000003e-05 2024-04-19T02:16:36.871 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.871 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.871 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:36.871 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093519+0000", 2024-04-19T02:16:36.871 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.066e-06 2024-04-19T02:16:36.871 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.871 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.871 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:36.871 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093525+0000", 2024-04-19T02:16:36.871 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.8170000000000004e-06 2024-04-19T02:16:36.871 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.871 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.871 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:36.871 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103412+0000", 2024-04-19T02:16:36.871 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0098872739999999997 2024-04-19T02:16:36.872 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.872 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.872 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:36.872 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103551+0000", 2024-04-19T02:16:36.872 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000139295 2024-04-19T02:16:36.872 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.872 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.872 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:36.872 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103701+0000", 2024-04-19T02:16:36.872 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014954599999999999 2024-04-19T02:16:36.872 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.872 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.872 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:36.872 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.108849+0000", 2024-04-19T02:16:36.873 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0051487199999999999 2024-04-19T02:16:36.873 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.873 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.873 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:36.873 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114355+0000", 2024-04-19T02:16:36.873 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0055052529999999999 2024-04-19T02:16:36.873 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.873 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.873 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:36.873 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114379+0000", 2024-04-19T02:16:36.873 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4275000000000001e-05 2024-04-19T02:16:36.873 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:36.873 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:36.873 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:36.874 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114410+0000", 2024-04-19T02:16:36.874 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1356999999999998e-05 2024-04-19T02:16:36.874 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:36.874 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:36.874 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:36.874 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:36.874 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:36.874 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:16:36.875 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:16:36.876 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:36.876+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:36.877 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:16:36.976 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:36.977+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:37.021 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:16:37.028 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 42 16 98273 98257 146.204 127.625 0.00527033 0.00683713 2024-04-19T02:16:37.041 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:16:37.061 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2: {} 2024-04-19T02:16:37.062 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:16:37.062 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:16:37.062 INFO:teuthology.orchestra.run.smithi121.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:16:37.065 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:37.065 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:37.079 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:37.079+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:37.080 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:16:37.111 INFO:teuthology.orchestra.run.smithi121.stderr:reweighted osd.2 to 1 (10000) 2024-04-19T02:16:37.122 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T02:16:37.124 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-19T02:16:37.124 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:16:37.178 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:37.178+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:37.279 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:37.280+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:37.302 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:37.303 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:37.318 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:16:37.380 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:37.380+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:37.483 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:37.483+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:37.525 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:16:37.527 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-04-19T02:16:37.536 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2024-04-19T02:16:37.110170+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5892344666,"num_objects":89925,"num_object_clones":0,"num_object_copies":179850,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":3790,"num_objects_unfound":0,"num_objects_dirty":89925,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":90149,"num_write_kb":5757138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1501,"num_bytes_recovered":98369536,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60296,"ondisk_log_size":60296,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":243,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":11702712,"kb_used_data":11428828,"kb_used_omap":4,"kb_used_meta":273787,"kb_avail":271412808,"statfs":{"total":289910292480,"available":277926715392,"internally_reserved":0,"allocated":11703119872,"data_stored":11702378200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":280358226},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,2,3,10],"upper_bound":16},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":675872768,"num_objects":10313,"num_object_clones":0,"num_object_copies":20626,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-393,"num_objects_unfound":0,"num_objects_dirty":10313,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10313,"num_write_kb":660032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":864,"num_bytes_recovered":56623104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.014064"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.094246+0000","last_change":"2024-04-19T02:15:29.280412+0000","last_active":"2024-04-19T02:16:30.094246+0000","last_peered":"2024-04-19T02:16:30.094246+0000","last_clean":"2024-04-19T02:16:30.094246+0000","last_became_active":"2024-04-19T02:15:29.278762+0000","last_became_peered":"2024-04-19T02:15:29.278762+0000","last_unstale":"2024-04-19T02:16:30.094246+0000","last_undegraded":"2024-04-19T02:16:30.094246+0000","last_fullsized":"2024-04-19T02:16:30.094246+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:45.301675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093736+0000","last_change":"2024-04-19T02:15:29.284695+0000","last_active":"2024-04-19T02:16:30.093736+0000","last_peered":"2024-04-19T02:16:30.093736+0000","last_clean":"2024-04-19T02:16:30.093736+0000","last_became_active":"2024-04-19T02:15:29.283468+0000","last_became_peered":"2024-04-19T02:15:29.283468+0000","last_unstale":"2024-04-19T02:16:30.093736+0000","last_undegraded":"2024-04-19T02:16:30.093736+0000","last_fullsized":"2024-04-19T02:16:30.093736+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.384881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.089939+0000","last_change":"2024-04-19T02:15:29.286709+0000","last_active":"2024-04-19T02:16:30.089939+0000","last_peered":"2024-04-19T02:16:30.089939+0000","last_clean":"2024-04-19T02:16:30.089939+0000","last_became_active":"2024-04-19T02:15:29.286169+0000","last_became_peered":"2024-04-19T02:15:29.286169+0000","last_unstale":"2024-04-19T02:16:30.089939+0000","last_undegraded":"2024-04-19T02:16:30.089939+0000","last_fullsized":"2024-04-19T02:16:30.089939+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:58.741466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.089851+0000","last_change":"2024-04-19T02:15:29.280131+0000","last_active":"2024-04-19T02:16:30.089851+0000","last_peered":"2024-04-19T02:16:30.089851+0000","last_clean":"2024-04-19T02:16:30.089851+0000","last_became_active":"2024-04-19T02:15:29.279388+0000","last_became_peered":"2024-04-19T02:15:29.279388+0000","last_unstale":"2024-04-19T02:16:30.089851+0000","last_undegraded":"2024-04-19T02:16:30.089851+0000","last_fullsized":"2024-04-19T02:16:30.089851+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:36:48.819486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093099+0000","last_change":"2024-04-19T02:15:53.955892+0000","last_active":"2024-04-19T02:16:30.093099+0000","last_peered":"2024-04-19T02:16:30.093099+0000","last_clean":"2024-04-19T02:16:30.093099+0000","last_became_active":"2024-04-19T02:15:53.955553+0000","last_became_peered":"2024-04-19T02:15:53.955553+0000","last_unstale":"2024-04-19T02:16:30.093099+0000","last_undegraded":"2024-04-19T02:16:30.093099+0000","last_fullsized":"2024-04-19T02:16:30.093099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:45:39.791209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.090361+0000","last_change":"2024-04-19T02:15:29.283908+0000","last_active":"2024-04-19T02:16:30.090361+0000","last_peered":"2024-04-19T02:16:30.090361+0000","last_clean":"2024-04-19T02:16:30.090361+0000","last_became_active":"2024-04-19T02:15:29.281729+0000","last_became_peered":"2024-04-19T02:15:29.281729+0000","last_unstale":"2024-04-19T02:16:30.090361+0000","last_undegraded":"2024-04-19T02:16:30.090361+0000","last_fullsized":"2024-04-19T02:16:30.090361+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:03:15.383476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.089164+0000","last_change":"2024-04-19T02:15:29.281253+0000","last_active":"2024-04-19T02:16:30.089164+0000","last_peered":"2024-04-19T02:16:30.089164+0000","last_clean":"2024-04-19T02:16:30.089164+0000","last_became_active":"2024-04-19T02:15:29.279951+0000","last_became_peered":"2024-04-19T02:15:29.279951+0000","last_unstale":"2024-04-19T02:16:30.089164+0000","last_undegraded":"2024-04-19T02:16:30.089164+0000","last_fullsized":"2024-04-19T02:16:30.089164+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.089086+0000","last_change":"2024-04-19T02:15:29.283952+0000","last_active":"2024-04-19T02:16:30.089086+0000","last_peered":"2024-04-19T02:16:30.089086+0000","last_clean":"2024-04-19T02:16:30.089086+0000","last_became_active":"2024-04-19T02:15:29.282721+0000","last_became_peered":"2024-04-19T02:15:29.282721+0000","last_unstale":"2024-04-19T02:16:30.089086+0000","last_undegraded":"2024-04-19T02:16:30.089086+0000","last_fullsized":"2024-04-19T02:16:30.089086+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:45.301675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.092963+0000","last_change":"2024-04-19T02:15:29.282150+0000","last_active":"2024-04-19T02:16:30.092963+0000","last_peered":"2024-04-19T02:16:30.092963+0000","last_clean":"2024-04-19T02:16:30.092963+0000","last_became_active":"2024-04-19T02:15:29.281538+0000","last_became_peered":"2024-04-19T02:15:29.281538+0000","last_unstale":"2024-04-19T02:16:30.092963+0000","last_undegraded":"2024-04-19T02:16:30.092963+0000","last_fullsized":"2024-04-19T02:16:30.092963+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-19T02:16:32.104424+0000","last_change":"2024-04-19T02:16:30.093524+0000","last_active":"2024-04-19T02:16:32.104424+0000","last_peered":"2024-04-19T02:16:32.104424+0000","last_clean":"2024-04-19T02:16:32.104424+0000","last_became_active":"2024-04-19T02:16:30.093344+0000","last_became_peered":"2024-04-19T02:16:30.093344+0000","last_unstale":"2024-04-19T02:16:32.104424+0000","last_undegraded":"2024-04-19T02:16:32.104424+0000","last_fullsized":"2024-04-19T02:16:32.104424+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:14:40.293159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.089862+0000","last_change":"2024-04-19T02:15:29.280606+0000","last_active":"2024-04-19T02:16:30.089862+0000","last_peered":"2024-04-19T02:16:30.089862+0000","last_clean":"2024-04-19T02:16:30.089862+0000","last_became_active":"2024-04-19T02:15:29.280151+0000","last_became_peered":"2024-04-19T02:15:29.280151+0000","last_unstale":"2024-04-19T02:16:30.089862+0000","last_undegraded":"2024-04-19T02:16:30.089862+0000","last_fullsized":"2024-04-19T02:16:30.089862+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:26:22.452488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.089532+0000","last_change":"2024-04-19T02:15:53.958876+0000","last_active":"2024-04-19T02:16:30.089532+0000","last_peered":"2024-04-19T02:16:30.089532+0000","last_clean":"2024-04-19T02:16:30.089532+0000","last_became_active":"2024-04-19T02:15:53.958626+0000","last_became_peered":"2024-04-19T02:15:53.958626+0000","last_unstale":"2024-04-19T02:16:30.089532+0000","last_undegraded":"2024-04-19T02:16:30.089532+0000","last_fullsized":"2024-04-19T02:16:30.089532+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:23:57.044018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093051+0000","last_change":"2024-04-19T02:15:53.956801+0000","last_active":"2024-04-19T02:16:30.093051+0000","last_peered":"2024-04-19T02:16:30.093051+0000","last_clean":"2024-04-19T02:16:30.093051+0000","last_became_active":"2024-04-19T02:15:53.956620+0000","last_became_peered":"2024-04-19T02:15:53.956620+0000","last_unstale":"2024-04-19T02:16:30.093051+0000","last_undegraded":"2024-04-19T02:16:30.093051+0000","last_fullsized":"2024-04-19T02:16:30.093051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:57:05.843101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.090512+0000","last_change":"2024-04-19T02:15:29.284262+0000","last_active":"2024-04-19T02:16:30.090512+0000","last_peered":"2024-04-19T02:16:30.090512+0000","last_clean":"2024-04-19T02:16:30.090512+0000","last_became_active":"2024-04-19T02:15:29.283121+0000","last_became_peered":"2024-04-19T02:15:29.283121+0000","last_unstale":"2024-04-19T02:16:30.090512+0000","last_undegraded":"2024-04-19T02:16:30.090512+0000","last_fullsized":"2024-04-19T02:16:30.090512+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.089245+0000","last_change":"2024-04-19T02:15:29.285139+0000","last_active":"2024-04-19T02:16:30.089245+0000","last_peered":"2024-04-19T02:16:30.089245+0000","last_clean":"2024-04-19T02:16:30.089245+0000","last_became_active":"2024-04-19T02:15:29.284649+0000","last_became_peered":"2024-04-19T02:15:29.284649+0000","last_unstale":"2024-04-19T02:16:30.089245+0000","last_undegraded":"2024-04-19T02:16:30.089245+0000","last_fullsized":"2024-04-19T02:16:30.089245+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.089078+0000","last_change":"2024-04-19T02:15:29.283648+0000","last_active":"2024-04-19T02:16:30.089078+0000","last_peered":"2024-04-19T02:16:30.089078+0000","last_clean":"2024-04-19T02:16:30.089078+0000","last_became_active":"2024-04-19T02:15:29.281606+0000","last_became_peered":"2024-04-19T02:15:29.281606+0000","last_unstale":"2024-04-19T02:16:30.089078+0000","last_undegraded":"2024-04-19T02:16:30.089078+0000","last_fullsized":"2024-04-19T02:16:30.089078+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093245+0000","last_change":"2024-04-19T02:15:29.278673+0000","last_active":"2024-04-19T02:16:30.093245+0000","last_peered":"2024-04-19T02:16:30.093245+0000","last_clean":"2024-04-19T02:16:30.093245+0000","last_became_active":"2024-04-19T02:15:29.277699+0000","last_became_peered":"2024-04-19T02:15:29.277699+0000","last_unstale":"2024-04-19T02:16:30.093245+0000","last_undegraded":"2024-04-19T02:16:30.093245+0000","last_fullsized":"2024-04-19T02:16:30.093245+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.094707+0000","last_change":"2024-04-19T02:15:29.283341+0000","last_active":"2024-04-19T02:16:30.094707+0000","last_peered":"2024-04-19T02:16:30.094707+0000","last_clean":"2024-04-19T02:16:30.094707+0000","last_became_active":"2024-04-19T02:15:29.281591+0000","last_became_peered":"2024-04-19T02:15:29.281591+0000","last_unstale":"2024-04-19T02:16:30.094707+0000","last_undegraded":"2024-04-19T02:16:30.094707+0000","last_fullsized":"2024-04-19T02:16:30.094707+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:34.593754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093425+0000","last_change":"2024-04-19T02:15:29.282110+0000","last_active":"2024-04-19T02:16:30.093425+0000","last_peered":"2024-04-19T02:16:30.093425+0000","last_clean":"2024-04-19T02:16:30.093425+0000","last_became_active":"2024-04-19T02:15:29.281716+0000","last_became_peered":"2024-04-19T02:15:29.281716+0000","last_unstale":"2024-04-19T02:16:30.093425+0000","last_undegraded":"2024-04-19T02:16:30.093425+0000","last_fullsized":"2024-04-19T02:16:30.093425+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.089907+0000","last_change":"2024-04-19T02:15:29.285237+0000","last_active":"2024-04-19T02:16:30.089907+0000","last_peered":"2024-04-19T02:16:30.089907+0000","last_clean":"2024-04-19T02:16:30.089907+0000","last_became_active":"2024-04-19T02:15:29.282790+0000","last_became_peered":"2024-04-19T02:15:29.282790+0000","last_unstale":"2024-04-19T02:16:30.089907+0000","last_undegraded":"2024-04-19T02:16:30.089907+0000","last_fullsized":"2024-04-19T02:16:30.089907+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.089797+0000","last_change":"2024-04-19T02:15:29.282609+0000","last_active":"2024-04-19T02:16:30.089797+0000","last_peered":"2024-04-19T02:16:30.089797+0000","last_clean":"2024-04-19T02:16:30.089797+0000","last_became_active":"2024-04-19T02:15:29.281665+0000","last_became_peered":"2024-04-19T02:15:29.281665+0000","last_unstale":"2024-04-19T02:16:30.089797+0000","last_undegraded":"2024-04-19T02:16:30.089797+0000","last_fullsized":"2024-04-19T02:16:30.089797+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.384881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.090104+0000","last_change":"2024-04-19T02:15:53.955813+0000","last_active":"2024-04-19T02:16:30.090104+0000","last_peered":"2024-04-19T02:16:30.090104+0000","last_clean":"2024-04-19T02:16:30.090104+0000","last_became_active":"2024-04-19T02:15:53.955614+0000","last_became_peered":"2024-04-19T02:15:53.955614+0000","last_unstale":"2024-04-19T02:16:30.090104+0000","last_undegraded":"2024-04-19T02:16:30.090104+0000","last_fullsized":"2024-04-19T02:16:30.090104+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:58:03.192647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093072+0000","last_change":"2024-04-19T02:15:29.277109+0000","last_active":"2024-04-19T02:16:30.093072+0000","last_peered":"2024-04-19T02:16:30.093072+0000","last_clean":"2024-04-19T02:16:30.093072+0000","last_became_active":"2024-04-19T02:15:29.275417+0000","last_became_peered":"2024-04-19T02:15:29.275417+0000","last_unstale":"2024-04-19T02:16:30.093072+0000","last_undegraded":"2024-04-19T02:16:30.093072+0000","last_fullsized":"2024-04-19T02:16:30.093072+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093243+0000","last_change":"2024-04-19T02:15:29.283266+0000","last_active":"2024-04-19T02:16:30.093243+0000","last_peered":"2024-04-19T02:16:30.093243+0000","last_clean":"2024-04-19T02:16:30.093243+0000","last_became_active":"2024-04-19T02:15:29.281505+0000","last_became_peered":"2024-04-19T02:15:29.281505+0000","last_unstale":"2024-04-19T02:16:30.093243+0000","last_undegraded":"2024-04-19T02:16:30.093243+0000","last_fullsized":"2024-04-19T02:16:30.093243+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.094168+0000","last_change":"2024-04-19T02:15:29.278084+0000","last_active":"2024-04-19T02:16:30.094168+0000","last_peered":"2024-04-19T02:16:30.094168+0000","last_clean":"2024-04-19T02:16:30.094168+0000","last_became_active":"2024-04-19T02:15:29.276952+0000","last_became_peered":"2024-04-19T02:15:29.276952+0000","last_unstale":"2024-04-19T02:16:30.094168+0000","last_undegraded":"2024-04-19T02:16:30.094168+0000","last_fullsized":"2024-04-19T02:16:30.094168+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093698+0000","last_change":"2024-04-19T02:15:29.279904+0000","last_active":"2024-04-19T02:16:30.093698+0000","last_peered":"2024-04-19T02:16:30.093698+0000","last_clean":"2024-04-19T02:16:30.093698+0000","last_became_active":"2024-04-19T02:15:29.278938+0000","last_became_peered":"2024-04-19T02:15:29.278938+0000","last_unstale":"2024-04-19T02:16:30.093698+0000","last_undegraded":"2024-04-19T02:16:30.093698+0000","last_fullsized":"2024-04-19T02:16:30.093698+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.089844+0000","last_change":"2024-04-19T02:15:29.287389+0000","last_active":"2024-04-19T02:16:30.089844+0000","last_peered":"2024-04-19T02:16:30.089844+0000","last_clean":"2024-04-19T02:16:30.089844+0000","last_became_active":"2024-04-19T02:15:29.286431+0000","last_became_peered":"2024-04-19T02:15:29.286431+0000","last_unstale":"2024-04-19T02:16:30.089844+0000","last_undegraded":"2024-04-19T02:16:30.089844+0000","last_fullsized":"2024-04-19T02:16:30.089844+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:58:30.117887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093568+0000","last_change":"2024-04-19T02:15:53.959207+0000","last_active":"2024-04-19T02:16:30.093568+0000","last_peered":"2024-04-19T02:16:30.093568+0000","last_clean":"2024-04-19T02:16:30.093568+0000","last_became_active":"2024-04-19T02:15:53.959007+0000","last_became_peered":"2024-04-19T02:15:53.959007+0000","last_unstale":"2024-04-19T02:16:30.093568+0000","last_undegraded":"2024-04-19T02:16:30.093568+0000","last_fullsized":"2024-04-19T02:16:30.093568+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:08:21.065077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093416+0000","last_change":"2024-04-19T02:15:29.281792+0000","last_active":"2024-04-19T02:16:30.093416+0000","last_peered":"2024-04-19T02:16:30.093416+0000","last_clean":"2024-04-19T02:16:30.093416+0000","last_became_active":"2024-04-19T02:15:29.280479+0000","last_became_peered":"2024-04-19T02:15:29.280479+0000","last_unstale":"2024-04-19T02:16:30.093416+0000","last_undegraded":"2024-04-19T02:16:30.093416+0000","last_fullsized":"2024-04-19T02:16:30.093416+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093162+0000","last_change":"2024-04-19T02:15:28.888778+0000","last_active":"2024-04-19T02:16:30.093162+0000","last_peered":"2024-04-19T02:16:30.093162+0000","last_clean":"2024-04-19T02:16:30.093162+0000","last_became_active":"2024-04-19T02:15:28.888543+0000","last_became_peered":"2024-04-19T02:15:28.888543+0000","last_unstale":"2024-04-19T02:16:30.093162+0000","last_undegraded":"2024-04-19T02:16:30.093162+0000","last_fullsized":"2024-04-19T02:16:30.093162+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:43:51.221619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093470+0000","last_change":"2024-04-19T02:15:29.279986+0000","last_active":"2024-04-19T02:16:30.093470+0000","last_peered":"2024-04-19T02:16:30.093470+0000","last_clean":"2024-04-19T02:16:30.093470+0000","last_became_active":"2024-04-19T02:15:29.279690+0000","last_became_peered":"2024-04-19T02:15:29.279690+0000","last_unstale":"2024-04-19T02:16:30.093470+0000","last_undegraded":"2024-04-19T02:16:30.093470+0000","last_fullsized":"2024-04-19T02:16:30.093470+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.096020+0000","last_change":"2024-04-19T02:15:28.890463+0000","last_active":"2024-04-19T02:16:30.096020+0000","last_peered":"2024-04-19T02:16:30.096020+0000","last_clean":"2024-04-19T02:16:30.096020+0000","last_became_active":"2024-04-19T02:15:28.889777+0000","last_became_peered":"2024-04-19T02:15:28.889777+0000","last_unstale":"2024-04-19T02:16:30.096020+0000","last_undegraded":"2024-04-19T02:16:30.096020+0000","last_fullsized":"2024-04-19T02:16:30.096020+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:58:21.520250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.094085+0000","last_change":"2024-04-19T02:15:29.280879+0000","last_active":"2024-04-19T02:16:30.094085+0000","last_peered":"2024-04-19T02:16:30.094085+0000","last_clean":"2024-04-19T02:16:30.094085+0000","last_became_active":"2024-04-19T02:15:29.279314+0000","last_became_peered":"2024-04-19T02:15:29.279314+0000","last_unstale":"2024-04-19T02:16:30.094085+0000","last_undegraded":"2024-04-19T02:16:30.094085+0000","last_fullsized":"2024-04-19T02:16:30.094085+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093504+0000","last_change":"2024-04-19T02:15:28.891867+0000","last_active":"2024-04-19T02:16:30.093504+0000","last_peered":"2024-04-19T02:16:30.093504+0000","last_clean":"2024-04-19T02:16:30.093504+0000","last_became_active":"2024-04-19T02:15:28.890806+0000","last_became_peered":"2024-04-19T02:15:28.890806+0000","last_unstale":"2024-04-19T02:16:30.093504+0000","last_undegraded":"2024-04-19T02:16:30.093504+0000","last_fullsized":"2024-04-19T02:16:30.093504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:57.946581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.095874+0000","last_change":"2024-04-19T02:15:29.278148+0000","last_active":"2024-04-19T02:16:30.095874+0000","last_peered":"2024-04-19T02:16:30.095874+0000","last_clean":"2024-04-19T02:16:30.095874+0000","last_became_active":"2024-04-19T02:15:29.277402+0000","last_became_peered":"2024-04-19T02:15:29.277402+0000","last_unstale":"2024-04-19T02:16:30.095874+0000","last_undegraded":"2024-04-19T02:16:30.095874+0000","last_fullsized":"2024-04-19T02:16:30.095874+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.089698+0000","last_change":"2024-04-19T02:15:28.892905+0000","last_active":"2024-04-19T02:16:30.089698+0000","last_peered":"2024-04-19T02:16:30.089698+0000","last_clean":"2024-04-19T02:16:30.089698+0000","last_became_active":"2024-04-19T02:15:28.892541+0000","last_became_peered":"2024-04-19T02:15:28.892541+0000","last_unstale":"2024-04-19T02:16:30.089698+0000","last_undegraded":"2024-04-19T02:16:30.089698+0000","last_fullsized":"2024-04-19T02:16:30.089698+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:33.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093766+0000","last_change":"2024-04-19T02:15:29.278810+0000","last_active":"2024-04-19T02:16:30.093766+0000","last_peered":"2024-04-19T02:16:30.093766+0000","last_clean":"2024-04-19T02:16:30.093766+0000","last_became_active":"2024-04-19T02:15:29.278093+0000","last_became_peered":"2024-04-19T02:15:29.278093+0000","last_unstale":"2024-04-19T02:16:30.093766+0000","last_undegraded":"2024-04-19T02:16:30.093766+0000","last_fullsized":"2024-04-19T02:16:30.093766+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:34.883207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.092925+0000","last_change":"2024-04-19T02:15:28.892937+0000","last_active":"2024-04-19T02:16:30.092925+0000","last_peered":"2024-04-19T02:16:30.092925+0000","last_clean":"2024-04-19T02:16:30.092925+0000","last_became_active":"2024-04-19T02:15:28.891440+0000","last_became_peered":"2024-04-19T02:15:28.891440+0000","last_unstale":"2024-04-19T02:16:30.092925+0000","last_undegraded":"2024-04-19T02:16:30.092925+0000","last_fullsized":"2024-04-19T02:16:30.092925+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.092861+0000","last_change":"2024-04-19T02:15:29.278404+0000","last_active":"2024-04-19T02:16:30.092861+0000","last_peered":"2024-04-19T02:16:30.092861+0000","last_clean":"2024-04-19T02:16:30.092861+0000","last_became_active":"2024-04-19T02:15:29.277460+0000","last_became_peered":"2024-04-19T02:15:29.277460+0000","last_unstale":"2024-04-19T02:16:30.092861+0000","last_undegraded":"2024-04-19T02:16:30.092861+0000","last_fullsized":"2024-04-19T02:16:30.092861+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.089670+0000","last_change":"2024-04-19T02:15:28.891097+0000","last_active":"2024-04-19T02:16:30.089670+0000","last_peered":"2024-04-19T02:16:30.089670+0000","last_clean":"2024-04-19T02:16:30.089670+0000","last_became_active":"2024-04-19T02:15:28.890795+0000","last_became_peered":"2024-04-19T02:15:28.890795+0000","last_unstale":"2024-04-19T02:16:30.089670+0000","last_undegraded":"2024-04-19T02:16:30.089670+0000","last_fullsized":"2024-04-19T02:16:30.089670+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.090263+0000","last_change":"2024-04-19T02:15:29.278546+0000","last_active":"2024-04-19T02:16:30.090263+0000","last_peered":"2024-04-19T02:16:30.090263+0000","last_clean":"2024-04-19T02:16:30.090263+0000","last_became_active":"2024-04-19T02:15:29.277547+0000","last_became_peered":"2024-04-19T02:15:29.277547+0000","last_unstale":"2024-04-19T02:16:30.090263+0000","last_undegraded":"2024-04-19T02:16:30.090263+0000","last_fullsized":"2024-04-19T02:16:30.090263+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.090183+0000","last_change":"2024-04-19T02:15:28.892977+0000","last_active":"2024-04-19T02:16:30.090183+0000","last_peered":"2024-04-19T02:16:30.090183+0000","last_clean":"2024-04-19T02:16:30.090183+0000","last_became_active":"2024-04-19T02:15:28.892636+0000","last_became_peered":"2024-04-19T02:15:28.892636+0000","last_unstale":"2024-04-19T02:16:30.090183+0000","last_undegraded":"2024-04-19T02:16:30.090183+0000","last_fullsized":"2024-04-19T02:16:30.090183+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:43:51.221619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.095812+0000","last_change":"2024-04-19T02:15:53.955655+0000","last_active":"2024-04-19T02:16:30.095812+0000","last_peered":"2024-04-19T02:16:30.095812+0000","last_clean":"2024-04-19T02:16:30.095812+0000","last_became_active":"2024-04-19T02:15:53.955382+0000","last_became_peered":"2024-04-19T02:15:53.955382+0000","last_unstale":"2024-04-19T02:16:30.095812+0000","last_undegraded":"2024-04-19T02:16:30.095812+0000","last_fullsized":"2024-04-19T02:16:30.095812+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:48.239260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093058+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:16:30.093058+0000","last_peered":"2024-04-19T02:16:30.093058+0000","last_clean":"2024-04-19T02:16:30.093058+0000","last_became_active":"2024-04-19T02:15:28.890751+0000","last_became_peered":"2024-04-19T02:15:28.890751+0000","last_unstale":"2024-04-19T02:16:30.093058+0000","last_undegraded":"2024-04-19T02:16:30.093058+0000","last_fullsized":"2024-04-19T02:16:30.093058+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.092906+0000","last_change":"2024-04-19T02:15:53.957865+0000","last_active":"2024-04-19T02:16:30.092906+0000","last_peered":"2024-04-19T02:16:30.092906+0000","last_clean":"2024-04-19T02:16:30.092906+0000","last_became_active":"2024-04-19T02:15:53.957627+0000","last_became_peered":"2024-04-19T02:15:53.957627+0000","last_unstale":"2024-04-19T02:16:30.092906+0000","last_undegraded":"2024-04-19T02:16:30.092906+0000","last_fullsized":"2024-04-19T02:16:30.092906+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:16:45.799016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.092861+0000","last_change":"2024-04-19T02:15:28.892934+0000","last_active":"2024-04-19T02:16:30.092861+0000","last_peered":"2024-04-19T02:16:30.092861+0000","last_clean":"2024-04-19T02:16:30.092861+0000","last_became_active":"2024-04-19T02:15:28.891879+0000","last_became_peered":"2024-04-19T02:15:28.891879+0000","last_unstale":"2024-04-19T02:16:30.092861+0000","last_undegraded":"2024-04-19T02:16:30.092861+0000","last_fullsized":"2024-04-19T02:16:30.092861+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:10:12.514798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093617+0000","last_change":"2024-04-19T02:15:29.279685+0000","last_active":"2024-04-19T02:16:30.093617+0000","last_peered":"2024-04-19T02:16:30.093617+0000","last_clean":"2024-04-19T02:16:30.093617+0000","last_became_active":"2024-04-19T02:15:29.278810+0000","last_became_peered":"2024-04-19T02:15:29.278810+0000","last_unstale":"2024-04-19T02:16:30.093617+0000","last_undegraded":"2024-04-19T02:16:30.093617+0000","last_fullsized":"2024-04-19T02:16:30.093617+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.089408+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:16:30.089408+0000","last_peered":"2024-04-19T02:16:30.089408+0000","last_clean":"2024-04-19T02:16:30.089408+0000","last_became_active":"2024-04-19T02:15:28.890882+0000","last_became_peered":"2024-04-19T02:15:28.890882+0000","last_unstale":"2024-04-19T02:16:30.089408+0000","last_undegraded":"2024-04-19T02:16:30.089408+0000","last_fullsized":"2024-04-19T02:16:30.089408+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:31.673938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093587+0000","last_change":"2024-04-19T02:15:29.284258+0000","last_active":"2024-04-19T02:16:30.093587+0000","last_peered":"2024-04-19T02:16:30.093587+0000","last_clean":"2024-04-19T02:16:30.093587+0000","last_became_active":"2024-04-19T02:15:29.283995+0000","last_became_peered":"2024-04-19T02:15:29.283995+0000","last_unstale":"2024-04-19T02:16:30.093587+0000","last_undegraded":"2024-04-19T02:16:30.093587+0000","last_fullsized":"2024-04-19T02:16:30.093587+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:35.941308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"34'5693","reported_seq":5719,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-19T02:16:32.791899+0000","last_change":"2024-04-19T02:15:53.956977+0000","last_active":"2024-04-19T02:16:32.791899+0000","last_peered":"2024-04-19T02:16:32.791899+0000","last_clean":"2024-04-19T02:16:32.791899+0000","last_became_active":"2024-04-19T02:15:53.956730+0000","last_became_peered":"2024-04-19T02:15:53.956730+0000","last_unstale":"2024-04-19T02:16:32.791899+0000","last_undegraded":"2024-04-19T02:16:32.791899+0000","last_fullsized":"2024-04-19T02:16:32.791899+0000","mapping_epoch":16,"log_start":"21'2000","ondisk_log_start":"21'2000","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3693,"log_dups_size":0,"ondisk_log_size":3693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:56:46.323499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":373096448,"num_objects":5693,"num_object_clones":0,"num_object_copies":11386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5693,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5693,"num_write_kb":364352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.090270+0000","last_change":"2024-04-19T02:15:28.890265+0000","last_active":"2024-04-19T02:16:30.090270+0000","last_peered":"2024-04-19T02:16:30.090270+0000","last_clean":"2024-04-19T02:16:30.090270+0000","last_became_active":"2024-04-19T02:15:28.890004+0000","last_became_peered":"2024-04-19T02:15:28.890004+0000","last_unstale":"2024-04-19T02:16:30.090270+0000","last_undegraded":"2024-04-19T02:16:30.090270+0000","last_fullsized":"2024-04-19T02:16:30.090270+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:02.517101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.092994+0000","last_change":"2024-04-19T02:15:29.285529+0000","last_active":"2024-04-19T02:16:30.092994+0000","last_peered":"2024-04-19T02:16:30.092994+0000","last_clean":"2024-04-19T02:16:30.092994+0000","last_became_active":"2024-04-19T02:15:29.285197+0000","last_became_peered":"2024-04-19T02:15:29.285197+0000","last_unstale":"2024-04-19T02:16:30.092994+0000","last_undegraded":"2024-04-19T02:16:30.092994+0000","last_fullsized":"2024-04-19T02:16:30.092994+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"34'5670","reported_seq":5695,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-19T02:16:32.755132+0000","last_change":"2024-04-19T02:15:53.958523+0000","last_active":"2024-04-19T02:16:32.755132+0000","last_peered":"2024-04-19T02:16:32.755132+0000","last_clean":"2024-04-19T02:16:32.755132+0000","last_became_active":"2024-04-19T02:15:53.957627+0000","last_became_peered":"2024-04-19T02:15:53.957627+0000","last_unstale":"2024-04-19T02:16:32.755132+0000","last_undegraded":"2024-04-19T02:16:32.755132+0000","last_fullsized":"2024-04-19T02:16:32.755132+0000","mapping_epoch":16,"log_start":"21'1747","ondisk_log_start":"21'1747","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3923,"log_dups_size":0,"ondisk_log_size":3923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:59:55.120296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":371589120,"num_objects":5670,"num_object_clones":0,"num_object_copies":11340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5670,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5670,"num_write_kb":362880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093818+0000","last_change":"2024-04-19T02:15:28.893902+0000","last_active":"2024-04-19T02:16:30.093818+0000","last_peered":"2024-04-19T02:16:30.093818+0000","last_clean":"2024-04-19T02:16:30.093818+0000","last_became_active":"2024-04-19T02:15:28.893231+0000","last_became_peered":"2024-04-19T02:15:28.893231+0000","last_unstale":"2024-04-19T02:16:30.093818+0000","last_undegraded":"2024-04-19T02:16:30.093818+0000","last_fullsized":"2024-04-19T02:16:30.093818+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:23.658442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093030+0000","last_change":"2024-04-19T02:15:29.282874+0000","last_active":"2024-04-19T02:16:30.093030+0000","last_peered":"2024-04-19T02:16:30.093030+0000","last_clean":"2024-04-19T02:16:30.093030+0000","last_became_active":"2024-04-19T02:15:29.281675+0000","last_became_peered":"2024-04-19T02:15:29.281675+0000","last_unstale":"2024-04-19T02:16:30.093030+0000","last_undegraded":"2024-04-19T02:16:30.093030+0000","last_fullsized":"2024-04-19T02:16:30.093030+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:35.941308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"34'5583","reported_seq":5609,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-19T02:16:32.739379+0000","last_change":"2024-04-19T02:15:53.958324+0000","last_active":"2024-04-19T02:16:32.739379+0000","last_peered":"2024-04-19T02:16:32.739379+0000","last_clean":"2024-04-19T02:16:32.739379+0000","last_became_active":"2024-04-19T02:15:53.957392+0000","last_became_peered":"2024-04-19T02:15:53.957392+0000","last_unstale":"2024-04-19T02:16:32.739379+0000","last_undegraded":"2024-04-19T02:16:32.739379+0000","last_fullsized":"2024-04-19T02:16:32.739379+0000","mapping_epoch":16,"log_start":"21'1600","ondisk_log_start":"21'1600","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3983,"log_dups_size":0,"ondisk_log_size":3983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:12:58.132969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":365887488,"num_objects":5583,"num_object_clones":0,"num_object_copies":11166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5583,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5583,"num_write_kb":357312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.089927+0000","last_change":"2024-04-19T02:15:28.891234+0000","last_active":"2024-04-19T02:16:30.089927+0000","last_peered":"2024-04-19T02:16:30.089927+0000","last_clean":"2024-04-19T02:16:30.089927+0000","last_became_active":"2024-04-19T02:15:28.890881+0000","last_became_peered":"2024-04-19T02:15:28.890881+0000","last_unstale":"2024-04-19T02:16:30.089927+0000","last_undegraded":"2024-04-19T02:16:30.089927+0000","last_fullsized":"2024-04-19T02:16:30.089927+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.090429+0000","last_change":"2024-04-19T02:15:29.281937+0000","last_active":"2024-04-19T02:16:30.090429+0000","last_peered":"2024-04-19T02:16:30.090429+0000","last_clean":"2024-04-19T02:16:30.090429+0000","last_became_active":"2024-04-19T02:15:29.280727+0000","last_became_peered":"2024-04-19T02:15:29.280727+0000","last_unstale":"2024-04-19T02:16:30.090429+0000","last_undegraded":"2024-04-19T02:16:30.090429+0000","last_fullsized":"2024-04-19T02:16:30.090429+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"34'5710","reported_seq":5736,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-19T02:16:32.774416+0000","last_change":"2024-04-19T02:15:53.959099+0000","last_active":"2024-04-19T02:16:32.774416+0000","last_peered":"2024-04-19T02:16:32.774416+0000","last_clean":"2024-04-19T02:16:32.774416+0000","last_became_active":"2024-04-19T02:15:53.958885+0000","last_became_peered":"2024-04-19T02:15:53.958885+0000","last_unstale":"2024-04-19T02:16:32.774416+0000","last_undegraded":"2024-04-19T02:16:32.774416+0000","last_fullsized":"2024-04-19T02:16:32.774416+0000","mapping_epoch":16,"log_start":"22'2100","ondisk_log_start":"22'2100","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3610,"log_dups_size":0,"ondisk_log_size":3610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:53:26.969927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":374210560,"num_objects":5710,"num_object_clones":0,"num_object_copies":11420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5710,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5710,"num_write_kb":365440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.089317+0000","last_change":"2024-04-19T02:15:28.892767+0000","last_active":"2024-04-19T02:16:30.089317+0000","last_peered":"2024-04-19T02:16:30.089317+0000","last_clean":"2024-04-19T02:16:30.089317+0000","last_became_active":"2024-04-19T02:15:28.892235+0000","last_became_peered":"2024-04-19T02:15:28.892235+0000","last_unstale":"2024-04-19T02:16:30.089317+0000","last_undegraded":"2024-04-19T02:16:30.089317+0000","last_fullsized":"2024-04-19T02:16:30.089317+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:37.690735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093262+0000","last_change":"2024-04-19T02:15:29.279857+0000","last_active":"2024-04-19T02:16:30.093262+0000","last_peered":"2024-04-19T02:16:30.093262+0000","last_clean":"2024-04-19T02:16:30.093262+0000","last_became_active":"2024-04-19T02:15:29.279536+0000","last_became_peered":"2024-04-19T02:15:29.279536+0000","last_unstale":"2024-04-19T02:16:30.093262+0000","last_undegraded":"2024-04-19T02:16:30.093262+0000","last_fullsized":"2024-04-19T02:16:30.093262+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:00.191179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"34'5656","reported_seq":5682,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-19T02:16:32.783769+0000","last_change":"2024-04-19T02:15:53.957261+0000","last_active":"2024-04-19T02:16:32.783769+0000","last_peered":"2024-04-19T02:16:32.783769+0000","last_clean":"2024-04-19T02:16:32.783769+0000","last_became_active":"2024-04-19T02:15:53.957092+0000","last_became_peered":"2024-04-19T02:15:53.957092+0000","last_unstale":"2024-04-19T02:16:32.783769+0000","last_undegraded":"2024-04-19T02:16:32.783769+0000","last_fullsized":"2024-04-19T02:16:32.783769+0000","mapping_epoch":16,"log_start":"21'1913","ondisk_log_start":"21'1913","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3743,"log_dups_size":0,"ondisk_log_size":3743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:54:15.544923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":370671616,"num_objects":5656,"num_object_clones":0,"num_object_copies":11312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5656,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5656,"num_write_kb":361984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093207+0000","last_change":"2024-04-19T02:15:28.891611+0000","last_active":"2024-04-19T02:16:30.093207+0000","last_peered":"2024-04-19T02:16:30.093207+0000","last_clean":"2024-04-19T02:16:30.093207+0000","last_became_active":"2024-04-19T02:15:28.890914+0000","last_became_peered":"2024-04-19T02:15:28.890914+0000","last_unstale":"2024-04-19T02:16:30.093207+0000","last_undegraded":"2024-04-19T02:16:30.093207+0000","last_fullsized":"2024-04-19T02:16:30.093207+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:37.690735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.089451+0000","last_change":"2024-04-19T02:15:29.285774+0000","last_active":"2024-04-19T02:16:30.089451+0000","last_peered":"2024-04-19T02:16:30.089451+0000","last_clean":"2024-04-19T02:16:30.089451+0000","last_became_active":"2024-04-19T02:15:29.284705+0000","last_became_peered":"2024-04-19T02:15:29.284705+0000","last_unstale":"2024-04-19T02:16:30.089451+0000","last_undegraded":"2024-04-19T02:16:30.089451+0000","last_fullsized":"2024-04-19T02:16:30.089451+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"34'5562","reported_seq":5588,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-19T02:16:32.766711+0000","last_change":"2024-04-19T02:15:53.955286+0000","last_active":"2024-04-19T02:16:32.766711+0000","last_peered":"2024-04-19T02:16:32.766711+0000","last_clean":"2024-04-19T02:16:32.766711+0000","last_became_active":"2024-04-19T02:15:53.955026+0000","last_became_peered":"2024-04-19T02:15:53.955026+0000","last_unstale":"2024-04-19T02:16:32.766711+0000","last_undegraded":"2024-04-19T02:16:32.766711+0000","last_fullsized":"2024-04-19T02:16:32.766711+0000","mapping_epoch":16,"log_start":"21'1900","ondisk_log_start":"21'1900","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3662,"log_dups_size":0,"ondisk_log_size":3662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:05:48.594301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":364511232,"num_objects":5562,"num_object_clones":0,"num_object_copies":11124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5562,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5562,"num_write_kb":355968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.090387+0000","last_change":"2024-04-19T02:15:28.892873+0000","last_active":"2024-04-19T02:16:30.090387+0000","last_peered":"2024-04-19T02:16:30.090387+0000","last_clean":"2024-04-19T02:16:30.090387+0000","last_became_active":"2024-04-19T02:15:28.892487+0000","last_became_peered":"2024-04-19T02:15:28.892487+0000","last_unstale":"2024-04-19T02:16:30.090387+0000","last_undegraded":"2024-04-19T02:16:30.090387+0000","last_fullsized":"2024-04-19T02:16:30.090387+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:35.412837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.090081+0000","last_change":"2024-04-19T02:15:29.285019+0000","last_active":"2024-04-19T02:16:30.090081+0000","last_peered":"2024-04-19T02:16:30.090081+0000","last_clean":"2024-04-19T02:16:30.090081+0000","last_became_active":"2024-04-19T02:15:29.284650+0000","last_became_peered":"2024-04-19T02:15:29.284650+0000","last_unstale":"2024-04-19T02:16:30.090081+0000","last_undegraded":"2024-04-19T02:16:30.090081+0000","last_fullsized":"2024-04-19T02:16:30.090081+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"34'5653","reported_seq":5679,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-19T02:16:32.777564+0000","last_change":"2024-04-19T02:15:53.957403+0000","last_active":"2024-04-19T02:16:32.777564+0000","last_peered":"2024-04-19T02:16:32.777564+0000","last_clean":"2024-04-19T02:16:32.777564+0000","last_became_active":"2024-04-19T02:15:53.957190+0000","last_became_peered":"2024-04-19T02:15:53.957190+0000","last_unstale":"2024-04-19T02:16:32.777564+0000","last_undegraded":"2024-04-19T02:16:32.777564+0000","last_fullsized":"2024-04-19T02:16:32.777564+0000","mapping_epoch":16,"log_start":"21'1901","ondisk_log_start":"21'1901","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3752,"log_dups_size":0,"ondisk_log_size":3752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:07:12.817884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":370475008,"num_objects":5653,"num_object_clones":0,"num_object_copies":11306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5653,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5653,"num_write_kb":361792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.089131+0000","last_change":"2024-04-19T02:15:53.956839+0000","last_active":"2024-04-19T02:16:30.089131+0000","last_peered":"2024-04-19T02:16:30.089131+0000","last_clean":"2024-04-19T02:16:30.089131+0000","last_became_active":"2024-04-19T02:15:53.956630+0000","last_became_peered":"2024-04-19T02:15:53.956630+0000","last_unstale":"2024-04-19T02:16:30.089131+0000","last_undegraded":"2024-04-19T02:16:30.089131+0000","last_fullsized":"2024-04-19T02:16:30.089131+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:47.229730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.089820+0000","last_change":"2024-04-19T02:15:29.287190+0000","last_active":"2024-04-19T02:16:30.089820+0000","last_peered":"2024-04-19T02:16:30.089820+0000","last_clean":"2024-04-19T02:16:30.089820+0000","last_became_active":"2024-04-19T02:15:29.286606+0000","last_became_peered":"2024-04-19T02:15:29.286606+0000","last_unstale":"2024-04-19T02:16:30.089820+0000","last_undegraded":"2024-04-19T02:16:30.089820+0000","last_fullsized":"2024-04-19T02:16:30.089820+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:28.387062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"34'5550","reported_seq":5576,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-19T02:16:32.747206+0000","last_change":"2024-04-19T02:15:53.958448+0000","last_active":"2024-04-19T02:16:32.747206+0000","last_peered":"2024-04-19T02:16:32.747206+0000","last_clean":"2024-04-19T02:16:32.747206+0000","last_became_active":"2024-04-19T02:15:53.957595+0000","last_became_peered":"2024-04-19T02:15:53.957595+0000","last_unstale":"2024-04-19T02:16:32.747206+0000","last_undegraded":"2024-04-19T02:16:32.747206+0000","last_fullsized":"2024-04-19T02:16:32.747206+0000","mapping_epoch":16,"log_start":"21'1644","ondisk_log_start":"21'1644","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3906,"log_dups_size":0,"ondisk_log_size":3906,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:26:31.855319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":363724800,"num_objects":5550,"num_object_clones":0,"num_object_copies":11100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5550,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5550,"num_write_kb":355200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093203+0000","last_change":"2024-04-19T02:15:28.894121+0000","last_active":"2024-04-19T02:16:30.093203+0000","last_peered":"2024-04-19T02:16:30.093203+0000","last_clean":"2024-04-19T02:16:30.093203+0000","last_became_active":"2024-04-19T02:15:28.893902+0000","last_became_peered":"2024-04-19T02:15:28.893902+0000","last_unstale":"2024-04-19T02:16:30.093203+0000","last_undegraded":"2024-04-19T02:16:30.093203+0000","last_fullsized":"2024-04-19T02:16:30.093203+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:10:35.146583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093262+0000","last_change":"2024-04-19T02:15:29.282870+0000","last_active":"2024-04-19T02:16:30.093262+0000","last_peered":"2024-04-19T02:16:30.093262+0000","last_clean":"2024-04-19T02:16:30.093262+0000","last_became_active":"2024-04-19T02:15:29.281873+0000","last_became_peered":"2024-04-19T02:15:29.281873+0000","last_unstale":"2024-04-19T02:16:30.093262+0000","last_undegraded":"2024-04-19T02:16:30.093262+0000","last_fullsized":"2024-04-19T02:16:30.093262+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"34'5716","reported_seq":5742,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-19T02:16:32.770749+0000","last_change":"2024-04-19T02:15:53.955498+0000","last_active":"2024-04-19T02:16:32.770749+0000","last_peered":"2024-04-19T02:16:32.770749+0000","last_clean":"2024-04-19T02:16:32.770749+0000","last_became_active":"2024-04-19T02:15:53.954910+0000","last_became_peered":"2024-04-19T02:15:53.954910+0000","last_unstale":"2024-04-19T02:16:32.770749+0000","last_undegraded":"2024-04-19T02:16:32.770749+0000","last_fullsized":"2024-04-19T02:16:32.770749+0000","mapping_epoch":16,"log_start":"22'2100","ondisk_log_start":"22'2100","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3616,"log_dups_size":0,"ondisk_log_size":3616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:58:27.262672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":374603776,"num_objects":5716,"num_object_clones":0,"num_object_copies":11432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5716,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5716,"num_write_kb":365824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.096012+0000","last_change":"2024-04-19T02:15:24.527061+0000","last_active":"2024-04-19T02:16:30.096012+0000","last_peered":"2024-04-19T02:16:30.096012+0000","last_clean":"2024-04-19T02:16:30.096012+0000","last_became_active":"2024-04-19T02:15:24.526757+0000","last_became_peered":"2024-04-19T02:15:24.526757+0000","last_unstale":"2024-04-19T02:16:30.096012+0000","last_undegraded":"2024-04-19T02:16:30.096012+0000","last_fullsized":"2024-04-19T02:16:30.096012+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:17:13.649077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.090005+0000","last_change":"2024-04-19T02:15:28.892766+0000","last_active":"2024-04-19T02:16:30.090005+0000","last_peered":"2024-04-19T02:16:30.090005+0000","last_clean":"2024-04-19T02:16:30.090005+0000","last_became_active":"2024-04-19T02:15:28.892396+0000","last_became_peered":"2024-04-19T02:15:28.892396+0000","last_unstale":"2024-04-19T02:16:30.090005+0000","last_undegraded":"2024-04-19T02:16:30.090005+0000","last_fullsized":"2024-04-19T02:16:30.090005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:57.946581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.092577+0000","last_change":"2024-04-19T02:15:29.277922+0000","last_active":"2024-04-19T02:16:30.092577+0000","last_peered":"2024-04-19T02:16:30.092577+0000","last_clean":"2024-04-19T02:16:30.092577+0000","last_became_active":"2024-04-19T02:15:29.276968+0000","last_became_peered":"2024-04-19T02:15:29.276968+0000","last_unstale":"2024-04-19T02:16:30.092577+0000","last_undegraded":"2024-04-19T02:16:30.092577+0000","last_fullsized":"2024-04-19T02:16:30.092577+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"34'5632","reported_seq":5658,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-19T02:16:32.769639+0000","last_change":"2024-04-19T02:15:53.955228+0000","last_active":"2024-04-19T02:16:32.769639+0000","last_peered":"2024-04-19T02:16:32.769639+0000","last_clean":"2024-04-19T02:16:32.769639+0000","last_became_active":"2024-04-19T02:15:53.954960+0000","last_became_peered":"2024-04-19T02:15:53.954960+0000","last_unstale":"2024-04-19T02:16:32.769639+0000","last_undegraded":"2024-04-19T02:16:32.769639+0000","last_fullsized":"2024-04-19T02:16:32.769639+0000","mapping_epoch":16,"log_start":"22'2000","ondisk_log_start":"22'2000","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3632,"log_dups_size":0,"ondisk_log_size":3632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:46:07.409922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":369098752,"num_objects":5632,"num_object_clones":0,"num_object_copies":11264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5632,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5632,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.090510+0000","last_change":"2024-04-19T02:15:24.530933+0000","last_active":"2024-04-19T02:16:30.090510+0000","last_peered":"2024-04-19T02:16:30.090510+0000","last_clean":"2024-04-19T02:16:30.090510+0000","last_became_active":"2024-04-19T02:15:24.530550+0000","last_became_peered":"2024-04-19T02:15:24.530550+0000","last_unstale":"2024-04-19T02:16:30.090510+0000","last_undegraded":"2024-04-19T02:16:30.090510+0000","last_fullsized":"2024-04-19T02:16:30.090510+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:18:15.194321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.090030+0000","last_change":"2024-04-19T02:15:28.893062+0000","last_active":"2024-04-19T02:16:30.090030+0000","last_peered":"2024-04-19T02:16:30.090030+0000","last_clean":"2024-04-19T02:16:30.090030+0000","last_became_active":"2024-04-19T02:15:28.892798+0000","last_became_peered":"2024-04-19T02:15:28.892798+0000","last_unstale":"2024-04-19T02:16:30.090030+0000","last_undegraded":"2024-04-19T02:16:30.090030+0000","last_fullsized":"2024-04-19T02:16:30.090030+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:53.170180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.095946+0000","last_change":"2024-04-19T02:15:29.278294+0000","last_active":"2024-04-19T02:16:30.095946+0000","last_peered":"2024-04-19T02:16:30.095946+0000","last_clean":"2024-04-19T02:16:30.095946+0000","last_became_active":"2024-04-19T02:15:29.277536+0000","last_became_peered":"2024-04-19T02:15:29.277536+0000","last_unstale":"2024-04-19T02:16:30.095946+0000","last_undegraded":"2024-04-19T02:16:30.095946+0000","last_fullsized":"2024-04-19T02:16:30.095946+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"34'5628","reported_seq":5654,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-19T02:16:32.761718+0000","last_change":"2024-04-19T02:15:53.956251+0000","last_active":"2024-04-19T02:16:32.761718+0000","last_peered":"2024-04-19T02:16:32.761718+0000","last_clean":"2024-04-19T02:16:32.761718+0000","last_became_active":"2024-04-19T02:15:53.955886+0000","last_became_peered":"2024-04-19T02:15:53.955886+0000","last_unstale":"2024-04-19T02:16:32.761718+0000","last_undegraded":"2024-04-19T02:16:32.761718+0000","last_fullsized":"2024-04-19T02:16:32.761718+0000","mapping_epoch":16,"log_start":"22'2000","ondisk_log_start":"22'2000","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3628,"log_dups_size":0,"ondisk_log_size":3628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:38:38.586906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":368836608,"num_objects":5628,"num_object_clones":0,"num_object_copies":11256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5628,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5628,"num_write_kb":360192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.092990+0000","last_change":"2024-04-19T02:15:24.527048+0000","last_active":"2024-04-19T02:16:30.092990+0000","last_peered":"2024-04-19T02:16:30.092990+0000","last_clean":"2024-04-19T02:16:30.092990+0000","last_became_active":"2024-04-19T02:15:24.526790+0000","last_became_peered":"2024-04-19T02:15:24.526790+0000","last_unstale":"2024-04-19T02:16:30.092990+0000","last_undegraded":"2024-04-19T02:16:30.092990+0000","last_fullsized":"2024-04-19T02:16:30.092990+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.088984+0000","last_change":"2024-04-19T02:15:53.956945+0000","last_active":"2024-04-19T02:16:30.088984+0000","last_peered":"2024-04-19T02:16:30.088984+0000","last_clean":"2024-04-19T02:16:30.088984+0000","last_became_active":"2024-04-19T02:15:53.956719+0000","last_became_peered":"2024-04-19T02:15:53.956719+0000","last_unstale":"2024-04-19T02:16:30.088984+0000","last_undegraded":"2024-04-19T02:16:30.088984+0000","last_fullsized":"2024-04-19T02:16:30.088984+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:00:37.754624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093426+0000","last_change":"2024-04-19T02:15:29.282663+0000","last_active":"2024-04-19T02:16:30.093426+0000","last_peered":"2024-04-19T02:16:30.093426+0000","last_clean":"2024-04-19T02:16:30.093426+0000","last_became_active":"2024-04-19T02:15:29.282217+0000","last_became_peered":"2024-04-19T02:15:29.282217+0000","last_unstale":"2024-04-19T02:16:30.093426+0000","last_undegraded":"2024-04-19T02:16:30.093426+0000","last_fullsized":"2024-04-19T02:16:30.093426+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"34'5551","reported_seq":5577,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-19T02:16:32.733690+0000","last_change":"2024-04-19T02:15:53.958264+0000","last_active":"2024-04-19T02:16:32.733690+0000","last_peered":"2024-04-19T02:16:32.733690+0000","last_clean":"2024-04-19T02:16:32.733690+0000","last_became_active":"2024-04-19T02:15:53.956689+0000","last_became_peered":"2024-04-19T02:15:53.956689+0000","last_unstale":"2024-04-19T02:16:32.733690+0000","last_undegraded":"2024-04-19T02:16:32.733690+0000","last_fullsized":"2024-04-19T02:16:32.733690+0000","mapping_epoch":16,"log_start":"21'1600","ondisk_log_start":"21'1600","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3951,"log_dups_size":0,"ondisk_log_size":3951,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:24:32.928594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":363790336,"num_objects":5551,"num_object_clones":0,"num_object_copies":11102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5551,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5551,"num_write_kb":355264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.090102+0000","last_change":"2024-04-19T02:15:24.530924+0000","last_active":"2024-04-19T02:16:30.090102+0000","last_peered":"2024-04-19T02:16:30.090102+0000","last_clean":"2024-04-19T02:16:30.090102+0000","last_became_active":"2024-04-19T02:15:24.530551+0000","last_became_peered":"2024-04-19T02:15:24.530551+0000","last_unstale":"2024-04-19T02:16:30.090102+0000","last_undegraded":"2024-04-19T02:16:30.090102+0000","last_fullsized":"2024-04-19T02:16:30.090102+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:30.576946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":229,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.089169+0000","last_change":"2024-04-19T02:15:24.533634+0000","last_active":"2024-04-19T02:16:30.089169+0000","last_peered":"2024-04-19T02:16:30.089169+0000","last_clean":"2024-04-19T02:16:30.089169+0000","last_became_active":"2024-04-19T02:15:24.533420+0000","last_became_peered":"2024-04-19T02:15:24.533420+0000","last_unstale":"2024-04-19T02:16:30.089169+0000","last_undegraded":"2024-04-19T02:16:30.089169+0000","last_fullsized":"2024-04-19T02:16:30.089169+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093004+0000","last_change":"2024-04-19T02:15:28.890244+0000","last_active":"2024-04-19T02:16:30.093004+0000","last_peered":"2024-04-19T02:16:30.093004+0000","last_clean":"2024-04-19T02:16:30.093004+0000","last_became_active":"2024-04-19T02:15:28.889831+0000","last_became_peered":"2024-04-19T02:15:28.889831+0000","last_unstale":"2024-04-19T02:16:30.093004+0000","last_undegraded":"2024-04-19T02:16:30.093004+0000","last_fullsized":"2024-04-19T02:16:30.093004+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.090040+0000","last_change":"2024-04-19T02:15:29.285015+0000","last_active":"2024-04-19T02:16:30.090040+0000","last_peered":"2024-04-19T02:16:30.090040+0000","last_clean":"2024-04-19T02:16:30.090040+0000","last_became_active":"2024-04-19T02:15:29.284164+0000","last_became_peered":"2024-04-19T02:15:29.284164+0000","last_unstale":"2024-04-19T02:16:30.090040+0000","last_undegraded":"2024-04-19T02:16:30.090040+0000","last_fullsized":"2024-04-19T02:16:30.090040+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:36.987844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"34'5658","reported_seq":5684,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-19T02:16:32.797320+0000","last_change":"2024-04-19T02:15:53.956463+0000","last_active":"2024-04-19T02:16:32.797320+0000","last_peered":"2024-04-19T02:16:32.797320+0000","last_clean":"2024-04-19T02:16:32.797320+0000","last_became_active":"2024-04-19T02:15:53.955819+0000","last_became_peered":"2024-04-19T02:15:53.955819+0000","last_unstale":"2024-04-19T02:16:32.797320+0000","last_undegraded":"2024-04-19T02:16:32.797320+0000","last_fullsized":"2024-04-19T02:16:32.797320+0000","mapping_epoch":16,"log_start":"21'1931","ondisk_log_start":"21'1931","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3727,"log_dups_size":0,"ondisk_log_size":3727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:46:07.409922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":370802688,"num_objects":5658,"num_object_clones":0,"num_object_copies":11316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5658,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5658,"num_write_kb":362112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.089245+0000","last_change":"2024-04-19T02:15:24.533912+0000","last_active":"2024-04-19T02:16:30.089245+0000","last_peered":"2024-04-19T02:16:30.089245+0000","last_clean":"2024-04-19T02:16:30.089245+0000","last_became_active":"2024-04-19T02:15:24.533580+0000","last_became_peered":"2024-04-19T02:15:24.533580+0000","last_unstale":"2024-04-19T02:16:30.089245+0000","last_undegraded":"2024-04-19T02:16:30.089245+0000","last_fullsized":"2024-04-19T02:16:30.089245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:45.045477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.092752+0000","last_change":"2024-04-19T02:15:28.891889+0000","last_active":"2024-04-19T02:16:30.092752+0000","last_peered":"2024-04-19T02:16:30.092752+0000","last_clean":"2024-04-19T02:16:30.092752+0000","last_became_active":"2024-04-19T02:15:28.890919+0000","last_became_peered":"2024-04-19T02:15:28.890919+0000","last_unstale":"2024-04-19T02:16:30.092752+0000","last_undegraded":"2024-04-19T02:16:30.092752+0000","last_fullsized":"2024-04-19T02:16:30.092752+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:35.412837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093169+0000","last_change":"2024-04-19T02:15:53.957881+0000","last_active":"2024-04-19T02:16:30.093169+0000","last_peered":"2024-04-19T02:16:30.093169+0000","last_clean":"2024-04-19T02:16:30.093169+0000","last_became_active":"2024-04-19T02:15:53.957657+0000","last_became_peered":"2024-04-19T02:15:53.957657+0000","last_unstale":"2024-04-19T02:16:30.093169+0000","last_undegraded":"2024-04-19T02:16:30.093169+0000","last_fullsized":"2024-04-19T02:16:30.093169+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:46.921714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"34'5642","reported_seq":5667,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-19T02:16:32.799658+0000","last_change":"2024-04-19T02:15:53.955068+0000","last_active":"2024-04-19T02:16:32.799658+0000","last_peered":"2024-04-19T02:16:32.799658+0000","last_clean":"2024-04-19T02:16:32.799658+0000","last_became_active":"2024-04-19T02:15:53.954721+0000","last_became_peered":"2024-04-19T02:15:53.954721+0000","last_unstale":"2024-04-19T02:16:32.799658+0000","last_undegraded":"2024-04-19T02:16:32.799658+0000","last_fullsized":"2024-04-19T02:16:32.799658+0000","mapping_epoch":16,"log_start":"21'1900","ondisk_log_start":"21'1900","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3742,"log_dups_size":0,"ondisk_log_size":3742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:18:29.742535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":369754112,"num_objects":5642,"num_object_clones":0,"num_object_copies":11284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5642,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5642,"num_write_kb":361088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093339+0000","last_change":"2024-04-19T02:15:53.959105+0000","last_active":"2024-04-19T02:16:30.093339+0000","last_peered":"2024-04-19T02:16:30.093339+0000","last_clean":"2024-04-19T02:16:30.093339+0000","last_became_active":"2024-04-19T02:15:53.958836+0000","last_became_peered":"2024-04-19T02:15:53.958836+0000","last_unstale":"2024-04-19T02:16:30.093339+0000","last_undegraded":"2024-04-19T02:16:30.093339+0000","last_fullsized":"2024-04-19T02:16:30.093339+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:18:00.321514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.095897+0000","last_change":"2024-04-19T02:15:28.892125+0000","last_active":"2024-04-19T02:16:30.095897+0000","last_peered":"2024-04-19T02:16:30.095897+0000","last_clean":"2024-04-19T02:16:30.095897+0000","last_became_active":"2024-04-19T02:15:28.891300+0000","last_became_peered":"2024-04-19T02:15:28.891300+0000","last_unstale":"2024-04-19T02:16:30.095897+0000","last_undegraded":"2024-04-19T02:16:30.095897+0000","last_fullsized":"2024-04-19T02:16:30.095897+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.092638+0000","last_change":"2024-04-19T02:15:29.281694+0000","last_active":"2024-04-19T02:16:30.092638+0000","last_peered":"2024-04-19T02:16:30.092638+0000","last_clean":"2024-04-19T02:16:30.092638+0000","last_became_active":"2024-04-19T02:15:29.280519+0000","last_became_peered":"2024-04-19T02:15:29.280519+0000","last_unstale":"2024-04-19T02:16:30.092638+0000","last_undegraded":"2024-04-19T02:16:30.092638+0000","last_fullsized":"2024-04-19T02:16:30.092638+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:50.890545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"34'5462","reported_seq":8502,"reported_epoch":34,"state":"active+remapped+backfilling","last_fresh":"2024-04-19T02:16:32.771479+0000","last_change":"2024-04-19T02:16:30.103016+0000","last_active":"2024-04-19T02:16:32.771479+0000","last_peered":"2024-04-19T02:16:32.771479+0000","last_clean":"2024-04-19T02:16:22.050311+0000","last_became_active":"2024-04-19T02:16:24.119992+0000","last_became_peered":"2024-04-19T02:16:24.119992+0000","last_unstale":"2024-04-19T02:16:32.771479+0000","last_undegraded":"2024-04-19T02:16:32.771479+0000","last_fullsized":"2024-04-19T02:16:32.771479+0000","mapping_epoch":29,"log_start":"21'1837","ondisk_log_start":"21'1837","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3625,"log_dups_size":0,"ondisk_log_size":3625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:28.663111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":357957632,"num_objects":5462,"num_object_clones":0,"num_object_copies":10924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":3790,"num_objects_unfound":0,"num_objects_dirty":5462,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5462,"num_write_kb":349568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1501,"num_bytes_recovered":98369536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[{"shards":"0,2","objects":5462}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093177+0000","last_change":"2024-04-19T02:15:28.891702+0000","last_active":"2024-04-19T02:16:30.093177+0000","last_peered":"2024-04-19T02:16:30.093177+0000","last_clean":"2024-04-19T02:16:30.093177+0000","last_became_active":"2024-04-19T02:15:28.890743+0000","last_became_peered":"2024-04-19T02:15:28.890743+0000","last_unstale":"2024-04-19T02:16:30.093177+0000","last_undegraded":"2024-04-19T02:16:30.093177+0000","last_fullsized":"2024-04-19T02:16:30.093177+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093547+0000","last_change":"2024-04-19T02:15:24.526845+0000","last_active":"2024-04-19T02:16:30.093547+0000","last_peered":"2024-04-19T02:16:30.093547+0000","last_clean":"2024-04-19T02:16:30.093547+0000","last_became_active":"2024-04-19T02:15:24.526500+0000","last_became_peered":"2024-04-19T02:15:24.526500+0000","last_unstale":"2024-04-19T02:16:30.093547+0000","last_undegraded":"2024-04-19T02:16:30.093547+0000","last_fullsized":"2024-04-19T02:16:30.093547+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:16.883355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.095866+0000","last_change":"2024-04-19T02:15:29.278686+0000","last_active":"2024-04-19T02:16:30.095866+0000","last_peered":"2024-04-19T02:16:30.095866+0000","last_clean":"2024-04-19T02:16:30.095866+0000","last_became_active":"2024-04-19T02:15:29.278108+0000","last_became_peered":"2024-04-19T02:15:29.278108+0000","last_unstale":"2024-04-19T02:16:30.095866+0000","last_undegraded":"2024-04-19T02:16:30.095866+0000","last_fullsized":"2024-04-19T02:16:30.095866+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:34.593754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"34'5535","reported_seq":5561,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-19T02:16:32.742195+0000","last_change":"2024-04-19T02:15:53.957269+0000","last_active":"2024-04-19T02:16:32.742195+0000","last_peered":"2024-04-19T02:16:32.742195+0000","last_clean":"2024-04-19T02:16:32.742195+0000","last_became_active":"2024-04-19T02:15:53.956554+0000","last_became_peered":"2024-04-19T02:15:53.956554+0000","last_unstale":"2024-04-19T02:16:32.742195+0000","last_undegraded":"2024-04-19T02:16:32.742195+0000","last_fullsized":"2024-04-19T02:16:32.742195+0000","mapping_epoch":16,"log_start":"21'1628","ondisk_log_start":"21'1628","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3907,"log_dups_size":0,"ondisk_log_size":3907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:29:38.789719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":362741760,"num_objects":5535,"num_object_clones":0,"num_object_copies":11070,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5535,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5535,"num_write_kb":354240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.090269+0000","last_change":"2024-04-19T02:15:24.533777+0000","last_active":"2024-04-19T02:16:30.090269+0000","last_peered":"2024-04-19T02:16:30.090269+0000","last_clean":"2024-04-19T02:16:30.090269+0000","last_became_active":"2024-04-19T02:15:24.533436+0000","last_became_peered":"2024-04-19T02:15:24.533436+0000","last_unstale":"2024-04-19T02:16:30.090269+0000","last_undegraded":"2024-04-19T02:16:30.090269+0000","last_fullsized":"2024-04-19T02:16:30.090269+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:53:25.922418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093459+0000","last_change":"2024-04-19T02:15:28.891370+0000","last_active":"2024-04-19T02:16:30.093459+0000","last_peered":"2024-04-19T02:16:30.093459+0000","last_clean":"2024-04-19T02:16:30.093459+0000","last_became_active":"2024-04-19T02:15:28.890702+0000","last_became_peered":"2024-04-19T02:15:28.890702+0000","last_unstale":"2024-04-19T02:16:30.093459+0000","last_undegraded":"2024-04-19T02:16:30.093459+0000","last_fullsized":"2024-04-19T02:16:30.093459+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:33.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.092949+0000","last_change":"2024-04-19T02:15:29.282244+0000","last_active":"2024-04-19T02:16:30.092949+0000","last_peered":"2024-04-19T02:16:30.092949+0000","last_clean":"2024-04-19T02:16:30.092949+0000","last_became_active":"2024-04-19T02:15:29.280366+0000","last_became_peered":"2024-04-19T02:15:29.280366+0000","last_unstale":"2024-04-19T02:16:30.092949+0000","last_undegraded":"2024-04-19T02:16:30.092949+0000","last_fullsized":"2024-04-19T02:16:30.092949+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.092735+0000","last_change":"2024-04-19T02:15:28.893027+0000","last_active":"2024-04-19T02:16:30.092735+0000","last_peered":"2024-04-19T02:16:30.092735+0000","last_clean":"2024-04-19T02:16:30.092735+0000","last_became_active":"2024-04-19T02:15:28.892695+0000","last_became_peered":"2024-04-19T02:15:28.892695+0000","last_unstale":"2024-04-19T02:16:30.092735+0000","last_undegraded":"2024-04-19T02:16:30.092735+0000","last_fullsized":"2024-04-19T02:16:30.092735+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093025+0000","last_change":"2024-04-19T02:15:29.283155+0000","last_active":"2024-04-19T02:16:30.093025+0000","last_peered":"2024-04-19T02:16:30.093025+0000","last_clean":"2024-04-19T02:16:30.093025+0000","last_became_active":"2024-04-19T02:15:29.281407+0000","last_became_peered":"2024-04-19T02:15:29.281407+0000","last_unstale":"2024-04-19T02:16:30.093025+0000","last_undegraded":"2024-04-19T02:16:30.093025+0000","last_fullsized":"2024-04-19T02:16:30.093025+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.089618+0000","last_change":"2024-04-19T02:15:28.893067+0000","last_active":"2024-04-19T02:16:30.089618+0000","last_peered":"2024-04-19T02:16:30.089618+0000","last_clean":"2024-04-19T02:16:30.089618+0000","last_became_active":"2024-04-19T02:15:28.892781+0000","last_became_peered":"2024-04-19T02:15:28.892781+0000","last_unstale":"2024-04-19T02:16:30.089618+0000","last_undegraded":"2024-04-19T02:16:30.089618+0000","last_fullsized":"2024-04-19T02:16:30.089618+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:54:15.590143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.089903+0000","last_change":"2024-04-19T02:15:29.281279+0000","last_active":"2024-04-19T02:16:30.089903+0000","last_peered":"2024-04-19T02:16:30.089903+0000","last_clean":"2024-04-19T02:16:30.089903+0000","last_became_active":"2024-04-19T02:15:29.279360+0000","last_became_peered":"2024-04-19T02:15:29.279360+0000","last_unstale":"2024-04-19T02:16:30.089903+0000","last_undegraded":"2024-04-19T02:16:30.089903+0000","last_fullsized":"2024-04-19T02:16:30.089903+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093224+0000","last_change":"2024-04-19T02:15:28.893239+0000","last_active":"2024-04-19T02:16:30.093224+0000","last_peered":"2024-04-19T02:16:30.093224+0000","last_clean":"2024-04-19T02:16:30.093224+0000","last_became_active":"2024-04-19T02:15:28.892881+0000","last_became_peered":"2024-04-19T02:15:28.892881+0000","last_unstale":"2024-04-19T02:16:30.093224+0000","last_undegraded":"2024-04-19T02:16:30.093224+0000","last_fullsized":"2024-04-19T02:16:30.093224+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.090436+0000","last_change":"2024-04-19T02:15:29.281652+0000","last_active":"2024-04-19T02:16:30.090436+0000","last_peered":"2024-04-19T02:16:30.090436+0000","last_clean":"2024-04-19T02:16:30.090436+0000","last_became_active":"2024-04-19T02:15:29.281175+0000","last_became_peered":"2024-04-19T02:15:29.281175+0000","last_unstale":"2024-04-19T02:16:30.090436+0000","last_undegraded":"2024-04-19T02:16:30.090436+0000","last_fullsized":"2024-04-19T02:16:30.090436+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:16.568764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093621+0000","last_change":"2024-04-19T02:15:28.892058+0000","last_active":"2024-04-19T02:16:30.093621+0000","last_peered":"2024-04-19T02:16:30.093621+0000","last_clean":"2024-04-19T02:16:30.093621+0000","last_became_active":"2024-04-19T02:15:28.890877+0000","last_became_peered":"2024-04-19T02:15:28.890877+0000","last_unstale":"2024-04-19T02:16:30.093621+0000","last_undegraded":"2024-04-19T02:16:30.093621+0000","last_fullsized":"2024-04-19T02:16:30.093621+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:53.170180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093816+0000","last_change":"2024-04-19T02:15:29.278810+0000","last_active":"2024-04-19T02:16:30.093816+0000","last_peered":"2024-04-19T02:16:30.093816+0000","last_clean":"2024-04-19T02:16:30.093816+0000","last_became_active":"2024-04-19T02:15:29.277913+0000","last_became_peered":"2024-04-19T02:15:29.277913+0000","last_unstale":"2024-04-19T02:16:30.093816+0000","last_undegraded":"2024-04-19T02:16:30.093816+0000","last_fullsized":"2024-04-19T02:16:30.093816+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:24.082666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093347+0000","last_change":"2024-04-19T02:15:28.889132+0000","last_active":"2024-04-19T02:16:30.093347+0000","last_peered":"2024-04-19T02:16:30.093347+0000","last_clean":"2024-04-19T02:16:30.093347+0000","last_became_active":"2024-04-19T02:15:28.888926+0000","last_became_peered":"2024-04-19T02:15:28.888926+0000","last_unstale":"2024-04-19T02:16:30.093347+0000","last_undegraded":"2024-04-19T02:16:30.093347+0000","last_fullsized":"2024-04-19T02:16:30.093347+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.089483+0000","last_change":"2024-04-19T02:15:29.282776+0000","last_active":"2024-04-19T02:16:30.089483+0000","last_peered":"2024-04-19T02:16:30.089483+0000","last_clean":"2024-04-19T02:16:30.089483+0000","last_became_active":"2024-04-19T02:15:29.279382+0000","last_became_peered":"2024-04-19T02:15:29.279382+0000","last_unstale":"2024-04-19T02:16:30.089483+0000","last_undegraded":"2024-04-19T02:16:30.089483+0000","last_fullsized":"2024-04-19T02:16:30.089483+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.089323+0000","last_change":"2024-04-19T02:15:29.283537+0000","last_active":"2024-04-19T02:16:30.089323+0000","last_peered":"2024-04-19T02:16:30.089323+0000","last_clean":"2024-04-19T02:16:30.089323+0000","last_became_active":"2024-04-19T02:15:29.281801+0000","last_became_peered":"2024-04-19T02:15:29.281801+0000","last_unstale":"2024-04-19T02:16:30.089323+0000","last_undegraded":"2024-04-19T02:16:30.089323+0000","last_fullsized":"2024-04-19T02:16:30.089323+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.092825+0000","last_change":"2024-04-19T02:15:29.281560+0000","last_active":"2024-04-19T02:16:30.092825+0000","last_peered":"2024-04-19T02:16:30.092825+0000","last_clean":"2024-04-19T02:16:30.092825+0000","last_became_active":"2024-04-19T02:15:29.281261+0000","last_became_peered":"2024-04-19T02:15:29.281261+0000","last_unstale":"2024-04-19T02:16:30.092825+0000","last_undegraded":"2024-04-19T02:16:30.092825+0000","last_fullsized":"2024-04-19T02:16:30.092825+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.090019+0000","last_change":"2024-04-19T02:15:53.955913+0000","last_active":"2024-04-19T02:16:30.090019+0000","last_peered":"2024-04-19T02:16:30.090019+0000","last_clean":"2024-04-19T02:16:30.090019+0000","last_became_active":"2024-04-19T02:15:53.955676+0000","last_became_peered":"2024-04-19T02:15:53.955676+0000","last_unstale":"2024-04-19T02:16:30.090019+0000","last_undegraded":"2024-04-19T02:16:30.090019+0000","last_fullsized":"2024-04-19T02:16:30.090019+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:53:02.899902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093381+0000","last_change":"2024-04-19T02:15:29.278702+0000","last_active":"2024-04-19T02:16:30.093381+0000","last_peered":"2024-04-19T02:16:30.093381+0000","last_clean":"2024-04-19T02:16:30.093381+0000","last_became_active":"2024-04-19T02:15:29.277756+0000","last_became_peered":"2024-04-19T02:15:29.277756+0000","last_unstale":"2024-04-19T02:16:30.093381+0000","last_undegraded":"2024-04-19T02:16:30.093381+0000","last_fullsized":"2024-04-19T02:16:30.093381+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093080+0000","last_change":"2024-04-19T02:15:29.277568+0000","last_active":"2024-04-19T02:16:30.093080+0000","last_peered":"2024-04-19T02:16:30.093080+0000","last_clean":"2024-04-19T02:16:30.093080+0000","last_became_active":"2024-04-19T02:15:29.276725+0000","last_became_peered":"2024-04-19T02:15:29.276725+0000","last_unstale":"2024-04-19T02:16:30.093080+0000","last_undegraded":"2024-04-19T02:16:30.093080+0000","last_fullsized":"2024-04-19T02:16:30.093080+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":5891751936,"num_objects":89901,"num_object_clones":0,"num_object_copies":179802,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":3790,"num_objects_unfound":0,"num_objects_dirty":89901,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89901,"num_write_kb":5753664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1501,"num_bytes_recovered":98369536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":11894259712,"data_stored":11894259712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60100,"ondisk_log_size":60100,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738384,"num_pgs":84,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4723384,"kb_used_data":4615980,"kb_used_omap":1,"kb_used_meta":107390,"kb_avail":89648456,"statfs":{"total":96636764160,"available":91800018944,"internally_reserved":0,"allocated":4726763520,"data_stored":4726526284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":109967814},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.313,"15min":0.313},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.497,"5min":0.497,"15min":0.497},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.17000000000000001}]},{"osd":1,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.22},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.253}]}]},{"osd":0,"up_from":8,"seq":34359738385,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3631300,"kb_used_data":3545980,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":90740540,"statfs":{"total":96636764160,"available":92918312960,"internally_reserved":0,"allocated":3631083520,"data_stored":3630827514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":87292358},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2,1,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.22600000000000001},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":1.046}]},{"osd":2,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":2.1000000000000001,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":0.215},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":1.8660000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738384,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3348028,"kb_used_data":3266868,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":91023812,"statfs":{"total":96636764160,"available":93208383488,"internally_reserved":0,"allocated":3345272832,"data_stored":3345024402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":83098054},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,2,7],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:16:26 2024","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.16900000000000001},{"interface":"front","average":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"min":{"1min":0.16,"5min":0.16,"15min":0.16},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.23799999999999999}]},{"osd":2,"last update":"Fri Apr 19 02:16:26 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.221},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.21099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3691315200,"data_stored":3691315200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3424911360,"data_stored":3424911360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4778033152,"data_stored":4778033152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:16:37.541 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:16:37.548 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:37.548 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:37.564 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:16:37.605 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:37.606+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:37.683 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:37.684+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:37.728 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:37.728 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:37.741 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:16:37.783 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:37.784+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:37.886 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:37.885+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:37.908 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:37.908 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:37.921 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:16:37.928 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:16:37.930 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-04-19T02:16:37.940 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2024-04-19T02:16:37.110170+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5892344666,"num_objects":89925,"num_object_clones":0,"num_object_copies":179850,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":3790,"num_objects_unfound":0,"num_objects_dirty":89925,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":90149,"num_write_kb":5757138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1501,"num_bytes_recovered":98369536,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60296,"ondisk_log_size":60296,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":243,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":11702712,"kb_used_data":11428828,"kb_used_omap":4,"kb_used_meta":273787,"kb_avail":271412808,"statfs":{"total":289910292480,"available":277926715392,"internally_reserved":0,"allocated":11703119872,"data_stored":11702378200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":280358226},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,2,3,10],"upper_bound":16},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":675872768,"num_objects":10313,"num_object_clones":0,"num_object_copies":20626,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-393,"num_objects_unfound":0,"num_objects_dirty":10313,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10313,"num_write_kb":660032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":864,"num_bytes_recovered":56623104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.014064"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.094246+0000","last_change":"2024-04-19T02:15:29.280412+0000","last_active":"2024-04-19T02:16:30.094246+0000","last_peered":"2024-04-19T02:16:30.094246+0000","last_clean":"2024-04-19T02:16:30.094246+0000","last_became_active":"2024-04-19T02:15:29.278762+0000","last_became_peered":"2024-04-19T02:15:29.278762+0000","last_unstale":"2024-04-19T02:16:30.094246+0000","last_undegraded":"2024-04-19T02:16:30.094246+0000","last_fullsized":"2024-04-19T02:16:30.094246+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:45.301675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093736+0000","last_change":"2024-04-19T02:15:29.284695+0000","last_active":"2024-04-19T02:16:30.093736+0000","last_peered":"2024-04-19T02:16:30.093736+0000","last_clean":"2024-04-19T02:16:30.093736+0000","last_became_active":"2024-04-19T02:15:29.283468+0000","last_became_peered":"2024-04-19T02:15:29.283468+0000","last_unstale":"2024-04-19T02:16:30.093736+0000","last_undegraded":"2024-04-19T02:16:30.093736+0000","last_fullsized":"2024-04-19T02:16:30.093736+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.384881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.089939+0000","last_change":"2024-04-19T02:15:29.286709+0000","last_active":"2024-04-19T02:16:30.089939+0000","last_peered":"2024-04-19T02:16:30.089939+0000","last_clean":"2024-04-19T02:16:30.089939+0000","last_became_active":"2024-04-19T02:15:29.286169+0000","last_became_peered":"2024-04-19T02:15:29.286169+0000","last_unstale":"2024-04-19T02:16:30.089939+0000","last_undegraded":"2024-04-19T02:16:30.089939+0000","last_fullsized":"2024-04-19T02:16:30.089939+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:58.741466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.089851+0000","last_change":"2024-04-19T02:15:29.280131+0000","last_active":"2024-04-19T02:16:30.089851+0000","last_peered":"2024-04-19T02:16:30.089851+0000","last_clean":"2024-04-19T02:16:30.089851+0000","last_became_active":"2024-04-19T02:15:29.279388+0000","last_became_peered":"2024-04-19T02:15:29.279388+0000","last_unstale":"2024-04-19T02:16:30.089851+0000","last_undegraded":"2024-04-19T02:16:30.089851+0000","last_fullsized":"2024-04-19T02:16:30.089851+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:36:48.819486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093099+0000","last_change":"2024-04-19T02:15:53.955892+0000","last_active":"2024-04-19T02:16:30.093099+0000","last_peered":"2024-04-19T02:16:30.093099+0000","last_clean":"2024-04-19T02:16:30.093099+0000","last_became_active":"2024-04-19T02:15:53.955553+0000","last_became_peered":"2024-04-19T02:15:53.955553+0000","last_unstale":"2024-04-19T02:16:30.093099+0000","last_undegraded":"2024-04-19T02:16:30.093099+0000","last_fullsized":"2024-04-19T02:16:30.093099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:45:39.791209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.090361+0000","last_change":"2024-04-19T02:15:29.283908+0000","last_active":"2024-04-19T02:16:30.090361+0000","last_peered":"2024-04-19T02:16:30.090361+0000","last_clean":"2024-04-19T02:16:30.090361+0000","last_became_active":"2024-04-19T02:15:29.281729+0000","last_became_peered":"2024-04-19T02:15:29.281729+0000","last_unstale":"2024-04-19T02:16:30.090361+0000","last_undegraded":"2024-04-19T02:16:30.090361+0000","last_fullsized":"2024-04-19T02:16:30.090361+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:03:15.383476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.089164+0000","last_change":"2024-04-19T02:15:29.281253+0000","last_active":"2024-04-19T02:16:30.089164+0000","last_peered":"2024-04-19T02:16:30.089164+0000","last_clean":"2024-04-19T02:16:30.089164+0000","last_became_active":"2024-04-19T02:15:29.279951+0000","last_became_peered":"2024-04-19T02:15:29.279951+0000","last_unstale":"2024-04-19T02:16:30.089164+0000","last_undegraded":"2024-04-19T02:16:30.089164+0000","last_fullsized":"2024-04-19T02:16:30.089164+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.089086+0000","last_change":"2024-04-19T02:15:29.283952+0000","last_active":"2024-04-19T02:16:30.089086+0000","last_peered":"2024-04-19T02:16:30.089086+0000","last_clean":"2024-04-19T02:16:30.089086+0000","last_became_active":"2024-04-19T02:15:29.282721+0000","last_became_peered":"2024-04-19T02:15:29.282721+0000","last_unstale":"2024-04-19T02:16:30.089086+0000","last_undegraded":"2024-04-19T02:16:30.089086+0000","last_fullsized":"2024-04-19T02:16:30.089086+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:45.301675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.092963+0000","last_change":"2024-04-19T02:15:29.282150+0000","last_active":"2024-04-19T02:16:30.092963+0000","last_peered":"2024-04-19T02:16:30.092963+0000","last_clean":"2024-04-19T02:16:30.092963+0000","last_became_active":"2024-04-19T02:15:29.281538+0000","last_became_peered":"2024-04-19T02:15:29.281538+0000","last_unstale":"2024-04-19T02:16:30.092963+0000","last_undegraded":"2024-04-19T02:16:30.092963+0000","last_fullsized":"2024-04-19T02:16:30.092963+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-19T02:16:32.104424+0000","last_change":"2024-04-19T02:16:30.093524+0000","last_active":"2024-04-19T02:16:32.104424+0000","last_peered":"2024-04-19T02:16:32.104424+0000","last_clean":"2024-04-19T02:16:32.104424+0000","last_became_active":"2024-04-19T02:16:30.093344+0000","last_became_peered":"2024-04-19T02:16:30.093344+0000","last_unstale":"2024-04-19T02:16:32.104424+0000","last_undegraded":"2024-04-19T02:16:32.104424+0000","last_fullsized":"2024-04-19T02:16:32.104424+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:14:40.293159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.089862+0000","last_change":"2024-04-19T02:15:29.280606+0000","last_active":"2024-04-19T02:16:30.089862+0000","last_peered":"2024-04-19T02:16:30.089862+0000","last_clean":"2024-04-19T02:16:30.089862+0000","last_became_active":"2024-04-19T02:15:29.280151+0000","last_became_peered":"2024-04-19T02:15:29.280151+0000","last_unstale":"2024-04-19T02:16:30.089862+0000","last_undegraded":"2024-04-19T02:16:30.089862+0000","last_fullsized":"2024-04-19T02:16:30.089862+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:26:22.452488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.089532+0000","last_change":"2024-04-19T02:15:53.958876+0000","last_active":"2024-04-19T02:16:30.089532+0000","last_peered":"2024-04-19T02:16:30.089532+0000","last_clean":"2024-04-19T02:16:30.089532+0000","last_became_active":"2024-04-19T02:15:53.958626+0000","last_became_peered":"2024-04-19T02:15:53.958626+0000","last_unstale":"2024-04-19T02:16:30.089532+0000","last_undegraded":"2024-04-19T02:16:30.089532+0000","last_fullsized":"2024-04-19T02:16:30.089532+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:23:57.044018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093051+0000","last_change":"2024-04-19T02:15:53.956801+0000","last_active":"2024-04-19T02:16:30.093051+0000","last_peered":"2024-04-19T02:16:30.093051+0000","last_clean":"2024-04-19T02:16:30.093051+0000","last_became_active":"2024-04-19T02:15:53.956620+0000","last_became_peered":"2024-04-19T02:15:53.956620+0000","last_unstale":"2024-04-19T02:16:30.093051+0000","last_undegraded":"2024-04-19T02:16:30.093051+0000","last_fullsized":"2024-04-19T02:16:30.093051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:57:05.843101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.090512+0000","last_change":"2024-04-19T02:15:29.284262+0000","last_active":"2024-04-19T02:16:30.090512+0000","last_peered":"2024-04-19T02:16:30.090512+0000","last_clean":"2024-04-19T02:16:30.090512+0000","last_became_active":"2024-04-19T02:15:29.283121+0000","last_became_peered":"2024-04-19T02:15:29.283121+0000","last_unstale":"2024-04-19T02:16:30.090512+0000","last_undegraded":"2024-04-19T02:16:30.090512+0000","last_fullsized":"2024-04-19T02:16:30.090512+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.089245+0000","last_change":"2024-04-19T02:15:29.285139+0000","last_active":"2024-04-19T02:16:30.089245+0000","last_peered":"2024-04-19T02:16:30.089245+0000","last_clean":"2024-04-19T02:16:30.089245+0000","last_became_active":"2024-04-19T02:15:29.284649+0000","last_became_peered":"2024-04-19T02:15:29.284649+0000","last_unstale":"2024-04-19T02:16:30.089245+0000","last_undegraded":"2024-04-19T02:16:30.089245+0000","last_fullsized":"2024-04-19T02:16:30.089245+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.089078+0000","last_change":"2024-04-19T02:15:29.283648+0000","last_active":"2024-04-19T02:16:30.089078+0000","last_peered":"2024-04-19T02:16:30.089078+0000","last_clean":"2024-04-19T02:16:30.089078+0000","last_became_active":"2024-04-19T02:15:29.281606+0000","last_became_peered":"2024-04-19T02:15:29.281606+0000","last_unstale":"2024-04-19T02:16:30.089078+0000","last_undegraded":"2024-04-19T02:16:30.089078+0000","last_fullsized":"2024-04-19T02:16:30.089078+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093245+0000","last_change":"2024-04-19T02:15:29.278673+0000","last_active":"2024-04-19T02:16:30.093245+0000","last_peered":"2024-04-19T02:16:30.093245+0000","last_clean":"2024-04-19T02:16:30.093245+0000","last_became_active":"2024-04-19T02:15:29.277699+0000","last_became_peered":"2024-04-19T02:15:29.277699+0000","last_unstale":"2024-04-19T02:16:30.093245+0000","last_undegraded":"2024-04-19T02:16:30.093245+0000","last_fullsized":"2024-04-19T02:16:30.093245+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.094707+0000","last_change":"2024-04-19T02:15:29.283341+0000","last_active":"2024-04-19T02:16:30.094707+0000","last_peered":"2024-04-19T02:16:30.094707+0000","last_clean":"2024-04-19T02:16:30.094707+0000","last_became_active":"2024-04-19T02:15:29.281591+0000","last_became_peered":"2024-04-19T02:15:29.281591+0000","last_unstale":"2024-04-19T02:16:30.094707+0000","last_undegraded":"2024-04-19T02:16:30.094707+0000","last_fullsized":"2024-04-19T02:16:30.094707+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:34.593754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093425+0000","last_change":"2024-04-19T02:15:29.282110+0000","last_active":"2024-04-19T02:16:30.093425+0000","last_peered":"2024-04-19T02:16:30.093425+0000","last_clean":"2024-04-19T02:16:30.093425+0000","last_became_active":"2024-04-19T02:15:29.281716+0000","last_became_peered":"2024-04-19T02:15:29.281716+0000","last_unstale":"2024-04-19T02:16:30.093425+0000","last_undegraded":"2024-04-19T02:16:30.093425+0000","last_fullsized":"2024-04-19T02:16:30.093425+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.089907+0000","last_change":"2024-04-19T02:15:29.285237+0000","last_active":"2024-04-19T02:16:30.089907+0000","last_peered":"2024-04-19T02:16:30.089907+0000","last_clean":"2024-04-19T02:16:30.089907+0000","last_became_active":"2024-04-19T02:15:29.282790+0000","last_became_peered":"2024-04-19T02:15:29.282790+0000","last_unstale":"2024-04-19T02:16:30.089907+0000","last_undegraded":"2024-04-19T02:16:30.089907+0000","last_fullsized":"2024-04-19T02:16:30.089907+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.089797+0000","last_change":"2024-04-19T02:15:29.282609+0000","last_active":"2024-04-19T02:16:30.089797+0000","last_peered":"2024-04-19T02:16:30.089797+0000","last_clean":"2024-04-19T02:16:30.089797+0000","last_became_active":"2024-04-19T02:15:29.281665+0000","last_became_peered":"2024-04-19T02:15:29.281665+0000","last_unstale":"2024-04-19T02:16:30.089797+0000","last_undegraded":"2024-04-19T02:16:30.089797+0000","last_fullsized":"2024-04-19T02:16:30.089797+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.384881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.090104+0000","last_change":"2024-04-19T02:15:53.955813+0000","last_active":"2024-04-19T02:16:30.090104+0000","last_peered":"2024-04-19T02:16:30.090104+0000","last_clean":"2024-04-19T02:16:30.090104+0000","last_became_active":"2024-04-19T02:15:53.955614+0000","last_became_peered":"2024-04-19T02:15:53.955614+0000","last_unstale":"2024-04-19T02:16:30.090104+0000","last_undegraded":"2024-04-19T02:16:30.090104+0000","last_fullsized":"2024-04-19T02:16:30.090104+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:58:03.192647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093072+0000","last_change":"2024-04-19T02:15:29.277109+0000","last_active":"2024-04-19T02:16:30.093072+0000","last_peered":"2024-04-19T02:16:30.093072+0000","last_clean":"2024-04-19T02:16:30.093072+0000","last_became_active":"2024-04-19T02:15:29.275417+0000","last_became_peered":"2024-04-19T02:15:29.275417+0000","last_unstale":"2024-04-19T02:16:30.093072+0000","last_undegraded":"2024-04-19T02:16:30.093072+0000","last_fullsized":"2024-04-19T02:16:30.093072+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093243+0000","last_change":"2024-04-19T02:15:29.283266+0000","last_active":"2024-04-19T02:16:30.093243+0000","last_peered":"2024-04-19T02:16:30.093243+0000","last_clean":"2024-04-19T02:16:30.093243+0000","last_became_active":"2024-04-19T02:15:29.281505+0000","last_became_peered":"2024-04-19T02:15:29.281505+0000","last_unstale":"2024-04-19T02:16:30.093243+0000","last_undegraded":"2024-04-19T02:16:30.093243+0000","last_fullsized":"2024-04-19T02:16:30.093243+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.094168+0000","last_change":"2024-04-19T02:15:29.278084+0000","last_active":"2024-04-19T02:16:30.094168+0000","last_peered":"2024-04-19T02:16:30.094168+0000","last_clean":"2024-04-19T02:16:30.094168+0000","last_became_active":"2024-04-19T02:15:29.276952+0000","last_became_peered":"2024-04-19T02:15:29.276952+0000","last_unstale":"2024-04-19T02:16:30.094168+0000","last_undegraded":"2024-04-19T02:16:30.094168+0000","last_fullsized":"2024-04-19T02:16:30.094168+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093698+0000","last_change":"2024-04-19T02:15:29.279904+0000","last_active":"2024-04-19T02:16:30.093698+0000","last_peered":"2024-04-19T02:16:30.093698+0000","last_clean":"2024-04-19T02:16:30.093698+0000","last_became_active":"2024-04-19T02:15:29.278938+0000","last_became_peered":"2024-04-19T02:15:29.278938+0000","last_unstale":"2024-04-19T02:16:30.093698+0000","last_undegraded":"2024-04-19T02:16:30.093698+0000","last_fullsized":"2024-04-19T02:16:30.093698+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.089844+0000","last_change":"2024-04-19T02:15:29.287389+0000","last_active":"2024-04-19T02:16:30.089844+0000","last_peered":"2024-04-19T02:16:30.089844+0000","last_clean":"2024-04-19T02:16:30.089844+0000","last_became_active":"2024-04-19T02:15:29.286431+0000","last_became_peered":"2024-04-19T02:15:29.286431+0000","last_unstale":"2024-04-19T02:16:30.089844+0000","last_undegraded":"2024-04-19T02:16:30.089844+0000","last_fullsized":"2024-04-19T02:16:30.089844+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:58:30.117887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093568+0000","last_change":"2024-04-19T02:15:53.959207+0000","last_active":"2024-04-19T02:16:30.093568+0000","last_peered":"2024-04-19T02:16:30.093568+0000","last_clean":"2024-04-19T02:16:30.093568+0000","last_became_active":"2024-04-19T02:15:53.959007+0000","last_became_peered":"2024-04-19T02:15:53.959007+0000","last_unstale":"2024-04-19T02:16:30.093568+0000","last_undegraded":"2024-04-19T02:16:30.093568+0000","last_fullsized":"2024-04-19T02:16:30.093568+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:08:21.065077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093416+0000","last_change":"2024-04-19T02:15:29.281792+0000","last_active":"2024-04-19T02:16:30.093416+0000","last_peered":"2024-04-19T02:16:30.093416+0000","last_clean":"2024-04-19T02:16:30.093416+0000","last_became_active":"2024-04-19T02:15:29.280479+0000","last_became_peered":"2024-04-19T02:15:29.280479+0000","last_unstale":"2024-04-19T02:16:30.093416+0000","last_undegraded":"2024-04-19T02:16:30.093416+0000","last_fullsized":"2024-04-19T02:16:30.093416+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093162+0000","last_change":"2024-04-19T02:15:28.888778+0000","last_active":"2024-04-19T02:16:30.093162+0000","last_peered":"2024-04-19T02:16:30.093162+0000","last_clean":"2024-04-19T02:16:30.093162+0000","last_became_active":"2024-04-19T02:15:28.888543+0000","last_became_peered":"2024-04-19T02:15:28.888543+0000","last_unstale":"2024-04-19T02:16:30.093162+0000","last_undegraded":"2024-04-19T02:16:30.093162+0000","last_fullsized":"2024-04-19T02:16:30.093162+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:43:51.221619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093470+0000","last_change":"2024-04-19T02:15:29.279986+0000","last_active":"2024-04-19T02:16:30.093470+0000","last_peered":"2024-04-19T02:16:30.093470+0000","last_clean":"2024-04-19T02:16:30.093470+0000","last_became_active":"2024-04-19T02:15:29.279690+0000","last_became_peered":"2024-04-19T02:15:29.279690+0000","last_unstale":"2024-04-19T02:16:30.093470+0000","last_undegraded":"2024-04-19T02:16:30.093470+0000","last_fullsized":"2024-04-19T02:16:30.093470+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.096020+0000","last_change":"2024-04-19T02:15:28.890463+0000","last_active":"2024-04-19T02:16:30.096020+0000","last_peered":"2024-04-19T02:16:30.096020+0000","last_clean":"2024-04-19T02:16:30.096020+0000","last_became_active":"2024-04-19T02:15:28.889777+0000","last_became_peered":"2024-04-19T02:15:28.889777+0000","last_unstale":"2024-04-19T02:16:30.096020+0000","last_undegraded":"2024-04-19T02:16:30.096020+0000","last_fullsized":"2024-04-19T02:16:30.096020+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:58:21.520250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.094085+0000","last_change":"2024-04-19T02:15:29.280879+0000","last_active":"2024-04-19T02:16:30.094085+0000","last_peered":"2024-04-19T02:16:30.094085+0000","last_clean":"2024-04-19T02:16:30.094085+0000","last_became_active":"2024-04-19T02:15:29.279314+0000","last_became_peered":"2024-04-19T02:15:29.279314+0000","last_unstale":"2024-04-19T02:16:30.094085+0000","last_undegraded":"2024-04-19T02:16:30.094085+0000","last_fullsized":"2024-04-19T02:16:30.094085+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093504+0000","last_change":"2024-04-19T02:15:28.891867+0000","last_active":"2024-04-19T02:16:30.093504+0000","last_peered":"2024-04-19T02:16:30.093504+0000","last_clean":"2024-04-19T02:16:30.093504+0000","last_became_active":"2024-04-19T02:15:28.890806+0000","last_became_peered":"2024-04-19T02:15:28.890806+0000","last_unstale":"2024-04-19T02:16:30.093504+0000","last_undegraded":"2024-04-19T02:16:30.093504+0000","last_fullsized":"2024-04-19T02:16:30.093504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:57.946581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.095874+0000","last_change":"2024-04-19T02:15:29.278148+0000","last_active":"2024-04-19T02:16:30.095874+0000","last_peered":"2024-04-19T02:16:30.095874+0000","last_clean":"2024-04-19T02:16:30.095874+0000","last_became_active":"2024-04-19T02:15:29.277402+0000","last_became_peered":"2024-04-19T02:15:29.277402+0000","last_unstale":"2024-04-19T02:16:30.095874+0000","last_undegraded":"2024-04-19T02:16:30.095874+0000","last_fullsized":"2024-04-19T02:16:30.095874+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.089698+0000","last_change":"2024-04-19T02:15:28.892905+0000","last_active":"2024-04-19T02:16:30.089698+0000","last_peered":"2024-04-19T02:16:30.089698+0000","last_clean":"2024-04-19T02:16:30.089698+0000","last_became_active":"2024-04-19T02:15:28.892541+0000","last_became_peered":"2024-04-19T02:15:28.892541+0000","last_unstale":"2024-04-19T02:16:30.089698+0000","last_undegraded":"2024-04-19T02:16:30.089698+0000","last_fullsized":"2024-04-19T02:16:30.089698+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:33.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093766+0000","last_change":"2024-04-19T02:15:29.278810+0000","last_active":"2024-04-19T02:16:30.093766+0000","last_peered":"2024-04-19T02:16:30.093766+0000","last_clean":"2024-04-19T02:16:30.093766+0000","last_became_active":"2024-04-19T02:15:29.278093+0000","last_became_peered":"2024-04-19T02:15:29.278093+0000","last_unstale":"2024-04-19T02:16:30.093766+0000","last_undegraded":"2024-04-19T02:16:30.093766+0000","last_fullsized":"2024-04-19T02:16:30.093766+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:34.883207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.092925+0000","last_change":"2024-04-19T02:15:28.892937+0000","last_active":"2024-04-19T02:16:30.092925+0000","last_peered":"2024-04-19T02:16:30.092925+0000","last_clean":"2024-04-19T02:16:30.092925+0000","last_became_active":"2024-04-19T02:15:28.891440+0000","last_became_peered":"2024-04-19T02:15:28.891440+0000","last_unstale":"2024-04-19T02:16:30.092925+0000","last_undegraded":"2024-04-19T02:16:30.092925+0000","last_fullsized":"2024-04-19T02:16:30.092925+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.092861+0000","last_change":"2024-04-19T02:15:29.278404+0000","last_active":"2024-04-19T02:16:30.092861+0000","last_peered":"2024-04-19T02:16:30.092861+0000","last_clean":"2024-04-19T02:16:30.092861+0000","last_became_active":"2024-04-19T02:15:29.277460+0000","last_became_peered":"2024-04-19T02:15:29.277460+0000","last_unstale":"2024-04-19T02:16:30.092861+0000","last_undegraded":"2024-04-19T02:16:30.092861+0000","last_fullsized":"2024-04-19T02:16:30.092861+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.089670+0000","last_change":"2024-04-19T02:15:28.891097+0000","last_active":"2024-04-19T02:16:30.089670+0000","last_peered":"2024-04-19T02:16:30.089670+0000","last_clean":"2024-04-19T02:16:30.089670+0000","last_became_active":"2024-04-19T02:15:28.890795+0000","last_became_peered":"2024-04-19T02:15:28.890795+0000","last_unstale":"2024-04-19T02:16:30.089670+0000","last_undegraded":"2024-04-19T02:16:30.089670+0000","last_fullsized":"2024-04-19T02:16:30.089670+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.090263+0000","last_change":"2024-04-19T02:15:29.278546+0000","last_active":"2024-04-19T02:16:30.090263+0000","last_peered":"2024-04-19T02:16:30.090263+0000","last_clean":"2024-04-19T02:16:30.090263+0000","last_became_active":"2024-04-19T02:15:29.277547+0000","last_became_peered":"2024-04-19T02:15:29.277547+0000","last_unstale":"2024-04-19T02:16:30.090263+0000","last_undegraded":"2024-04-19T02:16:30.090263+0000","last_fullsized":"2024-04-19T02:16:30.090263+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.090183+0000","last_change":"2024-04-19T02:15:28.892977+0000","last_active":"2024-04-19T02:16:30.090183+0000","last_peered":"2024-04-19T02:16:30.090183+0000","last_clean":"2024-04-19T02:16:30.090183+0000","last_became_active":"2024-04-19T02:15:28.892636+0000","last_became_peered":"2024-04-19T02:15:28.892636+0000","last_unstale":"2024-04-19T02:16:30.090183+0000","last_undegraded":"2024-04-19T02:16:30.090183+0000","last_fullsized":"2024-04-19T02:16:30.090183+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:43:51.221619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.095812+0000","last_change":"2024-04-19T02:15:53.955655+0000","last_active":"2024-04-19T02:16:30.095812+0000","last_peered":"2024-04-19T02:16:30.095812+0000","last_clean":"2024-04-19T02:16:30.095812+0000","last_became_active":"2024-04-19T02:15:53.955382+0000","last_became_peered":"2024-04-19T02:15:53.955382+0000","last_unstale":"2024-04-19T02:16:30.095812+0000","last_undegraded":"2024-04-19T02:16:30.095812+0000","last_fullsized":"2024-04-19T02:16:30.095812+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:48.239260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093058+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:16:30.093058+0000","last_peered":"2024-04-19T02:16:30.093058+0000","last_clean":"2024-04-19T02:16:30.093058+0000","last_became_active":"2024-04-19T02:15:28.890751+0000","last_became_peered":"2024-04-19T02:15:28.890751+0000","last_unstale":"2024-04-19T02:16:30.093058+0000","last_undegraded":"2024-04-19T02:16:30.093058+0000","last_fullsized":"2024-04-19T02:16:30.093058+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.092906+0000","last_change":"2024-04-19T02:15:53.957865+0000","last_active":"2024-04-19T02:16:30.092906+0000","last_peered":"2024-04-19T02:16:30.092906+0000","last_clean":"2024-04-19T02:16:30.092906+0000","last_became_active":"2024-04-19T02:15:53.957627+0000","last_became_peered":"2024-04-19T02:15:53.957627+0000","last_unstale":"2024-04-19T02:16:30.092906+0000","last_undegraded":"2024-04-19T02:16:30.092906+0000","last_fullsized":"2024-04-19T02:16:30.092906+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:16:45.799016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.092861+0000","last_change":"2024-04-19T02:15:28.892934+0000","last_active":"2024-04-19T02:16:30.092861+0000","last_peered":"2024-04-19T02:16:30.092861+0000","last_clean":"2024-04-19T02:16:30.092861+0000","last_became_active":"2024-04-19T02:15:28.891879+0000","last_became_peered":"2024-04-19T02:15:28.891879+0000","last_unstale":"2024-04-19T02:16:30.092861+0000","last_undegraded":"2024-04-19T02:16:30.092861+0000","last_fullsized":"2024-04-19T02:16:30.092861+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:10:12.514798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093617+0000","last_change":"2024-04-19T02:15:29.279685+0000","last_active":"2024-04-19T02:16:30.093617+0000","last_peered":"2024-04-19T02:16:30.093617+0000","last_clean":"2024-04-19T02:16:30.093617+0000","last_became_active":"2024-04-19T02:15:29.278810+0000","last_became_peered":"2024-04-19T02:15:29.278810+0000","last_unstale":"2024-04-19T02:16:30.093617+0000","last_undegraded":"2024-04-19T02:16:30.093617+0000","last_fullsized":"2024-04-19T02:16:30.093617+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.089408+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:16:30.089408+0000","last_peered":"2024-04-19T02:16:30.089408+0000","last_clean":"2024-04-19T02:16:30.089408+0000","last_became_active":"2024-04-19T02:15:28.890882+0000","last_became_peered":"2024-04-19T02:15:28.890882+0000","last_unstale":"2024-04-19T02:16:30.089408+0000","last_undegraded":"2024-04-19T02:16:30.089408+0000","last_fullsized":"2024-04-19T02:16:30.089408+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:31.673938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093587+0000","last_change":"2024-04-19T02:15:29.284258+0000","last_active":"2024-04-19T02:16:30.093587+0000","last_peered":"2024-04-19T02:16:30.093587+0000","last_clean":"2024-04-19T02:16:30.093587+0000","last_became_active":"2024-04-19T02:15:29.283995+0000","last_became_peered":"2024-04-19T02:15:29.283995+0000","last_unstale":"2024-04-19T02:16:30.093587+0000","last_undegraded":"2024-04-19T02:16:30.093587+0000","last_fullsized":"2024-04-19T02:16:30.093587+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:35.941308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"34'5693","reported_seq":5719,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-19T02:16:32.791899+0000","last_change":"2024-04-19T02:15:53.956977+0000","last_active":"2024-04-19T02:16:32.791899+0000","last_peered":"2024-04-19T02:16:32.791899+0000","last_clean":"2024-04-19T02:16:32.791899+0000","last_became_active":"2024-04-19T02:15:53.956730+0000","last_became_peered":"2024-04-19T02:15:53.956730+0000","last_unstale":"2024-04-19T02:16:32.791899+0000","last_undegraded":"2024-04-19T02:16:32.791899+0000","last_fullsized":"2024-04-19T02:16:32.791899+0000","mapping_epoch":16,"log_start":"21'2000","ondisk_log_start":"21'2000","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3693,"log_dups_size":0,"ondisk_log_size":3693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:56:46.323499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":373096448,"num_objects":5693,"num_object_clones":0,"num_object_copies":11386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5693,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5693,"num_write_kb":364352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.090270+0000","last_change":"2024-04-19T02:15:28.890265+0000","last_active":"2024-04-19T02:16:30.090270+0000","last_peered":"2024-04-19T02:16:30.090270+0000","last_clean":"2024-04-19T02:16:30.090270+0000","last_became_active":"2024-04-19T02:15:28.890004+0000","last_became_peered":"2024-04-19T02:15:28.890004+0000","last_unstale":"2024-04-19T02:16:30.090270+0000","last_undegraded":"2024-04-19T02:16:30.090270+0000","last_fullsized":"2024-04-19T02:16:30.090270+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:02.517101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.092994+0000","last_change":"2024-04-19T02:15:29.285529+0000","last_active":"2024-04-19T02:16:30.092994+0000","last_peered":"2024-04-19T02:16:30.092994+0000","last_clean":"2024-04-19T02:16:30.092994+0000","last_became_active":"2024-04-19T02:15:29.285197+0000","last_became_peered":"2024-04-19T02:15:29.285197+0000","last_unstale":"2024-04-19T02:16:30.092994+0000","last_undegraded":"2024-04-19T02:16:30.092994+0000","last_fullsized":"2024-04-19T02:16:30.092994+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"34'5670","reported_seq":5695,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-19T02:16:32.755132+0000","last_change":"2024-04-19T02:15:53.958523+0000","last_active":"2024-04-19T02:16:32.755132+0000","last_peered":"2024-04-19T02:16:32.755132+0000","last_clean":"2024-04-19T02:16:32.755132+0000","last_became_active":"2024-04-19T02:15:53.957627+0000","last_became_peered":"2024-04-19T02:15:53.957627+0000","last_unstale":"2024-04-19T02:16:32.755132+0000","last_undegraded":"2024-04-19T02:16:32.755132+0000","last_fullsized":"2024-04-19T02:16:32.755132+0000","mapping_epoch":16,"log_start":"21'1747","ondisk_log_start":"21'1747","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3923,"log_dups_size":0,"ondisk_log_size":3923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:59:55.120296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":371589120,"num_objects":5670,"num_object_clones":0,"num_object_copies":11340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5670,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5670,"num_write_kb":362880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093818+0000","last_change":"2024-04-19T02:15:28.893902+0000","last_active":"2024-04-19T02:16:30.093818+0000","last_peered":"2024-04-19T02:16:30.093818+0000","last_clean":"2024-04-19T02:16:30.093818+0000","last_became_active":"2024-04-19T02:15:28.893231+0000","last_became_peered":"2024-04-19T02:15:28.893231+0000","last_unstale":"2024-04-19T02:16:30.093818+0000","last_undegraded":"2024-04-19T02:16:30.093818+0000","last_fullsized":"2024-04-19T02:16:30.093818+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:23.658442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093030+0000","last_change":"2024-04-19T02:15:29.282874+0000","last_active":"2024-04-19T02:16:30.093030+0000","last_peered":"2024-04-19T02:16:30.093030+0000","last_clean":"2024-04-19T02:16:30.093030+0000","last_became_active":"2024-04-19T02:15:29.281675+0000","last_became_peered":"2024-04-19T02:15:29.281675+0000","last_unstale":"2024-04-19T02:16:30.093030+0000","last_undegraded":"2024-04-19T02:16:30.093030+0000","last_fullsized":"2024-04-19T02:16:30.093030+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:35.941308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"34'5583","reported_seq":5609,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-19T02:16:32.739379+0000","last_change":"2024-04-19T02:15:53.958324+0000","last_active":"2024-04-19T02:16:32.739379+0000","last_peered":"2024-04-19T02:16:32.739379+0000","last_clean":"2024-04-19T02:16:32.739379+0000","last_became_active":"2024-04-19T02:15:53.957392+0000","last_became_peered":"2024-04-19T02:15:53.957392+0000","last_unstale":"2024-04-19T02:16:32.739379+0000","last_undegraded":"2024-04-19T02:16:32.739379+0000","last_fullsized":"2024-04-19T02:16:32.739379+0000","mapping_epoch":16,"log_start":"21'1600","ondisk_log_start":"21'1600","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3983,"log_dups_size":0,"ondisk_log_size":3983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:12:58.132969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":365887488,"num_objects":5583,"num_object_clones":0,"num_object_copies":11166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5583,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5583,"num_write_kb":357312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.089927+0000","last_change":"2024-04-19T02:15:28.891234+0000","last_active":"2024-04-19T02:16:30.089927+0000","last_peered":"2024-04-19T02:16:30.089927+0000","last_clean":"2024-04-19T02:16:30.089927+0000","last_became_active":"2024-04-19T02:15:28.890881+0000","last_became_peered":"2024-04-19T02:15:28.890881+0000","last_unstale":"2024-04-19T02:16:30.089927+0000","last_undegraded":"2024-04-19T02:16:30.089927+0000","last_fullsized":"2024-04-19T02:16:30.089927+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.090429+0000","last_change":"2024-04-19T02:15:29.281937+0000","last_active":"2024-04-19T02:16:30.090429+0000","last_peered":"2024-04-19T02:16:30.090429+0000","last_clean":"2024-04-19T02:16:30.090429+0000","last_became_active":"2024-04-19T02:15:29.280727+0000","last_became_peered":"2024-04-19T02:15:29.280727+0000","last_unstale":"2024-04-19T02:16:30.090429+0000","last_undegraded":"2024-04-19T02:16:30.090429+0000","last_fullsized":"2024-04-19T02:16:30.090429+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"34'5710","reported_seq":5736,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-19T02:16:32.774416+0000","last_change":"2024-04-19T02:15:53.959099+0000","last_active":"2024-04-19T02:16:32.774416+0000","last_peered":"2024-04-19T02:16:32.774416+0000","last_clean":"2024-04-19T02:16:32.774416+0000","last_became_active":"2024-04-19T02:15:53.958885+0000","last_became_peered":"2024-04-19T02:15:53.958885+0000","last_unstale":"2024-04-19T02:16:32.774416+0000","last_undegraded":"2024-04-19T02:16:32.774416+0000","last_fullsized":"2024-04-19T02:16:32.774416+0000","mapping_epoch":16,"log_start":"22'2100","ondisk_log_start":"22'2100","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3610,"log_dups_size":0,"ondisk_log_size":3610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:53:26.969927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":374210560,"num_objects":5710,"num_object_clones":0,"num_object_copies":11420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5710,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5710,"num_write_kb":365440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.089317+0000","last_change":"2024-04-19T02:15:28.892767+0000","last_active":"2024-04-19T02:16:30.089317+0000","last_peered":"2024-04-19T02:16:30.089317+0000","last_clean":"2024-04-19T02:16:30.089317+0000","last_became_active":"2024-04-19T02:15:28.892235+0000","last_became_peered":"2024-04-19T02:15:28.892235+0000","last_unstale":"2024-04-19T02:16:30.089317+0000","last_undegraded":"2024-04-19T02:16:30.089317+0000","last_fullsized":"2024-04-19T02:16:30.089317+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:37.690735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093262+0000","last_change":"2024-04-19T02:15:29.279857+0000","last_active":"2024-04-19T02:16:30.093262+0000","last_peered":"2024-04-19T02:16:30.093262+0000","last_clean":"2024-04-19T02:16:30.093262+0000","last_became_active":"2024-04-19T02:15:29.279536+0000","last_became_peered":"2024-04-19T02:15:29.279536+0000","last_unstale":"2024-04-19T02:16:30.093262+0000","last_undegraded":"2024-04-19T02:16:30.093262+0000","last_fullsized":"2024-04-19T02:16:30.093262+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:00.191179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"34'5656","reported_seq":5682,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-19T02:16:32.783769+0000","last_change":"2024-04-19T02:15:53.957261+0000","last_active":"2024-04-19T02:16:32.783769+0000","last_peered":"2024-04-19T02:16:32.783769+0000","last_clean":"2024-04-19T02:16:32.783769+0000","last_became_active":"2024-04-19T02:15:53.957092+0000","last_became_peered":"2024-04-19T02:15:53.957092+0000","last_unstale":"2024-04-19T02:16:32.783769+0000","last_undegraded":"2024-04-19T02:16:32.783769+0000","last_fullsized":"2024-04-19T02:16:32.783769+0000","mapping_epoch":16,"log_start":"21'1913","ondisk_log_start":"21'1913","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3743,"log_dups_size":0,"ondisk_log_size":3743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:54:15.544923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":370671616,"num_objects":5656,"num_object_clones":0,"num_object_copies":11312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5656,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5656,"num_write_kb":361984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093207+0000","last_change":"2024-04-19T02:15:28.891611+0000","last_active":"2024-04-19T02:16:30.093207+0000","last_peered":"2024-04-19T02:16:30.093207+0000","last_clean":"2024-04-19T02:16:30.093207+0000","last_became_active":"2024-04-19T02:15:28.890914+0000","last_became_peered":"2024-04-19T02:15:28.890914+0000","last_unstale":"2024-04-19T02:16:30.093207+0000","last_undegraded":"2024-04-19T02:16:30.093207+0000","last_fullsized":"2024-04-19T02:16:30.093207+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:37.690735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.089451+0000","last_change":"2024-04-19T02:15:29.285774+0000","last_active":"2024-04-19T02:16:30.089451+0000","last_peered":"2024-04-19T02:16:30.089451+0000","last_clean":"2024-04-19T02:16:30.089451+0000","last_became_active":"2024-04-19T02:15:29.284705+0000","last_became_peered":"2024-04-19T02:15:29.284705+0000","last_unstale":"2024-04-19T02:16:30.089451+0000","last_undegraded":"2024-04-19T02:16:30.089451+0000","last_fullsized":"2024-04-19T02:16:30.089451+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"34'5562","reported_seq":5588,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-19T02:16:32.766711+0000","last_change":"2024-04-19T02:15:53.955286+0000","last_active":"2024-04-19T02:16:32.766711+0000","last_peered":"2024-04-19T02:16:32.766711+0000","last_clean":"2024-04-19T02:16:32.766711+0000","last_became_active":"2024-04-19T02:15:53.955026+0000","last_became_peered":"2024-04-19T02:15:53.955026+0000","last_unstale":"2024-04-19T02:16:32.766711+0000","last_undegraded":"2024-04-19T02:16:32.766711+0000","last_fullsized":"2024-04-19T02:16:32.766711+0000","mapping_epoch":16,"log_start":"21'1900","ondisk_log_start":"21'1900","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3662,"log_dups_size":0,"ondisk_log_size":3662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:05:48.594301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":364511232,"num_objects":5562,"num_object_clones":0,"num_object_copies":11124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5562,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5562,"num_write_kb":355968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.090387+0000","last_change":"2024-04-19T02:15:28.892873+0000","last_active":"2024-04-19T02:16:30.090387+0000","last_peered":"2024-04-19T02:16:30.090387+0000","last_clean":"2024-04-19T02:16:30.090387+0000","last_became_active":"2024-04-19T02:15:28.892487+0000","last_became_peered":"2024-04-19T02:15:28.892487+0000","last_unstale":"2024-04-19T02:16:30.090387+0000","last_undegraded":"2024-04-19T02:16:30.090387+0000","last_fullsized":"2024-04-19T02:16:30.090387+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:35.412837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.090081+0000","last_change":"2024-04-19T02:15:29.285019+0000","last_active":"2024-04-19T02:16:30.090081+0000","last_peered":"2024-04-19T02:16:30.090081+0000","last_clean":"2024-04-19T02:16:30.090081+0000","last_became_active":"2024-04-19T02:15:29.284650+0000","last_became_peered":"2024-04-19T02:15:29.284650+0000","last_unstale":"2024-04-19T02:16:30.090081+0000","last_undegraded":"2024-04-19T02:16:30.090081+0000","last_fullsized":"2024-04-19T02:16:30.090081+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"34'5653","reported_seq":5679,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-19T02:16:32.777564+0000","last_change":"2024-04-19T02:15:53.957403+0000","last_active":"2024-04-19T02:16:32.777564+0000","last_peered":"2024-04-19T02:16:32.777564+0000","last_clean":"2024-04-19T02:16:32.777564+0000","last_became_active":"2024-04-19T02:15:53.957190+0000","last_became_peered":"2024-04-19T02:15:53.957190+0000","last_unstale":"2024-04-19T02:16:32.777564+0000","last_undegraded":"2024-04-19T02:16:32.777564+0000","last_fullsized":"2024-04-19T02:16:32.777564+0000","mapping_epoch":16,"log_start":"21'1901","ondisk_log_start":"21'1901","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3752,"log_dups_size":0,"ondisk_log_size":3752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:07:12.817884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":370475008,"num_objects":5653,"num_object_clones":0,"num_object_copies":11306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5653,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5653,"num_write_kb":361792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.089131+0000","last_change":"2024-04-19T02:15:53.956839+0000","last_active":"2024-04-19T02:16:30.089131+0000","last_peered":"2024-04-19T02:16:30.089131+0000","last_clean":"2024-04-19T02:16:30.089131+0000","last_became_active":"2024-04-19T02:15:53.956630+0000","last_became_peered":"2024-04-19T02:15:53.956630+0000","last_unstale":"2024-04-19T02:16:30.089131+0000","last_undegraded":"2024-04-19T02:16:30.089131+0000","last_fullsized":"2024-04-19T02:16:30.089131+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:47.229730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.089820+0000","last_change":"2024-04-19T02:15:29.287190+0000","last_active":"2024-04-19T02:16:30.089820+0000","last_peered":"2024-04-19T02:16:30.089820+0000","last_clean":"2024-04-19T02:16:30.089820+0000","last_became_active":"2024-04-19T02:15:29.286606+0000","last_became_peered":"2024-04-19T02:15:29.286606+0000","last_unstale":"2024-04-19T02:16:30.089820+0000","last_undegraded":"2024-04-19T02:16:30.089820+0000","last_fullsized":"2024-04-19T02:16:30.089820+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:28.387062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"34'5550","reported_seq":5576,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-19T02:16:32.747206+0000","last_change":"2024-04-19T02:15:53.958448+0000","last_active":"2024-04-19T02:16:32.747206+0000","last_peered":"2024-04-19T02:16:32.747206+0000","last_clean":"2024-04-19T02:16:32.747206+0000","last_became_active":"2024-04-19T02:15:53.957595+0000","last_became_peered":"2024-04-19T02:15:53.957595+0000","last_unstale":"2024-04-19T02:16:32.747206+0000","last_undegraded":"2024-04-19T02:16:32.747206+0000","last_fullsized":"2024-04-19T02:16:32.747206+0000","mapping_epoch":16,"log_start":"21'1644","ondisk_log_start":"21'1644","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3906,"log_dups_size":0,"ondisk_log_size":3906,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:26:31.855319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":363724800,"num_objects":5550,"num_object_clones":0,"num_object_copies":11100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5550,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5550,"num_write_kb":355200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093203+0000","last_change":"2024-04-19T02:15:28.894121+0000","last_active":"2024-04-19T02:16:30.093203+0000","last_peered":"2024-04-19T02:16:30.093203+0000","last_clean":"2024-04-19T02:16:30.093203+0000","last_became_active":"2024-04-19T02:15:28.893902+0000","last_became_peered":"2024-04-19T02:15:28.893902+0000","last_unstale":"2024-04-19T02:16:30.093203+0000","last_undegraded":"2024-04-19T02:16:30.093203+0000","last_fullsized":"2024-04-19T02:16:30.093203+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:10:35.146583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093262+0000","last_change":"2024-04-19T02:15:29.282870+0000","last_active":"2024-04-19T02:16:30.093262+0000","last_peered":"2024-04-19T02:16:30.093262+0000","last_clean":"2024-04-19T02:16:30.093262+0000","last_became_active":"2024-04-19T02:15:29.281873+0000","last_became_peered":"2024-04-19T02:15:29.281873+0000","last_unstale":"2024-04-19T02:16:30.093262+0000","last_undegraded":"2024-04-19T02:16:30.093262+0000","last_fullsized":"2024-04-19T02:16:30.093262+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"34'5716","reported_seq":5742,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-19T02:16:32.770749+0000","last_change":"2024-04-19T02:15:53.955498+0000","last_active":"2024-04-19T02:16:32.770749+0000","last_peered":"2024-04-19T02:16:32.770749+0000","last_clean":"2024-04-19T02:16:32.770749+0000","last_became_active":"2024-04-19T02:15:53.954910+0000","last_became_peered":"2024-04-19T02:15:53.954910+0000","last_unstale":"2024-04-19T02:16:32.770749+0000","last_undegraded":"2024-04-19T02:16:32.770749+0000","last_fullsized":"2024-04-19T02:16:32.770749+0000","mapping_epoch":16,"log_start":"22'2100","ondisk_log_start":"22'2100","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3616,"log_dups_size":0,"ondisk_log_size":3616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:58:27.262672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":374603776,"num_objects":5716,"num_object_clones":0,"num_object_copies":11432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5716,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5716,"num_write_kb":365824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.096012+0000","last_change":"2024-04-19T02:15:24.527061+0000","last_active":"2024-04-19T02:16:30.096012+0000","last_peered":"2024-04-19T02:16:30.096012+0000","last_clean":"2024-04-19T02:16:30.096012+0000","last_became_active":"2024-04-19T02:15:24.526757+0000","last_became_peered":"2024-04-19T02:15:24.526757+0000","last_unstale":"2024-04-19T02:16:30.096012+0000","last_undegraded":"2024-04-19T02:16:30.096012+0000","last_fullsized":"2024-04-19T02:16:30.096012+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:17:13.649077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.090005+0000","last_change":"2024-04-19T02:15:28.892766+0000","last_active":"2024-04-19T02:16:30.090005+0000","last_peered":"2024-04-19T02:16:30.090005+0000","last_clean":"2024-04-19T02:16:30.090005+0000","last_became_active":"2024-04-19T02:15:28.892396+0000","last_became_peered":"2024-04-19T02:15:28.892396+0000","last_unstale":"2024-04-19T02:16:30.090005+0000","last_undegraded":"2024-04-19T02:16:30.090005+0000","last_fullsized":"2024-04-19T02:16:30.090005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:57.946581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.092577+0000","last_change":"2024-04-19T02:15:29.277922+0000","last_active":"2024-04-19T02:16:30.092577+0000","last_peered":"2024-04-19T02:16:30.092577+0000","last_clean":"2024-04-19T02:16:30.092577+0000","last_became_active":"2024-04-19T02:15:29.276968+0000","last_became_peered":"2024-04-19T02:15:29.276968+0000","last_unstale":"2024-04-19T02:16:30.092577+0000","last_undegraded":"2024-04-19T02:16:30.092577+0000","last_fullsized":"2024-04-19T02:16:30.092577+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"34'5632","reported_seq":5658,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-19T02:16:32.769639+0000","last_change":"2024-04-19T02:15:53.955228+0000","last_active":"2024-04-19T02:16:32.769639+0000","last_peered":"2024-04-19T02:16:32.769639+0000","last_clean":"2024-04-19T02:16:32.769639+0000","last_became_active":"2024-04-19T02:15:53.954960+0000","last_became_peered":"2024-04-19T02:15:53.954960+0000","last_unstale":"2024-04-19T02:16:32.769639+0000","last_undegraded":"2024-04-19T02:16:32.769639+0000","last_fullsized":"2024-04-19T02:16:32.769639+0000","mapping_epoch":16,"log_start":"22'2000","ondisk_log_start":"22'2000","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3632,"log_dups_size":0,"ondisk_log_size":3632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:46:07.409922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":369098752,"num_objects":5632,"num_object_clones":0,"num_object_copies":11264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5632,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5632,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.090510+0000","last_change":"2024-04-19T02:15:24.530933+0000","last_active":"2024-04-19T02:16:30.090510+0000","last_peered":"2024-04-19T02:16:30.090510+0000","last_clean":"2024-04-19T02:16:30.090510+0000","last_became_active":"2024-04-19T02:15:24.530550+0000","last_became_peered":"2024-04-19T02:15:24.530550+0000","last_unstale":"2024-04-19T02:16:30.090510+0000","last_undegraded":"2024-04-19T02:16:30.090510+0000","last_fullsized":"2024-04-19T02:16:30.090510+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:18:15.194321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.090030+0000","last_change":"2024-04-19T02:15:28.893062+0000","last_active":"2024-04-19T02:16:30.090030+0000","last_peered":"2024-04-19T02:16:30.090030+0000","last_clean":"2024-04-19T02:16:30.090030+0000","last_became_active":"2024-04-19T02:15:28.892798+0000","last_became_peered":"2024-04-19T02:15:28.892798+0000","last_unstale":"2024-04-19T02:16:30.090030+0000","last_undegraded":"2024-04-19T02:16:30.090030+0000","last_fullsized":"2024-04-19T02:16:30.090030+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:53.170180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.095946+0000","last_change":"2024-04-19T02:15:29.278294+0000","last_active":"2024-04-19T02:16:30.095946+0000","last_peered":"2024-04-19T02:16:30.095946+0000","last_clean":"2024-04-19T02:16:30.095946+0000","last_became_active":"2024-04-19T02:15:29.277536+0000","last_became_peered":"2024-04-19T02:15:29.277536+0000","last_unstale":"2024-04-19T02:16:30.095946+0000","last_undegraded":"2024-04-19T02:16:30.095946+0000","last_fullsized":"2024-04-19T02:16:30.095946+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"34'5628","reported_seq":5654,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-19T02:16:32.761718+0000","last_change":"2024-04-19T02:15:53.956251+0000","last_active":"2024-04-19T02:16:32.761718+0000","last_peered":"2024-04-19T02:16:32.761718+0000","last_clean":"2024-04-19T02:16:32.761718+0000","last_became_active":"2024-04-19T02:15:53.955886+0000","last_became_peered":"2024-04-19T02:15:53.955886+0000","last_unstale":"2024-04-19T02:16:32.761718+0000","last_undegraded":"2024-04-19T02:16:32.761718+0000","last_fullsized":"2024-04-19T02:16:32.761718+0000","mapping_epoch":16,"log_start":"22'2000","ondisk_log_start":"22'2000","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3628,"log_dups_size":0,"ondisk_log_size":3628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:38:38.586906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":368836608,"num_objects":5628,"num_object_clones":0,"num_object_copies":11256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5628,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5628,"num_write_kb":360192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.092990+0000","last_change":"2024-04-19T02:15:24.527048+0000","last_active":"2024-04-19T02:16:30.092990+0000","last_peered":"2024-04-19T02:16:30.092990+0000","last_clean":"2024-04-19T02:16:30.092990+0000","last_became_active":"2024-04-19T02:15:24.526790+0000","last_became_peered":"2024-04-19T02:15:24.526790+0000","last_unstale":"2024-04-19T02:16:30.092990+0000","last_undegraded":"2024-04-19T02:16:30.092990+0000","last_fullsized":"2024-04-19T02:16:30.092990+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.088984+0000","last_change":"2024-04-19T02:15:53.956945+0000","last_active":"2024-04-19T02:16:30.088984+0000","last_peered":"2024-04-19T02:16:30.088984+0000","last_clean":"2024-04-19T02:16:30.088984+0000","last_became_active":"2024-04-19T02:15:53.956719+0000","last_became_peered":"2024-04-19T02:15:53.956719+0000","last_unstale":"2024-04-19T02:16:30.088984+0000","last_undegraded":"2024-04-19T02:16:30.088984+0000","last_fullsized":"2024-04-19T02:16:30.088984+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:00:37.754624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093426+0000","last_change":"2024-04-19T02:15:29.282663+0000","last_active":"2024-04-19T02:16:30.093426+0000","last_peered":"2024-04-19T02:16:30.093426+0000","last_clean":"2024-04-19T02:16:30.093426+0000","last_became_active":"2024-04-19T02:15:29.282217+0000","last_became_peered":"2024-04-19T02:15:29.282217+0000","last_unstale":"2024-04-19T02:16:30.093426+0000","last_undegraded":"2024-04-19T02:16:30.093426+0000","last_fullsized":"2024-04-19T02:16:30.093426+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"34'5551","reported_seq":5577,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-19T02:16:32.733690+0000","last_change":"2024-04-19T02:15:53.958264+0000","last_active":"2024-04-19T02:16:32.733690+0000","last_peered":"2024-04-19T02:16:32.733690+0000","last_clean":"2024-04-19T02:16:32.733690+0000","last_became_active":"2024-04-19T02:15:53.956689+0000","last_became_peered":"2024-04-19T02:15:53.956689+0000","last_unstale":"2024-04-19T02:16:32.733690+0000","last_undegraded":"2024-04-19T02:16:32.733690+0000","last_fullsized":"2024-04-19T02:16:32.733690+0000","mapping_epoch":16,"log_start":"21'1600","ondisk_log_start":"21'1600","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3951,"log_dups_size":0,"ondisk_log_size":3951,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:24:32.928594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":363790336,"num_objects":5551,"num_object_clones":0,"num_object_copies":11102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5551,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5551,"num_write_kb":355264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.090102+0000","last_change":"2024-04-19T02:15:24.530924+0000","last_active":"2024-04-19T02:16:30.090102+0000","last_peered":"2024-04-19T02:16:30.090102+0000","last_clean":"2024-04-19T02:16:30.090102+0000","last_became_active":"2024-04-19T02:15:24.530551+0000","last_became_peered":"2024-04-19T02:15:24.530551+0000","last_unstale":"2024-04-19T02:16:30.090102+0000","last_undegraded":"2024-04-19T02:16:30.090102+0000","last_fullsized":"2024-04-19T02:16:30.090102+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:30.576946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":229,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.089169+0000","last_change":"2024-04-19T02:15:24.533634+0000","last_active":"2024-04-19T02:16:30.089169+0000","last_peered":"2024-04-19T02:16:30.089169+0000","last_clean":"2024-04-19T02:16:30.089169+0000","last_became_active":"2024-04-19T02:15:24.533420+0000","last_became_peered":"2024-04-19T02:15:24.533420+0000","last_unstale":"2024-04-19T02:16:30.089169+0000","last_undegraded":"2024-04-19T02:16:30.089169+0000","last_fullsized":"2024-04-19T02:16:30.089169+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093004+0000","last_change":"2024-04-19T02:15:28.890244+0000","last_active":"2024-04-19T02:16:30.093004+0000","last_peered":"2024-04-19T02:16:30.093004+0000","last_clean":"2024-04-19T02:16:30.093004+0000","last_became_active":"2024-04-19T02:15:28.889831+0000","last_became_peered":"2024-04-19T02:15:28.889831+0000","last_unstale":"2024-04-19T02:16:30.093004+0000","last_undegraded":"2024-04-19T02:16:30.093004+0000","last_fullsized":"2024-04-19T02:16:30.093004+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.090040+0000","last_change":"2024-04-19T02:15:29.285015+0000","last_active":"2024-04-19T02:16:30.090040+0000","last_peered":"2024-04-19T02:16:30.090040+0000","last_clean":"2024-04-19T02:16:30.090040+0000","last_became_active":"2024-04-19T02:15:29.284164+0000","last_became_peered":"2024-04-19T02:15:29.284164+0000","last_unstale":"2024-04-19T02:16:30.090040+0000","last_undegraded":"2024-04-19T02:16:30.090040+0000","last_fullsized":"2024-04-19T02:16:30.090040+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:36.987844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"34'5658","reported_seq":5684,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-19T02:16:32.797320+0000","last_change":"2024-04-19T02:15:53.956463+0000","last_active":"2024-04-19T02:16:32.797320+0000","last_peered":"2024-04-19T02:16:32.797320+0000","last_clean":"2024-04-19T02:16:32.797320+0000","last_became_active":"2024-04-19T02:15:53.955819+0000","last_became_peered":"2024-04-19T02:15:53.955819+0000","last_unstale":"2024-04-19T02:16:32.797320+0000","last_undegraded":"2024-04-19T02:16:32.797320+0000","last_fullsized":"2024-04-19T02:16:32.797320+0000","mapping_epoch":16,"log_start":"21'1931","ondisk_log_start":"21'1931","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3727,"log_dups_size":0,"ondisk_log_size":3727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:46:07.409922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":370802688,"num_objects":5658,"num_object_clones":0,"num_object_copies":11316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5658,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5658,"num_write_kb":362112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.089245+0000","last_change":"2024-04-19T02:15:24.533912+0000","last_active":"2024-04-19T02:16:30.089245+0000","last_peered":"2024-04-19T02:16:30.089245+0000","last_clean":"2024-04-19T02:16:30.089245+0000","last_became_active":"2024-04-19T02:15:24.533580+0000","last_became_peered":"2024-04-19T02:15:24.533580+0000","last_unstale":"2024-04-19T02:16:30.089245+0000","last_undegraded":"2024-04-19T02:16:30.089245+0000","last_fullsized":"2024-04-19T02:16:30.089245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:45.045477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.092752+0000","last_change":"2024-04-19T02:15:28.891889+0000","last_active":"2024-04-19T02:16:30.092752+0000","last_peered":"2024-04-19T02:16:30.092752+0000","last_clean":"2024-04-19T02:16:30.092752+0000","last_became_active":"2024-04-19T02:15:28.890919+0000","last_became_peered":"2024-04-19T02:15:28.890919+0000","last_unstale":"2024-04-19T02:16:30.092752+0000","last_undegraded":"2024-04-19T02:16:30.092752+0000","last_fullsized":"2024-04-19T02:16:30.092752+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:35.412837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093169+0000","last_change":"2024-04-19T02:15:53.957881+0000","last_active":"2024-04-19T02:16:30.093169+0000","last_peered":"2024-04-19T02:16:30.093169+0000","last_clean":"2024-04-19T02:16:30.093169+0000","last_became_active":"2024-04-19T02:15:53.957657+0000","last_became_peered":"2024-04-19T02:15:53.957657+0000","last_unstale":"2024-04-19T02:16:30.093169+0000","last_undegraded":"2024-04-19T02:16:30.093169+0000","last_fullsized":"2024-04-19T02:16:30.093169+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:46.921714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"34'5642","reported_seq":5667,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-19T02:16:32.799658+0000","last_change":"2024-04-19T02:15:53.955068+0000","last_active":"2024-04-19T02:16:32.799658+0000","last_peered":"2024-04-19T02:16:32.799658+0000","last_clean":"2024-04-19T02:16:32.799658+0000","last_became_active":"2024-04-19T02:15:53.954721+0000","last_became_peered":"2024-04-19T02:15:53.954721+0000","last_unstale":"2024-04-19T02:16:32.799658+0000","last_undegraded":"2024-04-19T02:16:32.799658+0000","last_fullsized":"2024-04-19T02:16:32.799658+0000","mapping_epoch":16,"log_start":"21'1900","ondisk_log_start":"21'1900","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3742,"log_dups_size":0,"ondisk_log_size":3742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:18:29.742535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":369754112,"num_objects":5642,"num_object_clones":0,"num_object_copies":11284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5642,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5642,"num_write_kb":361088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093339+0000","last_change":"2024-04-19T02:15:53.959105+0000","last_active":"2024-04-19T02:16:30.093339+0000","last_peered":"2024-04-19T02:16:30.093339+0000","last_clean":"2024-04-19T02:16:30.093339+0000","last_became_active":"2024-04-19T02:15:53.958836+0000","last_became_peered":"2024-04-19T02:15:53.958836+0000","last_unstale":"2024-04-19T02:16:30.093339+0000","last_undegraded":"2024-04-19T02:16:30.093339+0000","last_fullsized":"2024-04-19T02:16:30.093339+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:18:00.321514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.095897+0000","last_change":"2024-04-19T02:15:28.892125+0000","last_active":"2024-04-19T02:16:30.095897+0000","last_peered":"2024-04-19T02:16:30.095897+0000","last_clean":"2024-04-19T02:16:30.095897+0000","last_became_active":"2024-04-19T02:15:28.891300+0000","last_became_peered":"2024-04-19T02:15:28.891300+0000","last_unstale":"2024-04-19T02:16:30.095897+0000","last_undegraded":"2024-04-19T02:16:30.095897+0000","last_fullsized":"2024-04-19T02:16:30.095897+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.092638+0000","last_change":"2024-04-19T02:15:29.281694+0000","last_active":"2024-04-19T02:16:30.092638+0000","last_peered":"2024-04-19T02:16:30.092638+0000","last_clean":"2024-04-19T02:16:30.092638+0000","last_became_active":"2024-04-19T02:15:29.280519+0000","last_became_peered":"2024-04-19T02:15:29.280519+0000","last_unstale":"2024-04-19T02:16:30.092638+0000","last_undegraded":"2024-04-19T02:16:30.092638+0000","last_fullsized":"2024-04-19T02:16:30.092638+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:50.890545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"34'5462","reported_seq":8502,"reported_epoch":34,"state":"active+remapped+backfilling","last_fresh":"2024-04-19T02:16:32.771479+0000","last_change":"2024-04-19T02:16:30.103016+0000","last_active":"2024-04-19T02:16:32.771479+0000","last_peered":"2024-04-19T02:16:32.771479+0000","last_clean":"2024-04-19T02:16:22.050311+0000","last_became_active":"2024-04-19T02:16:24.119992+0000","last_became_peered":"2024-04-19T02:16:24.119992+0000","last_unstale":"2024-04-19T02:16:32.771479+0000","last_undegraded":"2024-04-19T02:16:32.771479+0000","last_fullsized":"2024-04-19T02:16:32.771479+0000","mapping_epoch":29,"log_start":"21'1837","ondisk_log_start":"21'1837","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3625,"log_dups_size":0,"ondisk_log_size":3625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:28.663111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":357957632,"num_objects":5462,"num_object_clones":0,"num_object_copies":10924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":3790,"num_objects_unfound":0,"num_objects_dirty":5462,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5462,"num_write_kb":349568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1501,"num_bytes_recovered":98369536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[{"shards":"0,2","objects":5462}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093177+0000","last_change":"2024-04-19T02:15:28.891702+0000","last_active":"2024-04-19T02:16:30.093177+0000","last_peered":"2024-04-19T02:16:30.093177+0000","last_clean":"2024-04-19T02:16:30.093177+0000","last_became_active":"2024-04-19T02:15:28.890743+0000","last_became_peered":"2024-04-19T02:15:28.890743+0000","last_unstale":"2024-04-19T02:16:30.093177+0000","last_undegraded":"2024-04-19T02:16:30.093177+0000","last_fullsized":"2024-04-19T02:16:30.093177+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093547+0000","last_change":"2024-04-19T02:15:24.526845+0000","last_active":"2024-04-19T02:16:30.093547+0000","last_peered":"2024-04-19T02:16:30.093547+0000","last_clean":"2024-04-19T02:16:30.093547+0000","last_became_active":"2024-04-19T02:15:24.526500+0000","last_became_peered":"2024-04-19T02:15:24.526500+0000","last_unstale":"2024-04-19T02:16:30.093547+0000","last_undegraded":"2024-04-19T02:16:30.093547+0000","last_fullsized":"2024-04-19T02:16:30.093547+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:16.883355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.095866+0000","last_change":"2024-04-19T02:15:29.278686+0000","last_active":"2024-04-19T02:16:30.095866+0000","last_peered":"2024-04-19T02:16:30.095866+0000","last_clean":"2024-04-19T02:16:30.095866+0000","last_became_active":"2024-04-19T02:15:29.278108+0000","last_became_peered":"2024-04-19T02:15:29.278108+0000","last_unstale":"2024-04-19T02:16:30.095866+0000","last_undegraded":"2024-04-19T02:16:30.095866+0000","last_fullsized":"2024-04-19T02:16:30.095866+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:34.593754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"34'5535","reported_seq":5561,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-19T02:16:32.742195+0000","last_change":"2024-04-19T02:15:53.957269+0000","last_active":"2024-04-19T02:16:32.742195+0000","last_peered":"2024-04-19T02:16:32.742195+0000","last_clean":"2024-04-19T02:16:32.742195+0000","last_became_active":"2024-04-19T02:15:53.956554+0000","last_became_peered":"2024-04-19T02:15:53.956554+0000","last_unstale":"2024-04-19T02:16:32.742195+0000","last_undegraded":"2024-04-19T02:16:32.742195+0000","last_fullsized":"2024-04-19T02:16:32.742195+0000","mapping_epoch":16,"log_start":"21'1628","ondisk_log_start":"21'1628","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3907,"log_dups_size":0,"ondisk_log_size":3907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:29:38.789719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":362741760,"num_objects":5535,"num_object_clones":0,"num_object_copies":11070,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5535,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5535,"num_write_kb":354240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.090269+0000","last_change":"2024-04-19T02:15:24.533777+0000","last_active":"2024-04-19T02:16:30.090269+0000","last_peered":"2024-04-19T02:16:30.090269+0000","last_clean":"2024-04-19T02:16:30.090269+0000","last_became_active":"2024-04-19T02:15:24.533436+0000","last_became_peered":"2024-04-19T02:15:24.533436+0000","last_unstale":"2024-04-19T02:16:30.090269+0000","last_undegraded":"2024-04-19T02:16:30.090269+0000","last_fullsized":"2024-04-19T02:16:30.090269+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:53:25.922418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093459+0000","last_change":"2024-04-19T02:15:28.891370+0000","last_active":"2024-04-19T02:16:30.093459+0000","last_peered":"2024-04-19T02:16:30.093459+0000","last_clean":"2024-04-19T02:16:30.093459+0000","last_became_active":"2024-04-19T02:15:28.890702+0000","last_became_peered":"2024-04-19T02:15:28.890702+0000","last_unstale":"2024-04-19T02:16:30.093459+0000","last_undegraded":"2024-04-19T02:16:30.093459+0000","last_fullsized":"2024-04-19T02:16:30.093459+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:33.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.092949+0000","last_change":"2024-04-19T02:15:29.282244+0000","last_active":"2024-04-19T02:16:30.092949+0000","last_peered":"2024-04-19T02:16:30.092949+0000","last_clean":"2024-04-19T02:16:30.092949+0000","last_became_active":"2024-04-19T02:15:29.280366+0000","last_became_peered":"2024-04-19T02:15:29.280366+0000","last_unstale":"2024-04-19T02:16:30.092949+0000","last_undegraded":"2024-04-19T02:16:30.092949+0000","last_fullsized":"2024-04-19T02:16:30.092949+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.092735+0000","last_change":"2024-04-19T02:15:28.893027+0000","last_active":"2024-04-19T02:16:30.092735+0000","last_peered":"2024-04-19T02:16:30.092735+0000","last_clean":"2024-04-19T02:16:30.092735+0000","last_became_active":"2024-04-19T02:15:28.892695+0000","last_became_peered":"2024-04-19T02:15:28.892695+0000","last_unstale":"2024-04-19T02:16:30.092735+0000","last_undegraded":"2024-04-19T02:16:30.092735+0000","last_fullsized":"2024-04-19T02:16:30.092735+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093025+0000","last_change":"2024-04-19T02:15:29.283155+0000","last_active":"2024-04-19T02:16:30.093025+0000","last_peered":"2024-04-19T02:16:30.093025+0000","last_clean":"2024-04-19T02:16:30.093025+0000","last_became_active":"2024-04-19T02:15:29.281407+0000","last_became_peered":"2024-04-19T02:15:29.281407+0000","last_unstale":"2024-04-19T02:16:30.093025+0000","last_undegraded":"2024-04-19T02:16:30.093025+0000","last_fullsized":"2024-04-19T02:16:30.093025+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.089618+0000","last_change":"2024-04-19T02:15:28.893067+0000","last_active":"2024-04-19T02:16:30.089618+0000","last_peered":"2024-04-19T02:16:30.089618+0000","last_clean":"2024-04-19T02:16:30.089618+0000","last_became_active":"2024-04-19T02:15:28.892781+0000","last_became_peered":"2024-04-19T02:15:28.892781+0000","last_unstale":"2024-04-19T02:16:30.089618+0000","last_undegraded":"2024-04-19T02:16:30.089618+0000","last_fullsized":"2024-04-19T02:16:30.089618+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:54:15.590143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.089903+0000","last_change":"2024-04-19T02:15:29.281279+0000","last_active":"2024-04-19T02:16:30.089903+0000","last_peered":"2024-04-19T02:16:30.089903+0000","last_clean":"2024-04-19T02:16:30.089903+0000","last_became_active":"2024-04-19T02:15:29.279360+0000","last_became_peered":"2024-04-19T02:15:29.279360+0000","last_unstale":"2024-04-19T02:16:30.089903+0000","last_undegraded":"2024-04-19T02:16:30.089903+0000","last_fullsized":"2024-04-19T02:16:30.089903+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093224+0000","last_change":"2024-04-19T02:15:28.893239+0000","last_active":"2024-04-19T02:16:30.093224+0000","last_peered":"2024-04-19T02:16:30.093224+0000","last_clean":"2024-04-19T02:16:30.093224+0000","last_became_active":"2024-04-19T02:15:28.892881+0000","last_became_peered":"2024-04-19T02:15:28.892881+0000","last_unstale":"2024-04-19T02:16:30.093224+0000","last_undegraded":"2024-04-19T02:16:30.093224+0000","last_fullsized":"2024-04-19T02:16:30.093224+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.090436+0000","last_change":"2024-04-19T02:15:29.281652+0000","last_active":"2024-04-19T02:16:30.090436+0000","last_peered":"2024-04-19T02:16:30.090436+0000","last_clean":"2024-04-19T02:16:30.090436+0000","last_became_active":"2024-04-19T02:15:29.281175+0000","last_became_peered":"2024-04-19T02:15:29.281175+0000","last_unstale":"2024-04-19T02:16:30.090436+0000","last_undegraded":"2024-04-19T02:16:30.090436+0000","last_fullsized":"2024-04-19T02:16:30.090436+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:16.568764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093621+0000","last_change":"2024-04-19T02:15:28.892058+0000","last_active":"2024-04-19T02:16:30.093621+0000","last_peered":"2024-04-19T02:16:30.093621+0000","last_clean":"2024-04-19T02:16:30.093621+0000","last_became_active":"2024-04-19T02:15:28.890877+0000","last_became_peered":"2024-04-19T02:15:28.890877+0000","last_unstale":"2024-04-19T02:16:30.093621+0000","last_undegraded":"2024-04-19T02:16:30.093621+0000","last_fullsized":"2024-04-19T02:16:30.093621+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:53.170180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093816+0000","last_change":"2024-04-19T02:15:29.278810+0000","last_active":"2024-04-19T02:16:30.093816+0000","last_peered":"2024-04-19T02:16:30.093816+0000","last_clean":"2024-04-19T02:16:30.093816+0000","last_became_active":"2024-04-19T02:15:29.277913+0000","last_became_peered":"2024-04-19T02:15:29.277913+0000","last_unstale":"2024-04-19T02:16:30.093816+0000","last_undegraded":"2024-04-19T02:16:30.093816+0000","last_fullsized":"2024-04-19T02:16:30.093816+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:24.082666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093347+0000","last_change":"2024-04-19T02:15:28.889132+0000","last_active":"2024-04-19T02:16:30.093347+0000","last_peered":"2024-04-19T02:16:30.093347+0000","last_clean":"2024-04-19T02:16:30.093347+0000","last_became_active":"2024-04-19T02:15:28.888926+0000","last_became_peered":"2024-04-19T02:15:28.888926+0000","last_unstale":"2024-04-19T02:16:30.093347+0000","last_undegraded":"2024-04-19T02:16:30.093347+0000","last_fullsized":"2024-04-19T02:16:30.093347+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.089483+0000","last_change":"2024-04-19T02:15:29.282776+0000","last_active":"2024-04-19T02:16:30.089483+0000","last_peered":"2024-04-19T02:16:30.089483+0000","last_clean":"2024-04-19T02:16:30.089483+0000","last_became_active":"2024-04-19T02:15:29.279382+0000","last_became_peered":"2024-04-19T02:15:29.279382+0000","last_unstale":"2024-04-19T02:16:30.089483+0000","last_undegraded":"2024-04-19T02:16:30.089483+0000","last_fullsized":"2024-04-19T02:16:30.089483+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.089323+0000","last_change":"2024-04-19T02:15:29.283537+0000","last_active":"2024-04-19T02:16:30.089323+0000","last_peered":"2024-04-19T02:16:30.089323+0000","last_clean":"2024-04-19T02:16:30.089323+0000","last_became_active":"2024-04-19T02:15:29.281801+0000","last_became_peered":"2024-04-19T02:15:29.281801+0000","last_unstale":"2024-04-19T02:16:30.089323+0000","last_undegraded":"2024-04-19T02:16:30.089323+0000","last_fullsized":"2024-04-19T02:16:30.089323+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.092825+0000","last_change":"2024-04-19T02:15:29.281560+0000","last_active":"2024-04-19T02:16:30.092825+0000","last_peered":"2024-04-19T02:16:30.092825+0000","last_clean":"2024-04-19T02:16:30.092825+0000","last_became_active":"2024-04-19T02:15:29.281261+0000","last_became_peered":"2024-04-19T02:15:29.281261+0000","last_unstale":"2024-04-19T02:16:30.092825+0000","last_undegraded":"2024-04-19T02:16:30.092825+0000","last_fullsized":"2024-04-19T02:16:30.092825+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.090019+0000","last_change":"2024-04-19T02:15:53.955913+0000","last_active":"2024-04-19T02:16:30.090019+0000","last_peered":"2024-04-19T02:16:30.090019+0000","last_clean":"2024-04-19T02:16:30.090019+0000","last_became_active":"2024-04-19T02:15:53.955676+0000","last_became_peered":"2024-04-19T02:15:53.955676+0000","last_unstale":"2024-04-19T02:16:30.090019+0000","last_undegraded":"2024-04-19T02:16:30.090019+0000","last_fullsized":"2024-04-19T02:16:30.090019+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:53:02.899902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093381+0000","last_change":"2024-04-19T02:15:29.278702+0000","last_active":"2024-04-19T02:16:30.093381+0000","last_peered":"2024-04-19T02:16:30.093381+0000","last_clean":"2024-04-19T02:16:30.093381+0000","last_became_active":"2024-04-19T02:15:29.277756+0000","last_became_peered":"2024-04-19T02:15:29.277756+0000","last_unstale":"2024-04-19T02:16:30.093381+0000","last_undegraded":"2024-04-19T02:16:30.093381+0000","last_fullsized":"2024-04-19T02:16:30.093381+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-19T02:16:30.093080+0000","last_change":"2024-04-19T02:15:29.277568+0000","last_active":"2024-04-19T02:16:30.093080+0000","last_peered":"2024-04-19T02:16:30.093080+0000","last_clean":"2024-04-19T02:16:30.093080+0000","last_became_active":"2024-04-19T02:15:29.276725+0000","last_became_peered":"2024-04-19T02:15:29.276725+0000","last_unstale":"2024-04-19T02:16:30.093080+0000","last_undegraded":"2024-04-19T02:16:30.093080+0000","last_fullsized":"2024-04-19T02:16:30.093080+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":5891751936,"num_objects":89901,"num_object_clones":0,"num_object_copies":179802,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":3790,"num_objects_unfound":0,"num_objects_dirty":89901,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89901,"num_write_kb":5753664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1501,"num_bytes_recovered":98369536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":11894259712,"data_stored":11894259712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60100,"ondisk_log_size":60100,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738384,"num_pgs":84,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4723384,"kb_used_data":4615980,"kb_used_omap":1,"kb_used_meta":107390,"kb_avail":89648456,"statfs":{"total":96636764160,"available":91800018944,"internally_reserved":0,"allocated":4726763520,"data_stored":4726526284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":109967814},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.313,"15min":0.313},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.497,"5min":0.497,"15min":0.497},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.17000000000000001}]},{"osd":1,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.22},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.253}]}]},{"osd":0,"up_from":8,"seq":34359738385,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3631300,"kb_used_data":3545980,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":90740540,"statfs":{"total":96636764160,"available":92918312960,"internally_reserved":0,"allocated":3631083520,"data_stored":3630827514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":87292358},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2,1,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.22600000000000001},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":1.046}]},{"osd":2,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":2.1000000000000001,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":0.215},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":1.8660000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738384,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3348028,"kb_used_data":3266868,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":91023812,"statfs":{"total":96636764160,"available":93208383488,"internally_reserved":0,"allocated":3345272832,"data_stored":3345024402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":83098054},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,2,7],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:16:26 2024","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.16900000000000001},{"interface":"front","average":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"min":{"1min":0.16,"5min":0.16,"15min":0.16},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.23799999999999999}]},{"osd":2,"last update":"Fri Apr 19 02:16:26 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.221},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.21099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3691315200,"data_stored":3691315200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3424911360,"data_stored":3424911360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4778033152,"data_stored":4778033152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:16:37.945 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-19T02:16:37.985 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:37.985+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:38.028 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 43 16 100170 100154 145.561 118.562 0.00981852 0.0068633 2024-04-19T02:16:38.065 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:38.065 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:38.080 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:16:38.086 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:38.086+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:38.130 INFO:teuthology.orchestra.run.smithi121.stderr:nodeep-scrub is unset 2024-04-19T02:16:38.186 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:38.186+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:38.243 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:38.243 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:38.258 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:16:38.287 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:38.287+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:38.388 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:38.389+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:38.407 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:16:38.407 INFO:teuthology.orchestra.run.smithi121.stdout:{"fsid":"f6ab5dd0-bb9f-4b48-a9fc-4728c7955ca8","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":83,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":38,"num_osds":3,"num_up_osds":3,"osd_up_since":1713492922,"num_in_osds":3,"osd_in_since":1713492915,"num_remapped_pgs":1},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":120},{"state_name":"active+remapped+backfilling","count":1}],"num_pgs":121,"num_pools":5,"num_objects":89925,"data_bytes":5892344666,"bytes_used":11983577088,"bytes_avail":277926715392,"bytes_total":289910292480,"misplaced_objects":3790,"misplaced_total":179850,"misplaced_ratio":0.021073116485960521,"recovering_objects_per_sec":143,"recovering_bytes_per_sec":9435417,"recovering_keys_per_sec":0,"num_objects_recovered":864,"num_bytes_recovered":56623104,"num_keys_recovered":0,"write_bytes_sec":112624372,"read_op_per_sec":0,"write_op_per_sec":1718},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4230}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-04-19T02:16:34.750409+0000","services":{}},"progress_events":{}} 2024-04-19T02:16:38.421 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-04-19T02:16:38.421 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:16:38.427 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:38.427 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:38.442 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:16:38.489 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:38.490+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:38.590 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:38.591+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:38.607 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:38.607 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:38.622 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:16:38.691 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:38.691+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:38.775 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:16:38.777 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-04-19T02:16:38.786 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":72,"stamp":"2024-04-19T02:16:38.750936+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6536432474,"num_objects":99753,"num_object_clones":0,"num_object_copies":199506,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":3427,"num_objects_unfound":0,"num_objects_dirty":99753,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":99977,"num_write_kb":6386130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2240,"num_bytes_recovered":146800640,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60224,"ondisk_log_size":60224,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":243,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":13169108,"kb_used_data":12841120,"kb_used_omap":4,"kb_used_meta":327931,"kb_avail":269946412,"statfs":{"total":289910292480,"available":276425125888,"internally_reserved":0,"allocated":13149306880,"data_stored":13148481548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":335801682},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,3,0,2,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":644087808,"num_objects":9828,"num_object_clones":0,"num_object_copies":19656,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-363,"num_objects_unfound":0,"num_objects_dirty":9828,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9828,"num_write_kb":628992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":739,"num_bytes_recovered":48431104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000747"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.115902+0000","last_change":"2024-04-19T02:15:29.280412+0000","last_active":"2024-04-19T02:16:36.115902+0000","last_peered":"2024-04-19T02:16:36.115902+0000","last_clean":"2024-04-19T02:16:36.115902+0000","last_became_active":"2024-04-19T02:15:29.278762+0000","last_became_peered":"2024-04-19T02:15:29.278762+0000","last_unstale":"2024-04-19T02:16:36.115902+0000","last_undegraded":"2024-04-19T02:16:36.115902+0000","last_fullsized":"2024-04-19T02:16:36.115902+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:45.301675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.115508+0000","last_change":"2024-04-19T02:15:29.284695+0000","last_active":"2024-04-19T02:16:36.115508+0000","last_peered":"2024-04-19T02:16:36.115508+0000","last_clean":"2024-04-19T02:16:36.115508+0000","last_became_active":"2024-04-19T02:15:29.283468+0000","last_became_peered":"2024-04-19T02:15:29.283468+0000","last_unstale":"2024-04-19T02:16:36.115508+0000","last_undegraded":"2024-04-19T02:16:36.115508+0000","last_fullsized":"2024-04-19T02:16:36.115508+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.384881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119635+0000","last_change":"2024-04-19T02:15:29.286709+0000","last_active":"2024-04-19T02:16:36.119635+0000","last_peered":"2024-04-19T02:16:36.119635+0000","last_clean":"2024-04-19T02:16:36.119635+0000","last_became_active":"2024-04-19T02:15:29.286169+0000","last_became_peered":"2024-04-19T02:15:29.286169+0000","last_unstale":"2024-04-19T02:16:36.119635+0000","last_undegraded":"2024-04-19T02:16:36.119635+0000","last_fullsized":"2024-04-19T02:16:36.119635+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:58.741466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119561+0000","last_change":"2024-04-19T02:15:29.280131+0000","last_active":"2024-04-19T02:16:36.119561+0000","last_peered":"2024-04-19T02:16:36.119561+0000","last_clean":"2024-04-19T02:16:36.119561+0000","last_became_active":"2024-04-19T02:15:29.279388+0000","last_became_peered":"2024-04-19T02:15:29.279388+0000","last_unstale":"2024-04-19T02:16:36.119561+0000","last_undegraded":"2024-04-19T02:16:36.119561+0000","last_fullsized":"2024-04-19T02:16:36.119561+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:36:48.819486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109473+0000","last_change":"2024-04-19T02:15:53.955892+0000","last_active":"2024-04-19T02:16:36.109473+0000","last_peered":"2024-04-19T02:16:36.109473+0000","last_clean":"2024-04-19T02:16:36.109473+0000","last_became_active":"2024-04-19T02:15:53.955553+0000","last_became_peered":"2024-04-19T02:15:53.955553+0000","last_unstale":"2024-04-19T02:16:36.109473+0000","last_undegraded":"2024-04-19T02:16:36.109473+0000","last_fullsized":"2024-04-19T02:16:36.109473+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:45:39.791209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118574+0000","last_change":"2024-04-19T02:15:29.283908+0000","last_active":"2024-04-19T02:16:36.118574+0000","last_peered":"2024-04-19T02:16:36.118574+0000","last_clean":"2024-04-19T02:16:36.118574+0000","last_became_active":"2024-04-19T02:15:29.281729+0000","last_became_peered":"2024-04-19T02:15:29.281729+0000","last_unstale":"2024-04-19T02:16:36.118574+0000","last_undegraded":"2024-04-19T02:16:36.118574+0000","last_fullsized":"2024-04-19T02:16:36.118574+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:03:15.383476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118611+0000","last_change":"2024-04-19T02:15:29.281253+0000","last_active":"2024-04-19T02:16:36.118611+0000","last_peered":"2024-04-19T02:16:36.118611+0000","last_clean":"2024-04-19T02:16:36.118611+0000","last_became_active":"2024-04-19T02:15:29.279951+0000","last_became_peered":"2024-04-19T02:15:29.279951+0000","last_unstale":"2024-04-19T02:16:36.118611+0000","last_undegraded":"2024-04-19T02:16:36.118611+0000","last_fullsized":"2024-04-19T02:16:36.118611+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118290+0000","last_change":"2024-04-19T02:15:29.283952+0000","last_active":"2024-04-19T02:16:36.118290+0000","last_peered":"2024-04-19T02:16:36.118290+0000","last_clean":"2024-04-19T02:16:36.118290+0000","last_became_active":"2024-04-19T02:15:29.282721+0000","last_became_peered":"2024-04-19T02:15:29.282721+0000","last_unstale":"2024-04-19T02:16:36.118290+0000","last_undegraded":"2024-04-19T02:16:36.118290+0000","last_fullsized":"2024-04-19T02:16:36.118290+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:45.301675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109780+0000","last_change":"2024-04-19T02:15:29.282150+0000","last_active":"2024-04-19T02:16:36.109780+0000","last_peered":"2024-04-19T02:16:36.109780+0000","last_clean":"2024-04-19T02:16:36.109780+0000","last_became_active":"2024-04-19T02:15:29.281538+0000","last_became_peered":"2024-04-19T02:15:29.281538+0000","last_unstale":"2024-04-19T02:16:36.109780+0000","last_undegraded":"2024-04-19T02:16:36.109780+0000","last_fullsized":"2024-04-19T02:16:36.109780+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119156+0000","last_change":"2024-04-19T02:16:30.093524+0000","last_active":"2024-04-19T02:16:36.119156+0000","last_peered":"2024-04-19T02:16:36.119156+0000","last_clean":"2024-04-19T02:16:36.119156+0000","last_became_active":"2024-04-19T02:16:30.093344+0000","last_became_peered":"2024-04-19T02:16:30.093344+0000","last_unstale":"2024-04-19T02:16:36.119156+0000","last_undegraded":"2024-04-19T02:16:36.119156+0000","last_fullsized":"2024-04-19T02:16:36.119156+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:14:40.293159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119375+0000","last_change":"2024-04-19T02:15:29.280606+0000","last_active":"2024-04-19T02:16:36.119375+0000","last_peered":"2024-04-19T02:16:36.119375+0000","last_clean":"2024-04-19T02:16:36.119375+0000","last_became_active":"2024-04-19T02:15:29.280151+0000","last_became_peered":"2024-04-19T02:15:29.280151+0000","last_unstale":"2024-04-19T02:16:36.119375+0000","last_undegraded":"2024-04-19T02:16:36.119375+0000","last_fullsized":"2024-04-19T02:16:36.119375+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:26:22.452488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119241+0000","last_change":"2024-04-19T02:15:53.958876+0000","last_active":"2024-04-19T02:16:36.119241+0000","last_peered":"2024-04-19T02:16:36.119241+0000","last_clean":"2024-04-19T02:16:36.119241+0000","last_became_active":"2024-04-19T02:15:53.958626+0000","last_became_peered":"2024-04-19T02:15:53.958626+0000","last_unstale":"2024-04-19T02:16:36.119241+0000","last_undegraded":"2024-04-19T02:16:36.119241+0000","last_fullsized":"2024-04-19T02:16:36.119241+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:23:57.044018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109386+0000","last_change":"2024-04-19T02:15:53.956801+0000","last_active":"2024-04-19T02:16:36.109386+0000","last_peered":"2024-04-19T02:16:36.109386+0000","last_clean":"2024-04-19T02:16:36.109386+0000","last_became_active":"2024-04-19T02:15:53.956620+0000","last_became_peered":"2024-04-19T02:15:53.956620+0000","last_unstale":"2024-04-19T02:16:36.109386+0000","last_undegraded":"2024-04-19T02:16:36.109386+0000","last_fullsized":"2024-04-19T02:16:36.109386+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:57:05.843101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118904+0000","last_change":"2024-04-19T02:15:29.284262+0000","last_active":"2024-04-19T02:16:36.118904+0000","last_peered":"2024-04-19T02:16:36.118904+0000","last_clean":"2024-04-19T02:16:36.118904+0000","last_became_active":"2024-04-19T02:15:29.283121+0000","last_became_peered":"2024-04-19T02:15:29.283121+0000","last_unstale":"2024-04-19T02:16:36.118904+0000","last_undegraded":"2024-04-19T02:16:36.118904+0000","last_fullsized":"2024-04-19T02:16:36.118904+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118730+0000","last_change":"2024-04-19T02:15:29.285139+0000","last_active":"2024-04-19T02:16:36.118730+0000","last_peered":"2024-04-19T02:16:36.118730+0000","last_clean":"2024-04-19T02:16:36.118730+0000","last_became_active":"2024-04-19T02:15:29.284649+0000","last_became_peered":"2024-04-19T02:15:29.284649+0000","last_unstale":"2024-04-19T02:16:36.118730+0000","last_undegraded":"2024-04-19T02:16:36.118730+0000","last_fullsized":"2024-04-19T02:16:36.118730+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118330+0000","last_change":"2024-04-19T02:15:29.283648+0000","last_active":"2024-04-19T02:16:36.118330+0000","last_peered":"2024-04-19T02:16:36.118330+0000","last_clean":"2024-04-19T02:16:36.118330+0000","last_became_active":"2024-04-19T02:15:29.281606+0000","last_became_peered":"2024-04-19T02:15:29.281606+0000","last_unstale":"2024-04-19T02:16:36.118330+0000","last_undegraded":"2024-04-19T02:16:36.118330+0000","last_fullsized":"2024-04-19T02:16:36.118330+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109828+0000","last_change":"2024-04-19T02:15:29.278673+0000","last_active":"2024-04-19T02:16:36.109828+0000","last_peered":"2024-04-19T02:16:36.109828+0000","last_clean":"2024-04-19T02:16:36.109828+0000","last_became_active":"2024-04-19T02:15:29.277699+0000","last_became_peered":"2024-04-19T02:15:29.277699+0000","last_unstale":"2024-04-19T02:16:36.109828+0000","last_undegraded":"2024-04-19T02:16:36.109828+0000","last_fullsized":"2024-04-19T02:16:36.109828+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.115725+0000","last_change":"2024-04-19T02:15:29.283341+0000","last_active":"2024-04-19T02:16:36.115725+0000","last_peered":"2024-04-19T02:16:36.115725+0000","last_clean":"2024-04-19T02:16:36.115725+0000","last_became_active":"2024-04-19T02:15:29.281591+0000","last_became_peered":"2024-04-19T02:15:29.281591+0000","last_unstale":"2024-04-19T02:16:36.115725+0000","last_undegraded":"2024-04-19T02:16:36.115725+0000","last_fullsized":"2024-04-19T02:16:36.115725+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:34.593754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109881+0000","last_change":"2024-04-19T02:15:29.282110+0000","last_active":"2024-04-19T02:16:36.109881+0000","last_peered":"2024-04-19T02:16:36.109881+0000","last_clean":"2024-04-19T02:16:36.109881+0000","last_became_active":"2024-04-19T02:15:29.281716+0000","last_became_peered":"2024-04-19T02:15:29.281716+0000","last_unstale":"2024-04-19T02:16:36.109881+0000","last_undegraded":"2024-04-19T02:16:36.109881+0000","last_fullsized":"2024-04-19T02:16:36.109881+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119482+0000","last_change":"2024-04-19T02:15:29.285237+0000","last_active":"2024-04-19T02:16:36.119482+0000","last_peered":"2024-04-19T02:16:36.119482+0000","last_clean":"2024-04-19T02:16:36.119482+0000","last_became_active":"2024-04-19T02:15:29.282790+0000","last_became_peered":"2024-04-19T02:15:29.282790+0000","last_unstale":"2024-04-19T02:16:36.119482+0000","last_undegraded":"2024-04-19T02:16:36.119482+0000","last_fullsized":"2024-04-19T02:16:36.119482+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118682+0000","last_change":"2024-04-19T02:15:29.282609+0000","last_active":"2024-04-19T02:16:36.118682+0000","last_peered":"2024-04-19T02:16:36.118682+0000","last_clean":"2024-04-19T02:16:36.118682+0000","last_became_active":"2024-04-19T02:15:29.281665+0000","last_became_peered":"2024-04-19T02:15:29.281665+0000","last_unstale":"2024-04-19T02:16:36.118682+0000","last_undegraded":"2024-04-19T02:16:36.118682+0000","last_fullsized":"2024-04-19T02:16:36.118682+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.384881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118442+0000","last_change":"2024-04-19T02:15:53.955813+0000","last_active":"2024-04-19T02:16:36.118442+0000","last_peered":"2024-04-19T02:16:36.118442+0000","last_clean":"2024-04-19T02:16:36.118442+0000","last_became_active":"2024-04-19T02:15:53.955614+0000","last_became_peered":"2024-04-19T02:15:53.955614+0000","last_unstale":"2024-04-19T02:16:36.118442+0000","last_undegraded":"2024-04-19T02:16:36.118442+0000","last_fullsized":"2024-04-19T02:16:36.118442+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:58:03.192647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109416+0000","last_change":"2024-04-19T02:15:29.277109+0000","last_active":"2024-04-19T02:16:36.109416+0000","last_peered":"2024-04-19T02:16:36.109416+0000","last_clean":"2024-04-19T02:16:36.109416+0000","last_became_active":"2024-04-19T02:15:29.275417+0000","last_became_peered":"2024-04-19T02:15:29.275417+0000","last_unstale":"2024-04-19T02:16:36.109416+0000","last_undegraded":"2024-04-19T02:16:36.109416+0000","last_fullsized":"2024-04-19T02:16:36.109416+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.115084+0000","last_change":"2024-04-19T02:15:29.283266+0000","last_active":"2024-04-19T02:16:36.115084+0000","last_peered":"2024-04-19T02:16:36.115084+0000","last_clean":"2024-04-19T02:16:36.115084+0000","last_became_active":"2024-04-19T02:15:29.281505+0000","last_became_peered":"2024-04-19T02:15:29.281505+0000","last_unstale":"2024-04-19T02:16:36.115084+0000","last_undegraded":"2024-04-19T02:16:36.115084+0000","last_fullsized":"2024-04-19T02:16:36.115084+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.115920+0000","last_change":"2024-04-19T02:15:29.278084+0000","last_active":"2024-04-19T02:16:36.115920+0000","last_peered":"2024-04-19T02:16:36.115920+0000","last_clean":"2024-04-19T02:16:36.115920+0000","last_became_active":"2024-04-19T02:15:29.276952+0000","last_became_peered":"2024-04-19T02:15:29.276952+0000","last_unstale":"2024-04-19T02:16:36.115920+0000","last_undegraded":"2024-04-19T02:16:36.115920+0000","last_fullsized":"2024-04-19T02:16:36.115920+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.110442+0000","last_change":"2024-04-19T02:15:29.279904+0000","last_active":"2024-04-19T02:16:36.110442+0000","last_peered":"2024-04-19T02:16:36.110442+0000","last_clean":"2024-04-19T02:16:36.110442+0000","last_became_active":"2024-04-19T02:15:29.278938+0000","last_became_peered":"2024-04-19T02:15:29.278938+0000","last_unstale":"2024-04-19T02:16:36.110442+0000","last_undegraded":"2024-04-19T02:16:36.110442+0000","last_fullsized":"2024-04-19T02:16:36.110442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119447+0000","last_change":"2024-04-19T02:15:29.287389+0000","last_active":"2024-04-19T02:16:36.119447+0000","last_peered":"2024-04-19T02:16:36.119447+0000","last_clean":"2024-04-19T02:16:36.119447+0000","last_became_active":"2024-04-19T02:15:29.286431+0000","last_became_peered":"2024-04-19T02:15:29.286431+0000","last_unstale":"2024-04-19T02:16:36.119447+0000","last_undegraded":"2024-04-19T02:16:36.119447+0000","last_fullsized":"2024-04-19T02:16:36.119447+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:58:30.117887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109444+0000","last_change":"2024-04-19T02:15:53.959207+0000","last_active":"2024-04-19T02:16:36.109444+0000","last_peered":"2024-04-19T02:16:36.109444+0000","last_clean":"2024-04-19T02:16:36.109444+0000","last_became_active":"2024-04-19T02:15:53.959007+0000","last_became_peered":"2024-04-19T02:15:53.959007+0000","last_unstale":"2024-04-19T02:16:36.109444+0000","last_undegraded":"2024-04-19T02:16:36.109444+0000","last_fullsized":"2024-04-19T02:16:36.109444+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:08:21.065077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.115630+0000","last_change":"2024-04-19T02:15:29.281792+0000","last_active":"2024-04-19T02:16:36.115630+0000","last_peered":"2024-04-19T02:16:36.115630+0000","last_clean":"2024-04-19T02:16:36.115630+0000","last_became_active":"2024-04-19T02:15:29.280479+0000","last_became_peered":"2024-04-19T02:15:29.280479+0000","last_unstale":"2024-04-19T02:16:36.115630+0000","last_undegraded":"2024-04-19T02:16:36.115630+0000","last_fullsized":"2024-04-19T02:16:36.115630+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109501+0000","last_change":"2024-04-19T02:15:28.888778+0000","last_active":"2024-04-19T02:16:36.109501+0000","last_peered":"2024-04-19T02:16:36.109501+0000","last_clean":"2024-04-19T02:16:36.109501+0000","last_became_active":"2024-04-19T02:15:28.888543+0000","last_became_peered":"2024-04-19T02:15:28.888543+0000","last_unstale":"2024-04-19T02:16:36.109501+0000","last_undegraded":"2024-04-19T02:16:36.109501+0000","last_fullsized":"2024-04-19T02:16:36.109501+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:43:51.221619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.110223+0000","last_change":"2024-04-19T02:15:29.279986+0000","last_active":"2024-04-19T02:16:36.110223+0000","last_peered":"2024-04-19T02:16:36.110223+0000","last_clean":"2024-04-19T02:16:36.110223+0000","last_became_active":"2024-04-19T02:15:29.279690+0000","last_became_peered":"2024-04-19T02:15:29.279690+0000","last_unstale":"2024-04-19T02:16:36.110223+0000","last_undegraded":"2024-04-19T02:16:36.110223+0000","last_fullsized":"2024-04-19T02:16:36.110223+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109296+0000","last_change":"2024-04-19T02:15:28.890463+0000","last_active":"2024-04-19T02:16:36.109296+0000","last_peered":"2024-04-19T02:16:36.109296+0000","last_clean":"2024-04-19T02:16:36.109296+0000","last_became_active":"2024-04-19T02:15:28.889777+0000","last_became_peered":"2024-04-19T02:15:28.889777+0000","last_unstale":"2024-04-19T02:16:36.109296+0000","last_undegraded":"2024-04-19T02:16:36.109296+0000","last_fullsized":"2024-04-19T02:16:36.109296+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:58:21.520250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.115861+0000","last_change":"2024-04-19T02:15:29.280879+0000","last_active":"2024-04-19T02:16:36.115861+0000","last_peered":"2024-04-19T02:16:36.115861+0000","last_clean":"2024-04-19T02:16:36.115861+0000","last_became_active":"2024-04-19T02:15:29.279314+0000","last_became_peered":"2024-04-19T02:15:29.279314+0000","last_unstale":"2024-04-19T02:16:36.115861+0000","last_undegraded":"2024-04-19T02:16:36.115861+0000","last_fullsized":"2024-04-19T02:16:36.115861+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.110396+0000","last_change":"2024-04-19T02:15:28.891867+0000","last_active":"2024-04-19T02:16:36.110396+0000","last_peered":"2024-04-19T02:16:36.110396+0000","last_clean":"2024-04-19T02:16:36.110396+0000","last_became_active":"2024-04-19T02:15:28.890806+0000","last_became_peered":"2024-04-19T02:15:28.890806+0000","last_unstale":"2024-04-19T02:16:36.110396+0000","last_undegraded":"2024-04-19T02:16:36.110396+0000","last_fullsized":"2024-04-19T02:16:36.110396+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:57.946581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109200+0000","last_change":"2024-04-19T02:15:29.278148+0000","last_active":"2024-04-19T02:16:36.109200+0000","last_peered":"2024-04-19T02:16:36.109200+0000","last_clean":"2024-04-19T02:16:36.109200+0000","last_became_active":"2024-04-19T02:15:29.277402+0000","last_became_peered":"2024-04-19T02:15:29.277402+0000","last_unstale":"2024-04-19T02:16:36.109200+0000","last_undegraded":"2024-04-19T02:16:36.109200+0000","last_fullsized":"2024-04-19T02:16:36.109200+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119644+0000","last_change":"2024-04-19T02:15:28.892905+0000","last_active":"2024-04-19T02:16:36.119644+0000","last_peered":"2024-04-19T02:16:36.119644+0000","last_clean":"2024-04-19T02:16:36.119644+0000","last_became_active":"2024-04-19T02:15:28.892541+0000","last_became_peered":"2024-04-19T02:15:28.892541+0000","last_unstale":"2024-04-19T02:16:36.119644+0000","last_undegraded":"2024-04-19T02:16:36.119644+0000","last_fullsized":"2024-04-19T02:16:36.119644+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:33.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.110091+0000","last_change":"2024-04-19T02:15:29.278810+0000","last_active":"2024-04-19T02:16:36.110091+0000","last_peered":"2024-04-19T02:16:36.110091+0000","last_clean":"2024-04-19T02:16:36.110091+0000","last_became_active":"2024-04-19T02:15:29.278093+0000","last_became_peered":"2024-04-19T02:15:29.278093+0000","last_unstale":"2024-04-19T02:16:36.110091+0000","last_undegraded":"2024-04-19T02:16:36.110091+0000","last_fullsized":"2024-04-19T02:16:36.110091+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:34.883207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.115376+0000","last_change":"2024-04-19T02:15:28.892937+0000","last_active":"2024-04-19T02:16:36.115376+0000","last_peered":"2024-04-19T02:16:36.115376+0000","last_clean":"2024-04-19T02:16:36.115376+0000","last_became_active":"2024-04-19T02:15:28.891440+0000","last_became_peered":"2024-04-19T02:15:28.891440+0000","last_unstale":"2024-04-19T02:16:36.115376+0000","last_undegraded":"2024-04-19T02:16:36.115376+0000","last_fullsized":"2024-04-19T02:16:36.115376+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109371+0000","last_change":"2024-04-19T02:15:29.278404+0000","last_active":"2024-04-19T02:16:36.109371+0000","last_peered":"2024-04-19T02:16:36.109371+0000","last_clean":"2024-04-19T02:16:36.109371+0000","last_became_active":"2024-04-19T02:15:29.277460+0000","last_became_peered":"2024-04-19T02:15:29.277460+0000","last_unstale":"2024-04-19T02:16:36.109371+0000","last_undegraded":"2024-04-19T02:16:36.109371+0000","last_fullsized":"2024-04-19T02:16:36.109371+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119407+0000","last_change":"2024-04-19T02:15:28.891097+0000","last_active":"2024-04-19T02:16:36.119407+0000","last_peered":"2024-04-19T02:16:36.119407+0000","last_clean":"2024-04-19T02:16:36.119407+0000","last_became_active":"2024-04-19T02:15:28.890795+0000","last_became_peered":"2024-04-19T02:15:28.890795+0000","last_unstale":"2024-04-19T02:16:36.119407+0000","last_undegraded":"2024-04-19T02:16:36.119407+0000","last_fullsized":"2024-04-19T02:16:36.119407+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.120535+0000","last_change":"2024-04-19T02:15:29.278546+0000","last_active":"2024-04-19T02:16:36.120535+0000","last_peered":"2024-04-19T02:16:36.120535+0000","last_clean":"2024-04-19T02:16:36.120535+0000","last_became_active":"2024-04-19T02:15:29.277547+0000","last_became_peered":"2024-04-19T02:15:29.277547+0000","last_unstale":"2024-04-19T02:16:36.120535+0000","last_undegraded":"2024-04-19T02:16:36.120535+0000","last_fullsized":"2024-04-19T02:16:36.120535+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119008+0000","last_change":"2024-04-19T02:15:28.892977+0000","last_active":"2024-04-19T02:16:36.119008+0000","last_peered":"2024-04-19T02:16:36.119008+0000","last_clean":"2024-04-19T02:16:36.119008+0000","last_became_active":"2024-04-19T02:15:28.892636+0000","last_became_peered":"2024-04-19T02:15:28.892636+0000","last_unstale":"2024-04-19T02:16:36.119008+0000","last_undegraded":"2024-04-19T02:16:36.119008+0000","last_fullsized":"2024-04-19T02:16:36.119008+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:43:51.221619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109598+0000","last_change":"2024-04-19T02:15:53.955655+0000","last_active":"2024-04-19T02:16:36.109598+0000","last_peered":"2024-04-19T02:16:36.109598+0000","last_clean":"2024-04-19T02:16:36.109598+0000","last_became_active":"2024-04-19T02:15:53.955382+0000","last_became_peered":"2024-04-19T02:15:53.955382+0000","last_unstale":"2024-04-19T02:16:36.109598+0000","last_undegraded":"2024-04-19T02:16:36.109598+0000","last_fullsized":"2024-04-19T02:16:36.109598+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:48.239260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109444+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:16:36.109444+0000","last_peered":"2024-04-19T02:16:36.109444+0000","last_clean":"2024-04-19T02:16:36.109444+0000","last_became_active":"2024-04-19T02:15:28.890751+0000","last_became_peered":"2024-04-19T02:15:28.890751+0000","last_unstale":"2024-04-19T02:16:36.109444+0000","last_undegraded":"2024-04-19T02:16:36.109444+0000","last_fullsized":"2024-04-19T02:16:36.109444+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109523+0000","last_change":"2024-04-19T02:15:53.957865+0000","last_active":"2024-04-19T02:16:36.109523+0000","last_peered":"2024-04-19T02:16:36.109523+0000","last_clean":"2024-04-19T02:16:36.109523+0000","last_became_active":"2024-04-19T02:15:53.957627+0000","last_became_peered":"2024-04-19T02:15:53.957627+0000","last_unstale":"2024-04-19T02:16:36.109523+0000","last_undegraded":"2024-04-19T02:16:36.109523+0000","last_fullsized":"2024-04-19T02:16:36.109523+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:16:45.799016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.114958+0000","last_change":"2024-04-19T02:15:28.892934+0000","last_active":"2024-04-19T02:16:36.114958+0000","last_peered":"2024-04-19T02:16:36.114958+0000","last_clean":"2024-04-19T02:16:36.114958+0000","last_became_active":"2024-04-19T02:15:28.891879+0000","last_became_peered":"2024-04-19T02:15:28.891879+0000","last_unstale":"2024-04-19T02:16:36.114958+0000","last_undegraded":"2024-04-19T02:16:36.114958+0000","last_fullsized":"2024-04-19T02:16:36.114958+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:10:12.514798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.110374+0000","last_change":"2024-04-19T02:15:29.279685+0000","last_active":"2024-04-19T02:16:36.110374+0000","last_peered":"2024-04-19T02:16:36.110374+0000","last_clean":"2024-04-19T02:16:36.110374+0000","last_became_active":"2024-04-19T02:15:29.278810+0000","last_became_peered":"2024-04-19T02:15:29.278810+0000","last_unstale":"2024-04-19T02:16:36.110374+0000","last_undegraded":"2024-04-19T02:16:36.110374+0000","last_fullsized":"2024-04-19T02:16:36.110374+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118492+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:16:36.118492+0000","last_peered":"2024-04-19T02:16:36.118492+0000","last_clean":"2024-04-19T02:16:36.118492+0000","last_became_active":"2024-04-19T02:15:28.890882+0000","last_became_peered":"2024-04-19T02:15:28.890882+0000","last_unstale":"2024-04-19T02:16:36.118492+0000","last_undegraded":"2024-04-19T02:16:36.118492+0000","last_fullsized":"2024-04-19T02:16:36.118492+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:31.673938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.110562+0000","last_change":"2024-04-19T02:15:29.284258+0000","last_active":"2024-04-19T02:16:36.110562+0000","last_peered":"2024-04-19T02:16:36.110562+0000","last_clean":"2024-04-19T02:16:36.110562+0000","last_became_active":"2024-04-19T02:15:29.283995+0000","last_became_peered":"2024-04-19T02:15:29.283995+0000","last_unstale":"2024-04-19T02:16:36.110562+0000","last_undegraded":"2024-04-19T02:16:36.110562+0000","last_fullsized":"2024-04-19T02:16:36.110562+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:35.941308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"37'6312","reported_seq":6341,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-19T02:16:37.787567+0000","last_change":"2024-04-19T02:15:53.956977+0000","last_active":"2024-04-19T02:16:37.787567+0000","last_peered":"2024-04-19T02:16:37.787567+0000","last_clean":"2024-04-19T02:16:37.787567+0000","last_became_active":"2024-04-19T02:15:53.956730+0000","last_became_peered":"2024-04-19T02:15:53.956730+0000","last_unstale":"2024-04-19T02:16:37.787567+0000","last_undegraded":"2024-04-19T02:16:37.787567+0000","last_fullsized":"2024-04-19T02:16:37.787567+0000","mapping_epoch":16,"log_start":"23'2600","ondisk_log_start":"23'2600","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3712,"log_dups_size":0,"ondisk_log_size":3712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:56:46.323499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413663232,"num_objects":6312,"num_object_clones":0,"num_object_copies":12624,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6312,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6312,"num_write_kb":403968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119482+0000","last_change":"2024-04-19T02:15:28.890265+0000","last_active":"2024-04-19T02:16:36.119482+0000","last_peered":"2024-04-19T02:16:36.119482+0000","last_clean":"2024-04-19T02:16:36.119482+0000","last_became_active":"2024-04-19T02:15:28.890004+0000","last_became_peered":"2024-04-19T02:15:28.890004+0000","last_unstale":"2024-04-19T02:16:36.119482+0000","last_undegraded":"2024-04-19T02:16:36.119482+0000","last_fullsized":"2024-04-19T02:16:36.119482+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:02.517101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.114836+0000","last_change":"2024-04-19T02:15:29.285529+0000","last_active":"2024-04-19T02:16:36.114836+0000","last_peered":"2024-04-19T02:16:36.114836+0000","last_clean":"2024-04-19T02:16:36.114836+0000","last_became_active":"2024-04-19T02:15:29.285197+0000","last_became_peered":"2024-04-19T02:15:29.285197+0000","last_unstale":"2024-04-19T02:16:36.114836+0000","last_undegraded":"2024-04-19T02:16:36.114836+0000","last_fullsized":"2024-04-19T02:16:36.114836+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"37'6301","reported_seq":6330,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-19T02:16:37.743800+0000","last_change":"2024-04-19T02:15:53.958523+0000","last_active":"2024-04-19T02:16:37.743800+0000","last_peered":"2024-04-19T02:16:37.743800+0000","last_clean":"2024-04-19T02:16:37.743800+0000","last_became_active":"2024-04-19T02:15:53.957627+0000","last_became_peered":"2024-04-19T02:15:53.957627+0000","last_unstale":"2024-04-19T02:16:37.743800+0000","last_undegraded":"2024-04-19T02:16:37.743800+0000","last_fullsized":"2024-04-19T02:16:37.743800+0000","mapping_epoch":16,"log_start":"22'2347","ondisk_log_start":"22'2347","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3954,"log_dups_size":0,"ondisk_log_size":3954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:59:55.120296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":412942336,"num_objects":6301,"num_object_clones":0,"num_object_copies":12602,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6301,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6301,"num_write_kb":403264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.115538+0000","last_change":"2024-04-19T02:15:28.893902+0000","last_active":"2024-04-19T02:16:36.115538+0000","last_peered":"2024-04-19T02:16:36.115538+0000","last_clean":"2024-04-19T02:16:36.115538+0000","last_became_active":"2024-04-19T02:15:28.893231+0000","last_became_peered":"2024-04-19T02:15:28.893231+0000","last_unstale":"2024-04-19T02:16:36.115538+0000","last_undegraded":"2024-04-19T02:16:36.115538+0000","last_fullsized":"2024-04-19T02:16:36.115538+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:23.658442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.115048+0000","last_change":"2024-04-19T02:15:29.282874+0000","last_active":"2024-04-19T02:16:36.115048+0000","last_peered":"2024-04-19T02:16:36.115048+0000","last_clean":"2024-04-19T02:16:36.115048+0000","last_became_active":"2024-04-19T02:15:29.281675+0000","last_became_peered":"2024-04-19T02:15:29.281675+0000","last_unstale":"2024-04-19T02:16:36.115048+0000","last_undegraded":"2024-04-19T02:16:36.115048+0000","last_fullsized":"2024-04-19T02:16:36.115048+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:35.941308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"37'6199","reported_seq":6226,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-19T02:16:37.759413+0000","last_change":"2024-04-19T02:15:53.958324+0000","last_active":"2024-04-19T02:16:37.759413+0000","last_peered":"2024-04-19T02:16:37.759413+0000","last_clean":"2024-04-19T02:16:37.759413+0000","last_became_active":"2024-04-19T02:15:53.957392+0000","last_became_peered":"2024-04-19T02:15:53.957392+0000","last_unstale":"2024-04-19T02:16:37.759413+0000","last_undegraded":"2024-04-19T02:16:37.759413+0000","last_fullsized":"2024-04-19T02:16:37.759413+0000","mapping_epoch":16,"log_start":"22'2300","ondisk_log_start":"22'2300","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3899,"log_dups_size":0,"ondisk_log_size":3899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:12:58.132969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":406257664,"num_objects":6199,"num_object_clones":0,"num_object_copies":12398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6199,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6199,"num_write_kb":396736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119538+0000","last_change":"2024-04-19T02:15:28.891234+0000","last_active":"2024-04-19T02:16:36.119538+0000","last_peered":"2024-04-19T02:16:36.119538+0000","last_clean":"2024-04-19T02:16:36.119538+0000","last_became_active":"2024-04-19T02:15:28.890881+0000","last_became_peered":"2024-04-19T02:15:28.890881+0000","last_unstale":"2024-04-19T02:16:36.119538+0000","last_undegraded":"2024-04-19T02:16:36.119538+0000","last_fullsized":"2024-04-19T02:16:36.119538+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118794+0000","last_change":"2024-04-19T02:15:29.281937+0000","last_active":"2024-04-19T02:16:36.118794+0000","last_peered":"2024-04-19T02:16:36.118794+0000","last_clean":"2024-04-19T02:16:36.118794+0000","last_became_active":"2024-04-19T02:15:29.280727+0000","last_became_peered":"2024-04-19T02:15:29.280727+0000","last_unstale":"2024-04-19T02:16:36.118794+0000","last_undegraded":"2024-04-19T02:16:36.118794+0000","last_fullsized":"2024-04-19T02:16:36.118794+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"37'6332","reported_seq":6361,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-19T02:16:37.772023+0000","last_change":"2024-04-19T02:15:53.959099+0000","last_active":"2024-04-19T02:16:37.772023+0000","last_peered":"2024-04-19T02:16:37.772023+0000","last_clean":"2024-04-19T02:16:37.772023+0000","last_became_active":"2024-04-19T02:15:53.958885+0000","last_became_peered":"2024-04-19T02:15:53.958885+0000","last_unstale":"2024-04-19T02:16:37.772023+0000","last_undegraded":"2024-04-19T02:16:37.772023+0000","last_fullsized":"2024-04-19T02:16:37.772023+0000","mapping_epoch":16,"log_start":"23'2700","ondisk_log_start":"23'2700","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3632,"log_dups_size":0,"ondisk_log_size":3632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:53:26.969927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":414973952,"num_objects":6332,"num_object_clones":0,"num_object_copies":12664,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6332,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6332,"num_write_kb":405248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119509+0000","last_change":"2024-04-19T02:15:28.892767+0000","last_active":"2024-04-19T02:16:36.119509+0000","last_peered":"2024-04-19T02:16:36.119509+0000","last_clean":"2024-04-19T02:16:36.119509+0000","last_became_active":"2024-04-19T02:15:28.892235+0000","last_became_peered":"2024-04-19T02:15:28.892235+0000","last_unstale":"2024-04-19T02:16:36.119509+0000","last_undegraded":"2024-04-19T02:16:36.119509+0000","last_fullsized":"2024-04-19T02:16:36.119509+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:37.690735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109626+0000","last_change":"2024-04-19T02:15:29.279857+0000","last_active":"2024-04-19T02:16:36.109626+0000","last_peered":"2024-04-19T02:16:36.109626+0000","last_clean":"2024-04-19T02:16:36.109626+0000","last_became_active":"2024-04-19T02:15:29.279536+0000","last_became_peered":"2024-04-19T02:15:29.279536+0000","last_unstale":"2024-04-19T02:16:36.109626+0000","last_undegraded":"2024-04-19T02:16:36.109626+0000","last_fullsized":"2024-04-19T02:16:36.109626+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:00.191179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"37'6264","reported_seq":6292,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-19T02:16:37.807014+0000","last_change":"2024-04-19T02:15:53.957261+0000","last_active":"2024-04-19T02:16:37.807014+0000","last_peered":"2024-04-19T02:16:37.807014+0000","last_clean":"2024-04-19T02:16:37.807014+0000","last_became_active":"2024-04-19T02:15:53.957092+0000","last_became_peered":"2024-04-19T02:15:53.957092+0000","last_unstale":"2024-04-19T02:16:37.807014+0000","last_undegraded":"2024-04-19T02:16:37.807014+0000","last_fullsized":"2024-04-19T02:16:37.807014+0000","mapping_epoch":16,"log_start":"23'2513","ondisk_log_start":"23'2513","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3751,"log_dups_size":0,"ondisk_log_size":3751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:54:15.544923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":410517504,"num_objects":6264,"num_object_clones":0,"num_object_copies":12528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6264,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6264,"num_write_kb":400896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109542+0000","last_change":"2024-04-19T02:15:28.891611+0000","last_active":"2024-04-19T02:16:36.109542+0000","last_peered":"2024-04-19T02:16:36.109542+0000","last_clean":"2024-04-19T02:16:36.109542+0000","last_became_active":"2024-04-19T02:15:28.890914+0000","last_became_peered":"2024-04-19T02:15:28.890914+0000","last_unstale":"2024-04-19T02:16:36.109542+0000","last_undegraded":"2024-04-19T02:16:36.109542+0000","last_fullsized":"2024-04-19T02:16:36.109542+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:37.690735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119155+0000","last_change":"2024-04-19T02:15:29.285774+0000","last_active":"2024-04-19T02:16:36.119155+0000","last_peered":"2024-04-19T02:16:36.119155+0000","last_clean":"2024-04-19T02:16:36.119155+0000","last_became_active":"2024-04-19T02:15:29.284705+0000","last_became_peered":"2024-04-19T02:15:29.284705+0000","last_unstale":"2024-04-19T02:16:36.119155+0000","last_undegraded":"2024-04-19T02:16:36.119155+0000","last_fullsized":"2024-04-19T02:16:36.119155+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"37'6195","reported_seq":6224,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-19T02:16:37.752803+0000","last_change":"2024-04-19T02:15:53.955286+0000","last_active":"2024-04-19T02:16:37.752803+0000","last_peered":"2024-04-19T02:16:37.752803+0000","last_clean":"2024-04-19T02:16:37.752803+0000","last_became_active":"2024-04-19T02:15:53.955026+0000","last_became_peered":"2024-04-19T02:15:53.955026+0000","last_unstale":"2024-04-19T02:16:37.752803+0000","last_undegraded":"2024-04-19T02:16:37.752803+0000","last_fullsized":"2024-04-19T02:16:37.752803+0000","mapping_epoch":16,"log_start":"23'2600","ondisk_log_start":"23'2600","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3595,"log_dups_size":0,"ondisk_log_size":3595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:05:48.594301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":405995520,"num_objects":6195,"num_object_clones":0,"num_object_copies":12390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6195,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6195,"num_write_kb":396480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118652+0000","last_change":"2024-04-19T02:15:28.892873+0000","last_active":"2024-04-19T02:16:36.118652+0000","last_peered":"2024-04-19T02:16:36.118652+0000","last_clean":"2024-04-19T02:16:36.118652+0000","last_became_active":"2024-04-19T02:15:28.892487+0000","last_became_peered":"2024-04-19T02:15:28.892487+0000","last_unstale":"2024-04-19T02:16:36.118652+0000","last_undegraded":"2024-04-19T02:16:36.118652+0000","last_fullsized":"2024-04-19T02:16:36.118652+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:35.412837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119736+0000","last_change":"2024-04-19T02:15:29.285019+0000","last_active":"2024-04-19T02:16:36.119736+0000","last_peered":"2024-04-19T02:16:36.119736+0000","last_clean":"2024-04-19T02:16:36.119736+0000","last_became_active":"2024-04-19T02:15:29.284650+0000","last_became_peered":"2024-04-19T02:15:29.284650+0000","last_unstale":"2024-04-19T02:16:36.119736+0000","last_undegraded":"2024-04-19T02:16:36.119736+0000","last_fullsized":"2024-04-19T02:16:36.119736+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"37'6289","reported_seq":6318,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-19T02:16:37.787045+0000","last_change":"2024-04-19T02:15:53.957403+0000","last_active":"2024-04-19T02:16:37.787045+0000","last_peered":"2024-04-19T02:16:37.787045+0000","last_clean":"2024-04-19T02:16:37.787045+0000","last_became_active":"2024-04-19T02:15:53.957190+0000","last_became_peered":"2024-04-19T02:15:53.957190+0000","last_unstale":"2024-04-19T02:16:37.787045+0000","last_undegraded":"2024-04-19T02:16:37.787045+0000","last_fullsized":"2024-04-19T02:16:37.787045+0000","mapping_epoch":16,"log_start":"23'2601","ondisk_log_start":"23'2601","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3688,"log_dups_size":0,"ondisk_log_size":3688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:07:12.817884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":412155904,"num_objects":6289,"num_object_clones":0,"num_object_copies":12578,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6289,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6289,"num_write_kb":402496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118538+0000","last_change":"2024-04-19T02:15:53.956839+0000","last_active":"2024-04-19T02:16:36.118538+0000","last_peered":"2024-04-19T02:16:36.118538+0000","last_clean":"2024-04-19T02:16:36.118538+0000","last_became_active":"2024-04-19T02:15:53.956630+0000","last_became_peered":"2024-04-19T02:15:53.956630+0000","last_unstale":"2024-04-19T02:16:36.118538+0000","last_undegraded":"2024-04-19T02:16:36.118538+0000","last_fullsized":"2024-04-19T02:16:36.118538+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:47.229730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119650+0000","last_change":"2024-04-19T02:15:29.287190+0000","last_active":"2024-04-19T02:16:36.119650+0000","last_peered":"2024-04-19T02:16:36.119650+0000","last_clean":"2024-04-19T02:16:36.119650+0000","last_became_active":"2024-04-19T02:15:29.286606+0000","last_became_peered":"2024-04-19T02:15:29.286606+0000","last_unstale":"2024-04-19T02:16:36.119650+0000","last_undegraded":"2024-04-19T02:16:36.119650+0000","last_fullsized":"2024-04-19T02:16:36.119650+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:28.387062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"37'6160","reported_seq":6189,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-19T02:16:37.708869+0000","last_change":"2024-04-19T02:15:53.958448+0000","last_active":"2024-04-19T02:16:37.708869+0000","last_peered":"2024-04-19T02:16:37.708869+0000","last_clean":"2024-04-19T02:16:37.708869+0000","last_became_active":"2024-04-19T02:15:53.957595+0000","last_became_peered":"2024-04-19T02:15:53.957595+0000","last_unstale":"2024-04-19T02:16:37.708869+0000","last_undegraded":"2024-04-19T02:16:37.708869+0000","last_fullsized":"2024-04-19T02:16:37.708869+0000","mapping_epoch":16,"log_start":"22'2244","ondisk_log_start":"22'2244","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3916,"log_dups_size":0,"ondisk_log_size":3916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:26:31.855319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":403701760,"num_objects":6160,"num_object_clones":0,"num_object_copies":12320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6160,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6160,"num_write_kb":394240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.114969+0000","last_change":"2024-04-19T02:15:28.894121+0000","last_active":"2024-04-19T02:16:36.114969+0000","last_peered":"2024-04-19T02:16:36.114969+0000","last_clean":"2024-04-19T02:16:36.114969+0000","last_became_active":"2024-04-19T02:15:28.893902+0000","last_became_peered":"2024-04-19T02:15:28.893902+0000","last_unstale":"2024-04-19T02:16:36.114969+0000","last_undegraded":"2024-04-19T02:16:36.114969+0000","last_fullsized":"2024-04-19T02:16:36.114969+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:10:35.146583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.110130+0000","last_change":"2024-04-19T02:15:29.282870+0000","last_active":"2024-04-19T02:16:36.110130+0000","last_peered":"2024-04-19T02:16:36.110130+0000","last_clean":"2024-04-19T02:16:36.110130+0000","last_became_active":"2024-04-19T02:15:29.281873+0000","last_became_peered":"2024-04-19T02:15:29.281873+0000","last_unstale":"2024-04-19T02:16:36.110130+0000","last_undegraded":"2024-04-19T02:16:36.110130+0000","last_fullsized":"2024-04-19T02:16:36.110130+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"37'6297","reported_seq":6326,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-19T02:16:37.716291+0000","last_change":"2024-04-19T02:15:53.955498+0000","last_active":"2024-04-19T02:16:37.716291+0000","last_peered":"2024-04-19T02:16:37.716291+0000","last_clean":"2024-04-19T02:16:37.716291+0000","last_became_active":"2024-04-19T02:15:53.954910+0000","last_became_peered":"2024-04-19T02:15:53.954910+0000","last_unstale":"2024-04-19T02:16:37.716291+0000","last_undegraded":"2024-04-19T02:16:37.716291+0000","last_fullsized":"2024-04-19T02:16:37.716291+0000","mapping_epoch":16,"log_start":"23'2700","ondisk_log_start":"23'2700","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3597,"log_dups_size":0,"ondisk_log_size":3597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:58:27.262672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":412680192,"num_objects":6297,"num_object_clones":0,"num_object_copies":12594,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6297,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6297,"num_write_kb":403008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.110331+0000","last_change":"2024-04-19T02:15:24.527061+0000","last_active":"2024-04-19T02:16:36.110331+0000","last_peered":"2024-04-19T02:16:36.110331+0000","last_clean":"2024-04-19T02:16:36.110331+0000","last_became_active":"2024-04-19T02:15:24.526757+0000","last_became_peered":"2024-04-19T02:15:24.526757+0000","last_unstale":"2024-04-19T02:16:36.110331+0000","last_undegraded":"2024-04-19T02:16:36.110331+0000","last_fullsized":"2024-04-19T02:16:36.110331+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:17:13.649077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119650+0000","last_change":"2024-04-19T02:15:28.892766+0000","last_active":"2024-04-19T02:16:36.119650+0000","last_peered":"2024-04-19T02:16:36.119650+0000","last_clean":"2024-04-19T02:16:36.119650+0000","last_became_active":"2024-04-19T02:15:28.892396+0000","last_became_peered":"2024-04-19T02:15:28.892396+0000","last_unstale":"2024-04-19T02:16:36.119650+0000","last_undegraded":"2024-04-19T02:16:36.119650+0000","last_fullsized":"2024-04-19T02:16:36.119650+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:57.946581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.116987+0000","last_change":"2024-04-19T02:15:29.277922+0000","last_active":"2024-04-19T02:16:36.116987+0000","last_peered":"2024-04-19T02:16:36.116987+0000","last_clean":"2024-04-19T02:16:36.116987+0000","last_became_active":"2024-04-19T02:15:29.276968+0000","last_became_peered":"2024-04-19T02:15:29.276968+0000","last_unstale":"2024-04-19T02:16:36.116987+0000","last_undegraded":"2024-04-19T02:16:36.116987+0000","last_fullsized":"2024-04-19T02:16:36.116987+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"37'6244","reported_seq":6273,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-19T02:16:37.762569+0000","last_change":"2024-04-19T02:15:53.955228+0000","last_active":"2024-04-19T02:16:37.762569+0000","last_peered":"2024-04-19T02:16:37.762569+0000","last_clean":"2024-04-19T02:16:37.762569+0000","last_became_active":"2024-04-19T02:15:53.954960+0000","last_became_peered":"2024-04-19T02:15:53.954960+0000","last_unstale":"2024-04-19T02:16:37.762569+0000","last_undegraded":"2024-04-19T02:16:37.762569+0000","last_fullsized":"2024-04-19T02:16:37.762569+0000","mapping_epoch":16,"log_start":"23'2600","ondisk_log_start":"23'2600","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3644,"log_dups_size":0,"ondisk_log_size":3644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:46:07.409922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":409206784,"num_objects":6244,"num_object_clones":0,"num_object_copies":12488,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6244,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6244,"num_write_kb":399616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118913+0000","last_change":"2024-04-19T02:15:24.530933+0000","last_active":"2024-04-19T02:16:36.118913+0000","last_peered":"2024-04-19T02:16:36.118913+0000","last_clean":"2024-04-19T02:16:36.118913+0000","last_became_active":"2024-04-19T02:15:24.530550+0000","last_became_peered":"2024-04-19T02:15:24.530550+0000","last_unstale":"2024-04-19T02:16:36.118913+0000","last_undegraded":"2024-04-19T02:16:36.118913+0000","last_fullsized":"2024-04-19T02:16:36.118913+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:18:15.194321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118812+0000","last_change":"2024-04-19T02:15:28.893062+0000","last_active":"2024-04-19T02:16:36.118812+0000","last_peered":"2024-04-19T02:16:36.118812+0000","last_clean":"2024-04-19T02:16:36.118812+0000","last_became_active":"2024-04-19T02:15:28.892798+0000","last_became_peered":"2024-04-19T02:15:28.892798+0000","last_unstale":"2024-04-19T02:16:36.118812+0000","last_undegraded":"2024-04-19T02:16:36.118812+0000","last_fullsized":"2024-04-19T02:16:36.118812+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:53.170180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.110264+0000","last_change":"2024-04-19T02:15:29.278294+0000","last_active":"2024-04-19T02:16:36.110264+0000","last_peered":"2024-04-19T02:16:36.110264+0000","last_clean":"2024-04-19T02:16:36.110264+0000","last_became_active":"2024-04-19T02:15:29.277536+0000","last_became_peered":"2024-04-19T02:15:29.277536+0000","last_unstale":"2024-04-19T02:16:36.110264+0000","last_undegraded":"2024-04-19T02:16:36.110264+0000","last_fullsized":"2024-04-19T02:16:36.110264+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"37'6254","reported_seq":6283,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-19T02:16:37.777667+0000","last_change":"2024-04-19T02:15:53.956251+0000","last_active":"2024-04-19T02:16:37.777667+0000","last_peered":"2024-04-19T02:16:37.777667+0000","last_clean":"2024-04-19T02:16:37.777667+0000","last_became_active":"2024-04-19T02:15:53.955886+0000","last_became_peered":"2024-04-19T02:15:53.955886+0000","last_unstale":"2024-04-19T02:16:37.777667+0000","last_undegraded":"2024-04-19T02:16:37.777667+0000","last_fullsized":"2024-04-19T02:16:37.777667+0000","mapping_epoch":16,"log_start":"23'2600","ondisk_log_start":"23'2600","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3654,"log_dups_size":0,"ondisk_log_size":3654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:38:38.586906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":409862144,"num_objects":6254,"num_object_clones":0,"num_object_copies":12508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6254,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6254,"num_write_kb":400256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109339+0000","last_change":"2024-04-19T02:15:24.527048+0000","last_active":"2024-04-19T02:16:36.109339+0000","last_peered":"2024-04-19T02:16:36.109339+0000","last_clean":"2024-04-19T02:16:36.109339+0000","last_became_active":"2024-04-19T02:15:24.526790+0000","last_became_peered":"2024-04-19T02:15:24.526790+0000","last_unstale":"2024-04-19T02:16:36.109339+0000","last_undegraded":"2024-04-19T02:16:36.109339+0000","last_fullsized":"2024-04-19T02:16:36.109339+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118208+0000","last_change":"2024-04-19T02:15:53.956945+0000","last_active":"2024-04-19T02:16:36.118208+0000","last_peered":"2024-04-19T02:16:36.118208+0000","last_clean":"2024-04-19T02:16:36.118208+0000","last_became_active":"2024-04-19T02:15:53.956719+0000","last_became_peered":"2024-04-19T02:15:53.956719+0000","last_unstale":"2024-04-19T02:16:36.118208+0000","last_undegraded":"2024-04-19T02:16:36.118208+0000","last_fullsized":"2024-04-19T02:16:36.118208+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:00:37.754624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.110687+0000","last_change":"2024-04-19T02:15:29.282663+0000","last_active":"2024-04-19T02:16:36.110687+0000","last_peered":"2024-04-19T02:16:36.110687+0000","last_clean":"2024-04-19T02:16:36.110687+0000","last_became_active":"2024-04-19T02:15:29.282217+0000","last_became_peered":"2024-04-19T02:15:29.282217+0000","last_unstale":"2024-04-19T02:16:36.110687+0000","last_undegraded":"2024-04-19T02:16:36.110687+0000","last_fullsized":"2024-04-19T02:16:36.110687+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"37'6174","reported_seq":6203,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-19T02:16:37.748233+0000","last_change":"2024-04-19T02:15:53.958264+0000","last_active":"2024-04-19T02:16:37.748233+0000","last_peered":"2024-04-19T02:16:37.748233+0000","last_clean":"2024-04-19T02:16:37.748233+0000","last_became_active":"2024-04-19T02:15:53.956689+0000","last_became_peered":"2024-04-19T02:15:53.956689+0000","last_unstale":"2024-04-19T02:16:37.748233+0000","last_undegraded":"2024-04-19T02:16:37.748233+0000","last_fullsized":"2024-04-19T02:16:37.748233+0000","mapping_epoch":16,"log_start":"22'2200","ondisk_log_start":"22'2200","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3974,"log_dups_size":0,"ondisk_log_size":3974,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:24:32.928594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404619264,"num_objects":6174,"num_object_clones":0,"num_object_copies":12348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6174,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6174,"num_write_kb":395136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118853+0000","last_change":"2024-04-19T02:15:24.530924+0000","last_active":"2024-04-19T02:16:36.118853+0000","last_peered":"2024-04-19T02:16:36.118853+0000","last_clean":"2024-04-19T02:16:36.118853+0000","last_became_active":"2024-04-19T02:15:24.530551+0000","last_became_peered":"2024-04-19T02:15:24.530551+0000","last_unstale":"2024-04-19T02:16:36.118853+0000","last_undegraded":"2024-04-19T02:16:36.118853+0000","last_fullsized":"2024-04-19T02:16:36.118853+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:30.576946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":232,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118383+0000","last_change":"2024-04-19T02:15:24.533634+0000","last_active":"2024-04-19T02:16:36.118383+0000","last_peered":"2024-04-19T02:16:36.118383+0000","last_clean":"2024-04-19T02:16:36.118383+0000","last_became_active":"2024-04-19T02:15:24.533420+0000","last_became_peered":"2024-04-19T02:15:24.533420+0000","last_unstale":"2024-04-19T02:16:36.118383+0000","last_undegraded":"2024-04-19T02:16:36.118383+0000","last_fullsized":"2024-04-19T02:16:36.118383+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109353+0000","last_change":"2024-04-19T02:15:28.890244+0000","last_active":"2024-04-19T02:16:36.109353+0000","last_peered":"2024-04-19T02:16:36.109353+0000","last_clean":"2024-04-19T02:16:36.109353+0000","last_became_active":"2024-04-19T02:15:28.889831+0000","last_became_peered":"2024-04-19T02:15:28.889831+0000","last_unstale":"2024-04-19T02:16:36.109353+0000","last_undegraded":"2024-04-19T02:16:36.109353+0000","last_fullsized":"2024-04-19T02:16:36.109353+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119730+0000","last_change":"2024-04-19T02:15:29.285015+0000","last_active":"2024-04-19T02:16:36.119730+0000","last_peered":"2024-04-19T02:16:36.119730+0000","last_clean":"2024-04-19T02:16:36.119730+0000","last_became_active":"2024-04-19T02:15:29.284164+0000","last_became_peered":"2024-04-19T02:15:29.284164+0000","last_unstale":"2024-04-19T02:16:36.119730+0000","last_undegraded":"2024-04-19T02:16:36.119730+0000","last_fullsized":"2024-04-19T02:16:36.119730+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:36.987844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"37'6264","reported_seq":6293,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-19T02:16:37.807067+0000","last_change":"2024-04-19T02:15:53.956463+0000","last_active":"2024-04-19T02:16:37.807067+0000","last_peered":"2024-04-19T02:16:37.807067+0000","last_clean":"2024-04-19T02:16:37.807067+0000","last_became_active":"2024-04-19T02:15:53.955819+0000","last_became_peered":"2024-04-19T02:15:53.955819+0000","last_unstale":"2024-04-19T02:16:37.807067+0000","last_undegraded":"2024-04-19T02:16:37.807067+0000","last_fullsized":"2024-04-19T02:16:37.807067+0000","mapping_epoch":16,"log_start":"23'2531","ondisk_log_start":"23'2531","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3733,"log_dups_size":0,"ondisk_log_size":3733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:46:07.409922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":410517504,"num_objects":6264,"num_object_clones":0,"num_object_copies":12528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6264,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6264,"num_write_kb":400896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118407+0000","last_change":"2024-04-19T02:15:24.533912+0000","last_active":"2024-04-19T02:16:36.118407+0000","last_peered":"2024-04-19T02:16:36.118407+0000","last_clean":"2024-04-19T02:16:36.118407+0000","last_became_active":"2024-04-19T02:15:24.533580+0000","last_became_peered":"2024-04-19T02:15:24.533580+0000","last_unstale":"2024-04-19T02:16:36.118407+0000","last_undegraded":"2024-04-19T02:16:36.118407+0000","last_fullsized":"2024-04-19T02:16:36.118407+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:45.045477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109172+0000","last_change":"2024-04-19T02:15:28.891889+0000","last_active":"2024-04-19T02:16:36.109172+0000","last_peered":"2024-04-19T02:16:36.109172+0000","last_clean":"2024-04-19T02:16:36.109172+0000","last_became_active":"2024-04-19T02:15:28.890919+0000","last_became_peered":"2024-04-19T02:15:28.890919+0000","last_unstale":"2024-04-19T02:16:36.109172+0000","last_undegraded":"2024-04-19T02:16:36.109172+0000","last_fullsized":"2024-04-19T02:16:36.109172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:35.412837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109834+0000","last_change":"2024-04-19T02:15:53.957881+0000","last_active":"2024-04-19T02:16:36.109834+0000","last_peered":"2024-04-19T02:16:36.109834+0000","last_clean":"2024-04-19T02:16:36.109834+0000","last_became_active":"2024-04-19T02:15:53.957657+0000","last_became_peered":"2024-04-19T02:15:53.957657+0000","last_unstale":"2024-04-19T02:16:36.109834+0000","last_undegraded":"2024-04-19T02:16:36.109834+0000","last_fullsized":"2024-04-19T02:16:36.109834+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:46.921714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"37'6240","reported_seq":6269,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-19T02:16:37.803472+0000","last_change":"2024-04-19T02:15:53.955068+0000","last_active":"2024-04-19T02:16:37.803472+0000","last_peered":"2024-04-19T02:16:37.803472+0000","last_clean":"2024-04-19T02:16:37.803472+0000","last_became_active":"2024-04-19T02:15:53.954721+0000","last_became_peered":"2024-04-19T02:15:53.954721+0000","last_unstale":"2024-04-19T02:16:37.803472+0000","last_undegraded":"2024-04-19T02:16:37.803472+0000","last_fullsized":"2024-04-19T02:16:37.803472+0000","mapping_epoch":16,"log_start":"23'2500","ondisk_log_start":"23'2500","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3740,"log_dups_size":0,"ondisk_log_size":3740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:18:29.742535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408944640,"num_objects":6240,"num_object_clones":0,"num_object_copies":12480,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6240,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6240,"num_write_kb":399360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109748+0000","last_change":"2024-04-19T02:15:53.959105+0000","last_active":"2024-04-19T02:16:36.109748+0000","last_peered":"2024-04-19T02:16:36.109748+0000","last_clean":"2024-04-19T02:16:36.109748+0000","last_became_active":"2024-04-19T02:15:53.958836+0000","last_became_peered":"2024-04-19T02:15:53.958836+0000","last_unstale":"2024-04-19T02:16:36.109748+0000","last_undegraded":"2024-04-19T02:16:36.109748+0000","last_fullsized":"2024-04-19T02:16:36.109748+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:18:00.321514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.110191+0000","last_change":"2024-04-19T02:15:28.892125+0000","last_active":"2024-04-19T02:16:36.110191+0000","last_peered":"2024-04-19T02:16:36.110191+0000","last_clean":"2024-04-19T02:16:36.110191+0000","last_became_active":"2024-04-19T02:15:28.891300+0000","last_became_peered":"2024-04-19T02:15:28.891300+0000","last_unstale":"2024-04-19T02:16:36.110191+0000","last_undegraded":"2024-04-19T02:16:36.110191+0000","last_fullsized":"2024-04-19T02:16:36.110191+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.116300+0000","last_change":"2024-04-19T02:15:29.281694+0000","last_active":"2024-04-19T02:16:36.116300+0000","last_peered":"2024-04-19T02:16:36.116300+0000","last_clean":"2024-04-19T02:16:36.116300+0000","last_became_active":"2024-04-19T02:15:29.280519+0000","last_became_peered":"2024-04-19T02:15:29.280519+0000","last_unstale":"2024-04-19T02:16:36.116300+0000","last_undegraded":"2024-04-19T02:16:36.116300+0000","last_fullsized":"2024-04-19T02:16:36.116300+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:50.890545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"37'6069","reported_seq":10589,"reported_epoch":37,"state":"active+remapped+backfilling","last_fresh":"2024-04-19T02:16:37.777247+0000","last_change":"2024-04-19T02:16:30.103016+0000","last_active":"2024-04-19T02:16:37.777247+0000","last_peered":"2024-04-19T02:16:37.777247+0000","last_clean":"2024-04-19T02:16:22.050311+0000","last_became_active":"2024-04-19T02:16:24.119992+0000","last_became_peered":"2024-04-19T02:16:24.119992+0000","last_unstale":"2024-04-19T02:16:37.777247+0000","last_undegraded":"2024-04-19T02:16:37.777247+0000","last_fullsized":"2024-04-19T02:16:37.777247+0000","mapping_epoch":29,"log_start":"22'2437","ondisk_log_start":"22'2437","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3632,"log_dups_size":0,"ondisk_log_size":3632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:28.663111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":397737984,"num_objects":6069,"num_object_clones":0,"num_object_copies":12138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":3427,"num_objects_unfound":0,"num_objects_dirty":6069,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6069,"num_write_kb":388416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2240,"num_bytes_recovered":146800640,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[{"shards":"0,2","objects":6069}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109883+0000","last_change":"2024-04-19T02:15:28.891702+0000","last_active":"2024-04-19T02:16:36.109883+0000","last_peered":"2024-04-19T02:16:36.109883+0000","last_clean":"2024-04-19T02:16:36.109883+0000","last_became_active":"2024-04-19T02:15:28.890743+0000","last_became_peered":"2024-04-19T02:15:28.890743+0000","last_unstale":"2024-04-19T02:16:36.109883+0000","last_undegraded":"2024-04-19T02:16:36.109883+0000","last_fullsized":"2024-04-19T02:16:36.109883+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.110353+0000","last_change":"2024-04-19T02:15:24.526845+0000","last_active":"2024-04-19T02:16:36.110353+0000","last_peered":"2024-04-19T02:16:36.110353+0000","last_clean":"2024-04-19T02:16:36.110353+0000","last_became_active":"2024-04-19T02:15:24.526500+0000","last_became_peered":"2024-04-19T02:15:24.526500+0000","last_unstale":"2024-04-19T02:16:36.110353+0000","last_undegraded":"2024-04-19T02:16:36.110353+0000","last_fullsized":"2024-04-19T02:16:36.110353+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:16.883355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109192+0000","last_change":"2024-04-19T02:15:29.278686+0000","last_active":"2024-04-19T02:16:36.109192+0000","last_peered":"2024-04-19T02:16:36.109192+0000","last_clean":"2024-04-19T02:16:36.109192+0000","last_became_active":"2024-04-19T02:15:29.278108+0000","last_became_peered":"2024-04-19T02:15:29.278108+0000","last_unstale":"2024-04-19T02:16:36.109192+0000","last_undegraded":"2024-04-19T02:16:36.109192+0000","last_fullsized":"2024-04-19T02:16:36.109192+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:34.593754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"37'6135","reported_seq":6163,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-19T02:16:37.761370+0000","last_change":"2024-04-19T02:15:53.957269+0000","last_active":"2024-04-19T02:16:37.761370+0000","last_peered":"2024-04-19T02:16:37.761370+0000","last_clean":"2024-04-19T02:16:37.761370+0000","last_became_active":"2024-04-19T02:15:53.956554+0000","last_became_peered":"2024-04-19T02:15:53.956554+0000","last_unstale":"2024-04-19T02:16:37.761370+0000","last_undegraded":"2024-04-19T02:16:37.761370+0000","last_fullsized":"2024-04-19T02:16:37.761370+0000","mapping_epoch":16,"log_start":"22'2228","ondisk_log_start":"22'2228","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3907,"log_dups_size":0,"ondisk_log_size":3907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:29:38.789719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":402063360,"num_objects":6135,"num_object_clones":0,"num_object_copies":12270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6135,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6135,"num_write_kb":392640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119645+0000","last_change":"2024-04-19T02:15:24.533777+0000","last_active":"2024-04-19T02:16:36.119645+0000","last_peered":"2024-04-19T02:16:36.119645+0000","last_clean":"2024-04-19T02:16:36.119645+0000","last_became_active":"2024-04-19T02:15:24.533436+0000","last_became_peered":"2024-04-19T02:15:24.533436+0000","last_unstale":"2024-04-19T02:16:36.119645+0000","last_undegraded":"2024-04-19T02:16:36.119645+0000","last_fullsized":"2024-04-19T02:16:36.119645+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:53:25.922418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.110135+0000","last_change":"2024-04-19T02:15:28.891370+0000","last_active":"2024-04-19T02:16:36.110135+0000","last_peered":"2024-04-19T02:16:36.110135+0000","last_clean":"2024-04-19T02:16:36.110135+0000","last_became_active":"2024-04-19T02:15:28.890702+0000","last_became_peered":"2024-04-19T02:15:28.890702+0000","last_unstale":"2024-04-19T02:16:36.110135+0000","last_undegraded":"2024-04-19T02:16:36.110135+0000","last_fullsized":"2024-04-19T02:16:36.110135+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:33.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.114984+0000","last_change":"2024-04-19T02:15:29.282244+0000","last_active":"2024-04-19T02:16:36.114984+0000","last_peered":"2024-04-19T02:16:36.114984+0000","last_clean":"2024-04-19T02:16:36.114984+0000","last_became_active":"2024-04-19T02:15:29.280366+0000","last_became_peered":"2024-04-19T02:15:29.280366+0000","last_unstale":"2024-04-19T02:16:36.114984+0000","last_undegraded":"2024-04-19T02:16:36.114984+0000","last_fullsized":"2024-04-19T02:16:36.114984+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.116345+0000","last_change":"2024-04-19T02:15:28.893027+0000","last_active":"2024-04-19T02:16:36.116345+0000","last_peered":"2024-04-19T02:16:36.116345+0000","last_clean":"2024-04-19T02:16:36.116345+0000","last_became_active":"2024-04-19T02:15:28.892695+0000","last_became_peered":"2024-04-19T02:15:28.892695+0000","last_unstale":"2024-04-19T02:16:36.116345+0000","last_undegraded":"2024-04-19T02:16:36.116345+0000","last_fullsized":"2024-04-19T02:16:36.116345+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.115395+0000","last_change":"2024-04-19T02:15:29.283155+0000","last_active":"2024-04-19T02:16:36.115395+0000","last_peered":"2024-04-19T02:16:36.115395+0000","last_clean":"2024-04-19T02:16:36.115395+0000","last_became_active":"2024-04-19T02:15:29.281407+0000","last_became_peered":"2024-04-19T02:15:29.281407+0000","last_unstale":"2024-04-19T02:16:36.115395+0000","last_undegraded":"2024-04-19T02:16:36.115395+0000","last_fullsized":"2024-04-19T02:16:36.115395+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119328+0000","last_change":"2024-04-19T02:15:28.893067+0000","last_active":"2024-04-19T02:16:36.119328+0000","last_peered":"2024-04-19T02:16:36.119328+0000","last_clean":"2024-04-19T02:16:36.119328+0000","last_became_active":"2024-04-19T02:15:28.892781+0000","last_became_peered":"2024-04-19T02:15:28.892781+0000","last_unstale":"2024-04-19T02:16:36.119328+0000","last_undegraded":"2024-04-19T02:16:36.119328+0000","last_fullsized":"2024-04-19T02:16:36.119328+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:54:15.590143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118748+0000","last_change":"2024-04-19T02:15:29.281279+0000","last_active":"2024-04-19T02:16:36.118748+0000","last_peered":"2024-04-19T02:16:36.118748+0000","last_clean":"2024-04-19T02:16:36.118748+0000","last_became_active":"2024-04-19T02:15:29.279360+0000","last_became_peered":"2024-04-19T02:15:29.279360+0000","last_unstale":"2024-04-19T02:16:36.118748+0000","last_undegraded":"2024-04-19T02:16:36.118748+0000","last_fullsized":"2024-04-19T02:16:36.118748+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.115543+0000","last_change":"2024-04-19T02:15:28.893239+0000","last_active":"2024-04-19T02:16:36.115543+0000","last_peered":"2024-04-19T02:16:36.115543+0000","last_clean":"2024-04-19T02:16:36.115543+0000","last_became_active":"2024-04-19T02:15:28.892881+0000","last_became_peered":"2024-04-19T02:15:28.892881+0000","last_unstale":"2024-04-19T02:16:36.115543+0000","last_undegraded":"2024-04-19T02:16:36.115543+0000","last_fullsized":"2024-04-19T02:16:36.115543+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118723+0000","last_change":"2024-04-19T02:15:29.281652+0000","last_active":"2024-04-19T02:16:36.118723+0000","last_peered":"2024-04-19T02:16:36.118723+0000","last_clean":"2024-04-19T02:16:36.118723+0000","last_became_active":"2024-04-19T02:15:29.281175+0000","last_became_peered":"2024-04-19T02:15:29.281175+0000","last_unstale":"2024-04-19T02:16:36.118723+0000","last_undegraded":"2024-04-19T02:16:36.118723+0000","last_fullsized":"2024-04-19T02:16:36.118723+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:16.568764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.110437+0000","last_change":"2024-04-19T02:15:28.892058+0000","last_active":"2024-04-19T02:16:36.110437+0000","last_peered":"2024-04-19T02:16:36.110437+0000","last_clean":"2024-04-19T02:16:36.110437+0000","last_became_active":"2024-04-19T02:15:28.890877+0000","last_became_peered":"2024-04-19T02:15:28.890877+0000","last_unstale":"2024-04-19T02:16:36.110437+0000","last_undegraded":"2024-04-19T02:16:36.110437+0000","last_fullsized":"2024-04-19T02:16:36.110437+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:53.170180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.115287+0000","last_change":"2024-04-19T02:15:29.278810+0000","last_active":"2024-04-19T02:16:36.115287+0000","last_peered":"2024-04-19T02:16:36.115287+0000","last_clean":"2024-04-19T02:16:36.115287+0000","last_became_active":"2024-04-19T02:15:29.277913+0000","last_became_peered":"2024-04-19T02:15:29.277913+0000","last_unstale":"2024-04-19T02:16:36.115287+0000","last_undegraded":"2024-04-19T02:16:36.115287+0000","last_fullsized":"2024-04-19T02:16:36.115287+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:24.082666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.110394+0000","last_change":"2024-04-19T02:15:28.889132+0000","last_active":"2024-04-19T02:16:36.110394+0000","last_peered":"2024-04-19T02:16:36.110394+0000","last_clean":"2024-04-19T02:16:36.110394+0000","last_became_active":"2024-04-19T02:15:28.888926+0000","last_became_peered":"2024-04-19T02:15:28.888926+0000","last_unstale":"2024-04-19T02:16:36.110394+0000","last_undegraded":"2024-04-19T02:16:36.110394+0000","last_fullsized":"2024-04-19T02:16:36.110394+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118533+0000","last_change":"2024-04-19T02:15:29.282776+0000","last_active":"2024-04-19T02:16:36.118533+0000","last_peered":"2024-04-19T02:16:36.118533+0000","last_clean":"2024-04-19T02:16:36.118533+0000","last_became_active":"2024-04-19T02:15:29.279382+0000","last_became_peered":"2024-04-19T02:15:29.279382+0000","last_unstale":"2024-04-19T02:16:36.118533+0000","last_undegraded":"2024-04-19T02:16:36.118533+0000","last_fullsized":"2024-04-19T02:16:36.118533+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118462+0000","last_change":"2024-04-19T02:15:29.283537+0000","last_active":"2024-04-19T02:16:36.118462+0000","last_peered":"2024-04-19T02:16:36.118462+0000","last_clean":"2024-04-19T02:16:36.118462+0000","last_became_active":"2024-04-19T02:15:29.281801+0000","last_became_peered":"2024-04-19T02:15:29.281801+0000","last_unstale":"2024-04-19T02:16:36.118462+0000","last_undegraded":"2024-04-19T02:16:36.118462+0000","last_fullsized":"2024-04-19T02:16:36.118462+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109257+0000","last_change":"2024-04-19T02:15:29.281560+0000","last_active":"2024-04-19T02:16:36.109257+0000","last_peered":"2024-04-19T02:16:36.109257+0000","last_clean":"2024-04-19T02:16:36.109257+0000","last_became_active":"2024-04-19T02:15:29.281261+0000","last_became_peered":"2024-04-19T02:15:29.281261+0000","last_unstale":"2024-04-19T02:16:36.109257+0000","last_undegraded":"2024-04-19T02:16:36.109257+0000","last_fullsized":"2024-04-19T02:16:36.109257+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118440+0000","last_change":"2024-04-19T02:15:53.955913+0000","last_active":"2024-04-19T02:16:36.118440+0000","last_peered":"2024-04-19T02:16:36.118440+0000","last_clean":"2024-04-19T02:16:36.118440+0000","last_became_active":"2024-04-19T02:15:53.955676+0000","last_became_peered":"2024-04-19T02:15:53.955676+0000","last_unstale":"2024-04-19T02:16:36.118440+0000","last_undegraded":"2024-04-19T02:16:36.118440+0000","last_fullsized":"2024-04-19T02:16:36.118440+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:53:02.899902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109624+0000","last_change":"2024-04-19T02:15:29.278702+0000","last_active":"2024-04-19T02:16:36.109624+0000","last_peered":"2024-04-19T02:16:36.109624+0000","last_clean":"2024-04-19T02:16:36.109624+0000","last_became_active":"2024-04-19T02:15:29.277756+0000","last_became_peered":"2024-04-19T02:15:29.277756+0000","last_unstale":"2024-04-19T02:16:36.109624+0000","last_undegraded":"2024-04-19T02:16:36.109624+0000","last_fullsized":"2024-04-19T02:16:36.109624+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.115452+0000","last_change":"2024-04-19T02:15:29.277568+0000","last_active":"2024-04-19T02:16:36.115452+0000","last_peered":"2024-04-19T02:16:36.115452+0000","last_clean":"2024-04-19T02:16:36.115452+0000","last_became_active":"2024-04-19T02:15:29.276725+0000","last_became_peered":"2024-04-19T02:15:29.276725+0000","last_unstale":"2024-04-19T02:16:36.115452+0000","last_undegraded":"2024-04-19T02:16:36.115452+0000","last_fullsized":"2024-04-19T02:16:36.115452+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":6535839744,"num_objects":99729,"num_object_clones":0,"num_object_copies":199458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":3427,"num_objects_unfound":0,"num_objects_dirty":99729,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99729,"num_write_kb":6382656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2240,"num_bytes_recovered":146800640,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":13244956672,"data_stored":13244956672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60028,"ondisk_log_size":60028,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738385,"num_pgs":84,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5253660,"kb_used_data":5128208,"kb_used_omap":1,"kb_used_meta":125438,"kb_avail":89118180,"statfs":{"total":96636764160,"available":91257016320,"internally_reserved":0,"allocated":5251284992,"data_stored":5251024944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":128448966},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.313,"15min":0.313},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.497,"5min":0.497,"15min":0.497},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":1.8200000000000001}]},{"osd":1,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.36499999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738386,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4054592,"kb_used_data":3951276,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":90317248,"statfs":{"total":96636764160,"available":92484861952,"internally_reserved":0,"allocated":4046106624,"data_stored":4045820194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":105773510},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.17699999999999999},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.24099999999999999}]},{"osd":2,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":2.1000000000000001,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":0.19},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.22700000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738385,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3860856,"kb_used_data":3761636,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":90510984,"statfs":{"total":96636764160,"available":92683247616,"internally_reserved":0,"allocated":3851915264,"data_stored":3851636410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":101579206},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,3,0,2,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:16:26 2024","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.19},{"interface":"front","average":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"min":{"1min":0.16,"5min":0.16,"15min":0.16},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.254}]},{"osd":2,"last update":"Fri Apr 19 02:16:26 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.22700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4092657664,"data_stored":4092657664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3852468224,"data_stored":3852468224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5299830784,"data_stored":5299830784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:16:38.791 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:38.792+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:38.811 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:38.812 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:38.826 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:16:38.893 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:38.893+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:38.994 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:38.994+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:39.012 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:39.012 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:39.023 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:16:39.029 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 44 16 102054 102038 144.928 117.75 0.0149246 0.00689697 2024-04-19T02:16:39.074 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:16:39.094 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:39.094+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:39.195 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:39.195+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:39.226 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:16:39.246 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:16:39.247 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:39.247 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:39.262 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:16:39.266 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2: {} 2024-04-19T02:16:39.267 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:16:39.267 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:16:39.268 INFO:teuthology.orchestra.run.smithi121.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:16:39.306 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:39.306+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:39.397 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:39.397+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:39.439 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:16:39.440 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:16:39.440 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.440 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:102845 5.2 5:49268b73:::benchmark_data_smithi121_44835_object102844:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T02:16:39.440 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:39.435309+0000", 2024-04-19T02:16:39.440 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0050070490000000004, 2024-04-19T02:16:39.440 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.005029342, 2024-04-19T02:16:39.440 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:39.440 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:39.440 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:39.440 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:39.440 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:39.440 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 102845 2024-04-19T02:16:39.440 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.441 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:39.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.441 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:39.441 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.435309+0000", 2024-04-19T02:16:39.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:39.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.441 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:39.441 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.435309+0000", 2024-04-19T02:16:39.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:39.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.441 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:39.441 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.435309+0000", 2024-04-19T02:16:39.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:39.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.442 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:39.442 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.435406+0000", 2024-04-19T02:16:39.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7504999999999996e-05 2024-04-19T02:16:39.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.442 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:39.442 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.435414+0000", 2024-04-19T02:16:39.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9449999999999993e-06 2024-04-19T02:16:39.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.443 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:39.443 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.435420+0000", 2024-04-19T02:16:39.443 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2680000000000002e-06 2024-04-19T02:16:39.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.443 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:39.443 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.435449+0000", 2024-04-19T02:16:39.443 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9201e-05 2024-04-19T02:16:39.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.443 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:39.443 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.435556+0000", 2024-04-19T02:16:39.443 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107093 2024-04-19T02:16:39.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.444 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:39.444 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.435692+0000", 2024-04-19T02:16:39.444 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013661000000000001 2024-04-19T02:16:39.444 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.444 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.444 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:39.444 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.438083+0000", 2024-04-19T02:16:39.444 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0023904289999999999 2024-04-19T02:16:39.444 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.444 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:39.444 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.444 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.444 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.444 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:102847 5.9 5:9de4e4a9:::benchmark_data_smithi121_44835_object102846:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T02:16:39.445 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:39.435426+0000", 2024-04-19T02:16:39.445 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0048900539999999996, 2024-04-19T02:16:39.445 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0049928009999999998, 2024-04-19T02:16:39.445 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:39.445 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:39.445 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:39.445 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:39.445 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:39.445 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 102847 2024-04-19T02:16:39.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.445 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:39.445 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.445 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:39.445 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.435426+0000", 2024-04-19T02:16:39.446 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:39.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.446 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:39.446 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.435426+0000", 2024-04-19T02:16:39.446 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:39.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.446 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:39.446 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.435426+0000", 2024-04-19T02:16:39.446 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:39.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.446 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:39.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.435522+0000", 2024-04-19T02:16:39.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6401000000000001e-05 2024-04-19T02:16:39.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:39.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.435530+0000", 2024-04-19T02:16:39.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4970000000000004e-06 2024-04-19T02:16:39.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:39.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.435536+0000", 2024-04-19T02:16:39.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0859999999999998e-06 2024-04-19T02:16:39.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:39.448 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.435590+0000", 2024-04-19T02:16:39.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4154999999999999e-05 2024-04-19T02:16:39.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.448 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:39.448 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.435699+0000", 2024-04-19T02:16:39.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010832600000000001 2024-04-19T02:16:39.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.448 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:39.448 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.435832+0000", 2024-04-19T02:16:39.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000133213 2024-04-19T02:16:39.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.448 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:39.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.438802+0000", 2024-04-19T02:16:39.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0029706310000000001 2024-04-19T02:16:39.449 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.449 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:39.449 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.449 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:102850 5.d 5:b73c5b7c:::benchmark_data_smithi121_44835_object102849:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T02:16:39.449 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:39.435544+0000", 2024-04-19T02:16:39.449 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0047728529999999996, 2024-04-19T02:16:39.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.004936167, 2024-04-19T02:16:39.449 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:39.449 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:39.449 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:39.449 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:39.450 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:39.450 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 102850 2024-04-19T02:16:39.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.450 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:39.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.450 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:39.450 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.435544+0000", 2024-04-19T02:16:39.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:39.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.450 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:39.450 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.435544+0000", 2024-04-19T02:16:39.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:39.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.451 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:39.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.435543+0000", 2024-04-19T02:16:39.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:39.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.451 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:39.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.435643+0000", 2024-04-19T02:16:39.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9599000000000006e-05 2024-04-19T02:16:39.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.451 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:39.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.435651+0000", 2024-04-19T02:16:39.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7790000000000001e-06 2024-04-19T02:16:39.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:39.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.435658+0000", 2024-04-19T02:16:39.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1149999999999996e-06 2024-04-19T02:16:39.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:39.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.435691+0000", 2024-04-19T02:16:39.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2396e-05 2024-04-19T02:16:39.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:39.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.435794+0000", 2024-04-19T02:16:39.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000103599 2024-04-19T02:16:39.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:39.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.435878+0000", 2024-04-19T02:16:39.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3157000000000004e-05 2024-04-19T02:16:39.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:39.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.439348+0000", 2024-04-19T02:16:39.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0034698950000000002 2024-04-19T02:16:39.453 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.453 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:39.453 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.454 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:102852 5.d 5:bd4b3273:::benchmark_data_smithi121_44835_object102851:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T02:16:39.454 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:39.435694+0000", 2024-04-19T02:16:39.454 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0046223150000000001, 2024-04-19T02:16:39.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0048479839999999996, 2024-04-19T02:16:39.454 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:39.454 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:39.454 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:39.454 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:39.454 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:39.454 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 102852 2024-04-19T02:16:39.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.455 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:39.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:39.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.435694+0000", 2024-04-19T02:16:39.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:39.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:39.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.435694+0000", 2024-04-19T02:16:39.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:39.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:39.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.435694+0000", 2024-04-19T02:16:39.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:39.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:39.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.435758+0000", 2024-04-19T02:16:39.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4930000000000003e-05 2024-04-19T02:16:39.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:39.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.435766+0000", 2024-04-19T02:16:39.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5909999999999998e-06 2024-04-19T02:16:39.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:39.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.435771+0000", 2024-04-19T02:16:39.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5469999999999998e-06 2024-04-19T02:16:39.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:39.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.437859+0000", 2024-04-19T02:16:39.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020888870000000002 2024-04-19T02:16:39.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:39.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.437950+0000", 2024-04-19T02:16:39.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0551999999999996e-05 2024-04-19T02:16:39.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:39.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.438037+0000", 2024-04-19T02:16:39.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7145999999999995e-05 2024-04-19T02:16:39.458 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.458 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:39.458 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.439871+0000", 2024-04-19T02:16:39.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001833349 2024-04-19T02:16:39.458 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.458 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:39.458 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.458 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.458 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4549.0:102854 5.3 e38/16 5:c7fdf5c7:::benchmark_data_smithi121_44835_object102853:head v 38'6490, mlcod=38'6486)", 2024-04-19T02:16:39.458 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:39.438526+0000", 2024-04-19T02:16:39.459 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.001790954, 2024-04-19T02:16:39.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00209647, 2024-04-19T02:16:39.459 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:39.459 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:16:39.459 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:39.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:39.459 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.438526+0000", 2024-04-19T02:16:39.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:39.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:39.459 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.438526+0000", 2024-04-19T02:16:39.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:39.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:39.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.438525+0000", 2024-04-19T02:16:39.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:39.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:39.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.438598+0000", 2024-04-19T02:16:39.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2738999999999996e-05 2024-04-19T02:16:39.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:39.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.438604+0000", 2024-04-19T02:16:39.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4640000000000003e-06 2024-04-19T02:16:39.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:39.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.438610+0000", 2024-04-19T02:16:39.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7069999999999997e-06 2024-04-19T02:16:39.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:39.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.438644+0000", 2024-04-19T02:16:39.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4140000000000002e-05 2024-04-19T02:16:39.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:39.462 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.438661+0000", 2024-04-19T02:16:39.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6697e-05 2024-04-19T02:16:39.462 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.462 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:39.462 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.462 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4549.0:102849 5.c e38/16 5:32e30ef9:::benchmark_data_smithi121_44835_object102848:head v 38'6426, mlcod=38'6423)", 2024-04-19T02:16:39.462 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:39.439947+0000", 2024-04-19T02:16:39.462 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00036973600000000001, 2024-04-19T02:16:39.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000714227, 2024-04-19T02:16:39.462 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:39.462 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:16:39.462 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:39.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.463 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:39.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.439947+0000", 2024-04-19T02:16:39.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:39.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.463 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:39.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.439947+0000", 2024-04-19T02:16:39.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:39.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.463 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:39.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.439946+0000", 2024-04-19T02:16:39.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:39.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:39.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.440005+0000", 2024-04-19T02:16:39.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8687000000000002e-05 2024-04-19T02:16:39.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:39.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.440014+0000", 2024-04-19T02:16:39.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6610000000000006e-06 2024-04-19T02:16:39.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:39.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.440019+0000", 2024-04-19T02:16:39.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6269999999999997e-06 2024-04-19T02:16:39.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:39.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.440042+0000", 2024-04-19T02:16:39.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2909999999999999e-05 2024-04-19T02:16:39.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:39.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:39.440054+0000", 2024-04-19T02:16:39.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2079000000000001e-05 2024-04-19T02:16:39.465 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.465 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:39.465 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.466 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.466 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-04-19T02:16:39.466 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 6 2024-04-19T02:16:39.466 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:16:39.467 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:16:39.498 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:39.498+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:39.599 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:39.599+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:39.669 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:16:39.669 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-04-19T02:16:39.669 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-04-19T02:16:39.669 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-04-19T02:16:39.669 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:16:39.681 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:16:39.725 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:39.725+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:39.801 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:39.801+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:39.855 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:16:39.855 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-04-19T02:16:39.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-04-19T02:16:39.855 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:16:39.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.855 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:39.855 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:16:39.855 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 70.584186614999993, 2024-04-19T02:16:39.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020307345000000001, 2024-04-19T02:16:39.856 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:39.856 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:39.856 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:39.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:39.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:16:39.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:39.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:39.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:16:39.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:39.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:39.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269791+0000", 2024-04-19T02:16:39.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:39.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:39.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269795+0000", 2024-04-19T02:16:39.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5619999999999999e-06 2024-04-19T02:16:39.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:39.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269802+0000", 2024-04-19T02:16:39.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8469999999999998e-06 2024-04-19T02:16:39.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:39.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269807+0000", 2024-04-19T02:16:39.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.707e-06 2024-04-19T02:16:39.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:39.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269950+0000", 2024-04-19T02:16:39.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000143313 2024-04-19T02:16:39.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:39.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269955+0000", 2024-04-19T02:16:39.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4029999999999998e-06 2024-04-19T02:16:39.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:39.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.283806+0000", 2024-04-19T02:16:39.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013850220999999999 2024-04-19T02:16:39.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:39.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.283896+0000", 2024-04-19T02:16:39.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0261999999999997e-05 2024-04-19T02:16:39.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:39.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284022+0000", 2024-04-19T02:16:39.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012641200000000001 2024-04-19T02:16:39.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:39.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289066+0000", 2024-04-19T02:16:39.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050438490000000004 2024-04-19T02:16:39.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:39.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290011+0000", 2024-04-19T02:16:39.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00094490700000000004 2024-04-19T02:16:39.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:39.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290054+0000", 2024-04-19T02:16:39.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.337e-05 2024-04-19T02:16:39.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:39.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290099+0000", 2024-04-19T02:16:39.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4987999999999997e-05 2024-04-19T02:16:39.861 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.861 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:39.861 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.861 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:39.861 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:16:39.861 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 70.584108685000004, 2024-04-19T02:16:39.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020331023, 2024-04-19T02:16:39.861 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:39.862 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:39.862 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:39.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:39.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:16:39.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:39.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:39.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:16:39.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:39.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:39.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269869+0000", 2024-04-19T02:16:39.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:39.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.863 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:39.863 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269873+0000", 2024-04-19T02:16:39.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0219999999999998e-06 2024-04-19T02:16:39.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.863 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:39.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269881+0000", 2024-04-19T02:16:39.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.79e-06 2024-04-19T02:16:39.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:39.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269887+0000", 2024-04-19T02:16:39.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7899999999999996e-06 2024-04-19T02:16:39.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:39.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269983+0000", 2024-04-19T02:16:39.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6057000000000005e-05 2024-04-19T02:16:39.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:39.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269986+0000", 2024-04-19T02:16:39.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9220000000000001e-06 2024-04-19T02:16:39.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:39.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284350+0000", 2024-04-19T02:16:39.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014364335000000001 2024-04-19T02:16:39.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:39.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284664+0000", 2024-04-19T02:16:39.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000313646 2024-04-19T02:16:39.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:39.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284794+0000", 2024-04-19T02:16:39.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129839 2024-04-19T02:16:39.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:39.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289107+0000", 2024-04-19T02:16:39.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0043127060000000004 2024-04-19T02:16:39.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:39.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290108+0000", 2024-04-19T02:16:39.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0010010590000000001 2024-04-19T02:16:39.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:39.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290144+0000", 2024-04-19T02:16:39.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6709999999999999e-05 2024-04-19T02:16:39.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.867 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:39.867 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290201+0000", 2024-04-19T02:16:39.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6654999999999999e-05 2024-04-19T02:16:39.867 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.867 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:39.867 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.867 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:39.867 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:16:39.867 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 70.584066344000007, 2024-04-19T02:16:39.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020507241999999998, 2024-04-19T02:16:39.868 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:39.868 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:39.868 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:39.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:39.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:16:39.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:39.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:39.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:16:39.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:39.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:39.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:16:39.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:39.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:39.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269915+0000", 2024-04-19T02:16:39.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.472e-06 2024-04-19T02:16:39.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:39.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269928+0000", 2024-04-19T02:16:39.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2979000000000001e-05 2024-04-19T02:16:39.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:39.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269935+0000", 2024-04-19T02:16:39.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8859999999999998e-06 2024-04-19T02:16:39.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:39.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270009+0000", 2024-04-19T02:16:39.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3429000000000005e-05 2024-04-19T02:16:39.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:39.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270013+0000", 2024-04-19T02:16:39.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2590000000000002e-06 2024-04-19T02:16:39.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:39.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285375+0000", 2024-04-19T02:16:39.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015362275999999999 2024-04-19T02:16:39.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:39.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285451+0000", 2024-04-19T02:16:39.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5338000000000003e-05 2024-04-19T02:16:39.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:39.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285562+0000", 2024-04-19T02:16:39.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000111285 2024-04-19T02:16:39.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:39.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289134+0000", 2024-04-19T02:16:39.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035719670000000001 2024-04-19T02:16:39.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:39.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290341+0000", 2024-04-19T02:16:39.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012074500000000001 2024-04-19T02:16:39.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:39.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290383+0000", 2024-04-19T02:16:39.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1386e-05 2024-04-19T02:16:39.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:39.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290419+0000", 2024-04-19T02:16:39.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6884000000000001e-05 2024-04-19T02:16:39.873 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.873 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:39.873 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.873 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:39.873 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269945+0000", 2024-04-19T02:16:39.873 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 70.584033762000004, 2024-04-19T02:16:39.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019709098000000001, 2024-04-19T02:16:39.873 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:39.873 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:39.873 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:39.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.873 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:39.873 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269945+0000", 2024-04-19T02:16:39.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:39.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:39.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269945+0000", 2024-04-19T02:16:39.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:39.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:39.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269944+0000", 2024-04-19T02:16:39.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:39.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:39.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269965+0000", 2024-04-19T02:16:39.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0803999999999999e-05 2024-04-19T02:16:39.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:39.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269973+0000", 2024-04-19T02:16:39.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3560000000000004e-06 2024-04-19T02:16:39.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:39.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269982+0000", 2024-04-19T02:16:39.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9600000000000006e-06 2024-04-19T02:16:39.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:39.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270014+0000", 2024-04-19T02:16:39.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2913000000000001e-05 2024-04-19T02:16:39.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.876 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:39.876 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270018+0000", 2024-04-19T02:16:39.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2200000000000001e-06 2024-04-19T02:16:39.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.876 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:39.876 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278999+0000", 2024-04-19T02:16:39.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0089818009999999993 2024-04-19T02:16:39.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.876 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:39.876 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.279088+0000", 2024-04-19T02:16:39.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8988999999999998e-05 2024-04-19T02:16:39.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:39.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.280160+0000", 2024-04-19T02:16:39.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001071572 2024-04-19T02:16:39.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:39.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288342+0000", 2024-04-19T02:16:39.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.008182468 2024-04-19T02:16:39.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:39.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289545+0000", 2024-04-19T02:16:39.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012026739999999999 2024-04-19T02:16:39.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.878 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:39.878 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289608+0000", 2024-04-19T02:16:39.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2904999999999995e-05 2024-04-19T02:16:39.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.878 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:39.878 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289654+0000", 2024-04-19T02:16:39.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5850000000000003e-05 2024-04-19T02:16:39.878 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.878 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:39.878 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.879 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:39.879 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:16:39.879 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 70.583988083999998, 2024-04-19T02:16:39.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022007204999999998, 2024-04-19T02:16:39.879 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:39.879 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:39.879 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:39.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.879 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:39.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:16:39.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:39.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.879 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:39.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:16:39.880 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:39.880 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.880 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.880 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:39.880 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269990+0000", 2024-04-19T02:16:39.880 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:39.880 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.880 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.880 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:39.880 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269999+0000", 2024-04-19T02:16:39.880 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9539999999999993e-06 2024-04-19T02:16:39.881 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.881 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.881 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:39.881 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270006+0000", 2024-04-19T02:16:39.882 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.216e-06 2024-04-19T02:16:39.882 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.882 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.882 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:39.882 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270012+0000", 2024-04-19T02:16:39.882 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5049999999999998e-06 2024-04-19T02:16:39.882 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.882 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.882 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:39.882 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270058+0000", 2024-04-19T02:16:39.882 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.634e-05 2024-04-19T02:16:39.882 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.882 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:39.883 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270064+0000", 2024-04-19T02:16:39.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0669999999999997e-06 2024-04-19T02:16:39.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:39.883 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287159+0000", 2024-04-19T02:16:39.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017095086999999998 2024-04-19T02:16:39.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:39.883 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287254+0000", 2024-04-19T02:16:39.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4716000000000006e-05 2024-04-19T02:16:39.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.884 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:39.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287389+0000", 2024-04-19T02:16:39.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013511900000000001 2024-04-19T02:16:39.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.884 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:39.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290481+0000", 2024-04-19T02:16:39.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030920169999999999 2024-04-19T02:16:39.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.884 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:39.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291931+0000", 2024-04-19T02:16:39.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001450118 2024-04-19T02:16:39.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.885 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:39.885 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291960+0000", 2024-04-19T02:16:39.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9096000000000001e-05 2024-04-19T02:16:39.885 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.885 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:39.885 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291998+0000", 2024-04-19T02:16:39.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7514e-05 2024-04-19T02:16:39.885 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.885 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:39.885 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.885 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.885 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:39.886 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:39.886 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 70.583927513000006, 2024-04-19T02:16:39.886 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020759494999999999, 2024-04-19T02:16:39.886 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:39.886 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:39.886 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:39.886 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.886 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:39.886 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:39.886 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:39.886 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.886 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.886 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:39.886 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:39.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:39.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:39.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:39.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:39.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:39.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270054+0000", 2024-04-19T02:16:39.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.27e-06 2024-04-19T02:16:39.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:39.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270061+0000", 2024-04-19T02:16:39.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1289999999999998e-06 2024-04-19T02:16:39.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.888 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:39.888 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270067+0000", 2024-04-19T02:16:39.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.207e-06 2024-04-19T02:16:39.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.888 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:39.888 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270105+0000", 2024-04-19T02:16:39.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7549999999999998e-05 2024-04-19T02:16:39.889 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.889 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.889 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:39.889 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270112+0000", 2024-04-19T02:16:39.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3200000000000002e-06 2024-04-19T02:16:39.889 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.889 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.889 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:39.889 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282454+0000", 2024-04-19T02:16:39.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012341569 2024-04-19T02:16:39.889 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.889 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.889 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:39.889 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282740+0000", 2024-04-19T02:16:39.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000286481 2024-04-19T02:16:39.890 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.890 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:39.890 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282879+0000", 2024-04-19T02:16:39.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013887799999999999 2024-04-19T02:16:39.890 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.890 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:39.890 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290325+0000", 2024-04-19T02:16:39.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074459779999999998 2024-04-19T02:16:39.890 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.890 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:39.890 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290759+0000", 2024-04-19T02:16:39.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000433688 2024-04-19T02:16:39.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:39.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290789+0000", 2024-04-19T02:16:39.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9960000000000001e-05 2024-04-19T02:16:39.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:39.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290811+0000", 2024-04-19T02:16:39.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1965999999999999e-05 2024-04-19T02:16:39.891 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.891 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:39.891 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.891 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:39.892 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:16:39.892 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 70.583877307999998, 2024-04-19T02:16:39.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020837887999999999, 2024-04-19T02:16:39.892 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:39.892 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:39.892 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:39.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:39.892 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:16:39.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:39.892 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:39.892 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:16:39.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:39.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.893 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:39.893 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:16:39.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:39.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.893 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:39.893 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270109+0000", 2024-04-19T02:16:39.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3110000000000006e-06 2024-04-19T02:16:39.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.893 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:39.893 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270117+0000", 2024-04-19T02:16:39.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0479999999999999e-06 2024-04-19T02:16:39.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.894 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:39.894 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270123+0000", 2024-04-19T02:16:39.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5500000000000002e-06 2024-04-19T02:16:39.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.894 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:39.894 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270150+0000", 2024-04-19T02:16:39.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7712000000000002e-05 2024-04-19T02:16:39.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.894 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:39.894 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270153+0000", 2024-04-19T02:16:39.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6089999999999999e-06 2024-04-19T02:16:39.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:39.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285958+0000", 2024-04-19T02:16:39.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015805274000000001 2024-04-19T02:16:39.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:39.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286126+0000", 2024-04-19T02:16:39.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016765700000000001 2024-04-19T02:16:39.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:39.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286296+0000", 2024-04-19T02:16:39.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017007 2024-04-19T02:16:39.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:39.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290426+0000", 2024-04-19T02:16:39.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041299839999999997 2024-04-19T02:16:39.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:39.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290867+0000", 2024-04-19T02:16:39.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00044083300000000001 2024-04-19T02:16:39.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:39.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290900+0000", 2024-04-19T02:16:39.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3380000000000002e-05 2024-04-19T02:16:39.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:39.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290939+0000", 2024-04-19T02:16:39.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8970000000000001e-05 2024-04-19T02:16:39.897 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.897 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:39.897 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.897 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:21 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:39.897 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:16:39.897 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 70.583788635999994, 2024-04-19T02:16:39.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020833187999999999, 2024-04-19T02:16:39.898 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:39.898 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:16:39.898 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:39.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.898 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:39.898 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:16:39.898 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:39.898 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.898 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:39.898 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:16:39.898 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:39.898 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.898 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:39.899 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270189+0000", 2024-04-19T02:16:39.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:39.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.899 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:39.899 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270192+0000", 2024-04-19T02:16:39.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7549999999999999e-06 2024-04-19T02:16:39.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.899 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:39.899 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270198+0000", 2024-04-19T02:16:39.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0859999999999998e-06 2024-04-19T02:16:39.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:39.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270204+0000", 2024-04-19T02:16:39.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1970000000000004e-06 2024-04-19T02:16:39.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:39.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270238+0000", 2024-04-19T02:16:39.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4282000000000001e-05 2024-04-19T02:16:39.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:39.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270240+0000", 2024-04-19T02:16:39.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3099999999999999e-06 2024-04-19T02:16:39.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:39.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287131+0000", 2024-04-19T02:16:39.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01689104 2024-04-19T02:16:39.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:39.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287262+0000", 2024-04-19T02:16:39.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130347 2024-04-19T02:16:39.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:39.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291023+0000", 2024-04-19T02:16:39.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037616350000000002 2024-04-19T02:16:39.901 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.901 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:39.902 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.902 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:16494 5.7 5:e2c19dca:::benchmark_data_smithi121_44835_object16493:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:39.902 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.871684+0000", 2024-04-19T02:16:39.902 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 39.982294981000003, 2024-04-19T02:16:39.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019343257999999999, 2024-04-19T02:16:39.902 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:39.902 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:39.902 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:39.902 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:39.902 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:39.902 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16494 2024-04-19T02:16:39.903 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.903 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:39.903 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.903 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:39.903 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871684+0000", 2024-04-19T02:16:39.903 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:39.903 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.903 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.903 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:39.903 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871684+0000", 2024-04-19T02:16:39.903 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:39.903 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.903 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.903 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:39.903 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871683+0000", 2024-04-19T02:16:39.904 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:39.904 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.904 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.904 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:39.904 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871762+0000", 2024-04-19T02:16:39.904 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8981999999999997e-05 2024-04-19T02:16:39.904 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.904 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.904 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:39.904 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871770+0000", 2024-04-19T02:16:39.904 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7060000000000004e-06 2024-04-19T02:16:39.904 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.904 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.904 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:39.905 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871776+0000", 2024-04-19T02:16:39.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4880000000000004e-06 2024-04-19T02:16:39.905 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.905 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.905 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:39.905 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.874098+0000", 2024-04-19T02:16:39.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0023215309999999999 2024-04-19T02:16:39.905 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.905 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.905 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:39.905 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.874245+0000", 2024-04-19T02:16:39.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014735599999999999 2024-04-19T02:16:39.905 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.905 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.906 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:39.906 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.874394+0000", 2024-04-19T02:16:39.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014848300000000001 2024-04-19T02:16:39.906 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.906 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:39.906 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.876474+0000", 2024-04-19T02:16:39.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020803060000000001 2024-04-19T02:16:39.906 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.906 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:39.906 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.890939+0000", 2024-04-19T02:16:39.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014464985 2024-04-19T02:16:39.906 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.907 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.907 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:39.907 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.890986+0000", 2024-04-19T02:16:39.907 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7321000000000003e-05 2024-04-19T02:16:39.907 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.907 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.907 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:39.907 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891027+0000", 2024-04-19T02:16:39.907 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0689999999999998e-05 2024-04-19T02:16:39.907 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.907 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:39.907 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.907 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.907 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.907 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:16519 5.f 5:fc30d3a1:::benchmark_data_smithi121_44835_object16518:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:39.908 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.880723+0000", 2024-04-19T02:16:39.908 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 39.973255858000002, 2024-04-19T02:16:39.908 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020492519000000001, 2024-04-19T02:16:39.908 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:39.908 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:39.908 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:39.908 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:39.908 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:39.908 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16519 2024-04-19T02:16:39.908 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.908 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:39.908 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.908 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:39.908 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880723+0000", 2024-04-19T02:16:39.909 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:39.909 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.909 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.909 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:39.909 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880723+0000", 2024-04-19T02:16:39.909 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:39.909 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.909 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.909 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:39.909 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880722+0000", 2024-04-19T02:16:39.909 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:39.909 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.909 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.909 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:39.910 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880794+0000", 2024-04-19T02:16:39.910 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1515999999999998e-05 2024-04-19T02:16:39.910 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.910 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.910 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:39.910 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880805+0000", 2024-04-19T02:16:39.910 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1353e-05 2024-04-19T02:16:39.910 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.910 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.910 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:39.910 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880812+0000", 2024-04-19T02:16:39.910 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1230000000000002e-06 2024-04-19T02:16:39.910 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.910 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.911 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:39.911 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.890954+0000", 2024-04-19T02:16:39.911 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010142253 2024-04-19T02:16:39.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.911 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:39.911 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891079+0000", 2024-04-19T02:16:39.911 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000124917 2024-04-19T02:16:39.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.911 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:39.911 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891218+0000", 2024-04-19T02:16:39.911 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000138715 2024-04-19T02:16:39.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.912 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.912 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:39.912 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.897321+0000", 2024-04-19T02:16:39.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0061026830000000002 2024-04-19T02:16:39.912 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.912 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.912 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:39.912 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901137+0000", 2024-04-19T02:16:39.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038161699999999998 2024-04-19T02:16:39.912 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.912 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.912 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:39.912 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901181+0000", 2024-04-19T02:16:39.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4362e-05 2024-04-19T02:16:39.912 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.913 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.913 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:39.913 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901215+0000", 2024-04-19T02:16:39.913 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3929e-05 2024-04-19T02:16:39.913 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.913 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:39.913 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.913 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.913 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.913 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:16520 5.f 5:f0474691:::benchmark_data_smithi121_44835_object16519:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:39.913 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.880833+0000", 2024-04-19T02:16:39.913 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 39.973145842999998, 2024-04-19T02:16:39.913 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020460160000000002, 2024-04-19T02:16:39.913 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:39.913 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:39.914 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:39.914 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:39.914 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:39.914 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16520 2024-04-19T02:16:39.914 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.914 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:39.914 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.914 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:39.914 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880833+0000", 2024-04-19T02:16:39.914 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:39.914 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.914 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.914 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:39.914 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880833+0000", 2024-04-19T02:16:39.914 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:39.915 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.915 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.915 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:39.915 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880832+0000", 2024-04-19T02:16:39.915 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:39.915 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.915 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.915 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:39.915 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880909+0000", 2024-04-19T02:16:39.915 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7095000000000006e-05 2024-04-19T02:16:39.915 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.915 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.915 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:39.915 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880919+0000", 2024-04-19T02:16:39.915 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8919999999999995e-06 2024-04-19T02:16:39.916 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.916 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.916 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:39.916 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880927+0000", 2024-04-19T02:16:39.916 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8809999999999996e-06 2024-04-19T02:16:39.916 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.916 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.916 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:39.916 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891901+0000", 2024-04-19T02:16:39.916 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010974263999999999 2024-04-19T02:16:39.916 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.916 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.916 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:39.916 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.892021+0000", 2024-04-19T02:16:39.916 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120074 2024-04-19T02:16:39.917 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.917 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.917 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:39.917 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.892165+0000", 2024-04-19T02:16:39.917 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014328600000000001 2024-04-19T02:16:39.917 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.917 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.917 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:39.917 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.897347+0000", 2024-04-19T02:16:39.917 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.005182603 2024-04-19T02:16:39.917 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.917 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.917 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:39.917 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901224+0000", 2024-04-19T02:16:39.917 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038767620000000002 2024-04-19T02:16:39.917 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.918 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.918 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:39.918 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901264+0000", 2024-04-19T02:16:39.918 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9579000000000002e-05 2024-04-19T02:16:39.918 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.918 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.918 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:39.918 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901293+0000", 2024-04-19T02:16:39.918 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9300999999999999e-05 2024-04-19T02:16:39.918 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.918 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:39.918 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.918 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.918 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.919 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:44167 5.7 5:ef4300c4:::benchmark_data_smithi121_44835_object44166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:39.919 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:09.853830+0000", 2024-04-19T02:16:39.919 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.000148359000001, 2024-04-19T02:16:39.919 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020082104, 2024-04-19T02:16:39.919 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:39.919 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:39.919 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:39.919 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:39.919 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:39.919 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 44167 2024-04-19T02:16:39.919 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.919 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:39.919 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.919 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:39.919 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853830+0000", 2024-04-19T02:16:39.919 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:39.920 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.920 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.920 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:39.920 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853830+0000", 2024-04-19T02:16:39.920 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:39.920 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.920 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.920 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:39.920 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853829+0000", 2024-04-19T02:16:39.920 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:39.920 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.920 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.920 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:39.920 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853863+0000", 2024-04-19T02:16:39.920 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3151999999999997e-05 2024-04-19T02:16:39.921 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.921 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.921 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:39.921 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853873+0000", 2024-04-19T02:16:39.921 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0366e-05 2024-04-19T02:16:39.921 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.921 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.921 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:39.921 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853881+0000", 2024-04-19T02:16:39.921 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6539999999999999e-06 2024-04-19T02:16:39.921 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.921 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.921 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:39.921 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.859162+0000", 2024-04-19T02:16:39.922 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052810740000000002 2024-04-19T02:16:39.922 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.922 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.922 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:39.922 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.859303+0000", 2024-04-19T02:16:39.922 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000140975 2024-04-19T02:16:39.922 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.922 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.922 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:39.922 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.859460+0000", 2024-04-19T02:16:39.922 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015754199999999999 2024-04-19T02:16:39.922 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.922 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.922 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:39.922 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.865142+0000", 2024-04-19T02:16:39.923 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0056819130000000002 2024-04-19T02:16:39.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.923 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.923 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:39.923 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.873828+0000", 2024-04-19T02:16:39.923 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0086861799999999999 2024-04-19T02:16:39.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.923 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.923 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:39.923 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.873871+0000", 2024-04-19T02:16:39.923 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2624999999999999e-05 2024-04-19T02:16:39.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.923 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.923 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:39.923 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.873912+0000", 2024-04-19T02:16:39.924 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1486000000000002e-05 2024-04-19T02:16:39.924 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.924 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:39.924 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.924 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.924 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.924 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:53042 5.f 5:f744ac14:::benchmark_data_smithi121_44835_object53041:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T02:16:39.924 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:13.560196+0000", 2024-04-19T02:16:39.924 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.293782539999999, 2024-04-19T02:16:39.924 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020122021, 2024-04-19T02:16:39.924 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:39.924 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:39.924 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:39.924 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:39.924 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:39.925 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 53042 2024-04-19T02:16:39.925 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.925 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:39.925 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.925 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:39.925 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560196+0000", 2024-04-19T02:16:39.925 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:39.925 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.925 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.925 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:39.925 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560196+0000", 2024-04-19T02:16:39.925 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:39.925 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.925 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.925 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:39.926 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560195+0000", 2024-04-19T02:16:39.926 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:39.926 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.926 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.926 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:39.926 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560255+0000", 2024-04-19T02:16:39.926 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9441000000000002e-05 2024-04-19T02:16:39.926 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.926 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.926 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:39.926 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560264+0000", 2024-04-19T02:16:39.926 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1130000000000007e-06 2024-04-19T02:16:39.926 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.926 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.927 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:39.927 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560271+0000", 2024-04-19T02:16:39.927 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9800000000000001e-06 2024-04-19T02:16:39.927 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.927 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.927 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:39.927 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560312+0000", 2024-04-19T02:16:39.927 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0828999999999998e-05 2024-04-19T02:16:39.927 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.927 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.927 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:39.927 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560456+0000", 2024-04-19T02:16:39.927 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014474799999999999 2024-04-19T02:16:39.927 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.928 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.928 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:39.928 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560591+0000", 2024-04-19T02:16:39.928 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013482699999999999 2024-04-19T02:16:39.928 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.928 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.928 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:39.928 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.564799+0000", 2024-04-19T02:16:39.928 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042080080000000001 2024-04-19T02:16:39.928 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.928 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.928 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:39.928 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580233+0000", 2024-04-19T02:16:39.928 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015433715000000001 2024-04-19T02:16:39.929 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.929 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.929 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:39.929 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580280+0000", 2024-04-19T02:16:39.929 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6465000000000003e-05 2024-04-19T02:16:39.929 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.929 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.929 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:39.929 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580318+0000", 2024-04-19T02:16:39.929 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8557999999999999e-05 2024-04-19T02:16:39.929 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.929 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:39.929 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.929 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.929 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.929 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:53044 5.7 5:ec8fd8f2:::benchmark_data_smithi121_44835_object53043:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T02:16:39.930 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:13.561281+0000", 2024-04-19T02:16:39.930 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.292697338, 2024-04-19T02:16:39.930 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019133752, 2024-04-19T02:16:39.930 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:39.930 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:39.930 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:39.930 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:39.930 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:39.930 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 53044 2024-04-19T02:16:39.930 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.930 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:39.930 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.930 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:39.930 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.561281+0000", 2024-04-19T02:16:39.930 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:39.931 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.931 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.931 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:39.931 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.561281+0000", 2024-04-19T02:16:39.931 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:39.931 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.931 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.931 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:39.931 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.561270+0000", 2024-04-19T02:16:39.931 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999886 2024-04-19T02:16:39.931 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.931 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.932 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:39.932 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.561364+0000", 2024-04-19T02:16:39.932 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4721000000000003e-05 2024-04-19T02:16:39.932 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.932 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.932 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:39.932 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.561375+0000", 2024-04-19T02:16:39.932 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0900999999999999e-05 2024-04-19T02:16:39.932 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.932 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.932 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:39.932 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.561383+0000", 2024-04-19T02:16:39.932 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5460000000000003e-06 2024-04-19T02:16:39.932 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.932 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.933 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:39.933 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.562716+0000", 2024-04-19T02:16:39.933 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001333592 2024-04-19T02:16:39.933 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.933 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.933 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:39.933 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.562831+0000", 2024-04-19T02:16:39.933 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000114585 2024-04-19T02:16:39.933 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.933 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.933 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:39.933 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.562984+0000", 2024-04-19T02:16:39.933 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000152724 2024-04-19T02:16:39.933 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.933 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.934 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:39.934 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.571517+0000", 2024-04-19T02:16:39.934 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0085335199999999993 2024-04-19T02:16:39.934 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.934 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.934 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:39.934 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580332+0000", 2024-04-19T02:16:39.934 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0088147859999999998 2024-04-19T02:16:39.934 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.934 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.934 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:39.934 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580377+0000", 2024-04-19T02:16:39.934 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5293000000000002e-05 2024-04-19T02:16:39.934 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.934 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.935 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:39.935 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580415+0000", 2024-04-19T02:16:39.935 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7756999999999998e-05 2024-04-19T02:16:39.935 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.935 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:39.935 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.935 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.935 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.935 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:85866 5.2 5:48b1d46d:::benchmark_data_smithi121_44835_object85865:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T02:16:39.935 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:30.771909+0000", 2024-04-19T02:16:39.935 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 9.0820692679999997, 2024-04-19T02:16:39.935 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020516216, 2024-04-19T02:16:39.935 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:39.935 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:39.935 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:39.936 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:39.936 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:39.936 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 85866 2024-04-19T02:16:39.936 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.936 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:39.936 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.936 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:39.936 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771909+0000", 2024-04-19T02:16:39.936 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:39.936 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.936 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.936 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:39.936 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771909+0000", 2024-04-19T02:16:39.936 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:39.937 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.937 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.937 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:39.937 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771909+0000", 2024-04-19T02:16:39.937 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:39.937 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.937 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.937 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:39.937 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771952+0000", 2024-04-19T02:16:39.937 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2660000000000002e-05 2024-04-19T02:16:39.937 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.937 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.937 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:39.937 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771959+0000", 2024-04-19T02:16:39.937 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7670000000000003e-06 2024-04-19T02:16:39.937 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.938 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.938 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:39.938 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771966+0000", 2024-04-19T02:16:39.938 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.905e-06 2024-04-19T02:16:39.938 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.938 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.938 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:39.938 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771999+0000", 2024-04-19T02:16:39.938 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2360999999999997e-05 2024-04-19T02:16:39.938 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.938 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.938 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:39.938 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.772133+0000", 2024-04-19T02:16:39.938 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013398699999999999 2024-04-19T02:16:39.939 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.939 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.939 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:39.939 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.772280+0000", 2024-04-19T02:16:39.939 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000147198 2024-04-19T02:16:39.939 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.939 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.939 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:39.939 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.774312+0000", 2024-04-19T02:16:39.939 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020325339999999999 2024-04-19T02:16:39.939 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.939 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.939 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:39.939 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.792370+0000", 2024-04-19T02:16:39.939 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018057321000000001 2024-04-19T02:16:39.939 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.940 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.940 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:39.940 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.792403+0000", 2024-04-19T02:16:39.940 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3247000000000002e-05 2024-04-19T02:16:39.940 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.940 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.940 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:39.940 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.792426+0000", 2024-04-19T02:16:39.940 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2697999999999999e-05 2024-04-19T02:16:39.940 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.940 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:39.940 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.940 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.940 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.940 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:94438 5.7 5:eb242aac:::benchmark_data_smithi121_44835_object94437:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T02:16:39.941 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:35.095629+0000", 2024-04-19T02:16:39.941 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.7583492449999998, 2024-04-19T02:16:39.941 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019240869000000001, 2024-04-19T02:16:39.941 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:39.941 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:39.941 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:39.941 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:39.941 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:39.941 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 94438 2024-04-19T02:16:39.941 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.941 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:39.941 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.941 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:39.941 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.095629+0000", 2024-04-19T02:16:39.941 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:39.941 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.942 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.942 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:39.942 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.095629+0000", 2024-04-19T02:16:39.942 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:39.942 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.942 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.942 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:39.942 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.095628+0000", 2024-04-19T02:16:39.942 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:39.942 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.942 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.942 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:39.942 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.095652+0000", 2024-04-19T02:16:39.942 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3819999999999999e-05 2024-04-19T02:16:39.943 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.943 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.943 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:39.943 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.095660+0000", 2024-04-19T02:16:39.943 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0919999999999998e-06 2024-04-19T02:16:39.943 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.943 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.943 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:39.943 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.095665+0000", 2024-04-19T02:16:39.943 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2950000000000004e-06 2024-04-19T02:16:39.943 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.943 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.943 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:39.943 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.095686+0000", 2024-04-19T02:16:39.943 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1392000000000001e-05 2024-04-19T02:16:39.943 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.944 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.944 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:39.944 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.095791+0000", 2024-04-19T02:16:39.944 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010500100000000001 2024-04-19T02:16:39.944 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.944 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.944 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:39.944 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.095878+0000", 2024-04-19T02:16:39.944 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6674000000000004e-05 2024-04-19T02:16:39.944 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.944 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.944 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:39.944 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.097633+0000", 2024-04-19T02:16:39.944 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017547369999999999 2024-04-19T02:16:39.944 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.944 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.945 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:39.945 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.114800+0000", 2024-04-19T02:16:39.945 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017167449000000001 2024-04-19T02:16:39.945 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.945 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.945 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:39.945 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.114848+0000", 2024-04-19T02:16:39.945 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8096999999999997e-05 2024-04-19T02:16:39.945 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.945 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.945 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:39.945 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.114870+0000", 2024-04-19T02:16:39.945 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2158999999999999e-05 2024-04-19T02:16:39.945 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.945 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:39.946 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.946 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.946 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.946 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:94468 5.2 5:4f406431:::benchmark_data_smithi121_44835_object94467:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T02:16:39.946 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:16:39.946 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.7425494539999997, 2024-04-19T02:16:39.946 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024835144999999999, 2024-04-19T02:16:39.946 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:39.946 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:39.946 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:39.946 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:39.946 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:39.946 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 94468 2024-04-19T02:16:39.946 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.947 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:39.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.947 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:39.947 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:16:39.947 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:39.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.947 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:39.947 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:16:39.947 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:39.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.947 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:39.947 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:16:39.947 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:39.948 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.948 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.948 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:39.948 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111498+0000", 2024-04-19T02:16:39.948 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9529000000000005e-05 2024-04-19T02:16:39.948 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.948 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.948 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:39.948 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111506+0000", 2024-04-19T02:16:39.948 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9030000000000004e-06 2024-04-19T02:16:39.948 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.948 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.948 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:39.948 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111513+0000", 2024-04-19T02:16:39.948 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8759999999999999e-06 2024-04-19T02:16:39.948 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.949 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.949 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:39.949 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112466+0000", 2024-04-19T02:16:39.949 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00095318499999999995 2024-04-19T02:16:39.949 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.949 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.949 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:39.949 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112590+0000", 2024-04-19T02:16:39.949 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012380900000000001 2024-04-19T02:16:39.949 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.949 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.949 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:39.949 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112728+0000", 2024-04-19T02:16:39.949 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013753800000000001 2024-04-19T02:16:39.949 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.950 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.950 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:39.950 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115064+0000", 2024-04-19T02:16:39.950 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002336819 2024-04-19T02:16:39.950 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.950 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.950 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:39.950 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136207+0000", 2024-04-19T02:16:39.950 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021142942000000001 2024-04-19T02:16:39.950 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.950 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.950 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:39.950 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136241+0000", 2024-04-19T02:16:39.950 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3577000000000001e-05 2024-04-19T02:16:39.950 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.951 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.951 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:39.951 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136264+0000", 2024-04-19T02:16:39.951 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3421000000000002e-05 2024-04-19T02:16:39.951 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.951 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:39.951 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.951 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.951 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.951 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:94472 5.2 5:45b7e9be:::benchmark_data_smithi121_44835_object94471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:39.951 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:16:39.951 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.7389029230000004, 2024-04-19T02:16:39.951 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021273843000000001, 2024-04-19T02:16:39.951 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:39.951 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:39.951 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:39.952 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:39.952 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:39.952 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 94472 2024-04-19T02:16:39.952 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.952 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:39.952 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.952 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:39.952 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:16:39.952 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:39.952 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.952 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.952 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:39.952 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:16:39.952 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:39.953 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.953 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.953 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:39.953 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115075+0000", 2024-04-19T02:16:39.953 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:39.953 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.953 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.953 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:39.953 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115161+0000", 2024-04-19T02:16:39.953 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6632000000000007e-05 2024-04-19T02:16:39.953 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.953 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.953 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:39.953 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115171+0000", 2024-04-19T02:16:39.954 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2969999999999992e-06 2024-04-19T02:16:39.954 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.954 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.954 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:39.954 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115178+0000", 2024-04-19T02:16:39.954 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7610000000000007e-06 2024-04-19T02:16:39.954 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.954 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.954 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:39.954 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115213+0000", 2024-04-19T02:16:39.954 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5000999999999999e-05 2024-04-19T02:16:39.954 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.954 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.954 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:39.954 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115303+0000", 2024-04-19T02:16:39.955 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9791999999999997e-05 2024-04-19T02:16:39.955 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.955 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.955 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:39.955 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115391+0000", 2024-04-19T02:16:39.955 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7559000000000007e-05 2024-04-19T02:16:39.955 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.955 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.955 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:39.955 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.117894+0000", 2024-04-19T02:16:39.955 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002503496 2024-04-19T02:16:39.955 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.955 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.955 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:39.955 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136297+0000", 2024-04-19T02:16:39.955 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018402335999999998 2024-04-19T02:16:39.956 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.956 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.956 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:39.956 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136327+0000", 2024-04-19T02:16:39.956 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0534999999999998e-05 2024-04-19T02:16:39.956 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.956 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.956 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:39.956 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136350+0000", 2024-04-19T02:16:39.956 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2427999999999999e-05 2024-04-19T02:16:39.956 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.956 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:39.956 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.956 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.957 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.957 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:96668 5.f 5:f48d3288:::benchmark_data_smithi121_44835_object96667:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-19T02:16:39.957 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:36.254669+0000", 2024-04-19T02:16:39.957 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.5993098039999998, 2024-04-19T02:16:39.957 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019875075999999998, 2024-04-19T02:16:39.957 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:39.957 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:39.957 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:39.957 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:39.957 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:39.957 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 96668 2024-04-19T02:16:39.957 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.957 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:39.957 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.958 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:39.958 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254669+0000", 2024-04-19T02:16:39.958 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:39.958 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.958 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.958 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:39.958 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254669+0000", 2024-04-19T02:16:39.958 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:39.958 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.958 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.958 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:39.958 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254668+0000", 2024-04-19T02:16:39.958 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:39.958 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.959 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.959 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:39.959 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254738+0000", 2024-04-19T02:16:39.959 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9913000000000006e-05 2024-04-19T02:16:39.959 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.959 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.959 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:39.959 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254748+0000", 2024-04-19T02:16:39.959 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7429999999999997e-06 2024-04-19T02:16:39.959 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.959 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.959 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:39.959 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254754+0000", 2024-04-19T02:16:39.959 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3840000000000002e-06 2024-04-19T02:16:39.959 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.960 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.960 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:39.960 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.256882+0000", 2024-04-19T02:16:39.960 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021282950000000001 2024-04-19T02:16:39.960 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.960 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.960 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:39.960 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.257007+0000", 2024-04-19T02:16:39.960 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012430699999999999 2024-04-19T02:16:39.960 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.960 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.960 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:39.960 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.257150+0000", 2024-04-19T02:16:39.960 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014291999999999999 2024-04-19T02:16:39.960 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.961 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.961 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:39.961 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.261375+0000", 2024-04-19T02:16:39.961 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042252100000000001 2024-04-19T02:16:39.961 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.961 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.961 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:39.961 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.274489+0000", 2024-04-19T02:16:39.961 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013113915 2024-04-19T02:16:39.961 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.961 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.961 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:39.961 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.274521+0000", 2024-04-19T02:16:39.961 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2691999999999998e-05 2024-04-19T02:16:39.962 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.962 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.962 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:39.962 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.274544+0000", 2024-04-19T02:16:39.962 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2408999999999998e-05 2024-04-19T02:16:39.962 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.962 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:39.962 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.962 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.962 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.962 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:98093 5.f 5:fcbc05b3:::benchmark_data_smithi121_44835_object98092:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-19T02:16:39.962 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:36.938897+0000", 2024-04-19T02:16:39.962 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 2.9150819569999999, 2024-04-19T02:16:39.962 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019526373, 2024-04-19T02:16:39.963 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:39.963 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:39.963 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:39.963 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:39.963 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:39.963 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 98093 2024-04-19T02:16:39.963 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.963 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:39.963 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.963 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:39.963 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.938897+0000", 2024-04-19T02:16:39.963 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:39.963 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.963 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.964 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:39.964 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.938897+0000", 2024-04-19T02:16:39.964 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:39.964 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.964 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.964 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:39.964 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.938896+0000", 2024-04-19T02:16:39.964 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:39.964 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.964 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.964 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:39.964 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.938920+0000", 2024-04-19T02:16:39.964 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3969e-05 2024-04-19T02:16:39.964 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.964 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.964 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:39.965 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.938927+0000", 2024-04-19T02:16:39.965 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4760000000000003e-06 2024-04-19T02:16:39.965 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.965 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.965 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:39.965 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.938930+0000", 2024-04-19T02:16:39.965 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7349999999999998e-06 2024-04-19T02:16:39.965 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.965 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.965 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:39.965 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.945557+0000", 2024-04-19T02:16:39.965 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0066265689999999997 2024-04-19T02:16:39.965 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.965 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.966 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:39.966 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.945653+0000", 2024-04-19T02:16:39.966 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5948999999999999e-05 2024-04-19T02:16:39.966 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.966 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.966 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:39.966 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.945739+0000", 2024-04-19T02:16:39.966 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6012000000000003e-05 2024-04-19T02:16:39.966 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.966 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.966 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:39.966 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.949258+0000", 2024-04-19T02:16:39.966 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035189140000000002 2024-04-19T02:16:39.966 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.966 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.967 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:39.967 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.958372+0000", 2024-04-19T02:16:39.967 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0091140430000000005 2024-04-19T02:16:39.967 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.967 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.967 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:39.967 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.958402+0000", 2024-04-19T02:16:39.967 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9879e-05 2024-04-19T02:16:39.967 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:39.967 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:39.967 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:39.967 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.958423+0000", 2024-04-19T02:16:39.967 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1206999999999999e-05 2024-04-19T02:16:39.967 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.967 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:39.968 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.968 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:39.968 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:39.968 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:16:39.969 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:39.969+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:39.970 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:16:40.029 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 45 16 104070 104054 144.507 126 0.0110436 0.00691747 2024-04-19T02:16:40.070 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:40.071+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:40.142 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T02:16:40.144 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:16:40.144 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:16:40.144 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.144 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:104284 5.4 5:2b5fe09b:::benchmark_data_smithi121_44835_object104283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T02:16:40.144 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:40.139359+0000", 2024-04-19T02:16:40.144 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0054257250000000002, 2024-04-19T02:16:40.144 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0054484829999999996, 2024-04-19T02:16:40.144 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:40.144 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:40.144 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:40.145 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:40.145 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:40.145 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 104284 2024-04-19T02:16:40.145 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.145 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:40.145 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.145 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:40.145 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.139359+0000", 2024-04-19T02:16:40.145 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.145 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.145 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.145 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:40.145 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.139359+0000", 2024-04-19T02:16:40.145 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.145 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.146 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.146 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:40.146 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.139358+0000", 2024-04-19T02:16:40.146 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:40.146 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.146 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.146 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:40.146 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.139431+0000", 2024-04-19T02:16:40.146 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3543999999999999e-05 2024-04-19T02:16:40.146 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.146 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.146 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:40.146 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.139443+0000", 2024-04-19T02:16:40.146 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1385e-05 2024-04-19T02:16:40.146 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.147 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.147 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:40.147 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.139451+0000", 2024-04-19T02:16:40.147 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.1850000000000004e-06 2024-04-19T02:16:40.147 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.147 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.147 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:40.147 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.141009+0000", 2024-04-19T02:16:40.147 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0015581219999999999 2024-04-19T02:16:40.147 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.147 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.147 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:40.147 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.141100+0000", 2024-04-19T02:16:40.147 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0729000000000005e-05 2024-04-19T02:16:40.147 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.147 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.148 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:40.148 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.141185+0000", 2024-04-19T02:16:40.148 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.4764000000000004e-05 2024-04-19T02:16:40.148 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.148 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.148 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:40.148 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.143128+0000", 2024-04-19T02:16:40.148 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0019435089999999999 2024-04-19T02:16:40.148 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.148 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:40.148 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.148 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.148 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.148 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:104286 5.b 5:d7684267:::benchmark_data_smithi121_44835_object104285:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T02:16:40.148 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:40.139506+0000", 2024-04-19T02:16:40.149 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0052781859999999998, 2024-04-19T02:16:40.149 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0053581590000000004, 2024-04-19T02:16:40.149 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:40.149 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:40.149 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:40.149 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:40.149 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:40.149 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 104286 2024-04-19T02:16:40.149 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.149 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:40.149 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.149 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:40.149 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.139506+0000", 2024-04-19T02:16:40.149 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.149 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.149 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.150 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:40.150 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.139506+0000", 2024-04-19T02:16:40.150 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.150 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.150 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.150 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:40.150 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.139506+0000", 2024-04-19T02:16:40.150 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:40.150 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.150 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.150 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:40.150 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.139591+0000", 2024-04-19T02:16:40.150 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.4757000000000002e-05 2024-04-19T02:16:40.150 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.151 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.151 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:40.151 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.139599+0000", 2024-04-19T02:16:40.151 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.5650000000000002e-06 2024-04-19T02:16:40.151 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.151 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.151 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:40.151 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.139606+0000", 2024-04-19T02:16:40.151 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5320000000000003e-06 2024-04-19T02:16:40.151 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.151 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.151 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:40.151 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.139640+0000", 2024-04-19T02:16:40.151 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4748e-05 2024-04-19T02:16:40.151 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.152 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.152 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:40.152 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.139768+0000", 2024-04-19T02:16:40.152 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012719000000000001 2024-04-19T02:16:40.152 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.152 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.152 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:40.152 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.139914+0000", 2024-04-19T02:16:40.152 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000146071 2024-04-19T02:16:40.152 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.152 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.152 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:40.152 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.144063+0000", 2024-04-19T02:16:40.152 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0041496520000000002 2024-04-19T02:16:40.152 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.152 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:40.153 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.153 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.153 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.153 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:104289 5.b 5:da0e6b73:::benchmark_data_smithi121_44835_object104288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T02:16:40.153 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:40.140193+0000", 2024-04-19T02:16:40.153 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0045918740000000001, 2024-04-19T02:16:40.153 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0047187729999999999, 2024-04-19T02:16:40.153 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:40.153 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:40.153 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:40.153 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:40.153 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:40.153 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 104289 2024-04-19T02:16:40.153 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.153 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:40.154 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.154 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:40.154 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.140193+0000", 2024-04-19T02:16:40.154 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.154 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.154 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.154 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:40.154 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.140193+0000", 2024-04-19T02:16:40.154 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.154 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.154 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.154 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:40.154 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.140192+0000", 2024-04-19T02:16:40.154 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:40.154 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.154 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.155 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:40.155 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.140269+0000", 2024-04-19T02:16:40.155 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.6903999999999994e-05 2024-04-19T02:16:40.155 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.155 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.155 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:40.155 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.140278+0000", 2024-04-19T02:16:40.155 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.6589999999999996e-06 2024-04-19T02:16:40.155 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.155 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.155 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:40.155 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.140284+0000", 2024-04-19T02:16:40.155 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.55e-06 2024-04-19T02:16:40.155 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.155 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.156 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:40.156 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.141757+0000", 2024-04-19T02:16:40.156 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0014726839999999999 2024-04-19T02:16:40.156 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.156 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.156 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:40.156 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.141897+0000", 2024-04-19T02:16:40.156 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000139961 2024-04-19T02:16:40.156 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.156 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.156 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:40.156 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.142066+0000", 2024-04-19T02:16:40.156 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00016893600000000001 2024-04-19T02:16:40.156 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.156 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.157 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:40.157 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.144440+0000", 2024-04-19T02:16:40.157 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0023747550000000001 2024-04-19T02:16:40.157 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.157 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:40.157 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.157 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.157 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.157 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:104293 5.0 5:03ffe73e:::benchmark_data_smithi121_44835_object104292:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T02:16:40.157 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:40.143202+0000", 2024-04-19T02:16:40.157 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.001582745, 2024-04-19T02:16:40.157 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001757338, 2024-04-19T02:16:40.157 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:40.157 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:40.157 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:40.158 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:40.158 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:40.158 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 104293 2024-04-19T02:16:40.158 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.158 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:40.158 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.158 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:40.158 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.143202+0000", 2024-04-19T02:16:40.158 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.158 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.158 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.158 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:40.158 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.143202+0000", 2024-04-19T02:16:40.158 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.158 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.159 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.159 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:40.159 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.143201+0000", 2024-04-19T02:16:40.159 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:40.159 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.159 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.159 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:40.159 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.143248+0000", 2024-04-19T02:16:40.159 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.6931000000000002e-05 2024-04-19T02:16:40.159 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.160 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.160 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:40.160 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.143257+0000", 2024-04-19T02:16:40.160 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3030000000000005e-06 2024-04-19T02:16:40.161 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.161 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.161 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:40.162 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.143264+0000", 2024-04-19T02:16:40.162 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.9700000000000002e-06 2024-04-19T02:16:40.162 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.162 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.162 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:40.162 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.143297+0000", 2024-04-19T02:16:40.162 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3260999999999999e-05 2024-04-19T02:16:40.162 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.162 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.162 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:40.162 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.143377+0000", 2024-04-19T02:16:40.162 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9676000000000001e-05 2024-04-19T02:16:40.162 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.162 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.163 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:40.163 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.143506+0000", 2024-04-19T02:16:40.163 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000129531 2024-04-19T02:16:40.163 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.163 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:40.163 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.163 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.163 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.163 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:104294 5.4 5:25ec702d:::benchmark_data_smithi121_44835_object104293:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T02:16:40.163 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:40.143407+0000", 2024-04-19T02:16:40.163 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0013773559999999999, 2024-04-19T02:16:40.163 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0015967500000000001, 2024-04-19T02:16:40.163 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:40.164 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:40.164 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:40.164 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:40.164 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:40.164 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 104294 2024-04-19T02:16:40.164 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.164 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:40.164 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.164 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:40.164 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.143407+0000", 2024-04-19T02:16:40.164 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.164 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.164 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.164 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:40.164 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.143407+0000", 2024-04-19T02:16:40.165 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.165 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.165 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.165 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:40.165 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.143406+0000", 2024-04-19T02:16:40.165 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:40.165 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.165 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.165 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:40.165 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.143471+0000", 2024-04-19T02:16:40.165 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.4760999999999999e-05 2024-04-19T02:16:40.165 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.165 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.165 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:40.166 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.143481+0000", 2024-04-19T02:16:40.166 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.8290000000000003e-06 2024-04-19T02:16:40.166 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.166 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.166 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:40.166 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.143488+0000", 2024-04-19T02:16:40.166 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.041e-06 2024-04-19T02:16:40.166 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.166 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.166 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:40.166 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.143522+0000", 2024-04-19T02:16:40.166 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4159000000000003e-05 2024-04-19T02:16:40.166 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.166 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.166 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:40.167 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.143608+0000", 2024-04-19T02:16:40.167 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.6237999999999997e-05 2024-04-19T02:16:40.167 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.167 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.167 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:40.167 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.143698+0000", 2024-04-19T02:16:40.167 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.9735999999999996e-05 2024-04-19T02:16:40.167 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.167 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:40.167 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.167 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.168 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.168 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop_reply(client.4549.0:104284 5.4 e38/16)", 2024-04-19T02:16:40.168 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:40.143539+0000", 2024-04-19T02:16:40.168 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.001245726, 2024-04-19T02:16:40.168 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001504193, 2024-04-19T02:16:40.168 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:40.168 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "queued for pg", 2024-04-19T02:16:40.168 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:40.168 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.169 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:40.169 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.143539+0000", 2024-04-19T02:16:40.169 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.169 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.169 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.169 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:40.169 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.143539+0000", 2024-04-19T02:16:40.169 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.169 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.169 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.169 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:40.169 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.143538+0000", 2024-04-19T02:16:40.169 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:40.169 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.169 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.170 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:40.170 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.143541+0000", 2024-04-19T02:16:40.170 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.6869999999999999e-06 2024-04-19T02:16:40.170 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.170 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.170 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:40.170 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.143548+0000", 2024-04-19T02:16:40.170 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.3500000000000002e-06 2024-04-19T02:16:40.170 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.171 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.171 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:40.171 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.143552+0000", 2024-04-19T02:16:40.171 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3120000000000004e-06 2024-04-19T02:16:40.171 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.171 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:40.171 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.171 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.171 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.171 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:104297 5.9 e38/16)", 2024-04-19T02:16:40.171 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:40.144158+0000", 2024-04-19T02:16:40.171 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.000626266, 2024-04-19T02:16:40.171 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00091018100000000003, 2024-04-19T02:16:40.171 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:40.172 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "queued for pg", 2024-04-19T02:16:40.172 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:40.172 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.172 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:40.172 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.144158+0000", 2024-04-19T02:16:40.172 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.172 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.172 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.172 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:40.172 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.144158+0000", 2024-04-19T02:16:40.173 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.173 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.173 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.173 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:40.173 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.144158+0000", 2024-04-19T02:16:40.173 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:40.173 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.173 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.173 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:40.173 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.144258+0000", 2024-04-19T02:16:40.173 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010012400000000001 2024-04-19T02:16:40.173 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.173 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.173 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:40.173 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.144266+0000", 2024-04-19T02:16:40.174 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.5399999999999996e-06 2024-04-19T02:16:40.174 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.174 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.174 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:40.174 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.144272+0000", 2024-04-19T02:16:40.174 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.0390000000000001e-06 2024-04-19T02:16:40.174 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.174 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:40.174 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.174 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.174 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.174 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:104299 5.a e38/16 5:504daef0:::benchmark_data_smithi121_44835_object104298:head v 38'6614, mlcod=38'6612)", 2024-04-19T02:16:40.174 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:40.144625+0000", 2024-04-19T02:16:40.174 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.000159531, 2024-04-19T02:16:40.175 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00047390300000000002, 2024-04-19T02:16:40.175 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:40.175 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:16:40.175 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:40.175 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.175 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:40.175 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.144625+0000", 2024-04-19T02:16:40.175 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.175 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.175 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.175 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:40.175 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.144625+0000", 2024-04-19T02:16:40.175 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.175 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.176 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.176 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:40.176 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.144625+0000", 2024-04-19T02:16:40.176 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:40.176 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.176 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.176 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:40.176 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.144681+0000", 2024-04-19T02:16:40.176 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.6051000000000003e-05 2024-04-19T02:16:40.176 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.176 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.176 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:40.176 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.144688+0000", 2024-04-19T02:16:40.176 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.2899999999999997e-06 2024-04-19T02:16:40.176 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.177 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.177 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:40.177 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.144694+0000", 2024-04-19T02:16:40.177 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.3489999999999997e-06 2024-04-19T02:16:40.177 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.177 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.177 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:40.177 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.144734+0000", 2024-04-19T02:16:40.177 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9786000000000002e-05 2024-04-19T02:16:40.177 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.177 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.177 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:40.177 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.144754+0000", 2024-04-19T02:16:40.177 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.9794000000000001e-05 2024-04-19T02:16:40.177 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.178 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:40.178 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.178 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.178 INFO:teuthology.orchestra.run.smithi174.stdout: ], 2024-04-19T02:16:40.178 INFO:teuthology.orchestra.run.smithi174.stdout: "num_ops": 8 2024-04-19T02:16:40.178 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:16:40.180 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:40.179+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:40.180 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:16:40.280 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:40.280+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:40.345 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:16:40.346 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [], 2024-04-19T02:16:40.346 INFO:teuthology.orchestra.run.smithi174.stdout: "complaint_time": 30, 2024-04-19T02:16:40.346 INFO:teuthology.orchestra.run.smithi174.stdout: "num_blocked_ops": 0 2024-04-19T02:16:40.346 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:16:40.360 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:16:40.381 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:40.382+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:40.482 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:40.483+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:40.534 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:16:40.534 INFO:teuthology.orchestra.run.smithi174.stdout: "size": 20, 2024-04-19T02:16:40.534 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 600, 2024-04-19T02:16:40.535 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:16:40.535 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.535 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:10 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:40.535 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269877+0000", 2024-04-19T02:16:40.535 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 71.263512933000001, 2024-04-19T02:16:40.535 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020732751000000001, 2024-04-19T02:16:40.535 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:40.535 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:40.535 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:40.535 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.535 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:40.535 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269877+0000", 2024-04-19T02:16:40.535 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.535 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.535 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.536 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:40.536 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269877+0000", 2024-04-19T02:16:40.536 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.536 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.536 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.536 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:40.536 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269875+0000", 2024-04-19T02:16:40.536 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:40.536 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.536 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.536 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:40.536 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269891+0000", 2024-04-19T02:16:40.536 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.5494000000000001e-05 2024-04-19T02:16:40.536 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.536 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.537 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:40.537 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269903+0000", 2024-04-19T02:16:40.537 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2003e-05 2024-04-19T02:16:40.537 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.537 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.537 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:40.537 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269914+0000", 2024-04-19T02:16:40.537 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0947e-05 2024-04-19T02:16:40.537 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.537 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.537 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:40.537 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269971+0000", 2024-04-19T02:16:40.537 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7036000000000001e-05 2024-04-19T02:16:40.537 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.537 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.537 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:16:40.538 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269979+0000", 2024-04-19T02:16:40.538 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.6660000000000008e-06 2024-04-19T02:16:40.538 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.538 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.538 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:40.538 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284891+0000", 2024-04-19T02:16:40.538 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014912584 2024-04-19T02:16:40.538 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.538 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.538 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:40.539 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285213+0000", 2024-04-19T02:16:40.539 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00032172199999999998 2024-04-19T02:16:40.539 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.539 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.539 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:40.539 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285357+0000", 2024-04-19T02:16:40.539 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014367899999999999 2024-04-19T02:16:40.539 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.539 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.539 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:40.539 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288883+0000", 2024-04-19T02:16:40.539 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0035268719999999999 2024-04-19T02:16:40.539 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.539 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.539 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:40.540 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290537+0000", 2024-04-19T02:16:40.540 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016537399999999999 2024-04-19T02:16:40.540 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.540 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.540 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:40.540 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290576+0000", 2024-04-19T02:16:40.540 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9266e-05 2024-04-19T02:16:40.540 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.540 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.540 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:40.540 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290609+0000", 2024-04-19T02:16:40.540 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2818000000000003e-05 2024-04-19T02:16:40.540 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.540 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:40.540 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.541 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.541 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.541 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:11 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:40.541 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:40.541 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 71.263460011999996, 2024-04-19T02:16:40.541 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020352748, 2024-04-19T02:16:40.541 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:40.541 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:40.541 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:40.541 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.541 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:40.541 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:40.541 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.541 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.542 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.542 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:40.542 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:40.542 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.542 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.542 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.542 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:40.542 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:40.542 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:40.542 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.542 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.542 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:40.542 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269933+0000", 2024-04-19T02:16:40.543 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2169999999999996e-06 2024-04-19T02:16:40.543 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.543 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.543 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:40.543 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269940+0000", 2024-04-19T02:16:40.543 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1500000000000002e-06 2024-04-19T02:16:40.543 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.543 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.543 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:40.543 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269948+0000", 2024-04-19T02:16:40.543 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.8690000000000004e-06 2024-04-19T02:16:40.543 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.543 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.543 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:40.543 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:16:40.543 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2994999999999997e-05 2024-04-19T02:16:40.544 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.544 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.544 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:16:40.544 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269997+0000", 2024-04-19T02:16:40.544 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.9020000000000004e-06 2024-04-19T02:16:40.544 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.544 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.544 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:40.544 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.282729+0000", 2024-04-19T02:16:40.544 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.012732537 2024-04-19T02:16:40.544 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.544 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.544 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:40.544 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.282838+0000", 2024-04-19T02:16:40.545 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000108298 2024-04-19T02:16:40.545 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.545 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.545 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:40.545 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.283002+0000", 2024-04-19T02:16:40.545 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00016466300000000001 2024-04-19T02:16:40.545 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.545 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.545 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:40.545 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288708+0000", 2024-04-19T02:16:40.545 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.005705066 2024-04-19T02:16:40.545 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.545 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.545 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:40.546 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290215+0000", 2024-04-19T02:16:40.546 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0015075010000000001 2024-04-19T02:16:40.546 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.546 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.546 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:40.546 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290259+0000", 2024-04-19T02:16:40.546 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3711999999999998e-05 2024-04-19T02:16:40.546 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.546 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.546 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:40.546 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290282+0000", 2024-04-19T02:16:40.546 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3458000000000001e-05 2024-04-19T02:16:40.546 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.546 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:40.547 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.547 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.547 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.547 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:14 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:40.547 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:40.547 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 71.263426222000007, 2024-04-19T02:16:40.547 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020137202, 2024-04-19T02:16:40.547 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:40.547 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:40.547 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:40.547 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.547 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:40.547 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:40.547 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.548 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.548 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.548 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:40.548 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:40.548 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.548 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.548 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.548 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:40.548 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:40.548 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:40.548 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.548 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.548 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:40.548 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269971+0000", 2024-04-19T02:16:40.549 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.5459999999999992e-06 2024-04-19T02:16:40.549 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.549 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.549 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:40.549 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269979+0000", 2024-04-19T02:16:40.549 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9130000000000003e-06 2024-04-19T02:16:40.549 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.549 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.549 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:40.549 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269986+0000", 2024-04-19T02:16:40.549 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.3779999999999998e-06 2024-04-19T02:16:40.549 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.549 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.549 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:40.549 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270030+0000", 2024-04-19T02:16:40.550 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3982e-05 2024-04-19T02:16:40.550 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.550 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.550 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:16:40.550 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270034+0000", 2024-04-19T02:16:40.550 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1779999999999996e-06 2024-04-19T02:16:40.550 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.550 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.550 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:40.550 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.277870+0000", 2024-04-19T02:16:40.550 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0078362150000000005 2024-04-19T02:16:40.550 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.550 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.551 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:40.551 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.278216+0000", 2024-04-19T02:16:40.551 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00034634999999999999 2024-04-19T02:16:40.551 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.551 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.551 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:40.551 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.278732+0000", 2024-04-19T02:16:40.551 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00051536099999999999 2024-04-19T02:16:40.551 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.551 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.551 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:40.551 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.287694+0000", 2024-04-19T02:16:40.551 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0089621019999999996 2024-04-19T02:16:40.551 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.551 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.552 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:40.552 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290026+0000", 2024-04-19T02:16:40.552 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0023323139999999998 2024-04-19T02:16:40.552 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.552 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.552 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:40.552 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290067+0000", 2024-04-19T02:16:40.552 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1043e-05 2024-04-19T02:16:40.552 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.552 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.552 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:40.552 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290100+0000", 2024-04-19T02:16:40.552 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3278999999999998e-05 2024-04-19T02:16:40.552 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.553 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:40.553 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.553 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.553 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.553 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:40.553 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:40.553 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 71.263394430000005, 2024-04-19T02:16:40.553 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020731702000000001, 2024-04-19T02:16:40.553 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:40.553 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:40.553 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:40.553 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.553 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:40.553 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:40.553 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.554 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.554 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.554 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:40.554 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:40.554 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.554 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.554 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.554 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:40.554 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:40.554 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:40.554 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.554 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.554 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:40.554 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269998+0000", 2024-04-19T02:16:40.554 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7100000000000001e-06 2024-04-19T02:16:40.555 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.555 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.555 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:40.555 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270005+0000", 2024-04-19T02:16:40.555 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.241e-06 2024-04-19T02:16:40.555 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.555 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.555 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:40.555 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270011+0000", 2024-04-19T02:16:40.555 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6279999999999999e-06 2024-04-19T02:16:40.555 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.555 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.555 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:40.555 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270046+0000", 2024-04-19T02:16:40.555 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5173999999999999e-05 2024-04-19T02:16:40.555 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.556 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.556 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:40.556 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:40.556 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0019999999999997e-06 2024-04-19T02:16:40.556 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.556 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.556 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:40.556 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285619+0000", 2024-04-19T02:16:40.556 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015567391 2024-04-19T02:16:40.556 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.556 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.556 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:40.556 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285671+0000", 2024-04-19T02:16:40.556 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2460999999999998e-05 2024-04-19T02:16:40.556 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.557 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.557 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:40.557 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285775+0000", 2024-04-19T02:16:40.557 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000103389 2024-04-19T02:16:40.557 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.557 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.557 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:40.557 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288934+0000", 2024-04-19T02:16:40.557 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0031595859999999998 2024-04-19T02:16:40.557 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.557 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.557 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:40.557 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290650+0000", 2024-04-19T02:16:40.557 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001716242 2024-04-19T02:16:40.557 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.558 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.558 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:40.558 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290692+0000", 2024-04-19T02:16:40.558 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1910999999999999e-05 2024-04-19T02:16:40.558 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.558 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.558 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:40.558 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290727+0000", 2024-04-19T02:16:40.558 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4412000000000002e-05 2024-04-19T02:16:40.558 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.558 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:40.558 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.558 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.558 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.559 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:40.559 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270019+0000", 2024-04-19T02:16:40.559 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 71.263370835000003, 2024-04-19T02:16:40.559 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020572014999999999, 2024-04-19T02:16:40.559 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:40.559 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:40.559 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:40.559 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.559 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:40.559 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270019+0000", 2024-04-19T02:16:40.559 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.559 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.559 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.559 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:40.560 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270019+0000", 2024-04-19T02:16:40.560 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.560 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.560 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.560 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:40.560 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270018+0000", 2024-04-19T02:16:40.560 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:40.560 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.560 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.560 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:40.560 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270021+0000", 2024-04-19T02:16:40.560 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0319999999999999e-06 2024-04-19T02:16:40.560 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.560 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.561 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:40.561 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270028+0000", 2024-04-19T02:16:40.561 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6189999999999996e-06 2024-04-19T02:16:40.561 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.561 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.561 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:40.561 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270035+0000", 2024-04-19T02:16:40.561 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1690000000000003e-06 2024-04-19T02:16:40.561 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.561 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.561 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:40.561 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270078+0000", 2024-04-19T02:16:40.561 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3061e-05 2024-04-19T02:16:40.561 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.561 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.562 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:40.562 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270082+0000", 2024-04-19T02:16:40.562 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4510000000000002e-06 2024-04-19T02:16:40.562 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.562 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.562 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:40.562 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284354+0000", 2024-04-19T02:16:40.562 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014271588999999999 2024-04-19T02:16:40.562 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.562 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.562 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:40.562 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284497+0000", 2024-04-19T02:16:40.562 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014335800000000001 2024-04-19T02:16:40.563 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.563 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.563 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:40.563 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284626+0000", 2024-04-19T02:16:40.563 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000128744 2024-04-19T02:16:40.563 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.563 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.563 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:40.563 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288844+0000", 2024-04-19T02:16:40.563 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00421807 2024-04-19T02:16:40.563 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.563 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.563 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:40.563 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290508+0000", 2024-04-19T02:16:40.564 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001663774 2024-04-19T02:16:40.564 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.564 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.564 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:40.564 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290556+0000", 2024-04-19T02:16:40.564 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.7599999999999998e-05 2024-04-19T02:16:40.564 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.564 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.564 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:40.564 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290591+0000", 2024-04-19T02:16:40.564 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5034999999999999e-05 2024-04-19T02:16:40.564 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.564 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:40.564 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.564 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.565 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.565 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:40.565 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:40.565 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 71.263347972000005, 2024-04-19T02:16:40.565 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020192280999999999, 2024-04-19T02:16:40.565 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:40.565 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:40.565 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:40.565 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.565 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:40.565 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:40.565 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.565 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.565 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.566 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:40.566 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:40.566 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.566 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.566 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.566 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:40.566 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:40.566 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:40.566 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.566 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.566 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:40.566 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270045+0000", 2024-04-19T02:16:40.566 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8680000000000001e-06 2024-04-19T02:16:40.566 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.566 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.567 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:40.567 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270052+0000", 2024-04-19T02:16:40.567 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.9999999999999999e-06 2024-04-19T02:16:40.567 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.567 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.567 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:40.567 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270056+0000", 2024-04-19T02:16:40.567 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4479999999999996e-06 2024-04-19T02:16:40.567 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.567 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.567 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:40.567 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270089+0000", 2024-04-19T02:16:40.567 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3071000000000002e-05 2024-04-19T02:16:40.567 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.567 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.568 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:40.568 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270092+0000", 2024-04-19T02:16:40.568 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9780000000000001e-06 2024-04-19T02:16:40.568 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.568 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.568 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:40.568 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.280632+0000", 2024-04-19T02:16:40.568 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010539712 2024-04-19T02:16:40.568 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.568 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.568 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:40.568 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.280743+0000", 2024-04-19T02:16:40.568 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000111048 2024-04-19T02:16:40.568 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.568 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.569 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:40.569 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.281531+0000", 2024-04-19T02:16:40.569 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00078738199999999999 2024-04-19T02:16:40.569 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.569 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.569 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:40.569 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.287949+0000", 2024-04-19T02:16:40.569 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0064185730000000003 2024-04-19T02:16:40.569 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.569 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.569 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:40.569 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290184+0000", 2024-04-19T02:16:40.569 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0022350849999999999 2024-04-19T02:16:40.569 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.570 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.570 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:40.570 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290209+0000", 2024-04-19T02:16:40.570 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4907000000000001e-05 2024-04-19T02:16:40.570 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.570 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.570 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:40.570 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290234+0000", 2024-04-19T02:16:40.570 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4666999999999999e-05 2024-04-19T02:16:40.570 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.570 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:40.570 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.570 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.570 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.570 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:19 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:40.571 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:40.571 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 71.263326505999999, 2024-04-19T02:16:40.571 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020818203, 2024-04-19T02:16:40.571 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:40.571 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:40.571 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:40.571 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.571 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:40.571 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:40.571 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.571 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.571 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.571 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:40.571 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:40.571 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.572 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.572 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.572 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:40.572 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:40.572 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:40.573 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.573 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.573 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:40.574 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270065+0000", 2024-04-19T02:16:40.574 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4310000000000001e-06 2024-04-19T02:16:40.574 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.574 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.574 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:40.574 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270070+0000", 2024-04-19T02:16:40.574 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2859999999999999e-06 2024-04-19T02:16:40.574 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.574 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.574 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:40.574 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270077+0000", 2024-04-19T02:16:40.574 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5270000000000004e-06 2024-04-19T02:16:40.574 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.574 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.575 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:40.575 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270107+0000", 2024-04-19T02:16:40.575 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0205999999999998e-05 2024-04-19T02:16:40.575 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.575 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.575 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:40.575 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270111+0000", 2024-04-19T02:16:40.575 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8650000000000003e-06 2024-04-19T02:16:40.575 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.575 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.575 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:40.575 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285936+0000", 2024-04-19T02:16:40.575 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015824677999999998 2024-04-19T02:16:40.575 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.575 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.576 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:40.576 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286007+0000", 2024-04-19T02:16:40.576 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1157999999999999e-05 2024-04-19T02:16:40.576 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.576 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.576 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:40.576 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286086+0000", 2024-04-19T02:16:40.576 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9084000000000004e-05 2024-04-19T02:16:40.576 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.576 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.576 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:40.576 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290740+0000", 2024-04-19T02:16:40.576 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0046543679999999999 2024-04-19T02:16:40.576 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.577 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.577 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:40.577 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290833+0000", 2024-04-19T02:16:40.577 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2551000000000002e-05 2024-04-19T02:16:40.577 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.577 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.577 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:40.577 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290859+0000", 2024-04-19T02:16:40.577 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.6696999999999999e-05 2024-04-19T02:16:40.577 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.577 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.577 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:40.577 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290881+0000", 2024-04-19T02:16:40.577 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1653000000000001e-05 2024-04-19T02:16:40.577 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.578 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:40.578 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.578 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.578 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.578 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:77622 5.8 5:166fbe77:::benchmark_data_smithi121_44835_object77621:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:40.578 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:16:40.578 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 13.727829569000001, 2024-04-19T02:16:40.578 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.021784694, 2024-04-19T02:16:40.578 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:40.578 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:40.578 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:40.578 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:40.578 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:40.578 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 77622 2024-04-19T02:16:40.579 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.579 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:40.579 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.579 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:40.579 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:16:40.579 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.579 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.579 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.579 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:40.579 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:16:40.579 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.579 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.579 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.579 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:40.579 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805559+0000", 2024-04-19T02:16:40.580 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:40.580 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.580 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.580 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:40.580 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805659+0000", 2024-04-19T02:16:40.580 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.9908000000000006e-05 2024-04-19T02:16:40.580 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.580 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.580 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:40.580 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805668+0000", 2024-04-19T02:16:40.580 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2129999999999997e-06 2024-04-19T02:16:40.580 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.580 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.580 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:40.580 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805673+0000", 2024-04-19T02:16:40.581 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0370000000000002e-06 2024-04-19T02:16:40.581 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.581 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.581 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:40.581 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812022+0000", 2024-04-19T02:16:40.581 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0063483239999999998 2024-04-19T02:16:40.581 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.581 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.581 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:40.581 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812129+0000", 2024-04-19T02:16:40.581 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010744200000000001 2024-04-19T02:16:40.581 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.581 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.581 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:40.581 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812252+0000", 2024-04-19T02:16:40.582 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000122519 2024-04-19T02:16:40.582 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.582 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.582 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:40.582 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.820979+0000", 2024-04-19T02:16:40.582 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0087272740000000001 2024-04-19T02:16:40.582 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.582 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.582 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:40.582 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827270+0000", 2024-04-19T02:16:40.582 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0062906239999999999 2024-04-19T02:16:40.582 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.582 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.582 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:40.582 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827309+0000", 2024-04-19T02:16:40.583 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9678999999999997e-05 2024-04-19T02:16:40.583 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.583 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.583 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:40.583 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827345+0000", 2024-04-19T02:16:40.583 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5308000000000001e-05 2024-04-19T02:16:40.583 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.583 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:40.583 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.583 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.583 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.583 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:77623 5.8 5:1ac4372b:::benchmark_data_smithi121_44835_object77622:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:40.583 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:26.807355+0000", 2024-04-19T02:16:40.583 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 13.726034926000001, 2024-04-19T02:16:40.583 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020092922999999999, 2024-04-19T02:16:40.584 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:40.584 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:40.584 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:40.584 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:40.584 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:40.584 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 77623 2024-04-19T02:16:40.584 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.584 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:40.584 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.584 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:40.584 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.807355+0000", 2024-04-19T02:16:40.584 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.584 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.584 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.584 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:40.584 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.807355+0000", 2024-04-19T02:16:40.585 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.585 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.585 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.585 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:40.585 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.807353+0000", 2024-04-19T02:16:40.585 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:40.585 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.585 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.585 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:40.585 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.807433+0000", 2024-04-19T02:16:40.585 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9938999999999995e-05 2024-04-19T02:16:40.585 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.585 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.585 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:40.585 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.807443+0000", 2024-04-19T02:16:40.586 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0193e-05 2024-04-19T02:16:40.586 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.586 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.586 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:40.586 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.807451+0000", 2024-04-19T02:16:40.586 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.204e-06 2024-04-19T02:16:40.586 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.586 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.586 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:40.586 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.814228+0000", 2024-04-19T02:16:40.586 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0067777740000000003 2024-04-19T02:16:40.586 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.586 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.586 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:40.586 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.814355+0000", 2024-04-19T02:16:40.587 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012678400000000001 2024-04-19T02:16:40.587 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.587 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.587 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:40.587 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.814439+0000", 2024-04-19T02:16:40.587 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.3752999999999996e-05 2024-04-19T02:16:40.587 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.587 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.587 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:40.587 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.823137+0000", 2024-04-19T02:16:40.587 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0086980159999999994 2024-04-19T02:16:40.587 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.587 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.587 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:40.587 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827390+0000", 2024-04-19T02:16:40.588 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0042527659999999998 2024-04-19T02:16:40.588 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.588 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.588 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:40.588 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827426+0000", 2024-04-19T02:16:40.588 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5809000000000002e-05 2024-04-19T02:16:40.588 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.588 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.588 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:40.588 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827447+0000", 2024-04-19T02:16:40.588 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1892999999999999e-05 2024-04-19T02:16:40.588 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.588 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:40.588 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.588 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.589 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.589 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78224 5.4 5:26e797d5:::benchmark_data_smithi121_44835_object78223:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:40.589 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:16:40.589 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 13.42682737, 2024-04-19T02:16:40.589 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.021471998999999999, 2024-04-19T02:16:40.589 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:40.589 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:40.589 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:40.589 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:40.589 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:40.589 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78224 2024-04-19T02:16:40.589 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.589 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:40.589 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.589 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:40.590 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:16:40.590 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.590 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.590 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.590 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:40.590 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:16:40.590 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.590 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.590 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.590 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:40.590 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106561+0000", 2024-04-19T02:16:40.590 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:40.590 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.590 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.591 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:40.591 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106630+0000", 2024-04-19T02:16:40.591 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.8553999999999994e-05 2024-04-19T02:16:40.591 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.591 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.591 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:40.591 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106644+0000", 2024-04-19T02:16:40.591 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.4651000000000001e-05 2024-04-19T02:16:40.591 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.591 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.591 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:40.591 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106653+0000", 2024-04-19T02:16:40.591 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.6719999999999993e-06 2024-04-19T02:16:40.591 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.591 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.592 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:40.592 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106693+0000", 2024-04-19T02:16:40.592 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9978999999999998e-05 2024-04-19T02:16:40.592 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.592 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.592 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:40.592 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106840+0000", 2024-04-19T02:16:40.592 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0001473 2024-04-19T02:16:40.592 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.592 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.592 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:40.592 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106971+0000", 2024-04-19T02:16:40.592 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013051499999999999 2024-04-19T02:16:40.592 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.593 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.593 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:40.593 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.109047+0000", 2024-04-19T02:16:40.593 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.002076002 2024-04-19T02:16:40.593 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.593 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.593 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:40.593 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.127967+0000", 2024-04-19T02:16:40.593 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.018919780000000001 2024-04-19T02:16:40.593 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.593 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.593 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:40.593 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128004+0000", 2024-04-19T02:16:40.593 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7719000000000003e-05 2024-04-19T02:16:40.593 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.593 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.594 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:40.594 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128034+0000", 2024-04-19T02:16:40.594 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9651000000000001e-05 2024-04-19T02:16:40.594 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.594 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:40.594 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.594 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.594 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.594 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78259 5.4 5:2aa344b2:::benchmark_data_smithi121_44835_object78258:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:40.594 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:16:40.594 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 13.408132301, 2024-04-19T02:16:40.594 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022934350999999999, 2024-04-19T02:16:40.594 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:40.594 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:40.595 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:40.595 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:40.595 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:40.595 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78259 2024-04-19T02:16:40.595 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.595 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:40.595 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.595 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:40.595 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:16:40.595 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.595 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.595 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.595 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:40.595 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:16:40.595 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.595 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.596 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.596 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:40.596 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125256+0000", 2024-04-19T02:16:40.596 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:40.596 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.596 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.596 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:40.596 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125347+0000", 2024-04-19T02:16:40.596 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0470000000000006e-05 2024-04-19T02:16:40.596 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.596 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.596 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:40.596 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125358+0000", 2024-04-19T02:16:40.596 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1764e-05 2024-04-19T02:16:40.596 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.597 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.597 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:40.597 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125364+0000", 2024-04-19T02:16:40.597 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7189999999999998e-06 2024-04-19T02:16:40.597 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.597 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.597 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:40.597 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125391+0000", 2024-04-19T02:16:40.597 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7270000000000001e-05 2024-04-19T02:16:40.597 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.597 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.597 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:40.597 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125471+0000", 2024-04-19T02:16:40.597 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9209999999999995e-05 2024-04-19T02:16:40.597 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.598 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.598 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:40.598 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125559+0000", 2024-04-19T02:16:40.598 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.8689000000000004e-05 2024-04-19T02:16:40.598 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.598 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.598 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:40.598 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128164+0000", 2024-04-19T02:16:40.598 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0026050270000000002 2024-04-19T02:16:40.598 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.598 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.598 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:40.598 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148139+0000", 2024-04-19T02:16:40.598 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.019975050000000001 2024-04-19T02:16:40.599 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.599 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.599 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:40.599 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148169+0000", 2024-04-19T02:16:40.599 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0001e-05 2024-04-19T02:16:40.599 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.599 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.599 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:40.599 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148191+0000", 2024-04-19T02:16:40.599 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.2104999999999999e-05 2024-04-19T02:16:40.599 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.599 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:40.599 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.599 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.599 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.600 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78271 5.4 5:2982d7a6:::benchmark_data_smithi121_44835_object78270:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:40.600 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:16:40.600 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 13.401269071, 2024-04-19T02:16:40.600 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020841755999999999, 2024-04-19T02:16:40.600 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:40.600 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:40.600 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:40.600 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:40.600 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:40.600 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78271 2024-04-19T02:16:40.600 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.600 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:40.600 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.600 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:40.600 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:16:40.601 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.601 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.601 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.601 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:40.601 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:16:40.601 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.601 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.601 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.601 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:40.601 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132119+0000", 2024-04-19T02:16:40.601 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:40.601 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.601 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.601 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:40.601 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132185+0000", 2024-04-19T02:16:40.602 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5994000000000005e-05 2024-04-19T02:16:40.602 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.602 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.602 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:40.602 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132197+0000", 2024-04-19T02:16:40.602 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2091e-05 2024-04-19T02:16:40.602 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.602 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.602 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:40.602 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132206+0000", 2024-04-19T02:16:40.602 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.5099999999999998e-06 2024-04-19T02:16:40.602 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.602 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.602 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:40.603 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132242+0000", 2024-04-19T02:16:40.603 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5663000000000001e-05 2024-04-19T02:16:40.603 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.603 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.603 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:40.603 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132335+0000", 2024-04-19T02:16:40.603 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3275000000000004e-05 2024-04-19T02:16:40.603 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.603 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.603 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:40.603 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132432+0000", 2024-04-19T02:16:40.603 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7571000000000005e-05 2024-04-19T02:16:40.603 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.603 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.604 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:40.604 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.136706+0000", 2024-04-19T02:16:40.604 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0042738170000000001 2024-04-19T02:16:40.604 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.604 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.604 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:40.604 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152909+0000", 2024-04-19T02:16:40.604 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016202415000000001 2024-04-19T02:16:40.604 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.604 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.604 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:40.604 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152938+0000", 2024-04-19T02:16:40.604 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9740999999999999e-05 2024-04-19T02:16:40.604 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.605 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.605 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:40.605 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152962+0000", 2024-04-19T02:16:40.605 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3659000000000002e-05 2024-04-19T02:16:40.605 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.605 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:40.605 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.605 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.605 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.605 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78272 5.4 5:273e819a:::benchmark_data_smithi121_44835_object78271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:40.605 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:16:40.606 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 13.400780028, 2024-04-19T02:16:40.606 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022180163999999999, 2024-04-19T02:16:40.606 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:40.606 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:40.606 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:40.606 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:40.606 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:40.606 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78272 2024-04-19T02:16:40.606 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.606 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:40.606 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.606 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:40.606 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:16:40.607 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.607 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.607 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.607 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:40.607 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:16:40.607 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.607 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.607 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.607 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:40.607 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:16:40.607 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:40.608 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.608 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.608 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:40.608 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132690+0000", 2024-04-19T02:16:40.608 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0963000000000004e-05 2024-04-19T02:16:40.608 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.608 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.608 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:40.608 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132703+0000", 2024-04-19T02:16:40.608 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.3072e-05 2024-04-19T02:16:40.608 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.608 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.609 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:40.609 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132710+0000", 2024-04-19T02:16:40.609 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3100000000000003e-06 2024-04-19T02:16:40.609 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.609 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.609 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:40.609 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134005+0000", 2024-04-19T02:16:40.609 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001294513 2024-04-19T02:16:40.609 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.609 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.609 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:40.609 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134139+0000", 2024-04-19T02:16:40.609 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000134447 2024-04-19T02:16:40.609 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.610 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.610 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:40.610 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134284+0000", 2024-04-19T02:16:40.610 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014514399999999999 2024-04-19T02:16:40.610 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.610 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.610 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:40.610 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.139622+0000", 2024-04-19T02:16:40.610 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0053373830000000002 2024-04-19T02:16:40.610 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.610 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.610 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:40.610 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154737+0000", 2024-04-19T02:16:40.610 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015115195999999999 2024-04-19T02:16:40.611 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.611 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.611 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:40.611 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154768+0000", 2024-04-19T02:16:40.611 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0824999999999997e-05 2024-04-19T02:16:40.611 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.611 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.611 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:40.611 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154790+0000", 2024-04-19T02:16:40.611 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1999000000000001e-05 2024-04-19T02:16:40.611 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.611 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:40.611 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.611 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.611 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.612 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78865 5.4 5:2abefe97:::benchmark_data_smithi121_44835_object78864:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:40.612 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.427133+0000", 2024-04-19T02:16:40.612 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 13.106256567000001, 2024-04-19T02:16:40.612 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020107725999999999, 2024-04-19T02:16:40.612 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:40.612 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:40.612 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:40.612 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:40.612 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:40.612 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78865 2024-04-19T02:16:40.612 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.612 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:40.612 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.612 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:40.613 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.427133+0000", 2024-04-19T02:16:40.613 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.613 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.613 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.613 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:40.613 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.427133+0000", 2024-04-19T02:16:40.613 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.613 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.613 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.613 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:40.613 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.427132+0000", 2024-04-19T02:16:40.613 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:40.613 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.613 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.613 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:40.614 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.427196+0000", 2024-04-19T02:16:40.614 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.3866000000000001e-05 2024-04-19T02:16:40.614 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.614 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.614 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:40.614 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.427205+0000", 2024-04-19T02:16:40.614 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.6810000000000004e-06 2024-04-19T02:16:40.614 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.614 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.614 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:40.614 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.427210+0000", 2024-04-19T02:16:40.614 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.6110000000000001e-06 2024-04-19T02:16:40.614 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.614 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.615 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:40.615 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.431822+0000", 2024-04-19T02:16:40.615 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0046120110000000001 2024-04-19T02:16:40.615 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.615 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.615 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:40.615 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.431952+0000", 2024-04-19T02:16:40.615 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000129474 2024-04-19T02:16:40.615 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.615 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.615 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:40.615 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.432087+0000", 2024-04-19T02:16:40.615 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013454 2024-04-19T02:16:40.615 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.615 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.616 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:40.616 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.439095+0000", 2024-04-19T02:16:40.616 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0070082160000000003 2024-04-19T02:16:40.616 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.616 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.616 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:40.616 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.447183+0000", 2024-04-19T02:16:40.616 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0080887690000000009 2024-04-19T02:16:40.616 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.616 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.616 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:40.616 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.447214+0000", 2024-04-19T02:16:40.616 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0131999999999999e-05 2024-04-19T02:16:40.616 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.616 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.617 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:40.617 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.447241+0000", 2024-04-19T02:16:40.617 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.6974999999999998e-05 2024-04-19T02:16:40.617 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.617 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:40.617 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.617 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.617 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.617 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:94475 5.e 5:7a360208:::benchmark_data_smithi121_44835_object94474:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:40.617 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:35.118023+0000", 2024-04-19T02:16:40.617 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 5.4153660879999999, 2024-04-19T02:16:40.617 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020591993999999999, 2024-04-19T02:16:40.617 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:40.617 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:40.617 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:40.618 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:40.618 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:40.618 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 94475 2024-04-19T02:16:40.618 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.618 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:40.618 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.618 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:40.618 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118023+0000", 2024-04-19T02:16:40.618 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.618 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.618 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.618 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:40.618 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118023+0000", 2024-04-19T02:16:40.618 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.619 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.619 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.619 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:40.619 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118023+0000", 2024-04-19T02:16:40.619 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:40.619 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.619 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.619 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:40.619 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118041+0000", 2024-04-19T02:16:40.619 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.8689999999999999e-05 2024-04-19T02:16:40.619 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.619 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.619 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:40.619 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118049+0000", 2024-04-19T02:16:40.619 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.5939999999999996e-06 2024-04-19T02:16:40.620 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.620 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.620 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:40.620 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118053+0000", 2024-04-19T02:16:40.620 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2080000000000002e-06 2024-04-19T02:16:40.620 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.620 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.620 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:40.620 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118093+0000", 2024-04-19T02:16:40.620 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9634e-05 2024-04-19T02:16:40.620 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.620 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.620 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:40.620 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118191+0000", 2024-04-19T02:16:40.620 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.8272999999999999e-05 2024-04-19T02:16:40.621 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.621 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.621 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:40.621 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118280+0000", 2024-04-19T02:16:40.621 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.8702999999999994e-05 2024-04-19T02:16:40.621 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.621 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.621 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:40.621 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.124833+0000", 2024-04-19T02:16:40.621 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0065528180000000002 2024-04-19T02:16:40.621 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.621 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.622 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:40.622 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.138520+0000", 2024-04-19T02:16:40.622 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.013686959 2024-04-19T02:16:40.622 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.622 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.622 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:40.622 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.138577+0000", 2024-04-19T02:16:40.622 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7689000000000003e-05 2024-04-19T02:16:40.622 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.622 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.622 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:40.622 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.138615+0000", 2024-04-19T02:16:40.622 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8016999999999999e-05 2024-04-19T02:16:40.622 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.623 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:40.623 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.623 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.623 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.623 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:94481 5.e 5:7b2fbebf:::benchmark_data_smithi121_44835_object94480:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:40.623 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:16:40.623 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 5.4121437109999997, 2024-04-19T02:16:40.623 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020897846000000001, 2024-04-19T02:16:40.623 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:40.623 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:40.623 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:40.623 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:40.623 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:40.623 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 94481 2024-04-19T02:16:40.623 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.624 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:40.624 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.624 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:40.624 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:16:40.624 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.624 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.624 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.624 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:40.624 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:16:40.624 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.624 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.624 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.625 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:40.625 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121245+0000", 2024-04-19T02:16:40.625 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:40.625 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.625 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.625 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:40.625 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121273+0000", 2024-04-19T02:16:40.625 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7250000000000002e-05 2024-04-19T02:16:40.625 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.625 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.625 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:40.625 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121277+0000", 2024-04-19T02:16:40.625 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2860000000000001e-06 2024-04-19T02:16:40.625 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.625 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.626 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:40.626 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121280+0000", 2024-04-19T02:16:40.626 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2739999999999999e-06 2024-04-19T02:16:40.626 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.626 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.626 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:40.626 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121320+0000", 2024-04-19T02:16:40.626 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9879000000000002e-05 2024-04-19T02:16:40.626 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.626 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.626 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:40.626 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121448+0000", 2024-04-19T02:16:40.626 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012748800000000001 2024-04-19T02:16:40.626 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.627 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.627 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:40.627 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121595+0000", 2024-04-19T02:16:40.627 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014741299999999999 2024-04-19T02:16:40.627 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.627 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.627 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:40.627 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.127776+0000", 2024-04-19T02:16:40.627 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0061811360000000003 2024-04-19T02:16:40.627 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.627 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.627 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:40.627 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142073+0000", 2024-04-19T02:16:40.627 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014296959999999999 2024-04-19T02:16:40.628 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.628 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.628 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:40.628 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142106+0000", 2024-04-19T02:16:40.628 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3348e-05 2024-04-19T02:16:40.628 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.628 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.628 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:40.628 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142144+0000", 2024-04-19T02:16:40.628 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7153000000000002e-05 2024-04-19T02:16:40.628 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.628 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:40.628 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.628 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.629 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.629 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:94581 5.b 5:dc86d6e9:::benchmark_data_smithi121_44835_object94580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:40.629 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:16:40.629 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 5.3532091380000004, 2024-04-19T02:16:40.629 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022099711000000001, 2024-04-19T02:16:40.629 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:40.629 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:40.629 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:40.629 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:40.629 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:40.629 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 94581 2024-04-19T02:16:40.629 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.629 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:40.629 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.629 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:40.630 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:16:40.630 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.630 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.630 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.630 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:40.630 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:16:40.630 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.630 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.630 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.630 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:40.630 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:16:40.630 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:40.630 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.630 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.631 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:40.631 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180253+0000", 2024-04-19T02:16:40.631 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3163000000000004e-05 2024-04-19T02:16:40.631 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.631 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.631 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:40.631 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180266+0000", 2024-04-19T02:16:40.631 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2886e-05 2024-04-19T02:16:40.631 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.631 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.631 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:40.631 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180273+0000", 2024-04-19T02:16:40.631 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.4059999999999999e-06 2024-04-19T02:16:40.631 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.631 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.632 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:40.632 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180646+0000", 2024-04-19T02:16:40.632 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00037283999999999999 2024-04-19T02:16:40.632 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.632 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.632 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:40.632 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180774+0000", 2024-04-19T02:16:40.632 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012793799999999999 2024-04-19T02:16:40.632 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.632 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.632 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:40.632 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180920+0000", 2024-04-19T02:16:40.632 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000146692 2024-04-19T02:16:40.632 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.632 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.633 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:40.633 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.183344+0000", 2024-04-19T02:16:40.633 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0024231669999999999 2024-04-19T02:16:40.633 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.633 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.633 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:40.633 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202196+0000", 2024-04-19T02:16:40.633 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.018852384 2024-04-19T02:16:40.633 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.633 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.633 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:40.633 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202241+0000", 2024-04-19T02:16:40.633 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4923999999999999e-05 2024-04-19T02:16:40.633 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.633 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.634 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:40.634 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202280+0000", 2024-04-19T02:16:40.634 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9096e-05 2024-04-19T02:16:40.634 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.634 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:40.634 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.634 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.634 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.634 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:96356 5.0 5:0a661b39:::benchmark_data_smithi121_44835_object96355:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:40.634 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:16:40.634 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 4.4399962960000003, 2024-04-19T02:16:40.634 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020955516, 2024-04-19T02:16:40.634 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:40.634 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:40.635 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:40.635 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:40.635 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:40.635 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 96356 2024-04-19T02:16:40.635 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.635 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:40.635 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.635 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:40.635 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:16:40.635 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.635 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.635 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.635 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:40.635 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:16:40.635 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.635 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.636 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.636 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:40.636 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:16:40.636 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:40.636 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.636 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.636 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:40.636 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093455+0000", 2024-04-19T02:16:40.636 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.2205000000000005e-05 2024-04-19T02:16:40.636 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.636 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.636 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:40.636 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093464+0000", 2024-04-19T02:16:40.636 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3910000000000004e-06 2024-04-19T02:16:40.636 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.637 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.637 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:40.637 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093469+0000", 2024-04-19T02:16:40.637 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.7249999999999997e-06 2024-04-19T02:16:40.637 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.637 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.637 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:40.637 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099643+0000", 2024-04-19T02:16:40.637 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0061743359999999999 2024-04-19T02:16:40.637 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.637 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.637 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:40.637 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099774+0000", 2024-04-19T02:16:40.637 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013050599999999999 2024-04-19T02:16:40.638 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.638 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.638 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:40.638 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099917+0000", 2024-04-19T02:16:40.638 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000143187 2024-04-19T02:16:40.638 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.638 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.638 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:40.638 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.105432+0000", 2024-04-19T02:16:40.638 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.005514873 2024-04-19T02:16:40.638 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.638 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.638 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:40.638 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114264+0000", 2024-04-19T02:16:40.639 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.008831752 2024-04-19T02:16:40.639 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.639 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.639 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:40.639 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114300+0000", 2024-04-19T02:16:40.639 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6582000000000003e-05 2024-04-19T02:16:40.639 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.639 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.639 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:40.639 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114349+0000", 2024-04-19T02:16:40.639 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8579999999999999e-05 2024-04-19T02:16:40.639 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.639 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:40.639 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.640 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.640 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.640 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:96357 5.0 5:00efce8b:::benchmark_data_smithi121_44835_object96356:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:40.640 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:16:40.640 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 4.4399166179999998, 2024-04-19T02:16:40.640 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020937471999999999, 2024-04-19T02:16:40.640 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:40.640 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:40.640 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:40.640 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:40.640 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:40.640 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 96357 2024-04-19T02:16:40.640 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.640 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:40.640 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.641 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:40.641 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:16:40.641 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.641 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.641 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.641 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:40.641 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:16:40.641 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.641 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.641 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.641 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:40.641 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093472+0000", 2024-04-19T02:16:40.641 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:40.641 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.642 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.642 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:40.642 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093513+0000", 2024-04-19T02:16:40.642 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0213000000000003e-05 2024-04-19T02:16:40.642 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.642 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.642 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:40.642 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093519+0000", 2024-04-19T02:16:40.642 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.066e-06 2024-04-19T02:16:40.642 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.642 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.642 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:40.642 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093525+0000", 2024-04-19T02:16:40.642 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.8170000000000004e-06 2024-04-19T02:16:40.642 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.643 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.643 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:40.643 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103412+0000", 2024-04-19T02:16:40.643 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0098872739999999997 2024-04-19T02:16:40.643 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.643 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.643 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:40.643 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103551+0000", 2024-04-19T02:16:40.643 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000139295 2024-04-19T02:16:40.643 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.643 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.643 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:40.643 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103701+0000", 2024-04-19T02:16:40.643 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014954599999999999 2024-04-19T02:16:40.644 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.644 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.644 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:40.644 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.108849+0000", 2024-04-19T02:16:40.644 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0051487199999999999 2024-04-19T02:16:40.644 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.644 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.644 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:40.644 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114355+0000", 2024-04-19T02:16:40.644 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0055052529999999999 2024-04-19T02:16:40.644 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.644 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.644 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:40.644 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114379+0000", 2024-04-19T02:16:40.644 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4275000000000001e-05 2024-04-19T02:16:40.644 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.645 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.645 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:40.645 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114410+0000", 2024-04-19T02:16:40.645 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1356999999999998e-05 2024-04-19T02:16:40.645 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.645 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:40.645 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.645 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.645 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.645 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:104431 5.8 5:14818e19:::benchmark_data_smithi121_44835_object104430:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T02:16:40.645 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:16:40.645 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.32200409299999999, 2024-04-19T02:16:40.645 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022149528000000002, 2024-04-19T02:16:40.645 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:40.645 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:40.646 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:40.646 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:40.646 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:40.646 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 104431 2024-04-19T02:16:40.646 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.646 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:40.646 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.646 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:40.646 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:16:40.646 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.646 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.646 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.646 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:40.646 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:16:40.646 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:40.647 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.647 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.647 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:40.647 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211384+0000", 2024-04-19T02:16:40.647 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:40.647 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.647 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.647 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:40.647 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211458+0000", 2024-04-19T02:16:40.647 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3311000000000003e-05 2024-04-19T02:16:40.647 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.647 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.647 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:40.647 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211471+0000", 2024-04-19T02:16:40.647 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.3308e-05 2024-04-19T02:16:40.648 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.648 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.648 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:40.648 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211479+0000", 2024-04-19T02:16:40.648 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0909999999999993e-06 2024-04-19T02:16:40.648 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.648 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.648 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:40.648 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.221821+0000", 2024-04-19T02:16:40.648 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010341596999999999 2024-04-19T02:16:40.648 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.648 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.648 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:40.648 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.221966+0000", 2024-04-19T02:16:40.648 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000145167 2024-04-19T02:16:40.649 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.649 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.649 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:40.649 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.222077+0000", 2024-04-19T02:16:40.649 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011128000000000001 2024-04-19T02:16:40.649 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.649 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.649 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:40.649 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.228126+0000", 2024-04-19T02:16:40.649 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0060486710000000003 2024-04-19T02:16:40.649 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.649 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.649 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:40.649 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233449+0000", 2024-04-19T02:16:40.649 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0053231370000000004 2024-04-19T02:16:40.650 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.650 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.650 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:40.650 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233498+0000", 2024-04-19T02:16:40.650 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8798999999999998e-05 2024-04-19T02:16:40.650 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:40.650 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:40.650 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:40.650 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233535+0000", 2024-04-19T02:16:40.650 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7119000000000002e-05 2024-04-19T02:16:40.650 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.650 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:40.650 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.650 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:40.650 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:40.651 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:16:40.652 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:40.651+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:40.652 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:16:40.753 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:40.753+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:40.836 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-04-19T02:16:40.836 INFO:teuthology.orchestra.run.smithi177.stdout: "ops": [ 2024-04-19T02:16:40.836 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.836 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:105667 5.a 5:58bce481:::benchmark_data_smithi121_44835_object105666:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T02:16:40.836 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:40.830170+0000", 2024-04-19T02:16:40.836 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0063399850000000002, 2024-04-19T02:16:40.837 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0063704929999999996, 2024-04-19T02:16:40.837 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:40.837 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:40.837 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:40.837 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:40.837 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:40.837 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 105667 2024-04-19T02:16:40.837 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.837 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:40.837 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.837 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:40.837 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.830170+0000", 2024-04-19T02:16:40.837 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:40.837 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.837 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.838 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:40.838 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.830170+0000", 2024-04-19T02:16:40.838 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:40.838 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.838 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.838 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:40.838 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.830169+0000", 2024-04-19T02:16:40.838 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:40.838 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.838 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.838 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:40.838 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.830219+0000", 2024-04-19T02:16:40.838 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.9496000000000002e-05 2024-04-19T02:16:40.838 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.839 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.839 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:40.839 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.830229+0000", 2024-04-19T02:16:40.839 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0382e-05 2024-04-19T02:16:40.839 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.839 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.839 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:40.839 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.830237+0000", 2024-04-19T02:16:40.839 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.7389999999999999e-06 2024-04-19T02:16:40.839 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.839 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.839 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:40.839 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.834193+0000", 2024-04-19T02:16:40.839 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0039556590000000003 2024-04-19T02:16:40.839 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.840 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.840 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:40.840 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.834323+0000", 2024-04-19T02:16:40.840 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00013075599999999999 2024-04-19T02:16:40.840 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.840 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.840 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:40.840 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.834465+0000", 2024-04-19T02:16:40.840 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00014202299999999999 2024-04-19T02:16:40.840 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.840 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.840 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:40.840 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.836420+0000", 2024-04-19T02:16:40.840 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0019542209999999999 2024-04-19T02:16:40.841 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:40.841 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:40.841 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:40.841 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.841 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.841 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:105668 5.6 5:6f8fc45f:::benchmark_data_smithi121_44835_object105667:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T02:16:40.841 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:40.830806+0000", 2024-04-19T02:16:40.841 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0057036049999999996, 2024-04-19T02:16:40.841 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0058176069999999998, 2024-04-19T02:16:40.841 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:40.841 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:40.841 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:40.841 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:40.841 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:40.841 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 105668 2024-04-19T02:16:40.842 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.842 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:40.842 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.842 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:40.842 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.830806+0000", 2024-04-19T02:16:40.842 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:40.842 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.842 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.842 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:40.842 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.830806+0000", 2024-04-19T02:16:40.842 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:40.842 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.842 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.842 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:40.843 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.830806+0000", 2024-04-19T02:16:40.843 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:40.843 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.843 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.843 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:40.843 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.830900+0000", 2024-04-19T02:16:40.843 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.4308999999999994e-05 2024-04-19T02:16:40.843 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.843 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.843 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:40.843 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.830909+0000", 2024-04-19T02:16:40.843 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.2040000000000003e-06 2024-04-19T02:16:40.843 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.843 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.844 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:40.844 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.830917+0000", 2024-04-19T02:16:40.844 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.7319999999999998e-06 2024-04-19T02:16:40.844 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.844 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.844 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:40.844 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.830958+0000", 2024-04-19T02:16:40.844 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.1146999999999998e-05 2024-04-19T02:16:40.844 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.844 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.844 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:40.844 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.831033+0000", 2024-04-19T02:16:40.844 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.5421999999999997e-05 2024-04-19T02:16:40.844 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.844 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.845 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:40.845 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.831129+0000", 2024-04-19T02:16:40.845 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.5488000000000005e-05 2024-04-19T02:16:40.845 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.845 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.845 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:40.845 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.836187+0000", 2024-04-19T02:16:40.845 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0050581159999999997 2024-04-19T02:16:40.845 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:40.845 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:40.845 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:40.845 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.845 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.845 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:105665 5.4 e38/16 5:2bab7fac:::benchmark_data_smithi121_44835_object105664:head v 38'6527, mlcod=38'6523)", 2024-04-19T02:16:40.845 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:40.830812+0000", 2024-04-19T02:16:40.846 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0056983809999999998, 2024-04-19T02:16:40.846 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0058892240000000002, 2024-04-19T02:16:40.846 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:40.846 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:40.846 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:40.846 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.846 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:40.846 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.830812+0000", 2024-04-19T02:16:40.846 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:40.846 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.846 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.846 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:40.846 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.830812+0000", 2024-04-19T02:16:40.847 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:40.847 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.847 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.847 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:40.847 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.830811+0000", 2024-04-19T02:16:40.847 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:40.847 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.847 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.847 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:40.847 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.830924+0000", 2024-04-19T02:16:40.847 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000112553 2024-04-19T02:16:40.847 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.847 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.847 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:40.847 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.830931+0000", 2024-04-19T02:16:40.848 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.5079999999999999e-06 2024-04-19T02:16:40.848 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.848 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.848 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:40.848 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.830937+0000", 2024-04-19T02:16:40.848 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.9229999999999999e-06 2024-04-19T02:16:40.848 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.848 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.848 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:40.848 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.832863+0000", 2024-04-19T02:16:40.848 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0019257600000000001 2024-04-19T02:16:40.848 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.848 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.848 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:40.848 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.832875+0000", 2024-04-19T02:16:40.849 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.1766999999999999e-05 2024-04-19T02:16:40.849 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:40.849 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:40.849 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:40.849 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.849 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.849 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:105659 5.2 e38/16 5:47de1e1b:::benchmark_data_smithi121_44835_object105658:head v 38'6621, mlcod=38'6615)", 2024-04-19T02:16:40.849 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:40.828247+0000", 2024-04-19T02:16:40.849 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0082628800000000002, 2024-04-19T02:16:40.849 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0084976840000000001, 2024-04-19T02:16:40.849 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:40.849 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:40.849 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:40.850 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.850 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:40.850 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.828247+0000", 2024-04-19T02:16:40.850 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:40.850 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.850 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.850 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:40.850 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.828247+0000", 2024-04-19T02:16:40.850 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:40.850 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.850 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.850 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:40.850 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.828247+0000", 2024-04-19T02:16:40.850 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:40.851 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.851 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.851 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:40.851 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.828299+0000", 2024-04-19T02:16:40.851 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.1906000000000001e-05 2024-04-19T02:16:40.851 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.851 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.851 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:40.851 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.828306+0000", 2024-04-19T02:16:40.851 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.0489999999999998e-06 2024-04-19T02:16:40.851 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.851 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.851 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:40.851 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.828309+0000", 2024-04-19T02:16:40.851 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6200000000000001e-06 2024-04-19T02:16:40.852 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.852 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.852 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:40.852 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.830538+0000", 2024-04-19T02:16:40.852 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0022286929999999999 2024-04-19T02:16:40.852 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.852 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.852 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:40.852 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.830556+0000", 2024-04-19T02:16:40.852 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.84e-05 2024-04-19T02:16:40.852 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:40.852 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:40.852 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:40.852 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.852 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.853 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:105661 5.c 5:387a312a:::benchmark_data_smithi121_44835_object105660:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T02:16:40.853 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:40.828871+0000", 2024-04-19T02:16:40.853 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0076390700000000004, 2024-04-19T02:16:40.853 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0079149790000000008, 2024-04-19T02:16:40.853 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:40.853 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:40.853 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:40.853 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:40.853 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:40.853 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 105661 2024-04-19T02:16:40.853 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.853 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:40.853 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.853 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:40.853 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.828871+0000", 2024-04-19T02:16:40.854 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:40.854 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.854 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.854 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:40.854 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.828871+0000", 2024-04-19T02:16:40.854 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:40.854 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.854 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.854 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:40.854 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.828870+0000", 2024-04-19T02:16:40.854 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:40.854 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.854 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.854 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:40.854 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.828900+0000", 2024-04-19T02:16:40.855 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.0035e-05 2024-04-19T02:16:40.855 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.855 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.855 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:40.855 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.828907+0000", 2024-04-19T02:16:40.855 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.6780000000000003e-06 2024-04-19T02:16:40.855 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.855 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.855 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:40.855 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.828911+0000", 2024-04-19T02:16:40.855 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.6489999999999999e-06 2024-04-19T02:16:40.855 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.855 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.855 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:40.855 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.828944+0000", 2024-04-19T02:16:40.856 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.3089000000000001e-05 2024-04-19T02:16:40.856 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.856 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.856 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:40.856 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.829040+0000", 2024-04-19T02:16:40.856 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.5987000000000001e-05 2024-04-19T02:16:40.856 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.856 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.856 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:40.856 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.829160+0000", 2024-04-19T02:16:40.856 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0001193 2024-04-19T02:16:40.856 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.856 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.856 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:40.856 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.832965+0000", 2024-04-19T02:16:40.857 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.003805419 2024-04-19T02:16:40.857 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:40.857 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:40.857 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:40.857 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.857 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.857 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:105664 5.3 5:c9082f96:::benchmark_data_smithi121_44835_object105663:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T02:16:40.857 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:40.829044+0000", 2024-04-19T02:16:40.857 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0074659449999999999, 2024-04-19T02:16:40.857 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0078057140000000001, 2024-04-19T02:16:40.857 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:40.857 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:40.857 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:40.857 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:40.857 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:40.858 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 105664 2024-04-19T02:16:40.858 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.858 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:40.858 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.858 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:40.858 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.829044+0000", 2024-04-19T02:16:40.858 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:40.858 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.858 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.858 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:40.858 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.829044+0000", 2024-04-19T02:16:40.858 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:40.858 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.858 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.858 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:40.859 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.829043+0000", 2024-04-19T02:16:40.859 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:40.859 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.859 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.859 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:40.859 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.829156+0000", 2024-04-19T02:16:40.859 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000112519 2024-04-19T02:16:40.859 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.859 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.859 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:40.859 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.829166+0000", 2024-04-19T02:16:40.859 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0315e-05 2024-04-19T02:16:40.859 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.859 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.859 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:40.860 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.829173+0000", 2024-04-19T02:16:40.860 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.1040000000000001e-06 2024-04-19T02:16:40.860 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.860 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.860 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:40.860 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.829212+0000", 2024-04-19T02:16:40.860 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.9057000000000002e-05 2024-04-19T02:16:40.860 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.860 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.860 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:40.860 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.829395+0000", 2024-04-19T02:16:40.860 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00018284900000000001 2024-04-19T02:16:40.860 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.860 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.860 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:40.861 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.829685+0000", 2024-04-19T02:16:40.861 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000289473 2024-04-19T02:16:40.861 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.861 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.861 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:40.861 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.834099+0000", 2024-04-19T02:16:40.861 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0044143259999999997 2024-04-19T02:16:40.861 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:40.861 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:40.861 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:40.861 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.861 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.861 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:105662 5.4 e38/16 5:21cb29f2:::benchmark_data_smithi121_44835_object105661:head v 38'6526, mlcod=38'6523)", 2024-04-19T02:16:40.861 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:40.829223+0000", 2024-04-19T02:16:40.861 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.007287282, 2024-04-19T02:16:40.862 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0076944200000000004, 2024-04-19T02:16:40.862 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:40.862 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:40.862 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:40.862 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.862 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:40.862 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.829223+0000", 2024-04-19T02:16:40.862 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:40.862 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.862 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.862 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:40.862 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.829223+0000", 2024-04-19T02:16:40.862 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:40.862 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.863 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.863 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:40.863 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.829222+0000", 2024-04-19T02:16:40.863 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:40.863 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.863 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.863 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:40.863 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.829271+0000", 2024-04-19T02:16:40.863 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.8757000000000001e-05 2024-04-19T02:16:40.863 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.863 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.863 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:40.863 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.829280+0000", 2024-04-19T02:16:40.863 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.9090000000000006e-06 2024-04-19T02:16:40.863 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.864 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.864 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:40.864 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.829285+0000", 2024-04-19T02:16:40.864 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.5430000000000001e-06 2024-04-19T02:16:40.864 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.864 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.864 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:40.864 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.830908+0000", 2024-04-19T02:16:40.864 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.001622723 2024-04-19T02:16:40.864 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.864 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.864 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:40.864 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.830927+0000", 2024-04-19T02:16:40.864 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.8892000000000001e-05 2024-04-19T02:16:40.864 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:40.865 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:40.865 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:40.865 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.865 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.865 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:105666 5.5 5:ad665898:::benchmark_data_smithi121_44835_object105665:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T02:16:40.865 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:40.829249+0000", 2024-04-19T02:16:40.865 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0072610130000000002, 2024-04-19T02:16:40.865 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0077415399999999999, 2024-04-19T02:16:40.865 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:40.865 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:40.865 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:40.865 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:40.865 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:40.865 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 105666 2024-04-19T02:16:40.865 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.866 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:40.866 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.866 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:40.866 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.829249+0000", 2024-04-19T02:16:40.866 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:40.866 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.866 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.866 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:40.866 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.829249+0000", 2024-04-19T02:16:40.866 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:40.866 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.866 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.866 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:40.866 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.829248+0000", 2024-04-19T02:16:40.867 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:40.867 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.867 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.867 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:40.867 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.829333+0000", 2024-04-19T02:16:40.867 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.4464999999999999e-05 2024-04-19T02:16:40.867 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.867 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.867 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:40.867 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.829341+0000", 2024-04-19T02:16:40.867 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.8210000000000002e-06 2024-04-19T02:16:40.867 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.867 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.867 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:40.867 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.829346+0000", 2024-04-19T02:16:40.868 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.6230000000000002e-06 2024-04-19T02:16:40.868 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.868 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.868 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:40.868 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.829491+0000", 2024-04-19T02:16:40.868 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00014443600000000001 2024-04-19T02:16:40.868 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.868 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.868 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:40.868 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.830918+0000", 2024-04-19T02:16:40.868 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.001427687 2024-04-19T02:16:40.868 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.868 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.868 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:40.868 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.831064+0000", 2024-04-19T02:16:40.868 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00014571899999999999 2024-04-19T02:16:40.869 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.869 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.869 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:40.869 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.836000+0000", 2024-04-19T02:16:40.869 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.004935521 2024-04-19T02:16:40.869 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.869 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.869 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:40.869 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.836956+0000", 2024-04-19T02:16:40.869 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00095619499999999996 2024-04-19T02:16:40.869 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.869 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.869 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:40.869 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.836984+0000", 2024-04-19T02:16:40.869 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.8411e-05 2024-04-19T02:16:40.870 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:40.870 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:40.870 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:40.870 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.870 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.870 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:105660 5.2 e38/16 5:464bf73c:::benchmark_data_smithi121_44835_object105659:head v 38'6622, mlcod=38'6617)", 2024-04-19T02:16:40.870 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:40.829444+0000", 2024-04-19T02:16:40.870 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0070663269999999999, 2024-04-19T02:16:40.870 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0076324790000000002, 2024-04-19T02:16:40.870 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:40.870 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:40.870 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:40.870 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.870 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:40.871 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.829444+0000", 2024-04-19T02:16:40.871 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:40.871 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.871 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.871 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:40.871 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.829444+0000", 2024-04-19T02:16:40.871 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:40.871 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.871 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.871 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:40.871 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.829443+0000", 2024-04-19T02:16:40.871 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:40.871 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.871 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.871 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:40.872 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.829511+0000", 2024-04-19T02:16:40.872 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.8189999999999996e-05 2024-04-19T02:16:40.872 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.872 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.872 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:40.872 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.829518+0000", 2024-04-19T02:16:40.872 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.2049999999999996e-06 2024-04-19T02:16:40.872 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.872 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.872 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:40.872 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.829524+0000", 2024-04-19T02:16:40.872 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.2039999999999996e-06 2024-04-19T02:16:40.872 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.872 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.873 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:40.873 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.834200+0000", 2024-04-19T02:16:40.873 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0046766849999999999 2024-04-19T02:16:40.873 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:40.873 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:40.873 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:40.873 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.834220+0000", 2024-04-19T02:16:40.873 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.0049999999999999e-05 2024-04-19T02:16:40.873 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:40.873 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:40.873 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:40.873 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:40.873 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2024-04-19T02:16:40.873 INFO:teuthology.orchestra.run.smithi177.stdout: "num_ops": 9 2024-04-19T02:16:40.873 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-04-19T02:16:40.875 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:40.875+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:40.875 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:16:40.976 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:40.977+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:41.029 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 46 16 106056 106040 144.064 124.125 0.00711163 0.00693883 2024-04-19T02:16:41.062 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-04-19T02:16:41.063 INFO:teuthology.orchestra.run.smithi177.stdout: "ops": [], 2024-04-19T02:16:41.063 INFO:teuthology.orchestra.run.smithi177.stdout: "complaint_time": 30, 2024-04-19T02:16:41.063 INFO:teuthology.orchestra.run.smithi177.stdout: "num_blocked_ops": 0 2024-04-19T02:16:41.063 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-04-19T02:16:41.078 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:16:41.078 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:41.078+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:41.138 INFO:teuthology.orchestra.run.smithi121.stderr:noscrub is set 2024-04-19T02:16:41.178 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:41.178+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:41.278 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:41.278+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:41.279 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:16:41.311 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-04-19T02:16:41.311 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 20, 2024-04-19T02:16:41.311 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 600, 2024-04-19T02:16:41.311 INFO:teuthology.orchestra.run.smithi177.stdout: "ops": [ 2024-04-19T02:16:41.312 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.312 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:61815 5.c 5:3ca8a794:::benchmark_data_smithi121_44835_object61814:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:41.312 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:17.482110+0000", 2024-04-19T02:16:41.312 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 23.827775851999998, 2024-04-19T02:16:41.312 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.021577559999999999, 2024-04-19T02:16:41.312 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:41.312 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:41.312 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:41.312 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:41.312 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:41.312 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 61815 2024-04-19T02:16:41.312 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.312 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:41.312 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.312 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:41.313 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482110+0000", 2024-04-19T02:16:41.313 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:41.313 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.313 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.313 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:41.313 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482110+0000", 2024-04-19T02:16:41.313 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:41.313 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.313 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.313 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:41.313 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482109+0000", 2024-04-19T02:16:41.313 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:41.313 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.314 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.314 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:41.314 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482197+0000", 2024-04-19T02:16:41.314 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.7405999999999996e-05 2024-04-19T02:16:41.314 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.314 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.314 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:41.314 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482206+0000", 2024-04-19T02:16:41.314 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.0010000000000007e-06 2024-04-19T02:16:41.314 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.314 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.314 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:41.314 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482211+0000", 2024-04-19T02:16:41.314 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.4569999999999996e-06 2024-04-19T02:16:41.314 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.315 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.315 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:41.315 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.489465+0000", 2024-04-19T02:16:41.315 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.007253776 2024-04-19T02:16:41.315 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.315 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.315 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:41.315 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.489582+0000", 2024-04-19T02:16:41.315 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00011669500000000001 2024-04-19T02:16:41.315 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.315 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.315 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:41.315 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.489684+0000", 2024-04-19T02:16:41.315 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000102533 2024-04-19T02:16:41.315 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.316 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.316 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:41.316 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.491836+0000", 2024-04-19T02:16:41.316 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0021516759999999999 2024-04-19T02:16:41.316 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.316 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.316 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:41.316 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503615+0000", 2024-04-19T02:16:41.316 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.011778906 2024-04-19T02:16:41.316 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.316 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.316 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:41.316 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503652+0000", 2024-04-19T02:16:41.316 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6622999999999998e-05 2024-04-19T02:16:41.316 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.317 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.317 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:41.317 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503688+0000", 2024-04-19T02:16:41.317 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6127000000000002e-05 2024-04-19T02:16:41.317 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:41.317 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:41.317 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:41.317 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.317 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.317 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:78170 5.1 5:8b9c8e45:::benchmark_data_smithi121_44835_object78169:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:41.317 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.078784+0000", 2024-04-19T02:16:41.317 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 14.231101563999999, 2024-04-19T02:16:41.318 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.019726264, 2024-04-19T02:16:41.318 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:41.318 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:41.318 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:41.318 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:41.318 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:41.318 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 78170 2024-04-19T02:16:41.318 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.318 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:41.318 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.318 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:41.318 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.078784+0000", 2024-04-19T02:16:41.318 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:41.319 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.319 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.319 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:41.319 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.078784+0000", 2024-04-19T02:16:41.319 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:41.319 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.319 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.319 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:41.319 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.078784+0000", 2024-04-19T02:16:41.319 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:41.319 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.319 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.319 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:41.320 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.078887+0000", 2024-04-19T02:16:41.320 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000103305 2024-04-19T02:16:41.320 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.320 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.320 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:41.320 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.078895+0000", 2024-04-19T02:16:41.320 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.4409999999999993e-06 2024-04-19T02:16:41.320 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.321 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.321 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:41.321 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.078902+0000", 2024-04-19T02:16:41.321 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.9990000000000002e-06 2024-04-19T02:16:41.321 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.321 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.321 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:41.321 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.080865+0000", 2024-04-19T02:16:41.321 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0019620169999999999 2024-04-19T02:16:41.321 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.322 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.322 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:41.322 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.080997+0000", 2024-04-19T02:16:41.322 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00013229100000000001 2024-04-19T02:16:41.322 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.322 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.322 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:41.322 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.081163+0000", 2024-04-19T02:16:41.322 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00016632300000000001 2024-04-19T02:16:41.322 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.322 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.322 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:41.322 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.087215+0000", 2024-04-19T02:16:41.322 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0060522600000000003 2024-04-19T02:16:41.323 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.323 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.323 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:41.323 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.087261+0000", 2024-04-19T02:16:41.323 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.5788999999999998e-05 2024-04-19T02:16:41.323 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.323 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.323 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:41.323 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.098357+0000", 2024-04-19T02:16:41.323 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.011095571 2024-04-19T02:16:41.323 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.323 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.323 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:41.323 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.098407+0000", 2024-04-19T02:16:41.323 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.9821000000000003e-05 2024-04-19T02:16:41.323 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.324 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.324 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:41.324 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.098511+0000", 2024-04-19T02:16:41.324 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000104101 2024-04-19T02:16:41.324 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:41.324 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:41.324 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:41.324 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.324 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.324 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:78247 5.c 5:3efb1468:::benchmark_data_smithi121_44835_object78246:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:41.324 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.116347+0000", 2024-04-19T02:16:41.324 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 14.193538797, 2024-04-19T02:16:41.324 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.032194436999999999, 2024-04-19T02:16:41.324 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:41.324 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:41.325 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:41.325 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:41.325 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:41.325 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 78247 2024-04-19T02:16:41.325 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.325 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:41.325 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.325 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:41.325 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116347+0000", 2024-04-19T02:16:41.325 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:41.325 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.325 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.325 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:41.325 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116347+0000", 2024-04-19T02:16:41.326 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:41.326 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.326 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.326 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:41.326 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116346+0000", 2024-04-19T02:16:41.326 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:41.326 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.326 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.326 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:41.326 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116370+0000", 2024-04-19T02:16:41.326 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.3892000000000001e-05 2024-04-19T02:16:41.326 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.326 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.326 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:41.326 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116385+0000", 2024-04-19T02:16:41.327 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.5162e-05 2024-04-19T02:16:41.327 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.327 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.327 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:41.327 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116394+0000", 2024-04-19T02:16:41.327 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.8000000000000004e-06 2024-04-19T02:16:41.327 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.327 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.327 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:41.327 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124856+0000", 2024-04-19T02:16:41.328 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0084622169999999993 2024-04-19T02:16:41.328 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.328 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.328 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:41.328 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124966+0000", 2024-04-19T02:16:41.328 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000109747 2024-04-19T02:16:41.328 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.328 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.328 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:41.328 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125216+0000", 2024-04-19T02:16:41.328 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000249545 2024-04-19T02:16:41.328 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.329 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.329 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:41.329 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.131713+0000", 2024-04-19T02:16:41.329 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0064972370000000003 2024-04-19T02:16:41.329 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.329 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.329 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:41.329 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148323+0000", 2024-04-19T02:16:41.329 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016609641000000001 2024-04-19T02:16:41.329 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.329 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.329 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:41.329 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148359+0000", 2024-04-19T02:16:41.330 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6412000000000003e-05 2024-04-19T02:16:41.330 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.330 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.330 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:41.330 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148542+0000", 2024-04-19T02:16:41.330 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00018265600000000001 2024-04-19T02:16:41.330 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:41.330 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:41.330 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:41.331 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.331 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.331 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:78248 5.c 5:30b7cc74:::benchmark_data_smithi121_44835_object78247:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:41.331 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.116471+0000", 2024-04-19T02:16:41.331 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 14.193415296, 2024-04-19T02:16:41.331 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.032127452000000001, 2024-04-19T02:16:41.331 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:41.331 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:41.331 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:41.331 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:41.331 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:41.331 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 78248 2024-04-19T02:16:41.331 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.331 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:41.331 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.332 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:41.332 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116471+0000", 2024-04-19T02:16:41.332 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:41.332 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.332 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.332 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:41.332 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116471+0000", 2024-04-19T02:16:41.332 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:41.332 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.332 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.332 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:41.332 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116470+0000", 2024-04-19T02:16:41.332 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:41.332 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.332 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.332 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:41.333 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116496+0000", 2024-04-19T02:16:41.333 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.5517e-05 2024-04-19T02:16:41.333 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.333 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.333 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:41.333 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116505+0000", 2024-04-19T02:16:41.333 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.9250000000000007e-06 2024-04-19T02:16:41.333 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.333 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.333 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:41.333 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116516+0000", 2024-04-19T02:16:41.333 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.012e-05 2024-04-19T02:16:41.333 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.333 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.333 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:41.334 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.127803+0000", 2024-04-19T02:16:41.334 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.011287523000000001 2024-04-19T02:16:41.334 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.334 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.334 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:41.334 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.127932+0000", 2024-04-19T02:16:41.334 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012848499999999999 2024-04-19T02:16:41.334 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.334 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.335 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:41.335 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128022+0000", 2024-04-19T02:16:41.335 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.0890000000000006e-05 2024-04-19T02:16:41.335 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.335 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.335 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:41.335 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.131909+0000", 2024-04-19T02:16:41.335 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0038864609999999999 2024-04-19T02:16:41.335 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.335 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.335 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:41.336 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148552+0000", 2024-04-19T02:16:41.336 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016643162999999999 2024-04-19T02:16:41.336 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.336 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.336 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:41.336 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148577+0000", 2024-04-19T02:16:41.336 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.5333999999999998e-05 2024-04-19T02:16:41.336 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.336 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.336 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:41.336 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148598+0000", 2024-04-19T02:16:41.336 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.0687999999999999e-05 2024-04-19T02:16:41.336 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:41.336 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:41.336 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:41.337 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.337 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.337 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:78258 5.a 5:549070de:::benchmark_data_smithi121_44835_object78257:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:41.337 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.124295+0000", 2024-04-19T02:16:41.337 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 14.185590749999999, 2024-04-19T02:16:41.337 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020189543000000001, 2024-04-19T02:16:41.337 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:41.337 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:41.337 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:41.337 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:41.337 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:41.337 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 78258 2024-04-19T02:16:41.337 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.337 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:41.337 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.338 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:41.338 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124295+0000", 2024-04-19T02:16:41.338 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:41.338 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.338 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.338 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:41.339 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124295+0000", 2024-04-19T02:16:41.339 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:41.339 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.339 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.339 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:41.339 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124294+0000", 2024-04-19T02:16:41.339 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:41.339 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.339 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.339 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:41.339 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124358+0000", 2024-04-19T02:16:41.339 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.4040000000000003e-05 2024-04-19T02:16:41.339 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.339 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.339 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:41.339 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124374+0000", 2024-04-19T02:16:41.340 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.5291e-05 2024-04-19T02:16:41.340 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.340 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.340 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:41.340 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124383+0000", 2024-04-19T02:16:41.340 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.8360000000000004e-06 2024-04-19T02:16:41.340 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.340 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.340 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:41.340 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124908+0000", 2024-04-19T02:16:41.340 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00052415700000000003 2024-04-19T02:16:41.340 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.340 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.340 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:41.341 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125023+0000", 2024-04-19T02:16:41.341 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00011506999999999999 2024-04-19T02:16:41.341 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.341 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.341 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:41.341 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125182+0000", 2024-04-19T02:16:41.341 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00015942500000000001 2024-04-19T02:16:41.341 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.341 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.341 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:41.341 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.129505+0000", 2024-04-19T02:16:41.341 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0043225080000000001 2024-04-19T02:16:41.341 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.341 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.341 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:41.342 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.144379+0000", 2024-04-19T02:16:41.342 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.014874263 2024-04-19T02:16:41.342 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.342 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.342 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:41.342 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.144444+0000", 2024-04-19T02:16:41.342 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.5451999999999996e-05 2024-04-19T02:16:41.342 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.342 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.342 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:41.342 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.144485+0000", 2024-04-19T02:16:41.342 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.0426999999999998e-05 2024-04-19T02:16:41.342 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:41.342 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:41.343 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:41.343 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.343 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.343 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:78259 5.4 e31/16 5:2aa344b2:::benchmark_data_smithi121_44835_object78258:head v 31'4849, mlcod=31'4843)", 2024-04-19T02:16:41.343 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.125675+0000", 2024-04-19T02:16:41.343 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 14.184210878, 2024-04-19T02:16:41.343 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.022419326, 2024-04-19T02:16:41.343 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:41.343 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:41.343 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:41.343 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.343 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:41.343 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125675+0000", 2024-04-19T02:16:41.343 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:41.344 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.344 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.344 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:41.344 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125675+0000", 2024-04-19T02:16:41.344 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:41.344 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.344 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.344 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:41.344 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125674+0000", 2024-04-19T02:16:41.344 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:41.344 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.344 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.344 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:41.344 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125723+0000", 2024-04-19T02:16:41.344 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.8998000000000001e-05 2024-04-19T02:16:41.344 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.345 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.345 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:41.345 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125733+0000", 2024-04-19T02:16:41.345 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.1379999999999996e-06 2024-04-19T02:16:41.345 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.345 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.345 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:41.345 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125740+0000", 2024-04-19T02:16:41.345 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.0779999999999998e-06 2024-04-19T02:16:41.345 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.345 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.345 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:41.345 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.129589+0000", 2024-04-19T02:16:41.345 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0038488910000000001 2024-04-19T02:16:41.345 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.345 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.346 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:41.346 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.129605+0000", 2024-04-19T02:16:41.346 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.6877000000000001e-05 2024-04-19T02:16:41.346 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.346 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.346 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:41.346 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148057+0000", 2024-04-19T02:16:41.346 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.018451624 2024-04-19T02:16:41.346 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.346 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.346 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:41.346 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148094+0000", 2024-04-19T02:16:41.346 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.7327999999999999e-05 2024-04-19T02:16:41.347 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:41.347 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:41.347 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:41.347 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.347 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.347 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:78263 5.1 5:8e231862:::benchmark_data_smithi121_44835_object78262:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:41.347 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.128154+0000", 2024-04-19T02:16:41.347 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 14.181731692, 2024-04-19T02:16:41.347 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020882214, 2024-04-19T02:16:41.347 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:41.347 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:41.347 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:41.348 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:41.348 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:41.348 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 78263 2024-04-19T02:16:41.348 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.348 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:41.348 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.348 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:41.348 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128154+0000", 2024-04-19T02:16:41.349 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:41.349 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.349 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.349 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:41.349 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128154+0000", 2024-04-19T02:16:41.349 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:41.349 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.349 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.349 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:41.349 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128153+0000", 2024-04-19T02:16:41.350 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:41.350 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.350 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.350 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:41.350 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128246+0000", 2024-04-19T02:16:41.350 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.302e-05 2024-04-19T02:16:41.350 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.350 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.350 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:41.350 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128263+0000", 2024-04-19T02:16:41.350 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.6753e-05 2024-04-19T02:16:41.350 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.350 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.350 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:41.351 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128271+0000", 2024-04-19T02:16:41.351 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.2290000000000003e-06 2024-04-19T02:16:41.351 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.351 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.351 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:41.351 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128459+0000", 2024-04-19T02:16:41.351 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00018772 2024-04-19T02:16:41.351 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.351 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.351 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:41.351 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128574+0000", 2024-04-19T02:16:41.351 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00011437700000000001 2024-04-19T02:16:41.351 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.351 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.351 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:41.352 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128696+0000", 2024-04-19T02:16:41.352 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000122831 2024-04-19T02:16:41.352 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.352 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.352 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:41.352 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.130816+0000", 2024-04-19T02:16:41.352 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0021196750000000001 2024-04-19T02:16:41.352 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.352 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.352 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:41.352 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.131859+0000", 2024-04-19T02:16:41.352 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0010434419999999999 2024-04-19T02:16:41.352 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.352 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.352 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:41.353 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148848+0000", 2024-04-19T02:16:41.353 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016988712 2024-04-19T02:16:41.353 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.353 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.353 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:41.353 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148905+0000", 2024-04-19T02:16:41.353 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.6722999999999999e-05 2024-04-19T02:16:41.353 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.353 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.353 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:41.353 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.149036+0000", 2024-04-19T02:16:41.353 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000131567 2024-04-19T02:16:41.353 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:41.353 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:41.354 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:41.354 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.354 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.354 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:78271 5.4 e31/16 5:2982d7a6:::benchmark_data_smithi121_44835_object78270:head v 31'4850, mlcod=31'4847)", 2024-04-19T02:16:41.354 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.132554+0000", 2024-04-19T02:16:41.354 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 14.177332158, 2024-04-19T02:16:41.354 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020294946000000001, 2024-04-19T02:16:41.354 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:41.354 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:41.354 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:41.354 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.354 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:41.354 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132554+0000", 2024-04-19T02:16:41.354 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:41.355 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.355 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.355 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:41.355 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132554+0000", 2024-04-19T02:16:41.355 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:41.355 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.355 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.355 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:41.355 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132553+0000", 2024-04-19T02:16:41.355 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:41.355 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.355 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.355 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:41.355 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132615+0000", 2024-04-19T02:16:41.355 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.1772000000000004e-05 2024-04-19T02:16:41.356 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.356 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.356 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:41.356 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132620+0000", 2024-04-19T02:16:41.356 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.0939999999999998e-06 2024-04-19T02:16:41.356 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.356 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.356 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:41.356 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132624+0000", 2024-04-19T02:16:41.356 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.2229999999999999e-06 2024-04-19T02:16:41.356 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.356 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.356 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:41.356 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132649+0000", 2024-04-19T02:16:41.357 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.5352000000000001e-05 2024-04-19T02:16:41.357 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.357 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.357 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:41.357 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132661+0000", 2024-04-19T02:16:41.357 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.1851999999999999e-05 2024-04-19T02:16:41.357 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.357 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.357 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:41.357 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.152820+0000", 2024-04-19T02:16:41.357 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020159369999999999 2024-04-19T02:16:41.357 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.357 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.357 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:41.358 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.152849+0000", 2024-04-19T02:16:41.358 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.868e-05 2024-04-19T02:16:41.358 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:41.358 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:41.358 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:41.358 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.358 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.358 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:86809 5.1 5:87590d07:::benchmark_data_smithi121_44835_object86808:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T02:16:41.358 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:31.248111+0000", 2024-04-19T02:16:41.359 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 10.061774745999999, 2024-04-19T02:16:41.360 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.019434132999999999, 2024-04-19T02:16:41.360 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:41.360 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:41.360 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:41.360 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:41.360 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:41.360 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 86809 2024-04-19T02:16:41.360 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.360 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:41.360 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.360 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:41.360 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.248111+0000", 2024-04-19T02:16:41.360 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:41.361 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.361 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.361 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:41.361 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.248111+0000", 2024-04-19T02:16:41.361 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:41.361 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.361 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.361 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:41.361 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.248111+0000", 2024-04-19T02:16:41.361 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:41.361 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.361 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.361 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:41.361 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.248181+0000", 2024-04-19T02:16:41.361 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.0698999999999995e-05 2024-04-19T02:16:41.362 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.362 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.362 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:41.362 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.248191+0000", 2024-04-19T02:16:41.362 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.3170000000000008e-06 2024-04-19T02:16:41.362 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.362 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.362 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:41.362 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.248197+0000", 2024-04-19T02:16:41.362 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.1279999999999996e-06 2024-04-19T02:16:41.362 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.362 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.362 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:41.362 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.256815+0000", 2024-04-19T02:16:41.363 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0086187390000000003 2024-04-19T02:16:41.363 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.363 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.363 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:41.363 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.256968+0000", 2024-04-19T02:16:41.363 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000152795 2024-04-19T02:16:41.363 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.363 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.363 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:41.363 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.257125+0000", 2024-04-19T02:16:41.363 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000156391 2024-04-19T02:16:41.363 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.363 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.363 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:41.363 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.264616+0000", 2024-04-19T02:16:41.364 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0074914789999999997 2024-04-19T02:16:41.364 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.364 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.364 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:41.364 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.264658+0000", 2024-04-19T02:16:41.364 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.2026e-05 2024-04-19T02:16:41.364 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.364 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.364 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:41.364 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.267383+0000", 2024-04-19T02:16:41.364 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0027250120000000002 2024-04-19T02:16:41.364 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.364 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.364 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:41.364 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.267438+0000", 2024-04-19T02:16:41.365 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.4784999999999998e-05 2024-04-19T02:16:41.365 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.365 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.365 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:41.365 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.267545+0000", 2024-04-19T02:16:41.365 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000107382 2024-04-19T02:16:41.365 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:41.365 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:41.365 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:41.365 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.365 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.365 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:87963 5.3 5:c47b3227:::benchmark_data_smithi121_44835_object87962:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T02:16:41.365 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:31.833755+0000", 2024-04-19T02:16:41.365 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 9.476131037, 2024-04-19T02:16:41.365 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.019779005999999998, 2024-04-19T02:16:41.366 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:41.366 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:41.366 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:41.366 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:41.366 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:41.366 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 87963 2024-04-19T02:16:41.366 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.366 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:41.366 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.366 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:41.366 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.833755+0000", 2024-04-19T02:16:41.366 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:41.366 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.366 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.367 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:41.367 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.833755+0000", 2024-04-19T02:16:41.367 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:41.367 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.367 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.367 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:41.367 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.833754+0000", 2024-04-19T02:16:41.367 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:41.367 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.367 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.367 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:41.367 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.833881+0000", 2024-04-19T02:16:41.367 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000126785 2024-04-19T02:16:41.367 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.367 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.368 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:41.368 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.833890+0000", 2024-04-19T02:16:41.368 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.0110000000000006e-06 2024-04-19T02:16:41.368 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.368 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.368 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:41.368 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.833897+0000", 2024-04-19T02:16:41.368 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.5309999999999998e-06 2024-04-19T02:16:41.368 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.368 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.368 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:41.368 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.842658+0000", 2024-04-19T02:16:41.368 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0087616929999999992 2024-04-19T02:16:41.368 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.368 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.369 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:41.369 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.842749+0000", 2024-04-19T02:16:41.369 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.0556999999999994e-05 2024-04-19T02:16:41.369 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.369 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.369 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:41.369 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.842832+0000", 2024-04-19T02:16:41.369 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.2696999999999998e-05 2024-04-19T02:16:41.369 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.369 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.369 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:41.369 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.844494+0000", 2024-04-19T02:16:41.369 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0016623429999999999 2024-04-19T02:16:41.369 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.369 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.370 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:41.370 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.853446+0000", 2024-04-19T02:16:41.370 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0089523499999999995 2024-04-19T02:16:41.370 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.370 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.370 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:41.370 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.853495+0000", 2024-04-19T02:16:41.370 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.8847999999999997e-05 2024-04-19T02:16:41.370 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.370 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.370 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:41.370 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.853534+0000", 2024-04-19T02:16:41.370 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.8829999999999999e-05 2024-04-19T02:16:41.370 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:41.371 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:41.371 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:41.371 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.371 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.371 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:94191 5.c 5:3155c784:::benchmark_data_smithi121_44835_object94190:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T02:16:41.371 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:34.963381+0000", 2024-04-19T02:16:41.371 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 6.3465044729999995, 2024-04-19T02:16:41.371 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.021414343999999998, 2024-04-19T02:16:41.371 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:41.371 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:41.371 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:41.371 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:41.371 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:41.371 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 94191 2024-04-19T02:16:41.371 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.371 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:41.372 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.372 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:41.372 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.963381+0000", 2024-04-19T02:16:41.372 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:41.372 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.372 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.372 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:41.372 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.963381+0000", 2024-04-19T02:16:41.372 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:41.372 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.372 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.372 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:41.372 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.963381+0000", 2024-04-19T02:16:41.372 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:41.372 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.372 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.373 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:41.373 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.963457+0000", 2024-04-19T02:16:41.373 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.5827000000000004e-05 2024-04-19T02:16:41.373 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.373 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.373 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:41.373 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.963465+0000", 2024-04-19T02:16:41.373 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.2800000000000003e-06 2024-04-19T02:16:41.373 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.373 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.373 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:41.373 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.963470+0000", 2024-04-19T02:16:41.373 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.2310000000000004e-06 2024-04-19T02:16:41.373 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.373 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.374 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:41.374 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.969469+0000", 2024-04-19T02:16:41.374 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0059987169999999998 2024-04-19T02:16:41.374 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.374 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.374 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:41.374 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.969594+0000", 2024-04-19T02:16:41.374 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012517299999999999 2024-04-19T02:16:41.374 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.374 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.374 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:41.374 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.969759+0000", 2024-04-19T02:16:41.374 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00016459999999999999 2024-04-19T02:16:41.374 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.374 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.375 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:41.375 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.975130+0000", 2024-04-19T02:16:41.375 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0053717410000000002 2024-04-19T02:16:41.375 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.375 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.375 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:41.375 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.984704+0000", 2024-04-19T02:16:41.375 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.009573715 2024-04-19T02:16:41.375 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.375 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.375 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:41.375 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.984758+0000", 2024-04-19T02:16:41.375 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.4039000000000002e-05 2024-04-19T02:16:41.375 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.375 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.376 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:41.376 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.984796+0000", 2024-04-19T02:16:41.376 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.7619e-05 2024-04-19T02:16:41.376 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:41.376 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:41.376 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:41.376 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.376 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.376 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:94471 5.6 5:641302c2:::benchmark_data_smithi121_44835_object94470:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:41.376 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:35.112592+0000", 2024-04-19T02:16:41.376 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 6.1972944090000004, 2024-04-19T02:16:41.376 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.023525194999999999, 2024-04-19T02:16:41.376 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:41.376 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:41.377 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:41.377 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:41.377 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:41.377 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 94471 2024-04-19T02:16:41.377 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.377 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:41.377 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.377 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:41.377 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.112592+0000", 2024-04-19T02:16:41.377 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:41.377 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.377 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.377 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:41.377 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.112592+0000", 2024-04-19T02:16:41.377 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:41.377 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.378 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.378 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:41.378 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.112591+0000", 2024-04-19T02:16:41.378 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:41.378 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.378 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.378 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:41.378 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.112621+0000", 2024-04-19T02:16:41.378 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.0701999999999998e-05 2024-04-19T02:16:41.378 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.378 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.378 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:41.378 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.112631+0000", 2024-04-19T02:16:41.378 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.3209999999999994e-06 2024-04-19T02:16:41.378 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.379 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.379 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:41.379 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.112638+0000", 2024-04-19T02:16:41.379 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.187e-06 2024-04-19T02:16:41.379 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.379 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.379 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:41.379 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.113893+0000", 2024-04-19T02:16:41.379 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0012553390000000001 2024-04-19T02:16:41.379 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.379 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.379 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:41.379 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.114012+0000", 2024-04-19T02:16:41.379 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000118638 2024-04-19T02:16:41.379 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.380 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.380 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:41.380 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.114151+0000", 2024-04-19T02:16:41.380 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00013928700000000001 2024-04-19T02:16:41.380 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.380 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.380 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:41.380 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.120607+0000", 2024-04-19T02:16:41.380 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0064559179999999997 2024-04-19T02:16:41.380 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.380 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.380 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:41.380 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136026+0000", 2024-04-19T02:16:41.380 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015418762000000001 2024-04-19T02:16:41.380 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.380 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.381 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:41.381 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136084+0000", 2024-04-19T02:16:41.381 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.8245000000000002e-05 2024-04-19T02:16:41.381 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.381 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.381 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:41.381 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136117+0000", 2024-04-19T02:16:41.381 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.2616000000000001e-05 2024-04-19T02:16:41.381 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:41.381 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:41.381 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:41.381 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.381 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.381 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:94468 5.2 e34/16 5:4f406431:::benchmark_data_smithi121_44835_object94467:head v 34'5918, mlcod=34'5914)", 2024-04-19T02:16:41.382 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:35.113059+0000", 2024-04-19T02:16:41.382 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 6.1968271259999996, 2024-04-19T02:16:41.382 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.022987177000000001, 2024-04-19T02:16:41.382 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:41.382 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:41.382 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:41.382 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.382 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:41.382 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.113059+0000", 2024-04-19T02:16:41.382 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:41.382 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.382 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.382 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:41.383 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.113059+0000", 2024-04-19T02:16:41.383 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:41.383 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.383 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.383 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:41.383 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.113058+0000", 2024-04-19T02:16:41.383 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:41.383 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.383 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.383 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:41.383 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.113103+0000", 2024-04-19T02:16:41.383 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.4159000000000002e-05 2024-04-19T02:16:41.383 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.383 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.383 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:41.384 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.113110+0000", 2024-04-19T02:16:41.384 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.1049999999999997e-06 2024-04-19T02:16:41.384 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.384 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.384 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:41.384 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.113115+0000", 2024-04-19T02:16:41.384 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.3229999999999997e-06 2024-04-19T02:16:41.384 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.384 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.384 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:41.384 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.114338+0000", 2024-04-19T02:16:41.384 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.001223179 2024-04-19T02:16:41.384 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.384 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.384 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:41.385 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.114355+0000", 2024-04-19T02:16:41.385 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.6963999999999999e-05 2024-04-19T02:16:41.385 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.385 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.385 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:41.385 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136011+0000", 2024-04-19T02:16:41.385 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.021656102999999999 2024-04-19T02:16:41.385 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.385 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.385 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:41.385 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136046+0000", 2024-04-19T02:16:41.385 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.4802999999999999e-05 2024-04-19T02:16:41.385 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:41.385 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:41.386 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:41.386 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.386 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.386 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:94473 5.6 5:6db36ce7:::benchmark_data_smithi121_44835_object94472:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:41.386 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:35.116069+0000", 2024-04-19T02:16:41.386 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 6.1938170289999999, 2024-04-19T02:16:41.386 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020111038000000001, 2024-04-19T02:16:41.386 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:41.386 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:41.386 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:41.386 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:41.386 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:41.386 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 94473 2024-04-19T02:16:41.386 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.386 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:41.387 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.387 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:41.387 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116069+0000", 2024-04-19T02:16:41.387 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:41.387 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.387 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.387 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:41.387 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116069+0000", 2024-04-19T02:16:41.387 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:41.387 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.387 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.387 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:41.387 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116067+0000", 2024-04-19T02:16:41.387 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:41.387 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.388 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.388 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:41.388 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116096+0000", 2024-04-19T02:16:41.388 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.9034e-05 2024-04-19T02:16:41.388 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.388 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.388 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:41.388 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116107+0000", 2024-04-19T02:16:41.388 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0543000000000001e-05 2024-04-19T02:16:41.388 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.388 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.388 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:41.388 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116115+0000", 2024-04-19T02:16:41.388 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.8860000000000004e-06 2024-04-19T02:16:41.388 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.388 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.389 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:41.389 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116281+0000", 2024-04-19T02:16:41.389 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00016668100000000001 2024-04-19T02:16:41.389 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.389 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.389 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:41.389 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116394+0000", 2024-04-19T02:16:41.389 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000112138 2024-04-19T02:16:41.389 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.389 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.389 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:41.389 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116502+0000", 2024-04-19T02:16:41.389 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000108513 2024-04-19T02:16:41.389 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.390 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.390 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:41.390 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.120647+0000", 2024-04-19T02:16:41.390 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0041448459999999998 2024-04-19T02:16:41.390 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.390 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.390 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:41.390 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136124+0000", 2024-04-19T02:16:41.390 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015476678000000001 2024-04-19T02:16:41.390 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.390 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.390 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:41.390 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136149+0000", 2024-04-19T02:16:41.390 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.5412999999999999e-05 2024-04-19T02:16:41.391 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.391 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.391 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:41.391 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136180+0000", 2024-04-19T02:16:41.391 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.0970999999999999e-05 2024-04-19T02:16:41.391 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:41.391 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:41.391 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:41.391 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.391 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.391 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:94472 5.2 e35/16 5:45b7e9be:::benchmark_data_smithi121_44835_object94471:head v 35'5919, mlcod=34'5914)", 2024-04-19T02:16:41.391 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:35.116129+0000", 2024-04-19T02:16:41.391 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 6.1937566960000003, 2024-04-19T02:16:41.391 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.019945311, 2024-04-19T02:16:41.391 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:41.391 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:41.392 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:41.392 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.392 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:41.392 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116129+0000", 2024-04-19T02:16:41.392 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:41.392 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.392 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.392 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:41.392 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116129+0000", 2024-04-19T02:16:41.392 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:41.392 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.392 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.392 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:41.392 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116129+0000", 2024-04-19T02:16:41.392 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:41.392 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.393 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.393 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:41.393 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116149+0000", 2024-04-19T02:16:41.393 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.9874999999999999e-05 2024-04-19T02:16:41.393 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.393 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.393 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:41.393 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116153+0000", 2024-04-19T02:16:41.393 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.7190000000000001e-06 2024-04-19T02:16:41.393 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.393 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.393 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:41.393 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116157+0000", 2024-04-19T02:16:41.393 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.3100000000000001e-06 2024-04-19T02:16:41.393 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.393 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.394 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:41.394 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116250+0000", 2024-04-19T02:16:41.394 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.3022999999999993e-05 2024-04-19T02:16:41.394 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.394 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.394 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:41.394 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116267+0000", 2024-04-19T02:16:41.394 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.685e-05 2024-04-19T02:16:41.394 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.394 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.394 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:41.394 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136051+0000", 2024-04-19T02:16:41.394 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.019784748000000001 2024-04-19T02:16:41.394 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.395 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.395 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:41.395 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136075+0000", 2024-04-19T02:16:41.395 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.3332e-05 2024-04-19T02:16:41.395 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:41.395 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:41.395 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:41.395 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.395 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.395 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:94581 5.b e35/16 5:dc86d6e9:::benchmark_data_smithi121_44835_object94580:head v 35'5875, mlcod=35'5872)", 2024-04-19T02:16:41.395 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:35.181295+0000", 2024-04-19T02:16:41.395 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 6.1285910880000003, 2024-04-19T02:16:41.395 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.02078327, 2024-04-19T02:16:41.395 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:41.395 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:41.396 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:41.396 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.396 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:41.396 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.181295+0000", 2024-04-19T02:16:41.396 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:41.396 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.396 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.396 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:41.396 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.181295+0000", 2024-04-19T02:16:41.396 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:41.396 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.396 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.396 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:41.396 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.181294+0000", 2024-04-19T02:16:41.396 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:41.397 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.397 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.397 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:41.397 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.181321+0000", 2024-04-19T02:16:41.397 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.6588999999999999e-05 2024-04-19T02:16:41.397 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.397 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.397 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:41.397 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.181329+0000", 2024-04-19T02:16:41.397 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.9289999999999998e-06 2024-04-19T02:16:41.397 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.397 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.397 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:41.397 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.181334+0000", 2024-04-19T02:16:41.398 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.2789999999999998e-06 2024-04-19T02:16:41.398 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.398 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.398 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:41.398 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.186093+0000", 2024-04-19T02:16:41.398 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0047585509999999998 2024-04-19T02:16:41.398 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.398 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.398 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:41.398 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.186111+0000", 2024-04-19T02:16:41.398 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.7901e-05 2024-04-19T02:16:41.398 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.398 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.398 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:41.398 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.202037+0000", 2024-04-19T02:16:41.399 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015926020999999999 2024-04-19T02:16:41.399 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.399 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.399 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:41.399 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.202078+0000", 2024-04-19T02:16:41.399 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.1424999999999997e-05 2024-04-19T02:16:41.399 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:41.399 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:41.399 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:41.399 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.399 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.399 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "MOSDPGPushReply(5.1 35/29 [PushReplyOp(5:860e8104:::benchmark_data_smithi121_44835_object52857:head)])", 2024-04-19T02:16:41.399 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:35.719222+0000", 2024-04-19T02:16:41.399 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 5.5906643530000002, 2024-04-19T02:16:41.399 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.022063027999999998, 2024-04-19T02:16:41.400 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:41.400 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "reached pg", 2024-04-19T02:16:41.400 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:41.400 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.400 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:41.400 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.719222+0000", 2024-04-19T02:16:41.400 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:41.400 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.400 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.400 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:41.400 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.719222+0000", 2024-04-19T02:16:41.400 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:41.400 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.400 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.400 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:41.401 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.719221+0000", 2024-04-19T02:16:41.401 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967296 2024-04-19T02:16:41.401 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.401 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.401 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:41.401 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.719225+0000", 2024-04-19T02:16:41.401 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.5779999999999999e-06 2024-04-19T02:16:41.401 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.401 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.401 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:41.401 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.719232+0000", 2024-04-19T02:16:41.401 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.1319999999999996e-06 2024-04-19T02:16:41.401 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.401 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.401 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:41.402 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.719239+0000", 2024-04-19T02:16:41.402 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.8120000000000002e-06 2024-04-19T02:16:41.402 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.402 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.402 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:41.402 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.741004+0000", 2024-04-19T02:16:41.402 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.021764614000000002 2024-04-19T02:16:41.402 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.402 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.402 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:41.402 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.741285+0000", 2024-04-19T02:16:41.402 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000281079 2024-04-19T02:16:41.402 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:41.402 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:41.402 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:41.403 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.403 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.403 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:96375 5.1 5:84bae481:::benchmark_data_smithi121_44835_object96374:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:41.403 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:36.105748+0000", 2024-04-19T02:16:41.403 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 5.204137963, 2024-04-19T02:16:41.403 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.021551219999999999, 2024-04-19T02:16:41.403 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:41.403 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:41.403 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:41.403 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:41.403 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:41.403 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 96375 2024-04-19T02:16:41.403 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.403 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:41.403 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.404 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:41.404 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.105748+0000", 2024-04-19T02:16:41.404 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:41.404 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.404 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.404 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:41.404 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.105748+0000", 2024-04-19T02:16:41.404 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:41.404 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.404 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.404 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:41.404 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.105747+0000", 2024-04-19T02:16:41.404 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:41.404 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.404 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.405 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:41.405 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.105869+0000", 2024-04-19T02:16:41.405 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000121965 2024-04-19T02:16:41.405 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.405 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.405 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:41.405 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.105879+0000", 2024-04-19T02:16:41.405 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0049e-05 2024-04-19T02:16:41.405 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.405 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.405 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:41.405 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.105886+0000", 2024-04-19T02:16:41.405 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.0879999999999997e-06 2024-04-19T02:16:41.405 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.405 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.406 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:41.406 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.107778+0000", 2024-04-19T02:16:41.406 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0018912670000000001 2024-04-19T02:16:41.406 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.406 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.406 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:41.406 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.107885+0000", 2024-04-19T02:16:41.406 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000106982 2024-04-19T02:16:41.406 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.406 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.406 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:41.406 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.108016+0000", 2024-04-19T02:16:41.406 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000131581 2024-04-19T02:16:41.406 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.406 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.407 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:41.407 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.110857+0000", 2024-04-19T02:16:41.407 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.002840604 2024-04-19T02:16:41.407 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.407 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.407 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:41.407 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.118745+0000", 2024-04-19T02:16:41.407 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0078886970000000001 2024-04-19T02:16:41.407 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.407 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.407 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:41.407 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.127135+0000", 2024-04-19T02:16:41.407 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0083899939999999996 2024-04-19T02:16:41.407 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.407 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.408 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:41.408 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.127191+0000", 2024-04-19T02:16:41.408 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.5294000000000003e-05 2024-04-19T02:16:41.408 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.408 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.408 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:41.408 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.127299+0000", 2024-04-19T02:16:41.408 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000108439 2024-04-19T02:16:41.408 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:41.408 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:41.408 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:41.408 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.408 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.408 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:104186 5.1 5:8759ec67:::benchmark_data_smithi121_44835_object104185:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T02:16:41.409 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:40.086927+0000", 2024-04-19T02:16:41.409 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 1.222959122, 2024-04-19T02:16:41.409 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020306884000000001, 2024-04-19T02:16:41.409 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:41.409 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:41.409 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:41.409 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:41.409 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:41.409 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 104186 2024-04-19T02:16:41.409 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.409 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:41.409 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.409 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:41.409 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086927+0000", 2024-04-19T02:16:41.409 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:41.410 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.410 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.410 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:41.410 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086927+0000", 2024-04-19T02:16:41.410 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:41.410 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.410 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.410 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:41.410 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086926+0000", 2024-04-19T02:16:41.410 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:41.410 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.410 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.410 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:41.410 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086951+0000", 2024-04-19T02:16:41.411 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.5452e-05 2024-04-19T02:16:41.411 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.411 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.411 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:41.411 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086960+0000", 2024-04-19T02:16:41.411 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.1620000000000008e-06 2024-04-19T02:16:41.411 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.411 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.411 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:41.411 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086966+0000", 2024-04-19T02:16:41.411 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.0290000000000002e-06 2024-04-19T02:16:41.411 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.411 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.411 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:41.411 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.090593+0000", 2024-04-19T02:16:41.411 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0036272079999999998 2024-04-19T02:16:41.412 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.412 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.412 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:41.412 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.090699+0000", 2024-04-19T02:16:41.412 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000106001 2024-04-19T02:16:41.412 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.412 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.412 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:41.412 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.090842+0000", 2024-04-19T02:16:41.412 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00014270900000000001 2024-04-19T02:16:41.412 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.412 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.412 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:41.412 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.094673+0000", 2024-04-19T02:16:41.412 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0038316999999999999 2024-04-19T02:16:41.413 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.413 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.413 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:41.413 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.097494+0000", 2024-04-19T02:16:41.413 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0028205539999999999 2024-04-19T02:16:41.413 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.413 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.413 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:41.413 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.107075+0000", 2024-04-19T02:16:41.413 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0095813870000000002 2024-04-19T02:16:41.413 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.413 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.413 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:41.413 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.107127+0000", 2024-04-19T02:16:41.413 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.1498000000000001e-05 2024-04-19T02:16:41.413 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.414 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.414 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:41.414 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.107234+0000", 2024-04-19T02:16:41.414 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000107058 2024-04-19T02:16:41.414 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:41.414 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:41.414 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:41.414 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.414 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.414 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:104187 5.1 5:8636ab61:::benchmark_data_smithi121_44835_object104186:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T02:16:41.414 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:40.086972+0000", 2024-04-19T02:16:41.414 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 1.222913728, 2024-04-19T02:16:41.414 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020992607999999999, 2024-04-19T02:16:41.414 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:41.415 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:41.415 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:41.415 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:41.415 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:41.415 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 104187 2024-04-19T02:16:41.415 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.415 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:41.415 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.415 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:41.415 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086972+0000", 2024-04-19T02:16:41.415 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:41.415 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.415 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.415 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:41.416 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086972+0000", 2024-04-19T02:16:41.416 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:41.416 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.416 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.416 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:41.416 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086972+0000", 2024-04-19T02:16:41.416 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:41.416 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.416 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.416 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:41.416 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.087000+0000", 2024-04-19T02:16:41.416 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.8569e-05 2024-04-19T02:16:41.416 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.416 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.416 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:41.416 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.087007+0000", 2024-04-19T02:16:41.417 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.4280000000000001e-06 2024-04-19T02:16:41.417 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.417 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.417 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:41.417 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.087013+0000", 2024-04-19T02:16:41.417 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.3929999999999996e-06 2024-04-19T02:16:41.417 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.417 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.417 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:41.417 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.092659+0000", 2024-04-19T02:16:41.417 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0056460850000000003 2024-04-19T02:16:41.417 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.417 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.417 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:41.417 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.092780+0000", 2024-04-19T02:16:41.418 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012113200000000001 2024-04-19T02:16:41.418 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.418 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.418 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:41.418 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.092894+0000", 2024-04-19T02:16:41.418 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000113057 2024-04-19T02:16:41.418 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.418 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.418 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:41.418 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.097526+0000", 2024-04-19T02:16:41.418 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0046325940000000003 2024-04-19T02:16:41.418 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.418 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.418 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:41.418 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.097536+0000", 2024-04-19T02:16:41.419 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.4110000000000002e-06 2024-04-19T02:16:41.419 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.419 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.419 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:41.419 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.107809+0000", 2024-04-19T02:16:41.419 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.010273882999999999 2024-04-19T02:16:41.419 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.419 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.419 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:41.419 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.107864+0000", 2024-04-19T02:16:41.419 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.4792e-05 2024-04-19T02:16:41.419 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:41.419 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:41.419 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:41.419 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.107965+0000", 2024-04-19T02:16:41.420 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000100641 2024-04-19T02:16:41.420 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:41.420 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:41.420 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:41.420 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:41.420 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:41.420 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-04-19T02:16:41.422 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:41.422+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:41.422 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:16:41.427 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:16:41.446 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:16:41.466 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2: {} 2024-04-19T02:16:41.467 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:16:41.467 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:16:41.467 INFO:teuthology.orchestra.run.smithi121.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:16:41.521 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:41.521+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:41.595 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:41.595 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:41.601 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:16:41.622 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:41.623+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:41.723 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:41.723+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:41.792 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:16:41.810 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:41.810 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:41.823 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:16:41.824 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:41.825+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:41.925 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:41.925+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:41.985 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:41.985 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:41.999 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:16:42.029 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 47 16 108053 108037 143.654 124.812 0.0077675 0.00695854 2024-04-19T02:16:42.044 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:42.044+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:42.127 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:42.127+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:42.151 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:16:42.154 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-04-19T02:16:42.163 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2024-04-19T02:16:41.134112+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6536432474,"num_objects":99753,"num_object_clones":0,"num_object_copies":199506,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":3427,"num_objects_unfound":0,"num_objects_dirty":99753,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":99977,"num_write_kb":6386130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2240,"num_bytes_recovered":146800640,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60224,"ondisk_log_size":60224,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":243,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":13169108,"kb_used_data":12841120,"kb_used_omap":4,"kb_used_meta":327931,"kb_avail":269946412,"statfs":{"total":289910292480,"available":276425125888,"internally_reserved":0,"allocated":13149306880,"data_stored":13148481548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":335801682},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,3,0,2,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":644087808,"num_objects":9828,"num_object_clones":0,"num_object_copies":19656,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-363,"num_objects_unfound":0,"num_objects_dirty":9828,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9828,"num_write_kb":628992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":739,"num_bytes_recovered":48431104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.028121"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.115902+0000","last_change":"2024-04-19T02:15:29.280412+0000","last_active":"2024-04-19T02:16:36.115902+0000","last_peered":"2024-04-19T02:16:36.115902+0000","last_clean":"2024-04-19T02:16:36.115902+0000","last_became_active":"2024-04-19T02:15:29.278762+0000","last_became_peered":"2024-04-19T02:15:29.278762+0000","last_unstale":"2024-04-19T02:16:36.115902+0000","last_undegraded":"2024-04-19T02:16:36.115902+0000","last_fullsized":"2024-04-19T02:16:36.115902+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:45.301675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.115508+0000","last_change":"2024-04-19T02:15:29.284695+0000","last_active":"2024-04-19T02:16:36.115508+0000","last_peered":"2024-04-19T02:16:36.115508+0000","last_clean":"2024-04-19T02:16:36.115508+0000","last_became_active":"2024-04-19T02:15:29.283468+0000","last_became_peered":"2024-04-19T02:15:29.283468+0000","last_unstale":"2024-04-19T02:16:36.115508+0000","last_undegraded":"2024-04-19T02:16:36.115508+0000","last_fullsized":"2024-04-19T02:16:36.115508+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.384881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119635+0000","last_change":"2024-04-19T02:15:29.286709+0000","last_active":"2024-04-19T02:16:36.119635+0000","last_peered":"2024-04-19T02:16:36.119635+0000","last_clean":"2024-04-19T02:16:36.119635+0000","last_became_active":"2024-04-19T02:15:29.286169+0000","last_became_peered":"2024-04-19T02:15:29.286169+0000","last_unstale":"2024-04-19T02:16:36.119635+0000","last_undegraded":"2024-04-19T02:16:36.119635+0000","last_fullsized":"2024-04-19T02:16:36.119635+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:58.741466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119561+0000","last_change":"2024-04-19T02:15:29.280131+0000","last_active":"2024-04-19T02:16:36.119561+0000","last_peered":"2024-04-19T02:16:36.119561+0000","last_clean":"2024-04-19T02:16:36.119561+0000","last_became_active":"2024-04-19T02:15:29.279388+0000","last_became_peered":"2024-04-19T02:15:29.279388+0000","last_unstale":"2024-04-19T02:16:36.119561+0000","last_undegraded":"2024-04-19T02:16:36.119561+0000","last_fullsized":"2024-04-19T02:16:36.119561+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:36:48.819486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109473+0000","last_change":"2024-04-19T02:15:53.955892+0000","last_active":"2024-04-19T02:16:36.109473+0000","last_peered":"2024-04-19T02:16:36.109473+0000","last_clean":"2024-04-19T02:16:36.109473+0000","last_became_active":"2024-04-19T02:15:53.955553+0000","last_became_peered":"2024-04-19T02:15:53.955553+0000","last_unstale":"2024-04-19T02:16:36.109473+0000","last_undegraded":"2024-04-19T02:16:36.109473+0000","last_fullsized":"2024-04-19T02:16:36.109473+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:45:39.791209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118574+0000","last_change":"2024-04-19T02:15:29.283908+0000","last_active":"2024-04-19T02:16:36.118574+0000","last_peered":"2024-04-19T02:16:36.118574+0000","last_clean":"2024-04-19T02:16:36.118574+0000","last_became_active":"2024-04-19T02:15:29.281729+0000","last_became_peered":"2024-04-19T02:15:29.281729+0000","last_unstale":"2024-04-19T02:16:36.118574+0000","last_undegraded":"2024-04-19T02:16:36.118574+0000","last_fullsized":"2024-04-19T02:16:36.118574+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:03:15.383476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118611+0000","last_change":"2024-04-19T02:15:29.281253+0000","last_active":"2024-04-19T02:16:36.118611+0000","last_peered":"2024-04-19T02:16:36.118611+0000","last_clean":"2024-04-19T02:16:36.118611+0000","last_became_active":"2024-04-19T02:15:29.279951+0000","last_became_peered":"2024-04-19T02:15:29.279951+0000","last_unstale":"2024-04-19T02:16:36.118611+0000","last_undegraded":"2024-04-19T02:16:36.118611+0000","last_fullsized":"2024-04-19T02:16:36.118611+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118290+0000","last_change":"2024-04-19T02:15:29.283952+0000","last_active":"2024-04-19T02:16:36.118290+0000","last_peered":"2024-04-19T02:16:36.118290+0000","last_clean":"2024-04-19T02:16:36.118290+0000","last_became_active":"2024-04-19T02:15:29.282721+0000","last_became_peered":"2024-04-19T02:15:29.282721+0000","last_unstale":"2024-04-19T02:16:36.118290+0000","last_undegraded":"2024-04-19T02:16:36.118290+0000","last_fullsized":"2024-04-19T02:16:36.118290+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:45.301675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109780+0000","last_change":"2024-04-19T02:15:29.282150+0000","last_active":"2024-04-19T02:16:36.109780+0000","last_peered":"2024-04-19T02:16:36.109780+0000","last_clean":"2024-04-19T02:16:36.109780+0000","last_became_active":"2024-04-19T02:15:29.281538+0000","last_became_peered":"2024-04-19T02:15:29.281538+0000","last_unstale":"2024-04-19T02:16:36.109780+0000","last_undegraded":"2024-04-19T02:16:36.109780+0000","last_fullsized":"2024-04-19T02:16:36.109780+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119156+0000","last_change":"2024-04-19T02:16:30.093524+0000","last_active":"2024-04-19T02:16:36.119156+0000","last_peered":"2024-04-19T02:16:36.119156+0000","last_clean":"2024-04-19T02:16:36.119156+0000","last_became_active":"2024-04-19T02:16:30.093344+0000","last_became_peered":"2024-04-19T02:16:30.093344+0000","last_unstale":"2024-04-19T02:16:36.119156+0000","last_undegraded":"2024-04-19T02:16:36.119156+0000","last_fullsized":"2024-04-19T02:16:36.119156+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:14:40.293159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119375+0000","last_change":"2024-04-19T02:15:29.280606+0000","last_active":"2024-04-19T02:16:36.119375+0000","last_peered":"2024-04-19T02:16:36.119375+0000","last_clean":"2024-04-19T02:16:36.119375+0000","last_became_active":"2024-04-19T02:15:29.280151+0000","last_became_peered":"2024-04-19T02:15:29.280151+0000","last_unstale":"2024-04-19T02:16:36.119375+0000","last_undegraded":"2024-04-19T02:16:36.119375+0000","last_fullsized":"2024-04-19T02:16:36.119375+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:26:22.452488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119241+0000","last_change":"2024-04-19T02:15:53.958876+0000","last_active":"2024-04-19T02:16:36.119241+0000","last_peered":"2024-04-19T02:16:36.119241+0000","last_clean":"2024-04-19T02:16:36.119241+0000","last_became_active":"2024-04-19T02:15:53.958626+0000","last_became_peered":"2024-04-19T02:15:53.958626+0000","last_unstale":"2024-04-19T02:16:36.119241+0000","last_undegraded":"2024-04-19T02:16:36.119241+0000","last_fullsized":"2024-04-19T02:16:36.119241+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:23:57.044018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109386+0000","last_change":"2024-04-19T02:15:53.956801+0000","last_active":"2024-04-19T02:16:36.109386+0000","last_peered":"2024-04-19T02:16:36.109386+0000","last_clean":"2024-04-19T02:16:36.109386+0000","last_became_active":"2024-04-19T02:15:53.956620+0000","last_became_peered":"2024-04-19T02:15:53.956620+0000","last_unstale":"2024-04-19T02:16:36.109386+0000","last_undegraded":"2024-04-19T02:16:36.109386+0000","last_fullsized":"2024-04-19T02:16:36.109386+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:57:05.843101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118904+0000","last_change":"2024-04-19T02:15:29.284262+0000","last_active":"2024-04-19T02:16:36.118904+0000","last_peered":"2024-04-19T02:16:36.118904+0000","last_clean":"2024-04-19T02:16:36.118904+0000","last_became_active":"2024-04-19T02:15:29.283121+0000","last_became_peered":"2024-04-19T02:15:29.283121+0000","last_unstale":"2024-04-19T02:16:36.118904+0000","last_undegraded":"2024-04-19T02:16:36.118904+0000","last_fullsized":"2024-04-19T02:16:36.118904+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118730+0000","last_change":"2024-04-19T02:15:29.285139+0000","last_active":"2024-04-19T02:16:36.118730+0000","last_peered":"2024-04-19T02:16:36.118730+0000","last_clean":"2024-04-19T02:16:36.118730+0000","last_became_active":"2024-04-19T02:15:29.284649+0000","last_became_peered":"2024-04-19T02:15:29.284649+0000","last_unstale":"2024-04-19T02:16:36.118730+0000","last_undegraded":"2024-04-19T02:16:36.118730+0000","last_fullsized":"2024-04-19T02:16:36.118730+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118330+0000","last_change":"2024-04-19T02:15:29.283648+0000","last_active":"2024-04-19T02:16:36.118330+0000","last_peered":"2024-04-19T02:16:36.118330+0000","last_clean":"2024-04-19T02:16:36.118330+0000","last_became_active":"2024-04-19T02:15:29.281606+0000","last_became_peered":"2024-04-19T02:15:29.281606+0000","last_unstale":"2024-04-19T02:16:36.118330+0000","last_undegraded":"2024-04-19T02:16:36.118330+0000","last_fullsized":"2024-04-19T02:16:36.118330+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109828+0000","last_change":"2024-04-19T02:15:29.278673+0000","last_active":"2024-04-19T02:16:36.109828+0000","last_peered":"2024-04-19T02:16:36.109828+0000","last_clean":"2024-04-19T02:16:36.109828+0000","last_became_active":"2024-04-19T02:15:29.277699+0000","last_became_peered":"2024-04-19T02:15:29.277699+0000","last_unstale":"2024-04-19T02:16:36.109828+0000","last_undegraded":"2024-04-19T02:16:36.109828+0000","last_fullsized":"2024-04-19T02:16:36.109828+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.115725+0000","last_change":"2024-04-19T02:15:29.283341+0000","last_active":"2024-04-19T02:16:36.115725+0000","last_peered":"2024-04-19T02:16:36.115725+0000","last_clean":"2024-04-19T02:16:36.115725+0000","last_became_active":"2024-04-19T02:15:29.281591+0000","last_became_peered":"2024-04-19T02:15:29.281591+0000","last_unstale":"2024-04-19T02:16:36.115725+0000","last_undegraded":"2024-04-19T02:16:36.115725+0000","last_fullsized":"2024-04-19T02:16:36.115725+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:34.593754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109881+0000","last_change":"2024-04-19T02:15:29.282110+0000","last_active":"2024-04-19T02:16:36.109881+0000","last_peered":"2024-04-19T02:16:36.109881+0000","last_clean":"2024-04-19T02:16:36.109881+0000","last_became_active":"2024-04-19T02:15:29.281716+0000","last_became_peered":"2024-04-19T02:15:29.281716+0000","last_unstale":"2024-04-19T02:16:36.109881+0000","last_undegraded":"2024-04-19T02:16:36.109881+0000","last_fullsized":"2024-04-19T02:16:36.109881+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119482+0000","last_change":"2024-04-19T02:15:29.285237+0000","last_active":"2024-04-19T02:16:36.119482+0000","last_peered":"2024-04-19T02:16:36.119482+0000","last_clean":"2024-04-19T02:16:36.119482+0000","last_became_active":"2024-04-19T02:15:29.282790+0000","last_became_peered":"2024-04-19T02:15:29.282790+0000","last_unstale":"2024-04-19T02:16:36.119482+0000","last_undegraded":"2024-04-19T02:16:36.119482+0000","last_fullsized":"2024-04-19T02:16:36.119482+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118682+0000","last_change":"2024-04-19T02:15:29.282609+0000","last_active":"2024-04-19T02:16:36.118682+0000","last_peered":"2024-04-19T02:16:36.118682+0000","last_clean":"2024-04-19T02:16:36.118682+0000","last_became_active":"2024-04-19T02:15:29.281665+0000","last_became_peered":"2024-04-19T02:15:29.281665+0000","last_unstale":"2024-04-19T02:16:36.118682+0000","last_undegraded":"2024-04-19T02:16:36.118682+0000","last_fullsized":"2024-04-19T02:16:36.118682+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.384881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118442+0000","last_change":"2024-04-19T02:15:53.955813+0000","last_active":"2024-04-19T02:16:36.118442+0000","last_peered":"2024-04-19T02:16:36.118442+0000","last_clean":"2024-04-19T02:16:36.118442+0000","last_became_active":"2024-04-19T02:15:53.955614+0000","last_became_peered":"2024-04-19T02:15:53.955614+0000","last_unstale":"2024-04-19T02:16:36.118442+0000","last_undegraded":"2024-04-19T02:16:36.118442+0000","last_fullsized":"2024-04-19T02:16:36.118442+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:58:03.192647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109416+0000","last_change":"2024-04-19T02:15:29.277109+0000","last_active":"2024-04-19T02:16:36.109416+0000","last_peered":"2024-04-19T02:16:36.109416+0000","last_clean":"2024-04-19T02:16:36.109416+0000","last_became_active":"2024-04-19T02:15:29.275417+0000","last_became_peered":"2024-04-19T02:15:29.275417+0000","last_unstale":"2024-04-19T02:16:36.109416+0000","last_undegraded":"2024-04-19T02:16:36.109416+0000","last_fullsized":"2024-04-19T02:16:36.109416+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.115084+0000","last_change":"2024-04-19T02:15:29.283266+0000","last_active":"2024-04-19T02:16:36.115084+0000","last_peered":"2024-04-19T02:16:36.115084+0000","last_clean":"2024-04-19T02:16:36.115084+0000","last_became_active":"2024-04-19T02:15:29.281505+0000","last_became_peered":"2024-04-19T02:15:29.281505+0000","last_unstale":"2024-04-19T02:16:36.115084+0000","last_undegraded":"2024-04-19T02:16:36.115084+0000","last_fullsized":"2024-04-19T02:16:36.115084+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.115920+0000","last_change":"2024-04-19T02:15:29.278084+0000","last_active":"2024-04-19T02:16:36.115920+0000","last_peered":"2024-04-19T02:16:36.115920+0000","last_clean":"2024-04-19T02:16:36.115920+0000","last_became_active":"2024-04-19T02:15:29.276952+0000","last_became_peered":"2024-04-19T02:15:29.276952+0000","last_unstale":"2024-04-19T02:16:36.115920+0000","last_undegraded":"2024-04-19T02:16:36.115920+0000","last_fullsized":"2024-04-19T02:16:36.115920+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.110442+0000","last_change":"2024-04-19T02:15:29.279904+0000","last_active":"2024-04-19T02:16:36.110442+0000","last_peered":"2024-04-19T02:16:36.110442+0000","last_clean":"2024-04-19T02:16:36.110442+0000","last_became_active":"2024-04-19T02:15:29.278938+0000","last_became_peered":"2024-04-19T02:15:29.278938+0000","last_unstale":"2024-04-19T02:16:36.110442+0000","last_undegraded":"2024-04-19T02:16:36.110442+0000","last_fullsized":"2024-04-19T02:16:36.110442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119447+0000","last_change":"2024-04-19T02:15:29.287389+0000","last_active":"2024-04-19T02:16:36.119447+0000","last_peered":"2024-04-19T02:16:36.119447+0000","last_clean":"2024-04-19T02:16:36.119447+0000","last_became_active":"2024-04-19T02:15:29.286431+0000","last_became_peered":"2024-04-19T02:15:29.286431+0000","last_unstale":"2024-04-19T02:16:36.119447+0000","last_undegraded":"2024-04-19T02:16:36.119447+0000","last_fullsized":"2024-04-19T02:16:36.119447+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:58:30.117887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109444+0000","last_change":"2024-04-19T02:15:53.959207+0000","last_active":"2024-04-19T02:16:36.109444+0000","last_peered":"2024-04-19T02:16:36.109444+0000","last_clean":"2024-04-19T02:16:36.109444+0000","last_became_active":"2024-04-19T02:15:53.959007+0000","last_became_peered":"2024-04-19T02:15:53.959007+0000","last_unstale":"2024-04-19T02:16:36.109444+0000","last_undegraded":"2024-04-19T02:16:36.109444+0000","last_fullsized":"2024-04-19T02:16:36.109444+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:08:21.065077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.115630+0000","last_change":"2024-04-19T02:15:29.281792+0000","last_active":"2024-04-19T02:16:36.115630+0000","last_peered":"2024-04-19T02:16:36.115630+0000","last_clean":"2024-04-19T02:16:36.115630+0000","last_became_active":"2024-04-19T02:15:29.280479+0000","last_became_peered":"2024-04-19T02:15:29.280479+0000","last_unstale":"2024-04-19T02:16:36.115630+0000","last_undegraded":"2024-04-19T02:16:36.115630+0000","last_fullsized":"2024-04-19T02:16:36.115630+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109501+0000","last_change":"2024-04-19T02:15:28.888778+0000","last_active":"2024-04-19T02:16:36.109501+0000","last_peered":"2024-04-19T02:16:36.109501+0000","last_clean":"2024-04-19T02:16:36.109501+0000","last_became_active":"2024-04-19T02:15:28.888543+0000","last_became_peered":"2024-04-19T02:15:28.888543+0000","last_unstale":"2024-04-19T02:16:36.109501+0000","last_undegraded":"2024-04-19T02:16:36.109501+0000","last_fullsized":"2024-04-19T02:16:36.109501+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:43:51.221619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.110223+0000","last_change":"2024-04-19T02:15:29.279986+0000","last_active":"2024-04-19T02:16:36.110223+0000","last_peered":"2024-04-19T02:16:36.110223+0000","last_clean":"2024-04-19T02:16:36.110223+0000","last_became_active":"2024-04-19T02:15:29.279690+0000","last_became_peered":"2024-04-19T02:15:29.279690+0000","last_unstale":"2024-04-19T02:16:36.110223+0000","last_undegraded":"2024-04-19T02:16:36.110223+0000","last_fullsized":"2024-04-19T02:16:36.110223+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109296+0000","last_change":"2024-04-19T02:15:28.890463+0000","last_active":"2024-04-19T02:16:36.109296+0000","last_peered":"2024-04-19T02:16:36.109296+0000","last_clean":"2024-04-19T02:16:36.109296+0000","last_became_active":"2024-04-19T02:15:28.889777+0000","last_became_peered":"2024-04-19T02:15:28.889777+0000","last_unstale":"2024-04-19T02:16:36.109296+0000","last_undegraded":"2024-04-19T02:16:36.109296+0000","last_fullsized":"2024-04-19T02:16:36.109296+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:58:21.520250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.115861+0000","last_change":"2024-04-19T02:15:29.280879+0000","last_active":"2024-04-19T02:16:36.115861+0000","last_peered":"2024-04-19T02:16:36.115861+0000","last_clean":"2024-04-19T02:16:36.115861+0000","last_became_active":"2024-04-19T02:15:29.279314+0000","last_became_peered":"2024-04-19T02:15:29.279314+0000","last_unstale":"2024-04-19T02:16:36.115861+0000","last_undegraded":"2024-04-19T02:16:36.115861+0000","last_fullsized":"2024-04-19T02:16:36.115861+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.110396+0000","last_change":"2024-04-19T02:15:28.891867+0000","last_active":"2024-04-19T02:16:36.110396+0000","last_peered":"2024-04-19T02:16:36.110396+0000","last_clean":"2024-04-19T02:16:36.110396+0000","last_became_active":"2024-04-19T02:15:28.890806+0000","last_became_peered":"2024-04-19T02:15:28.890806+0000","last_unstale":"2024-04-19T02:16:36.110396+0000","last_undegraded":"2024-04-19T02:16:36.110396+0000","last_fullsized":"2024-04-19T02:16:36.110396+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:57.946581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109200+0000","last_change":"2024-04-19T02:15:29.278148+0000","last_active":"2024-04-19T02:16:36.109200+0000","last_peered":"2024-04-19T02:16:36.109200+0000","last_clean":"2024-04-19T02:16:36.109200+0000","last_became_active":"2024-04-19T02:15:29.277402+0000","last_became_peered":"2024-04-19T02:15:29.277402+0000","last_unstale":"2024-04-19T02:16:36.109200+0000","last_undegraded":"2024-04-19T02:16:36.109200+0000","last_fullsized":"2024-04-19T02:16:36.109200+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119644+0000","last_change":"2024-04-19T02:15:28.892905+0000","last_active":"2024-04-19T02:16:36.119644+0000","last_peered":"2024-04-19T02:16:36.119644+0000","last_clean":"2024-04-19T02:16:36.119644+0000","last_became_active":"2024-04-19T02:15:28.892541+0000","last_became_peered":"2024-04-19T02:15:28.892541+0000","last_unstale":"2024-04-19T02:16:36.119644+0000","last_undegraded":"2024-04-19T02:16:36.119644+0000","last_fullsized":"2024-04-19T02:16:36.119644+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:33.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.110091+0000","last_change":"2024-04-19T02:15:29.278810+0000","last_active":"2024-04-19T02:16:36.110091+0000","last_peered":"2024-04-19T02:16:36.110091+0000","last_clean":"2024-04-19T02:16:36.110091+0000","last_became_active":"2024-04-19T02:15:29.278093+0000","last_became_peered":"2024-04-19T02:15:29.278093+0000","last_unstale":"2024-04-19T02:16:36.110091+0000","last_undegraded":"2024-04-19T02:16:36.110091+0000","last_fullsized":"2024-04-19T02:16:36.110091+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:34.883207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.115376+0000","last_change":"2024-04-19T02:15:28.892937+0000","last_active":"2024-04-19T02:16:36.115376+0000","last_peered":"2024-04-19T02:16:36.115376+0000","last_clean":"2024-04-19T02:16:36.115376+0000","last_became_active":"2024-04-19T02:15:28.891440+0000","last_became_peered":"2024-04-19T02:15:28.891440+0000","last_unstale":"2024-04-19T02:16:36.115376+0000","last_undegraded":"2024-04-19T02:16:36.115376+0000","last_fullsized":"2024-04-19T02:16:36.115376+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109371+0000","last_change":"2024-04-19T02:15:29.278404+0000","last_active":"2024-04-19T02:16:36.109371+0000","last_peered":"2024-04-19T02:16:36.109371+0000","last_clean":"2024-04-19T02:16:36.109371+0000","last_became_active":"2024-04-19T02:15:29.277460+0000","last_became_peered":"2024-04-19T02:15:29.277460+0000","last_unstale":"2024-04-19T02:16:36.109371+0000","last_undegraded":"2024-04-19T02:16:36.109371+0000","last_fullsized":"2024-04-19T02:16:36.109371+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119407+0000","last_change":"2024-04-19T02:15:28.891097+0000","last_active":"2024-04-19T02:16:36.119407+0000","last_peered":"2024-04-19T02:16:36.119407+0000","last_clean":"2024-04-19T02:16:36.119407+0000","last_became_active":"2024-04-19T02:15:28.890795+0000","last_became_peered":"2024-04-19T02:15:28.890795+0000","last_unstale":"2024-04-19T02:16:36.119407+0000","last_undegraded":"2024-04-19T02:16:36.119407+0000","last_fullsized":"2024-04-19T02:16:36.119407+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.120535+0000","last_change":"2024-04-19T02:15:29.278546+0000","last_active":"2024-04-19T02:16:36.120535+0000","last_peered":"2024-04-19T02:16:36.120535+0000","last_clean":"2024-04-19T02:16:36.120535+0000","last_became_active":"2024-04-19T02:15:29.277547+0000","last_became_peered":"2024-04-19T02:15:29.277547+0000","last_unstale":"2024-04-19T02:16:36.120535+0000","last_undegraded":"2024-04-19T02:16:36.120535+0000","last_fullsized":"2024-04-19T02:16:36.120535+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119008+0000","last_change":"2024-04-19T02:15:28.892977+0000","last_active":"2024-04-19T02:16:36.119008+0000","last_peered":"2024-04-19T02:16:36.119008+0000","last_clean":"2024-04-19T02:16:36.119008+0000","last_became_active":"2024-04-19T02:15:28.892636+0000","last_became_peered":"2024-04-19T02:15:28.892636+0000","last_unstale":"2024-04-19T02:16:36.119008+0000","last_undegraded":"2024-04-19T02:16:36.119008+0000","last_fullsized":"2024-04-19T02:16:36.119008+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:43:51.221619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109598+0000","last_change":"2024-04-19T02:15:53.955655+0000","last_active":"2024-04-19T02:16:36.109598+0000","last_peered":"2024-04-19T02:16:36.109598+0000","last_clean":"2024-04-19T02:16:36.109598+0000","last_became_active":"2024-04-19T02:15:53.955382+0000","last_became_peered":"2024-04-19T02:15:53.955382+0000","last_unstale":"2024-04-19T02:16:36.109598+0000","last_undegraded":"2024-04-19T02:16:36.109598+0000","last_fullsized":"2024-04-19T02:16:36.109598+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:48.239260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109444+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:16:36.109444+0000","last_peered":"2024-04-19T02:16:36.109444+0000","last_clean":"2024-04-19T02:16:36.109444+0000","last_became_active":"2024-04-19T02:15:28.890751+0000","last_became_peered":"2024-04-19T02:15:28.890751+0000","last_unstale":"2024-04-19T02:16:36.109444+0000","last_undegraded":"2024-04-19T02:16:36.109444+0000","last_fullsized":"2024-04-19T02:16:36.109444+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109523+0000","last_change":"2024-04-19T02:15:53.957865+0000","last_active":"2024-04-19T02:16:36.109523+0000","last_peered":"2024-04-19T02:16:36.109523+0000","last_clean":"2024-04-19T02:16:36.109523+0000","last_became_active":"2024-04-19T02:15:53.957627+0000","last_became_peered":"2024-04-19T02:15:53.957627+0000","last_unstale":"2024-04-19T02:16:36.109523+0000","last_undegraded":"2024-04-19T02:16:36.109523+0000","last_fullsized":"2024-04-19T02:16:36.109523+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:16:45.799016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.114958+0000","last_change":"2024-04-19T02:15:28.892934+0000","last_active":"2024-04-19T02:16:36.114958+0000","last_peered":"2024-04-19T02:16:36.114958+0000","last_clean":"2024-04-19T02:16:36.114958+0000","last_became_active":"2024-04-19T02:15:28.891879+0000","last_became_peered":"2024-04-19T02:15:28.891879+0000","last_unstale":"2024-04-19T02:16:36.114958+0000","last_undegraded":"2024-04-19T02:16:36.114958+0000","last_fullsized":"2024-04-19T02:16:36.114958+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:10:12.514798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.110374+0000","last_change":"2024-04-19T02:15:29.279685+0000","last_active":"2024-04-19T02:16:36.110374+0000","last_peered":"2024-04-19T02:16:36.110374+0000","last_clean":"2024-04-19T02:16:36.110374+0000","last_became_active":"2024-04-19T02:15:29.278810+0000","last_became_peered":"2024-04-19T02:15:29.278810+0000","last_unstale":"2024-04-19T02:16:36.110374+0000","last_undegraded":"2024-04-19T02:16:36.110374+0000","last_fullsized":"2024-04-19T02:16:36.110374+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118492+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:16:36.118492+0000","last_peered":"2024-04-19T02:16:36.118492+0000","last_clean":"2024-04-19T02:16:36.118492+0000","last_became_active":"2024-04-19T02:15:28.890882+0000","last_became_peered":"2024-04-19T02:15:28.890882+0000","last_unstale":"2024-04-19T02:16:36.118492+0000","last_undegraded":"2024-04-19T02:16:36.118492+0000","last_fullsized":"2024-04-19T02:16:36.118492+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:31.673938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.110562+0000","last_change":"2024-04-19T02:15:29.284258+0000","last_active":"2024-04-19T02:16:36.110562+0000","last_peered":"2024-04-19T02:16:36.110562+0000","last_clean":"2024-04-19T02:16:36.110562+0000","last_became_active":"2024-04-19T02:15:29.283995+0000","last_became_peered":"2024-04-19T02:15:29.283995+0000","last_unstale":"2024-04-19T02:16:36.110562+0000","last_undegraded":"2024-04-19T02:16:36.110562+0000","last_fullsized":"2024-04-19T02:16:36.110562+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:35.941308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"37'6312","reported_seq":6341,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-19T02:16:37.787567+0000","last_change":"2024-04-19T02:15:53.956977+0000","last_active":"2024-04-19T02:16:37.787567+0000","last_peered":"2024-04-19T02:16:37.787567+0000","last_clean":"2024-04-19T02:16:37.787567+0000","last_became_active":"2024-04-19T02:15:53.956730+0000","last_became_peered":"2024-04-19T02:15:53.956730+0000","last_unstale":"2024-04-19T02:16:37.787567+0000","last_undegraded":"2024-04-19T02:16:37.787567+0000","last_fullsized":"2024-04-19T02:16:37.787567+0000","mapping_epoch":16,"log_start":"23'2600","ondisk_log_start":"23'2600","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3712,"log_dups_size":0,"ondisk_log_size":3712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:56:46.323499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413663232,"num_objects":6312,"num_object_clones":0,"num_object_copies":12624,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6312,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6312,"num_write_kb":403968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119482+0000","last_change":"2024-04-19T02:15:28.890265+0000","last_active":"2024-04-19T02:16:36.119482+0000","last_peered":"2024-04-19T02:16:36.119482+0000","last_clean":"2024-04-19T02:16:36.119482+0000","last_became_active":"2024-04-19T02:15:28.890004+0000","last_became_peered":"2024-04-19T02:15:28.890004+0000","last_unstale":"2024-04-19T02:16:36.119482+0000","last_undegraded":"2024-04-19T02:16:36.119482+0000","last_fullsized":"2024-04-19T02:16:36.119482+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:02.517101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.114836+0000","last_change":"2024-04-19T02:15:29.285529+0000","last_active":"2024-04-19T02:16:36.114836+0000","last_peered":"2024-04-19T02:16:36.114836+0000","last_clean":"2024-04-19T02:16:36.114836+0000","last_became_active":"2024-04-19T02:15:29.285197+0000","last_became_peered":"2024-04-19T02:15:29.285197+0000","last_unstale":"2024-04-19T02:16:36.114836+0000","last_undegraded":"2024-04-19T02:16:36.114836+0000","last_fullsized":"2024-04-19T02:16:36.114836+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"37'6301","reported_seq":6330,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-19T02:16:37.743800+0000","last_change":"2024-04-19T02:15:53.958523+0000","last_active":"2024-04-19T02:16:37.743800+0000","last_peered":"2024-04-19T02:16:37.743800+0000","last_clean":"2024-04-19T02:16:37.743800+0000","last_became_active":"2024-04-19T02:15:53.957627+0000","last_became_peered":"2024-04-19T02:15:53.957627+0000","last_unstale":"2024-04-19T02:16:37.743800+0000","last_undegraded":"2024-04-19T02:16:37.743800+0000","last_fullsized":"2024-04-19T02:16:37.743800+0000","mapping_epoch":16,"log_start":"22'2347","ondisk_log_start":"22'2347","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3954,"log_dups_size":0,"ondisk_log_size":3954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:59:55.120296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":412942336,"num_objects":6301,"num_object_clones":0,"num_object_copies":12602,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6301,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6301,"num_write_kb":403264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.115538+0000","last_change":"2024-04-19T02:15:28.893902+0000","last_active":"2024-04-19T02:16:36.115538+0000","last_peered":"2024-04-19T02:16:36.115538+0000","last_clean":"2024-04-19T02:16:36.115538+0000","last_became_active":"2024-04-19T02:15:28.893231+0000","last_became_peered":"2024-04-19T02:15:28.893231+0000","last_unstale":"2024-04-19T02:16:36.115538+0000","last_undegraded":"2024-04-19T02:16:36.115538+0000","last_fullsized":"2024-04-19T02:16:36.115538+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:23.658442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.115048+0000","last_change":"2024-04-19T02:15:29.282874+0000","last_active":"2024-04-19T02:16:36.115048+0000","last_peered":"2024-04-19T02:16:36.115048+0000","last_clean":"2024-04-19T02:16:36.115048+0000","last_became_active":"2024-04-19T02:15:29.281675+0000","last_became_peered":"2024-04-19T02:15:29.281675+0000","last_unstale":"2024-04-19T02:16:36.115048+0000","last_undegraded":"2024-04-19T02:16:36.115048+0000","last_fullsized":"2024-04-19T02:16:36.115048+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:35.941308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"37'6199","reported_seq":6226,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-19T02:16:37.759413+0000","last_change":"2024-04-19T02:15:53.958324+0000","last_active":"2024-04-19T02:16:37.759413+0000","last_peered":"2024-04-19T02:16:37.759413+0000","last_clean":"2024-04-19T02:16:37.759413+0000","last_became_active":"2024-04-19T02:15:53.957392+0000","last_became_peered":"2024-04-19T02:15:53.957392+0000","last_unstale":"2024-04-19T02:16:37.759413+0000","last_undegraded":"2024-04-19T02:16:37.759413+0000","last_fullsized":"2024-04-19T02:16:37.759413+0000","mapping_epoch":16,"log_start":"22'2300","ondisk_log_start":"22'2300","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3899,"log_dups_size":0,"ondisk_log_size":3899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:12:58.132969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":406257664,"num_objects":6199,"num_object_clones":0,"num_object_copies":12398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6199,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6199,"num_write_kb":396736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119538+0000","last_change":"2024-04-19T02:15:28.891234+0000","last_active":"2024-04-19T02:16:36.119538+0000","last_peered":"2024-04-19T02:16:36.119538+0000","last_clean":"2024-04-19T02:16:36.119538+0000","last_became_active":"2024-04-19T02:15:28.890881+0000","last_became_peered":"2024-04-19T02:15:28.890881+0000","last_unstale":"2024-04-19T02:16:36.119538+0000","last_undegraded":"2024-04-19T02:16:36.119538+0000","last_fullsized":"2024-04-19T02:16:36.119538+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118794+0000","last_change":"2024-04-19T02:15:29.281937+0000","last_active":"2024-04-19T02:16:36.118794+0000","last_peered":"2024-04-19T02:16:36.118794+0000","last_clean":"2024-04-19T02:16:36.118794+0000","last_became_active":"2024-04-19T02:15:29.280727+0000","last_became_peered":"2024-04-19T02:15:29.280727+0000","last_unstale":"2024-04-19T02:16:36.118794+0000","last_undegraded":"2024-04-19T02:16:36.118794+0000","last_fullsized":"2024-04-19T02:16:36.118794+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"37'6332","reported_seq":6361,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-19T02:16:37.772023+0000","last_change":"2024-04-19T02:15:53.959099+0000","last_active":"2024-04-19T02:16:37.772023+0000","last_peered":"2024-04-19T02:16:37.772023+0000","last_clean":"2024-04-19T02:16:37.772023+0000","last_became_active":"2024-04-19T02:15:53.958885+0000","last_became_peered":"2024-04-19T02:15:53.958885+0000","last_unstale":"2024-04-19T02:16:37.772023+0000","last_undegraded":"2024-04-19T02:16:37.772023+0000","last_fullsized":"2024-04-19T02:16:37.772023+0000","mapping_epoch":16,"log_start":"23'2700","ondisk_log_start":"23'2700","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3632,"log_dups_size":0,"ondisk_log_size":3632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:53:26.969927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":414973952,"num_objects":6332,"num_object_clones":0,"num_object_copies":12664,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6332,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6332,"num_write_kb":405248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119509+0000","last_change":"2024-04-19T02:15:28.892767+0000","last_active":"2024-04-19T02:16:36.119509+0000","last_peered":"2024-04-19T02:16:36.119509+0000","last_clean":"2024-04-19T02:16:36.119509+0000","last_became_active":"2024-04-19T02:15:28.892235+0000","last_became_peered":"2024-04-19T02:15:28.892235+0000","last_unstale":"2024-04-19T02:16:36.119509+0000","last_undegraded":"2024-04-19T02:16:36.119509+0000","last_fullsized":"2024-04-19T02:16:36.119509+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:37.690735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109626+0000","last_change":"2024-04-19T02:15:29.279857+0000","last_active":"2024-04-19T02:16:36.109626+0000","last_peered":"2024-04-19T02:16:36.109626+0000","last_clean":"2024-04-19T02:16:36.109626+0000","last_became_active":"2024-04-19T02:15:29.279536+0000","last_became_peered":"2024-04-19T02:15:29.279536+0000","last_unstale":"2024-04-19T02:16:36.109626+0000","last_undegraded":"2024-04-19T02:16:36.109626+0000","last_fullsized":"2024-04-19T02:16:36.109626+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:00.191179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"37'6264","reported_seq":6292,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-19T02:16:37.807014+0000","last_change":"2024-04-19T02:15:53.957261+0000","last_active":"2024-04-19T02:16:37.807014+0000","last_peered":"2024-04-19T02:16:37.807014+0000","last_clean":"2024-04-19T02:16:37.807014+0000","last_became_active":"2024-04-19T02:15:53.957092+0000","last_became_peered":"2024-04-19T02:15:53.957092+0000","last_unstale":"2024-04-19T02:16:37.807014+0000","last_undegraded":"2024-04-19T02:16:37.807014+0000","last_fullsized":"2024-04-19T02:16:37.807014+0000","mapping_epoch":16,"log_start":"23'2513","ondisk_log_start":"23'2513","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3751,"log_dups_size":0,"ondisk_log_size":3751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:54:15.544923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":410517504,"num_objects":6264,"num_object_clones":0,"num_object_copies":12528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6264,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6264,"num_write_kb":400896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109542+0000","last_change":"2024-04-19T02:15:28.891611+0000","last_active":"2024-04-19T02:16:36.109542+0000","last_peered":"2024-04-19T02:16:36.109542+0000","last_clean":"2024-04-19T02:16:36.109542+0000","last_became_active":"2024-04-19T02:15:28.890914+0000","last_became_peered":"2024-04-19T02:15:28.890914+0000","last_unstale":"2024-04-19T02:16:36.109542+0000","last_undegraded":"2024-04-19T02:16:36.109542+0000","last_fullsized":"2024-04-19T02:16:36.109542+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:37.690735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119155+0000","last_change":"2024-04-19T02:15:29.285774+0000","last_active":"2024-04-19T02:16:36.119155+0000","last_peered":"2024-04-19T02:16:36.119155+0000","last_clean":"2024-04-19T02:16:36.119155+0000","last_became_active":"2024-04-19T02:15:29.284705+0000","last_became_peered":"2024-04-19T02:15:29.284705+0000","last_unstale":"2024-04-19T02:16:36.119155+0000","last_undegraded":"2024-04-19T02:16:36.119155+0000","last_fullsized":"2024-04-19T02:16:36.119155+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"37'6195","reported_seq":6224,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-19T02:16:37.752803+0000","last_change":"2024-04-19T02:15:53.955286+0000","last_active":"2024-04-19T02:16:37.752803+0000","last_peered":"2024-04-19T02:16:37.752803+0000","last_clean":"2024-04-19T02:16:37.752803+0000","last_became_active":"2024-04-19T02:15:53.955026+0000","last_became_peered":"2024-04-19T02:15:53.955026+0000","last_unstale":"2024-04-19T02:16:37.752803+0000","last_undegraded":"2024-04-19T02:16:37.752803+0000","last_fullsized":"2024-04-19T02:16:37.752803+0000","mapping_epoch":16,"log_start":"23'2600","ondisk_log_start":"23'2600","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3595,"log_dups_size":0,"ondisk_log_size":3595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:05:48.594301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":405995520,"num_objects":6195,"num_object_clones":0,"num_object_copies":12390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6195,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6195,"num_write_kb":396480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118652+0000","last_change":"2024-04-19T02:15:28.892873+0000","last_active":"2024-04-19T02:16:36.118652+0000","last_peered":"2024-04-19T02:16:36.118652+0000","last_clean":"2024-04-19T02:16:36.118652+0000","last_became_active":"2024-04-19T02:15:28.892487+0000","last_became_peered":"2024-04-19T02:15:28.892487+0000","last_unstale":"2024-04-19T02:16:36.118652+0000","last_undegraded":"2024-04-19T02:16:36.118652+0000","last_fullsized":"2024-04-19T02:16:36.118652+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:35.412837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119736+0000","last_change":"2024-04-19T02:15:29.285019+0000","last_active":"2024-04-19T02:16:36.119736+0000","last_peered":"2024-04-19T02:16:36.119736+0000","last_clean":"2024-04-19T02:16:36.119736+0000","last_became_active":"2024-04-19T02:15:29.284650+0000","last_became_peered":"2024-04-19T02:15:29.284650+0000","last_unstale":"2024-04-19T02:16:36.119736+0000","last_undegraded":"2024-04-19T02:16:36.119736+0000","last_fullsized":"2024-04-19T02:16:36.119736+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"37'6289","reported_seq":6318,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-19T02:16:37.787045+0000","last_change":"2024-04-19T02:15:53.957403+0000","last_active":"2024-04-19T02:16:37.787045+0000","last_peered":"2024-04-19T02:16:37.787045+0000","last_clean":"2024-04-19T02:16:37.787045+0000","last_became_active":"2024-04-19T02:15:53.957190+0000","last_became_peered":"2024-04-19T02:15:53.957190+0000","last_unstale":"2024-04-19T02:16:37.787045+0000","last_undegraded":"2024-04-19T02:16:37.787045+0000","last_fullsized":"2024-04-19T02:16:37.787045+0000","mapping_epoch":16,"log_start":"23'2601","ondisk_log_start":"23'2601","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3688,"log_dups_size":0,"ondisk_log_size":3688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:07:12.817884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":412155904,"num_objects":6289,"num_object_clones":0,"num_object_copies":12578,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6289,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6289,"num_write_kb":402496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118538+0000","last_change":"2024-04-19T02:15:53.956839+0000","last_active":"2024-04-19T02:16:36.118538+0000","last_peered":"2024-04-19T02:16:36.118538+0000","last_clean":"2024-04-19T02:16:36.118538+0000","last_became_active":"2024-04-19T02:15:53.956630+0000","last_became_peered":"2024-04-19T02:15:53.956630+0000","last_unstale":"2024-04-19T02:16:36.118538+0000","last_undegraded":"2024-04-19T02:16:36.118538+0000","last_fullsized":"2024-04-19T02:16:36.118538+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:47.229730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119650+0000","last_change":"2024-04-19T02:15:29.287190+0000","last_active":"2024-04-19T02:16:36.119650+0000","last_peered":"2024-04-19T02:16:36.119650+0000","last_clean":"2024-04-19T02:16:36.119650+0000","last_became_active":"2024-04-19T02:15:29.286606+0000","last_became_peered":"2024-04-19T02:15:29.286606+0000","last_unstale":"2024-04-19T02:16:36.119650+0000","last_undegraded":"2024-04-19T02:16:36.119650+0000","last_fullsized":"2024-04-19T02:16:36.119650+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:28.387062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"37'6160","reported_seq":6189,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-19T02:16:37.708869+0000","last_change":"2024-04-19T02:15:53.958448+0000","last_active":"2024-04-19T02:16:37.708869+0000","last_peered":"2024-04-19T02:16:37.708869+0000","last_clean":"2024-04-19T02:16:37.708869+0000","last_became_active":"2024-04-19T02:15:53.957595+0000","last_became_peered":"2024-04-19T02:15:53.957595+0000","last_unstale":"2024-04-19T02:16:37.708869+0000","last_undegraded":"2024-04-19T02:16:37.708869+0000","last_fullsized":"2024-04-19T02:16:37.708869+0000","mapping_epoch":16,"log_start":"22'2244","ondisk_log_start":"22'2244","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3916,"log_dups_size":0,"ondisk_log_size":3916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:26:31.855319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":403701760,"num_objects":6160,"num_object_clones":0,"num_object_copies":12320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6160,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6160,"num_write_kb":394240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.114969+0000","last_change":"2024-04-19T02:15:28.894121+0000","last_active":"2024-04-19T02:16:36.114969+0000","last_peered":"2024-04-19T02:16:36.114969+0000","last_clean":"2024-04-19T02:16:36.114969+0000","last_became_active":"2024-04-19T02:15:28.893902+0000","last_became_peered":"2024-04-19T02:15:28.893902+0000","last_unstale":"2024-04-19T02:16:36.114969+0000","last_undegraded":"2024-04-19T02:16:36.114969+0000","last_fullsized":"2024-04-19T02:16:36.114969+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:10:35.146583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.110130+0000","last_change":"2024-04-19T02:15:29.282870+0000","last_active":"2024-04-19T02:16:36.110130+0000","last_peered":"2024-04-19T02:16:36.110130+0000","last_clean":"2024-04-19T02:16:36.110130+0000","last_became_active":"2024-04-19T02:15:29.281873+0000","last_became_peered":"2024-04-19T02:15:29.281873+0000","last_unstale":"2024-04-19T02:16:36.110130+0000","last_undegraded":"2024-04-19T02:16:36.110130+0000","last_fullsized":"2024-04-19T02:16:36.110130+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"37'6297","reported_seq":6326,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-19T02:16:37.716291+0000","last_change":"2024-04-19T02:15:53.955498+0000","last_active":"2024-04-19T02:16:37.716291+0000","last_peered":"2024-04-19T02:16:37.716291+0000","last_clean":"2024-04-19T02:16:37.716291+0000","last_became_active":"2024-04-19T02:15:53.954910+0000","last_became_peered":"2024-04-19T02:15:53.954910+0000","last_unstale":"2024-04-19T02:16:37.716291+0000","last_undegraded":"2024-04-19T02:16:37.716291+0000","last_fullsized":"2024-04-19T02:16:37.716291+0000","mapping_epoch":16,"log_start":"23'2700","ondisk_log_start":"23'2700","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3597,"log_dups_size":0,"ondisk_log_size":3597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:58:27.262672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":412680192,"num_objects":6297,"num_object_clones":0,"num_object_copies":12594,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6297,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6297,"num_write_kb":403008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.110331+0000","last_change":"2024-04-19T02:15:24.527061+0000","last_active":"2024-04-19T02:16:36.110331+0000","last_peered":"2024-04-19T02:16:36.110331+0000","last_clean":"2024-04-19T02:16:36.110331+0000","last_became_active":"2024-04-19T02:15:24.526757+0000","last_became_peered":"2024-04-19T02:15:24.526757+0000","last_unstale":"2024-04-19T02:16:36.110331+0000","last_undegraded":"2024-04-19T02:16:36.110331+0000","last_fullsized":"2024-04-19T02:16:36.110331+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:17:13.649077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119650+0000","last_change":"2024-04-19T02:15:28.892766+0000","last_active":"2024-04-19T02:16:36.119650+0000","last_peered":"2024-04-19T02:16:36.119650+0000","last_clean":"2024-04-19T02:16:36.119650+0000","last_became_active":"2024-04-19T02:15:28.892396+0000","last_became_peered":"2024-04-19T02:15:28.892396+0000","last_unstale":"2024-04-19T02:16:36.119650+0000","last_undegraded":"2024-04-19T02:16:36.119650+0000","last_fullsized":"2024-04-19T02:16:36.119650+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:57.946581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.116987+0000","last_change":"2024-04-19T02:15:29.277922+0000","last_active":"2024-04-19T02:16:36.116987+0000","last_peered":"2024-04-19T02:16:36.116987+0000","last_clean":"2024-04-19T02:16:36.116987+0000","last_became_active":"2024-04-19T02:15:29.276968+0000","last_became_peered":"2024-04-19T02:15:29.276968+0000","last_unstale":"2024-04-19T02:16:36.116987+0000","last_undegraded":"2024-04-19T02:16:36.116987+0000","last_fullsized":"2024-04-19T02:16:36.116987+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"37'6244","reported_seq":6273,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-19T02:16:37.762569+0000","last_change":"2024-04-19T02:15:53.955228+0000","last_active":"2024-04-19T02:16:37.762569+0000","last_peered":"2024-04-19T02:16:37.762569+0000","last_clean":"2024-04-19T02:16:37.762569+0000","last_became_active":"2024-04-19T02:15:53.954960+0000","last_became_peered":"2024-04-19T02:15:53.954960+0000","last_unstale":"2024-04-19T02:16:37.762569+0000","last_undegraded":"2024-04-19T02:16:37.762569+0000","last_fullsized":"2024-04-19T02:16:37.762569+0000","mapping_epoch":16,"log_start":"23'2600","ondisk_log_start":"23'2600","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3644,"log_dups_size":0,"ondisk_log_size":3644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:46:07.409922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":409206784,"num_objects":6244,"num_object_clones":0,"num_object_copies":12488,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6244,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6244,"num_write_kb":399616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118913+0000","last_change":"2024-04-19T02:15:24.530933+0000","last_active":"2024-04-19T02:16:36.118913+0000","last_peered":"2024-04-19T02:16:36.118913+0000","last_clean":"2024-04-19T02:16:36.118913+0000","last_became_active":"2024-04-19T02:15:24.530550+0000","last_became_peered":"2024-04-19T02:15:24.530550+0000","last_unstale":"2024-04-19T02:16:36.118913+0000","last_undegraded":"2024-04-19T02:16:36.118913+0000","last_fullsized":"2024-04-19T02:16:36.118913+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:18:15.194321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118812+0000","last_change":"2024-04-19T02:15:28.893062+0000","last_active":"2024-04-19T02:16:36.118812+0000","last_peered":"2024-04-19T02:16:36.118812+0000","last_clean":"2024-04-19T02:16:36.118812+0000","last_became_active":"2024-04-19T02:15:28.892798+0000","last_became_peered":"2024-04-19T02:15:28.892798+0000","last_unstale":"2024-04-19T02:16:36.118812+0000","last_undegraded":"2024-04-19T02:16:36.118812+0000","last_fullsized":"2024-04-19T02:16:36.118812+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:53.170180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.110264+0000","last_change":"2024-04-19T02:15:29.278294+0000","last_active":"2024-04-19T02:16:36.110264+0000","last_peered":"2024-04-19T02:16:36.110264+0000","last_clean":"2024-04-19T02:16:36.110264+0000","last_became_active":"2024-04-19T02:15:29.277536+0000","last_became_peered":"2024-04-19T02:15:29.277536+0000","last_unstale":"2024-04-19T02:16:36.110264+0000","last_undegraded":"2024-04-19T02:16:36.110264+0000","last_fullsized":"2024-04-19T02:16:36.110264+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"37'6254","reported_seq":6283,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-19T02:16:37.777667+0000","last_change":"2024-04-19T02:15:53.956251+0000","last_active":"2024-04-19T02:16:37.777667+0000","last_peered":"2024-04-19T02:16:37.777667+0000","last_clean":"2024-04-19T02:16:37.777667+0000","last_became_active":"2024-04-19T02:15:53.955886+0000","last_became_peered":"2024-04-19T02:15:53.955886+0000","last_unstale":"2024-04-19T02:16:37.777667+0000","last_undegraded":"2024-04-19T02:16:37.777667+0000","last_fullsized":"2024-04-19T02:16:37.777667+0000","mapping_epoch":16,"log_start":"23'2600","ondisk_log_start":"23'2600","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3654,"log_dups_size":0,"ondisk_log_size":3654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:38:38.586906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":409862144,"num_objects":6254,"num_object_clones":0,"num_object_copies":12508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6254,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6254,"num_write_kb":400256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109339+0000","last_change":"2024-04-19T02:15:24.527048+0000","last_active":"2024-04-19T02:16:36.109339+0000","last_peered":"2024-04-19T02:16:36.109339+0000","last_clean":"2024-04-19T02:16:36.109339+0000","last_became_active":"2024-04-19T02:15:24.526790+0000","last_became_peered":"2024-04-19T02:15:24.526790+0000","last_unstale":"2024-04-19T02:16:36.109339+0000","last_undegraded":"2024-04-19T02:16:36.109339+0000","last_fullsized":"2024-04-19T02:16:36.109339+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118208+0000","last_change":"2024-04-19T02:15:53.956945+0000","last_active":"2024-04-19T02:16:36.118208+0000","last_peered":"2024-04-19T02:16:36.118208+0000","last_clean":"2024-04-19T02:16:36.118208+0000","last_became_active":"2024-04-19T02:15:53.956719+0000","last_became_peered":"2024-04-19T02:15:53.956719+0000","last_unstale":"2024-04-19T02:16:36.118208+0000","last_undegraded":"2024-04-19T02:16:36.118208+0000","last_fullsized":"2024-04-19T02:16:36.118208+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:00:37.754624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.110687+0000","last_change":"2024-04-19T02:15:29.282663+0000","last_active":"2024-04-19T02:16:36.110687+0000","last_peered":"2024-04-19T02:16:36.110687+0000","last_clean":"2024-04-19T02:16:36.110687+0000","last_became_active":"2024-04-19T02:15:29.282217+0000","last_became_peered":"2024-04-19T02:15:29.282217+0000","last_unstale":"2024-04-19T02:16:36.110687+0000","last_undegraded":"2024-04-19T02:16:36.110687+0000","last_fullsized":"2024-04-19T02:16:36.110687+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"37'6174","reported_seq":6203,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-19T02:16:37.748233+0000","last_change":"2024-04-19T02:15:53.958264+0000","last_active":"2024-04-19T02:16:37.748233+0000","last_peered":"2024-04-19T02:16:37.748233+0000","last_clean":"2024-04-19T02:16:37.748233+0000","last_became_active":"2024-04-19T02:15:53.956689+0000","last_became_peered":"2024-04-19T02:15:53.956689+0000","last_unstale":"2024-04-19T02:16:37.748233+0000","last_undegraded":"2024-04-19T02:16:37.748233+0000","last_fullsized":"2024-04-19T02:16:37.748233+0000","mapping_epoch":16,"log_start":"22'2200","ondisk_log_start":"22'2200","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3974,"log_dups_size":0,"ondisk_log_size":3974,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:24:32.928594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404619264,"num_objects":6174,"num_object_clones":0,"num_object_copies":12348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6174,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6174,"num_write_kb":395136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118853+0000","last_change":"2024-04-19T02:15:24.530924+0000","last_active":"2024-04-19T02:16:36.118853+0000","last_peered":"2024-04-19T02:16:36.118853+0000","last_clean":"2024-04-19T02:16:36.118853+0000","last_became_active":"2024-04-19T02:15:24.530551+0000","last_became_peered":"2024-04-19T02:15:24.530551+0000","last_unstale":"2024-04-19T02:16:36.118853+0000","last_undegraded":"2024-04-19T02:16:36.118853+0000","last_fullsized":"2024-04-19T02:16:36.118853+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:30.576946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":232,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118383+0000","last_change":"2024-04-19T02:15:24.533634+0000","last_active":"2024-04-19T02:16:36.118383+0000","last_peered":"2024-04-19T02:16:36.118383+0000","last_clean":"2024-04-19T02:16:36.118383+0000","last_became_active":"2024-04-19T02:15:24.533420+0000","last_became_peered":"2024-04-19T02:15:24.533420+0000","last_unstale":"2024-04-19T02:16:36.118383+0000","last_undegraded":"2024-04-19T02:16:36.118383+0000","last_fullsized":"2024-04-19T02:16:36.118383+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109353+0000","last_change":"2024-04-19T02:15:28.890244+0000","last_active":"2024-04-19T02:16:36.109353+0000","last_peered":"2024-04-19T02:16:36.109353+0000","last_clean":"2024-04-19T02:16:36.109353+0000","last_became_active":"2024-04-19T02:15:28.889831+0000","last_became_peered":"2024-04-19T02:15:28.889831+0000","last_unstale":"2024-04-19T02:16:36.109353+0000","last_undegraded":"2024-04-19T02:16:36.109353+0000","last_fullsized":"2024-04-19T02:16:36.109353+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119730+0000","last_change":"2024-04-19T02:15:29.285015+0000","last_active":"2024-04-19T02:16:36.119730+0000","last_peered":"2024-04-19T02:16:36.119730+0000","last_clean":"2024-04-19T02:16:36.119730+0000","last_became_active":"2024-04-19T02:15:29.284164+0000","last_became_peered":"2024-04-19T02:15:29.284164+0000","last_unstale":"2024-04-19T02:16:36.119730+0000","last_undegraded":"2024-04-19T02:16:36.119730+0000","last_fullsized":"2024-04-19T02:16:36.119730+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:36.987844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"37'6264","reported_seq":6293,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-19T02:16:37.807067+0000","last_change":"2024-04-19T02:15:53.956463+0000","last_active":"2024-04-19T02:16:37.807067+0000","last_peered":"2024-04-19T02:16:37.807067+0000","last_clean":"2024-04-19T02:16:37.807067+0000","last_became_active":"2024-04-19T02:15:53.955819+0000","last_became_peered":"2024-04-19T02:15:53.955819+0000","last_unstale":"2024-04-19T02:16:37.807067+0000","last_undegraded":"2024-04-19T02:16:37.807067+0000","last_fullsized":"2024-04-19T02:16:37.807067+0000","mapping_epoch":16,"log_start":"23'2531","ondisk_log_start":"23'2531","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3733,"log_dups_size":0,"ondisk_log_size":3733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:46:07.409922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":410517504,"num_objects":6264,"num_object_clones":0,"num_object_copies":12528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6264,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6264,"num_write_kb":400896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118407+0000","last_change":"2024-04-19T02:15:24.533912+0000","last_active":"2024-04-19T02:16:36.118407+0000","last_peered":"2024-04-19T02:16:36.118407+0000","last_clean":"2024-04-19T02:16:36.118407+0000","last_became_active":"2024-04-19T02:15:24.533580+0000","last_became_peered":"2024-04-19T02:15:24.533580+0000","last_unstale":"2024-04-19T02:16:36.118407+0000","last_undegraded":"2024-04-19T02:16:36.118407+0000","last_fullsized":"2024-04-19T02:16:36.118407+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:45.045477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109172+0000","last_change":"2024-04-19T02:15:28.891889+0000","last_active":"2024-04-19T02:16:36.109172+0000","last_peered":"2024-04-19T02:16:36.109172+0000","last_clean":"2024-04-19T02:16:36.109172+0000","last_became_active":"2024-04-19T02:15:28.890919+0000","last_became_peered":"2024-04-19T02:15:28.890919+0000","last_unstale":"2024-04-19T02:16:36.109172+0000","last_undegraded":"2024-04-19T02:16:36.109172+0000","last_fullsized":"2024-04-19T02:16:36.109172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:35.412837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109834+0000","last_change":"2024-04-19T02:15:53.957881+0000","last_active":"2024-04-19T02:16:36.109834+0000","last_peered":"2024-04-19T02:16:36.109834+0000","last_clean":"2024-04-19T02:16:36.109834+0000","last_became_active":"2024-04-19T02:15:53.957657+0000","last_became_peered":"2024-04-19T02:15:53.957657+0000","last_unstale":"2024-04-19T02:16:36.109834+0000","last_undegraded":"2024-04-19T02:16:36.109834+0000","last_fullsized":"2024-04-19T02:16:36.109834+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:46.921714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"37'6240","reported_seq":6269,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-19T02:16:37.803472+0000","last_change":"2024-04-19T02:15:53.955068+0000","last_active":"2024-04-19T02:16:37.803472+0000","last_peered":"2024-04-19T02:16:37.803472+0000","last_clean":"2024-04-19T02:16:37.803472+0000","last_became_active":"2024-04-19T02:15:53.954721+0000","last_became_peered":"2024-04-19T02:15:53.954721+0000","last_unstale":"2024-04-19T02:16:37.803472+0000","last_undegraded":"2024-04-19T02:16:37.803472+0000","last_fullsized":"2024-04-19T02:16:37.803472+0000","mapping_epoch":16,"log_start":"23'2500","ondisk_log_start":"23'2500","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3740,"log_dups_size":0,"ondisk_log_size":3740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:18:29.742535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408944640,"num_objects":6240,"num_object_clones":0,"num_object_copies":12480,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6240,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6240,"num_write_kb":399360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109748+0000","last_change":"2024-04-19T02:15:53.959105+0000","last_active":"2024-04-19T02:16:36.109748+0000","last_peered":"2024-04-19T02:16:36.109748+0000","last_clean":"2024-04-19T02:16:36.109748+0000","last_became_active":"2024-04-19T02:15:53.958836+0000","last_became_peered":"2024-04-19T02:15:53.958836+0000","last_unstale":"2024-04-19T02:16:36.109748+0000","last_undegraded":"2024-04-19T02:16:36.109748+0000","last_fullsized":"2024-04-19T02:16:36.109748+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:18:00.321514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.110191+0000","last_change":"2024-04-19T02:15:28.892125+0000","last_active":"2024-04-19T02:16:36.110191+0000","last_peered":"2024-04-19T02:16:36.110191+0000","last_clean":"2024-04-19T02:16:36.110191+0000","last_became_active":"2024-04-19T02:15:28.891300+0000","last_became_peered":"2024-04-19T02:15:28.891300+0000","last_unstale":"2024-04-19T02:16:36.110191+0000","last_undegraded":"2024-04-19T02:16:36.110191+0000","last_fullsized":"2024-04-19T02:16:36.110191+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.116300+0000","last_change":"2024-04-19T02:15:29.281694+0000","last_active":"2024-04-19T02:16:36.116300+0000","last_peered":"2024-04-19T02:16:36.116300+0000","last_clean":"2024-04-19T02:16:36.116300+0000","last_became_active":"2024-04-19T02:15:29.280519+0000","last_became_peered":"2024-04-19T02:15:29.280519+0000","last_unstale":"2024-04-19T02:16:36.116300+0000","last_undegraded":"2024-04-19T02:16:36.116300+0000","last_fullsized":"2024-04-19T02:16:36.116300+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:50.890545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"37'6069","reported_seq":10589,"reported_epoch":37,"state":"active+remapped+backfilling","last_fresh":"2024-04-19T02:16:37.777247+0000","last_change":"2024-04-19T02:16:30.103016+0000","last_active":"2024-04-19T02:16:37.777247+0000","last_peered":"2024-04-19T02:16:37.777247+0000","last_clean":"2024-04-19T02:16:22.050311+0000","last_became_active":"2024-04-19T02:16:24.119992+0000","last_became_peered":"2024-04-19T02:16:24.119992+0000","last_unstale":"2024-04-19T02:16:37.777247+0000","last_undegraded":"2024-04-19T02:16:37.777247+0000","last_fullsized":"2024-04-19T02:16:37.777247+0000","mapping_epoch":29,"log_start":"22'2437","ondisk_log_start":"22'2437","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3632,"log_dups_size":0,"ondisk_log_size":3632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:28.663111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":397737984,"num_objects":6069,"num_object_clones":0,"num_object_copies":12138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":3427,"num_objects_unfound":0,"num_objects_dirty":6069,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6069,"num_write_kb":388416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2240,"num_bytes_recovered":146800640,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[{"shards":"0,2","objects":6069}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109883+0000","last_change":"2024-04-19T02:15:28.891702+0000","last_active":"2024-04-19T02:16:36.109883+0000","last_peered":"2024-04-19T02:16:36.109883+0000","last_clean":"2024-04-19T02:16:36.109883+0000","last_became_active":"2024-04-19T02:15:28.890743+0000","last_became_peered":"2024-04-19T02:15:28.890743+0000","last_unstale":"2024-04-19T02:16:36.109883+0000","last_undegraded":"2024-04-19T02:16:36.109883+0000","last_fullsized":"2024-04-19T02:16:36.109883+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.110353+0000","last_change":"2024-04-19T02:15:24.526845+0000","last_active":"2024-04-19T02:16:36.110353+0000","last_peered":"2024-04-19T02:16:36.110353+0000","last_clean":"2024-04-19T02:16:36.110353+0000","last_became_active":"2024-04-19T02:15:24.526500+0000","last_became_peered":"2024-04-19T02:15:24.526500+0000","last_unstale":"2024-04-19T02:16:36.110353+0000","last_undegraded":"2024-04-19T02:16:36.110353+0000","last_fullsized":"2024-04-19T02:16:36.110353+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:16.883355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109192+0000","last_change":"2024-04-19T02:15:29.278686+0000","last_active":"2024-04-19T02:16:36.109192+0000","last_peered":"2024-04-19T02:16:36.109192+0000","last_clean":"2024-04-19T02:16:36.109192+0000","last_became_active":"2024-04-19T02:15:29.278108+0000","last_became_peered":"2024-04-19T02:15:29.278108+0000","last_unstale":"2024-04-19T02:16:36.109192+0000","last_undegraded":"2024-04-19T02:16:36.109192+0000","last_fullsized":"2024-04-19T02:16:36.109192+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:34.593754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"37'6135","reported_seq":6163,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-19T02:16:37.761370+0000","last_change":"2024-04-19T02:15:53.957269+0000","last_active":"2024-04-19T02:16:37.761370+0000","last_peered":"2024-04-19T02:16:37.761370+0000","last_clean":"2024-04-19T02:16:37.761370+0000","last_became_active":"2024-04-19T02:15:53.956554+0000","last_became_peered":"2024-04-19T02:15:53.956554+0000","last_unstale":"2024-04-19T02:16:37.761370+0000","last_undegraded":"2024-04-19T02:16:37.761370+0000","last_fullsized":"2024-04-19T02:16:37.761370+0000","mapping_epoch":16,"log_start":"22'2228","ondisk_log_start":"22'2228","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3907,"log_dups_size":0,"ondisk_log_size":3907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:29:38.789719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":402063360,"num_objects":6135,"num_object_clones":0,"num_object_copies":12270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6135,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6135,"num_write_kb":392640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119645+0000","last_change":"2024-04-19T02:15:24.533777+0000","last_active":"2024-04-19T02:16:36.119645+0000","last_peered":"2024-04-19T02:16:36.119645+0000","last_clean":"2024-04-19T02:16:36.119645+0000","last_became_active":"2024-04-19T02:15:24.533436+0000","last_became_peered":"2024-04-19T02:15:24.533436+0000","last_unstale":"2024-04-19T02:16:36.119645+0000","last_undegraded":"2024-04-19T02:16:36.119645+0000","last_fullsized":"2024-04-19T02:16:36.119645+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:53:25.922418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.110135+0000","last_change":"2024-04-19T02:15:28.891370+0000","last_active":"2024-04-19T02:16:36.110135+0000","last_peered":"2024-04-19T02:16:36.110135+0000","last_clean":"2024-04-19T02:16:36.110135+0000","last_became_active":"2024-04-19T02:15:28.890702+0000","last_became_peered":"2024-04-19T02:15:28.890702+0000","last_unstale":"2024-04-19T02:16:36.110135+0000","last_undegraded":"2024-04-19T02:16:36.110135+0000","last_fullsized":"2024-04-19T02:16:36.110135+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:33.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.114984+0000","last_change":"2024-04-19T02:15:29.282244+0000","last_active":"2024-04-19T02:16:36.114984+0000","last_peered":"2024-04-19T02:16:36.114984+0000","last_clean":"2024-04-19T02:16:36.114984+0000","last_became_active":"2024-04-19T02:15:29.280366+0000","last_became_peered":"2024-04-19T02:15:29.280366+0000","last_unstale":"2024-04-19T02:16:36.114984+0000","last_undegraded":"2024-04-19T02:16:36.114984+0000","last_fullsized":"2024-04-19T02:16:36.114984+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.116345+0000","last_change":"2024-04-19T02:15:28.893027+0000","last_active":"2024-04-19T02:16:36.116345+0000","last_peered":"2024-04-19T02:16:36.116345+0000","last_clean":"2024-04-19T02:16:36.116345+0000","last_became_active":"2024-04-19T02:15:28.892695+0000","last_became_peered":"2024-04-19T02:15:28.892695+0000","last_unstale":"2024-04-19T02:16:36.116345+0000","last_undegraded":"2024-04-19T02:16:36.116345+0000","last_fullsized":"2024-04-19T02:16:36.116345+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.115395+0000","last_change":"2024-04-19T02:15:29.283155+0000","last_active":"2024-04-19T02:16:36.115395+0000","last_peered":"2024-04-19T02:16:36.115395+0000","last_clean":"2024-04-19T02:16:36.115395+0000","last_became_active":"2024-04-19T02:15:29.281407+0000","last_became_peered":"2024-04-19T02:15:29.281407+0000","last_unstale":"2024-04-19T02:16:36.115395+0000","last_undegraded":"2024-04-19T02:16:36.115395+0000","last_fullsized":"2024-04-19T02:16:36.115395+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119328+0000","last_change":"2024-04-19T02:15:28.893067+0000","last_active":"2024-04-19T02:16:36.119328+0000","last_peered":"2024-04-19T02:16:36.119328+0000","last_clean":"2024-04-19T02:16:36.119328+0000","last_became_active":"2024-04-19T02:15:28.892781+0000","last_became_peered":"2024-04-19T02:15:28.892781+0000","last_unstale":"2024-04-19T02:16:36.119328+0000","last_undegraded":"2024-04-19T02:16:36.119328+0000","last_fullsized":"2024-04-19T02:16:36.119328+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:54:15.590143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118748+0000","last_change":"2024-04-19T02:15:29.281279+0000","last_active":"2024-04-19T02:16:36.118748+0000","last_peered":"2024-04-19T02:16:36.118748+0000","last_clean":"2024-04-19T02:16:36.118748+0000","last_became_active":"2024-04-19T02:15:29.279360+0000","last_became_peered":"2024-04-19T02:15:29.279360+0000","last_unstale":"2024-04-19T02:16:36.118748+0000","last_undegraded":"2024-04-19T02:16:36.118748+0000","last_fullsized":"2024-04-19T02:16:36.118748+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.115543+0000","last_change":"2024-04-19T02:15:28.893239+0000","last_active":"2024-04-19T02:16:36.115543+0000","last_peered":"2024-04-19T02:16:36.115543+0000","last_clean":"2024-04-19T02:16:36.115543+0000","last_became_active":"2024-04-19T02:15:28.892881+0000","last_became_peered":"2024-04-19T02:15:28.892881+0000","last_unstale":"2024-04-19T02:16:36.115543+0000","last_undegraded":"2024-04-19T02:16:36.115543+0000","last_fullsized":"2024-04-19T02:16:36.115543+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118723+0000","last_change":"2024-04-19T02:15:29.281652+0000","last_active":"2024-04-19T02:16:36.118723+0000","last_peered":"2024-04-19T02:16:36.118723+0000","last_clean":"2024-04-19T02:16:36.118723+0000","last_became_active":"2024-04-19T02:15:29.281175+0000","last_became_peered":"2024-04-19T02:15:29.281175+0000","last_unstale":"2024-04-19T02:16:36.118723+0000","last_undegraded":"2024-04-19T02:16:36.118723+0000","last_fullsized":"2024-04-19T02:16:36.118723+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:16.568764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.110437+0000","last_change":"2024-04-19T02:15:28.892058+0000","last_active":"2024-04-19T02:16:36.110437+0000","last_peered":"2024-04-19T02:16:36.110437+0000","last_clean":"2024-04-19T02:16:36.110437+0000","last_became_active":"2024-04-19T02:15:28.890877+0000","last_became_peered":"2024-04-19T02:15:28.890877+0000","last_unstale":"2024-04-19T02:16:36.110437+0000","last_undegraded":"2024-04-19T02:16:36.110437+0000","last_fullsized":"2024-04-19T02:16:36.110437+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:53.170180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.115287+0000","last_change":"2024-04-19T02:15:29.278810+0000","last_active":"2024-04-19T02:16:36.115287+0000","last_peered":"2024-04-19T02:16:36.115287+0000","last_clean":"2024-04-19T02:16:36.115287+0000","last_became_active":"2024-04-19T02:15:29.277913+0000","last_became_peered":"2024-04-19T02:15:29.277913+0000","last_unstale":"2024-04-19T02:16:36.115287+0000","last_undegraded":"2024-04-19T02:16:36.115287+0000","last_fullsized":"2024-04-19T02:16:36.115287+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:24.082666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.110394+0000","last_change":"2024-04-19T02:15:28.889132+0000","last_active":"2024-04-19T02:16:36.110394+0000","last_peered":"2024-04-19T02:16:36.110394+0000","last_clean":"2024-04-19T02:16:36.110394+0000","last_became_active":"2024-04-19T02:15:28.888926+0000","last_became_peered":"2024-04-19T02:15:28.888926+0000","last_unstale":"2024-04-19T02:16:36.110394+0000","last_undegraded":"2024-04-19T02:16:36.110394+0000","last_fullsized":"2024-04-19T02:16:36.110394+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118533+0000","last_change":"2024-04-19T02:15:29.282776+0000","last_active":"2024-04-19T02:16:36.118533+0000","last_peered":"2024-04-19T02:16:36.118533+0000","last_clean":"2024-04-19T02:16:36.118533+0000","last_became_active":"2024-04-19T02:15:29.279382+0000","last_became_peered":"2024-04-19T02:15:29.279382+0000","last_unstale":"2024-04-19T02:16:36.118533+0000","last_undegraded":"2024-04-19T02:16:36.118533+0000","last_fullsized":"2024-04-19T02:16:36.118533+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118462+0000","last_change":"2024-04-19T02:15:29.283537+0000","last_active":"2024-04-19T02:16:36.118462+0000","last_peered":"2024-04-19T02:16:36.118462+0000","last_clean":"2024-04-19T02:16:36.118462+0000","last_became_active":"2024-04-19T02:15:29.281801+0000","last_became_peered":"2024-04-19T02:15:29.281801+0000","last_unstale":"2024-04-19T02:16:36.118462+0000","last_undegraded":"2024-04-19T02:16:36.118462+0000","last_fullsized":"2024-04-19T02:16:36.118462+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109257+0000","last_change":"2024-04-19T02:15:29.281560+0000","last_active":"2024-04-19T02:16:36.109257+0000","last_peered":"2024-04-19T02:16:36.109257+0000","last_clean":"2024-04-19T02:16:36.109257+0000","last_became_active":"2024-04-19T02:15:29.281261+0000","last_became_peered":"2024-04-19T02:15:29.281261+0000","last_unstale":"2024-04-19T02:16:36.109257+0000","last_undegraded":"2024-04-19T02:16:36.109257+0000","last_fullsized":"2024-04-19T02:16:36.109257+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118440+0000","last_change":"2024-04-19T02:15:53.955913+0000","last_active":"2024-04-19T02:16:36.118440+0000","last_peered":"2024-04-19T02:16:36.118440+0000","last_clean":"2024-04-19T02:16:36.118440+0000","last_became_active":"2024-04-19T02:15:53.955676+0000","last_became_peered":"2024-04-19T02:15:53.955676+0000","last_unstale":"2024-04-19T02:16:36.118440+0000","last_undegraded":"2024-04-19T02:16:36.118440+0000","last_fullsized":"2024-04-19T02:16:36.118440+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:53:02.899902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109624+0000","last_change":"2024-04-19T02:15:29.278702+0000","last_active":"2024-04-19T02:16:36.109624+0000","last_peered":"2024-04-19T02:16:36.109624+0000","last_clean":"2024-04-19T02:16:36.109624+0000","last_became_active":"2024-04-19T02:15:29.277756+0000","last_became_peered":"2024-04-19T02:15:29.277756+0000","last_unstale":"2024-04-19T02:16:36.109624+0000","last_undegraded":"2024-04-19T02:16:36.109624+0000","last_fullsized":"2024-04-19T02:16:36.109624+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.115452+0000","last_change":"2024-04-19T02:15:29.277568+0000","last_active":"2024-04-19T02:16:36.115452+0000","last_peered":"2024-04-19T02:16:36.115452+0000","last_clean":"2024-04-19T02:16:36.115452+0000","last_became_active":"2024-04-19T02:15:29.276725+0000","last_became_peered":"2024-04-19T02:15:29.276725+0000","last_unstale":"2024-04-19T02:16:36.115452+0000","last_undegraded":"2024-04-19T02:16:36.115452+0000","last_fullsized":"2024-04-19T02:16:36.115452+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":6535839744,"num_objects":99729,"num_object_clones":0,"num_object_copies":199458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":3427,"num_objects_unfound":0,"num_objects_dirty":99729,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99729,"num_write_kb":6382656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2240,"num_bytes_recovered":146800640,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":13244956672,"data_stored":13244956672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60028,"ondisk_log_size":60028,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738385,"num_pgs":84,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5253660,"kb_used_data":5128208,"kb_used_omap":1,"kb_used_meta":125438,"kb_avail":89118180,"statfs":{"total":96636764160,"available":91257016320,"internally_reserved":0,"allocated":5251284992,"data_stored":5251024944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":128448966},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.313,"15min":0.313},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.497,"5min":0.497,"15min":0.497},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":1.8200000000000001}]},{"osd":1,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.36499999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738386,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4054592,"kb_used_data":3951276,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":90317248,"statfs":{"total":96636764160,"available":92484861952,"internally_reserved":0,"allocated":4046106624,"data_stored":4045820194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":105773510},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.17699999999999999},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.24099999999999999}]},{"osd":2,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":2.1000000000000001,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":0.19},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.22700000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738385,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3860856,"kb_used_data":3761636,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":90510984,"statfs":{"total":96636764160,"available":92683247616,"internally_reserved":0,"allocated":3851915264,"data_stored":3851636410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":101579206},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,3,0,2,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:16:26 2024","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.19},{"interface":"front","average":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"min":{"1min":0.16,"5min":0.16,"15min":0.16},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.254}]},{"osd":2,"last update":"Fri Apr 19 02:16:26 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.22700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4092657664,"data_stored":4092657664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3852468224,"data_stored":3852468224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5299830784,"data_stored":5299830784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:16:42.168 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-19T02:16:42.173 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:42.174 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:42.189 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:16:42.231 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:42.231+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:42.329 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:42.329+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:42.400 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:42.401 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:42.416 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:16:42.462 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:42.462+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:42.530 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:42.530+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:42.585 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:42.585 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:42.599 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:16:42.631 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:42.631+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:42.633 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:16:42.633 INFO:teuthology.orchestra.run.smithi121.stdout:{"fsid":"f6ab5dd0-bb9f-4b48-a9fc-4728c7955ca8","health":{"status":"HEALTH_WARN","checks":{"OSDMAP_FLAGS":{"severity":"HEALTH_WARN","summary":{"message":"noscrub flag(s) set","count":7},"muted":false}},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":88,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":39,"num_osds":3,"num_up_osds":3,"osd_up_since":1713492922,"num_in_osds":3,"osd_in_since":1713492915,"num_remapped_pgs":1},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":120},{"state_name":"active+remapped+backfilling","count":1}],"num_pgs":121,"num_pools":5,"num_objects":99753,"data_bytes":6536432474,"bytes_used":13485166592,"bytes_avail":276425125888,"bytes_total":289910292480,"misplaced_objects":3427,"misplaced_total":199506,"misplaced_ratio":0.017177428247771995,"recovering_objects_per_sec":130,"recovering_bytes_per_sec":8576233,"recovering_keys_per_sec":0,"num_objects_recovered":739,"num_bytes_recovered":48431104,"num_keys_recovered":0,"write_bytes_sec":114055777,"read_op_per_sec":0,"write_op_per_sec":1740},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4230}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-04-19T02:16:34.750409+0000","services":{}},"progress_events":{}} 2024-04-19T02:16:42.647 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-04-19T02:16:42.648 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:16:42.732 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:42.733+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:42.786 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:42.786 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:42.801 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:16:42.833 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:42.833+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:42.934 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:42.935+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:42.992 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:16:42.994 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-04-19T02:16:43.004 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":75,"stamp":"2024-04-19T02:16:42.751464+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6536432474,"num_objects":99753,"num_object_clones":0,"num_object_copies":199506,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":3427,"num_objects_unfound":0,"num_objects_dirty":99753,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":99977,"num_write_kb":6386130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2240,"num_bytes_recovered":146800640,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60224,"ondisk_log_size":60224,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":243,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":13169108,"kb_used_data":12841120,"kb_used_omap":4,"kb_used_meta":327931,"kb_avail":269946412,"statfs":{"total":289910292480,"available":276425125888,"internally_reserved":0,"allocated":13149306880,"data_stored":13148481548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":335801682},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,3,0,2,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":644087808,"num_objects":9828,"num_object_clones":0,"num_object_copies":19656,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-363,"num_objects_unfound":0,"num_objects_dirty":9828,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9828,"num_write_kb":628992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":739,"num_bytes_recovered":48431104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000829"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.115902+0000","last_change":"2024-04-19T02:15:29.280412+0000","last_active":"2024-04-19T02:16:36.115902+0000","last_peered":"2024-04-19T02:16:36.115902+0000","last_clean":"2024-04-19T02:16:36.115902+0000","last_became_active":"2024-04-19T02:15:29.278762+0000","last_became_peered":"2024-04-19T02:15:29.278762+0000","last_unstale":"2024-04-19T02:16:36.115902+0000","last_undegraded":"2024-04-19T02:16:36.115902+0000","last_fullsized":"2024-04-19T02:16:36.115902+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:45.301675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.115508+0000","last_change":"2024-04-19T02:15:29.284695+0000","last_active":"2024-04-19T02:16:36.115508+0000","last_peered":"2024-04-19T02:16:36.115508+0000","last_clean":"2024-04-19T02:16:36.115508+0000","last_became_active":"2024-04-19T02:15:29.283468+0000","last_became_peered":"2024-04-19T02:15:29.283468+0000","last_unstale":"2024-04-19T02:16:36.115508+0000","last_undegraded":"2024-04-19T02:16:36.115508+0000","last_fullsized":"2024-04-19T02:16:36.115508+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.384881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119635+0000","last_change":"2024-04-19T02:15:29.286709+0000","last_active":"2024-04-19T02:16:36.119635+0000","last_peered":"2024-04-19T02:16:36.119635+0000","last_clean":"2024-04-19T02:16:36.119635+0000","last_became_active":"2024-04-19T02:15:29.286169+0000","last_became_peered":"2024-04-19T02:15:29.286169+0000","last_unstale":"2024-04-19T02:16:36.119635+0000","last_undegraded":"2024-04-19T02:16:36.119635+0000","last_fullsized":"2024-04-19T02:16:36.119635+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:58.741466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119561+0000","last_change":"2024-04-19T02:15:29.280131+0000","last_active":"2024-04-19T02:16:36.119561+0000","last_peered":"2024-04-19T02:16:36.119561+0000","last_clean":"2024-04-19T02:16:36.119561+0000","last_became_active":"2024-04-19T02:15:29.279388+0000","last_became_peered":"2024-04-19T02:15:29.279388+0000","last_unstale":"2024-04-19T02:16:36.119561+0000","last_undegraded":"2024-04-19T02:16:36.119561+0000","last_fullsized":"2024-04-19T02:16:36.119561+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:36:48.819486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109473+0000","last_change":"2024-04-19T02:15:53.955892+0000","last_active":"2024-04-19T02:16:36.109473+0000","last_peered":"2024-04-19T02:16:36.109473+0000","last_clean":"2024-04-19T02:16:36.109473+0000","last_became_active":"2024-04-19T02:15:53.955553+0000","last_became_peered":"2024-04-19T02:15:53.955553+0000","last_unstale":"2024-04-19T02:16:36.109473+0000","last_undegraded":"2024-04-19T02:16:36.109473+0000","last_fullsized":"2024-04-19T02:16:36.109473+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:45:39.791209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118574+0000","last_change":"2024-04-19T02:15:29.283908+0000","last_active":"2024-04-19T02:16:36.118574+0000","last_peered":"2024-04-19T02:16:36.118574+0000","last_clean":"2024-04-19T02:16:36.118574+0000","last_became_active":"2024-04-19T02:15:29.281729+0000","last_became_peered":"2024-04-19T02:15:29.281729+0000","last_unstale":"2024-04-19T02:16:36.118574+0000","last_undegraded":"2024-04-19T02:16:36.118574+0000","last_fullsized":"2024-04-19T02:16:36.118574+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:03:15.383476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118611+0000","last_change":"2024-04-19T02:15:29.281253+0000","last_active":"2024-04-19T02:16:36.118611+0000","last_peered":"2024-04-19T02:16:36.118611+0000","last_clean":"2024-04-19T02:16:36.118611+0000","last_became_active":"2024-04-19T02:15:29.279951+0000","last_became_peered":"2024-04-19T02:15:29.279951+0000","last_unstale":"2024-04-19T02:16:36.118611+0000","last_undegraded":"2024-04-19T02:16:36.118611+0000","last_fullsized":"2024-04-19T02:16:36.118611+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118290+0000","last_change":"2024-04-19T02:15:29.283952+0000","last_active":"2024-04-19T02:16:36.118290+0000","last_peered":"2024-04-19T02:16:36.118290+0000","last_clean":"2024-04-19T02:16:36.118290+0000","last_became_active":"2024-04-19T02:15:29.282721+0000","last_became_peered":"2024-04-19T02:15:29.282721+0000","last_unstale":"2024-04-19T02:16:36.118290+0000","last_undegraded":"2024-04-19T02:16:36.118290+0000","last_fullsized":"2024-04-19T02:16:36.118290+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:45.301675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109780+0000","last_change":"2024-04-19T02:15:29.282150+0000","last_active":"2024-04-19T02:16:36.109780+0000","last_peered":"2024-04-19T02:16:36.109780+0000","last_clean":"2024-04-19T02:16:36.109780+0000","last_became_active":"2024-04-19T02:15:29.281538+0000","last_became_peered":"2024-04-19T02:15:29.281538+0000","last_unstale":"2024-04-19T02:16:36.109780+0000","last_undegraded":"2024-04-19T02:16:36.109780+0000","last_fullsized":"2024-04-19T02:16:36.109780+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119156+0000","last_change":"2024-04-19T02:16:30.093524+0000","last_active":"2024-04-19T02:16:36.119156+0000","last_peered":"2024-04-19T02:16:36.119156+0000","last_clean":"2024-04-19T02:16:36.119156+0000","last_became_active":"2024-04-19T02:16:30.093344+0000","last_became_peered":"2024-04-19T02:16:30.093344+0000","last_unstale":"2024-04-19T02:16:36.119156+0000","last_undegraded":"2024-04-19T02:16:36.119156+0000","last_fullsized":"2024-04-19T02:16:36.119156+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:14:40.293159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119375+0000","last_change":"2024-04-19T02:15:29.280606+0000","last_active":"2024-04-19T02:16:36.119375+0000","last_peered":"2024-04-19T02:16:36.119375+0000","last_clean":"2024-04-19T02:16:36.119375+0000","last_became_active":"2024-04-19T02:15:29.280151+0000","last_became_peered":"2024-04-19T02:15:29.280151+0000","last_unstale":"2024-04-19T02:16:36.119375+0000","last_undegraded":"2024-04-19T02:16:36.119375+0000","last_fullsized":"2024-04-19T02:16:36.119375+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:26:22.452488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119241+0000","last_change":"2024-04-19T02:15:53.958876+0000","last_active":"2024-04-19T02:16:36.119241+0000","last_peered":"2024-04-19T02:16:36.119241+0000","last_clean":"2024-04-19T02:16:36.119241+0000","last_became_active":"2024-04-19T02:15:53.958626+0000","last_became_peered":"2024-04-19T02:15:53.958626+0000","last_unstale":"2024-04-19T02:16:36.119241+0000","last_undegraded":"2024-04-19T02:16:36.119241+0000","last_fullsized":"2024-04-19T02:16:36.119241+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:23:57.044018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109386+0000","last_change":"2024-04-19T02:15:53.956801+0000","last_active":"2024-04-19T02:16:36.109386+0000","last_peered":"2024-04-19T02:16:36.109386+0000","last_clean":"2024-04-19T02:16:36.109386+0000","last_became_active":"2024-04-19T02:15:53.956620+0000","last_became_peered":"2024-04-19T02:15:53.956620+0000","last_unstale":"2024-04-19T02:16:36.109386+0000","last_undegraded":"2024-04-19T02:16:36.109386+0000","last_fullsized":"2024-04-19T02:16:36.109386+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:57:05.843101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118904+0000","last_change":"2024-04-19T02:15:29.284262+0000","last_active":"2024-04-19T02:16:36.118904+0000","last_peered":"2024-04-19T02:16:36.118904+0000","last_clean":"2024-04-19T02:16:36.118904+0000","last_became_active":"2024-04-19T02:15:29.283121+0000","last_became_peered":"2024-04-19T02:15:29.283121+0000","last_unstale":"2024-04-19T02:16:36.118904+0000","last_undegraded":"2024-04-19T02:16:36.118904+0000","last_fullsized":"2024-04-19T02:16:36.118904+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118730+0000","last_change":"2024-04-19T02:15:29.285139+0000","last_active":"2024-04-19T02:16:36.118730+0000","last_peered":"2024-04-19T02:16:36.118730+0000","last_clean":"2024-04-19T02:16:36.118730+0000","last_became_active":"2024-04-19T02:15:29.284649+0000","last_became_peered":"2024-04-19T02:15:29.284649+0000","last_unstale":"2024-04-19T02:16:36.118730+0000","last_undegraded":"2024-04-19T02:16:36.118730+0000","last_fullsized":"2024-04-19T02:16:36.118730+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118330+0000","last_change":"2024-04-19T02:15:29.283648+0000","last_active":"2024-04-19T02:16:36.118330+0000","last_peered":"2024-04-19T02:16:36.118330+0000","last_clean":"2024-04-19T02:16:36.118330+0000","last_became_active":"2024-04-19T02:15:29.281606+0000","last_became_peered":"2024-04-19T02:15:29.281606+0000","last_unstale":"2024-04-19T02:16:36.118330+0000","last_undegraded":"2024-04-19T02:16:36.118330+0000","last_fullsized":"2024-04-19T02:16:36.118330+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109828+0000","last_change":"2024-04-19T02:15:29.278673+0000","last_active":"2024-04-19T02:16:36.109828+0000","last_peered":"2024-04-19T02:16:36.109828+0000","last_clean":"2024-04-19T02:16:36.109828+0000","last_became_active":"2024-04-19T02:15:29.277699+0000","last_became_peered":"2024-04-19T02:15:29.277699+0000","last_unstale":"2024-04-19T02:16:36.109828+0000","last_undegraded":"2024-04-19T02:16:36.109828+0000","last_fullsized":"2024-04-19T02:16:36.109828+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.115725+0000","last_change":"2024-04-19T02:15:29.283341+0000","last_active":"2024-04-19T02:16:36.115725+0000","last_peered":"2024-04-19T02:16:36.115725+0000","last_clean":"2024-04-19T02:16:36.115725+0000","last_became_active":"2024-04-19T02:15:29.281591+0000","last_became_peered":"2024-04-19T02:15:29.281591+0000","last_unstale":"2024-04-19T02:16:36.115725+0000","last_undegraded":"2024-04-19T02:16:36.115725+0000","last_fullsized":"2024-04-19T02:16:36.115725+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:34.593754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109881+0000","last_change":"2024-04-19T02:15:29.282110+0000","last_active":"2024-04-19T02:16:36.109881+0000","last_peered":"2024-04-19T02:16:36.109881+0000","last_clean":"2024-04-19T02:16:36.109881+0000","last_became_active":"2024-04-19T02:15:29.281716+0000","last_became_peered":"2024-04-19T02:15:29.281716+0000","last_unstale":"2024-04-19T02:16:36.109881+0000","last_undegraded":"2024-04-19T02:16:36.109881+0000","last_fullsized":"2024-04-19T02:16:36.109881+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119482+0000","last_change":"2024-04-19T02:15:29.285237+0000","last_active":"2024-04-19T02:16:36.119482+0000","last_peered":"2024-04-19T02:16:36.119482+0000","last_clean":"2024-04-19T02:16:36.119482+0000","last_became_active":"2024-04-19T02:15:29.282790+0000","last_became_peered":"2024-04-19T02:15:29.282790+0000","last_unstale":"2024-04-19T02:16:36.119482+0000","last_undegraded":"2024-04-19T02:16:36.119482+0000","last_fullsized":"2024-04-19T02:16:36.119482+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118682+0000","last_change":"2024-04-19T02:15:29.282609+0000","last_active":"2024-04-19T02:16:36.118682+0000","last_peered":"2024-04-19T02:16:36.118682+0000","last_clean":"2024-04-19T02:16:36.118682+0000","last_became_active":"2024-04-19T02:15:29.281665+0000","last_became_peered":"2024-04-19T02:15:29.281665+0000","last_unstale":"2024-04-19T02:16:36.118682+0000","last_undegraded":"2024-04-19T02:16:36.118682+0000","last_fullsized":"2024-04-19T02:16:36.118682+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.384881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118442+0000","last_change":"2024-04-19T02:15:53.955813+0000","last_active":"2024-04-19T02:16:36.118442+0000","last_peered":"2024-04-19T02:16:36.118442+0000","last_clean":"2024-04-19T02:16:36.118442+0000","last_became_active":"2024-04-19T02:15:53.955614+0000","last_became_peered":"2024-04-19T02:15:53.955614+0000","last_unstale":"2024-04-19T02:16:36.118442+0000","last_undegraded":"2024-04-19T02:16:36.118442+0000","last_fullsized":"2024-04-19T02:16:36.118442+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:58:03.192647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109416+0000","last_change":"2024-04-19T02:15:29.277109+0000","last_active":"2024-04-19T02:16:36.109416+0000","last_peered":"2024-04-19T02:16:36.109416+0000","last_clean":"2024-04-19T02:16:36.109416+0000","last_became_active":"2024-04-19T02:15:29.275417+0000","last_became_peered":"2024-04-19T02:15:29.275417+0000","last_unstale":"2024-04-19T02:16:36.109416+0000","last_undegraded":"2024-04-19T02:16:36.109416+0000","last_fullsized":"2024-04-19T02:16:36.109416+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.115084+0000","last_change":"2024-04-19T02:15:29.283266+0000","last_active":"2024-04-19T02:16:36.115084+0000","last_peered":"2024-04-19T02:16:36.115084+0000","last_clean":"2024-04-19T02:16:36.115084+0000","last_became_active":"2024-04-19T02:15:29.281505+0000","last_became_peered":"2024-04-19T02:15:29.281505+0000","last_unstale":"2024-04-19T02:16:36.115084+0000","last_undegraded":"2024-04-19T02:16:36.115084+0000","last_fullsized":"2024-04-19T02:16:36.115084+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.115920+0000","last_change":"2024-04-19T02:15:29.278084+0000","last_active":"2024-04-19T02:16:36.115920+0000","last_peered":"2024-04-19T02:16:36.115920+0000","last_clean":"2024-04-19T02:16:36.115920+0000","last_became_active":"2024-04-19T02:15:29.276952+0000","last_became_peered":"2024-04-19T02:15:29.276952+0000","last_unstale":"2024-04-19T02:16:36.115920+0000","last_undegraded":"2024-04-19T02:16:36.115920+0000","last_fullsized":"2024-04-19T02:16:36.115920+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.110442+0000","last_change":"2024-04-19T02:15:29.279904+0000","last_active":"2024-04-19T02:16:36.110442+0000","last_peered":"2024-04-19T02:16:36.110442+0000","last_clean":"2024-04-19T02:16:36.110442+0000","last_became_active":"2024-04-19T02:15:29.278938+0000","last_became_peered":"2024-04-19T02:15:29.278938+0000","last_unstale":"2024-04-19T02:16:36.110442+0000","last_undegraded":"2024-04-19T02:16:36.110442+0000","last_fullsized":"2024-04-19T02:16:36.110442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119447+0000","last_change":"2024-04-19T02:15:29.287389+0000","last_active":"2024-04-19T02:16:36.119447+0000","last_peered":"2024-04-19T02:16:36.119447+0000","last_clean":"2024-04-19T02:16:36.119447+0000","last_became_active":"2024-04-19T02:15:29.286431+0000","last_became_peered":"2024-04-19T02:15:29.286431+0000","last_unstale":"2024-04-19T02:16:36.119447+0000","last_undegraded":"2024-04-19T02:16:36.119447+0000","last_fullsized":"2024-04-19T02:16:36.119447+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:58:30.117887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109444+0000","last_change":"2024-04-19T02:15:53.959207+0000","last_active":"2024-04-19T02:16:36.109444+0000","last_peered":"2024-04-19T02:16:36.109444+0000","last_clean":"2024-04-19T02:16:36.109444+0000","last_became_active":"2024-04-19T02:15:53.959007+0000","last_became_peered":"2024-04-19T02:15:53.959007+0000","last_unstale":"2024-04-19T02:16:36.109444+0000","last_undegraded":"2024-04-19T02:16:36.109444+0000","last_fullsized":"2024-04-19T02:16:36.109444+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:08:21.065077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.115630+0000","last_change":"2024-04-19T02:15:29.281792+0000","last_active":"2024-04-19T02:16:36.115630+0000","last_peered":"2024-04-19T02:16:36.115630+0000","last_clean":"2024-04-19T02:16:36.115630+0000","last_became_active":"2024-04-19T02:15:29.280479+0000","last_became_peered":"2024-04-19T02:15:29.280479+0000","last_unstale":"2024-04-19T02:16:36.115630+0000","last_undegraded":"2024-04-19T02:16:36.115630+0000","last_fullsized":"2024-04-19T02:16:36.115630+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109501+0000","last_change":"2024-04-19T02:15:28.888778+0000","last_active":"2024-04-19T02:16:36.109501+0000","last_peered":"2024-04-19T02:16:36.109501+0000","last_clean":"2024-04-19T02:16:36.109501+0000","last_became_active":"2024-04-19T02:15:28.888543+0000","last_became_peered":"2024-04-19T02:15:28.888543+0000","last_unstale":"2024-04-19T02:16:36.109501+0000","last_undegraded":"2024-04-19T02:16:36.109501+0000","last_fullsized":"2024-04-19T02:16:36.109501+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:43:51.221619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.110223+0000","last_change":"2024-04-19T02:15:29.279986+0000","last_active":"2024-04-19T02:16:36.110223+0000","last_peered":"2024-04-19T02:16:36.110223+0000","last_clean":"2024-04-19T02:16:36.110223+0000","last_became_active":"2024-04-19T02:15:29.279690+0000","last_became_peered":"2024-04-19T02:15:29.279690+0000","last_unstale":"2024-04-19T02:16:36.110223+0000","last_undegraded":"2024-04-19T02:16:36.110223+0000","last_fullsized":"2024-04-19T02:16:36.110223+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109296+0000","last_change":"2024-04-19T02:15:28.890463+0000","last_active":"2024-04-19T02:16:36.109296+0000","last_peered":"2024-04-19T02:16:36.109296+0000","last_clean":"2024-04-19T02:16:36.109296+0000","last_became_active":"2024-04-19T02:15:28.889777+0000","last_became_peered":"2024-04-19T02:15:28.889777+0000","last_unstale":"2024-04-19T02:16:36.109296+0000","last_undegraded":"2024-04-19T02:16:36.109296+0000","last_fullsized":"2024-04-19T02:16:36.109296+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:58:21.520250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.115861+0000","last_change":"2024-04-19T02:15:29.280879+0000","last_active":"2024-04-19T02:16:36.115861+0000","last_peered":"2024-04-19T02:16:36.115861+0000","last_clean":"2024-04-19T02:16:36.115861+0000","last_became_active":"2024-04-19T02:15:29.279314+0000","last_became_peered":"2024-04-19T02:15:29.279314+0000","last_unstale":"2024-04-19T02:16:36.115861+0000","last_undegraded":"2024-04-19T02:16:36.115861+0000","last_fullsized":"2024-04-19T02:16:36.115861+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.110396+0000","last_change":"2024-04-19T02:15:28.891867+0000","last_active":"2024-04-19T02:16:36.110396+0000","last_peered":"2024-04-19T02:16:36.110396+0000","last_clean":"2024-04-19T02:16:36.110396+0000","last_became_active":"2024-04-19T02:15:28.890806+0000","last_became_peered":"2024-04-19T02:15:28.890806+0000","last_unstale":"2024-04-19T02:16:36.110396+0000","last_undegraded":"2024-04-19T02:16:36.110396+0000","last_fullsized":"2024-04-19T02:16:36.110396+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:57.946581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109200+0000","last_change":"2024-04-19T02:15:29.278148+0000","last_active":"2024-04-19T02:16:36.109200+0000","last_peered":"2024-04-19T02:16:36.109200+0000","last_clean":"2024-04-19T02:16:36.109200+0000","last_became_active":"2024-04-19T02:15:29.277402+0000","last_became_peered":"2024-04-19T02:15:29.277402+0000","last_unstale":"2024-04-19T02:16:36.109200+0000","last_undegraded":"2024-04-19T02:16:36.109200+0000","last_fullsized":"2024-04-19T02:16:36.109200+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119644+0000","last_change":"2024-04-19T02:15:28.892905+0000","last_active":"2024-04-19T02:16:36.119644+0000","last_peered":"2024-04-19T02:16:36.119644+0000","last_clean":"2024-04-19T02:16:36.119644+0000","last_became_active":"2024-04-19T02:15:28.892541+0000","last_became_peered":"2024-04-19T02:15:28.892541+0000","last_unstale":"2024-04-19T02:16:36.119644+0000","last_undegraded":"2024-04-19T02:16:36.119644+0000","last_fullsized":"2024-04-19T02:16:36.119644+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:33.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.110091+0000","last_change":"2024-04-19T02:15:29.278810+0000","last_active":"2024-04-19T02:16:36.110091+0000","last_peered":"2024-04-19T02:16:36.110091+0000","last_clean":"2024-04-19T02:16:36.110091+0000","last_became_active":"2024-04-19T02:15:29.278093+0000","last_became_peered":"2024-04-19T02:15:29.278093+0000","last_unstale":"2024-04-19T02:16:36.110091+0000","last_undegraded":"2024-04-19T02:16:36.110091+0000","last_fullsized":"2024-04-19T02:16:36.110091+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:34.883207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.115376+0000","last_change":"2024-04-19T02:15:28.892937+0000","last_active":"2024-04-19T02:16:36.115376+0000","last_peered":"2024-04-19T02:16:36.115376+0000","last_clean":"2024-04-19T02:16:36.115376+0000","last_became_active":"2024-04-19T02:15:28.891440+0000","last_became_peered":"2024-04-19T02:15:28.891440+0000","last_unstale":"2024-04-19T02:16:36.115376+0000","last_undegraded":"2024-04-19T02:16:36.115376+0000","last_fullsized":"2024-04-19T02:16:36.115376+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109371+0000","last_change":"2024-04-19T02:15:29.278404+0000","last_active":"2024-04-19T02:16:36.109371+0000","last_peered":"2024-04-19T02:16:36.109371+0000","last_clean":"2024-04-19T02:16:36.109371+0000","last_became_active":"2024-04-19T02:15:29.277460+0000","last_became_peered":"2024-04-19T02:15:29.277460+0000","last_unstale":"2024-04-19T02:16:36.109371+0000","last_undegraded":"2024-04-19T02:16:36.109371+0000","last_fullsized":"2024-04-19T02:16:36.109371+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119407+0000","last_change":"2024-04-19T02:15:28.891097+0000","last_active":"2024-04-19T02:16:36.119407+0000","last_peered":"2024-04-19T02:16:36.119407+0000","last_clean":"2024-04-19T02:16:36.119407+0000","last_became_active":"2024-04-19T02:15:28.890795+0000","last_became_peered":"2024-04-19T02:15:28.890795+0000","last_unstale":"2024-04-19T02:16:36.119407+0000","last_undegraded":"2024-04-19T02:16:36.119407+0000","last_fullsized":"2024-04-19T02:16:36.119407+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.120535+0000","last_change":"2024-04-19T02:15:29.278546+0000","last_active":"2024-04-19T02:16:36.120535+0000","last_peered":"2024-04-19T02:16:36.120535+0000","last_clean":"2024-04-19T02:16:36.120535+0000","last_became_active":"2024-04-19T02:15:29.277547+0000","last_became_peered":"2024-04-19T02:15:29.277547+0000","last_unstale":"2024-04-19T02:16:36.120535+0000","last_undegraded":"2024-04-19T02:16:36.120535+0000","last_fullsized":"2024-04-19T02:16:36.120535+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119008+0000","last_change":"2024-04-19T02:15:28.892977+0000","last_active":"2024-04-19T02:16:36.119008+0000","last_peered":"2024-04-19T02:16:36.119008+0000","last_clean":"2024-04-19T02:16:36.119008+0000","last_became_active":"2024-04-19T02:15:28.892636+0000","last_became_peered":"2024-04-19T02:15:28.892636+0000","last_unstale":"2024-04-19T02:16:36.119008+0000","last_undegraded":"2024-04-19T02:16:36.119008+0000","last_fullsized":"2024-04-19T02:16:36.119008+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:43:51.221619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109598+0000","last_change":"2024-04-19T02:15:53.955655+0000","last_active":"2024-04-19T02:16:36.109598+0000","last_peered":"2024-04-19T02:16:36.109598+0000","last_clean":"2024-04-19T02:16:36.109598+0000","last_became_active":"2024-04-19T02:15:53.955382+0000","last_became_peered":"2024-04-19T02:15:53.955382+0000","last_unstale":"2024-04-19T02:16:36.109598+0000","last_undegraded":"2024-04-19T02:16:36.109598+0000","last_fullsized":"2024-04-19T02:16:36.109598+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:48.239260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109444+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:16:36.109444+0000","last_peered":"2024-04-19T02:16:36.109444+0000","last_clean":"2024-04-19T02:16:36.109444+0000","last_became_active":"2024-04-19T02:15:28.890751+0000","last_became_peered":"2024-04-19T02:15:28.890751+0000","last_unstale":"2024-04-19T02:16:36.109444+0000","last_undegraded":"2024-04-19T02:16:36.109444+0000","last_fullsized":"2024-04-19T02:16:36.109444+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109523+0000","last_change":"2024-04-19T02:15:53.957865+0000","last_active":"2024-04-19T02:16:36.109523+0000","last_peered":"2024-04-19T02:16:36.109523+0000","last_clean":"2024-04-19T02:16:36.109523+0000","last_became_active":"2024-04-19T02:15:53.957627+0000","last_became_peered":"2024-04-19T02:15:53.957627+0000","last_unstale":"2024-04-19T02:16:36.109523+0000","last_undegraded":"2024-04-19T02:16:36.109523+0000","last_fullsized":"2024-04-19T02:16:36.109523+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:16:45.799016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.114958+0000","last_change":"2024-04-19T02:15:28.892934+0000","last_active":"2024-04-19T02:16:36.114958+0000","last_peered":"2024-04-19T02:16:36.114958+0000","last_clean":"2024-04-19T02:16:36.114958+0000","last_became_active":"2024-04-19T02:15:28.891879+0000","last_became_peered":"2024-04-19T02:15:28.891879+0000","last_unstale":"2024-04-19T02:16:36.114958+0000","last_undegraded":"2024-04-19T02:16:36.114958+0000","last_fullsized":"2024-04-19T02:16:36.114958+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:10:12.514798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.110374+0000","last_change":"2024-04-19T02:15:29.279685+0000","last_active":"2024-04-19T02:16:36.110374+0000","last_peered":"2024-04-19T02:16:36.110374+0000","last_clean":"2024-04-19T02:16:36.110374+0000","last_became_active":"2024-04-19T02:15:29.278810+0000","last_became_peered":"2024-04-19T02:15:29.278810+0000","last_unstale":"2024-04-19T02:16:36.110374+0000","last_undegraded":"2024-04-19T02:16:36.110374+0000","last_fullsized":"2024-04-19T02:16:36.110374+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118492+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:16:36.118492+0000","last_peered":"2024-04-19T02:16:36.118492+0000","last_clean":"2024-04-19T02:16:36.118492+0000","last_became_active":"2024-04-19T02:15:28.890882+0000","last_became_peered":"2024-04-19T02:15:28.890882+0000","last_unstale":"2024-04-19T02:16:36.118492+0000","last_undegraded":"2024-04-19T02:16:36.118492+0000","last_fullsized":"2024-04-19T02:16:36.118492+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:31.673938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.110562+0000","last_change":"2024-04-19T02:15:29.284258+0000","last_active":"2024-04-19T02:16:36.110562+0000","last_peered":"2024-04-19T02:16:36.110562+0000","last_clean":"2024-04-19T02:16:36.110562+0000","last_became_active":"2024-04-19T02:15:29.283995+0000","last_became_peered":"2024-04-19T02:15:29.283995+0000","last_unstale":"2024-04-19T02:16:36.110562+0000","last_undegraded":"2024-04-19T02:16:36.110562+0000","last_fullsized":"2024-04-19T02:16:36.110562+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:35.941308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"37'6312","reported_seq":6341,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-19T02:16:37.787567+0000","last_change":"2024-04-19T02:15:53.956977+0000","last_active":"2024-04-19T02:16:37.787567+0000","last_peered":"2024-04-19T02:16:37.787567+0000","last_clean":"2024-04-19T02:16:37.787567+0000","last_became_active":"2024-04-19T02:15:53.956730+0000","last_became_peered":"2024-04-19T02:15:53.956730+0000","last_unstale":"2024-04-19T02:16:37.787567+0000","last_undegraded":"2024-04-19T02:16:37.787567+0000","last_fullsized":"2024-04-19T02:16:37.787567+0000","mapping_epoch":16,"log_start":"23'2600","ondisk_log_start":"23'2600","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3712,"log_dups_size":0,"ondisk_log_size":3712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:56:46.323499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413663232,"num_objects":6312,"num_object_clones":0,"num_object_copies":12624,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6312,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6312,"num_write_kb":403968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119482+0000","last_change":"2024-04-19T02:15:28.890265+0000","last_active":"2024-04-19T02:16:36.119482+0000","last_peered":"2024-04-19T02:16:36.119482+0000","last_clean":"2024-04-19T02:16:36.119482+0000","last_became_active":"2024-04-19T02:15:28.890004+0000","last_became_peered":"2024-04-19T02:15:28.890004+0000","last_unstale":"2024-04-19T02:16:36.119482+0000","last_undegraded":"2024-04-19T02:16:36.119482+0000","last_fullsized":"2024-04-19T02:16:36.119482+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:02.517101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.114836+0000","last_change":"2024-04-19T02:15:29.285529+0000","last_active":"2024-04-19T02:16:36.114836+0000","last_peered":"2024-04-19T02:16:36.114836+0000","last_clean":"2024-04-19T02:16:36.114836+0000","last_became_active":"2024-04-19T02:15:29.285197+0000","last_became_peered":"2024-04-19T02:15:29.285197+0000","last_unstale":"2024-04-19T02:16:36.114836+0000","last_undegraded":"2024-04-19T02:16:36.114836+0000","last_fullsized":"2024-04-19T02:16:36.114836+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"37'6301","reported_seq":6330,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-19T02:16:37.743800+0000","last_change":"2024-04-19T02:15:53.958523+0000","last_active":"2024-04-19T02:16:37.743800+0000","last_peered":"2024-04-19T02:16:37.743800+0000","last_clean":"2024-04-19T02:16:37.743800+0000","last_became_active":"2024-04-19T02:15:53.957627+0000","last_became_peered":"2024-04-19T02:15:53.957627+0000","last_unstale":"2024-04-19T02:16:37.743800+0000","last_undegraded":"2024-04-19T02:16:37.743800+0000","last_fullsized":"2024-04-19T02:16:37.743800+0000","mapping_epoch":16,"log_start":"22'2347","ondisk_log_start":"22'2347","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3954,"log_dups_size":0,"ondisk_log_size":3954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:59:55.120296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":412942336,"num_objects":6301,"num_object_clones":0,"num_object_copies":12602,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6301,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6301,"num_write_kb":403264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.115538+0000","last_change":"2024-04-19T02:15:28.893902+0000","last_active":"2024-04-19T02:16:36.115538+0000","last_peered":"2024-04-19T02:16:36.115538+0000","last_clean":"2024-04-19T02:16:36.115538+0000","last_became_active":"2024-04-19T02:15:28.893231+0000","last_became_peered":"2024-04-19T02:15:28.893231+0000","last_unstale":"2024-04-19T02:16:36.115538+0000","last_undegraded":"2024-04-19T02:16:36.115538+0000","last_fullsized":"2024-04-19T02:16:36.115538+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:23.658442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.115048+0000","last_change":"2024-04-19T02:15:29.282874+0000","last_active":"2024-04-19T02:16:36.115048+0000","last_peered":"2024-04-19T02:16:36.115048+0000","last_clean":"2024-04-19T02:16:36.115048+0000","last_became_active":"2024-04-19T02:15:29.281675+0000","last_became_peered":"2024-04-19T02:15:29.281675+0000","last_unstale":"2024-04-19T02:16:36.115048+0000","last_undegraded":"2024-04-19T02:16:36.115048+0000","last_fullsized":"2024-04-19T02:16:36.115048+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:35.941308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"37'6199","reported_seq":6226,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-19T02:16:37.759413+0000","last_change":"2024-04-19T02:15:53.958324+0000","last_active":"2024-04-19T02:16:37.759413+0000","last_peered":"2024-04-19T02:16:37.759413+0000","last_clean":"2024-04-19T02:16:37.759413+0000","last_became_active":"2024-04-19T02:15:53.957392+0000","last_became_peered":"2024-04-19T02:15:53.957392+0000","last_unstale":"2024-04-19T02:16:37.759413+0000","last_undegraded":"2024-04-19T02:16:37.759413+0000","last_fullsized":"2024-04-19T02:16:37.759413+0000","mapping_epoch":16,"log_start":"22'2300","ondisk_log_start":"22'2300","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3899,"log_dups_size":0,"ondisk_log_size":3899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:12:58.132969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":406257664,"num_objects":6199,"num_object_clones":0,"num_object_copies":12398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6199,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6199,"num_write_kb":396736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119538+0000","last_change":"2024-04-19T02:15:28.891234+0000","last_active":"2024-04-19T02:16:36.119538+0000","last_peered":"2024-04-19T02:16:36.119538+0000","last_clean":"2024-04-19T02:16:36.119538+0000","last_became_active":"2024-04-19T02:15:28.890881+0000","last_became_peered":"2024-04-19T02:15:28.890881+0000","last_unstale":"2024-04-19T02:16:36.119538+0000","last_undegraded":"2024-04-19T02:16:36.119538+0000","last_fullsized":"2024-04-19T02:16:36.119538+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118794+0000","last_change":"2024-04-19T02:15:29.281937+0000","last_active":"2024-04-19T02:16:36.118794+0000","last_peered":"2024-04-19T02:16:36.118794+0000","last_clean":"2024-04-19T02:16:36.118794+0000","last_became_active":"2024-04-19T02:15:29.280727+0000","last_became_peered":"2024-04-19T02:15:29.280727+0000","last_unstale":"2024-04-19T02:16:36.118794+0000","last_undegraded":"2024-04-19T02:16:36.118794+0000","last_fullsized":"2024-04-19T02:16:36.118794+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"37'6332","reported_seq":6361,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-19T02:16:37.772023+0000","last_change":"2024-04-19T02:15:53.959099+0000","last_active":"2024-04-19T02:16:37.772023+0000","last_peered":"2024-04-19T02:16:37.772023+0000","last_clean":"2024-04-19T02:16:37.772023+0000","last_became_active":"2024-04-19T02:15:53.958885+0000","last_became_peered":"2024-04-19T02:15:53.958885+0000","last_unstale":"2024-04-19T02:16:37.772023+0000","last_undegraded":"2024-04-19T02:16:37.772023+0000","last_fullsized":"2024-04-19T02:16:37.772023+0000","mapping_epoch":16,"log_start":"23'2700","ondisk_log_start":"23'2700","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3632,"log_dups_size":0,"ondisk_log_size":3632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:53:26.969927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":414973952,"num_objects":6332,"num_object_clones":0,"num_object_copies":12664,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6332,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6332,"num_write_kb":405248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119509+0000","last_change":"2024-04-19T02:15:28.892767+0000","last_active":"2024-04-19T02:16:36.119509+0000","last_peered":"2024-04-19T02:16:36.119509+0000","last_clean":"2024-04-19T02:16:36.119509+0000","last_became_active":"2024-04-19T02:15:28.892235+0000","last_became_peered":"2024-04-19T02:15:28.892235+0000","last_unstale":"2024-04-19T02:16:36.119509+0000","last_undegraded":"2024-04-19T02:16:36.119509+0000","last_fullsized":"2024-04-19T02:16:36.119509+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:37.690735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109626+0000","last_change":"2024-04-19T02:15:29.279857+0000","last_active":"2024-04-19T02:16:36.109626+0000","last_peered":"2024-04-19T02:16:36.109626+0000","last_clean":"2024-04-19T02:16:36.109626+0000","last_became_active":"2024-04-19T02:15:29.279536+0000","last_became_peered":"2024-04-19T02:15:29.279536+0000","last_unstale":"2024-04-19T02:16:36.109626+0000","last_undegraded":"2024-04-19T02:16:36.109626+0000","last_fullsized":"2024-04-19T02:16:36.109626+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:00.191179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"37'6264","reported_seq":6292,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-19T02:16:37.807014+0000","last_change":"2024-04-19T02:15:53.957261+0000","last_active":"2024-04-19T02:16:37.807014+0000","last_peered":"2024-04-19T02:16:37.807014+0000","last_clean":"2024-04-19T02:16:37.807014+0000","last_became_active":"2024-04-19T02:15:53.957092+0000","last_became_peered":"2024-04-19T02:15:53.957092+0000","last_unstale":"2024-04-19T02:16:37.807014+0000","last_undegraded":"2024-04-19T02:16:37.807014+0000","last_fullsized":"2024-04-19T02:16:37.807014+0000","mapping_epoch":16,"log_start":"23'2513","ondisk_log_start":"23'2513","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3751,"log_dups_size":0,"ondisk_log_size":3751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:54:15.544923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":410517504,"num_objects":6264,"num_object_clones":0,"num_object_copies":12528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6264,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6264,"num_write_kb":400896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109542+0000","last_change":"2024-04-19T02:15:28.891611+0000","last_active":"2024-04-19T02:16:36.109542+0000","last_peered":"2024-04-19T02:16:36.109542+0000","last_clean":"2024-04-19T02:16:36.109542+0000","last_became_active":"2024-04-19T02:15:28.890914+0000","last_became_peered":"2024-04-19T02:15:28.890914+0000","last_unstale":"2024-04-19T02:16:36.109542+0000","last_undegraded":"2024-04-19T02:16:36.109542+0000","last_fullsized":"2024-04-19T02:16:36.109542+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:37.690735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119155+0000","last_change":"2024-04-19T02:15:29.285774+0000","last_active":"2024-04-19T02:16:36.119155+0000","last_peered":"2024-04-19T02:16:36.119155+0000","last_clean":"2024-04-19T02:16:36.119155+0000","last_became_active":"2024-04-19T02:15:29.284705+0000","last_became_peered":"2024-04-19T02:15:29.284705+0000","last_unstale":"2024-04-19T02:16:36.119155+0000","last_undegraded":"2024-04-19T02:16:36.119155+0000","last_fullsized":"2024-04-19T02:16:36.119155+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"37'6195","reported_seq":6224,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-19T02:16:37.752803+0000","last_change":"2024-04-19T02:15:53.955286+0000","last_active":"2024-04-19T02:16:37.752803+0000","last_peered":"2024-04-19T02:16:37.752803+0000","last_clean":"2024-04-19T02:16:37.752803+0000","last_became_active":"2024-04-19T02:15:53.955026+0000","last_became_peered":"2024-04-19T02:15:53.955026+0000","last_unstale":"2024-04-19T02:16:37.752803+0000","last_undegraded":"2024-04-19T02:16:37.752803+0000","last_fullsized":"2024-04-19T02:16:37.752803+0000","mapping_epoch":16,"log_start":"23'2600","ondisk_log_start":"23'2600","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3595,"log_dups_size":0,"ondisk_log_size":3595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:05:48.594301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":405995520,"num_objects":6195,"num_object_clones":0,"num_object_copies":12390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6195,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6195,"num_write_kb":396480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118652+0000","last_change":"2024-04-19T02:15:28.892873+0000","last_active":"2024-04-19T02:16:36.118652+0000","last_peered":"2024-04-19T02:16:36.118652+0000","last_clean":"2024-04-19T02:16:36.118652+0000","last_became_active":"2024-04-19T02:15:28.892487+0000","last_became_peered":"2024-04-19T02:15:28.892487+0000","last_unstale":"2024-04-19T02:16:36.118652+0000","last_undegraded":"2024-04-19T02:16:36.118652+0000","last_fullsized":"2024-04-19T02:16:36.118652+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:35.412837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119736+0000","last_change":"2024-04-19T02:15:29.285019+0000","last_active":"2024-04-19T02:16:36.119736+0000","last_peered":"2024-04-19T02:16:36.119736+0000","last_clean":"2024-04-19T02:16:36.119736+0000","last_became_active":"2024-04-19T02:15:29.284650+0000","last_became_peered":"2024-04-19T02:15:29.284650+0000","last_unstale":"2024-04-19T02:16:36.119736+0000","last_undegraded":"2024-04-19T02:16:36.119736+0000","last_fullsized":"2024-04-19T02:16:36.119736+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"37'6289","reported_seq":6318,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-19T02:16:37.787045+0000","last_change":"2024-04-19T02:15:53.957403+0000","last_active":"2024-04-19T02:16:37.787045+0000","last_peered":"2024-04-19T02:16:37.787045+0000","last_clean":"2024-04-19T02:16:37.787045+0000","last_became_active":"2024-04-19T02:15:53.957190+0000","last_became_peered":"2024-04-19T02:15:53.957190+0000","last_unstale":"2024-04-19T02:16:37.787045+0000","last_undegraded":"2024-04-19T02:16:37.787045+0000","last_fullsized":"2024-04-19T02:16:37.787045+0000","mapping_epoch":16,"log_start":"23'2601","ondisk_log_start":"23'2601","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3688,"log_dups_size":0,"ondisk_log_size":3688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:07:12.817884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":412155904,"num_objects":6289,"num_object_clones":0,"num_object_copies":12578,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6289,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6289,"num_write_kb":402496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118538+0000","last_change":"2024-04-19T02:15:53.956839+0000","last_active":"2024-04-19T02:16:36.118538+0000","last_peered":"2024-04-19T02:16:36.118538+0000","last_clean":"2024-04-19T02:16:36.118538+0000","last_became_active":"2024-04-19T02:15:53.956630+0000","last_became_peered":"2024-04-19T02:15:53.956630+0000","last_unstale":"2024-04-19T02:16:36.118538+0000","last_undegraded":"2024-04-19T02:16:36.118538+0000","last_fullsized":"2024-04-19T02:16:36.118538+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:47.229730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119650+0000","last_change":"2024-04-19T02:15:29.287190+0000","last_active":"2024-04-19T02:16:36.119650+0000","last_peered":"2024-04-19T02:16:36.119650+0000","last_clean":"2024-04-19T02:16:36.119650+0000","last_became_active":"2024-04-19T02:15:29.286606+0000","last_became_peered":"2024-04-19T02:15:29.286606+0000","last_unstale":"2024-04-19T02:16:36.119650+0000","last_undegraded":"2024-04-19T02:16:36.119650+0000","last_fullsized":"2024-04-19T02:16:36.119650+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:28.387062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"37'6160","reported_seq":6189,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-19T02:16:37.708869+0000","last_change":"2024-04-19T02:15:53.958448+0000","last_active":"2024-04-19T02:16:37.708869+0000","last_peered":"2024-04-19T02:16:37.708869+0000","last_clean":"2024-04-19T02:16:37.708869+0000","last_became_active":"2024-04-19T02:15:53.957595+0000","last_became_peered":"2024-04-19T02:15:53.957595+0000","last_unstale":"2024-04-19T02:16:37.708869+0000","last_undegraded":"2024-04-19T02:16:37.708869+0000","last_fullsized":"2024-04-19T02:16:37.708869+0000","mapping_epoch":16,"log_start":"22'2244","ondisk_log_start":"22'2244","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3916,"log_dups_size":0,"ondisk_log_size":3916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:26:31.855319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":403701760,"num_objects":6160,"num_object_clones":0,"num_object_copies":12320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6160,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6160,"num_write_kb":394240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.114969+0000","last_change":"2024-04-19T02:15:28.894121+0000","last_active":"2024-04-19T02:16:36.114969+0000","last_peered":"2024-04-19T02:16:36.114969+0000","last_clean":"2024-04-19T02:16:36.114969+0000","last_became_active":"2024-04-19T02:15:28.893902+0000","last_became_peered":"2024-04-19T02:15:28.893902+0000","last_unstale":"2024-04-19T02:16:36.114969+0000","last_undegraded":"2024-04-19T02:16:36.114969+0000","last_fullsized":"2024-04-19T02:16:36.114969+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:10:35.146583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.110130+0000","last_change":"2024-04-19T02:15:29.282870+0000","last_active":"2024-04-19T02:16:36.110130+0000","last_peered":"2024-04-19T02:16:36.110130+0000","last_clean":"2024-04-19T02:16:36.110130+0000","last_became_active":"2024-04-19T02:15:29.281873+0000","last_became_peered":"2024-04-19T02:15:29.281873+0000","last_unstale":"2024-04-19T02:16:36.110130+0000","last_undegraded":"2024-04-19T02:16:36.110130+0000","last_fullsized":"2024-04-19T02:16:36.110130+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"37'6297","reported_seq":6326,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-19T02:16:37.716291+0000","last_change":"2024-04-19T02:15:53.955498+0000","last_active":"2024-04-19T02:16:37.716291+0000","last_peered":"2024-04-19T02:16:37.716291+0000","last_clean":"2024-04-19T02:16:37.716291+0000","last_became_active":"2024-04-19T02:15:53.954910+0000","last_became_peered":"2024-04-19T02:15:53.954910+0000","last_unstale":"2024-04-19T02:16:37.716291+0000","last_undegraded":"2024-04-19T02:16:37.716291+0000","last_fullsized":"2024-04-19T02:16:37.716291+0000","mapping_epoch":16,"log_start":"23'2700","ondisk_log_start":"23'2700","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3597,"log_dups_size":0,"ondisk_log_size":3597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:58:27.262672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":412680192,"num_objects":6297,"num_object_clones":0,"num_object_copies":12594,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6297,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6297,"num_write_kb":403008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.110331+0000","last_change":"2024-04-19T02:15:24.527061+0000","last_active":"2024-04-19T02:16:36.110331+0000","last_peered":"2024-04-19T02:16:36.110331+0000","last_clean":"2024-04-19T02:16:36.110331+0000","last_became_active":"2024-04-19T02:15:24.526757+0000","last_became_peered":"2024-04-19T02:15:24.526757+0000","last_unstale":"2024-04-19T02:16:36.110331+0000","last_undegraded":"2024-04-19T02:16:36.110331+0000","last_fullsized":"2024-04-19T02:16:36.110331+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:17:13.649077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119650+0000","last_change":"2024-04-19T02:15:28.892766+0000","last_active":"2024-04-19T02:16:36.119650+0000","last_peered":"2024-04-19T02:16:36.119650+0000","last_clean":"2024-04-19T02:16:36.119650+0000","last_became_active":"2024-04-19T02:15:28.892396+0000","last_became_peered":"2024-04-19T02:15:28.892396+0000","last_unstale":"2024-04-19T02:16:36.119650+0000","last_undegraded":"2024-04-19T02:16:36.119650+0000","last_fullsized":"2024-04-19T02:16:36.119650+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:57.946581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.116987+0000","last_change":"2024-04-19T02:15:29.277922+0000","last_active":"2024-04-19T02:16:36.116987+0000","last_peered":"2024-04-19T02:16:36.116987+0000","last_clean":"2024-04-19T02:16:36.116987+0000","last_became_active":"2024-04-19T02:15:29.276968+0000","last_became_peered":"2024-04-19T02:15:29.276968+0000","last_unstale":"2024-04-19T02:16:36.116987+0000","last_undegraded":"2024-04-19T02:16:36.116987+0000","last_fullsized":"2024-04-19T02:16:36.116987+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"37'6244","reported_seq":6273,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-19T02:16:37.762569+0000","last_change":"2024-04-19T02:15:53.955228+0000","last_active":"2024-04-19T02:16:37.762569+0000","last_peered":"2024-04-19T02:16:37.762569+0000","last_clean":"2024-04-19T02:16:37.762569+0000","last_became_active":"2024-04-19T02:15:53.954960+0000","last_became_peered":"2024-04-19T02:15:53.954960+0000","last_unstale":"2024-04-19T02:16:37.762569+0000","last_undegraded":"2024-04-19T02:16:37.762569+0000","last_fullsized":"2024-04-19T02:16:37.762569+0000","mapping_epoch":16,"log_start":"23'2600","ondisk_log_start":"23'2600","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3644,"log_dups_size":0,"ondisk_log_size":3644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:46:07.409922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":409206784,"num_objects":6244,"num_object_clones":0,"num_object_copies":12488,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6244,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6244,"num_write_kb":399616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118913+0000","last_change":"2024-04-19T02:15:24.530933+0000","last_active":"2024-04-19T02:16:36.118913+0000","last_peered":"2024-04-19T02:16:36.118913+0000","last_clean":"2024-04-19T02:16:36.118913+0000","last_became_active":"2024-04-19T02:15:24.530550+0000","last_became_peered":"2024-04-19T02:15:24.530550+0000","last_unstale":"2024-04-19T02:16:36.118913+0000","last_undegraded":"2024-04-19T02:16:36.118913+0000","last_fullsized":"2024-04-19T02:16:36.118913+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:18:15.194321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118812+0000","last_change":"2024-04-19T02:15:28.893062+0000","last_active":"2024-04-19T02:16:36.118812+0000","last_peered":"2024-04-19T02:16:36.118812+0000","last_clean":"2024-04-19T02:16:36.118812+0000","last_became_active":"2024-04-19T02:15:28.892798+0000","last_became_peered":"2024-04-19T02:15:28.892798+0000","last_unstale":"2024-04-19T02:16:36.118812+0000","last_undegraded":"2024-04-19T02:16:36.118812+0000","last_fullsized":"2024-04-19T02:16:36.118812+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:53.170180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.110264+0000","last_change":"2024-04-19T02:15:29.278294+0000","last_active":"2024-04-19T02:16:36.110264+0000","last_peered":"2024-04-19T02:16:36.110264+0000","last_clean":"2024-04-19T02:16:36.110264+0000","last_became_active":"2024-04-19T02:15:29.277536+0000","last_became_peered":"2024-04-19T02:15:29.277536+0000","last_unstale":"2024-04-19T02:16:36.110264+0000","last_undegraded":"2024-04-19T02:16:36.110264+0000","last_fullsized":"2024-04-19T02:16:36.110264+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"37'6254","reported_seq":6283,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-19T02:16:37.777667+0000","last_change":"2024-04-19T02:15:53.956251+0000","last_active":"2024-04-19T02:16:37.777667+0000","last_peered":"2024-04-19T02:16:37.777667+0000","last_clean":"2024-04-19T02:16:37.777667+0000","last_became_active":"2024-04-19T02:15:53.955886+0000","last_became_peered":"2024-04-19T02:15:53.955886+0000","last_unstale":"2024-04-19T02:16:37.777667+0000","last_undegraded":"2024-04-19T02:16:37.777667+0000","last_fullsized":"2024-04-19T02:16:37.777667+0000","mapping_epoch":16,"log_start":"23'2600","ondisk_log_start":"23'2600","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3654,"log_dups_size":0,"ondisk_log_size":3654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:38:38.586906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":409862144,"num_objects":6254,"num_object_clones":0,"num_object_copies":12508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6254,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6254,"num_write_kb":400256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109339+0000","last_change":"2024-04-19T02:15:24.527048+0000","last_active":"2024-04-19T02:16:36.109339+0000","last_peered":"2024-04-19T02:16:36.109339+0000","last_clean":"2024-04-19T02:16:36.109339+0000","last_became_active":"2024-04-19T02:15:24.526790+0000","last_became_peered":"2024-04-19T02:15:24.526790+0000","last_unstale":"2024-04-19T02:16:36.109339+0000","last_undegraded":"2024-04-19T02:16:36.109339+0000","last_fullsized":"2024-04-19T02:16:36.109339+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118208+0000","last_change":"2024-04-19T02:15:53.956945+0000","last_active":"2024-04-19T02:16:36.118208+0000","last_peered":"2024-04-19T02:16:36.118208+0000","last_clean":"2024-04-19T02:16:36.118208+0000","last_became_active":"2024-04-19T02:15:53.956719+0000","last_became_peered":"2024-04-19T02:15:53.956719+0000","last_unstale":"2024-04-19T02:16:36.118208+0000","last_undegraded":"2024-04-19T02:16:36.118208+0000","last_fullsized":"2024-04-19T02:16:36.118208+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:00:37.754624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.110687+0000","last_change":"2024-04-19T02:15:29.282663+0000","last_active":"2024-04-19T02:16:36.110687+0000","last_peered":"2024-04-19T02:16:36.110687+0000","last_clean":"2024-04-19T02:16:36.110687+0000","last_became_active":"2024-04-19T02:15:29.282217+0000","last_became_peered":"2024-04-19T02:15:29.282217+0000","last_unstale":"2024-04-19T02:16:36.110687+0000","last_undegraded":"2024-04-19T02:16:36.110687+0000","last_fullsized":"2024-04-19T02:16:36.110687+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"37'6174","reported_seq":6203,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-19T02:16:37.748233+0000","last_change":"2024-04-19T02:15:53.958264+0000","last_active":"2024-04-19T02:16:37.748233+0000","last_peered":"2024-04-19T02:16:37.748233+0000","last_clean":"2024-04-19T02:16:37.748233+0000","last_became_active":"2024-04-19T02:15:53.956689+0000","last_became_peered":"2024-04-19T02:15:53.956689+0000","last_unstale":"2024-04-19T02:16:37.748233+0000","last_undegraded":"2024-04-19T02:16:37.748233+0000","last_fullsized":"2024-04-19T02:16:37.748233+0000","mapping_epoch":16,"log_start":"22'2200","ondisk_log_start":"22'2200","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3974,"log_dups_size":0,"ondisk_log_size":3974,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:24:32.928594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404619264,"num_objects":6174,"num_object_clones":0,"num_object_copies":12348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6174,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6174,"num_write_kb":395136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118853+0000","last_change":"2024-04-19T02:15:24.530924+0000","last_active":"2024-04-19T02:16:36.118853+0000","last_peered":"2024-04-19T02:16:36.118853+0000","last_clean":"2024-04-19T02:16:36.118853+0000","last_became_active":"2024-04-19T02:15:24.530551+0000","last_became_peered":"2024-04-19T02:15:24.530551+0000","last_unstale":"2024-04-19T02:16:36.118853+0000","last_undegraded":"2024-04-19T02:16:36.118853+0000","last_fullsized":"2024-04-19T02:16:36.118853+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:30.576946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":232,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118383+0000","last_change":"2024-04-19T02:15:24.533634+0000","last_active":"2024-04-19T02:16:36.118383+0000","last_peered":"2024-04-19T02:16:36.118383+0000","last_clean":"2024-04-19T02:16:36.118383+0000","last_became_active":"2024-04-19T02:15:24.533420+0000","last_became_peered":"2024-04-19T02:15:24.533420+0000","last_unstale":"2024-04-19T02:16:36.118383+0000","last_undegraded":"2024-04-19T02:16:36.118383+0000","last_fullsized":"2024-04-19T02:16:36.118383+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109353+0000","last_change":"2024-04-19T02:15:28.890244+0000","last_active":"2024-04-19T02:16:36.109353+0000","last_peered":"2024-04-19T02:16:36.109353+0000","last_clean":"2024-04-19T02:16:36.109353+0000","last_became_active":"2024-04-19T02:15:28.889831+0000","last_became_peered":"2024-04-19T02:15:28.889831+0000","last_unstale":"2024-04-19T02:16:36.109353+0000","last_undegraded":"2024-04-19T02:16:36.109353+0000","last_fullsized":"2024-04-19T02:16:36.109353+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119730+0000","last_change":"2024-04-19T02:15:29.285015+0000","last_active":"2024-04-19T02:16:36.119730+0000","last_peered":"2024-04-19T02:16:36.119730+0000","last_clean":"2024-04-19T02:16:36.119730+0000","last_became_active":"2024-04-19T02:15:29.284164+0000","last_became_peered":"2024-04-19T02:15:29.284164+0000","last_unstale":"2024-04-19T02:16:36.119730+0000","last_undegraded":"2024-04-19T02:16:36.119730+0000","last_fullsized":"2024-04-19T02:16:36.119730+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:36.987844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"37'6264","reported_seq":6293,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-19T02:16:37.807067+0000","last_change":"2024-04-19T02:15:53.956463+0000","last_active":"2024-04-19T02:16:37.807067+0000","last_peered":"2024-04-19T02:16:37.807067+0000","last_clean":"2024-04-19T02:16:37.807067+0000","last_became_active":"2024-04-19T02:15:53.955819+0000","last_became_peered":"2024-04-19T02:15:53.955819+0000","last_unstale":"2024-04-19T02:16:37.807067+0000","last_undegraded":"2024-04-19T02:16:37.807067+0000","last_fullsized":"2024-04-19T02:16:37.807067+0000","mapping_epoch":16,"log_start":"23'2531","ondisk_log_start":"23'2531","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3733,"log_dups_size":0,"ondisk_log_size":3733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:46:07.409922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":410517504,"num_objects":6264,"num_object_clones":0,"num_object_copies":12528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6264,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6264,"num_write_kb":400896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118407+0000","last_change":"2024-04-19T02:15:24.533912+0000","last_active":"2024-04-19T02:16:36.118407+0000","last_peered":"2024-04-19T02:16:36.118407+0000","last_clean":"2024-04-19T02:16:36.118407+0000","last_became_active":"2024-04-19T02:15:24.533580+0000","last_became_peered":"2024-04-19T02:15:24.533580+0000","last_unstale":"2024-04-19T02:16:36.118407+0000","last_undegraded":"2024-04-19T02:16:36.118407+0000","last_fullsized":"2024-04-19T02:16:36.118407+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:45.045477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109172+0000","last_change":"2024-04-19T02:15:28.891889+0000","last_active":"2024-04-19T02:16:36.109172+0000","last_peered":"2024-04-19T02:16:36.109172+0000","last_clean":"2024-04-19T02:16:36.109172+0000","last_became_active":"2024-04-19T02:15:28.890919+0000","last_became_peered":"2024-04-19T02:15:28.890919+0000","last_unstale":"2024-04-19T02:16:36.109172+0000","last_undegraded":"2024-04-19T02:16:36.109172+0000","last_fullsized":"2024-04-19T02:16:36.109172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:35.412837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109834+0000","last_change":"2024-04-19T02:15:53.957881+0000","last_active":"2024-04-19T02:16:36.109834+0000","last_peered":"2024-04-19T02:16:36.109834+0000","last_clean":"2024-04-19T02:16:36.109834+0000","last_became_active":"2024-04-19T02:15:53.957657+0000","last_became_peered":"2024-04-19T02:15:53.957657+0000","last_unstale":"2024-04-19T02:16:36.109834+0000","last_undegraded":"2024-04-19T02:16:36.109834+0000","last_fullsized":"2024-04-19T02:16:36.109834+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:46.921714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"37'6240","reported_seq":6269,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-19T02:16:37.803472+0000","last_change":"2024-04-19T02:15:53.955068+0000","last_active":"2024-04-19T02:16:37.803472+0000","last_peered":"2024-04-19T02:16:37.803472+0000","last_clean":"2024-04-19T02:16:37.803472+0000","last_became_active":"2024-04-19T02:15:53.954721+0000","last_became_peered":"2024-04-19T02:15:53.954721+0000","last_unstale":"2024-04-19T02:16:37.803472+0000","last_undegraded":"2024-04-19T02:16:37.803472+0000","last_fullsized":"2024-04-19T02:16:37.803472+0000","mapping_epoch":16,"log_start":"23'2500","ondisk_log_start":"23'2500","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3740,"log_dups_size":0,"ondisk_log_size":3740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:18:29.742535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408944640,"num_objects":6240,"num_object_clones":0,"num_object_copies":12480,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6240,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6240,"num_write_kb":399360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109748+0000","last_change":"2024-04-19T02:15:53.959105+0000","last_active":"2024-04-19T02:16:36.109748+0000","last_peered":"2024-04-19T02:16:36.109748+0000","last_clean":"2024-04-19T02:16:36.109748+0000","last_became_active":"2024-04-19T02:15:53.958836+0000","last_became_peered":"2024-04-19T02:15:53.958836+0000","last_unstale":"2024-04-19T02:16:36.109748+0000","last_undegraded":"2024-04-19T02:16:36.109748+0000","last_fullsized":"2024-04-19T02:16:36.109748+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:18:00.321514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.110191+0000","last_change":"2024-04-19T02:15:28.892125+0000","last_active":"2024-04-19T02:16:36.110191+0000","last_peered":"2024-04-19T02:16:36.110191+0000","last_clean":"2024-04-19T02:16:36.110191+0000","last_became_active":"2024-04-19T02:15:28.891300+0000","last_became_peered":"2024-04-19T02:15:28.891300+0000","last_unstale":"2024-04-19T02:16:36.110191+0000","last_undegraded":"2024-04-19T02:16:36.110191+0000","last_fullsized":"2024-04-19T02:16:36.110191+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.116300+0000","last_change":"2024-04-19T02:15:29.281694+0000","last_active":"2024-04-19T02:16:36.116300+0000","last_peered":"2024-04-19T02:16:36.116300+0000","last_clean":"2024-04-19T02:16:36.116300+0000","last_became_active":"2024-04-19T02:15:29.280519+0000","last_became_peered":"2024-04-19T02:15:29.280519+0000","last_unstale":"2024-04-19T02:16:36.116300+0000","last_undegraded":"2024-04-19T02:16:36.116300+0000","last_fullsized":"2024-04-19T02:16:36.116300+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:50.890545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"37'6069","reported_seq":10589,"reported_epoch":37,"state":"active+remapped+backfilling","last_fresh":"2024-04-19T02:16:37.777247+0000","last_change":"2024-04-19T02:16:30.103016+0000","last_active":"2024-04-19T02:16:37.777247+0000","last_peered":"2024-04-19T02:16:37.777247+0000","last_clean":"2024-04-19T02:16:22.050311+0000","last_became_active":"2024-04-19T02:16:24.119992+0000","last_became_peered":"2024-04-19T02:16:24.119992+0000","last_unstale":"2024-04-19T02:16:37.777247+0000","last_undegraded":"2024-04-19T02:16:37.777247+0000","last_fullsized":"2024-04-19T02:16:37.777247+0000","mapping_epoch":29,"log_start":"22'2437","ondisk_log_start":"22'2437","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3632,"log_dups_size":0,"ondisk_log_size":3632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:28.663111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":397737984,"num_objects":6069,"num_object_clones":0,"num_object_copies":12138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":3427,"num_objects_unfound":0,"num_objects_dirty":6069,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6069,"num_write_kb":388416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2240,"num_bytes_recovered":146800640,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[{"shards":"0,2","objects":6069}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109883+0000","last_change":"2024-04-19T02:15:28.891702+0000","last_active":"2024-04-19T02:16:36.109883+0000","last_peered":"2024-04-19T02:16:36.109883+0000","last_clean":"2024-04-19T02:16:36.109883+0000","last_became_active":"2024-04-19T02:15:28.890743+0000","last_became_peered":"2024-04-19T02:15:28.890743+0000","last_unstale":"2024-04-19T02:16:36.109883+0000","last_undegraded":"2024-04-19T02:16:36.109883+0000","last_fullsized":"2024-04-19T02:16:36.109883+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.110353+0000","last_change":"2024-04-19T02:15:24.526845+0000","last_active":"2024-04-19T02:16:36.110353+0000","last_peered":"2024-04-19T02:16:36.110353+0000","last_clean":"2024-04-19T02:16:36.110353+0000","last_became_active":"2024-04-19T02:15:24.526500+0000","last_became_peered":"2024-04-19T02:15:24.526500+0000","last_unstale":"2024-04-19T02:16:36.110353+0000","last_undegraded":"2024-04-19T02:16:36.110353+0000","last_fullsized":"2024-04-19T02:16:36.110353+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:16.883355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109192+0000","last_change":"2024-04-19T02:15:29.278686+0000","last_active":"2024-04-19T02:16:36.109192+0000","last_peered":"2024-04-19T02:16:36.109192+0000","last_clean":"2024-04-19T02:16:36.109192+0000","last_became_active":"2024-04-19T02:15:29.278108+0000","last_became_peered":"2024-04-19T02:15:29.278108+0000","last_unstale":"2024-04-19T02:16:36.109192+0000","last_undegraded":"2024-04-19T02:16:36.109192+0000","last_fullsized":"2024-04-19T02:16:36.109192+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:34.593754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"37'6135","reported_seq":6163,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-19T02:16:37.761370+0000","last_change":"2024-04-19T02:15:53.957269+0000","last_active":"2024-04-19T02:16:37.761370+0000","last_peered":"2024-04-19T02:16:37.761370+0000","last_clean":"2024-04-19T02:16:37.761370+0000","last_became_active":"2024-04-19T02:15:53.956554+0000","last_became_peered":"2024-04-19T02:15:53.956554+0000","last_unstale":"2024-04-19T02:16:37.761370+0000","last_undegraded":"2024-04-19T02:16:37.761370+0000","last_fullsized":"2024-04-19T02:16:37.761370+0000","mapping_epoch":16,"log_start":"22'2228","ondisk_log_start":"22'2228","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3907,"log_dups_size":0,"ondisk_log_size":3907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:29:38.789719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":402063360,"num_objects":6135,"num_object_clones":0,"num_object_copies":12270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6135,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6135,"num_write_kb":392640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119645+0000","last_change":"2024-04-19T02:15:24.533777+0000","last_active":"2024-04-19T02:16:36.119645+0000","last_peered":"2024-04-19T02:16:36.119645+0000","last_clean":"2024-04-19T02:16:36.119645+0000","last_became_active":"2024-04-19T02:15:24.533436+0000","last_became_peered":"2024-04-19T02:15:24.533436+0000","last_unstale":"2024-04-19T02:16:36.119645+0000","last_undegraded":"2024-04-19T02:16:36.119645+0000","last_fullsized":"2024-04-19T02:16:36.119645+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:53:25.922418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.110135+0000","last_change":"2024-04-19T02:15:28.891370+0000","last_active":"2024-04-19T02:16:36.110135+0000","last_peered":"2024-04-19T02:16:36.110135+0000","last_clean":"2024-04-19T02:16:36.110135+0000","last_became_active":"2024-04-19T02:15:28.890702+0000","last_became_peered":"2024-04-19T02:15:28.890702+0000","last_unstale":"2024-04-19T02:16:36.110135+0000","last_undegraded":"2024-04-19T02:16:36.110135+0000","last_fullsized":"2024-04-19T02:16:36.110135+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:33.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.114984+0000","last_change":"2024-04-19T02:15:29.282244+0000","last_active":"2024-04-19T02:16:36.114984+0000","last_peered":"2024-04-19T02:16:36.114984+0000","last_clean":"2024-04-19T02:16:36.114984+0000","last_became_active":"2024-04-19T02:15:29.280366+0000","last_became_peered":"2024-04-19T02:15:29.280366+0000","last_unstale":"2024-04-19T02:16:36.114984+0000","last_undegraded":"2024-04-19T02:16:36.114984+0000","last_fullsized":"2024-04-19T02:16:36.114984+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.116345+0000","last_change":"2024-04-19T02:15:28.893027+0000","last_active":"2024-04-19T02:16:36.116345+0000","last_peered":"2024-04-19T02:16:36.116345+0000","last_clean":"2024-04-19T02:16:36.116345+0000","last_became_active":"2024-04-19T02:15:28.892695+0000","last_became_peered":"2024-04-19T02:15:28.892695+0000","last_unstale":"2024-04-19T02:16:36.116345+0000","last_undegraded":"2024-04-19T02:16:36.116345+0000","last_fullsized":"2024-04-19T02:16:36.116345+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.115395+0000","last_change":"2024-04-19T02:15:29.283155+0000","last_active":"2024-04-19T02:16:36.115395+0000","last_peered":"2024-04-19T02:16:36.115395+0000","last_clean":"2024-04-19T02:16:36.115395+0000","last_became_active":"2024-04-19T02:15:29.281407+0000","last_became_peered":"2024-04-19T02:15:29.281407+0000","last_unstale":"2024-04-19T02:16:36.115395+0000","last_undegraded":"2024-04-19T02:16:36.115395+0000","last_fullsized":"2024-04-19T02:16:36.115395+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.119328+0000","last_change":"2024-04-19T02:15:28.893067+0000","last_active":"2024-04-19T02:16:36.119328+0000","last_peered":"2024-04-19T02:16:36.119328+0000","last_clean":"2024-04-19T02:16:36.119328+0000","last_became_active":"2024-04-19T02:15:28.892781+0000","last_became_peered":"2024-04-19T02:15:28.892781+0000","last_unstale":"2024-04-19T02:16:36.119328+0000","last_undegraded":"2024-04-19T02:16:36.119328+0000","last_fullsized":"2024-04-19T02:16:36.119328+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:54:15.590143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118748+0000","last_change":"2024-04-19T02:15:29.281279+0000","last_active":"2024-04-19T02:16:36.118748+0000","last_peered":"2024-04-19T02:16:36.118748+0000","last_clean":"2024-04-19T02:16:36.118748+0000","last_became_active":"2024-04-19T02:15:29.279360+0000","last_became_peered":"2024-04-19T02:15:29.279360+0000","last_unstale":"2024-04-19T02:16:36.118748+0000","last_undegraded":"2024-04-19T02:16:36.118748+0000","last_fullsized":"2024-04-19T02:16:36.118748+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.115543+0000","last_change":"2024-04-19T02:15:28.893239+0000","last_active":"2024-04-19T02:16:36.115543+0000","last_peered":"2024-04-19T02:16:36.115543+0000","last_clean":"2024-04-19T02:16:36.115543+0000","last_became_active":"2024-04-19T02:15:28.892881+0000","last_became_peered":"2024-04-19T02:15:28.892881+0000","last_unstale":"2024-04-19T02:16:36.115543+0000","last_undegraded":"2024-04-19T02:16:36.115543+0000","last_fullsized":"2024-04-19T02:16:36.115543+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118723+0000","last_change":"2024-04-19T02:15:29.281652+0000","last_active":"2024-04-19T02:16:36.118723+0000","last_peered":"2024-04-19T02:16:36.118723+0000","last_clean":"2024-04-19T02:16:36.118723+0000","last_became_active":"2024-04-19T02:15:29.281175+0000","last_became_peered":"2024-04-19T02:15:29.281175+0000","last_unstale":"2024-04-19T02:16:36.118723+0000","last_undegraded":"2024-04-19T02:16:36.118723+0000","last_fullsized":"2024-04-19T02:16:36.118723+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:16.568764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.110437+0000","last_change":"2024-04-19T02:15:28.892058+0000","last_active":"2024-04-19T02:16:36.110437+0000","last_peered":"2024-04-19T02:16:36.110437+0000","last_clean":"2024-04-19T02:16:36.110437+0000","last_became_active":"2024-04-19T02:15:28.890877+0000","last_became_peered":"2024-04-19T02:15:28.890877+0000","last_unstale":"2024-04-19T02:16:36.110437+0000","last_undegraded":"2024-04-19T02:16:36.110437+0000","last_fullsized":"2024-04-19T02:16:36.110437+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:53.170180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.115287+0000","last_change":"2024-04-19T02:15:29.278810+0000","last_active":"2024-04-19T02:16:36.115287+0000","last_peered":"2024-04-19T02:16:36.115287+0000","last_clean":"2024-04-19T02:16:36.115287+0000","last_became_active":"2024-04-19T02:15:29.277913+0000","last_became_peered":"2024-04-19T02:15:29.277913+0000","last_unstale":"2024-04-19T02:16:36.115287+0000","last_undegraded":"2024-04-19T02:16:36.115287+0000","last_fullsized":"2024-04-19T02:16:36.115287+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:24.082666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.110394+0000","last_change":"2024-04-19T02:15:28.889132+0000","last_active":"2024-04-19T02:16:36.110394+0000","last_peered":"2024-04-19T02:16:36.110394+0000","last_clean":"2024-04-19T02:16:36.110394+0000","last_became_active":"2024-04-19T02:15:28.888926+0000","last_became_peered":"2024-04-19T02:15:28.888926+0000","last_unstale":"2024-04-19T02:16:36.110394+0000","last_undegraded":"2024-04-19T02:16:36.110394+0000","last_fullsized":"2024-04-19T02:16:36.110394+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118533+0000","last_change":"2024-04-19T02:15:29.282776+0000","last_active":"2024-04-19T02:16:36.118533+0000","last_peered":"2024-04-19T02:16:36.118533+0000","last_clean":"2024-04-19T02:16:36.118533+0000","last_became_active":"2024-04-19T02:15:29.279382+0000","last_became_peered":"2024-04-19T02:15:29.279382+0000","last_unstale":"2024-04-19T02:16:36.118533+0000","last_undegraded":"2024-04-19T02:16:36.118533+0000","last_fullsized":"2024-04-19T02:16:36.118533+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118462+0000","last_change":"2024-04-19T02:15:29.283537+0000","last_active":"2024-04-19T02:16:36.118462+0000","last_peered":"2024-04-19T02:16:36.118462+0000","last_clean":"2024-04-19T02:16:36.118462+0000","last_became_active":"2024-04-19T02:15:29.281801+0000","last_became_peered":"2024-04-19T02:15:29.281801+0000","last_unstale":"2024-04-19T02:16:36.118462+0000","last_undegraded":"2024-04-19T02:16:36.118462+0000","last_fullsized":"2024-04-19T02:16:36.118462+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109257+0000","last_change":"2024-04-19T02:15:29.281560+0000","last_active":"2024-04-19T02:16:36.109257+0000","last_peered":"2024-04-19T02:16:36.109257+0000","last_clean":"2024-04-19T02:16:36.109257+0000","last_became_active":"2024-04-19T02:15:29.281261+0000","last_became_peered":"2024-04-19T02:15:29.281261+0000","last_unstale":"2024-04-19T02:16:36.109257+0000","last_undegraded":"2024-04-19T02:16:36.109257+0000","last_fullsized":"2024-04-19T02:16:36.109257+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.118440+0000","last_change":"2024-04-19T02:15:53.955913+0000","last_active":"2024-04-19T02:16:36.118440+0000","last_peered":"2024-04-19T02:16:36.118440+0000","last_clean":"2024-04-19T02:16:36.118440+0000","last_became_active":"2024-04-19T02:15:53.955676+0000","last_became_peered":"2024-04-19T02:15:53.955676+0000","last_unstale":"2024-04-19T02:16:36.118440+0000","last_undegraded":"2024-04-19T02:16:36.118440+0000","last_fullsized":"2024-04-19T02:16:36.118440+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:53:02.899902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.109624+0000","last_change":"2024-04-19T02:15:29.278702+0000","last_active":"2024-04-19T02:16:36.109624+0000","last_peered":"2024-04-19T02:16:36.109624+0000","last_clean":"2024-04-19T02:16:36.109624+0000","last_became_active":"2024-04-19T02:15:29.277756+0000","last_became_peered":"2024-04-19T02:15:29.277756+0000","last_unstale":"2024-04-19T02:16:36.109624+0000","last_undegraded":"2024-04-19T02:16:36.109624+0000","last_fullsized":"2024-04-19T02:16:36.109624+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-19T02:16:36.115452+0000","last_change":"2024-04-19T02:15:29.277568+0000","last_active":"2024-04-19T02:16:36.115452+0000","last_peered":"2024-04-19T02:16:36.115452+0000","last_clean":"2024-04-19T02:16:36.115452+0000","last_became_active":"2024-04-19T02:15:29.276725+0000","last_became_peered":"2024-04-19T02:15:29.276725+0000","last_unstale":"2024-04-19T02:16:36.115452+0000","last_undegraded":"2024-04-19T02:16:36.115452+0000","last_fullsized":"2024-04-19T02:16:36.115452+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":6535839744,"num_objects":99729,"num_object_clones":0,"num_object_copies":199458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":3427,"num_objects_unfound":0,"num_objects_dirty":99729,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99729,"num_write_kb":6382656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2240,"num_bytes_recovered":146800640,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":13244956672,"data_stored":13244956672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60028,"ondisk_log_size":60028,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738385,"num_pgs":84,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5253660,"kb_used_data":5128208,"kb_used_omap":1,"kb_used_meta":125438,"kb_avail":89118180,"statfs":{"total":96636764160,"available":91257016320,"internally_reserved":0,"allocated":5251284992,"data_stored":5251024944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":128448966},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.313,"15min":0.313},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.497,"5min":0.497,"15min":0.497},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":1.8200000000000001}]},{"osd":1,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.36499999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738386,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4054592,"kb_used_data":3951276,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":90317248,"statfs":{"total":96636764160,"available":92484861952,"internally_reserved":0,"allocated":4046106624,"data_stored":4045820194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":105773510},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.17699999999999999},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.24099999999999999}]},{"osd":2,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":2.1000000000000001,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":0.19},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.22700000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738385,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3860856,"kb_used_data":3761636,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":90510984,"statfs":{"total":96636764160,"available":92683247616,"internally_reserved":0,"allocated":3851915264,"data_stored":3851636410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":101579206},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,3,0,2,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:16:26 2024","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.19},{"interface":"front","average":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"min":{"1min":0.16,"5min":0.16,"15min":0.16},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.254}]},{"osd":2,"last update":"Fri Apr 19 02:16:26 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.22700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4092657664,"data_stored":4092657664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3852468224,"data_stored":3852468224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5299830784,"data_stored":5299830784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:16:43.029 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 48 16 110052 110036 143.264 124.938 0.00673315 0.0069776 2024-04-19T02:16:43.030 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:43.030 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:43.035 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:43.035+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:43.045 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:16:43.136 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:43.136+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:43.150 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T02:16:43.217 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:43.217 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:43.234 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:16:43.237 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:43.237+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:43.337 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:43.337+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:43.403 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:43.403 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:43.417 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:16:43.437 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:43.438+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:43.480 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:16:43.538 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:43.538+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:43.624 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:43.624 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:43.630 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:16:43.639 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:16:43.640 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:43.640+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:43.650 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:16:43.670 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2: {} 2024-04-19T02:16:43.671 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:16:43.671 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:16:43.671 INFO:teuthology.orchestra.run.smithi121.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:16:43.741 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:43.742+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:43.842 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:43.842+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:43.855 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:16:43.855 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-04-19T02:16:43.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-04-19T02:16:43.855 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:16:43.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.855 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:43.855 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:16:43.855 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 74.582970353999997, 2024-04-19T02:16:43.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020307345000000001, 2024-04-19T02:16:43.856 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:43.856 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:43.856 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:43.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:43.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:16:43.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:43.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:43.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:16:43.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:43.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:43.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269791+0000", 2024-04-19T02:16:43.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:43.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:43.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269795+0000", 2024-04-19T02:16:43.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5619999999999999e-06 2024-04-19T02:16:43.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:43.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269802+0000", 2024-04-19T02:16:43.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8469999999999998e-06 2024-04-19T02:16:43.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:43.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269807+0000", 2024-04-19T02:16:43.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.707e-06 2024-04-19T02:16:43.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:43.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269950+0000", 2024-04-19T02:16:43.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000143313 2024-04-19T02:16:43.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:43.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269955+0000", 2024-04-19T02:16:43.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4029999999999998e-06 2024-04-19T02:16:43.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:43.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.283806+0000", 2024-04-19T02:16:43.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013850220999999999 2024-04-19T02:16:43.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:43.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.283896+0000", 2024-04-19T02:16:43.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0261999999999997e-05 2024-04-19T02:16:43.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:43.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284022+0000", 2024-04-19T02:16:43.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012641200000000001 2024-04-19T02:16:43.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:43.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289066+0000", 2024-04-19T02:16:43.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050438490000000004 2024-04-19T02:16:43.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:43.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290011+0000", 2024-04-19T02:16:43.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00094490700000000004 2024-04-19T02:16:43.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:43.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290054+0000", 2024-04-19T02:16:43.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.337e-05 2024-04-19T02:16:43.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:43.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290099+0000", 2024-04-19T02:16:43.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4987999999999997e-05 2024-04-19T02:16:43.861 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:43.861 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:43.861 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:43.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.861 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:43.861 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:16:43.861 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 74.582892423999994, 2024-04-19T02:16:43.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020331023, 2024-04-19T02:16:43.862 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:43.862 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:43.862 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:43.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:43.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:16:43.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:43.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:43.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:16:43.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:43.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.863 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:43.863 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269869+0000", 2024-04-19T02:16:43.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:43.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.863 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:43.863 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269873+0000", 2024-04-19T02:16:43.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0219999999999998e-06 2024-04-19T02:16:43.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.863 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:43.863 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269881+0000", 2024-04-19T02:16:43.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.79e-06 2024-04-19T02:16:43.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:43.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269887+0000", 2024-04-19T02:16:43.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7899999999999996e-06 2024-04-19T02:16:43.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:43.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269983+0000", 2024-04-19T02:16:43.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6057000000000005e-05 2024-04-19T02:16:43.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:43.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269986+0000", 2024-04-19T02:16:43.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9220000000000001e-06 2024-04-19T02:16:43.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:43.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284350+0000", 2024-04-19T02:16:43.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014364335000000001 2024-04-19T02:16:43.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:43.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284664+0000", 2024-04-19T02:16:43.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000313646 2024-04-19T02:16:43.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:43.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284794+0000", 2024-04-19T02:16:43.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129839 2024-04-19T02:16:43.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:43.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289107+0000", 2024-04-19T02:16:43.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0043127060000000004 2024-04-19T02:16:43.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:43.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290108+0000", 2024-04-19T02:16:43.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0010010590000000001 2024-04-19T02:16:43.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.867 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:43.867 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290144+0000", 2024-04-19T02:16:43.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6709999999999999e-05 2024-04-19T02:16:43.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.867 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:43.867 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290201+0000", 2024-04-19T02:16:43.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6654999999999999e-05 2024-04-19T02:16:43.867 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:43.867 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:43.867 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:43.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.867 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:43.867 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:16:43.867 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 74.582850082999997, 2024-04-19T02:16:43.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020507241999999998, 2024-04-19T02:16:43.868 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:43.868 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:43.868 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:43.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:43.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:16:43.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:43.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:43.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:16:43.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:43.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:43.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:16:43.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:43.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:43.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269915+0000", 2024-04-19T02:16:43.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.472e-06 2024-04-19T02:16:43.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:43.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269928+0000", 2024-04-19T02:16:43.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2979000000000001e-05 2024-04-19T02:16:43.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:43.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269935+0000", 2024-04-19T02:16:43.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8859999999999998e-06 2024-04-19T02:16:43.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:43.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270009+0000", 2024-04-19T02:16:43.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3429000000000005e-05 2024-04-19T02:16:43.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:43.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270013+0000", 2024-04-19T02:16:43.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2590000000000002e-06 2024-04-19T02:16:43.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:43.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285375+0000", 2024-04-19T02:16:43.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015362275999999999 2024-04-19T02:16:43.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:43.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285451+0000", 2024-04-19T02:16:43.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5338000000000003e-05 2024-04-19T02:16:43.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:43.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285562+0000", 2024-04-19T02:16:43.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000111285 2024-04-19T02:16:43.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:43.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289134+0000", 2024-04-19T02:16:43.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035719670000000001 2024-04-19T02:16:43.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:43.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290341+0000", 2024-04-19T02:16:43.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012074500000000001 2024-04-19T02:16:43.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:43.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290383+0000", 2024-04-19T02:16:43.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1386e-05 2024-04-19T02:16:43.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.873 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:43.873 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290419+0000", 2024-04-19T02:16:43.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6884000000000001e-05 2024-04-19T02:16:43.873 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:43.873 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:43.873 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:43.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.873 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:43.873 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269945+0000", 2024-04-19T02:16:43.873 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 74.582817500999994, 2024-04-19T02:16:43.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019709098000000001, 2024-04-19T02:16:43.873 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:43.874 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:43.874 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:43.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:43.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269945+0000", 2024-04-19T02:16:43.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:43.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:43.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269945+0000", 2024-04-19T02:16:43.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:43.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:43.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269944+0000", 2024-04-19T02:16:43.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:43.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:43.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269965+0000", 2024-04-19T02:16:43.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0803999999999999e-05 2024-04-19T02:16:43.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:43.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269973+0000", 2024-04-19T02:16:43.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3560000000000004e-06 2024-04-19T02:16:43.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.876 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:43.876 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269982+0000", 2024-04-19T02:16:43.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9600000000000006e-06 2024-04-19T02:16:43.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.876 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:43.876 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270014+0000", 2024-04-19T02:16:43.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2913000000000001e-05 2024-04-19T02:16:43.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.876 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:43.876 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270018+0000", 2024-04-19T02:16:43.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2200000000000001e-06 2024-04-19T02:16:43.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:43.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278999+0000", 2024-04-19T02:16:43.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0089818009999999993 2024-04-19T02:16:43.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:43.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.279088+0000", 2024-04-19T02:16:43.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8988999999999998e-05 2024-04-19T02:16:43.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:43.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.280160+0000", 2024-04-19T02:16:43.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001071572 2024-04-19T02:16:43.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.878 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:43.878 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288342+0000", 2024-04-19T02:16:43.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.008182468 2024-04-19T02:16:43.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.878 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:43.878 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289545+0000", 2024-04-19T02:16:43.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012026739999999999 2024-04-19T02:16:43.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.879 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:43.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289608+0000", 2024-04-19T02:16:43.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2904999999999995e-05 2024-04-19T02:16:43.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.879 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:43.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289654+0000", 2024-04-19T02:16:43.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5850000000000003e-05 2024-04-19T02:16:43.879 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:43.879 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:43.879 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:43.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.879 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:43.879 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:16:43.880 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 74.582771823000002, 2024-04-19T02:16:43.880 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022007204999999998, 2024-04-19T02:16:43.880 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:43.880 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:43.880 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:43.880 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.880 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:43.880 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:16:43.880 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:43.881 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.881 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.881 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:43.881 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:16:43.881 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:43.881 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.881 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.881 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:43.881 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269990+0000", 2024-04-19T02:16:43.881 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:43.881 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.881 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.881 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:43.881 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269999+0000", 2024-04-19T02:16:43.881 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9539999999999993e-06 2024-04-19T02:16:43.881 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.882 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.882 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:43.882 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270006+0000", 2024-04-19T02:16:43.882 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.216e-06 2024-04-19T02:16:43.882 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.882 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.882 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:43.882 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270012+0000", 2024-04-19T02:16:43.882 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5049999999999998e-06 2024-04-19T02:16:43.882 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.882 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.882 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:43.882 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270058+0000", 2024-04-19T02:16:43.882 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.634e-05 2024-04-19T02:16:43.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:43.883 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270064+0000", 2024-04-19T02:16:43.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0669999999999997e-06 2024-04-19T02:16:43.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:43.883 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287159+0000", 2024-04-19T02:16:43.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017095086999999998 2024-04-19T02:16:43.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:43.883 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287254+0000", 2024-04-19T02:16:43.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4716000000000006e-05 2024-04-19T02:16:43.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.884 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:43.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287389+0000", 2024-04-19T02:16:43.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013511900000000001 2024-04-19T02:16:43.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.884 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:43.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290481+0000", 2024-04-19T02:16:43.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030920169999999999 2024-04-19T02:16:43.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.885 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:43.885 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291931+0000", 2024-04-19T02:16:43.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001450118 2024-04-19T02:16:43.885 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.885 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:43.885 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291960+0000", 2024-04-19T02:16:43.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9096000000000001e-05 2024-04-19T02:16:43.885 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.885 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:43.885 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291998+0000", 2024-04-19T02:16:43.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7514e-05 2024-04-19T02:16:43.885 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:43.885 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:43.885 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:43.886 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.886 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.886 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:43.886 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:43.886 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 74.582711251999996, 2024-04-19T02:16:43.886 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020759494999999999, 2024-04-19T02:16:43.886 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:43.886 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:43.886 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:43.886 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.886 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:43.886 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:43.886 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:43.886 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:43.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:43.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:43.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:43.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:43.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:43.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:43.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270054+0000", 2024-04-19T02:16:43.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.27e-06 2024-04-19T02:16:43.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.888 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:43.888 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270061+0000", 2024-04-19T02:16:43.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1289999999999998e-06 2024-04-19T02:16:43.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.888 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:43.888 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270067+0000", 2024-04-19T02:16:43.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.207e-06 2024-04-19T02:16:43.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.888 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:43.888 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270105+0000", 2024-04-19T02:16:43.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7549999999999998e-05 2024-04-19T02:16:43.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.889 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.889 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:43.889 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270112+0000", 2024-04-19T02:16:43.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3200000000000002e-06 2024-04-19T02:16:43.889 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.889 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.889 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:43.889 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282454+0000", 2024-04-19T02:16:43.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012341569 2024-04-19T02:16:43.889 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.889 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.889 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:43.889 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282740+0000", 2024-04-19T02:16:43.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000286481 2024-04-19T02:16:43.889 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.890 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:43.890 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282879+0000", 2024-04-19T02:16:43.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013887799999999999 2024-04-19T02:16:43.890 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:43.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290325+0000", 2024-04-19T02:16:43.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074459779999999998 2024-04-19T02:16:43.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:43.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290759+0000", 2024-04-19T02:16:43.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000433688 2024-04-19T02:16:43.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:43.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290789+0000", 2024-04-19T02:16:43.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9960000000000001e-05 2024-04-19T02:16:43.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:43.892 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290811+0000", 2024-04-19T02:16:43.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1965999999999999e-05 2024-04-19T02:16:43.892 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:43.892 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:43.892 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:43.892 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.892 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:43.892 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:16:43.892 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 74.582661047000002, 2024-04-19T02:16:43.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020837887999999999, 2024-04-19T02:16:43.892 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:43.892 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:43.893 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:43.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.893 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:43.893 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:16:43.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:43.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.893 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:43.893 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:16:43.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:43.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.893 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:43.893 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:16:43.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:43.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.894 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:43.894 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270109+0000", 2024-04-19T02:16:43.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3110000000000006e-06 2024-04-19T02:16:43.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.894 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:43.894 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270117+0000", 2024-04-19T02:16:43.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0479999999999999e-06 2024-04-19T02:16:43.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.894 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:43.894 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270123+0000", 2024-04-19T02:16:43.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5500000000000002e-06 2024-04-19T02:16:43.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:43.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270150+0000", 2024-04-19T02:16:43.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7712000000000002e-05 2024-04-19T02:16:43.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:43.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270153+0000", 2024-04-19T02:16:43.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6089999999999999e-06 2024-04-19T02:16:43.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:43.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285958+0000", 2024-04-19T02:16:43.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015805274000000001 2024-04-19T02:16:43.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:43.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286126+0000", 2024-04-19T02:16:43.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016765700000000001 2024-04-19T02:16:43.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:43.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286296+0000", 2024-04-19T02:16:43.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017007 2024-04-19T02:16:43.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:43.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290426+0000", 2024-04-19T02:16:43.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041299839999999997 2024-04-19T02:16:43.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:43.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290867+0000", 2024-04-19T02:16:43.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00044083300000000001 2024-04-19T02:16:43.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:43.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290900+0000", 2024-04-19T02:16:43.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3380000000000002e-05 2024-04-19T02:16:43.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.898 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:43.898 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290939+0000", 2024-04-19T02:16:43.898 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8970000000000001e-05 2024-04-19T02:16:43.898 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:43.898 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:43.898 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:43.898 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.898 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:21 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:43.898 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:16:43.898 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 74.582572374999998, 2024-04-19T02:16:43.898 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020833187999999999, 2024-04-19T02:16:43.898 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:43.899 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:16:43.899 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:43.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.899 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:43.899 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:16:43.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:43.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.899 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:43.899 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:16:43.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:43.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.899 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:43.899 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270189+0000", 2024-04-19T02:16:43.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:43.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:43.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270192+0000", 2024-04-19T02:16:43.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7549999999999999e-06 2024-04-19T02:16:43.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:43.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270198+0000", 2024-04-19T02:16:43.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0859999999999998e-06 2024-04-19T02:16:43.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:43.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270204+0000", 2024-04-19T02:16:43.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1970000000000004e-06 2024-04-19T02:16:43.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:43.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270238+0000", 2024-04-19T02:16:43.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4282000000000001e-05 2024-04-19T02:16:43.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:43.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270240+0000", 2024-04-19T02:16:43.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3099999999999999e-06 2024-04-19T02:16:43.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:43.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287131+0000", 2024-04-19T02:16:43.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01689104 2024-04-19T02:16:43.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:43.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287262+0000", 2024-04-19T02:16:43.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130347 2024-04-19T02:16:43.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:43.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291023+0000", 2024-04-19T02:16:43.903 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037616350000000002 2024-04-19T02:16:43.903 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:43.903 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:43.903 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:43.903 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.903 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.903 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:16494 5.7 5:e2c19dca:::benchmark_data_smithi121_44835_object16493:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:43.903 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.871684+0000", 2024-04-19T02:16:43.903 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 43.981078719999999, 2024-04-19T02:16:43.903 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019343257999999999, 2024-04-19T02:16:43.903 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:43.903 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:43.903 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:43.903 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:43.903 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:43.904 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16494 2024-04-19T02:16:43.904 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.904 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:43.904 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.904 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:43.904 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871684+0000", 2024-04-19T02:16:43.904 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:43.904 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.904 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.904 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:43.904 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871684+0000", 2024-04-19T02:16:43.904 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:43.904 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.904 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.904 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:43.904 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871683+0000", 2024-04-19T02:16:43.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:43.905 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.905 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.905 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:43.905 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871762+0000", 2024-04-19T02:16:43.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8981999999999997e-05 2024-04-19T02:16:43.905 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.905 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.905 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:43.905 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871770+0000", 2024-04-19T02:16:43.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7060000000000004e-06 2024-04-19T02:16:43.905 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.905 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.905 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:43.905 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871776+0000", 2024-04-19T02:16:43.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4880000000000004e-06 2024-04-19T02:16:43.905 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.906 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:43.906 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.874098+0000", 2024-04-19T02:16:43.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0023215309999999999 2024-04-19T02:16:43.906 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.906 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:43.906 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.874245+0000", 2024-04-19T02:16:43.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014735599999999999 2024-04-19T02:16:43.906 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.906 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:43.906 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.874394+0000", 2024-04-19T02:16:43.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014848300000000001 2024-04-19T02:16:43.907 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.907 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.907 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:43.907 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.876474+0000", 2024-04-19T02:16:43.907 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020803060000000001 2024-04-19T02:16:43.907 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.907 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.907 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:43.907 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.890939+0000", 2024-04-19T02:16:43.907 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014464985 2024-04-19T02:16:43.907 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.907 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.907 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:43.907 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.890986+0000", 2024-04-19T02:16:43.908 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7321000000000003e-05 2024-04-19T02:16:43.908 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.908 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.908 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:43.908 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891027+0000", 2024-04-19T02:16:43.908 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0689999999999998e-05 2024-04-19T02:16:43.908 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:43.908 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:43.908 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:43.908 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.908 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.908 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:16519 5.f 5:fc30d3a1:::benchmark_data_smithi121_44835_object16518:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:43.908 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.880723+0000", 2024-04-19T02:16:43.909 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 43.972039596999998, 2024-04-19T02:16:43.909 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020492519000000001, 2024-04-19T02:16:43.909 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:43.909 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:43.909 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:43.909 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:43.909 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:43.909 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16519 2024-04-19T02:16:43.909 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.909 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:43.909 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.909 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:43.909 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880723+0000", 2024-04-19T02:16:43.909 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:43.910 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.910 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.910 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:43.910 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880723+0000", 2024-04-19T02:16:43.910 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:43.910 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.910 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.910 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:43.910 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880722+0000", 2024-04-19T02:16:43.910 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:43.910 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.910 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.910 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:43.910 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880794+0000", 2024-04-19T02:16:43.911 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1515999999999998e-05 2024-04-19T02:16:43.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.911 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:43.911 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880805+0000", 2024-04-19T02:16:43.911 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1353e-05 2024-04-19T02:16:43.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.911 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:43.911 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880812+0000", 2024-04-19T02:16:43.911 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1230000000000002e-06 2024-04-19T02:16:43.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.911 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:43.911 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.890954+0000", 2024-04-19T02:16:43.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010142253 2024-04-19T02:16:43.912 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.912 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.912 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:43.912 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891079+0000", 2024-04-19T02:16:43.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000124917 2024-04-19T02:16:43.912 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.912 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.912 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:43.912 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891218+0000", 2024-04-19T02:16:43.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000138715 2024-04-19T02:16:43.912 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.912 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.912 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:43.913 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.897321+0000", 2024-04-19T02:16:43.913 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0061026830000000002 2024-04-19T02:16:43.913 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.913 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.913 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:43.913 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901137+0000", 2024-04-19T02:16:43.913 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038161699999999998 2024-04-19T02:16:43.913 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.913 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.913 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:43.913 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901181+0000", 2024-04-19T02:16:43.913 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4362e-05 2024-04-19T02:16:43.913 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.913 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.913 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:43.913 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901215+0000", 2024-04-19T02:16:43.914 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3929e-05 2024-04-19T02:16:43.914 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:43.914 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:43.914 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:43.914 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.914 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.914 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:16520 5.f 5:f0474691:::benchmark_data_smithi121_44835_object16519:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:43.914 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.880833+0000", 2024-04-19T02:16:43.914 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 43.971929582000001, 2024-04-19T02:16:43.914 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020460160000000002, 2024-04-19T02:16:43.914 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:43.914 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:43.914 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:43.914 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:43.915 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:43.915 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16520 2024-04-19T02:16:43.915 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.915 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:43.915 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.915 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:43.915 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880833+0000", 2024-04-19T02:16:43.915 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:43.915 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.915 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.915 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:43.915 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880833+0000", 2024-04-19T02:16:43.915 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:43.915 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.915 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.916 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:43.916 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880832+0000", 2024-04-19T02:16:43.916 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:43.916 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.916 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.916 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:43.916 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880909+0000", 2024-04-19T02:16:43.916 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7095000000000006e-05 2024-04-19T02:16:43.916 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.916 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.916 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:43.916 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880919+0000", 2024-04-19T02:16:43.916 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8919999999999995e-06 2024-04-19T02:16:43.916 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.917 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.917 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:43.917 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880927+0000", 2024-04-19T02:16:43.917 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8809999999999996e-06 2024-04-19T02:16:43.917 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.917 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.917 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:43.917 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891901+0000", 2024-04-19T02:16:43.917 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010974263999999999 2024-04-19T02:16:43.917 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.917 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.917 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:43.917 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.892021+0000", 2024-04-19T02:16:43.917 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120074 2024-04-19T02:16:43.917 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.918 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.918 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:43.918 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.892165+0000", 2024-04-19T02:16:43.918 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014328600000000001 2024-04-19T02:16:43.918 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.918 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.918 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:43.918 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.897347+0000", 2024-04-19T02:16:43.918 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.005182603 2024-04-19T02:16:43.918 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.918 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.918 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:43.918 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901224+0000", 2024-04-19T02:16:43.918 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038767620000000002 2024-04-19T02:16:43.918 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.919 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.919 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:43.919 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901264+0000", 2024-04-19T02:16:43.919 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9579000000000002e-05 2024-04-19T02:16:43.919 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.919 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.919 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:43.919 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901293+0000", 2024-04-19T02:16:43.919 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9300999999999999e-05 2024-04-19T02:16:43.919 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:43.919 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:43.919 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:43.919 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.919 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.919 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:44167 5.7 5:ef4300c4:::benchmark_data_smithi121_44835_object44166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:43.920 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:09.853830+0000", 2024-04-19T02:16:43.920 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 33.998932097999997, 2024-04-19T02:16:43.920 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020082104, 2024-04-19T02:16:43.920 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:43.920 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:43.920 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:43.920 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:43.920 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:43.920 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 44167 2024-04-19T02:16:43.920 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.920 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:43.920 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.920 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:43.920 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853830+0000", 2024-04-19T02:16:43.921 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:43.921 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.921 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.921 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:43.921 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853830+0000", 2024-04-19T02:16:43.921 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:43.921 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.921 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.921 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:43.921 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853829+0000", 2024-04-19T02:16:43.921 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:43.921 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.921 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.921 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:43.921 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853863+0000", 2024-04-19T02:16:43.921 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3151999999999997e-05 2024-04-19T02:16:43.922 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.922 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.922 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:43.922 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853873+0000", 2024-04-19T02:16:43.922 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0366e-05 2024-04-19T02:16:43.922 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.922 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.922 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:43.922 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853881+0000", 2024-04-19T02:16:43.922 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6539999999999999e-06 2024-04-19T02:16:43.922 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.922 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.922 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:43.922 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.859162+0000", 2024-04-19T02:16:43.923 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052810740000000002 2024-04-19T02:16:43.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.923 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.923 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:43.923 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.859303+0000", 2024-04-19T02:16:43.923 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000140975 2024-04-19T02:16:43.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.923 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.923 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:43.923 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.859460+0000", 2024-04-19T02:16:43.923 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015754199999999999 2024-04-19T02:16:43.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.923 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.923 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:43.923 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.865142+0000", 2024-04-19T02:16:43.924 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0056819130000000002 2024-04-19T02:16:43.924 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.924 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.924 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:43.924 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.873828+0000", 2024-04-19T02:16:43.924 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0086861799999999999 2024-04-19T02:16:43.924 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.924 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.924 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:43.924 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.873871+0000", 2024-04-19T02:16:43.924 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2624999999999999e-05 2024-04-19T02:16:43.924 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.924 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.924 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:43.924 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.873912+0000", 2024-04-19T02:16:43.924 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1486000000000002e-05 2024-04-19T02:16:43.925 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:43.925 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:43.925 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:43.925 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.925 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.925 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:53042 5.f 5:f744ac14:::benchmark_data_smithi121_44835_object53041:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T02:16:43.925 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:13.560196+0000", 2024-04-19T02:16:43.925 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.292566278999999, 2024-04-19T02:16:43.925 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020122021, 2024-04-19T02:16:43.925 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:43.925 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:43.925 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:43.925 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:43.925 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:43.926 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 53042 2024-04-19T02:16:43.926 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.926 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:43.926 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.926 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:43.926 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560196+0000", 2024-04-19T02:16:43.926 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:43.926 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.926 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.926 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:43.926 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560196+0000", 2024-04-19T02:16:43.926 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:43.926 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.926 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.927 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:43.927 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560195+0000", 2024-04-19T02:16:43.927 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:43.927 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.927 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.927 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:43.927 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560255+0000", 2024-04-19T02:16:43.927 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9441000000000002e-05 2024-04-19T02:16:43.927 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.927 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.927 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:43.927 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560264+0000", 2024-04-19T02:16:43.927 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1130000000000007e-06 2024-04-19T02:16:43.927 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.927 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.928 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:43.928 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560271+0000", 2024-04-19T02:16:43.928 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9800000000000001e-06 2024-04-19T02:16:43.928 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.928 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.928 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:43.928 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560312+0000", 2024-04-19T02:16:43.928 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0828999999999998e-05 2024-04-19T02:16:43.928 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.928 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.928 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:43.928 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560456+0000", 2024-04-19T02:16:43.928 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014474799999999999 2024-04-19T02:16:43.928 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.929 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.929 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:43.929 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560591+0000", 2024-04-19T02:16:43.929 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013482699999999999 2024-04-19T02:16:43.929 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.929 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.929 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:43.929 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.564799+0000", 2024-04-19T02:16:43.929 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042080080000000001 2024-04-19T02:16:43.929 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.929 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.929 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:43.929 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580233+0000", 2024-04-19T02:16:43.929 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015433715000000001 2024-04-19T02:16:43.930 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.930 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.930 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:43.930 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580280+0000", 2024-04-19T02:16:43.930 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6465000000000003e-05 2024-04-19T02:16:43.930 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.930 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.930 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:43.930 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580318+0000", 2024-04-19T02:16:43.930 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8557999999999999e-05 2024-04-19T02:16:43.930 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:43.930 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:43.930 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:43.930 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.931 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.931 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:53044 5.7 5:ec8fd8f2:::benchmark_data_smithi121_44835_object53043:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T02:16:43.931 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:13.561281+0000", 2024-04-19T02:16:43.931 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.291481077, 2024-04-19T02:16:43.931 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019133752, 2024-04-19T02:16:43.931 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:43.931 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:43.931 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:43.931 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:43.931 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:43.931 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 53044 2024-04-19T02:16:43.931 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.931 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:43.931 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.932 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:43.932 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.561281+0000", 2024-04-19T02:16:43.932 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:43.932 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.932 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.932 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:43.932 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.561281+0000", 2024-04-19T02:16:43.932 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:43.932 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.932 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.932 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:43.932 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.561270+0000", 2024-04-19T02:16:43.932 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999886 2024-04-19T02:16:43.932 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.933 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.933 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:43.933 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.561364+0000", 2024-04-19T02:16:43.933 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4721000000000003e-05 2024-04-19T02:16:43.933 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.933 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.933 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:43.933 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.561375+0000", 2024-04-19T02:16:43.933 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0900999999999999e-05 2024-04-19T02:16:43.933 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.933 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.933 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:43.933 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.561383+0000", 2024-04-19T02:16:43.934 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5460000000000003e-06 2024-04-19T02:16:43.934 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.934 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.934 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:43.934 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.562716+0000", 2024-04-19T02:16:43.934 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001333592 2024-04-19T02:16:43.934 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.934 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.934 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:43.934 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.562831+0000", 2024-04-19T02:16:43.934 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000114585 2024-04-19T02:16:43.934 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.934 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.934 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:43.935 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.562984+0000", 2024-04-19T02:16:43.935 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000152724 2024-04-19T02:16:43.935 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.935 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.935 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:43.935 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.571517+0000", 2024-04-19T02:16:43.935 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0085335199999999993 2024-04-19T02:16:43.935 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.935 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.935 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:43.935 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580332+0000", 2024-04-19T02:16:43.935 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0088147859999999998 2024-04-19T02:16:43.935 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.935 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.936 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:43.936 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580377+0000", 2024-04-19T02:16:43.936 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5293000000000002e-05 2024-04-19T02:16:43.936 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.936 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.936 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:43.936 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580415+0000", 2024-04-19T02:16:43.936 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7756999999999998e-05 2024-04-19T02:16:43.936 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:43.936 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:43.936 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:43.936 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.937 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.937 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:85866 5.2 5:48b1d46d:::benchmark_data_smithi121_44835_object85865:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T02:16:43.937 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:30.771909+0000", 2024-04-19T02:16:43.937 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.080853007, 2024-04-19T02:16:43.937 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020516216, 2024-04-19T02:16:43.937 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:43.937 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:43.937 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:43.937 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:43.937 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:43.937 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 85866 2024-04-19T02:16:43.937 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.937 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:43.937 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.938 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:43.938 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771909+0000", 2024-04-19T02:16:43.938 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:43.938 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.938 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.938 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:43.938 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771909+0000", 2024-04-19T02:16:43.938 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:43.938 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.938 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.938 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:43.938 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771909+0000", 2024-04-19T02:16:43.939 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:43.939 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.939 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.939 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:43.939 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771952+0000", 2024-04-19T02:16:43.939 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2660000000000002e-05 2024-04-19T02:16:43.939 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.939 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.939 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:43.939 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771959+0000", 2024-04-19T02:16:43.939 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7670000000000003e-06 2024-04-19T02:16:43.939 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.939 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.939 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:43.939 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771966+0000", 2024-04-19T02:16:43.940 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.905e-06 2024-04-19T02:16:43.940 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.940 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.940 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:43.940 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771999+0000", 2024-04-19T02:16:43.940 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2360999999999997e-05 2024-04-19T02:16:43.940 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.940 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.940 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:43.940 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.772133+0000", 2024-04-19T02:16:43.940 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013398699999999999 2024-04-19T02:16:43.940 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.940 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.940 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:43.941 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.772280+0000", 2024-04-19T02:16:43.941 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000147198 2024-04-19T02:16:43.941 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.941 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.941 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:43.941 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.774312+0000", 2024-04-19T02:16:43.941 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020325339999999999 2024-04-19T02:16:43.941 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.941 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.941 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:43.941 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.792370+0000", 2024-04-19T02:16:43.941 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018057321000000001 2024-04-19T02:16:43.941 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.941 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.941 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:43.942 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.792403+0000", 2024-04-19T02:16:43.942 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3247000000000002e-05 2024-04-19T02:16:43.942 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.942 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.942 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:43.942 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.792426+0000", 2024-04-19T02:16:43.942 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2697999999999999e-05 2024-04-19T02:16:43.942 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:43.942 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:43.942 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:43.942 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.942 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.942 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:94438 5.7 5:eb242aac:::benchmark_data_smithi121_44835_object94437:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T02:16:43.942 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:35.095629+0000", 2024-04-19T02:16:43.942 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.7571329840000001, 2024-04-19T02:16:43.943 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019240869000000001, 2024-04-19T02:16:43.943 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:43.943 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:43.943 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:43.943 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:43.943 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:43.943 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 94438 2024-04-19T02:16:43.943 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.943 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:43.943 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.943 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:43.943 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.095629+0000", 2024-04-19T02:16:43.943 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:43.943 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.943 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.943 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:43.944 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.095629+0000", 2024-04-19T02:16:43.944 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:43.944 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.944 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.944 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:43.944 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.095628+0000", 2024-04-19T02:16:43.944 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:43.944 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.944 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.944 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:43.944 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.095652+0000", 2024-04-19T02:16:43.944 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3819999999999999e-05 2024-04-19T02:16:43.944 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.944 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.944 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:43.944 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.095660+0000", 2024-04-19T02:16:43.945 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0919999999999998e-06 2024-04-19T02:16:43.945 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.945 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.945 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:43.945 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.095665+0000", 2024-04-19T02:16:43.945 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2950000000000004e-06 2024-04-19T02:16:43.945 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.945 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.945 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:43.945 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.095686+0000", 2024-04-19T02:16:43.945 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1392000000000001e-05 2024-04-19T02:16:43.945 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.945 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.945 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:43.945 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.095791+0000", 2024-04-19T02:16:43.946 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010500100000000001 2024-04-19T02:16:43.946 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.946 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.946 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:43.946 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.095878+0000", 2024-04-19T02:16:43.946 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6674000000000004e-05 2024-04-19T02:16:43.946 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.946 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.946 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:43.946 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.097633+0000", 2024-04-19T02:16:43.946 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017547369999999999 2024-04-19T02:16:43.946 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.946 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.946 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:43.947 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.114800+0000", 2024-04-19T02:16:43.947 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017167449000000001 2024-04-19T02:16:43.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.947 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:43.947 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.114848+0000", 2024-04-19T02:16:43.947 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8096999999999997e-05 2024-04-19T02:16:43.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.947 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:43.947 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.114870+0000", 2024-04-19T02:16:43.947 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2158999999999999e-05 2024-04-19T02:16:43.947 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:43.947 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:43.947 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:43.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.948 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.948 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:94468 5.2 5:4f406431:::benchmark_data_smithi121_44835_object94467:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T02:16:43.948 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:16:43.948 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.7413331929999991, 2024-04-19T02:16:43.948 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024835144999999999, 2024-04-19T02:16:43.948 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:43.948 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:43.948 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:43.948 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:43.948 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:43.948 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 94468 2024-04-19T02:16:43.948 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.948 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:43.949 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.949 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:43.949 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:16:43.949 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:43.949 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.949 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.949 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:43.949 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:16:43.949 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:43.949 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.949 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.949 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:43.949 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:16:43.949 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:43.950 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.950 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.950 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:43.950 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111498+0000", 2024-04-19T02:16:43.950 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9529000000000005e-05 2024-04-19T02:16:43.950 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.950 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.950 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:43.950 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111506+0000", 2024-04-19T02:16:43.950 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9030000000000004e-06 2024-04-19T02:16:43.950 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.950 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.950 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:43.950 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111513+0000", 2024-04-19T02:16:43.951 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8759999999999999e-06 2024-04-19T02:16:43.951 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.951 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.951 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:43.951 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112466+0000", 2024-04-19T02:16:43.951 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00095318499999999995 2024-04-19T02:16:43.951 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.951 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.951 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:43.951 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112590+0000", 2024-04-19T02:16:43.951 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012380900000000001 2024-04-19T02:16:43.951 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.951 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.951 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:43.952 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112728+0000", 2024-04-19T02:16:43.952 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013753800000000001 2024-04-19T02:16:43.952 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.952 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.952 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:43.952 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115064+0000", 2024-04-19T02:16:43.952 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002336819 2024-04-19T02:16:43.952 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.952 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.952 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:43.952 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136207+0000", 2024-04-19T02:16:43.952 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021142942000000001 2024-04-19T02:16:43.952 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.952 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.953 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:43.953 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136241+0000", 2024-04-19T02:16:43.953 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3577000000000001e-05 2024-04-19T02:16:43.953 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.953 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.953 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:43.953 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136264+0000", 2024-04-19T02:16:43.953 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3421000000000002e-05 2024-04-19T02:16:43.953 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:43.953 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:43.953 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:43.953 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.953 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.954 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:94472 5.2 5:45b7e9be:::benchmark_data_smithi121_44835_object94471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:43.954 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:16:43.954 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.7376866619999998, 2024-04-19T02:16:43.954 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021273843000000001, 2024-04-19T02:16:43.954 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:43.954 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:43.954 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:43.954 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:43.954 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:43.954 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 94472 2024-04-19T02:16:43.954 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.954 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:43.954 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.955 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:43.955 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:16:43.955 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:43.955 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.955 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.955 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:43.955 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:16:43.955 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:43.955 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.955 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.955 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:43.955 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115075+0000", 2024-04-19T02:16:43.956 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:43.956 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.956 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.956 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:43.956 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115161+0000", 2024-04-19T02:16:43.956 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6632000000000007e-05 2024-04-19T02:16:43.956 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.956 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.956 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:43.956 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115171+0000", 2024-04-19T02:16:43.956 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2969999999999992e-06 2024-04-19T02:16:43.956 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.956 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.956 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:43.957 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115178+0000", 2024-04-19T02:16:43.957 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7610000000000007e-06 2024-04-19T02:16:43.957 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.957 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.957 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:43.957 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115213+0000", 2024-04-19T02:16:43.957 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5000999999999999e-05 2024-04-19T02:16:43.957 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.957 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.957 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:43.957 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115303+0000", 2024-04-19T02:16:43.957 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9791999999999997e-05 2024-04-19T02:16:43.957 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.957 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.958 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:43.958 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115391+0000", 2024-04-19T02:16:43.958 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7559000000000007e-05 2024-04-19T02:16:43.958 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.958 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.958 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:43.958 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.117894+0000", 2024-04-19T02:16:43.958 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002503496 2024-04-19T02:16:43.958 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.958 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.958 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:43.958 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136297+0000", 2024-04-19T02:16:43.958 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018402335999999998 2024-04-19T02:16:43.958 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.959 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.959 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:43.959 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136327+0000", 2024-04-19T02:16:43.959 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0534999999999998e-05 2024-04-19T02:16:43.959 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.959 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.959 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:43.959 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136350+0000", 2024-04-19T02:16:43.959 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2427999999999999e-05 2024-04-19T02:16:43.959 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:43.959 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:43.959 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:43.959 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.960 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.960 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:96668 5.f 5:f48d3288:::benchmark_data_smithi121_44835_object96667:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-19T02:16:43.960 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:36.254669+0000", 2024-04-19T02:16:43.960 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 7.5980935430000001, 2024-04-19T02:16:43.960 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019875075999999998, 2024-04-19T02:16:43.960 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:43.960 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:43.960 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:43.960 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:43.960 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:43.960 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 96668 2024-04-19T02:16:43.960 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.960 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:43.960 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.960 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:43.960 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254669+0000", 2024-04-19T02:16:43.961 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:43.961 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.961 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.961 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:43.961 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254669+0000", 2024-04-19T02:16:43.961 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:43.961 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.961 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.961 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:43.961 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254668+0000", 2024-04-19T02:16:43.961 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:43.961 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.961 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.961 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:43.962 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254738+0000", 2024-04-19T02:16:43.962 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9913000000000006e-05 2024-04-19T02:16:43.962 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.962 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.962 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:43.962 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254748+0000", 2024-04-19T02:16:43.962 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7429999999999997e-06 2024-04-19T02:16:43.962 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.962 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.962 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:43.962 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254754+0000", 2024-04-19T02:16:43.962 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3840000000000002e-06 2024-04-19T02:16:43.962 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.962 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.962 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:43.963 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.256882+0000", 2024-04-19T02:16:43.963 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021282950000000001 2024-04-19T02:16:43.963 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.963 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.963 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:43.963 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.257007+0000", 2024-04-19T02:16:43.963 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012430699999999999 2024-04-19T02:16:43.963 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.963 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.963 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:43.963 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.257150+0000", 2024-04-19T02:16:43.963 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014291999999999999 2024-04-19T02:16:43.963 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.964 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.964 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:43.964 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.261375+0000", 2024-04-19T02:16:43.964 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042252100000000001 2024-04-19T02:16:43.964 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.964 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.964 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:43.964 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.274489+0000", 2024-04-19T02:16:43.964 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013113915 2024-04-19T02:16:43.964 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.964 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.964 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:43.964 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.274521+0000", 2024-04-19T02:16:43.964 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2691999999999998e-05 2024-04-19T02:16:43.965 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.965 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.965 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:43.965 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.274544+0000", 2024-04-19T02:16:43.965 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2408999999999998e-05 2024-04-19T02:16:43.965 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:43.965 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:43.965 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:43.965 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.965 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.965 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:98093 5.f 5:fcbc05b3:::benchmark_data_smithi121_44835_object98092:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-19T02:16:43.965 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:36.938897+0000", 2024-04-19T02:16:43.965 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 6.9138656960000002, 2024-04-19T02:16:43.965 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019526373, 2024-04-19T02:16:43.966 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:43.966 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:43.966 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:43.966 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:43.966 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:43.966 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 98093 2024-04-19T02:16:43.966 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.966 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:43.966 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.966 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:43.966 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.938897+0000", 2024-04-19T02:16:43.967 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:43.967 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.967 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.967 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:43.967 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.938897+0000", 2024-04-19T02:16:43.967 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:43.967 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.967 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.967 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:43.967 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.938896+0000", 2024-04-19T02:16:43.967 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:43.967 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.967 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.968 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:43.968 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.938920+0000", 2024-04-19T02:16:43.968 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3969e-05 2024-04-19T02:16:43.968 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.968 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.968 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:43.968 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.938927+0000", 2024-04-19T02:16:43.968 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4760000000000003e-06 2024-04-19T02:16:43.968 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.968 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.968 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:43.968 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.938930+0000", 2024-04-19T02:16:43.968 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7349999999999998e-06 2024-04-19T02:16:43.968 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.968 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.969 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:43.969 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.945557+0000", 2024-04-19T02:16:43.969 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0066265689999999997 2024-04-19T02:16:43.969 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.969 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.969 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:43.969 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.945653+0000", 2024-04-19T02:16:43.969 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5948999999999999e-05 2024-04-19T02:16:43.969 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.969 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.969 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:43.969 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.945739+0000", 2024-04-19T02:16:43.969 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6012000000000003e-05 2024-04-19T02:16:43.970 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.970 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.970 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:43.970 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.949258+0000", 2024-04-19T02:16:43.970 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035189140000000002 2024-04-19T02:16:43.970 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.970 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.970 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:43.970 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.958372+0000", 2024-04-19T02:16:43.970 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0091140430000000005 2024-04-19T02:16:43.970 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.970 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.970 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:43.971 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.958402+0000", 2024-04-19T02:16:43.971 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9879e-05 2024-04-19T02:16:43.971 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:43.971 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:43.971 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:43.971 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.958423+0000", 2024-04-19T02:16:43.971 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1206999999999999e-05 2024-04-19T02:16:43.971 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:43.971 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:43.971 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:43.971 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:43.971 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:43.971 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:16:43.973 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:16:43.973 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:43.972+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:44.029 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 49 16 112079 112063 142.926 126.688 0.00271561 0.00699389 2024-04-19T02:16:44.073 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:44.073+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:44.144 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:16:44.144 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:16:44.144 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.144 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:112304 5.9 e39/16 5:97bf1eb8:::benchmark_data_smithi121_44835_object112303:head v 39'7155, mlcod=39'7151)", 2024-04-19T02:16:44.144 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:44.140625+0000", 2024-04-19T02:16:44.144 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.004191424, 2024-04-19T02:16:44.144 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0042147290000000004, 2024-04-19T02:16:44.145 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:44.145 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:16:44.145 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:44.145 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.145 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:44.145 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:44.140625+0000", 2024-04-19T02:16:44.145 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:44.145 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.145 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.145 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:44.145 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:44.140625+0000", 2024-04-19T02:16:44.145 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:44.145 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.145 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.146 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:44.146 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:44.140625+0000", 2024-04-19T02:16:44.146 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:44.146 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.146 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.146 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:44.146 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:44.140685+0000", 2024-04-19T02:16:44.146 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.9726999999999999e-05 2024-04-19T02:16:44.146 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.146 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.146 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:44.146 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:44.140693+0000", 2024-04-19T02:16:44.146 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.7439999999999996e-06 2024-04-19T02:16:44.146 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.147 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.147 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:44.147 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:44.140700+0000", 2024-04-19T02:16:44.147 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.2530000000000001e-06 2024-04-19T02:16:44.147 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.147 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.147 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:44.147 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:44.140732+0000", 2024-04-19T02:16:44.147 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2801e-05 2024-04-19T02:16:44.147 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.147 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.147 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:44.147 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:44.140751+0000", 2024-04-19T02:16:44.147 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.8428999999999999e-05 2024-04-19T02:16:44.147 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:44.148 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:44.148 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:44.148 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.148 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.148 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:112303 5.1 e39/29 5:87778780:::benchmark_data_smithi121_44835_object112302:head v 39'6849, mlcod=39'6846)", 2024-04-19T02:16:44.148 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:44.140816+0000", 2024-04-19T02:16:44.148 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0040007530000000001, 2024-04-19T02:16:44.148 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.004089344, 2024-04-19T02:16:44.148 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:44.148 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:16:44.148 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:44.148 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.148 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:44.148 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:44.140816+0000", 2024-04-19T02:16:44.149 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:44.149 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.149 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.149 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:44.149 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:44.140816+0000", 2024-04-19T02:16:44.149 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:44.149 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.149 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.149 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:44.149 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:44.140815+0000", 2024-04-19T02:16:44.149 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:44.149 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.149 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.149 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:44.149 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:44.140878+0000", 2024-04-19T02:16:44.150 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.2750999999999996e-05 2024-04-19T02:16:44.150 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.150 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.150 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:44.150 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:44.140891+0000", 2024-04-19T02:16:44.150 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2802e-05 2024-04-19T02:16:44.150 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.150 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.150 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:44.150 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:44.140898+0000", 2024-04-19T02:16:44.150 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.7460000000000003e-06 2024-04-19T02:16:44.150 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.150 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.150 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:44.151 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:44.143696+0000", 2024-04-19T02:16:44.151 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0027980790000000002 2024-04-19T02:16:44.151 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.151 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.151 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:44.151 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:44.143717+0000", 2024-04-19T02:16:44.151 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1458999999999999e-05 2024-04-19T02:16:44.151 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:44.151 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:44.151 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:44.151 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.152 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.152 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:112306 5.9 e39/16 5:938989a2:::benchmark_data_smithi121_44835_object112305:head v 39'7156, mlcod=39'7151)", 2024-04-19T02:16:44.152 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:44.143173+0000", 2024-04-19T02:16:44.152 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0016441450000000001, 2024-04-19T02:16:44.152 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001794943, 2024-04-19T02:16:44.152 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:44.152 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:16:44.152 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:44.152 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.152 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:44.152 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:44.143173+0000", 2024-04-19T02:16:44.152 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:44.153 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.153 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.153 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:44.153 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:44.143173+0000", 2024-04-19T02:16:44.153 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:44.153 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.153 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.153 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:44.153 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:44.143172+0000", 2024-04-19T02:16:44.153 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:44.153 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.153 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.153 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:44.153 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:44.143195+0000", 2024-04-19T02:16:44.153 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3153e-05 2024-04-19T02:16:44.154 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.154 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.154 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:44.154 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:44.143205+0000", 2024-04-19T02:16:44.154 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7170000000000003e-06 2024-04-19T02:16:44.154 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.154 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.154 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:44.154 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:44.143211+0000", 2024-04-19T02:16:44.154 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7230000000000001e-06 2024-04-19T02:16:44.154 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.154 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.154 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:44.154 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:44.143726+0000", 2024-04-19T02:16:44.155 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00051557100000000004 2024-04-19T02:16:44.155 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.155 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.155 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:44.155 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:44.143745+0000", 2024-04-19T02:16:44.155 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.8465999999999999e-05 2024-04-19T02:16:44.155 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:44.155 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:44.155 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:44.155 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.155 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.155 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:112313 5.d e39/16 5:b816a8dd:::benchmark_data_smithi121_44835_object112312:head v 39'7012, mlcod=39'7010)", 2024-04-19T02:16:44.155 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:44.144571+0000", 2024-04-19T02:16:44.155 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.00024555900000000001, 2024-04-19T02:16:44.155 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00046044599999999999, 2024-04-19T02:16:44.156 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:44.156 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:16:44.156 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:44.156 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.156 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:44.156 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:44.144571+0000", 2024-04-19T02:16:44.156 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:44.156 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.156 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.156 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:44.156 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:44.144571+0000", 2024-04-19T02:16:44.156 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:44.156 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.156 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.156 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:44.157 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:44.144571+0000", 2024-04-19T02:16:44.157 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:44.157 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.157 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.157 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:44.157 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:44.144640+0000", 2024-04-19T02:16:44.157 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.9416000000000001e-05 2024-04-19T02:16:44.157 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.157 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.157 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:44.157 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:44.144648+0000", 2024-04-19T02:16:44.157 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.1950000000000003e-06 2024-04-19T02:16:44.157 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.157 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.158 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:44.158 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:44.144655+0000", 2024-04-19T02:16:44.158 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.516e-06 2024-04-19T02:16:44.158 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.158 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.158 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:44.158 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:44.144682+0000", 2024-04-19T02:16:44.158 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7092000000000001e-05 2024-04-19T02:16:44.158 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.158 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.158 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:44.158 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:44.144695+0000", 2024-04-19T02:16:44.158 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.3179999999999999e-05 2024-04-19T02:16:44.158 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:44.159 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:44.159 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:44.159 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:44.159 INFO:teuthology.orchestra.run.smithi174.stdout: ], 2024-04-19T02:16:44.159 INFO:teuthology.orchestra.run.smithi174.stdout: "num_ops": 4 2024-04-19T02:16:44.159 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:16:44.160 INFO:teuthology.orchestra.run.smithi121.stderr:nodeep-scrub is set 2024-04-19T02:16:44.161 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:16:44.175 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:44.175+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:44.277 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:44.276+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:44.329 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:16:44.329 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [], 2024-04-19T02:16:44.330 INFO:teuthology.orchestra.run.smithi174.stdout: "complaint_time": 30, 2024-04-19T02:16:44.330 INFO:teuthology.orchestra.run.smithi174.stdout: "num_blocked_ops": 0 2024-04-19T02:16:44.330 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:16:44.345 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:16:44.377 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:44.377+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:44.477 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:44.477+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:44.553 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:16:44.553 INFO:teuthology.orchestra.run.smithi174.stdout: "size": 20, 2024-04-19T02:16:44.554 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 600, 2024-04-19T02:16:44.554 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:16:44.554 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.554 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:10 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:44.554 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269877+0000", 2024-04-19T02:16:44.554 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 75.282039210999997, 2024-04-19T02:16:44.554 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020732751000000001, 2024-04-19T02:16:44.554 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:44.554 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:44.554 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:44.554 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.554 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:44.554 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269877+0000", 2024-04-19T02:16:44.554 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:44.555 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.555 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.555 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:44.555 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269877+0000", 2024-04-19T02:16:44.555 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:44.555 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.555 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.555 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:44.555 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269875+0000", 2024-04-19T02:16:44.555 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:44.555 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.555 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.556 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:44.556 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269891+0000", 2024-04-19T02:16:44.556 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.5494000000000001e-05 2024-04-19T02:16:44.556 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.556 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.556 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:44.556 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269903+0000", 2024-04-19T02:16:44.556 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2003e-05 2024-04-19T02:16:44.556 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.556 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.556 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:44.556 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269914+0000", 2024-04-19T02:16:44.556 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0947e-05 2024-04-19T02:16:44.556 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.556 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.557 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:44.557 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269971+0000", 2024-04-19T02:16:44.557 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7036000000000001e-05 2024-04-19T02:16:44.557 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.557 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.557 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:16:44.557 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269979+0000", 2024-04-19T02:16:44.557 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.6660000000000008e-06 2024-04-19T02:16:44.557 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.557 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.557 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:44.557 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284891+0000", 2024-04-19T02:16:44.557 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014912584 2024-04-19T02:16:44.557 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.557 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.557 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:44.558 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285213+0000", 2024-04-19T02:16:44.558 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00032172199999999998 2024-04-19T02:16:44.558 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.558 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.558 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:44.558 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285357+0000", 2024-04-19T02:16:44.558 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014367899999999999 2024-04-19T02:16:44.558 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.558 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.558 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:44.558 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288883+0000", 2024-04-19T02:16:44.558 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0035268719999999999 2024-04-19T02:16:44.558 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.559 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.559 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:44.559 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290537+0000", 2024-04-19T02:16:44.559 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016537399999999999 2024-04-19T02:16:44.559 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.559 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.559 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:44.559 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290576+0000", 2024-04-19T02:16:44.559 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9266e-05 2024-04-19T02:16:44.559 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.559 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.559 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:44.559 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290609+0000", 2024-04-19T02:16:44.559 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2818000000000003e-05 2024-04-19T02:16:44.559 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:44.559 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:44.560 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:44.560 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.560 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.560 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:11 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:44.560 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:44.560 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 75.281986290000006, 2024-04-19T02:16:44.560 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020352748, 2024-04-19T02:16:44.560 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:44.560 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:44.560 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:44.560 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.560 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:44.560 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:44.560 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:44.561 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.561 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.561 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:44.561 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:44.561 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:44.561 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.561 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.561 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:44.561 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:44.561 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:44.561 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.561 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.561 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:44.561 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269933+0000", 2024-04-19T02:16:44.561 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2169999999999996e-06 2024-04-19T02:16:44.562 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.562 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.562 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:44.562 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269940+0000", 2024-04-19T02:16:44.562 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1500000000000002e-06 2024-04-19T02:16:44.562 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.562 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.562 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:44.562 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269948+0000", 2024-04-19T02:16:44.562 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.8690000000000004e-06 2024-04-19T02:16:44.562 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.562 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.562 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:44.562 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:16:44.562 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2994999999999997e-05 2024-04-19T02:16:44.563 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.563 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.563 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:16:44.563 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269997+0000", 2024-04-19T02:16:44.563 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.9020000000000004e-06 2024-04-19T02:16:44.563 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.563 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.563 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:44.563 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.282729+0000", 2024-04-19T02:16:44.563 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.012732537 2024-04-19T02:16:44.563 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.563 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.563 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:44.563 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.282838+0000", 2024-04-19T02:16:44.563 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000108298 2024-04-19T02:16:44.564 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.564 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.564 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:44.564 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.283002+0000", 2024-04-19T02:16:44.564 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00016466300000000001 2024-04-19T02:16:44.564 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.564 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.564 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:44.564 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288708+0000", 2024-04-19T02:16:44.564 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.005705066 2024-04-19T02:16:44.564 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.564 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.564 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:44.564 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290215+0000", 2024-04-19T02:16:44.564 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0015075010000000001 2024-04-19T02:16:44.564 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.565 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.565 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:44.565 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290259+0000", 2024-04-19T02:16:44.565 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3711999999999998e-05 2024-04-19T02:16:44.565 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.565 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.565 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:44.565 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290282+0000", 2024-04-19T02:16:44.565 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3458000000000001e-05 2024-04-19T02:16:44.565 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:44.565 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:44.565 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:44.565 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.565 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.566 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:14 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:44.566 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:44.566 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 75.281952500000003, 2024-04-19T02:16:44.566 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020137202, 2024-04-19T02:16:44.566 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:44.566 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:44.566 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:44.566 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.566 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:44.566 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:44.566 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:44.566 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.566 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.566 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:44.566 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:44.567 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:44.567 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.567 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.567 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:44.567 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:44.567 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:44.567 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.567 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.567 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:44.567 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269971+0000", 2024-04-19T02:16:44.567 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.5459999999999992e-06 2024-04-19T02:16:44.567 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.567 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.568 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:44.568 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269979+0000", 2024-04-19T02:16:44.568 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9130000000000003e-06 2024-04-19T02:16:44.568 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.568 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.568 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:44.568 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269986+0000", 2024-04-19T02:16:44.568 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.3779999999999998e-06 2024-04-19T02:16:44.568 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.568 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.568 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:44.568 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270030+0000", 2024-04-19T02:16:44.568 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3982e-05 2024-04-19T02:16:44.568 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.568 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.569 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:16:44.569 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270034+0000", 2024-04-19T02:16:44.569 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1779999999999996e-06 2024-04-19T02:16:44.569 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.569 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.569 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:44.569 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.277870+0000", 2024-04-19T02:16:44.569 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0078362150000000005 2024-04-19T02:16:44.569 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.569 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.569 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:44.569 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.278216+0000", 2024-04-19T02:16:44.569 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00034634999999999999 2024-04-19T02:16:44.569 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.569 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.570 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:44.570 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.278732+0000", 2024-04-19T02:16:44.570 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00051536099999999999 2024-04-19T02:16:44.570 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.570 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.570 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:44.570 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.287694+0000", 2024-04-19T02:16:44.570 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0089621019999999996 2024-04-19T02:16:44.570 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.570 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.570 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:44.570 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290026+0000", 2024-04-19T02:16:44.570 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0023323139999999998 2024-04-19T02:16:44.570 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.570 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.571 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:44.571 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290067+0000", 2024-04-19T02:16:44.571 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1043e-05 2024-04-19T02:16:44.571 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.571 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.571 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:44.571 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290100+0000", 2024-04-19T02:16:44.571 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3278999999999998e-05 2024-04-19T02:16:44.571 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:44.571 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:44.571 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:44.571 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.571 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.571 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:44.571 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:44.572 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 75.281920708000001, 2024-04-19T02:16:44.572 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020731702000000001, 2024-04-19T02:16:44.572 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:44.572 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:44.572 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:44.572 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.572 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:44.572 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:44.572 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:44.572 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.572 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.572 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:44.572 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:44.572 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:44.572 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.572 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.573 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:44.573 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:44.573 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:44.573 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.573 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.573 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:44.573 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269998+0000", 2024-04-19T02:16:44.573 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7100000000000001e-06 2024-04-19T02:16:44.573 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.573 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.573 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:44.573 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270005+0000", 2024-04-19T02:16:44.573 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.241e-06 2024-04-19T02:16:44.573 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.573 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.573 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:44.574 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270011+0000", 2024-04-19T02:16:44.574 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6279999999999999e-06 2024-04-19T02:16:44.574 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.574 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.574 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:44.574 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270046+0000", 2024-04-19T02:16:44.574 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5173999999999999e-05 2024-04-19T02:16:44.574 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.574 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.574 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:44.574 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:44.574 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0019999999999997e-06 2024-04-19T02:16:44.574 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.575 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.575 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:44.575 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285619+0000", 2024-04-19T02:16:44.575 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015567391 2024-04-19T02:16:44.575 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.575 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.576 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:44.576 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285671+0000", 2024-04-19T02:16:44.576 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2460999999999998e-05 2024-04-19T02:16:44.576 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.576 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.576 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:44.576 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285775+0000", 2024-04-19T02:16:44.576 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000103389 2024-04-19T02:16:44.576 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.576 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.576 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:44.576 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288934+0000", 2024-04-19T02:16:44.576 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0031595859999999998 2024-04-19T02:16:44.576 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.576 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.577 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:44.577 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290650+0000", 2024-04-19T02:16:44.577 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001716242 2024-04-19T02:16:44.577 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.577 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.577 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:44.577 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290692+0000", 2024-04-19T02:16:44.577 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1910999999999999e-05 2024-04-19T02:16:44.577 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.577 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.577 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:44.577 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290727+0000", 2024-04-19T02:16:44.577 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4412000000000002e-05 2024-04-19T02:16:44.577 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:44.577 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:44.578 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:44.578 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.578 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.578 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:44.578 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270019+0000", 2024-04-19T02:16:44.578 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 75.281897112999999, 2024-04-19T02:16:44.578 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020572014999999999, 2024-04-19T02:16:44.578 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:44.578 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:44.578 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:44.578 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.578 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:44.578 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270019+0000", 2024-04-19T02:16:44.578 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:44.578 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.579 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.579 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:44.579 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270019+0000", 2024-04-19T02:16:44.579 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:44.579 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.579 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.579 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:44.579 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270018+0000", 2024-04-19T02:16:44.579 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:44.579 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.579 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.579 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:44.579 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270021+0000", 2024-04-19T02:16:44.579 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0319999999999999e-06 2024-04-19T02:16:44.579 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.580 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.580 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:44.580 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270028+0000", 2024-04-19T02:16:44.580 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6189999999999996e-06 2024-04-19T02:16:44.580 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.580 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.580 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:44.580 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270035+0000", 2024-04-19T02:16:44.580 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1690000000000003e-06 2024-04-19T02:16:44.580 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.580 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.580 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:44.580 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270078+0000", 2024-04-19T02:16:44.580 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3061e-05 2024-04-19T02:16:44.581 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.581 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.581 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:44.581 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270082+0000", 2024-04-19T02:16:44.581 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4510000000000002e-06 2024-04-19T02:16:44.581 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.581 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.581 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:44.581 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284354+0000", 2024-04-19T02:16:44.581 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014271588999999999 2024-04-19T02:16:44.581 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.581 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.581 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:44.581 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284497+0000", 2024-04-19T02:16:44.581 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014335800000000001 2024-04-19T02:16:44.581 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.582 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.582 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:44.582 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284626+0000", 2024-04-19T02:16:44.582 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000128744 2024-04-19T02:16:44.582 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.582 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.582 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:44.582 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288844+0000", 2024-04-19T02:16:44.582 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00421807 2024-04-19T02:16:44.582 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.582 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.582 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:44.582 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290508+0000", 2024-04-19T02:16:44.582 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001663774 2024-04-19T02:16:44.583 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.583 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.583 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:44.583 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290556+0000", 2024-04-19T02:16:44.583 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.7599999999999998e-05 2024-04-19T02:16:44.583 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.583 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.583 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:44.583 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290591+0000", 2024-04-19T02:16:44.583 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5034999999999999e-05 2024-04-19T02:16:44.583 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:44.583 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:44.583 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:44.583 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.583 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.584 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:44.584 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:44.584 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 75.281874250000001, 2024-04-19T02:16:44.584 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020192280999999999, 2024-04-19T02:16:44.584 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:44.584 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:44.584 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:44.584 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.584 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:44.584 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:44.584 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:44.584 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.584 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.584 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:44.584 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:44.584 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:44.585 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.585 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.585 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:44.585 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:44.585 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:44.585 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.585 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.585 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:44.585 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270045+0000", 2024-04-19T02:16:44.585 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8680000000000001e-06 2024-04-19T02:16:44.585 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.585 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.585 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:44.585 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270052+0000", 2024-04-19T02:16:44.585 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.9999999999999999e-06 2024-04-19T02:16:44.586 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.586 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.586 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:44.586 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270056+0000", 2024-04-19T02:16:44.586 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4479999999999996e-06 2024-04-19T02:16:44.586 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.586 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.586 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:44.586 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270089+0000", 2024-04-19T02:16:44.586 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3071000000000002e-05 2024-04-19T02:16:44.586 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.586 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.586 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:44.586 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270092+0000", 2024-04-19T02:16:44.586 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9780000000000001e-06 2024-04-19T02:16:44.587 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.587 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.587 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:44.587 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.280632+0000", 2024-04-19T02:16:44.587 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010539712 2024-04-19T02:16:44.587 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.587 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.587 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:44.587 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.280743+0000", 2024-04-19T02:16:44.587 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000111048 2024-04-19T02:16:44.587 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.587 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.587 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:44.587 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.281531+0000", 2024-04-19T02:16:44.587 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00078738199999999999 2024-04-19T02:16:44.588 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.588 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.588 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:44.588 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.287949+0000", 2024-04-19T02:16:44.588 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0064185730000000003 2024-04-19T02:16:44.588 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.588 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.588 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:44.588 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290184+0000", 2024-04-19T02:16:44.588 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0022350849999999999 2024-04-19T02:16:44.588 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.588 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.588 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:44.588 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290209+0000", 2024-04-19T02:16:44.588 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4907000000000001e-05 2024-04-19T02:16:44.588 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.589 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.589 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:44.589 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290234+0000", 2024-04-19T02:16:44.589 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4666999999999999e-05 2024-04-19T02:16:44.589 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:44.589 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:44.589 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:44.589 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.589 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.589 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:19 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:44.589 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:44.589 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 75.281852783999994, 2024-04-19T02:16:44.589 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020818203, 2024-04-19T02:16:44.589 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:44.589 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:44.590 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:44.590 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.590 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:44.590 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:44.590 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:44.590 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.590 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.590 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:44.590 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:44.590 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:44.590 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.590 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.590 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:44.590 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:44.590 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:44.591 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.591 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.591 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:44.591 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270065+0000", 2024-04-19T02:16:44.591 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4310000000000001e-06 2024-04-19T02:16:44.591 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.591 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.591 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:44.591 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270070+0000", 2024-04-19T02:16:44.591 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2859999999999999e-06 2024-04-19T02:16:44.591 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.591 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.591 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:44.591 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270077+0000", 2024-04-19T02:16:44.591 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5270000000000004e-06 2024-04-19T02:16:44.592 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.592 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.592 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:44.592 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270107+0000", 2024-04-19T02:16:44.592 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0205999999999998e-05 2024-04-19T02:16:44.592 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.592 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.592 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:44.592 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270111+0000", 2024-04-19T02:16:44.592 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8650000000000003e-06 2024-04-19T02:16:44.592 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.592 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.592 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:44.592 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285936+0000", 2024-04-19T02:16:44.593 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015824677999999998 2024-04-19T02:16:44.593 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.593 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.593 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:44.593 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286007+0000", 2024-04-19T02:16:44.593 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1157999999999999e-05 2024-04-19T02:16:44.593 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.593 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.593 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:44.593 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286086+0000", 2024-04-19T02:16:44.593 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9084000000000004e-05 2024-04-19T02:16:44.593 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.593 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.593 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:44.593 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290740+0000", 2024-04-19T02:16:44.594 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0046543679999999999 2024-04-19T02:16:44.594 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.594 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.594 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:44.594 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290833+0000", 2024-04-19T02:16:44.594 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2551000000000002e-05 2024-04-19T02:16:44.594 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.594 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.594 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:44.594 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290859+0000", 2024-04-19T02:16:44.594 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.6696999999999999e-05 2024-04-19T02:16:44.594 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.594 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.594 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:44.595 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290881+0000", 2024-04-19T02:16:44.595 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1653000000000001e-05 2024-04-19T02:16:44.595 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:44.595 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:44.595 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:44.595 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.595 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.595 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:77622 5.8 5:166fbe77:::benchmark_data_smithi121_44835_object77621:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:44.595 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:16:44.595 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 17.746355847, 2024-04-19T02:16:44.595 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.021784694, 2024-04-19T02:16:44.595 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:44.595 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:44.595 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:44.595 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:44.595 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:44.596 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 77622 2024-04-19T02:16:44.596 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.596 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:44.596 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.596 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:44.596 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:16:44.596 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:44.596 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.596 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.596 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:44.596 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:16:44.596 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:44.596 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.596 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.596 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:44.597 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805559+0000", 2024-04-19T02:16:44.597 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:44.597 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.597 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.597 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:44.597 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805659+0000", 2024-04-19T02:16:44.597 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.9908000000000006e-05 2024-04-19T02:16:44.597 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.597 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.597 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:44.597 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805668+0000", 2024-04-19T02:16:44.597 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2129999999999997e-06 2024-04-19T02:16:44.597 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.597 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.597 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:44.598 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805673+0000", 2024-04-19T02:16:44.598 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0370000000000002e-06 2024-04-19T02:16:44.598 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.598 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.598 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:44.598 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812022+0000", 2024-04-19T02:16:44.598 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0063483239999999998 2024-04-19T02:16:44.598 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.598 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.598 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:44.598 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812129+0000", 2024-04-19T02:16:44.598 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010744200000000001 2024-04-19T02:16:44.598 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.598 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.598 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:44.599 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812252+0000", 2024-04-19T02:16:44.599 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000122519 2024-04-19T02:16:44.599 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.599 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.599 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:44.599 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.820979+0000", 2024-04-19T02:16:44.599 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0087272740000000001 2024-04-19T02:16:44.599 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.599 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.599 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:44.599 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827270+0000", 2024-04-19T02:16:44.599 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0062906239999999999 2024-04-19T02:16:44.599 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.599 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.599 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:44.600 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827309+0000", 2024-04-19T02:16:44.600 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9678999999999997e-05 2024-04-19T02:16:44.600 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.600 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.600 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:44.600 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827345+0000", 2024-04-19T02:16:44.600 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5308000000000001e-05 2024-04-19T02:16:44.600 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:44.600 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:44.600 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:44.600 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.600 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.600 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:77623 5.8 5:1ac4372b:::benchmark_data_smithi121_44835_object77622:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:44.600 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:26.807355+0000", 2024-04-19T02:16:44.600 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 17.744561204, 2024-04-19T02:16:44.600 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020092922999999999, 2024-04-19T02:16:44.601 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:44.601 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:44.601 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:44.601 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:44.601 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:44.601 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 77623 2024-04-19T02:16:44.601 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.601 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:44.601 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.601 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:44.601 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.807355+0000", 2024-04-19T02:16:44.601 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:44.601 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.601 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.601 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:44.602 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.807355+0000", 2024-04-19T02:16:44.602 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:44.602 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.602 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.602 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:44.602 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.807353+0000", 2024-04-19T02:16:44.602 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:44.602 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.602 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.602 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:44.602 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.807433+0000", 2024-04-19T02:16:44.602 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9938999999999995e-05 2024-04-19T02:16:44.602 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.602 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.602 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:44.603 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.807443+0000", 2024-04-19T02:16:44.603 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0193e-05 2024-04-19T02:16:44.603 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.603 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.603 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:44.603 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.807451+0000", 2024-04-19T02:16:44.603 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.204e-06 2024-04-19T02:16:44.603 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.603 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.603 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:44.603 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.814228+0000", 2024-04-19T02:16:44.603 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0067777740000000003 2024-04-19T02:16:44.603 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.603 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.604 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:44.604 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.814355+0000", 2024-04-19T02:16:44.604 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012678400000000001 2024-04-19T02:16:44.604 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.604 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.604 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:44.604 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.814439+0000", 2024-04-19T02:16:44.604 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.3752999999999996e-05 2024-04-19T02:16:44.604 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.604 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.604 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:44.604 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.823137+0000", 2024-04-19T02:16:44.604 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0086980159999999994 2024-04-19T02:16:44.604 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.604 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.605 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:44.605 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827390+0000", 2024-04-19T02:16:44.605 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0042527659999999998 2024-04-19T02:16:44.605 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.605 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.605 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:44.605 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827426+0000", 2024-04-19T02:16:44.605 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5809000000000002e-05 2024-04-19T02:16:44.605 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.605 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.605 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:44.605 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827447+0000", 2024-04-19T02:16:44.605 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1892999999999999e-05 2024-04-19T02:16:44.605 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:44.605 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:44.606 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:44.606 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.606 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.606 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78224 5.4 5:26e797d5:::benchmark_data_smithi121_44835_object78223:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:44.606 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:16:44.606 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 17.445353648000001, 2024-04-19T02:16:44.606 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.021471998999999999, 2024-04-19T02:16:44.606 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:44.606 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:44.606 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:44.606 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:44.606 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:44.607 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78224 2024-04-19T02:16:44.607 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.607 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:44.607 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.607 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:44.607 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:16:44.607 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:44.607 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.607 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.607 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:44.607 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:16:44.607 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:44.607 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.607 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.607 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:44.607 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106561+0000", 2024-04-19T02:16:44.608 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:44.608 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.608 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.608 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:44.608 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106630+0000", 2024-04-19T02:16:44.608 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.8553999999999994e-05 2024-04-19T02:16:44.608 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.608 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.608 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:44.608 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106644+0000", 2024-04-19T02:16:44.608 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.4651000000000001e-05 2024-04-19T02:16:44.608 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.608 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.608 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:44.608 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106653+0000", 2024-04-19T02:16:44.609 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.6719999999999993e-06 2024-04-19T02:16:44.609 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.609 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.609 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:44.609 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106693+0000", 2024-04-19T02:16:44.609 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9978999999999998e-05 2024-04-19T02:16:44.609 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.609 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.609 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:44.609 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106840+0000", 2024-04-19T02:16:44.609 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0001473 2024-04-19T02:16:44.609 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.609 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.609 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:44.609 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106971+0000", 2024-04-19T02:16:44.610 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013051499999999999 2024-04-19T02:16:44.610 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.610 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.610 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:44.610 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.109047+0000", 2024-04-19T02:16:44.610 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.002076002 2024-04-19T02:16:44.610 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.610 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.610 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:44.610 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.127967+0000", 2024-04-19T02:16:44.610 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.018919780000000001 2024-04-19T02:16:44.610 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.610 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.610 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:44.610 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128004+0000", 2024-04-19T02:16:44.611 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7719000000000003e-05 2024-04-19T02:16:44.611 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.611 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.611 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:44.611 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128034+0000", 2024-04-19T02:16:44.611 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9651000000000001e-05 2024-04-19T02:16:44.611 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:44.611 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:44.611 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:44.611 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.611 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.611 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78259 5.4 5:2aa344b2:::benchmark_data_smithi121_44835_object78258:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:44.611 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:16:44.611 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 17.426658579000001, 2024-04-19T02:16:44.611 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022934350999999999, 2024-04-19T02:16:44.612 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:44.612 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:44.612 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:44.612 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:44.612 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:44.612 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78259 2024-04-19T02:16:44.612 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.612 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:44.612 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.612 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:44.612 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:16:44.612 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:44.612 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.612 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.612 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:44.612 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:16:44.613 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:44.613 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.613 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.613 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:44.613 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125256+0000", 2024-04-19T02:16:44.613 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:44.613 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.613 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.613 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:44.613 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125347+0000", 2024-04-19T02:16:44.613 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0470000000000006e-05 2024-04-19T02:16:44.613 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.613 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.613 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:44.613 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125358+0000", 2024-04-19T02:16:44.614 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1764e-05 2024-04-19T02:16:44.614 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.614 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.614 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:44.614 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125364+0000", 2024-04-19T02:16:44.614 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7189999999999998e-06 2024-04-19T02:16:44.614 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.614 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.614 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:44.614 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125391+0000", 2024-04-19T02:16:44.614 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7270000000000001e-05 2024-04-19T02:16:44.614 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.614 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.614 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:44.614 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125471+0000", 2024-04-19T02:16:44.615 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9209999999999995e-05 2024-04-19T02:16:44.615 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.615 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.615 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:44.615 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125559+0000", 2024-04-19T02:16:44.615 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.8689000000000004e-05 2024-04-19T02:16:44.615 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.615 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.615 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:44.615 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128164+0000", 2024-04-19T02:16:44.615 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0026050270000000002 2024-04-19T02:16:44.615 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.615 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.615 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:44.615 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148139+0000", 2024-04-19T02:16:44.616 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.019975050000000001 2024-04-19T02:16:44.616 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.616 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.616 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:44.616 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148169+0000", 2024-04-19T02:16:44.616 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0001e-05 2024-04-19T02:16:44.616 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.616 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.616 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:44.616 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148191+0000", 2024-04-19T02:16:44.616 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.2104999999999999e-05 2024-04-19T02:16:44.616 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:44.616 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:44.616 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:44.616 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.616 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.617 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78271 5.4 5:2982d7a6:::benchmark_data_smithi121_44835_object78270:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:44.617 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:16:44.617 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 17.419795349000001, 2024-04-19T02:16:44.617 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020841755999999999, 2024-04-19T02:16:44.617 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:44.617 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:44.617 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:44.617 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:44.617 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:44.617 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78271 2024-04-19T02:16:44.617 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.617 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:44.617 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.617 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:44.618 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:16:44.618 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:44.618 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.618 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.618 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:44.618 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:16:44.618 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:44.618 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.618 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.618 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:44.618 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132119+0000", 2024-04-19T02:16:44.618 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:44.618 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.618 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.619 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:44.619 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132185+0000", 2024-04-19T02:16:44.619 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5994000000000005e-05 2024-04-19T02:16:44.619 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.619 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.619 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:44.619 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132197+0000", 2024-04-19T02:16:44.619 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2091e-05 2024-04-19T02:16:44.619 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.619 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.619 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:44.619 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132206+0000", 2024-04-19T02:16:44.619 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.5099999999999998e-06 2024-04-19T02:16:44.619 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.619 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.620 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:44.620 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132242+0000", 2024-04-19T02:16:44.620 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5663000000000001e-05 2024-04-19T02:16:44.620 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.620 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.620 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:44.620 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132335+0000", 2024-04-19T02:16:44.620 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3275000000000004e-05 2024-04-19T02:16:44.620 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.620 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.620 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:44.620 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132432+0000", 2024-04-19T02:16:44.620 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7571000000000005e-05 2024-04-19T02:16:44.620 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.620 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.620 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:44.621 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.136706+0000", 2024-04-19T02:16:44.621 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0042738170000000001 2024-04-19T02:16:44.621 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.621 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.621 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:44.621 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152909+0000", 2024-04-19T02:16:44.621 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016202415000000001 2024-04-19T02:16:44.621 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.621 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.621 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:44.621 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152938+0000", 2024-04-19T02:16:44.621 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9740999999999999e-05 2024-04-19T02:16:44.621 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.621 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.621 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:44.622 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152962+0000", 2024-04-19T02:16:44.622 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3659000000000002e-05 2024-04-19T02:16:44.622 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:44.622 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:44.622 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:44.622 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.622 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.622 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78272 5.4 5:273e819a:::benchmark_data_smithi121_44835_object78271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:44.622 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:16:44.622 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 17.419306305999999, 2024-04-19T02:16:44.622 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022180163999999999, 2024-04-19T02:16:44.622 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:44.622 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:44.622 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:44.623 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:44.623 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:44.623 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78272 2024-04-19T02:16:44.623 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.623 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:44.623 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.623 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:44.623 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:16:44.623 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:44.623 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.623 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.623 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:44.623 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:16:44.623 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:44.623 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.624 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.624 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:44.624 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:16:44.624 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:44.624 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.624 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.624 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:44.624 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132690+0000", 2024-04-19T02:16:44.624 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0963000000000004e-05 2024-04-19T02:16:44.624 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.624 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.624 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:44.624 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132703+0000", 2024-04-19T02:16:44.624 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.3072e-05 2024-04-19T02:16:44.624 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.625 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.625 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:44.625 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132710+0000", 2024-04-19T02:16:44.625 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3100000000000003e-06 2024-04-19T02:16:44.625 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.625 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.625 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:44.625 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134005+0000", 2024-04-19T02:16:44.625 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001294513 2024-04-19T02:16:44.625 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.625 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.625 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:44.625 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134139+0000", 2024-04-19T02:16:44.625 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000134447 2024-04-19T02:16:44.625 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.626 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.626 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:44.626 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134284+0000", 2024-04-19T02:16:44.626 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014514399999999999 2024-04-19T02:16:44.626 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.626 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.626 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:44.626 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.139622+0000", 2024-04-19T02:16:44.626 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0053373830000000002 2024-04-19T02:16:44.626 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.626 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.626 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:44.626 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154737+0000", 2024-04-19T02:16:44.626 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015115195999999999 2024-04-19T02:16:44.626 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.627 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.627 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:44.627 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154768+0000", 2024-04-19T02:16:44.627 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0824999999999997e-05 2024-04-19T02:16:44.627 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.627 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.627 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:44.627 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154790+0000", 2024-04-19T02:16:44.627 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1999000000000001e-05 2024-04-19T02:16:44.627 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:44.627 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:44.627 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:44.627 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.627 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.627 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78865 5.4 5:2abefe97:::benchmark_data_smithi121_44835_object78864:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:44.628 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.427133+0000", 2024-04-19T02:16:44.628 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 17.124782844999999, 2024-04-19T02:16:44.628 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020107725999999999, 2024-04-19T02:16:44.628 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:44.628 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:44.628 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:44.628 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:44.628 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:44.628 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78865 2024-04-19T02:16:44.628 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.628 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:44.628 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.628 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:44.628 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.427133+0000", 2024-04-19T02:16:44.628 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:44.629 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.629 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.629 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:44.629 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.427133+0000", 2024-04-19T02:16:44.629 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:44.629 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.629 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.629 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:44.629 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.427132+0000", 2024-04-19T02:16:44.629 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:44.629 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.629 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.629 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:44.629 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.427196+0000", 2024-04-19T02:16:44.629 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.3866000000000001e-05 2024-04-19T02:16:44.630 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.630 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.630 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:44.630 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.427205+0000", 2024-04-19T02:16:44.630 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.6810000000000004e-06 2024-04-19T02:16:44.630 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.630 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.630 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:44.630 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.427210+0000", 2024-04-19T02:16:44.630 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.6110000000000001e-06 2024-04-19T02:16:44.630 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.630 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.630 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:44.630 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.431822+0000", 2024-04-19T02:16:44.631 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0046120110000000001 2024-04-19T02:16:44.631 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.631 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.631 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:44.631 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.431952+0000", 2024-04-19T02:16:44.631 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000129474 2024-04-19T02:16:44.631 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.631 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.631 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:44.631 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.432087+0000", 2024-04-19T02:16:44.631 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013454 2024-04-19T02:16:44.631 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.631 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.631 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:44.631 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.439095+0000", 2024-04-19T02:16:44.631 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0070082160000000003 2024-04-19T02:16:44.632 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.632 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.632 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:44.632 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.447183+0000", 2024-04-19T02:16:44.632 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0080887690000000009 2024-04-19T02:16:44.632 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.632 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.632 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:44.632 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.447214+0000", 2024-04-19T02:16:44.632 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0131999999999999e-05 2024-04-19T02:16:44.632 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.632 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.632 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:44.632 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.447241+0000", 2024-04-19T02:16:44.632 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.6974999999999998e-05 2024-04-19T02:16:44.633 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:44.633 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:44.633 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:44.633 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.633 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.633 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:94475 5.e 5:7a360208:::benchmark_data_smithi121_44835_object94474:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:44.633 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:35.118023+0000", 2024-04-19T02:16:44.633 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 9.4338923660000003, 2024-04-19T02:16:44.633 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020591993999999999, 2024-04-19T02:16:44.633 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:44.633 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:44.633 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:44.633 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:44.633 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:44.633 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 94475 2024-04-19T02:16:44.633 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.634 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:44.634 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.634 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:44.634 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118023+0000", 2024-04-19T02:16:44.634 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:44.634 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.634 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.634 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:44.634 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118023+0000", 2024-04-19T02:16:44.634 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:44.634 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.634 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.634 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:44.634 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118023+0000", 2024-04-19T02:16:44.634 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:44.635 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.635 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.635 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:44.635 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118041+0000", 2024-04-19T02:16:44.635 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.8689999999999999e-05 2024-04-19T02:16:44.635 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.635 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.635 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:44.635 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118049+0000", 2024-04-19T02:16:44.635 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.5939999999999996e-06 2024-04-19T02:16:44.635 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.635 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.635 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:44.635 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118053+0000", 2024-04-19T02:16:44.635 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2080000000000002e-06 2024-04-19T02:16:44.636 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.636 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.636 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:44.636 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118093+0000", 2024-04-19T02:16:44.636 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9634e-05 2024-04-19T02:16:44.636 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.636 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.636 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:44.636 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118191+0000", 2024-04-19T02:16:44.636 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.8272999999999999e-05 2024-04-19T02:16:44.636 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.636 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.636 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:44.636 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118280+0000", 2024-04-19T02:16:44.636 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.8702999999999994e-05 2024-04-19T02:16:44.637 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.637 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.637 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:44.637 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.124833+0000", 2024-04-19T02:16:44.637 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0065528180000000002 2024-04-19T02:16:44.637 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.637 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.637 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:44.637 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.138520+0000", 2024-04-19T02:16:44.637 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.013686959 2024-04-19T02:16:44.637 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.637 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.637 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:44.637 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.138577+0000", 2024-04-19T02:16:44.637 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7689000000000003e-05 2024-04-19T02:16:44.638 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.638 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.638 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:44.638 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.138615+0000", 2024-04-19T02:16:44.638 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8016999999999999e-05 2024-04-19T02:16:44.638 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:44.638 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:44.638 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:44.638 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.638 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.638 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:94481 5.e 5:7b2fbebf:::benchmark_data_smithi121_44835_object94480:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:44.638 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:16:44.638 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 9.4306699890000001, 2024-04-19T02:16:44.638 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020897846000000001, 2024-04-19T02:16:44.639 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:44.639 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:44.639 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:44.639 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:44.639 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:44.639 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 94481 2024-04-19T02:16:44.639 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.639 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:44.639 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.639 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:44.639 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:16:44.639 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:44.639 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.639 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.639 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:44.639 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:16:44.640 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:44.640 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.640 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.640 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:44.640 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121245+0000", 2024-04-19T02:16:44.640 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:44.640 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.640 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.640 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:44.640 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121273+0000", 2024-04-19T02:16:44.640 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7250000000000002e-05 2024-04-19T02:16:44.640 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.640 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.640 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:44.640 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121277+0000", 2024-04-19T02:16:44.641 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2860000000000001e-06 2024-04-19T02:16:44.641 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.641 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.641 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:44.641 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121280+0000", 2024-04-19T02:16:44.641 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2739999999999999e-06 2024-04-19T02:16:44.641 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.641 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.641 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:44.641 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121320+0000", 2024-04-19T02:16:44.641 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9879000000000002e-05 2024-04-19T02:16:44.641 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.641 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.641 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:44.641 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121448+0000", 2024-04-19T02:16:44.641 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012748800000000001 2024-04-19T02:16:44.642 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.642 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.642 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:44.642 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121595+0000", 2024-04-19T02:16:44.642 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014741299999999999 2024-04-19T02:16:44.642 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.642 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.642 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:44.642 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.127776+0000", 2024-04-19T02:16:44.642 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0061811360000000003 2024-04-19T02:16:44.642 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.642 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.642 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:44.642 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142073+0000", 2024-04-19T02:16:44.642 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014296959999999999 2024-04-19T02:16:44.643 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.643 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.643 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:44.643 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142106+0000", 2024-04-19T02:16:44.643 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3348e-05 2024-04-19T02:16:44.643 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.643 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.643 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:44.643 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142144+0000", 2024-04-19T02:16:44.643 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7153000000000002e-05 2024-04-19T02:16:44.643 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:44.643 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:44.643 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:44.643 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.643 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.644 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:94581 5.b 5:dc86d6e9:::benchmark_data_smithi121_44835_object94580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:44.644 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:16:44.644 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 9.3717354159999999, 2024-04-19T02:16:44.644 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022099711000000001, 2024-04-19T02:16:44.644 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:44.644 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:44.644 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:44.644 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:44.644 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:44.644 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 94581 2024-04-19T02:16:44.644 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.644 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:44.644 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.644 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:44.644 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:16:44.645 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:44.645 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.645 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.645 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:44.645 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:16:44.645 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:44.645 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.645 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.645 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:44.645 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:16:44.645 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:44.645 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.645 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.645 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:44.645 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180253+0000", 2024-04-19T02:16:44.646 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3163000000000004e-05 2024-04-19T02:16:44.646 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.646 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.646 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:44.646 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180266+0000", 2024-04-19T02:16:44.646 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2886e-05 2024-04-19T02:16:44.646 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.646 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.646 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:44.646 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180273+0000", 2024-04-19T02:16:44.646 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.4059999999999999e-06 2024-04-19T02:16:44.646 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.646 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.646 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:44.646 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180646+0000", 2024-04-19T02:16:44.647 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00037283999999999999 2024-04-19T02:16:44.647 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.647 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.647 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:44.647 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180774+0000", 2024-04-19T02:16:44.647 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012793799999999999 2024-04-19T02:16:44.647 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.647 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.647 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:44.647 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180920+0000", 2024-04-19T02:16:44.647 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000146692 2024-04-19T02:16:44.647 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.647 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.647 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:44.647 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.183344+0000", 2024-04-19T02:16:44.648 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0024231669999999999 2024-04-19T02:16:44.648 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.648 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.648 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:44.648 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202196+0000", 2024-04-19T02:16:44.648 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.018852384 2024-04-19T02:16:44.648 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.648 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.648 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:44.648 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202241+0000", 2024-04-19T02:16:44.648 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4923999999999999e-05 2024-04-19T02:16:44.648 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.648 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.648 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:44.648 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202280+0000", 2024-04-19T02:16:44.649 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9096e-05 2024-04-19T02:16:44.649 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:44.649 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:44.649 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:44.649 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.649 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.649 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:96356 5.0 5:0a661b39:::benchmark_data_smithi121_44835_object96355:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:44.649 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:16:44.649 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 8.4585225739999998, 2024-04-19T02:16:44.649 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020955516, 2024-04-19T02:16:44.649 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:44.649 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:44.649 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:44.649 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:44.649 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:44.650 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 96356 2024-04-19T02:16:44.650 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.650 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:44.650 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.650 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:44.650 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:16:44.650 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:44.650 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.650 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.650 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:44.650 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:16:44.650 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:44.650 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.650 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.650 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:44.651 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:16:44.651 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:44.651 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.651 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.651 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:44.651 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093455+0000", 2024-04-19T02:16:44.651 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.2205000000000005e-05 2024-04-19T02:16:44.651 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.651 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.651 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:44.651 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093464+0000", 2024-04-19T02:16:44.651 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3910000000000004e-06 2024-04-19T02:16:44.651 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.651 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.651 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:44.652 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093469+0000", 2024-04-19T02:16:44.652 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.7249999999999997e-06 2024-04-19T02:16:44.652 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.652 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.652 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:44.652 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099643+0000", 2024-04-19T02:16:44.652 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0061743359999999999 2024-04-19T02:16:44.652 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.652 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.652 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:44.652 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099774+0000", 2024-04-19T02:16:44.652 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013050599999999999 2024-04-19T02:16:44.652 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.652 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.652 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:44.652 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099917+0000", 2024-04-19T02:16:44.653 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000143187 2024-04-19T02:16:44.653 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.653 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.653 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:44.653 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.105432+0000", 2024-04-19T02:16:44.653 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.005514873 2024-04-19T02:16:44.653 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.653 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.653 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:44.653 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114264+0000", 2024-04-19T02:16:44.653 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.008831752 2024-04-19T02:16:44.653 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.653 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.653 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:44.653 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114300+0000", 2024-04-19T02:16:44.654 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6582000000000003e-05 2024-04-19T02:16:44.654 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.654 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.654 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:44.654 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114349+0000", 2024-04-19T02:16:44.654 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8579999999999999e-05 2024-04-19T02:16:44.654 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:44.654 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:44.654 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:44.654 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.654 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.654 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:96357 5.0 5:00efce8b:::benchmark_data_smithi121_44835_object96356:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:44.654 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:16:44.654 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 8.4584428959999993, 2024-04-19T02:16:44.654 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020937471999999999, 2024-04-19T02:16:44.655 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:44.655 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:44.655 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:44.655 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:44.655 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:44.655 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 96357 2024-04-19T02:16:44.655 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.655 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:44.655 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.655 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:44.655 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:16:44.655 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:44.655 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.655 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.656 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:44.656 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:16:44.656 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:44.656 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.656 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.656 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:44.656 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093472+0000", 2024-04-19T02:16:44.656 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:44.656 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.656 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.656 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:44.656 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093513+0000", 2024-04-19T02:16:44.656 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0213000000000003e-05 2024-04-19T02:16:44.656 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.656 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.656 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:44.657 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093519+0000", 2024-04-19T02:16:44.657 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.066e-06 2024-04-19T02:16:44.657 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.657 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.657 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:44.657 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093525+0000", 2024-04-19T02:16:44.657 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.8170000000000004e-06 2024-04-19T02:16:44.657 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.657 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.657 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:44.657 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103412+0000", 2024-04-19T02:16:44.657 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0098872739999999997 2024-04-19T02:16:44.657 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.657 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.657 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:44.658 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103551+0000", 2024-04-19T02:16:44.658 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000139295 2024-04-19T02:16:44.658 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.658 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.658 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:44.658 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103701+0000", 2024-04-19T02:16:44.658 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014954599999999999 2024-04-19T02:16:44.658 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.658 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.658 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:44.658 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.108849+0000", 2024-04-19T02:16:44.658 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0051487199999999999 2024-04-19T02:16:44.658 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.658 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.659 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:44.659 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114355+0000", 2024-04-19T02:16:44.659 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0055052529999999999 2024-04-19T02:16:44.659 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.659 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.659 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:44.659 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114379+0000", 2024-04-19T02:16:44.659 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4275000000000001e-05 2024-04-19T02:16:44.659 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.659 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.659 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:44.659 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114410+0000", 2024-04-19T02:16:44.659 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1356999999999998e-05 2024-04-19T02:16:44.659 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:44.660 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:44.660 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:44.660 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.660 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.660 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:104431 5.8 5:14818e19:::benchmark_data_smithi121_44835_object104430:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T02:16:44.660 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:16:44.660 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 4.3405303709999998, 2024-04-19T02:16:44.660 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022149528000000002, 2024-04-19T02:16:44.660 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:44.660 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:44.660 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:44.660 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:44.660 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:44.660 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 104431 2024-04-19T02:16:44.660 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.661 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:44.661 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.661 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:44.661 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:16:44.661 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:44.661 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.661 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.661 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:44.661 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:16:44.661 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:44.661 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.661 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.661 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:44.661 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211384+0000", 2024-04-19T02:16:44.661 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:44.662 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.662 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.662 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:44.662 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211458+0000", 2024-04-19T02:16:44.662 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3311000000000003e-05 2024-04-19T02:16:44.662 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.662 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.662 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:44.662 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211471+0000", 2024-04-19T02:16:44.662 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.3308e-05 2024-04-19T02:16:44.662 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.666 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.666 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:44.666 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211479+0000", 2024-04-19T02:16:44.666 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0909999999999993e-06 2024-04-19T02:16:44.666 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.666 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.666 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:44.666 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.221821+0000", 2024-04-19T02:16:44.666 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010341596999999999 2024-04-19T02:16:44.666 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.666 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.666 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:44.667 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.221966+0000", 2024-04-19T02:16:44.667 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000145167 2024-04-19T02:16:44.667 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.667 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.667 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:44.667 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.222077+0000", 2024-04-19T02:16:44.667 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011128000000000001 2024-04-19T02:16:44.667 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.667 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.667 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:44.667 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.228126+0000", 2024-04-19T02:16:44.667 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0060486710000000003 2024-04-19T02:16:44.667 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.667 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.667 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:44.668 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233449+0000", 2024-04-19T02:16:44.668 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0053231370000000004 2024-04-19T02:16:44.668 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.668 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.668 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:44.668 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233498+0000", 2024-04-19T02:16:44.668 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8798999999999998e-05 2024-04-19T02:16:44.668 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:44.668 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:44.668 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:44.668 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233535+0000", 2024-04-19T02:16:44.668 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7119000000000002e-05 2024-04-19T02:16:44.668 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:44.668 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:44.668 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:44.669 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:44.669 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:44.669 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:16:44.670 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:44.670+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:44.671 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:16:44.771 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:44.772+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:44.856 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-04-19T02:16:44.856 INFO:teuthology.orchestra.run.smithi177.stdout: "ops": [ 2024-04-19T02:16:44.856 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.856 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:113737 5.6 5:63aa5f69:::benchmark_data_smithi121_44835_object113736:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T02:16:44.857 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:44.854221+0000", 2024-04-19T02:16:44.857 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0027219789999999998, 2024-04-19T02:16:44.857 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.002757968, 2024-04-19T02:16:44.857 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:44.857 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:44.857 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:44.857 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:44.857 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:44.857 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 113737 2024-04-19T02:16:44.857 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.857 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:44.857 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.857 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:44.857 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.854221+0000", 2024-04-19T02:16:44.858 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:44.858 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.858 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.858 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:44.858 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.854221+0000", 2024-04-19T02:16:44.858 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:44.858 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.858 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.858 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:44.858 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.854220+0000", 2024-04-19T02:16:44.858 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:44.858 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.858 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.859 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:44.859 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.854300+0000", 2024-04-19T02:16:44.859 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.9518999999999995e-05 2024-04-19T02:16:44.859 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.859 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.859 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:44.859 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.854322+0000", 2024-04-19T02:16:44.859 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.2741000000000001e-05 2024-04-19T02:16:44.859 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.859 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.859 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:44.859 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.854330+0000", 2024-04-19T02:16:44.859 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.2139999999999999e-06 2024-04-19T02:16:44.859 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.859 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.860 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:44.860 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.854369+0000", 2024-04-19T02:16:44.860 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.9799000000000003e-05 2024-04-19T02:16:44.860 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.860 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.860 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:44.860 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.854466+0000", 2024-04-19T02:16:44.860 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.6700999999999995e-05 2024-04-19T02:16:44.860 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.860 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.860 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:44.860 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.854549+0000", 2024-04-19T02:16:44.860 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.2867999999999993e-05 2024-04-19T02:16:44.861 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.861 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.861 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:44.861 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.856942+0000", 2024-04-19T02:16:44.861 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0023927639999999999 2024-04-19T02:16:44.861 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:44.861 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:44.861 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:44.861 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.861 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.861 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:113738 5.1 5:876c6240:::benchmark_data_smithi121_44835_object113737:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T02:16:44.861 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:44.854341+0000", 2024-04-19T02:16:44.861 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.002602114, 2024-04-19T02:16:44.861 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.002743409, 2024-04-19T02:16:44.861 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:44.861 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:44.862 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:44.862 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:44.862 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:44.862 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 113738 2024-04-19T02:16:44.862 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.862 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:44.862 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.862 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:44.862 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.854341+0000", 2024-04-19T02:16:44.862 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:44.862 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.862 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.862 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:44.863 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.854341+0000", 2024-04-19T02:16:44.863 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:44.863 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.863 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.863 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:44.863 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.854340+0000", 2024-04-19T02:16:44.863 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:44.863 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.863 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.863 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:44.863 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.854383+0000", 2024-04-19T02:16:44.863 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.2789e-05 2024-04-19T02:16:44.863 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.863 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.863 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:44.864 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.854391+0000", 2024-04-19T02:16:44.864 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.8429999999999993e-06 2024-04-19T02:16:44.864 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.864 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.864 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:44.864 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.854397+0000", 2024-04-19T02:16:44.864 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.9370000000000001e-06 2024-04-19T02:16:44.864 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.864 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.864 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:44.864 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.854437+0000", 2024-04-19T02:16:44.864 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.0343999999999999e-05 2024-04-19T02:16:44.864 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.864 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.864 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:44.865 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.854565+0000", 2024-04-19T02:16:44.865 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012829200000000001 2024-04-19T02:16:44.865 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.865 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.865 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:44.865 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.854713+0000", 2024-04-19T02:16:44.865 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00014751200000000001 2024-04-19T02:16:44.865 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:44.865 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:44.865 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:44.865 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.865 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.865 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:113740 5.1 5:8348ed05:::benchmark_data_smithi121_44835_object113739:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T02:16:44.865 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:44.854403+0000", 2024-04-19T02:16:44.865 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0025395410000000002, 2024-04-19T02:16:44.865 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.002733283, 2024-04-19T02:16:44.866 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:44.866 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:44.866 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:44.866 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:44.866 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:44.866 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 113740 2024-04-19T02:16:44.866 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.866 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:44.866 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.866 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:44.866 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.854403+0000", 2024-04-19T02:16:44.866 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:44.866 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.866 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.867 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:44.867 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.854403+0000", 2024-04-19T02:16:44.867 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:44.867 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.867 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.867 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:44.867 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.854403+0000", 2024-04-19T02:16:44.867 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:44.867 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.867 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.867 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:44.867 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.854439+0000", 2024-04-19T02:16:44.867 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6331000000000002e-05 2024-04-19T02:16:44.867 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.867 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.868 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:44.868 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.854447+0000", 2024-04-19T02:16:44.868 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.9929999999999995e-06 2024-04-19T02:16:44.868 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.868 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.868 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:44.868 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.854453+0000", 2024-04-19T02:16:44.868 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.9200000000000001e-06 2024-04-19T02:16:44.868 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.868 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.868 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:44.868 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.856649+0000", 2024-04-19T02:16:44.868 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0021959330000000002 2024-04-19T02:16:44.868 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.869 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.869 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:44.869 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.856752+0000", 2024-04-19T02:16:44.869 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000102927 2024-04-19T02:16:44.869 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.869 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.869 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:44.869 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.856879+0000", 2024-04-19T02:16:44.869 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000127632 2024-04-19T02:16:44.869 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:44.869 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:44.869 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:44.869 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.869 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.870 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:113741 5.1 5.e719cff1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T02:16:44.870 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:44.854459+0000", 2024-04-19T02:16:44.870 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0024838960000000002, 2024-04-19T02:16:44.870 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0027215920000000001, 2024-04-19T02:16:44.870 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:44.870 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "queued for pg", 2024-04-19T02:16:44.870 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:44.870 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:44.870 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:44.870 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 113741 2024-04-19T02:16:44.870 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.870 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:44.870 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.870 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:44.870 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.854459+0000", 2024-04-19T02:16:44.871 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:44.871 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.871 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.871 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:44.871 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.854459+0000", 2024-04-19T02:16:44.871 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:44.871 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.871 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.871 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:44.871 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.854458+0000", 2024-04-19T02:16:44.871 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:44.871 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.871 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.871 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:44.871 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.854533+0000", 2024-04-19T02:16:44.872 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.5106999999999998e-05 2024-04-19T02:16:44.872 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.872 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.872 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:44.872 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.854541+0000", 2024-04-19T02:16:44.872 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.8839999999999994e-06 2024-04-19T02:16:44.872 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.872 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.872 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:44.872 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.854557+0000", 2024-04-19T02:16:44.872 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.6036999999999999e-05 2024-04-19T02:16:44.872 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:44.872 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:44.872 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:44.872 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.872 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.873 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:113742 5.c 5:37ad6937:::benchmark_data_smithi121_44835_object113741:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T02:16:44.873 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:44.854567+0000", 2024-04-19T02:16:44.873 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.002375659, 2024-04-19T02:16:44.873 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0026666110000000002, 2024-04-19T02:16:44.873 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:44.873 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:44.873 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:44.873 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:44.873 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:44.874 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 113742 2024-04-19T02:16:44.874 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.874 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:44.874 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.874 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:44.874 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.854567+0000", 2024-04-19T02:16:44.874 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:44.874 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.874 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.874 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:44.874 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.854567+0000", 2024-04-19T02:16:44.874 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:44.875 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.875 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.875 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:44.875 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.854567+0000", 2024-04-19T02:16:44.875 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:44.875 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.875 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.875 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:44.875 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.854643+0000", 2024-04-19T02:16:44.875 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.6196e-05 2024-04-19T02:16:44.875 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.875 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.875 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:44.875 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.854651+0000", 2024-04-19T02:16:44.875 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.5159999999999994e-06 2024-04-19T02:16:44.876 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.876 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.876 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:44.876 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.854657+0000", 2024-04-19T02:16:44.876 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.0769999999999996e-06 2024-04-19T02:16:44.876 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.876 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.876 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:44.876 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.854703+0000", 2024-04-19T02:16:44.876 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.5330000000000001e-05 2024-04-19T02:16:44.876 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.876 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.876 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:44.876 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.854820+0000", 2024-04-19T02:16:44.876 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000116846 2024-04-19T02:16:44.876 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.877 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.877 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:44.877 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.855087+0000", 2024-04-19T02:16:44.877 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000267586 2024-04-19T02:16:44.877 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:44.877 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:44.877 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:44.877 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.877 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.877 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:113739 5.e e40/16 5:712e8c0a:::benchmark_data_smithi121_44835_object113738:head v 40'6990, mlcod=40'6988)", 2024-04-19T02:16:44.877 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:44.854948+0000", 2024-04-19T02:16:44.877 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0019952759999999998, 2024-04-19T02:16:44.877 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.002360329, 2024-04-19T02:16:44.877 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:44.877 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:44.878 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:44.878 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.878 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:44.878 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.854948+0000", 2024-04-19T02:16:44.878 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:44.878 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.878 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.878 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:44.878 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.854948+0000", 2024-04-19T02:16:44.878 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:44.878 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.878 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.878 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:44.878 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.854947+0000", 2024-04-19T02:16:44.878 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:44.879 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.879 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.879 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:44.879 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.856845+0000", 2024-04-19T02:16:44.879 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0018976189999999999 2024-04-19T02:16:44.879 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.879 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.879 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:44.879 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.856856+0000", 2024-04-19T02:16:44.879 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.1367e-05 2024-04-19T02:16:44.879 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.879 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.879 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:44.879 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.856863+0000", 2024-04-19T02:16:44.879 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.0990000000000001e-06 2024-04-19T02:16:44.880 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.880 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.880 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:44.880 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.856893+0000", 2024-04-19T02:16:44.880 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.0049e-05 2024-04-19T02:16:44.880 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.880 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.880 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:44.880 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.856915+0000", 2024-04-19T02:16:44.880 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.1633000000000001e-05 2024-04-19T02:16:44.880 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:44.880 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:44.880 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:44.880 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.880 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.880 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:113730 5.3 5:cbe34f42:::benchmark_data_smithi121_44835_object113729:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T02:16:44.881 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:44.848912+0000", 2024-04-19T02:16:44.881 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0080309300000000004, 2024-04-19T02:16:44.881 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0084329049999999992, 2024-04-19T02:16:44.881 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:44.881 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:44.881 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:44.881 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:44.881 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:44.881 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 113730 2024-04-19T02:16:44.881 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.881 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:44.881 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.881 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:44.881 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.848912+0000", 2024-04-19T02:16:44.881 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:44.882 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.882 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.882 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:44.882 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.848912+0000", 2024-04-19T02:16:44.882 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:44.882 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.882 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.882 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:44.882 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.848911+0000", 2024-04-19T02:16:44.882 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:44.882 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.882 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.882 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:44.882 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.848980+0000", 2024-04-19T02:16:44.883 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.9388999999999996e-05 2024-04-19T02:16:44.883 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.883 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.883 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:44.883 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.848990+0000", 2024-04-19T02:16:44.883 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.6679999999999996e-06 2024-04-19T02:16:44.883 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.883 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.883 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:44.883 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.848995+0000", 2024-04-19T02:16:44.883 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.4090000000000002e-06 2024-04-19T02:16:44.883 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.883 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.883 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:44.884 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.852213+0000", 2024-04-19T02:16:44.884 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0032174030000000002 2024-04-19T02:16:44.884 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.884 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.884 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:44.884 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.852355+0000", 2024-04-19T02:16:44.884 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000142788 2024-04-19T02:16:44.884 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.884 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.884 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:44.884 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.852539+0000", 2024-04-19T02:16:44.884 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00018360699999999999 2024-04-19T02:16:44.884 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.884 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.884 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:44.885 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.856890+0000", 2024-04-19T02:16:44.885 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.004350909 2024-04-19T02:16:44.885 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:44.885 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:44.885 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:44.885 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.885 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.885 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:113735 5.3 5:c7e39c48:::benchmark_data_smithi121_44835_object113734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T02:16:44.885 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:44.852672+0000", 2024-04-19T02:16:44.885 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0042705069999999998, 2024-04-19T02:16:44.885 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0047251970000000004, 2024-04-19T02:16:44.885 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:44.885 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:44.885 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:44.885 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:44.885 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:44.886 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 113735 2024-04-19T02:16:44.886 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.886 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:44.886 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.886 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:44.886 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.852672+0000", 2024-04-19T02:16:44.886 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:44.886 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.886 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.886 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:44.886 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.852672+0000", 2024-04-19T02:16:44.886 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:44.886 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.886 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.886 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:44.887 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.852671+0000", 2024-04-19T02:16:44.887 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:44.887 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.887 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.887 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:44.887 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.852743+0000", 2024-04-19T02:16:44.887 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.2162999999999993e-05 2024-04-19T02:16:44.887 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.887 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.887 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:44.887 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.852753+0000", 2024-04-19T02:16:44.887 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.3360000000000001e-06 2024-04-19T02:16:44.887 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.887 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.887 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:44.887 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.852760+0000", 2024-04-19T02:16:44.888 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.6820000000000003e-06 2024-04-19T02:16:44.888 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.888 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.888 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:44.888 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.854147+0000", 2024-04-19T02:16:44.888 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.001386736 2024-04-19T02:16:44.888 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.888 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.888 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:44.888 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.854283+0000", 2024-04-19T02:16:44.888 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00013556399999999999 2024-04-19T02:16:44.888 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:44.888 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:44.888 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:44.888 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.854443+0000", 2024-04-19T02:16:44.889 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000160676 2024-04-19T02:16:44.889 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:44.889 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:44.889 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:44.889 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:44.889 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2024-04-19T02:16:44.889 INFO:teuthology.orchestra.run.smithi177.stdout: "num_ops": 8 2024-04-19T02:16:44.889 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-04-19T02:16:44.890 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:44.890+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:44.891 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:16:44.991 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:44.991+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:45.029 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 50 16 114102 114086 142.596 126.438 0.00732564 0.00701035 2024-04-19T02:16:45.092 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:45.093+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:45.123 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-04-19T02:16:45.124 INFO:teuthology.orchestra.run.smithi177.stdout: "ops": [], 2024-04-19T02:16:45.124 INFO:teuthology.orchestra.run.smithi177.stdout: "complaint_time": 30, 2024-04-19T02:16:45.124 INFO:teuthology.orchestra.run.smithi177.stdout: "num_blocked_ops": 0 2024-04-19T02:16:45.124 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-04-19T02:16:45.141 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:16:45.193 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:45.193+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:45.294 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:45.294+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:45.371 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-04-19T02:16:45.371 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 20, 2024-04-19T02:16:45.371 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 600, 2024-04-19T02:16:45.371 INFO:teuthology.orchestra.run.smithi177.stdout: "ops": [ 2024-04-19T02:16:45.371 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.371 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:61815 5.c 5:3ca8a794:::benchmark_data_smithi121_44835_object61814:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:45.371 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:17.482110+0000", 2024-04-19T02:16:45.371 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 27.887898926999998, 2024-04-19T02:16:45.371 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.021577559999999999, 2024-04-19T02:16:45.372 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:45.372 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:45.372 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:45.372 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:45.372 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:45.372 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 61815 2024-04-19T02:16:45.372 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.372 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:45.372 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.372 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:45.372 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482110+0000", 2024-04-19T02:16:45.372 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:45.372 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.372 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.373 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:45.373 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482110+0000", 2024-04-19T02:16:45.373 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:45.373 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.373 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.373 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:45.373 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482109+0000", 2024-04-19T02:16:45.373 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:45.373 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.373 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.373 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:45.373 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482197+0000", 2024-04-19T02:16:45.373 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.7405999999999996e-05 2024-04-19T02:16:45.374 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.374 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.374 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:45.374 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482206+0000", 2024-04-19T02:16:45.374 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.0010000000000007e-06 2024-04-19T02:16:45.374 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.374 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.374 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:45.374 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482211+0000", 2024-04-19T02:16:45.374 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.4569999999999996e-06 2024-04-19T02:16:45.374 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.374 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.374 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:45.375 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.489465+0000", 2024-04-19T02:16:45.375 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.007253776 2024-04-19T02:16:45.375 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.375 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.375 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:45.375 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.489582+0000", 2024-04-19T02:16:45.375 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00011669500000000001 2024-04-19T02:16:45.375 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.375 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.375 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:45.375 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.489684+0000", 2024-04-19T02:16:45.375 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000102533 2024-04-19T02:16:45.375 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.376 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.376 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:45.376 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.491836+0000", 2024-04-19T02:16:45.376 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0021516759999999999 2024-04-19T02:16:45.376 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.376 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.376 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:45.376 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503615+0000", 2024-04-19T02:16:45.376 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.011778906 2024-04-19T02:16:45.376 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.376 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.376 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:45.376 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503652+0000", 2024-04-19T02:16:45.376 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6622999999999998e-05 2024-04-19T02:16:45.376 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.377 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.377 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:45.377 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503688+0000", 2024-04-19T02:16:45.377 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6127000000000002e-05 2024-04-19T02:16:45.377 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:45.377 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:45.377 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:45.377 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.377 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.377 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:78247 5.c 5:3efb1468:::benchmark_data_smithi121_44835_object78246:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:45.377 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.116347+0000", 2024-04-19T02:16:45.377 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 18.253661871999999, 2024-04-19T02:16:45.377 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.032194436999999999, 2024-04-19T02:16:45.377 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:45.377 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:45.378 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:45.378 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:45.378 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:45.378 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 78247 2024-04-19T02:16:45.378 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.378 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:45.378 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.378 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:45.380 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116347+0000", 2024-04-19T02:16:45.380 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:45.380 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.380 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.380 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:45.380 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116347+0000", 2024-04-19T02:16:45.381 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:45.381 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.381 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.381 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:45.381 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116346+0000", 2024-04-19T02:16:45.381 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:45.381 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.381 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.381 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:45.382 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116370+0000", 2024-04-19T02:16:45.382 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.3892000000000001e-05 2024-04-19T02:16:45.382 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.382 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.382 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:45.382 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116385+0000", 2024-04-19T02:16:45.382 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.5162e-05 2024-04-19T02:16:45.382 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.382 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.382 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:45.382 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116394+0000", 2024-04-19T02:16:45.382 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.8000000000000004e-06 2024-04-19T02:16:45.383 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.383 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.383 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:45.383 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124856+0000", 2024-04-19T02:16:45.383 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0084622169999999993 2024-04-19T02:16:45.383 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.383 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.383 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:45.383 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124966+0000", 2024-04-19T02:16:45.383 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000109747 2024-04-19T02:16:45.383 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.384 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.384 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:45.384 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125216+0000", 2024-04-19T02:16:45.384 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000249545 2024-04-19T02:16:45.384 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.384 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.384 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:45.384 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.131713+0000", 2024-04-19T02:16:45.384 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0064972370000000003 2024-04-19T02:16:45.384 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.384 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.385 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:45.385 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148323+0000", 2024-04-19T02:16:45.385 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016609641000000001 2024-04-19T02:16:45.385 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.385 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.385 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:45.385 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148359+0000", 2024-04-19T02:16:45.385 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6412000000000003e-05 2024-04-19T02:16:45.385 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.385 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.386 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:45.386 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148542+0000", 2024-04-19T02:16:45.386 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00018265600000000001 2024-04-19T02:16:45.386 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:45.386 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:45.386 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:45.386 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.387 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.387 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:78248 5.c 5:30b7cc74:::benchmark_data_smithi121_44835_object78247:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:45.387 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.116471+0000", 2024-04-19T02:16:45.387 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 18.253538371000001, 2024-04-19T02:16:45.387 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.032127452000000001, 2024-04-19T02:16:45.387 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:45.387 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:45.387 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:45.387 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:45.387 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:45.387 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 78248 2024-04-19T02:16:45.387 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.387 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:45.387 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.387 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:45.388 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116471+0000", 2024-04-19T02:16:45.388 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:45.388 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.388 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.388 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:45.388 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116471+0000", 2024-04-19T02:16:45.388 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:45.388 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.388 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.388 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:45.388 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116470+0000", 2024-04-19T02:16:45.388 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:45.388 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.388 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.389 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:45.389 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116496+0000", 2024-04-19T02:16:45.389 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.5517e-05 2024-04-19T02:16:45.389 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.389 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.389 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:45.389 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116505+0000", 2024-04-19T02:16:45.389 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.9250000000000007e-06 2024-04-19T02:16:45.389 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.389 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.389 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:45.389 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116516+0000", 2024-04-19T02:16:45.389 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.012e-05 2024-04-19T02:16:45.389 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.390 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.390 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:45.390 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.127803+0000", 2024-04-19T02:16:45.390 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.011287523000000001 2024-04-19T02:16:45.390 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.390 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.390 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:45.391 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.127932+0000", 2024-04-19T02:16:45.391 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012848499999999999 2024-04-19T02:16:45.391 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.391 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.391 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:45.391 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128022+0000", 2024-04-19T02:16:45.391 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.0890000000000006e-05 2024-04-19T02:16:45.391 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.391 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.391 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:45.391 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.131909+0000", 2024-04-19T02:16:45.391 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0038864609999999999 2024-04-19T02:16:45.391 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.391 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.391 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:45.392 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148552+0000", 2024-04-19T02:16:45.392 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016643162999999999 2024-04-19T02:16:45.392 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.392 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.392 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:45.392 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148577+0000", 2024-04-19T02:16:45.392 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.5333999999999998e-05 2024-04-19T02:16:45.392 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.392 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.392 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:45.392 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148598+0000", 2024-04-19T02:16:45.392 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.0687999999999999e-05 2024-04-19T02:16:45.393 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:45.393 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:45.393 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:45.393 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.393 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.393 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:78258 5.a 5:549070de:::benchmark_data_smithi121_44835_object78257:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:45.393 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.124295+0000", 2024-04-19T02:16:45.393 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 18.245713824999999, 2024-04-19T02:16:45.393 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020189543000000001, 2024-04-19T02:16:45.393 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:45.393 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:45.393 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:45.393 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:45.393 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:45.393 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 78258 2024-04-19T02:16:45.394 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.394 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:45.394 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.394 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:45.394 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124295+0000", 2024-04-19T02:16:45.394 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:45.394 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.394 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.394 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:45.394 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124295+0000", 2024-04-19T02:16:45.394 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:45.394 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.394 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.394 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:45.395 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124294+0000", 2024-04-19T02:16:45.395 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:45.395 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.395 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.395 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:45.395 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124358+0000", 2024-04-19T02:16:45.395 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.4040000000000003e-05 2024-04-19T02:16:45.395 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.395 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.395 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:45.395 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124374+0000", 2024-04-19T02:16:45.395 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.5291e-05 2024-04-19T02:16:45.395 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.395 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.395 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:45.396 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124383+0000", 2024-04-19T02:16:45.396 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.8360000000000004e-06 2024-04-19T02:16:45.396 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.396 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.396 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:45.396 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124908+0000", 2024-04-19T02:16:45.396 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00052415700000000003 2024-04-19T02:16:45.396 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.396 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.396 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:45.396 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125023+0000", 2024-04-19T02:16:45.396 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00011506999999999999 2024-04-19T02:16:45.396 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.396 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.397 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:45.397 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125182+0000", 2024-04-19T02:16:45.397 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00015942500000000001 2024-04-19T02:16:45.397 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.397 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.397 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:45.397 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.129505+0000", 2024-04-19T02:16:45.397 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0043225080000000001 2024-04-19T02:16:45.397 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.397 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.397 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:45.397 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.144379+0000", 2024-04-19T02:16:45.397 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.014874263 2024-04-19T02:16:45.397 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.397 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.398 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:45.398 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.144444+0000", 2024-04-19T02:16:45.398 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.5451999999999996e-05 2024-04-19T02:16:45.398 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.398 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.398 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:45.398 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.144485+0000", 2024-04-19T02:16:45.398 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.0426999999999998e-05 2024-04-19T02:16:45.398 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:45.398 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:45.398 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:45.398 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.398 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.398 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:78259 5.4 e31/16 5:2aa344b2:::benchmark_data_smithi121_44835_object78258:head v 31'4849, mlcod=31'4843)", 2024-04-19T02:16:45.398 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.125675+0000", 2024-04-19T02:16:45.399 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 18.244333953000002, 2024-04-19T02:16:45.399 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.022419326, 2024-04-19T02:16:45.399 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:45.399 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:45.399 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:45.399 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.399 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:45.399 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125675+0000", 2024-04-19T02:16:45.400 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:45.400 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.400 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.400 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:45.400 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125675+0000", 2024-04-19T02:16:45.400 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:45.400 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.400 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.400 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:45.400 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125674+0000", 2024-04-19T02:16:45.400 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:45.400 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.400 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.401 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:45.401 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125723+0000", 2024-04-19T02:16:45.401 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.8998000000000001e-05 2024-04-19T02:16:45.401 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.401 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.401 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:45.401 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125733+0000", 2024-04-19T02:16:45.401 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.1379999999999996e-06 2024-04-19T02:16:45.401 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.401 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.401 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:45.402 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125740+0000", 2024-04-19T02:16:45.402 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.0779999999999998e-06 2024-04-19T02:16:45.402 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.402 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.402 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:45.402 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.129589+0000", 2024-04-19T02:16:45.402 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0038488910000000001 2024-04-19T02:16:45.402 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.402 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.402 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:45.402 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.129605+0000", 2024-04-19T02:16:45.402 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.6877000000000001e-05 2024-04-19T02:16:45.402 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.403 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.403 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:45.403 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148057+0000", 2024-04-19T02:16:45.403 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.018451624 2024-04-19T02:16:45.403 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.403 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.403 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:45.403 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148094+0000", 2024-04-19T02:16:45.403 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.7327999999999999e-05 2024-04-19T02:16:45.403 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:45.403 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:45.403 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:45.403 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.404 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.404 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:78263 5.1 5:8e231862:::benchmark_data_smithi121_44835_object78262:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:45.404 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.128154+0000", 2024-04-19T02:16:45.404 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 18.241854767, 2024-04-19T02:16:45.404 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020882214, 2024-04-19T02:16:45.404 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:45.404 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:45.404 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:45.404 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:45.404 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:45.404 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 78263 2024-04-19T02:16:45.404 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.404 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:45.404 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.405 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:45.405 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128154+0000", 2024-04-19T02:16:45.405 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:45.405 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.405 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.405 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:45.405 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128154+0000", 2024-04-19T02:16:45.405 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:45.405 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.405 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.405 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:45.405 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128153+0000", 2024-04-19T02:16:45.405 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:45.405 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.406 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.406 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:45.406 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128246+0000", 2024-04-19T02:16:45.406 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.302e-05 2024-04-19T02:16:45.406 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.406 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.406 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:45.406 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128263+0000", 2024-04-19T02:16:45.406 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.6753e-05 2024-04-19T02:16:45.406 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.406 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.406 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:45.406 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128271+0000", 2024-04-19T02:16:45.406 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.2290000000000003e-06 2024-04-19T02:16:45.407 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.407 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.407 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:45.407 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128459+0000", 2024-04-19T02:16:45.407 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00018772 2024-04-19T02:16:45.407 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.407 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.407 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:45.407 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128574+0000", 2024-04-19T02:16:45.407 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00011437700000000001 2024-04-19T02:16:45.407 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.407 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.407 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:45.407 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128696+0000", 2024-04-19T02:16:45.408 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000122831 2024-04-19T02:16:45.408 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.408 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.408 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:45.408 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.130816+0000", 2024-04-19T02:16:45.408 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0021196750000000001 2024-04-19T02:16:45.408 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.408 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.408 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:45.408 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.131859+0000", 2024-04-19T02:16:45.408 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0010434419999999999 2024-04-19T02:16:45.408 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.408 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.408 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:45.408 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148848+0000", 2024-04-19T02:16:45.409 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016988712 2024-04-19T02:16:45.409 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.409 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.409 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:45.409 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148905+0000", 2024-04-19T02:16:45.409 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.6722999999999999e-05 2024-04-19T02:16:45.409 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.409 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.409 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:45.409 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.149036+0000", 2024-04-19T02:16:45.409 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000131567 2024-04-19T02:16:45.409 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:45.409 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:45.409 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:45.409 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.410 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.410 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:78271 5.4 e31/16 5:2982d7a6:::benchmark_data_smithi121_44835_object78270:head v 31'4850, mlcod=31'4847)", 2024-04-19T02:16:45.410 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.132554+0000", 2024-04-19T02:16:45.410 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 18.237455232999999, 2024-04-19T02:16:45.410 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020294946000000001, 2024-04-19T02:16:45.410 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:45.410 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:45.410 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:45.410 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.410 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:45.410 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132554+0000", 2024-04-19T02:16:45.410 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:45.411 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.411 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.411 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:45.411 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132554+0000", 2024-04-19T02:16:45.411 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:45.411 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.411 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.411 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:45.411 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132553+0000", 2024-04-19T02:16:45.411 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:45.411 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.411 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.411 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:45.412 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132615+0000", 2024-04-19T02:16:45.412 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.1772000000000004e-05 2024-04-19T02:16:45.412 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.412 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.412 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:45.412 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132620+0000", 2024-04-19T02:16:45.412 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.0939999999999998e-06 2024-04-19T02:16:45.412 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.412 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.412 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:45.412 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132624+0000", 2024-04-19T02:16:45.412 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.2229999999999999e-06 2024-04-19T02:16:45.412 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.412 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.412 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:45.413 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132649+0000", 2024-04-19T02:16:45.413 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.5352000000000001e-05 2024-04-19T02:16:45.413 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.413 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.413 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:45.413 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132661+0000", 2024-04-19T02:16:45.413 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.1851999999999999e-05 2024-04-19T02:16:45.413 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.413 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.413 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:45.414 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.152820+0000", 2024-04-19T02:16:45.414 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020159369999999999 2024-04-19T02:16:45.414 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.414 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.414 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:45.414 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.152849+0000", 2024-04-19T02:16:45.414 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.868e-05 2024-04-19T02:16:45.414 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:45.414 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:45.414 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:45.414 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.414 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.414 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:87963 5.3 5:c47b3227:::benchmark_data_smithi121_44835_object87962:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T02:16:45.415 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:31.833755+0000", 2024-04-19T02:16:45.415 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 13.536254112, 2024-04-19T02:16:45.415 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.019779005999999998, 2024-04-19T02:16:45.415 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:45.415 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:45.415 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:45.415 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:45.415 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:45.415 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 87963 2024-04-19T02:16:45.415 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.415 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:45.416 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.416 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:45.416 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.833755+0000", 2024-04-19T02:16:45.416 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:45.416 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.416 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.416 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:45.416 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.833755+0000", 2024-04-19T02:16:45.416 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:45.416 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.416 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.416 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:45.416 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.833754+0000", 2024-04-19T02:16:45.416 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:45.416 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.417 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.417 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:45.417 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.833881+0000", 2024-04-19T02:16:45.417 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000126785 2024-04-19T02:16:45.417 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.417 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.417 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:45.417 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.833890+0000", 2024-04-19T02:16:45.417 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.0110000000000006e-06 2024-04-19T02:16:45.417 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.417 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.417 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:45.417 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.833897+0000", 2024-04-19T02:16:45.417 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.5309999999999998e-06 2024-04-19T02:16:45.418 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.418 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.418 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:45.418 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.842658+0000", 2024-04-19T02:16:45.418 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0087616929999999992 2024-04-19T02:16:45.418 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.418 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.418 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:45.418 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.842749+0000", 2024-04-19T02:16:45.418 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.0556999999999994e-05 2024-04-19T02:16:45.418 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.418 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.418 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:45.418 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.842832+0000", 2024-04-19T02:16:45.419 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.2696999999999998e-05 2024-04-19T02:16:45.419 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.419 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.419 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:45.419 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.844494+0000", 2024-04-19T02:16:45.419 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0016623429999999999 2024-04-19T02:16:45.419 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.419 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.420 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:45.420 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.853446+0000", 2024-04-19T02:16:45.420 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0089523499999999995 2024-04-19T02:16:45.420 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.420 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.420 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:45.420 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.853495+0000", 2024-04-19T02:16:45.420 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.8847999999999997e-05 2024-04-19T02:16:45.420 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.420 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.420 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:45.420 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.853534+0000", 2024-04-19T02:16:45.420 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.8829999999999999e-05 2024-04-19T02:16:45.420 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:45.420 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:45.421 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:45.421 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.421 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.421 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:94191 5.c 5:3155c784:::benchmark_data_smithi121_44835_object94190:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T02:16:45.421 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:34.963381+0000", 2024-04-19T02:16:45.421 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 10.406627547999999, 2024-04-19T02:16:45.421 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.021414343999999998, 2024-04-19T02:16:45.421 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:45.421 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:45.421 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:45.422 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:45.422 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:45.422 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 94191 2024-04-19T02:16:45.422 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.422 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:45.422 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.422 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:45.422 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.963381+0000", 2024-04-19T02:16:45.422 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:45.422 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.422 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.422 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:45.422 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.963381+0000", 2024-04-19T02:16:45.422 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:45.423 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.423 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.423 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:45.423 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.963381+0000", 2024-04-19T02:16:45.423 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:45.423 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.423 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.423 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:45.423 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.963457+0000", 2024-04-19T02:16:45.423 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.5827000000000004e-05 2024-04-19T02:16:45.423 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.423 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.423 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:45.423 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.963465+0000", 2024-04-19T02:16:45.424 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.2800000000000003e-06 2024-04-19T02:16:45.424 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.424 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.424 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:45.424 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.963470+0000", 2024-04-19T02:16:45.424 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.2310000000000004e-06 2024-04-19T02:16:45.424 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.424 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.424 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:45.424 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.969469+0000", 2024-04-19T02:16:45.424 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0059987169999999998 2024-04-19T02:16:45.424 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.424 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.424 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:45.424 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.969594+0000", 2024-04-19T02:16:45.425 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012517299999999999 2024-04-19T02:16:45.425 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.425 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.425 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:45.425 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.969759+0000", 2024-04-19T02:16:45.425 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00016459999999999999 2024-04-19T02:16:45.425 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.425 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.425 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:45.425 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.975130+0000", 2024-04-19T02:16:45.425 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0053717410000000002 2024-04-19T02:16:45.425 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.426 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.426 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:45.426 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.984704+0000", 2024-04-19T02:16:45.426 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.009573715 2024-04-19T02:16:45.426 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.426 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.426 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:45.426 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.984758+0000", 2024-04-19T02:16:45.426 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.4039000000000002e-05 2024-04-19T02:16:45.426 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.426 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.426 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:45.427 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.984796+0000", 2024-04-19T02:16:45.427 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.7619e-05 2024-04-19T02:16:45.427 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:45.427 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:45.427 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:45.427 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.427 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.427 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:94471 5.6 5:641302c2:::benchmark_data_smithi121_44835_object94470:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:45.427 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:35.112592+0000", 2024-04-19T02:16:45.427 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 10.257417483999999, 2024-04-19T02:16:45.427 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.023525194999999999, 2024-04-19T02:16:45.427 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:45.428 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:45.428 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:45.428 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:45.428 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:45.428 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 94471 2024-04-19T02:16:45.428 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.428 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:45.428 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.428 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:45.428 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.112592+0000", 2024-04-19T02:16:45.428 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:45.429 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.429 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.429 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:45.429 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.112592+0000", 2024-04-19T02:16:45.429 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:45.429 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.429 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.429 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:45.429 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.112591+0000", 2024-04-19T02:16:45.429 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:45.429 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.429 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.430 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:45.430 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.112621+0000", 2024-04-19T02:16:45.430 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.0701999999999998e-05 2024-04-19T02:16:45.430 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.430 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.430 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:45.430 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.112631+0000", 2024-04-19T02:16:45.430 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.3209999999999994e-06 2024-04-19T02:16:45.430 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.430 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.430 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:45.430 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.112638+0000", 2024-04-19T02:16:45.431 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.187e-06 2024-04-19T02:16:45.431 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.431 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.431 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:45.431 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.113893+0000", 2024-04-19T02:16:45.431 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0012553390000000001 2024-04-19T02:16:45.431 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.431 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.431 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:45.431 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.114012+0000", 2024-04-19T02:16:45.431 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000118638 2024-04-19T02:16:45.431 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.431 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.432 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:45.432 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.114151+0000", 2024-04-19T02:16:45.432 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00013928700000000001 2024-04-19T02:16:45.432 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.432 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.432 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:45.432 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.120607+0000", 2024-04-19T02:16:45.432 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0064559179999999997 2024-04-19T02:16:45.432 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.432 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.432 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:45.433 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136026+0000", 2024-04-19T02:16:45.433 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015418762000000001 2024-04-19T02:16:45.433 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.433 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.433 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:45.433 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136084+0000", 2024-04-19T02:16:45.433 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.8245000000000002e-05 2024-04-19T02:16:45.433 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.433 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.433 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:45.434 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136117+0000", 2024-04-19T02:16:45.434 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.2616000000000001e-05 2024-04-19T02:16:45.434 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:45.434 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:45.434 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:45.434 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.434 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.434 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:94468 5.2 e34/16 5:4f406431:::benchmark_data_smithi121_44835_object94467:head v 34'5918, mlcod=34'5914)", 2024-04-19T02:16:45.434 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:35.113059+0000", 2024-04-19T02:16:45.434 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 10.256950201, 2024-04-19T02:16:45.434 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.022987177000000001, 2024-04-19T02:16:45.434 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:45.434 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:45.435 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:45.435 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.435 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:45.435 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.113059+0000", 2024-04-19T02:16:45.435 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:45.435 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.435 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.435 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:45.435 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.113059+0000", 2024-04-19T02:16:45.435 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:45.435 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.435 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.435 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:45.435 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.113058+0000", 2024-04-19T02:16:45.436 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:45.436 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.436 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.436 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:45.436 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.113103+0000", 2024-04-19T02:16:45.436 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.4159000000000002e-05 2024-04-19T02:16:45.436 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.436 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.436 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:45.436 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.113110+0000", 2024-04-19T02:16:45.436 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.1049999999999997e-06 2024-04-19T02:16:45.436 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.436 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.436 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:45.436 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.113115+0000", 2024-04-19T02:16:45.437 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.3229999999999997e-06 2024-04-19T02:16:45.437 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.437 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.437 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:45.437 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.114338+0000", 2024-04-19T02:16:45.437 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.001223179 2024-04-19T02:16:45.437 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.437 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.437 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:45.437 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.114355+0000", 2024-04-19T02:16:45.437 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.6963999999999999e-05 2024-04-19T02:16:45.437 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.438 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.438 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:45.438 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136011+0000", 2024-04-19T02:16:45.438 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.021656102999999999 2024-04-19T02:16:45.438 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.438 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.438 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:45.438 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136046+0000", 2024-04-19T02:16:45.438 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.4802999999999999e-05 2024-04-19T02:16:45.438 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:45.438 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:45.438 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:45.438 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.438 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.439 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:94473 5.6 5:6db36ce7:::benchmark_data_smithi121_44835_object94472:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:45.439 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:35.116069+0000", 2024-04-19T02:16:45.439 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 10.253940104, 2024-04-19T02:16:45.439 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020111038000000001, 2024-04-19T02:16:45.439 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:45.439 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:45.439 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:45.439 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:45.439 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:45.439 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 94473 2024-04-19T02:16:45.439 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.439 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:45.439 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.439 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:45.439 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116069+0000", 2024-04-19T02:16:45.440 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:45.440 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.440 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.440 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:45.440 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116069+0000", 2024-04-19T02:16:45.440 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:45.440 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.440 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.440 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:45.440 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116067+0000", 2024-04-19T02:16:45.440 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:45.440 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.440 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.440 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:45.440 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116096+0000", 2024-04-19T02:16:45.441 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.9034e-05 2024-04-19T02:16:45.441 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.441 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.441 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:45.441 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116107+0000", 2024-04-19T02:16:45.441 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0543000000000001e-05 2024-04-19T02:16:45.441 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.441 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.441 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:45.441 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116115+0000", 2024-04-19T02:16:45.441 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.8860000000000004e-06 2024-04-19T02:16:45.441 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.441 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.441 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:45.441 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116281+0000", 2024-04-19T02:16:45.442 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00016668100000000001 2024-04-19T02:16:45.442 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.442 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.442 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:45.442 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116394+0000", 2024-04-19T02:16:45.442 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000112138 2024-04-19T02:16:45.442 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.442 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.442 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:45.442 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116502+0000", 2024-04-19T02:16:45.442 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000108513 2024-04-19T02:16:45.442 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.442 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.442 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:45.442 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.120647+0000", 2024-04-19T02:16:45.443 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0041448459999999998 2024-04-19T02:16:45.443 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.443 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.443 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:45.443 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136124+0000", 2024-04-19T02:16:45.443 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015476678000000001 2024-04-19T02:16:45.443 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.443 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.443 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:45.443 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136149+0000", 2024-04-19T02:16:45.443 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.5412999999999999e-05 2024-04-19T02:16:45.443 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.443 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.443 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:45.444 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136180+0000", 2024-04-19T02:16:45.444 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.0970999999999999e-05 2024-04-19T02:16:45.444 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:45.444 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:45.444 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:45.444 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.444 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.444 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:94472 5.2 e35/16 5:45b7e9be:::benchmark_data_smithi121_44835_object94471:head v 35'5919, mlcod=34'5914)", 2024-04-19T02:16:45.444 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:35.116129+0000", 2024-04-19T02:16:45.444 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 10.253879770999999, 2024-04-19T02:16:45.444 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.019945311, 2024-04-19T02:16:45.444 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:45.444 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:45.444 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:45.444 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.445 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:45.445 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116129+0000", 2024-04-19T02:16:45.445 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:45.445 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.445 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.445 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:45.445 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116129+0000", 2024-04-19T02:16:45.445 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:45.445 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.446 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.446 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:45.446 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116129+0000", 2024-04-19T02:16:45.446 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:45.446 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.446 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.446 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:45.446 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116149+0000", 2024-04-19T02:16:45.446 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.9874999999999999e-05 2024-04-19T02:16:45.446 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.446 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.447 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:45.447 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116153+0000", 2024-04-19T02:16:45.447 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.7190000000000001e-06 2024-04-19T02:16:45.447 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.447 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.447 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:45.447 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116157+0000", 2024-04-19T02:16:45.447 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.3100000000000001e-06 2024-04-19T02:16:45.447 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.447 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.447 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:45.448 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116250+0000", 2024-04-19T02:16:45.448 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.3022999999999993e-05 2024-04-19T02:16:45.448 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.448 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.448 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:45.448 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116267+0000", 2024-04-19T02:16:45.448 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.685e-05 2024-04-19T02:16:45.448 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.448 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.448 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:45.448 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136051+0000", 2024-04-19T02:16:45.448 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.019784748000000001 2024-04-19T02:16:45.448 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.448 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.448 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:45.449 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136075+0000", 2024-04-19T02:16:45.449 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.3332e-05 2024-04-19T02:16:45.449 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:45.449 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:45.449 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:45.449 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.449 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.449 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:94581 5.b e35/16 5:dc86d6e9:::benchmark_data_smithi121_44835_object94580:head v 35'5875, mlcod=35'5872)", 2024-04-19T02:16:45.449 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:35.181295+0000", 2024-04-19T02:16:45.449 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 10.188714163, 2024-04-19T02:16:45.449 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.02078327, 2024-04-19T02:16:45.449 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:45.449 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:45.449 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:45.450 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.450 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:45.450 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.181295+0000", 2024-04-19T02:16:45.450 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:45.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.450 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.450 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:45.450 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.181295+0000", 2024-04-19T02:16:45.450 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:45.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.450 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.450 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:45.450 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.181294+0000", 2024-04-19T02:16:45.451 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:45.451 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.451 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.451 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:45.451 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.181321+0000", 2024-04-19T02:16:45.451 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.6588999999999999e-05 2024-04-19T02:16:45.451 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.451 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.451 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:45.451 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.181329+0000", 2024-04-19T02:16:45.451 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.9289999999999998e-06 2024-04-19T02:16:45.451 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.451 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.451 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:45.452 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.181334+0000", 2024-04-19T02:16:45.452 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.2789999999999998e-06 2024-04-19T02:16:45.452 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.452 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.452 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:45.452 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.186093+0000", 2024-04-19T02:16:45.452 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0047585509999999998 2024-04-19T02:16:45.452 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.452 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.452 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:45.452 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.186111+0000", 2024-04-19T02:16:45.452 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.7901e-05 2024-04-19T02:16:45.452 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.453 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.453 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:45.453 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.202037+0000", 2024-04-19T02:16:45.453 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015926020999999999 2024-04-19T02:16:45.453 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.453 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.453 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:45.453 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.202078+0000", 2024-04-19T02:16:45.453 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.1424999999999997e-05 2024-04-19T02:16:45.453 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:45.453 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:45.453 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:45.453 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.453 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.453 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "MOSDPGPushReply(5.1 35/29 [PushReplyOp(5:860e8104:::benchmark_data_smithi121_44835_object52857:head)])", 2024-04-19T02:16:45.454 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:35.719222+0000", 2024-04-19T02:16:45.454 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 9.6507874279999992, 2024-04-19T02:16:45.454 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.022063027999999998, 2024-04-19T02:16:45.454 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:45.454 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "reached pg", 2024-04-19T02:16:45.454 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:45.454 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.454 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:45.454 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.719222+0000", 2024-04-19T02:16:45.454 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:45.454 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.454 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.454 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:45.455 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.719222+0000", 2024-04-19T02:16:45.455 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:45.455 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.455 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.455 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:45.455 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.719221+0000", 2024-04-19T02:16:45.455 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967296 2024-04-19T02:16:45.455 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.455 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.455 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:45.455 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.719225+0000", 2024-04-19T02:16:45.455 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.5779999999999999e-06 2024-04-19T02:16:45.455 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.455 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.455 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:45.455 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.719232+0000", 2024-04-19T02:16:45.456 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.1319999999999996e-06 2024-04-19T02:16:45.456 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.456 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.456 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:45.456 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.719239+0000", 2024-04-19T02:16:45.456 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.8120000000000002e-06 2024-04-19T02:16:45.456 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.456 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.456 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:45.456 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.741004+0000", 2024-04-19T02:16:45.457 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.021764614000000002 2024-04-19T02:16:45.457 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.457 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.457 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:45.457 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.741285+0000", 2024-04-19T02:16:45.457 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000281079 2024-04-19T02:16:45.457 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:45.457 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:45.457 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:45.457 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.457 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.457 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:96375 5.1 5:84bae481:::benchmark_data_smithi121_44835_object96374:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:45.457 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:36.105748+0000", 2024-04-19T02:16:45.457 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 9.2642610380000008, 2024-04-19T02:16:45.457 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.021551219999999999, 2024-04-19T02:16:45.458 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:45.458 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:45.458 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:45.458 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:45.458 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:45.458 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 96375 2024-04-19T02:16:45.458 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.458 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:45.458 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.458 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:45.459 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.105748+0000", 2024-04-19T02:16:45.459 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:45.459 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.459 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.459 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:45.459 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.105748+0000", 2024-04-19T02:16:45.459 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:45.459 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.459 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.459 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:45.459 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.105747+0000", 2024-04-19T02:16:45.459 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:45.459 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.459 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.459 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:45.459 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.105869+0000", 2024-04-19T02:16:45.460 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000121965 2024-04-19T02:16:45.460 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.460 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.460 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:45.460 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.105879+0000", 2024-04-19T02:16:45.460 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0049e-05 2024-04-19T02:16:45.460 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.460 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.460 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:45.460 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.105886+0000", 2024-04-19T02:16:45.460 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.0879999999999997e-06 2024-04-19T02:16:45.460 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.461 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.461 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:45.461 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.107778+0000", 2024-04-19T02:16:45.461 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0018912670000000001 2024-04-19T02:16:45.461 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.461 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.461 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:45.461 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.107885+0000", 2024-04-19T02:16:45.461 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000106982 2024-04-19T02:16:45.462 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.462 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.462 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:45.462 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.108016+0000", 2024-04-19T02:16:45.462 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000131581 2024-04-19T02:16:45.462 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.462 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.462 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:45.462 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.110857+0000", 2024-04-19T02:16:45.462 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.002840604 2024-04-19T02:16:45.462 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.462 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.462 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:45.462 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.118745+0000", 2024-04-19T02:16:45.463 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0078886970000000001 2024-04-19T02:16:45.463 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.463 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.463 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:45.463 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.127135+0000", 2024-04-19T02:16:45.463 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0083899939999999996 2024-04-19T02:16:45.463 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.463 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.463 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:45.463 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.127191+0000", 2024-04-19T02:16:45.463 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.5294000000000003e-05 2024-04-19T02:16:45.463 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.463 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.463 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:45.463 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.127299+0000", 2024-04-19T02:16:45.464 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000108439 2024-04-19T02:16:45.464 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:45.464 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:45.464 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:45.464 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.464 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.464 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:104186 5.1 5:8759ec67:::benchmark_data_smithi121_44835_object104185:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T02:16:45.464 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:40.086927+0000", 2024-04-19T02:16:45.464 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 5.2830821969999997, 2024-04-19T02:16:45.464 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020306884000000001, 2024-04-19T02:16:45.464 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:45.464 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:45.464 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:45.465 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:45.465 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:45.465 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 104186 2024-04-19T02:16:45.465 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.465 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:45.465 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.465 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:45.465 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086927+0000", 2024-04-19T02:16:45.465 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:45.465 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.465 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.465 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:45.465 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086927+0000", 2024-04-19T02:16:45.465 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:45.466 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.466 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.466 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:45.466 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086926+0000", 2024-04-19T02:16:45.466 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:45.466 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.466 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.466 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:45.466 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086951+0000", 2024-04-19T02:16:45.466 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.5452e-05 2024-04-19T02:16:45.466 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.466 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.466 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:45.466 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086960+0000", 2024-04-19T02:16:45.466 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.1620000000000008e-06 2024-04-19T02:16:45.467 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.467 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.467 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:45.467 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086966+0000", 2024-04-19T02:16:45.467 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.0290000000000002e-06 2024-04-19T02:16:45.467 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.467 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.467 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:45.467 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.090593+0000", 2024-04-19T02:16:45.467 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0036272079999999998 2024-04-19T02:16:45.467 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.467 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.467 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:45.467 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.090699+0000", 2024-04-19T02:16:45.467 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000106001 2024-04-19T02:16:45.468 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.468 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.468 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:45.468 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.090842+0000", 2024-04-19T02:16:45.468 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00014270900000000001 2024-04-19T02:16:45.468 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.468 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.468 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:45.468 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.094673+0000", 2024-04-19T02:16:45.468 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0038316999999999999 2024-04-19T02:16:45.468 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.468 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.468 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:45.468 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.097494+0000", 2024-04-19T02:16:45.468 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0028205539999999999 2024-04-19T02:16:45.469 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.469 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.469 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:45.469 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.107075+0000", 2024-04-19T02:16:45.469 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0095813870000000002 2024-04-19T02:16:45.469 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.469 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.469 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:45.469 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.107127+0000", 2024-04-19T02:16:45.469 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.1498000000000001e-05 2024-04-19T02:16:45.469 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.469 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.469 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:45.469 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.107234+0000", 2024-04-19T02:16:45.469 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000107058 2024-04-19T02:16:45.469 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:45.470 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:45.470 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:45.470 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.470 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.470 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:104187 5.1 5:8636ab61:::benchmark_data_smithi121_44835_object104186:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T02:16:45.470 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:40.086972+0000", 2024-04-19T02:16:45.470 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 5.2830368029999999, 2024-04-19T02:16:45.470 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020992607999999999, 2024-04-19T02:16:45.470 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:45.470 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:45.470 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:45.470 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:45.470 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:45.470 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 104187 2024-04-19T02:16:45.471 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.471 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:45.471 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.471 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:45.471 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086972+0000", 2024-04-19T02:16:45.471 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:45.471 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.471 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.471 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:45.471 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086972+0000", 2024-04-19T02:16:45.471 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:45.471 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.471 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.471 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:45.471 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086972+0000", 2024-04-19T02:16:45.471 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:45.472 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.472 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.472 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:45.472 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.087000+0000", 2024-04-19T02:16:45.472 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.8569e-05 2024-04-19T02:16:45.472 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.472 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.473 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:45.473 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.087007+0000", 2024-04-19T02:16:45.473 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.4280000000000001e-06 2024-04-19T02:16:45.473 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.473 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.473 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:45.473 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.087013+0000", 2024-04-19T02:16:45.473 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.3929999999999996e-06 2024-04-19T02:16:45.473 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.473 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.473 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:45.473 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.092659+0000", 2024-04-19T02:16:45.473 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0056460850000000003 2024-04-19T02:16:45.473 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.473 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.474 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:45.474 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.092780+0000", 2024-04-19T02:16:45.474 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012113200000000001 2024-04-19T02:16:45.474 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.474 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.474 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:45.474 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.092894+0000", 2024-04-19T02:16:45.474 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000113057 2024-04-19T02:16:45.474 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.474 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.474 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:45.474 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.097526+0000", 2024-04-19T02:16:45.474 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0046325940000000003 2024-04-19T02:16:45.474 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.475 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.475 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:45.475 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.097536+0000", 2024-04-19T02:16:45.475 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.4110000000000002e-06 2024-04-19T02:16:45.475 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.475 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.475 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:45.475 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.107809+0000", 2024-04-19T02:16:45.475 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.010273882999999999 2024-04-19T02:16:45.475 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.475 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.475 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:45.475 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.107864+0000", 2024-04-19T02:16:45.475 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.4792e-05 2024-04-19T02:16:45.475 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.476 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.476 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:45.476 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.107965+0000", 2024-04-19T02:16:45.476 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000100641 2024-04-19T02:16:45.476 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:45.476 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:45.476 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:45.476 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.476 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.476 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:113448 5.1 5:816781af:::benchmark_data_smithi121_44835_object113447:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T02:16:45.476 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:44.698272+0000", 2024-04-19T02:16:45.476 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.67173659500000005, 2024-04-19T02:16:45.476 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.023047332, 2024-04-19T02:16:45.476 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:45.476 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:45.477 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:45.477 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:45.477 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:45.477 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 113448 2024-04-19T02:16:45.477 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.477 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:45.477 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.477 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:45.477 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.698272+0000", 2024-04-19T02:16:45.477 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:45.477 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.477 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.477 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:45.477 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.698272+0000", 2024-04-19T02:16:45.477 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:45.478 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.478 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.478 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:45.478 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.698272+0000", 2024-04-19T02:16:45.478 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:45.478 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.478 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.478 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:45.478 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.698307+0000", 2024-04-19T02:16:45.478 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.4712999999999998e-05 2024-04-19T02:16:45.478 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.478 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.478 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:45.478 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.698322+0000", 2024-04-19T02:16:45.479 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.5427999999999999e-05 2024-04-19T02:16:45.479 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.479 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.479 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:45.479 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.698328+0000", 2024-04-19T02:16:45.479 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.139e-06 2024-04-19T02:16:45.479 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.479 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.479 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:45.479 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.700548+0000", 2024-04-19T02:16:45.479 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.002219951 2024-04-19T02:16:45.479 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.479 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.479 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:45.479 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.700699+0000", 2024-04-19T02:16:45.480 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000151185 2024-04-19T02:16:45.480 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.480 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.480 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:45.480 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.700844+0000", 2024-04-19T02:16:45.480 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00014434800000000001 2024-04-19T02:16:45.480 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.480 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.480 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:45.480 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.705655+0000", 2024-04-19T02:16:45.480 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.004811503 2024-04-19T02:16:45.480 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.480 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.480 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:45.480 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.705933+0000", 2024-04-19T02:16:45.481 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00027823300000000002 2024-04-19T02:16:45.481 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.481 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.481 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:45.481 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.721130+0000", 2024-04-19T02:16:45.481 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015196708 2024-04-19T02:16:45.481 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.481 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.481 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:45.481 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.721197+0000", 2024-04-19T02:16:45.481 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.6928999999999996e-05 2024-04-19T02:16:45.481 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.481 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.481 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:45.481 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.721320+0000", 2024-04-19T02:16:45.482 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012277499999999999 2024-04-19T02:16:45.482 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:45.482 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:45.482 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:45.482 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.482 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.482 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:113660 5.1 5:80c3f0b7:::benchmark_data_smithi121_44835_object113659:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T02:16:45.482 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:44.810899+0000", 2024-04-19T02:16:45.482 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.55910997699999998, 2024-04-19T02:16:45.482 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.023870918000000001, 2024-04-19T02:16:45.482 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:45.482 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:45.482 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:45.482 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:45.483 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:45.483 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 113660 2024-04-19T02:16:45.483 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.483 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:45.483 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.483 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:45.483 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.810899+0000", 2024-04-19T02:16:45.483 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:45.483 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.483 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.483 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:45.483 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.810899+0000", 2024-04-19T02:16:45.483 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:45.483 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.483 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.484 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:45.484 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.810898+0000", 2024-04-19T02:16:45.484 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:45.484 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.484 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.484 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:45.484 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.810972+0000", 2024-04-19T02:16:45.484 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.3306000000000006e-05 2024-04-19T02:16:45.484 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.484 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.484 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:45.484 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.810978+0000", 2024-04-19T02:16:45.484 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.319e-06 2024-04-19T02:16:45.484 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.484 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.484 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:45.485 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.810984+0000", 2024-04-19T02:16:45.485 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.1650000000000003e-06 2024-04-19T02:16:45.485 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.485 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.485 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:45.485 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.820088+0000", 2024-04-19T02:16:45.485 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0091040310000000003 2024-04-19T02:16:45.485 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.485 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.485 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:45.485 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.820245+0000", 2024-04-19T02:16:45.485 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000157155 2024-04-19T02:16:45.485 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.485 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.485 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:45.486 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.820444+0000", 2024-04-19T02:16:45.486 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00019840299999999999 2024-04-19T02:16:45.486 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.486 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.486 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:45.486 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.824507+0000", 2024-04-19T02:16:45.486 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0040632999999999997 2024-04-19T02:16:45.486 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.486 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.486 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:45.486 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.827337+0000", 2024-04-19T02:16:45.487 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0028301429999999998 2024-04-19T02:16:45.487 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.487 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.487 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:45.489 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.834600+0000", 2024-04-19T02:16:45.490 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.007263294 2024-04-19T02:16:45.490 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.490 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.490 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:45.490 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.834654+0000", 2024-04-19T02:16:45.490 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.3508999999999999e-05 2024-04-19T02:16:45.490 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:45.490 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:45.490 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:45.490 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.834770+0000", 2024-04-19T02:16:45.490 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000116075 2024-04-19T02:16:45.490 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:45.491 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:45.491 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:45.491 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:45.491 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:45.491 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-04-19T02:16:45.492 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:45.492+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:45.493 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:16:45.593 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:45.592+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:45.664 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:16:45.664 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:16:45.664 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.665 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:115336 5.f 5.843b46df (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T02:16:45.665 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:45.662051+0000", 2024-04-19T02:16:45.665 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0021451999999999999, 2024-04-19T02:16:45.665 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021707720000000001, 2024-04-19T02:16:45.665 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:45.665 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-04-19T02:16:45.665 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:45.665 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:45.666 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:45.666 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 115336 2024-04-19T02:16:45.666 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.666 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:45.666 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.666 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:45.666 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.662051+0000", 2024-04-19T02:16:45.666 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:45.666 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.667 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.667 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:45.667 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.662051+0000", 2024-04-19T02:16:45.667 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:45.667 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.667 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.667 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:45.667 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.662050+0000", 2024-04-19T02:16:45.667 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:45.667 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.667 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.667 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:45.667 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.662117+0000", 2024-04-19T02:16:45.667 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7173000000000002e-05 2024-04-19T02:16:45.667 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:45.668 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.662132+0000", 2024-04-19T02:16:45.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5142e-05 2024-04-19T02:16:45.668 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:45.668 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.662139+0000", 2024-04-19T02:16:45.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3640000000000004e-06 2024-04-19T02:16:45.668 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:45.668 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:45.668 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:45.668 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.668 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:115337 5.9 5:9f0a2882:::benchmark_data_smithi121_44835_object115336:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T02:16:45.669 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:45.662146+0000", 2024-04-19T02:16:45.669 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0020495999999999999, 2024-04-19T02:16:45.669 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021534319999999998, 2024-04-19T02:16:45.669 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:45.669 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:45.669 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:45.669 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:45.669 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:45.669 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 115337 2024-04-19T02:16:45.669 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.669 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:45.669 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.669 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:45.669 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.662146+0000", 2024-04-19T02:16:45.669 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:45.670 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.670 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.670 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:45.670 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.662146+0000", 2024-04-19T02:16:45.670 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:45.670 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.670 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.670 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:45.670 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.662145+0000", 2024-04-19T02:16:45.670 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:45.670 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.670 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.670 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:45.671 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.662175+0000", 2024-04-19T02:16:45.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9345000000000001e-05 2024-04-19T02:16:45.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.671 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:45.671 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.662182+0000", 2024-04-19T02:16:45.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9670000000000004e-06 2024-04-19T02:16:45.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.671 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:45.671 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.662187+0000", 2024-04-19T02:16:45.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0479999999999998e-06 2024-04-19T02:16:45.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.671 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:45.672 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.662237+0000", 2024-04-19T02:16:45.672 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9994999999999998e-05 2024-04-19T02:16:45.672 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.672 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.672 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:45.672 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.662390+0000", 2024-04-19T02:16:45.672 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015269900000000001 2024-04-19T02:16:45.672 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.672 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.672 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:45.672 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.662537+0000", 2024-04-19T02:16:45.672 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014758100000000001 2024-04-19T02:16:45.672 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:45.672 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:45.672 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:45.672 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.673 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.673 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4549.0:115338 5.6 e40/16 5:62092f01:::benchmark_data_smithi121_44835_object115337:head v 40'7261, mlcod=40'7259)", 2024-04-19T02:16:45.673 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:45.662561+0000", 2024-04-19T02:16:45.673 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0016348210000000001, 2024-04-19T02:16:45.673 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017979230000000001, 2024-04-19T02:16:45.673 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:45.673 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:16:45.673 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:45.673 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.673 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:45.673 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.662561+0000", 2024-04-19T02:16:45.673 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:45.673 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.673 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.673 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:45.674 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.662561+0000", 2024-04-19T02:16:45.674 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:45.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.674 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.674 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:45.674 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.662560+0000", 2024-04-19T02:16:45.674 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:45.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.674 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.674 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:45.674 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.662612+0000", 2024-04-19T02:16:45.674 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1610000000000002e-05 2024-04-19T02:16:45.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.674 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.675 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:45.675 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.662620+0000", 2024-04-19T02:16:45.675 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6520000000000006e-06 2024-04-19T02:16:45.675 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.675 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.675 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:45.675 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.662626+0000", 2024-04-19T02:16:45.675 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4180000000000002e-06 2024-04-19T02:16:45.675 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.675 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.675 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:45.675 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.662660+0000", 2024-04-19T02:16:45.675 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4270000000000002e-05 2024-04-19T02:16:45.675 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.675 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.676 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:45.676 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.662679+0000", 2024-04-19T02:16:45.676 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8570999999999999e-05 2024-04-19T02:16:45.676 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:45.676 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:45.676 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:45.676 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.676 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.676 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:115317 5.f 5:fbe93141:::benchmark_data_smithi121_44835_object115316:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T02:16:45.676 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:45.652774+0000", 2024-04-19T02:16:45.676 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.011422059, 2024-04-19T02:16:45.676 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011626282, 2024-04-19T02:16:45.676 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:45.676 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:45.676 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:45.677 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:45.677 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:45.677 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 115317 2024-04-19T02:16:45.677 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.677 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:45.677 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.677 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:45.677 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.652774+0000", 2024-04-19T02:16:45.677 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:45.677 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.677 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.677 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:45.677 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.652774+0000", 2024-04-19T02:16:45.677 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:45.677 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.678 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.678 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:45.678 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.652773+0000", 2024-04-19T02:16:45.678 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:45.678 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.678 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.678 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:45.678 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.652884+0000", 2024-04-19T02:16:45.678 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011110100000000001 2024-04-19T02:16:45.678 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.678 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.678 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:45.678 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.652892+0000", 2024-04-19T02:16:45.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7589999999999997e-06 2024-04-19T02:16:45.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.679 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.679 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:45.679 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.652897+0000", 2024-04-19T02:16:45.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6890000000000003e-06 2024-04-19T02:16:45.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.679 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.679 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:45.679 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.652943+0000", 2024-04-19T02:16:45.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6495999999999997e-05 2024-04-19T02:16:45.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.679 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.679 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:45.679 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.653064+0000", 2024-04-19T02:16:45.680 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012094799999999999 2024-04-19T02:16:45.680 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.680 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:45.680 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.653183+0000", 2024-04-19T02:16:45.680 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000119042 2024-04-19T02:16:45.680 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.680 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:45.680 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.657118+0000", 2024-04-19T02:16:45.680 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039347369999999998 2024-04-19T02:16:45.680 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:45.680 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:45.680 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:45.681 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.681 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.681 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:115318 5.7 5:ef728bbf:::benchmark_data_smithi121_44835_object115317:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T02:16:45.681 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:45.652904+0000", 2024-04-19T02:16:45.681 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.011291651, 2024-04-19T02:16:45.681 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011554071000000001, 2024-04-19T02:16:45.681 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:45.681 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:45.681 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:45.681 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:45.681 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:45.681 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 115318 2024-04-19T02:16:45.681 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.681 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:45.681 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.681 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:45.682 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.652904+0000", 2024-04-19T02:16:45.682 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:45.682 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.682 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.682 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:45.682 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.652904+0000", 2024-04-19T02:16:45.682 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:45.682 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.682 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.682 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:45.682 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.652904+0000", 2024-04-19T02:16:45.682 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:45.682 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.683 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.683 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:45.683 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.652936+0000", 2024-04-19T02:16:45.683 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2023999999999997e-05 2024-04-19T02:16:45.683 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.683 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.683 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:45.683 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.652942+0000", 2024-04-19T02:16:45.683 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3400000000000003e-06 2024-04-19T02:16:45.683 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.683 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.683 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:45.683 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.652946+0000", 2024-04-19T02:16:45.683 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6890000000000002e-06 2024-04-19T02:16:45.683 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.684 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:45.684 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.653146+0000", 2024-04-19T02:16:45.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000200337 2024-04-19T02:16:45.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.684 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:45.684 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.653253+0000", 2024-04-19T02:16:45.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000106877 2024-04-19T02:16:45.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.684 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:45.684 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.653378+0000", 2024-04-19T02:16:45.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012520399999999999 2024-04-19T02:16:45.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:45.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.657215+0000", 2024-04-19T02:16:45.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038368180000000001 2024-04-19T02:16:45.685 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:45.685 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:45.685 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:45.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.685 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:115327 5.f 5:fa692e81:::benchmark_data_smithi121_44835_object115326:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T02:16:45.685 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:45.657961+0000", 2024-04-19T02:16:45.685 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0062351359999999996, 2024-04-19T02:16:45.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0065512640000000002, 2024-04-19T02:16:45.685 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:45.685 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:45.685 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:45.686 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:45.686 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:45.686 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 115327 2024-04-19T02:16:45.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.686 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:45.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:45.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.657961+0000", 2024-04-19T02:16:45.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:45.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:45.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.657961+0000", 2024-04-19T02:16:45.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:45.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.687 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.687 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:45.687 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.657956+0000", 2024-04-19T02:16:45.687 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999952 2024-04-19T02:16:45.687 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.687 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.687 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:45.687 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.658010+0000", 2024-04-19T02:16:45.687 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3834e-05 2024-04-19T02:16:45.687 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.687 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.687 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:45.687 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.658016+0000", 2024-04-19T02:16:45.687 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6980000000000001e-06 2024-04-19T02:16:45.687 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.688 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.688 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:45.688 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.658021+0000", 2024-04-19T02:16:45.688 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7160000000000002e-06 2024-04-19T02:16:45.688 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.688 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.689 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:45.689 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.658054+0000", 2024-04-19T02:16:45.689 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2573999999999997e-05 2024-04-19T02:16:45.689 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.689 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.689 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:45.689 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.658154+0000", 2024-04-19T02:16:45.689 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100333 2024-04-19T02:16:45.689 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.689 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.689 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:45.689 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.658271+0000", 2024-04-19T02:16:45.689 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000116798 2024-04-19T02:16:45.689 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:45.690 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:45.690 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:45.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.690 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.690 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:115329 5.f 5:f1566d5e:::benchmark_data_smithi121_44835_object115328:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T02:16:45.690 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:45.658137+0000", 2024-04-19T02:16:45.690 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0060591120000000002, 2024-04-19T02:16:45.690 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0064629249999999996, 2024-04-19T02:16:45.690 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:45.690 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:45.690 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:45.690 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:45.690 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:45.690 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 115329 2024-04-19T02:16:45.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.691 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:45.691 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.691 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:45.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.658137+0000", 2024-04-19T02:16:45.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:45.691 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.691 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.691 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:45.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.658137+0000", 2024-04-19T02:16:45.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:45.691 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.691 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.693 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:45.693 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.658136+0000", 2024-04-19T02:16:45.693 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:45.693 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:45.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.658191+0000", 2024-04-19T02:16:45.694 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4911000000000003e-05 2024-04-19T02:16:45.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:45.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.658199+0000", 2024-04-19T02:16:45.694 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5010000000000004e-06 2024-04-19T02:16:45.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:45.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.658207+0000", 2024-04-19T02:16:45.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1400000000000002e-06 2024-04-19T02:16:45.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.695 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.695 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:45.695 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.659903+0000", 2024-04-19T02:16:45.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001696143 2024-04-19T02:16:45.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.695 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.695 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:45.695 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.659995+0000", 2024-04-19T02:16:45.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2694000000000004e-05 2024-04-19T02:16:45.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.695 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.695 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:45.695 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.660287+0000", 2024-04-19T02:16:45.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00029165799999999998 2024-04-19T02:16:45.696 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:45.696 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:45.696 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:45.696 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.696 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.696 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:115330 5.d 5:b5d7a978:::benchmark_data_smithi121_44835_object115329:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T02:16:45.696 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:45.658984+0000", 2024-04-19T02:16:45.696 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0052119760000000001, 2024-04-19T02:16:45.696 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0057022280000000002, 2024-04-19T02:16:45.696 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:45.696 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:45.696 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:45.696 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:45.696 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:45.697 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 115330 2024-04-19T02:16:45.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.697 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:45.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.697 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:45.697 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.658984+0000", 2024-04-19T02:16:45.697 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:45.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.697 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:45.697 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.658984+0000", 2024-04-19T02:16:45.697 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:45.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.697 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:45.697 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.658983+0000", 2024-04-19T02:16:45.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:45.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.698 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:45.698 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.659080+0000", 2024-04-19T02:16:45.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6448999999999998e-05 2024-04-19T02:16:45.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.698 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:45.698 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.659100+0000", 2024-04-19T02:16:45.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0852e-05 2024-04-19T02:16:45.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.698 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:45.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.659107+0000", 2024-04-19T02:16:45.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7569999999999998e-06 2024-04-19T02:16:45.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:45.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.659143+0000", 2024-04-19T02:16:45.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5712e-05 2024-04-19T02:16:45.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:45.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.659288+0000", 2024-04-19T02:16:45.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014519500000000001 2024-04-19T02:16:45.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.700 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:45.700 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.659423+0000", 2024-04-19T02:16:45.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000134876 2024-04-19T02:16:45.700 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.700 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:45.700 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.662268+0000", 2024-04-19T02:16:45.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0028449450000000002 2024-04-19T02:16:45.700 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:45.700 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:45.700 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:45.700 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.701 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:115332 5.7 5:e39f7f3f:::benchmark_data_smithi121_44835_object115331:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T02:16:45.701 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:45.659133+0000", 2024-04-19T02:16:45.701 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0050629869999999997, 2024-04-19T02:16:45.701 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0056514690000000001, 2024-04-19T02:16:45.701 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:45.701 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:45.701 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:45.701 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:45.701 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:45.701 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 115332 2024-04-19T02:16:45.701 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.701 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:45.701 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.701 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:45.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.659133+0000", 2024-04-19T02:16:45.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:45.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.702 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:45.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.659133+0000", 2024-04-19T02:16:45.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:45.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.702 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:45.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.659132+0000", 2024-04-19T02:16:45.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:45.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.703 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:45.703 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.659160+0000", 2024-04-19T02:16:45.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7892999999999999e-05 2024-04-19T02:16:45.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.703 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:45.703 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.659168+0000", 2024-04-19T02:16:45.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2709999999999992e-06 2024-04-19T02:16:45.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.703 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:45.703 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.659174+0000", 2024-04-19T02:16:45.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2460000000000003e-06 2024-04-19T02:16:45.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:45.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.659888+0000", 2024-04-19T02:16:45.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00071423400000000001 2024-04-19T02:16:45.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:45.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.660006+0000", 2024-04-19T02:16:45.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011851800000000001 2024-04-19T02:16:45.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:45.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.660135+0000", 2024-04-19T02:16:45.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012841099999999999 2024-04-19T02:16:45.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.705 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:45.705 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.664324+0000", 2024-04-19T02:16:45.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041890979999999996 2024-04-19T02:16:45.705 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:45.705 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:45.705 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:45.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.705 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:115333 5.9 5:969611c7:::benchmark_data_smithi121_44835_object115332:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T02:16:45.705 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:45.659562+0000", 2024-04-19T02:16:45.705 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0046337510000000002, 2024-04-19T02:16:45.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052737440000000003, 2024-04-19T02:16:45.705 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:45.705 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:45.705 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:45.706 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:45.706 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:45.706 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 115333 2024-04-19T02:16:45.706 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.706 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:45.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.706 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:45.706 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.659562+0000", 2024-04-19T02:16:45.706 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:45.706 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.706 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:45.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.659562+0000", 2024-04-19T02:16:45.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:45.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:45.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.659561+0000", 2024-04-19T02:16:45.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:45.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:45.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.659644+0000", 2024-04-19T02:16:45.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2661e-05 2024-04-19T02:16:45.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:45.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.659654+0000", 2024-04-19T02:16:45.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.041e-05 2024-04-19T02:16:45.708 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:45.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.659662+0000", 2024-04-19T02:16:45.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6869999999999994e-06 2024-04-19T02:16:45.708 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:45.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.659701+0000", 2024-04-19T02:16:45.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8741000000000001e-05 2024-04-19T02:16:45.708 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:45.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.659830+0000", 2024-04-19T02:16:45.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129319 2024-04-19T02:16:45.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.709 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:45.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.659977+0000", 2024-04-19T02:16:45.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014707199999999999 2024-04-19T02:16:45.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.709 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:45.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.664273+0000", 2024-04-19T02:16:45.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042951910000000003 2024-04-19T02:16:45.710 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:45.710 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:45.710 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:45.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.710 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:115335 5.f 5:fd132d81:::benchmark_data_smithi121_44835_object115334:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T02:16:45.710 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:45.659814+0000", 2024-04-19T02:16:45.710 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0043816649999999999, 2024-04-19T02:16:45.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.005074907, 2024-04-19T02:16:45.710 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:45.710 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:45.710 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:45.710 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:45.711 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:45.711 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 115335 2024-04-19T02:16:45.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.711 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:45.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.711 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:45.711 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.659814+0000", 2024-04-19T02:16:45.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:45.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.711 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:45.711 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.659814+0000", 2024-04-19T02:16:45.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:45.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:45.712 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.659813+0000", 2024-04-19T02:16:45.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:45.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:45.712 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.661880+0000", 2024-04-19T02:16:45.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020661120000000002 2024-04-19T02:16:45.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:45.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.661906+0000", 2024-04-19T02:16:45.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6081e-05 2024-04-19T02:16:45.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:45.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.661914+0000", 2024-04-19T02:16:45.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0600000000000008e-06 2024-04-19T02:16:45.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:45.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.662444+0000", 2024-04-19T02:16:45.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00053068199999999999 2024-04-19T02:16:45.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.714 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:45.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.662522+0000", 2024-04-19T02:16:45.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7663000000000005e-05 2024-04-19T02:16:45.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:45.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:45.714 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:45.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.662617+0000", 2024-04-19T02:16:45.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5196000000000001e-05 2024-04-19T02:16:45.714 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:45.714 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:45.714 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:45.714 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:45.714 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-04-19T02:16:45.715 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 11 2024-04-19T02:16:45.715 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:16:45.715 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:16:45.717 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:16:45.717 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:45.716+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:45.817 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:45.818+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:45.867 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:16:45.888 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:16:45.909 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2: {} 2024-04-19T02:16:45.910 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:16:45.911 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:16:45.911 INFO:teuthology.orchestra.run.smithi121.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:16:45.918 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:45.918+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:45.928 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:45.928 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:45.942 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:16:46.011 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:16:46.019 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:46.019+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:46.029 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 51 16 116099 116083 142.247 124.812 0.00584 0.00702752 2024-04-19T02:16:46.120 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:46.120+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:46.153 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:46.153 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:46.162 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T02:16:46.166 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:16:46.223 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:46.223+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:46.322 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:46.322+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:46.332 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:46.333 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:46.349 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:16:46.364 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:16:46.366 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-04-19T02:16:46.376 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2024-04-19T02:16:44.751726+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":7180847962,"num_objects":109586,"num_object_clones":0,"num_object_copies":219172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2982,"num_objects_unfound":0,"num_objects_dirty":109586,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":109810,"num_write_kb":7015442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3002,"num_bytes_recovered":196739072,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60357,"ondisk_log_size":60357,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":243,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":14491660,"kb_used_data":14149736,"kb_used_omap":4,"kb_used_meta":341883,"kb_avail":268623860,"statfs":{"total":289910292480,"available":275070832640,"internally_reserved":0,"allocated":14489329664,"data_stored":14488458660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":350088530},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":644415488,"num_objects":9833,"num_object_clones":0,"num_object_copies":19666,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-445,"num_objects_unfound":0,"num_objects_dirty":9833,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9833,"num_write_kb":629312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":762,"num_bytes_recovered":49938432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.625942"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.134244+0000","last_change":"2024-04-19T02:15:29.280412+0000","last_active":"2024-04-19T02:16:38.134244+0000","last_peered":"2024-04-19T02:16:38.134244+0000","last_clean":"2024-04-19T02:16:38.134244+0000","last_became_active":"2024-04-19T02:15:29.278762+0000","last_became_peered":"2024-04-19T02:15:29.278762+0000","last_unstale":"2024-04-19T02:16:38.134244+0000","last_undegraded":"2024-04-19T02:16:38.134244+0000","last_fullsized":"2024-04-19T02:16:38.134244+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:45.301675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.131443+0000","last_change":"2024-04-19T02:15:29.284695+0000","last_active":"2024-04-19T02:16:38.131443+0000","last_peered":"2024-04-19T02:16:38.131443+0000","last_clean":"2024-04-19T02:16:38.131443+0000","last_became_active":"2024-04-19T02:15:29.283468+0000","last_became_peered":"2024-04-19T02:15:29.283468+0000","last_unstale":"2024-04-19T02:16:38.131443+0000","last_undegraded":"2024-04-19T02:16:38.131443+0000","last_fullsized":"2024-04-19T02:16:38.131443+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.384881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125717+0000","last_change":"2024-04-19T02:15:29.286709+0000","last_active":"2024-04-19T02:16:38.125717+0000","last_peered":"2024-04-19T02:16:38.125717+0000","last_clean":"2024-04-19T02:16:38.125717+0000","last_became_active":"2024-04-19T02:15:29.286169+0000","last_became_peered":"2024-04-19T02:15:29.286169+0000","last_unstale":"2024-04-19T02:16:38.125717+0000","last_undegraded":"2024-04-19T02:16:38.125717+0000","last_fullsized":"2024-04-19T02:16:38.125717+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:58.741466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125602+0000","last_change":"2024-04-19T02:15:29.280131+0000","last_active":"2024-04-19T02:16:38.125602+0000","last_peered":"2024-04-19T02:16:38.125602+0000","last_clean":"2024-04-19T02:16:38.125602+0000","last_became_active":"2024-04-19T02:15:29.279388+0000","last_became_peered":"2024-04-19T02:15:29.279388+0000","last_unstale":"2024-04-19T02:16:38.125602+0000","last_undegraded":"2024-04-19T02:16:38.125602+0000","last_fullsized":"2024-04-19T02:16:38.125602+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:36:48.819486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.128402+0000","last_change":"2024-04-19T02:15:53.955892+0000","last_active":"2024-04-19T02:16:38.128402+0000","last_peered":"2024-04-19T02:16:38.128402+0000","last_clean":"2024-04-19T02:16:38.128402+0000","last_became_active":"2024-04-19T02:15:53.955553+0000","last_became_peered":"2024-04-19T02:15:53.955553+0000","last_unstale":"2024-04-19T02:16:38.128402+0000","last_undegraded":"2024-04-19T02:16:38.128402+0000","last_fullsized":"2024-04-19T02:16:38.128402+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:45:39.791209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.124872+0000","last_change":"2024-04-19T02:15:29.283908+0000","last_active":"2024-04-19T02:16:38.124872+0000","last_peered":"2024-04-19T02:16:38.124872+0000","last_clean":"2024-04-19T02:16:38.124872+0000","last_became_active":"2024-04-19T02:15:29.281729+0000","last_became_peered":"2024-04-19T02:15:29.281729+0000","last_unstale":"2024-04-19T02:16:38.124872+0000","last_undegraded":"2024-04-19T02:16:38.124872+0000","last_fullsized":"2024-04-19T02:16:38.124872+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:03:15.383476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.124744+0000","last_change":"2024-04-19T02:15:29.281253+0000","last_active":"2024-04-19T02:16:38.124744+0000","last_peered":"2024-04-19T02:16:38.124744+0000","last_clean":"2024-04-19T02:16:38.124744+0000","last_became_active":"2024-04-19T02:15:29.279951+0000","last_became_peered":"2024-04-19T02:15:29.279951+0000","last_unstale":"2024-04-19T02:16:38.124744+0000","last_undegraded":"2024-04-19T02:16:38.124744+0000","last_fullsized":"2024-04-19T02:16:38.124744+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.124566+0000","last_change":"2024-04-19T02:15:29.283952+0000","last_active":"2024-04-19T02:16:38.124566+0000","last_peered":"2024-04-19T02:16:38.124566+0000","last_clean":"2024-04-19T02:16:38.124566+0000","last_became_active":"2024-04-19T02:15:29.282721+0000","last_became_peered":"2024-04-19T02:15:29.282721+0000","last_unstale":"2024-04-19T02:16:38.124566+0000","last_undegraded":"2024-04-19T02:16:38.124566+0000","last_fullsized":"2024-04-19T02:16:38.124566+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:45.301675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.128974+0000","last_change":"2024-04-19T02:15:29.282150+0000","last_active":"2024-04-19T02:16:38.128974+0000","last_peered":"2024-04-19T02:16:38.128974+0000","last_clean":"2024-04-19T02:16:38.128974+0000","last_became_active":"2024-04-19T02:15:29.281538+0000","last_became_peered":"2024-04-19T02:15:29.281538+0000","last_unstale":"2024-04-19T02:16:38.128974+0000","last_undegraded":"2024-04-19T02:16:38.128974+0000","last_fullsized":"2024-04-19T02:16:38.128974+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125014+0000","last_change":"2024-04-19T02:16:30.093524+0000","last_active":"2024-04-19T02:16:38.125014+0000","last_peered":"2024-04-19T02:16:38.125014+0000","last_clean":"2024-04-19T02:16:38.125014+0000","last_became_active":"2024-04-19T02:16:30.093344+0000","last_became_peered":"2024-04-19T02:16:30.093344+0000","last_unstale":"2024-04-19T02:16:38.125014+0000","last_undegraded":"2024-04-19T02:16:38.125014+0000","last_fullsized":"2024-04-19T02:16:38.125014+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:14:40.293159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125524+0000","last_change":"2024-04-19T02:15:29.280606+0000","last_active":"2024-04-19T02:16:38.125524+0000","last_peered":"2024-04-19T02:16:38.125524+0000","last_clean":"2024-04-19T02:16:38.125524+0000","last_became_active":"2024-04-19T02:15:29.280151+0000","last_became_peered":"2024-04-19T02:15:29.280151+0000","last_unstale":"2024-04-19T02:16:38.125524+0000","last_undegraded":"2024-04-19T02:16:38.125524+0000","last_fullsized":"2024-04-19T02:16:38.125524+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:26:22.452488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125269+0000","last_change":"2024-04-19T02:15:53.958876+0000","last_active":"2024-04-19T02:16:38.125269+0000","last_peered":"2024-04-19T02:16:38.125269+0000","last_clean":"2024-04-19T02:16:38.125269+0000","last_became_active":"2024-04-19T02:15:53.958626+0000","last_became_peered":"2024-04-19T02:15:53.958626+0000","last_unstale":"2024-04-19T02:16:38.125269+0000","last_undegraded":"2024-04-19T02:16:38.125269+0000","last_fullsized":"2024-04-19T02:16:38.125269+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:23:57.044018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.128076+0000","last_change":"2024-04-19T02:15:53.956801+0000","last_active":"2024-04-19T02:16:38.128076+0000","last_peered":"2024-04-19T02:16:38.128076+0000","last_clean":"2024-04-19T02:16:38.128076+0000","last_became_active":"2024-04-19T02:15:53.956620+0000","last_became_peered":"2024-04-19T02:15:53.956620+0000","last_unstale":"2024-04-19T02:16:38.128076+0000","last_undegraded":"2024-04-19T02:16:38.128076+0000","last_fullsized":"2024-04-19T02:16:38.128076+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:57:05.843101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125627+0000","last_change":"2024-04-19T02:15:29.284262+0000","last_active":"2024-04-19T02:16:38.125627+0000","last_peered":"2024-04-19T02:16:38.125627+0000","last_clean":"2024-04-19T02:16:38.125627+0000","last_became_active":"2024-04-19T02:15:29.283121+0000","last_became_peered":"2024-04-19T02:15:29.283121+0000","last_unstale":"2024-04-19T02:16:38.125627+0000","last_undegraded":"2024-04-19T02:16:38.125627+0000","last_fullsized":"2024-04-19T02:16:38.125627+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.124909+0000","last_change":"2024-04-19T02:15:29.285139+0000","last_active":"2024-04-19T02:16:38.124909+0000","last_peered":"2024-04-19T02:16:38.124909+0000","last_clean":"2024-04-19T02:16:38.124909+0000","last_became_active":"2024-04-19T02:15:29.284649+0000","last_became_peered":"2024-04-19T02:15:29.284649+0000","last_unstale":"2024-04-19T02:16:38.124909+0000","last_undegraded":"2024-04-19T02:16:38.124909+0000","last_fullsized":"2024-04-19T02:16:38.124909+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.124643+0000","last_change":"2024-04-19T02:15:29.283648+0000","last_active":"2024-04-19T02:16:38.124643+0000","last_peered":"2024-04-19T02:16:38.124643+0000","last_clean":"2024-04-19T02:16:38.124643+0000","last_became_active":"2024-04-19T02:15:29.281606+0000","last_became_peered":"2024-04-19T02:15:29.281606+0000","last_unstale":"2024-04-19T02:16:38.124643+0000","last_undegraded":"2024-04-19T02:16:38.124643+0000","last_fullsized":"2024-04-19T02:16:38.124643+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.129038+0000","last_change":"2024-04-19T02:15:29.278673+0000","last_active":"2024-04-19T02:16:38.129038+0000","last_peered":"2024-04-19T02:16:38.129038+0000","last_clean":"2024-04-19T02:16:38.129038+0000","last_became_active":"2024-04-19T02:15:29.277699+0000","last_became_peered":"2024-04-19T02:15:29.277699+0000","last_unstale":"2024-04-19T02:16:38.129038+0000","last_undegraded":"2024-04-19T02:16:38.129038+0000","last_fullsized":"2024-04-19T02:16:38.129038+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.131801+0000","last_change":"2024-04-19T02:15:29.283341+0000","last_active":"2024-04-19T02:16:38.131801+0000","last_peered":"2024-04-19T02:16:38.131801+0000","last_clean":"2024-04-19T02:16:38.131801+0000","last_became_active":"2024-04-19T02:15:29.281591+0000","last_became_peered":"2024-04-19T02:15:29.281591+0000","last_unstale":"2024-04-19T02:16:38.131801+0000","last_undegraded":"2024-04-19T02:16:38.131801+0000","last_fullsized":"2024-04-19T02:16:38.131801+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:34.593754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.131909+0000","last_change":"2024-04-19T02:15:29.282110+0000","last_active":"2024-04-19T02:16:38.131909+0000","last_peered":"2024-04-19T02:16:38.131909+0000","last_clean":"2024-04-19T02:16:38.131909+0000","last_became_active":"2024-04-19T02:15:29.281716+0000","last_became_peered":"2024-04-19T02:15:29.281716+0000","last_unstale":"2024-04-19T02:16:38.131909+0000","last_undegraded":"2024-04-19T02:16:38.131909+0000","last_fullsized":"2024-04-19T02:16:38.131909+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125513+0000","last_change":"2024-04-19T02:15:29.285237+0000","last_active":"2024-04-19T02:16:38.125513+0000","last_peered":"2024-04-19T02:16:38.125513+0000","last_clean":"2024-04-19T02:16:38.125513+0000","last_became_active":"2024-04-19T02:15:29.282790+0000","last_became_peered":"2024-04-19T02:15:29.282790+0000","last_unstale":"2024-04-19T02:16:38.125513+0000","last_undegraded":"2024-04-19T02:16:38.125513+0000","last_fullsized":"2024-04-19T02:16:38.125513+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.124951+0000","last_change":"2024-04-19T02:15:29.282609+0000","last_active":"2024-04-19T02:16:38.124951+0000","last_peered":"2024-04-19T02:16:38.124951+0000","last_clean":"2024-04-19T02:16:38.124951+0000","last_became_active":"2024-04-19T02:15:29.281665+0000","last_became_peered":"2024-04-19T02:15:29.281665+0000","last_unstale":"2024-04-19T02:16:38.124951+0000","last_undegraded":"2024-04-19T02:16:38.124951+0000","last_fullsized":"2024-04-19T02:16:38.124951+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.384881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.124792+0000","last_change":"2024-04-19T02:15:53.955813+0000","last_active":"2024-04-19T02:16:38.124792+0000","last_peered":"2024-04-19T02:16:38.124792+0000","last_clean":"2024-04-19T02:16:38.124792+0000","last_became_active":"2024-04-19T02:15:53.955614+0000","last_became_peered":"2024-04-19T02:15:53.955614+0000","last_unstale":"2024-04-19T02:16:38.124792+0000","last_undegraded":"2024-04-19T02:16:38.124792+0000","last_fullsized":"2024-04-19T02:16:38.124792+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:58:03.192647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.127805+0000","last_change":"2024-04-19T02:15:29.277109+0000","last_active":"2024-04-19T02:16:38.127805+0000","last_peered":"2024-04-19T02:16:38.127805+0000","last_clean":"2024-04-19T02:16:38.127805+0000","last_became_active":"2024-04-19T02:15:29.275417+0000","last_became_peered":"2024-04-19T02:15:29.275417+0000","last_unstale":"2024-04-19T02:16:38.127805+0000","last_undegraded":"2024-04-19T02:16:38.127805+0000","last_fullsized":"2024-04-19T02:16:38.127805+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.131121+0000","last_change":"2024-04-19T02:15:29.283266+0000","last_active":"2024-04-19T02:16:38.131121+0000","last_peered":"2024-04-19T02:16:38.131121+0000","last_clean":"2024-04-19T02:16:38.131121+0000","last_became_active":"2024-04-19T02:15:29.281505+0000","last_became_peered":"2024-04-19T02:15:29.281505+0000","last_unstale":"2024-04-19T02:16:38.131121+0000","last_undegraded":"2024-04-19T02:16:38.131121+0000","last_fullsized":"2024-04-19T02:16:38.131121+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.134184+0000","last_change":"2024-04-19T02:15:29.278084+0000","last_active":"2024-04-19T02:16:38.134184+0000","last_peered":"2024-04-19T02:16:38.134184+0000","last_clean":"2024-04-19T02:16:38.134184+0000","last_became_active":"2024-04-19T02:15:29.276952+0000","last_became_peered":"2024-04-19T02:15:29.276952+0000","last_unstale":"2024-04-19T02:16:38.134184+0000","last_undegraded":"2024-04-19T02:16:38.134184+0000","last_fullsized":"2024-04-19T02:16:38.134184+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.130333+0000","last_change":"2024-04-19T02:15:29.279904+0000","last_active":"2024-04-19T02:16:38.130333+0000","last_peered":"2024-04-19T02:16:38.130333+0000","last_clean":"2024-04-19T02:16:38.130333+0000","last_became_active":"2024-04-19T02:15:29.278938+0000","last_became_peered":"2024-04-19T02:15:29.278938+0000","last_unstale":"2024-04-19T02:16:38.130333+0000","last_undegraded":"2024-04-19T02:16:38.130333+0000","last_fullsized":"2024-04-19T02:16:38.130333+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125634+0000","last_change":"2024-04-19T02:15:29.287389+0000","last_active":"2024-04-19T02:16:38.125634+0000","last_peered":"2024-04-19T02:16:38.125634+0000","last_clean":"2024-04-19T02:16:38.125634+0000","last_became_active":"2024-04-19T02:15:29.286431+0000","last_became_peered":"2024-04-19T02:15:29.286431+0000","last_unstale":"2024-04-19T02:16:38.125634+0000","last_undegraded":"2024-04-19T02:16:38.125634+0000","last_fullsized":"2024-04-19T02:16:38.125634+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:58:30.117887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.128742+0000","last_change":"2024-04-19T02:15:53.959207+0000","last_active":"2024-04-19T02:16:38.128742+0000","last_peered":"2024-04-19T02:16:38.128742+0000","last_clean":"2024-04-19T02:16:38.128742+0000","last_became_active":"2024-04-19T02:15:53.959007+0000","last_became_peered":"2024-04-19T02:15:53.959007+0000","last_unstale":"2024-04-19T02:16:38.128742+0000","last_undegraded":"2024-04-19T02:16:38.128742+0000","last_fullsized":"2024-04-19T02:16:38.128742+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:08:21.065077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.131864+0000","last_change":"2024-04-19T02:15:29.281792+0000","last_active":"2024-04-19T02:16:38.131864+0000","last_peered":"2024-04-19T02:16:38.131864+0000","last_clean":"2024-04-19T02:16:38.131864+0000","last_became_active":"2024-04-19T02:15:29.280479+0000","last_became_peered":"2024-04-19T02:15:29.280479+0000","last_unstale":"2024-04-19T02:16:38.131864+0000","last_undegraded":"2024-04-19T02:16:38.131864+0000","last_fullsized":"2024-04-19T02:16:38.131864+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.127830+0000","last_change":"2024-04-19T02:15:28.888778+0000","last_active":"2024-04-19T02:16:38.127830+0000","last_peered":"2024-04-19T02:16:38.127830+0000","last_clean":"2024-04-19T02:16:38.127830+0000","last_became_active":"2024-04-19T02:15:28.888543+0000","last_became_peered":"2024-04-19T02:15:28.888543+0000","last_unstale":"2024-04-19T02:16:38.127830+0000","last_undegraded":"2024-04-19T02:16:38.127830+0000","last_fullsized":"2024-04-19T02:16:38.127830+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:43:51.221619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.130133+0000","last_change":"2024-04-19T02:15:29.279986+0000","last_active":"2024-04-19T02:16:38.130133+0000","last_peered":"2024-04-19T02:16:38.130133+0000","last_clean":"2024-04-19T02:16:38.130133+0000","last_became_active":"2024-04-19T02:15:29.279690+0000","last_became_peered":"2024-04-19T02:15:29.279690+0000","last_unstale":"2024-04-19T02:16:38.130133+0000","last_undegraded":"2024-04-19T02:16:38.130133+0000","last_fullsized":"2024-04-19T02:16:38.130133+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.127935+0000","last_change":"2024-04-19T02:15:28.890463+0000","last_active":"2024-04-19T02:16:38.127935+0000","last_peered":"2024-04-19T02:16:38.127935+0000","last_clean":"2024-04-19T02:16:38.127935+0000","last_became_active":"2024-04-19T02:15:28.889777+0000","last_became_peered":"2024-04-19T02:15:28.889777+0000","last_unstale":"2024-04-19T02:16:38.127935+0000","last_undegraded":"2024-04-19T02:16:38.127935+0000","last_fullsized":"2024-04-19T02:16:38.127935+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:58:21.520250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.134166+0000","last_change":"2024-04-19T02:15:29.280879+0000","last_active":"2024-04-19T02:16:38.134166+0000","last_peered":"2024-04-19T02:16:38.134166+0000","last_clean":"2024-04-19T02:16:38.134166+0000","last_became_active":"2024-04-19T02:15:29.279314+0000","last_became_peered":"2024-04-19T02:15:29.279314+0000","last_unstale":"2024-04-19T02:16:38.134166+0000","last_undegraded":"2024-04-19T02:16:38.134166+0000","last_fullsized":"2024-04-19T02:16:38.134166+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.129302+0000","last_change":"2024-04-19T02:15:28.891867+0000","last_active":"2024-04-19T02:16:38.129302+0000","last_peered":"2024-04-19T02:16:38.129302+0000","last_clean":"2024-04-19T02:16:38.129302+0000","last_became_active":"2024-04-19T02:15:28.890806+0000","last_became_peered":"2024-04-19T02:15:28.890806+0000","last_unstale":"2024-04-19T02:16:38.129302+0000","last_undegraded":"2024-04-19T02:16:38.129302+0000","last_fullsized":"2024-04-19T02:16:38.129302+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:57.946581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.127778+0000","last_change":"2024-04-19T02:15:29.278148+0000","last_active":"2024-04-19T02:16:38.127778+0000","last_peered":"2024-04-19T02:16:38.127778+0000","last_clean":"2024-04-19T02:16:38.127778+0000","last_became_active":"2024-04-19T02:15:29.277402+0000","last_became_peered":"2024-04-19T02:15:29.277402+0000","last_unstale":"2024-04-19T02:16:38.127778+0000","last_undegraded":"2024-04-19T02:16:38.127778+0000","last_fullsized":"2024-04-19T02:16:38.127778+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125995+0000","last_change":"2024-04-19T02:15:28.892905+0000","last_active":"2024-04-19T02:16:38.125995+0000","last_peered":"2024-04-19T02:16:38.125995+0000","last_clean":"2024-04-19T02:16:38.125995+0000","last_became_active":"2024-04-19T02:15:28.892541+0000","last_became_peered":"2024-04-19T02:15:28.892541+0000","last_unstale":"2024-04-19T02:16:38.125995+0000","last_undegraded":"2024-04-19T02:16:38.125995+0000","last_fullsized":"2024-04-19T02:16:38.125995+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:33.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.127915+0000","last_change":"2024-04-19T02:15:29.278810+0000","last_active":"2024-04-19T02:16:38.127915+0000","last_peered":"2024-04-19T02:16:38.127915+0000","last_clean":"2024-04-19T02:16:38.127915+0000","last_became_active":"2024-04-19T02:15:29.278093+0000","last_became_peered":"2024-04-19T02:15:29.278093+0000","last_unstale":"2024-04-19T02:16:38.127915+0000","last_undegraded":"2024-04-19T02:16:38.127915+0000","last_fullsized":"2024-04-19T02:16:38.127915+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:34.883207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.131508+0000","last_change":"2024-04-19T02:15:28.892937+0000","last_active":"2024-04-19T02:16:38.131508+0000","last_peered":"2024-04-19T02:16:38.131508+0000","last_clean":"2024-04-19T02:16:38.131508+0000","last_became_active":"2024-04-19T02:15:28.891440+0000","last_became_peered":"2024-04-19T02:15:28.891440+0000","last_unstale":"2024-04-19T02:16:38.131508+0000","last_undegraded":"2024-04-19T02:16:38.131508+0000","last_fullsized":"2024-04-19T02:16:38.131508+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.128517+0000","last_change":"2024-04-19T02:15:29.278404+0000","last_active":"2024-04-19T02:16:38.128517+0000","last_peered":"2024-04-19T02:16:38.128517+0000","last_clean":"2024-04-19T02:16:38.128517+0000","last_became_active":"2024-04-19T02:15:29.277460+0000","last_became_peered":"2024-04-19T02:15:29.277460+0000","last_unstale":"2024-04-19T02:16:38.128517+0000","last_undegraded":"2024-04-19T02:16:38.128517+0000","last_fullsized":"2024-04-19T02:16:38.128517+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125431+0000","last_change":"2024-04-19T02:15:28.891097+0000","last_active":"2024-04-19T02:16:38.125431+0000","last_peered":"2024-04-19T02:16:38.125431+0000","last_clean":"2024-04-19T02:16:38.125431+0000","last_became_active":"2024-04-19T02:15:28.890795+0000","last_became_peered":"2024-04-19T02:15:28.890795+0000","last_unstale":"2024-04-19T02:16:38.125431+0000","last_undegraded":"2024-04-19T02:16:38.125431+0000","last_fullsized":"2024-04-19T02:16:38.125431+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125457+0000","last_change":"2024-04-19T02:15:29.278546+0000","last_active":"2024-04-19T02:16:38.125457+0000","last_peered":"2024-04-19T02:16:38.125457+0000","last_clean":"2024-04-19T02:16:38.125457+0000","last_became_active":"2024-04-19T02:15:29.277547+0000","last_became_peered":"2024-04-19T02:15:29.277547+0000","last_unstale":"2024-04-19T02:16:38.125457+0000","last_undegraded":"2024-04-19T02:16:38.125457+0000","last_fullsized":"2024-04-19T02:16:38.125457+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125363+0000","last_change":"2024-04-19T02:15:28.892977+0000","last_active":"2024-04-19T02:16:38.125363+0000","last_peered":"2024-04-19T02:16:38.125363+0000","last_clean":"2024-04-19T02:16:38.125363+0000","last_became_active":"2024-04-19T02:15:28.892636+0000","last_became_peered":"2024-04-19T02:15:28.892636+0000","last_unstale":"2024-04-19T02:16:38.125363+0000","last_undegraded":"2024-04-19T02:16:38.125363+0000","last_fullsized":"2024-04-19T02:16:38.125363+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:43:51.221619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.128204+0000","last_change":"2024-04-19T02:15:53.955655+0000","last_active":"2024-04-19T02:16:38.128204+0000","last_peered":"2024-04-19T02:16:38.128204+0000","last_clean":"2024-04-19T02:16:38.128204+0000","last_became_active":"2024-04-19T02:15:53.955382+0000","last_became_peered":"2024-04-19T02:15:53.955382+0000","last_unstale":"2024-04-19T02:16:38.128204+0000","last_undegraded":"2024-04-19T02:16:38.128204+0000","last_fullsized":"2024-04-19T02:16:38.128204+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:48.239260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.128658+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:16:38.128658+0000","last_peered":"2024-04-19T02:16:38.128658+0000","last_clean":"2024-04-19T02:16:38.128658+0000","last_became_active":"2024-04-19T02:15:28.890751+0000","last_became_peered":"2024-04-19T02:15:28.890751+0000","last_unstale":"2024-04-19T02:16:38.128658+0000","last_undegraded":"2024-04-19T02:16:38.128658+0000","last_fullsized":"2024-04-19T02:16:38.128658+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.129785+0000","last_change":"2024-04-19T02:15:53.957865+0000","last_active":"2024-04-19T02:16:38.129785+0000","last_peered":"2024-04-19T02:16:38.129785+0000","last_clean":"2024-04-19T02:16:38.129785+0000","last_became_active":"2024-04-19T02:15:53.957627+0000","last_became_peered":"2024-04-19T02:15:53.957627+0000","last_unstale":"2024-04-19T02:16:38.129785+0000","last_undegraded":"2024-04-19T02:16:38.129785+0000","last_fullsized":"2024-04-19T02:16:38.129785+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:16:45.799016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.132005+0000","last_change":"2024-04-19T02:15:28.892934+0000","last_active":"2024-04-19T02:16:38.132005+0000","last_peered":"2024-04-19T02:16:38.132005+0000","last_clean":"2024-04-19T02:16:38.132005+0000","last_became_active":"2024-04-19T02:15:28.891879+0000","last_became_peered":"2024-04-19T02:15:28.891879+0000","last_unstale":"2024-04-19T02:16:38.132005+0000","last_undegraded":"2024-04-19T02:16:38.132005+0000","last_fullsized":"2024-04-19T02:16:38.132005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:10:12.514798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.130259+0000","last_change":"2024-04-19T02:15:29.279685+0000","last_active":"2024-04-19T02:16:38.130259+0000","last_peered":"2024-04-19T02:16:38.130259+0000","last_clean":"2024-04-19T02:16:38.130259+0000","last_became_active":"2024-04-19T02:15:29.278810+0000","last_became_peered":"2024-04-19T02:15:29.278810+0000","last_unstale":"2024-04-19T02:16:38.130259+0000","last_undegraded":"2024-04-19T02:16:38.130259+0000","last_fullsized":"2024-04-19T02:16:38.130259+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125302+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:16:38.125302+0000","last_peered":"2024-04-19T02:16:38.125302+0000","last_clean":"2024-04-19T02:16:38.125302+0000","last_became_active":"2024-04-19T02:15:28.890882+0000","last_became_peered":"2024-04-19T02:15:28.890882+0000","last_unstale":"2024-04-19T02:16:38.125302+0000","last_undegraded":"2024-04-19T02:16:38.125302+0000","last_fullsized":"2024-04-19T02:16:38.125302+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:31.673938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.129839+0000","last_change":"2024-04-19T02:15:29.284258+0000","last_active":"2024-04-19T02:16:38.129839+0000","last_peered":"2024-04-19T02:16:38.129839+0000","last_clean":"2024-04-19T02:16:38.129839+0000","last_became_active":"2024-04-19T02:15:29.283995+0000","last_became_peered":"2024-04-19T02:15:29.283995+0000","last_unstale":"2024-04-19T02:16:38.129839+0000","last_undegraded":"2024-04-19T02:16:38.129839+0000","last_fullsized":"2024-04-19T02:16:38.129839+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:35.941308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"39'6991","reported_seq":7022,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-19T02:16:42.806242+0000","last_change":"2024-04-19T02:15:53.956977+0000","last_active":"2024-04-19T02:16:42.806242+0000","last_peered":"2024-04-19T02:16:42.806242+0000","last_clean":"2024-04-19T02:16:42.806242+0000","last_became_active":"2024-04-19T02:15:53.956730+0000","last_became_peered":"2024-04-19T02:15:53.956730+0000","last_unstale":"2024-04-19T02:16:42.806242+0000","last_undegraded":"2024-04-19T02:16:42.806242+0000","last_fullsized":"2024-04-19T02:16:42.806242+0000","mapping_epoch":16,"log_start":"24'3300","ondisk_log_start":"24'3300","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3691,"log_dups_size":0,"ondisk_log_size":3691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:56:46.323499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458162176,"num_objects":6991,"num_object_clones":0,"num_object_copies":13982,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6991,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6991,"num_write_kb":447424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125282+0000","last_change":"2024-04-19T02:15:28.890265+0000","last_active":"2024-04-19T02:16:38.125282+0000","last_peered":"2024-04-19T02:16:38.125282+0000","last_clean":"2024-04-19T02:16:38.125282+0000","last_became_active":"2024-04-19T02:15:28.890004+0000","last_became_peered":"2024-04-19T02:15:28.890004+0000","last_unstale":"2024-04-19T02:16:38.125282+0000","last_undegraded":"2024-04-19T02:16:38.125282+0000","last_fullsized":"2024-04-19T02:16:38.125282+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:02.517101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.130955+0000","last_change":"2024-04-19T02:15:29.285529+0000","last_active":"2024-04-19T02:16:38.130955+0000","last_peered":"2024-04-19T02:16:38.130955+0000","last_clean":"2024-04-19T02:16:38.130955+0000","last_became_active":"2024-04-19T02:15:29.285197+0000","last_became_peered":"2024-04-19T02:15:29.285197+0000","last_unstale":"2024-04-19T02:16:38.130955+0000","last_undegraded":"2024-04-19T02:16:38.130955+0000","last_fullsized":"2024-04-19T02:16:38.130955+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"39'6945","reported_seq":6976,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-19T02:16:42.725902+0000","last_change":"2024-04-19T02:15:53.958523+0000","last_active":"2024-04-19T02:16:42.725902+0000","last_peered":"2024-04-19T02:16:42.725902+0000","last_clean":"2024-04-19T02:16:42.725902+0000","last_became_active":"2024-04-19T02:15:53.957627+0000","last_became_peered":"2024-04-19T02:15:53.957627+0000","last_unstale":"2024-04-19T02:16:42.725902+0000","last_undegraded":"2024-04-19T02:16:42.725902+0000","last_fullsized":"2024-04-19T02:16:42.725902+0000","mapping_epoch":16,"log_start":"24'3047","ondisk_log_start":"24'3047","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3898,"log_dups_size":0,"ondisk_log_size":3898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:59:55.120296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":455147520,"num_objects":6945,"num_object_clones":0,"num_object_copies":13890,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6945,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6945,"num_write_kb":444480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.131522+0000","last_change":"2024-04-19T02:15:28.893902+0000","last_active":"2024-04-19T02:16:38.131522+0000","last_peered":"2024-04-19T02:16:38.131522+0000","last_clean":"2024-04-19T02:16:38.131522+0000","last_became_active":"2024-04-19T02:15:28.893231+0000","last_became_peered":"2024-04-19T02:15:28.893231+0000","last_unstale":"2024-04-19T02:16:38.131522+0000","last_undegraded":"2024-04-19T02:16:38.131522+0000","last_fullsized":"2024-04-19T02:16:38.131522+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:23.658442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.132132+0000","last_change":"2024-04-19T02:15:29.282874+0000","last_active":"2024-04-19T02:16:38.132132+0000","last_peered":"2024-04-19T02:16:38.132132+0000","last_clean":"2024-04-19T02:16:38.132132+0000","last_became_active":"2024-04-19T02:15:29.281675+0000","last_became_peered":"2024-04-19T02:15:29.281675+0000","last_unstale":"2024-04-19T02:16:38.132132+0000","last_undegraded":"2024-04-19T02:16:38.132132+0000","last_fullsized":"2024-04-19T02:16:38.132132+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:35.941308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"39'6789","reported_seq":6820,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-19T02:16:42.755946+0000","last_change":"2024-04-19T02:15:53.958324+0000","last_active":"2024-04-19T02:16:42.755946+0000","last_peered":"2024-04-19T02:16:42.755946+0000","last_clean":"2024-04-19T02:16:42.755946+0000","last_became_active":"2024-04-19T02:15:53.957392+0000","last_became_peered":"2024-04-19T02:15:53.957392+0000","last_unstale":"2024-04-19T02:16:42.755946+0000","last_undegraded":"2024-04-19T02:16:42.755946+0000","last_fullsized":"2024-04-19T02:16:42.755946+0000","mapping_epoch":16,"log_start":"23'2800","ondisk_log_start":"23'2800","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3989,"log_dups_size":0,"ondisk_log_size":3989,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:12:58.132969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444923904,"num_objects":6789,"num_object_clones":0,"num_object_copies":13578,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6789,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6789,"num_write_kb":434496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125637+0000","last_change":"2024-04-19T02:15:28.891234+0000","last_active":"2024-04-19T02:16:38.125637+0000","last_peered":"2024-04-19T02:16:38.125637+0000","last_clean":"2024-04-19T02:16:38.125637+0000","last_became_active":"2024-04-19T02:15:28.890881+0000","last_became_peered":"2024-04-19T02:15:28.890881+0000","last_unstale":"2024-04-19T02:16:38.125637+0000","last_undegraded":"2024-04-19T02:16:38.125637+0000","last_fullsized":"2024-04-19T02:16:38.125637+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125068+0000","last_change":"2024-04-19T02:15:29.281937+0000","last_active":"2024-04-19T02:16:38.125068+0000","last_peered":"2024-04-19T02:16:38.125068+0000","last_clean":"2024-04-19T02:16:38.125068+0000","last_became_active":"2024-04-19T02:15:29.280727+0000","last_became_peered":"2024-04-19T02:15:29.280727+0000","last_unstale":"2024-04-19T02:16:38.125068+0000","last_undegraded":"2024-04-19T02:16:38.125068+0000","last_fullsized":"2024-04-19T02:16:38.125068+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"39'6969","reported_seq":7000,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-19T02:16:42.762749+0000","last_change":"2024-04-19T02:15:53.959099+0000","last_active":"2024-04-19T02:16:42.762749+0000","last_peered":"2024-04-19T02:16:42.762749+0000","last_clean":"2024-04-19T02:16:42.762749+0000","last_became_active":"2024-04-19T02:15:53.958885+0000","last_became_peered":"2024-04-19T02:15:53.958885+0000","last_unstale":"2024-04-19T02:16:42.762749+0000","last_undegraded":"2024-04-19T02:16:42.762749+0000","last_fullsized":"2024-04-19T02:16:42.762749+0000","mapping_epoch":16,"log_start":"24'3300","ondisk_log_start":"24'3300","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3669,"log_dups_size":0,"ondisk_log_size":3669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:53:26.969927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":456720384,"num_objects":6969,"num_object_clones":0,"num_object_copies":13938,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6969,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6969,"num_write_kb":446016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125126+0000","last_change":"2024-04-19T02:15:28.892767+0000","last_active":"2024-04-19T02:16:38.125126+0000","last_peered":"2024-04-19T02:16:38.125126+0000","last_clean":"2024-04-19T02:16:38.125126+0000","last_became_active":"2024-04-19T02:15:28.892235+0000","last_became_peered":"2024-04-19T02:15:28.892235+0000","last_unstale":"2024-04-19T02:16:38.125126+0000","last_undegraded":"2024-04-19T02:16:38.125126+0000","last_fullsized":"2024-04-19T02:16:38.125126+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:37.690735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.128671+0000","last_change":"2024-04-19T02:15:29.279857+0000","last_active":"2024-04-19T02:16:38.128671+0000","last_peered":"2024-04-19T02:16:38.128671+0000","last_clean":"2024-04-19T02:16:38.128671+0000","last_became_active":"2024-04-19T02:15:29.279536+0000","last_became_peered":"2024-04-19T02:15:29.279536+0000","last_unstale":"2024-04-19T02:16:38.128671+0000","last_undegraded":"2024-04-19T02:16:38.128671+0000","last_fullsized":"2024-04-19T02:16:38.128671+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:00.191179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"39'6850","reported_seq":6881,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-19T02:16:42.795184+0000","last_change":"2024-04-19T02:15:53.957261+0000","last_active":"2024-04-19T02:16:42.795184+0000","last_peered":"2024-04-19T02:16:42.795184+0000","last_clean":"2024-04-19T02:16:42.795184+0000","last_became_active":"2024-04-19T02:15:53.957092+0000","last_became_peered":"2024-04-19T02:15:53.957092+0000","last_unstale":"2024-04-19T02:16:42.795184+0000","last_undegraded":"2024-04-19T02:16:42.795184+0000","last_fullsized":"2024-04-19T02:16:42.795184+0000","mapping_epoch":16,"log_start":"24'3113","ondisk_log_start":"24'3113","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3737,"log_dups_size":0,"ondisk_log_size":3737,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:54:15.544923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448921600,"num_objects":6850,"num_object_clones":0,"num_object_copies":13700,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6850,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6850,"num_write_kb":438400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.128548+0000","last_change":"2024-04-19T02:15:28.891611+0000","last_active":"2024-04-19T02:16:38.128548+0000","last_peered":"2024-04-19T02:16:38.128548+0000","last_clean":"2024-04-19T02:16:38.128548+0000","last_became_active":"2024-04-19T02:15:28.890914+0000","last_became_peered":"2024-04-19T02:15:28.890914+0000","last_unstale":"2024-04-19T02:16:38.128548+0000","last_undegraded":"2024-04-19T02:16:38.128548+0000","last_fullsized":"2024-04-19T02:16:38.128548+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:37.690735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125197+0000","last_change":"2024-04-19T02:15:29.285774+0000","last_active":"2024-04-19T02:16:38.125197+0000","last_peered":"2024-04-19T02:16:38.125197+0000","last_clean":"2024-04-19T02:16:38.125197+0000","last_became_active":"2024-04-19T02:15:29.284705+0000","last_became_peered":"2024-04-19T02:15:29.284705+0000","last_unstale":"2024-04-19T02:16:38.125197+0000","last_undegraded":"2024-04-19T02:16:38.125197+0000","last_fullsized":"2024-04-19T02:16:38.125197+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"39'6832","reported_seq":6863,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-19T02:16:42.778464+0000","last_change":"2024-04-19T02:15:53.955286+0000","last_active":"2024-04-19T02:16:42.778464+0000","last_peered":"2024-04-19T02:16:42.778464+0000","last_clean":"2024-04-19T02:16:42.778464+0000","last_became_active":"2024-04-19T02:15:53.955026+0000","last_became_peered":"2024-04-19T02:15:53.955026+0000","last_unstale":"2024-04-19T02:16:42.778464+0000","last_undegraded":"2024-04-19T02:16:42.778464+0000","last_fullsized":"2024-04-19T02:16:42.778464+0000","mapping_epoch":16,"log_start":"24'3200","ondisk_log_start":"24'3200","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3632,"log_dups_size":0,"ondisk_log_size":3632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:05:48.594301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":447741952,"num_objects":6832,"num_object_clones":0,"num_object_copies":13664,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6832,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6832,"num_write_kb":437248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.124911+0000","last_change":"2024-04-19T02:15:28.892873+0000","last_active":"2024-04-19T02:16:38.124911+0000","last_peered":"2024-04-19T02:16:38.124911+0000","last_clean":"2024-04-19T02:16:38.124911+0000","last_became_active":"2024-04-19T02:15:28.892487+0000","last_became_peered":"2024-04-19T02:15:28.892487+0000","last_unstale":"2024-04-19T02:16:38.124911+0000","last_undegraded":"2024-04-19T02:16:38.124911+0000","last_fullsized":"2024-04-19T02:16:38.124911+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:35.412837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125817+0000","last_change":"2024-04-19T02:15:29.285019+0000","last_active":"2024-04-19T02:16:38.125817+0000","last_peered":"2024-04-19T02:16:38.125817+0000","last_clean":"2024-04-19T02:16:38.125817+0000","last_became_active":"2024-04-19T02:15:29.284650+0000","last_became_peered":"2024-04-19T02:15:29.284650+0000","last_unstale":"2024-04-19T02:16:38.125817+0000","last_undegraded":"2024-04-19T02:16:38.125817+0000","last_fullsized":"2024-04-19T02:16:38.125817+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"39'6889","reported_seq":6920,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-19T02:16:42.809700+0000","last_change":"2024-04-19T02:15:53.957403+0000","last_active":"2024-04-19T02:16:42.809700+0000","last_peered":"2024-04-19T02:16:42.809700+0000","last_clean":"2024-04-19T02:16:42.809700+0000","last_became_active":"2024-04-19T02:15:53.957190+0000","last_became_peered":"2024-04-19T02:15:53.957190+0000","last_unstale":"2024-04-19T02:16:42.809700+0000","last_undegraded":"2024-04-19T02:16:42.809700+0000","last_fullsized":"2024-04-19T02:16:42.809700+0000","mapping_epoch":16,"log_start":"24'3201","ondisk_log_start":"24'3201","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3688,"log_dups_size":0,"ondisk_log_size":3688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:07:12.817884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451477504,"num_objects":6889,"num_object_clones":0,"num_object_copies":13778,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6889,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6889,"num_write_kb":440896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.124978+0000","last_change":"2024-04-19T02:15:53.956839+0000","last_active":"2024-04-19T02:16:38.124978+0000","last_peered":"2024-04-19T02:16:38.124978+0000","last_clean":"2024-04-19T02:16:38.124978+0000","last_became_active":"2024-04-19T02:15:53.956630+0000","last_became_peered":"2024-04-19T02:15:53.956630+0000","last_unstale":"2024-04-19T02:16:38.124978+0000","last_undegraded":"2024-04-19T02:16:38.124978+0000","last_fullsized":"2024-04-19T02:16:38.124978+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:47.229730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.126019+0000","last_change":"2024-04-19T02:15:29.287190+0000","last_active":"2024-04-19T02:16:38.126019+0000","last_peered":"2024-04-19T02:16:38.126019+0000","last_clean":"2024-04-19T02:16:38.126019+0000","last_became_active":"2024-04-19T02:15:29.286606+0000","last_became_peered":"2024-04-19T02:15:29.286606+0000","last_unstale":"2024-04-19T02:16:38.126019+0000","last_undegraded":"2024-04-19T02:16:38.126019+0000","last_fullsized":"2024-04-19T02:16:38.126019+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:28.387062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"39'6749","reported_seq":6780,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-19T02:16:42.744153+0000","last_change":"2024-04-19T02:15:53.958448+0000","last_active":"2024-04-19T02:16:42.744153+0000","last_peered":"2024-04-19T02:16:42.744153+0000","last_clean":"2024-04-19T02:16:42.744153+0000","last_became_active":"2024-04-19T02:15:53.957595+0000","last_became_peered":"2024-04-19T02:15:53.957595+0000","last_unstale":"2024-04-19T02:16:42.744153+0000","last_undegraded":"2024-04-19T02:16:42.744153+0000","last_fullsized":"2024-04-19T02:16:42.744153+0000","mapping_epoch":16,"log_start":"23'2844","ondisk_log_start":"23'2844","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3905,"log_dups_size":0,"ondisk_log_size":3905,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:26:31.855319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442302464,"num_objects":6749,"num_object_clones":0,"num_object_copies":13498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6749,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6749,"num_write_kb":431936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.131092+0000","last_change":"2024-04-19T02:15:28.894121+0000","last_active":"2024-04-19T02:16:38.131092+0000","last_peered":"2024-04-19T02:16:38.131092+0000","last_clean":"2024-04-19T02:16:38.131092+0000","last_became_active":"2024-04-19T02:15:28.893902+0000","last_became_peered":"2024-04-19T02:15:28.893902+0000","last_unstale":"2024-04-19T02:16:38.131092+0000","last_undegraded":"2024-04-19T02:16:38.131092+0000","last_fullsized":"2024-04-19T02:16:38.131092+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:10:35.146583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.129171+0000","last_change":"2024-04-19T02:15:29.282870+0000","last_active":"2024-04-19T02:16:38.129171+0000","last_peered":"2024-04-19T02:16:38.129171+0000","last_clean":"2024-04-19T02:16:38.129171+0000","last_became_active":"2024-04-19T02:15:29.281873+0000","last_became_peered":"2024-04-19T02:15:29.281873+0000","last_unstale":"2024-04-19T02:16:38.129171+0000","last_undegraded":"2024-04-19T02:16:38.129171+0000","last_fullsized":"2024-04-19T02:16:38.129171+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"39'6903","reported_seq":6934,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-19T02:16:42.771497+0000","last_change":"2024-04-19T02:15:53.955498+0000","last_active":"2024-04-19T02:16:42.771497+0000","last_peered":"2024-04-19T02:16:42.771497+0000","last_clean":"2024-04-19T02:16:42.771497+0000","last_became_active":"2024-04-19T02:15:53.954910+0000","last_became_peered":"2024-04-19T02:15:53.954910+0000","last_unstale":"2024-04-19T02:16:42.771497+0000","last_undegraded":"2024-04-19T02:16:42.771497+0000","last_fullsized":"2024-04-19T02:16:42.771497+0000","mapping_epoch":16,"log_start":"24'3300","ondisk_log_start":"24'3300","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3603,"log_dups_size":0,"ondisk_log_size":3603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:58:27.262672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":452395008,"num_objects":6903,"num_object_clones":0,"num_object_copies":13806,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6903,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6903,"num_write_kb":441792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.128556+0000","last_change":"2024-04-19T02:15:24.527061+0000","last_active":"2024-04-19T02:16:38.128556+0000","last_peered":"2024-04-19T02:16:38.128556+0000","last_clean":"2024-04-19T02:16:38.128556+0000","last_became_active":"2024-04-19T02:15:24.526757+0000","last_became_peered":"2024-04-19T02:15:24.526757+0000","last_unstale":"2024-04-19T02:16:38.128556+0000","last_undegraded":"2024-04-19T02:16:38.128556+0000","last_fullsized":"2024-04-19T02:16:38.128556+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:17:13.649077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125723+0000","last_change":"2024-04-19T02:15:28.892766+0000","last_active":"2024-04-19T02:16:38.125723+0000","last_peered":"2024-04-19T02:16:38.125723+0000","last_clean":"2024-04-19T02:16:38.125723+0000","last_became_active":"2024-04-19T02:15:28.892396+0000","last_became_peered":"2024-04-19T02:15:28.892396+0000","last_unstale":"2024-04-19T02:16:38.125723+0000","last_undegraded":"2024-04-19T02:16:38.125723+0000","last_fullsized":"2024-04-19T02:16:38.125723+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:57.946581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.131216+0000","last_change":"2024-04-19T02:15:29.277922+0000","last_active":"2024-04-19T02:16:38.131216+0000","last_peered":"2024-04-19T02:16:38.131216+0000","last_clean":"2024-04-19T02:16:38.131216+0000","last_became_active":"2024-04-19T02:15:29.276968+0000","last_became_peered":"2024-04-19T02:15:29.276968+0000","last_unstale":"2024-04-19T02:16:38.131216+0000","last_undegraded":"2024-04-19T02:16:38.131216+0000","last_fullsized":"2024-04-19T02:16:38.131216+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"39'6854","reported_seq":6885,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-19T02:16:42.783346+0000","last_change":"2024-04-19T02:15:53.955228+0000","last_active":"2024-04-19T02:16:42.783346+0000","last_peered":"2024-04-19T02:16:42.783346+0000","last_clean":"2024-04-19T02:16:42.783346+0000","last_became_active":"2024-04-19T02:15:53.954960+0000","last_became_peered":"2024-04-19T02:15:53.954960+0000","last_unstale":"2024-04-19T02:16:42.783346+0000","last_undegraded":"2024-04-19T02:16:42.783346+0000","last_fullsized":"2024-04-19T02:16:42.783346+0000","mapping_epoch":16,"log_start":"24'3200","ondisk_log_start":"24'3200","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3654,"log_dups_size":0,"ondisk_log_size":3654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:46:07.409922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449183744,"num_objects":6854,"num_object_clones":0,"num_object_copies":13708,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6854,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6854,"num_write_kb":438656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125552+0000","last_change":"2024-04-19T02:15:24.530933+0000","last_active":"2024-04-19T02:16:38.125552+0000","last_peered":"2024-04-19T02:16:38.125552+0000","last_clean":"2024-04-19T02:16:38.125552+0000","last_became_active":"2024-04-19T02:15:24.530550+0000","last_became_peered":"2024-04-19T02:15:24.530550+0000","last_unstale":"2024-04-19T02:16:38.125552+0000","last_undegraded":"2024-04-19T02:16:38.125552+0000","last_fullsized":"2024-04-19T02:16:38.125552+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:18:15.194321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125285+0000","last_change":"2024-04-19T02:15:28.893062+0000","last_active":"2024-04-19T02:16:38.125285+0000","last_peered":"2024-04-19T02:16:38.125285+0000","last_clean":"2024-04-19T02:16:38.125285+0000","last_became_active":"2024-04-19T02:15:28.892798+0000","last_became_peered":"2024-04-19T02:15:28.892798+0000","last_unstale":"2024-04-19T02:16:38.125285+0000","last_undegraded":"2024-04-19T02:16:38.125285+0000","last_fullsized":"2024-04-19T02:16:38.125285+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:53.170180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.128397+0000","last_change":"2024-04-19T02:15:29.278294+0000","last_active":"2024-04-19T02:16:38.128397+0000","last_peered":"2024-04-19T02:16:38.128397+0000","last_clean":"2024-04-19T02:16:38.128397+0000","last_became_active":"2024-04-19T02:15:29.277536+0000","last_became_peered":"2024-04-19T02:15:29.277536+0000","last_unstale":"2024-04-19T02:16:38.128397+0000","last_undegraded":"2024-04-19T02:16:38.128397+0000","last_fullsized":"2024-04-19T02:16:38.128397+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"39'6902","reported_seq":6933,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-19T02:16:42.771784+0000","last_change":"2024-04-19T02:15:53.956251+0000","last_active":"2024-04-19T02:16:42.771784+0000","last_peered":"2024-04-19T02:16:42.771784+0000","last_clean":"2024-04-19T02:16:42.771784+0000","last_became_active":"2024-04-19T02:15:53.955886+0000","last_became_peered":"2024-04-19T02:15:53.955886+0000","last_unstale":"2024-04-19T02:16:42.771784+0000","last_undegraded":"2024-04-19T02:16:42.771784+0000","last_fullsized":"2024-04-19T02:16:42.771784+0000","mapping_epoch":16,"log_start":"24'3300","ondisk_log_start":"24'3300","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3602,"log_dups_size":0,"ondisk_log_size":3602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:38:38.586906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":452329472,"num_objects":6902,"num_object_clones":0,"num_object_copies":13804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6902,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6902,"num_write_kb":441728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.127758+0000","last_change":"2024-04-19T02:15:24.527048+0000","last_active":"2024-04-19T02:16:38.127758+0000","last_peered":"2024-04-19T02:16:38.127758+0000","last_clean":"2024-04-19T02:16:38.127758+0000","last_became_active":"2024-04-19T02:15:24.526790+0000","last_became_peered":"2024-04-19T02:15:24.526790+0000","last_unstale":"2024-04-19T02:16:38.127758+0000","last_undegraded":"2024-04-19T02:16:38.127758+0000","last_fullsized":"2024-04-19T02:16:38.127758+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.124484+0000","last_change":"2024-04-19T02:15:53.956945+0000","last_active":"2024-04-19T02:16:38.124484+0000","last_peered":"2024-04-19T02:16:38.124484+0000","last_clean":"2024-04-19T02:16:38.124484+0000","last_became_active":"2024-04-19T02:15:53.956719+0000","last_became_peered":"2024-04-19T02:15:53.956719+0000","last_unstale":"2024-04-19T02:16:38.124484+0000","last_undegraded":"2024-04-19T02:16:38.124484+0000","last_fullsized":"2024-04-19T02:16:38.124484+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:00:37.754624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.129362+0000","last_change":"2024-04-19T02:15:29.282663+0000","last_active":"2024-04-19T02:16:38.129362+0000","last_peered":"2024-04-19T02:16:38.129362+0000","last_clean":"2024-04-19T02:16:38.129362+0000","last_became_active":"2024-04-19T02:15:29.282217+0000","last_became_peered":"2024-04-19T02:15:29.282217+0000","last_unstale":"2024-04-19T02:16:38.129362+0000","last_undegraded":"2024-04-19T02:16:38.129362+0000","last_fullsized":"2024-04-19T02:16:38.129362+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"39'6789","reported_seq":6819,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-19T02:16:42.760465+0000","last_change":"2024-04-19T02:15:53.958264+0000","last_active":"2024-04-19T02:16:42.760465+0000","last_peered":"2024-04-19T02:16:42.760465+0000","last_clean":"2024-04-19T02:16:42.760465+0000","last_became_active":"2024-04-19T02:15:53.956689+0000","last_became_peered":"2024-04-19T02:15:53.956689+0000","last_unstale":"2024-04-19T02:16:42.760465+0000","last_undegraded":"2024-04-19T02:16:42.760465+0000","last_fullsized":"2024-04-19T02:16:42.760465+0000","mapping_epoch":16,"log_start":"23'2800","ondisk_log_start":"23'2800","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3989,"log_dups_size":0,"ondisk_log_size":3989,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:24:32.928594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444923904,"num_objects":6789,"num_object_clones":0,"num_object_copies":13578,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6789,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6789,"num_write_kb":434496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125371+0000","last_change":"2024-04-19T02:15:24.530924+0000","last_active":"2024-04-19T02:16:38.125371+0000","last_peered":"2024-04-19T02:16:38.125371+0000","last_clean":"2024-04-19T02:16:38.125371+0000","last_became_active":"2024-04-19T02:15:24.530551+0000","last_became_peered":"2024-04-19T02:15:24.530551+0000","last_unstale":"2024-04-19T02:16:38.125371+0000","last_undegraded":"2024-04-19T02:16:38.125371+0000","last_fullsized":"2024-04-19T02:16:38.125371+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:30.576946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":234,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.124663+0000","last_change":"2024-04-19T02:15:24.533634+0000","last_active":"2024-04-19T02:16:38.124663+0000","last_peered":"2024-04-19T02:16:38.124663+0000","last_clean":"2024-04-19T02:16:38.124663+0000","last_became_active":"2024-04-19T02:15:24.533420+0000","last_became_peered":"2024-04-19T02:15:24.533420+0000","last_unstale":"2024-04-19T02:16:38.124663+0000","last_undegraded":"2024-04-19T02:16:38.124663+0000","last_fullsized":"2024-04-19T02:16:38.124663+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.128444+0000","last_change":"2024-04-19T02:15:28.890244+0000","last_active":"2024-04-19T02:16:38.128444+0000","last_peered":"2024-04-19T02:16:38.128444+0000","last_clean":"2024-04-19T02:16:38.128444+0000","last_became_active":"2024-04-19T02:15:28.889831+0000","last_became_peered":"2024-04-19T02:15:28.889831+0000","last_unstale":"2024-04-19T02:16:38.128444+0000","last_undegraded":"2024-04-19T02:16:38.128444+0000","last_fullsized":"2024-04-19T02:16:38.128444+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125812+0000","last_change":"2024-04-19T02:15:29.285015+0000","last_active":"2024-04-19T02:16:38.125812+0000","last_peered":"2024-04-19T02:16:38.125812+0000","last_clean":"2024-04-19T02:16:38.125812+0000","last_became_active":"2024-04-19T02:15:29.284164+0000","last_became_peered":"2024-04-19T02:15:29.284164+0000","last_unstale":"2024-04-19T02:16:38.125812+0000","last_undegraded":"2024-04-19T02:16:38.125812+0000","last_fullsized":"2024-04-19T02:16:38.125812+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:36.987844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"39'6856","reported_seq":6886,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-19T02:16:42.796524+0000","last_change":"2024-04-19T02:15:53.956463+0000","last_active":"2024-04-19T02:16:42.796524+0000","last_peered":"2024-04-19T02:16:42.796524+0000","last_clean":"2024-04-19T02:16:42.796524+0000","last_became_active":"2024-04-19T02:15:53.955819+0000","last_became_peered":"2024-04-19T02:15:53.955819+0000","last_unstale":"2024-04-19T02:16:42.796524+0000","last_undegraded":"2024-04-19T02:16:42.796524+0000","last_fullsized":"2024-04-19T02:16:42.796524+0000","mapping_epoch":16,"log_start":"24'3131","ondisk_log_start":"24'3131","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3725,"log_dups_size":0,"ondisk_log_size":3725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:46:07.409922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449314816,"num_objects":6856,"num_object_clones":0,"num_object_copies":13712,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6856,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6856,"num_write_kb":438784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125127+0000","last_change":"2024-04-19T02:15:24.533912+0000","last_active":"2024-04-19T02:16:38.125127+0000","last_peered":"2024-04-19T02:16:38.125127+0000","last_clean":"2024-04-19T02:16:38.125127+0000","last_became_active":"2024-04-19T02:15:24.533580+0000","last_became_peered":"2024-04-19T02:15:24.533580+0000","last_unstale":"2024-04-19T02:16:38.125127+0000","last_undegraded":"2024-04-19T02:16:38.125127+0000","last_fullsized":"2024-04-19T02:16:38.125127+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:45.045477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.127685+0000","last_change":"2024-04-19T02:15:28.891889+0000","last_active":"2024-04-19T02:16:38.127685+0000","last_peered":"2024-04-19T02:16:38.127685+0000","last_clean":"2024-04-19T02:16:38.127685+0000","last_became_active":"2024-04-19T02:15:28.890919+0000","last_became_peered":"2024-04-19T02:15:28.890919+0000","last_unstale":"2024-04-19T02:16:38.127685+0000","last_undegraded":"2024-04-19T02:16:38.127685+0000","last_fullsized":"2024-04-19T02:16:38.127685+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:35.412837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.129964+0000","last_change":"2024-04-19T02:15:53.957881+0000","last_active":"2024-04-19T02:16:38.129964+0000","last_peered":"2024-04-19T02:16:38.129964+0000","last_clean":"2024-04-19T02:16:38.129964+0000","last_became_active":"2024-04-19T02:15:53.957657+0000","last_became_peered":"2024-04-19T02:15:53.957657+0000","last_unstale":"2024-04-19T02:16:38.129964+0000","last_undegraded":"2024-04-19T02:16:38.129964+0000","last_fullsized":"2024-04-19T02:16:38.129964+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:46.921714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"39'6851","reported_seq":6882,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-19T02:16:42.787856+0000","last_change":"2024-04-19T02:15:53.955068+0000","last_active":"2024-04-19T02:16:42.787856+0000","last_peered":"2024-04-19T02:16:42.787856+0000","last_clean":"2024-04-19T02:16:42.787856+0000","last_became_active":"2024-04-19T02:15:53.954721+0000","last_became_peered":"2024-04-19T02:15:53.954721+0000","last_unstale":"2024-04-19T02:16:42.787856+0000","last_undegraded":"2024-04-19T02:16:42.787856+0000","last_fullsized":"2024-04-19T02:16:42.787856+0000","mapping_epoch":16,"log_start":"24'3100","ondisk_log_start":"24'3100","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3751,"log_dups_size":0,"ondisk_log_size":3751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:18:29.742535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448987136,"num_objects":6851,"num_object_clones":0,"num_object_copies":13702,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6851,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6851,"num_write_kb":438464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.131877+0000","last_change":"2024-04-19T02:15:53.959105+0000","last_active":"2024-04-19T02:16:38.131877+0000","last_peered":"2024-04-19T02:16:38.131877+0000","last_clean":"2024-04-19T02:16:38.131877+0000","last_became_active":"2024-04-19T02:15:53.958836+0000","last_became_peered":"2024-04-19T02:15:53.958836+0000","last_unstale":"2024-04-19T02:16:38.131877+0000","last_undegraded":"2024-04-19T02:16:38.131877+0000","last_fullsized":"2024-04-19T02:16:38.131877+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:18:00.321514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.128410+0000","last_change":"2024-04-19T02:15:28.892125+0000","last_active":"2024-04-19T02:16:38.128410+0000","last_peered":"2024-04-19T02:16:38.128410+0000","last_clean":"2024-04-19T02:16:38.128410+0000","last_became_active":"2024-04-19T02:15:28.891300+0000","last_became_peered":"2024-04-19T02:15:28.891300+0000","last_unstale":"2024-04-19T02:16:38.128410+0000","last_undegraded":"2024-04-19T02:16:38.128410+0000","last_fullsized":"2024-04-19T02:16:38.128410+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.131317+0000","last_change":"2024-04-19T02:15:29.281694+0000","last_active":"2024-04-19T02:16:38.131317+0000","last_peered":"2024-04-19T02:16:38.131317+0000","last_clean":"2024-04-19T02:16:38.131317+0000","last_became_active":"2024-04-19T02:15:29.280519+0000","last_became_peered":"2024-04-19T02:15:29.280519+0000","last_unstale":"2024-04-19T02:16:38.131317+0000","last_undegraded":"2024-04-19T02:16:38.131317+0000","last_fullsized":"2024-04-19T02:16:38.131317+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:50.890545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"39'6695","reported_seq":12743,"reported_epoch":39,"state":"active+remapped+backfilling","last_fresh":"2024-04-19T02:16:42.781295+0000","last_change":"2024-04-19T02:16:30.103016+0000","last_active":"2024-04-19T02:16:42.781295+0000","last_peered":"2024-04-19T02:16:42.781295+0000","last_clean":"2024-04-19T02:16:22.050311+0000","last_became_active":"2024-04-19T02:16:24.119992+0000","last_became_peered":"2024-04-19T02:16:24.119992+0000","last_unstale":"2024-04-19T02:16:42.781295+0000","last_undegraded":"2024-04-19T02:16:42.781295+0000","last_fullsized":"2024-04-19T02:16:42.781295+0000","mapping_epoch":29,"log_start":"24'3037","ondisk_log_start":"24'3037","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3658,"log_dups_size":0,"ondisk_log_size":3658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:28.663111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":438763520,"num_objects":6695,"num_object_clones":0,"num_object_copies":13390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2982,"num_objects_unfound":0,"num_objects_dirty":6695,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6695,"num_write_kb":428480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3002,"num_bytes_recovered":196739072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[{"shards":"0,2","objects":6695}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.129107+0000","last_change":"2024-04-19T02:15:28.891702+0000","last_active":"2024-04-19T02:16:38.129107+0000","last_peered":"2024-04-19T02:16:38.129107+0000","last_clean":"2024-04-19T02:16:38.129107+0000","last_became_active":"2024-04-19T02:15:28.890743+0000","last_became_peered":"2024-04-19T02:15:28.890743+0000","last_unstale":"2024-04-19T02:16:38.129107+0000","last_undegraded":"2024-04-19T02:16:38.129107+0000","last_fullsized":"2024-04-19T02:16:38.129107+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.130226+0000","last_change":"2024-04-19T02:15:24.526845+0000","last_active":"2024-04-19T02:16:38.130226+0000","last_peered":"2024-04-19T02:16:38.130226+0000","last_clean":"2024-04-19T02:16:38.130226+0000","last_became_active":"2024-04-19T02:15:24.526500+0000","last_became_peered":"2024-04-19T02:15:24.526500+0000","last_unstale":"2024-04-19T02:16:38.130226+0000","last_undegraded":"2024-04-19T02:16:38.130226+0000","last_fullsized":"2024-04-19T02:16:38.130226+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:16.883355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.127690+0000","last_change":"2024-04-19T02:15:29.278686+0000","last_active":"2024-04-19T02:16:38.127690+0000","last_peered":"2024-04-19T02:16:38.127690+0000","last_clean":"2024-04-19T02:16:38.127690+0000","last_became_active":"2024-04-19T02:15:29.278108+0000","last_became_peered":"2024-04-19T02:15:29.278108+0000","last_unstale":"2024-04-19T02:16:38.127690+0000","last_undegraded":"2024-04-19T02:16:38.127690+0000","last_fullsized":"2024-04-19T02:16:38.127690+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:34.593754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"39'6698","reported_seq":6729,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-19T02:16:42.753764+0000","last_change":"2024-04-19T02:15:53.957269+0000","last_active":"2024-04-19T02:16:42.753764+0000","last_peered":"2024-04-19T02:16:42.753764+0000","last_clean":"2024-04-19T02:16:42.753764+0000","last_became_active":"2024-04-19T02:15:53.956554+0000","last_became_peered":"2024-04-19T02:15:53.956554+0000","last_unstale":"2024-04-19T02:16:42.753764+0000","last_undegraded":"2024-04-19T02:16:42.753764+0000","last_fullsized":"2024-04-19T02:16:42.753764+0000","mapping_epoch":16,"log_start":"23'2728","ondisk_log_start":"23'2728","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3970,"log_dups_size":0,"ondisk_log_size":3970,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:29:38.789719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":438960128,"num_objects":6698,"num_object_clones":0,"num_object_copies":13396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6698,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6698,"num_write_kb":428672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125316+0000","last_change":"2024-04-19T02:15:24.533777+0000","last_active":"2024-04-19T02:16:38.125316+0000","last_peered":"2024-04-19T02:16:38.125316+0000","last_clean":"2024-04-19T02:16:38.125316+0000","last_became_active":"2024-04-19T02:15:24.533436+0000","last_became_peered":"2024-04-19T02:15:24.533436+0000","last_unstale":"2024-04-19T02:16:38.125316+0000","last_undegraded":"2024-04-19T02:16:38.125316+0000","last_fullsized":"2024-04-19T02:16:38.125316+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:53:25.922418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.130130+0000","last_change":"2024-04-19T02:15:28.891370+0000","last_active":"2024-04-19T02:16:38.130130+0000","last_peered":"2024-04-19T02:16:38.130130+0000","last_clean":"2024-04-19T02:16:38.130130+0000","last_became_active":"2024-04-19T02:15:28.890702+0000","last_became_peered":"2024-04-19T02:15:28.890702+0000","last_unstale":"2024-04-19T02:16:38.130130+0000","last_undegraded":"2024-04-19T02:16:38.130130+0000","last_fullsized":"2024-04-19T02:16:38.130130+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:33.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.132102+0000","last_change":"2024-04-19T02:15:29.282244+0000","last_active":"2024-04-19T02:16:38.132102+0000","last_peered":"2024-04-19T02:16:38.132102+0000","last_clean":"2024-04-19T02:16:38.132102+0000","last_became_active":"2024-04-19T02:15:29.280366+0000","last_became_peered":"2024-04-19T02:15:29.280366+0000","last_unstale":"2024-04-19T02:16:38.132102+0000","last_undegraded":"2024-04-19T02:16:38.132102+0000","last_fullsized":"2024-04-19T02:16:38.132102+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.131397+0000","last_change":"2024-04-19T02:15:28.893027+0000","last_active":"2024-04-19T02:16:38.131397+0000","last_peered":"2024-04-19T02:16:38.131397+0000","last_clean":"2024-04-19T02:16:38.131397+0000","last_became_active":"2024-04-19T02:15:28.892695+0000","last_became_peered":"2024-04-19T02:15:28.892695+0000","last_unstale":"2024-04-19T02:16:38.131397+0000","last_undegraded":"2024-04-19T02:16:38.131397+0000","last_fullsized":"2024-04-19T02:16:38.131397+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.131592+0000","last_change":"2024-04-19T02:15:29.283155+0000","last_active":"2024-04-19T02:16:38.131592+0000","last_peered":"2024-04-19T02:16:38.131592+0000","last_clean":"2024-04-19T02:16:38.131592+0000","last_became_active":"2024-04-19T02:15:29.281407+0000","last_became_peered":"2024-04-19T02:15:29.281407+0000","last_unstale":"2024-04-19T02:16:38.131592+0000","last_undegraded":"2024-04-19T02:16:38.131592+0000","last_fullsized":"2024-04-19T02:16:38.131592+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125351+0000","last_change":"2024-04-19T02:15:28.893067+0000","last_active":"2024-04-19T02:16:38.125351+0000","last_peered":"2024-04-19T02:16:38.125351+0000","last_clean":"2024-04-19T02:16:38.125351+0000","last_became_active":"2024-04-19T02:15:28.892781+0000","last_became_peered":"2024-04-19T02:15:28.892781+0000","last_unstale":"2024-04-19T02:16:38.125351+0000","last_undegraded":"2024-04-19T02:16:38.125351+0000","last_fullsized":"2024-04-19T02:16:38.125351+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:54:15.590143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125200+0000","last_change":"2024-04-19T02:15:29.281279+0000","last_active":"2024-04-19T02:16:38.125200+0000","last_peered":"2024-04-19T02:16:38.125200+0000","last_clean":"2024-04-19T02:16:38.125200+0000","last_became_active":"2024-04-19T02:15:29.279360+0000","last_became_peered":"2024-04-19T02:15:29.279360+0000","last_unstale":"2024-04-19T02:16:38.125200+0000","last_undegraded":"2024-04-19T02:16:38.125200+0000","last_fullsized":"2024-04-19T02:16:38.125200+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.131694+0000","last_change":"2024-04-19T02:15:28.893239+0000","last_active":"2024-04-19T02:16:38.131694+0000","last_peered":"2024-04-19T02:16:38.131694+0000","last_clean":"2024-04-19T02:16:38.131694+0000","last_became_active":"2024-04-19T02:15:28.892881+0000","last_became_peered":"2024-04-19T02:15:28.892881+0000","last_unstale":"2024-04-19T02:16:38.131694+0000","last_undegraded":"2024-04-19T02:16:38.131694+0000","last_fullsized":"2024-04-19T02:16:38.131694+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125014+0000","last_change":"2024-04-19T02:15:29.281652+0000","last_active":"2024-04-19T02:16:38.125014+0000","last_peered":"2024-04-19T02:16:38.125014+0000","last_clean":"2024-04-19T02:16:38.125014+0000","last_became_active":"2024-04-19T02:15:29.281175+0000","last_became_peered":"2024-04-19T02:15:29.281175+0000","last_unstale":"2024-04-19T02:16:38.125014+0000","last_undegraded":"2024-04-19T02:16:38.125014+0000","last_fullsized":"2024-04-19T02:16:38.125014+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:16.568764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.130331+0000","last_change":"2024-04-19T02:15:28.892058+0000","last_active":"2024-04-19T02:16:38.130331+0000","last_peered":"2024-04-19T02:16:38.130331+0000","last_clean":"2024-04-19T02:16:38.130331+0000","last_became_active":"2024-04-19T02:15:28.890877+0000","last_became_peered":"2024-04-19T02:15:28.890877+0000","last_unstale":"2024-04-19T02:16:38.130331+0000","last_undegraded":"2024-04-19T02:16:38.130331+0000","last_fullsized":"2024-04-19T02:16:38.130331+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:53.170180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.132218+0000","last_change":"2024-04-19T02:15:29.278810+0000","last_active":"2024-04-19T02:16:38.132218+0000","last_peered":"2024-04-19T02:16:38.132218+0000","last_clean":"2024-04-19T02:16:38.132218+0000","last_became_active":"2024-04-19T02:15:29.277913+0000","last_became_peered":"2024-04-19T02:15:29.277913+0000","last_unstale":"2024-04-19T02:16:38.132218+0000","last_undegraded":"2024-04-19T02:16:38.132218+0000","last_fullsized":"2024-04-19T02:16:38.132218+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:24.082666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.129238+0000","last_change":"2024-04-19T02:15:28.889132+0000","last_active":"2024-04-19T02:16:38.129238+0000","last_peered":"2024-04-19T02:16:38.129238+0000","last_clean":"2024-04-19T02:16:38.129238+0000","last_became_active":"2024-04-19T02:15:28.888926+0000","last_became_peered":"2024-04-19T02:15:28.888926+0000","last_unstale":"2024-04-19T02:16:38.129238+0000","last_undegraded":"2024-04-19T02:16:38.129238+0000","last_fullsized":"2024-04-19T02:16:38.129238+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125335+0000","last_change":"2024-04-19T02:15:29.282776+0000","last_active":"2024-04-19T02:16:38.125335+0000","last_peered":"2024-04-19T02:16:38.125335+0000","last_clean":"2024-04-19T02:16:38.125335+0000","last_became_active":"2024-04-19T02:15:29.279382+0000","last_became_peered":"2024-04-19T02:15:29.279382+0000","last_unstale":"2024-04-19T02:16:38.125335+0000","last_undegraded":"2024-04-19T02:16:38.125335+0000","last_fullsized":"2024-04-19T02:16:38.125335+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125225+0000","last_change":"2024-04-19T02:15:29.283537+0000","last_active":"2024-04-19T02:16:38.125225+0000","last_peered":"2024-04-19T02:16:38.125225+0000","last_clean":"2024-04-19T02:16:38.125225+0000","last_became_active":"2024-04-19T02:15:29.281801+0000","last_became_peered":"2024-04-19T02:15:29.281801+0000","last_unstale":"2024-04-19T02:16:38.125225+0000","last_undegraded":"2024-04-19T02:16:38.125225+0000","last_fullsized":"2024-04-19T02:16:38.125225+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.127730+0000","last_change":"2024-04-19T02:15:29.281560+0000","last_active":"2024-04-19T02:16:38.127730+0000","last_peered":"2024-04-19T02:16:38.127730+0000","last_clean":"2024-04-19T02:16:38.127730+0000","last_became_active":"2024-04-19T02:15:29.281261+0000","last_became_peered":"2024-04-19T02:15:29.281261+0000","last_unstale":"2024-04-19T02:16:38.127730+0000","last_undegraded":"2024-04-19T02:16:38.127730+0000","last_fullsized":"2024-04-19T02:16:38.127730+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.124752+0000","last_change":"2024-04-19T02:15:53.955913+0000","last_active":"2024-04-19T02:16:38.124752+0000","last_peered":"2024-04-19T02:16:38.124752+0000","last_clean":"2024-04-19T02:16:38.124752+0000","last_became_active":"2024-04-19T02:15:53.955676+0000","last_became_peered":"2024-04-19T02:15:53.955676+0000","last_unstale":"2024-04-19T02:16:38.124752+0000","last_undegraded":"2024-04-19T02:16:38.124752+0000","last_fullsized":"2024-04-19T02:16:38.124752+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:53:02.899902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.128739+0000","last_change":"2024-04-19T02:15:29.278702+0000","last_active":"2024-04-19T02:16:38.128739+0000","last_peered":"2024-04-19T02:16:38.128739+0000","last_clean":"2024-04-19T02:16:38.128739+0000","last_became_active":"2024-04-19T02:15:29.277756+0000","last_became_peered":"2024-04-19T02:15:29.277756+0000","last_unstale":"2024-04-19T02:16:38.128739+0000","last_undegraded":"2024-04-19T02:16:38.128739+0000","last_fullsized":"2024-04-19T02:16:38.128739+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.131743+0000","last_change":"2024-04-19T02:15:29.277568+0000","last_active":"2024-04-19T02:16:38.131743+0000","last_peered":"2024-04-19T02:16:38.131743+0000","last_clean":"2024-04-19T02:16:38.131743+0000","last_became_active":"2024-04-19T02:15:29.276725+0000","last_became_peered":"2024-04-19T02:15:29.276725+0000","last_unstale":"2024-04-19T02:16:38.131743+0000","last_undegraded":"2024-04-19T02:16:38.131743+0000","last_fullsized":"2024-04-19T02:16:38.131743+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":7180255232,"num_objects":109562,"num_object_clones":0,"num_object_copies":219124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2982,"num_objects_unfound":0,"num_objects_dirty":109562,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109562,"num_write_kb":7011968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3002,"num_bytes_recovered":196739072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":14604566528,"data_stored":14604566528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60161,"ondisk_log_size":60161,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738386,"num_pgs":84,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5767476,"kb_used_data":5628072,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":88604364,"statfs":{"total":96636764160,"available":90730868736,"internally_reserved":0,"allocated":5763145728,"data_stored":5762870456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":142735814},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.313,"15min":0.313},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.497,"5min":0.497,"15min":0.497},"last":0.17699999999999999},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.193}]},{"osd":1,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.20999999999999999},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.318}]}]},{"osd":0,"up_from":8,"seq":34359738387,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4450512,"kb_used_data":4347204,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":89921328,"statfs":{"total":96636764160,"available":92079439872,"internally_reserved":0,"allocated":4451536896,"data_stored":4451235242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":105773510},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.219},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.27300000000000002}]},{"osd":2,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":2.1000000000000001,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.25700000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738386,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4273672,"kb_used_data":4174460,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":90098168,"statfs":{"total":96636764160,"available":92260524032,"internally_reserved":0,"allocated":4274647040,"data_stored":4274352962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":101579206},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:16:26 2024","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.157},{"interface":"front","average":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"min":{"1min":0.16,"5min":0.16,"15min":0.16},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.20100000000000001}]},{"osd":2,"last update":"Fri Apr 19 02:16:26 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.23899999999999999},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":2.2370000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4498063360,"data_stored":4498063360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4283432960,"data_stored":4283432960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5823070208,"data_stored":5823070208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:16:46.381 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-19T02:16:46.423 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:46.423+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:46.517 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:46.518 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:46.524 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:46.525+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:46.533 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:16:46.625 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:46.626+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:46.707 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:46.707 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:46.721 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:16:46.726 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:46.726+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:46.828 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:46.827+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:46.845 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:16:46.845 INFO:teuthology.orchestra.run.smithi121.stdout:{"fsid":"f6ab5dd0-bb9f-4b48-a9fc-4728c7955ca8","health":{"status":"HEALTH_WARN","checks":{"OSDMAP_FLAGS":{"severity":"HEALTH_WARN","summary":{"message":"noscrub,nodeep-scrub flag(s) set","count":20},"muted":false}},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":92,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":40,"num_osds":3,"num_up_osds":3,"osd_up_since":1713492922,"num_in_osds":3,"osd_in_since":1713492915,"num_remapped_pgs":1},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":120},{"state_name":"active+remapped+backfilling","count":1}],"num_pgs":121,"num_pools":5,"num_objects":109586,"data_bytes":7180847962,"bytes_used":14839459840,"bytes_avail":275070832640,"bytes_total":289910292480,"misplaced_objects":2982,"misplaced_total":219172,"misplaced_ratio":0.013605752559633527,"recovering_objects_per_sec":115,"recovering_bytes_per_sec":7536804,"recovering_keys_per_sec":0,"num_objects_recovered":762,"num_bytes_recovered":49938432,"num_keys_recovered":0,"write_bytes_sec":97256431,"read_op_per_sec":0,"write_op_per_sec":1484},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4230}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-04-19T02:16:34.750409+0000","services":{}},"progress_events":{}} 2024-04-19T02:16:46.859 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-04-19T02:16:46.859 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:16:46.910 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:46.910 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:46.926 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:16:46.928 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:46.928+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:47.029 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:47.029+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:47.029 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 52 16 118095 118079 141.91 124.75 0.00516277 0.00704409 2024-04-19T02:16:47.112 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:47.112 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:47.131 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:47.130+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:47.131 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:16:47.156 INFO:teuthology.orchestra.run.smithi121.stderr:noscrub is unset 2024-04-19T02:16:47.205 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:16:47.207 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-04-19T02:16:47.216 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2024-04-19T02:16:47.151530+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":7180847962,"num_objects":109586,"num_object_clones":0,"num_object_copies":219172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2982,"num_objects_unfound":0,"num_objects_dirty":109586,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":109810,"num_write_kb":7015442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3002,"num_bytes_recovered":196739072,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60357,"ondisk_log_size":60357,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":243,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":14491660,"kb_used_data":14149736,"kb_used_omap":4,"kb_used_meta":341883,"kb_avail":268623860,"statfs":{"total":289910292480,"available":275070832640,"internally_reserved":0,"allocated":14489329664,"data_stored":14488458660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":350088530},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":644415488,"num_objects":9833,"num_object_clones":0,"num_object_copies":19666,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-445,"num_objects_unfound":0,"num_objects_dirty":9833,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9833,"num_write_kb":629312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":762,"num_bytes_recovered":49938432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.400333"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.134244+0000","last_change":"2024-04-19T02:15:29.280412+0000","last_active":"2024-04-19T02:16:38.134244+0000","last_peered":"2024-04-19T02:16:38.134244+0000","last_clean":"2024-04-19T02:16:38.134244+0000","last_became_active":"2024-04-19T02:15:29.278762+0000","last_became_peered":"2024-04-19T02:15:29.278762+0000","last_unstale":"2024-04-19T02:16:38.134244+0000","last_undegraded":"2024-04-19T02:16:38.134244+0000","last_fullsized":"2024-04-19T02:16:38.134244+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:45.301675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.131443+0000","last_change":"2024-04-19T02:15:29.284695+0000","last_active":"2024-04-19T02:16:38.131443+0000","last_peered":"2024-04-19T02:16:38.131443+0000","last_clean":"2024-04-19T02:16:38.131443+0000","last_became_active":"2024-04-19T02:15:29.283468+0000","last_became_peered":"2024-04-19T02:15:29.283468+0000","last_unstale":"2024-04-19T02:16:38.131443+0000","last_undegraded":"2024-04-19T02:16:38.131443+0000","last_fullsized":"2024-04-19T02:16:38.131443+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.384881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125717+0000","last_change":"2024-04-19T02:15:29.286709+0000","last_active":"2024-04-19T02:16:38.125717+0000","last_peered":"2024-04-19T02:16:38.125717+0000","last_clean":"2024-04-19T02:16:38.125717+0000","last_became_active":"2024-04-19T02:15:29.286169+0000","last_became_peered":"2024-04-19T02:15:29.286169+0000","last_unstale":"2024-04-19T02:16:38.125717+0000","last_undegraded":"2024-04-19T02:16:38.125717+0000","last_fullsized":"2024-04-19T02:16:38.125717+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:58.741466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125602+0000","last_change":"2024-04-19T02:15:29.280131+0000","last_active":"2024-04-19T02:16:38.125602+0000","last_peered":"2024-04-19T02:16:38.125602+0000","last_clean":"2024-04-19T02:16:38.125602+0000","last_became_active":"2024-04-19T02:15:29.279388+0000","last_became_peered":"2024-04-19T02:15:29.279388+0000","last_unstale":"2024-04-19T02:16:38.125602+0000","last_undegraded":"2024-04-19T02:16:38.125602+0000","last_fullsized":"2024-04-19T02:16:38.125602+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:36:48.819486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.128402+0000","last_change":"2024-04-19T02:15:53.955892+0000","last_active":"2024-04-19T02:16:38.128402+0000","last_peered":"2024-04-19T02:16:38.128402+0000","last_clean":"2024-04-19T02:16:38.128402+0000","last_became_active":"2024-04-19T02:15:53.955553+0000","last_became_peered":"2024-04-19T02:15:53.955553+0000","last_unstale":"2024-04-19T02:16:38.128402+0000","last_undegraded":"2024-04-19T02:16:38.128402+0000","last_fullsized":"2024-04-19T02:16:38.128402+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:45:39.791209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.124872+0000","last_change":"2024-04-19T02:15:29.283908+0000","last_active":"2024-04-19T02:16:38.124872+0000","last_peered":"2024-04-19T02:16:38.124872+0000","last_clean":"2024-04-19T02:16:38.124872+0000","last_became_active":"2024-04-19T02:15:29.281729+0000","last_became_peered":"2024-04-19T02:15:29.281729+0000","last_unstale":"2024-04-19T02:16:38.124872+0000","last_undegraded":"2024-04-19T02:16:38.124872+0000","last_fullsized":"2024-04-19T02:16:38.124872+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:03:15.383476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.124744+0000","last_change":"2024-04-19T02:15:29.281253+0000","last_active":"2024-04-19T02:16:38.124744+0000","last_peered":"2024-04-19T02:16:38.124744+0000","last_clean":"2024-04-19T02:16:38.124744+0000","last_became_active":"2024-04-19T02:15:29.279951+0000","last_became_peered":"2024-04-19T02:15:29.279951+0000","last_unstale":"2024-04-19T02:16:38.124744+0000","last_undegraded":"2024-04-19T02:16:38.124744+0000","last_fullsized":"2024-04-19T02:16:38.124744+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.124566+0000","last_change":"2024-04-19T02:15:29.283952+0000","last_active":"2024-04-19T02:16:38.124566+0000","last_peered":"2024-04-19T02:16:38.124566+0000","last_clean":"2024-04-19T02:16:38.124566+0000","last_became_active":"2024-04-19T02:15:29.282721+0000","last_became_peered":"2024-04-19T02:15:29.282721+0000","last_unstale":"2024-04-19T02:16:38.124566+0000","last_undegraded":"2024-04-19T02:16:38.124566+0000","last_fullsized":"2024-04-19T02:16:38.124566+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:45.301675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.128974+0000","last_change":"2024-04-19T02:15:29.282150+0000","last_active":"2024-04-19T02:16:38.128974+0000","last_peered":"2024-04-19T02:16:38.128974+0000","last_clean":"2024-04-19T02:16:38.128974+0000","last_became_active":"2024-04-19T02:15:29.281538+0000","last_became_peered":"2024-04-19T02:15:29.281538+0000","last_unstale":"2024-04-19T02:16:38.128974+0000","last_undegraded":"2024-04-19T02:16:38.128974+0000","last_fullsized":"2024-04-19T02:16:38.128974+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125014+0000","last_change":"2024-04-19T02:16:30.093524+0000","last_active":"2024-04-19T02:16:38.125014+0000","last_peered":"2024-04-19T02:16:38.125014+0000","last_clean":"2024-04-19T02:16:38.125014+0000","last_became_active":"2024-04-19T02:16:30.093344+0000","last_became_peered":"2024-04-19T02:16:30.093344+0000","last_unstale":"2024-04-19T02:16:38.125014+0000","last_undegraded":"2024-04-19T02:16:38.125014+0000","last_fullsized":"2024-04-19T02:16:38.125014+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:14:40.293159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125524+0000","last_change":"2024-04-19T02:15:29.280606+0000","last_active":"2024-04-19T02:16:38.125524+0000","last_peered":"2024-04-19T02:16:38.125524+0000","last_clean":"2024-04-19T02:16:38.125524+0000","last_became_active":"2024-04-19T02:15:29.280151+0000","last_became_peered":"2024-04-19T02:15:29.280151+0000","last_unstale":"2024-04-19T02:16:38.125524+0000","last_undegraded":"2024-04-19T02:16:38.125524+0000","last_fullsized":"2024-04-19T02:16:38.125524+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:26:22.452488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125269+0000","last_change":"2024-04-19T02:15:53.958876+0000","last_active":"2024-04-19T02:16:38.125269+0000","last_peered":"2024-04-19T02:16:38.125269+0000","last_clean":"2024-04-19T02:16:38.125269+0000","last_became_active":"2024-04-19T02:15:53.958626+0000","last_became_peered":"2024-04-19T02:15:53.958626+0000","last_unstale":"2024-04-19T02:16:38.125269+0000","last_undegraded":"2024-04-19T02:16:38.125269+0000","last_fullsized":"2024-04-19T02:16:38.125269+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:23:57.044018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.128076+0000","last_change":"2024-04-19T02:15:53.956801+0000","last_active":"2024-04-19T02:16:38.128076+0000","last_peered":"2024-04-19T02:16:38.128076+0000","last_clean":"2024-04-19T02:16:38.128076+0000","last_became_active":"2024-04-19T02:15:53.956620+0000","last_became_peered":"2024-04-19T02:15:53.956620+0000","last_unstale":"2024-04-19T02:16:38.128076+0000","last_undegraded":"2024-04-19T02:16:38.128076+0000","last_fullsized":"2024-04-19T02:16:38.128076+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:57:05.843101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125627+0000","last_change":"2024-04-19T02:15:29.284262+0000","last_active":"2024-04-19T02:16:38.125627+0000","last_peered":"2024-04-19T02:16:38.125627+0000","last_clean":"2024-04-19T02:16:38.125627+0000","last_became_active":"2024-04-19T02:15:29.283121+0000","last_became_peered":"2024-04-19T02:15:29.283121+0000","last_unstale":"2024-04-19T02:16:38.125627+0000","last_undegraded":"2024-04-19T02:16:38.125627+0000","last_fullsized":"2024-04-19T02:16:38.125627+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.124909+0000","last_change":"2024-04-19T02:15:29.285139+0000","last_active":"2024-04-19T02:16:38.124909+0000","last_peered":"2024-04-19T02:16:38.124909+0000","last_clean":"2024-04-19T02:16:38.124909+0000","last_became_active":"2024-04-19T02:15:29.284649+0000","last_became_peered":"2024-04-19T02:15:29.284649+0000","last_unstale":"2024-04-19T02:16:38.124909+0000","last_undegraded":"2024-04-19T02:16:38.124909+0000","last_fullsized":"2024-04-19T02:16:38.124909+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.124643+0000","last_change":"2024-04-19T02:15:29.283648+0000","last_active":"2024-04-19T02:16:38.124643+0000","last_peered":"2024-04-19T02:16:38.124643+0000","last_clean":"2024-04-19T02:16:38.124643+0000","last_became_active":"2024-04-19T02:15:29.281606+0000","last_became_peered":"2024-04-19T02:15:29.281606+0000","last_unstale":"2024-04-19T02:16:38.124643+0000","last_undegraded":"2024-04-19T02:16:38.124643+0000","last_fullsized":"2024-04-19T02:16:38.124643+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.129038+0000","last_change":"2024-04-19T02:15:29.278673+0000","last_active":"2024-04-19T02:16:38.129038+0000","last_peered":"2024-04-19T02:16:38.129038+0000","last_clean":"2024-04-19T02:16:38.129038+0000","last_became_active":"2024-04-19T02:15:29.277699+0000","last_became_peered":"2024-04-19T02:15:29.277699+0000","last_unstale":"2024-04-19T02:16:38.129038+0000","last_undegraded":"2024-04-19T02:16:38.129038+0000","last_fullsized":"2024-04-19T02:16:38.129038+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.131801+0000","last_change":"2024-04-19T02:15:29.283341+0000","last_active":"2024-04-19T02:16:38.131801+0000","last_peered":"2024-04-19T02:16:38.131801+0000","last_clean":"2024-04-19T02:16:38.131801+0000","last_became_active":"2024-04-19T02:15:29.281591+0000","last_became_peered":"2024-04-19T02:15:29.281591+0000","last_unstale":"2024-04-19T02:16:38.131801+0000","last_undegraded":"2024-04-19T02:16:38.131801+0000","last_fullsized":"2024-04-19T02:16:38.131801+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:34.593754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.131909+0000","last_change":"2024-04-19T02:15:29.282110+0000","last_active":"2024-04-19T02:16:38.131909+0000","last_peered":"2024-04-19T02:16:38.131909+0000","last_clean":"2024-04-19T02:16:38.131909+0000","last_became_active":"2024-04-19T02:15:29.281716+0000","last_became_peered":"2024-04-19T02:15:29.281716+0000","last_unstale":"2024-04-19T02:16:38.131909+0000","last_undegraded":"2024-04-19T02:16:38.131909+0000","last_fullsized":"2024-04-19T02:16:38.131909+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125513+0000","last_change":"2024-04-19T02:15:29.285237+0000","last_active":"2024-04-19T02:16:38.125513+0000","last_peered":"2024-04-19T02:16:38.125513+0000","last_clean":"2024-04-19T02:16:38.125513+0000","last_became_active":"2024-04-19T02:15:29.282790+0000","last_became_peered":"2024-04-19T02:15:29.282790+0000","last_unstale":"2024-04-19T02:16:38.125513+0000","last_undegraded":"2024-04-19T02:16:38.125513+0000","last_fullsized":"2024-04-19T02:16:38.125513+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.124951+0000","last_change":"2024-04-19T02:15:29.282609+0000","last_active":"2024-04-19T02:16:38.124951+0000","last_peered":"2024-04-19T02:16:38.124951+0000","last_clean":"2024-04-19T02:16:38.124951+0000","last_became_active":"2024-04-19T02:15:29.281665+0000","last_became_peered":"2024-04-19T02:15:29.281665+0000","last_unstale":"2024-04-19T02:16:38.124951+0000","last_undegraded":"2024-04-19T02:16:38.124951+0000","last_fullsized":"2024-04-19T02:16:38.124951+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.384881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.124792+0000","last_change":"2024-04-19T02:15:53.955813+0000","last_active":"2024-04-19T02:16:38.124792+0000","last_peered":"2024-04-19T02:16:38.124792+0000","last_clean":"2024-04-19T02:16:38.124792+0000","last_became_active":"2024-04-19T02:15:53.955614+0000","last_became_peered":"2024-04-19T02:15:53.955614+0000","last_unstale":"2024-04-19T02:16:38.124792+0000","last_undegraded":"2024-04-19T02:16:38.124792+0000","last_fullsized":"2024-04-19T02:16:38.124792+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:58:03.192647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.127805+0000","last_change":"2024-04-19T02:15:29.277109+0000","last_active":"2024-04-19T02:16:38.127805+0000","last_peered":"2024-04-19T02:16:38.127805+0000","last_clean":"2024-04-19T02:16:38.127805+0000","last_became_active":"2024-04-19T02:15:29.275417+0000","last_became_peered":"2024-04-19T02:15:29.275417+0000","last_unstale":"2024-04-19T02:16:38.127805+0000","last_undegraded":"2024-04-19T02:16:38.127805+0000","last_fullsized":"2024-04-19T02:16:38.127805+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.131121+0000","last_change":"2024-04-19T02:15:29.283266+0000","last_active":"2024-04-19T02:16:38.131121+0000","last_peered":"2024-04-19T02:16:38.131121+0000","last_clean":"2024-04-19T02:16:38.131121+0000","last_became_active":"2024-04-19T02:15:29.281505+0000","last_became_peered":"2024-04-19T02:15:29.281505+0000","last_unstale":"2024-04-19T02:16:38.131121+0000","last_undegraded":"2024-04-19T02:16:38.131121+0000","last_fullsized":"2024-04-19T02:16:38.131121+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.134184+0000","last_change":"2024-04-19T02:15:29.278084+0000","last_active":"2024-04-19T02:16:38.134184+0000","last_peered":"2024-04-19T02:16:38.134184+0000","last_clean":"2024-04-19T02:16:38.134184+0000","last_became_active":"2024-04-19T02:15:29.276952+0000","last_became_peered":"2024-04-19T02:15:29.276952+0000","last_unstale":"2024-04-19T02:16:38.134184+0000","last_undegraded":"2024-04-19T02:16:38.134184+0000","last_fullsized":"2024-04-19T02:16:38.134184+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.130333+0000","last_change":"2024-04-19T02:15:29.279904+0000","last_active":"2024-04-19T02:16:38.130333+0000","last_peered":"2024-04-19T02:16:38.130333+0000","last_clean":"2024-04-19T02:16:38.130333+0000","last_became_active":"2024-04-19T02:15:29.278938+0000","last_became_peered":"2024-04-19T02:15:29.278938+0000","last_unstale":"2024-04-19T02:16:38.130333+0000","last_undegraded":"2024-04-19T02:16:38.130333+0000","last_fullsized":"2024-04-19T02:16:38.130333+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125634+0000","last_change":"2024-04-19T02:15:29.287389+0000","last_active":"2024-04-19T02:16:38.125634+0000","last_peered":"2024-04-19T02:16:38.125634+0000","last_clean":"2024-04-19T02:16:38.125634+0000","last_became_active":"2024-04-19T02:15:29.286431+0000","last_became_peered":"2024-04-19T02:15:29.286431+0000","last_unstale":"2024-04-19T02:16:38.125634+0000","last_undegraded":"2024-04-19T02:16:38.125634+0000","last_fullsized":"2024-04-19T02:16:38.125634+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:58:30.117887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.128742+0000","last_change":"2024-04-19T02:15:53.959207+0000","last_active":"2024-04-19T02:16:38.128742+0000","last_peered":"2024-04-19T02:16:38.128742+0000","last_clean":"2024-04-19T02:16:38.128742+0000","last_became_active":"2024-04-19T02:15:53.959007+0000","last_became_peered":"2024-04-19T02:15:53.959007+0000","last_unstale":"2024-04-19T02:16:38.128742+0000","last_undegraded":"2024-04-19T02:16:38.128742+0000","last_fullsized":"2024-04-19T02:16:38.128742+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:08:21.065077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.131864+0000","last_change":"2024-04-19T02:15:29.281792+0000","last_active":"2024-04-19T02:16:38.131864+0000","last_peered":"2024-04-19T02:16:38.131864+0000","last_clean":"2024-04-19T02:16:38.131864+0000","last_became_active":"2024-04-19T02:15:29.280479+0000","last_became_peered":"2024-04-19T02:15:29.280479+0000","last_unstale":"2024-04-19T02:16:38.131864+0000","last_undegraded":"2024-04-19T02:16:38.131864+0000","last_fullsized":"2024-04-19T02:16:38.131864+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.127830+0000","last_change":"2024-04-19T02:15:28.888778+0000","last_active":"2024-04-19T02:16:38.127830+0000","last_peered":"2024-04-19T02:16:38.127830+0000","last_clean":"2024-04-19T02:16:38.127830+0000","last_became_active":"2024-04-19T02:15:28.888543+0000","last_became_peered":"2024-04-19T02:15:28.888543+0000","last_unstale":"2024-04-19T02:16:38.127830+0000","last_undegraded":"2024-04-19T02:16:38.127830+0000","last_fullsized":"2024-04-19T02:16:38.127830+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:43:51.221619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.130133+0000","last_change":"2024-04-19T02:15:29.279986+0000","last_active":"2024-04-19T02:16:38.130133+0000","last_peered":"2024-04-19T02:16:38.130133+0000","last_clean":"2024-04-19T02:16:38.130133+0000","last_became_active":"2024-04-19T02:15:29.279690+0000","last_became_peered":"2024-04-19T02:15:29.279690+0000","last_unstale":"2024-04-19T02:16:38.130133+0000","last_undegraded":"2024-04-19T02:16:38.130133+0000","last_fullsized":"2024-04-19T02:16:38.130133+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.127935+0000","last_change":"2024-04-19T02:15:28.890463+0000","last_active":"2024-04-19T02:16:38.127935+0000","last_peered":"2024-04-19T02:16:38.127935+0000","last_clean":"2024-04-19T02:16:38.127935+0000","last_became_active":"2024-04-19T02:15:28.889777+0000","last_became_peered":"2024-04-19T02:15:28.889777+0000","last_unstale":"2024-04-19T02:16:38.127935+0000","last_undegraded":"2024-04-19T02:16:38.127935+0000","last_fullsized":"2024-04-19T02:16:38.127935+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:58:21.520250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.134166+0000","last_change":"2024-04-19T02:15:29.280879+0000","last_active":"2024-04-19T02:16:38.134166+0000","last_peered":"2024-04-19T02:16:38.134166+0000","last_clean":"2024-04-19T02:16:38.134166+0000","last_became_active":"2024-04-19T02:15:29.279314+0000","last_became_peered":"2024-04-19T02:15:29.279314+0000","last_unstale":"2024-04-19T02:16:38.134166+0000","last_undegraded":"2024-04-19T02:16:38.134166+0000","last_fullsized":"2024-04-19T02:16:38.134166+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.129302+0000","last_change":"2024-04-19T02:15:28.891867+0000","last_active":"2024-04-19T02:16:38.129302+0000","last_peered":"2024-04-19T02:16:38.129302+0000","last_clean":"2024-04-19T02:16:38.129302+0000","last_became_active":"2024-04-19T02:15:28.890806+0000","last_became_peered":"2024-04-19T02:15:28.890806+0000","last_unstale":"2024-04-19T02:16:38.129302+0000","last_undegraded":"2024-04-19T02:16:38.129302+0000","last_fullsized":"2024-04-19T02:16:38.129302+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:57.946581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.127778+0000","last_change":"2024-04-19T02:15:29.278148+0000","last_active":"2024-04-19T02:16:38.127778+0000","last_peered":"2024-04-19T02:16:38.127778+0000","last_clean":"2024-04-19T02:16:38.127778+0000","last_became_active":"2024-04-19T02:15:29.277402+0000","last_became_peered":"2024-04-19T02:15:29.277402+0000","last_unstale":"2024-04-19T02:16:38.127778+0000","last_undegraded":"2024-04-19T02:16:38.127778+0000","last_fullsized":"2024-04-19T02:16:38.127778+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125995+0000","last_change":"2024-04-19T02:15:28.892905+0000","last_active":"2024-04-19T02:16:38.125995+0000","last_peered":"2024-04-19T02:16:38.125995+0000","last_clean":"2024-04-19T02:16:38.125995+0000","last_became_active":"2024-04-19T02:15:28.892541+0000","last_became_peered":"2024-04-19T02:15:28.892541+0000","last_unstale":"2024-04-19T02:16:38.125995+0000","last_undegraded":"2024-04-19T02:16:38.125995+0000","last_fullsized":"2024-04-19T02:16:38.125995+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:33.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.127915+0000","last_change":"2024-04-19T02:15:29.278810+0000","last_active":"2024-04-19T02:16:38.127915+0000","last_peered":"2024-04-19T02:16:38.127915+0000","last_clean":"2024-04-19T02:16:38.127915+0000","last_became_active":"2024-04-19T02:15:29.278093+0000","last_became_peered":"2024-04-19T02:15:29.278093+0000","last_unstale":"2024-04-19T02:16:38.127915+0000","last_undegraded":"2024-04-19T02:16:38.127915+0000","last_fullsized":"2024-04-19T02:16:38.127915+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:34.883207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.131508+0000","last_change":"2024-04-19T02:15:28.892937+0000","last_active":"2024-04-19T02:16:38.131508+0000","last_peered":"2024-04-19T02:16:38.131508+0000","last_clean":"2024-04-19T02:16:38.131508+0000","last_became_active":"2024-04-19T02:15:28.891440+0000","last_became_peered":"2024-04-19T02:15:28.891440+0000","last_unstale":"2024-04-19T02:16:38.131508+0000","last_undegraded":"2024-04-19T02:16:38.131508+0000","last_fullsized":"2024-04-19T02:16:38.131508+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.128517+0000","last_change":"2024-04-19T02:15:29.278404+0000","last_active":"2024-04-19T02:16:38.128517+0000","last_peered":"2024-04-19T02:16:38.128517+0000","last_clean":"2024-04-19T02:16:38.128517+0000","last_became_active":"2024-04-19T02:15:29.277460+0000","last_became_peered":"2024-04-19T02:15:29.277460+0000","last_unstale":"2024-04-19T02:16:38.128517+0000","last_undegraded":"2024-04-19T02:16:38.128517+0000","last_fullsized":"2024-04-19T02:16:38.128517+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125431+0000","last_change":"2024-04-19T02:15:28.891097+0000","last_active":"2024-04-19T02:16:38.125431+0000","last_peered":"2024-04-19T02:16:38.125431+0000","last_clean":"2024-04-19T02:16:38.125431+0000","last_became_active":"2024-04-19T02:15:28.890795+0000","last_became_peered":"2024-04-19T02:15:28.890795+0000","last_unstale":"2024-04-19T02:16:38.125431+0000","last_undegraded":"2024-04-19T02:16:38.125431+0000","last_fullsized":"2024-04-19T02:16:38.125431+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125457+0000","last_change":"2024-04-19T02:15:29.278546+0000","last_active":"2024-04-19T02:16:38.125457+0000","last_peered":"2024-04-19T02:16:38.125457+0000","last_clean":"2024-04-19T02:16:38.125457+0000","last_became_active":"2024-04-19T02:15:29.277547+0000","last_became_peered":"2024-04-19T02:15:29.277547+0000","last_unstale":"2024-04-19T02:16:38.125457+0000","last_undegraded":"2024-04-19T02:16:38.125457+0000","last_fullsized":"2024-04-19T02:16:38.125457+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125363+0000","last_change":"2024-04-19T02:15:28.892977+0000","last_active":"2024-04-19T02:16:38.125363+0000","last_peered":"2024-04-19T02:16:38.125363+0000","last_clean":"2024-04-19T02:16:38.125363+0000","last_became_active":"2024-04-19T02:15:28.892636+0000","last_became_peered":"2024-04-19T02:15:28.892636+0000","last_unstale":"2024-04-19T02:16:38.125363+0000","last_undegraded":"2024-04-19T02:16:38.125363+0000","last_fullsized":"2024-04-19T02:16:38.125363+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:43:51.221619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.128204+0000","last_change":"2024-04-19T02:15:53.955655+0000","last_active":"2024-04-19T02:16:38.128204+0000","last_peered":"2024-04-19T02:16:38.128204+0000","last_clean":"2024-04-19T02:16:38.128204+0000","last_became_active":"2024-04-19T02:15:53.955382+0000","last_became_peered":"2024-04-19T02:15:53.955382+0000","last_unstale":"2024-04-19T02:16:38.128204+0000","last_undegraded":"2024-04-19T02:16:38.128204+0000","last_fullsized":"2024-04-19T02:16:38.128204+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:48.239260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.128658+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:16:38.128658+0000","last_peered":"2024-04-19T02:16:38.128658+0000","last_clean":"2024-04-19T02:16:38.128658+0000","last_became_active":"2024-04-19T02:15:28.890751+0000","last_became_peered":"2024-04-19T02:15:28.890751+0000","last_unstale":"2024-04-19T02:16:38.128658+0000","last_undegraded":"2024-04-19T02:16:38.128658+0000","last_fullsized":"2024-04-19T02:16:38.128658+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.129785+0000","last_change":"2024-04-19T02:15:53.957865+0000","last_active":"2024-04-19T02:16:38.129785+0000","last_peered":"2024-04-19T02:16:38.129785+0000","last_clean":"2024-04-19T02:16:38.129785+0000","last_became_active":"2024-04-19T02:15:53.957627+0000","last_became_peered":"2024-04-19T02:15:53.957627+0000","last_unstale":"2024-04-19T02:16:38.129785+0000","last_undegraded":"2024-04-19T02:16:38.129785+0000","last_fullsized":"2024-04-19T02:16:38.129785+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:16:45.799016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.132005+0000","last_change":"2024-04-19T02:15:28.892934+0000","last_active":"2024-04-19T02:16:38.132005+0000","last_peered":"2024-04-19T02:16:38.132005+0000","last_clean":"2024-04-19T02:16:38.132005+0000","last_became_active":"2024-04-19T02:15:28.891879+0000","last_became_peered":"2024-04-19T02:15:28.891879+0000","last_unstale":"2024-04-19T02:16:38.132005+0000","last_undegraded":"2024-04-19T02:16:38.132005+0000","last_fullsized":"2024-04-19T02:16:38.132005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:10:12.514798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.130259+0000","last_change":"2024-04-19T02:15:29.279685+0000","last_active":"2024-04-19T02:16:38.130259+0000","last_peered":"2024-04-19T02:16:38.130259+0000","last_clean":"2024-04-19T02:16:38.130259+0000","last_became_active":"2024-04-19T02:15:29.278810+0000","last_became_peered":"2024-04-19T02:15:29.278810+0000","last_unstale":"2024-04-19T02:16:38.130259+0000","last_undegraded":"2024-04-19T02:16:38.130259+0000","last_fullsized":"2024-04-19T02:16:38.130259+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125302+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:16:38.125302+0000","last_peered":"2024-04-19T02:16:38.125302+0000","last_clean":"2024-04-19T02:16:38.125302+0000","last_became_active":"2024-04-19T02:15:28.890882+0000","last_became_peered":"2024-04-19T02:15:28.890882+0000","last_unstale":"2024-04-19T02:16:38.125302+0000","last_undegraded":"2024-04-19T02:16:38.125302+0000","last_fullsized":"2024-04-19T02:16:38.125302+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:31.673938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.129839+0000","last_change":"2024-04-19T02:15:29.284258+0000","last_active":"2024-04-19T02:16:38.129839+0000","last_peered":"2024-04-19T02:16:38.129839+0000","last_clean":"2024-04-19T02:16:38.129839+0000","last_became_active":"2024-04-19T02:15:29.283995+0000","last_became_peered":"2024-04-19T02:15:29.283995+0000","last_unstale":"2024-04-19T02:16:38.129839+0000","last_undegraded":"2024-04-19T02:16:38.129839+0000","last_fullsized":"2024-04-19T02:16:38.129839+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:35.941308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"39'6991","reported_seq":7022,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-19T02:16:42.806242+0000","last_change":"2024-04-19T02:15:53.956977+0000","last_active":"2024-04-19T02:16:42.806242+0000","last_peered":"2024-04-19T02:16:42.806242+0000","last_clean":"2024-04-19T02:16:42.806242+0000","last_became_active":"2024-04-19T02:15:53.956730+0000","last_became_peered":"2024-04-19T02:15:53.956730+0000","last_unstale":"2024-04-19T02:16:42.806242+0000","last_undegraded":"2024-04-19T02:16:42.806242+0000","last_fullsized":"2024-04-19T02:16:42.806242+0000","mapping_epoch":16,"log_start":"24'3300","ondisk_log_start":"24'3300","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3691,"log_dups_size":0,"ondisk_log_size":3691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:56:46.323499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458162176,"num_objects":6991,"num_object_clones":0,"num_object_copies":13982,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6991,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6991,"num_write_kb":447424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125282+0000","last_change":"2024-04-19T02:15:28.890265+0000","last_active":"2024-04-19T02:16:38.125282+0000","last_peered":"2024-04-19T02:16:38.125282+0000","last_clean":"2024-04-19T02:16:38.125282+0000","last_became_active":"2024-04-19T02:15:28.890004+0000","last_became_peered":"2024-04-19T02:15:28.890004+0000","last_unstale":"2024-04-19T02:16:38.125282+0000","last_undegraded":"2024-04-19T02:16:38.125282+0000","last_fullsized":"2024-04-19T02:16:38.125282+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:02.517101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.130955+0000","last_change":"2024-04-19T02:15:29.285529+0000","last_active":"2024-04-19T02:16:38.130955+0000","last_peered":"2024-04-19T02:16:38.130955+0000","last_clean":"2024-04-19T02:16:38.130955+0000","last_became_active":"2024-04-19T02:15:29.285197+0000","last_became_peered":"2024-04-19T02:15:29.285197+0000","last_unstale":"2024-04-19T02:16:38.130955+0000","last_undegraded":"2024-04-19T02:16:38.130955+0000","last_fullsized":"2024-04-19T02:16:38.130955+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"39'6945","reported_seq":6976,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-19T02:16:42.725902+0000","last_change":"2024-04-19T02:15:53.958523+0000","last_active":"2024-04-19T02:16:42.725902+0000","last_peered":"2024-04-19T02:16:42.725902+0000","last_clean":"2024-04-19T02:16:42.725902+0000","last_became_active":"2024-04-19T02:15:53.957627+0000","last_became_peered":"2024-04-19T02:15:53.957627+0000","last_unstale":"2024-04-19T02:16:42.725902+0000","last_undegraded":"2024-04-19T02:16:42.725902+0000","last_fullsized":"2024-04-19T02:16:42.725902+0000","mapping_epoch":16,"log_start":"24'3047","ondisk_log_start":"24'3047","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3898,"log_dups_size":0,"ondisk_log_size":3898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:59:55.120296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":455147520,"num_objects":6945,"num_object_clones":0,"num_object_copies":13890,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6945,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6945,"num_write_kb":444480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.131522+0000","last_change":"2024-04-19T02:15:28.893902+0000","last_active":"2024-04-19T02:16:38.131522+0000","last_peered":"2024-04-19T02:16:38.131522+0000","last_clean":"2024-04-19T02:16:38.131522+0000","last_became_active":"2024-04-19T02:15:28.893231+0000","last_became_peered":"2024-04-19T02:15:28.893231+0000","last_unstale":"2024-04-19T02:16:38.131522+0000","last_undegraded":"2024-04-19T02:16:38.131522+0000","last_fullsized":"2024-04-19T02:16:38.131522+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:23.658442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.132132+0000","last_change":"2024-04-19T02:15:29.282874+0000","last_active":"2024-04-19T02:16:38.132132+0000","last_peered":"2024-04-19T02:16:38.132132+0000","last_clean":"2024-04-19T02:16:38.132132+0000","last_became_active":"2024-04-19T02:15:29.281675+0000","last_became_peered":"2024-04-19T02:15:29.281675+0000","last_unstale":"2024-04-19T02:16:38.132132+0000","last_undegraded":"2024-04-19T02:16:38.132132+0000","last_fullsized":"2024-04-19T02:16:38.132132+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:35.941308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"39'6789","reported_seq":6820,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-19T02:16:42.755946+0000","last_change":"2024-04-19T02:15:53.958324+0000","last_active":"2024-04-19T02:16:42.755946+0000","last_peered":"2024-04-19T02:16:42.755946+0000","last_clean":"2024-04-19T02:16:42.755946+0000","last_became_active":"2024-04-19T02:15:53.957392+0000","last_became_peered":"2024-04-19T02:15:53.957392+0000","last_unstale":"2024-04-19T02:16:42.755946+0000","last_undegraded":"2024-04-19T02:16:42.755946+0000","last_fullsized":"2024-04-19T02:16:42.755946+0000","mapping_epoch":16,"log_start":"23'2800","ondisk_log_start":"23'2800","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3989,"log_dups_size":0,"ondisk_log_size":3989,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:12:58.132969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444923904,"num_objects":6789,"num_object_clones":0,"num_object_copies":13578,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6789,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6789,"num_write_kb":434496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125637+0000","last_change":"2024-04-19T02:15:28.891234+0000","last_active":"2024-04-19T02:16:38.125637+0000","last_peered":"2024-04-19T02:16:38.125637+0000","last_clean":"2024-04-19T02:16:38.125637+0000","last_became_active":"2024-04-19T02:15:28.890881+0000","last_became_peered":"2024-04-19T02:15:28.890881+0000","last_unstale":"2024-04-19T02:16:38.125637+0000","last_undegraded":"2024-04-19T02:16:38.125637+0000","last_fullsized":"2024-04-19T02:16:38.125637+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125068+0000","last_change":"2024-04-19T02:15:29.281937+0000","last_active":"2024-04-19T02:16:38.125068+0000","last_peered":"2024-04-19T02:16:38.125068+0000","last_clean":"2024-04-19T02:16:38.125068+0000","last_became_active":"2024-04-19T02:15:29.280727+0000","last_became_peered":"2024-04-19T02:15:29.280727+0000","last_unstale":"2024-04-19T02:16:38.125068+0000","last_undegraded":"2024-04-19T02:16:38.125068+0000","last_fullsized":"2024-04-19T02:16:38.125068+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"39'6969","reported_seq":7000,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-19T02:16:42.762749+0000","last_change":"2024-04-19T02:15:53.959099+0000","last_active":"2024-04-19T02:16:42.762749+0000","last_peered":"2024-04-19T02:16:42.762749+0000","last_clean":"2024-04-19T02:16:42.762749+0000","last_became_active":"2024-04-19T02:15:53.958885+0000","last_became_peered":"2024-04-19T02:15:53.958885+0000","last_unstale":"2024-04-19T02:16:42.762749+0000","last_undegraded":"2024-04-19T02:16:42.762749+0000","last_fullsized":"2024-04-19T02:16:42.762749+0000","mapping_epoch":16,"log_start":"24'3300","ondisk_log_start":"24'3300","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3669,"log_dups_size":0,"ondisk_log_size":3669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:53:26.969927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":456720384,"num_objects":6969,"num_object_clones":0,"num_object_copies":13938,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6969,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6969,"num_write_kb":446016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125126+0000","last_change":"2024-04-19T02:15:28.892767+0000","last_active":"2024-04-19T02:16:38.125126+0000","last_peered":"2024-04-19T02:16:38.125126+0000","last_clean":"2024-04-19T02:16:38.125126+0000","last_became_active":"2024-04-19T02:15:28.892235+0000","last_became_peered":"2024-04-19T02:15:28.892235+0000","last_unstale":"2024-04-19T02:16:38.125126+0000","last_undegraded":"2024-04-19T02:16:38.125126+0000","last_fullsized":"2024-04-19T02:16:38.125126+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:37.690735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.128671+0000","last_change":"2024-04-19T02:15:29.279857+0000","last_active":"2024-04-19T02:16:38.128671+0000","last_peered":"2024-04-19T02:16:38.128671+0000","last_clean":"2024-04-19T02:16:38.128671+0000","last_became_active":"2024-04-19T02:15:29.279536+0000","last_became_peered":"2024-04-19T02:15:29.279536+0000","last_unstale":"2024-04-19T02:16:38.128671+0000","last_undegraded":"2024-04-19T02:16:38.128671+0000","last_fullsized":"2024-04-19T02:16:38.128671+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:00.191179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"39'6850","reported_seq":6881,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-19T02:16:42.795184+0000","last_change":"2024-04-19T02:15:53.957261+0000","last_active":"2024-04-19T02:16:42.795184+0000","last_peered":"2024-04-19T02:16:42.795184+0000","last_clean":"2024-04-19T02:16:42.795184+0000","last_became_active":"2024-04-19T02:15:53.957092+0000","last_became_peered":"2024-04-19T02:15:53.957092+0000","last_unstale":"2024-04-19T02:16:42.795184+0000","last_undegraded":"2024-04-19T02:16:42.795184+0000","last_fullsized":"2024-04-19T02:16:42.795184+0000","mapping_epoch":16,"log_start":"24'3113","ondisk_log_start":"24'3113","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3737,"log_dups_size":0,"ondisk_log_size":3737,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:54:15.544923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448921600,"num_objects":6850,"num_object_clones":0,"num_object_copies":13700,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6850,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6850,"num_write_kb":438400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.128548+0000","last_change":"2024-04-19T02:15:28.891611+0000","last_active":"2024-04-19T02:16:38.128548+0000","last_peered":"2024-04-19T02:16:38.128548+0000","last_clean":"2024-04-19T02:16:38.128548+0000","last_became_active":"2024-04-19T02:15:28.890914+0000","last_became_peered":"2024-04-19T02:15:28.890914+0000","last_unstale":"2024-04-19T02:16:38.128548+0000","last_undegraded":"2024-04-19T02:16:38.128548+0000","last_fullsized":"2024-04-19T02:16:38.128548+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:37.690735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125197+0000","last_change":"2024-04-19T02:15:29.285774+0000","last_active":"2024-04-19T02:16:38.125197+0000","last_peered":"2024-04-19T02:16:38.125197+0000","last_clean":"2024-04-19T02:16:38.125197+0000","last_became_active":"2024-04-19T02:15:29.284705+0000","last_became_peered":"2024-04-19T02:15:29.284705+0000","last_unstale":"2024-04-19T02:16:38.125197+0000","last_undegraded":"2024-04-19T02:16:38.125197+0000","last_fullsized":"2024-04-19T02:16:38.125197+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"39'6832","reported_seq":6863,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-19T02:16:42.778464+0000","last_change":"2024-04-19T02:15:53.955286+0000","last_active":"2024-04-19T02:16:42.778464+0000","last_peered":"2024-04-19T02:16:42.778464+0000","last_clean":"2024-04-19T02:16:42.778464+0000","last_became_active":"2024-04-19T02:15:53.955026+0000","last_became_peered":"2024-04-19T02:15:53.955026+0000","last_unstale":"2024-04-19T02:16:42.778464+0000","last_undegraded":"2024-04-19T02:16:42.778464+0000","last_fullsized":"2024-04-19T02:16:42.778464+0000","mapping_epoch":16,"log_start":"24'3200","ondisk_log_start":"24'3200","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3632,"log_dups_size":0,"ondisk_log_size":3632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:05:48.594301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":447741952,"num_objects":6832,"num_object_clones":0,"num_object_copies":13664,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6832,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6832,"num_write_kb":437248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.124911+0000","last_change":"2024-04-19T02:15:28.892873+0000","last_active":"2024-04-19T02:16:38.124911+0000","last_peered":"2024-04-19T02:16:38.124911+0000","last_clean":"2024-04-19T02:16:38.124911+0000","last_became_active":"2024-04-19T02:15:28.892487+0000","last_became_peered":"2024-04-19T02:15:28.892487+0000","last_unstale":"2024-04-19T02:16:38.124911+0000","last_undegraded":"2024-04-19T02:16:38.124911+0000","last_fullsized":"2024-04-19T02:16:38.124911+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:35.412837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125817+0000","last_change":"2024-04-19T02:15:29.285019+0000","last_active":"2024-04-19T02:16:38.125817+0000","last_peered":"2024-04-19T02:16:38.125817+0000","last_clean":"2024-04-19T02:16:38.125817+0000","last_became_active":"2024-04-19T02:15:29.284650+0000","last_became_peered":"2024-04-19T02:15:29.284650+0000","last_unstale":"2024-04-19T02:16:38.125817+0000","last_undegraded":"2024-04-19T02:16:38.125817+0000","last_fullsized":"2024-04-19T02:16:38.125817+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"39'6889","reported_seq":6920,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-19T02:16:42.809700+0000","last_change":"2024-04-19T02:15:53.957403+0000","last_active":"2024-04-19T02:16:42.809700+0000","last_peered":"2024-04-19T02:16:42.809700+0000","last_clean":"2024-04-19T02:16:42.809700+0000","last_became_active":"2024-04-19T02:15:53.957190+0000","last_became_peered":"2024-04-19T02:15:53.957190+0000","last_unstale":"2024-04-19T02:16:42.809700+0000","last_undegraded":"2024-04-19T02:16:42.809700+0000","last_fullsized":"2024-04-19T02:16:42.809700+0000","mapping_epoch":16,"log_start":"24'3201","ondisk_log_start":"24'3201","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3688,"log_dups_size":0,"ondisk_log_size":3688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:07:12.817884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451477504,"num_objects":6889,"num_object_clones":0,"num_object_copies":13778,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6889,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6889,"num_write_kb":440896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.124978+0000","last_change":"2024-04-19T02:15:53.956839+0000","last_active":"2024-04-19T02:16:38.124978+0000","last_peered":"2024-04-19T02:16:38.124978+0000","last_clean":"2024-04-19T02:16:38.124978+0000","last_became_active":"2024-04-19T02:15:53.956630+0000","last_became_peered":"2024-04-19T02:15:53.956630+0000","last_unstale":"2024-04-19T02:16:38.124978+0000","last_undegraded":"2024-04-19T02:16:38.124978+0000","last_fullsized":"2024-04-19T02:16:38.124978+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:47.229730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.126019+0000","last_change":"2024-04-19T02:15:29.287190+0000","last_active":"2024-04-19T02:16:38.126019+0000","last_peered":"2024-04-19T02:16:38.126019+0000","last_clean":"2024-04-19T02:16:38.126019+0000","last_became_active":"2024-04-19T02:15:29.286606+0000","last_became_peered":"2024-04-19T02:15:29.286606+0000","last_unstale":"2024-04-19T02:16:38.126019+0000","last_undegraded":"2024-04-19T02:16:38.126019+0000","last_fullsized":"2024-04-19T02:16:38.126019+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:28.387062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"39'6749","reported_seq":6780,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-19T02:16:42.744153+0000","last_change":"2024-04-19T02:15:53.958448+0000","last_active":"2024-04-19T02:16:42.744153+0000","last_peered":"2024-04-19T02:16:42.744153+0000","last_clean":"2024-04-19T02:16:42.744153+0000","last_became_active":"2024-04-19T02:15:53.957595+0000","last_became_peered":"2024-04-19T02:15:53.957595+0000","last_unstale":"2024-04-19T02:16:42.744153+0000","last_undegraded":"2024-04-19T02:16:42.744153+0000","last_fullsized":"2024-04-19T02:16:42.744153+0000","mapping_epoch":16,"log_start":"23'2844","ondisk_log_start":"23'2844","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3905,"log_dups_size":0,"ondisk_log_size":3905,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:26:31.855319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442302464,"num_objects":6749,"num_object_clones":0,"num_object_copies":13498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6749,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6749,"num_write_kb":431936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.131092+0000","last_change":"2024-04-19T02:15:28.894121+0000","last_active":"2024-04-19T02:16:38.131092+0000","last_peered":"2024-04-19T02:16:38.131092+0000","last_clean":"2024-04-19T02:16:38.131092+0000","last_became_active":"2024-04-19T02:15:28.893902+0000","last_became_peered":"2024-04-19T02:15:28.893902+0000","last_unstale":"2024-04-19T02:16:38.131092+0000","last_undegraded":"2024-04-19T02:16:38.131092+0000","last_fullsized":"2024-04-19T02:16:38.131092+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:10:35.146583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.129171+0000","last_change":"2024-04-19T02:15:29.282870+0000","last_active":"2024-04-19T02:16:38.129171+0000","last_peered":"2024-04-19T02:16:38.129171+0000","last_clean":"2024-04-19T02:16:38.129171+0000","last_became_active":"2024-04-19T02:15:29.281873+0000","last_became_peered":"2024-04-19T02:15:29.281873+0000","last_unstale":"2024-04-19T02:16:38.129171+0000","last_undegraded":"2024-04-19T02:16:38.129171+0000","last_fullsized":"2024-04-19T02:16:38.129171+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"39'6903","reported_seq":6934,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-19T02:16:42.771497+0000","last_change":"2024-04-19T02:15:53.955498+0000","last_active":"2024-04-19T02:16:42.771497+0000","last_peered":"2024-04-19T02:16:42.771497+0000","last_clean":"2024-04-19T02:16:42.771497+0000","last_became_active":"2024-04-19T02:15:53.954910+0000","last_became_peered":"2024-04-19T02:15:53.954910+0000","last_unstale":"2024-04-19T02:16:42.771497+0000","last_undegraded":"2024-04-19T02:16:42.771497+0000","last_fullsized":"2024-04-19T02:16:42.771497+0000","mapping_epoch":16,"log_start":"24'3300","ondisk_log_start":"24'3300","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3603,"log_dups_size":0,"ondisk_log_size":3603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:58:27.262672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":452395008,"num_objects":6903,"num_object_clones":0,"num_object_copies":13806,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6903,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6903,"num_write_kb":441792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.128556+0000","last_change":"2024-04-19T02:15:24.527061+0000","last_active":"2024-04-19T02:16:38.128556+0000","last_peered":"2024-04-19T02:16:38.128556+0000","last_clean":"2024-04-19T02:16:38.128556+0000","last_became_active":"2024-04-19T02:15:24.526757+0000","last_became_peered":"2024-04-19T02:15:24.526757+0000","last_unstale":"2024-04-19T02:16:38.128556+0000","last_undegraded":"2024-04-19T02:16:38.128556+0000","last_fullsized":"2024-04-19T02:16:38.128556+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:17:13.649077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125723+0000","last_change":"2024-04-19T02:15:28.892766+0000","last_active":"2024-04-19T02:16:38.125723+0000","last_peered":"2024-04-19T02:16:38.125723+0000","last_clean":"2024-04-19T02:16:38.125723+0000","last_became_active":"2024-04-19T02:15:28.892396+0000","last_became_peered":"2024-04-19T02:15:28.892396+0000","last_unstale":"2024-04-19T02:16:38.125723+0000","last_undegraded":"2024-04-19T02:16:38.125723+0000","last_fullsized":"2024-04-19T02:16:38.125723+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:57.946581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.131216+0000","last_change":"2024-04-19T02:15:29.277922+0000","last_active":"2024-04-19T02:16:38.131216+0000","last_peered":"2024-04-19T02:16:38.131216+0000","last_clean":"2024-04-19T02:16:38.131216+0000","last_became_active":"2024-04-19T02:15:29.276968+0000","last_became_peered":"2024-04-19T02:15:29.276968+0000","last_unstale":"2024-04-19T02:16:38.131216+0000","last_undegraded":"2024-04-19T02:16:38.131216+0000","last_fullsized":"2024-04-19T02:16:38.131216+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"39'6854","reported_seq":6885,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-19T02:16:42.783346+0000","last_change":"2024-04-19T02:15:53.955228+0000","last_active":"2024-04-19T02:16:42.783346+0000","last_peered":"2024-04-19T02:16:42.783346+0000","last_clean":"2024-04-19T02:16:42.783346+0000","last_became_active":"2024-04-19T02:15:53.954960+0000","last_became_peered":"2024-04-19T02:15:53.954960+0000","last_unstale":"2024-04-19T02:16:42.783346+0000","last_undegraded":"2024-04-19T02:16:42.783346+0000","last_fullsized":"2024-04-19T02:16:42.783346+0000","mapping_epoch":16,"log_start":"24'3200","ondisk_log_start":"24'3200","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3654,"log_dups_size":0,"ondisk_log_size":3654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:46:07.409922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449183744,"num_objects":6854,"num_object_clones":0,"num_object_copies":13708,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6854,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6854,"num_write_kb":438656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125552+0000","last_change":"2024-04-19T02:15:24.530933+0000","last_active":"2024-04-19T02:16:38.125552+0000","last_peered":"2024-04-19T02:16:38.125552+0000","last_clean":"2024-04-19T02:16:38.125552+0000","last_became_active":"2024-04-19T02:15:24.530550+0000","last_became_peered":"2024-04-19T02:15:24.530550+0000","last_unstale":"2024-04-19T02:16:38.125552+0000","last_undegraded":"2024-04-19T02:16:38.125552+0000","last_fullsized":"2024-04-19T02:16:38.125552+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:18:15.194321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125285+0000","last_change":"2024-04-19T02:15:28.893062+0000","last_active":"2024-04-19T02:16:38.125285+0000","last_peered":"2024-04-19T02:16:38.125285+0000","last_clean":"2024-04-19T02:16:38.125285+0000","last_became_active":"2024-04-19T02:15:28.892798+0000","last_became_peered":"2024-04-19T02:15:28.892798+0000","last_unstale":"2024-04-19T02:16:38.125285+0000","last_undegraded":"2024-04-19T02:16:38.125285+0000","last_fullsized":"2024-04-19T02:16:38.125285+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:53.170180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.128397+0000","last_change":"2024-04-19T02:15:29.278294+0000","last_active":"2024-04-19T02:16:38.128397+0000","last_peered":"2024-04-19T02:16:38.128397+0000","last_clean":"2024-04-19T02:16:38.128397+0000","last_became_active":"2024-04-19T02:15:29.277536+0000","last_became_peered":"2024-04-19T02:15:29.277536+0000","last_unstale":"2024-04-19T02:16:38.128397+0000","last_undegraded":"2024-04-19T02:16:38.128397+0000","last_fullsized":"2024-04-19T02:16:38.128397+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"39'6902","reported_seq":6933,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-19T02:16:42.771784+0000","last_change":"2024-04-19T02:15:53.956251+0000","last_active":"2024-04-19T02:16:42.771784+0000","last_peered":"2024-04-19T02:16:42.771784+0000","last_clean":"2024-04-19T02:16:42.771784+0000","last_became_active":"2024-04-19T02:15:53.955886+0000","last_became_peered":"2024-04-19T02:15:53.955886+0000","last_unstale":"2024-04-19T02:16:42.771784+0000","last_undegraded":"2024-04-19T02:16:42.771784+0000","last_fullsized":"2024-04-19T02:16:42.771784+0000","mapping_epoch":16,"log_start":"24'3300","ondisk_log_start":"24'3300","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3602,"log_dups_size":0,"ondisk_log_size":3602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:38:38.586906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":452329472,"num_objects":6902,"num_object_clones":0,"num_object_copies":13804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6902,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6902,"num_write_kb":441728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.127758+0000","last_change":"2024-04-19T02:15:24.527048+0000","last_active":"2024-04-19T02:16:38.127758+0000","last_peered":"2024-04-19T02:16:38.127758+0000","last_clean":"2024-04-19T02:16:38.127758+0000","last_became_active":"2024-04-19T02:15:24.526790+0000","last_became_peered":"2024-04-19T02:15:24.526790+0000","last_unstale":"2024-04-19T02:16:38.127758+0000","last_undegraded":"2024-04-19T02:16:38.127758+0000","last_fullsized":"2024-04-19T02:16:38.127758+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.124484+0000","last_change":"2024-04-19T02:15:53.956945+0000","last_active":"2024-04-19T02:16:38.124484+0000","last_peered":"2024-04-19T02:16:38.124484+0000","last_clean":"2024-04-19T02:16:38.124484+0000","last_became_active":"2024-04-19T02:15:53.956719+0000","last_became_peered":"2024-04-19T02:15:53.956719+0000","last_unstale":"2024-04-19T02:16:38.124484+0000","last_undegraded":"2024-04-19T02:16:38.124484+0000","last_fullsized":"2024-04-19T02:16:38.124484+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:00:37.754624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.129362+0000","last_change":"2024-04-19T02:15:29.282663+0000","last_active":"2024-04-19T02:16:38.129362+0000","last_peered":"2024-04-19T02:16:38.129362+0000","last_clean":"2024-04-19T02:16:38.129362+0000","last_became_active":"2024-04-19T02:15:29.282217+0000","last_became_peered":"2024-04-19T02:15:29.282217+0000","last_unstale":"2024-04-19T02:16:38.129362+0000","last_undegraded":"2024-04-19T02:16:38.129362+0000","last_fullsized":"2024-04-19T02:16:38.129362+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"39'6789","reported_seq":6819,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-19T02:16:42.760465+0000","last_change":"2024-04-19T02:15:53.958264+0000","last_active":"2024-04-19T02:16:42.760465+0000","last_peered":"2024-04-19T02:16:42.760465+0000","last_clean":"2024-04-19T02:16:42.760465+0000","last_became_active":"2024-04-19T02:15:53.956689+0000","last_became_peered":"2024-04-19T02:15:53.956689+0000","last_unstale":"2024-04-19T02:16:42.760465+0000","last_undegraded":"2024-04-19T02:16:42.760465+0000","last_fullsized":"2024-04-19T02:16:42.760465+0000","mapping_epoch":16,"log_start":"23'2800","ondisk_log_start":"23'2800","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3989,"log_dups_size":0,"ondisk_log_size":3989,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:24:32.928594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444923904,"num_objects":6789,"num_object_clones":0,"num_object_copies":13578,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6789,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6789,"num_write_kb":434496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125371+0000","last_change":"2024-04-19T02:15:24.530924+0000","last_active":"2024-04-19T02:16:38.125371+0000","last_peered":"2024-04-19T02:16:38.125371+0000","last_clean":"2024-04-19T02:16:38.125371+0000","last_became_active":"2024-04-19T02:15:24.530551+0000","last_became_peered":"2024-04-19T02:15:24.530551+0000","last_unstale":"2024-04-19T02:16:38.125371+0000","last_undegraded":"2024-04-19T02:16:38.125371+0000","last_fullsized":"2024-04-19T02:16:38.125371+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:30.576946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":234,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.124663+0000","last_change":"2024-04-19T02:15:24.533634+0000","last_active":"2024-04-19T02:16:38.124663+0000","last_peered":"2024-04-19T02:16:38.124663+0000","last_clean":"2024-04-19T02:16:38.124663+0000","last_became_active":"2024-04-19T02:15:24.533420+0000","last_became_peered":"2024-04-19T02:15:24.533420+0000","last_unstale":"2024-04-19T02:16:38.124663+0000","last_undegraded":"2024-04-19T02:16:38.124663+0000","last_fullsized":"2024-04-19T02:16:38.124663+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.128444+0000","last_change":"2024-04-19T02:15:28.890244+0000","last_active":"2024-04-19T02:16:38.128444+0000","last_peered":"2024-04-19T02:16:38.128444+0000","last_clean":"2024-04-19T02:16:38.128444+0000","last_became_active":"2024-04-19T02:15:28.889831+0000","last_became_peered":"2024-04-19T02:15:28.889831+0000","last_unstale":"2024-04-19T02:16:38.128444+0000","last_undegraded":"2024-04-19T02:16:38.128444+0000","last_fullsized":"2024-04-19T02:16:38.128444+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125812+0000","last_change":"2024-04-19T02:15:29.285015+0000","last_active":"2024-04-19T02:16:38.125812+0000","last_peered":"2024-04-19T02:16:38.125812+0000","last_clean":"2024-04-19T02:16:38.125812+0000","last_became_active":"2024-04-19T02:15:29.284164+0000","last_became_peered":"2024-04-19T02:15:29.284164+0000","last_unstale":"2024-04-19T02:16:38.125812+0000","last_undegraded":"2024-04-19T02:16:38.125812+0000","last_fullsized":"2024-04-19T02:16:38.125812+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:36.987844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"39'6856","reported_seq":6886,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-19T02:16:42.796524+0000","last_change":"2024-04-19T02:15:53.956463+0000","last_active":"2024-04-19T02:16:42.796524+0000","last_peered":"2024-04-19T02:16:42.796524+0000","last_clean":"2024-04-19T02:16:42.796524+0000","last_became_active":"2024-04-19T02:15:53.955819+0000","last_became_peered":"2024-04-19T02:15:53.955819+0000","last_unstale":"2024-04-19T02:16:42.796524+0000","last_undegraded":"2024-04-19T02:16:42.796524+0000","last_fullsized":"2024-04-19T02:16:42.796524+0000","mapping_epoch":16,"log_start":"24'3131","ondisk_log_start":"24'3131","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3725,"log_dups_size":0,"ondisk_log_size":3725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:46:07.409922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449314816,"num_objects":6856,"num_object_clones":0,"num_object_copies":13712,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6856,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6856,"num_write_kb":438784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125127+0000","last_change":"2024-04-19T02:15:24.533912+0000","last_active":"2024-04-19T02:16:38.125127+0000","last_peered":"2024-04-19T02:16:38.125127+0000","last_clean":"2024-04-19T02:16:38.125127+0000","last_became_active":"2024-04-19T02:15:24.533580+0000","last_became_peered":"2024-04-19T02:15:24.533580+0000","last_unstale":"2024-04-19T02:16:38.125127+0000","last_undegraded":"2024-04-19T02:16:38.125127+0000","last_fullsized":"2024-04-19T02:16:38.125127+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:45.045477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.127685+0000","last_change":"2024-04-19T02:15:28.891889+0000","last_active":"2024-04-19T02:16:38.127685+0000","last_peered":"2024-04-19T02:16:38.127685+0000","last_clean":"2024-04-19T02:16:38.127685+0000","last_became_active":"2024-04-19T02:15:28.890919+0000","last_became_peered":"2024-04-19T02:15:28.890919+0000","last_unstale":"2024-04-19T02:16:38.127685+0000","last_undegraded":"2024-04-19T02:16:38.127685+0000","last_fullsized":"2024-04-19T02:16:38.127685+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:35.412837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.129964+0000","last_change":"2024-04-19T02:15:53.957881+0000","last_active":"2024-04-19T02:16:38.129964+0000","last_peered":"2024-04-19T02:16:38.129964+0000","last_clean":"2024-04-19T02:16:38.129964+0000","last_became_active":"2024-04-19T02:15:53.957657+0000","last_became_peered":"2024-04-19T02:15:53.957657+0000","last_unstale":"2024-04-19T02:16:38.129964+0000","last_undegraded":"2024-04-19T02:16:38.129964+0000","last_fullsized":"2024-04-19T02:16:38.129964+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:46.921714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"39'6851","reported_seq":6882,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-19T02:16:42.787856+0000","last_change":"2024-04-19T02:15:53.955068+0000","last_active":"2024-04-19T02:16:42.787856+0000","last_peered":"2024-04-19T02:16:42.787856+0000","last_clean":"2024-04-19T02:16:42.787856+0000","last_became_active":"2024-04-19T02:15:53.954721+0000","last_became_peered":"2024-04-19T02:15:53.954721+0000","last_unstale":"2024-04-19T02:16:42.787856+0000","last_undegraded":"2024-04-19T02:16:42.787856+0000","last_fullsized":"2024-04-19T02:16:42.787856+0000","mapping_epoch":16,"log_start":"24'3100","ondisk_log_start":"24'3100","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3751,"log_dups_size":0,"ondisk_log_size":3751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:18:29.742535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448987136,"num_objects":6851,"num_object_clones":0,"num_object_copies":13702,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6851,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6851,"num_write_kb":438464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.131877+0000","last_change":"2024-04-19T02:15:53.959105+0000","last_active":"2024-04-19T02:16:38.131877+0000","last_peered":"2024-04-19T02:16:38.131877+0000","last_clean":"2024-04-19T02:16:38.131877+0000","last_became_active":"2024-04-19T02:15:53.958836+0000","last_became_peered":"2024-04-19T02:15:53.958836+0000","last_unstale":"2024-04-19T02:16:38.131877+0000","last_undegraded":"2024-04-19T02:16:38.131877+0000","last_fullsized":"2024-04-19T02:16:38.131877+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:18:00.321514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.128410+0000","last_change":"2024-04-19T02:15:28.892125+0000","last_active":"2024-04-19T02:16:38.128410+0000","last_peered":"2024-04-19T02:16:38.128410+0000","last_clean":"2024-04-19T02:16:38.128410+0000","last_became_active":"2024-04-19T02:15:28.891300+0000","last_became_peered":"2024-04-19T02:15:28.891300+0000","last_unstale":"2024-04-19T02:16:38.128410+0000","last_undegraded":"2024-04-19T02:16:38.128410+0000","last_fullsized":"2024-04-19T02:16:38.128410+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.131317+0000","last_change":"2024-04-19T02:15:29.281694+0000","last_active":"2024-04-19T02:16:38.131317+0000","last_peered":"2024-04-19T02:16:38.131317+0000","last_clean":"2024-04-19T02:16:38.131317+0000","last_became_active":"2024-04-19T02:15:29.280519+0000","last_became_peered":"2024-04-19T02:15:29.280519+0000","last_unstale":"2024-04-19T02:16:38.131317+0000","last_undegraded":"2024-04-19T02:16:38.131317+0000","last_fullsized":"2024-04-19T02:16:38.131317+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:50.890545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"39'6695","reported_seq":12743,"reported_epoch":39,"state":"active+remapped+backfilling","last_fresh":"2024-04-19T02:16:42.781295+0000","last_change":"2024-04-19T02:16:30.103016+0000","last_active":"2024-04-19T02:16:42.781295+0000","last_peered":"2024-04-19T02:16:42.781295+0000","last_clean":"2024-04-19T02:16:22.050311+0000","last_became_active":"2024-04-19T02:16:24.119992+0000","last_became_peered":"2024-04-19T02:16:24.119992+0000","last_unstale":"2024-04-19T02:16:42.781295+0000","last_undegraded":"2024-04-19T02:16:42.781295+0000","last_fullsized":"2024-04-19T02:16:42.781295+0000","mapping_epoch":29,"log_start":"24'3037","ondisk_log_start":"24'3037","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3658,"log_dups_size":0,"ondisk_log_size":3658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:28.663111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":438763520,"num_objects":6695,"num_object_clones":0,"num_object_copies":13390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2982,"num_objects_unfound":0,"num_objects_dirty":6695,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6695,"num_write_kb":428480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3002,"num_bytes_recovered":196739072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[{"shards":"0,2","objects":6695}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.129107+0000","last_change":"2024-04-19T02:15:28.891702+0000","last_active":"2024-04-19T02:16:38.129107+0000","last_peered":"2024-04-19T02:16:38.129107+0000","last_clean":"2024-04-19T02:16:38.129107+0000","last_became_active":"2024-04-19T02:15:28.890743+0000","last_became_peered":"2024-04-19T02:15:28.890743+0000","last_unstale":"2024-04-19T02:16:38.129107+0000","last_undegraded":"2024-04-19T02:16:38.129107+0000","last_fullsized":"2024-04-19T02:16:38.129107+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.130226+0000","last_change":"2024-04-19T02:15:24.526845+0000","last_active":"2024-04-19T02:16:38.130226+0000","last_peered":"2024-04-19T02:16:38.130226+0000","last_clean":"2024-04-19T02:16:38.130226+0000","last_became_active":"2024-04-19T02:15:24.526500+0000","last_became_peered":"2024-04-19T02:15:24.526500+0000","last_unstale":"2024-04-19T02:16:38.130226+0000","last_undegraded":"2024-04-19T02:16:38.130226+0000","last_fullsized":"2024-04-19T02:16:38.130226+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:16.883355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.127690+0000","last_change":"2024-04-19T02:15:29.278686+0000","last_active":"2024-04-19T02:16:38.127690+0000","last_peered":"2024-04-19T02:16:38.127690+0000","last_clean":"2024-04-19T02:16:38.127690+0000","last_became_active":"2024-04-19T02:15:29.278108+0000","last_became_peered":"2024-04-19T02:15:29.278108+0000","last_unstale":"2024-04-19T02:16:38.127690+0000","last_undegraded":"2024-04-19T02:16:38.127690+0000","last_fullsized":"2024-04-19T02:16:38.127690+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:34.593754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"39'6698","reported_seq":6729,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-19T02:16:42.753764+0000","last_change":"2024-04-19T02:15:53.957269+0000","last_active":"2024-04-19T02:16:42.753764+0000","last_peered":"2024-04-19T02:16:42.753764+0000","last_clean":"2024-04-19T02:16:42.753764+0000","last_became_active":"2024-04-19T02:15:53.956554+0000","last_became_peered":"2024-04-19T02:15:53.956554+0000","last_unstale":"2024-04-19T02:16:42.753764+0000","last_undegraded":"2024-04-19T02:16:42.753764+0000","last_fullsized":"2024-04-19T02:16:42.753764+0000","mapping_epoch":16,"log_start":"23'2728","ondisk_log_start":"23'2728","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3970,"log_dups_size":0,"ondisk_log_size":3970,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:29:38.789719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":438960128,"num_objects":6698,"num_object_clones":0,"num_object_copies":13396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6698,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6698,"num_write_kb":428672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125316+0000","last_change":"2024-04-19T02:15:24.533777+0000","last_active":"2024-04-19T02:16:38.125316+0000","last_peered":"2024-04-19T02:16:38.125316+0000","last_clean":"2024-04-19T02:16:38.125316+0000","last_became_active":"2024-04-19T02:15:24.533436+0000","last_became_peered":"2024-04-19T02:15:24.533436+0000","last_unstale":"2024-04-19T02:16:38.125316+0000","last_undegraded":"2024-04-19T02:16:38.125316+0000","last_fullsized":"2024-04-19T02:16:38.125316+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:53:25.922418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.130130+0000","last_change":"2024-04-19T02:15:28.891370+0000","last_active":"2024-04-19T02:16:38.130130+0000","last_peered":"2024-04-19T02:16:38.130130+0000","last_clean":"2024-04-19T02:16:38.130130+0000","last_became_active":"2024-04-19T02:15:28.890702+0000","last_became_peered":"2024-04-19T02:15:28.890702+0000","last_unstale":"2024-04-19T02:16:38.130130+0000","last_undegraded":"2024-04-19T02:16:38.130130+0000","last_fullsized":"2024-04-19T02:16:38.130130+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:33.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.132102+0000","last_change":"2024-04-19T02:15:29.282244+0000","last_active":"2024-04-19T02:16:38.132102+0000","last_peered":"2024-04-19T02:16:38.132102+0000","last_clean":"2024-04-19T02:16:38.132102+0000","last_became_active":"2024-04-19T02:15:29.280366+0000","last_became_peered":"2024-04-19T02:15:29.280366+0000","last_unstale":"2024-04-19T02:16:38.132102+0000","last_undegraded":"2024-04-19T02:16:38.132102+0000","last_fullsized":"2024-04-19T02:16:38.132102+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.131397+0000","last_change":"2024-04-19T02:15:28.893027+0000","last_active":"2024-04-19T02:16:38.131397+0000","last_peered":"2024-04-19T02:16:38.131397+0000","last_clean":"2024-04-19T02:16:38.131397+0000","last_became_active":"2024-04-19T02:15:28.892695+0000","last_became_peered":"2024-04-19T02:15:28.892695+0000","last_unstale":"2024-04-19T02:16:38.131397+0000","last_undegraded":"2024-04-19T02:16:38.131397+0000","last_fullsized":"2024-04-19T02:16:38.131397+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.131592+0000","last_change":"2024-04-19T02:15:29.283155+0000","last_active":"2024-04-19T02:16:38.131592+0000","last_peered":"2024-04-19T02:16:38.131592+0000","last_clean":"2024-04-19T02:16:38.131592+0000","last_became_active":"2024-04-19T02:15:29.281407+0000","last_became_peered":"2024-04-19T02:15:29.281407+0000","last_unstale":"2024-04-19T02:16:38.131592+0000","last_undegraded":"2024-04-19T02:16:38.131592+0000","last_fullsized":"2024-04-19T02:16:38.131592+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125351+0000","last_change":"2024-04-19T02:15:28.893067+0000","last_active":"2024-04-19T02:16:38.125351+0000","last_peered":"2024-04-19T02:16:38.125351+0000","last_clean":"2024-04-19T02:16:38.125351+0000","last_became_active":"2024-04-19T02:15:28.892781+0000","last_became_peered":"2024-04-19T02:15:28.892781+0000","last_unstale":"2024-04-19T02:16:38.125351+0000","last_undegraded":"2024-04-19T02:16:38.125351+0000","last_fullsized":"2024-04-19T02:16:38.125351+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:54:15.590143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125200+0000","last_change":"2024-04-19T02:15:29.281279+0000","last_active":"2024-04-19T02:16:38.125200+0000","last_peered":"2024-04-19T02:16:38.125200+0000","last_clean":"2024-04-19T02:16:38.125200+0000","last_became_active":"2024-04-19T02:15:29.279360+0000","last_became_peered":"2024-04-19T02:15:29.279360+0000","last_unstale":"2024-04-19T02:16:38.125200+0000","last_undegraded":"2024-04-19T02:16:38.125200+0000","last_fullsized":"2024-04-19T02:16:38.125200+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.131694+0000","last_change":"2024-04-19T02:15:28.893239+0000","last_active":"2024-04-19T02:16:38.131694+0000","last_peered":"2024-04-19T02:16:38.131694+0000","last_clean":"2024-04-19T02:16:38.131694+0000","last_became_active":"2024-04-19T02:15:28.892881+0000","last_became_peered":"2024-04-19T02:15:28.892881+0000","last_unstale":"2024-04-19T02:16:38.131694+0000","last_undegraded":"2024-04-19T02:16:38.131694+0000","last_fullsized":"2024-04-19T02:16:38.131694+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125014+0000","last_change":"2024-04-19T02:15:29.281652+0000","last_active":"2024-04-19T02:16:38.125014+0000","last_peered":"2024-04-19T02:16:38.125014+0000","last_clean":"2024-04-19T02:16:38.125014+0000","last_became_active":"2024-04-19T02:15:29.281175+0000","last_became_peered":"2024-04-19T02:15:29.281175+0000","last_unstale":"2024-04-19T02:16:38.125014+0000","last_undegraded":"2024-04-19T02:16:38.125014+0000","last_fullsized":"2024-04-19T02:16:38.125014+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:16.568764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.130331+0000","last_change":"2024-04-19T02:15:28.892058+0000","last_active":"2024-04-19T02:16:38.130331+0000","last_peered":"2024-04-19T02:16:38.130331+0000","last_clean":"2024-04-19T02:16:38.130331+0000","last_became_active":"2024-04-19T02:15:28.890877+0000","last_became_peered":"2024-04-19T02:15:28.890877+0000","last_unstale":"2024-04-19T02:16:38.130331+0000","last_undegraded":"2024-04-19T02:16:38.130331+0000","last_fullsized":"2024-04-19T02:16:38.130331+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:53.170180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.132218+0000","last_change":"2024-04-19T02:15:29.278810+0000","last_active":"2024-04-19T02:16:38.132218+0000","last_peered":"2024-04-19T02:16:38.132218+0000","last_clean":"2024-04-19T02:16:38.132218+0000","last_became_active":"2024-04-19T02:15:29.277913+0000","last_became_peered":"2024-04-19T02:15:29.277913+0000","last_unstale":"2024-04-19T02:16:38.132218+0000","last_undegraded":"2024-04-19T02:16:38.132218+0000","last_fullsized":"2024-04-19T02:16:38.132218+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:24.082666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.129238+0000","last_change":"2024-04-19T02:15:28.889132+0000","last_active":"2024-04-19T02:16:38.129238+0000","last_peered":"2024-04-19T02:16:38.129238+0000","last_clean":"2024-04-19T02:16:38.129238+0000","last_became_active":"2024-04-19T02:15:28.888926+0000","last_became_peered":"2024-04-19T02:15:28.888926+0000","last_unstale":"2024-04-19T02:16:38.129238+0000","last_undegraded":"2024-04-19T02:16:38.129238+0000","last_fullsized":"2024-04-19T02:16:38.129238+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125335+0000","last_change":"2024-04-19T02:15:29.282776+0000","last_active":"2024-04-19T02:16:38.125335+0000","last_peered":"2024-04-19T02:16:38.125335+0000","last_clean":"2024-04-19T02:16:38.125335+0000","last_became_active":"2024-04-19T02:15:29.279382+0000","last_became_peered":"2024-04-19T02:15:29.279382+0000","last_unstale":"2024-04-19T02:16:38.125335+0000","last_undegraded":"2024-04-19T02:16:38.125335+0000","last_fullsized":"2024-04-19T02:16:38.125335+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.125225+0000","last_change":"2024-04-19T02:15:29.283537+0000","last_active":"2024-04-19T02:16:38.125225+0000","last_peered":"2024-04-19T02:16:38.125225+0000","last_clean":"2024-04-19T02:16:38.125225+0000","last_became_active":"2024-04-19T02:15:29.281801+0000","last_became_peered":"2024-04-19T02:15:29.281801+0000","last_unstale":"2024-04-19T02:16:38.125225+0000","last_undegraded":"2024-04-19T02:16:38.125225+0000","last_fullsized":"2024-04-19T02:16:38.125225+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.127730+0000","last_change":"2024-04-19T02:15:29.281560+0000","last_active":"2024-04-19T02:16:38.127730+0000","last_peered":"2024-04-19T02:16:38.127730+0000","last_clean":"2024-04-19T02:16:38.127730+0000","last_became_active":"2024-04-19T02:15:29.281261+0000","last_became_peered":"2024-04-19T02:15:29.281261+0000","last_unstale":"2024-04-19T02:16:38.127730+0000","last_undegraded":"2024-04-19T02:16:38.127730+0000","last_fullsized":"2024-04-19T02:16:38.127730+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.124752+0000","last_change":"2024-04-19T02:15:53.955913+0000","last_active":"2024-04-19T02:16:38.124752+0000","last_peered":"2024-04-19T02:16:38.124752+0000","last_clean":"2024-04-19T02:16:38.124752+0000","last_became_active":"2024-04-19T02:15:53.955676+0000","last_became_peered":"2024-04-19T02:15:53.955676+0000","last_unstale":"2024-04-19T02:16:38.124752+0000","last_undegraded":"2024-04-19T02:16:38.124752+0000","last_fullsized":"2024-04-19T02:16:38.124752+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:53:02.899902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.128739+0000","last_change":"2024-04-19T02:15:29.278702+0000","last_active":"2024-04-19T02:16:38.128739+0000","last_peered":"2024-04-19T02:16:38.128739+0000","last_clean":"2024-04-19T02:16:38.128739+0000","last_became_active":"2024-04-19T02:15:29.277756+0000","last_became_peered":"2024-04-19T02:15:29.277756+0000","last_unstale":"2024-04-19T02:16:38.128739+0000","last_undegraded":"2024-04-19T02:16:38.128739+0000","last_fullsized":"2024-04-19T02:16:38.128739+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-19T02:16:38.131743+0000","last_change":"2024-04-19T02:15:29.277568+0000","last_active":"2024-04-19T02:16:38.131743+0000","last_peered":"2024-04-19T02:16:38.131743+0000","last_clean":"2024-04-19T02:16:38.131743+0000","last_became_active":"2024-04-19T02:15:29.276725+0000","last_became_peered":"2024-04-19T02:15:29.276725+0000","last_unstale":"2024-04-19T02:16:38.131743+0000","last_undegraded":"2024-04-19T02:16:38.131743+0000","last_fullsized":"2024-04-19T02:16:38.131743+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":7180255232,"num_objects":109562,"num_object_clones":0,"num_object_copies":219124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2982,"num_objects_unfound":0,"num_objects_dirty":109562,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109562,"num_write_kb":7011968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3002,"num_bytes_recovered":196739072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":14604566528,"data_stored":14604566528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60161,"ondisk_log_size":60161,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738386,"num_pgs":84,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5767476,"kb_used_data":5628072,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":88604364,"statfs":{"total":96636764160,"available":90730868736,"internally_reserved":0,"allocated":5763145728,"data_stored":5762870456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":142735814},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.313,"15min":0.313},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.497,"5min":0.497,"15min":0.497},"last":0.17699999999999999},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.193}]},{"osd":1,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.20999999999999999},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.318}]}]},{"osd":0,"up_from":8,"seq":34359738387,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4450512,"kb_used_data":4347204,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":89921328,"statfs":{"total":96636764160,"available":92079439872,"internally_reserved":0,"allocated":4451536896,"data_stored":4451235242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":105773510},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.219},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.27300000000000002}]},{"osd":2,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":2.1000000000000001,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.25700000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738386,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4273672,"kb_used_data":4174460,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":90098168,"statfs":{"total":96636764160,"available":92260524032,"internally_reserved":0,"allocated":4274647040,"data_stored":4274352962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":101579206},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:16:26 2024","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.157},{"interface":"front","average":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"min":{"1min":0.16,"5min":0.16,"15min":0.16},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.20100000000000001}]},{"osd":2,"last update":"Fri Apr 19 02:16:26 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.23899999999999999},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":2.2370000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4498063360,"data_stored":4498063360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4283432960,"data_stored":4283432960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5823070208,"data_stored":5823070208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:16:47.231 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:47.231+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:47.331 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:47.331+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:47.357 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:47.357 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:47.371 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:16:47.432 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:47.432+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:47.533 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:47.534+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:47.540 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:47.540 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:47.555 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:16:47.634 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:47.634+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:47.735 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:47.735+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:47.759 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:47.759 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:47.773 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:16:47.836 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:47.836+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:47.923 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:16:47.936 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:47.937+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:47.942 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:47.942 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:47.957 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:16:48.029 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 53 16 120047 120031 141.534 122 0.00355576 0.00706311 2024-04-19T02:16:48.037 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:48.037+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:48.070 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:16:48.091 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:16:48.112 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2: {} 2024-04-19T02:16:48.113 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:16:48.114 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:16:48.114 INFO:teuthology.orchestra.run.smithi121.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:16:48.126 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:16:48.126 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:16:48.126 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.126 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:120243 5.d e41/16)", 2024-04-19T02:16:48.126 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:48.126754+0000", 2024-04-19T02:16:48.126 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.000140846, 2024-04-19T02:16:48.126 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00015879800000000001, 2024-04-19T02:16:48.126 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:48.126 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "queued for pg", 2024-04-19T02:16:48.127 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:48.127 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.127 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:48.127 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.126754+0000", 2024-04-19T02:16:48.127 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:48.127 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.127 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.127 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:48.127 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.126754+0000", 2024-04-19T02:16:48.127 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:48.127 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.127 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.127 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:48.127 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.126754+0000", 2024-04-19T02:16:48.127 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:48.127 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.128 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.128 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:48.128 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.126868+0000", 2024-04-19T02:16:48.128 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000114058 2024-04-19T02:16:48.128 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.128 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.128 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:48.128 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.126875+0000", 2024-04-19T02:16:48.128 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.7610000000000007e-06 2024-04-19T02:16:48.128 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.128 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.128 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.128 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.126882+0000", 2024-04-19T02:16:48.128 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.3450000000000002e-06 2024-04-19T02:16:48.128 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.129 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:48.129 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.129 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.129 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.129 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:120250 5.b 5:d713cce9:::benchmark_data_smithi121_44835_object120249:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T02:16:48.129 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:48.126771+0000", 2024-04-19T02:16:48.129 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.00012385299999999999, 2024-04-19T02:16:48.129 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00019934799999999999, 2024-04-19T02:16:48.129 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:48.129 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "reached pg", 2024-04-19T02:16:48.129 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:48.129 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:48.129 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:48.129 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 120250 2024-04-19T02:16:48.129 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.130 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:48.130 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.130 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:48.130 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.126771+0000", 2024-04-19T02:16:48.130 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:48.130 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.130 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.130 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:48.130 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.126771+0000", 2024-04-19T02:16:48.130 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:48.130 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.130 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.130 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:48.130 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.126771+0000", 2024-04-19T02:16:48.131 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:48.131 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.131 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.131 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:48.131 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.126908+0000", 2024-04-19T02:16:48.131 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013701100000000001 2024-04-19T02:16:48.131 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.131 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.131 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:48.131 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.126915+0000", 2024-04-19T02:16:48.131 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.5689999999999999e-06 2024-04-19T02:16:48.131 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.131 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.131 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.132 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.126921+0000", 2024-04-19T02:16:48.132 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.1319999999999999e-06 2024-04-19T02:16:48.132 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.132 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.132 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:48.132 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.126951+0000", 2024-04-19T02:16:48.132 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9607e-05 2024-04-19T02:16:48.132 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.132 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:48.132 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.132 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.132 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.132 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:120234 5.4 5:26e56eb9:::benchmark_data_smithi121_44835_object120233:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T02:16:48.132 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:48.120370+0000", 2024-04-19T02:16:48.132 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0065251270000000004, 2024-04-19T02:16:48.132 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.006654002, 2024-04-19T02:16:48.133 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:48.133 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:48.133 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:48.133 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:48.133 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:48.133 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 120234 2024-04-19T02:16:48.133 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.133 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:48.133 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.133 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:48.133 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.120370+0000", 2024-04-19T02:16:48.133 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:48.133 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.133 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.133 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:48.134 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.120370+0000", 2024-04-19T02:16:48.134 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:48.134 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.134 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.134 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:48.134 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.120369+0000", 2024-04-19T02:16:48.134 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:48.134 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.134 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.134 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:48.134 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.120439+0000", 2024-04-19T02:16:48.134 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.9480000000000006e-05 2024-04-19T02:16:48.134 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.134 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.134 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:48.135 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.120449+0000", 2024-04-19T02:16:48.135 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.013e-05 2024-04-19T02:16:48.135 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.135 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.135 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.135 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.120455+0000", 2024-04-19T02:16:48.135 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5769999999999999e-06 2024-04-19T02:16:48.135 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.135 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.135 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:48.135 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.124093+0000", 2024-04-19T02:16:48.135 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0036378489999999999 2024-04-19T02:16:48.135 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.135 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.136 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:48.136 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.124248+0000", 2024-04-19T02:16:48.136 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000154876 2024-04-19T02:16:48.136 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.136 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.136 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:48.136 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.124411+0000", 2024-04-19T02:16:48.136 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000162683 2024-04-19T02:16:48.136 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.136 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.136 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:48.136 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.126719+0000", 2024-04-19T02:16:48.136 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0023083320000000002 2024-04-19T02:16:48.136 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.136 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:48.137 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.137 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.137 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.137 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:120239 5.0 5:094a377d:::benchmark_data_smithi121_44835_object120238:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T02:16:48.137 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:48.126052+0000", 2024-04-19T02:16:48.137 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.00084314399999999999, 2024-04-19T02:16:48.137 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0010344449999999999, 2024-04-19T02:16:48.137 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:48.137 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:48.137 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:48.137 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:48.137 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:48.137 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 120239 2024-04-19T02:16:48.137 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.137 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:48.138 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.138 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:48.138 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.126052+0000", 2024-04-19T02:16:48.138 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:48.138 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.138 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.138 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:48.138 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.126052+0000", 2024-04-19T02:16:48.138 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:48.138 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.138 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.138 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:48.138 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.126051+0000", 2024-04-19T02:16:48.138 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:48.138 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.139 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.139 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:48.139 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.126154+0000", 2024-04-19T02:16:48.139 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000102537 2024-04-19T02:16:48.139 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.139 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.139 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:48.139 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.126162+0000", 2024-04-19T02:16:48.139 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.9279999999999999e-06 2024-04-19T02:16:48.139 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.139 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.139 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.139 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.126171+0000", 2024-04-19T02:16:48.139 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.5269999999999998e-06 2024-04-19T02:16:48.139 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.140 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.140 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:48.140 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.126205+0000", 2024-04-19T02:16:48.140 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4442e-05 2024-04-19T02:16:48.140 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.140 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.140 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:48.140 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.126330+0000", 2024-04-19T02:16:48.140 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000124719 2024-04-19T02:16:48.140 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.140 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.141 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:48.141 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.126445+0000", 2024-04-19T02:16:48.141 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011494599999999999 2024-04-19T02:16:48.141 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.141 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:48.141 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.141 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.141 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.141 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:120246 5.0 5.e4bd3490 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T02:16:48.141 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:48.126474+0000", 2024-04-19T02:16:48.141 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.00042077100000000001, 2024-04-19T02:16:48.141 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00067749900000000003, 2024-04-19T02:16:48.141 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:48.141 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "queued for pg", 2024-04-19T02:16:48.142 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:48.142 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:48.142 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:48.142 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 120246 2024-04-19T02:16:48.142 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.142 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:48.142 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.142 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:48.142 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.126474+0000", 2024-04-19T02:16:48.142 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:48.142 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.142 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.142 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:48.142 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.126474+0000", 2024-04-19T02:16:48.143 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:48.143 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.143 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.143 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:48.143 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.126474+0000", 2024-04-19T02:16:48.143 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:48.143 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.143 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.143 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:48.143 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.126554+0000", 2024-04-19T02:16:48.143 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0088999999999998e-05 2024-04-19T02:16:48.143 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.143 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.143 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:48.143 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.126569+0000", 2024-04-19T02:16:48.144 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.5421e-05 2024-04-19T02:16:48.144 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.144 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.144 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.144 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.126581+0000", 2024-04-19T02:16:48.144 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2337000000000001e-05 2024-04-19T02:16:48.144 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.144 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:48.144 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.144 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.144 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.144 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:120247 5.4 5:224b60a1:::benchmark_data_smithi121_44835_object120246:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T02:16:48.144 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:48.126591+0000", 2024-04-19T02:16:48.144 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.00030393400000000001, 2024-04-19T02:16:48.144 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00061653100000000002, 2024-04-19T02:16:48.145 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:48.145 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:48.145 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:48.145 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:48.145 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:48.145 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 120247 2024-04-19T02:16:48.145 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.145 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:48.145 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.145 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:48.145 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.126591+0000", 2024-04-19T02:16:48.145 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:48.145 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.146 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.146 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:48.146 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.126591+0000", 2024-04-19T02:16:48.146 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:48.146 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.146 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.146 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:48.146 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.126590+0000", 2024-04-19T02:16:48.146 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:48.146 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.146 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.146 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:48.146 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.126622+0000", 2024-04-19T02:16:48.146 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1841999999999998e-05 2024-04-19T02:16:48.149 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.150 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.150 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:48.150 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.126638+0000", 2024-04-19T02:16:48.150 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.5588000000000001e-05 2024-04-19T02:16:48.150 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.150 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.150 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.150 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.126644+0000", 2024-04-19T02:16:48.150 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.8499999999999999e-06 2024-04-19T02:16:48.151 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.151 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.151 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:48.151 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.126741+0000", 2024-04-19T02:16:48.151 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7307999999999997e-05 2024-04-19T02:16:48.151 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.151 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.151 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:48.151 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.126867+0000", 2024-04-19T02:16:48.151 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012550800000000001 2024-04-19T02:16:48.151 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.151 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.151 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:48.151 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.126985+0000", 2024-04-19T02:16:48.151 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000117998 2024-04-19T02:16:48.152 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.152 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:48.152 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.152 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.152 INFO:teuthology.orchestra.run.smithi174.stdout: ], 2024-04-19T02:16:48.152 INFO:teuthology.orchestra.run.smithi174.stdout: "num_ops": 6 2024-04-19T02:16:48.152 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:16:48.153 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:16:48.154 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:48.153+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:48.253 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:48.254+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:48.354 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:48.355+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:48.364 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:16:48.364 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [], 2024-04-19T02:16:48.364 INFO:teuthology.orchestra.run.smithi174.stdout: "complaint_time": 30, 2024-04-19T02:16:48.364 INFO:teuthology.orchestra.run.smithi174.stdout: "num_blocked_ops": 0 2024-04-19T02:16:48.364 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:16:48.379 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:16:48.463 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:48.463+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:48.556 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:48.557+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:48.592 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:16:48.592 INFO:teuthology.orchestra.run.smithi174.stdout: "size": 20, 2024-04-19T02:16:48.592 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 600, 2024-04-19T02:16:48.592 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:16:48.592 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.593 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:10 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:48.593 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269877+0000", 2024-04-19T02:16:48.593 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 79.321090441999999, 2024-04-19T02:16:48.593 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020732751000000001, 2024-04-19T02:16:48.593 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:48.593 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:48.593 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:48.593 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.593 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:48.593 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269877+0000", 2024-04-19T02:16:48.593 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:48.593 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.593 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.594 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:48.594 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269877+0000", 2024-04-19T02:16:48.594 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:48.594 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.594 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.594 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:48.594 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269875+0000", 2024-04-19T02:16:48.594 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:48.594 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.594 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.594 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:48.595 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269891+0000", 2024-04-19T02:16:48.595 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.5494000000000001e-05 2024-04-19T02:16:48.595 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.595 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.595 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:48.595 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269903+0000", 2024-04-19T02:16:48.595 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2003e-05 2024-04-19T02:16:48.595 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.595 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.595 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.595 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269914+0000", 2024-04-19T02:16:48.595 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0947e-05 2024-04-19T02:16:48.595 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.595 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.596 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:48.596 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269971+0000", 2024-04-19T02:16:48.596 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7036000000000001e-05 2024-04-19T02:16:48.596 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.596 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.596 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:16:48.596 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269979+0000", 2024-04-19T02:16:48.596 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.6660000000000008e-06 2024-04-19T02:16:48.596 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.596 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.596 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:48.596 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284891+0000", 2024-04-19T02:16:48.596 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014912584 2024-04-19T02:16:48.597 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.597 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.597 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:48.597 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285213+0000", 2024-04-19T02:16:48.597 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00032172199999999998 2024-04-19T02:16:48.597 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.597 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.597 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:48.597 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285357+0000", 2024-04-19T02:16:48.597 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014367899999999999 2024-04-19T02:16:48.597 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.597 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.597 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:48.597 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288883+0000", 2024-04-19T02:16:48.597 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0035268719999999999 2024-04-19T02:16:48.598 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.598 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.598 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:48.598 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290537+0000", 2024-04-19T02:16:48.598 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016537399999999999 2024-04-19T02:16:48.598 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.598 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.598 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:48.598 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290576+0000", 2024-04-19T02:16:48.598 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9266e-05 2024-04-19T02:16:48.598 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.598 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.599 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:48.599 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290609+0000", 2024-04-19T02:16:48.599 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2818000000000003e-05 2024-04-19T02:16:48.599 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.599 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:48.599 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.599 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.599 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.599 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:11 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:48.599 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:48.599 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 79.321037520999994, 2024-04-19T02:16:48.599 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020352748, 2024-04-19T02:16:48.599 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:48.599 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:48.599 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:48.600 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.600 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:48.600 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:48.600 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:48.600 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.600 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.600 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:48.600 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:48.600 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:48.600 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.600 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.600 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:48.600 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:48.600 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:48.601 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.601 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.601 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:48.601 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269933+0000", 2024-04-19T02:16:48.601 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2169999999999996e-06 2024-04-19T02:16:48.601 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.601 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.601 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:48.601 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269940+0000", 2024-04-19T02:16:48.601 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1500000000000002e-06 2024-04-19T02:16:48.601 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.601 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.601 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.601 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269948+0000", 2024-04-19T02:16:48.601 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.8690000000000004e-06 2024-04-19T02:16:48.602 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.602 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.602 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:48.602 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:16:48.602 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2994999999999997e-05 2024-04-19T02:16:48.602 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.602 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.602 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:16:48.602 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269997+0000", 2024-04-19T02:16:48.602 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.9020000000000004e-06 2024-04-19T02:16:48.602 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.602 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.602 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:48.602 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.282729+0000", 2024-04-19T02:16:48.603 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.012732537 2024-04-19T02:16:48.603 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.603 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.603 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:48.603 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.282838+0000", 2024-04-19T02:16:48.603 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000108298 2024-04-19T02:16:48.603 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.603 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.603 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:48.603 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.283002+0000", 2024-04-19T02:16:48.603 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00016466300000000001 2024-04-19T02:16:48.603 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.603 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.604 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:48.604 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288708+0000", 2024-04-19T02:16:48.604 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.005705066 2024-04-19T02:16:48.604 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.604 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.604 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:48.604 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290215+0000", 2024-04-19T02:16:48.604 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0015075010000000001 2024-04-19T02:16:48.604 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.604 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.604 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:48.604 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290259+0000", 2024-04-19T02:16:48.604 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3711999999999998e-05 2024-04-19T02:16:48.604 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.604 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.605 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:48.605 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290282+0000", 2024-04-19T02:16:48.605 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3458000000000001e-05 2024-04-19T02:16:48.605 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.605 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:48.605 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.605 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.605 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.605 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:14 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:48.605 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:48.605 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 79.321003731000005, 2024-04-19T02:16:48.605 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020137202, 2024-04-19T02:16:48.605 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:48.605 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:48.605 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:48.605 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.606 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:48.606 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:48.606 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:48.606 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.606 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.606 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:48.606 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:48.606 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:48.606 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.606 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.606 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:48.606 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:48.607 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:48.607 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.607 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.607 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:48.607 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269971+0000", 2024-04-19T02:16:48.607 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.5459999999999992e-06 2024-04-19T02:16:48.607 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.607 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.607 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:48.607 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269979+0000", 2024-04-19T02:16:48.607 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9130000000000003e-06 2024-04-19T02:16:48.607 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.607 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.607 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.607 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269986+0000", 2024-04-19T02:16:48.608 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.3779999999999998e-06 2024-04-19T02:16:48.608 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.608 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.608 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:48.608 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270030+0000", 2024-04-19T02:16:48.608 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3982e-05 2024-04-19T02:16:48.608 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.608 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.608 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:16:48.608 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270034+0000", 2024-04-19T02:16:48.608 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1779999999999996e-06 2024-04-19T02:16:48.608 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.608 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.608 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:48.608 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.277870+0000", 2024-04-19T02:16:48.609 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0078362150000000005 2024-04-19T02:16:48.609 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.609 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.609 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:48.609 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.278216+0000", 2024-04-19T02:16:48.609 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00034634999999999999 2024-04-19T02:16:48.609 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.609 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.609 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:48.609 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.278732+0000", 2024-04-19T02:16:48.609 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00051536099999999999 2024-04-19T02:16:48.609 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.609 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.609 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:48.609 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.287694+0000", 2024-04-19T02:16:48.610 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0089621019999999996 2024-04-19T02:16:48.610 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.610 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.610 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:48.610 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290026+0000", 2024-04-19T02:16:48.610 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0023323139999999998 2024-04-19T02:16:48.610 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.610 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.610 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:48.610 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290067+0000", 2024-04-19T02:16:48.610 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1043e-05 2024-04-19T02:16:48.610 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.610 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.610 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:48.611 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290100+0000", 2024-04-19T02:16:48.611 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3278999999999998e-05 2024-04-19T02:16:48.611 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.611 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:48.611 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.611 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.611 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.611 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:48.611 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:48.611 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 79.320971939000003, 2024-04-19T02:16:48.611 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020731702000000001, 2024-04-19T02:16:48.611 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:48.611 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:48.611 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:48.612 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.612 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:48.612 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:48.612 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:48.612 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.612 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.612 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:48.612 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:48.612 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:48.612 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.612 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.612 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:48.612 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:48.612 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:48.612 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.612 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.613 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:48.613 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269998+0000", 2024-04-19T02:16:48.613 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7100000000000001e-06 2024-04-19T02:16:48.613 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.613 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.613 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:48.613 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270005+0000", 2024-04-19T02:16:48.613 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.241e-06 2024-04-19T02:16:48.613 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.613 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.613 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.613 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270011+0000", 2024-04-19T02:16:48.613 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6279999999999999e-06 2024-04-19T02:16:48.613 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.613 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.614 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:48.614 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270046+0000", 2024-04-19T02:16:48.614 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5173999999999999e-05 2024-04-19T02:16:48.614 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.614 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.614 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:48.614 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:48.614 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0019999999999997e-06 2024-04-19T02:16:48.614 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.614 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.614 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:48.614 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285619+0000", 2024-04-19T02:16:48.614 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015567391 2024-04-19T02:16:48.614 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.615 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.615 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:48.615 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285671+0000", 2024-04-19T02:16:48.615 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2460999999999998e-05 2024-04-19T02:16:48.615 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.615 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.615 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:48.615 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285775+0000", 2024-04-19T02:16:48.615 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000103389 2024-04-19T02:16:48.615 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.615 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.615 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:48.615 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288934+0000", 2024-04-19T02:16:48.615 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0031595859999999998 2024-04-19T02:16:48.615 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.616 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.616 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:48.616 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290650+0000", 2024-04-19T02:16:48.616 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001716242 2024-04-19T02:16:48.616 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.616 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.616 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:48.616 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290692+0000", 2024-04-19T02:16:48.616 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1910999999999999e-05 2024-04-19T02:16:48.616 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.616 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.616 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:48.616 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290727+0000", 2024-04-19T02:16:48.617 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4412000000000002e-05 2024-04-19T02:16:48.617 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.617 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:48.617 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.617 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.617 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.617 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:48.617 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270019+0000", 2024-04-19T02:16:48.617 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 79.320948344000001, 2024-04-19T02:16:48.617 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020572014999999999, 2024-04-19T02:16:48.617 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:48.617 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:48.617 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:48.617 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.618 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:48.618 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270019+0000", 2024-04-19T02:16:48.618 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:48.618 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.618 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.618 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:48.618 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270019+0000", 2024-04-19T02:16:48.618 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:48.618 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.618 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.618 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:48.618 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270018+0000", 2024-04-19T02:16:48.618 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:48.618 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.618 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.619 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:48.619 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270021+0000", 2024-04-19T02:16:48.619 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0319999999999999e-06 2024-04-19T02:16:48.619 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.619 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.619 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:48.619 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270028+0000", 2024-04-19T02:16:48.619 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6189999999999996e-06 2024-04-19T02:16:48.619 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.619 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.619 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.619 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270035+0000", 2024-04-19T02:16:48.619 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1690000000000003e-06 2024-04-19T02:16:48.619 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.620 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.620 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:48.620 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270078+0000", 2024-04-19T02:16:48.620 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3061e-05 2024-04-19T02:16:48.620 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.620 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.620 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:48.620 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270082+0000", 2024-04-19T02:16:48.620 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4510000000000002e-06 2024-04-19T02:16:48.620 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.620 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.620 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:48.620 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284354+0000", 2024-04-19T02:16:48.620 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014271588999999999 2024-04-19T02:16:48.621 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.621 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.621 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:48.621 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284497+0000", 2024-04-19T02:16:48.621 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014335800000000001 2024-04-19T02:16:48.621 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.621 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.621 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:48.621 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284626+0000", 2024-04-19T02:16:48.621 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000128744 2024-04-19T02:16:48.621 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.621 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.621 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:48.621 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288844+0000", 2024-04-19T02:16:48.621 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00421807 2024-04-19T02:16:48.621 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.622 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.622 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:48.622 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290508+0000", 2024-04-19T02:16:48.622 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001663774 2024-04-19T02:16:48.622 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.622 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.622 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:48.622 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290556+0000", 2024-04-19T02:16:48.622 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.7599999999999998e-05 2024-04-19T02:16:48.622 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.622 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.622 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:48.622 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290591+0000", 2024-04-19T02:16:48.622 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5034999999999999e-05 2024-04-19T02:16:48.623 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.623 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:48.623 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.623 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.623 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.623 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:48.623 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:48.623 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 79.320925481000003, 2024-04-19T02:16:48.623 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020192280999999999, 2024-04-19T02:16:48.623 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:48.623 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:48.623 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:48.623 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.624 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:48.624 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:48.624 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:48.624 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.624 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.624 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:48.624 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:48.624 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:48.624 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.624 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.624 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:48.624 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:48.624 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:48.624 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.624 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.625 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:48.625 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270045+0000", 2024-04-19T02:16:48.625 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8680000000000001e-06 2024-04-19T02:16:48.625 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.625 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.625 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:48.625 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270052+0000", 2024-04-19T02:16:48.625 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.9999999999999999e-06 2024-04-19T02:16:48.625 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.625 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.625 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.625 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270056+0000", 2024-04-19T02:16:48.625 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4479999999999996e-06 2024-04-19T02:16:48.625 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.625 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.625 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:48.626 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270089+0000", 2024-04-19T02:16:48.626 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3071000000000002e-05 2024-04-19T02:16:48.626 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.626 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.626 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:48.626 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270092+0000", 2024-04-19T02:16:48.626 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9780000000000001e-06 2024-04-19T02:16:48.626 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.626 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.626 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:48.626 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.280632+0000", 2024-04-19T02:16:48.626 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010539712 2024-04-19T02:16:48.626 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.626 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.627 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:48.627 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.280743+0000", 2024-04-19T02:16:48.627 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000111048 2024-04-19T02:16:48.627 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.627 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.627 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:48.627 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.281531+0000", 2024-04-19T02:16:48.627 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00078738199999999999 2024-04-19T02:16:48.627 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.627 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.627 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:48.627 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.287949+0000", 2024-04-19T02:16:48.627 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0064185730000000003 2024-04-19T02:16:48.627 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.627 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.628 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:48.628 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290184+0000", 2024-04-19T02:16:48.628 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0022350849999999999 2024-04-19T02:16:48.628 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.628 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.628 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:48.628 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290209+0000", 2024-04-19T02:16:48.628 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4907000000000001e-05 2024-04-19T02:16:48.628 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.628 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.628 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:48.628 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290234+0000", 2024-04-19T02:16:48.628 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4666999999999999e-05 2024-04-19T02:16:48.628 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.628 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:48.629 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.629 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.629 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.629 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:19 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:48.629 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:48.629 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 79.320904014999996, 2024-04-19T02:16:48.629 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020818203, 2024-04-19T02:16:48.629 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:48.629 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:48.629 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:48.629 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.629 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:48.629 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:48.629 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:48.629 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.629 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.630 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:48.630 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:48.630 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:48.630 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.630 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.630 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:48.630 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:48.630 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:48.630 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.630 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.630 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:48.631 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270065+0000", 2024-04-19T02:16:48.631 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4310000000000001e-06 2024-04-19T02:16:48.631 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.631 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.631 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:48.631 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270070+0000", 2024-04-19T02:16:48.631 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2859999999999999e-06 2024-04-19T02:16:48.631 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.631 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.631 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.631 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270077+0000", 2024-04-19T02:16:48.631 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5270000000000004e-06 2024-04-19T02:16:48.631 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.631 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.631 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:48.632 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270107+0000", 2024-04-19T02:16:48.632 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0205999999999998e-05 2024-04-19T02:16:48.632 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.632 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.632 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:48.632 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270111+0000", 2024-04-19T02:16:48.632 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8650000000000003e-06 2024-04-19T02:16:48.632 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.632 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.632 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:48.632 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285936+0000", 2024-04-19T02:16:48.632 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015824677999999998 2024-04-19T02:16:48.632 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.632 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.633 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:48.633 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286007+0000", 2024-04-19T02:16:48.633 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1157999999999999e-05 2024-04-19T02:16:48.633 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.633 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.633 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:48.633 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286086+0000", 2024-04-19T02:16:48.633 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9084000000000004e-05 2024-04-19T02:16:48.633 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.633 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.633 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:48.633 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290740+0000", 2024-04-19T02:16:48.633 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0046543679999999999 2024-04-19T02:16:48.633 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.634 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.634 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:48.634 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290833+0000", 2024-04-19T02:16:48.634 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2551000000000002e-05 2024-04-19T02:16:48.634 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.634 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.634 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:48.634 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290859+0000", 2024-04-19T02:16:48.634 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.6696999999999999e-05 2024-04-19T02:16:48.634 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.634 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.634 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:48.634 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290881+0000", 2024-04-19T02:16:48.635 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1653000000000001e-05 2024-04-19T02:16:48.635 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.635 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:48.635 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.635 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.635 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.635 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:77622 5.8 5:166fbe77:::benchmark_data_smithi121_44835_object77621:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:48.635 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:16:48.635 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 21.785407077999999, 2024-04-19T02:16:48.635 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.021784694, 2024-04-19T02:16:48.635 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:48.635 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:48.635 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:48.635 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:48.635 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:48.635 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 77622 2024-04-19T02:16:48.636 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.636 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:48.636 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.636 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:48.636 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:16:48.636 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:48.636 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.636 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.636 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:48.636 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:16:48.636 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:48.636 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.636 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.636 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:48.636 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805559+0000", 2024-04-19T02:16:48.637 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:48.637 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.637 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.637 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:48.637 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805659+0000", 2024-04-19T02:16:48.637 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.9908000000000006e-05 2024-04-19T02:16:48.637 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.637 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.637 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:48.637 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805668+0000", 2024-04-19T02:16:48.637 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2129999999999997e-06 2024-04-19T02:16:48.637 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.637 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.637 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.638 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805673+0000", 2024-04-19T02:16:48.638 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0370000000000002e-06 2024-04-19T02:16:48.638 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.638 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.638 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:48.638 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812022+0000", 2024-04-19T02:16:48.638 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0063483239999999998 2024-04-19T02:16:48.638 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.638 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.638 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:48.638 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812129+0000", 2024-04-19T02:16:48.638 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010744200000000001 2024-04-19T02:16:48.638 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.638 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.639 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:48.639 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812252+0000", 2024-04-19T02:16:48.639 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000122519 2024-04-19T02:16:48.639 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.639 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.639 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:48.639 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.820979+0000", 2024-04-19T02:16:48.639 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0087272740000000001 2024-04-19T02:16:48.639 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.639 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.639 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:48.639 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827270+0000", 2024-04-19T02:16:48.639 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0062906239999999999 2024-04-19T02:16:48.639 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.640 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.640 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:48.640 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827309+0000", 2024-04-19T02:16:48.640 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9678999999999997e-05 2024-04-19T02:16:48.640 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.640 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.640 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:48.640 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827345+0000", 2024-04-19T02:16:48.640 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5308000000000001e-05 2024-04-19T02:16:48.640 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.640 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:48.640 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.640 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.640 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.640 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78224 5.4 5:26e797d5:::benchmark_data_smithi121_44835_object78223:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:48.641 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:16:48.641 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 21.484404879, 2024-04-19T02:16:48.641 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.021471998999999999, 2024-04-19T02:16:48.641 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:48.641 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:48.641 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:48.641 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:48.641 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:48.641 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78224 2024-04-19T02:16:48.641 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.641 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:48.641 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.641 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:48.641 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:16:48.641 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:48.642 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.642 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.642 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:48.642 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:16:48.642 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:48.642 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.642 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.642 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:48.642 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106561+0000", 2024-04-19T02:16:48.642 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:48.642 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.642 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.642 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:48.642 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106630+0000", 2024-04-19T02:16:48.643 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.8553999999999994e-05 2024-04-19T02:16:48.643 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.643 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.643 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:48.643 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106644+0000", 2024-04-19T02:16:48.643 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.4651000000000001e-05 2024-04-19T02:16:48.643 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.643 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.643 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.643 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106653+0000", 2024-04-19T02:16:48.643 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.6719999999999993e-06 2024-04-19T02:16:48.643 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.643 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.643 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:48.644 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106693+0000", 2024-04-19T02:16:48.644 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9978999999999998e-05 2024-04-19T02:16:48.644 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.644 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.644 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:48.644 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106840+0000", 2024-04-19T02:16:48.644 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0001473 2024-04-19T02:16:48.644 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.644 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.644 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:48.644 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106971+0000", 2024-04-19T02:16:48.645 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013051499999999999 2024-04-19T02:16:48.645 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.645 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.645 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:48.645 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.109047+0000", 2024-04-19T02:16:48.645 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.002076002 2024-04-19T02:16:48.645 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.645 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.645 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:48.645 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.127967+0000", 2024-04-19T02:16:48.645 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.018919780000000001 2024-04-19T02:16:48.645 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.645 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.646 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:48.646 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128004+0000", 2024-04-19T02:16:48.646 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7719000000000003e-05 2024-04-19T02:16:48.646 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.646 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.646 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:48.646 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128034+0000", 2024-04-19T02:16:48.646 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9651000000000001e-05 2024-04-19T02:16:48.646 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.646 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:48.646 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.646 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.646 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.646 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78259 5.4 5:2aa344b2:::benchmark_data_smithi121_44835_object78258:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:48.647 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:16:48.647 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 21.46570981, 2024-04-19T02:16:48.647 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022934350999999999, 2024-04-19T02:16:48.647 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:48.647 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:48.647 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:48.647 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:48.647 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:48.647 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78259 2024-04-19T02:16:48.647 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.647 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:48.647 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.647 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:48.647 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:16:48.647 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:48.648 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.648 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.648 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:48.648 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:16:48.648 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:48.648 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.648 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.648 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:48.648 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125256+0000", 2024-04-19T02:16:48.648 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:48.648 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.648 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.648 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:48.648 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125347+0000", 2024-04-19T02:16:48.649 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0470000000000006e-05 2024-04-19T02:16:48.649 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.649 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.649 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:48.649 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125358+0000", 2024-04-19T02:16:48.649 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1764e-05 2024-04-19T02:16:48.649 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.649 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.649 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.649 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125364+0000", 2024-04-19T02:16:48.649 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7189999999999998e-06 2024-04-19T02:16:48.649 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.649 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.649 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:48.649 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125391+0000", 2024-04-19T02:16:48.650 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7270000000000001e-05 2024-04-19T02:16:48.650 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.650 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.650 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:48.650 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125471+0000", 2024-04-19T02:16:48.650 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9209999999999995e-05 2024-04-19T02:16:48.650 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.650 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.650 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:48.650 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125559+0000", 2024-04-19T02:16:48.650 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.8689000000000004e-05 2024-04-19T02:16:48.650 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.650 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.651 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:48.651 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128164+0000", 2024-04-19T02:16:48.651 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0026050270000000002 2024-04-19T02:16:48.651 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.651 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.651 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:48.651 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148139+0000", 2024-04-19T02:16:48.651 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.019975050000000001 2024-04-19T02:16:48.651 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.651 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.651 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:48.651 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148169+0000", 2024-04-19T02:16:48.651 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0001e-05 2024-04-19T02:16:48.651 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.651 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.651 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:48.652 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148191+0000", 2024-04-19T02:16:48.652 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.2104999999999999e-05 2024-04-19T02:16:48.652 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.652 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:48.652 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.652 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.652 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.652 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78271 5.4 5:2982d7a6:::benchmark_data_smithi121_44835_object78270:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:48.652 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:16:48.652 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 21.458846579999999, 2024-04-19T02:16:48.652 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020841755999999999, 2024-04-19T02:16:48.652 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:48.652 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:48.652 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:48.652 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:48.653 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:48.653 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78271 2024-04-19T02:16:48.653 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.653 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:48.653 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.653 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:48.653 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:16:48.653 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:48.653 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.653 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.653 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:48.653 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:16:48.653 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:48.653 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.653 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.654 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:48.654 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132119+0000", 2024-04-19T02:16:48.654 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:48.654 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.654 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.654 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:48.654 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132185+0000", 2024-04-19T02:16:48.654 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5994000000000005e-05 2024-04-19T02:16:48.654 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.654 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.654 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:48.654 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132197+0000", 2024-04-19T02:16:48.655 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2091e-05 2024-04-19T02:16:48.655 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.655 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.655 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.655 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132206+0000", 2024-04-19T02:16:48.655 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.5099999999999998e-06 2024-04-19T02:16:48.655 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.655 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.655 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:48.655 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132242+0000", 2024-04-19T02:16:48.655 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5663000000000001e-05 2024-04-19T02:16:48.655 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.655 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.656 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:48.656 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132335+0000", 2024-04-19T02:16:48.656 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3275000000000004e-05 2024-04-19T02:16:48.656 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.656 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.656 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:48.656 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132432+0000", 2024-04-19T02:16:48.656 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7571000000000005e-05 2024-04-19T02:16:48.656 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.656 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.656 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:48.657 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.136706+0000", 2024-04-19T02:16:48.657 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0042738170000000001 2024-04-19T02:16:48.657 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.657 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.657 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:48.657 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152909+0000", 2024-04-19T02:16:48.657 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016202415000000001 2024-04-19T02:16:48.657 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.657 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.657 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:48.657 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152938+0000", 2024-04-19T02:16:48.657 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9740999999999999e-05 2024-04-19T02:16:48.657 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.657 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.657 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:48.657 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152962+0000", 2024-04-19T02:16:48.657 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3659000000000002e-05 2024-04-19T02:16:48.658 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.658 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:48.658 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.658 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.658 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.658 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78272 5.4 5:273e819a:::benchmark_data_smithi121_44835_object78271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:48.658 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:16:48.658 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 21.458357537000001, 2024-04-19T02:16:48.658 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022180163999999999, 2024-04-19T02:16:48.658 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:48.658 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:48.658 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:48.658 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:48.659 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:48.659 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78272 2024-04-19T02:16:48.659 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.659 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:48.659 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.659 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:48.659 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:16:48.659 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:48.659 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.659 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.659 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:48.659 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:16:48.659 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:48.659 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.659 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.660 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:48.660 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:16:48.660 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:48.660 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.660 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.660 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:48.660 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132690+0000", 2024-04-19T02:16:48.660 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0963000000000004e-05 2024-04-19T02:16:48.660 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.660 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.660 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:48.660 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132703+0000", 2024-04-19T02:16:48.660 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.3072e-05 2024-04-19T02:16:48.660 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.660 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.660 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.661 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132710+0000", 2024-04-19T02:16:48.661 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3100000000000003e-06 2024-04-19T02:16:48.661 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.661 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.661 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:48.661 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134005+0000", 2024-04-19T02:16:48.661 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001294513 2024-04-19T02:16:48.661 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.661 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.661 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:48.661 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134139+0000", 2024-04-19T02:16:48.661 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000134447 2024-04-19T02:16:48.661 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.661 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.661 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:48.661 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134284+0000", 2024-04-19T02:16:48.662 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014514399999999999 2024-04-19T02:16:48.662 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.662 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.662 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:48.662 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.139622+0000", 2024-04-19T02:16:48.662 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0053373830000000002 2024-04-19T02:16:48.662 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.662 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.662 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:48.662 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154737+0000", 2024-04-19T02:16:48.662 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015115195999999999 2024-04-19T02:16:48.662 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.662 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.662 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:48.663 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154768+0000", 2024-04-19T02:16:48.663 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0824999999999997e-05 2024-04-19T02:16:48.663 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.663 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.663 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:48.663 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154790+0000", 2024-04-19T02:16:48.663 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1999000000000001e-05 2024-04-19T02:16:48.663 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.663 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:48.663 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.663 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.663 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.663 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78865 5.4 5:2abefe97:::benchmark_data_smithi121_44835_object78864:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:48.663 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.427133+0000", 2024-04-19T02:16:48.663 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 21.163834076000001, 2024-04-19T02:16:48.663 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020107725999999999, 2024-04-19T02:16:48.664 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:48.664 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:48.664 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:48.664 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:48.664 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:48.664 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78865 2024-04-19T02:16:48.664 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.664 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:48.664 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.664 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:48.664 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.427133+0000", 2024-04-19T02:16:48.664 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:48.664 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.664 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.665 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:48.665 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.427133+0000", 2024-04-19T02:16:48.665 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:48.665 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.665 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.665 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:48.665 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.427132+0000", 2024-04-19T02:16:48.665 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:48.665 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.665 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.665 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:48.665 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.427196+0000", 2024-04-19T02:16:48.665 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.3866000000000001e-05 2024-04-19T02:16:48.665 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.665 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.666 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:48.666 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.427205+0000", 2024-04-19T02:16:48.666 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.6810000000000004e-06 2024-04-19T02:16:48.666 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.666 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.666 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.666 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.427210+0000", 2024-04-19T02:16:48.666 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.6110000000000001e-06 2024-04-19T02:16:48.666 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.666 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.666 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:48.666 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.431822+0000", 2024-04-19T02:16:48.666 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0046120110000000001 2024-04-19T02:16:48.666 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.667 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.667 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:48.667 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.431952+0000", 2024-04-19T02:16:48.667 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000129474 2024-04-19T02:16:48.667 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.667 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.667 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:48.667 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.432087+0000", 2024-04-19T02:16:48.667 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013454 2024-04-19T02:16:48.667 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.667 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.667 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:48.667 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.439095+0000", 2024-04-19T02:16:48.667 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0070082160000000003 2024-04-19T02:16:48.667 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.667 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.668 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:48.668 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.447183+0000", 2024-04-19T02:16:48.668 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0080887690000000009 2024-04-19T02:16:48.668 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.668 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.668 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:48.668 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.447214+0000", 2024-04-19T02:16:48.668 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0131999999999999e-05 2024-04-19T02:16:48.668 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.668 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.668 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:48.668 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.447241+0000", 2024-04-19T02:16:48.668 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.6974999999999998e-05 2024-04-19T02:16:48.668 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.668 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:48.669 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.669 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.669 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.669 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:94475 5.e 5:7a360208:::benchmark_data_smithi121_44835_object94474:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:48.669 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:35.118023+0000", 2024-04-19T02:16:48.669 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 13.472943597, 2024-04-19T02:16:48.669 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020591993999999999, 2024-04-19T02:16:48.669 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:48.669 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:48.669 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:48.669 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:48.669 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:48.669 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 94475 2024-04-19T02:16:48.670 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.670 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:48.670 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.670 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:48.670 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118023+0000", 2024-04-19T02:16:48.670 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:48.670 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.670 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.670 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:48.670 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118023+0000", 2024-04-19T02:16:48.670 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:48.670 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.670 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.671 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:48.671 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118023+0000", 2024-04-19T02:16:48.671 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:48.671 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.671 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.671 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:48.671 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118041+0000", 2024-04-19T02:16:48.671 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.8689999999999999e-05 2024-04-19T02:16:48.671 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.671 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.671 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:48.671 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118049+0000", 2024-04-19T02:16:48.671 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.5939999999999996e-06 2024-04-19T02:16:48.671 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.672 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.672 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.672 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118053+0000", 2024-04-19T02:16:48.672 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2080000000000002e-06 2024-04-19T02:16:48.672 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.672 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.672 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:48.672 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118093+0000", 2024-04-19T02:16:48.672 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9634e-05 2024-04-19T02:16:48.672 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.672 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.672 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:48.672 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118191+0000", 2024-04-19T02:16:48.672 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.8272999999999999e-05 2024-04-19T02:16:48.673 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.673 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.673 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:48.673 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118280+0000", 2024-04-19T02:16:48.673 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.8702999999999994e-05 2024-04-19T02:16:48.673 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.673 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.673 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:48.673 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.124833+0000", 2024-04-19T02:16:48.673 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0065528180000000002 2024-04-19T02:16:48.673 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.673 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.673 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:48.673 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.138520+0000", 2024-04-19T02:16:48.673 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.013686959 2024-04-19T02:16:48.674 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.674 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.674 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:48.674 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.138577+0000", 2024-04-19T02:16:48.674 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7689000000000003e-05 2024-04-19T02:16:48.674 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.674 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.674 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:48.674 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.138615+0000", 2024-04-19T02:16:48.674 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8016999999999999e-05 2024-04-19T02:16:48.674 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.674 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:48.674 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.674 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.675 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.675 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:94481 5.e 5:7b2fbebf:::benchmark_data_smithi121_44835_object94480:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:48.675 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:16:48.675 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 13.46972122, 2024-04-19T02:16:48.675 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020897846000000001, 2024-04-19T02:16:48.675 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:48.675 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:48.675 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:48.675 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:48.675 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:48.675 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 94481 2024-04-19T02:16:48.675 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.675 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:48.675 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.675 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:48.676 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:16:48.676 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:48.676 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.676 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.676 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:48.676 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:16:48.676 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:48.676 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.676 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.676 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:48.676 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121245+0000", 2024-04-19T02:16:48.676 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:48.676 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.676 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.676 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:48.677 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121273+0000", 2024-04-19T02:16:48.677 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7250000000000002e-05 2024-04-19T02:16:48.677 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.677 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.677 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:48.677 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121277+0000", 2024-04-19T02:16:48.677 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2860000000000001e-06 2024-04-19T02:16:48.677 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.677 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.677 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.677 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121280+0000", 2024-04-19T02:16:48.677 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2739999999999999e-06 2024-04-19T02:16:48.677 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.677 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.677 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:48.677 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121320+0000", 2024-04-19T02:16:48.678 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9879000000000002e-05 2024-04-19T02:16:48.678 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.678 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.678 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:48.678 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121448+0000", 2024-04-19T02:16:48.678 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012748800000000001 2024-04-19T02:16:48.678 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.678 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.678 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:48.678 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121595+0000", 2024-04-19T02:16:48.678 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014741299999999999 2024-04-19T02:16:48.678 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.678 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.679 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:48.679 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.127776+0000", 2024-04-19T02:16:48.679 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0061811360000000003 2024-04-19T02:16:48.679 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.679 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.679 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:48.679 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142073+0000", 2024-04-19T02:16:48.679 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014296959999999999 2024-04-19T02:16:48.679 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.679 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.679 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:48.679 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142106+0000", 2024-04-19T02:16:48.679 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3348e-05 2024-04-19T02:16:48.679 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.679 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.679 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:48.680 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142144+0000", 2024-04-19T02:16:48.680 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7153000000000002e-05 2024-04-19T02:16:48.680 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.680 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:48.680 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.680 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.680 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.680 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:94581 5.b 5:dc86d6e9:::benchmark_data_smithi121_44835_object94580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:48.680 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:16:48.680 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 13.410786647, 2024-04-19T02:16:48.680 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022099711000000001, 2024-04-19T02:16:48.680 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:48.680 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:48.680 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:48.680 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:48.681 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:48.681 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 94581 2024-04-19T02:16:48.681 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.681 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:48.681 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.681 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:48.681 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:16:48.681 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:48.681 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.681 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.681 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:48.681 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:16:48.681 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:48.681 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.681 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.681 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:48.682 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:16:48.682 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:48.682 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.682 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.682 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:48.682 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180253+0000", 2024-04-19T02:16:48.682 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3163000000000004e-05 2024-04-19T02:16:48.682 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.682 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.682 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:48.682 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180266+0000", 2024-04-19T02:16:48.682 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2886e-05 2024-04-19T02:16:48.682 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.682 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.682 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.683 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180273+0000", 2024-04-19T02:16:48.683 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.4059999999999999e-06 2024-04-19T02:16:48.683 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.683 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.683 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:48.683 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180646+0000", 2024-04-19T02:16:48.683 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00037283999999999999 2024-04-19T02:16:48.683 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.683 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.683 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:48.683 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180774+0000", 2024-04-19T02:16:48.683 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012793799999999999 2024-04-19T02:16:48.683 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.683 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.683 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:48.684 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180920+0000", 2024-04-19T02:16:48.684 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000146692 2024-04-19T02:16:48.684 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.684 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.684 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:48.684 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.183344+0000", 2024-04-19T02:16:48.684 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0024231669999999999 2024-04-19T02:16:48.684 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.684 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.684 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:48.684 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202196+0000", 2024-04-19T02:16:48.684 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.018852384 2024-04-19T02:16:48.684 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.684 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.685 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:48.685 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202241+0000", 2024-04-19T02:16:48.685 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4923999999999999e-05 2024-04-19T02:16:48.685 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.685 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.685 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:48.685 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202280+0000", 2024-04-19T02:16:48.685 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9096e-05 2024-04-19T02:16:48.685 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.685 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:48.685 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.685 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.685 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.685 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:96356 5.0 5:0a661b39:::benchmark_data_smithi121_44835_object96355:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:48.685 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:16:48.685 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 12.497573805, 2024-04-19T02:16:48.686 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020955516, 2024-04-19T02:16:48.686 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:48.686 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:48.686 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:48.686 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:48.686 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:48.686 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 96356 2024-04-19T02:16:48.686 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.686 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:48.686 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.686 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:48.686 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:16:48.686 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:48.686 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.687 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.687 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:48.687 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:16:48.687 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:48.687 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.687 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.687 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:48.687 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:16:48.687 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:48.687 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.687 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.688 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:48.688 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093455+0000", 2024-04-19T02:16:48.688 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.2205000000000005e-05 2024-04-19T02:16:48.688 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.688 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.688 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:48.688 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093464+0000", 2024-04-19T02:16:48.688 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3910000000000004e-06 2024-04-19T02:16:48.688 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.688 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.688 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.688 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093469+0000", 2024-04-19T02:16:48.688 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.7249999999999997e-06 2024-04-19T02:16:48.688 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.688 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.689 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:48.689 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099643+0000", 2024-04-19T02:16:48.689 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0061743359999999999 2024-04-19T02:16:48.689 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.689 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.689 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:48.689 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099774+0000", 2024-04-19T02:16:48.689 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013050599999999999 2024-04-19T02:16:48.689 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.689 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.689 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:48.689 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099917+0000", 2024-04-19T02:16:48.689 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000143187 2024-04-19T02:16:48.689 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.689 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.689 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:48.690 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.105432+0000", 2024-04-19T02:16:48.690 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.005514873 2024-04-19T02:16:48.690 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.690 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.690 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:48.690 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114264+0000", 2024-04-19T02:16:48.690 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.008831752 2024-04-19T02:16:48.690 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.690 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.690 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:48.690 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114300+0000", 2024-04-19T02:16:48.690 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6582000000000003e-05 2024-04-19T02:16:48.690 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.690 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.691 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:48.691 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114349+0000", 2024-04-19T02:16:48.691 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8579999999999999e-05 2024-04-19T02:16:48.691 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.691 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:48.691 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.691 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.691 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.691 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:96357 5.0 5:00efce8b:::benchmark_data_smithi121_44835_object96356:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:48.691 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:16:48.691 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 12.497494127, 2024-04-19T02:16:48.691 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020937471999999999, 2024-04-19T02:16:48.691 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:48.691 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:48.691 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:48.692 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:48.692 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:48.692 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 96357 2024-04-19T02:16:48.692 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.692 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:48.692 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.692 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:48.692 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:16:48.692 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:48.692 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.692 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.692 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:48.692 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:16:48.692 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:48.692 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.693 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.693 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:48.693 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093472+0000", 2024-04-19T02:16:48.693 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:48.693 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.693 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.693 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:48.693 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093513+0000", 2024-04-19T02:16:48.693 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0213000000000003e-05 2024-04-19T02:16:48.693 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.693 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.693 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:48.693 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093519+0000", 2024-04-19T02:16:48.693 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.066e-06 2024-04-19T02:16:48.694 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.694 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.694 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.694 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093525+0000", 2024-04-19T02:16:48.694 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.8170000000000004e-06 2024-04-19T02:16:48.694 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.694 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.694 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:48.694 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103412+0000", 2024-04-19T02:16:48.694 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0098872739999999997 2024-04-19T02:16:48.694 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.694 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.694 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:48.694 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103551+0000", 2024-04-19T02:16:48.695 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000139295 2024-04-19T02:16:48.695 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.695 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.695 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:48.695 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103701+0000", 2024-04-19T02:16:48.695 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014954599999999999 2024-04-19T02:16:48.695 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.695 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.695 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:48.695 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.108849+0000", 2024-04-19T02:16:48.695 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0051487199999999999 2024-04-19T02:16:48.695 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.695 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.695 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:48.695 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114355+0000", 2024-04-19T02:16:48.696 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0055052529999999999 2024-04-19T02:16:48.696 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.696 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.696 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:48.696 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114379+0000", 2024-04-19T02:16:48.696 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4275000000000001e-05 2024-04-19T02:16:48.696 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.696 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.696 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:48.696 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114410+0000", 2024-04-19T02:16:48.696 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1356999999999998e-05 2024-04-19T02:16:48.696 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.696 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:48.696 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.697 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.697 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.697 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:104431 5.8 5:14818e19:::benchmark_data_smithi121_44835_object104430:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T02:16:48.697 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:16:48.697 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 8.379581602, 2024-04-19T02:16:48.697 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022149528000000002, 2024-04-19T02:16:48.697 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:48.697 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:48.697 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:48.697 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:48.697 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:48.697 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 104431 2024-04-19T02:16:48.697 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.697 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:48.698 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.698 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:48.698 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:16:48.698 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:48.698 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.698 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.698 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:48.698 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:16:48.698 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:48.698 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.698 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.698 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:48.698 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211384+0000", 2024-04-19T02:16:48.698 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:48.699 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.699 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.699 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:48.699 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211458+0000", 2024-04-19T02:16:48.699 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3311000000000003e-05 2024-04-19T02:16:48.699 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.699 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.699 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:48.699 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211471+0000", 2024-04-19T02:16:48.699 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.3308e-05 2024-04-19T02:16:48.699 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.699 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.699 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.699 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211479+0000", 2024-04-19T02:16:48.699 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0909999999999993e-06 2024-04-19T02:16:48.699 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.700 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.700 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:48.700 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.221821+0000", 2024-04-19T02:16:48.700 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010341596999999999 2024-04-19T02:16:48.700 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.700 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.700 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:48.700 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.221966+0000", 2024-04-19T02:16:48.700 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000145167 2024-04-19T02:16:48.700 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.700 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.700 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:48.700 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.222077+0000", 2024-04-19T02:16:48.700 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011128000000000001 2024-04-19T02:16:48.700 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.700 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.701 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:48.701 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.228126+0000", 2024-04-19T02:16:48.701 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0060486710000000003 2024-04-19T02:16:48.701 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.701 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.701 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:48.701 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233449+0000", 2024-04-19T02:16:48.701 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0053231370000000004 2024-04-19T02:16:48.701 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.701 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.701 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:48.701 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233498+0000", 2024-04-19T02:16:48.701 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8798999999999998e-05 2024-04-19T02:16:48.701 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.701 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.702 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:48.702 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233535+0000", 2024-04-19T02:16:48.702 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7119000000000002e-05 2024-04-19T02:16:48.702 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.702 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:48.702 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.702 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.702 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.702 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:114200 5.8 5:1428c006:::benchmark_data_smithi121_44835_object114199:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T02:16:48.702 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:45.082288+0000", 2024-04-19T02:16:48.702 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 3.5086790159999999, 2024-04-19T02:16:48.702 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020551719999999999, 2024-04-19T02:16:48.702 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:48.702 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:48.703 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:48.703 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:48.703 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:48.703 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 114200 2024-04-19T02:16:48.703 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.703 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:48.703 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.703 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:48.703 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.082288+0000", 2024-04-19T02:16:48.703 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:48.703 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.703 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.703 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:48.704 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.082288+0000", 2024-04-19T02:16:48.704 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:48.704 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.704 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.704 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:48.704 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.082287+0000", 2024-04-19T02:16:48.704 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:48.704 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.704 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.704 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:48.704 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.082345+0000", 2024-04-19T02:16:48.705 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7642999999999997e-05 2024-04-19T02:16:48.705 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.705 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.705 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:48.705 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.082351+0000", 2024-04-19T02:16:48.705 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.2999999999999998e-06 2024-04-19T02:16:48.705 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.705 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.705 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.705 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.082355+0000", 2024-04-19T02:16:48.705 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7890000000000001e-06 2024-04-19T02:16:48.705 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.705 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.705 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:48.706 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.085813+0000", 2024-04-19T02:16:48.706 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.003457636 2024-04-19T02:16:48.706 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.706 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.706 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:48.706 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.085918+0000", 2024-04-19T02:16:48.706 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010485299999999999 2024-04-19T02:16:48.706 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.706 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.706 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:48.706 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.086071+0000", 2024-04-19T02:16:48.706 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00015367199999999999 2024-04-19T02:16:48.707 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.707 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.707 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:48.707 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.092128+0000", 2024-04-19T02:16:48.707 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0060571080000000003 2024-04-19T02:16:48.707 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.707 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.707 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:48.707 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.102784+0000", 2024-04-19T02:16:48.707 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010656116 2024-04-19T02:16:48.707 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.707 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.707 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:48.707 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.102818+0000", 2024-04-19T02:16:48.707 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3661999999999997e-05 2024-04-19T02:16:48.708 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:48.708 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:48.708 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:48.708 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.102840+0000", 2024-04-19T02:16:48.708 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1509e-05 2024-04-19T02:16:48.708 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.708 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:48.708 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.708 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:48.708 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:48.708 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:16:48.709 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:48.709+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:48.710 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:16:48.810 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:48.810+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:48.900 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-04-19T02:16:48.901 INFO:teuthology.orchestra.run.smithi177.stdout: "ops": [ 2024-04-19T02:16:48.901 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.901 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:121754 5.3 5:c4280e38:::benchmark_data_smithi121_44835_object121753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T02:16:48.901 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:48.892612+0000", 2024-04-19T02:16:48.901 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0081035120000000002, 2024-04-19T02:16:48.901 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0081330559999999996, 2024-04-19T02:16:48.901 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:48.901 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:48.901 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:48.901 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:48.901 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:48.901 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 121754 2024-04-19T02:16:48.901 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.901 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:48.902 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.902 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:48.902 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.892612+0000", 2024-04-19T02:16:48.902 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:48.902 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.902 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.902 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:48.902 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.892612+0000", 2024-04-19T02:16:48.902 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:48.902 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.902 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.902 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:48.902 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.892611+0000", 2024-04-19T02:16:48.903 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:48.903 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.903 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.903 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:48.903 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.892679+0000", 2024-04-19T02:16:48.903 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.7892999999999995e-05 2024-04-19T02:16:48.903 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.903 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.903 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:48.903 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.892686+0000", 2024-04-19T02:16:48.903 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.8329999999999996e-06 2024-04-19T02:16:48.903 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.903 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.903 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.904 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.892693+0000", 2024-04-19T02:16:48.904 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.1770000000000001e-06 2024-04-19T02:16:48.904 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.904 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.904 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:48.904 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.892737+0000", 2024-04-19T02:16:48.904 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.3535000000000002e-05 2024-04-19T02:16:48.904 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.904 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.904 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:48.904 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.892890+0000", 2024-04-19T02:16:48.904 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00015370800000000001 2024-04-19T02:16:48.904 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.904 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.904 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:48.905 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.893047+0000", 2024-04-19T02:16:48.905 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00015635399999999999 2024-04-19T02:16:48.905 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.905 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.905 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:48.905 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.900024+0000", 2024-04-19T02:16:48.905 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0069767479999999996 2024-04-19T02:16:48.905 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:48.905 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:48.905 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:48.905 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.905 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.905 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:121755 5.1 5:8e7336e0:::benchmark_data_smithi121_44835_object121754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T02:16:48.905 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:48.892704+0000", 2024-04-19T02:16:48.906 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0080116030000000008, 2024-04-19T02:16:48.906 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0081391109999999992, 2024-04-19T02:16:48.906 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:48.906 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:48.906 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:48.906 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:48.906 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:48.906 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 121755 2024-04-19T02:16:48.906 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.906 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:48.906 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.906 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:48.906 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.892704+0000", 2024-04-19T02:16:48.906 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:48.907 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.907 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.907 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:48.907 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.892704+0000", 2024-04-19T02:16:48.907 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:48.907 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.907 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.907 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:48.907 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.892703+0000", 2024-04-19T02:16:48.907 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:48.907 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.907 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.907 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:48.907 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.892725+0000", 2024-04-19T02:16:48.907 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.1548000000000001e-05 2024-04-19T02:16:48.908 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.908 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.908 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:48.908 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.892730+0000", 2024-04-19T02:16:48.908 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.9389999999999996e-06 2024-04-19T02:16:48.908 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.908 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.908 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.908 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.892733+0000", 2024-04-19T02:16:48.908 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.4759999999999998e-06 2024-04-19T02:16:48.908 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.908 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.908 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:48.908 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.892773+0000", 2024-04-19T02:16:48.908 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.9793999999999999e-05 2024-04-19T02:16:48.909 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.909 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.909 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:48.909 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.892909+0000", 2024-04-19T02:16:48.909 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00013581199999999999 2024-04-19T02:16:48.909 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.909 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.909 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:48.909 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.893034+0000", 2024-04-19T02:16:48.909 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012490999999999999 2024-04-19T02:16:48.909 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.909 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.909 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:48.909 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.897042+0000", 2024-04-19T02:16:48.910 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0040081860000000004 2024-04-19T02:16:48.910 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.910 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.910 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:48.910 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.897132+0000", 2024-04-19T02:16:48.910 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.9835999999999998e-05 2024-04-19T02:16:48.910 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:48.910 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:48.910 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:48.910 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.910 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.910 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:121758 5.3 5:ce6a31dc:::benchmark_data_smithi121_44835_object121757:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T02:16:48.910 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:48.892742+0000", 2024-04-19T02:16:48.910 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0079735220000000002, 2024-04-19T02:16:48.910 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0082290739999999994, 2024-04-19T02:16:48.911 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:48.911 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:48.911 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:48.911 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:48.911 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:48.911 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 121758 2024-04-19T02:16:48.911 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.911 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:48.911 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.911 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:48.911 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.892742+0000", 2024-04-19T02:16:48.911 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:48.911 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.911 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.911 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:48.912 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.892742+0000", 2024-04-19T02:16:48.912 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:48.912 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.912 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.912 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:48.912 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.892742+0000", 2024-04-19T02:16:48.912 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:48.912 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.912 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.912 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:48.912 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.892903+0000", 2024-04-19T02:16:48.912 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00016111599999999999 2024-04-19T02:16:48.912 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.912 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.913 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:48.913 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.892911+0000", 2024-04-19T02:16:48.913 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.8769999999999993e-06 2024-04-19T02:16:48.913 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.913 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.913 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.913 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.892918+0000", 2024-04-19T02:16:48.913 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.7660000000000001e-06 2024-04-19T02:16:48.913 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.913 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.913 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:48.913 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.895989+0000", 2024-04-19T02:16:48.913 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.003071505 2024-04-19T02:16:48.913 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.914 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.914 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:48.914 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.896122+0000", 2024-04-19T02:16:48.914 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000132829 2024-04-19T02:16:48.914 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.914 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.914 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:48.914 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.896264+0000", 2024-04-19T02:16:48.914 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00014227700000000001 2024-04-19T02:16:48.914 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.914 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.914 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:48.914 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.900030+0000", 2024-04-19T02:16:48.914 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0037656640000000002 2024-04-19T02:16:48.915 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:48.915 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:48.915 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:48.915 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.915 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.915 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:121760 5.3 5:cf70d683:::benchmark_data_smithi121_44835_object121759:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T02:16:48.915 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:48.892926+0000", 2024-04-19T02:16:48.915 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0077901460000000004, 2024-04-19T02:16:48.915 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0081379850000000004, 2024-04-19T02:16:48.915 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:48.915 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:48.915 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:48.915 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:48.915 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:48.915 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 121760 2024-04-19T02:16:48.916 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.916 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:48.916 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.916 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:48.916 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.892926+0000", 2024-04-19T02:16:48.916 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:48.916 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.916 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.916 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:48.916 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.892926+0000", 2024-04-19T02:16:48.916 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:48.916 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.916 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.916 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:48.916 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.892925+0000", 2024-04-19T02:16:48.917 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:48.917 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.917 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.917 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:48.917 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.893040+0000", 2024-04-19T02:16:48.917 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000114922 2024-04-19T02:16:48.917 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.917 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.917 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:48.917 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.893050+0000", 2024-04-19T02:16:48.917 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0353000000000001e-05 2024-04-19T02:16:48.917 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.917 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.917 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.918 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.893058+0000", 2024-04-19T02:16:48.918 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.6459999999999993e-06 2024-04-19T02:16:48.918 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.918 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.918 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:48.918 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.898227+0000", 2024-04-19T02:16:48.918 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0051694799999999997 2024-04-19T02:16:48.918 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.918 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.918 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:48.918 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.898319+0000", 2024-04-19T02:16:48.918 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.1864e-05 2024-04-19T02:16:48.918 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.918 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.918 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:48.919 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.898438+0000", 2024-04-19T02:16:48.919 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00011894499999999999 2024-04-19T02:16:48.919 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.919 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.919 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:48.919 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.900355+0000", 2024-04-19T02:16:48.919 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.001917216 2024-04-19T02:16:48.919 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:48.919 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:48.919 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:48.919 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.919 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.919 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:121763 5.c 5:3d9f6cac:::benchmark_data_smithi121_44835_object121762:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T02:16:48.920 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:48.893134+0000", 2024-04-19T02:16:48.920 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0075814089999999999, 2024-04-19T02:16:48.920 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0080357520000000002, 2024-04-19T02:16:48.920 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:48.920 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:48.920 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:48.920 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:48.920 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:48.920 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 121763 2024-04-19T02:16:48.920 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.920 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:48.920 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.920 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:48.920 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.893134+0000", 2024-04-19T02:16:48.921 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:48.921 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.921 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.921 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:48.921 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.893134+0000", 2024-04-19T02:16:48.921 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:48.921 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.921 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.921 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:48.921 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.893133+0000", 2024-04-19T02:16:48.921 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:48.921 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.921 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.921 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:48.921 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.893324+0000", 2024-04-19T02:16:48.922 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00019011500000000001 2024-04-19T02:16:48.922 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.922 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.922 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:48.922 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.893332+0000", 2024-04-19T02:16:48.922 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.3019999999999995e-06 2024-04-19T02:16:48.922 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.922 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.922 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.922 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.893338+0000", 2024-04-19T02:16:48.922 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.3470000000000004e-06 2024-04-19T02:16:48.922 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.922 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.922 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:48.923 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.893373+0000", 2024-04-19T02:16:48.923 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.4520000000000002e-05 2024-04-19T02:16:48.923 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.923 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.923 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:48.923 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.893537+0000", 2024-04-19T02:16:48.923 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00016395599999999999 2024-04-19T02:16:48.923 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.923 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.923 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:48.923 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.893668+0000", 2024-04-19T02:16:48.923 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000131216 2024-04-19T02:16:48.923 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.923 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.923 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:48.924 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.897092+0000", 2024-04-19T02:16:48.924 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.003424182 2024-04-19T02:16:48.924 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:48.924 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:48.924 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:48.924 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.924 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.924 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:121770 5.7 e41/16 5:e613b736:::benchmark_data_smithi121_44835_object121769:head v 41'7629, mlcod=41'7626)", 2024-04-19T02:16:48.924 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:48.900166+0000", 2024-04-19T02:16:48.924 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.00054927700000000003, 2024-04-19T02:16:48.924 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0010981579999999999, 2024-04-19T02:16:48.924 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:48.924 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:48.924 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:48.924 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.925 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:48.925 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.900166+0000", 2024-04-19T02:16:48.925 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:48.925 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.925 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.925 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:48.925 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.900166+0000", 2024-04-19T02:16:48.925 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:48.925 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.925 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.925 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:48.925 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.900166+0000", 2024-04-19T02:16:48.925 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:48.925 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.925 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.925 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:48.926 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.900238+0000", 2024-04-19T02:16:48.926 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.2490000000000006e-05 2024-04-19T02:16:48.926 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.926 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.926 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:48.926 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.900251+0000", 2024-04-19T02:16:48.926 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.2677000000000001e-05 2024-04-19T02:16:48.926 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.926 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.926 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.926 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.900259+0000", 2024-04-19T02:16:48.926 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.6140000000000003e-06 2024-04-19T02:16:48.926 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.926 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.927 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:48.927 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.900296+0000", 2024-04-19T02:16:48.927 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.7036000000000003e-05 2024-04-19T02:16:48.927 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.927 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.927 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:48.927 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.900309+0000", 2024-04-19T02:16:48.927 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.3105000000000001e-05 2024-04-19T02:16:48.927 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:48.927 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:48.927 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:48.927 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.927 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.927 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:121772 5.c 5:39d17f03:::benchmark_data_smithi121_44835_object121771:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T02:16:48.928 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:48.900833+0000", 2024-04-19T02:16:48.928 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4294967295.9998822, 2024-04-19T02:16:48.928 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00049914700000000002, 2024-04-19T02:16:48.928 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:48.928 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:48.928 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:48.928 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:48.928 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:48.928 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 121772 2024-04-19T02:16:48.928 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.928 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:48.928 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.928 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:48.928 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.900833+0000", 2024-04-19T02:16:48.928 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:48.929 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.929 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.929 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:48.929 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.900833+0000", 2024-04-19T02:16:48.929 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:48.929 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.929 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.929 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:48.929 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.900832+0000", 2024-04-19T02:16:48.929 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:48.929 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.929 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.929 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:48.929 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.900893+0000", 2024-04-19T02:16:48.930 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.0782000000000002e-05 2024-04-19T02:16:48.930 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.930 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.930 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:48.930 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.900905+0000", 2024-04-19T02:16:48.930 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.183e-05 2024-04-19T02:16:48.930 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.930 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.930 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.930 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.900913+0000", 2024-04-19T02:16:48.930 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.5870000000000004e-06 2024-04-19T02:16:48.930 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.930 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.930 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:48.930 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.900954+0000", 2024-04-19T02:16:48.931 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.1149999999999997e-05 2024-04-19T02:16:48.931 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.931 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.931 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:48.931 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.901119+0000", 2024-04-19T02:16:48.931 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000165668 2024-04-19T02:16:48.931 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.931 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.931 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:48.931 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.901271+0000", 2024-04-19T02:16:48.931 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00015109300000000001 2024-04-19T02:16:48.931 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:48.931 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:48.932 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:48.932 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.932 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.932 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:121771 5.e e41/16 5:73ef21f5:::benchmark_data_smithi121_44835_object121770:head v 41'7493, mlcod=41'7491)", 2024-04-19T02:16:48.932 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:48.900964+0000", 2024-04-19T02:16:48.932 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4294967295.999752, 2024-04-19T02:16:48.932 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00043140799999999999, 2024-04-19T02:16:48.932 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:48.932 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:48.932 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:48.932 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.932 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:48.932 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.900964+0000", 2024-04-19T02:16:48.932 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:48.932 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.933 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.933 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:48.933 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.900964+0000", 2024-04-19T02:16:48.933 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:48.933 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.933 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.933 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:48.933 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.900963+0000", 2024-04-19T02:16:48.933 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:48.933 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.933 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.933 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:48.933 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.901035+0000", 2024-04-19T02:16:48.933 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.1762999999999997e-05 2024-04-19T02:16:48.934 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.934 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.934 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:48.934 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.901061+0000", 2024-04-19T02:16:48.934 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.5996999999999999e-05 2024-04-19T02:16:48.934 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.934 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.934 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.934 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.901067+0000", 2024-04-19T02:16:48.934 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.3280000000000002e-06 2024-04-19T02:16:48.934 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.934 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.934 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:48.934 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.901100+0000", 2024-04-19T02:16:48.935 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.3311e-05 2024-04-19T02:16:48.935 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.935 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.935 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:48.935 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.901117+0000", 2024-04-19T02:16:48.935 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.7051999999999999e-05 2024-04-19T02:16:48.935 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:48.935 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:48.935 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:48.935 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.935 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.935 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:121773 5.6 5:6f7256bf:::benchmark_data_smithi121_44835_object121772:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T02:16:48.935 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:48.901196+0000", 2024-04-19T02:16:48.935 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4294967295.9995198, 2024-04-19T02:16:48.936 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00024630300000000002, 2024-04-19T02:16:48.936 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:48.936 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "reached pg", 2024-04-19T02:16:48.936 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:48.936 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:48.936 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:48.936 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 121773 2024-04-19T02:16:48.936 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.936 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:48.936 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.936 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:48.936 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.901196+0000", 2024-04-19T02:16:48.936 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:48.936 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.936 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.936 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:48.937 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.901196+0000", 2024-04-19T02:16:48.937 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:48.937 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.937 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.937 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:48.937 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.901195+0000", 2024-04-19T02:16:48.937 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:48.937 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.937 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.937 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:48.937 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.901295+0000", 2024-04-19T02:16:48.937 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.9408999999999996e-05 2024-04-19T02:16:48.937 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.937 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.938 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:48.938 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.901304+0000", 2024-04-19T02:16:48.938 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.6309999999999998e-06 2024-04-19T02:16:48.938 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.938 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.938 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:48.938 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.901311+0000", 2024-04-19T02:16:48.938 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.0670000000000003e-06 2024-04-19T02:16:48.938 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:48.938 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:48.938 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:48.938 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:48.901347+0000", 2024-04-19T02:16:48.938 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6111e-05 2024-04-19T02:16:48.938 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:48.939 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:48.939 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:48.939 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:48.939 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2024-04-19T02:16:48.939 INFO:teuthology.orchestra.run.smithi177.stdout: "num_ops": 9 2024-04-19T02:16:48.939 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-04-19T02:16:48.940 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:48.940+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:48.941 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:16:49.029 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 54 16 122002 121986 141.176 122.188 0.00570481 0.0070807 2024-04-19T02:16:49.040 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:49.041+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:49.122 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-04-19T02:16:49.122 INFO:teuthology.orchestra.run.smithi177.stdout: "ops": [], 2024-04-19T02:16:49.122 INFO:teuthology.orchestra.run.smithi177.stdout: "complaint_time": 30, 2024-04-19T02:16:49.122 INFO:teuthology.orchestra.run.smithi177.stdout: "num_blocked_ops": 0 2024-04-19T02:16:49.123 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-04-19T02:16:49.138 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:16:49.141 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:49.141+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:49.169 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T02:16:49.242 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:49.242+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:49.330 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-04-19T02:16:49.478 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 20, 2024-04-19T02:16:49.478 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 600, 2024-04-19T02:16:49.479 INFO:teuthology.orchestra.run.smithi177.stdout: "ops": [ 2024-04-19T02:16:49.479 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.479 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:61815 5.c 5:3ca8a794:::benchmark_data_smithi121_44835_object61814:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:49.479 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:17.482110+0000", 2024-04-19T02:16:49.479 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 31.847022701, 2024-04-19T02:16:49.479 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.021577559999999999, 2024-04-19T02:16:49.479 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:49.479 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:49.479 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:49.479 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:49.479 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:49.479 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 61815 2024-04-19T02:16:49.479 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.479 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:49.480 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.480 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:49.480 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482110+0000", 2024-04-19T02:16:49.480 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:49.480 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.480 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.480 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:49.480 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482110+0000", 2024-04-19T02:16:49.480 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:49.480 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.480 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.480 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:49.480 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482109+0000", 2024-04-19T02:16:49.480 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:49.481 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.481 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.481 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:49.481 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482197+0000", 2024-04-19T02:16:49.481 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.7405999999999996e-05 2024-04-19T02:16:49.481 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.481 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.481 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:49.481 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482206+0000", 2024-04-19T02:16:49.481 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.0010000000000007e-06 2024-04-19T02:16:49.481 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.481 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.481 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:49.481 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482211+0000", 2024-04-19T02:16:49.481 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.4569999999999996e-06 2024-04-19T02:16:49.481 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.482 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.482 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:49.482 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.489465+0000", 2024-04-19T02:16:49.482 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.007253776 2024-04-19T02:16:49.482 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.482 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.482 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:49.482 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.489582+0000", 2024-04-19T02:16:49.482 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00011669500000000001 2024-04-19T02:16:49.482 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.482 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.482 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:49.482 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.489684+0000", 2024-04-19T02:16:49.482 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000102533 2024-04-19T02:16:49.483 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.483 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.483 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:49.483 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.491836+0000", 2024-04-19T02:16:49.483 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0021516759999999999 2024-04-19T02:16:49.483 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.483 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.483 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:49.483 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503615+0000", 2024-04-19T02:16:49.483 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.011778906 2024-04-19T02:16:49.483 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.483 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.483 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:49.483 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503652+0000", 2024-04-19T02:16:49.483 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6622999999999998e-05 2024-04-19T02:16:49.484 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.484 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.484 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:49.484 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503688+0000", 2024-04-19T02:16:49.484 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6127000000000002e-05 2024-04-19T02:16:49.484 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:49.484 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:49.484 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:49.484 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.484 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.484 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:78247 5.c 5:3efb1468:::benchmark_data_smithi121_44835_object78246:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:49.484 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.116347+0000", 2024-04-19T02:16:49.484 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 22.212785646, 2024-04-19T02:16:49.484 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.032194436999999999, 2024-04-19T02:16:49.485 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:49.485 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:49.485 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:49.485 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:49.485 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:49.485 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 78247 2024-04-19T02:16:49.485 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.485 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:49.485 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.485 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:49.485 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116347+0000", 2024-04-19T02:16:49.485 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:49.485 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.485 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.485 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:49.486 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116347+0000", 2024-04-19T02:16:49.486 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:49.486 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.486 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.486 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:49.486 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116346+0000", 2024-04-19T02:16:49.486 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:49.486 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.486 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.486 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:49.486 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116370+0000", 2024-04-19T02:16:49.486 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.3892000000000001e-05 2024-04-19T02:16:49.486 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.486 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.487 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:49.487 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116385+0000", 2024-04-19T02:16:49.487 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.5162e-05 2024-04-19T02:16:49.487 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.487 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.487 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:49.487 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116394+0000", 2024-04-19T02:16:49.487 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.8000000000000004e-06 2024-04-19T02:16:49.487 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.487 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.488 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:49.488 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124856+0000", 2024-04-19T02:16:49.488 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0084622169999999993 2024-04-19T02:16:49.488 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.488 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.488 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:49.488 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124966+0000", 2024-04-19T02:16:49.488 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000109747 2024-04-19T02:16:49.488 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.488 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.488 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:49.488 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125216+0000", 2024-04-19T02:16:49.488 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000249545 2024-04-19T02:16:49.488 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.488 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.489 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:49.489 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.131713+0000", 2024-04-19T02:16:49.489 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0064972370000000003 2024-04-19T02:16:49.489 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.489 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.489 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:49.489 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148323+0000", 2024-04-19T02:16:49.489 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016609641000000001 2024-04-19T02:16:49.489 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.489 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.489 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:49.489 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148359+0000", 2024-04-19T02:16:49.489 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6412000000000003e-05 2024-04-19T02:16:49.489 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.489 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.489 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:49.490 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148542+0000", 2024-04-19T02:16:49.490 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00018265600000000001 2024-04-19T02:16:49.490 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:49.490 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:49.490 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:49.490 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.490 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.490 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:78248 5.c 5:30b7cc74:::benchmark_data_smithi121_44835_object78247:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:49.490 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.116471+0000", 2024-04-19T02:16:49.490 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 22.212662144999999, 2024-04-19T02:16:49.490 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.032127452000000001, 2024-04-19T02:16:49.490 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:49.490 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:49.490 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:49.491 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:49.491 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:49.491 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 78248 2024-04-19T02:16:49.491 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.491 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:49.491 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.491 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:49.491 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116471+0000", 2024-04-19T02:16:49.491 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:49.491 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.491 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.491 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:49.491 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116471+0000", 2024-04-19T02:16:49.491 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:49.491 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.492 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.492 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:49.492 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116470+0000", 2024-04-19T02:16:49.492 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:49.492 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.492 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.492 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:49.492 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116496+0000", 2024-04-19T02:16:49.492 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.5517e-05 2024-04-19T02:16:49.492 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.492 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.492 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:49.492 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116505+0000", 2024-04-19T02:16:49.492 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.9250000000000007e-06 2024-04-19T02:16:49.492 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.493 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.493 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:49.493 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116516+0000", 2024-04-19T02:16:49.493 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.012e-05 2024-04-19T02:16:49.493 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.493 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.493 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:49.493 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.127803+0000", 2024-04-19T02:16:49.493 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.011287523000000001 2024-04-19T02:16:49.493 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.493 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.493 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:49.493 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.127932+0000", 2024-04-19T02:16:49.493 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012848499999999999 2024-04-19T02:16:49.493 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.494 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.494 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:49.494 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128022+0000", 2024-04-19T02:16:49.494 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.0890000000000006e-05 2024-04-19T02:16:49.494 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.494 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.494 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:49.494 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.131909+0000", 2024-04-19T02:16:49.494 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0038864609999999999 2024-04-19T02:16:49.494 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.494 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.494 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:49.494 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148552+0000", 2024-04-19T02:16:49.494 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016643162999999999 2024-04-19T02:16:49.495 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.495 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.495 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:49.495 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148577+0000", 2024-04-19T02:16:49.495 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.5333999999999998e-05 2024-04-19T02:16:49.495 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.495 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.495 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:49.495 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148598+0000", 2024-04-19T02:16:49.495 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.0687999999999999e-05 2024-04-19T02:16:49.495 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:49.495 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:49.495 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:49.495 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.495 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.496 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:78258 5.a 5:549070de:::benchmark_data_smithi121_44835_object78257:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:49.496 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.124295+0000", 2024-04-19T02:16:49.496 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 22.204837599000001, 2024-04-19T02:16:49.496 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020189543000000001, 2024-04-19T02:16:49.496 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:49.496 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:49.496 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:49.496 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:49.496 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:49.496 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 78258 2024-04-19T02:16:49.496 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.496 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:49.496 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.496 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:49.496 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124295+0000", 2024-04-19T02:16:49.497 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:49.497 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.497 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.497 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:49.497 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124295+0000", 2024-04-19T02:16:49.497 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:49.497 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.497 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.497 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:49.497 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124294+0000", 2024-04-19T02:16:49.497 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:49.497 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.497 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.497 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:49.498 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124358+0000", 2024-04-19T02:16:49.498 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.4040000000000003e-05 2024-04-19T02:16:49.498 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.498 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.498 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:49.498 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124374+0000", 2024-04-19T02:16:49.498 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.5291e-05 2024-04-19T02:16:49.498 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.498 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.498 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:49.498 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124383+0000", 2024-04-19T02:16:49.498 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.8360000000000004e-06 2024-04-19T02:16:49.498 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.498 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.499 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:49.499 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124908+0000", 2024-04-19T02:16:49.499 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00052415700000000003 2024-04-19T02:16:49.499 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.499 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.499 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:49.499 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125023+0000", 2024-04-19T02:16:49.499 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00011506999999999999 2024-04-19T02:16:49.499 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.499 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.499 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:49.499 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125182+0000", 2024-04-19T02:16:49.499 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00015942500000000001 2024-04-19T02:16:49.499 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.500 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.500 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:49.500 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.129505+0000", 2024-04-19T02:16:49.500 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0043225080000000001 2024-04-19T02:16:49.500 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.500 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.500 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:49.500 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.144379+0000", 2024-04-19T02:16:49.500 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.014874263 2024-04-19T02:16:49.500 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.500 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.500 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:49.500 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.144444+0000", 2024-04-19T02:16:49.500 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.5451999999999996e-05 2024-04-19T02:16:49.500 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.500 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.501 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:49.501 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.144485+0000", 2024-04-19T02:16:49.501 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.0426999999999998e-05 2024-04-19T02:16:49.501 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:49.501 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:49.501 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:49.501 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.501 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.501 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:78259 5.4 e31/16 5:2aa344b2:::benchmark_data_smithi121_44835_object78258:head v 31'4849, mlcod=31'4843)", 2024-04-19T02:16:49.501 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.125675+0000", 2024-04-19T02:16:49.501 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 22.203457727, 2024-04-19T02:16:49.501 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.022419326, 2024-04-19T02:16:49.501 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:49.501 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:49.501 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:49.502 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.502 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:49.502 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125675+0000", 2024-04-19T02:16:49.502 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:49.502 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.502 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.502 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:49.502 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125675+0000", 2024-04-19T02:16:49.502 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:49.502 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.502 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.502 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:49.502 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125674+0000", 2024-04-19T02:16:49.502 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:49.503 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.503 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.503 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:49.503 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125723+0000", 2024-04-19T02:16:49.503 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.8998000000000001e-05 2024-04-19T02:16:49.503 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.503 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.503 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:49.503 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125733+0000", 2024-04-19T02:16:49.503 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.1379999999999996e-06 2024-04-19T02:16:49.503 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.503 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.503 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:49.503 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125740+0000", 2024-04-19T02:16:49.503 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.0779999999999998e-06 2024-04-19T02:16:49.503 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.504 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.504 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:49.504 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.129589+0000", 2024-04-19T02:16:49.504 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0038488910000000001 2024-04-19T02:16:49.504 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.504 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.504 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:49.504 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.129605+0000", 2024-04-19T02:16:49.504 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.6877000000000001e-05 2024-04-19T02:16:49.504 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.504 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.504 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:49.506 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148057+0000", 2024-04-19T02:16:49.506 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.018451624 2024-04-19T02:16:49.506 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.506 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.506 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:49.507 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148094+0000", 2024-04-19T02:16:49.507 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.7327999999999999e-05 2024-04-19T02:16:49.507 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:49.507 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:49.507 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:49.507 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.507 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.507 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:78263 5.1 5:8e231862:::benchmark_data_smithi121_44835_object78262:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:49.507 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.128154+0000", 2024-04-19T02:16:49.507 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 22.200978541000001, 2024-04-19T02:16:49.507 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020882214, 2024-04-19T02:16:49.507 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:49.507 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:49.507 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:49.507 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:49.508 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:49.508 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 78263 2024-04-19T02:16:49.508 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.508 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:49.508 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.508 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:49.508 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128154+0000", 2024-04-19T02:16:49.508 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:49.508 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.508 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.508 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:49.508 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128154+0000", 2024-04-19T02:16:49.508 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:49.508 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.509 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.509 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:49.509 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128153+0000", 2024-04-19T02:16:49.509 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:49.509 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.509 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.509 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:49.509 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128246+0000", 2024-04-19T02:16:49.509 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.302e-05 2024-04-19T02:16:49.509 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.509 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.509 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:49.509 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128263+0000", 2024-04-19T02:16:49.509 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.6753e-05 2024-04-19T02:16:49.509 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.509 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.510 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:49.510 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128271+0000", 2024-04-19T02:16:49.510 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.2290000000000003e-06 2024-04-19T02:16:49.510 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.510 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.510 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:49.510 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128459+0000", 2024-04-19T02:16:49.510 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00018772 2024-04-19T02:16:49.510 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.510 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.510 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:49.510 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128574+0000", 2024-04-19T02:16:49.510 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00011437700000000001 2024-04-19T02:16:49.511 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.511 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.511 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:49.511 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128696+0000", 2024-04-19T02:16:49.511 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000122831 2024-04-19T02:16:49.511 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.511 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.511 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:49.511 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.130816+0000", 2024-04-19T02:16:49.511 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0021196750000000001 2024-04-19T02:16:49.511 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.511 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.511 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:49.511 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.131859+0000", 2024-04-19T02:16:49.511 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0010434419999999999 2024-04-19T02:16:49.512 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.512 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.512 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:49.512 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148848+0000", 2024-04-19T02:16:49.512 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016988712 2024-04-19T02:16:49.512 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.512 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.512 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:49.512 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148905+0000", 2024-04-19T02:16:49.512 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.6722999999999999e-05 2024-04-19T02:16:49.512 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.512 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.512 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:49.512 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.149036+0000", 2024-04-19T02:16:49.512 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000131567 2024-04-19T02:16:49.513 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:49.513 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:49.513 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:49.513 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.513 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.513 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:78271 5.4 e31/16 5:2982d7a6:::benchmark_data_smithi121_44835_object78270:head v 31'4850, mlcod=31'4847)", 2024-04-19T02:16:49.513 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.132554+0000", 2024-04-19T02:16:49.513 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 22.196579007, 2024-04-19T02:16:49.513 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020294946000000001, 2024-04-19T02:16:49.513 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:49.513 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:49.513 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:49.514 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.514 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:49.514 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132554+0000", 2024-04-19T02:16:49.514 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:49.514 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.514 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.514 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:49.514 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132554+0000", 2024-04-19T02:16:49.514 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:49.514 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.514 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.514 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:49.514 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132553+0000", 2024-04-19T02:16:49.514 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:49.515 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.515 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.515 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:49.515 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132615+0000", 2024-04-19T02:16:49.515 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.1772000000000004e-05 2024-04-19T02:16:49.515 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.515 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.515 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:49.515 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132620+0000", 2024-04-19T02:16:49.515 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.0939999999999998e-06 2024-04-19T02:16:49.515 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.515 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.515 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:49.515 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132624+0000", 2024-04-19T02:16:49.515 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.2229999999999999e-06 2024-04-19T02:16:49.516 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.516 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.516 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:49.516 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132649+0000", 2024-04-19T02:16:49.516 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.5352000000000001e-05 2024-04-19T02:16:49.516 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.516 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.516 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:49.516 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132661+0000", 2024-04-19T02:16:49.516 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.1851999999999999e-05 2024-04-19T02:16:49.516 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.516 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.516 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:49.516 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.152820+0000", 2024-04-19T02:16:49.516 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020159369999999999 2024-04-19T02:16:49.516 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.517 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.517 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:49.517 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.152849+0000", 2024-04-19T02:16:49.517 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.868e-05 2024-04-19T02:16:49.517 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:49.517 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:49.517 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:49.517 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.517 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.517 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:87963 5.3 5:c47b3227:::benchmark_data_smithi121_44835_object87962:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T02:16:49.517 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:31.833755+0000", 2024-04-19T02:16:49.517 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 17.495377886, 2024-04-19T02:16:49.517 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.019779005999999998, 2024-04-19T02:16:49.517 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:49.517 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:49.518 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:49.518 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:49.518 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:49.518 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 87963 2024-04-19T02:16:49.518 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.518 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:49.518 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.518 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:49.518 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.833755+0000", 2024-04-19T02:16:49.518 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:49.518 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.518 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.518 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:49.518 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.833755+0000", 2024-04-19T02:16:49.518 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:49.519 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.519 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.519 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:49.519 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.833754+0000", 2024-04-19T02:16:49.519 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:49.519 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.519 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.519 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:49.519 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.833881+0000", 2024-04-19T02:16:49.519 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000126785 2024-04-19T02:16:49.519 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.519 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.519 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:49.519 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.833890+0000", 2024-04-19T02:16:49.519 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.0110000000000006e-06 2024-04-19T02:16:49.520 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.520 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.520 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:49.520 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.833897+0000", 2024-04-19T02:16:49.520 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.5309999999999998e-06 2024-04-19T02:16:49.520 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.520 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.520 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:49.520 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.842658+0000", 2024-04-19T02:16:49.520 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0087616929999999992 2024-04-19T02:16:49.520 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.520 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.520 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:49.520 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.842749+0000", 2024-04-19T02:16:49.520 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.0556999999999994e-05 2024-04-19T02:16:49.521 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.521 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.521 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:49.521 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.842832+0000", 2024-04-19T02:16:49.521 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.2696999999999998e-05 2024-04-19T02:16:49.521 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.521 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.521 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:49.521 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.844494+0000", 2024-04-19T02:16:49.521 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0016623429999999999 2024-04-19T02:16:49.521 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.521 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.521 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:49.521 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.853446+0000", 2024-04-19T02:16:49.521 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0089523499999999995 2024-04-19T02:16:49.522 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.522 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.522 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:49.522 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.853495+0000", 2024-04-19T02:16:49.522 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.8847999999999997e-05 2024-04-19T02:16:49.522 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.522 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.522 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:49.522 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:31.853534+0000", 2024-04-19T02:16:49.522 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.8829999999999999e-05 2024-04-19T02:16:49.522 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:49.522 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:49.523 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:49.523 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.523 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.523 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:94191 5.c 5:3155c784:::benchmark_data_smithi121_44835_object94190:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T02:16:49.523 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:34.963381+0000", 2024-04-19T02:16:49.523 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 14.365751321999999, 2024-04-19T02:16:49.523 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.021414343999999998, 2024-04-19T02:16:49.523 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:49.523 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:49.523 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:49.523 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:49.523 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:49.523 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 94191 2024-04-19T02:16:49.523 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.523 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:49.523 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.524 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:49.524 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.963381+0000", 2024-04-19T02:16:49.524 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:49.524 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.524 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.524 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:49.524 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.963381+0000", 2024-04-19T02:16:49.524 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:49.524 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.524 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.524 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:49.524 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.963381+0000", 2024-04-19T02:16:49.524 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:49.524 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.524 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.525 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:49.525 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.963457+0000", 2024-04-19T02:16:49.525 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.5827000000000004e-05 2024-04-19T02:16:49.525 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.525 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.525 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:49.525 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.963465+0000", 2024-04-19T02:16:49.525 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.2800000000000003e-06 2024-04-19T02:16:49.525 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.525 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.525 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:49.525 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.963470+0000", 2024-04-19T02:16:49.525 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.2310000000000004e-06 2024-04-19T02:16:49.525 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.526 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.526 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:49.526 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.969469+0000", 2024-04-19T02:16:49.526 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0059987169999999998 2024-04-19T02:16:49.526 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.526 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.526 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:49.526 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.969594+0000", 2024-04-19T02:16:49.526 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012517299999999999 2024-04-19T02:16:49.526 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.526 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.526 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:49.526 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.969759+0000", 2024-04-19T02:16:49.526 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00016459999999999999 2024-04-19T02:16:49.527 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.527 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.527 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:49.527 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.975130+0000", 2024-04-19T02:16:49.527 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0053717410000000002 2024-04-19T02:16:49.527 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.527 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.527 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:49.527 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.984704+0000", 2024-04-19T02:16:49.527 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.009573715 2024-04-19T02:16:49.527 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.527 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.527 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:49.527 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.984758+0000", 2024-04-19T02:16:49.527 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.4039000000000002e-05 2024-04-19T02:16:49.528 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.528 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.528 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:49.528 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.984796+0000", 2024-04-19T02:16:49.528 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.7619e-05 2024-04-19T02:16:49.528 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:49.528 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:49.528 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:49.528 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.528 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.528 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:94471 5.6 5:641302c2:::benchmark_data_smithi121_44835_object94470:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:49.528 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:35.112592+0000", 2024-04-19T02:16:49.528 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 14.216541257999999, 2024-04-19T02:16:49.528 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.023525194999999999, 2024-04-19T02:16:49.528 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:49.529 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:49.529 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:49.529 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:49.529 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:49.529 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 94471 2024-04-19T02:16:49.529 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.529 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:49.529 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.529 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:49.529 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.112592+0000", 2024-04-19T02:16:49.529 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:49.529 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.529 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.529 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:49.529 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.112592+0000", 2024-04-19T02:16:49.530 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:49.530 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.530 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.530 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:49.530 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.112591+0000", 2024-04-19T02:16:49.530 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:49.530 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.530 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.530 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:49.530 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.112621+0000", 2024-04-19T02:16:49.530 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.0701999999999998e-05 2024-04-19T02:16:49.530 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.530 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.530 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:49.530 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.112631+0000", 2024-04-19T02:16:49.531 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.3209999999999994e-06 2024-04-19T02:16:49.531 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.531 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.531 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:49.531 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.112638+0000", 2024-04-19T02:16:49.531 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.187e-06 2024-04-19T02:16:49.531 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.531 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.531 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:49.531 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.113893+0000", 2024-04-19T02:16:49.531 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0012553390000000001 2024-04-19T02:16:49.531 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.531 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.531 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:49.531 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.114012+0000", 2024-04-19T02:16:49.532 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000118638 2024-04-19T02:16:49.532 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.532 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.532 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:49.532 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.114151+0000", 2024-04-19T02:16:49.532 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00013928700000000001 2024-04-19T02:16:49.532 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.532 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.532 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:49.532 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.120607+0000", 2024-04-19T02:16:49.532 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0064559179999999997 2024-04-19T02:16:49.532 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.532 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.532 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:49.533 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136026+0000", 2024-04-19T02:16:49.533 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015418762000000001 2024-04-19T02:16:49.533 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.533 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.533 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:49.533 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136084+0000", 2024-04-19T02:16:49.533 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.8245000000000002e-05 2024-04-19T02:16:49.533 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.533 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.533 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:49.533 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136117+0000", 2024-04-19T02:16:49.533 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.2616000000000001e-05 2024-04-19T02:16:49.533 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:49.533 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:49.533 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:49.534 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.534 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.534 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:94468 5.2 e34/16 5:4f406431:::benchmark_data_smithi121_44835_object94467:head v 34'5918, mlcod=34'5914)", 2024-04-19T02:16:49.534 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:35.113059+0000", 2024-04-19T02:16:49.534 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 14.216073975, 2024-04-19T02:16:49.534 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.022987177000000001, 2024-04-19T02:16:49.534 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:49.534 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:49.534 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:49.534 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.534 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:49.534 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.113059+0000", 2024-04-19T02:16:49.534 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:49.534 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.534 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.535 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:49.535 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.113059+0000", 2024-04-19T02:16:49.535 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:49.535 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.535 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.535 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:49.535 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.113058+0000", 2024-04-19T02:16:49.535 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:49.535 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.535 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.535 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:49.535 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.113103+0000", 2024-04-19T02:16:49.535 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.4159000000000002e-05 2024-04-19T02:16:49.535 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.535 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.536 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:49.536 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.113110+0000", 2024-04-19T02:16:49.536 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.1049999999999997e-06 2024-04-19T02:16:49.536 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.536 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.536 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:49.536 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.113115+0000", 2024-04-19T02:16:49.536 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.3229999999999997e-06 2024-04-19T02:16:49.536 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.536 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.536 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:49.536 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.114338+0000", 2024-04-19T02:16:49.536 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.001223179 2024-04-19T02:16:49.536 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.536 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.537 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:49.537 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.114355+0000", 2024-04-19T02:16:49.537 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.6963999999999999e-05 2024-04-19T02:16:49.537 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.537 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.537 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:49.537 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136011+0000", 2024-04-19T02:16:49.537 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.021656102999999999 2024-04-19T02:16:49.537 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.537 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.537 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:49.537 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136046+0000", 2024-04-19T02:16:49.537 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.4802999999999999e-05 2024-04-19T02:16:49.537 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:49.537 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:49.538 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:49.538 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.538 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.538 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:94473 5.6 5:6db36ce7:::benchmark_data_smithi121_44835_object94472:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:49.538 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:35.116069+0000", 2024-04-19T02:16:49.538 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 14.213063878, 2024-04-19T02:16:49.538 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020111038000000001, 2024-04-19T02:16:49.538 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:49.538 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:49.538 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:49.538 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:49.538 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:49.538 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 94473 2024-04-19T02:16:49.538 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.538 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:49.539 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.539 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:49.539 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116069+0000", 2024-04-19T02:16:49.539 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:49.539 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.539 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.539 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:49.539 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116069+0000", 2024-04-19T02:16:49.539 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:49.539 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.539 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.539 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:49.539 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116067+0000", 2024-04-19T02:16:49.539 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:49.539 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.540 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.540 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:49.540 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116096+0000", 2024-04-19T02:16:49.540 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.9034e-05 2024-04-19T02:16:49.540 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.540 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.540 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:49.540 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116107+0000", 2024-04-19T02:16:49.540 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0543000000000001e-05 2024-04-19T02:16:49.540 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.540 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.540 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:49.540 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116115+0000", 2024-04-19T02:16:49.540 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.8860000000000004e-06 2024-04-19T02:16:49.541 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.541 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.541 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:49.541 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116281+0000", 2024-04-19T02:16:49.541 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00016668100000000001 2024-04-19T02:16:49.541 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.541 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.541 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:49.541 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116394+0000", 2024-04-19T02:16:49.541 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000112138 2024-04-19T02:16:49.541 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.541 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.541 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:49.541 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116502+0000", 2024-04-19T02:16:49.541 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000108513 2024-04-19T02:16:49.542 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.542 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.542 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:49.542 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.120647+0000", 2024-04-19T02:16:49.542 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0041448459999999998 2024-04-19T02:16:49.542 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.542 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.542 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:49.542 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136124+0000", 2024-04-19T02:16:49.542 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015476678000000001 2024-04-19T02:16:49.542 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.542 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.542 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:49.542 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136149+0000", 2024-04-19T02:16:49.542 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.5412999999999999e-05 2024-04-19T02:16:49.543 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.543 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.543 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:49.543 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136180+0000", 2024-04-19T02:16:49.543 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.0970999999999999e-05 2024-04-19T02:16:49.543 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:49.543 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:49.543 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:49.543 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.543 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.543 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:94472 5.2 e35/16 5:45b7e9be:::benchmark_data_smithi121_44835_object94471:head v 35'5919, mlcod=34'5914)", 2024-04-19T02:16:49.543 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:35.116129+0000", 2024-04-19T02:16:49.543 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 14.213003544999999, 2024-04-19T02:16:49.543 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.019945311, 2024-04-19T02:16:49.543 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:49.544 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:49.544 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:49.544 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.544 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:49.544 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116129+0000", 2024-04-19T02:16:49.544 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:49.544 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.544 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.544 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:49.544 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116129+0000", 2024-04-19T02:16:49.544 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:49.544 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.544 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.544 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:49.544 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116129+0000", 2024-04-19T02:16:49.544 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:49.545 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.545 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.545 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:49.545 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116149+0000", 2024-04-19T02:16:49.545 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.9874999999999999e-05 2024-04-19T02:16:49.545 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.545 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.545 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:49.545 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116153+0000", 2024-04-19T02:16:49.545 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.7190000000000001e-06 2024-04-19T02:16:49.545 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.545 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.545 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:49.545 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116157+0000", 2024-04-19T02:16:49.546 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.3100000000000001e-06 2024-04-19T02:16:49.546 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.546 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.546 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:49.546 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116250+0000", 2024-04-19T02:16:49.546 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.3022999999999993e-05 2024-04-19T02:16:49.546 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.546 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.546 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:49.546 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116267+0000", 2024-04-19T02:16:49.546 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.685e-05 2024-04-19T02:16:49.546 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.546 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.546 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:49.547 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136051+0000", 2024-04-19T02:16:49.547 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.019784748000000001 2024-04-19T02:16:49.547 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.547 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.547 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:49.547 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136075+0000", 2024-04-19T02:16:49.547 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.3332e-05 2024-04-19T02:16:49.547 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:49.547 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:49.547 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:49.547 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.547 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.547 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:94581 5.b e35/16 5:dc86d6e9:::benchmark_data_smithi121_44835_object94580:head v 35'5875, mlcod=35'5872)", 2024-04-19T02:16:49.547 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:35.181295+0000", 2024-04-19T02:16:49.547 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 14.147837937, 2024-04-19T02:16:49.547 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.02078327, 2024-04-19T02:16:49.548 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:49.548 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:49.548 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:49.548 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.548 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:49.548 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.181295+0000", 2024-04-19T02:16:49.548 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:49.548 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.548 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.548 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:49.548 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.181295+0000", 2024-04-19T02:16:49.548 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:49.548 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.548 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.548 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:49.549 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.181294+0000", 2024-04-19T02:16:49.549 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:49.549 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.549 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.549 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:49.549 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.181321+0000", 2024-04-19T02:16:49.549 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.6588999999999999e-05 2024-04-19T02:16:49.549 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.549 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.549 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:49.549 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.181329+0000", 2024-04-19T02:16:49.549 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.9289999999999998e-06 2024-04-19T02:16:49.549 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.549 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.549 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:49.549 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.181334+0000", 2024-04-19T02:16:49.549 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.2789999999999998e-06 2024-04-19T02:16:49.550 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.550 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.550 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:49.550 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.186093+0000", 2024-04-19T02:16:49.550 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0047585509999999998 2024-04-19T02:16:49.550 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.550 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.550 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:49.550 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.186111+0000", 2024-04-19T02:16:49.550 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.7901e-05 2024-04-19T02:16:49.550 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.550 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.550 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:49.550 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.202037+0000", 2024-04-19T02:16:49.551 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015926020999999999 2024-04-19T02:16:49.551 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.551 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.551 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:49.551 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.202078+0000", 2024-04-19T02:16:49.551 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.1424999999999997e-05 2024-04-19T02:16:49.551 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:49.551 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:49.551 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:49.551 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.551 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.551 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "MOSDPGPushReply(5.1 35/29 [PushReplyOp(5:860e8104:::benchmark_data_smithi121_44835_object52857:head)])", 2024-04-19T02:16:49.551 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:35.719222+0000", 2024-04-19T02:16:49.551 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 13.609911201999999, 2024-04-19T02:16:49.551 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.022063027999999998, 2024-04-19T02:16:49.552 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:49.552 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "reached pg", 2024-04-19T02:16:49.552 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:49.552 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.552 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:49.552 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.719222+0000", 2024-04-19T02:16:49.552 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:49.552 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.552 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.552 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:49.552 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.719222+0000", 2024-04-19T02:16:49.552 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:49.552 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.552 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.552 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:49.553 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.719221+0000", 2024-04-19T02:16:49.553 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967296 2024-04-19T02:16:49.553 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.553 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.553 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:49.553 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.719225+0000", 2024-04-19T02:16:49.553 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.5779999999999999e-06 2024-04-19T02:16:49.553 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.553 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.553 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:49.553 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.719232+0000", 2024-04-19T02:16:49.553 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.1319999999999996e-06 2024-04-19T02:16:49.553 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.553 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.553 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:49.554 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.719239+0000", 2024-04-19T02:16:49.554 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.8120000000000002e-06 2024-04-19T02:16:49.554 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.554 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.554 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:49.554 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.741004+0000", 2024-04-19T02:16:49.554 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.021764614000000002 2024-04-19T02:16:49.554 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.554 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.554 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:49.554 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.741285+0000", 2024-04-19T02:16:49.554 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000281079 2024-04-19T02:16:49.554 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:49.554 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:49.554 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:49.555 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.555 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.555 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:96375 5.1 5:84bae481:::benchmark_data_smithi121_44835_object96374:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:49.555 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:36.105748+0000", 2024-04-19T02:16:49.555 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 13.223384812000001, 2024-04-19T02:16:49.555 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.021551219999999999, 2024-04-19T02:16:49.555 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:49.555 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:49.555 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:49.555 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:49.555 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:49.555 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 96375 2024-04-19T02:16:49.555 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.555 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:49.555 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.555 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:49.556 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.105748+0000", 2024-04-19T02:16:49.556 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:49.556 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.556 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.556 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:49.556 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.105748+0000", 2024-04-19T02:16:49.556 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:49.556 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.556 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.556 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:49.556 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.105747+0000", 2024-04-19T02:16:49.556 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:49.556 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.556 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.556 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:49.557 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.105869+0000", 2024-04-19T02:16:49.557 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000121965 2024-04-19T02:16:49.557 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.557 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.557 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:49.557 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.105879+0000", 2024-04-19T02:16:49.557 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0049e-05 2024-04-19T02:16:49.557 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.557 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.557 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:49.557 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.105886+0000", 2024-04-19T02:16:49.557 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.0879999999999997e-06 2024-04-19T02:16:49.557 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.557 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.557 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:49.557 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.107778+0000", 2024-04-19T02:16:49.558 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0018912670000000001 2024-04-19T02:16:49.558 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.558 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.558 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:49.558 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.107885+0000", 2024-04-19T02:16:49.558 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000106982 2024-04-19T02:16:49.558 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.558 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.558 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:49.558 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.108016+0000", 2024-04-19T02:16:49.558 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000131581 2024-04-19T02:16:49.558 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.558 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.559 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:49.559 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.110857+0000", 2024-04-19T02:16:49.559 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.002840604 2024-04-19T02:16:49.559 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.559 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.559 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:49.559 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.118745+0000", 2024-04-19T02:16:49.559 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0078886970000000001 2024-04-19T02:16:49.559 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.559 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.559 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:49.559 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.127135+0000", 2024-04-19T02:16:49.559 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0083899939999999996 2024-04-19T02:16:49.559 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.559 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.560 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:49.560 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.127191+0000", 2024-04-19T02:16:49.560 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.5294000000000003e-05 2024-04-19T02:16:49.560 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.560 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.560 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:49.560 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.127299+0000", 2024-04-19T02:16:49.560 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000108439 2024-04-19T02:16:49.560 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:49.560 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:49.560 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:49.560 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.560 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.560 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:104186 5.1 5:8759ec67:::benchmark_data_smithi121_44835_object104185:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T02:16:49.560 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:40.086927+0000", 2024-04-19T02:16:49.561 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 9.2422059710000006, 2024-04-19T02:16:49.561 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020306884000000001, 2024-04-19T02:16:49.561 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:49.561 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:49.561 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:49.561 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:49.561 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:49.561 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 104186 2024-04-19T02:16:49.561 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.561 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:49.561 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.561 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:49.561 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086927+0000", 2024-04-19T02:16:49.561 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:49.561 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.562 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.562 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:49.562 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086927+0000", 2024-04-19T02:16:49.562 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:49.562 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.562 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.562 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:49.562 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086926+0000", 2024-04-19T02:16:49.562 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:49.562 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.562 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.562 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:49.562 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086951+0000", 2024-04-19T02:16:49.562 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.5452e-05 2024-04-19T02:16:49.563 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.563 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.563 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:49.563 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086960+0000", 2024-04-19T02:16:49.563 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.1620000000000008e-06 2024-04-19T02:16:49.563 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.563 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.563 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:49.563 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086966+0000", 2024-04-19T02:16:49.563 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.0290000000000002e-06 2024-04-19T02:16:49.563 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.563 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.564 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:49.564 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.090593+0000", 2024-04-19T02:16:49.564 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0036272079999999998 2024-04-19T02:16:49.564 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.564 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.564 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:49.564 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.090699+0000", 2024-04-19T02:16:49.564 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000106001 2024-04-19T02:16:49.564 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.564 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.564 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:49.564 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.090842+0000", 2024-04-19T02:16:49.564 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00014270900000000001 2024-04-19T02:16:49.564 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.564 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.565 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:49.565 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.094673+0000", 2024-04-19T02:16:49.565 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0038316999999999999 2024-04-19T02:16:49.565 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.565 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.565 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:49.565 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.097494+0000", 2024-04-19T02:16:49.565 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0028205539999999999 2024-04-19T02:16:49.565 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.565 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.565 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:49.565 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.107075+0000", 2024-04-19T02:16:49.565 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0095813870000000002 2024-04-19T02:16:49.565 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.566 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.566 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:49.566 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.107127+0000", 2024-04-19T02:16:49.566 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.1498000000000001e-05 2024-04-19T02:16:49.566 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.566 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.566 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:49.566 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.107234+0000", 2024-04-19T02:16:49.566 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000107058 2024-04-19T02:16:49.566 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:49.566 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:49.566 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:49.566 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.566 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.566 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:104187 5.1 5:8636ab61:::benchmark_data_smithi121_44835_object104186:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T02:16:49.567 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:40.086972+0000", 2024-04-19T02:16:49.567 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 9.2421605769999999, 2024-04-19T02:16:49.567 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020992607999999999, 2024-04-19T02:16:49.567 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:49.567 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:49.567 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:49.567 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:49.567 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:49.567 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 104187 2024-04-19T02:16:49.567 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.567 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:49.567 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.567 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:49.567 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086972+0000", 2024-04-19T02:16:49.568 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:49.568 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.568 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.568 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:49.568 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086972+0000", 2024-04-19T02:16:49.568 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:49.568 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.568 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.568 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:49.568 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086972+0000", 2024-04-19T02:16:49.568 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:49.568 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.568 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.568 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:49.568 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.087000+0000", 2024-04-19T02:16:49.568 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.8569e-05 2024-04-19T02:16:49.569 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.569 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.569 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:49.569 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.087007+0000", 2024-04-19T02:16:49.569 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.4280000000000001e-06 2024-04-19T02:16:49.569 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.569 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.569 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:49.569 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.087013+0000", 2024-04-19T02:16:49.569 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.3929999999999996e-06 2024-04-19T02:16:49.569 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.569 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.569 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:49.569 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.092659+0000", 2024-04-19T02:16:49.569 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0056460850000000003 2024-04-19T02:16:49.569 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.570 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.570 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:49.570 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.092780+0000", 2024-04-19T02:16:49.570 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012113200000000001 2024-04-19T02:16:49.570 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.570 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.570 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:49.570 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.092894+0000", 2024-04-19T02:16:49.570 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000113057 2024-04-19T02:16:49.570 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.570 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.570 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:49.570 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.097526+0000", 2024-04-19T02:16:49.570 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0046325940000000003 2024-04-19T02:16:49.571 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.571 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.571 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:49.571 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.097536+0000", 2024-04-19T02:16:49.571 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.4110000000000002e-06 2024-04-19T02:16:49.571 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.571 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.571 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:49.571 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.107809+0000", 2024-04-19T02:16:49.571 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.010273882999999999 2024-04-19T02:16:49.571 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.571 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.571 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:49.571 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.107864+0000", 2024-04-19T02:16:49.571 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.4792e-05 2024-04-19T02:16:49.572 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.572 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.572 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:49.572 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.107965+0000", 2024-04-19T02:16:49.572 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000100641 2024-04-19T02:16:49.572 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:49.572 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:49.572 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:49.572 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.572 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.572 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:113448 5.1 5:816781af:::benchmark_data_smithi121_44835_object113447:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T02:16:49.572 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:44.698272+0000", 2024-04-19T02:16:49.572 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4.6308603689999996, 2024-04-19T02:16:49.572 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.023047332, 2024-04-19T02:16:49.572 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:49.573 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:49.573 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:49.573 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:49.573 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:49.573 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 113448 2024-04-19T02:16:49.573 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.573 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:49.573 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.573 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:49.573 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.698272+0000", 2024-04-19T02:16:49.573 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:49.573 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.573 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.573 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:49.573 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.698272+0000", 2024-04-19T02:16:49.573 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:49.574 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.574 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.574 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:49.574 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.698272+0000", 2024-04-19T02:16:49.574 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:49.574 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.574 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.574 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:49.574 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.698307+0000", 2024-04-19T02:16:49.574 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.4712999999999998e-05 2024-04-19T02:16:49.574 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.574 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.574 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:49.574 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.698322+0000", 2024-04-19T02:16:49.575 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.5427999999999999e-05 2024-04-19T02:16:49.575 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.575 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.575 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:49.575 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.698328+0000", 2024-04-19T02:16:49.575 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.139e-06 2024-04-19T02:16:49.575 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.575 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.575 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:49.575 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.700548+0000", 2024-04-19T02:16:49.575 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.002219951 2024-04-19T02:16:49.575 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.575 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.575 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:49.575 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.700699+0000", 2024-04-19T02:16:49.575 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000151185 2024-04-19T02:16:49.576 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.576 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.576 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:49.576 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.700844+0000", 2024-04-19T02:16:49.576 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00014434800000000001 2024-04-19T02:16:49.576 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.576 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.576 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:49.576 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.705655+0000", 2024-04-19T02:16:49.576 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.004811503 2024-04-19T02:16:49.576 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.576 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.576 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:49.576 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.705933+0000", 2024-04-19T02:16:49.576 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00027823300000000002 2024-04-19T02:16:49.576 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.577 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.577 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:49.577 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.721130+0000", 2024-04-19T02:16:49.577 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015196708 2024-04-19T02:16:49.577 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.577 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.577 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:49.577 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.721197+0000", 2024-04-19T02:16:49.577 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.6928999999999996e-05 2024-04-19T02:16:49.577 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.577 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.577 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:49.577 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.721320+0000", 2024-04-19T02:16:49.577 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012277499999999999 2024-04-19T02:16:49.577 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:49.578 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:49.578 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:49.578 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.578 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.578 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:113660 5.1 5:80c3f0b7:::benchmark_data_smithi121_44835_object113659:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T02:16:49.578 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:44.810899+0000", 2024-04-19T02:16:49.578 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4.5182337510000004, 2024-04-19T02:16:49.578 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.023870918000000001, 2024-04-19T02:16:49.578 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:49.578 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:49.578 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:49.578 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:49.578 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:49.578 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 113660 2024-04-19T02:16:49.579 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.579 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:49.579 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.579 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:49.579 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.810899+0000", 2024-04-19T02:16:49.579 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:49.579 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.579 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.579 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:49.579 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.810899+0000", 2024-04-19T02:16:49.579 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:49.579 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.579 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.579 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:49.579 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.810898+0000", 2024-04-19T02:16:49.580 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:49.580 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.580 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.580 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:49.580 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.810972+0000", 2024-04-19T02:16:49.580 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.3306000000000006e-05 2024-04-19T02:16:49.580 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.580 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.580 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:49.580 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.810978+0000", 2024-04-19T02:16:49.580 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.319e-06 2024-04-19T02:16:49.580 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.580 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.580 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:49.580 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.810984+0000", 2024-04-19T02:16:49.581 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.1650000000000003e-06 2024-04-19T02:16:49.581 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.581 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.581 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:49.581 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.820088+0000", 2024-04-19T02:16:49.581 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0091040310000000003 2024-04-19T02:16:49.581 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.581 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.581 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:49.581 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.820245+0000", 2024-04-19T02:16:49.581 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000157155 2024-04-19T02:16:49.581 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.581 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.581 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:49.581 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.820444+0000", 2024-04-19T02:16:49.581 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00019840299999999999 2024-04-19T02:16:49.582 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.582 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.582 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:49.582 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.824507+0000", 2024-04-19T02:16:49.582 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0040632999999999997 2024-04-19T02:16:49.582 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.582 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.582 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:49.582 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.827337+0000", 2024-04-19T02:16:49.582 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0028301429999999998 2024-04-19T02:16:49.582 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.582 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.582 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:49.582 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.834600+0000", 2024-04-19T02:16:49.583 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.007263294 2024-04-19T02:16:49.583 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.583 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.583 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:49.583 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.834654+0000", 2024-04-19T02:16:49.583 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.3508999999999999e-05 2024-04-19T02:16:49.583 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:49.583 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:49.583 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:49.583 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.834770+0000", 2024-04-19T02:16:49.583 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000116075 2024-04-19T02:16:49.583 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:49.583 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:49.583 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:49.583 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:49.583 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:49.584 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-04-19T02:16:49.584 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:16:49.585 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:49.505+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:49.606 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:49.606+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:49.706 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:49.707+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:49.752 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:16:49.753 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:16:49.753 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.753 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:123437 5.d 5:b892b68b:::benchmark_data_smithi121_44835_object123436:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T02:16:49.753 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:49.746263+0000", 2024-04-19T02:16:49.753 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00711132, 2024-04-19T02:16:49.753 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0071320849999999998, 2024-04-19T02:16:49.753 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:49.753 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:49.753 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:49.753 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:49.753 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:49.753 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 123437 2024-04-19T02:16:49.753 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.753 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:49.753 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.754 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:49.754 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.746263+0000", 2024-04-19T02:16:49.754 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:49.754 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.754 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.754 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:49.754 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.746263+0000", 2024-04-19T02:16:49.754 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:49.754 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.754 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.754 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:49.754 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.746262+0000", 2024-04-19T02:16:49.754 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:49.754 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.755 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:49.755 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.746346+0000", 2024-04-19T02:16:49.755 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3366000000000001e-05 2024-04-19T02:16:49.755 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.755 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:49.755 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.746356+0000", 2024-04-19T02:16:49.755 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0039e-05 2024-04-19T02:16:49.755 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.755 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:49.755 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.746363+0000", 2024-04-19T02:16:49.755 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5159999999999997e-06 2024-04-19T02:16:49.755 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.756 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.756 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:49.756 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.746402+0000", 2024-04-19T02:16:49.756 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8488999999999997e-05 2024-04-19T02:16:49.756 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.756 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.756 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:49.756 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.746499+0000", 2024-04-19T02:16:49.756 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7375999999999997e-05 2024-04-19T02:16:49.756 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.756 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.756 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:49.756 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.746628+0000", 2024-04-19T02:16:49.756 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012906300000000001 2024-04-19T02:16:49.756 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:49.756 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:49.756 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:49.757 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.757 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.757 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4549.0:123438 5.3 e41/16 5:cea83fc0:::benchmark_data_smithi121_44835_object123437:head v 41'7721, mlcod=41'7719)", 2024-04-19T02:16:49.757 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:49.746823+0000", 2024-04-19T02:16:49.757 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0065517910000000004, 2024-04-19T02:16:49.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0066294279999999997, 2024-04-19T02:16:49.757 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:49.757 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:16:49.757 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:49.757 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.757 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:49.757 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.746823+0000", 2024-04-19T02:16:49.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:49.757 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.757 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.757 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:49.758 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.746823+0000", 2024-04-19T02:16:49.758 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:49.758 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.758 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.758 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:49.758 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.746822+0000", 2024-04-19T02:16:49.758 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:49.758 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.758 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.758 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:49.758 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.746888+0000", 2024-04-19T02:16:49.758 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5736999999999998e-05 2024-04-19T02:16:49.758 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.758 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.759 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:49.759 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.746901+0000", 2024-04-19T02:16:49.759 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2714999999999999e-05 2024-04-19T02:16:49.759 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.759 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.759 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:49.759 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.746905+0000", 2024-04-19T02:16:49.759 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6240000000000001e-06 2024-04-19T02:16:49.759 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.759 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.759 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:49.759 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.746939+0000", 2024-04-19T02:16:49.759 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3872999999999999e-05 2024-04-19T02:16:49.759 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.759 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.759 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:49.760 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.746961+0000", 2024-04-19T02:16:49.760 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1568000000000001e-05 2024-04-19T02:16:49.760 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:49.760 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:49.760 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:49.760 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.760 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.760 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:123439 5.9 5:976a19ca:::benchmark_data_smithi121_44835_object123438:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T02:16:49.760 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:49.746922+0000", 2024-04-19T02:16:49.760 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0064525659999999999, 2024-04-19T02:16:49.760 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0065705609999999999, 2024-04-19T02:16:49.760 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:49.760 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:49.760 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:49.760 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:49.760 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:49.761 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 123439 2024-04-19T02:16:49.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.761 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:49.761 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.761 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:49.761 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.746922+0000", 2024-04-19T02:16:49.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:49.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.761 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.761 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:49.761 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.746922+0000", 2024-04-19T02:16:49.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:49.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.761 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.761 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:49.761 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.746921+0000", 2024-04-19T02:16:49.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:49.762 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.762 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:49.762 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.746993+0000", 2024-04-19T02:16:49.762 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1339000000000003e-05 2024-04-19T02:16:49.762 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.762 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:49.762 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.747003+0000", 2024-04-19T02:16:49.762 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0781999999999999e-05 2024-04-19T02:16:49.762 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.762 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:49.762 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.747012+0000", 2024-04-19T02:16:49.762 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1580000000000005e-06 2024-04-19T02:16:49.763 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.763 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.763 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:49.763 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.747051+0000", 2024-04-19T02:16:49.763 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9737999999999998e-05 2024-04-19T02:16:49.763 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.763 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.763 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:49.763 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.747152+0000", 2024-04-19T02:16:49.763 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010049 2024-04-19T02:16:49.763 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.763 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.763 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:49.763 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.747240+0000", 2024-04-19T02:16:49.763 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8206000000000002e-05 2024-04-19T02:16:49.763 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:49.764 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:49.764 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:49.764 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.764 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.764 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4549.0:123440 5.5 e41/16 5:a96c80c2:::benchmark_data_smithi121_44835_object123439:head v 41'7733, mlcod=41'7730)", 2024-04-19T02:16:49.764 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:49.747679+0000", 2024-04-19T02:16:49.764 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0056955030000000002, 2024-04-19T02:16:49.764 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0058566740000000001, 2024-04-19T02:16:49.764 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:49.764 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:16:49.764 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:49.764 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.764 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:49.764 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.747679+0000", 2024-04-19T02:16:49.764 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:49.765 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.765 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.765 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:49.765 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.747679+0000", 2024-04-19T02:16:49.765 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:49.765 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.765 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.765 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:49.765 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.747679+0000", 2024-04-19T02:16:49.765 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:49.765 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.765 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.765 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:49.765 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.747739+0000", 2024-04-19T02:16:49.766 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0590000000000001e-05 2024-04-19T02:16:49.766 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.766 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:49.766 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.747751+0000", 2024-04-19T02:16:49.766 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.203e-05 2024-04-19T02:16:49.766 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.766 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:49.766 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.747758+0000", 2024-04-19T02:16:49.766 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3589999999999996e-06 2024-04-19T02:16:49.766 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.766 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:49.766 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.748544+0000", 2024-04-19T02:16:49.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00078677499999999997 2024-04-19T02:16:49.767 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.767 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:49.767 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.748561+0000", 2024-04-19T02:16:49.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.66e-05 2024-04-19T02:16:49.767 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:49.767 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:49.767 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:49.767 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.767 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:123442 5.d 5:b72765e8:::benchmark_data_smithi121_44835_object123441:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T02:16:49.767 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:49.748914+0000", 2024-04-19T02:16:49.767 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0044602899999999996, 2024-04-19T02:16:49.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0046590829999999996, 2024-04-19T02:16:49.768 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:49.768 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:49.768 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:49.768 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:49.768 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:49.768 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 123442 2024-04-19T02:16:49.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.768 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:49.768 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.768 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:49.768 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.748914+0000", 2024-04-19T02:16:49.768 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:49.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.768 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.768 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:49.768 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.748914+0000", 2024-04-19T02:16:49.768 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:49.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.769 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:49.769 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.748914+0000", 2024-04-19T02:16:49.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:49.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.769 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:49.769 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.748972+0000", 2024-04-19T02:16:49.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8767000000000002e-05 2024-04-19T02:16:49.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.769 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:49.769 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.748984+0000", 2024-04-19T02:16:49.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1781e-05 2024-04-19T02:16:49.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.770 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.770 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:49.770 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.748991+0000", 2024-04-19T02:16:49.770 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2590000000000003e-06 2024-04-19T02:16:49.770 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.770 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.770 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:49.770 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.751499+0000", 2024-04-19T02:16:49.770 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0025076909999999998 2024-04-19T02:16:49.770 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.770 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.770 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:49.770 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.751632+0000", 2024-04-19T02:16:49.770 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013335699999999999 2024-04-19T02:16:49.770 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.770 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.771 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:49.771 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.751719+0000", 2024-04-19T02:16:49.771 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6623000000000001e-05 2024-04-19T02:16:49.771 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:49.771 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:49.771 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:49.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.771 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.771 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:123443 5.f 5:faf80c99:::benchmark_data_smithi121_44835_object123442:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T02:16:49.771 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:49.748999+0000", 2024-04-19T02:16:49.771 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0043762159999999996, 2024-04-19T02:16:49.771 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0046254199999999999, 2024-04-19T02:16:49.771 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:49.771 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:49.771 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:49.771 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:49.772 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:49.772 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 123443 2024-04-19T02:16:49.772 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.772 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:49.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.772 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:49.772 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.748999+0000", 2024-04-19T02:16:49.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:49.772 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.772 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:49.772 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.748999+0000", 2024-04-19T02:16:49.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:49.772 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.772 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:49.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.748998+0000", 2024-04-19T02:16:49.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:49.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:49.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.749081+0000", 2024-04-19T02:16:49.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3282000000000007e-05 2024-04-19T02:16:49.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:49.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.749090+0000", 2024-04-19T02:16:49.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9959999999999999e-06 2024-04-19T02:16:49.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:49.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.749096+0000", 2024-04-19T02:16:49.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.755e-06 2024-04-19T02:16:49.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:49.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.749121+0000", 2024-04-19T02:16:49.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4941000000000001e-05 2024-04-19T02:16:49.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:49.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.749204+0000", 2024-04-19T02:16:49.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3330000000000003e-05 2024-04-19T02:16:49.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:49.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.749289+0000", 2024-04-19T02:16:49.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4858000000000006e-05 2024-04-19T02:16:49.775 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:49.775 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:49.775 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:49.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.775 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:123447 5.9 5:97fb9ed8:::benchmark_data_smithi121_44835_object123446:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T02:16:49.775 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:49.749199+0000", 2024-04-19T02:16:49.775 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0041753470000000003, 2024-04-19T02:16:49.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0044679280000000004, 2024-04-19T02:16:49.775 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:49.775 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:49.775 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:49.775 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:49.776 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:49.776 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 123447 2024-04-19T02:16:49.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.776 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:49.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.776 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:49.776 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.749199+0000", 2024-04-19T02:16:49.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:49.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.776 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:49.776 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.749199+0000", 2024-04-19T02:16:49.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:49.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.776 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:49.776 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.749199+0000", 2024-04-19T02:16:49.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:49.777 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.777 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.777 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:49.777 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.749263+0000", 2024-04-19T02:16:49.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4712e-05 2024-04-19T02:16:49.777 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.777 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.777 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:49.777 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.749271+0000", 2024-04-19T02:16:49.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5100000000000001e-06 2024-04-19T02:16:49.777 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.777 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.777 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:49.777 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.749277+0000", 2024-04-19T02:16:49.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6869999999999999e-06 2024-04-19T02:16:49.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:49.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.749307+0000", 2024-04-19T02:16:49.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0583000000000002e-05 2024-04-19T02:16:49.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:49.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.749383+0000", 2024-04-19T02:16:49.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5400000000000003e-05 2024-04-19T02:16:49.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:49.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.749469+0000", 2024-04-19T02:16:49.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6394e-05 2024-04-19T02:16:49.779 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:49.779 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:49.779 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:49.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.779 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4549.0:123444 5.3 e41/16 5:ce8085a7:::benchmark_data_smithi121_44835_object123443:head v 41'7722, mlcod=41'7719)", 2024-04-19T02:16:49.779 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:49.749533+0000", 2024-04-19T02:16:49.779 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.003841981, 2024-04-19T02:16:49.779 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041775919999999999, 2024-04-19T02:16:49.779 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:49.779 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:16:49.779 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:49.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:49.779 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.749533+0000", 2024-04-19T02:16:49.779 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:49.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.780 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:49.780 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.749533+0000", 2024-04-19T02:16:49.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:49.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.780 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:49.780 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.749532+0000", 2024-04-19T02:16:49.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:49.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.780 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:49.780 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.749588+0000", 2024-04-19T02:16:49.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.596e-05 2024-04-19T02:16:49.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.781 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:49.781 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.749599+0000", 2024-04-19T02:16:49.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0696000000000001e-05 2024-04-19T02:16:49.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.781 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:49.781 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.749606+0000", 2024-04-19T02:16:49.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8650000000000003e-06 2024-04-19T02:16:49.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.781 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:49.781 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.749639+0000", 2024-04-19T02:16:49.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3209e-05 2024-04-19T02:16:49.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.781 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:49.782 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.749658+0000", 2024-04-19T02:16:49.782 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9429999999999999e-05 2024-04-19T02:16:49.782 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:49.782 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:49.782 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:49.782 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.782 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.782 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:123451 5.d 5.14eea5dd (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T02:16:49.782 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:49.751945+0000", 2024-04-19T02:16:49.782 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0014295480000000001, 2024-04-19T02:16:49.782 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017981519999999999, 2024-04-19T02:16:49.782 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:49.782 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-04-19T02:16:49.782 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:49.783 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:49.783 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:49.783 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 123451 2024-04-19T02:16:49.783 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.783 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:49.783 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.783 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:49.783 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.751945+0000", 2024-04-19T02:16:49.783 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:49.783 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.783 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.783 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:49.783 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.751945+0000", 2024-04-19T02:16:49.783 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:49.783 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.783 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.784 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:49.784 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.751944+0000", 2024-04-19T02:16:49.784 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:49.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.784 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:49.784 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.752073+0000", 2024-04-19T02:16:49.784 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012916699999999999 2024-04-19T02:16:49.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.784 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:49.784 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.752085+0000", 2024-04-19T02:16:49.784 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1735e-05 2024-04-19T02:16:49.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.784 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:49.785 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.752092+0000", 2024-04-19T02:16:49.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3690000000000001e-06 2024-04-19T02:16:49.785 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:49.785 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:49.785 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:49.785 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.785 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.785 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4549.0:123449 5.6 e41/16 5:60d2ee40:::benchmark_data_smithi121_44835_object123448:head v 41'7809, mlcod=41'7807)", 2024-04-19T02:16:49.785 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:49.752277+0000", 2024-04-19T02:16:49.785 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0010979449999999999, 2024-04-19T02:16:49.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001497312, 2024-04-19T02:16:49.785 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:49.785 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:16:49.785 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:49.785 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.785 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:49.786 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.752277+0000", 2024-04-19T02:16:49.786 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:49.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.786 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:49.786 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.752277+0000", 2024-04-19T02:16:49.786 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:49.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.786 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:49.786 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.752276+0000", 2024-04-19T02:16:49.786 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:49.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.786 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:49.786 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.752344+0000", 2024-04-19T02:16:49.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7514000000000004e-05 2024-04-19T02:16:49.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:49.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.752352+0000", 2024-04-19T02:16:49.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3899999999999993e-06 2024-04-19T02:16:49.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:49.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.752356+0000", 2024-04-19T02:16:49.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.34e-06 2024-04-19T02:16:49.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:49.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.752398+0000", 2024-04-19T02:16:49.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1634000000000002e-05 2024-04-19T02:16:49.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.788 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:49.788 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.752412+0000", 2024-04-19T02:16:49.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3740999999999999e-05 2024-04-19T02:16:49.788 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:49.788 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:49.788 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:49.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.788 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4549.0:123450 5.1 e41/29 5:8a406e8b:::benchmark_data_smithi121_44835_object123449:head v 41'7545, mlcod=41'7543)", 2024-04-19T02:16:49.788 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:49.752447+0000", 2024-04-19T02:16:49.788 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00092757500000000004, 2024-04-19T02:16:49.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013600050000000001, 2024-04-19T02:16:49.789 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:49.789 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:16:49.789 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:49.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:49.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.752447+0000", 2024-04-19T02:16:49.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:49.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:49.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.752447+0000", 2024-04-19T02:16:49.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:49.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:49.790 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.752447+0000", 2024-04-19T02:16:49.790 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:49.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.790 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:49.790 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.752535+0000", 2024-04-19T02:16:49.790 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7886000000000005e-05 2024-04-19T02:16:49.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.790 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:49.790 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.752540+0000", 2024-04-19T02:16:49.793 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.57e-06 2024-04-19T02:16:49.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.793 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.793 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:49.793 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.752544+0000", 2024-04-19T02:16:49.794 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.225e-06 2024-04-19T02:16:49.794 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.794 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.794 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:49.794 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.752578+0000", 2024-04-19T02:16:49.794 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4150999999999999e-05 2024-04-19T02:16:49.794 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:49.794 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:49.794 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:49.794 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:49.752604+0000", 2024-04-19T02:16:49.794 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6060000000000001e-05 2024-04-19T02:16:49.794 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:49.794 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:49.794 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:49.795 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:49.795 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-04-19T02:16:49.795 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 11 2024-04-19T02:16:49.795 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:16:49.796 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:16:49.807 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:49.808+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:49.907 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:49.908+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:49.968 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:16:49.968 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-04-19T02:16:49.968 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-04-19T02:16:49.968 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-04-19T02:16:49.968 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:16:49.979 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:16:50.008 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:50.009+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:50.029 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 55 16 124029 124013 140.912 126.688 0.00707739 0.00709373 2024-04-19T02:16:50.109 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:50.109+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:50.125 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:16:50.149 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:16:50.149 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-04-19T02:16:50.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-04-19T02:16:50.149 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:16:50.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.149 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:50.149 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:16:50.149 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 80.877643782000007, 2024-04-19T02:16:50.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020307345000000001, 2024-04-19T02:16:50.149 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:50.149 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:50.150 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:50.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:50.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:16:50.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:50.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:50.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:16:50.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:50.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:50.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269791+0000", 2024-04-19T02:16:50.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:50.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:50.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269795+0000", 2024-04-19T02:16:50.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5619999999999999e-06 2024-04-19T02:16:50.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:50.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269802+0000", 2024-04-19T02:16:50.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8469999999999998e-06 2024-04-19T02:16:50.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:50.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269807+0000", 2024-04-19T02:16:50.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.707e-06 2024-04-19T02:16:50.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:50.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269950+0000", 2024-04-19T02:16:50.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000143313 2024-04-19T02:16:50.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:50.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269955+0000", 2024-04-19T02:16:50.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4029999999999998e-06 2024-04-19T02:16:50.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:50.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.283806+0000", 2024-04-19T02:16:50.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013850220999999999 2024-04-19T02:16:50.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:50.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.283896+0000", 2024-04-19T02:16:50.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0261999999999997e-05 2024-04-19T02:16:50.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:50.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284022+0000", 2024-04-19T02:16:50.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012641200000000001 2024-04-19T02:16:50.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:50.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289066+0000", 2024-04-19T02:16:50.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050438490000000004 2024-04-19T02:16:50.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:50.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290011+0000", 2024-04-19T02:16:50.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00094490700000000004 2024-04-19T02:16:50.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:50.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290054+0000", 2024-04-19T02:16:50.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.337e-05 2024-04-19T02:16:50.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:50.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290099+0000", 2024-04-19T02:16:50.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4987999999999997e-05 2024-04-19T02:16:50.155 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:50.155 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:50.155 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:50.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.155 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:50.155 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:16:50.155 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 80.877565852000004, 2024-04-19T02:16:50.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020331023, 2024-04-19T02:16:50.155 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:50.155 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:50.155 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:50.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:50.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:16:50.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:50.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:50.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:16:50.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:50.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:50.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269869+0000", 2024-04-19T02:16:50.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:50.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:50.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269873+0000", 2024-04-19T02:16:50.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0219999999999998e-06 2024-04-19T02:16:50.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:50.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269881+0000", 2024-04-19T02:16:50.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.79e-06 2024-04-19T02:16:50.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:50.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269887+0000", 2024-04-19T02:16:50.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7899999999999996e-06 2024-04-19T02:16:50.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:50.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269983+0000", 2024-04-19T02:16:50.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6057000000000005e-05 2024-04-19T02:16:50.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:50.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269986+0000", 2024-04-19T02:16:50.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9220000000000001e-06 2024-04-19T02:16:50.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:50.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284350+0000", 2024-04-19T02:16:50.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014364335000000001 2024-04-19T02:16:50.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:50.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284664+0000", 2024-04-19T02:16:50.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000313646 2024-04-19T02:16:50.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:50.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284794+0000", 2024-04-19T02:16:50.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129839 2024-04-19T02:16:50.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:50.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289107+0000", 2024-04-19T02:16:50.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0043127060000000004 2024-04-19T02:16:50.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:50.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290108+0000", 2024-04-19T02:16:50.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0010010590000000001 2024-04-19T02:16:50.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:50.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290144+0000", 2024-04-19T02:16:50.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6709999999999999e-05 2024-04-19T02:16:50.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:50.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290201+0000", 2024-04-19T02:16:50.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6654999999999999e-05 2024-04-19T02:16:50.161 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:50.161 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:50.161 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:50.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.161 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:50.161 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:16:50.161 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 80.877523511000007, 2024-04-19T02:16:50.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020507241999999998, 2024-04-19T02:16:50.161 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:50.161 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:50.161 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:50.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:50.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:16:50.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:50.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:50.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:16:50.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:50.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:50.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:16:50.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:50.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:50.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269915+0000", 2024-04-19T02:16:50.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.472e-06 2024-04-19T02:16:50.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:50.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269928+0000", 2024-04-19T02:16:50.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2979000000000001e-05 2024-04-19T02:16:50.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:50.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269935+0000", 2024-04-19T02:16:50.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8859999999999998e-06 2024-04-19T02:16:50.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:50.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270009+0000", 2024-04-19T02:16:50.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3429000000000005e-05 2024-04-19T02:16:50.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.164 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:50.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270013+0000", 2024-04-19T02:16:50.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2590000000000002e-06 2024-04-19T02:16:50.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.164 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:50.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285375+0000", 2024-04-19T02:16:50.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015362275999999999 2024-04-19T02:16:50.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.164 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:50.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285451+0000", 2024-04-19T02:16:50.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5338000000000003e-05 2024-04-19T02:16:50.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:50.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285562+0000", 2024-04-19T02:16:50.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000111285 2024-04-19T02:16:50.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:50.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289134+0000", 2024-04-19T02:16:50.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035719670000000001 2024-04-19T02:16:50.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:50.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290341+0000", 2024-04-19T02:16:50.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012074500000000001 2024-04-19T02:16:50.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:50.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290383+0000", 2024-04-19T02:16:50.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1386e-05 2024-04-19T02:16:50.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:50.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290419+0000", 2024-04-19T02:16:50.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6884000000000001e-05 2024-04-19T02:16:50.166 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:50.166 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:50.166 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:50.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.167 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:50.167 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269945+0000", 2024-04-19T02:16:50.167 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 80.877490929000004, 2024-04-19T02:16:50.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019709098000000001, 2024-04-19T02:16:50.167 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:50.167 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:50.167 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:50.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:50.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269945+0000", 2024-04-19T02:16:50.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:50.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:50.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269945+0000", 2024-04-19T02:16:50.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:50.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:50.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269944+0000", 2024-04-19T02:16:50.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:50.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:50.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269965+0000", 2024-04-19T02:16:50.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0803999999999999e-05 2024-04-19T02:16:50.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:50.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269973+0000", 2024-04-19T02:16:50.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3560000000000004e-06 2024-04-19T02:16:50.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:50.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269982+0000", 2024-04-19T02:16:50.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9600000000000006e-06 2024-04-19T02:16:50.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:50.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270014+0000", 2024-04-19T02:16:50.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2913000000000001e-05 2024-04-19T02:16:50.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:50.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270018+0000", 2024-04-19T02:16:50.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2200000000000001e-06 2024-04-19T02:16:50.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:50.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278999+0000", 2024-04-19T02:16:50.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0089818009999999993 2024-04-19T02:16:50.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:50.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.279088+0000", 2024-04-19T02:16:50.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8988999999999998e-05 2024-04-19T02:16:50.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:50.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.280160+0000", 2024-04-19T02:16:50.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001071572 2024-04-19T02:16:50.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:50.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288342+0000", 2024-04-19T02:16:50.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.008182468 2024-04-19T02:16:50.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:50.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289545+0000", 2024-04-19T02:16:50.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012026739999999999 2024-04-19T02:16:50.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:50.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289608+0000", 2024-04-19T02:16:50.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2904999999999995e-05 2024-04-19T02:16:50.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:50.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289654+0000", 2024-04-19T02:16:50.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5850000000000003e-05 2024-04-19T02:16:50.172 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:50.172 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:50.172 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:50.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.172 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:50.172 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:16:50.173 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 80.877445250999997, 2024-04-19T02:16:50.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022007204999999998, 2024-04-19T02:16:50.173 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:50.173 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:50.173 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:50.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:50.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:16:50.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:50.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:50.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:16:50.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:50.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.174 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:50.174 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269990+0000", 2024-04-19T02:16:50.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:50.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.174 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:50.174 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269999+0000", 2024-04-19T02:16:50.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9539999999999993e-06 2024-04-19T02:16:50.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.174 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:50.174 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270006+0000", 2024-04-19T02:16:50.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.216e-06 2024-04-19T02:16:50.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:50.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270012+0000", 2024-04-19T02:16:50.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5049999999999998e-06 2024-04-19T02:16:50.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:50.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270058+0000", 2024-04-19T02:16:50.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.634e-05 2024-04-19T02:16:50.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:50.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270064+0000", 2024-04-19T02:16:50.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0669999999999997e-06 2024-04-19T02:16:50.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:50.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287159+0000", 2024-04-19T02:16:50.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017095086999999998 2024-04-19T02:16:50.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:50.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287254+0000", 2024-04-19T02:16:50.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4716000000000006e-05 2024-04-19T02:16:50.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:50.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287389+0000", 2024-04-19T02:16:50.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013511900000000001 2024-04-19T02:16:50.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:50.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290481+0000", 2024-04-19T02:16:50.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030920169999999999 2024-04-19T02:16:50.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:50.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291931+0000", 2024-04-19T02:16:50.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001450118 2024-04-19T02:16:50.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:50.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291960+0000", 2024-04-19T02:16:50.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9096000000000001e-05 2024-04-19T02:16:50.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:50.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291998+0000", 2024-04-19T02:16:50.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7514e-05 2024-04-19T02:16:50.178 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:50.178 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:50.178 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:50.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.178 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:50.178 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:50.178 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 80.877384680000006, 2024-04-19T02:16:50.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020759494999999999, 2024-04-19T02:16:50.179 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:50.179 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:50.179 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:50.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:50.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:50.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:50.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:50.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:50.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:50.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:50.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:50.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:50.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:50.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270054+0000", 2024-04-19T02:16:50.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.27e-06 2024-04-19T02:16:50.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:50.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270061+0000", 2024-04-19T02:16:50.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1289999999999998e-06 2024-04-19T02:16:50.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:50.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270067+0000", 2024-04-19T02:16:50.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.207e-06 2024-04-19T02:16:50.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:50.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270105+0000", 2024-04-19T02:16:50.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7549999999999998e-05 2024-04-19T02:16:50.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:50.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270112+0000", 2024-04-19T02:16:50.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3200000000000002e-06 2024-04-19T02:16:50.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:50.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282454+0000", 2024-04-19T02:16:50.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012341569 2024-04-19T02:16:50.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:50.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282740+0000", 2024-04-19T02:16:50.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000286481 2024-04-19T02:16:50.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:50.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282879+0000", 2024-04-19T02:16:50.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013887799999999999 2024-04-19T02:16:50.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:50.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290325+0000", 2024-04-19T02:16:50.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074459779999999998 2024-04-19T02:16:50.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:50.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290759+0000", 2024-04-19T02:16:50.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000433688 2024-04-19T02:16:50.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:50.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290789+0000", 2024-04-19T02:16:50.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9960000000000001e-05 2024-04-19T02:16:50.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:50.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290811+0000", 2024-04-19T02:16:50.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1965999999999999e-05 2024-04-19T02:16:50.184 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:50.184 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:50.184 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:50.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.184 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:50.184 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:16:50.184 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 80.877334474999998, 2024-04-19T02:16:50.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020837887999999999, 2024-04-19T02:16:50.184 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:50.184 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:50.184 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:50.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:50.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:16:50.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:50.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:50.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:16:50.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:50.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:50.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:16:50.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:50.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:50.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270109+0000", 2024-04-19T02:16:50.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3110000000000006e-06 2024-04-19T02:16:50.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:50.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270117+0000", 2024-04-19T02:16:50.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0479999999999999e-06 2024-04-19T02:16:50.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:50.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270123+0000", 2024-04-19T02:16:50.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5500000000000002e-06 2024-04-19T02:16:50.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:50.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270150+0000", 2024-04-19T02:16:50.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7712000000000002e-05 2024-04-19T02:16:50.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:50.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270153+0000", 2024-04-19T02:16:50.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6089999999999999e-06 2024-04-19T02:16:50.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:50.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285958+0000", 2024-04-19T02:16:50.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015805274000000001 2024-04-19T02:16:50.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:50.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286126+0000", 2024-04-19T02:16:50.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016765700000000001 2024-04-19T02:16:50.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:50.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286296+0000", 2024-04-19T02:16:50.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017007 2024-04-19T02:16:50.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:50.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290426+0000", 2024-04-19T02:16:50.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041299839999999997 2024-04-19T02:16:50.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:50.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290867+0000", 2024-04-19T02:16:50.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00044083300000000001 2024-04-19T02:16:50.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:50.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290900+0000", 2024-04-19T02:16:50.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3380000000000002e-05 2024-04-19T02:16:50.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:50.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290939+0000", 2024-04-19T02:16:50.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8970000000000001e-05 2024-04-19T02:16:50.190 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:50.190 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:50.190 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:50.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.190 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:21 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:50.190 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:16:50.190 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 80.877245802999994, 2024-04-19T02:16:50.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020833187999999999, 2024-04-19T02:16:50.190 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:50.190 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:16:50.190 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:50.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:50.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:16:50.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:50.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:50.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:16:50.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:50.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:50.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270189+0000", 2024-04-19T02:16:50.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:50.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:50.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270192+0000", 2024-04-19T02:16:50.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7549999999999999e-06 2024-04-19T02:16:50.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:50.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270198+0000", 2024-04-19T02:16:50.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0859999999999998e-06 2024-04-19T02:16:50.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:50.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270204+0000", 2024-04-19T02:16:50.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1970000000000004e-06 2024-04-19T02:16:50.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:50.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270238+0000", 2024-04-19T02:16:50.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4282000000000001e-05 2024-04-19T02:16:50.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:50.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270240+0000", 2024-04-19T02:16:50.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3099999999999999e-06 2024-04-19T02:16:50.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:50.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287131+0000", 2024-04-19T02:16:50.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01689104 2024-04-19T02:16:50.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:50.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287262+0000", 2024-04-19T02:16:50.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130347 2024-04-19T02:16:50.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:50.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291023+0000", 2024-04-19T02:16:50.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037616350000000002 2024-04-19T02:16:50.194 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:50.194 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:50.195 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:50.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.195 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:16494 5.7 5:e2c19dca:::benchmark_data_smithi121_44835_object16493:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:50.195 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.871684+0000", 2024-04-19T02:16:50.195 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.275752148000002, 2024-04-19T02:16:50.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019343257999999999, 2024-04-19T02:16:50.195 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:50.195 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:50.195 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:50.195 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:50.195 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:50.195 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16494 2024-04-19T02:16:50.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.195 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:50.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:50.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871684+0000", 2024-04-19T02:16:50.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:50.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:50.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871684+0000", 2024-04-19T02:16:50.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:50.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:50.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871683+0000", 2024-04-19T02:16:50.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:50.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:50.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871762+0000", 2024-04-19T02:16:50.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8981999999999997e-05 2024-04-19T02:16:50.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:50.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871770+0000", 2024-04-19T02:16:50.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7060000000000004e-06 2024-04-19T02:16:50.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:50.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.871776+0000", 2024-04-19T02:16:50.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4880000000000004e-06 2024-04-19T02:16:50.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:50.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.874098+0000", 2024-04-19T02:16:50.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0023215309999999999 2024-04-19T02:16:50.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:50.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.874245+0000", 2024-04-19T02:16:50.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014735599999999999 2024-04-19T02:16:50.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:50.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.874394+0000", 2024-04-19T02:16:50.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014848300000000001 2024-04-19T02:16:50.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:50.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.876474+0000", 2024-04-19T02:16:50.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020803060000000001 2024-04-19T02:16:50.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:50.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.890939+0000", 2024-04-19T02:16:50.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014464985 2024-04-19T02:16:50.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:50.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.890986+0000", 2024-04-19T02:16:50.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7321000000000003e-05 2024-04-19T02:16:50.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:50.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891027+0000", 2024-04-19T02:16:50.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0689999999999998e-05 2024-04-19T02:16:50.200 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:50.200 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:50.200 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:50.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.200 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:16519 5.f 5:fc30d3a1:::benchmark_data_smithi121_44835_object16518:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:50.202 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.880723+0000", 2024-04-19T02:16:50.203 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.266713025000001, 2024-04-19T02:16:50.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020492519000000001, 2024-04-19T02:16:50.203 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:50.203 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:50.203 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:50.203 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:50.203 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:50.203 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16519 2024-04-19T02:16:50.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.203 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:50.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:50.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880723+0000", 2024-04-19T02:16:50.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:50.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:50.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880723+0000", 2024-04-19T02:16:50.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:50.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:50.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880722+0000", 2024-04-19T02:16:50.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:50.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:50.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880794+0000", 2024-04-19T02:16:50.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1515999999999998e-05 2024-04-19T02:16:50.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:50.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880805+0000", 2024-04-19T02:16:50.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1353e-05 2024-04-19T02:16:50.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:50.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880812+0000", 2024-04-19T02:16:50.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1230000000000002e-06 2024-04-19T02:16:50.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:50.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.890954+0000", 2024-04-19T02:16:50.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010142253 2024-04-19T02:16:50.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:50.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891079+0000", 2024-04-19T02:16:50.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000124917 2024-04-19T02:16:50.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:50.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891218+0000", 2024-04-19T02:16:50.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000138715 2024-04-19T02:16:50.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:50.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.897321+0000", 2024-04-19T02:16:50.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0061026830000000002 2024-04-19T02:16:50.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:50.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901137+0000", 2024-04-19T02:16:50.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038161699999999998 2024-04-19T02:16:50.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:50.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901181+0000", 2024-04-19T02:16:50.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4362e-05 2024-04-19T02:16:50.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:50.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901215+0000", 2024-04-19T02:16:50.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3929e-05 2024-04-19T02:16:50.208 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:50.208 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:50.208 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:50.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.208 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:16520 5.f 5:f0474691:::benchmark_data_smithi121_44835_object16519:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:50.208 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.880833+0000", 2024-04-19T02:16:50.208 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.266603009999997, 2024-04-19T02:16:50.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020460160000000002, 2024-04-19T02:16:50.208 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:50.208 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:50.208 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:50.208 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:50.208 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:50.209 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16520 2024-04-19T02:16:50.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.209 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:50.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:50.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880833+0000", 2024-04-19T02:16:50.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:50.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:50.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880833+0000", 2024-04-19T02:16:50.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:50.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:50.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880832+0000", 2024-04-19T02:16:50.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:50.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:50.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880909+0000", 2024-04-19T02:16:50.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7095000000000006e-05 2024-04-19T02:16:50.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:50.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880919+0000", 2024-04-19T02:16:50.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8919999999999995e-06 2024-04-19T02:16:50.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:50.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880927+0000", 2024-04-19T02:16:50.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8809999999999996e-06 2024-04-19T02:16:50.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:50.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891901+0000", 2024-04-19T02:16:50.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010974263999999999 2024-04-19T02:16:50.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:50.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.892021+0000", 2024-04-19T02:16:50.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120074 2024-04-19T02:16:50.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:50.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.892165+0000", 2024-04-19T02:16:50.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014328600000000001 2024-04-19T02:16:50.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:50.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.897347+0000", 2024-04-19T02:16:50.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.005182603 2024-04-19T02:16:50.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:50.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901224+0000", 2024-04-19T02:16:50.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038767620000000002 2024-04-19T02:16:50.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:50.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901264+0000", 2024-04-19T02:16:50.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9579000000000002e-05 2024-04-19T02:16:50.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:50.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901293+0000", 2024-04-19T02:16:50.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9300999999999999e-05 2024-04-19T02:16:50.213 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:50.213 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:50.213 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:50.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.213 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:44167 5.7 5:ef4300c4:::benchmark_data_smithi121_44835_object44166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:50.213 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:09.853830+0000", 2024-04-19T02:16:50.213 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.293605526, 2024-04-19T02:16:50.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020082104, 2024-04-19T02:16:50.213 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:50.214 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:50.214 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:50.214 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:50.214 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:50.214 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 44167 2024-04-19T02:16:50.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.214 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:50.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:50.214 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853830+0000", 2024-04-19T02:16:50.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:50.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:50.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853830+0000", 2024-04-19T02:16:50.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:50.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:50.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853829+0000", 2024-04-19T02:16:50.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:50.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:50.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853863+0000", 2024-04-19T02:16:50.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3151999999999997e-05 2024-04-19T02:16:50.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:50.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853873+0000", 2024-04-19T02:16:50.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0366e-05 2024-04-19T02:16:50.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:50.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853881+0000", 2024-04-19T02:16:50.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6539999999999999e-06 2024-04-19T02:16:50.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:50.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.859162+0000", 2024-04-19T02:16:50.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052810740000000002 2024-04-19T02:16:50.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:50.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.859303+0000", 2024-04-19T02:16:50.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000140975 2024-04-19T02:16:50.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:50.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.859460+0000", 2024-04-19T02:16:50.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015754199999999999 2024-04-19T02:16:50.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:50.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.865142+0000", 2024-04-19T02:16:50.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0056819130000000002 2024-04-19T02:16:50.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:50.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.873828+0000", 2024-04-19T02:16:50.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0086861799999999999 2024-04-19T02:16:50.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:50.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.873871+0000", 2024-04-19T02:16:50.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2624999999999999e-05 2024-04-19T02:16:50.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:50.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.873912+0000", 2024-04-19T02:16:50.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1486000000000002e-05 2024-04-19T02:16:50.218 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:50.218 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:50.219 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:50.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.219 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:53042 5.f 5:f744ac14:::benchmark_data_smithi121_44835_object53041:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T02:16:50.219 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:13.560196+0000", 2024-04-19T02:16:50.219 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 36.587239707000002, 2024-04-19T02:16:50.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020122021, 2024-04-19T02:16:50.219 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:50.219 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:50.219 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:50.219 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:50.219 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:50.219 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 53042 2024-04-19T02:16:50.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.219 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:50.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:50.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560196+0000", 2024-04-19T02:16:50.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:50.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:50.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560196+0000", 2024-04-19T02:16:50.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:50.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:50.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560195+0000", 2024-04-19T02:16:50.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:50.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:50.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560255+0000", 2024-04-19T02:16:50.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9441000000000002e-05 2024-04-19T02:16:50.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:50.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560264+0000", 2024-04-19T02:16:50.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1130000000000007e-06 2024-04-19T02:16:50.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:50.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560271+0000", 2024-04-19T02:16:50.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9800000000000001e-06 2024-04-19T02:16:50.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:50.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560312+0000", 2024-04-19T02:16:50.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0828999999999998e-05 2024-04-19T02:16:50.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:50.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560456+0000", 2024-04-19T02:16:50.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014474799999999999 2024-04-19T02:16:50.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:50.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560591+0000", 2024-04-19T02:16:50.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013482699999999999 2024-04-19T02:16:50.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:50.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.564799+0000", 2024-04-19T02:16:50.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042080080000000001 2024-04-19T02:16:50.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.223 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:50.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580233+0000", 2024-04-19T02:16:50.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015433715000000001 2024-04-19T02:16:50.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.223 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:50.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580280+0000", 2024-04-19T02:16:50.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6465000000000003e-05 2024-04-19T02:16:50.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.223 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:50.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580318+0000", 2024-04-19T02:16:50.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8557999999999999e-05 2024-04-19T02:16:50.224 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:50.224 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:50.224 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:50.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.224 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:85866 5.2 5:48b1d46d:::benchmark_data_smithi121_44835_object85865:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T02:16:50.224 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:30.771909+0000", 2024-04-19T02:16:50.224 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 19.375526435000001, 2024-04-19T02:16:50.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020516216, 2024-04-19T02:16:50.224 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:50.224 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:50.224 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:50.224 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:50.225 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:50.225 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 85866 2024-04-19T02:16:50.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.225 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:50.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:50.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771909+0000", 2024-04-19T02:16:50.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:50.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:50.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771909+0000", 2024-04-19T02:16:50.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:50.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:50.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771909+0000", 2024-04-19T02:16:50.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:50.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:50.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771952+0000", 2024-04-19T02:16:50.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2660000000000002e-05 2024-04-19T02:16:50.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:50.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771959+0000", 2024-04-19T02:16:50.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7670000000000003e-06 2024-04-19T02:16:50.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:50.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771966+0000", 2024-04-19T02:16:50.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.905e-06 2024-04-19T02:16:50.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:50.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771999+0000", 2024-04-19T02:16:50.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2360999999999997e-05 2024-04-19T02:16:50.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:50.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.772133+0000", 2024-04-19T02:16:50.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013398699999999999 2024-04-19T02:16:50.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:50.228 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.772280+0000", 2024-04-19T02:16:50.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000147198 2024-04-19T02:16:50.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.228 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:50.228 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.774312+0000", 2024-04-19T02:16:50.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020325339999999999 2024-04-19T02:16:50.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.228 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:50.228 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.792370+0000", 2024-04-19T02:16:50.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018057321000000001 2024-04-19T02:16:50.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:50.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.792403+0000", 2024-04-19T02:16:50.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3247000000000002e-05 2024-04-19T02:16:50.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:50.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.792426+0000", 2024-04-19T02:16:50.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2697999999999999e-05 2024-04-19T02:16:50.229 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:50.229 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:50.229 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:50.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.229 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:94438 5.7 5:eb242aac:::benchmark_data_smithi121_44835_object94437:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T02:16:50.229 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:35.095629+0000", 2024-04-19T02:16:50.229 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.051806411999999, 2024-04-19T02:16:50.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019240869000000001, 2024-04-19T02:16:50.230 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:50.230 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:50.230 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:50.230 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:50.230 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:50.230 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 94438 2024-04-19T02:16:50.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.230 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:50.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:50.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.095629+0000", 2024-04-19T02:16:50.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:50.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:50.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.095629+0000", 2024-04-19T02:16:50.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:50.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:50.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.095628+0000", 2024-04-19T02:16:50.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:50.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:50.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.095652+0000", 2024-04-19T02:16:50.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3819999999999999e-05 2024-04-19T02:16:50.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:50.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.095660+0000", 2024-04-19T02:16:50.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0919999999999998e-06 2024-04-19T02:16:50.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:50.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.095665+0000", 2024-04-19T02:16:50.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2950000000000004e-06 2024-04-19T02:16:50.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:50.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.095686+0000", 2024-04-19T02:16:50.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1392000000000001e-05 2024-04-19T02:16:50.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:50.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.095791+0000", 2024-04-19T02:16:50.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010500100000000001 2024-04-19T02:16:50.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:50.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.095878+0000", 2024-04-19T02:16:50.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6674000000000004e-05 2024-04-19T02:16:50.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:50.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.097633+0000", 2024-04-19T02:16:50.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017547369999999999 2024-04-19T02:16:50.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:50.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.114800+0000", 2024-04-19T02:16:50.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017167449000000001 2024-04-19T02:16:50.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:50.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.114848+0000", 2024-04-19T02:16:50.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8096999999999997e-05 2024-04-19T02:16:50.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:50.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.114870+0000", 2024-04-19T02:16:50.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2158999999999999e-05 2024-04-19T02:16:50.234 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:50.235 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:50.235 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:50.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.235 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:94468 5.2 5:4f406431:::benchmark_data_smithi121_44835_object94467:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T02:16:50.235 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:16:50.235 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.036006621, 2024-04-19T02:16:50.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024835144999999999, 2024-04-19T02:16:50.235 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:50.235 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:50.235 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:50.235 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:50.235 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:50.235 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 94468 2024-04-19T02:16:50.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.236 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:50.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:50.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:16:50.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:50.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:50.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:16:50.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:50.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:50.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:16:50.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:50.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:50.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111498+0000", 2024-04-19T02:16:50.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9529000000000005e-05 2024-04-19T02:16:50.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:50.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111506+0000", 2024-04-19T02:16:50.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9030000000000004e-06 2024-04-19T02:16:50.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:50.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111513+0000", 2024-04-19T02:16:50.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8759999999999999e-06 2024-04-19T02:16:50.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:50.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112466+0000", 2024-04-19T02:16:50.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00095318499999999995 2024-04-19T02:16:50.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:50.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112590+0000", 2024-04-19T02:16:50.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012380900000000001 2024-04-19T02:16:50.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:50.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112728+0000", 2024-04-19T02:16:50.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013753800000000001 2024-04-19T02:16:50.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:50.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115064+0000", 2024-04-19T02:16:50.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002336819 2024-04-19T02:16:50.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:50.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136207+0000", 2024-04-19T02:16:50.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021142942000000001 2024-04-19T02:16:50.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:50.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136241+0000", 2024-04-19T02:16:50.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3577000000000001e-05 2024-04-19T02:16:50.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:50.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136264+0000", 2024-04-19T02:16:50.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3421000000000002e-05 2024-04-19T02:16:50.240 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:50.240 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:50.240 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:50.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.240 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:94472 5.2 5:45b7e9be:::benchmark_data_smithi121_44835_object94471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:50.240 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:16:50.240 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.032360089999999, 2024-04-19T02:16:50.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021273843000000001, 2024-04-19T02:16:50.241 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:50.241 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:50.241 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:50.241 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:50.241 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:50.241 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 94472 2024-04-19T02:16:50.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.241 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:50.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:50.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:16:50.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:50.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:50.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:16:50.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:50.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:50.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115075+0000", 2024-04-19T02:16:50.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:50.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:50.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115161+0000", 2024-04-19T02:16:50.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6632000000000007e-05 2024-04-19T02:16:50.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:50.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115171+0000", 2024-04-19T02:16:50.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2969999999999992e-06 2024-04-19T02:16:50.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:50.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115178+0000", 2024-04-19T02:16:50.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7610000000000007e-06 2024-04-19T02:16:50.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:50.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115213+0000", 2024-04-19T02:16:50.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5000999999999999e-05 2024-04-19T02:16:50.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:50.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115303+0000", 2024-04-19T02:16:50.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9791999999999997e-05 2024-04-19T02:16:50.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:50.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115391+0000", 2024-04-19T02:16:50.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7559000000000007e-05 2024-04-19T02:16:50.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:50.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.117894+0000", 2024-04-19T02:16:50.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002503496 2024-04-19T02:16:50.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:50.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136297+0000", 2024-04-19T02:16:50.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018402335999999998 2024-04-19T02:16:50.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:50.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136327+0000", 2024-04-19T02:16:50.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0534999999999998e-05 2024-04-19T02:16:50.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:50.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136350+0000", 2024-04-19T02:16:50.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2427999999999999e-05 2024-04-19T02:16:50.245 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:50.245 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:50.246 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:50.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.246 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:96668 5.f 5:f48d3288:::benchmark_data_smithi121_44835_object96667:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-19T02:16:50.246 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:36.254669+0000", 2024-04-19T02:16:50.246 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.892766971, 2024-04-19T02:16:50.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019875075999999998, 2024-04-19T02:16:50.246 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:50.246 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:50.246 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:50.246 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:50.246 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:50.246 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 96668 2024-04-19T02:16:50.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.247 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:50.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:50.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254669+0000", 2024-04-19T02:16:50.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:50.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:50.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254669+0000", 2024-04-19T02:16:50.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:50.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:50.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254668+0000", 2024-04-19T02:16:50.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:50.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:50.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254738+0000", 2024-04-19T02:16:50.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9913000000000006e-05 2024-04-19T02:16:50.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:50.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254748+0000", 2024-04-19T02:16:50.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7429999999999997e-06 2024-04-19T02:16:50.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:50.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254754+0000", 2024-04-19T02:16:50.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3840000000000002e-06 2024-04-19T02:16:50.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:50.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.256882+0000", 2024-04-19T02:16:50.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021282950000000001 2024-04-19T02:16:50.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:50.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.257007+0000", 2024-04-19T02:16:50.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012430699999999999 2024-04-19T02:16:50.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:50.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.257150+0000", 2024-04-19T02:16:50.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014291999999999999 2024-04-19T02:16:50.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:50.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.261375+0000", 2024-04-19T02:16:50.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042252100000000001 2024-04-19T02:16:50.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:50.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.274489+0000", 2024-04-19T02:16:50.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013113915 2024-04-19T02:16:50.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:50.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.274521+0000", 2024-04-19T02:16:50.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2691999999999998e-05 2024-04-19T02:16:50.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:50.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.274544+0000", 2024-04-19T02:16:50.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2408999999999998e-05 2024-04-19T02:16:50.251 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:50.251 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:50.251 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:50.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.251 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:98093 5.f 5:fcbc05b3:::benchmark_data_smithi121_44835_object98092:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-19T02:16:50.251 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:36.938897+0000", 2024-04-19T02:16:50.251 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.208539124, 2024-04-19T02:16:50.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019526373, 2024-04-19T02:16:50.251 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:50.252 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:50.252 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:50.252 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:50.252 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:50.252 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 98093 2024-04-19T02:16:50.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.252 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:50.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:50.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.938897+0000", 2024-04-19T02:16:50.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:50.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:50.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.938897+0000", 2024-04-19T02:16:50.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:50.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:50.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.938896+0000", 2024-04-19T02:16:50.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:50.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:50.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.938920+0000", 2024-04-19T02:16:50.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3969e-05 2024-04-19T02:16:50.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:50.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.938927+0000", 2024-04-19T02:16:50.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4760000000000003e-06 2024-04-19T02:16:50.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:50.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.938930+0000", 2024-04-19T02:16:50.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7349999999999998e-06 2024-04-19T02:16:50.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:50.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.945557+0000", 2024-04-19T02:16:50.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0066265689999999997 2024-04-19T02:16:50.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:50.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.945653+0000", 2024-04-19T02:16:50.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5948999999999999e-05 2024-04-19T02:16:50.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.255 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:50.255 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.945739+0000", 2024-04-19T02:16:50.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6012000000000003e-05 2024-04-19T02:16:50.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.255 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:50.255 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.949258+0000", 2024-04-19T02:16:50.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035189140000000002 2024-04-19T02:16:50.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.255 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:50.255 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.958372+0000", 2024-04-19T02:16:50.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0091140430000000005 2024-04-19T02:16:50.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:50.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.958402+0000", 2024-04-19T02:16:50.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9879e-05 2024-04-19T02:16:50.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:50.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.958423+0000", 2024-04-19T02:16:50.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1206999999999999e-05 2024-04-19T02:16:50.256 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:50.256 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:50.256 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:50.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.257 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:115094 5.f 5:fa7be3c5:::benchmark_data_smithi121_44835_object115093:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T02:16:50.257 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:45.537388+0000", 2024-04-19T02:16:50.257 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.6100477179999997, 2024-04-19T02:16:50.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019162065999999998, 2024-04-19T02:16:50.257 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:50.257 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:50.257 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:50.257 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:50.257 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:50.257 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 115094 2024-04-19T02:16:50.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.257 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:50.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:50.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.537388+0000", 2024-04-19T02:16:50.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:50.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:50.258 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.537388+0000", 2024-04-19T02:16:50.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:50.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:50.258 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.537388+0000", 2024-04-19T02:16:50.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:50.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:50.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.537475+0000", 2024-04-19T02:16:50.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7621999999999996e-05 2024-04-19T02:16:50.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:50.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.537481+0000", 2024-04-19T02:16:50.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2259999999999996e-06 2024-04-19T02:16:50.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:50.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.537484+0000", 2024-04-19T02:16:50.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7050000000000001e-06 2024-04-19T02:16:50.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:50.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.542363+0000", 2024-04-19T02:16:50.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0048788950000000003 2024-04-19T02:16:50.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.260 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.260 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:50.260 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.542475+0000", 2024-04-19T02:16:50.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011184900000000001 2024-04-19T02:16:50.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.260 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.260 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:50.260 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.542617+0000", 2024-04-19T02:16:50.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014222900000000001 2024-04-19T02:16:50.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.260 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.260 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:50.260 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.551443+0000", 2024-04-19T02:16:50.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0088261950000000002 2024-04-19T02:16:50.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:50.261 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.556487+0000", 2024-04-19T02:16:50.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050436109999999999 2024-04-19T02:16:50.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:50.261 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.556519+0000", 2024-04-19T02:16:50.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2183e-05 2024-04-19T02:16:50.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:50.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:50.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:50.261 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:45.556550+0000", 2024-04-19T02:16:50.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0920000000000002e-05 2024-04-19T02:16:50.262 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:50.262 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:50.262 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:50.262 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:50.262 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:50.262 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:16:50.263 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:16:50.264 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:50.264+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:50.265 INFO:teuthology.orchestra.run.smithi121.stderr:nodeep-scrub is unset 2024-04-19T02:16:50.265 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:16:50.276 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:16:50.297 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:16:50.317 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2: {} 2024-04-19T02:16:50.319 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:16:50.319 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:16:50.319 INFO:teuthology.orchestra.run.smithi121.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:16:50.364 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:50.364+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:50.442 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:50.442 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:50.456 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:16:50.500 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:50.500+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:50.567 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:50.567+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:50.625 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:16:50.627 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-04-19T02:16:50.628 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:50.628 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:50.636 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2024-04-19T02:16:50.157708+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":7835355994,"num_objects":119573,"num_object_clones":0,"num_object_copies":239146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2459,"num_objects_unfound":0,"num_objects_dirty":119573,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":119797,"num_write_kb":7654610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3773,"num_bytes_recovered":247267328,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60044,"ondisk_log_size":60044,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":243,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":15952212,"kb_used_data":15506096,"kb_used_omap":4,"kb_used_meta":446075,"kb_avail":267163308,"statfs":{"total":289910292480,"available":273575227392,"internally_reserved":0,"allocated":15878242304,"data_stored":15877325628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":456781138},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,4,0,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1298923520,"num_objects":19820,"num_object_clones":0,"num_object_copies":39640,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-968,"num_objects_unfound":0,"num_objects_dirty":19820,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19820,"num_write_kb":1268480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1533,"num_bytes_recovered":100466688,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.406243"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.162409+0000","last_change":"2024-04-19T02:15:29.280412+0000","last_active":"2024-04-19T02:16:44.162409+0000","last_peered":"2024-04-19T02:16:44.162409+0000","last_clean":"2024-04-19T02:16:44.162409+0000","last_became_active":"2024-04-19T02:15:29.278762+0000","last_became_peered":"2024-04-19T02:15:29.278762+0000","last_unstale":"2024-04-19T02:16:44.162409+0000","last_undegraded":"2024-04-19T02:16:44.162409+0000","last_fullsized":"2024-04-19T02:16:44.162409+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:45.301675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.164348+0000","last_change":"2024-04-19T02:15:29.284695+0000","last_active":"2024-04-19T02:16:44.164348+0000","last_peered":"2024-04-19T02:16:44.164348+0000","last_clean":"2024-04-19T02:16:44.164348+0000","last_became_active":"2024-04-19T02:15:29.283468+0000","last_became_peered":"2024-04-19T02:15:29.283468+0000","last_unstale":"2024-04-19T02:16:44.164348+0000","last_undegraded":"2024-04-19T02:16:44.164348+0000","last_fullsized":"2024-04-19T02:16:44.164348+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.384881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.152120+0000","last_change":"2024-04-19T02:15:29.286709+0000","last_active":"2024-04-19T02:16:44.152120+0000","last_peered":"2024-04-19T02:16:44.152120+0000","last_clean":"2024-04-19T02:16:44.152120+0000","last_became_active":"2024-04-19T02:15:29.286169+0000","last_became_peered":"2024-04-19T02:15:29.286169+0000","last_unstale":"2024-04-19T02:16:44.152120+0000","last_undegraded":"2024-04-19T02:16:44.152120+0000","last_fullsized":"2024-04-19T02:16:44.152120+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:58.741466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.152426+0000","last_change":"2024-04-19T02:15:29.280131+0000","last_active":"2024-04-19T02:16:44.152426+0000","last_peered":"2024-04-19T02:16:44.152426+0000","last_clean":"2024-04-19T02:16:44.152426+0000","last_became_active":"2024-04-19T02:15:29.279388+0000","last_became_peered":"2024-04-19T02:15:29.279388+0000","last_unstale":"2024-04-19T02:16:44.152426+0000","last_undegraded":"2024-04-19T02:16:44.152426+0000","last_fullsized":"2024-04-19T02:16:44.152426+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:36:48.819486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.155636+0000","last_change":"2024-04-19T02:15:53.955892+0000","last_active":"2024-04-19T02:16:44.155636+0000","last_peered":"2024-04-19T02:16:44.155636+0000","last_clean":"2024-04-19T02:16:44.155636+0000","last_became_active":"2024-04-19T02:15:53.955553+0000","last_became_peered":"2024-04-19T02:15:53.955553+0000","last_unstale":"2024-04-19T02:16:44.155636+0000","last_undegraded":"2024-04-19T02:16:44.155636+0000","last_fullsized":"2024-04-19T02:16:44.155636+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:45:39.791209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.151833+0000","last_change":"2024-04-19T02:15:29.283908+0000","last_active":"2024-04-19T02:16:44.151833+0000","last_peered":"2024-04-19T02:16:44.151833+0000","last_clean":"2024-04-19T02:16:44.151833+0000","last_became_active":"2024-04-19T02:15:29.281729+0000","last_became_peered":"2024-04-19T02:15:29.281729+0000","last_unstale":"2024-04-19T02:16:44.151833+0000","last_undegraded":"2024-04-19T02:16:44.151833+0000","last_fullsized":"2024-04-19T02:16:44.151833+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:03:15.383476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.151562+0000","last_change":"2024-04-19T02:15:29.281253+0000","last_active":"2024-04-19T02:16:44.151562+0000","last_peered":"2024-04-19T02:16:44.151562+0000","last_clean":"2024-04-19T02:16:44.151562+0000","last_became_active":"2024-04-19T02:15:29.279951+0000","last_became_peered":"2024-04-19T02:15:29.279951+0000","last_unstale":"2024-04-19T02:16:44.151562+0000","last_undegraded":"2024-04-19T02:16:44.151562+0000","last_fullsized":"2024-04-19T02:16:44.151562+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.151490+0000","last_change":"2024-04-19T02:15:29.283952+0000","last_active":"2024-04-19T02:16:44.151490+0000","last_peered":"2024-04-19T02:16:44.151490+0000","last_clean":"2024-04-19T02:16:44.151490+0000","last_became_active":"2024-04-19T02:15:29.282721+0000","last_became_peered":"2024-04-19T02:15:29.282721+0000","last_unstale":"2024-04-19T02:16:44.151490+0000","last_undegraded":"2024-04-19T02:16:44.151490+0000","last_fullsized":"2024-04-19T02:16:44.151490+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:45.301675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.155518+0000","last_change":"2024-04-19T02:15:29.282150+0000","last_active":"2024-04-19T02:16:44.155518+0000","last_peered":"2024-04-19T02:16:44.155518+0000","last_clean":"2024-04-19T02:16:44.155518+0000","last_became_active":"2024-04-19T02:15:29.281538+0000","last_became_peered":"2024-04-19T02:15:29.281538+0000","last_unstale":"2024-04-19T02:16:44.155518+0000","last_undegraded":"2024-04-19T02:16:44.155518+0000","last_fullsized":"2024-04-19T02:16:44.155518+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.151931+0000","last_change":"2024-04-19T02:16:30.093524+0000","last_active":"2024-04-19T02:16:44.151931+0000","last_peered":"2024-04-19T02:16:44.151931+0000","last_clean":"2024-04-19T02:16:44.151931+0000","last_became_active":"2024-04-19T02:16:30.093344+0000","last_became_peered":"2024-04-19T02:16:30.093344+0000","last_unstale":"2024-04-19T02:16:44.151931+0000","last_undegraded":"2024-04-19T02:16:44.151931+0000","last_fullsized":"2024-04-19T02:16:44.151931+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:14:40.293159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.152023+0000","last_change":"2024-04-19T02:15:29.280606+0000","last_active":"2024-04-19T02:16:44.152023+0000","last_peered":"2024-04-19T02:16:44.152023+0000","last_clean":"2024-04-19T02:16:44.152023+0000","last_became_active":"2024-04-19T02:15:29.280151+0000","last_became_peered":"2024-04-19T02:15:29.280151+0000","last_unstale":"2024-04-19T02:16:44.152023+0000","last_undegraded":"2024-04-19T02:16:44.152023+0000","last_fullsized":"2024-04-19T02:16:44.152023+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:26:22.452488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.152030+0000","last_change":"2024-04-19T02:15:53.958876+0000","last_active":"2024-04-19T02:16:44.152030+0000","last_peered":"2024-04-19T02:16:44.152030+0000","last_clean":"2024-04-19T02:16:44.152030+0000","last_became_active":"2024-04-19T02:15:53.958626+0000","last_became_peered":"2024-04-19T02:15:53.958626+0000","last_unstale":"2024-04-19T02:16:44.152030+0000","last_undegraded":"2024-04-19T02:16:44.152030+0000","last_fullsized":"2024-04-19T02:16:44.152030+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:23:57.044018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.155441+0000","last_change":"2024-04-19T02:15:53.956801+0000","last_active":"2024-04-19T02:16:44.155441+0000","last_peered":"2024-04-19T02:16:44.155441+0000","last_clean":"2024-04-19T02:16:44.155441+0000","last_became_active":"2024-04-19T02:15:53.956620+0000","last_became_peered":"2024-04-19T02:15:53.956620+0000","last_unstale":"2024-04-19T02:16:44.155441+0000","last_undegraded":"2024-04-19T02:16:44.155441+0000","last_fullsized":"2024-04-19T02:16:44.155441+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:57:05.843101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.152276+0000","last_change":"2024-04-19T02:15:29.284262+0000","last_active":"2024-04-19T02:16:44.152276+0000","last_peered":"2024-04-19T02:16:44.152276+0000","last_clean":"2024-04-19T02:16:44.152276+0000","last_became_active":"2024-04-19T02:15:29.283121+0000","last_became_peered":"2024-04-19T02:15:29.283121+0000","last_unstale":"2024-04-19T02:16:44.152276+0000","last_undegraded":"2024-04-19T02:16:44.152276+0000","last_fullsized":"2024-04-19T02:16:44.152276+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.151647+0000","last_change":"2024-04-19T02:15:29.285139+0000","last_active":"2024-04-19T02:16:44.151647+0000","last_peered":"2024-04-19T02:16:44.151647+0000","last_clean":"2024-04-19T02:16:44.151647+0000","last_became_active":"2024-04-19T02:15:29.284649+0000","last_became_peered":"2024-04-19T02:15:29.284649+0000","last_unstale":"2024-04-19T02:16:44.151647+0000","last_undegraded":"2024-04-19T02:16:44.151647+0000","last_fullsized":"2024-04-19T02:16:44.151647+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.151526+0000","last_change":"2024-04-19T02:15:29.283648+0000","last_active":"2024-04-19T02:16:44.151526+0000","last_peered":"2024-04-19T02:16:44.151526+0000","last_clean":"2024-04-19T02:16:44.151526+0000","last_became_active":"2024-04-19T02:15:29.281606+0000","last_became_peered":"2024-04-19T02:15:29.281606+0000","last_unstale":"2024-04-19T02:16:44.151526+0000","last_undegraded":"2024-04-19T02:16:44.151526+0000","last_fullsized":"2024-04-19T02:16:44.151526+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.155603+0000","last_change":"2024-04-19T02:15:29.278673+0000","last_active":"2024-04-19T02:16:44.155603+0000","last_peered":"2024-04-19T02:16:44.155603+0000","last_clean":"2024-04-19T02:16:44.155603+0000","last_became_active":"2024-04-19T02:15:29.277699+0000","last_became_peered":"2024-04-19T02:15:29.277699+0000","last_unstale":"2024-04-19T02:16:44.155603+0000","last_undegraded":"2024-04-19T02:16:44.155603+0000","last_fullsized":"2024-04-19T02:16:44.155603+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.164538+0000","last_change":"2024-04-19T02:15:29.283341+0000","last_active":"2024-04-19T02:16:44.164538+0000","last_peered":"2024-04-19T02:16:44.164538+0000","last_clean":"2024-04-19T02:16:44.164538+0000","last_became_active":"2024-04-19T02:15:29.281591+0000","last_became_peered":"2024-04-19T02:15:29.281591+0000","last_unstale":"2024-04-19T02:16:44.164538+0000","last_undegraded":"2024-04-19T02:16:44.164538+0000","last_fullsized":"2024-04-19T02:16:44.164538+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:34.593754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.155128+0000","last_change":"2024-04-19T02:15:29.282110+0000","last_active":"2024-04-19T02:16:44.155128+0000","last_peered":"2024-04-19T02:16:44.155128+0000","last_clean":"2024-04-19T02:16:44.155128+0000","last_became_active":"2024-04-19T02:15:29.281716+0000","last_became_peered":"2024-04-19T02:15:29.281716+0000","last_unstale":"2024-04-19T02:16:44.155128+0000","last_undegraded":"2024-04-19T02:16:44.155128+0000","last_fullsized":"2024-04-19T02:16:44.155128+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.152358+0000","last_change":"2024-04-19T02:15:29.285237+0000","last_active":"2024-04-19T02:16:44.152358+0000","last_peered":"2024-04-19T02:16:44.152358+0000","last_clean":"2024-04-19T02:16:44.152358+0000","last_became_active":"2024-04-19T02:15:29.282790+0000","last_became_peered":"2024-04-19T02:15:29.282790+0000","last_unstale":"2024-04-19T02:16:44.152358+0000","last_undegraded":"2024-04-19T02:16:44.152358+0000","last_fullsized":"2024-04-19T02:16:44.152358+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.151907+0000","last_change":"2024-04-19T02:15:29.282609+0000","last_active":"2024-04-19T02:16:44.151907+0000","last_peered":"2024-04-19T02:16:44.151907+0000","last_clean":"2024-04-19T02:16:44.151907+0000","last_became_active":"2024-04-19T02:15:29.281665+0000","last_became_peered":"2024-04-19T02:15:29.281665+0000","last_unstale":"2024-04-19T02:16:44.151907+0000","last_undegraded":"2024-04-19T02:16:44.151907+0000","last_fullsized":"2024-04-19T02:16:44.151907+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.384881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.151685+0000","last_change":"2024-04-19T02:15:53.955813+0000","last_active":"2024-04-19T02:16:44.151685+0000","last_peered":"2024-04-19T02:16:44.151685+0000","last_clean":"2024-04-19T02:16:44.151685+0000","last_became_active":"2024-04-19T02:15:53.955614+0000","last_became_peered":"2024-04-19T02:15:53.955614+0000","last_unstale":"2024-04-19T02:16:44.151685+0000","last_undegraded":"2024-04-19T02:16:44.151685+0000","last_fullsized":"2024-04-19T02:16:44.151685+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:58:03.192647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.153208+0000","last_change":"2024-04-19T02:15:29.277109+0000","last_active":"2024-04-19T02:16:44.153208+0000","last_peered":"2024-04-19T02:16:44.153208+0000","last_clean":"2024-04-19T02:16:44.153208+0000","last_became_active":"2024-04-19T02:15:29.275417+0000","last_became_peered":"2024-04-19T02:15:29.275417+0000","last_unstale":"2024-04-19T02:16:44.153208+0000","last_undegraded":"2024-04-19T02:16:44.153208+0000","last_fullsized":"2024-04-19T02:16:44.153208+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.159661+0000","last_change":"2024-04-19T02:15:29.283266+0000","last_active":"2024-04-19T02:16:44.159661+0000","last_peered":"2024-04-19T02:16:44.159661+0000","last_clean":"2024-04-19T02:16:44.159661+0000","last_became_active":"2024-04-19T02:15:29.281505+0000","last_became_peered":"2024-04-19T02:15:29.281505+0000","last_unstale":"2024-04-19T02:16:44.159661+0000","last_undegraded":"2024-04-19T02:16:44.159661+0000","last_fullsized":"2024-04-19T02:16:44.159661+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.162391+0000","last_change":"2024-04-19T02:15:29.278084+0000","last_active":"2024-04-19T02:16:44.162391+0000","last_peered":"2024-04-19T02:16:44.162391+0000","last_clean":"2024-04-19T02:16:44.162391+0000","last_became_active":"2024-04-19T02:15:29.276952+0000","last_became_peered":"2024-04-19T02:15:29.276952+0000","last_unstale":"2024-04-19T02:16:44.162391+0000","last_undegraded":"2024-04-19T02:16:44.162391+0000","last_fullsized":"2024-04-19T02:16:44.162391+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.155687+0000","last_change":"2024-04-19T02:15:29.279904+0000","last_active":"2024-04-19T02:16:44.155687+0000","last_peered":"2024-04-19T02:16:44.155687+0000","last_clean":"2024-04-19T02:16:44.155687+0000","last_became_active":"2024-04-19T02:15:29.278938+0000","last_became_peered":"2024-04-19T02:15:29.278938+0000","last_unstale":"2024-04-19T02:16:44.155687+0000","last_undegraded":"2024-04-19T02:16:44.155687+0000","last_fullsized":"2024-04-19T02:16:44.155687+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.152044+0000","last_change":"2024-04-19T02:15:29.287389+0000","last_active":"2024-04-19T02:16:44.152044+0000","last_peered":"2024-04-19T02:16:44.152044+0000","last_clean":"2024-04-19T02:16:44.152044+0000","last_became_active":"2024-04-19T02:15:29.286431+0000","last_became_peered":"2024-04-19T02:15:29.286431+0000","last_unstale":"2024-04-19T02:16:44.152044+0000","last_undegraded":"2024-04-19T02:16:44.152044+0000","last_fullsized":"2024-04-19T02:16:44.152044+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:58:30.117887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.153503+0000","last_change":"2024-04-19T02:15:53.959207+0000","last_active":"2024-04-19T02:16:44.153503+0000","last_peered":"2024-04-19T02:16:44.153503+0000","last_clean":"2024-04-19T02:16:44.153503+0000","last_became_active":"2024-04-19T02:15:53.959007+0000","last_became_peered":"2024-04-19T02:15:53.959007+0000","last_unstale":"2024-04-19T02:16:44.153503+0000","last_undegraded":"2024-04-19T02:16:44.153503+0000","last_fullsized":"2024-04-19T02:16:44.153503+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:08:21.065077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.165124+0000","last_change":"2024-04-19T02:15:29.281792+0000","last_active":"2024-04-19T02:16:44.165124+0000","last_peered":"2024-04-19T02:16:44.165124+0000","last_clean":"2024-04-19T02:16:44.165124+0000","last_became_active":"2024-04-19T02:15:29.280479+0000","last_became_peered":"2024-04-19T02:15:29.280479+0000","last_unstale":"2024-04-19T02:16:44.165124+0000","last_undegraded":"2024-04-19T02:16:44.165124+0000","last_fullsized":"2024-04-19T02:16:44.165124+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.153218+0000","last_change":"2024-04-19T02:15:28.888778+0000","last_active":"2024-04-19T02:16:44.153218+0000","last_peered":"2024-04-19T02:16:44.153218+0000","last_clean":"2024-04-19T02:16:44.153218+0000","last_became_active":"2024-04-19T02:15:28.888543+0000","last_became_peered":"2024-04-19T02:15:28.888543+0000","last_unstale":"2024-04-19T02:16:44.153218+0000","last_undegraded":"2024-04-19T02:16:44.153218+0000","last_fullsized":"2024-04-19T02:16:44.153218+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:43:51.221619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.155355+0000","last_change":"2024-04-19T02:15:29.279986+0000","last_active":"2024-04-19T02:16:44.155355+0000","last_peered":"2024-04-19T02:16:44.155355+0000","last_clean":"2024-04-19T02:16:44.155355+0000","last_became_active":"2024-04-19T02:15:29.279690+0000","last_became_peered":"2024-04-19T02:15:29.279690+0000","last_unstale":"2024-04-19T02:16:44.155355+0000","last_undegraded":"2024-04-19T02:16:44.155355+0000","last_fullsized":"2024-04-19T02:16:44.155355+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.153228+0000","last_change":"2024-04-19T02:15:28.890463+0000","last_active":"2024-04-19T02:16:44.153228+0000","last_peered":"2024-04-19T02:16:44.153228+0000","last_clean":"2024-04-19T02:16:44.153228+0000","last_became_active":"2024-04-19T02:15:28.889777+0000","last_became_peered":"2024-04-19T02:15:28.889777+0000","last_unstale":"2024-04-19T02:16:44.153228+0000","last_undegraded":"2024-04-19T02:16:44.153228+0000","last_fullsized":"2024-04-19T02:16:44.153228+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:58:21.520250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.162304+0000","last_change":"2024-04-19T02:15:29.280879+0000","last_active":"2024-04-19T02:16:44.162304+0000","last_peered":"2024-04-19T02:16:44.162304+0000","last_clean":"2024-04-19T02:16:44.162304+0000","last_became_active":"2024-04-19T02:15:29.279314+0000","last_became_peered":"2024-04-19T02:15:29.279314+0000","last_unstale":"2024-04-19T02:16:44.162304+0000","last_undegraded":"2024-04-19T02:16:44.162304+0000","last_fullsized":"2024-04-19T02:16:44.162304+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.155778+0000","last_change":"2024-04-19T02:15:28.891867+0000","last_active":"2024-04-19T02:16:44.155778+0000","last_peered":"2024-04-19T02:16:44.155778+0000","last_clean":"2024-04-19T02:16:44.155778+0000","last_became_active":"2024-04-19T02:15:28.890806+0000","last_became_peered":"2024-04-19T02:15:28.890806+0000","last_unstale":"2024-04-19T02:16:44.155778+0000","last_undegraded":"2024-04-19T02:16:44.155778+0000","last_fullsized":"2024-04-19T02:16:44.155778+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:57.946581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.153131+0000","last_change":"2024-04-19T02:15:29.278148+0000","last_active":"2024-04-19T02:16:44.153131+0000","last_peered":"2024-04-19T02:16:44.153131+0000","last_clean":"2024-04-19T02:16:44.153131+0000","last_became_active":"2024-04-19T02:15:29.277402+0000","last_became_peered":"2024-04-19T02:15:29.277402+0000","last_unstale":"2024-04-19T02:16:44.153131+0000","last_undegraded":"2024-04-19T02:16:44.153131+0000","last_fullsized":"2024-04-19T02:16:44.153131+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.152140+0000","last_change":"2024-04-19T02:15:28.892905+0000","last_active":"2024-04-19T02:16:44.152140+0000","last_peered":"2024-04-19T02:16:44.152140+0000","last_clean":"2024-04-19T02:16:44.152140+0000","last_became_active":"2024-04-19T02:15:28.892541+0000","last_became_peered":"2024-04-19T02:15:28.892541+0000","last_unstale":"2024-04-19T02:16:44.152140+0000","last_undegraded":"2024-04-19T02:16:44.152140+0000","last_fullsized":"2024-04-19T02:16:44.152140+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:33.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.153307+0000","last_change":"2024-04-19T02:15:29.278810+0000","last_active":"2024-04-19T02:16:44.153307+0000","last_peered":"2024-04-19T02:16:44.153307+0000","last_clean":"2024-04-19T02:16:44.153307+0000","last_became_active":"2024-04-19T02:15:29.278093+0000","last_became_peered":"2024-04-19T02:15:29.278093+0000","last_unstale":"2024-04-19T02:16:44.153307+0000","last_undegraded":"2024-04-19T02:16:44.153307+0000","last_fullsized":"2024-04-19T02:16:44.153307+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:34.883207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":40,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.162486+0000","last_change":"2024-04-19T02:15:28.892937+0000","last_active":"2024-04-19T02:16:44.162486+0000","last_peered":"2024-04-19T02:16:44.162486+0000","last_clean":"2024-04-19T02:16:44.162486+0000","last_became_active":"2024-04-19T02:15:28.891440+0000","last_became_peered":"2024-04-19T02:15:28.891440+0000","last_unstale":"2024-04-19T02:16:44.162486+0000","last_undegraded":"2024-04-19T02:16:44.162486+0000","last_fullsized":"2024-04-19T02:16:44.162486+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.153412+0000","last_change":"2024-04-19T02:15:29.278404+0000","last_active":"2024-04-19T02:16:44.153412+0000","last_peered":"2024-04-19T02:16:44.153412+0000","last_clean":"2024-04-19T02:16:44.153412+0000","last_became_active":"2024-04-19T02:15:29.277460+0000","last_became_peered":"2024-04-19T02:15:29.277460+0000","last_unstale":"2024-04-19T02:16:44.153412+0000","last_undegraded":"2024-04-19T02:16:44.153412+0000","last_fullsized":"2024-04-19T02:16:44.153412+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":43,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.152195+0000","last_change":"2024-04-19T02:15:28.891097+0000","last_active":"2024-04-19T02:16:44.152195+0000","last_peered":"2024-04-19T02:16:44.152195+0000","last_clean":"2024-04-19T02:16:44.152195+0000","last_became_active":"2024-04-19T02:15:28.890795+0000","last_became_peered":"2024-04-19T02:15:28.890795+0000","last_unstale":"2024-04-19T02:16:44.152195+0000","last_undegraded":"2024-04-19T02:16:44.152195+0000","last_fullsized":"2024-04-19T02:16:44.152195+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.152427+0000","last_change":"2024-04-19T02:15:29.278546+0000","last_active":"2024-04-19T02:16:44.152427+0000","last_peered":"2024-04-19T02:16:44.152427+0000","last_clean":"2024-04-19T02:16:44.152427+0000","last_became_active":"2024-04-19T02:15:29.277547+0000","last_became_peered":"2024-04-19T02:15:29.277547+0000","last_unstale":"2024-04-19T02:16:44.152427+0000","last_undegraded":"2024-04-19T02:16:44.152427+0000","last_fullsized":"2024-04-19T02:16:44.152427+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":39,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.152344+0000","last_change":"2024-04-19T02:15:28.892977+0000","last_active":"2024-04-19T02:16:44.152344+0000","last_peered":"2024-04-19T02:16:44.152344+0000","last_clean":"2024-04-19T02:16:44.152344+0000","last_became_active":"2024-04-19T02:15:28.892636+0000","last_became_peered":"2024-04-19T02:15:28.892636+0000","last_unstale":"2024-04-19T02:16:44.152344+0000","last_undegraded":"2024-04-19T02:16:44.152344+0000","last_fullsized":"2024-04-19T02:16:44.152344+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:43:51.221619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.153231+0000","last_change":"2024-04-19T02:15:53.955655+0000","last_active":"2024-04-19T02:16:44.153231+0000","last_peered":"2024-04-19T02:16:44.153231+0000","last_clean":"2024-04-19T02:16:44.153231+0000","last_became_active":"2024-04-19T02:15:53.955382+0000","last_became_peered":"2024-04-19T02:15:53.955382+0000","last_unstale":"2024-04-19T02:16:44.153231+0000","last_undegraded":"2024-04-19T02:16:44.153231+0000","last_fullsized":"2024-04-19T02:16:44.153231+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:48.239260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.153495+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:16:44.153495+0000","last_peered":"2024-04-19T02:16:44.153495+0000","last_clean":"2024-04-19T02:16:44.153495+0000","last_became_active":"2024-04-19T02:15:28.890751+0000","last_became_peered":"2024-04-19T02:15:28.890751+0000","last_unstale":"2024-04-19T02:16:44.153495+0000","last_undegraded":"2024-04-19T02:16:44.153495+0000","last_fullsized":"2024-04-19T02:16:44.153495+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.154959+0000","last_change":"2024-04-19T02:15:53.957865+0000","last_active":"2024-04-19T02:16:44.154959+0000","last_peered":"2024-04-19T02:16:44.154959+0000","last_clean":"2024-04-19T02:16:44.154959+0000","last_became_active":"2024-04-19T02:15:53.957627+0000","last_became_peered":"2024-04-19T02:15:53.957627+0000","last_unstale":"2024-04-19T02:16:44.154959+0000","last_undegraded":"2024-04-19T02:16:44.154959+0000","last_fullsized":"2024-04-19T02:16:44.154959+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:16:45.799016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.159554+0000","last_change":"2024-04-19T02:15:28.892934+0000","last_active":"2024-04-19T02:16:44.159554+0000","last_peered":"2024-04-19T02:16:44.159554+0000","last_clean":"2024-04-19T02:16:44.159554+0000","last_became_active":"2024-04-19T02:15:28.891879+0000","last_became_peered":"2024-04-19T02:15:28.891879+0000","last_unstale":"2024-04-19T02:16:44.159554+0000","last_undegraded":"2024-04-19T02:16:44.159554+0000","last_fullsized":"2024-04-19T02:16:44.159554+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:10:12.514798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.155511+0000","last_change":"2024-04-19T02:15:29.279685+0000","last_active":"2024-04-19T02:16:44.155511+0000","last_peered":"2024-04-19T02:16:44.155511+0000","last_clean":"2024-04-19T02:16:44.155511+0000","last_became_active":"2024-04-19T02:15:29.278810+0000","last_became_peered":"2024-04-19T02:15:29.278810+0000","last_unstale":"2024-04-19T02:16:44.155511+0000","last_undegraded":"2024-04-19T02:16:44.155511+0000","last_fullsized":"2024-04-19T02:16:44.155511+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.151705+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:16:44.151705+0000","last_peered":"2024-04-19T02:16:44.151705+0000","last_clean":"2024-04-19T02:16:44.151705+0000","last_became_active":"2024-04-19T02:15:28.890882+0000","last_became_peered":"2024-04-19T02:15:28.890882+0000","last_unstale":"2024-04-19T02:16:44.151705+0000","last_undegraded":"2024-04-19T02:16:44.151705+0000","last_fullsized":"2024-04-19T02:16:44.151705+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:31.673938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.155851+0000","last_change":"2024-04-19T02:15:29.284258+0000","last_active":"2024-04-19T02:16:44.155851+0000","last_peered":"2024-04-19T02:16:44.155851+0000","last_clean":"2024-04-19T02:16:44.155851+0000","last_became_active":"2024-04-19T02:15:29.283995+0000","last_became_peered":"2024-04-19T02:15:29.283995+0000","last_unstale":"2024-04-19T02:16:44.155851+0000","last_undegraded":"2024-04-19T02:16:44.155851+0000","last_fullsized":"2024-04-19T02:16:44.155851+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:35.941308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"41'7607","reported_seq":7640,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.793252+0000","last_change":"2024-04-19T02:15:53.956977+0000","last_active":"2024-04-19T02:16:47.793252+0000","last_peered":"2024-04-19T02:16:47.793252+0000","last_clean":"2024-04-19T02:16:47.793252+0000","last_became_active":"2024-04-19T02:15:53.956730+0000","last_became_peered":"2024-04-19T02:15:53.956730+0000","last_unstale":"2024-04-19T02:16:47.793252+0000","last_undegraded":"2024-04-19T02:16:47.793252+0000","last_fullsized":"2024-04-19T02:16:47.793252+0000","mapping_epoch":16,"log_start":"26'3900","ondisk_log_start":"26'3900","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3707,"log_dups_size":0,"ondisk_log_size":3707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:56:46.323499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":498532352,"num_objects":7607,"num_object_clones":0,"num_object_copies":15214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7607,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7607,"num_write_kb":486848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.152275+0000","last_change":"2024-04-19T02:15:28.890265+0000","last_active":"2024-04-19T02:16:44.152275+0000","last_peered":"2024-04-19T02:16:44.152275+0000","last_clean":"2024-04-19T02:16:44.152275+0000","last_became_active":"2024-04-19T02:15:28.890004+0000","last_became_peered":"2024-04-19T02:15:28.890004+0000","last_unstale":"2024-04-19T02:16:44.152275+0000","last_undegraded":"2024-04-19T02:16:44.152275+0000","last_fullsized":"2024-04-19T02:16:44.152275+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:02.517101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.159402+0000","last_change":"2024-04-19T02:15:29.285529+0000","last_active":"2024-04-19T02:16:44.159402+0000","last_peered":"2024-04-19T02:16:44.159402+0000","last_clean":"2024-04-19T02:16:44.159402+0000","last_became_active":"2024-04-19T02:15:29.285197+0000","last_became_peered":"2024-04-19T02:15:29.285197+0000","last_unstale":"2024-04-19T02:16:44.159402+0000","last_undegraded":"2024-04-19T02:16:44.159402+0000","last_fullsized":"2024-04-19T02:16:44.159402+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"41'7556","reported_seq":7589,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.757058+0000","last_change":"2024-04-19T02:15:53.958523+0000","last_active":"2024-04-19T02:16:47.757058+0000","last_peered":"2024-04-19T02:16:47.757058+0000","last_clean":"2024-04-19T02:16:47.757058+0000","last_became_active":"2024-04-19T02:15:53.957627+0000","last_became_peered":"2024-04-19T02:15:53.957627+0000","last_unstale":"2024-04-19T02:16:47.757058+0000","last_undegraded":"2024-04-19T02:16:47.757058+0000","last_fullsized":"2024-04-19T02:16:47.757058+0000","mapping_epoch":16,"log_start":"25'3647","ondisk_log_start":"25'3647","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3909,"log_dups_size":0,"ondisk_log_size":3909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:59:55.120296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":495190016,"num_objects":7556,"num_object_clones":0,"num_object_copies":15112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7556,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7556,"num_write_kb":483584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":39,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.164337+0000","last_change":"2024-04-19T02:15:28.893902+0000","last_active":"2024-04-19T02:16:44.164337+0000","last_peered":"2024-04-19T02:16:44.164337+0000","last_clean":"2024-04-19T02:16:44.164337+0000","last_became_active":"2024-04-19T02:15:28.893231+0000","last_became_peered":"2024-04-19T02:15:28.893231+0000","last_unstale":"2024-04-19T02:16:44.164337+0000","last_undegraded":"2024-04-19T02:16:44.164337+0000","last_fullsized":"2024-04-19T02:16:44.164337+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:23.658442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.159674+0000","last_change":"2024-04-19T02:15:29.282874+0000","last_active":"2024-04-19T02:16:44.159674+0000","last_peered":"2024-04-19T02:16:44.159674+0000","last_clean":"2024-04-19T02:16:44.159674+0000","last_became_active":"2024-04-19T02:15:29.281675+0000","last_became_peered":"2024-04-19T02:15:29.281675+0000","last_unstale":"2024-04-19T02:16:44.159674+0000","last_undegraded":"2024-04-19T02:16:44.159674+0000","last_fullsized":"2024-04-19T02:16:44.159674+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:35.941308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"41'7409","reported_seq":7441,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.769815+0000","last_change":"2024-04-19T02:15:53.958324+0000","last_active":"2024-04-19T02:16:47.769815+0000","last_peered":"2024-04-19T02:16:47.769815+0000","last_clean":"2024-04-19T02:16:47.769815+0000","last_became_active":"2024-04-19T02:15:53.957392+0000","last_became_peered":"2024-04-19T02:15:53.957392+0000","last_unstale":"2024-04-19T02:16:47.769815+0000","last_undegraded":"2024-04-19T02:16:47.769815+0000","last_fullsized":"2024-04-19T02:16:47.769815+0000","mapping_epoch":16,"log_start":"25'3500","ondisk_log_start":"25'3500","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3909,"log_dups_size":0,"ondisk_log_size":3909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:12:58.132969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":485556224,"num_objects":7409,"num_object_clones":0,"num_object_copies":14818,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7409,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7409,"num_write_kb":474176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.152108+0000","last_change":"2024-04-19T02:15:28.891234+0000","last_active":"2024-04-19T02:16:44.152108+0000","last_peered":"2024-04-19T02:16:44.152108+0000","last_clean":"2024-04-19T02:16:44.152108+0000","last_became_active":"2024-04-19T02:15:28.890881+0000","last_became_peered":"2024-04-19T02:15:28.890881+0000","last_unstale":"2024-04-19T02:16:44.152108+0000","last_undegraded":"2024-04-19T02:16:44.152108+0000","last_fullsized":"2024-04-19T02:16:44.152108+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.152176+0000","last_change":"2024-04-19T02:15:29.281937+0000","last_active":"2024-04-19T02:16:44.152176+0000","last_peered":"2024-04-19T02:16:44.152176+0000","last_clean":"2024-04-19T02:16:44.152176+0000","last_became_active":"2024-04-19T02:15:29.280727+0000","last_became_peered":"2024-04-19T02:15:29.280727+0000","last_unstale":"2024-04-19T02:16:44.152176+0000","last_undegraded":"2024-04-19T02:16:44.152176+0000","last_fullsized":"2024-04-19T02:16:44.152176+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"41'7588","reported_seq":7621,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.778345+0000","last_change":"2024-04-19T02:15:53.959099+0000","last_active":"2024-04-19T02:16:47.778345+0000","last_peered":"2024-04-19T02:16:47.778345+0000","last_clean":"2024-04-19T02:16:47.778345+0000","last_became_active":"2024-04-19T02:15:53.958885+0000","last_became_peered":"2024-04-19T02:15:53.958885+0000","last_unstale":"2024-04-19T02:16:47.778345+0000","last_undegraded":"2024-04-19T02:16:47.778345+0000","last_fullsized":"2024-04-19T02:16:47.778345+0000","mapping_epoch":16,"log_start":"26'4000","ondisk_log_start":"26'4000","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3588,"log_dups_size":0,"ondisk_log_size":3588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:53:26.969927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":497287168,"num_objects":7588,"num_object_clones":0,"num_object_copies":15176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7588,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7588,"num_write_kb":485632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.151945+0000","last_change":"2024-04-19T02:15:28.892767+0000","last_active":"2024-04-19T02:16:44.151945+0000","last_peered":"2024-04-19T02:16:44.151945+0000","last_clean":"2024-04-19T02:16:44.151945+0000","last_became_active":"2024-04-19T02:15:28.892235+0000","last_became_peered":"2024-04-19T02:15:28.892235+0000","last_unstale":"2024-04-19T02:16:44.151945+0000","last_undegraded":"2024-04-19T02:16:44.151945+0000","last_fullsized":"2024-04-19T02:16:44.151945+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:37.690735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.155768+0000","last_change":"2024-04-19T02:15:29.279857+0000","last_active":"2024-04-19T02:16:44.155768+0000","last_peered":"2024-04-19T02:16:44.155768+0000","last_clean":"2024-04-19T02:16:44.155768+0000","last_became_active":"2024-04-19T02:15:29.279536+0000","last_became_peered":"2024-04-19T02:15:29.279536+0000","last_unstale":"2024-04-19T02:16:44.155768+0000","last_undegraded":"2024-04-19T02:16:44.155768+0000","last_fullsized":"2024-04-19T02:16:44.155768+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:00.191179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"41'7504","reported_seq":7537,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.806195+0000","last_change":"2024-04-19T02:15:53.957261+0000","last_active":"2024-04-19T02:16:47.806195+0000","last_peered":"2024-04-19T02:16:47.806195+0000","last_clean":"2024-04-19T02:16:47.806195+0000","last_became_active":"2024-04-19T02:15:53.957092+0000","last_became_peered":"2024-04-19T02:15:53.957092+0000","last_unstale":"2024-04-19T02:16:47.806195+0000","last_undegraded":"2024-04-19T02:16:47.806195+0000","last_fullsized":"2024-04-19T02:16:47.806195+0000","mapping_epoch":16,"log_start":"26'3813","ondisk_log_start":"26'3813","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3691,"log_dups_size":0,"ondisk_log_size":3691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:54:15.544923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":491782144,"num_objects":7504,"num_object_clones":0,"num_object_copies":15008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7504,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7504,"num_write_kb":480256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":39,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.155714+0000","last_change":"2024-04-19T02:15:28.891611+0000","last_active":"2024-04-19T02:16:44.155714+0000","last_peered":"2024-04-19T02:16:44.155714+0000","last_clean":"2024-04-19T02:16:44.155714+0000","last_became_active":"2024-04-19T02:15:28.890914+0000","last_became_peered":"2024-04-19T02:15:28.890914+0000","last_unstale":"2024-04-19T02:16:44.155714+0000","last_undegraded":"2024-04-19T02:16:44.155714+0000","last_fullsized":"2024-04-19T02:16:44.155714+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:37.690735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.152450+0000","last_change":"2024-04-19T02:15:29.285774+0000","last_active":"2024-04-19T02:16:44.152450+0000","last_peered":"2024-04-19T02:16:44.152450+0000","last_clean":"2024-04-19T02:16:44.152450+0000","last_became_active":"2024-04-19T02:15:29.284705+0000","last_became_peered":"2024-04-19T02:15:29.284705+0000","last_unstale":"2024-04-19T02:16:44.152450+0000","last_undegraded":"2024-04-19T02:16:44.152450+0000","last_fullsized":"2024-04-19T02:16:44.152450+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"41'7472","reported_seq":7505,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.775437+0000","last_change":"2024-04-19T02:15:53.955286+0000","last_active":"2024-04-19T02:16:47.775437+0000","last_peered":"2024-04-19T02:16:47.775437+0000","last_clean":"2024-04-19T02:16:47.775437+0000","last_became_active":"2024-04-19T02:15:53.955026+0000","last_became_peered":"2024-04-19T02:15:53.955026+0000","last_unstale":"2024-04-19T02:16:47.775437+0000","last_undegraded":"2024-04-19T02:16:47.775437+0000","last_fullsized":"2024-04-19T02:16:47.775437+0000","mapping_epoch":16,"log_start":"26'3900","ondisk_log_start":"26'3900","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3572,"log_dups_size":0,"ondisk_log_size":3572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:05:48.594301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":489684992,"num_objects":7472,"num_object_clones":0,"num_object_copies":14944,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7472,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7472,"num_write_kb":478208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.151927+0000","last_change":"2024-04-19T02:15:28.892873+0000","last_active":"2024-04-19T02:16:44.151927+0000","last_peered":"2024-04-19T02:16:44.151927+0000","last_clean":"2024-04-19T02:16:44.151927+0000","last_became_active":"2024-04-19T02:15:28.892487+0000","last_became_peered":"2024-04-19T02:15:28.892487+0000","last_unstale":"2024-04-19T02:16:44.151927+0000","last_undegraded":"2024-04-19T02:16:44.151927+0000","last_fullsized":"2024-04-19T02:16:44.151927+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:35.412837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.152278+0000","last_change":"2024-04-19T02:15:29.285019+0000","last_active":"2024-04-19T02:16:44.152278+0000","last_peered":"2024-04-19T02:16:44.152278+0000","last_clean":"2024-04-19T02:16:44.152278+0000","last_became_active":"2024-04-19T02:15:29.284650+0000","last_became_peered":"2024-04-19T02:15:29.284650+0000","last_unstale":"2024-04-19T02:16:44.152278+0000","last_undegraded":"2024-04-19T02:16:44.152278+0000","last_fullsized":"2024-04-19T02:16:44.152278+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"41'7523","reported_seq":7556,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.799060+0000","last_change":"2024-04-19T02:15:53.957403+0000","last_active":"2024-04-19T02:16:47.799060+0000","last_peered":"2024-04-19T02:16:47.799060+0000","last_clean":"2024-04-19T02:16:47.799060+0000","last_became_active":"2024-04-19T02:15:53.957190+0000","last_became_peered":"2024-04-19T02:15:53.957190+0000","last_unstale":"2024-04-19T02:16:47.799060+0000","last_undegraded":"2024-04-19T02:16:47.799060+0000","last_fullsized":"2024-04-19T02:16:47.799060+0000","mapping_epoch":16,"log_start":"25'3801","ondisk_log_start":"25'3801","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3722,"log_dups_size":0,"ondisk_log_size":3722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:07:12.817884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493027328,"num_objects":7523,"num_object_clones":0,"num_object_copies":15046,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7523,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7523,"num_write_kb":481472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.151550+0000","last_change":"2024-04-19T02:15:53.956839+0000","last_active":"2024-04-19T02:16:44.151550+0000","last_peered":"2024-04-19T02:16:44.151550+0000","last_clean":"2024-04-19T02:16:44.151550+0000","last_became_active":"2024-04-19T02:15:53.956630+0000","last_became_peered":"2024-04-19T02:15:53.956630+0000","last_unstale":"2024-04-19T02:16:44.151550+0000","last_undegraded":"2024-04-19T02:16:44.151550+0000","last_fullsized":"2024-04-19T02:16:44.151550+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:47.229730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.152237+0000","last_change":"2024-04-19T02:15:29.287190+0000","last_active":"2024-04-19T02:16:44.152237+0000","last_peered":"2024-04-19T02:16:44.152237+0000","last_clean":"2024-04-19T02:16:44.152237+0000","last_became_active":"2024-04-19T02:15:29.286606+0000","last_became_peered":"2024-04-19T02:15:29.286606+0000","last_unstale":"2024-04-19T02:16:44.152237+0000","last_undegraded":"2024-04-19T02:16:44.152237+0000","last_fullsized":"2024-04-19T02:16:44.152237+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:28.387062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"41'7333","reported_seq":7366,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.743113+0000","last_change":"2024-04-19T02:15:53.958448+0000","last_active":"2024-04-19T02:16:47.743113+0000","last_peered":"2024-04-19T02:16:47.743113+0000","last_clean":"2024-04-19T02:16:47.743113+0000","last_became_active":"2024-04-19T02:15:53.957595+0000","last_became_peered":"2024-04-19T02:15:53.957595+0000","last_unstale":"2024-04-19T02:16:47.743113+0000","last_undegraded":"2024-04-19T02:16:47.743113+0000","last_fullsized":"2024-04-19T02:16:47.743113+0000","mapping_epoch":16,"log_start":"24'3344","ondisk_log_start":"24'3344","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3989,"log_dups_size":0,"ondisk_log_size":3989,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:26:31.855319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":480575488,"num_objects":7333,"num_object_clones":0,"num_object_copies":14666,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7333,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7333,"num_write_kb":469312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.159576+0000","last_change":"2024-04-19T02:15:28.894121+0000","last_active":"2024-04-19T02:16:44.159576+0000","last_peered":"2024-04-19T02:16:44.159576+0000","last_clean":"2024-04-19T02:16:44.159576+0000","last_became_active":"2024-04-19T02:15:28.893902+0000","last_became_peered":"2024-04-19T02:15:28.893902+0000","last_unstale":"2024-04-19T02:16:44.159576+0000","last_undegraded":"2024-04-19T02:16:44.159576+0000","last_fullsized":"2024-04-19T02:16:44.159576+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:10:35.146583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.155680+0000","last_change":"2024-04-19T02:15:29.282870+0000","last_active":"2024-04-19T02:16:44.155680+0000","last_peered":"2024-04-19T02:16:44.155680+0000","last_clean":"2024-04-19T02:16:44.155680+0000","last_became_active":"2024-04-19T02:15:29.281873+0000","last_became_peered":"2024-04-19T02:15:29.281873+0000","last_unstale":"2024-04-19T02:16:44.155680+0000","last_undegraded":"2024-04-19T02:16:44.155680+0000","last_fullsized":"2024-04-19T02:16:44.155680+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"41'7475","reported_seq":7508,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.760357+0000","last_change":"2024-04-19T02:15:53.955498+0000","last_active":"2024-04-19T02:16:47.760357+0000","last_peered":"2024-04-19T02:16:47.760357+0000","last_clean":"2024-04-19T02:16:47.760357+0000","last_became_active":"2024-04-19T02:15:53.954910+0000","last_became_peered":"2024-04-19T02:15:53.954910+0000","last_unstale":"2024-04-19T02:16:47.760357+0000","last_undegraded":"2024-04-19T02:16:47.760357+0000","last_fullsized":"2024-04-19T02:16:47.760357+0000","mapping_epoch":16,"log_start":"26'3900","ondisk_log_start":"26'3900","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3575,"log_dups_size":0,"ondisk_log_size":3575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:58:27.262672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":489881600,"num_objects":7475,"num_object_clones":0,"num_object_copies":14950,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7475,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7475,"num_write_kb":478400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.155249+0000","last_change":"2024-04-19T02:15:24.527061+0000","last_active":"2024-04-19T02:16:44.155249+0000","last_peered":"2024-04-19T02:16:44.155249+0000","last_clean":"2024-04-19T02:16:44.155249+0000","last_became_active":"2024-04-19T02:15:24.526757+0000","last_became_peered":"2024-04-19T02:15:24.526757+0000","last_unstale":"2024-04-19T02:16:44.155249+0000","last_undegraded":"2024-04-19T02:16:44.155249+0000","last_fullsized":"2024-04-19T02:16:44.155249+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:17:13.649077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.152199+0000","last_change":"2024-04-19T02:15:28.892766+0000","last_active":"2024-04-19T02:16:44.152199+0000","last_peered":"2024-04-19T02:16:44.152199+0000","last_clean":"2024-04-19T02:16:44.152199+0000","last_became_active":"2024-04-19T02:15:28.892396+0000","last_became_peered":"2024-04-19T02:15:28.892396+0000","last_unstale":"2024-04-19T02:16:44.152199+0000","last_undegraded":"2024-04-19T02:16:44.152199+0000","last_fullsized":"2024-04-19T02:16:44.152199+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:57.946581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.161376+0000","last_change":"2024-04-19T02:15:29.277922+0000","last_active":"2024-04-19T02:16:44.161376+0000","last_peered":"2024-04-19T02:16:44.161376+0000","last_clean":"2024-04-19T02:16:44.161376+0000","last_became_active":"2024-04-19T02:15:29.276968+0000","last_became_peered":"2024-04-19T02:15:29.276968+0000","last_unstale":"2024-04-19T02:16:44.161376+0000","last_undegraded":"2024-04-19T02:16:44.161376+0000","last_fullsized":"2024-04-19T02:16:44.161376+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"41'7508","reported_seq":7541,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.763145+0000","last_change":"2024-04-19T02:15:53.955228+0000","last_active":"2024-04-19T02:16:47.763145+0000","last_peered":"2024-04-19T02:16:47.763145+0000","last_clean":"2024-04-19T02:16:47.763145+0000","last_became_active":"2024-04-19T02:15:53.954960+0000","last_became_peered":"2024-04-19T02:15:53.954960+0000","last_unstale":"2024-04-19T02:16:47.763145+0000","last_undegraded":"2024-04-19T02:16:47.763145+0000","last_fullsized":"2024-04-19T02:16:47.763145+0000","mapping_epoch":16,"log_start":"26'3900","ondisk_log_start":"26'3900","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3608,"log_dups_size":0,"ondisk_log_size":3608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:46:07.409922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":492044288,"num_objects":7508,"num_object_clones":0,"num_object_copies":15016,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7508,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7508,"num_write_kb":480512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":40,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.152266+0000","last_change":"2024-04-19T02:15:24.530933+0000","last_active":"2024-04-19T02:16:44.152266+0000","last_peered":"2024-04-19T02:16:44.152266+0000","last_clean":"2024-04-19T02:16:44.152266+0000","last_became_active":"2024-04-19T02:15:24.530550+0000","last_became_peered":"2024-04-19T02:15:24.530550+0000","last_unstale":"2024-04-19T02:16:44.152266+0000","last_undegraded":"2024-04-19T02:16:44.152266+0000","last_fullsized":"2024-04-19T02:16:44.152266+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:18:15.194321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.152276+0000","last_change":"2024-04-19T02:15:28.893062+0000","last_active":"2024-04-19T02:16:44.152276+0000","last_peered":"2024-04-19T02:16:44.152276+0000","last_clean":"2024-04-19T02:16:44.152276+0000","last_became_active":"2024-04-19T02:15:28.892798+0000","last_became_peered":"2024-04-19T02:15:28.892798+0000","last_unstale":"2024-04-19T02:16:44.152276+0000","last_undegraded":"2024-04-19T02:16:44.152276+0000","last_fullsized":"2024-04-19T02:16:44.152276+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:53.170180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.155115+0000","last_change":"2024-04-19T02:15:29.278294+0000","last_active":"2024-04-19T02:16:44.155115+0000","last_peered":"2024-04-19T02:16:44.155115+0000","last_clean":"2024-04-19T02:16:44.155115+0000","last_became_active":"2024-04-19T02:15:29.277536+0000","last_became_peered":"2024-04-19T02:15:29.277536+0000","last_unstale":"2024-04-19T02:16:44.155115+0000","last_undegraded":"2024-04-19T02:16:44.155115+0000","last_fullsized":"2024-04-19T02:16:44.155115+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"41'7557","reported_seq":7589,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.786134+0000","last_change":"2024-04-19T02:15:53.956251+0000","last_active":"2024-04-19T02:16:47.786134+0000","last_peered":"2024-04-19T02:16:47.786134+0000","last_clean":"2024-04-19T02:16:47.786134+0000","last_became_active":"2024-04-19T02:15:53.955886+0000","last_became_peered":"2024-04-19T02:15:53.955886+0000","last_unstale":"2024-04-19T02:16:47.786134+0000","last_undegraded":"2024-04-19T02:16:47.786134+0000","last_fullsized":"2024-04-19T02:16:47.786134+0000","mapping_epoch":16,"log_start":"26'3900","ondisk_log_start":"26'3900","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3657,"log_dups_size":0,"ondisk_log_size":3657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:38:38.586906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":495255552,"num_objects":7557,"num_object_clones":0,"num_object_copies":15114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7557,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7557,"num_write_kb":483648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.153110+0000","last_change":"2024-04-19T02:15:24.527048+0000","last_active":"2024-04-19T02:16:44.153110+0000","last_peered":"2024-04-19T02:16:44.153110+0000","last_clean":"2024-04-19T02:16:44.153110+0000","last_became_active":"2024-04-19T02:15:24.526790+0000","last_became_peered":"2024-04-19T02:15:24.526790+0000","last_unstale":"2024-04-19T02:16:44.153110+0000","last_undegraded":"2024-04-19T02:16:44.153110+0000","last_fullsized":"2024-04-19T02:16:44.153110+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.151403+0000","last_change":"2024-04-19T02:15:53.956945+0000","last_active":"2024-04-19T02:16:44.151403+0000","last_peered":"2024-04-19T02:16:44.151403+0000","last_clean":"2024-04-19T02:16:44.151403+0000","last_became_active":"2024-04-19T02:15:53.956719+0000","last_became_peered":"2024-04-19T02:15:53.956719+0000","last_unstale":"2024-04-19T02:16:44.151403+0000","last_undegraded":"2024-04-19T02:16:44.151403+0000","last_fullsized":"2024-04-19T02:16:44.151403+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:00:37.754624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.155803+0000","last_change":"2024-04-19T02:15:29.282663+0000","last_active":"2024-04-19T02:16:44.155803+0000","last_peered":"2024-04-19T02:16:44.155803+0000","last_clean":"2024-04-19T02:16:44.155803+0000","last_became_active":"2024-04-19T02:15:29.282217+0000","last_became_peered":"2024-04-19T02:15:29.282217+0000","last_unstale":"2024-04-19T02:16:44.155803+0000","last_undegraded":"2024-04-19T02:16:44.155803+0000","last_fullsized":"2024-04-19T02:16:44.155803+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"41'7430","reported_seq":7463,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.767972+0000","last_change":"2024-04-19T02:15:53.958264+0000","last_active":"2024-04-19T02:16:47.767972+0000","last_peered":"2024-04-19T02:16:47.767972+0000","last_clean":"2024-04-19T02:16:47.767972+0000","last_became_active":"2024-04-19T02:15:53.956689+0000","last_became_peered":"2024-04-19T02:15:53.956689+0000","last_unstale":"2024-04-19T02:16:47.767972+0000","last_undegraded":"2024-04-19T02:16:47.767972+0000","last_fullsized":"2024-04-19T02:16:47.767972+0000","mapping_epoch":16,"log_start":"25'3500","ondisk_log_start":"25'3500","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3930,"log_dups_size":0,"ondisk_log_size":3930,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:24:32.928594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":486932480,"num_objects":7430,"num_object_clones":0,"num_object_copies":14860,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7430,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7430,"num_write_kb":475520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":40,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.152274+0000","last_change":"2024-04-19T02:15:24.530924+0000","last_active":"2024-04-19T02:16:44.152274+0000","last_peered":"2024-04-19T02:16:44.152274+0000","last_clean":"2024-04-19T02:16:44.152274+0000","last_became_active":"2024-04-19T02:15:24.530551+0000","last_became_peered":"2024-04-19T02:15:24.530551+0000","last_unstale":"2024-04-19T02:16:44.152274+0000","last_undegraded":"2024-04-19T02:16:44.152274+0000","last_fullsized":"2024-04-19T02:16:44.152274+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:30.576946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":236,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.151579+0000","last_change":"2024-04-19T02:15:24.533634+0000","last_active":"2024-04-19T02:16:44.151579+0000","last_peered":"2024-04-19T02:16:44.151579+0000","last_clean":"2024-04-19T02:16:44.151579+0000","last_became_active":"2024-04-19T02:15:24.533420+0000","last_became_peered":"2024-04-19T02:15:24.533420+0000","last_unstale":"2024-04-19T02:16:44.151579+0000","last_undegraded":"2024-04-19T02:16:44.151579+0000","last_fullsized":"2024-04-19T02:16:44.151579+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.153335+0000","last_change":"2024-04-19T02:15:28.890244+0000","last_active":"2024-04-19T02:16:44.153335+0000","last_peered":"2024-04-19T02:16:44.153335+0000","last_clean":"2024-04-19T02:16:44.153335+0000","last_became_active":"2024-04-19T02:15:28.889831+0000","last_became_peered":"2024-04-19T02:15:28.889831+0000","last_unstale":"2024-04-19T02:16:44.153335+0000","last_undegraded":"2024-04-19T02:16:44.153335+0000","last_fullsized":"2024-04-19T02:16:44.153335+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.152480+0000","last_change":"2024-04-19T02:15:29.285015+0000","last_active":"2024-04-19T02:16:44.152480+0000","last_peered":"2024-04-19T02:16:44.152480+0000","last_clean":"2024-04-19T02:16:44.152480+0000","last_became_active":"2024-04-19T02:15:29.284164+0000","last_became_peered":"2024-04-19T02:15:29.284164+0000","last_unstale":"2024-04-19T02:16:44.152480+0000","last_undegraded":"2024-04-19T02:16:44.152480+0000","last_fullsized":"2024-04-19T02:16:44.152480+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:36.987844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"41'7496","reported_seq":7529,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.793685+0000","last_change":"2024-04-19T02:15:53.956463+0000","last_active":"2024-04-19T02:16:47.793685+0000","last_peered":"2024-04-19T02:16:47.793685+0000","last_clean":"2024-04-19T02:16:47.793685+0000","last_became_active":"2024-04-19T02:15:53.955819+0000","last_became_peered":"2024-04-19T02:15:53.955819+0000","last_unstale":"2024-04-19T02:16:47.793685+0000","last_undegraded":"2024-04-19T02:16:47.793685+0000","last_fullsized":"2024-04-19T02:16:47.793685+0000","mapping_epoch":16,"log_start":"26'3831","ondisk_log_start":"26'3831","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3665,"log_dups_size":0,"ondisk_log_size":3665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:46:07.409922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":491257856,"num_objects":7496,"num_object_clones":0,"num_object_copies":14992,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7496,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7496,"num_write_kb":479744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.151615+0000","last_change":"2024-04-19T02:15:24.533912+0000","last_active":"2024-04-19T02:16:44.151615+0000","last_peered":"2024-04-19T02:16:44.151615+0000","last_clean":"2024-04-19T02:16:44.151615+0000","last_became_active":"2024-04-19T02:15:24.533580+0000","last_became_peered":"2024-04-19T02:15:24.533580+0000","last_unstale":"2024-04-19T02:16:44.151615+0000","last_undegraded":"2024-04-19T02:16:44.151615+0000","last_fullsized":"2024-04-19T02:16:44.151615+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:45.045477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.153025+0000","last_change":"2024-04-19T02:15:28.891889+0000","last_active":"2024-04-19T02:16:44.153025+0000","last_peered":"2024-04-19T02:16:44.153025+0000","last_clean":"2024-04-19T02:16:44.153025+0000","last_became_active":"2024-04-19T02:15:28.890919+0000","last_became_peered":"2024-04-19T02:15:28.890919+0000","last_unstale":"2024-04-19T02:16:44.153025+0000","last_undegraded":"2024-04-19T02:16:44.153025+0000","last_fullsized":"2024-04-19T02:16:44.153025+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:35.412837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.155226+0000","last_change":"2024-04-19T02:15:53.957881+0000","last_active":"2024-04-19T02:16:44.155226+0000","last_peered":"2024-04-19T02:16:44.155226+0000","last_clean":"2024-04-19T02:16:44.155226+0000","last_became_active":"2024-04-19T02:15:53.957657+0000","last_became_peered":"2024-04-19T02:15:53.957657+0000","last_unstale":"2024-04-19T02:16:44.155226+0000","last_undegraded":"2024-04-19T02:16:44.155226+0000","last_fullsized":"2024-04-19T02:16:44.155226+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:46.921714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"41'7485","reported_seq":7518,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.797441+0000","last_change":"2024-04-19T02:15:53.955068+0000","last_active":"2024-04-19T02:16:47.797441+0000","last_peered":"2024-04-19T02:16:47.797441+0000","last_clean":"2024-04-19T02:16:47.797441+0000","last_became_active":"2024-04-19T02:15:53.954721+0000","last_became_peered":"2024-04-19T02:15:53.954721+0000","last_unstale":"2024-04-19T02:16:47.797441+0000","last_undegraded":"2024-04-19T02:16:47.797441+0000","last_fullsized":"2024-04-19T02:16:47.797441+0000","mapping_epoch":16,"log_start":"25'3800","ondisk_log_start":"25'3800","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3685,"log_dups_size":0,"ondisk_log_size":3685,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:18:29.742535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":490536960,"num_objects":7485,"num_object_clones":0,"num_object_copies":14970,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7485,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7485,"num_write_kb":479040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.155050+0000","last_change":"2024-04-19T02:15:53.959105+0000","last_active":"2024-04-19T02:16:44.155050+0000","last_peered":"2024-04-19T02:16:44.155050+0000","last_clean":"2024-04-19T02:16:44.155050+0000","last_became_active":"2024-04-19T02:15:53.958836+0000","last_became_peered":"2024-04-19T02:15:53.958836+0000","last_unstale":"2024-04-19T02:16:44.155050+0000","last_undegraded":"2024-04-19T02:16:44.155050+0000","last_fullsized":"2024-04-19T02:16:44.155050+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:18:00.321514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.155040+0000","last_change":"2024-04-19T02:15:28.892125+0000","last_active":"2024-04-19T02:16:44.155040+0000","last_peered":"2024-04-19T02:16:44.155040+0000","last_clean":"2024-04-19T02:16:44.155040+0000","last_became_active":"2024-04-19T02:15:28.891300+0000","last_became_peered":"2024-04-19T02:15:28.891300+0000","last_unstale":"2024-04-19T02:16:44.155040+0000","last_undegraded":"2024-04-19T02:16:44.155040+0000","last_fullsized":"2024-04-19T02:16:44.155040+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.160196+0000","last_change":"2024-04-19T02:15:29.281694+0000","last_active":"2024-04-19T02:16:44.160196+0000","last_peered":"2024-04-19T02:16:44.160196+0000","last_clean":"2024-04-19T02:16:44.160196+0000","last_became_active":"2024-04-19T02:15:29.280519+0000","last_became_peered":"2024-04-19T02:15:29.280519+0000","last_unstale":"2024-04-19T02:16:44.160196+0000","last_undegraded":"2024-04-19T02:16:44.160196+0000","last_fullsized":"2024-04-19T02:16:44.160196+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:50.890545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"41'7301","reported_seq":14893,"reported_epoch":41,"state":"active+remapped+backfilling","last_fresh":"2024-04-19T02:16:47.789897+0000","last_change":"2024-04-19T02:16:30.103016+0000","last_active":"2024-04-19T02:16:47.789897+0000","last_peered":"2024-04-19T02:16:47.789897+0000","last_clean":"2024-04-19T02:16:22.050311+0000","last_became_active":"2024-04-19T02:16:24.119992+0000","last_became_peered":"2024-04-19T02:16:24.119992+0000","last_unstale":"2024-04-19T02:16:47.789897+0000","last_undegraded":"2024-04-19T02:16:47.789897+0000","last_fullsized":"2024-04-19T02:16:47.789897+0000","mapping_epoch":29,"log_start":"25'3637","ondisk_log_start":"25'3637","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3664,"log_dups_size":0,"ondisk_log_size":3664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:28.663111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":478478336,"num_objects":7301,"num_object_clones":0,"num_object_copies":14602,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2459,"num_objects_unfound":0,"num_objects_dirty":7301,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7301,"num_write_kb":467264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3773,"num_bytes_recovered":247267328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[{"shards":"0,2","objects":7301}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":39,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.155690+0000","last_change":"2024-04-19T02:15:28.891702+0000","last_active":"2024-04-19T02:16:44.155690+0000","last_peered":"2024-04-19T02:16:44.155690+0000","last_clean":"2024-04-19T02:16:44.155690+0000","last_became_active":"2024-04-19T02:15:28.890743+0000","last_became_peered":"2024-04-19T02:15:28.890743+0000","last_unstale":"2024-04-19T02:16:44.155690+0000","last_undegraded":"2024-04-19T02:16:44.155690+0000","last_fullsized":"2024-04-19T02:16:44.155690+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":40,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.155433+0000","last_change":"2024-04-19T02:15:24.526845+0000","last_active":"2024-04-19T02:16:44.155433+0000","last_peered":"2024-04-19T02:16:44.155433+0000","last_clean":"2024-04-19T02:16:44.155433+0000","last_became_active":"2024-04-19T02:15:24.526500+0000","last_became_peered":"2024-04-19T02:15:24.526500+0000","last_unstale":"2024-04-19T02:16:44.155433+0000","last_undegraded":"2024-04-19T02:16:44.155433+0000","last_fullsized":"2024-04-19T02:16:44.155433+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:16.883355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.153131+0000","last_change":"2024-04-19T02:15:29.278686+0000","last_active":"2024-04-19T02:16:44.153131+0000","last_peered":"2024-04-19T02:16:44.153131+0000","last_clean":"2024-04-19T02:16:44.153131+0000","last_became_active":"2024-04-19T02:15:29.278108+0000","last_became_peered":"2024-04-19T02:15:29.278108+0000","last_unstale":"2024-04-19T02:16:44.153131+0000","last_undegraded":"2024-04-19T02:16:44.153131+0000","last_fullsized":"2024-04-19T02:16:44.153131+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:34.593754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"41'7305","reported_seq":7338,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.767756+0000","last_change":"2024-04-19T02:15:53.957269+0000","last_active":"2024-04-19T02:16:47.767756+0000","last_peered":"2024-04-19T02:16:47.767756+0000","last_clean":"2024-04-19T02:16:47.767756+0000","last_became_active":"2024-04-19T02:15:53.956554+0000","last_became_peered":"2024-04-19T02:15:53.956554+0000","last_unstale":"2024-04-19T02:16:47.767756+0000","last_undegraded":"2024-04-19T02:16:47.767756+0000","last_fullsized":"2024-04-19T02:16:47.767756+0000","mapping_epoch":16,"log_start":"25'3328","ondisk_log_start":"25'3328","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3977,"log_dups_size":0,"ondisk_log_size":3977,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:29:38.789719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":478740480,"num_objects":7305,"num_object_clones":0,"num_object_copies":14610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7305,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7305,"num_write_kb":467520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":40,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.152336+0000","last_change":"2024-04-19T02:15:24.533777+0000","last_active":"2024-04-19T02:16:44.152336+0000","last_peered":"2024-04-19T02:16:44.152336+0000","last_clean":"2024-04-19T02:16:44.152336+0000","last_became_active":"2024-04-19T02:15:24.533436+0000","last_became_peered":"2024-04-19T02:15:24.533436+0000","last_unstale":"2024-04-19T02:16:44.152336+0000","last_undegraded":"2024-04-19T02:16:44.152336+0000","last_fullsized":"2024-04-19T02:16:44.152336+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:53:25.922418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.155347+0000","last_change":"2024-04-19T02:15:28.891370+0000","last_active":"2024-04-19T02:16:44.155347+0000","last_peered":"2024-04-19T02:16:44.155347+0000","last_clean":"2024-04-19T02:16:44.155347+0000","last_became_active":"2024-04-19T02:15:28.890702+0000","last_became_peered":"2024-04-19T02:15:28.890702+0000","last_unstale":"2024-04-19T02:16:44.155347+0000","last_undegraded":"2024-04-19T02:16:44.155347+0000","last_fullsized":"2024-04-19T02:16:44.155347+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:33.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.159629+0000","last_change":"2024-04-19T02:15:29.282244+0000","last_active":"2024-04-19T02:16:44.159629+0000","last_peered":"2024-04-19T02:16:44.159629+0000","last_clean":"2024-04-19T02:16:44.159629+0000","last_became_active":"2024-04-19T02:15:29.280366+0000","last_became_peered":"2024-04-19T02:15:29.280366+0000","last_unstale":"2024-04-19T02:16:44.159629+0000","last_undegraded":"2024-04-19T02:16:44.159629+0000","last_fullsized":"2024-04-19T02:16:44.159629+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.159711+0000","last_change":"2024-04-19T02:15:28.893027+0000","last_active":"2024-04-19T02:16:44.159711+0000","last_peered":"2024-04-19T02:16:44.159711+0000","last_clean":"2024-04-19T02:16:44.159711+0000","last_became_active":"2024-04-19T02:15:28.892695+0000","last_became_peered":"2024-04-19T02:15:28.892695+0000","last_unstale":"2024-04-19T02:16:44.159711+0000","last_undegraded":"2024-04-19T02:16:44.159711+0000","last_fullsized":"2024-04-19T02:16:44.159711+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.161819+0000","last_change":"2024-04-19T02:15:29.283155+0000","last_active":"2024-04-19T02:16:44.161819+0000","last_peered":"2024-04-19T02:16:44.161819+0000","last_clean":"2024-04-19T02:16:44.161819+0000","last_became_active":"2024-04-19T02:15:29.281407+0000","last_became_peered":"2024-04-19T02:15:29.281407+0000","last_unstale":"2024-04-19T02:16:44.161819+0000","last_undegraded":"2024-04-19T02:16:44.161819+0000","last_fullsized":"2024-04-19T02:16:44.161819+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":39,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.152102+0000","last_change":"2024-04-19T02:15:28.893067+0000","last_active":"2024-04-19T02:16:44.152102+0000","last_peered":"2024-04-19T02:16:44.152102+0000","last_clean":"2024-04-19T02:16:44.152102+0000","last_became_active":"2024-04-19T02:15:28.892781+0000","last_became_peered":"2024-04-19T02:15:28.892781+0000","last_unstale":"2024-04-19T02:16:44.152102+0000","last_undegraded":"2024-04-19T02:16:44.152102+0000","last_fullsized":"2024-04-19T02:16:44.152102+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:54:15.590143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.152186+0000","last_change":"2024-04-19T02:15:29.281279+0000","last_active":"2024-04-19T02:16:44.152186+0000","last_peered":"2024-04-19T02:16:44.152186+0000","last_clean":"2024-04-19T02:16:44.152186+0000","last_became_active":"2024-04-19T02:15:29.279360+0000","last_became_peered":"2024-04-19T02:15:29.279360+0000","last_unstale":"2024-04-19T02:16:44.152186+0000","last_undegraded":"2024-04-19T02:16:44.152186+0000","last_fullsized":"2024-04-19T02:16:44.152186+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":39,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.162677+0000","last_change":"2024-04-19T02:15:28.893239+0000","last_active":"2024-04-19T02:16:44.162677+0000","last_peered":"2024-04-19T02:16:44.162677+0000","last_clean":"2024-04-19T02:16:44.162677+0000","last_became_active":"2024-04-19T02:15:28.892881+0000","last_became_peered":"2024-04-19T02:15:28.892881+0000","last_unstale":"2024-04-19T02:16:44.162677+0000","last_undegraded":"2024-04-19T02:16:44.162677+0000","last_fullsized":"2024-04-19T02:16:44.162677+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.152126+0000","last_change":"2024-04-19T02:15:29.281652+0000","last_active":"2024-04-19T02:16:44.152126+0000","last_peered":"2024-04-19T02:16:44.152126+0000","last_clean":"2024-04-19T02:16:44.152126+0000","last_became_active":"2024-04-19T02:15:29.281175+0000","last_became_peered":"2024-04-19T02:15:29.281175+0000","last_unstale":"2024-04-19T02:16:44.152126+0000","last_undegraded":"2024-04-19T02:16:44.152126+0000","last_fullsized":"2024-04-19T02:16:44.152126+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:16.568764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.155596+0000","last_change":"2024-04-19T02:15:28.892058+0000","last_active":"2024-04-19T02:16:44.155596+0000","last_peered":"2024-04-19T02:16:44.155596+0000","last_clean":"2024-04-19T02:16:44.155596+0000","last_became_active":"2024-04-19T02:15:28.890877+0000","last_became_peered":"2024-04-19T02:15:28.890877+0000","last_unstale":"2024-04-19T02:16:44.155596+0000","last_undegraded":"2024-04-19T02:16:44.155596+0000","last_fullsized":"2024-04-19T02:16:44.155596+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:53.170180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.159774+0000","last_change":"2024-04-19T02:15:29.278810+0000","last_active":"2024-04-19T02:16:44.159774+0000","last_peered":"2024-04-19T02:16:44.159774+0000","last_clean":"2024-04-19T02:16:44.159774+0000","last_became_active":"2024-04-19T02:15:29.277913+0000","last_became_peered":"2024-04-19T02:15:29.277913+0000","last_unstale":"2024-04-19T02:16:44.159774+0000","last_undegraded":"2024-04-19T02:16:44.159774+0000","last_fullsized":"2024-04-19T02:16:44.159774+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:24.082666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.155757+0000","last_change":"2024-04-19T02:15:28.889132+0000","last_active":"2024-04-19T02:16:44.155757+0000","last_peered":"2024-04-19T02:16:44.155757+0000","last_clean":"2024-04-19T02:16:44.155757+0000","last_became_active":"2024-04-19T02:15:28.888926+0000","last_became_peered":"2024-04-19T02:15:28.888926+0000","last_unstale":"2024-04-19T02:16:44.155757+0000","last_undegraded":"2024-04-19T02:16:44.155757+0000","last_fullsized":"2024-04-19T02:16:44.155757+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.151752+0000","last_change":"2024-04-19T02:15:29.282776+0000","last_active":"2024-04-19T02:16:44.151752+0000","last_peered":"2024-04-19T02:16:44.151752+0000","last_clean":"2024-04-19T02:16:44.151752+0000","last_became_active":"2024-04-19T02:15:29.279382+0000","last_became_peered":"2024-04-19T02:15:29.279382+0000","last_unstale":"2024-04-19T02:16:44.151752+0000","last_undegraded":"2024-04-19T02:16:44.151752+0000","last_fullsized":"2024-04-19T02:16:44.151752+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.151667+0000","last_change":"2024-04-19T02:15:29.283537+0000","last_active":"2024-04-19T02:16:44.151667+0000","last_peered":"2024-04-19T02:16:44.151667+0000","last_clean":"2024-04-19T02:16:44.151667+0000","last_became_active":"2024-04-19T02:15:29.281801+0000","last_became_peered":"2024-04-19T02:15:29.281801+0000","last_unstale":"2024-04-19T02:16:44.151667+0000","last_undegraded":"2024-04-19T02:16:44.151667+0000","last_fullsized":"2024-04-19T02:16:44.151667+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.153111+0000","last_change":"2024-04-19T02:15:29.281560+0000","last_active":"2024-04-19T02:16:44.153111+0000","last_peered":"2024-04-19T02:16:44.153111+0000","last_clean":"2024-04-19T02:16:44.153111+0000","last_became_active":"2024-04-19T02:15:29.281261+0000","last_became_peered":"2024-04-19T02:15:29.281261+0000","last_unstale":"2024-04-19T02:16:44.153111+0000","last_undegraded":"2024-04-19T02:16:44.153111+0000","last_fullsized":"2024-04-19T02:16:44.153111+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.151590+0000","last_change":"2024-04-19T02:15:53.955913+0000","last_active":"2024-04-19T02:16:44.151590+0000","last_peered":"2024-04-19T02:16:44.151590+0000","last_clean":"2024-04-19T02:16:44.151590+0000","last_became_active":"2024-04-19T02:15:53.955676+0000","last_became_peered":"2024-04-19T02:15:53.955676+0000","last_unstale":"2024-04-19T02:16:44.151590+0000","last_undegraded":"2024-04-19T02:16:44.151590+0000","last_fullsized":"2024-04-19T02:16:44.151590+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:53:02.899902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.155786+0000","last_change":"2024-04-19T02:15:29.278702+0000","last_active":"2024-04-19T02:16:44.155786+0000","last_peered":"2024-04-19T02:16:44.155786+0000","last_clean":"2024-04-19T02:16:44.155786+0000","last_became_active":"2024-04-19T02:15:29.277756+0000","last_became_peered":"2024-04-19T02:15:29.277756+0000","last_unstale":"2024-04-19T02:16:44.155786+0000","last_undegraded":"2024-04-19T02:16:44.155786+0000","last_fullsized":"2024-04-19T02:16:44.155786+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.161890+0000","last_change":"2024-04-19T02:15:29.277568+0000","last_active":"2024-04-19T02:16:44.161890+0000","last_peered":"2024-04-19T02:16:44.161890+0000","last_clean":"2024-04-19T02:16:44.161890+0000","last_became_active":"2024-04-19T02:15:29.276725+0000","last_became_peered":"2024-04-19T02:15:29.276725+0000","last_unstale":"2024-04-19T02:16:44.161890+0000","last_undegraded":"2024-04-19T02:16:44.161890+0000","last_fullsized":"2024-04-19T02:16:44.161890+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":7834763264,"num_objects":119549,"num_object_clones":0,"num_object_copies":239098,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2459,"num_objects_unfound":0,"num_objects_dirty":119549,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119549,"num_write_kb":7651136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3773,"num_bytes_recovered":247267328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15989342208,"data_stored":15989342208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":59848,"ondisk_log_size":59848,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738387,"num_pgs":84,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6340172,"kb_used_data":6146624,"kb_used_omap":1,"kb_used_meta":193534,"kb_avail":88031668,"statfs":{"total":96636764160,"available":90144428032,"internally_reserved":0,"allocated":6294142976,"data_stored":6293852480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":198179270},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,4,0,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.313,"15min":0.313},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.497,"5min":0.497,"15min":0.497},"last":0.216},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.17899999999999999}]},{"osd":1,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.253},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.20399999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738388,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4869416,"kb_used_data":4752156,"kb_used_omap":1,"kb_used_meta":117246,"kb_avail":89502424,"statfs":{"total":96636764160,"available":91650482176,"internally_reserved":0,"allocated":4866207744,"data_stored":4865890866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":120060358},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.19600000000000001},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.221}]},{"osd":2,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":2.1000000000000001,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":0.20899999999999999},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.23699999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738387,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4742624,"kb_used_data":4607316,"kb_used_omap":1,"kb_used_meta":135294,"kb_avail":89629216,"statfs":{"total":96636764160,"available":91780317184,"internally_reserved":0,"allocated":4717891584,"data_stored":4717582282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":138541510},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:16:26 2024","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.219},{"interface":"front","average":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"min":{"1min":0.16,"5min":0.16,"15min":0.16},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.224}]},{"osd":2,"last update":"Fri Apr 19 02:16:26 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.184}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4911923200,"data_stored":4911923200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4724097024,"data_stored":4724097024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6353321984,"data_stored":6353321984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:16:50.641 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-19T02:16:50.643 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:16:50.668 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:50.668+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:50.769 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:50.769+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:50.855 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:50.855 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:50.868 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:16:50.870 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:50.870+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:50.972 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:50.972+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:51.029 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 56 16 126075 126059 140.679 127.875 0.0077271 0.0071057 2024-04-19T02:16:51.057 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:51.057 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:51.071 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:51.071+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:51.073 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:16:51.105 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:16:51.105 INFO:teuthology.orchestra.run.smithi121.stdout:{"fsid":"f6ab5dd0-bb9f-4b48-a9fc-4728c7955ca8","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":96,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":42,"num_osds":3,"num_up_osds":3,"osd_up_since":1713492922,"num_in_osds":3,"osd_in_since":1713492915,"num_remapped_pgs":1},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":120},{"state_name":"active+remapped+backfilling","count":1}],"num_pgs":121,"num_pools":5,"num_objects":119573,"data_bytes":7835355994,"bytes_used":16335065088,"bytes_avail":273575227392,"bytes_total":289910292480,"misplaced_objects":2459,"misplaced_total":239146,"misplaced_ratio":0.010282421616920208,"recovering_objects_per_sec":201,"recovering_bytes_per_sec":13187701,"recovering_keys_per_sec":0,"num_objects_recovered":1533,"num_bytes_recovered":100466688,"num_keys_recovered":0,"write_bytes_sec":170502443,"read_op_per_sec":0,"write_op_per_sec":2601},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4230}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-04-19T02:16:34.750409+0000","services":{}},"progress_events":{}} 2024-04-19T02:16:51.120 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-04-19T02:16:51.120 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:16:51.174 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:51.174+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:51.275 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:51.276+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:51.302 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:51.303 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:51.317 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:16:51.403 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:51.404+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:51.473 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:16:51.475 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-04-19T02:16:51.477 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:51.477+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:51.485 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2024-04-19T02:16:50.752783+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":7835355994,"num_objects":119573,"num_object_clones":0,"num_object_copies":239146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2459,"num_objects_unfound":0,"num_objects_dirty":119573,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":119797,"num_write_kb":7654610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3773,"num_bytes_recovered":247267328,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60044,"ondisk_log_size":60044,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":243,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":15952212,"kb_used_data":15506096,"kb_used_omap":4,"kb_used_meta":446075,"kb_avail":267163308,"statfs":{"total":289910292480,"available":273575227392,"internally_reserved":0,"allocated":15878242304,"data_stored":15877325628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":456781138},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,4,0,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":654508032,"num_objects":9987,"num_object_clones":0,"num_object_copies":19974,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-523,"num_objects_unfound":0,"num_objects_dirty":9987,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9987,"num_write_kb":639168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":771,"num_bytes_recovered":50528256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.609192"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.162409+0000","last_change":"2024-04-19T02:15:29.280412+0000","last_active":"2024-04-19T02:16:44.162409+0000","last_peered":"2024-04-19T02:16:44.162409+0000","last_clean":"2024-04-19T02:16:44.162409+0000","last_became_active":"2024-04-19T02:15:29.278762+0000","last_became_peered":"2024-04-19T02:15:29.278762+0000","last_unstale":"2024-04-19T02:16:44.162409+0000","last_undegraded":"2024-04-19T02:16:44.162409+0000","last_fullsized":"2024-04-19T02:16:44.162409+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:45.301675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.164348+0000","last_change":"2024-04-19T02:15:29.284695+0000","last_active":"2024-04-19T02:16:44.164348+0000","last_peered":"2024-04-19T02:16:44.164348+0000","last_clean":"2024-04-19T02:16:44.164348+0000","last_became_active":"2024-04-19T02:15:29.283468+0000","last_became_peered":"2024-04-19T02:15:29.283468+0000","last_unstale":"2024-04-19T02:16:44.164348+0000","last_undegraded":"2024-04-19T02:16:44.164348+0000","last_fullsized":"2024-04-19T02:16:44.164348+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.384881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.152120+0000","last_change":"2024-04-19T02:15:29.286709+0000","last_active":"2024-04-19T02:16:44.152120+0000","last_peered":"2024-04-19T02:16:44.152120+0000","last_clean":"2024-04-19T02:16:44.152120+0000","last_became_active":"2024-04-19T02:15:29.286169+0000","last_became_peered":"2024-04-19T02:15:29.286169+0000","last_unstale":"2024-04-19T02:16:44.152120+0000","last_undegraded":"2024-04-19T02:16:44.152120+0000","last_fullsized":"2024-04-19T02:16:44.152120+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:58.741466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.152426+0000","last_change":"2024-04-19T02:15:29.280131+0000","last_active":"2024-04-19T02:16:44.152426+0000","last_peered":"2024-04-19T02:16:44.152426+0000","last_clean":"2024-04-19T02:16:44.152426+0000","last_became_active":"2024-04-19T02:15:29.279388+0000","last_became_peered":"2024-04-19T02:15:29.279388+0000","last_unstale":"2024-04-19T02:16:44.152426+0000","last_undegraded":"2024-04-19T02:16:44.152426+0000","last_fullsized":"2024-04-19T02:16:44.152426+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:36:48.819486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.155636+0000","last_change":"2024-04-19T02:15:53.955892+0000","last_active":"2024-04-19T02:16:44.155636+0000","last_peered":"2024-04-19T02:16:44.155636+0000","last_clean":"2024-04-19T02:16:44.155636+0000","last_became_active":"2024-04-19T02:15:53.955553+0000","last_became_peered":"2024-04-19T02:15:53.955553+0000","last_unstale":"2024-04-19T02:16:44.155636+0000","last_undegraded":"2024-04-19T02:16:44.155636+0000","last_fullsized":"2024-04-19T02:16:44.155636+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:45:39.791209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.151833+0000","last_change":"2024-04-19T02:15:29.283908+0000","last_active":"2024-04-19T02:16:44.151833+0000","last_peered":"2024-04-19T02:16:44.151833+0000","last_clean":"2024-04-19T02:16:44.151833+0000","last_became_active":"2024-04-19T02:15:29.281729+0000","last_became_peered":"2024-04-19T02:15:29.281729+0000","last_unstale":"2024-04-19T02:16:44.151833+0000","last_undegraded":"2024-04-19T02:16:44.151833+0000","last_fullsized":"2024-04-19T02:16:44.151833+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:03:15.383476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.151562+0000","last_change":"2024-04-19T02:15:29.281253+0000","last_active":"2024-04-19T02:16:44.151562+0000","last_peered":"2024-04-19T02:16:44.151562+0000","last_clean":"2024-04-19T02:16:44.151562+0000","last_became_active":"2024-04-19T02:15:29.279951+0000","last_became_peered":"2024-04-19T02:15:29.279951+0000","last_unstale":"2024-04-19T02:16:44.151562+0000","last_undegraded":"2024-04-19T02:16:44.151562+0000","last_fullsized":"2024-04-19T02:16:44.151562+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.151490+0000","last_change":"2024-04-19T02:15:29.283952+0000","last_active":"2024-04-19T02:16:44.151490+0000","last_peered":"2024-04-19T02:16:44.151490+0000","last_clean":"2024-04-19T02:16:44.151490+0000","last_became_active":"2024-04-19T02:15:29.282721+0000","last_became_peered":"2024-04-19T02:15:29.282721+0000","last_unstale":"2024-04-19T02:16:44.151490+0000","last_undegraded":"2024-04-19T02:16:44.151490+0000","last_fullsized":"2024-04-19T02:16:44.151490+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:45.301675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.155518+0000","last_change":"2024-04-19T02:15:29.282150+0000","last_active":"2024-04-19T02:16:44.155518+0000","last_peered":"2024-04-19T02:16:44.155518+0000","last_clean":"2024-04-19T02:16:44.155518+0000","last_became_active":"2024-04-19T02:15:29.281538+0000","last_became_peered":"2024-04-19T02:15:29.281538+0000","last_unstale":"2024-04-19T02:16:44.155518+0000","last_undegraded":"2024-04-19T02:16:44.155518+0000","last_fullsized":"2024-04-19T02:16:44.155518+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.151931+0000","last_change":"2024-04-19T02:16:30.093524+0000","last_active":"2024-04-19T02:16:44.151931+0000","last_peered":"2024-04-19T02:16:44.151931+0000","last_clean":"2024-04-19T02:16:44.151931+0000","last_became_active":"2024-04-19T02:16:30.093344+0000","last_became_peered":"2024-04-19T02:16:30.093344+0000","last_unstale":"2024-04-19T02:16:44.151931+0000","last_undegraded":"2024-04-19T02:16:44.151931+0000","last_fullsized":"2024-04-19T02:16:44.151931+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:14:40.293159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.152023+0000","last_change":"2024-04-19T02:15:29.280606+0000","last_active":"2024-04-19T02:16:44.152023+0000","last_peered":"2024-04-19T02:16:44.152023+0000","last_clean":"2024-04-19T02:16:44.152023+0000","last_became_active":"2024-04-19T02:15:29.280151+0000","last_became_peered":"2024-04-19T02:15:29.280151+0000","last_unstale":"2024-04-19T02:16:44.152023+0000","last_undegraded":"2024-04-19T02:16:44.152023+0000","last_fullsized":"2024-04-19T02:16:44.152023+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:26:22.452488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.152030+0000","last_change":"2024-04-19T02:15:53.958876+0000","last_active":"2024-04-19T02:16:44.152030+0000","last_peered":"2024-04-19T02:16:44.152030+0000","last_clean":"2024-04-19T02:16:44.152030+0000","last_became_active":"2024-04-19T02:15:53.958626+0000","last_became_peered":"2024-04-19T02:15:53.958626+0000","last_unstale":"2024-04-19T02:16:44.152030+0000","last_undegraded":"2024-04-19T02:16:44.152030+0000","last_fullsized":"2024-04-19T02:16:44.152030+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:23:57.044018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.155441+0000","last_change":"2024-04-19T02:15:53.956801+0000","last_active":"2024-04-19T02:16:44.155441+0000","last_peered":"2024-04-19T02:16:44.155441+0000","last_clean":"2024-04-19T02:16:44.155441+0000","last_became_active":"2024-04-19T02:15:53.956620+0000","last_became_peered":"2024-04-19T02:15:53.956620+0000","last_unstale":"2024-04-19T02:16:44.155441+0000","last_undegraded":"2024-04-19T02:16:44.155441+0000","last_fullsized":"2024-04-19T02:16:44.155441+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:57:05.843101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.152276+0000","last_change":"2024-04-19T02:15:29.284262+0000","last_active":"2024-04-19T02:16:44.152276+0000","last_peered":"2024-04-19T02:16:44.152276+0000","last_clean":"2024-04-19T02:16:44.152276+0000","last_became_active":"2024-04-19T02:15:29.283121+0000","last_became_peered":"2024-04-19T02:15:29.283121+0000","last_unstale":"2024-04-19T02:16:44.152276+0000","last_undegraded":"2024-04-19T02:16:44.152276+0000","last_fullsized":"2024-04-19T02:16:44.152276+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.151647+0000","last_change":"2024-04-19T02:15:29.285139+0000","last_active":"2024-04-19T02:16:44.151647+0000","last_peered":"2024-04-19T02:16:44.151647+0000","last_clean":"2024-04-19T02:16:44.151647+0000","last_became_active":"2024-04-19T02:15:29.284649+0000","last_became_peered":"2024-04-19T02:15:29.284649+0000","last_unstale":"2024-04-19T02:16:44.151647+0000","last_undegraded":"2024-04-19T02:16:44.151647+0000","last_fullsized":"2024-04-19T02:16:44.151647+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.151526+0000","last_change":"2024-04-19T02:15:29.283648+0000","last_active":"2024-04-19T02:16:44.151526+0000","last_peered":"2024-04-19T02:16:44.151526+0000","last_clean":"2024-04-19T02:16:44.151526+0000","last_became_active":"2024-04-19T02:15:29.281606+0000","last_became_peered":"2024-04-19T02:15:29.281606+0000","last_unstale":"2024-04-19T02:16:44.151526+0000","last_undegraded":"2024-04-19T02:16:44.151526+0000","last_fullsized":"2024-04-19T02:16:44.151526+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.155603+0000","last_change":"2024-04-19T02:15:29.278673+0000","last_active":"2024-04-19T02:16:44.155603+0000","last_peered":"2024-04-19T02:16:44.155603+0000","last_clean":"2024-04-19T02:16:44.155603+0000","last_became_active":"2024-04-19T02:15:29.277699+0000","last_became_peered":"2024-04-19T02:15:29.277699+0000","last_unstale":"2024-04-19T02:16:44.155603+0000","last_undegraded":"2024-04-19T02:16:44.155603+0000","last_fullsized":"2024-04-19T02:16:44.155603+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.164538+0000","last_change":"2024-04-19T02:15:29.283341+0000","last_active":"2024-04-19T02:16:44.164538+0000","last_peered":"2024-04-19T02:16:44.164538+0000","last_clean":"2024-04-19T02:16:44.164538+0000","last_became_active":"2024-04-19T02:15:29.281591+0000","last_became_peered":"2024-04-19T02:15:29.281591+0000","last_unstale":"2024-04-19T02:16:44.164538+0000","last_undegraded":"2024-04-19T02:16:44.164538+0000","last_fullsized":"2024-04-19T02:16:44.164538+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:34.593754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.155128+0000","last_change":"2024-04-19T02:15:29.282110+0000","last_active":"2024-04-19T02:16:44.155128+0000","last_peered":"2024-04-19T02:16:44.155128+0000","last_clean":"2024-04-19T02:16:44.155128+0000","last_became_active":"2024-04-19T02:15:29.281716+0000","last_became_peered":"2024-04-19T02:15:29.281716+0000","last_unstale":"2024-04-19T02:16:44.155128+0000","last_undegraded":"2024-04-19T02:16:44.155128+0000","last_fullsized":"2024-04-19T02:16:44.155128+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.152358+0000","last_change":"2024-04-19T02:15:29.285237+0000","last_active":"2024-04-19T02:16:44.152358+0000","last_peered":"2024-04-19T02:16:44.152358+0000","last_clean":"2024-04-19T02:16:44.152358+0000","last_became_active":"2024-04-19T02:15:29.282790+0000","last_became_peered":"2024-04-19T02:15:29.282790+0000","last_unstale":"2024-04-19T02:16:44.152358+0000","last_undegraded":"2024-04-19T02:16:44.152358+0000","last_fullsized":"2024-04-19T02:16:44.152358+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.151907+0000","last_change":"2024-04-19T02:15:29.282609+0000","last_active":"2024-04-19T02:16:44.151907+0000","last_peered":"2024-04-19T02:16:44.151907+0000","last_clean":"2024-04-19T02:16:44.151907+0000","last_became_active":"2024-04-19T02:15:29.281665+0000","last_became_peered":"2024-04-19T02:15:29.281665+0000","last_unstale":"2024-04-19T02:16:44.151907+0000","last_undegraded":"2024-04-19T02:16:44.151907+0000","last_fullsized":"2024-04-19T02:16:44.151907+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.384881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.151685+0000","last_change":"2024-04-19T02:15:53.955813+0000","last_active":"2024-04-19T02:16:44.151685+0000","last_peered":"2024-04-19T02:16:44.151685+0000","last_clean":"2024-04-19T02:16:44.151685+0000","last_became_active":"2024-04-19T02:15:53.955614+0000","last_became_peered":"2024-04-19T02:15:53.955614+0000","last_unstale":"2024-04-19T02:16:44.151685+0000","last_undegraded":"2024-04-19T02:16:44.151685+0000","last_fullsized":"2024-04-19T02:16:44.151685+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:58:03.192647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.153208+0000","last_change":"2024-04-19T02:15:29.277109+0000","last_active":"2024-04-19T02:16:44.153208+0000","last_peered":"2024-04-19T02:16:44.153208+0000","last_clean":"2024-04-19T02:16:44.153208+0000","last_became_active":"2024-04-19T02:15:29.275417+0000","last_became_peered":"2024-04-19T02:15:29.275417+0000","last_unstale":"2024-04-19T02:16:44.153208+0000","last_undegraded":"2024-04-19T02:16:44.153208+0000","last_fullsized":"2024-04-19T02:16:44.153208+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.159661+0000","last_change":"2024-04-19T02:15:29.283266+0000","last_active":"2024-04-19T02:16:44.159661+0000","last_peered":"2024-04-19T02:16:44.159661+0000","last_clean":"2024-04-19T02:16:44.159661+0000","last_became_active":"2024-04-19T02:15:29.281505+0000","last_became_peered":"2024-04-19T02:15:29.281505+0000","last_unstale":"2024-04-19T02:16:44.159661+0000","last_undegraded":"2024-04-19T02:16:44.159661+0000","last_fullsized":"2024-04-19T02:16:44.159661+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.162391+0000","last_change":"2024-04-19T02:15:29.278084+0000","last_active":"2024-04-19T02:16:44.162391+0000","last_peered":"2024-04-19T02:16:44.162391+0000","last_clean":"2024-04-19T02:16:44.162391+0000","last_became_active":"2024-04-19T02:15:29.276952+0000","last_became_peered":"2024-04-19T02:15:29.276952+0000","last_unstale":"2024-04-19T02:16:44.162391+0000","last_undegraded":"2024-04-19T02:16:44.162391+0000","last_fullsized":"2024-04-19T02:16:44.162391+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.155687+0000","last_change":"2024-04-19T02:15:29.279904+0000","last_active":"2024-04-19T02:16:44.155687+0000","last_peered":"2024-04-19T02:16:44.155687+0000","last_clean":"2024-04-19T02:16:44.155687+0000","last_became_active":"2024-04-19T02:15:29.278938+0000","last_became_peered":"2024-04-19T02:15:29.278938+0000","last_unstale":"2024-04-19T02:16:44.155687+0000","last_undegraded":"2024-04-19T02:16:44.155687+0000","last_fullsized":"2024-04-19T02:16:44.155687+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.152044+0000","last_change":"2024-04-19T02:15:29.287389+0000","last_active":"2024-04-19T02:16:44.152044+0000","last_peered":"2024-04-19T02:16:44.152044+0000","last_clean":"2024-04-19T02:16:44.152044+0000","last_became_active":"2024-04-19T02:15:29.286431+0000","last_became_peered":"2024-04-19T02:15:29.286431+0000","last_unstale":"2024-04-19T02:16:44.152044+0000","last_undegraded":"2024-04-19T02:16:44.152044+0000","last_fullsized":"2024-04-19T02:16:44.152044+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:58:30.117887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.153503+0000","last_change":"2024-04-19T02:15:53.959207+0000","last_active":"2024-04-19T02:16:44.153503+0000","last_peered":"2024-04-19T02:16:44.153503+0000","last_clean":"2024-04-19T02:16:44.153503+0000","last_became_active":"2024-04-19T02:15:53.959007+0000","last_became_peered":"2024-04-19T02:15:53.959007+0000","last_unstale":"2024-04-19T02:16:44.153503+0000","last_undegraded":"2024-04-19T02:16:44.153503+0000","last_fullsized":"2024-04-19T02:16:44.153503+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:08:21.065077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.165124+0000","last_change":"2024-04-19T02:15:29.281792+0000","last_active":"2024-04-19T02:16:44.165124+0000","last_peered":"2024-04-19T02:16:44.165124+0000","last_clean":"2024-04-19T02:16:44.165124+0000","last_became_active":"2024-04-19T02:15:29.280479+0000","last_became_peered":"2024-04-19T02:15:29.280479+0000","last_unstale":"2024-04-19T02:16:44.165124+0000","last_undegraded":"2024-04-19T02:16:44.165124+0000","last_fullsized":"2024-04-19T02:16:44.165124+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.153218+0000","last_change":"2024-04-19T02:15:28.888778+0000","last_active":"2024-04-19T02:16:44.153218+0000","last_peered":"2024-04-19T02:16:44.153218+0000","last_clean":"2024-04-19T02:16:44.153218+0000","last_became_active":"2024-04-19T02:15:28.888543+0000","last_became_peered":"2024-04-19T02:15:28.888543+0000","last_unstale":"2024-04-19T02:16:44.153218+0000","last_undegraded":"2024-04-19T02:16:44.153218+0000","last_fullsized":"2024-04-19T02:16:44.153218+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:43:51.221619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.155355+0000","last_change":"2024-04-19T02:15:29.279986+0000","last_active":"2024-04-19T02:16:44.155355+0000","last_peered":"2024-04-19T02:16:44.155355+0000","last_clean":"2024-04-19T02:16:44.155355+0000","last_became_active":"2024-04-19T02:15:29.279690+0000","last_became_peered":"2024-04-19T02:15:29.279690+0000","last_unstale":"2024-04-19T02:16:44.155355+0000","last_undegraded":"2024-04-19T02:16:44.155355+0000","last_fullsized":"2024-04-19T02:16:44.155355+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.153228+0000","last_change":"2024-04-19T02:15:28.890463+0000","last_active":"2024-04-19T02:16:44.153228+0000","last_peered":"2024-04-19T02:16:44.153228+0000","last_clean":"2024-04-19T02:16:44.153228+0000","last_became_active":"2024-04-19T02:15:28.889777+0000","last_became_peered":"2024-04-19T02:15:28.889777+0000","last_unstale":"2024-04-19T02:16:44.153228+0000","last_undegraded":"2024-04-19T02:16:44.153228+0000","last_fullsized":"2024-04-19T02:16:44.153228+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:58:21.520250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.162304+0000","last_change":"2024-04-19T02:15:29.280879+0000","last_active":"2024-04-19T02:16:44.162304+0000","last_peered":"2024-04-19T02:16:44.162304+0000","last_clean":"2024-04-19T02:16:44.162304+0000","last_became_active":"2024-04-19T02:15:29.279314+0000","last_became_peered":"2024-04-19T02:15:29.279314+0000","last_unstale":"2024-04-19T02:16:44.162304+0000","last_undegraded":"2024-04-19T02:16:44.162304+0000","last_fullsized":"2024-04-19T02:16:44.162304+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.155778+0000","last_change":"2024-04-19T02:15:28.891867+0000","last_active":"2024-04-19T02:16:44.155778+0000","last_peered":"2024-04-19T02:16:44.155778+0000","last_clean":"2024-04-19T02:16:44.155778+0000","last_became_active":"2024-04-19T02:15:28.890806+0000","last_became_peered":"2024-04-19T02:15:28.890806+0000","last_unstale":"2024-04-19T02:16:44.155778+0000","last_undegraded":"2024-04-19T02:16:44.155778+0000","last_fullsized":"2024-04-19T02:16:44.155778+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:57.946581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.153131+0000","last_change":"2024-04-19T02:15:29.278148+0000","last_active":"2024-04-19T02:16:44.153131+0000","last_peered":"2024-04-19T02:16:44.153131+0000","last_clean":"2024-04-19T02:16:44.153131+0000","last_became_active":"2024-04-19T02:15:29.277402+0000","last_became_peered":"2024-04-19T02:15:29.277402+0000","last_unstale":"2024-04-19T02:16:44.153131+0000","last_undegraded":"2024-04-19T02:16:44.153131+0000","last_fullsized":"2024-04-19T02:16:44.153131+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.152140+0000","last_change":"2024-04-19T02:15:28.892905+0000","last_active":"2024-04-19T02:16:44.152140+0000","last_peered":"2024-04-19T02:16:44.152140+0000","last_clean":"2024-04-19T02:16:44.152140+0000","last_became_active":"2024-04-19T02:15:28.892541+0000","last_became_peered":"2024-04-19T02:15:28.892541+0000","last_unstale":"2024-04-19T02:16:44.152140+0000","last_undegraded":"2024-04-19T02:16:44.152140+0000","last_fullsized":"2024-04-19T02:16:44.152140+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:33.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.153307+0000","last_change":"2024-04-19T02:15:29.278810+0000","last_active":"2024-04-19T02:16:44.153307+0000","last_peered":"2024-04-19T02:16:44.153307+0000","last_clean":"2024-04-19T02:16:44.153307+0000","last_became_active":"2024-04-19T02:15:29.278093+0000","last_became_peered":"2024-04-19T02:15:29.278093+0000","last_unstale":"2024-04-19T02:16:44.153307+0000","last_undegraded":"2024-04-19T02:16:44.153307+0000","last_fullsized":"2024-04-19T02:16:44.153307+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:34.883207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":40,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.162486+0000","last_change":"2024-04-19T02:15:28.892937+0000","last_active":"2024-04-19T02:16:44.162486+0000","last_peered":"2024-04-19T02:16:44.162486+0000","last_clean":"2024-04-19T02:16:44.162486+0000","last_became_active":"2024-04-19T02:15:28.891440+0000","last_became_peered":"2024-04-19T02:15:28.891440+0000","last_unstale":"2024-04-19T02:16:44.162486+0000","last_undegraded":"2024-04-19T02:16:44.162486+0000","last_fullsized":"2024-04-19T02:16:44.162486+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.153412+0000","last_change":"2024-04-19T02:15:29.278404+0000","last_active":"2024-04-19T02:16:44.153412+0000","last_peered":"2024-04-19T02:16:44.153412+0000","last_clean":"2024-04-19T02:16:44.153412+0000","last_became_active":"2024-04-19T02:15:29.277460+0000","last_became_peered":"2024-04-19T02:15:29.277460+0000","last_unstale":"2024-04-19T02:16:44.153412+0000","last_undegraded":"2024-04-19T02:16:44.153412+0000","last_fullsized":"2024-04-19T02:16:44.153412+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":43,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.152195+0000","last_change":"2024-04-19T02:15:28.891097+0000","last_active":"2024-04-19T02:16:44.152195+0000","last_peered":"2024-04-19T02:16:44.152195+0000","last_clean":"2024-04-19T02:16:44.152195+0000","last_became_active":"2024-04-19T02:15:28.890795+0000","last_became_peered":"2024-04-19T02:15:28.890795+0000","last_unstale":"2024-04-19T02:16:44.152195+0000","last_undegraded":"2024-04-19T02:16:44.152195+0000","last_fullsized":"2024-04-19T02:16:44.152195+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.152427+0000","last_change":"2024-04-19T02:15:29.278546+0000","last_active":"2024-04-19T02:16:44.152427+0000","last_peered":"2024-04-19T02:16:44.152427+0000","last_clean":"2024-04-19T02:16:44.152427+0000","last_became_active":"2024-04-19T02:15:29.277547+0000","last_became_peered":"2024-04-19T02:15:29.277547+0000","last_unstale":"2024-04-19T02:16:44.152427+0000","last_undegraded":"2024-04-19T02:16:44.152427+0000","last_fullsized":"2024-04-19T02:16:44.152427+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":39,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.152344+0000","last_change":"2024-04-19T02:15:28.892977+0000","last_active":"2024-04-19T02:16:44.152344+0000","last_peered":"2024-04-19T02:16:44.152344+0000","last_clean":"2024-04-19T02:16:44.152344+0000","last_became_active":"2024-04-19T02:15:28.892636+0000","last_became_peered":"2024-04-19T02:15:28.892636+0000","last_unstale":"2024-04-19T02:16:44.152344+0000","last_undegraded":"2024-04-19T02:16:44.152344+0000","last_fullsized":"2024-04-19T02:16:44.152344+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:43:51.221619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.153231+0000","last_change":"2024-04-19T02:15:53.955655+0000","last_active":"2024-04-19T02:16:44.153231+0000","last_peered":"2024-04-19T02:16:44.153231+0000","last_clean":"2024-04-19T02:16:44.153231+0000","last_became_active":"2024-04-19T02:15:53.955382+0000","last_became_peered":"2024-04-19T02:15:53.955382+0000","last_unstale":"2024-04-19T02:16:44.153231+0000","last_undegraded":"2024-04-19T02:16:44.153231+0000","last_fullsized":"2024-04-19T02:16:44.153231+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:48.239260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.153495+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:16:44.153495+0000","last_peered":"2024-04-19T02:16:44.153495+0000","last_clean":"2024-04-19T02:16:44.153495+0000","last_became_active":"2024-04-19T02:15:28.890751+0000","last_became_peered":"2024-04-19T02:15:28.890751+0000","last_unstale":"2024-04-19T02:16:44.153495+0000","last_undegraded":"2024-04-19T02:16:44.153495+0000","last_fullsized":"2024-04-19T02:16:44.153495+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.154959+0000","last_change":"2024-04-19T02:15:53.957865+0000","last_active":"2024-04-19T02:16:44.154959+0000","last_peered":"2024-04-19T02:16:44.154959+0000","last_clean":"2024-04-19T02:16:44.154959+0000","last_became_active":"2024-04-19T02:15:53.957627+0000","last_became_peered":"2024-04-19T02:15:53.957627+0000","last_unstale":"2024-04-19T02:16:44.154959+0000","last_undegraded":"2024-04-19T02:16:44.154959+0000","last_fullsized":"2024-04-19T02:16:44.154959+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:16:45.799016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.159554+0000","last_change":"2024-04-19T02:15:28.892934+0000","last_active":"2024-04-19T02:16:44.159554+0000","last_peered":"2024-04-19T02:16:44.159554+0000","last_clean":"2024-04-19T02:16:44.159554+0000","last_became_active":"2024-04-19T02:15:28.891879+0000","last_became_peered":"2024-04-19T02:15:28.891879+0000","last_unstale":"2024-04-19T02:16:44.159554+0000","last_undegraded":"2024-04-19T02:16:44.159554+0000","last_fullsized":"2024-04-19T02:16:44.159554+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:10:12.514798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.155511+0000","last_change":"2024-04-19T02:15:29.279685+0000","last_active":"2024-04-19T02:16:44.155511+0000","last_peered":"2024-04-19T02:16:44.155511+0000","last_clean":"2024-04-19T02:16:44.155511+0000","last_became_active":"2024-04-19T02:15:29.278810+0000","last_became_peered":"2024-04-19T02:15:29.278810+0000","last_unstale":"2024-04-19T02:16:44.155511+0000","last_undegraded":"2024-04-19T02:16:44.155511+0000","last_fullsized":"2024-04-19T02:16:44.155511+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.151705+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:16:44.151705+0000","last_peered":"2024-04-19T02:16:44.151705+0000","last_clean":"2024-04-19T02:16:44.151705+0000","last_became_active":"2024-04-19T02:15:28.890882+0000","last_became_peered":"2024-04-19T02:15:28.890882+0000","last_unstale":"2024-04-19T02:16:44.151705+0000","last_undegraded":"2024-04-19T02:16:44.151705+0000","last_fullsized":"2024-04-19T02:16:44.151705+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:31.673938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.155851+0000","last_change":"2024-04-19T02:15:29.284258+0000","last_active":"2024-04-19T02:16:44.155851+0000","last_peered":"2024-04-19T02:16:44.155851+0000","last_clean":"2024-04-19T02:16:44.155851+0000","last_became_active":"2024-04-19T02:15:29.283995+0000","last_became_peered":"2024-04-19T02:15:29.283995+0000","last_unstale":"2024-04-19T02:16:44.155851+0000","last_undegraded":"2024-04-19T02:16:44.155851+0000","last_fullsized":"2024-04-19T02:16:44.155851+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:35.941308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"41'7607","reported_seq":7640,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.793252+0000","last_change":"2024-04-19T02:15:53.956977+0000","last_active":"2024-04-19T02:16:47.793252+0000","last_peered":"2024-04-19T02:16:47.793252+0000","last_clean":"2024-04-19T02:16:47.793252+0000","last_became_active":"2024-04-19T02:15:53.956730+0000","last_became_peered":"2024-04-19T02:15:53.956730+0000","last_unstale":"2024-04-19T02:16:47.793252+0000","last_undegraded":"2024-04-19T02:16:47.793252+0000","last_fullsized":"2024-04-19T02:16:47.793252+0000","mapping_epoch":16,"log_start":"26'3900","ondisk_log_start":"26'3900","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3707,"log_dups_size":0,"ondisk_log_size":3707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:56:46.323499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":498532352,"num_objects":7607,"num_object_clones":0,"num_object_copies":15214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7607,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7607,"num_write_kb":486848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.152275+0000","last_change":"2024-04-19T02:15:28.890265+0000","last_active":"2024-04-19T02:16:44.152275+0000","last_peered":"2024-04-19T02:16:44.152275+0000","last_clean":"2024-04-19T02:16:44.152275+0000","last_became_active":"2024-04-19T02:15:28.890004+0000","last_became_peered":"2024-04-19T02:15:28.890004+0000","last_unstale":"2024-04-19T02:16:44.152275+0000","last_undegraded":"2024-04-19T02:16:44.152275+0000","last_fullsized":"2024-04-19T02:16:44.152275+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:02.517101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.159402+0000","last_change":"2024-04-19T02:15:29.285529+0000","last_active":"2024-04-19T02:16:44.159402+0000","last_peered":"2024-04-19T02:16:44.159402+0000","last_clean":"2024-04-19T02:16:44.159402+0000","last_became_active":"2024-04-19T02:15:29.285197+0000","last_became_peered":"2024-04-19T02:15:29.285197+0000","last_unstale":"2024-04-19T02:16:44.159402+0000","last_undegraded":"2024-04-19T02:16:44.159402+0000","last_fullsized":"2024-04-19T02:16:44.159402+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"41'7556","reported_seq":7589,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.757058+0000","last_change":"2024-04-19T02:15:53.958523+0000","last_active":"2024-04-19T02:16:47.757058+0000","last_peered":"2024-04-19T02:16:47.757058+0000","last_clean":"2024-04-19T02:16:47.757058+0000","last_became_active":"2024-04-19T02:15:53.957627+0000","last_became_peered":"2024-04-19T02:15:53.957627+0000","last_unstale":"2024-04-19T02:16:47.757058+0000","last_undegraded":"2024-04-19T02:16:47.757058+0000","last_fullsized":"2024-04-19T02:16:47.757058+0000","mapping_epoch":16,"log_start":"25'3647","ondisk_log_start":"25'3647","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3909,"log_dups_size":0,"ondisk_log_size":3909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:59:55.120296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":495190016,"num_objects":7556,"num_object_clones":0,"num_object_copies":15112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7556,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7556,"num_write_kb":483584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":39,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.164337+0000","last_change":"2024-04-19T02:15:28.893902+0000","last_active":"2024-04-19T02:16:44.164337+0000","last_peered":"2024-04-19T02:16:44.164337+0000","last_clean":"2024-04-19T02:16:44.164337+0000","last_became_active":"2024-04-19T02:15:28.893231+0000","last_became_peered":"2024-04-19T02:15:28.893231+0000","last_unstale":"2024-04-19T02:16:44.164337+0000","last_undegraded":"2024-04-19T02:16:44.164337+0000","last_fullsized":"2024-04-19T02:16:44.164337+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:23.658442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.159674+0000","last_change":"2024-04-19T02:15:29.282874+0000","last_active":"2024-04-19T02:16:44.159674+0000","last_peered":"2024-04-19T02:16:44.159674+0000","last_clean":"2024-04-19T02:16:44.159674+0000","last_became_active":"2024-04-19T02:15:29.281675+0000","last_became_peered":"2024-04-19T02:15:29.281675+0000","last_unstale":"2024-04-19T02:16:44.159674+0000","last_undegraded":"2024-04-19T02:16:44.159674+0000","last_fullsized":"2024-04-19T02:16:44.159674+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:35.941308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"41'7409","reported_seq":7441,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.769815+0000","last_change":"2024-04-19T02:15:53.958324+0000","last_active":"2024-04-19T02:16:47.769815+0000","last_peered":"2024-04-19T02:16:47.769815+0000","last_clean":"2024-04-19T02:16:47.769815+0000","last_became_active":"2024-04-19T02:15:53.957392+0000","last_became_peered":"2024-04-19T02:15:53.957392+0000","last_unstale":"2024-04-19T02:16:47.769815+0000","last_undegraded":"2024-04-19T02:16:47.769815+0000","last_fullsized":"2024-04-19T02:16:47.769815+0000","mapping_epoch":16,"log_start":"25'3500","ondisk_log_start":"25'3500","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3909,"log_dups_size":0,"ondisk_log_size":3909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:12:58.132969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":485556224,"num_objects":7409,"num_object_clones":0,"num_object_copies":14818,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7409,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7409,"num_write_kb":474176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.152108+0000","last_change":"2024-04-19T02:15:28.891234+0000","last_active":"2024-04-19T02:16:44.152108+0000","last_peered":"2024-04-19T02:16:44.152108+0000","last_clean":"2024-04-19T02:16:44.152108+0000","last_became_active":"2024-04-19T02:15:28.890881+0000","last_became_peered":"2024-04-19T02:15:28.890881+0000","last_unstale":"2024-04-19T02:16:44.152108+0000","last_undegraded":"2024-04-19T02:16:44.152108+0000","last_fullsized":"2024-04-19T02:16:44.152108+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.152176+0000","last_change":"2024-04-19T02:15:29.281937+0000","last_active":"2024-04-19T02:16:44.152176+0000","last_peered":"2024-04-19T02:16:44.152176+0000","last_clean":"2024-04-19T02:16:44.152176+0000","last_became_active":"2024-04-19T02:15:29.280727+0000","last_became_peered":"2024-04-19T02:15:29.280727+0000","last_unstale":"2024-04-19T02:16:44.152176+0000","last_undegraded":"2024-04-19T02:16:44.152176+0000","last_fullsized":"2024-04-19T02:16:44.152176+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"41'7588","reported_seq":7621,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.778345+0000","last_change":"2024-04-19T02:15:53.959099+0000","last_active":"2024-04-19T02:16:47.778345+0000","last_peered":"2024-04-19T02:16:47.778345+0000","last_clean":"2024-04-19T02:16:47.778345+0000","last_became_active":"2024-04-19T02:15:53.958885+0000","last_became_peered":"2024-04-19T02:15:53.958885+0000","last_unstale":"2024-04-19T02:16:47.778345+0000","last_undegraded":"2024-04-19T02:16:47.778345+0000","last_fullsized":"2024-04-19T02:16:47.778345+0000","mapping_epoch":16,"log_start":"26'4000","ondisk_log_start":"26'4000","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3588,"log_dups_size":0,"ondisk_log_size":3588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:53:26.969927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":497287168,"num_objects":7588,"num_object_clones":0,"num_object_copies":15176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7588,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7588,"num_write_kb":485632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.151945+0000","last_change":"2024-04-19T02:15:28.892767+0000","last_active":"2024-04-19T02:16:44.151945+0000","last_peered":"2024-04-19T02:16:44.151945+0000","last_clean":"2024-04-19T02:16:44.151945+0000","last_became_active":"2024-04-19T02:15:28.892235+0000","last_became_peered":"2024-04-19T02:15:28.892235+0000","last_unstale":"2024-04-19T02:16:44.151945+0000","last_undegraded":"2024-04-19T02:16:44.151945+0000","last_fullsized":"2024-04-19T02:16:44.151945+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:37.690735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.155768+0000","last_change":"2024-04-19T02:15:29.279857+0000","last_active":"2024-04-19T02:16:44.155768+0000","last_peered":"2024-04-19T02:16:44.155768+0000","last_clean":"2024-04-19T02:16:44.155768+0000","last_became_active":"2024-04-19T02:15:29.279536+0000","last_became_peered":"2024-04-19T02:15:29.279536+0000","last_unstale":"2024-04-19T02:16:44.155768+0000","last_undegraded":"2024-04-19T02:16:44.155768+0000","last_fullsized":"2024-04-19T02:16:44.155768+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:00.191179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"41'7504","reported_seq":7537,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.806195+0000","last_change":"2024-04-19T02:15:53.957261+0000","last_active":"2024-04-19T02:16:47.806195+0000","last_peered":"2024-04-19T02:16:47.806195+0000","last_clean":"2024-04-19T02:16:47.806195+0000","last_became_active":"2024-04-19T02:15:53.957092+0000","last_became_peered":"2024-04-19T02:15:53.957092+0000","last_unstale":"2024-04-19T02:16:47.806195+0000","last_undegraded":"2024-04-19T02:16:47.806195+0000","last_fullsized":"2024-04-19T02:16:47.806195+0000","mapping_epoch":16,"log_start":"26'3813","ondisk_log_start":"26'3813","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3691,"log_dups_size":0,"ondisk_log_size":3691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:54:15.544923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":491782144,"num_objects":7504,"num_object_clones":0,"num_object_copies":15008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7504,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7504,"num_write_kb":480256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":39,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.155714+0000","last_change":"2024-04-19T02:15:28.891611+0000","last_active":"2024-04-19T02:16:44.155714+0000","last_peered":"2024-04-19T02:16:44.155714+0000","last_clean":"2024-04-19T02:16:44.155714+0000","last_became_active":"2024-04-19T02:15:28.890914+0000","last_became_peered":"2024-04-19T02:15:28.890914+0000","last_unstale":"2024-04-19T02:16:44.155714+0000","last_undegraded":"2024-04-19T02:16:44.155714+0000","last_fullsized":"2024-04-19T02:16:44.155714+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:37.690735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.152450+0000","last_change":"2024-04-19T02:15:29.285774+0000","last_active":"2024-04-19T02:16:44.152450+0000","last_peered":"2024-04-19T02:16:44.152450+0000","last_clean":"2024-04-19T02:16:44.152450+0000","last_became_active":"2024-04-19T02:15:29.284705+0000","last_became_peered":"2024-04-19T02:15:29.284705+0000","last_unstale":"2024-04-19T02:16:44.152450+0000","last_undegraded":"2024-04-19T02:16:44.152450+0000","last_fullsized":"2024-04-19T02:16:44.152450+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"41'7472","reported_seq":7505,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.775437+0000","last_change":"2024-04-19T02:15:53.955286+0000","last_active":"2024-04-19T02:16:47.775437+0000","last_peered":"2024-04-19T02:16:47.775437+0000","last_clean":"2024-04-19T02:16:47.775437+0000","last_became_active":"2024-04-19T02:15:53.955026+0000","last_became_peered":"2024-04-19T02:15:53.955026+0000","last_unstale":"2024-04-19T02:16:47.775437+0000","last_undegraded":"2024-04-19T02:16:47.775437+0000","last_fullsized":"2024-04-19T02:16:47.775437+0000","mapping_epoch":16,"log_start":"26'3900","ondisk_log_start":"26'3900","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3572,"log_dups_size":0,"ondisk_log_size":3572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:05:48.594301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":489684992,"num_objects":7472,"num_object_clones":0,"num_object_copies":14944,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7472,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7472,"num_write_kb":478208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.151927+0000","last_change":"2024-04-19T02:15:28.892873+0000","last_active":"2024-04-19T02:16:44.151927+0000","last_peered":"2024-04-19T02:16:44.151927+0000","last_clean":"2024-04-19T02:16:44.151927+0000","last_became_active":"2024-04-19T02:15:28.892487+0000","last_became_peered":"2024-04-19T02:15:28.892487+0000","last_unstale":"2024-04-19T02:16:44.151927+0000","last_undegraded":"2024-04-19T02:16:44.151927+0000","last_fullsized":"2024-04-19T02:16:44.151927+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:35.412837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.152278+0000","last_change":"2024-04-19T02:15:29.285019+0000","last_active":"2024-04-19T02:16:44.152278+0000","last_peered":"2024-04-19T02:16:44.152278+0000","last_clean":"2024-04-19T02:16:44.152278+0000","last_became_active":"2024-04-19T02:15:29.284650+0000","last_became_peered":"2024-04-19T02:15:29.284650+0000","last_unstale":"2024-04-19T02:16:44.152278+0000","last_undegraded":"2024-04-19T02:16:44.152278+0000","last_fullsized":"2024-04-19T02:16:44.152278+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"41'7523","reported_seq":7556,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.799060+0000","last_change":"2024-04-19T02:15:53.957403+0000","last_active":"2024-04-19T02:16:47.799060+0000","last_peered":"2024-04-19T02:16:47.799060+0000","last_clean":"2024-04-19T02:16:47.799060+0000","last_became_active":"2024-04-19T02:15:53.957190+0000","last_became_peered":"2024-04-19T02:15:53.957190+0000","last_unstale":"2024-04-19T02:16:47.799060+0000","last_undegraded":"2024-04-19T02:16:47.799060+0000","last_fullsized":"2024-04-19T02:16:47.799060+0000","mapping_epoch":16,"log_start":"25'3801","ondisk_log_start":"25'3801","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3722,"log_dups_size":0,"ondisk_log_size":3722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:07:12.817884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493027328,"num_objects":7523,"num_object_clones":0,"num_object_copies":15046,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7523,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7523,"num_write_kb":481472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.151550+0000","last_change":"2024-04-19T02:15:53.956839+0000","last_active":"2024-04-19T02:16:44.151550+0000","last_peered":"2024-04-19T02:16:44.151550+0000","last_clean":"2024-04-19T02:16:44.151550+0000","last_became_active":"2024-04-19T02:15:53.956630+0000","last_became_peered":"2024-04-19T02:15:53.956630+0000","last_unstale":"2024-04-19T02:16:44.151550+0000","last_undegraded":"2024-04-19T02:16:44.151550+0000","last_fullsized":"2024-04-19T02:16:44.151550+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:47.229730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.152237+0000","last_change":"2024-04-19T02:15:29.287190+0000","last_active":"2024-04-19T02:16:44.152237+0000","last_peered":"2024-04-19T02:16:44.152237+0000","last_clean":"2024-04-19T02:16:44.152237+0000","last_became_active":"2024-04-19T02:15:29.286606+0000","last_became_peered":"2024-04-19T02:15:29.286606+0000","last_unstale":"2024-04-19T02:16:44.152237+0000","last_undegraded":"2024-04-19T02:16:44.152237+0000","last_fullsized":"2024-04-19T02:16:44.152237+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:28.387062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"41'7333","reported_seq":7366,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.743113+0000","last_change":"2024-04-19T02:15:53.958448+0000","last_active":"2024-04-19T02:16:47.743113+0000","last_peered":"2024-04-19T02:16:47.743113+0000","last_clean":"2024-04-19T02:16:47.743113+0000","last_became_active":"2024-04-19T02:15:53.957595+0000","last_became_peered":"2024-04-19T02:15:53.957595+0000","last_unstale":"2024-04-19T02:16:47.743113+0000","last_undegraded":"2024-04-19T02:16:47.743113+0000","last_fullsized":"2024-04-19T02:16:47.743113+0000","mapping_epoch":16,"log_start":"24'3344","ondisk_log_start":"24'3344","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3989,"log_dups_size":0,"ondisk_log_size":3989,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:26:31.855319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":480575488,"num_objects":7333,"num_object_clones":0,"num_object_copies":14666,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7333,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7333,"num_write_kb":469312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.159576+0000","last_change":"2024-04-19T02:15:28.894121+0000","last_active":"2024-04-19T02:16:44.159576+0000","last_peered":"2024-04-19T02:16:44.159576+0000","last_clean":"2024-04-19T02:16:44.159576+0000","last_became_active":"2024-04-19T02:15:28.893902+0000","last_became_peered":"2024-04-19T02:15:28.893902+0000","last_unstale":"2024-04-19T02:16:44.159576+0000","last_undegraded":"2024-04-19T02:16:44.159576+0000","last_fullsized":"2024-04-19T02:16:44.159576+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:10:35.146583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.155680+0000","last_change":"2024-04-19T02:15:29.282870+0000","last_active":"2024-04-19T02:16:44.155680+0000","last_peered":"2024-04-19T02:16:44.155680+0000","last_clean":"2024-04-19T02:16:44.155680+0000","last_became_active":"2024-04-19T02:15:29.281873+0000","last_became_peered":"2024-04-19T02:15:29.281873+0000","last_unstale":"2024-04-19T02:16:44.155680+0000","last_undegraded":"2024-04-19T02:16:44.155680+0000","last_fullsized":"2024-04-19T02:16:44.155680+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"41'7475","reported_seq":7508,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.760357+0000","last_change":"2024-04-19T02:15:53.955498+0000","last_active":"2024-04-19T02:16:47.760357+0000","last_peered":"2024-04-19T02:16:47.760357+0000","last_clean":"2024-04-19T02:16:47.760357+0000","last_became_active":"2024-04-19T02:15:53.954910+0000","last_became_peered":"2024-04-19T02:15:53.954910+0000","last_unstale":"2024-04-19T02:16:47.760357+0000","last_undegraded":"2024-04-19T02:16:47.760357+0000","last_fullsized":"2024-04-19T02:16:47.760357+0000","mapping_epoch":16,"log_start":"26'3900","ondisk_log_start":"26'3900","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3575,"log_dups_size":0,"ondisk_log_size":3575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:58:27.262672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":489881600,"num_objects":7475,"num_object_clones":0,"num_object_copies":14950,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7475,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7475,"num_write_kb":478400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.155249+0000","last_change":"2024-04-19T02:15:24.527061+0000","last_active":"2024-04-19T02:16:44.155249+0000","last_peered":"2024-04-19T02:16:44.155249+0000","last_clean":"2024-04-19T02:16:44.155249+0000","last_became_active":"2024-04-19T02:15:24.526757+0000","last_became_peered":"2024-04-19T02:15:24.526757+0000","last_unstale":"2024-04-19T02:16:44.155249+0000","last_undegraded":"2024-04-19T02:16:44.155249+0000","last_fullsized":"2024-04-19T02:16:44.155249+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:17:13.649077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.152199+0000","last_change":"2024-04-19T02:15:28.892766+0000","last_active":"2024-04-19T02:16:44.152199+0000","last_peered":"2024-04-19T02:16:44.152199+0000","last_clean":"2024-04-19T02:16:44.152199+0000","last_became_active":"2024-04-19T02:15:28.892396+0000","last_became_peered":"2024-04-19T02:15:28.892396+0000","last_unstale":"2024-04-19T02:16:44.152199+0000","last_undegraded":"2024-04-19T02:16:44.152199+0000","last_fullsized":"2024-04-19T02:16:44.152199+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:57.946581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.161376+0000","last_change":"2024-04-19T02:15:29.277922+0000","last_active":"2024-04-19T02:16:44.161376+0000","last_peered":"2024-04-19T02:16:44.161376+0000","last_clean":"2024-04-19T02:16:44.161376+0000","last_became_active":"2024-04-19T02:15:29.276968+0000","last_became_peered":"2024-04-19T02:15:29.276968+0000","last_unstale":"2024-04-19T02:16:44.161376+0000","last_undegraded":"2024-04-19T02:16:44.161376+0000","last_fullsized":"2024-04-19T02:16:44.161376+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"41'7508","reported_seq":7541,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.763145+0000","last_change":"2024-04-19T02:15:53.955228+0000","last_active":"2024-04-19T02:16:47.763145+0000","last_peered":"2024-04-19T02:16:47.763145+0000","last_clean":"2024-04-19T02:16:47.763145+0000","last_became_active":"2024-04-19T02:15:53.954960+0000","last_became_peered":"2024-04-19T02:15:53.954960+0000","last_unstale":"2024-04-19T02:16:47.763145+0000","last_undegraded":"2024-04-19T02:16:47.763145+0000","last_fullsized":"2024-04-19T02:16:47.763145+0000","mapping_epoch":16,"log_start":"26'3900","ondisk_log_start":"26'3900","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3608,"log_dups_size":0,"ondisk_log_size":3608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:46:07.409922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":492044288,"num_objects":7508,"num_object_clones":0,"num_object_copies":15016,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7508,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7508,"num_write_kb":480512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":40,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.152266+0000","last_change":"2024-04-19T02:15:24.530933+0000","last_active":"2024-04-19T02:16:44.152266+0000","last_peered":"2024-04-19T02:16:44.152266+0000","last_clean":"2024-04-19T02:16:44.152266+0000","last_became_active":"2024-04-19T02:15:24.530550+0000","last_became_peered":"2024-04-19T02:15:24.530550+0000","last_unstale":"2024-04-19T02:16:44.152266+0000","last_undegraded":"2024-04-19T02:16:44.152266+0000","last_fullsized":"2024-04-19T02:16:44.152266+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:18:15.194321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.152276+0000","last_change":"2024-04-19T02:15:28.893062+0000","last_active":"2024-04-19T02:16:44.152276+0000","last_peered":"2024-04-19T02:16:44.152276+0000","last_clean":"2024-04-19T02:16:44.152276+0000","last_became_active":"2024-04-19T02:15:28.892798+0000","last_became_peered":"2024-04-19T02:15:28.892798+0000","last_unstale":"2024-04-19T02:16:44.152276+0000","last_undegraded":"2024-04-19T02:16:44.152276+0000","last_fullsized":"2024-04-19T02:16:44.152276+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:53.170180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.155115+0000","last_change":"2024-04-19T02:15:29.278294+0000","last_active":"2024-04-19T02:16:44.155115+0000","last_peered":"2024-04-19T02:16:44.155115+0000","last_clean":"2024-04-19T02:16:44.155115+0000","last_became_active":"2024-04-19T02:15:29.277536+0000","last_became_peered":"2024-04-19T02:15:29.277536+0000","last_unstale":"2024-04-19T02:16:44.155115+0000","last_undegraded":"2024-04-19T02:16:44.155115+0000","last_fullsized":"2024-04-19T02:16:44.155115+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"41'7557","reported_seq":7589,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.786134+0000","last_change":"2024-04-19T02:15:53.956251+0000","last_active":"2024-04-19T02:16:47.786134+0000","last_peered":"2024-04-19T02:16:47.786134+0000","last_clean":"2024-04-19T02:16:47.786134+0000","last_became_active":"2024-04-19T02:15:53.955886+0000","last_became_peered":"2024-04-19T02:15:53.955886+0000","last_unstale":"2024-04-19T02:16:47.786134+0000","last_undegraded":"2024-04-19T02:16:47.786134+0000","last_fullsized":"2024-04-19T02:16:47.786134+0000","mapping_epoch":16,"log_start":"26'3900","ondisk_log_start":"26'3900","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3657,"log_dups_size":0,"ondisk_log_size":3657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:38:38.586906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":495255552,"num_objects":7557,"num_object_clones":0,"num_object_copies":15114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7557,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7557,"num_write_kb":483648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.153110+0000","last_change":"2024-04-19T02:15:24.527048+0000","last_active":"2024-04-19T02:16:44.153110+0000","last_peered":"2024-04-19T02:16:44.153110+0000","last_clean":"2024-04-19T02:16:44.153110+0000","last_became_active":"2024-04-19T02:15:24.526790+0000","last_became_peered":"2024-04-19T02:15:24.526790+0000","last_unstale":"2024-04-19T02:16:44.153110+0000","last_undegraded":"2024-04-19T02:16:44.153110+0000","last_fullsized":"2024-04-19T02:16:44.153110+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.151403+0000","last_change":"2024-04-19T02:15:53.956945+0000","last_active":"2024-04-19T02:16:44.151403+0000","last_peered":"2024-04-19T02:16:44.151403+0000","last_clean":"2024-04-19T02:16:44.151403+0000","last_became_active":"2024-04-19T02:15:53.956719+0000","last_became_peered":"2024-04-19T02:15:53.956719+0000","last_unstale":"2024-04-19T02:16:44.151403+0000","last_undegraded":"2024-04-19T02:16:44.151403+0000","last_fullsized":"2024-04-19T02:16:44.151403+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:00:37.754624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.155803+0000","last_change":"2024-04-19T02:15:29.282663+0000","last_active":"2024-04-19T02:16:44.155803+0000","last_peered":"2024-04-19T02:16:44.155803+0000","last_clean":"2024-04-19T02:16:44.155803+0000","last_became_active":"2024-04-19T02:15:29.282217+0000","last_became_peered":"2024-04-19T02:15:29.282217+0000","last_unstale":"2024-04-19T02:16:44.155803+0000","last_undegraded":"2024-04-19T02:16:44.155803+0000","last_fullsized":"2024-04-19T02:16:44.155803+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"41'7430","reported_seq":7463,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.767972+0000","last_change":"2024-04-19T02:15:53.958264+0000","last_active":"2024-04-19T02:16:47.767972+0000","last_peered":"2024-04-19T02:16:47.767972+0000","last_clean":"2024-04-19T02:16:47.767972+0000","last_became_active":"2024-04-19T02:15:53.956689+0000","last_became_peered":"2024-04-19T02:15:53.956689+0000","last_unstale":"2024-04-19T02:16:47.767972+0000","last_undegraded":"2024-04-19T02:16:47.767972+0000","last_fullsized":"2024-04-19T02:16:47.767972+0000","mapping_epoch":16,"log_start":"25'3500","ondisk_log_start":"25'3500","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3930,"log_dups_size":0,"ondisk_log_size":3930,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:24:32.928594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":486932480,"num_objects":7430,"num_object_clones":0,"num_object_copies":14860,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7430,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7430,"num_write_kb":475520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":40,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.152274+0000","last_change":"2024-04-19T02:15:24.530924+0000","last_active":"2024-04-19T02:16:44.152274+0000","last_peered":"2024-04-19T02:16:44.152274+0000","last_clean":"2024-04-19T02:16:44.152274+0000","last_became_active":"2024-04-19T02:15:24.530551+0000","last_became_peered":"2024-04-19T02:15:24.530551+0000","last_unstale":"2024-04-19T02:16:44.152274+0000","last_undegraded":"2024-04-19T02:16:44.152274+0000","last_fullsized":"2024-04-19T02:16:44.152274+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:30.576946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":236,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.151579+0000","last_change":"2024-04-19T02:15:24.533634+0000","last_active":"2024-04-19T02:16:44.151579+0000","last_peered":"2024-04-19T02:16:44.151579+0000","last_clean":"2024-04-19T02:16:44.151579+0000","last_became_active":"2024-04-19T02:15:24.533420+0000","last_became_peered":"2024-04-19T02:15:24.533420+0000","last_unstale":"2024-04-19T02:16:44.151579+0000","last_undegraded":"2024-04-19T02:16:44.151579+0000","last_fullsized":"2024-04-19T02:16:44.151579+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.153335+0000","last_change":"2024-04-19T02:15:28.890244+0000","last_active":"2024-04-19T02:16:44.153335+0000","last_peered":"2024-04-19T02:16:44.153335+0000","last_clean":"2024-04-19T02:16:44.153335+0000","last_became_active":"2024-04-19T02:15:28.889831+0000","last_became_peered":"2024-04-19T02:15:28.889831+0000","last_unstale":"2024-04-19T02:16:44.153335+0000","last_undegraded":"2024-04-19T02:16:44.153335+0000","last_fullsized":"2024-04-19T02:16:44.153335+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.152480+0000","last_change":"2024-04-19T02:15:29.285015+0000","last_active":"2024-04-19T02:16:44.152480+0000","last_peered":"2024-04-19T02:16:44.152480+0000","last_clean":"2024-04-19T02:16:44.152480+0000","last_became_active":"2024-04-19T02:15:29.284164+0000","last_became_peered":"2024-04-19T02:15:29.284164+0000","last_unstale":"2024-04-19T02:16:44.152480+0000","last_undegraded":"2024-04-19T02:16:44.152480+0000","last_fullsized":"2024-04-19T02:16:44.152480+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:36.987844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"41'7496","reported_seq":7529,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.793685+0000","last_change":"2024-04-19T02:15:53.956463+0000","last_active":"2024-04-19T02:16:47.793685+0000","last_peered":"2024-04-19T02:16:47.793685+0000","last_clean":"2024-04-19T02:16:47.793685+0000","last_became_active":"2024-04-19T02:15:53.955819+0000","last_became_peered":"2024-04-19T02:15:53.955819+0000","last_unstale":"2024-04-19T02:16:47.793685+0000","last_undegraded":"2024-04-19T02:16:47.793685+0000","last_fullsized":"2024-04-19T02:16:47.793685+0000","mapping_epoch":16,"log_start":"26'3831","ondisk_log_start":"26'3831","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3665,"log_dups_size":0,"ondisk_log_size":3665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:46:07.409922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":491257856,"num_objects":7496,"num_object_clones":0,"num_object_copies":14992,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7496,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7496,"num_write_kb":479744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.151615+0000","last_change":"2024-04-19T02:15:24.533912+0000","last_active":"2024-04-19T02:16:44.151615+0000","last_peered":"2024-04-19T02:16:44.151615+0000","last_clean":"2024-04-19T02:16:44.151615+0000","last_became_active":"2024-04-19T02:15:24.533580+0000","last_became_peered":"2024-04-19T02:15:24.533580+0000","last_unstale":"2024-04-19T02:16:44.151615+0000","last_undegraded":"2024-04-19T02:16:44.151615+0000","last_fullsized":"2024-04-19T02:16:44.151615+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:45.045477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.153025+0000","last_change":"2024-04-19T02:15:28.891889+0000","last_active":"2024-04-19T02:16:44.153025+0000","last_peered":"2024-04-19T02:16:44.153025+0000","last_clean":"2024-04-19T02:16:44.153025+0000","last_became_active":"2024-04-19T02:15:28.890919+0000","last_became_peered":"2024-04-19T02:15:28.890919+0000","last_unstale":"2024-04-19T02:16:44.153025+0000","last_undegraded":"2024-04-19T02:16:44.153025+0000","last_fullsized":"2024-04-19T02:16:44.153025+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:35.412837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.155226+0000","last_change":"2024-04-19T02:15:53.957881+0000","last_active":"2024-04-19T02:16:44.155226+0000","last_peered":"2024-04-19T02:16:44.155226+0000","last_clean":"2024-04-19T02:16:44.155226+0000","last_became_active":"2024-04-19T02:15:53.957657+0000","last_became_peered":"2024-04-19T02:15:53.957657+0000","last_unstale":"2024-04-19T02:16:44.155226+0000","last_undegraded":"2024-04-19T02:16:44.155226+0000","last_fullsized":"2024-04-19T02:16:44.155226+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:46.921714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"41'7485","reported_seq":7518,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.797441+0000","last_change":"2024-04-19T02:15:53.955068+0000","last_active":"2024-04-19T02:16:47.797441+0000","last_peered":"2024-04-19T02:16:47.797441+0000","last_clean":"2024-04-19T02:16:47.797441+0000","last_became_active":"2024-04-19T02:15:53.954721+0000","last_became_peered":"2024-04-19T02:15:53.954721+0000","last_unstale":"2024-04-19T02:16:47.797441+0000","last_undegraded":"2024-04-19T02:16:47.797441+0000","last_fullsized":"2024-04-19T02:16:47.797441+0000","mapping_epoch":16,"log_start":"25'3800","ondisk_log_start":"25'3800","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3685,"log_dups_size":0,"ondisk_log_size":3685,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:18:29.742535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":490536960,"num_objects":7485,"num_object_clones":0,"num_object_copies":14970,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7485,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7485,"num_write_kb":479040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.155050+0000","last_change":"2024-04-19T02:15:53.959105+0000","last_active":"2024-04-19T02:16:44.155050+0000","last_peered":"2024-04-19T02:16:44.155050+0000","last_clean":"2024-04-19T02:16:44.155050+0000","last_became_active":"2024-04-19T02:15:53.958836+0000","last_became_peered":"2024-04-19T02:15:53.958836+0000","last_unstale":"2024-04-19T02:16:44.155050+0000","last_undegraded":"2024-04-19T02:16:44.155050+0000","last_fullsized":"2024-04-19T02:16:44.155050+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:18:00.321514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.155040+0000","last_change":"2024-04-19T02:15:28.892125+0000","last_active":"2024-04-19T02:16:44.155040+0000","last_peered":"2024-04-19T02:16:44.155040+0000","last_clean":"2024-04-19T02:16:44.155040+0000","last_became_active":"2024-04-19T02:15:28.891300+0000","last_became_peered":"2024-04-19T02:15:28.891300+0000","last_unstale":"2024-04-19T02:16:44.155040+0000","last_undegraded":"2024-04-19T02:16:44.155040+0000","last_fullsized":"2024-04-19T02:16:44.155040+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.160196+0000","last_change":"2024-04-19T02:15:29.281694+0000","last_active":"2024-04-19T02:16:44.160196+0000","last_peered":"2024-04-19T02:16:44.160196+0000","last_clean":"2024-04-19T02:16:44.160196+0000","last_became_active":"2024-04-19T02:15:29.280519+0000","last_became_peered":"2024-04-19T02:15:29.280519+0000","last_unstale":"2024-04-19T02:16:44.160196+0000","last_undegraded":"2024-04-19T02:16:44.160196+0000","last_fullsized":"2024-04-19T02:16:44.160196+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:50.890545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"41'7301","reported_seq":14893,"reported_epoch":41,"state":"active+remapped+backfilling","last_fresh":"2024-04-19T02:16:47.789897+0000","last_change":"2024-04-19T02:16:30.103016+0000","last_active":"2024-04-19T02:16:47.789897+0000","last_peered":"2024-04-19T02:16:47.789897+0000","last_clean":"2024-04-19T02:16:22.050311+0000","last_became_active":"2024-04-19T02:16:24.119992+0000","last_became_peered":"2024-04-19T02:16:24.119992+0000","last_unstale":"2024-04-19T02:16:47.789897+0000","last_undegraded":"2024-04-19T02:16:47.789897+0000","last_fullsized":"2024-04-19T02:16:47.789897+0000","mapping_epoch":29,"log_start":"25'3637","ondisk_log_start":"25'3637","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3664,"log_dups_size":0,"ondisk_log_size":3664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:28.663111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":478478336,"num_objects":7301,"num_object_clones":0,"num_object_copies":14602,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2459,"num_objects_unfound":0,"num_objects_dirty":7301,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7301,"num_write_kb":467264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3773,"num_bytes_recovered":247267328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[{"shards":"0,2","objects":7301}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":39,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.155690+0000","last_change":"2024-04-19T02:15:28.891702+0000","last_active":"2024-04-19T02:16:44.155690+0000","last_peered":"2024-04-19T02:16:44.155690+0000","last_clean":"2024-04-19T02:16:44.155690+0000","last_became_active":"2024-04-19T02:15:28.890743+0000","last_became_peered":"2024-04-19T02:15:28.890743+0000","last_unstale":"2024-04-19T02:16:44.155690+0000","last_undegraded":"2024-04-19T02:16:44.155690+0000","last_fullsized":"2024-04-19T02:16:44.155690+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":40,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.155433+0000","last_change":"2024-04-19T02:15:24.526845+0000","last_active":"2024-04-19T02:16:44.155433+0000","last_peered":"2024-04-19T02:16:44.155433+0000","last_clean":"2024-04-19T02:16:44.155433+0000","last_became_active":"2024-04-19T02:15:24.526500+0000","last_became_peered":"2024-04-19T02:15:24.526500+0000","last_unstale":"2024-04-19T02:16:44.155433+0000","last_undegraded":"2024-04-19T02:16:44.155433+0000","last_fullsized":"2024-04-19T02:16:44.155433+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:16.883355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.153131+0000","last_change":"2024-04-19T02:15:29.278686+0000","last_active":"2024-04-19T02:16:44.153131+0000","last_peered":"2024-04-19T02:16:44.153131+0000","last_clean":"2024-04-19T02:16:44.153131+0000","last_became_active":"2024-04-19T02:15:29.278108+0000","last_became_peered":"2024-04-19T02:15:29.278108+0000","last_unstale":"2024-04-19T02:16:44.153131+0000","last_undegraded":"2024-04-19T02:16:44.153131+0000","last_fullsized":"2024-04-19T02:16:44.153131+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:34.593754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"41'7305","reported_seq":7338,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.767756+0000","last_change":"2024-04-19T02:15:53.957269+0000","last_active":"2024-04-19T02:16:47.767756+0000","last_peered":"2024-04-19T02:16:47.767756+0000","last_clean":"2024-04-19T02:16:47.767756+0000","last_became_active":"2024-04-19T02:15:53.956554+0000","last_became_peered":"2024-04-19T02:15:53.956554+0000","last_unstale":"2024-04-19T02:16:47.767756+0000","last_undegraded":"2024-04-19T02:16:47.767756+0000","last_fullsized":"2024-04-19T02:16:47.767756+0000","mapping_epoch":16,"log_start":"25'3328","ondisk_log_start":"25'3328","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3977,"log_dups_size":0,"ondisk_log_size":3977,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:29:38.789719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":478740480,"num_objects":7305,"num_object_clones":0,"num_object_copies":14610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7305,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7305,"num_write_kb":467520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":40,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.152336+0000","last_change":"2024-04-19T02:15:24.533777+0000","last_active":"2024-04-19T02:16:44.152336+0000","last_peered":"2024-04-19T02:16:44.152336+0000","last_clean":"2024-04-19T02:16:44.152336+0000","last_became_active":"2024-04-19T02:15:24.533436+0000","last_became_peered":"2024-04-19T02:15:24.533436+0000","last_unstale":"2024-04-19T02:16:44.152336+0000","last_undegraded":"2024-04-19T02:16:44.152336+0000","last_fullsized":"2024-04-19T02:16:44.152336+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:53:25.922418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.155347+0000","last_change":"2024-04-19T02:15:28.891370+0000","last_active":"2024-04-19T02:16:44.155347+0000","last_peered":"2024-04-19T02:16:44.155347+0000","last_clean":"2024-04-19T02:16:44.155347+0000","last_became_active":"2024-04-19T02:15:28.890702+0000","last_became_peered":"2024-04-19T02:15:28.890702+0000","last_unstale":"2024-04-19T02:16:44.155347+0000","last_undegraded":"2024-04-19T02:16:44.155347+0000","last_fullsized":"2024-04-19T02:16:44.155347+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:33.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.159629+0000","last_change":"2024-04-19T02:15:29.282244+0000","last_active":"2024-04-19T02:16:44.159629+0000","last_peered":"2024-04-19T02:16:44.159629+0000","last_clean":"2024-04-19T02:16:44.159629+0000","last_became_active":"2024-04-19T02:15:29.280366+0000","last_became_peered":"2024-04-19T02:15:29.280366+0000","last_unstale":"2024-04-19T02:16:44.159629+0000","last_undegraded":"2024-04-19T02:16:44.159629+0000","last_fullsized":"2024-04-19T02:16:44.159629+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.159711+0000","last_change":"2024-04-19T02:15:28.893027+0000","last_active":"2024-04-19T02:16:44.159711+0000","last_peered":"2024-04-19T02:16:44.159711+0000","last_clean":"2024-04-19T02:16:44.159711+0000","last_became_active":"2024-04-19T02:15:28.892695+0000","last_became_peered":"2024-04-19T02:15:28.892695+0000","last_unstale":"2024-04-19T02:16:44.159711+0000","last_undegraded":"2024-04-19T02:16:44.159711+0000","last_fullsized":"2024-04-19T02:16:44.159711+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.161819+0000","last_change":"2024-04-19T02:15:29.283155+0000","last_active":"2024-04-19T02:16:44.161819+0000","last_peered":"2024-04-19T02:16:44.161819+0000","last_clean":"2024-04-19T02:16:44.161819+0000","last_became_active":"2024-04-19T02:15:29.281407+0000","last_became_peered":"2024-04-19T02:15:29.281407+0000","last_unstale":"2024-04-19T02:16:44.161819+0000","last_undegraded":"2024-04-19T02:16:44.161819+0000","last_fullsized":"2024-04-19T02:16:44.161819+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":39,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.152102+0000","last_change":"2024-04-19T02:15:28.893067+0000","last_active":"2024-04-19T02:16:44.152102+0000","last_peered":"2024-04-19T02:16:44.152102+0000","last_clean":"2024-04-19T02:16:44.152102+0000","last_became_active":"2024-04-19T02:15:28.892781+0000","last_became_peered":"2024-04-19T02:15:28.892781+0000","last_unstale":"2024-04-19T02:16:44.152102+0000","last_undegraded":"2024-04-19T02:16:44.152102+0000","last_fullsized":"2024-04-19T02:16:44.152102+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:54:15.590143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.152186+0000","last_change":"2024-04-19T02:15:29.281279+0000","last_active":"2024-04-19T02:16:44.152186+0000","last_peered":"2024-04-19T02:16:44.152186+0000","last_clean":"2024-04-19T02:16:44.152186+0000","last_became_active":"2024-04-19T02:15:29.279360+0000","last_became_peered":"2024-04-19T02:15:29.279360+0000","last_unstale":"2024-04-19T02:16:44.152186+0000","last_undegraded":"2024-04-19T02:16:44.152186+0000","last_fullsized":"2024-04-19T02:16:44.152186+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":39,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.162677+0000","last_change":"2024-04-19T02:15:28.893239+0000","last_active":"2024-04-19T02:16:44.162677+0000","last_peered":"2024-04-19T02:16:44.162677+0000","last_clean":"2024-04-19T02:16:44.162677+0000","last_became_active":"2024-04-19T02:15:28.892881+0000","last_became_peered":"2024-04-19T02:15:28.892881+0000","last_unstale":"2024-04-19T02:16:44.162677+0000","last_undegraded":"2024-04-19T02:16:44.162677+0000","last_fullsized":"2024-04-19T02:16:44.162677+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.152126+0000","last_change":"2024-04-19T02:15:29.281652+0000","last_active":"2024-04-19T02:16:44.152126+0000","last_peered":"2024-04-19T02:16:44.152126+0000","last_clean":"2024-04-19T02:16:44.152126+0000","last_became_active":"2024-04-19T02:15:29.281175+0000","last_became_peered":"2024-04-19T02:15:29.281175+0000","last_unstale":"2024-04-19T02:16:44.152126+0000","last_undegraded":"2024-04-19T02:16:44.152126+0000","last_fullsized":"2024-04-19T02:16:44.152126+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:16.568764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.155596+0000","last_change":"2024-04-19T02:15:28.892058+0000","last_active":"2024-04-19T02:16:44.155596+0000","last_peered":"2024-04-19T02:16:44.155596+0000","last_clean":"2024-04-19T02:16:44.155596+0000","last_became_active":"2024-04-19T02:15:28.890877+0000","last_became_peered":"2024-04-19T02:15:28.890877+0000","last_unstale":"2024-04-19T02:16:44.155596+0000","last_undegraded":"2024-04-19T02:16:44.155596+0000","last_fullsized":"2024-04-19T02:16:44.155596+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:53.170180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.159774+0000","last_change":"2024-04-19T02:15:29.278810+0000","last_active":"2024-04-19T02:16:44.159774+0000","last_peered":"2024-04-19T02:16:44.159774+0000","last_clean":"2024-04-19T02:16:44.159774+0000","last_became_active":"2024-04-19T02:15:29.277913+0000","last_became_peered":"2024-04-19T02:15:29.277913+0000","last_unstale":"2024-04-19T02:16:44.159774+0000","last_undegraded":"2024-04-19T02:16:44.159774+0000","last_fullsized":"2024-04-19T02:16:44.159774+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:24.082666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.155757+0000","last_change":"2024-04-19T02:15:28.889132+0000","last_active":"2024-04-19T02:16:44.155757+0000","last_peered":"2024-04-19T02:16:44.155757+0000","last_clean":"2024-04-19T02:16:44.155757+0000","last_became_active":"2024-04-19T02:15:28.888926+0000","last_became_peered":"2024-04-19T02:15:28.888926+0000","last_unstale":"2024-04-19T02:16:44.155757+0000","last_undegraded":"2024-04-19T02:16:44.155757+0000","last_fullsized":"2024-04-19T02:16:44.155757+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.151752+0000","last_change":"2024-04-19T02:15:29.282776+0000","last_active":"2024-04-19T02:16:44.151752+0000","last_peered":"2024-04-19T02:16:44.151752+0000","last_clean":"2024-04-19T02:16:44.151752+0000","last_became_active":"2024-04-19T02:15:29.279382+0000","last_became_peered":"2024-04-19T02:15:29.279382+0000","last_unstale":"2024-04-19T02:16:44.151752+0000","last_undegraded":"2024-04-19T02:16:44.151752+0000","last_fullsized":"2024-04-19T02:16:44.151752+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.151667+0000","last_change":"2024-04-19T02:15:29.283537+0000","last_active":"2024-04-19T02:16:44.151667+0000","last_peered":"2024-04-19T02:16:44.151667+0000","last_clean":"2024-04-19T02:16:44.151667+0000","last_became_active":"2024-04-19T02:15:29.281801+0000","last_became_peered":"2024-04-19T02:15:29.281801+0000","last_unstale":"2024-04-19T02:16:44.151667+0000","last_undegraded":"2024-04-19T02:16:44.151667+0000","last_fullsized":"2024-04-19T02:16:44.151667+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.153111+0000","last_change":"2024-04-19T02:15:29.281560+0000","last_active":"2024-04-19T02:16:44.153111+0000","last_peered":"2024-04-19T02:16:44.153111+0000","last_clean":"2024-04-19T02:16:44.153111+0000","last_became_active":"2024-04-19T02:15:29.281261+0000","last_became_peered":"2024-04-19T02:15:29.281261+0000","last_unstale":"2024-04-19T02:16:44.153111+0000","last_undegraded":"2024-04-19T02:16:44.153111+0000","last_fullsized":"2024-04-19T02:16:44.153111+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.151590+0000","last_change":"2024-04-19T02:15:53.955913+0000","last_active":"2024-04-19T02:16:44.151590+0000","last_peered":"2024-04-19T02:16:44.151590+0000","last_clean":"2024-04-19T02:16:44.151590+0000","last_became_active":"2024-04-19T02:15:53.955676+0000","last_became_peered":"2024-04-19T02:15:53.955676+0000","last_unstale":"2024-04-19T02:16:44.151590+0000","last_undegraded":"2024-04-19T02:16:44.151590+0000","last_fullsized":"2024-04-19T02:16:44.151590+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:53:02.899902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.155786+0000","last_change":"2024-04-19T02:15:29.278702+0000","last_active":"2024-04-19T02:16:44.155786+0000","last_peered":"2024-04-19T02:16:44.155786+0000","last_clean":"2024-04-19T02:16:44.155786+0000","last_became_active":"2024-04-19T02:15:29.277756+0000","last_became_peered":"2024-04-19T02:15:29.277756+0000","last_unstale":"2024-04-19T02:16:44.155786+0000","last_undegraded":"2024-04-19T02:16:44.155786+0000","last_fullsized":"2024-04-19T02:16:44.155786+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-19T02:16:44.161890+0000","last_change":"2024-04-19T02:15:29.277568+0000","last_active":"2024-04-19T02:16:44.161890+0000","last_peered":"2024-04-19T02:16:44.161890+0000","last_clean":"2024-04-19T02:16:44.161890+0000","last_became_active":"2024-04-19T02:15:29.276725+0000","last_became_peered":"2024-04-19T02:15:29.276725+0000","last_unstale":"2024-04-19T02:16:44.161890+0000","last_undegraded":"2024-04-19T02:16:44.161890+0000","last_fullsized":"2024-04-19T02:16:44.161890+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":7834763264,"num_objects":119549,"num_object_clones":0,"num_object_copies":239098,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2459,"num_objects_unfound":0,"num_objects_dirty":119549,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119549,"num_write_kb":7651136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3773,"num_bytes_recovered":247267328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15989342208,"data_stored":15989342208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":59848,"ondisk_log_size":59848,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738387,"num_pgs":84,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6340172,"kb_used_data":6146624,"kb_used_omap":1,"kb_used_meta":193534,"kb_avail":88031668,"statfs":{"total":96636764160,"available":90144428032,"internally_reserved":0,"allocated":6294142976,"data_stored":6293852480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":198179270},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,4,0,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.313,"15min":0.313},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.497,"5min":0.497,"15min":0.497},"last":0.216},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.17899999999999999}]},{"osd":1,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.253},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.20399999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738388,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4869416,"kb_used_data":4752156,"kb_used_omap":1,"kb_used_meta":117246,"kb_avail":89502424,"statfs":{"total":96636764160,"available":91650482176,"internally_reserved":0,"allocated":4866207744,"data_stored":4865890866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":120060358},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.19600000000000001},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.221}]},{"osd":2,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":2.1000000000000001,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":0.20899999999999999},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.23699999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738387,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4742624,"kb_used_data":4607316,"kb_used_omap":1,"kb_used_meta":135294,"kb_avail":89629216,"statfs":{"total":96636764160,"available":91780317184,"internally_reserved":0,"allocated":4717891584,"data_stored":4717582282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":138541510},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:16:26 2024","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.219},{"interface":"front","average":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"min":{"1min":0.16,"5min":0.16,"15min":0.16},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.224}]},{"osd":2,"last update":"Fri Apr 19 02:16:26 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.184}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4911923200,"data_stored":4911923200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4724097024,"data_stored":4724097024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6353321984,"data_stored":6353321984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:16:51.541 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:51.541 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:51.556 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:16:51.602 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:51.600+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:51.678 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:51.678+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:51.723 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:51.724 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:51.736 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:16:51.779 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:51.779+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:51.880 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:51.881+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:51.945 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:51.945 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:51.960 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:16:52.003 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:52.003+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:52.030 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 57 16 128037 128021 140.362 122.625 0.00833747 0.00712197 2024-04-19T02:16:52.082 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:52.082+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:52.124 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:52.124 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:52.137 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:16:52.182 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:52.183+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:52.267 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T02:16:52.286 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:52.286+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:52.306 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:52.306 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:52.320 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:16:52.331 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:16:52.386 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:52.387+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:52.481 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:16:52.487 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:52.487+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:52.489 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:52.489 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:52.502 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:16:52.503 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:16:52.522 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2: {} 2024-04-19T02:16:52.523 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:16:52.523 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:16:52.523 INFO:teuthology.orchestra.run.smithi121.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:16:52.588 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:52.588+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:52.689 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:52.689+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:52.723 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:16:52.723 INFO:teuthology.orchestra.run.smithi174.stdout: "size": 20, 2024-04-19T02:16:52.723 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 600, 2024-04-19T02:16:52.723 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:16:52.723 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.723 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:10 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:52.723 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269877+0000", 2024-04-19T02:16:52.723 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 83.451522906999998, 2024-04-19T02:16:52.723 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020732751000000001, 2024-04-19T02:16:52.723 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:52.723 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.724 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:52.724 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.724 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:52.724 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269877+0000", 2024-04-19T02:16:52.724 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:52.724 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.724 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.724 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:52.724 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269877+0000", 2024-04-19T02:16:52.724 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:52.724 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.724 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.724 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:52.724 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269875+0000", 2024-04-19T02:16:52.724 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:52.725 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.725 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.725 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:52.725 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269891+0000", 2024-04-19T02:16:52.725 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.5494000000000001e-05 2024-04-19T02:16:52.725 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.725 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.725 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:52.725 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269903+0000", 2024-04-19T02:16:52.725 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2003e-05 2024-04-19T02:16:52.725 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.725 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.725 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.725 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269914+0000", 2024-04-19T02:16:52.725 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0947e-05 2024-04-19T02:16:52.726 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.726 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.726 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:52.726 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269971+0000", 2024-04-19T02:16:52.726 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7036000000000001e-05 2024-04-19T02:16:52.726 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.726 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.726 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:16:52.726 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269979+0000", 2024-04-19T02:16:52.726 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.6660000000000008e-06 2024-04-19T02:16:52.726 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.726 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.726 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:52.726 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284891+0000", 2024-04-19T02:16:52.727 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014912584 2024-04-19T02:16:52.727 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.727 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.727 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:52.727 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285213+0000", 2024-04-19T02:16:52.727 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00032172199999999998 2024-04-19T02:16:52.727 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.727 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.727 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:52.727 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285357+0000", 2024-04-19T02:16:52.727 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014367899999999999 2024-04-19T02:16:52.727 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.727 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.727 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:52.727 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288883+0000", 2024-04-19T02:16:52.728 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0035268719999999999 2024-04-19T02:16:52.728 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.728 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.728 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:52.728 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290537+0000", 2024-04-19T02:16:52.728 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016537399999999999 2024-04-19T02:16:52.728 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.728 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.728 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:52.728 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290576+0000", 2024-04-19T02:16:52.728 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9266e-05 2024-04-19T02:16:52.728 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.728 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.728 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:52.728 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290609+0000", 2024-04-19T02:16:52.729 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2818000000000003e-05 2024-04-19T02:16:52.729 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:52.729 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:52.729 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:52.729 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.729 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.729 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:11 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:52.729 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:52.729 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 83.451469986000006, 2024-04-19T02:16:52.729 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020352748, 2024-04-19T02:16:52.729 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:52.729 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.729 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:52.729 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.729 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:52.730 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:52.730 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:52.730 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.730 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.730 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:52.730 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:52.730 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:52.730 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.730 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.730 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:52.730 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:52.730 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:52.730 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.730 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.731 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:52.731 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269933+0000", 2024-04-19T02:16:52.731 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2169999999999996e-06 2024-04-19T02:16:52.731 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.731 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.731 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:52.731 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269940+0000", 2024-04-19T02:16:52.731 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1500000000000002e-06 2024-04-19T02:16:52.731 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.731 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.731 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.731 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269948+0000", 2024-04-19T02:16:52.731 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.8690000000000004e-06 2024-04-19T02:16:52.731 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.731 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.732 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:52.732 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:16:52.732 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2994999999999997e-05 2024-04-19T02:16:52.732 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.732 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.732 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:16:52.732 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269997+0000", 2024-04-19T02:16:52.732 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.9020000000000004e-06 2024-04-19T02:16:52.732 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.732 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.732 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:52.732 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.282729+0000", 2024-04-19T02:16:52.732 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.012732537 2024-04-19T02:16:52.732 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.732 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.733 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:52.733 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.282838+0000", 2024-04-19T02:16:52.733 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000108298 2024-04-19T02:16:52.733 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.733 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.733 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:52.733 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.283002+0000", 2024-04-19T02:16:52.733 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00016466300000000001 2024-04-19T02:16:52.733 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.733 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.733 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:52.733 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288708+0000", 2024-04-19T02:16:52.733 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.005705066 2024-04-19T02:16:52.734 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.734 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.734 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:52.734 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290215+0000", 2024-04-19T02:16:52.734 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0015075010000000001 2024-04-19T02:16:52.734 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.734 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.734 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:52.734 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290259+0000", 2024-04-19T02:16:52.734 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3711999999999998e-05 2024-04-19T02:16:52.734 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.734 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.734 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:52.735 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290282+0000", 2024-04-19T02:16:52.735 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3458000000000001e-05 2024-04-19T02:16:52.735 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:52.735 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:52.735 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:52.735 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.735 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.735 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:14 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:52.735 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:52.735 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 83.451436196000003, 2024-04-19T02:16:52.735 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020137202, 2024-04-19T02:16:52.735 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:52.735 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.735 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:52.735 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.736 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:52.736 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:52.736 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:52.736 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.736 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.736 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:52.736 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:52.736 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:52.736 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.736 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.736 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:52.736 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:52.736 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:52.736 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.737 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.737 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:52.737 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269971+0000", 2024-04-19T02:16:52.737 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.5459999999999992e-06 2024-04-19T02:16:52.737 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.737 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.737 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:52.737 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269979+0000", 2024-04-19T02:16:52.737 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9130000000000003e-06 2024-04-19T02:16:52.737 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.737 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.737 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.737 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269986+0000", 2024-04-19T02:16:52.737 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.3779999999999998e-06 2024-04-19T02:16:52.737 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.738 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.738 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:52.738 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270030+0000", 2024-04-19T02:16:52.738 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3982e-05 2024-04-19T02:16:52.738 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.738 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.738 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:16:52.738 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270034+0000", 2024-04-19T02:16:52.738 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1779999999999996e-06 2024-04-19T02:16:52.738 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.738 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.738 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:52.738 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.277870+0000", 2024-04-19T02:16:52.738 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0078362150000000005 2024-04-19T02:16:52.739 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.739 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.739 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:52.739 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.278216+0000", 2024-04-19T02:16:52.739 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00034634999999999999 2024-04-19T02:16:52.739 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.739 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.739 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:52.739 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.278732+0000", 2024-04-19T02:16:52.739 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00051536099999999999 2024-04-19T02:16:52.739 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.739 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.739 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:52.739 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.287694+0000", 2024-04-19T02:16:52.739 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0089621019999999996 2024-04-19T02:16:52.740 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.740 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.740 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:52.740 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290026+0000", 2024-04-19T02:16:52.740 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0023323139999999998 2024-04-19T02:16:52.740 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.740 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.740 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:52.740 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290067+0000", 2024-04-19T02:16:52.740 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1043e-05 2024-04-19T02:16:52.740 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.740 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.740 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:52.740 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290100+0000", 2024-04-19T02:16:52.740 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3278999999999998e-05 2024-04-19T02:16:52.740 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:52.741 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:52.741 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:52.741 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.741 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.741 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:52.741 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:52.741 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 83.451404404000002, 2024-04-19T02:16:52.741 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020731702000000001, 2024-04-19T02:16:52.741 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:52.741 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.741 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:52.741 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.741 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:52.741 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:52.741 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:52.742 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.742 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.742 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:52.742 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:52.742 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:52.742 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.742 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.742 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:52.742 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:52.742 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:52.742 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.742 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.742 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:52.742 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269998+0000", 2024-04-19T02:16:52.743 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7100000000000001e-06 2024-04-19T02:16:52.743 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.743 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.743 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:52.743 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270005+0000", 2024-04-19T02:16:52.743 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.241e-06 2024-04-19T02:16:52.743 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.743 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.743 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.743 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270011+0000", 2024-04-19T02:16:52.743 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6279999999999999e-06 2024-04-19T02:16:52.743 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.743 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.743 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:52.743 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270046+0000", 2024-04-19T02:16:52.743 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5173999999999999e-05 2024-04-19T02:16:52.743 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.744 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.744 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:52.744 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:52.744 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0019999999999997e-06 2024-04-19T02:16:52.744 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.744 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.744 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:52.744 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285619+0000", 2024-04-19T02:16:52.744 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015567391 2024-04-19T02:16:52.744 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.744 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.744 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:52.744 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285671+0000", 2024-04-19T02:16:52.744 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2460999999999998e-05 2024-04-19T02:16:52.744 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.745 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.745 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:52.745 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285775+0000", 2024-04-19T02:16:52.745 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000103389 2024-04-19T02:16:52.745 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.745 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.745 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:52.745 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288934+0000", 2024-04-19T02:16:52.745 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0031595859999999998 2024-04-19T02:16:52.745 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.745 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.745 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:52.745 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290650+0000", 2024-04-19T02:16:52.745 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001716242 2024-04-19T02:16:52.745 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.745 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.746 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:52.746 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290692+0000", 2024-04-19T02:16:52.746 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1910999999999999e-05 2024-04-19T02:16:52.746 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.746 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.746 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:52.746 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290727+0000", 2024-04-19T02:16:52.746 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4412000000000002e-05 2024-04-19T02:16:52.746 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:52.746 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:52.746 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:52.746 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.746 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.746 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:52.747 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270019+0000", 2024-04-19T02:16:52.747 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 83.451380809, 2024-04-19T02:16:52.747 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020572014999999999, 2024-04-19T02:16:52.747 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:52.747 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.747 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:52.747 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.747 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:52.747 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270019+0000", 2024-04-19T02:16:52.747 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:52.747 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.747 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.747 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:52.747 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270019+0000", 2024-04-19T02:16:52.747 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:52.747 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.748 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.748 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:52.748 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270018+0000", 2024-04-19T02:16:52.748 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:52.748 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.748 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.748 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:52.748 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270021+0000", 2024-04-19T02:16:52.748 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0319999999999999e-06 2024-04-19T02:16:52.748 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.748 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.748 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:52.748 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270028+0000", 2024-04-19T02:16:52.748 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6189999999999996e-06 2024-04-19T02:16:52.748 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.748 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.749 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.749 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270035+0000", 2024-04-19T02:16:52.749 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1690000000000003e-06 2024-04-19T02:16:52.749 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.749 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.749 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:52.749 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270078+0000", 2024-04-19T02:16:52.749 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3061e-05 2024-04-19T02:16:52.749 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.749 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.749 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:52.749 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270082+0000", 2024-04-19T02:16:52.749 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4510000000000002e-06 2024-04-19T02:16:52.749 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.749 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.749 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:52.749 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284354+0000", 2024-04-19T02:16:52.750 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014271588999999999 2024-04-19T02:16:52.750 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.750 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.750 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:52.750 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284497+0000", 2024-04-19T02:16:52.750 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014335800000000001 2024-04-19T02:16:52.750 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.750 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.750 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:52.750 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284626+0000", 2024-04-19T02:16:52.750 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000128744 2024-04-19T02:16:52.750 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.750 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.750 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:52.750 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288844+0000", 2024-04-19T02:16:52.751 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00421807 2024-04-19T02:16:52.751 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.751 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.751 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:52.751 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290508+0000", 2024-04-19T02:16:52.751 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001663774 2024-04-19T02:16:52.751 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.751 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.751 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:52.751 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290556+0000", 2024-04-19T02:16:52.751 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.7599999999999998e-05 2024-04-19T02:16:52.751 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.751 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.751 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:52.751 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290591+0000", 2024-04-19T02:16:52.752 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5034999999999999e-05 2024-04-19T02:16:52.752 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:52.752 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:52.752 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:52.752 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.752 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.752 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:52.752 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:52.752 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 83.451357946000002, 2024-04-19T02:16:52.752 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020192280999999999, 2024-04-19T02:16:52.752 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:52.752 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.752 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:52.752 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.752 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:52.753 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:52.753 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:52.753 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.753 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.753 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:52.753 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:52.753 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:52.753 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.753 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.753 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:52.753 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:52.753 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:52.753 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.753 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.754 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:52.754 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270045+0000", 2024-04-19T02:16:52.754 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8680000000000001e-06 2024-04-19T02:16:52.754 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.754 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.754 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:52.754 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270052+0000", 2024-04-19T02:16:52.754 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.9999999999999999e-06 2024-04-19T02:16:52.754 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.754 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.754 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.754 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270056+0000", 2024-04-19T02:16:52.754 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4479999999999996e-06 2024-04-19T02:16:52.754 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.755 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.755 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:52.755 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270089+0000", 2024-04-19T02:16:52.755 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3071000000000002e-05 2024-04-19T02:16:52.755 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.755 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.755 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:52.755 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270092+0000", 2024-04-19T02:16:52.755 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9780000000000001e-06 2024-04-19T02:16:52.755 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.755 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.755 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:52.755 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.280632+0000", 2024-04-19T02:16:52.755 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010539712 2024-04-19T02:16:52.755 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.756 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.756 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:52.756 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.280743+0000", 2024-04-19T02:16:52.756 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000111048 2024-04-19T02:16:52.756 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.756 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.756 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:52.756 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.281531+0000", 2024-04-19T02:16:52.756 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00078738199999999999 2024-04-19T02:16:52.756 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.756 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.756 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:52.756 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.287949+0000", 2024-04-19T02:16:52.756 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0064185730000000003 2024-04-19T02:16:52.756 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.756 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.757 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:52.757 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290184+0000", 2024-04-19T02:16:52.757 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0022350849999999999 2024-04-19T02:16:52.757 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.757 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.757 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:52.757 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290209+0000", 2024-04-19T02:16:52.757 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4907000000000001e-05 2024-04-19T02:16:52.757 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.757 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.757 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:52.757 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290234+0000", 2024-04-19T02:16:52.757 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4666999999999999e-05 2024-04-19T02:16:52.757 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:52.757 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:52.758 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:52.758 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.758 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.758 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:19 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:52.758 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:52.758 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 83.451336479999995, 2024-04-19T02:16:52.758 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020818203, 2024-04-19T02:16:52.758 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:52.758 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.758 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:52.758 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.758 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:52.758 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:52.759 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:52.759 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.759 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.759 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:52.759 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:52.759 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:52.759 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.759 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.759 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:52.759 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:52.759 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:52.759 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.759 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.759 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:52.759 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270065+0000", 2024-04-19T02:16:52.759 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4310000000000001e-06 2024-04-19T02:16:52.760 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.760 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.760 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:52.760 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270070+0000", 2024-04-19T02:16:52.760 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2859999999999999e-06 2024-04-19T02:16:52.760 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.760 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.760 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.760 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270077+0000", 2024-04-19T02:16:52.760 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5270000000000004e-06 2024-04-19T02:16:52.760 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.760 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.760 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:52.760 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270107+0000", 2024-04-19T02:16:52.760 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0205999999999998e-05 2024-04-19T02:16:52.761 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.761 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.761 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:52.761 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270111+0000", 2024-04-19T02:16:52.761 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8650000000000003e-06 2024-04-19T02:16:52.761 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.761 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.761 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:52.761 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285936+0000", 2024-04-19T02:16:52.761 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015824677999999998 2024-04-19T02:16:52.761 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.761 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.761 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:52.761 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286007+0000", 2024-04-19T02:16:52.762 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1157999999999999e-05 2024-04-19T02:16:52.762 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.762 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.762 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:52.762 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286086+0000", 2024-04-19T02:16:52.762 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9084000000000004e-05 2024-04-19T02:16:52.762 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.762 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.762 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:52.762 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290740+0000", 2024-04-19T02:16:52.762 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0046543679999999999 2024-04-19T02:16:52.762 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.762 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.762 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:52.762 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290833+0000", 2024-04-19T02:16:52.763 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2551000000000002e-05 2024-04-19T02:16:52.763 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.763 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.763 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:52.763 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290859+0000", 2024-04-19T02:16:52.763 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.6696999999999999e-05 2024-04-19T02:16:52.763 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.763 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.763 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:52.763 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290881+0000", 2024-04-19T02:16:52.763 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1653000000000001e-05 2024-04-19T02:16:52.763 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:52.763 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:52.763 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:52.764 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.764 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.764 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:77622 5.8 5:166fbe77:::benchmark_data_smithi121_44835_object77621:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:52.764 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:16:52.764 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 25.915839543000001, 2024-04-19T02:16:52.764 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.021784694, 2024-04-19T02:16:52.764 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:52.764 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.764 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:52.764 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:52.764 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:52.764 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 77622 2024-04-19T02:16:52.764 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.764 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:52.765 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.765 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:52.765 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:16:52.765 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:52.765 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.765 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.765 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:52.765 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:16:52.765 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:52.765 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.765 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.765 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:52.765 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805559+0000", 2024-04-19T02:16:52.765 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:52.766 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.766 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.766 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:52.766 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805659+0000", 2024-04-19T02:16:52.766 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.9908000000000006e-05 2024-04-19T02:16:52.766 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.766 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.766 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:52.766 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805668+0000", 2024-04-19T02:16:52.766 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2129999999999997e-06 2024-04-19T02:16:52.766 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.766 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.766 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.766 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805673+0000", 2024-04-19T02:16:52.767 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0370000000000002e-06 2024-04-19T02:16:52.767 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.767 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.767 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:52.767 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812022+0000", 2024-04-19T02:16:52.767 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0063483239999999998 2024-04-19T02:16:52.767 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.767 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.767 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:52.767 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812129+0000", 2024-04-19T02:16:52.767 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010744200000000001 2024-04-19T02:16:52.767 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.767 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.767 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:52.767 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812252+0000", 2024-04-19T02:16:52.768 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000122519 2024-04-19T02:16:52.768 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.768 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.768 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:52.768 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.820979+0000", 2024-04-19T02:16:52.768 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0087272740000000001 2024-04-19T02:16:52.768 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.768 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.768 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:52.768 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827270+0000", 2024-04-19T02:16:52.768 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0062906239999999999 2024-04-19T02:16:52.768 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.768 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.768 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:52.769 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827309+0000", 2024-04-19T02:16:52.769 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9678999999999997e-05 2024-04-19T02:16:52.769 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.769 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.769 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:52.769 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827345+0000", 2024-04-19T02:16:52.769 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5308000000000001e-05 2024-04-19T02:16:52.769 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:52.769 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:52.769 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:52.769 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.769 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.769 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78224 5.4 5:26e797d5:::benchmark_data_smithi121_44835_object78223:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:52.769 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:16:52.769 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 25.614837344000001, 2024-04-19T02:16:52.770 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.021471998999999999, 2024-04-19T02:16:52.770 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:52.770 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.770 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:52.770 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:52.770 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:52.770 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78224 2024-04-19T02:16:52.770 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.770 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:52.770 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.770 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:52.770 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:16:52.770 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:52.770 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.771 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.771 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:52.771 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:16:52.771 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:52.771 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.771 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.771 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:52.771 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106561+0000", 2024-04-19T02:16:52.771 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:52.771 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.771 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.771 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:52.771 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106630+0000", 2024-04-19T02:16:52.771 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.8553999999999994e-05 2024-04-19T02:16:52.771 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.772 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.772 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:52.772 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106644+0000", 2024-04-19T02:16:52.772 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.4651000000000001e-05 2024-04-19T02:16:52.772 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.772 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.772 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.772 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106653+0000", 2024-04-19T02:16:52.772 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.6719999999999993e-06 2024-04-19T02:16:52.772 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.772 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.772 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:52.772 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106693+0000", 2024-04-19T02:16:52.772 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9978999999999998e-05 2024-04-19T02:16:52.772 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.773 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.773 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:52.773 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106840+0000", 2024-04-19T02:16:52.773 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0001473 2024-04-19T02:16:52.773 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.773 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.773 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:52.773 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106971+0000", 2024-04-19T02:16:52.773 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013051499999999999 2024-04-19T02:16:52.773 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.773 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.773 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:52.773 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.109047+0000", 2024-04-19T02:16:52.773 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.002076002 2024-04-19T02:16:52.774 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.774 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.774 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:52.774 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.127967+0000", 2024-04-19T02:16:52.774 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.018919780000000001 2024-04-19T02:16:52.774 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.774 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.774 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:52.774 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128004+0000", 2024-04-19T02:16:52.774 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7719000000000003e-05 2024-04-19T02:16:52.774 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.774 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.774 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:52.774 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128034+0000", 2024-04-19T02:16:52.775 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9651000000000001e-05 2024-04-19T02:16:52.775 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:52.775 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:52.775 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:52.775 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.775 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.775 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78259 5.4 5:2aa344b2:::benchmark_data_smithi121_44835_object78258:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:52.775 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:16:52.775 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 25.596142274999998, 2024-04-19T02:16:52.775 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022934350999999999, 2024-04-19T02:16:52.775 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:52.775 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.775 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:52.775 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:52.775 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:52.776 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78259 2024-04-19T02:16:52.776 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.776 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:52.776 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.776 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:52.776 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:16:52.776 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:52.776 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.776 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.776 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:52.776 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:16:52.776 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:52.776 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.776 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.777 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:52.777 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125256+0000", 2024-04-19T02:16:52.777 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:52.777 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.777 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.777 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:52.777 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125347+0000", 2024-04-19T02:16:52.777 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0470000000000006e-05 2024-04-19T02:16:52.777 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.777 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.777 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:52.777 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125358+0000", 2024-04-19T02:16:52.777 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1764e-05 2024-04-19T02:16:52.777 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.777 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.778 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.778 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125364+0000", 2024-04-19T02:16:52.778 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7189999999999998e-06 2024-04-19T02:16:52.778 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.778 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.778 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:52.778 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125391+0000", 2024-04-19T02:16:52.778 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7270000000000001e-05 2024-04-19T02:16:52.778 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.778 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.778 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:52.778 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125471+0000", 2024-04-19T02:16:52.778 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9209999999999995e-05 2024-04-19T02:16:52.778 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.779 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.779 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:52.779 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125559+0000", 2024-04-19T02:16:52.779 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.8689000000000004e-05 2024-04-19T02:16:52.779 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.779 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.779 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:52.779 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128164+0000", 2024-04-19T02:16:52.779 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0026050270000000002 2024-04-19T02:16:52.779 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.779 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.779 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:52.779 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148139+0000", 2024-04-19T02:16:52.779 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.019975050000000001 2024-04-19T02:16:52.780 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.780 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.780 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:52.780 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148169+0000", 2024-04-19T02:16:52.780 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0001e-05 2024-04-19T02:16:52.780 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.780 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.780 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:52.780 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148191+0000", 2024-04-19T02:16:52.780 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.2104999999999999e-05 2024-04-19T02:16:52.780 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:52.780 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:52.780 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:52.780 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.780 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.780 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78271 5.4 5:2982d7a6:::benchmark_data_smithi121_44835_object78270:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:52.781 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:16:52.781 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 25.589279045000001, 2024-04-19T02:16:52.781 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020841755999999999, 2024-04-19T02:16:52.781 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:52.781 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.781 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:52.781 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:52.781 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:52.781 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78271 2024-04-19T02:16:52.781 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.781 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:52.781 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.781 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:52.781 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:16:52.781 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:52.782 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.782 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.782 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:52.782 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:16:52.782 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:52.782 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.782 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.782 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:52.782 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132119+0000", 2024-04-19T02:16:52.782 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:52.782 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.782 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.782 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:52.782 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132185+0000", 2024-04-19T02:16:52.783 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5994000000000005e-05 2024-04-19T02:16:52.783 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.783 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.783 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:52.783 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132197+0000", 2024-04-19T02:16:52.783 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2091e-05 2024-04-19T02:16:52.783 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.783 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.783 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.783 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132206+0000", 2024-04-19T02:16:52.783 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.5099999999999998e-06 2024-04-19T02:16:52.783 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.783 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.783 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:52.784 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132242+0000", 2024-04-19T02:16:52.784 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5663000000000001e-05 2024-04-19T02:16:52.784 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.784 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.784 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:52.784 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132335+0000", 2024-04-19T02:16:52.784 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3275000000000004e-05 2024-04-19T02:16:52.784 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.784 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.784 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:52.784 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132432+0000", 2024-04-19T02:16:52.784 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7571000000000005e-05 2024-04-19T02:16:52.784 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.784 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.784 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:52.784 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.136706+0000", 2024-04-19T02:16:52.785 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0042738170000000001 2024-04-19T02:16:52.785 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.785 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.785 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:52.785 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152909+0000", 2024-04-19T02:16:52.785 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016202415000000001 2024-04-19T02:16:52.785 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.785 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.785 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:52.785 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152938+0000", 2024-04-19T02:16:52.785 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9740999999999999e-05 2024-04-19T02:16:52.785 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.785 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.785 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:52.785 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152962+0000", 2024-04-19T02:16:52.786 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3659000000000002e-05 2024-04-19T02:16:52.786 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:52.786 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:52.786 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:52.786 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.786 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.786 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78272 5.4 5:273e819a:::benchmark_data_smithi121_44835_object78271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:52.786 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:16:52.786 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 25.588790002, 2024-04-19T02:16:52.786 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022180163999999999, 2024-04-19T02:16:52.786 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:52.786 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.786 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:52.786 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:52.787 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:52.787 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78272 2024-04-19T02:16:52.787 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.787 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:52.787 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.787 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:52.787 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:16:52.787 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:52.787 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.787 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.787 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:52.787 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:16:52.787 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:52.787 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.788 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.788 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:52.788 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:16:52.788 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:52.788 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.788 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.788 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:52.788 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132690+0000", 2024-04-19T02:16:52.788 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0963000000000004e-05 2024-04-19T02:16:52.788 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.788 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.788 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:52.788 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132703+0000", 2024-04-19T02:16:52.788 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.3072e-05 2024-04-19T02:16:52.789 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.789 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.789 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.789 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132710+0000", 2024-04-19T02:16:52.789 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3100000000000003e-06 2024-04-19T02:16:52.789 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.789 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.789 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:52.789 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134005+0000", 2024-04-19T02:16:52.789 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001294513 2024-04-19T02:16:52.789 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.789 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.789 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:52.789 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134139+0000", 2024-04-19T02:16:52.789 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000134447 2024-04-19T02:16:52.789 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.790 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.790 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:52.790 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134284+0000", 2024-04-19T02:16:52.790 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014514399999999999 2024-04-19T02:16:52.790 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.790 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.790 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:52.790 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.139622+0000", 2024-04-19T02:16:52.790 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0053373830000000002 2024-04-19T02:16:52.790 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.790 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.790 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:52.790 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154737+0000", 2024-04-19T02:16:52.790 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015115195999999999 2024-04-19T02:16:52.791 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.791 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.791 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:52.791 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154768+0000", 2024-04-19T02:16:52.791 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0824999999999997e-05 2024-04-19T02:16:52.791 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.791 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.791 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:52.791 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154790+0000", 2024-04-19T02:16:52.791 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1999000000000001e-05 2024-04-19T02:16:52.791 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:52.791 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:52.791 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:52.791 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.791 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.792 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:94475 5.e 5:7a360208:::benchmark_data_smithi121_44835_object94474:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:52.792 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:35.118023+0000", 2024-04-19T02:16:52.792 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 17.603376061999999, 2024-04-19T02:16:52.792 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020591993999999999, 2024-04-19T02:16:52.792 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:52.792 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.792 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:52.792 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:52.792 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:52.792 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 94475 2024-04-19T02:16:52.792 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.792 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:52.792 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.792 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:52.792 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118023+0000", 2024-04-19T02:16:52.793 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:52.793 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.793 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.793 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:52.793 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118023+0000", 2024-04-19T02:16:52.793 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:52.793 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.793 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.793 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:52.793 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118023+0000", 2024-04-19T02:16:52.793 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:52.793 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.793 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.793 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:52.793 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118041+0000", 2024-04-19T02:16:52.794 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.8689999999999999e-05 2024-04-19T02:16:52.794 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.794 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.794 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:52.794 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118049+0000", 2024-04-19T02:16:52.794 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.5939999999999996e-06 2024-04-19T02:16:52.794 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.794 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.794 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.794 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118053+0000", 2024-04-19T02:16:52.794 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2080000000000002e-06 2024-04-19T02:16:52.794 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.794 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.795 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:52.795 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118093+0000", 2024-04-19T02:16:52.795 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9634e-05 2024-04-19T02:16:52.795 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.795 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.795 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:52.795 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118191+0000", 2024-04-19T02:16:52.795 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.8272999999999999e-05 2024-04-19T02:16:52.795 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.795 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.795 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:52.795 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118280+0000", 2024-04-19T02:16:52.795 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.8702999999999994e-05 2024-04-19T02:16:52.795 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.795 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.796 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:52.796 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.124833+0000", 2024-04-19T02:16:52.796 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0065528180000000002 2024-04-19T02:16:52.796 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.796 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.796 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:52.796 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.138520+0000", 2024-04-19T02:16:52.796 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.013686959 2024-04-19T02:16:52.796 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.796 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.796 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:52.796 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.138577+0000", 2024-04-19T02:16:52.796 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7689000000000003e-05 2024-04-19T02:16:52.796 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.796 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.796 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:52.797 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.138615+0000", 2024-04-19T02:16:52.797 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8016999999999999e-05 2024-04-19T02:16:52.797 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:52.797 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:52.797 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:52.797 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.797 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.797 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:94481 5.e 5:7b2fbebf:::benchmark_data_smithi121_44835_object94480:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:52.797 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:16:52.797 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 17.600153684999999, 2024-04-19T02:16:52.797 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020897846000000001, 2024-04-19T02:16:52.797 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:52.797 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.797 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:52.797 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:52.798 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:52.798 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 94481 2024-04-19T02:16:52.798 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.798 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:52.798 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.798 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:52.798 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:16:52.798 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:52.798 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.798 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.798 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:52.798 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:16:52.798 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:52.798 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.798 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.799 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:52.799 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121245+0000", 2024-04-19T02:16:52.799 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:52.799 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.799 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.799 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:52.799 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121273+0000", 2024-04-19T02:16:52.799 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7250000000000002e-05 2024-04-19T02:16:52.799 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.799 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.799 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:52.799 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121277+0000", 2024-04-19T02:16:52.799 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2860000000000001e-06 2024-04-19T02:16:52.799 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.799 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.800 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.800 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121280+0000", 2024-04-19T02:16:52.800 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2739999999999999e-06 2024-04-19T02:16:52.800 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.800 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.800 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:52.800 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121320+0000", 2024-04-19T02:16:52.800 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9879000000000002e-05 2024-04-19T02:16:52.800 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.800 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.800 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:52.800 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121448+0000", 2024-04-19T02:16:52.800 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012748800000000001 2024-04-19T02:16:52.800 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.800 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.801 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:52.801 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121595+0000", 2024-04-19T02:16:52.801 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014741299999999999 2024-04-19T02:16:52.801 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.801 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.801 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:52.801 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.127776+0000", 2024-04-19T02:16:52.801 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0061811360000000003 2024-04-19T02:16:52.801 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.801 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.801 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:52.801 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142073+0000", 2024-04-19T02:16:52.801 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014296959999999999 2024-04-19T02:16:52.801 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.801 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.802 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:52.802 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142106+0000", 2024-04-19T02:16:52.802 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3348e-05 2024-04-19T02:16:52.802 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.802 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.802 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:52.802 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142144+0000", 2024-04-19T02:16:52.802 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7153000000000002e-05 2024-04-19T02:16:52.802 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:52.802 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:52.802 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:52.802 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.802 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.802 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:94581 5.b 5:dc86d6e9:::benchmark_data_smithi121_44835_object94580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:52.802 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:16:52.803 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 17.541219112, 2024-04-19T02:16:52.803 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022099711000000001, 2024-04-19T02:16:52.803 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:52.803 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.803 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:52.803 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:52.803 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:52.803 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 94581 2024-04-19T02:16:52.803 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.803 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:52.803 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.803 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:52.803 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:16:52.803 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:52.804 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.804 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.804 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:52.804 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:16:52.804 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:52.804 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.804 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.804 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:52.804 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:16:52.804 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:52.804 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.804 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.804 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:52.804 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180253+0000", 2024-04-19T02:16:52.804 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3163000000000004e-05 2024-04-19T02:16:52.805 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.805 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.805 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:52.805 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180266+0000", 2024-04-19T02:16:52.805 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2886e-05 2024-04-19T02:16:52.805 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.805 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.805 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.805 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180273+0000", 2024-04-19T02:16:52.805 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.4059999999999999e-06 2024-04-19T02:16:52.805 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.805 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.805 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:52.805 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180646+0000", 2024-04-19T02:16:52.805 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00037283999999999999 2024-04-19T02:16:52.806 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.806 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.806 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:52.806 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180774+0000", 2024-04-19T02:16:52.806 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012793799999999999 2024-04-19T02:16:52.806 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.806 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.806 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:52.806 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180920+0000", 2024-04-19T02:16:52.806 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000146692 2024-04-19T02:16:52.806 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.806 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.806 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:52.806 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.183344+0000", 2024-04-19T02:16:52.806 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0024231669999999999 2024-04-19T02:16:52.807 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.807 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.807 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:52.807 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202196+0000", 2024-04-19T02:16:52.807 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.018852384 2024-04-19T02:16:52.807 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.807 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.807 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:52.807 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202241+0000", 2024-04-19T02:16:52.807 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4923999999999999e-05 2024-04-19T02:16:52.807 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.807 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.807 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:52.807 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202280+0000", 2024-04-19T02:16:52.808 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9096e-05 2024-04-19T02:16:52.808 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:52.808 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:52.808 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:52.808 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.808 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.808 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:96356 5.0 5:0a661b39:::benchmark_data_smithi121_44835_object96355:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:52.808 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:16:52.808 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 16.62800627, 2024-04-19T02:16:52.808 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020955516, 2024-04-19T02:16:52.808 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:52.808 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.808 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:52.808 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:52.808 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:52.808 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 96356 2024-04-19T02:16:52.809 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.809 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:52.809 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.809 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:52.809 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:16:52.809 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:52.809 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.809 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.809 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:52.809 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:16:52.809 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:52.809 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.809 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.809 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:52.809 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:16:52.810 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:52.810 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.810 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.810 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:52.810 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093455+0000", 2024-04-19T02:16:52.810 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.2205000000000005e-05 2024-04-19T02:16:52.810 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.810 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.810 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:52.810 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093464+0000", 2024-04-19T02:16:52.810 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3910000000000004e-06 2024-04-19T02:16:52.810 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.810 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.810 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.811 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093469+0000", 2024-04-19T02:16:52.811 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.7249999999999997e-06 2024-04-19T02:16:52.811 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.811 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.811 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:52.811 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099643+0000", 2024-04-19T02:16:52.811 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0061743359999999999 2024-04-19T02:16:52.811 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.811 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.811 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:52.811 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099774+0000", 2024-04-19T02:16:52.811 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013050599999999999 2024-04-19T02:16:52.811 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.811 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.811 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:52.812 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099917+0000", 2024-04-19T02:16:52.812 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000143187 2024-04-19T02:16:52.812 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.812 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.812 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:52.812 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.105432+0000", 2024-04-19T02:16:52.812 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.005514873 2024-04-19T02:16:52.812 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.812 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.812 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:52.812 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114264+0000", 2024-04-19T02:16:52.812 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.008831752 2024-04-19T02:16:52.812 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.813 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.813 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:52.813 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114300+0000", 2024-04-19T02:16:52.813 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6582000000000003e-05 2024-04-19T02:16:52.813 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.813 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.813 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:52.813 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114349+0000", 2024-04-19T02:16:52.813 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8579999999999999e-05 2024-04-19T02:16:52.813 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:52.813 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:52.813 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:52.813 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.813 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.813 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:96357 5.0 5:00efce8b:::benchmark_data_smithi121_44835_object96356:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:52.814 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:16:52.814 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 16.627926592000001, 2024-04-19T02:16:52.814 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020937471999999999, 2024-04-19T02:16:52.814 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:52.814 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.814 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:52.814 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:52.814 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:52.814 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 96357 2024-04-19T02:16:52.814 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.814 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:52.814 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.814 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:52.814 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:16:52.815 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:52.815 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.815 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.815 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:52.815 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:16:52.815 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:52.815 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.815 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.815 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:52.815 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093472+0000", 2024-04-19T02:16:52.815 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:52.815 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.815 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.816 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:52.816 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093513+0000", 2024-04-19T02:16:52.816 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0213000000000003e-05 2024-04-19T02:16:52.816 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.816 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.816 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:52.816 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093519+0000", 2024-04-19T02:16:52.816 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.066e-06 2024-04-19T02:16:52.816 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.816 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.816 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.816 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093525+0000", 2024-04-19T02:16:52.816 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.8170000000000004e-06 2024-04-19T02:16:52.816 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.816 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.817 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:52.817 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103412+0000", 2024-04-19T02:16:52.817 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0098872739999999997 2024-04-19T02:16:52.817 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.817 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.817 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:52.817 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103551+0000", 2024-04-19T02:16:52.817 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000139295 2024-04-19T02:16:52.817 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.817 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.817 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:52.817 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103701+0000", 2024-04-19T02:16:52.817 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014954599999999999 2024-04-19T02:16:52.817 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.817 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.818 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:52.818 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.108849+0000", 2024-04-19T02:16:52.818 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0051487199999999999 2024-04-19T02:16:52.818 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.818 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.818 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:52.818 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114355+0000", 2024-04-19T02:16:52.818 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0055052529999999999 2024-04-19T02:16:52.818 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.818 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.818 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:52.818 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114379+0000", 2024-04-19T02:16:52.818 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4275000000000001e-05 2024-04-19T02:16:52.818 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.819 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.819 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:52.819 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114410+0000", 2024-04-19T02:16:52.819 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1356999999999998e-05 2024-04-19T02:16:52.819 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:52.819 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:52.819 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:52.819 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.819 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.819 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:104431 5.8 5:14818e19:::benchmark_data_smithi121_44835_object104430:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T02:16:52.819 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:16:52.819 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 12.510014067, 2024-04-19T02:16:52.819 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022149528000000002, 2024-04-19T02:16:52.819 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:52.819 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.820 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:52.820 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:52.820 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:52.820 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 104431 2024-04-19T02:16:52.820 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.820 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:52.820 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.820 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:52.820 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:16:52.820 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:52.820 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.820 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.820 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:52.820 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:16:52.820 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:52.821 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.821 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.821 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:52.821 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211384+0000", 2024-04-19T02:16:52.821 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:52.821 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.821 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.821 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:52.821 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211458+0000", 2024-04-19T02:16:52.821 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3311000000000003e-05 2024-04-19T02:16:52.821 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.821 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.821 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:52.821 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211471+0000", 2024-04-19T02:16:52.821 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.3308e-05 2024-04-19T02:16:52.822 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.822 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.822 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.822 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211479+0000", 2024-04-19T02:16:52.822 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0909999999999993e-06 2024-04-19T02:16:52.822 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.822 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.822 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:52.822 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.221821+0000", 2024-04-19T02:16:52.822 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010341596999999999 2024-04-19T02:16:52.822 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.822 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.822 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:52.822 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.221966+0000", 2024-04-19T02:16:52.823 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000145167 2024-04-19T02:16:52.823 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.823 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.823 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:52.823 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.222077+0000", 2024-04-19T02:16:52.823 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011128000000000001 2024-04-19T02:16:52.823 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.823 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.823 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:52.823 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.228126+0000", 2024-04-19T02:16:52.823 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0060486710000000003 2024-04-19T02:16:52.823 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.823 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.823 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:52.823 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233449+0000", 2024-04-19T02:16:52.823 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0053231370000000004 2024-04-19T02:16:52.824 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.824 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.824 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:52.824 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233498+0000", 2024-04-19T02:16:52.824 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8798999999999998e-05 2024-04-19T02:16:52.824 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.824 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.824 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:52.824 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233535+0000", 2024-04-19T02:16:52.824 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7119000000000002e-05 2024-04-19T02:16:52.824 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:52.824 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:52.824 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:52.824 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.824 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.825 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:114200 5.8 5:1428c006:::benchmark_data_smithi121_44835_object114199:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T02:16:52.825 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:45.082288+0000", 2024-04-19T02:16:52.825 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 7.6391114810000005, 2024-04-19T02:16:52.825 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020551719999999999, 2024-04-19T02:16:52.825 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:52.825 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.825 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:52.825 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:52.825 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:52.825 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 114200 2024-04-19T02:16:52.825 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.825 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:52.825 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.825 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:52.826 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.082288+0000", 2024-04-19T02:16:52.826 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:52.826 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.826 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.826 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:52.826 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.082288+0000", 2024-04-19T02:16:52.826 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:52.826 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.826 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.826 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:52.826 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.082287+0000", 2024-04-19T02:16:52.826 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:52.826 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.826 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.826 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:52.827 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.082345+0000", 2024-04-19T02:16:52.827 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7642999999999997e-05 2024-04-19T02:16:52.827 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.827 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.827 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:52.827 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.082351+0000", 2024-04-19T02:16:52.827 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.2999999999999998e-06 2024-04-19T02:16:52.827 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.827 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.827 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.827 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.082355+0000", 2024-04-19T02:16:52.827 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7890000000000001e-06 2024-04-19T02:16:52.827 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.827 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.827 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:52.828 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.085813+0000", 2024-04-19T02:16:52.828 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.003457636 2024-04-19T02:16:52.828 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.828 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.828 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:52.828 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.085918+0000", 2024-04-19T02:16:52.828 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010485299999999999 2024-04-19T02:16:52.828 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.828 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.828 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:52.828 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.086071+0000", 2024-04-19T02:16:52.828 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00015367199999999999 2024-04-19T02:16:52.828 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.828 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.828 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:52.829 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.092128+0000", 2024-04-19T02:16:52.829 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0060571080000000003 2024-04-19T02:16:52.829 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.829 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.829 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:52.829 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.102784+0000", 2024-04-19T02:16:52.829 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010656116 2024-04-19T02:16:52.829 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.829 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.829 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:52.829 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.102818+0000", 2024-04-19T02:16:52.829 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3661999999999997e-05 2024-04-19T02:16:52.829 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.829 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.829 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:52.830 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.102840+0000", 2024-04-19T02:16:52.830 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1509e-05 2024-04-19T02:16:52.830 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:52.830 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:52.830 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:52.830 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.830 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.830 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:121827 5.e 5:73ab8f20:::benchmark_data_smithi121_44835_object121826:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T02:16:52.830 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:48.926285+0000", 2024-04-19T02:16:52.830 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 3.7951141229999998, 2024-04-19T02:16:52.830 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020626592999999999, 2024-04-19T02:16:52.830 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:52.830 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:52.830 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:52.831 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:52.831 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:52.831 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 121827 2024-04-19T02:16:52.831 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.831 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:52.831 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.831 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:52.831 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.926285+0000", 2024-04-19T02:16:52.831 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:52.831 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.831 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.831 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:52.831 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.926285+0000", 2024-04-19T02:16:52.831 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:52.831 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.832 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.832 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:52.832 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.926285+0000", 2024-04-19T02:16:52.832 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:52.832 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.832 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.832 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:52.832 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.926306+0000", 2024-04-19T02:16:52.832 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.0659e-05 2024-04-19T02:16:52.832 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.832 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.832 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:52.832 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.926310+0000", 2024-04-19T02:16:52.832 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.374e-06 2024-04-19T02:16:52.832 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.833 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.833 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:52.833 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.926313+0000", 2024-04-19T02:16:52.833 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1879999999999998e-06 2024-04-19T02:16:52.833 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.833 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.833 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:52.833 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.930441+0000", 2024-04-19T02:16:52.833 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0041274220000000004 2024-04-19T02:16:52.833 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.833 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.833 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:52.833 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.930534+0000", 2024-04-19T02:16:52.833 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3834999999999999e-05 2024-04-19T02:16:52.833 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.833 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.834 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:52.834 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.930644+0000", 2024-04-19T02:16:52.834 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000110109 2024-04-19T02:16:52.834 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.834 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.834 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:52.834 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.933925+0000", 2024-04-19T02:16:52.834 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0032810349999999999 2024-04-19T02:16:52.834 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.834 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.834 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:52.834 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.946847+0000", 2024-04-19T02:16:52.834 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.012921807 2024-04-19T02:16:52.835 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.835 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.835 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:52.835 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.946875+0000", 2024-04-19T02:16:52.835 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7977e-05 2024-04-19T02:16:52.835 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:52.835 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:52.835 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:52.835 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.946912+0000", 2024-04-19T02:16:52.835 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6604999999999999e-05 2024-04-19T02:16:52.835 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:52.835 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:52.835 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:52.835 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:52.835 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:52.836 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:16:52.837 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:52.836+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:52.838 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:16:52.938 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:52.938+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:53.024 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-04-19T02:16:53.024 INFO:teuthology.orchestra.run.smithi177.stdout: "ops": [ 2024-04-19T02:16:53.024 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.024 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:129995 5.4 e42/16 5:25b9f625:::benchmark_data_smithi121_44835_object129994:head v 42'8054, mlcod=42'8051)", 2024-04-19T02:16:53.024 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:53.023940+0000", 2024-04-19T02:16:53.024 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.00083012600000000004, 2024-04-19T02:16:53.024 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00085511599999999995, 2024-04-19T02:16:53.025 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:53.025 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:53.025 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:53.025 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.025 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:53.025 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.023940+0000", 2024-04-19T02:16:53.025 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:53.025 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.025 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.025 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:53.025 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.023940+0000", 2024-04-19T02:16:53.025 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:53.025 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.025 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.025 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:53.026 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.023939+0000", 2024-04-19T02:16:53.026 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:53.026 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.026 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.026 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:53.026 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.023978+0000", 2024-04-19T02:16:53.026 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.8454999999999997e-05 2024-04-19T02:16:53.026 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.026 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.026 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:53.026 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.023987+0000", 2024-04-19T02:16:53.026 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.7700000000000007e-06 2024-04-19T02:16:53.026 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.026 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.027 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.027 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.023993+0000", 2024-04-19T02:16:53.027 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.003e-06 2024-04-19T02:16:53.027 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.027 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.027 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:53.027 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.024024+0000", 2024-04-19T02:16:53.027 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.1745999999999997e-05 2024-04-19T02:16:53.027 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.027 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.027 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:53.027 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.024041+0000", 2024-04-19T02:16:53.027 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.6535999999999999e-05 2024-04-19T02:16:53.027 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.027 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:53.028 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.028 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.028 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.028 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:129997 5.8 e42/16 5:172c32c8:::benchmark_data_smithi121_44835_object129996:head v 42'8211, mlcod=42'8209)", 2024-04-19T02:16:53.028 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:53.024073+0000", 2024-04-19T02:16:53.028 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.00069639300000000001, 2024-04-19T02:16:53.028 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00079224700000000005, 2024-04-19T02:16:53.028 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:53.028 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:53.028 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:53.028 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.028 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:53.028 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.024073+0000", 2024-04-19T02:16:53.028 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:53.028 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.028 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.029 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:53.029 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.024073+0000", 2024-04-19T02:16:53.029 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:53.029 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.029 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.029 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:53.029 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.024073+0000", 2024-04-19T02:16:53.029 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:53.029 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.029 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.029 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:53.029 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.024132+0000", 2024-04-19T02:16:53.029 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.9058000000000003e-05 2024-04-19T02:16:53.029 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.030 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.030 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:53.030 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.024142+0000", 2024-04-19T02:16:53.030 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0463e-05 2024-04-19T02:16:53.030 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.030 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.030 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.030 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.024149+0000", 2024-04-19T02:16:53.030 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.2230000000000004e-06 2024-04-19T02:16:53.030 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.030 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.030 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:53.030 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.024210+0000", 2024-04-19T02:16:53.030 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.1586000000000003e-05 2024-04-19T02:16:53.031 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.031 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.031 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:53.031 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.024239+0000", 2024-04-19T02:16:53.031 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.8660999999999999e-05 2024-04-19T02:16:53.031 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.031 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:53.031 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.031 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.031 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.031 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:129998 5.0 e42/16 5:03d2c590:::benchmark_data_smithi121_44835_object129997:head v 42'8004, mlcod=42'8002)", 2024-04-19T02:16:53.031 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:53.024168+0000", 2024-04-19T02:16:53.031 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.00060178399999999996, 2024-04-19T02:16:53.031 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000757346, 2024-04-19T02:16:53.032 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:53.032 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:53.032 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:53.032 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.032 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:53.032 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.024168+0000", 2024-04-19T02:16:53.032 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:53.032 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.032 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.032 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:53.032 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.024168+0000", 2024-04-19T02:16:53.032 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:53.032 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.032 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.032 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:53.033 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.024168+0000", 2024-04-19T02:16:53.033 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:53.033 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.033 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.033 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:53.033 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.024243+0000", 2024-04-19T02:16:53.033 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.5238e-05 2024-04-19T02:16:53.033 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.033 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.033 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:53.033 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.024253+0000", 2024-04-19T02:16:53.033 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.7219999999999994e-06 2024-04-19T02:16:53.033 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.033 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.034 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.034 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.024258+0000", 2024-04-19T02:16:53.034 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.8619999999999999e-06 2024-04-19T02:16:53.034 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.034 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.034 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:53.034 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.024301+0000", 2024-04-19T02:16:53.034 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.2437e-05 2024-04-19T02:16:53.034 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.034 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.034 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:53.034 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.024320+0000", 2024-04-19T02:16:53.034 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.9117999999999999e-05 2024-04-19T02:16:53.034 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.035 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:53.035 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.035 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.035 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.035 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:129993 5.7 e42/16 5:ef388394:::benchmark_data_smithi121_44835_object129992:head v 42'8098, mlcod=42'8096)", 2024-04-19T02:16:53.035 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:53.022852+0000", 2024-04-19T02:16:53.035 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.001918182, 2024-04-19T02:16:53.035 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0021321859999999999, 2024-04-19T02:16:53.035 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:53.035 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:53.035 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:53.035 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.035 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:53.035 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.022852+0000", 2024-04-19T02:16:53.035 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:53.036 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.036 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.036 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:53.036 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.022852+0000", 2024-04-19T02:16:53.036 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:53.036 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.036 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.036 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:53.036 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.022851+0000", 2024-04-19T02:16:53.036 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:53.036 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.036 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.036 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:53.036 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.022908+0000", 2024-04-19T02:16:53.036 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.7095000000000001e-05 2024-04-19T02:16:53.037 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.037 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.037 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:53.037 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.022916+0000", 2024-04-19T02:16:53.037 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.7810000000000005e-06 2024-04-19T02:16:53.037 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.037 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.037 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.037 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.022922+0000", 2024-04-19T02:16:53.037 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.5430000000000001e-06 2024-04-19T02:16:53.037 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.037 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.037 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:53.037 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.022959+0000", 2024-04-19T02:16:53.038 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.7543000000000003e-05 2024-04-19T02:16:53.038 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.038 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.038 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:53.038 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.022974+0000", 2024-04-19T02:16:53.038 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.4724e-05 2024-04-19T02:16:53.038 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.038 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:53.038 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.038 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.038 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.038 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:129999 5.5 5:a502f22f:::benchmark_data_smithi121_44835_object129998:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T02:16:53.039 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:53.023645+0000", 2024-04-19T02:16:53.039 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0011246819999999999, 2024-04-19T02:16:53.039 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0014040669999999999, 2024-04-19T02:16:53.039 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:53.039 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:53.039 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:53.039 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:53.039 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:53.039 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 129999 2024-04-19T02:16:53.039 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.039 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:53.039 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.039 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:53.039 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.023645+0000", 2024-04-19T02:16:53.040 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:53.040 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.040 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.040 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:53.040 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.023645+0000", 2024-04-19T02:16:53.040 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:53.040 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.040 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.040 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:53.040 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.023644+0000", 2024-04-19T02:16:53.040 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:53.040 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.040 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.040 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:53.041 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.023702+0000", 2024-04-19T02:16:53.041 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.7766999999999998e-05 2024-04-19T02:16:53.041 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.041 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.041 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:53.041 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.023710+0000", 2024-04-19T02:16:53.041 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.5510000000000002e-06 2024-04-19T02:16:53.041 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.041 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.041 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.041 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.023715+0000", 2024-04-19T02:16:53.041 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.3079999999999998e-06 2024-04-19T02:16:53.041 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.041 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.042 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:53.042 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.023743+0000", 2024-04-19T02:16:53.042 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.8581e-05 2024-04-19T02:16:53.042 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.042 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.042 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:53.042 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.023838+0000", 2024-04-19T02:16:53.042 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.4921999999999997e-05 2024-04-19T02:16:53.042 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.042 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.042 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:53.042 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.023939+0000", 2024-04-19T02:16:53.042 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000100901 2024-04-19T02:16:53.043 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.043 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:53.043 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.043 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.043 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.043 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:129994 5.b e42/16 5:d0c932e4:::benchmark_data_smithi121_44835_object129993:head v 42'8101, mlcod=42'8099)", 2024-04-19T02:16:53.043 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:53.023837+0000", 2024-04-19T02:16:53.043 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.00093260399999999996, 2024-04-19T02:16:53.043 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.001284596, 2024-04-19T02:16:53.043 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:53.043 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:53.043 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:53.043 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.043 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:53.043 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.023837+0000", 2024-04-19T02:16:53.044 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:53.044 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.044 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.044 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:53.044 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.023837+0000", 2024-04-19T02:16:53.044 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:53.044 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.044 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.044 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:53.044 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.023837+0000", 2024-04-19T02:16:53.044 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:53.044 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.044 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.044 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:53.045 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.023908+0000", 2024-04-19T02:16:53.045 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.1006000000000004e-05 2024-04-19T02:16:53.045 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.045 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.045 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:53.045 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.023921+0000", 2024-04-19T02:16:53.045 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.3525e-05 2024-04-19T02:16:53.045 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.045 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.045 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.045 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.023929+0000", 2024-04-19T02:16:53.045 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.6850000000000001e-06 2024-04-19T02:16:53.045 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.045 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.045 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:53.046 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.023967+0000", 2024-04-19T02:16:53.046 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.8352000000000001e-05 2024-04-19T02:16:53.046 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.046 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.046 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:53.046 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.023984+0000", 2024-04-19T02:16:53.046 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.6948000000000001e-05 2024-04-19T02:16:53.046 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.046 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:53.046 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.046 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.046 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2024-04-19T02:16:53.046 INFO:teuthology.orchestra.run.smithi177.stdout: "num_ops": 6 2024-04-19T02:16:53.046 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-04-19T02:16:53.048 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 58 16 130019 130003 140.078 123.875 0.00478882 0.00713675 2024-04-19T02:16:53.048 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:53.048+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:53.049 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:16:53.149 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:53.149+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:53.168 INFO:teuthology.orchestra.run.smithi121.stderr:noscrub is set 2024-04-19T02:16:53.237 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-04-19T02:16:53.237 INFO:teuthology.orchestra.run.smithi177.stdout: "ops": [], 2024-04-19T02:16:53.237 INFO:teuthology.orchestra.run.smithi177.stdout: "complaint_time": 30, 2024-04-19T02:16:53.237 INFO:teuthology.orchestra.run.smithi177.stdout: "num_blocked_ops": 0 2024-04-19T02:16:53.238 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-04-19T02:16:53.250 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:53.250+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:53.254 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:16:53.350 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:53.350+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:53.442 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-04-19T02:16:53.442 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 20, 2024-04-19T02:16:53.442 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 600, 2024-04-19T02:16:53.442 INFO:teuthology.orchestra.run.smithi177.stdout: "ops": [ 2024-04-19T02:16:53.442 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.442 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:61815 5.c 5:3ca8a794:::benchmark_data_smithi121_44835_object61814:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:53.442 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:17.482110+0000", 2024-04-19T02:16:53.442 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 35.958190223999999, 2024-04-19T02:16:53.442 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.021577559999999999, 2024-04-19T02:16:53.442 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:53.443 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:53.443 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:53.443 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:53.443 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:53.443 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 61815 2024-04-19T02:16:53.443 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.443 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:53.443 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.443 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:53.443 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482110+0000", 2024-04-19T02:16:53.443 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:53.443 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.443 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.443 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:53.443 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482110+0000", 2024-04-19T02:16:53.444 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:53.444 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.444 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.444 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:53.444 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482109+0000", 2024-04-19T02:16:53.444 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:53.444 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.444 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.444 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:53.444 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482197+0000", 2024-04-19T02:16:53.444 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.7405999999999996e-05 2024-04-19T02:16:53.444 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.444 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.444 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:53.445 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482206+0000", 2024-04-19T02:16:53.445 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.0010000000000007e-06 2024-04-19T02:16:53.445 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.445 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.445 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.445 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482211+0000", 2024-04-19T02:16:53.445 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.4569999999999996e-06 2024-04-19T02:16:53.445 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.445 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.445 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:53.445 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.489465+0000", 2024-04-19T02:16:53.445 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.007253776 2024-04-19T02:16:53.445 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.445 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.445 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:53.446 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.489582+0000", 2024-04-19T02:16:53.446 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00011669500000000001 2024-04-19T02:16:53.446 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.446 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.446 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:53.446 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.489684+0000", 2024-04-19T02:16:53.446 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000102533 2024-04-19T02:16:53.446 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.446 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.446 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:53.446 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.491836+0000", 2024-04-19T02:16:53.446 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0021516759999999999 2024-04-19T02:16:53.446 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.446 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.446 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:53.447 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503615+0000", 2024-04-19T02:16:53.447 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.011778906 2024-04-19T02:16:53.447 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.447 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.447 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:53.447 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503652+0000", 2024-04-19T02:16:53.447 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6622999999999998e-05 2024-04-19T02:16:53.447 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.447 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.447 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:53.447 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503688+0000", 2024-04-19T02:16:53.447 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6127000000000002e-05 2024-04-19T02:16:53.447 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.447 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:53.448 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.448 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.448 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.448 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:78247 5.c 5:3efb1468:::benchmark_data_smithi121_44835_object78246:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:53.448 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.116347+0000", 2024-04-19T02:16:53.448 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 26.323953168999999, 2024-04-19T02:16:53.448 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.032194436999999999, 2024-04-19T02:16:53.448 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:53.448 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:53.448 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:53.448 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:53.448 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:53.448 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 78247 2024-04-19T02:16:53.448 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.449 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:53.449 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.449 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:53.449 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116347+0000", 2024-04-19T02:16:53.449 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:53.449 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.449 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.449 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:53.449 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116347+0000", 2024-04-19T02:16:53.449 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:53.449 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.449 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.449 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:53.449 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116346+0000", 2024-04-19T02:16:53.450 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:53.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.450 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.450 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:53.450 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116370+0000", 2024-04-19T02:16:53.450 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.3892000000000001e-05 2024-04-19T02:16:53.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.450 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.450 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:53.450 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116385+0000", 2024-04-19T02:16:53.450 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.5162e-05 2024-04-19T02:16:53.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.450 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.450 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.451 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116394+0000", 2024-04-19T02:16:53.451 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.8000000000000004e-06 2024-04-19T02:16:53.451 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.451 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.451 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:53.451 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124856+0000", 2024-04-19T02:16:53.451 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0084622169999999993 2024-04-19T02:16:53.451 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.451 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.451 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:53.451 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124966+0000", 2024-04-19T02:16:53.451 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000109747 2024-04-19T02:16:53.451 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.451 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.451 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:53.452 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125216+0000", 2024-04-19T02:16:53.452 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000249545 2024-04-19T02:16:53.452 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.452 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.452 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:53.452 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.131713+0000", 2024-04-19T02:16:53.452 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0064972370000000003 2024-04-19T02:16:53.452 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.452 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.452 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:53.452 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148323+0000", 2024-04-19T02:16:53.452 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016609641000000001 2024-04-19T02:16:53.452 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.452 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.452 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:53.453 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148359+0000", 2024-04-19T02:16:53.453 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6412000000000003e-05 2024-04-19T02:16:53.453 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.453 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.453 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:53.453 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148542+0000", 2024-04-19T02:16:53.453 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00018265600000000001 2024-04-19T02:16:53.453 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.453 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:53.453 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.453 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.453 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.453 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:78248 5.c 5:30b7cc74:::benchmark_data_smithi121_44835_object78247:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:53.453 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.116471+0000", 2024-04-19T02:16:53.453 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 26.323829667999998, 2024-04-19T02:16:53.454 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.032127452000000001, 2024-04-19T02:16:53.454 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:53.454 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:53.454 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:53.454 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:53.454 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:53.454 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 78248 2024-04-19T02:16:53.454 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.454 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:53.454 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.454 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:53.454 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116471+0000", 2024-04-19T02:16:53.454 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:53.454 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.454 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.455 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:53.455 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116471+0000", 2024-04-19T02:16:53.455 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:53.455 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.455 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.455 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:53.455 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116470+0000", 2024-04-19T02:16:53.455 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:53.455 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.455 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.455 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:53.455 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116496+0000", 2024-04-19T02:16:53.455 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.5517e-05 2024-04-19T02:16:53.455 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.455 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.456 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:53.456 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116505+0000", 2024-04-19T02:16:53.456 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.9250000000000007e-06 2024-04-19T02:16:53.456 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.456 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.456 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.456 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116516+0000", 2024-04-19T02:16:53.456 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.012e-05 2024-04-19T02:16:53.456 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.456 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.456 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:53.456 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.127803+0000", 2024-04-19T02:16:53.456 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.011287523000000001 2024-04-19T02:16:53.456 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.457 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.457 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:53.457 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.127932+0000", 2024-04-19T02:16:53.457 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012848499999999999 2024-04-19T02:16:53.457 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.457 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.457 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:53.457 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128022+0000", 2024-04-19T02:16:53.457 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.0890000000000006e-05 2024-04-19T02:16:53.457 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.457 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.457 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:53.457 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.131909+0000", 2024-04-19T02:16:53.457 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0038864609999999999 2024-04-19T02:16:53.457 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.458 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.458 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:53.458 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148552+0000", 2024-04-19T02:16:53.458 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016643162999999999 2024-04-19T02:16:53.458 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.458 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.458 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:53.458 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148577+0000", 2024-04-19T02:16:53.458 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.5333999999999998e-05 2024-04-19T02:16:53.458 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.458 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.458 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:53.458 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148598+0000", 2024-04-19T02:16:53.458 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.0687999999999999e-05 2024-04-19T02:16:53.459 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.459 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:53.459 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.459 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.459 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.459 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:78258 5.a 5:549070de:::benchmark_data_smithi121_44835_object78257:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:53.459 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.124295+0000", 2024-04-19T02:16:53.459 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 26.316005122, 2024-04-19T02:16:53.459 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020189543000000001, 2024-04-19T02:16:53.459 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:53.459 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:53.459 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:53.459 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:53.459 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:53.459 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 78258 2024-04-19T02:16:53.460 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.460 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:53.460 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.460 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:53.460 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124295+0000", 2024-04-19T02:16:53.460 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:53.460 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.460 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.460 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:53.460 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124295+0000", 2024-04-19T02:16:53.460 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:53.460 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.460 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.460 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:53.460 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124294+0000", 2024-04-19T02:16:53.461 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:53.461 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.461 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.461 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:53.461 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124358+0000", 2024-04-19T02:16:53.461 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.4040000000000003e-05 2024-04-19T02:16:53.461 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.461 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.461 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:53.461 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124374+0000", 2024-04-19T02:16:53.461 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.5291e-05 2024-04-19T02:16:53.461 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.461 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.461 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.461 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124383+0000", 2024-04-19T02:16:53.462 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.8360000000000004e-06 2024-04-19T02:16:53.462 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.462 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.462 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:53.462 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124908+0000", 2024-04-19T02:16:53.462 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00052415700000000003 2024-04-19T02:16:53.462 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.462 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.462 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:53.462 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125023+0000", 2024-04-19T02:16:53.462 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00011506999999999999 2024-04-19T02:16:53.462 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.462 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.462 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:53.463 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125182+0000", 2024-04-19T02:16:53.463 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00015942500000000001 2024-04-19T02:16:53.463 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.463 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.463 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:53.463 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.129505+0000", 2024-04-19T02:16:53.463 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0043225080000000001 2024-04-19T02:16:53.463 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.463 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.463 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:53.463 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.144379+0000", 2024-04-19T02:16:53.463 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.014874263 2024-04-19T02:16:53.463 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.463 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.464 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:53.464 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.144444+0000", 2024-04-19T02:16:53.464 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.5451999999999996e-05 2024-04-19T02:16:53.464 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.464 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.464 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:53.464 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.144485+0000", 2024-04-19T02:16:53.464 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.0426999999999998e-05 2024-04-19T02:16:53.464 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.464 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:53.464 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.464 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.464 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.464 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:78259 5.4 e31/16 5:2aa344b2:::benchmark_data_smithi121_44835_object78258:head v 31'4849, mlcod=31'4843)", 2024-04-19T02:16:53.464 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.125675+0000", 2024-04-19T02:16:53.465 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 26.314625249999999, 2024-04-19T02:16:53.465 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.022419326, 2024-04-19T02:16:53.465 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:53.465 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:53.465 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:53.465 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.465 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:53.465 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125675+0000", 2024-04-19T02:16:53.465 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:53.465 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.465 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.465 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:53.465 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125675+0000", 2024-04-19T02:16:53.465 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:53.465 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.466 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.466 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:53.466 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125674+0000", 2024-04-19T02:16:53.466 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:53.466 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.466 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.466 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:53.466 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125723+0000", 2024-04-19T02:16:53.466 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.8998000000000001e-05 2024-04-19T02:16:53.466 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.466 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.466 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:53.466 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125733+0000", 2024-04-19T02:16:53.466 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.1379999999999996e-06 2024-04-19T02:16:53.467 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.467 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.467 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.467 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125740+0000", 2024-04-19T02:16:53.467 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.0779999999999998e-06 2024-04-19T02:16:53.467 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.467 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.467 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:53.467 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.129589+0000", 2024-04-19T02:16:53.467 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0038488910000000001 2024-04-19T02:16:53.467 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.467 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.467 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:53.467 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.129605+0000", 2024-04-19T02:16:53.467 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.6877000000000001e-05 2024-04-19T02:16:53.468 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.468 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.468 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:53.468 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148057+0000", 2024-04-19T02:16:53.468 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.018451624 2024-04-19T02:16:53.468 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.468 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.468 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:53.468 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148094+0000", 2024-04-19T02:16:53.468 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.7327999999999999e-05 2024-04-19T02:16:53.468 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.468 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:53.468 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.468 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.468 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.469 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:78263 5.1 5:8e231862:::benchmark_data_smithi121_44835_object78262:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:53.469 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.128154+0000", 2024-04-19T02:16:53.469 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 26.312146064, 2024-04-19T02:16:53.469 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020882214, 2024-04-19T02:16:53.469 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:53.469 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:53.469 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:53.469 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:53.469 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:53.469 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 78263 2024-04-19T02:16:53.469 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.469 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:53.469 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.469 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:53.469 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128154+0000", 2024-04-19T02:16:53.470 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:53.470 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.470 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.470 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:53.470 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128154+0000", 2024-04-19T02:16:53.470 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:53.470 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.470 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.470 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:53.470 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128153+0000", 2024-04-19T02:16:53.470 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:53.470 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.470 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.470 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:53.471 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128246+0000", 2024-04-19T02:16:53.471 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.302e-05 2024-04-19T02:16:53.471 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.471 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.471 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:53.471 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128263+0000", 2024-04-19T02:16:53.471 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.6753e-05 2024-04-19T02:16:53.471 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.471 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.471 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.471 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128271+0000", 2024-04-19T02:16:53.471 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.2290000000000003e-06 2024-04-19T02:16:53.471 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.471 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.471 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:53.471 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128459+0000", 2024-04-19T02:16:53.472 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00018772 2024-04-19T02:16:53.472 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.472 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.472 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:53.472 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128574+0000", 2024-04-19T02:16:53.472 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00011437700000000001 2024-04-19T02:16:53.472 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.472 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.472 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:53.472 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128696+0000", 2024-04-19T02:16:53.472 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000122831 2024-04-19T02:16:53.472 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.472 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.472 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:53.472 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.130816+0000", 2024-04-19T02:16:53.473 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0021196750000000001 2024-04-19T02:16:53.473 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.473 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.473 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:53.473 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.131859+0000", 2024-04-19T02:16:53.473 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0010434419999999999 2024-04-19T02:16:53.473 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.473 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.473 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:53.473 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148848+0000", 2024-04-19T02:16:53.473 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016988712 2024-04-19T02:16:53.473 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.473 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.473 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:53.473 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148905+0000", 2024-04-19T02:16:53.474 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.6722999999999999e-05 2024-04-19T02:16:53.474 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.474 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.474 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:53.474 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.149036+0000", 2024-04-19T02:16:53.474 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000131567 2024-04-19T02:16:53.474 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.474 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:53.474 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.474 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.474 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.474 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:78271 5.4 e31/16 5:2982d7a6:::benchmark_data_smithi121_44835_object78270:head v 31'4850, mlcod=31'4847)", 2024-04-19T02:16:53.474 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.132554+0000", 2024-04-19T02:16:53.475 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 26.307746529999999, 2024-04-19T02:16:53.475 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020294946000000001, 2024-04-19T02:16:53.475 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:53.475 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:53.475 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:53.475 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.475 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:53.475 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132554+0000", 2024-04-19T02:16:53.475 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:53.475 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.475 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.475 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:53.475 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132554+0000", 2024-04-19T02:16:53.475 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:53.475 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.476 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.476 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:53.476 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132553+0000", 2024-04-19T02:16:53.476 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:53.476 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.476 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.476 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:53.476 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132615+0000", 2024-04-19T02:16:53.476 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.1772000000000004e-05 2024-04-19T02:16:53.476 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.476 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.476 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:53.476 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132620+0000", 2024-04-19T02:16:53.476 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.0939999999999998e-06 2024-04-19T02:16:53.476 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.476 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.477 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.477 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132624+0000", 2024-04-19T02:16:53.477 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.2229999999999999e-06 2024-04-19T02:16:53.477 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.477 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.477 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:53.477 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132649+0000", 2024-04-19T02:16:53.477 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.5352000000000001e-05 2024-04-19T02:16:53.477 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.477 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.477 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:53.477 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132661+0000", 2024-04-19T02:16:53.477 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.1851999999999999e-05 2024-04-19T02:16:53.477 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.477 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.478 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:53.479 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.152820+0000", 2024-04-19T02:16:53.479 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020159369999999999 2024-04-19T02:16:53.479 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.479 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.479 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:53.479 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.152849+0000", 2024-04-19T02:16:53.479 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.868e-05 2024-04-19T02:16:53.479 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.479 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:53.479 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.479 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.479 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.480 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:94191 5.c 5:3155c784:::benchmark_data_smithi121_44835_object94190:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T02:16:53.480 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:34.963381+0000", 2024-04-19T02:16:53.480 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 18.476918845, 2024-04-19T02:16:53.480 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.021414343999999998, 2024-04-19T02:16:53.480 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:53.480 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:53.480 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:53.480 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:53.480 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:53.480 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 94191 2024-04-19T02:16:53.480 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.480 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:53.480 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.480 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:53.480 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.963381+0000", 2024-04-19T02:16:53.481 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:53.481 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.481 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.481 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:53.481 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.963381+0000", 2024-04-19T02:16:53.481 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:53.481 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.481 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.481 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:53.481 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.963381+0000", 2024-04-19T02:16:53.481 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:53.481 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.481 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.481 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:53.481 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.963457+0000", 2024-04-19T02:16:53.482 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.5827000000000004e-05 2024-04-19T02:16:53.482 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.482 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.482 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:53.482 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.963465+0000", 2024-04-19T02:16:53.482 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.2800000000000003e-06 2024-04-19T02:16:53.482 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.482 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.482 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.482 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.963470+0000", 2024-04-19T02:16:53.482 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.2310000000000004e-06 2024-04-19T02:16:53.482 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.482 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.482 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:53.483 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.969469+0000", 2024-04-19T02:16:53.483 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0059987169999999998 2024-04-19T02:16:53.483 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.483 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.483 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:53.483 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.969594+0000", 2024-04-19T02:16:53.483 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012517299999999999 2024-04-19T02:16:53.483 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.483 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.483 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:53.483 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.969759+0000", 2024-04-19T02:16:53.483 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00016459999999999999 2024-04-19T02:16:53.483 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.483 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.484 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:53.484 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.975130+0000", 2024-04-19T02:16:53.484 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0053717410000000002 2024-04-19T02:16:53.484 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.484 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.484 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:53.484 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.984704+0000", 2024-04-19T02:16:53.484 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.009573715 2024-04-19T02:16:53.484 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.484 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.484 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:53.484 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.984758+0000", 2024-04-19T02:16:53.484 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.4039000000000002e-05 2024-04-19T02:16:53.484 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.485 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.485 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:53.485 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.984796+0000", 2024-04-19T02:16:53.485 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.7619e-05 2024-04-19T02:16:53.485 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.485 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:53.485 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.485 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.485 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.485 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:94471 5.6 5:641302c2:::benchmark_data_smithi121_44835_object94470:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:53.485 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:35.112592+0000", 2024-04-19T02:16:53.485 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 18.327708780999998, 2024-04-19T02:16:53.485 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.023525194999999999, 2024-04-19T02:16:53.485 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:53.485 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:53.486 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:53.486 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:53.486 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:53.486 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 94471 2024-04-19T02:16:53.486 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.486 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:53.486 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.486 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:53.486 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.112592+0000", 2024-04-19T02:16:53.486 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:53.486 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.486 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.486 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:53.486 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.112592+0000", 2024-04-19T02:16:53.487 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:53.487 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.487 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.487 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:53.487 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.112591+0000", 2024-04-19T02:16:53.487 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:53.487 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.487 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.487 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:53.487 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.112621+0000", 2024-04-19T02:16:53.487 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.0701999999999998e-05 2024-04-19T02:16:53.487 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.487 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.487 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:53.487 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.112631+0000", 2024-04-19T02:16:53.488 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.3209999999999994e-06 2024-04-19T02:16:53.488 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.488 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.488 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.488 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.112638+0000", 2024-04-19T02:16:53.488 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.187e-06 2024-04-19T02:16:53.488 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.488 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.488 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:53.488 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.113893+0000", 2024-04-19T02:16:53.488 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0012553390000000001 2024-04-19T02:16:53.488 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.488 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.488 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:53.489 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.114012+0000", 2024-04-19T02:16:53.489 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000118638 2024-04-19T02:16:53.489 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.489 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.489 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:53.489 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.114151+0000", 2024-04-19T02:16:53.489 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00013928700000000001 2024-04-19T02:16:53.489 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.489 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.489 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:53.489 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.120607+0000", 2024-04-19T02:16:53.489 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0064559179999999997 2024-04-19T02:16:53.489 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.489 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.490 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:53.490 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136026+0000", 2024-04-19T02:16:53.490 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015418762000000001 2024-04-19T02:16:53.490 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.490 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.490 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:53.490 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136084+0000", 2024-04-19T02:16:53.490 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.8245000000000002e-05 2024-04-19T02:16:53.490 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.490 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.490 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:53.490 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136117+0000", 2024-04-19T02:16:53.490 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.2616000000000001e-05 2024-04-19T02:16:53.490 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.491 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:53.491 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.491 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.491 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.491 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:94468 5.2 e34/16 5:4f406431:::benchmark_data_smithi121_44835_object94467:head v 34'5918, mlcod=34'5914)", 2024-04-19T02:16:53.491 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:35.113059+0000", 2024-04-19T02:16:53.491 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 18.327241497999999, 2024-04-19T02:16:53.491 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.022987177000000001, 2024-04-19T02:16:53.491 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:53.491 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:53.491 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:53.491 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.491 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:53.491 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.113059+0000", 2024-04-19T02:16:53.491 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:53.491 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.492 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.492 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:53.492 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.113059+0000", 2024-04-19T02:16:53.492 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:53.492 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.492 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.492 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:53.492 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.113058+0000", 2024-04-19T02:16:53.492 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:53.492 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.492 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.492 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:53.492 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.113103+0000", 2024-04-19T02:16:53.492 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.4159000000000002e-05 2024-04-19T02:16:53.492 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.493 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.493 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:53.493 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.113110+0000", 2024-04-19T02:16:53.493 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.1049999999999997e-06 2024-04-19T02:16:53.493 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.493 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.493 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.493 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.113115+0000", 2024-04-19T02:16:53.493 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.3229999999999997e-06 2024-04-19T02:16:53.493 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.493 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.493 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:53.493 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.114338+0000", 2024-04-19T02:16:53.493 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.001223179 2024-04-19T02:16:53.494 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.494 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.494 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:53.494 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.114355+0000", 2024-04-19T02:16:53.494 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.6963999999999999e-05 2024-04-19T02:16:53.494 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.494 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.494 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:53.494 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136011+0000", 2024-04-19T02:16:53.494 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.021656102999999999 2024-04-19T02:16:53.494 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.494 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.494 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:53.494 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136046+0000", 2024-04-19T02:16:53.494 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.4802999999999999e-05 2024-04-19T02:16:53.495 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.495 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:53.495 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.495 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.495 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.495 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:94473 5.6 5:6db36ce7:::benchmark_data_smithi121_44835_object94472:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:53.495 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:35.116069+0000", 2024-04-19T02:16:53.495 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 18.324231400999999, 2024-04-19T02:16:53.495 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020111038000000001, 2024-04-19T02:16:53.495 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:53.495 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:53.495 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:53.495 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:53.495 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:53.495 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 94473 2024-04-19T02:16:53.496 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.496 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:53.496 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.496 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:53.496 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116069+0000", 2024-04-19T02:16:53.496 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:53.496 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.496 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.496 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:53.496 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116069+0000", 2024-04-19T02:16:53.496 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:53.496 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.496 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.496 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:53.496 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116067+0000", 2024-04-19T02:16:53.497 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:53.497 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.497 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.497 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:53.497 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116096+0000", 2024-04-19T02:16:53.497 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.9034e-05 2024-04-19T02:16:53.497 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.497 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.497 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:53.497 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116107+0000", 2024-04-19T02:16:53.497 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0543000000000001e-05 2024-04-19T02:16:53.497 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.497 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.497 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.497 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116115+0000", 2024-04-19T02:16:53.498 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.8860000000000004e-06 2024-04-19T02:16:53.498 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.498 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.498 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:53.498 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116281+0000", 2024-04-19T02:16:53.498 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00016668100000000001 2024-04-19T02:16:53.498 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.498 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.498 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:53.498 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116394+0000", 2024-04-19T02:16:53.498 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000112138 2024-04-19T02:16:53.498 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.498 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.498 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:53.498 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.116502+0000", 2024-04-19T02:16:53.499 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000108513 2024-04-19T02:16:53.499 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.499 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.499 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:53.499 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.120647+0000", 2024-04-19T02:16:53.499 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0041448459999999998 2024-04-19T02:16:53.499 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.499 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.499 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:53.499 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136124+0000", 2024-04-19T02:16:53.499 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015476678000000001 2024-04-19T02:16:53.499 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.499 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.499 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:53.499 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136149+0000", 2024-04-19T02:16:53.500 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.5412999999999999e-05 2024-04-19T02:16:53.500 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.500 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.500 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:53.500 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136180+0000", 2024-04-19T02:16:53.500 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.0970999999999999e-05 2024-04-19T02:16:53.500 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.500 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:53.500 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.500 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.500 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.500 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:94581 5.b e35/16 5:dc86d6e9:::benchmark_data_smithi121_44835_object94580:head v 35'5875, mlcod=35'5872)", 2024-04-19T02:16:53.500 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:35.181295+0000", 2024-04-19T02:16:53.500 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 18.259005460000001, 2024-04-19T02:16:53.500 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.02078327, 2024-04-19T02:16:53.501 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:53.501 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:53.501 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:53.501 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.501 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:53.501 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.181295+0000", 2024-04-19T02:16:53.501 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:53.501 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.501 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.501 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:53.501 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.181295+0000", 2024-04-19T02:16:53.501 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:53.501 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.501 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.501 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:53.502 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.181294+0000", 2024-04-19T02:16:53.502 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:53.502 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.502 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.502 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:53.502 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.181321+0000", 2024-04-19T02:16:53.502 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.6588999999999999e-05 2024-04-19T02:16:53.502 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.502 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.502 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:53.502 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.181329+0000", 2024-04-19T02:16:53.502 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.9289999999999998e-06 2024-04-19T02:16:53.502 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.502 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.502 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.503 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.181334+0000", 2024-04-19T02:16:53.503 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.2789999999999998e-06 2024-04-19T02:16:53.503 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.503 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.503 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:53.503 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.186093+0000", 2024-04-19T02:16:53.503 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0047585509999999998 2024-04-19T02:16:53.503 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.503 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.503 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:53.503 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.186111+0000", 2024-04-19T02:16:53.503 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.7901e-05 2024-04-19T02:16:53.503 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.503 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.503 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:53.504 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.202037+0000", 2024-04-19T02:16:53.504 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015926020999999999 2024-04-19T02:16:53.504 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.504 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.504 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:53.504 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.202078+0000", 2024-04-19T02:16:53.504 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.1424999999999997e-05 2024-04-19T02:16:53.504 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.504 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:53.504 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.504 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.504 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.504 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "MOSDPGPushReply(5.1 35/29 [PushReplyOp(5:860e8104:::benchmark_data_smithi121_44835_object52857:head)])", 2024-04-19T02:16:53.504 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:35.719222+0000", 2024-04-19T02:16:53.504 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 17.721078725000002, 2024-04-19T02:16:53.505 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.022063027999999998, 2024-04-19T02:16:53.505 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:53.505 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "reached pg", 2024-04-19T02:16:53.505 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:53.505 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.505 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:53.505 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.719222+0000", 2024-04-19T02:16:53.505 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:53.505 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.505 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.505 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:53.505 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.719222+0000", 2024-04-19T02:16:53.505 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:53.505 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.505 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.505 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:53.506 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.719221+0000", 2024-04-19T02:16:53.506 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967296 2024-04-19T02:16:53.506 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.506 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.506 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:53.506 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.719225+0000", 2024-04-19T02:16:53.506 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.5779999999999999e-06 2024-04-19T02:16:53.506 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.506 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.506 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:53.506 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.719232+0000", 2024-04-19T02:16:53.506 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.1319999999999996e-06 2024-04-19T02:16:53.506 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.506 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.507 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.507 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.719239+0000", 2024-04-19T02:16:53.507 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.8120000000000002e-06 2024-04-19T02:16:53.507 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.507 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.507 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:53.507 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.741004+0000", 2024-04-19T02:16:53.507 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.021764614000000002 2024-04-19T02:16:53.507 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.507 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.507 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:53.507 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.741285+0000", 2024-04-19T02:16:53.507 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000281079 2024-04-19T02:16:53.507 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.507 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:53.508 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.508 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.508 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.508 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:96375 5.1 5:84bae481:::benchmark_data_smithi121_44835_object96374:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:53.508 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:36.105748+0000", 2024-04-19T02:16:53.508 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 17.334552335000001, 2024-04-19T02:16:53.508 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.021551219999999999, 2024-04-19T02:16:53.508 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:53.508 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:53.508 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:53.508 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:53.508 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:53.508 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 96375 2024-04-19T02:16:53.509 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.509 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:53.509 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.509 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:53.509 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.105748+0000", 2024-04-19T02:16:53.509 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:53.509 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.509 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.509 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:53.509 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.105748+0000", 2024-04-19T02:16:53.509 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:53.509 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.509 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.509 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:53.509 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.105747+0000", 2024-04-19T02:16:53.510 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:53.510 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.510 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.510 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:53.510 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.105869+0000", 2024-04-19T02:16:53.510 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000121965 2024-04-19T02:16:53.510 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.510 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.510 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:53.510 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.105879+0000", 2024-04-19T02:16:53.510 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0049e-05 2024-04-19T02:16:53.510 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.510 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.510 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.511 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.105886+0000", 2024-04-19T02:16:53.511 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.0879999999999997e-06 2024-04-19T02:16:53.511 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.511 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.511 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:53.511 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.107778+0000", 2024-04-19T02:16:53.511 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0018912670000000001 2024-04-19T02:16:53.511 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.511 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.511 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:53.511 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.107885+0000", 2024-04-19T02:16:53.511 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000106982 2024-04-19T02:16:53.511 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.511 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.512 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:53.512 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.108016+0000", 2024-04-19T02:16:53.512 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000131581 2024-04-19T02:16:53.512 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.512 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.512 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:53.512 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.110857+0000", 2024-04-19T02:16:53.512 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.002840604 2024-04-19T02:16:53.512 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.512 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.512 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:53.512 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.118745+0000", 2024-04-19T02:16:53.512 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0078886970000000001 2024-04-19T02:16:53.512 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.513 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.513 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:53.513 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.127135+0000", 2024-04-19T02:16:53.513 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0083899939999999996 2024-04-19T02:16:53.513 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.513 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.513 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:53.513 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.127191+0000", 2024-04-19T02:16:53.513 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.5294000000000003e-05 2024-04-19T02:16:53.513 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.513 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.513 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:53.513 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.127299+0000", 2024-04-19T02:16:53.513 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000108439 2024-04-19T02:16:53.513 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.514 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:53.514 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.514 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.514 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.514 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:104186 5.1 5:8759ec67:::benchmark_data_smithi121_44835_object104185:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T02:16:53.514 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:40.086927+0000", 2024-04-19T02:16:53.514 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 13.353373494, 2024-04-19T02:16:53.514 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020306884000000001, 2024-04-19T02:16:53.514 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:53.514 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:53.514 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:53.514 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:53.514 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:53.514 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 104186 2024-04-19T02:16:53.515 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.515 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:53.515 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.515 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:53.515 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086927+0000", 2024-04-19T02:16:53.515 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:53.515 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.515 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.515 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:53.515 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086927+0000", 2024-04-19T02:16:53.515 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:53.515 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.515 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.515 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:53.515 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086926+0000", 2024-04-19T02:16:53.516 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:53.516 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.516 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.516 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:53.516 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086951+0000", 2024-04-19T02:16:53.516 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.5452e-05 2024-04-19T02:16:53.516 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.516 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.516 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:53.516 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086960+0000", 2024-04-19T02:16:53.516 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.1620000000000008e-06 2024-04-19T02:16:53.516 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.516 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.516 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.517 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086966+0000", 2024-04-19T02:16:53.517 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.0290000000000002e-06 2024-04-19T02:16:53.517 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.517 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.517 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:53.517 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.090593+0000", 2024-04-19T02:16:53.517 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0036272079999999998 2024-04-19T02:16:53.517 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.517 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.517 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:53.517 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.090699+0000", 2024-04-19T02:16:53.517 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000106001 2024-04-19T02:16:53.517 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.517 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.517 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:53.518 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.090842+0000", 2024-04-19T02:16:53.518 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00014270900000000001 2024-04-19T02:16:53.518 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.518 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.518 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:53.518 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.094673+0000", 2024-04-19T02:16:53.518 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0038316999999999999 2024-04-19T02:16:53.518 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.518 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.518 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:53.518 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.097494+0000", 2024-04-19T02:16:53.518 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0028205539999999999 2024-04-19T02:16:53.518 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.518 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.519 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:53.519 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.107075+0000", 2024-04-19T02:16:53.519 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0095813870000000002 2024-04-19T02:16:53.519 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.519 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.519 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:53.519 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.107127+0000", 2024-04-19T02:16:53.519 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.1498000000000001e-05 2024-04-19T02:16:53.519 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.519 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.519 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:53.519 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.107234+0000", 2024-04-19T02:16:53.519 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000107058 2024-04-19T02:16:53.519 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.519 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:53.520 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.520 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.520 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.520 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:104187 5.1 5:8636ab61:::benchmark_data_smithi121_44835_object104186:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T02:16:53.520 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:40.086972+0000", 2024-04-19T02:16:53.520 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 13.353328100000001, 2024-04-19T02:16:53.520 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020992607999999999, 2024-04-19T02:16:53.520 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:53.520 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:53.520 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:53.520 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:53.520 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:53.520 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 104187 2024-04-19T02:16:53.520 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.520 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:53.521 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.521 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:53.521 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086972+0000", 2024-04-19T02:16:53.521 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:53.521 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.521 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.521 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:53.521 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086972+0000", 2024-04-19T02:16:53.521 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:53.521 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.521 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.521 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:53.521 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086972+0000", 2024-04-19T02:16:53.521 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:53.522 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.522 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.522 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:53.522 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.087000+0000", 2024-04-19T02:16:53.522 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.8569e-05 2024-04-19T02:16:53.522 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.522 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.522 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:53.522 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.087007+0000", 2024-04-19T02:16:53.522 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.4280000000000001e-06 2024-04-19T02:16:53.522 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.522 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.522 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.522 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.087013+0000", 2024-04-19T02:16:53.523 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.3929999999999996e-06 2024-04-19T02:16:53.523 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.523 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.523 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:53.523 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.092659+0000", 2024-04-19T02:16:53.523 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0056460850000000003 2024-04-19T02:16:53.523 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.523 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.523 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:53.523 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.092780+0000", 2024-04-19T02:16:53.523 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012113200000000001 2024-04-19T02:16:53.523 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.523 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.523 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:53.524 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.092894+0000", 2024-04-19T02:16:53.524 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000113057 2024-04-19T02:16:53.524 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.524 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.524 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:53.524 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.097526+0000", 2024-04-19T02:16:53.524 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0046325940000000003 2024-04-19T02:16:53.524 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.524 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.524 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:53.524 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.097536+0000", 2024-04-19T02:16:53.524 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.4110000000000002e-06 2024-04-19T02:16:53.524 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.524 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.525 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:53.525 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.107809+0000", 2024-04-19T02:16:53.525 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.010273882999999999 2024-04-19T02:16:53.525 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.525 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.525 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:53.525 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.107864+0000", 2024-04-19T02:16:53.525 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.4792e-05 2024-04-19T02:16:53.525 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.525 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.525 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:53.525 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.107965+0000", 2024-04-19T02:16:53.525 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000100641 2024-04-19T02:16:53.525 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.525 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:53.526 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.526 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.526 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.526 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:113448 5.1 5:816781af:::benchmark_data_smithi121_44835_object113447:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T02:16:53.526 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:44.698272+0000", 2024-04-19T02:16:53.526 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 8.7420278919999994, 2024-04-19T02:16:53.526 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.023047332, 2024-04-19T02:16:53.526 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:53.526 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:53.526 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:53.526 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:53.526 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:53.526 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 113448 2024-04-19T02:16:53.526 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.527 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:53.527 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.527 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:53.527 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.698272+0000", 2024-04-19T02:16:53.527 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:53.527 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.527 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.527 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:53.527 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.698272+0000", 2024-04-19T02:16:53.527 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:53.527 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.527 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.527 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:53.527 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.698272+0000", 2024-04-19T02:16:53.528 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:53.528 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.528 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.528 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:53.528 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.698307+0000", 2024-04-19T02:16:53.528 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.4712999999999998e-05 2024-04-19T02:16:53.528 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.528 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.528 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:53.528 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.698322+0000", 2024-04-19T02:16:53.528 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.5427999999999999e-05 2024-04-19T02:16:53.528 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.528 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.528 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.528 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.698328+0000", 2024-04-19T02:16:53.529 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.139e-06 2024-04-19T02:16:53.529 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.529 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.529 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:53.529 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.700548+0000", 2024-04-19T02:16:53.529 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.002219951 2024-04-19T02:16:53.529 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.529 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.529 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:53.529 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.700699+0000", 2024-04-19T02:16:53.529 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000151185 2024-04-19T02:16:53.529 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.529 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.529 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:53.530 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.700844+0000", 2024-04-19T02:16:53.530 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00014434800000000001 2024-04-19T02:16:53.530 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.530 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.530 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:53.530 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.705655+0000", 2024-04-19T02:16:53.530 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.004811503 2024-04-19T02:16:53.530 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.530 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.530 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:53.530 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.705933+0000", 2024-04-19T02:16:53.530 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00027823300000000002 2024-04-19T02:16:53.530 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.531 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.531 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:53.531 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.721130+0000", 2024-04-19T02:16:53.531 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015196708 2024-04-19T02:16:53.531 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.531 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.531 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:53.531 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.721197+0000", 2024-04-19T02:16:53.531 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.6928999999999996e-05 2024-04-19T02:16:53.531 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.531 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.531 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:53.531 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.721320+0000", 2024-04-19T02:16:53.531 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012277499999999999 2024-04-19T02:16:53.531 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.532 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:53.532 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.532 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.532 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.532 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:113660 5.1 5:80c3f0b7:::benchmark_data_smithi121_44835_object113659:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T02:16:53.532 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:44.810899+0000", 2024-04-19T02:16:53.532 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 8.6294012739999992, 2024-04-19T02:16:53.532 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.023870918000000001, 2024-04-19T02:16:53.532 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:53.532 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:53.532 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:53.532 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:53.532 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:53.532 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 113660 2024-04-19T02:16:53.532 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.533 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:53.533 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.533 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:53.533 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.810899+0000", 2024-04-19T02:16:53.533 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:53.533 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.533 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.533 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:53.533 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.810899+0000", 2024-04-19T02:16:53.533 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:53.533 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.533 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.533 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:53.533 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.810898+0000", 2024-04-19T02:16:53.534 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:53.534 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.534 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.534 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:53.534 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.810972+0000", 2024-04-19T02:16:53.534 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.3306000000000006e-05 2024-04-19T02:16:53.534 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.534 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.534 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:53.534 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.810978+0000", 2024-04-19T02:16:53.534 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.319e-06 2024-04-19T02:16:53.534 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.534 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.534 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.535 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.810984+0000", 2024-04-19T02:16:53.535 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.1650000000000003e-06 2024-04-19T02:16:53.535 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.535 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.535 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:53.535 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.820088+0000", 2024-04-19T02:16:53.535 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0091040310000000003 2024-04-19T02:16:53.535 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.535 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.535 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:53.535 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.820245+0000", 2024-04-19T02:16:53.535 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000157155 2024-04-19T02:16:53.535 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.535 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.535 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:53.536 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.820444+0000", 2024-04-19T02:16:53.536 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00019840299999999999 2024-04-19T02:16:53.536 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.536 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.536 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:53.536 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.824507+0000", 2024-04-19T02:16:53.536 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0040632999999999997 2024-04-19T02:16:53.536 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.536 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.536 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:53.536 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.827337+0000", 2024-04-19T02:16:53.536 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0028301429999999998 2024-04-19T02:16:53.536 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.536 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.537 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:53.537 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.834600+0000", 2024-04-19T02:16:53.537 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.007263294 2024-04-19T02:16:53.537 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.537 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.537 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:53.537 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.834654+0000", 2024-04-19T02:16:53.537 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.3508999999999999e-05 2024-04-19T02:16:53.537 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.537 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.537 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:53.537 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.834770+0000", 2024-04-19T02:16:53.537 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000116075 2024-04-19T02:16:53.537 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.537 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:53.538 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.538 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.538 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.538 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:129052 5.1 5:81fcf9a6:::benchmark_data_smithi121_44835_object129051:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T02:16:53.538 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:52.546357+0000", 2024-04-19T02:16:53.538 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.89394287900000002, 2024-04-19T02:16:53.538 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020114360000000001, 2024-04-19T02:16:53.538 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:53.538 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:53.538 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:53.538 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:53.538 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:53.538 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 129052 2024-04-19T02:16:53.538 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.539 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:53.539 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.539 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:53.539 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:52.546357+0000", 2024-04-19T02:16:53.539 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:53.539 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.539 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.539 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:53.539 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:52.546357+0000", 2024-04-19T02:16:53.539 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:53.539 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.539 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.539 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:53.539 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:52.546357+0000", 2024-04-19T02:16:53.540 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:53.540 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.540 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.540 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:53.540 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:52.546411+0000", 2024-04-19T02:16:53.540 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.4737000000000001e-05 2024-04-19T02:16:53.540 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.540 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.540 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:53.540 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:52.546427+0000", 2024-04-19T02:16:53.540 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.5722e-05 2024-04-19T02:16:53.540 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.540 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.540 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.540 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:52.546435+0000", 2024-04-19T02:16:53.541 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.8380000000000002e-06 2024-04-19T02:16:53.541 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.541 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.541 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:53.541 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:52.550064+0000", 2024-04-19T02:16:53.541 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0036286410000000002 2024-04-19T02:16:53.541 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.541 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.541 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:53.541 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:52.550188+0000", 2024-04-19T02:16:53.541 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012434999999999999 2024-04-19T02:16:53.541 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.541 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.541 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:53.542 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:52.550382+0000", 2024-04-19T02:16:53.542 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00019446200000000001 2024-04-19T02:16:53.542 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.542 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.542 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:53.542 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:52.553649+0000", 2024-04-19T02:16:53.542 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0032662699999999999 2024-04-19T02:16:53.542 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.542 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.542 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:53.542 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:52.556721+0000", 2024-04-19T02:16:53.542 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0030726740000000001 2024-04-19T02:16:53.542 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.542 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.543 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:53.543 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:52.566368+0000", 2024-04-19T02:16:53.543 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0096468999999999999 2024-04-19T02:16:53.543 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.543 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.543 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:53.543 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:52.566412+0000", 2024-04-19T02:16:53.543 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.3936000000000001e-05 2024-04-19T02:16:53.543 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.543 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.543 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:53.543 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:52.566472+0000", 2024-04-19T02:16:53.543 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.9608999999999998e-05 2024-04-19T02:16:53.543 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.543 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:53.544 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.544 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.544 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.544 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:130092 5.6 5:65fc2f1e:::benchmark_data_smithi121_44835_object130091:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T02:16:53.544 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:53.069891+0000", 2024-04-19T02:16:53.544 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.37040948200000001, 2024-04-19T02:16:53.544 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.023733942000000001, 2024-04-19T02:16:53.544 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:53.544 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:53.544 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:53.544 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:53.544 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:53.544 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 130092 2024-04-19T02:16:53.544 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.544 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:53.545 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.545 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:53.545 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.069891+0000", 2024-04-19T02:16:53.545 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:53.545 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.545 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.545 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:53.545 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.069891+0000", 2024-04-19T02:16:53.545 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:53.545 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.545 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.545 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:53.545 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.069890+0000", 2024-04-19T02:16:53.545 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:53.545 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.546 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.546 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:53.546 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.069910+0000", 2024-04-19T02:16:53.546 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.0378999999999999e-05 2024-04-19T02:16:53.546 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.546 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.546 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:53.546 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.069919+0000", 2024-04-19T02:16:53.546 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.6629999999999999e-06 2024-04-19T02:16:53.546 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.546 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.546 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.546 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.069926+0000", 2024-04-19T02:16:53.546 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.2509999999999997e-06 2024-04-19T02:16:53.546 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.547 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.547 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:53.547 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.069975+0000", 2024-04-19T02:16:53.547 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.8857999999999999e-05 2024-04-19T02:16:53.547 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.547 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.547 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:53.547 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.070131+0000", 2024-04-19T02:16:53.547 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00015667599999999999 2024-04-19T02:16:53.547 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.547 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.547 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:53.547 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.070290+0000", 2024-04-19T02:16:53.547 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00015898799999999999 2024-04-19T02:16:53.547 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.548 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.548 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:53.548 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.076926+0000", 2024-04-19T02:16:53.548 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0066357079999999997 2024-04-19T02:16:53.548 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.548 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.548 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:53.548 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.093570+0000", 2024-04-19T02:16:53.548 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016643425999999999 2024-04-19T02:16:53.548 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.548 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.548 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:53.548 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.093606+0000", 2024-04-19T02:16:53.548 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6520000000000003e-05 2024-04-19T02:16:53.548 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:53.549 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:53.549 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:53.549 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.093625+0000", 2024-04-19T02:16:53.549 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.8686999999999999e-05 2024-04-19T02:16:53.549 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.549 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:53.549 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.549 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:53.549 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:53.549 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-04-19T02:16:53.551 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:16:53.551 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:53.550+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:53.652 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:53.652+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:53.717 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:16:53.717 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:16:53.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.717 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:131333 5.7 5:ee786fa2:::benchmark_data_smithi121_44835_object131332:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T02:16:53.717 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:53.713636+0000", 2024-04-19T02:16:53.717 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0040062810000000004, 2024-04-19T02:16:53.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040332639999999999, 2024-04-19T02:16:53.718 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:53.718 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:53.718 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:53.718 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:53.718 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:53.718 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 131333 2024-04-19T02:16:53.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.718 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:53.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:53.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.713636+0000", 2024-04-19T02:16:53.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:53.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:53.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.713636+0000", 2024-04-19T02:16:53.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:53.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:53.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.713635+0000", 2024-04-19T02:16:53.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:53.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:53.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.713688+0000", 2024-04-19T02:16:53.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3310999999999998e-05 2024-04-19T02:16:53.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.720 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:53.720 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.713695+0000", 2024-04-19T02:16:53.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.951e-06 2024-04-19T02:16:53.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.720 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.720 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.713701+0000", 2024-04-19T02:16:53.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3550000000000004e-06 2024-04-19T02:16:53.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.720 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:53.721 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.713735+0000", 2024-04-19T02:16:53.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4397999999999998e-05 2024-04-19T02:16:53.721 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.721 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:53.721 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.713822+0000", 2024-04-19T02:16:53.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7151000000000006e-05 2024-04-19T02:16:53.721 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.721 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:53.721 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.713908+0000", 2024-04-19T02:16:53.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5568999999999993e-05 2024-04-19T02:16:53.721 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:53.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.715845+0000", 2024-04-19T02:16:53.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001937313 2024-04-19T02:16:53.722 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:53.722 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:53.722 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:53.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.722 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:131339 5.f 5:f1c396a3:::benchmark_data_smithi121_44835_object131338:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T02:16:53.722 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:53.715070+0000", 2024-04-19T02:16:53.722 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0025714069999999999, 2024-04-19T02:16:53.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026866009999999998, 2024-04-19T02:16:53.723 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:53.723 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:53.723 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:53.723 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:53.723 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:53.723 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 131339 2024-04-19T02:16:53.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.723 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:53.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:53.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.715070+0000", 2024-04-19T02:16:53.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:53.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.724 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:53.724 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.715070+0000", 2024-04-19T02:16:53.724 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:53.724 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.724 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.724 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:53.724 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.715070+0000", 2024-04-19T02:16:53.724 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:53.724 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.724 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.724 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:53.724 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.715133+0000", 2024-04-19T02:16:53.724 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2819999999999998e-05 2024-04-19T02:16:53.724 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.724 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.725 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:53.725 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.715142+0000", 2024-04-19T02:16:53.725 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6989999999999998e-06 2024-04-19T02:16:53.725 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.725 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.725 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.725 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.715150+0000", 2024-04-19T02:16:53.725 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5299999999999999e-06 2024-04-19T02:16:53.725 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.725 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.725 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:53.725 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.715190+0000", 2024-04-19T02:16:53.725 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0012000000000002e-05 2024-04-19T02:16:53.725 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.725 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.726 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:53.726 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.715337+0000", 2024-04-19T02:16:53.726 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014755399999999999 2024-04-19T02:16:53.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.726 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:53.726 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.715485+0000", 2024-04-19T02:16:53.726 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014804900000000001 2024-04-19T02:16:53.726 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:53.726 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:53.726 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:53.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.727 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4549.0:131338 5.3 e43/16 5:cfa49c05:::benchmark_data_smithi121_44835_object131337:head v 43'8226, mlcod=43'8224)", 2024-04-19T02:16:53.727 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:53.716605+0000", 2024-04-19T02:16:53.727 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0010369419999999999, 2024-04-19T02:16:53.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012244420000000001, 2024-04-19T02:16:53.727 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:53.727 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:16:53.727 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:53.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.727 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:53.727 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.716605+0000", 2024-04-19T02:16:53.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:53.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.727 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:53.727 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.716605+0000", 2024-04-19T02:16:53.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:53.728 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.728 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.728 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:53.728 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.716604+0000", 2024-04-19T02:16:53.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:53.728 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.728 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.728 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:53.728 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.716630+0000", 2024-04-19T02:16:53.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5313e-05 2024-04-19T02:16:53.728 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.728 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.728 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:53.728 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.716641+0000", 2024-04-19T02:16:53.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1681e-05 2024-04-19T02:16:53.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.729 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.716648+0000", 2024-04-19T02:16:53.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5089999999999999e-06 2024-04-19T02:16:53.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:53.729 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.716685+0000", 2024-04-19T02:16:53.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7457999999999999e-05 2024-04-19T02:16:53.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:53.730 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.716706+0000", 2024-04-19T02:16:53.730 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0205999999999999e-05 2024-04-19T02:16:53.730 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:53.730 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:53.730 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:53.730 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.730 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.730 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:131341 5.2 5:4eda67eb:::benchmark_data_smithi121_44835_object131340:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T02:16:53.730 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:53.716545+0000", 2024-04-19T02:16:53.730 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0010971620000000001, 2024-04-19T02:16:53.730 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001346571, 2024-04-19T02:16:53.730 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:53.730 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:53.731 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:53.731 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:53.731 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:53.731 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 131341 2024-04-19T02:16:53.731 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.731 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:53.731 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.731 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:53.731 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.716545+0000", 2024-04-19T02:16:53.731 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:53.731 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.731 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.731 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:53.731 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.716545+0000", 2024-04-19T02:16:53.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:53.732 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.732 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.732 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:53.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.716544+0000", 2024-04-19T02:16:53.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:53.732 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.732 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.732 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:53.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.716649+0000", 2024-04-19T02:16:53.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105431 2024-04-19T02:16:53.732 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.732 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.732 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:53.733 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.716657+0000", 2024-04-19T02:16:53.733 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3030000000000002e-06 2024-04-19T02:16:53.733 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.733 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.733 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.716663+0000", 2024-04-19T02:16:53.733 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2489999999999998e-06 2024-04-19T02:16:53.733 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.733 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:53.733 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.716692+0000", 2024-04-19T02:16:53.733 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9298e-05 2024-04-19T02:16:53.733 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.734 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:53.734 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.716813+0000", 2024-04-19T02:16:53.734 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012043 2024-04-19T02:16:53.734 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.734 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.734 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:53.734 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.716946+0000", 2024-04-19T02:16:53.734 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013322400000000001 2024-04-19T02:16:53.734 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:53.734 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:53.734 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:53.735 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.735 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.735 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4549.0:131336 5.5 e43/16 5:a187c571:::benchmark_data_smithi121_44835_object131335:head v 43'8251, mlcod=43'8249)", 2024-04-19T02:16:53.735 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:53.716657+0000", 2024-04-19T02:16:53.735 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00098474200000000004, 2024-04-19T02:16:53.735 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013060420000000001, 2024-04-19T02:16:53.735 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:53.735 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:16:53.735 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:53.735 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.735 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:53.735 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.716657+0000", 2024-04-19T02:16:53.735 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:53.735 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.736 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.736 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:53.736 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.716657+0000", 2024-04-19T02:16:53.736 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:53.736 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.736 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.736 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:53.736 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.716657+0000", 2024-04-19T02:16:53.736 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:53.736 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.736 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.736 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:53.736 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.716682+0000", 2024-04-19T02:16:53.736 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5493000000000001e-05 2024-04-19T02:16:53.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.737 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.737 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:53.737 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.716688+0000", 2024-04-19T02:16:53.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.02e-06 2024-04-19T02:16:53.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.737 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.737 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.737 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.716693+0000", 2024-04-19T02:16:53.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2379999999999999e-06 2024-04-19T02:16:53.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.737 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.737 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:53.737 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.716722+0000", 2024-04-19T02:16:53.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9227999999999999e-05 2024-04-19T02:16:53.738 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.738 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:53.738 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.716738+0000", 2024-04-19T02:16:53.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.643e-05 2024-04-19T02:16:53.738 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:53.738 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:53.738 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:53.738 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.738 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4549.0:131328 5.1 e43/29 5:81caefc2:::benchmark_data_smithi121_44835_object131327:head v 43'8050, mlcod=43'8046)", 2024-04-19T02:16:53.738 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:53.717198+0000", 2024-04-19T02:16:53.738 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00044406699999999998, 2024-04-19T02:16:53.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00082245400000000002, 2024-04-19T02:16:53.739 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:53.739 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:16:53.739 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:53.739 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.739 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:53.739 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.717198+0000", 2024-04-19T02:16:53.739 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:53.739 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.739 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.739 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:53.739 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.717198+0000", 2024-04-19T02:16:53.739 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:53.739 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.739 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.739 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:53.740 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.717197+0000", 2024-04-19T02:16:53.740 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:53.740 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.740 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.740 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:53.740 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.717300+0000", 2024-04-19T02:16:53.740 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010265 2024-04-19T02:16:53.740 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.740 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.740 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:53.740 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.717311+0000", 2024-04-19T02:16:53.740 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1447999999999999e-05 2024-04-19T02:16:53.740 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.740 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.741 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.717318+0000", 2024-04-19T02:16:53.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7379999999999997e-06 2024-04-19T02:16:53.741 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.741 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:53.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.717350+0000", 2024-04-19T02:16:53.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2348999999999998e-05 2024-04-19T02:16:53.741 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.741 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:53.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.717379+0000", 2024-04-19T02:16:53.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8452000000000001e-05 2024-04-19T02:16:53.741 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:53.742 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:53.742 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:53.742 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.742 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.742 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4549.0:131342 5.c e43/16 5:325d7a1b:::benchmark_data_smithi121_44835_object131341:head v 43'8217, mlcod=43'8214)", 2024-04-19T02:16:53.742 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:53.717333+0000", 2024-04-19T02:16:53.742 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00030837300000000002, 2024-04-19T02:16:53.742 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00074351599999999995, 2024-04-19T02:16:53.742 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:53.742 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:16:53.742 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:53.742 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.742 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:53.742 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.717333+0000", 2024-04-19T02:16:53.743 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:53.743 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.743 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.743 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:53.743 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.717333+0000", 2024-04-19T02:16:53.743 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:53.743 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.743 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.743 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:53.743 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.717333+0000", 2024-04-19T02:16:53.743 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:53.743 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.743 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:53.744 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.717364+0000", 2024-04-19T02:16:53.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0689999999999999e-05 2024-04-19T02:16:53.744 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:53.744 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.717384+0000", 2024-04-19T02:16:53.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0480999999999999e-05 2024-04-19T02:16:53.744 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.744 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.717398+0000", 2024-04-19T02:16:53.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4126e-05 2024-04-19T02:16:53.744 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.745 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:53.745 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.717442+0000", 2024-04-19T02:16:53.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3603999999999998e-05 2024-04-19T02:16:53.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.745 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:53.745 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.717459+0000", 2024-04-19T02:16:53.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7005000000000001e-05 2024-04-19T02:16:53.745 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:53.745 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:53.745 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:53.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.745 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4549.0:131340 5.3 e43/16)", 2024-04-19T02:16:53.746 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:53.717415+0000", 2024-04-19T02:16:53.746 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00022682999999999999, 2024-04-19T02:16:53.746 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00071778200000000003, 2024-04-19T02:16:53.746 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:53.746 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-04-19T02:16:53.746 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:53.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.746 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:53.746 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.717415+0000", 2024-04-19T02:16:53.746 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:53.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.746 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:53.746 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.717415+0000", 2024-04-19T02:16:53.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:53.747 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.747 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:53.747 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.717415+0000", 2024-04-19T02:16:53.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:53.747 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.747 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:53.747 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.717448+0000", 2024-04-19T02:16:53.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3284000000000002e-05 2024-04-19T02:16:53.747 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.747 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:53.747 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.717456+0000", 2024-04-19T02:16:53.748 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6820000000000003e-06 2024-04-19T02:16:53.748 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:53.748 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:53.748 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:53.748 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.717461+0000", 2024-04-19T02:16:53.748 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0980000000000001e-06 2024-04-19T02:16:53.748 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:53.748 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:53.748 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:53.748 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:53.748 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-04-19T02:16:53.748 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 8 2024-04-19T02:16:53.748 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:16:53.749 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:16:53.752 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:53.752+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:53.852 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:53.853+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:53.922 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:16:53.922 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-04-19T02:16:53.922 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-04-19T02:16:53.922 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-04-19T02:16:53.922 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:16:53.938 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:16:53.953 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:53.954+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:54.030 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 59 16 132009 131993 139.811 124.375 0.00651307 0.00715005 2024-04-19T02:16:54.054 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:54.055+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:54.114 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:16:54.114 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-04-19T02:16:54.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-04-19T02:16:54.114 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:16:54.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.114 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:54.114 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:16:54.114 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 84.842604894000004, 2024-04-19T02:16:54.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020307345000000001, 2024-04-19T02:16:54.114 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:54.114 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:54.115 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:54.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:54.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:16:54.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:54.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:54.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:16:54.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:54.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:54.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269791+0000", 2024-04-19T02:16:54.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:54.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:54.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269795+0000", 2024-04-19T02:16:54.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5619999999999999e-06 2024-04-19T02:16:54.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:54.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269802+0000", 2024-04-19T02:16:54.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8469999999999998e-06 2024-04-19T02:16:54.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:54.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269807+0000", 2024-04-19T02:16:54.117 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.707e-06 2024-04-19T02:16:54.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.117 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:54.117 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269950+0000", 2024-04-19T02:16:54.117 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000143313 2024-04-19T02:16:54.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.117 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:54.117 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269955+0000", 2024-04-19T02:16:54.117 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4029999999999998e-06 2024-04-19T02:16:54.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.117 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:54.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.283806+0000", 2024-04-19T02:16:54.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013850220999999999 2024-04-19T02:16:54.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:54.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.283896+0000", 2024-04-19T02:16:54.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0261999999999997e-05 2024-04-19T02:16:54.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:54.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284022+0000", 2024-04-19T02:16:54.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012641200000000001 2024-04-19T02:16:54.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:54.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289066+0000", 2024-04-19T02:16:54.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050438490000000004 2024-04-19T02:16:54.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:54.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290011+0000", 2024-04-19T02:16:54.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00094490700000000004 2024-04-19T02:16:54.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:54.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290054+0000", 2024-04-19T02:16:54.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.337e-05 2024-04-19T02:16:54.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:54.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290099+0000", 2024-04-19T02:16:54.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4987999999999997e-05 2024-04-19T02:16:54.120 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:54.120 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:54.120 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:54.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.120 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:54.120 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:16:54.120 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 84.842526964000001, 2024-04-19T02:16:54.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020331023, 2024-04-19T02:16:54.120 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:54.120 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:54.121 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:54.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:54.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:16:54.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:54.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:54.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:16:54.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:54.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:54.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269869+0000", 2024-04-19T02:16:54.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:54.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:54.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269873+0000", 2024-04-19T02:16:54.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0219999999999998e-06 2024-04-19T02:16:54.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:54.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269881+0000", 2024-04-19T02:16:54.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.79e-06 2024-04-19T02:16:54.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:54.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269887+0000", 2024-04-19T02:16:54.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7899999999999996e-06 2024-04-19T02:16:54.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.123 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:54.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269983+0000", 2024-04-19T02:16:54.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6057000000000005e-05 2024-04-19T02:16:54.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.123 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:54.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269986+0000", 2024-04-19T02:16:54.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9220000000000001e-06 2024-04-19T02:16:54.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.123 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:54.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284350+0000", 2024-04-19T02:16:54.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014364335000000001 2024-04-19T02:16:54.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:54.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284664+0000", 2024-04-19T02:16:54.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000313646 2024-04-19T02:16:54.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:54.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284794+0000", 2024-04-19T02:16:54.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129839 2024-04-19T02:16:54.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.125 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:54.125 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289107+0000", 2024-04-19T02:16:54.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0043127060000000004 2024-04-19T02:16:54.125 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.125 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.125 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:54.125 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290108+0000", 2024-04-19T02:16:54.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0010010590000000001 2024-04-19T02:16:54.125 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.125 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.125 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:54.125 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290144+0000", 2024-04-19T02:16:54.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6709999999999999e-05 2024-04-19T02:16:54.125 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.125 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.126 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:54.126 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290201+0000", 2024-04-19T02:16:54.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6654999999999999e-05 2024-04-19T02:16:54.126 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:54.126 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:54.126 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:54.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.126 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:54.126 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:16:54.126 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 84.842484623000004, 2024-04-19T02:16:54.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020507241999999998, 2024-04-19T02:16:54.126 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:54.126 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:54.126 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:54.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:54.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:16:54.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:54.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:54.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:16:54.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:54.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:54.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:16:54.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:54.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:54.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269915+0000", 2024-04-19T02:16:54.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.472e-06 2024-04-19T02:16:54.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:54.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269928+0000", 2024-04-19T02:16:54.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2979000000000001e-05 2024-04-19T02:16:54.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:54.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269935+0000", 2024-04-19T02:16:54.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8859999999999998e-06 2024-04-19T02:16:54.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.129 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:54.129 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270009+0000", 2024-04-19T02:16:54.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3429000000000005e-05 2024-04-19T02:16:54.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.129 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:54.129 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270013+0000", 2024-04-19T02:16:54.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2590000000000002e-06 2024-04-19T02:16:54.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.129 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:54.129 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285375+0000", 2024-04-19T02:16:54.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015362275999999999 2024-04-19T02:16:54.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.130 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:54.130 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285451+0000", 2024-04-19T02:16:54.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5338000000000003e-05 2024-04-19T02:16:54.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.130 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:54.130 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285562+0000", 2024-04-19T02:16:54.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000111285 2024-04-19T02:16:54.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.130 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:54.130 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289134+0000", 2024-04-19T02:16:54.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035719670000000001 2024-04-19T02:16:54.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:54.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290341+0000", 2024-04-19T02:16:54.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012074500000000001 2024-04-19T02:16:54.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:54.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290383+0000", 2024-04-19T02:16:54.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1386e-05 2024-04-19T02:16:54.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:54.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290419+0000", 2024-04-19T02:16:54.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6884000000000001e-05 2024-04-19T02:16:54.132 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:54.132 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:54.132 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:54.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.132 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:54.132 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269945+0000", 2024-04-19T02:16:54.132 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 84.842452041000001, 2024-04-19T02:16:54.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019709098000000001, 2024-04-19T02:16:54.132 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:54.132 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:54.132 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:54.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.132 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:54.133 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269945+0000", 2024-04-19T02:16:54.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:54.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.133 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:54.133 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269945+0000", 2024-04-19T02:16:54.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:54.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.133 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:54.133 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269944+0000", 2024-04-19T02:16:54.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:54.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.133 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:54.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269965+0000", 2024-04-19T02:16:54.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0803999999999999e-05 2024-04-19T02:16:54.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:54.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269973+0000", 2024-04-19T02:16:54.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3560000000000004e-06 2024-04-19T02:16:54.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:54.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269982+0000", 2024-04-19T02:16:54.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9600000000000006e-06 2024-04-19T02:16:54.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:54.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270014+0000", 2024-04-19T02:16:54.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2913000000000001e-05 2024-04-19T02:16:54.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:54.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270018+0000", 2024-04-19T02:16:54.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2200000000000001e-06 2024-04-19T02:16:54.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:54.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278999+0000", 2024-04-19T02:16:54.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0089818009999999993 2024-04-19T02:16:54.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.136 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:54.136 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.279088+0000", 2024-04-19T02:16:54.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8988999999999998e-05 2024-04-19T02:16:54.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.136 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:54.136 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.280160+0000", 2024-04-19T02:16:54.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001071572 2024-04-19T02:16:54.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.136 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:54.136 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288342+0000", 2024-04-19T02:16:54.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.008182468 2024-04-19T02:16:54.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:54.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289545+0000", 2024-04-19T02:16:54.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012026739999999999 2024-04-19T02:16:54.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:54.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289608+0000", 2024-04-19T02:16:54.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2904999999999995e-05 2024-04-19T02:16:54.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:54.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289654+0000", 2024-04-19T02:16:54.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5850000000000003e-05 2024-04-19T02:16:54.137 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:54.138 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:54.138 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:54.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.138 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:54.138 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:16:54.138 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 84.842406362999995, 2024-04-19T02:16:54.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022007204999999998, 2024-04-19T02:16:54.138 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:54.138 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:54.138 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:54.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.138 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:54.138 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:16:54.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:54.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:54.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:16:54.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:54.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:54.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269990+0000", 2024-04-19T02:16:54.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:54.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:54.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269999+0000", 2024-04-19T02:16:54.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9539999999999993e-06 2024-04-19T02:16:54.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:54.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270006+0000", 2024-04-19T02:16:54.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.216e-06 2024-04-19T02:16:54.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:54.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270012+0000", 2024-04-19T02:16:54.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5049999999999998e-06 2024-04-19T02:16:54.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:54.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270058+0000", 2024-04-19T02:16:54.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.634e-05 2024-04-19T02:16:54.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:54.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270064+0000", 2024-04-19T02:16:54.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0669999999999997e-06 2024-04-19T02:16:54.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:54.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287159+0000", 2024-04-19T02:16:54.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017095086999999998 2024-04-19T02:16:54.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:54.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287254+0000", 2024-04-19T02:16:54.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4716000000000006e-05 2024-04-19T02:16:54.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.142 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:54.142 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287389+0000", 2024-04-19T02:16:54.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013511900000000001 2024-04-19T02:16:54.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.142 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:54.142 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290481+0000", 2024-04-19T02:16:54.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030920169999999999 2024-04-19T02:16:54.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.142 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:54.143 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291931+0000", 2024-04-19T02:16:54.143 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001450118 2024-04-19T02:16:54.143 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.143 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.143 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:54.143 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291960+0000", 2024-04-19T02:16:54.143 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9096000000000001e-05 2024-04-19T02:16:54.143 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.143 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.143 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:54.143 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291998+0000", 2024-04-19T02:16:54.143 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7514e-05 2024-04-19T02:16:54.143 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:54.143 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:54.144 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:54.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.144 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:54.144 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:54.144 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 84.842345792000003, 2024-04-19T02:16:54.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020759494999999999, 2024-04-19T02:16:54.144 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:54.144 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:54.144 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:54.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.144 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:54.144 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:54.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:54.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:54.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:54.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:54.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:54.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:54.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:54.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:54.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270054+0000", 2024-04-19T02:16:54.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.27e-06 2024-04-19T02:16:54.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:54.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270061+0000", 2024-04-19T02:16:54.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1289999999999998e-06 2024-04-19T02:16:54.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:54.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270067+0000", 2024-04-19T02:16:54.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.207e-06 2024-04-19T02:16:54.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:54.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270105+0000", 2024-04-19T02:16:54.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7549999999999998e-05 2024-04-19T02:16:54.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.147 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:54.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270112+0000", 2024-04-19T02:16:54.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3200000000000002e-06 2024-04-19T02:16:54.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.147 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:54.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282454+0000", 2024-04-19T02:16:54.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012341569 2024-04-19T02:16:54.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.147 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:54.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282740+0000", 2024-04-19T02:16:54.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000286481 2024-04-19T02:16:54.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:54.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282879+0000", 2024-04-19T02:16:54.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013887799999999999 2024-04-19T02:16:54.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:54.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290325+0000", 2024-04-19T02:16:54.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074459779999999998 2024-04-19T02:16:54.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:54.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290759+0000", 2024-04-19T02:16:54.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000433688 2024-04-19T02:16:54.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:54.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290789+0000", 2024-04-19T02:16:54.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9960000000000001e-05 2024-04-19T02:16:54.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:54.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290811+0000", 2024-04-19T02:16:54.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1965999999999999e-05 2024-04-19T02:16:54.149 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:54.149 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:54.149 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:54.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.150 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:54.150 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:16:54.150 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 84.842295586999995, 2024-04-19T02:16:54.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020837887999999999, 2024-04-19T02:16:54.150 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:54.150 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:54.150 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:54.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:54.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:16:54.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:54.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:54.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:16:54.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:54.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:54.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:16:54.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:54.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:54.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270109+0000", 2024-04-19T02:16:54.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3110000000000006e-06 2024-04-19T02:16:54.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:54.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270117+0000", 2024-04-19T02:16:54.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0479999999999999e-06 2024-04-19T02:16:54.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:54.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270123+0000", 2024-04-19T02:16:54.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5500000000000002e-06 2024-04-19T02:16:54.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:54.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270150+0000", 2024-04-19T02:16:54.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7712000000000002e-05 2024-04-19T02:16:54.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:54.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270153+0000", 2024-04-19T02:16:54.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6089999999999999e-06 2024-04-19T02:16:54.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:54.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285958+0000", 2024-04-19T02:16:54.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015805274000000001 2024-04-19T02:16:54.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:54.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286126+0000", 2024-04-19T02:16:54.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016765700000000001 2024-04-19T02:16:54.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:54.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286296+0000", 2024-04-19T02:16:54.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017007 2024-04-19T02:16:54.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:54.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290426+0000", 2024-04-19T02:16:54.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041299839999999997 2024-04-19T02:16:54.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:54.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290867+0000", 2024-04-19T02:16:54.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00044083300000000001 2024-04-19T02:16:54.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:54.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290900+0000", 2024-04-19T02:16:54.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3380000000000002e-05 2024-04-19T02:16:54.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:54.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290939+0000", 2024-04-19T02:16:54.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8970000000000001e-05 2024-04-19T02:16:54.155 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:54.155 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:54.155 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:54.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.156 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:21 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:54.156 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:16:54.156 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 84.842206915000006, 2024-04-19T02:16:54.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020833187999999999, 2024-04-19T02:16:54.156 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:54.156 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:16:54.156 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:54.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:54.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:16:54.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:54.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:54.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:16:54.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:54.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:54.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270189+0000", 2024-04-19T02:16:54.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:54.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:54.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270192+0000", 2024-04-19T02:16:54.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7549999999999999e-06 2024-04-19T02:16:54.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:54.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270198+0000", 2024-04-19T02:16:54.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0859999999999998e-06 2024-04-19T02:16:54.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:54.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270204+0000", 2024-04-19T02:16:54.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1970000000000004e-06 2024-04-19T02:16:54.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:54.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270238+0000", 2024-04-19T02:16:54.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4282000000000001e-05 2024-04-19T02:16:54.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:54.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270240+0000", 2024-04-19T02:16:54.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3099999999999999e-06 2024-04-19T02:16:54.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:54.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287131+0000", 2024-04-19T02:16:54.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01689104 2024-04-19T02:16:54.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:54.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287262+0000", 2024-04-19T02:16:54.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130347 2024-04-19T02:16:54.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:54.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291023+0000", 2024-04-19T02:16:54.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037616350000000002 2024-04-19T02:16:54.160 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:54.160 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:54.160 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:54.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.160 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:16519 5.f 5:fc30d3a1:::benchmark_data_smithi121_44835_object16518:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:54.160 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.880723+0000", 2024-04-19T02:16:54.160 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 54.231674136999999, 2024-04-19T02:16:54.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020492519000000001, 2024-04-19T02:16:54.160 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:54.160 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:54.160 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:54.161 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:54.161 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:54.161 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16519 2024-04-19T02:16:54.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.161 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:54.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:54.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880723+0000", 2024-04-19T02:16:54.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:54.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:54.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880723+0000", 2024-04-19T02:16:54.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:54.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:54.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880722+0000", 2024-04-19T02:16:54.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:54.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:54.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880794+0000", 2024-04-19T02:16:54.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1515999999999998e-05 2024-04-19T02:16:54.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:54.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880805+0000", 2024-04-19T02:16:54.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1353e-05 2024-04-19T02:16:54.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:54.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880812+0000", 2024-04-19T02:16:54.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1230000000000002e-06 2024-04-19T02:16:54.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:54.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.890954+0000", 2024-04-19T02:16:54.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010142253 2024-04-19T02:16:54.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:54.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891079+0000", 2024-04-19T02:16:54.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000124917 2024-04-19T02:16:54.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.164 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:54.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891218+0000", 2024-04-19T02:16:54.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000138715 2024-04-19T02:16:54.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.164 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:54.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.897321+0000", 2024-04-19T02:16:54.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0061026830000000002 2024-04-19T02:16:54.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.164 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:54.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901137+0000", 2024-04-19T02:16:54.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038161699999999998 2024-04-19T02:16:54.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:54.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901181+0000", 2024-04-19T02:16:54.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4362e-05 2024-04-19T02:16:54.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:54.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901215+0000", 2024-04-19T02:16:54.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3929e-05 2024-04-19T02:16:54.165 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:54.165 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:54.165 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:54.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.166 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:16520 5.f 5:f0474691:::benchmark_data_smithi121_44835_object16519:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:54.166 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.880833+0000", 2024-04-19T02:16:54.166 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 54.231564122000002, 2024-04-19T02:16:54.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020460160000000002, 2024-04-19T02:16:54.166 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:54.166 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:54.166 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:54.166 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:54.166 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:54.166 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16520 2024-04-19T02:16:54.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.166 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:54.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:54.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880833+0000", 2024-04-19T02:16:54.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:54.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:54.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880833+0000", 2024-04-19T02:16:54.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:54.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:54.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880832+0000", 2024-04-19T02:16:54.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:54.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:54.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880909+0000", 2024-04-19T02:16:54.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7095000000000006e-05 2024-04-19T02:16:54.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:54.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880919+0000", 2024-04-19T02:16:54.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8919999999999995e-06 2024-04-19T02:16:54.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:54.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880927+0000", 2024-04-19T02:16:54.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8809999999999996e-06 2024-04-19T02:16:54.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:54.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891901+0000", 2024-04-19T02:16:54.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010974263999999999 2024-04-19T02:16:54.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:54.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.892021+0000", 2024-04-19T02:16:54.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120074 2024-04-19T02:16:54.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:54.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.892165+0000", 2024-04-19T02:16:54.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014328600000000001 2024-04-19T02:16:54.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:54.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.897347+0000", 2024-04-19T02:16:54.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.005182603 2024-04-19T02:16:54.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:54.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901224+0000", 2024-04-19T02:16:54.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038767620000000002 2024-04-19T02:16:54.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:54.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901264+0000", 2024-04-19T02:16:54.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9579000000000002e-05 2024-04-19T02:16:54.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:54.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901293+0000", 2024-04-19T02:16:54.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9300999999999999e-05 2024-04-19T02:16:54.171 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:54.171 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:54.171 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:54.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.171 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:44167 5.7 5:ef4300c4:::benchmark_data_smithi121_44835_object44166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:54.171 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:09.853830+0000", 2024-04-19T02:16:54.171 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 44.258566637999998, 2024-04-19T02:16:54.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020082104, 2024-04-19T02:16:54.171 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:54.172 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:54.172 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:54.172 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:54.172 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:54.172 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 44167 2024-04-19T02:16:54.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.172 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:54.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:54.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853830+0000", 2024-04-19T02:16:54.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:54.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:54.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853830+0000", 2024-04-19T02:16:54.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:54.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:54.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853829+0000", 2024-04-19T02:16:54.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:54.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:54.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853863+0000", 2024-04-19T02:16:54.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3151999999999997e-05 2024-04-19T02:16:54.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:54.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853873+0000", 2024-04-19T02:16:54.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0366e-05 2024-04-19T02:16:54.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.174 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:54.174 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853881+0000", 2024-04-19T02:16:54.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6539999999999999e-06 2024-04-19T02:16:54.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.174 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:54.174 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.859162+0000", 2024-04-19T02:16:54.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052810740000000002 2024-04-19T02:16:54.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.174 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:54.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.859303+0000", 2024-04-19T02:16:54.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000140975 2024-04-19T02:16:54.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:54.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.859460+0000", 2024-04-19T02:16:54.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015754199999999999 2024-04-19T02:16:54.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:54.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.865142+0000", 2024-04-19T02:16:54.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0056819130000000002 2024-04-19T02:16:54.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:54.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.873828+0000", 2024-04-19T02:16:54.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0086861799999999999 2024-04-19T02:16:54.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:54.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.873871+0000", 2024-04-19T02:16:54.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2624999999999999e-05 2024-04-19T02:16:54.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:54.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.873912+0000", 2024-04-19T02:16:54.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1486000000000002e-05 2024-04-19T02:16:54.176 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:54.176 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:54.177 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:54.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.177 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:53042 5.f 5:f744ac14:::benchmark_data_smithi121_44835_object53041:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T02:16:54.177 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:13.560196+0000", 2024-04-19T02:16:54.177 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.552200818999999, 2024-04-19T02:16:54.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020122021, 2024-04-19T02:16:54.177 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:54.177 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:54.177 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:54.177 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:54.177 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:54.177 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 53042 2024-04-19T02:16:54.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.177 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:54.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:54.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560196+0000", 2024-04-19T02:16:54.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:54.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:54.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560196+0000", 2024-04-19T02:16:54.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:54.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:54.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560195+0000", 2024-04-19T02:16:54.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:54.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:54.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560255+0000", 2024-04-19T02:16:54.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9441000000000002e-05 2024-04-19T02:16:54.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:54.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560264+0000", 2024-04-19T02:16:54.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1130000000000007e-06 2024-04-19T02:16:54.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:54.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560271+0000", 2024-04-19T02:16:54.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9800000000000001e-06 2024-04-19T02:16:54.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:54.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560312+0000", 2024-04-19T02:16:54.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0828999999999998e-05 2024-04-19T02:16:54.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:54.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560456+0000", 2024-04-19T02:16:54.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014474799999999999 2024-04-19T02:16:54.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:54.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560591+0000", 2024-04-19T02:16:54.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013482699999999999 2024-04-19T02:16:54.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:54.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.564799+0000", 2024-04-19T02:16:54.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042080080000000001 2024-04-19T02:16:54.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:54.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580233+0000", 2024-04-19T02:16:54.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015433715000000001 2024-04-19T02:16:54.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:54.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580280+0000", 2024-04-19T02:16:54.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6465000000000003e-05 2024-04-19T02:16:54.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:54.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580318+0000", 2024-04-19T02:16:54.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8557999999999999e-05 2024-04-19T02:16:54.182 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:54.182 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:54.182 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:54.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.182 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:85866 5.2 5:48b1d46d:::benchmark_data_smithi121_44835_object85865:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T02:16:54.182 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:30.771909+0000", 2024-04-19T02:16:54.183 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 23.340487546999999, 2024-04-19T02:16:54.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020516216, 2024-04-19T02:16:54.183 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:54.183 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:54.183 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:54.183 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:54.183 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:54.183 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 85866 2024-04-19T02:16:54.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.183 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:54.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:54.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771909+0000", 2024-04-19T02:16:54.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:54.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:54.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771909+0000", 2024-04-19T02:16:54.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:54.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:54.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771909+0000", 2024-04-19T02:16:54.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:54.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:54.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771952+0000", 2024-04-19T02:16:54.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2660000000000002e-05 2024-04-19T02:16:54.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:54.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771959+0000", 2024-04-19T02:16:54.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7670000000000003e-06 2024-04-19T02:16:54.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:54.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771966+0000", 2024-04-19T02:16:54.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.905e-06 2024-04-19T02:16:54.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:54.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771999+0000", 2024-04-19T02:16:54.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2360999999999997e-05 2024-04-19T02:16:54.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:54.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.772133+0000", 2024-04-19T02:16:54.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013398699999999999 2024-04-19T02:16:54.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:54.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.772280+0000", 2024-04-19T02:16:54.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000147198 2024-04-19T02:16:54.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:54.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.774312+0000", 2024-04-19T02:16:54.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020325339999999999 2024-04-19T02:16:54.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:54.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.792370+0000", 2024-04-19T02:16:54.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018057321000000001 2024-04-19T02:16:54.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:54.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.792403+0000", 2024-04-19T02:16:54.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3247000000000002e-05 2024-04-19T02:16:54.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:54.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.792426+0000", 2024-04-19T02:16:54.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2697999999999999e-05 2024-04-19T02:16:54.188 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:54.188 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:54.188 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:54.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.188 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:94468 5.2 5:4f406431:::benchmark_data_smithi121_44835_object94467:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T02:16:54.188 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:16:54.188 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 19.000967733, 2024-04-19T02:16:54.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024835144999999999, 2024-04-19T02:16:54.188 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:54.188 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:54.188 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:54.189 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:54.189 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:54.189 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 94468 2024-04-19T02:16:54.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.189 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:54.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:54.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:16:54.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:54.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:54.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:16:54.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:54.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:54.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:16:54.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:54.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:54.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111498+0000", 2024-04-19T02:16:54.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9529000000000005e-05 2024-04-19T02:16:54.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:54.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111506+0000", 2024-04-19T02:16:54.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9030000000000004e-06 2024-04-19T02:16:54.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:54.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111513+0000", 2024-04-19T02:16:54.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8759999999999999e-06 2024-04-19T02:16:54.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:54.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112466+0000", 2024-04-19T02:16:54.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00095318499999999995 2024-04-19T02:16:54.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:54.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112590+0000", 2024-04-19T02:16:54.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012380900000000001 2024-04-19T02:16:54.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:54.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112728+0000", 2024-04-19T02:16:54.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013753800000000001 2024-04-19T02:16:54.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:54.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115064+0000", 2024-04-19T02:16:54.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002336819 2024-04-19T02:16:54.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:54.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136207+0000", 2024-04-19T02:16:54.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021142942000000001 2024-04-19T02:16:54.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:54.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136241+0000", 2024-04-19T02:16:54.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3577000000000001e-05 2024-04-19T02:16:54.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:54.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136264+0000", 2024-04-19T02:16:54.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3421000000000002e-05 2024-04-19T02:16:54.193 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:54.193 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:54.193 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:54.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.194 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:94472 5.2 5:45b7e9be:::benchmark_data_smithi121_44835_object94471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:54.194 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:16:54.194 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.997321201999998, 2024-04-19T02:16:54.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021273843000000001, 2024-04-19T02:16:54.194 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:54.194 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:54.194 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:54.194 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:54.194 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:54.194 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 94472 2024-04-19T02:16:54.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.194 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:54.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:54.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:16:54.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:54.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:54.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:16:54.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:54.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:54.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115075+0000", 2024-04-19T02:16:54.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:54.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:54.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115161+0000", 2024-04-19T02:16:54.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6632000000000007e-05 2024-04-19T02:16:54.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:54.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115171+0000", 2024-04-19T02:16:54.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2969999999999992e-06 2024-04-19T02:16:54.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:54.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115178+0000", 2024-04-19T02:16:54.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7610000000000007e-06 2024-04-19T02:16:54.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:54.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115213+0000", 2024-04-19T02:16:54.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5000999999999999e-05 2024-04-19T02:16:54.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:54.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115303+0000", 2024-04-19T02:16:54.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9791999999999997e-05 2024-04-19T02:16:54.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:54.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115391+0000", 2024-04-19T02:16:54.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7559000000000007e-05 2024-04-19T02:16:54.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:54.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.117894+0000", 2024-04-19T02:16:54.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002503496 2024-04-19T02:16:54.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:54.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136297+0000", 2024-04-19T02:16:54.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018402335999999998 2024-04-19T02:16:54.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:54.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136327+0000", 2024-04-19T02:16:54.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0534999999999998e-05 2024-04-19T02:16:54.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:54.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136350+0000", 2024-04-19T02:16:54.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2427999999999999e-05 2024-04-19T02:16:54.199 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:54.199 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:54.199 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:54.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.199 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:96668 5.f 5:f48d3288:::benchmark_data_smithi121_44835_object96667:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-19T02:16:54.199 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:36.254669+0000", 2024-04-19T02:16:54.199 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 17.857728083000001, 2024-04-19T02:16:54.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019875075999999998, 2024-04-19T02:16:54.200 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:54.200 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:54.200 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:54.200 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:54.200 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:54.200 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 96668 2024-04-19T02:16:54.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.200 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:54.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:54.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254669+0000", 2024-04-19T02:16:54.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:54.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:54.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254669+0000", 2024-04-19T02:16:54.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:54.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:54.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254668+0000", 2024-04-19T02:16:54.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:54.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:54.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254738+0000", 2024-04-19T02:16:54.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9913000000000006e-05 2024-04-19T02:16:54.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:54.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254748+0000", 2024-04-19T02:16:54.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7429999999999997e-06 2024-04-19T02:16:54.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:54.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254754+0000", 2024-04-19T02:16:54.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3840000000000002e-06 2024-04-19T02:16:54.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:54.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.256882+0000", 2024-04-19T02:16:54.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021282950000000001 2024-04-19T02:16:54.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:54.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.257007+0000", 2024-04-19T02:16:54.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012430699999999999 2024-04-19T02:16:54.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:54.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.257150+0000", 2024-04-19T02:16:54.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014291999999999999 2024-04-19T02:16:54.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:54.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.261375+0000", 2024-04-19T02:16:54.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042252100000000001 2024-04-19T02:16:54.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:54.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.274489+0000", 2024-04-19T02:16:54.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013113915 2024-04-19T02:16:54.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:54.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.274521+0000", 2024-04-19T02:16:54.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2691999999999998e-05 2024-04-19T02:16:54.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:54.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.274544+0000", 2024-04-19T02:16:54.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2408999999999998e-05 2024-04-19T02:16:54.204 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:54.204 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:54.205 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:54.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.205 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:98093 5.f 5:fcbc05b3:::benchmark_data_smithi121_44835_object98092:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-19T02:16:54.205 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:36.938897+0000", 2024-04-19T02:16:54.205 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 17.173500235999999, 2024-04-19T02:16:54.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019526373, 2024-04-19T02:16:54.205 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:54.205 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:54.205 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:54.205 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:54.205 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:54.205 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 98093 2024-04-19T02:16:54.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.206 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:54.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:54.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.938897+0000", 2024-04-19T02:16:54.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:54.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:54.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.938897+0000", 2024-04-19T02:16:54.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:54.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:54.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.938896+0000", 2024-04-19T02:16:54.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:54.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:54.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.938920+0000", 2024-04-19T02:16:54.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3969e-05 2024-04-19T02:16:54.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:54.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.938927+0000", 2024-04-19T02:16:54.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4760000000000003e-06 2024-04-19T02:16:54.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:54.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.938930+0000", 2024-04-19T02:16:54.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7349999999999998e-06 2024-04-19T02:16:54.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:54.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.945557+0000", 2024-04-19T02:16:54.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0066265689999999997 2024-04-19T02:16:54.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:54.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.945653+0000", 2024-04-19T02:16:54.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5948999999999999e-05 2024-04-19T02:16:54.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:54.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.945739+0000", 2024-04-19T02:16:54.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6012000000000003e-05 2024-04-19T02:16:54.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:54.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.949258+0000", 2024-04-19T02:16:54.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035189140000000002 2024-04-19T02:16:54.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:54.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.958372+0000", 2024-04-19T02:16:54.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0091140430000000005 2024-04-19T02:16:54.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:54.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.958402+0000", 2024-04-19T02:16:54.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9879e-05 2024-04-19T02:16:54.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:54.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.958423+0000", 2024-04-19T02:16:54.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1206999999999999e-05 2024-04-19T02:16:54.210 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:54.210 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:54.210 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:54.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.211 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:129219 5.2 5:45e7e1f4:::benchmark_data_smithi121_44835_object129218:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T02:16:54.211 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:52.629592+0000", 2024-04-19T02:16:54.211 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.4828049489999999, 2024-04-19T02:16:54.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021099489999999999, 2024-04-19T02:16:54.211 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:54.211 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:54.211 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:54.211 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:54.211 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:54.211 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129219 2024-04-19T02:16:54.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.211 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:54.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:54.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629592+0000", 2024-04-19T02:16:54.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:54.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:54.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629592+0000", 2024-04-19T02:16:54.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:54.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:54.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629591+0000", 2024-04-19T02:16:54.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:54.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:54.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629618+0000", 2024-04-19T02:16:54.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6970000000000001e-05 2024-04-19T02:16:54.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:54.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629639+0000", 2024-04-19T02:16:54.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0701999999999999e-05 2024-04-19T02:16:54.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:54.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629645+0000", 2024-04-19T02:16:54.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2299999999999996e-06 2024-04-19T02:16:54.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:54.214 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.635658+0000", 2024-04-19T02:16:54.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0060127549999999998 2024-04-19T02:16:54.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:54.214 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.635811+0000", 2024-04-19T02:16:54.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015305700000000001 2024-04-19T02:16:54.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:54.214 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.635967+0000", 2024-04-19T02:16:54.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015578599999999999 2024-04-19T02:16:54.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:54.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.642488+0000", 2024-04-19T02:16:54.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0065215619999999998 2024-04-19T02:16:54.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:54.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650603+0000", 2024-04-19T02:16:54.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0081144900000000002 2024-04-19T02:16:54.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:54.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650652+0000", 2024-04-19T02:16:54.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9079999999999998e-05 2024-04-19T02:16:54.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:54.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650691+0000", 2024-04-19T02:16:54.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9501e-05 2024-04-19T02:16:54.216 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:54.216 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:54.216 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:54.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.216 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:129220 5.2 5:44721865:::benchmark_data_smithi121_44835_object129219:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T02:16:54.216 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:52.630382+0000", 2024-04-19T02:16:54.216 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.482014546, 2024-04-19T02:16:54.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.02043969, 2024-04-19T02:16:54.217 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:54.217 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:54.217 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:54.217 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:54.217 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:54.217 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129220 2024-04-19T02:16:54.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.217 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:54.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:54.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.630382+0000", 2024-04-19T02:16:54.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:54.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:54.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.630382+0000", 2024-04-19T02:16:54.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:54.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:54.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.630382+0000", 2024-04-19T02:16:54.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:54.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:54.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.630451+0000", 2024-04-19T02:16:54.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9022000000000004e-05 2024-04-19T02:16:54.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:54.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.630460+0000", 2024-04-19T02:16:54.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7059999999999999e-06 2024-04-19T02:16:54.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:54.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.630466+0000", 2024-04-19T02:16:54.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4689999999999996e-06 2024-04-19T02:16:54.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:54.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.639381+0000", 2024-04-19T02:16:54.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0089152529999999997 2024-04-19T02:16:54.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:54.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.639492+0000", 2024-04-19T02:16:54.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011075500000000001 2024-04-19T02:16:54.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:54.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.639589+0000", 2024-04-19T02:16:54.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7157999999999994e-05 2024-04-19T02:16:54.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:54.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.646571+0000", 2024-04-19T02:16:54.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00698177 2024-04-19T02:16:54.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:54.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650743+0000", 2024-04-19T02:16:54.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041725909999999998 2024-04-19T02:16:54.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:54.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650785+0000", 2024-04-19T02:16:54.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2026e-05 2024-04-19T02:16:54.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:54.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650822+0000", 2024-04-19T02:16:54.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6689000000000001e-05 2024-04-19T02:16:54.222 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:54.222 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:54.222 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:54.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.222 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:130093 5.2 5:41dcb8a4:::benchmark_data_smithi121_44835_object130092:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T02:16:54.222 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:53.069964+0000", 2024-04-19T02:16:54.223 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.0424329489999999, 2024-04-19T02:16:54.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020424088, 2024-04-19T02:16:54.223 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:54.223 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:54.223 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:54.223 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:54.223 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:54.223 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 130093 2024-04-19T02:16:54.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.223 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:54.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.223 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:54.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.069964+0000", 2024-04-19T02:16:54.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:54.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:54.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.069964+0000", 2024-04-19T02:16:54.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:54.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:54.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.069963+0000", 2024-04-19T02:16:54.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:54.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:54.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.070064+0000", 2024-04-19T02:16:54.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100709 2024-04-19T02:16:54.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:54.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.070072+0000", 2024-04-19T02:16:54.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8339999999999999e-06 2024-04-19T02:16:54.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:54.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.070077+0000", 2024-04-19T02:16:54.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2399999999999998e-06 2024-04-19T02:16:54.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:54.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.071370+0000", 2024-04-19T02:16:54.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012926470000000001 2024-04-19T02:16:54.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:54.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.071497+0000", 2024-04-19T02:16:54.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000127701 2024-04-19T02:16:54.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:54.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.071662+0000", 2024-04-19T02:16:54.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016424300000000001 2024-04-19T02:16:54.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:54.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.077150+0000", 2024-04-19T02:16:54.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.005488031 2024-04-19T02:16:54.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:54.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.090305+0000", 2024-04-19T02:16:54.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013155622 2024-04-19T02:16:54.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:54.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.090352+0000", 2024-04-19T02:16:54.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6798999999999997e-05 2024-04-19T02:16:54.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:54.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:54.228 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:54.228 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.090388+0000", 2024-04-19T02:16:54.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5837999999999998e-05 2024-04-19T02:16:54.228 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:54.228 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:54.228 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:54.228 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:54.228 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:54.228 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:16:54.229 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:54.229+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:54.230 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:16:54.331 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:54.331+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:54.399 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:16:54.399 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:16:54.400 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.400 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:132739 5.0 5:0ca90244:::benchmark_data_smithi121_44835_object132738:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T02:16:54.400 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:54.395990+0000", 2024-04-19T02:16:54.400 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0033138389999999998, 2024-04-19T02:16:54.400 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0033423350000000001, 2024-04-19T02:16:54.400 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:54.400 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:54.400 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:54.400 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:54.401 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:54.401 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 132739 2024-04-19T02:16:54.401 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.401 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:54.401 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.401 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:54.401 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.395990+0000", 2024-04-19T02:16:54.402 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:54.402 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.402 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.402 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:54.402 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.395990+0000", 2024-04-19T02:16:54.402 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:54.402 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.403 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.404 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:54.404 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.395989+0000", 2024-04-19T02:16:54.404 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:54.404 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.404 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.404 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:54.404 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.396096+0000", 2024-04-19T02:16:54.405 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000107363 2024-04-19T02:16:54.405 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.405 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.405 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:54.405 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.396109+0000", 2024-04-19T02:16:54.405 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2383e-05 2024-04-19T02:16:54.405 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.405 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.405 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:54.405 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.396118+0000", 2024-04-19T02:16:54.406 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.9090000000000006e-06 2024-04-19T02:16:54.406 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.406 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.406 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:54.406 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.396153+0000", 2024-04-19T02:16:54.406 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5475999999999997e-05 2024-04-19T02:16:54.406 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.407 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.407 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:54.407 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.396243+0000", 2024-04-19T02:16:54.407 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.9926000000000006e-05 2024-04-19T02:16:54.407 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.407 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.407 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:54.407 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.396362+0000", 2024-04-19T02:16:54.407 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000119306 2024-04-19T02:16:54.407 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.408 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.408 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:54.408 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.399153+0000", 2024-04-19T02:16:54.408 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0027903350000000001 2024-04-19T02:16:54.408 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:54.408 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:54.408 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:54.408 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.408 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.409 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:132740 5.4 5:288a390b:::benchmark_data_smithi121_44835_object132739:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T02:16:54.409 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:54.396128+0000", 2024-04-19T02:16:54.409 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.00317614, 2024-04-19T02:16:54.409 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0032940700000000001, 2024-04-19T02:16:54.409 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:54.409 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:54.409 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:54.409 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:54.409 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:54.409 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 132740 2024-04-19T02:16:54.410 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.410 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:54.410 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.410 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:54.410 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.396128+0000", 2024-04-19T02:16:54.410 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:54.410 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.410 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.411 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:54.411 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.396128+0000", 2024-04-19T02:16:54.411 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:54.411 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.411 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.411 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:54.412 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.396127+0000", 2024-04-19T02:16:54.412 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:54.412 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.412 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.412 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:54.412 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.396158+0000", 2024-04-19T02:16:54.412 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1424000000000003e-05 2024-04-19T02:16:54.412 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.412 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.412 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:54.413 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.396167+0000", 2024-04-19T02:16:54.413 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.9949999999999994e-06 2024-04-19T02:16:54.413 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.413 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.413 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:54.413 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.396175+0000", 2024-04-19T02:16:54.413 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0039999999999999e-06 2024-04-19T02:16:54.413 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.413 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.413 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:54.413 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.396218+0000", 2024-04-19T02:16:54.413 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2116000000000001e-05 2024-04-19T02:16:54.414 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.414 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.414 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:54.414 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.396349+0000", 2024-04-19T02:16:54.414 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000131762 2024-04-19T02:16:54.414 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.414 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.414 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:54.414 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.396501+0000", 2024-04-19T02:16:54.414 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000151576 2024-04-19T02:16:54.414 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:54.415 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:54.415 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:54.415 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.415 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.415 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:132741 5.8 5:12833bc5:::benchmark_data_smithi121_44835_object132740:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T02:16:54.415 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:54.396213+0000", 2024-04-19T02:16:54.415 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.003090705, 2024-04-19T02:16:54.415 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0032844800000000002, 2024-04-19T02:16:54.415 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:54.415 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:54.416 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:54.416 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:54.416 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:54.416 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 132741 2024-04-19T02:16:54.416 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.416 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:54.416 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.416 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:54.416 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.396213+0000", 2024-04-19T02:16:54.417 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:54.417 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.417 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.417 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:54.417 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.396213+0000", 2024-04-19T02:16:54.417 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:54.417 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.417 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.417 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:54.418 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.396212+0000", 2024-04-19T02:16:54.418 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:54.418 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.418 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.418 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:54.418 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.396311+0000", 2024-04-19T02:16:54.418 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.9023000000000004e-05 2024-04-19T02:16:54.418 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.418 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.418 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:54.418 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.396323+0000", 2024-04-19T02:16:54.419 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1756000000000001e-05 2024-04-19T02:16:54.419 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.419 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.419 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:54.419 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.396330+0000", 2024-04-19T02:16:54.419 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1439999999999997e-06 2024-04-19T02:16:54.419 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.419 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.419 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:54.419 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.396581+0000", 2024-04-19T02:16:54.420 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00025124700000000002 2024-04-19T02:16:54.420 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.420 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.420 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:54.420 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.396692+0000", 2024-04-19T02:16:54.420 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000110504 2024-04-19T02:16:54.420 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.420 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.420 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:54.420 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.396821+0000", 2024-04-19T02:16:54.421 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000128835 2024-04-19T02:16:54.421 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:54.421 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:54.421 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:54.421 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.421 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.421 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:132744 5.e 5:749a6ad5:::benchmark_data_smithi121_44835_object132743:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T02:16:54.421 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:54.396427+0000", 2024-04-19T02:16:54.421 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0028762359999999999, 2024-04-19T02:16:54.421 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0031455010000000002, 2024-04-19T02:16:54.422 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:54.422 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:54.422 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:54.422 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:54.422 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:54.422 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 132744 2024-04-19T02:16:54.422 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.423 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:54.423 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.423 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:54.423 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.396427+0000", 2024-04-19T02:16:54.423 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:54.423 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.423 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.423 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:54.423 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.396427+0000", 2024-04-19T02:16:54.423 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:54.424 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.424 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.424 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:54.424 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.396427+0000", 2024-04-19T02:16:54.424 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:54.424 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.424 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.424 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:54.424 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.396545+0000", 2024-04-19T02:16:54.425 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000117926 2024-04-19T02:16:54.425 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.425 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.425 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:54.425 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.396556+0000", 2024-04-19T02:16:54.425 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1036000000000001e-05 2024-04-19T02:16:54.425 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.426 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.426 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:54.426 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.396563+0000", 2024-04-19T02:16:54.426 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.5490000000000001e-06 2024-04-19T02:16:54.426 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.426 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.426 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:54.426 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.396977+0000", 2024-04-19T02:16:54.426 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00041374899999999999 2024-04-19T02:16:54.426 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.426 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.427 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:54.427 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.397091+0000", 2024-04-19T02:16:54.427 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000114244 2024-04-19T02:16:54.427 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.427 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.427 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:54.427 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.397229+0000", 2024-04-19T02:16:54.427 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013810499999999999 2024-04-19T02:16:54.428 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:54.428 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:54.428 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:54.428 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.428 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.428 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:132738 5.9 e43/16 5:938a09fa:::benchmark_data_smithi121_44835_object132737:head v 43'8425, mlcod=43'8423)", 2024-04-19T02:16:54.428 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:54.396510+0000", 2024-04-19T02:16:54.428 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0027937449999999998, 2024-04-19T02:16:54.429 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0031334190000000001, 2024-04-19T02:16:54.429 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:54.429 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:16:54.429 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:54.429 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.429 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:54.429 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.396510+0000", 2024-04-19T02:16:54.429 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:54.430 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.430 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.430 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:54.430 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.396510+0000", 2024-04-19T02:16:54.430 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:54.430 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.430 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.430 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:54.430 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.396510+0000", 2024-04-19T02:16:54.431 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:54.431 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.431 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.431 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:54.431 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.396591+0000", 2024-04-19T02:16:54.431 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.1285000000000005e-05 2024-04-19T02:16:54.431 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.431 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.431 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:54.431 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.396598+0000", 2024-04-19T02:16:54.431 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.8349999999999998e-06 2024-04-19T02:16:54.431 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.431 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.431 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:54.432 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.396603+0000", 2024-04-19T02:16:54.432 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.4199999999999998e-06 2024-04-19T02:16:54.432 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.432 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.432 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:54.432 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.396667+0000", 2024-04-19T02:16:54.432 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.3955999999999995e-05 2024-04-19T02:16:54.432 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.432 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.432 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:54.433 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.396685+0000", 2024-04-19T02:16:54.433 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.7612999999999999e-05 2024-04-19T02:16:54.433 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:54.433 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:54.433 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:54.433 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.433 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.433 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:132742 5.f e43/16 5:fb3b4bc3:::benchmark_data_smithi121_44835_object132741:head v 43'8350, mlcod=43'8348)", 2024-04-19T02:16:54.433 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:54.398445+0000", 2024-04-19T02:16:54.433 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.00085873399999999999, 2024-04-19T02:16:54.433 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0012569149999999999, 2024-04-19T02:16:54.433 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:54.434 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:16:54.434 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:54.434 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.434 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:54.434 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.398445+0000", 2024-04-19T02:16:54.434 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:54.434 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.434 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.434 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:54.434 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.398445+0000", 2024-04-19T02:16:54.435 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:54.435 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.435 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.435 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:54.435 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.398444+0000", 2024-04-19T02:16:54.435 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:54.435 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.435 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.435 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:54.435 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.398479+0000", 2024-04-19T02:16:54.435 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5315999999999999e-05 2024-04-19T02:16:54.435 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.436 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.436 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:54.436 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.398488+0000", 2024-04-19T02:16:54.436 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.234e-06 2024-04-19T02:16:54.436 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.436 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.436 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:54.436 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.398497+0000", 2024-04-19T02:16:54.436 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.5019999999999992e-06 2024-04-19T02:16:54.436 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.436 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.436 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:54.437 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.398538+0000", 2024-04-19T02:16:54.437 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0794000000000003e-05 2024-04-19T02:16:54.437 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.437 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.437 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:54.437 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.398557+0000", 2024-04-19T02:16:54.437 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.9253999999999999e-05 2024-04-19T02:16:54.437 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:54.437 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:54.437 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:54.438 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.438 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.438 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:132745 5.d e43/16 5:b9b3c8a9:::benchmark_data_smithi121_44835_object132744:head v 43'8306, mlcod=43'8304)", 2024-04-19T02:16:54.438 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:54.398509+0000", 2024-04-19T02:16:54.438 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.00079480299999999996, 2024-04-19T02:16:54.438 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0012493579999999999, 2024-04-19T02:16:54.438 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:54.438 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:16:54.438 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:54.438 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.439 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:54.439 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.398509+0000", 2024-04-19T02:16:54.439 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:54.439 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.439 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.439 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:54.439 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.398509+0000", 2024-04-19T02:16:54.439 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:54.439 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.439 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.440 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:54.440 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.398508+0000", 2024-04-19T02:16:54.440 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:54.440 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.440 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.440 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:54.440 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.398537+0000", 2024-04-19T02:16:54.440 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.8813999999999999e-05 2024-04-19T02:16:54.440 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.441 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.441 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:54.441 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.398544+0000", 2024-04-19T02:16:54.441 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.204e-06 2024-04-19T02:16:54.441 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.441 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.441 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:54.441 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.398550+0000", 2024-04-19T02:16:54.441 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7980000000000002e-06 2024-04-19T02:16:54.441 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.441 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.441 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:54.442 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.398590+0000", 2024-04-19T02:16:54.442 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9518999999999999e-05 2024-04-19T02:16:54.442 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.442 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.442 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:54.442 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.398611+0000", 2024-04-19T02:16:54.442 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.0808000000000001e-05 2024-04-19T02:16:54.442 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:54.442 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:54.442 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:54.442 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.443 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.443 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:132748 5.4 5:2dd65f18:::benchmark_data_smithi121_44835_object132747:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T02:16:54.443 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:54.398568+0000", 2024-04-19T02:16:54.443 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.00073599099999999997, 2024-04-19T02:16:54.443 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0012543020000000001, 2024-04-19T02:16:54.443 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:54.443 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:54.444 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:54.444 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:54.444 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:54.444 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 132748 2024-04-19T02:16:54.444 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.444 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:54.444 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.444 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:54.444 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.398568+0000", 2024-04-19T02:16:54.444 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:54.444 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.445 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.445 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:54.445 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.398568+0000", 2024-04-19T02:16:54.445 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:54.445 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.445 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.445 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:54.445 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.398567+0000", 2024-04-19T02:16:54.445 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:54.445 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.445 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.445 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:54.446 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.398595+0000", 2024-04-19T02:16:54.446 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.8513999999999998e-05 2024-04-19T02:16:54.446 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.446 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.446 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:54.446 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.398603+0000", 2024-04-19T02:16:54.446 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.6920000000000002e-06 2024-04-19T02:16:54.446 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.446 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.446 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:54.447 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.398609+0000", 2024-04-19T02:16:54.447 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.207e-06 2024-04-19T02:16:54.447 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.447 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.447 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:54.447 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.398646+0000", 2024-04-19T02:16:54.447 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6245999999999998e-05 2024-04-19T02:16:54.447 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.447 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.447 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:54.448 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.398772+0000", 2024-04-19T02:16:54.448 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012655699999999999 2024-04-19T02:16:54.448 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.448 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.448 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:54.448 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.398919+0000", 2024-04-19T02:16:54.448 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000147109 2024-04-19T02:16:54.448 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:54.448 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:54.448 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:54.448 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.449 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.449 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:132749 5.1 e43/29 5:84026ca8:::benchmark_data_smithi121_44835_object132748:head v 43'8140, mlcod=43'8138)", 2024-04-19T02:16:54.449 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:54.399130+0000", 2024-04-19T02:16:54.449 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.00017380299999999999, 2024-04-19T02:16:54.449 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00076183800000000003, 2024-04-19T02:16:54.449 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:54.449 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:16:54.449 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:54.449 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.449 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:54.450 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.399130+0000", 2024-04-19T02:16:54.450 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:54.450 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.450 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.450 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:54.450 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.399130+0000", 2024-04-19T02:16:54.450 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:54.450 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.450 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.450 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:54.450 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.399129+0000", 2024-04-19T02:16:54.451 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:54.451 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.451 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.451 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:54.451 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.399157+0000", 2024-04-19T02:16:54.451 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.8031999999999999e-05 2024-04-19T02:16:54.451 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.451 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.451 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:54.451 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.399172+0000", 2024-04-19T02:16:54.451 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.4955e-05 2024-04-19T02:16:54.451 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.452 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.452 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:54.452 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.399178+0000", 2024-04-19T02:16:54.452 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2700000000000004e-06 2024-04-19T02:16:54.452 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.452 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.452 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:54.452 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.399213+0000", 2024-04-19T02:16:54.452 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5642999999999997e-05 2024-04-19T02:16:54.452 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.452 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.453 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:54.453 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.399236+0000", 2024-04-19T02:16:54.453 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.2291999999999999e-05 2024-04-19T02:16:54.453 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:54.453 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:54.453 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:54.453 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.453 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.453 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop_reply(client.4549.0:132740 5.4 e43/16)", 2024-04-19T02:16:54.453 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:54.399193+0000", 2024-04-19T02:16:54.454 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.000110778, 2024-04-19T02:16:54.454 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00075275799999999996, 2024-04-19T02:16:54.454 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:54.454 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "queued for pg", 2024-04-19T02:16:54.454 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:54.454 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.454 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:54.454 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.399193+0000", 2024-04-19T02:16:54.454 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:54.455 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.455 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.455 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:54.455 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.399193+0000", 2024-04-19T02:16:54.455 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:54.455 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.455 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.455 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:54.455 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.399193+0000", 2024-04-19T02:16:54.455 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:54.456 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.456 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.456 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:54.456 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.399197+0000", 2024-04-19T02:16:54.456 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0180000000000003e-06 2024-04-19T02:16:54.456 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.456 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.456 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:54.456 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.399202+0000", 2024-04-19T02:16:54.456 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.4909999999999996e-06 2024-04-19T02:16:54.457 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:54.457 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:54.457 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:54.457 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:54.399206+0000", 2024-04-19T02:16:54.457 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4469999999999999e-06 2024-04-19T02:16:54.457 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:54.457 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:54.457 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:54.457 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:54.458 INFO:teuthology.orchestra.run.smithi174.stdout: ], 2024-04-19T02:16:54.458 INFO:teuthology.orchestra.run.smithi174.stdout: "num_ops": 10 2024-04-19T02:16:54.458 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:16:54.459 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:54.460+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:54.460 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:16:54.490 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:16:54.536 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:16:54.560 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:54.561+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:54.635 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:16:54.635 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [], 2024-04-19T02:16:54.635 INFO:teuthology.orchestra.run.smithi174.stdout: "complaint_time": 30, 2024-04-19T02:16:54.635 INFO:teuthology.orchestra.run.smithi174.stdout: "num_blocked_ops": 0 2024-04-19T02:16:54.635 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:16:54.648 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:16:54.661 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:54.661+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:54.690 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:16:54.713 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:16:54.732 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2: {} 2024-04-19T02:16:54.733 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:16:54.733 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:16:54.733 INFO:teuthology.orchestra.run.smithi121.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:16:54.762 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:54.762+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:54.818 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:54.818 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:54.832 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:16:54.859 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:16:54.861 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-04-19T02:16:54.862 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:54.862+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:54.870 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":85,"stamp":"2024-04-19T02:16:54.753391+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":8490584922,"num_objects":129571,"num_object_clones":0,"num_object_copies":259142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":1870,"num_objects_unfound":0,"num_objects_dirty":129571,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":129795,"num_write_kb":8294482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4542,"num_bytes_recovered":297664512,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60342,"ondisk_log_size":60342,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":243,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":17311796,"kb_used_data":16849300,"kb_used_omap":4,"kb_used_meta":462459,"kb_avail":265803724,"statfs":{"total":289910292480,"available":272183013376,"internally_reserved":0,"allocated":17253683200,"data_stored":17252743688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":473558354},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1309736960,"num_objects":19985,"num_object_clones":0,"num_object_copies":39970,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-1112,"num_objects_unfound":0,"num_objects_dirty":19985,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19985,"num_write_kb":1279040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1540,"num_bytes_recovered":100925440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.601860"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.162613+0000","last_change":"2024-04-19T02:15:29.280412+0000","last_active":"2024-04-19T02:16:47.162613+0000","last_peered":"2024-04-19T02:16:47.162613+0000","last_clean":"2024-04-19T02:16:47.162613+0000","last_became_active":"2024-04-19T02:15:29.278762+0000","last_became_peered":"2024-04-19T02:15:29.278762+0000","last_unstale":"2024-04-19T02:16:47.162613+0000","last_undegraded":"2024-04-19T02:16:47.162613+0000","last_fullsized":"2024-04-19T02:16:47.162613+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:45.301675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.161503+0000","last_change":"2024-04-19T02:15:29.284695+0000","last_active":"2024-04-19T02:16:47.161503+0000","last_peered":"2024-04-19T02:16:47.161503+0000","last_clean":"2024-04-19T02:16:47.161503+0000","last_became_active":"2024-04-19T02:15:29.283468+0000","last_became_peered":"2024-04-19T02:15:29.283468+0000","last_unstale":"2024-04-19T02:16:47.161503+0000","last_undegraded":"2024-04-19T02:16:47.161503+0000","last_fullsized":"2024-04-19T02:16:47.161503+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.384881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.158515+0000","last_change":"2024-04-19T02:15:29.286709+0000","last_active":"2024-04-19T02:16:47.158515+0000","last_peered":"2024-04-19T02:16:47.158515+0000","last_clean":"2024-04-19T02:16:47.158515+0000","last_became_active":"2024-04-19T02:15:29.286169+0000","last_became_peered":"2024-04-19T02:15:29.286169+0000","last_unstale":"2024-04-19T02:16:47.158515+0000","last_undegraded":"2024-04-19T02:16:47.158515+0000","last_fullsized":"2024-04-19T02:16:47.158515+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:58.741466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.158231+0000","last_change":"2024-04-19T02:15:29.280131+0000","last_active":"2024-04-19T02:16:47.158231+0000","last_peered":"2024-04-19T02:16:47.158231+0000","last_clean":"2024-04-19T02:16:47.158231+0000","last_became_active":"2024-04-19T02:15:29.279388+0000","last_became_peered":"2024-04-19T02:15:29.279388+0000","last_unstale":"2024-04-19T02:16:47.158231+0000","last_undegraded":"2024-04-19T02:16:47.158231+0000","last_fullsized":"2024-04-19T02:16:47.158231+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:36:48.819486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.153795+0000","last_change":"2024-04-19T02:15:53.955892+0000","last_active":"2024-04-19T02:16:47.153795+0000","last_peered":"2024-04-19T02:16:47.153795+0000","last_clean":"2024-04-19T02:16:47.153795+0000","last_became_active":"2024-04-19T02:15:53.955553+0000","last_became_peered":"2024-04-19T02:15:53.955553+0000","last_unstale":"2024-04-19T02:16:47.153795+0000","last_undegraded":"2024-04-19T02:16:47.153795+0000","last_fullsized":"2024-04-19T02:16:47.153795+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:45:39.791209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.156629+0000","last_change":"2024-04-19T02:15:29.283908+0000","last_active":"2024-04-19T02:16:47.156629+0000","last_peered":"2024-04-19T02:16:47.156629+0000","last_clean":"2024-04-19T02:16:47.156629+0000","last_became_active":"2024-04-19T02:15:29.281729+0000","last_became_peered":"2024-04-19T02:15:29.281729+0000","last_unstale":"2024-04-19T02:16:47.156629+0000","last_undegraded":"2024-04-19T02:16:47.156629+0000","last_fullsized":"2024-04-19T02:16:47.156629+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:03:15.383476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.157088+0000","last_change":"2024-04-19T02:15:29.281253+0000","last_active":"2024-04-19T02:16:47.157088+0000","last_peered":"2024-04-19T02:16:47.157088+0000","last_clean":"2024-04-19T02:16:47.157088+0000","last_became_active":"2024-04-19T02:15:29.279951+0000","last_became_peered":"2024-04-19T02:15:29.279951+0000","last_unstale":"2024-04-19T02:16:47.157088+0000","last_undegraded":"2024-04-19T02:16:47.157088+0000","last_fullsized":"2024-04-19T02:16:47.157088+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.156107+0000","last_change":"2024-04-19T02:15:29.283952+0000","last_active":"2024-04-19T02:16:47.156107+0000","last_peered":"2024-04-19T02:16:47.156107+0000","last_clean":"2024-04-19T02:16:47.156107+0000","last_became_active":"2024-04-19T02:15:29.282721+0000","last_became_peered":"2024-04-19T02:15:29.282721+0000","last_unstale":"2024-04-19T02:16:47.156107+0000","last_undegraded":"2024-04-19T02:16:47.156107+0000","last_fullsized":"2024-04-19T02:16:47.156107+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:45.301675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.154394+0000","last_change":"2024-04-19T02:15:29.282150+0000","last_active":"2024-04-19T02:16:47.154394+0000","last_peered":"2024-04-19T02:16:47.154394+0000","last_clean":"2024-04-19T02:16:47.154394+0000","last_became_active":"2024-04-19T02:15:29.281538+0000","last_became_peered":"2024-04-19T02:15:29.281538+0000","last_unstale":"2024-04-19T02:16:47.154394+0000","last_undegraded":"2024-04-19T02:16:47.154394+0000","last_fullsized":"2024-04-19T02:16:47.154394+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.158086+0000","last_change":"2024-04-19T02:16:30.093524+0000","last_active":"2024-04-19T02:16:47.158086+0000","last_peered":"2024-04-19T02:16:47.158086+0000","last_clean":"2024-04-19T02:16:47.158086+0000","last_became_active":"2024-04-19T02:16:30.093344+0000","last_became_peered":"2024-04-19T02:16:30.093344+0000","last_unstale":"2024-04-19T02:16:47.158086+0000","last_undegraded":"2024-04-19T02:16:47.158086+0000","last_fullsized":"2024-04-19T02:16:47.158086+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:14:40.293159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.158423+0000","last_change":"2024-04-19T02:15:29.280606+0000","last_active":"2024-04-19T02:16:47.158423+0000","last_peered":"2024-04-19T02:16:47.158423+0000","last_clean":"2024-04-19T02:16:47.158423+0000","last_became_active":"2024-04-19T02:15:29.280151+0000","last_became_peered":"2024-04-19T02:15:29.280151+0000","last_unstale":"2024-04-19T02:16:47.158423+0000","last_undegraded":"2024-04-19T02:16:47.158423+0000","last_fullsized":"2024-04-19T02:16:47.158423+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:26:22.452488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.158064+0000","last_change":"2024-04-19T02:15:53.958876+0000","last_active":"2024-04-19T02:16:47.158064+0000","last_peered":"2024-04-19T02:16:47.158064+0000","last_clean":"2024-04-19T02:16:47.158064+0000","last_became_active":"2024-04-19T02:15:53.958626+0000","last_became_peered":"2024-04-19T02:15:53.958626+0000","last_unstale":"2024-04-19T02:16:47.158064+0000","last_undegraded":"2024-04-19T02:16:47.158064+0000","last_fullsized":"2024-04-19T02:16:47.158064+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:23:57.044018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.153544+0000","last_change":"2024-04-19T02:15:53.956801+0000","last_active":"2024-04-19T02:16:47.153544+0000","last_peered":"2024-04-19T02:16:47.153544+0000","last_clean":"2024-04-19T02:16:47.153544+0000","last_became_active":"2024-04-19T02:15:53.956620+0000","last_became_peered":"2024-04-19T02:15:53.956620+0000","last_unstale":"2024-04-19T02:16:47.153544+0000","last_undegraded":"2024-04-19T02:16:47.153544+0000","last_fullsized":"2024-04-19T02:16:47.153544+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:57:05.843101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.156618+0000","last_change":"2024-04-19T02:15:29.284262+0000","last_active":"2024-04-19T02:16:47.156618+0000","last_peered":"2024-04-19T02:16:47.156618+0000","last_clean":"2024-04-19T02:16:47.156618+0000","last_became_active":"2024-04-19T02:15:29.283121+0000","last_became_peered":"2024-04-19T02:15:29.283121+0000","last_unstale":"2024-04-19T02:16:47.156618+0000","last_undegraded":"2024-04-19T02:16:47.156618+0000","last_fullsized":"2024-04-19T02:16:47.156618+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.157163+0000","last_change":"2024-04-19T02:15:29.285139+0000","last_active":"2024-04-19T02:16:47.157163+0000","last_peered":"2024-04-19T02:16:47.157163+0000","last_clean":"2024-04-19T02:16:47.157163+0000","last_became_active":"2024-04-19T02:15:29.284649+0000","last_became_peered":"2024-04-19T02:15:29.284649+0000","last_unstale":"2024-04-19T02:16:47.157163+0000","last_undegraded":"2024-04-19T02:16:47.157163+0000","last_fullsized":"2024-04-19T02:16:47.157163+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.156149+0000","last_change":"2024-04-19T02:15:29.283648+0000","last_active":"2024-04-19T02:16:47.156149+0000","last_peered":"2024-04-19T02:16:47.156149+0000","last_clean":"2024-04-19T02:16:47.156149+0000","last_became_active":"2024-04-19T02:15:29.281606+0000","last_became_peered":"2024-04-19T02:15:29.281606+0000","last_unstale":"2024-04-19T02:16:47.156149+0000","last_undegraded":"2024-04-19T02:16:47.156149+0000","last_fullsized":"2024-04-19T02:16:47.156149+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.154380+0000","last_change":"2024-04-19T02:15:29.278673+0000","last_active":"2024-04-19T02:16:47.154380+0000","last_peered":"2024-04-19T02:16:47.154380+0000","last_clean":"2024-04-19T02:16:47.154380+0000","last_became_active":"2024-04-19T02:15:29.277699+0000","last_became_peered":"2024-04-19T02:15:29.277699+0000","last_unstale":"2024-04-19T02:16:47.154380+0000","last_undegraded":"2024-04-19T02:16:47.154380+0000","last_fullsized":"2024-04-19T02:16:47.154380+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.162012+0000","last_change":"2024-04-19T02:15:29.283341+0000","last_active":"2024-04-19T02:16:47.162012+0000","last_peered":"2024-04-19T02:16:47.162012+0000","last_clean":"2024-04-19T02:16:47.162012+0000","last_became_active":"2024-04-19T02:15:29.281591+0000","last_became_peered":"2024-04-19T02:15:29.281591+0000","last_unstale":"2024-04-19T02:16:47.162012+0000","last_undegraded":"2024-04-19T02:16:47.162012+0000","last_fullsized":"2024-04-19T02:16:47.162012+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:34.593754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.154400+0000","last_change":"2024-04-19T02:15:29.282110+0000","last_active":"2024-04-19T02:16:47.154400+0000","last_peered":"2024-04-19T02:16:47.154400+0000","last_clean":"2024-04-19T02:16:47.154400+0000","last_became_active":"2024-04-19T02:15:29.281716+0000","last_became_peered":"2024-04-19T02:15:29.281716+0000","last_unstale":"2024-04-19T02:16:47.154400+0000","last_undegraded":"2024-04-19T02:16:47.154400+0000","last_fullsized":"2024-04-19T02:16:47.154400+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.158153+0000","last_change":"2024-04-19T02:15:29.285237+0000","last_active":"2024-04-19T02:16:47.158153+0000","last_peered":"2024-04-19T02:16:47.158153+0000","last_clean":"2024-04-19T02:16:47.158153+0000","last_became_active":"2024-04-19T02:15:29.282790+0000","last_became_peered":"2024-04-19T02:15:29.282790+0000","last_unstale":"2024-04-19T02:16:47.158153+0000","last_undegraded":"2024-04-19T02:16:47.158153+0000","last_fullsized":"2024-04-19T02:16:47.158153+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.156856+0000","last_change":"2024-04-19T02:15:29.282609+0000","last_active":"2024-04-19T02:16:47.156856+0000","last_peered":"2024-04-19T02:16:47.156856+0000","last_clean":"2024-04-19T02:16:47.156856+0000","last_became_active":"2024-04-19T02:15:29.281665+0000","last_became_peered":"2024-04-19T02:15:29.281665+0000","last_unstale":"2024-04-19T02:16:47.156856+0000","last_undegraded":"2024-04-19T02:16:47.156856+0000","last_fullsized":"2024-04-19T02:16:47.156856+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.384881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.156287+0000","last_change":"2024-04-19T02:15:53.955813+0000","last_active":"2024-04-19T02:16:47.156287+0000","last_peered":"2024-04-19T02:16:47.156287+0000","last_clean":"2024-04-19T02:16:47.156287+0000","last_became_active":"2024-04-19T02:15:53.955614+0000","last_became_peered":"2024-04-19T02:15:53.955614+0000","last_unstale":"2024-04-19T02:16:47.156287+0000","last_undegraded":"2024-04-19T02:16:47.156287+0000","last_fullsized":"2024-04-19T02:16:47.156287+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:58:03.192647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.154568+0000","last_change":"2024-04-19T02:15:29.277109+0000","last_active":"2024-04-19T02:16:47.154568+0000","last_peered":"2024-04-19T02:16:47.154568+0000","last_clean":"2024-04-19T02:16:47.154568+0000","last_became_active":"2024-04-19T02:15:29.275417+0000","last_became_peered":"2024-04-19T02:15:29.275417+0000","last_unstale":"2024-04-19T02:16:47.154568+0000","last_undegraded":"2024-04-19T02:16:47.154568+0000","last_fullsized":"2024-04-19T02:16:47.154568+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.161575+0000","last_change":"2024-04-19T02:15:29.283266+0000","last_active":"2024-04-19T02:16:47.161575+0000","last_peered":"2024-04-19T02:16:47.161575+0000","last_clean":"2024-04-19T02:16:47.161575+0000","last_became_active":"2024-04-19T02:15:29.281505+0000","last_became_peered":"2024-04-19T02:15:29.281505+0000","last_unstale":"2024-04-19T02:16:47.161575+0000","last_undegraded":"2024-04-19T02:16:47.161575+0000","last_fullsized":"2024-04-19T02:16:47.161575+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.162603+0000","last_change":"2024-04-19T02:15:29.278084+0000","last_active":"2024-04-19T02:16:47.162603+0000","last_peered":"2024-04-19T02:16:47.162603+0000","last_clean":"2024-04-19T02:16:47.162603+0000","last_became_active":"2024-04-19T02:15:29.276952+0000","last_became_peered":"2024-04-19T02:15:29.276952+0000","last_unstale":"2024-04-19T02:16:47.162603+0000","last_undegraded":"2024-04-19T02:16:47.162603+0000","last_fullsized":"2024-04-19T02:16:47.162603+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.156579+0000","last_change":"2024-04-19T02:15:29.279904+0000","last_active":"2024-04-19T02:16:47.156579+0000","last_peered":"2024-04-19T02:16:47.156579+0000","last_clean":"2024-04-19T02:16:47.156579+0000","last_became_active":"2024-04-19T02:15:29.278938+0000","last_became_peered":"2024-04-19T02:15:29.278938+0000","last_unstale":"2024-04-19T02:16:47.156579+0000","last_undegraded":"2024-04-19T02:16:47.156579+0000","last_fullsized":"2024-04-19T02:16:47.156579+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.158445+0000","last_change":"2024-04-19T02:15:29.287389+0000","last_active":"2024-04-19T02:16:47.158445+0000","last_peered":"2024-04-19T02:16:47.158445+0000","last_clean":"2024-04-19T02:16:47.158445+0000","last_became_active":"2024-04-19T02:15:29.286431+0000","last_became_peered":"2024-04-19T02:15:29.286431+0000","last_unstale":"2024-04-19T02:16:47.158445+0000","last_undegraded":"2024-04-19T02:16:47.158445+0000","last_fullsized":"2024-04-19T02:16:47.158445+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:58:30.117887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.154147+0000","last_change":"2024-04-19T02:15:53.959207+0000","last_active":"2024-04-19T02:16:47.154147+0000","last_peered":"2024-04-19T02:16:47.154147+0000","last_clean":"2024-04-19T02:16:47.154147+0000","last_became_active":"2024-04-19T02:15:53.959007+0000","last_became_peered":"2024-04-19T02:15:53.959007+0000","last_unstale":"2024-04-19T02:16:47.154147+0000","last_undegraded":"2024-04-19T02:16:47.154147+0000","last_fullsized":"2024-04-19T02:16:47.154147+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:08:21.065077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.162118+0000","last_change":"2024-04-19T02:15:29.281792+0000","last_active":"2024-04-19T02:16:47.162118+0000","last_peered":"2024-04-19T02:16:47.162118+0000","last_clean":"2024-04-19T02:16:47.162118+0000","last_became_active":"2024-04-19T02:15:29.280479+0000","last_became_peered":"2024-04-19T02:15:29.280479+0000","last_unstale":"2024-04-19T02:16:47.162118+0000","last_undegraded":"2024-04-19T02:16:47.162118+0000","last_fullsized":"2024-04-19T02:16:47.162118+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.154641+0000","last_change":"2024-04-19T02:15:28.888778+0000","last_active":"2024-04-19T02:16:47.154641+0000","last_peered":"2024-04-19T02:16:47.154641+0000","last_clean":"2024-04-19T02:16:47.154641+0000","last_became_active":"2024-04-19T02:15:28.888543+0000","last_became_peered":"2024-04-19T02:15:28.888543+0000","last_unstale":"2024-04-19T02:16:47.154641+0000","last_undegraded":"2024-04-19T02:16:47.154641+0000","last_fullsized":"2024-04-19T02:16:47.154641+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:43:51.221619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.156422+0000","last_change":"2024-04-19T02:15:29.279986+0000","last_active":"2024-04-19T02:16:47.156422+0000","last_peered":"2024-04-19T02:16:47.156422+0000","last_clean":"2024-04-19T02:16:47.156422+0000","last_became_active":"2024-04-19T02:15:29.279690+0000","last_became_peered":"2024-04-19T02:15:29.279690+0000","last_unstale":"2024-04-19T02:16:47.156422+0000","last_undegraded":"2024-04-19T02:16:47.156422+0000","last_fullsized":"2024-04-19T02:16:47.156422+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.153659+0000","last_change":"2024-04-19T02:15:28.890463+0000","last_active":"2024-04-19T02:16:47.153659+0000","last_peered":"2024-04-19T02:16:47.153659+0000","last_clean":"2024-04-19T02:16:47.153659+0000","last_became_active":"2024-04-19T02:15:28.889777+0000","last_became_peered":"2024-04-19T02:15:28.889777+0000","last_unstale":"2024-04-19T02:16:47.153659+0000","last_undegraded":"2024-04-19T02:16:47.153659+0000","last_fullsized":"2024-04-19T02:16:47.153659+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:58:21.520250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.162543+0000","last_change":"2024-04-19T02:15:29.280879+0000","last_active":"2024-04-19T02:16:47.162543+0000","last_peered":"2024-04-19T02:16:47.162543+0000","last_clean":"2024-04-19T02:16:47.162543+0000","last_became_active":"2024-04-19T02:15:29.279314+0000","last_became_peered":"2024-04-19T02:15:29.279314+0000","last_unstale":"2024-04-19T02:16:47.162543+0000","last_undegraded":"2024-04-19T02:16:47.162543+0000","last_fullsized":"2024-04-19T02:16:47.162543+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.154754+0000","last_change":"2024-04-19T02:15:28.891867+0000","last_active":"2024-04-19T02:16:47.154754+0000","last_peered":"2024-04-19T02:16:47.154754+0000","last_clean":"2024-04-19T02:16:47.154754+0000","last_became_active":"2024-04-19T02:15:28.890806+0000","last_became_peered":"2024-04-19T02:15:28.890806+0000","last_unstale":"2024-04-19T02:16:47.154754+0000","last_undegraded":"2024-04-19T02:16:47.154754+0000","last_fullsized":"2024-04-19T02:16:47.154754+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:57.946581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.153573+0000","last_change":"2024-04-19T02:15:29.278148+0000","last_active":"2024-04-19T02:16:47.153573+0000","last_peered":"2024-04-19T02:16:47.153573+0000","last_clean":"2024-04-19T02:16:47.153573+0000","last_became_active":"2024-04-19T02:15:29.277402+0000","last_became_peered":"2024-04-19T02:15:29.277402+0000","last_unstale":"2024-04-19T02:16:47.153573+0000","last_undegraded":"2024-04-19T02:16:47.153573+0000","last_fullsized":"2024-04-19T02:16:47.153573+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.158404+0000","last_change":"2024-04-19T02:15:28.892905+0000","last_active":"2024-04-19T02:16:47.158404+0000","last_peered":"2024-04-19T02:16:47.158404+0000","last_clean":"2024-04-19T02:16:47.158404+0000","last_became_active":"2024-04-19T02:15:28.892541+0000","last_became_peered":"2024-04-19T02:15:28.892541+0000","last_unstale":"2024-04-19T02:16:47.158404+0000","last_undegraded":"2024-04-19T02:16:47.158404+0000","last_fullsized":"2024-04-19T02:16:47.158404+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:33.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.154906+0000","last_change":"2024-04-19T02:15:29.278810+0000","last_active":"2024-04-19T02:16:47.154906+0000","last_peered":"2024-04-19T02:16:47.154906+0000","last_clean":"2024-04-19T02:16:47.154906+0000","last_became_active":"2024-04-19T02:15:29.278093+0000","last_became_peered":"2024-04-19T02:15:29.278093+0000","last_unstale":"2024-04-19T02:16:47.154906+0000","last_undegraded":"2024-04-19T02:16:47.154906+0000","last_fullsized":"2024-04-19T02:16:47.154906+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:34.883207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":41,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.161807+0000","last_change":"2024-04-19T02:15:28.892937+0000","last_active":"2024-04-19T02:16:47.161807+0000","last_peered":"2024-04-19T02:16:47.161807+0000","last_clean":"2024-04-19T02:16:47.161807+0000","last_became_active":"2024-04-19T02:15:28.891440+0000","last_became_peered":"2024-04-19T02:15:28.891440+0000","last_unstale":"2024-04-19T02:16:47.161807+0000","last_undegraded":"2024-04-19T02:16:47.161807+0000","last_fullsized":"2024-04-19T02:16:47.161807+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.153935+0000","last_change":"2024-04-19T02:15:29.278404+0000","last_active":"2024-04-19T02:16:47.153935+0000","last_peered":"2024-04-19T02:16:47.153935+0000","last_clean":"2024-04-19T02:16:47.153935+0000","last_became_active":"2024-04-19T02:15:29.277460+0000","last_became_peered":"2024-04-19T02:15:29.277460+0000","last_unstale":"2024-04-19T02:16:47.153935+0000","last_undegraded":"2024-04-19T02:16:47.153935+0000","last_fullsized":"2024-04-19T02:16:47.153935+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.158160+0000","last_change":"2024-04-19T02:15:28.891097+0000","last_active":"2024-04-19T02:16:47.158160+0000","last_peered":"2024-04-19T02:16:47.158160+0000","last_clean":"2024-04-19T02:16:47.158160+0000","last_became_active":"2024-04-19T02:15:28.890795+0000","last_became_peered":"2024-04-19T02:15:28.890795+0000","last_unstale":"2024-04-19T02:16:47.158160+0000","last_undegraded":"2024-04-19T02:16:47.158160+0000","last_fullsized":"2024-04-19T02:16:47.158160+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.157166+0000","last_change":"2024-04-19T02:15:29.278546+0000","last_active":"2024-04-19T02:16:47.157166+0000","last_peered":"2024-04-19T02:16:47.157166+0000","last_clean":"2024-04-19T02:16:47.157166+0000","last_became_active":"2024-04-19T02:15:29.277547+0000","last_became_peered":"2024-04-19T02:15:29.277547+0000","last_unstale":"2024-04-19T02:16:47.157166+0000","last_undegraded":"2024-04-19T02:16:47.157166+0000","last_fullsized":"2024-04-19T02:16:47.157166+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.157091+0000","last_change":"2024-04-19T02:15:28.892977+0000","last_active":"2024-04-19T02:16:47.157091+0000","last_peered":"2024-04-19T02:16:47.157091+0000","last_clean":"2024-04-19T02:16:47.157091+0000","last_became_active":"2024-04-19T02:15:28.892636+0000","last_became_peered":"2024-04-19T02:15:28.892636+0000","last_unstale":"2024-04-19T02:16:47.157091+0000","last_undegraded":"2024-04-19T02:16:47.157091+0000","last_fullsized":"2024-04-19T02:16:47.157091+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:43:51.221619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.154009+0000","last_change":"2024-04-19T02:15:53.955655+0000","last_active":"2024-04-19T02:16:47.154009+0000","last_peered":"2024-04-19T02:16:47.154009+0000","last_clean":"2024-04-19T02:16:47.154009+0000","last_became_active":"2024-04-19T02:15:53.955382+0000","last_became_peered":"2024-04-19T02:15:53.955382+0000","last_unstale":"2024-04-19T02:16:47.154009+0000","last_undegraded":"2024-04-19T02:16:47.154009+0000","last_fullsized":"2024-04-19T02:16:47.154009+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:48.239260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.154067+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:16:47.154067+0000","last_peered":"2024-04-19T02:16:47.154067+0000","last_clean":"2024-04-19T02:16:47.154067+0000","last_became_active":"2024-04-19T02:15:28.890751+0000","last_became_peered":"2024-04-19T02:15:28.890751+0000","last_unstale":"2024-04-19T02:16:47.154067+0000","last_undegraded":"2024-04-19T02:16:47.154067+0000","last_fullsized":"2024-04-19T02:16:47.154067+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.154102+0000","last_change":"2024-04-19T02:15:53.957865+0000","last_active":"2024-04-19T02:16:47.154102+0000","last_peered":"2024-04-19T02:16:47.154102+0000","last_clean":"2024-04-19T02:16:47.154102+0000","last_became_active":"2024-04-19T02:15:53.957627+0000","last_became_peered":"2024-04-19T02:15:53.957627+0000","last_unstale":"2024-04-19T02:16:47.154102+0000","last_undegraded":"2024-04-19T02:16:47.154102+0000","last_fullsized":"2024-04-19T02:16:47.154102+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:16:45.799016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.162379+0000","last_change":"2024-04-19T02:15:28.892934+0000","last_active":"2024-04-19T02:16:47.162379+0000","last_peered":"2024-04-19T02:16:47.162379+0000","last_clean":"2024-04-19T02:16:47.162379+0000","last_became_active":"2024-04-19T02:15:28.891879+0000","last_became_peered":"2024-04-19T02:15:28.891879+0000","last_unstale":"2024-04-19T02:16:47.162379+0000","last_undegraded":"2024-04-19T02:16:47.162379+0000","last_fullsized":"2024-04-19T02:16:47.162379+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:10:12.514798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.156513+0000","last_change":"2024-04-19T02:15:29.279685+0000","last_active":"2024-04-19T02:16:47.156513+0000","last_peered":"2024-04-19T02:16:47.156513+0000","last_clean":"2024-04-19T02:16:47.156513+0000","last_became_active":"2024-04-19T02:15:29.278810+0000","last_became_peered":"2024-04-19T02:15:29.278810+0000","last_unstale":"2024-04-19T02:16:47.156513+0000","last_undegraded":"2024-04-19T02:16:47.156513+0000","last_fullsized":"2024-04-19T02:16:47.156513+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":46,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.156377+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:16:47.156377+0000","last_peered":"2024-04-19T02:16:47.156377+0000","last_clean":"2024-04-19T02:16:47.156377+0000","last_became_active":"2024-04-19T02:15:28.890882+0000","last_became_peered":"2024-04-19T02:15:28.890882+0000","last_unstale":"2024-04-19T02:16:47.156377+0000","last_undegraded":"2024-04-19T02:16:47.156377+0000","last_fullsized":"2024-04-19T02:16:47.156377+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:31.673938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.154938+0000","last_change":"2024-04-19T02:15:29.284258+0000","last_active":"2024-04-19T02:16:47.154938+0000","last_peered":"2024-04-19T02:16:47.154938+0000","last_clean":"2024-04-19T02:16:47.154938+0000","last_became_active":"2024-04-19T02:15:29.283995+0000","last_became_peered":"2024-04-19T02:15:29.283995+0000","last_unstale":"2024-04-19T02:16:47.154938+0000","last_undegraded":"2024-04-19T02:16:47.154938+0000","last_fullsized":"2024-04-19T02:16:47.154938+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:35.941308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"42'8232","reported_seq":8266,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-19T02:16:52.800593+0000","last_change":"2024-04-19T02:15:53.956977+0000","last_active":"2024-04-19T02:16:52.800593+0000","last_peered":"2024-04-19T02:16:52.800593+0000","last_clean":"2024-04-19T02:16:52.800593+0000","last_became_active":"2024-04-19T02:15:53.956730+0000","last_became_peered":"2024-04-19T02:15:53.956730+0000","last_unstale":"2024-04-19T02:16:52.800593+0000","last_undegraded":"2024-04-19T02:16:52.800593+0000","last_fullsized":"2024-04-19T02:16:52.800593+0000","mapping_epoch":16,"log_start":"27'4500","ondisk_log_start":"27'4500","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3732,"log_dups_size":0,"ondisk_log_size":3732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:56:46.323499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539492352,"num_objects":8232,"num_object_clones":0,"num_object_copies":16464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8232,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8232,"num_write_kb":526848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":39,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.158401+0000","last_change":"2024-04-19T02:15:28.890265+0000","last_active":"2024-04-19T02:16:47.158401+0000","last_peered":"2024-04-19T02:16:47.158401+0000","last_clean":"2024-04-19T02:16:47.158401+0000","last_became_active":"2024-04-19T02:15:28.890004+0000","last_became_peered":"2024-04-19T02:15:28.890004+0000","last_unstale":"2024-04-19T02:16:47.158401+0000","last_undegraded":"2024-04-19T02:16:47.158401+0000","last_fullsized":"2024-04-19T02:16:47.158401+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:02.517101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.161488+0000","last_change":"2024-04-19T02:15:29.285529+0000","last_active":"2024-04-19T02:16:47.161488+0000","last_peered":"2024-04-19T02:16:47.161488+0000","last_clean":"2024-04-19T02:16:47.161488+0000","last_became_active":"2024-04-19T02:15:29.285197+0000","last_became_peered":"2024-04-19T02:15:29.285197+0000","last_unstale":"2024-04-19T02:16:47.161488+0000","last_undegraded":"2024-04-19T02:16:47.161488+0000","last_fullsized":"2024-04-19T02:16:47.161488+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"42'8185","reported_seq":8219,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-19T02:16:52.749497+0000","last_change":"2024-04-19T02:15:53.958523+0000","last_active":"2024-04-19T02:16:52.749497+0000","last_peered":"2024-04-19T02:16:52.749497+0000","last_clean":"2024-04-19T02:16:52.749497+0000","last_became_active":"2024-04-19T02:15:53.957627+0000","last_became_peered":"2024-04-19T02:15:53.957627+0000","last_unstale":"2024-04-19T02:16:52.749497+0000","last_undegraded":"2024-04-19T02:16:52.749497+0000","last_fullsized":"2024-04-19T02:16:52.749497+0000","mapping_epoch":16,"log_start":"27'4247","ondisk_log_start":"27'4247","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3938,"log_dups_size":0,"ondisk_log_size":3938,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:59:55.120296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":536412160,"num_objects":8185,"num_object_clones":0,"num_object_copies":16370,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8185,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8185,"num_write_kb":523840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.161586+0000","last_change":"2024-04-19T02:15:28.893902+0000","last_active":"2024-04-19T02:16:47.161586+0000","last_peered":"2024-04-19T02:16:47.161586+0000","last_clean":"2024-04-19T02:16:47.161586+0000","last_became_active":"2024-04-19T02:15:28.893231+0000","last_became_peered":"2024-04-19T02:15:28.893231+0000","last_unstale":"2024-04-19T02:16:47.161586+0000","last_undegraded":"2024-04-19T02:16:47.161586+0000","last_fullsized":"2024-04-19T02:16:47.161586+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:23.658442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.162518+0000","last_change":"2024-04-19T02:15:29.282874+0000","last_active":"2024-04-19T02:16:47.162518+0000","last_peered":"2024-04-19T02:16:47.162518+0000","last_clean":"2024-04-19T02:16:47.162518+0000","last_became_active":"2024-04-19T02:15:29.281675+0000","last_became_peered":"2024-04-19T02:15:29.281675+0000","last_unstale":"2024-04-19T02:16:47.162518+0000","last_undegraded":"2024-04-19T02:16:47.162518+0000","last_fullsized":"2024-04-19T02:16:47.162518+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:35.941308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"42'8069","reported_seq":8103,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-19T02:16:52.761622+0000","last_change":"2024-04-19T02:15:53.958324+0000","last_active":"2024-04-19T02:16:52.761622+0000","last_peered":"2024-04-19T02:16:52.761622+0000","last_clean":"2024-04-19T02:16:52.761622+0000","last_became_active":"2024-04-19T02:15:53.957392+0000","last_became_peered":"2024-04-19T02:15:53.957392+0000","last_unstale":"2024-04-19T02:16:52.761622+0000","last_undegraded":"2024-04-19T02:16:52.761622+0000","last_fullsized":"2024-04-19T02:16:52.761622+0000","mapping_epoch":16,"log_start":"26'4100","ondisk_log_start":"26'4100","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3969,"log_dups_size":0,"ondisk_log_size":3969,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:12:58.132969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528809984,"num_objects":8069,"num_object_clones":0,"num_object_copies":16138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8069,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8069,"num_write_kb":516416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":39,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.158519+0000","last_change":"2024-04-19T02:15:28.891234+0000","last_active":"2024-04-19T02:16:47.158519+0000","last_peered":"2024-04-19T02:16:47.158519+0000","last_clean":"2024-04-19T02:16:47.158519+0000","last_became_active":"2024-04-19T02:15:28.890881+0000","last_became_peered":"2024-04-19T02:15:28.890881+0000","last_unstale":"2024-04-19T02:16:47.158519+0000","last_undegraded":"2024-04-19T02:16:47.158519+0000","last_fullsized":"2024-04-19T02:16:47.158519+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.156498+0000","last_change":"2024-04-19T02:15:29.281937+0000","last_active":"2024-04-19T02:16:47.156498+0000","last_peered":"2024-04-19T02:16:47.156498+0000","last_clean":"2024-04-19T02:16:47.156498+0000","last_became_active":"2024-04-19T02:15:29.280727+0000","last_became_peered":"2024-04-19T02:15:29.280727+0000","last_unstale":"2024-04-19T02:16:47.156498+0000","last_undegraded":"2024-04-19T02:16:47.156498+0000","last_fullsized":"2024-04-19T02:16:47.156498+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"42'8219","reported_seq":8253,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-19T02:16:52.794933+0000","last_change":"2024-04-19T02:15:53.959099+0000","last_active":"2024-04-19T02:16:52.794933+0000","last_peered":"2024-04-19T02:16:52.794933+0000","last_clean":"2024-04-19T02:16:52.794933+0000","last_became_active":"2024-04-19T02:15:53.958885+0000","last_became_peered":"2024-04-19T02:15:53.958885+0000","last_unstale":"2024-04-19T02:16:52.794933+0000","last_undegraded":"2024-04-19T02:16:52.794933+0000","last_fullsized":"2024-04-19T02:16:52.794933+0000","mapping_epoch":16,"log_start":"30'4600","ondisk_log_start":"30'4600","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3619,"log_dups_size":0,"ondisk_log_size":3619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:53:26.969927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":538640384,"num_objects":8219,"num_object_clones":0,"num_object_copies":16438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8219,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8219,"num_write_kb":526016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.157970+0000","last_change":"2024-04-19T02:15:28.892767+0000","last_active":"2024-04-19T02:16:47.157970+0000","last_peered":"2024-04-19T02:16:47.157970+0000","last_clean":"2024-04-19T02:16:47.157970+0000","last_became_active":"2024-04-19T02:15:28.892235+0000","last_became_peered":"2024-04-19T02:15:28.892235+0000","last_unstale":"2024-04-19T02:16:47.157970+0000","last_undegraded":"2024-04-19T02:16:47.157970+0000","last_fullsized":"2024-04-19T02:16:47.157970+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:37.690735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.153958+0000","last_change":"2024-04-19T02:15:29.279857+0000","last_active":"2024-04-19T02:16:47.153958+0000","last_peered":"2024-04-19T02:16:47.153958+0000","last_clean":"2024-04-19T02:16:47.153958+0000","last_became_active":"2024-04-19T02:15:29.279536+0000","last_became_peered":"2024-04-19T02:15:29.279536+0000","last_unstale":"2024-04-19T02:16:47.153958+0000","last_undegraded":"2024-04-19T02:16:47.153958+0000","last_fullsized":"2024-04-19T02:16:47.153958+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:00.191179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"42'8123","reported_seq":8155,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-19T02:16:52.789346+0000","last_change":"2024-04-19T02:15:53.957261+0000","last_active":"2024-04-19T02:16:52.789346+0000","last_peered":"2024-04-19T02:16:52.789346+0000","last_clean":"2024-04-19T02:16:52.789346+0000","last_became_active":"2024-04-19T02:15:53.957092+0000","last_became_peered":"2024-04-19T02:15:53.957092+0000","last_unstale":"2024-04-19T02:16:52.789346+0000","last_undegraded":"2024-04-19T02:16:52.789346+0000","last_fullsized":"2024-04-19T02:16:52.789346+0000","mapping_epoch":16,"log_start":"27'4413","ondisk_log_start":"27'4413","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3710,"log_dups_size":0,"ondisk_log_size":3710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:54:15.544923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":532348928,"num_objects":8123,"num_object_clones":0,"num_object_copies":16246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8123,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8123,"num_write_kb":519872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.153873+0000","last_change":"2024-04-19T02:15:28.891611+0000","last_active":"2024-04-19T02:16:47.153873+0000","last_peered":"2024-04-19T02:16:47.153873+0000","last_clean":"2024-04-19T02:16:47.153873+0000","last_became_active":"2024-04-19T02:15:28.890914+0000","last_became_peered":"2024-04-19T02:15:28.890914+0000","last_unstale":"2024-04-19T02:16:47.153873+0000","last_undegraded":"2024-04-19T02:16:47.153873+0000","last_fullsized":"2024-04-19T02:16:47.153873+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:37.690735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.157984+0000","last_change":"2024-04-19T02:15:29.285774+0000","last_active":"2024-04-19T02:16:47.157984+0000","last_peered":"2024-04-19T02:16:47.157984+0000","last_clean":"2024-04-19T02:16:47.157984+0000","last_became_active":"2024-04-19T02:15:29.284705+0000","last_became_peered":"2024-04-19T02:15:29.284705+0000","last_unstale":"2024-04-19T02:16:47.157984+0000","last_undegraded":"2024-04-19T02:16:47.157984+0000","last_fullsized":"2024-04-19T02:16:47.157984+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"42'8117","reported_seq":8151,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-19T02:16:52.781090+0000","last_change":"2024-04-19T02:15:53.955286+0000","last_active":"2024-04-19T02:16:52.781090+0000","last_peered":"2024-04-19T02:16:52.781090+0000","last_clean":"2024-04-19T02:16:52.781090+0000","last_became_active":"2024-04-19T02:15:53.955026+0000","last_became_peered":"2024-04-19T02:15:53.955026+0000","last_unstale":"2024-04-19T02:16:52.781090+0000","last_undegraded":"2024-04-19T02:16:52.781090+0000","last_fullsized":"2024-04-19T02:16:52.781090+0000","mapping_epoch":16,"log_start":"30'4500","ondisk_log_start":"30'4500","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3617,"log_dups_size":0,"ondisk_log_size":3617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:05:48.594301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":531955712,"num_objects":8117,"num_object_clones":0,"num_object_copies":16234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8117,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8117,"num_write_kb":519488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.156377+0000","last_change":"2024-04-19T02:15:28.892873+0000","last_active":"2024-04-19T02:16:47.156377+0000","last_peered":"2024-04-19T02:16:47.156377+0000","last_clean":"2024-04-19T02:16:47.156377+0000","last_became_active":"2024-04-19T02:15:28.892487+0000","last_became_peered":"2024-04-19T02:15:28.892487+0000","last_unstale":"2024-04-19T02:16:47.156377+0000","last_undegraded":"2024-04-19T02:16:47.156377+0000","last_fullsized":"2024-04-19T02:16:47.156377+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:35.412837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.158706+0000","last_change":"2024-04-19T02:15:29.285019+0000","last_active":"2024-04-19T02:16:47.158706+0000","last_peered":"2024-04-19T02:16:47.158706+0000","last_clean":"2024-04-19T02:16:47.158706+0000","last_became_active":"2024-04-19T02:15:29.284650+0000","last_became_peered":"2024-04-19T02:15:29.284650+0000","last_unstale":"2024-04-19T02:16:47.158706+0000","last_undegraded":"2024-04-19T02:16:47.158706+0000","last_fullsized":"2024-04-19T02:16:47.158706+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"42'8144","reported_seq":8177,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-19T02:16:52.817326+0000","last_change":"2024-04-19T02:15:53.957403+0000","last_active":"2024-04-19T02:16:52.817326+0000","last_peered":"2024-04-19T02:16:52.817326+0000","last_clean":"2024-04-19T02:16:52.817326+0000","last_became_active":"2024-04-19T02:15:53.957190+0000","last_became_peered":"2024-04-19T02:15:53.957190+0000","last_unstale":"2024-04-19T02:16:52.817326+0000","last_undegraded":"2024-04-19T02:16:52.817326+0000","last_fullsized":"2024-04-19T02:16:52.817326+0000","mapping_epoch":16,"log_start":"27'4401","ondisk_log_start":"27'4401","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3743,"log_dups_size":0,"ondisk_log_size":3743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:07:12.817884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":533725184,"num_objects":8144,"num_object_clones":0,"num_object_copies":16288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8144,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8144,"num_write_kb":521216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.157060+0000","last_change":"2024-04-19T02:15:53.956839+0000","last_active":"2024-04-19T02:16:47.157060+0000","last_peered":"2024-04-19T02:16:47.157060+0000","last_clean":"2024-04-19T02:16:47.157060+0000","last_became_active":"2024-04-19T02:15:53.956630+0000","last_became_peered":"2024-04-19T02:15:53.956630+0000","last_unstale":"2024-04-19T02:16:47.157060+0000","last_undegraded":"2024-04-19T02:16:47.157060+0000","last_fullsized":"2024-04-19T02:16:47.157060+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:47.229730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.158476+0000","last_change":"2024-04-19T02:15:29.287190+0000","last_active":"2024-04-19T02:16:47.158476+0000","last_peered":"2024-04-19T02:16:47.158476+0000","last_clean":"2024-04-19T02:16:47.158476+0000","last_became_active":"2024-04-19T02:15:29.286606+0000","last_became_peered":"2024-04-19T02:15:29.286606+0000","last_unstale":"2024-04-19T02:16:47.158476+0000","last_undegraded":"2024-04-19T02:16:47.158476+0000","last_fullsized":"2024-04-19T02:16:47.158476+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:28.387062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"42'7934","reported_seq":7968,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-19T02:16:52.758724+0000","last_change":"2024-04-19T02:15:53.958448+0000","last_active":"2024-04-19T02:16:52.758724+0000","last_peered":"2024-04-19T02:16:52.758724+0000","last_clean":"2024-04-19T02:16:52.758724+0000","last_became_active":"2024-04-19T02:15:53.957595+0000","last_became_peered":"2024-04-19T02:15:53.957595+0000","last_unstale":"2024-04-19T02:16:52.758724+0000","last_undegraded":"2024-04-19T02:16:52.758724+0000","last_fullsized":"2024-04-19T02:16:52.758724+0000","mapping_epoch":16,"log_start":"26'3944","ondisk_log_start":"26'3944","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3990,"log_dups_size":0,"ondisk_log_size":3990,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:26:31.855319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":519962624,"num_objects":7934,"num_object_clones":0,"num_object_copies":15868,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7934,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7934,"num_write_kb":507776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.161488+0000","last_change":"2024-04-19T02:15:28.894121+0000","last_active":"2024-04-19T02:16:47.161488+0000","last_peered":"2024-04-19T02:16:47.161488+0000","last_clean":"2024-04-19T02:16:47.161488+0000","last_became_active":"2024-04-19T02:15:28.893902+0000","last_became_peered":"2024-04-19T02:15:28.893902+0000","last_unstale":"2024-04-19T02:16:47.161488+0000","last_undegraded":"2024-04-19T02:16:47.161488+0000","last_fullsized":"2024-04-19T02:16:47.161488+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:10:35.146583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.154600+0000","last_change":"2024-04-19T02:15:29.282870+0000","last_active":"2024-04-19T02:16:47.154600+0000","last_peered":"2024-04-19T02:16:47.154600+0000","last_clean":"2024-04-19T02:16:47.154600+0000","last_became_active":"2024-04-19T02:15:29.281873+0000","last_became_peered":"2024-04-19T02:15:29.281873+0000","last_unstale":"2024-04-19T02:16:47.154600+0000","last_undegraded":"2024-04-19T02:16:47.154600+0000","last_fullsized":"2024-04-19T02:16:47.154600+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"42'8111","reported_seq":8142,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-19T02:16:52.799561+0000","last_change":"2024-04-19T02:15:53.955498+0000","last_active":"2024-04-19T02:16:52.799561+0000","last_peered":"2024-04-19T02:16:52.799561+0000","last_clean":"2024-04-19T02:16:52.799561+0000","last_became_active":"2024-04-19T02:15:53.954910+0000","last_became_peered":"2024-04-19T02:15:53.954910+0000","last_unstale":"2024-04-19T02:16:52.799561+0000","last_undegraded":"2024-04-19T02:16:52.799561+0000","last_fullsized":"2024-04-19T02:16:52.799561+0000","mapping_epoch":16,"log_start":"27'4500","ondisk_log_start":"27'4500","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3611,"log_dups_size":0,"ondisk_log_size":3611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:58:27.262672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":531562496,"num_objects":8111,"num_object_clones":0,"num_object_copies":16222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8111,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8111,"num_write_kb":519104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.154694+0000","last_change":"2024-04-19T02:15:24.527061+0000","last_active":"2024-04-19T02:16:47.154694+0000","last_peered":"2024-04-19T02:16:47.154694+0000","last_clean":"2024-04-19T02:16:47.154694+0000","last_became_active":"2024-04-19T02:15:24.526757+0000","last_became_peered":"2024-04-19T02:15:24.526757+0000","last_unstale":"2024-04-19T02:16:47.154694+0000","last_undegraded":"2024-04-19T02:16:47.154694+0000","last_fullsized":"2024-04-19T02:16:47.154694+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:17:13.649077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.158629+0000","last_change":"2024-04-19T02:15:28.892766+0000","last_active":"2024-04-19T02:16:47.158629+0000","last_peered":"2024-04-19T02:16:47.158629+0000","last_clean":"2024-04-19T02:16:47.158629+0000","last_became_active":"2024-04-19T02:15:28.892396+0000","last_became_peered":"2024-04-19T02:15:28.892396+0000","last_unstale":"2024-04-19T02:16:47.158629+0000","last_undegraded":"2024-04-19T02:16:47.158629+0000","last_fullsized":"2024-04-19T02:16:47.158629+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:57.946581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.161530+0000","last_change":"2024-04-19T02:15:29.277922+0000","last_active":"2024-04-19T02:16:47.161530+0000","last_peered":"2024-04-19T02:16:47.161530+0000","last_clean":"2024-04-19T02:16:47.161530+0000","last_became_active":"2024-04-19T02:15:29.276968+0000","last_became_peered":"2024-04-19T02:15:29.276968+0000","last_unstale":"2024-04-19T02:16:47.161530+0000","last_undegraded":"2024-04-19T02:16:47.161530+0000","last_fullsized":"2024-04-19T02:16:47.161530+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"42'8130","reported_seq":8164,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-19T02:16:52.780562+0000","last_change":"2024-04-19T02:15:53.955228+0000","last_active":"2024-04-19T02:16:52.780562+0000","last_peered":"2024-04-19T02:16:52.780562+0000","last_clean":"2024-04-19T02:16:52.780562+0000","last_became_active":"2024-04-19T02:15:53.954960+0000","last_became_peered":"2024-04-19T02:15:53.954960+0000","last_unstale":"2024-04-19T02:16:52.780562+0000","last_undegraded":"2024-04-19T02:16:52.780562+0000","last_fullsized":"2024-04-19T02:16:52.780562+0000","mapping_epoch":16,"log_start":"27'4500","ondisk_log_start":"27'4500","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3630,"log_dups_size":0,"ondisk_log_size":3630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:46:07.409922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":532807680,"num_objects":8130,"num_object_clones":0,"num_object_copies":16260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8130,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8130,"num_write_kb":520320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.156561+0000","last_change":"2024-04-19T02:15:24.530933+0000","last_active":"2024-04-19T02:16:47.156561+0000","last_peered":"2024-04-19T02:16:47.156561+0000","last_clean":"2024-04-19T02:16:47.156561+0000","last_became_active":"2024-04-19T02:15:24.530550+0000","last_became_peered":"2024-04-19T02:15:24.530550+0000","last_unstale":"2024-04-19T02:16:47.156561+0000","last_undegraded":"2024-04-19T02:16:47.156561+0000","last_fullsized":"2024-04-19T02:16:47.156561+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:18:15.194321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.156993+0000","last_change":"2024-04-19T02:15:28.893062+0000","last_active":"2024-04-19T02:16:47.156993+0000","last_peered":"2024-04-19T02:16:47.156993+0000","last_clean":"2024-04-19T02:16:47.156993+0000","last_became_active":"2024-04-19T02:15:28.892798+0000","last_became_peered":"2024-04-19T02:15:28.892798+0000","last_unstale":"2024-04-19T02:16:47.156993+0000","last_undegraded":"2024-04-19T02:16:47.156993+0000","last_fullsized":"2024-04-19T02:16:47.156993+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:53.170180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.154412+0000","last_change":"2024-04-19T02:15:29.278294+0000","last_active":"2024-04-19T02:16:47.154412+0000","last_peered":"2024-04-19T02:16:47.154412+0000","last_clean":"2024-04-19T02:16:47.154412+0000","last_became_active":"2024-04-19T02:15:29.277536+0000","last_became_peered":"2024-04-19T02:15:29.277536+0000","last_unstale":"2024-04-19T02:16:47.154412+0000","last_undegraded":"2024-04-19T02:16:47.154412+0000","last_fullsized":"2024-04-19T02:16:47.154412+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"42'8171","reported_seq":8205,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-19T02:16:52.772220+0000","last_change":"2024-04-19T02:15:53.956251+0000","last_active":"2024-04-19T02:16:52.772220+0000","last_peered":"2024-04-19T02:16:52.772220+0000","last_clean":"2024-04-19T02:16:52.772220+0000","last_became_active":"2024-04-19T02:15:53.955886+0000","last_became_peered":"2024-04-19T02:15:53.955886+0000","last_unstale":"2024-04-19T02:16:52.772220+0000","last_undegraded":"2024-04-19T02:16:52.772220+0000","last_fullsized":"2024-04-19T02:16:52.772220+0000","mapping_epoch":16,"log_start":"28'4500","ondisk_log_start":"28'4500","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3671,"log_dups_size":0,"ondisk_log_size":3671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:38:38.586906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":535494656,"num_objects":8171,"num_object_clones":0,"num_object_copies":16342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8171,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8171,"num_write_kb":522944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.154494+0000","last_change":"2024-04-19T02:15:24.527048+0000","last_active":"2024-04-19T02:16:47.154494+0000","last_peered":"2024-04-19T02:16:47.154494+0000","last_clean":"2024-04-19T02:16:47.154494+0000","last_became_active":"2024-04-19T02:15:24.526790+0000","last_became_peered":"2024-04-19T02:15:24.526790+0000","last_unstale":"2024-04-19T02:16:47.154494+0000","last_undegraded":"2024-04-19T02:16:47.154494+0000","last_fullsized":"2024-04-19T02:16:47.154494+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.155968+0000","last_change":"2024-04-19T02:15:53.956945+0000","last_active":"2024-04-19T02:16:47.155968+0000","last_peered":"2024-04-19T02:16:47.155968+0000","last_clean":"2024-04-19T02:16:47.155968+0000","last_became_active":"2024-04-19T02:15:53.956719+0000","last_became_peered":"2024-04-19T02:15:53.956719+0000","last_unstale":"2024-04-19T02:16:47.155968+0000","last_undegraded":"2024-04-19T02:16:47.155968+0000","last_fullsized":"2024-04-19T02:16:47.155968+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:00:37.754624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.154825+0000","last_change":"2024-04-19T02:15:29.282663+0000","last_active":"2024-04-19T02:16:47.154825+0000","last_peered":"2024-04-19T02:16:47.154825+0000","last_clean":"2024-04-19T02:16:47.154825+0000","last_became_active":"2024-04-19T02:15:29.282217+0000","last_became_peered":"2024-04-19T02:15:29.282217+0000","last_unstale":"2024-04-19T02:16:47.154825+0000","last_undegraded":"2024-04-19T02:16:47.154825+0000","last_fullsized":"2024-04-19T02:16:47.154825+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"42'8022","reported_seq":8055,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-19T02:16:52.770677+0000","last_change":"2024-04-19T02:15:53.958264+0000","last_active":"2024-04-19T02:16:52.770677+0000","last_peered":"2024-04-19T02:16:52.770677+0000","last_clean":"2024-04-19T02:16:52.770677+0000","last_became_active":"2024-04-19T02:15:53.956689+0000","last_became_peered":"2024-04-19T02:15:53.956689+0000","last_unstale":"2024-04-19T02:16:52.770677+0000","last_undegraded":"2024-04-19T02:16:52.770677+0000","last_fullsized":"2024-04-19T02:16:52.770677+0000","mapping_epoch":16,"log_start":"26'4100","ondisk_log_start":"26'4100","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3922,"log_dups_size":0,"ondisk_log_size":3922,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:24:32.928594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525729792,"num_objects":8022,"num_object_clones":0,"num_object_copies":16044,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8022,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8022,"num_write_kb":513408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.157068+0000","last_change":"2024-04-19T02:15:24.530924+0000","last_active":"2024-04-19T02:16:47.157068+0000","last_peered":"2024-04-19T02:16:47.157068+0000","last_clean":"2024-04-19T02:16:47.157068+0000","last_became_active":"2024-04-19T02:15:24.530551+0000","last_became_peered":"2024-04-19T02:15:24.530551+0000","last_unstale":"2024-04-19T02:16:47.157068+0000","last_undegraded":"2024-04-19T02:16:47.157068+0000","last_fullsized":"2024-04-19T02:16:47.157068+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:30.576946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":237,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.156188+0000","last_change":"2024-04-19T02:15:24.533634+0000","last_active":"2024-04-19T02:16:47.156188+0000","last_peered":"2024-04-19T02:16:47.156188+0000","last_clean":"2024-04-19T02:16:47.156188+0000","last_became_active":"2024-04-19T02:15:24.533420+0000","last_became_peered":"2024-04-19T02:15:24.533420+0000","last_unstale":"2024-04-19T02:16:47.156188+0000","last_undegraded":"2024-04-19T02:16:47.156188+0000","last_fullsized":"2024-04-19T02:16:47.156188+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.153857+0000","last_change":"2024-04-19T02:15:28.890244+0000","last_active":"2024-04-19T02:16:47.153857+0000","last_peered":"2024-04-19T02:16:47.153857+0000","last_clean":"2024-04-19T02:16:47.153857+0000","last_became_active":"2024-04-19T02:15:28.889831+0000","last_became_peered":"2024-04-19T02:15:28.889831+0000","last_unstale":"2024-04-19T02:16:47.153857+0000","last_undegraded":"2024-04-19T02:16:47.153857+0000","last_fullsized":"2024-04-19T02:16:47.153857+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.158627+0000","last_change":"2024-04-19T02:15:29.285015+0000","last_active":"2024-04-19T02:16:47.158627+0000","last_peered":"2024-04-19T02:16:47.158627+0000","last_clean":"2024-04-19T02:16:47.158627+0000","last_became_active":"2024-04-19T02:15:29.284164+0000","last_became_peered":"2024-04-19T02:15:29.284164+0000","last_unstale":"2024-04-19T02:16:47.158627+0000","last_undegraded":"2024-04-19T02:16:47.158627+0000","last_fullsized":"2024-04-19T02:16:47.158627+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:36.987844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"42'8076","reported_seq":8110,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-19T02:16:52.781288+0000","last_change":"2024-04-19T02:15:53.956463+0000","last_active":"2024-04-19T02:16:52.781288+0000","last_peered":"2024-04-19T02:16:52.781288+0000","last_clean":"2024-04-19T02:16:52.781288+0000","last_became_active":"2024-04-19T02:15:53.955819+0000","last_became_peered":"2024-04-19T02:15:53.955819+0000","last_unstale":"2024-04-19T02:16:52.781288+0000","last_undegraded":"2024-04-19T02:16:52.781288+0000","last_fullsized":"2024-04-19T02:16:52.781288+0000","mapping_epoch":16,"log_start":"27'4331","ondisk_log_start":"27'4331","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3745,"log_dups_size":0,"ondisk_log_size":3745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:46:07.409922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":529268736,"num_objects":8076,"num_object_clones":0,"num_object_copies":16152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8076,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8076,"num_write_kb":516864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.156221+0000","last_change":"2024-04-19T02:15:24.533912+0000","last_active":"2024-04-19T02:16:47.156221+0000","last_peered":"2024-04-19T02:16:47.156221+0000","last_clean":"2024-04-19T02:16:47.156221+0000","last_became_active":"2024-04-19T02:15:24.533580+0000","last_became_peered":"2024-04-19T02:15:24.533580+0000","last_unstale":"2024-04-19T02:16:47.156221+0000","last_undegraded":"2024-04-19T02:16:47.156221+0000","last_fullsized":"2024-04-19T02:16:47.156221+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:45.045477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.154317+0000","last_change":"2024-04-19T02:15:28.891889+0000","last_active":"2024-04-19T02:16:47.154317+0000","last_peered":"2024-04-19T02:16:47.154317+0000","last_clean":"2024-04-19T02:16:47.154317+0000","last_became_active":"2024-04-19T02:15:28.890919+0000","last_became_peered":"2024-04-19T02:15:28.890919+0000","last_unstale":"2024-04-19T02:16:47.154317+0000","last_undegraded":"2024-04-19T02:16:47.154317+0000","last_fullsized":"2024-04-19T02:16:47.154317+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:35.412837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.156318+0000","last_change":"2024-04-19T02:15:53.957881+0000","last_active":"2024-04-19T02:16:47.156318+0000","last_peered":"2024-04-19T02:16:47.156318+0000","last_clean":"2024-04-19T02:16:47.156318+0000","last_became_active":"2024-04-19T02:15:53.957657+0000","last_became_peered":"2024-04-19T02:15:53.957657+0000","last_unstale":"2024-04-19T02:16:47.156318+0000","last_undegraded":"2024-04-19T02:16:47.156318+0000","last_fullsized":"2024-04-19T02:16:47.156318+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:46.921714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"42'8119","reported_seq":8153,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-19T02:16:52.775173+0000","last_change":"2024-04-19T02:15:53.955068+0000","last_active":"2024-04-19T02:16:52.775173+0000","last_peered":"2024-04-19T02:16:52.775173+0000","last_clean":"2024-04-19T02:16:52.775173+0000","last_became_active":"2024-04-19T02:15:53.954721+0000","last_became_peered":"2024-04-19T02:15:53.954721+0000","last_unstale":"2024-04-19T02:16:52.775173+0000","last_undegraded":"2024-04-19T02:16:52.775173+0000","last_fullsized":"2024-04-19T02:16:52.775173+0000","mapping_epoch":16,"log_start":"27'4400","ondisk_log_start":"27'4400","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3719,"log_dups_size":0,"ondisk_log_size":3719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:18:29.742535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":532086784,"num_objects":8119,"num_object_clones":0,"num_object_copies":16238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8119,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8119,"num_write_kb":519616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.154227+0000","last_change":"2024-04-19T02:15:53.959105+0000","last_active":"2024-04-19T02:16:47.154227+0000","last_peered":"2024-04-19T02:16:47.154227+0000","last_clean":"2024-04-19T02:16:47.154227+0000","last_became_active":"2024-04-19T02:15:53.958836+0000","last_became_peered":"2024-04-19T02:15:53.958836+0000","last_unstale":"2024-04-19T02:16:47.154227+0000","last_undegraded":"2024-04-19T02:16:47.154227+0000","last_fullsized":"2024-04-19T02:16:47.154227+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:18:00.321514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.154433+0000","last_change":"2024-04-19T02:15:28.892125+0000","last_active":"2024-04-19T02:16:47.154433+0000","last_peered":"2024-04-19T02:16:47.154433+0000","last_clean":"2024-04-19T02:16:47.154433+0000","last_became_active":"2024-04-19T02:15:28.891300+0000","last_became_peered":"2024-04-19T02:15:28.891300+0000","last_unstale":"2024-04-19T02:16:47.154433+0000","last_undegraded":"2024-04-19T02:16:47.154433+0000","last_fullsized":"2024-04-19T02:16:47.154433+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.161728+0000","last_change":"2024-04-19T02:15:29.281694+0000","last_active":"2024-04-19T02:16:47.161728+0000","last_peered":"2024-04-19T02:16:47.161728+0000","last_clean":"2024-04-19T02:16:47.161728+0000","last_became_active":"2024-04-19T02:15:29.280519+0000","last_became_peered":"2024-04-19T02:15:29.280519+0000","last_unstale":"2024-04-19T02:16:47.161728+0000","last_undegraded":"2024-04-19T02:16:47.161728+0000","last_fullsized":"2024-04-19T02:16:47.161728+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:50.890545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"42'7925","reported_seq":17056,"reported_epoch":42,"state":"active+remapped+backfilling","last_fresh":"2024-04-19T02:16:52.805835+0000","last_change":"2024-04-19T02:16:30.103016+0000","last_active":"2024-04-19T02:16:52.805835+0000","last_peered":"2024-04-19T02:16:52.805835+0000","last_clean":"2024-04-19T02:16:22.050311+0000","last_became_active":"2024-04-19T02:16:24.119992+0000","last_became_peered":"2024-04-19T02:16:24.119992+0000","last_unstale":"2024-04-19T02:16:52.805835+0000","last_undegraded":"2024-04-19T02:16:52.805835+0000","last_fullsized":"2024-04-19T02:16:52.805835+0000","mapping_epoch":29,"log_start":"27'4337","ondisk_log_start":"27'4337","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3588,"log_dups_size":0,"ondisk_log_size":3588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:28.663111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":519372800,"num_objects":7925,"num_object_clones":0,"num_object_copies":15850,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":1870,"num_objects_unfound":0,"num_objects_dirty":7925,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7925,"num_write_kb":507200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4542,"num_bytes_recovered":297664512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[{"shards":"0,2","objects":7925}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.154523+0000","last_change":"2024-04-19T02:15:28.891702+0000","last_active":"2024-04-19T02:16:47.154523+0000","last_peered":"2024-04-19T02:16:47.154523+0000","last_clean":"2024-04-19T02:16:47.154523+0000","last_became_active":"2024-04-19T02:15:28.890743+0000","last_became_peered":"2024-04-19T02:15:28.890743+0000","last_unstale":"2024-04-19T02:16:47.154523+0000","last_undegraded":"2024-04-19T02:16:47.154523+0000","last_fullsized":"2024-04-19T02:16:47.154523+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.156492+0000","last_change":"2024-04-19T02:15:24.526845+0000","last_active":"2024-04-19T02:16:47.156492+0000","last_peered":"2024-04-19T02:16:47.156492+0000","last_clean":"2024-04-19T02:16:47.156492+0000","last_became_active":"2024-04-19T02:15:24.526500+0000","last_became_peered":"2024-04-19T02:15:24.526500+0000","last_unstale":"2024-04-19T02:16:47.156492+0000","last_undegraded":"2024-04-19T02:16:47.156492+0000","last_fullsized":"2024-04-19T02:16:47.156492+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:16.883355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.153528+0000","last_change":"2024-04-19T02:15:29.278686+0000","last_active":"2024-04-19T02:16:47.153528+0000","last_peered":"2024-04-19T02:16:47.153528+0000","last_clean":"2024-04-19T02:16:47.153528+0000","last_became_active":"2024-04-19T02:15:29.278108+0000","last_became_peered":"2024-04-19T02:15:29.278108+0000","last_unstale":"2024-04-19T02:16:47.153528+0000","last_undegraded":"2024-04-19T02:16:47.153528+0000","last_fullsized":"2024-04-19T02:16:47.153528+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:34.593754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"42'7970","reported_seq":8004,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-19T02:16:52.756515+0000","last_change":"2024-04-19T02:15:53.957269+0000","last_active":"2024-04-19T02:16:52.756515+0000","last_peered":"2024-04-19T02:16:52.756515+0000","last_clean":"2024-04-19T02:16:52.756515+0000","last_became_active":"2024-04-19T02:15:53.956554+0000","last_became_peered":"2024-04-19T02:15:53.956554+0000","last_unstale":"2024-04-19T02:16:52.756515+0000","last_undegraded":"2024-04-19T02:16:52.756515+0000","last_fullsized":"2024-04-19T02:16:52.756515+0000","mapping_epoch":16,"log_start":"26'4028","ondisk_log_start":"26'4028","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3942,"log_dups_size":0,"ondisk_log_size":3942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:29:38.789719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":522321920,"num_objects":7970,"num_object_clones":0,"num_object_copies":15940,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7970,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7970,"num_write_kb":510080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.158394+0000","last_change":"2024-04-19T02:15:24.533777+0000","last_active":"2024-04-19T02:16:47.158394+0000","last_peered":"2024-04-19T02:16:47.158394+0000","last_clean":"2024-04-19T02:16:47.158394+0000","last_became_active":"2024-04-19T02:15:24.533436+0000","last_became_peered":"2024-04-19T02:15:24.533436+0000","last_unstale":"2024-04-19T02:16:47.158394+0000","last_undegraded":"2024-04-19T02:16:47.158394+0000","last_fullsized":"2024-04-19T02:16:47.158394+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:53:25.922418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":39,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.156395+0000","last_change":"2024-04-19T02:15:28.891370+0000","last_active":"2024-04-19T02:16:47.156395+0000","last_peered":"2024-04-19T02:16:47.156395+0000","last_clean":"2024-04-19T02:16:47.156395+0000","last_became_active":"2024-04-19T02:15:28.890702+0000","last_became_peered":"2024-04-19T02:15:28.890702+0000","last_unstale":"2024-04-19T02:16:47.156395+0000","last_undegraded":"2024-04-19T02:16:47.156395+0000","last_fullsized":"2024-04-19T02:16:47.156395+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:33.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.162450+0000","last_change":"2024-04-19T02:15:29.282244+0000","last_active":"2024-04-19T02:16:47.162450+0000","last_peered":"2024-04-19T02:16:47.162450+0000","last_clean":"2024-04-19T02:16:47.162450+0000","last_became_active":"2024-04-19T02:15:29.280366+0000","last_became_peered":"2024-04-19T02:15:29.280366+0000","last_unstale":"2024-04-19T02:16:47.162450+0000","last_undegraded":"2024-04-19T02:16:47.162450+0000","last_fullsized":"2024-04-19T02:16:47.162450+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":39,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.161772+0000","last_change":"2024-04-19T02:15:28.893027+0000","last_active":"2024-04-19T02:16:47.161772+0000","last_peered":"2024-04-19T02:16:47.161772+0000","last_clean":"2024-04-19T02:16:47.161772+0000","last_became_active":"2024-04-19T02:15:28.892695+0000","last_became_peered":"2024-04-19T02:15:28.892695+0000","last_unstale":"2024-04-19T02:16:47.161772+0000","last_undegraded":"2024-04-19T02:16:47.161772+0000","last_fullsized":"2024-04-19T02:16:47.161772+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.162154+0000","last_change":"2024-04-19T02:15:29.283155+0000","last_active":"2024-04-19T02:16:47.162154+0000","last_peered":"2024-04-19T02:16:47.162154+0000","last_clean":"2024-04-19T02:16:47.162154+0000","last_became_active":"2024-04-19T02:15:29.281407+0000","last_became_peered":"2024-04-19T02:15:29.281407+0000","last_unstale":"2024-04-19T02:16:47.162154+0000","last_undegraded":"2024-04-19T02:16:47.162154+0000","last_fullsized":"2024-04-19T02:16:47.162154+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.158075+0000","last_change":"2024-04-19T02:15:28.893067+0000","last_active":"2024-04-19T02:16:47.158075+0000","last_peered":"2024-04-19T02:16:47.158075+0000","last_clean":"2024-04-19T02:16:47.158075+0000","last_became_active":"2024-04-19T02:15:28.892781+0000","last_became_peered":"2024-04-19T02:15:28.892781+0000","last_unstale":"2024-04-19T02:16:47.158075+0000","last_undegraded":"2024-04-19T02:16:47.158075+0000","last_fullsized":"2024-04-19T02:16:47.158075+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:54:15.590143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.156923+0000","last_change":"2024-04-19T02:15:29.281279+0000","last_active":"2024-04-19T02:16:47.156923+0000","last_peered":"2024-04-19T02:16:47.156923+0000","last_clean":"2024-04-19T02:16:47.156923+0000","last_became_active":"2024-04-19T02:15:29.279360+0000","last_became_peered":"2024-04-19T02:15:29.279360+0000","last_unstale":"2024-04-19T02:16:47.156923+0000","last_undegraded":"2024-04-19T02:16:47.156923+0000","last_fullsized":"2024-04-19T02:16:47.156923+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.161923+0000","last_change":"2024-04-19T02:15:28.893239+0000","last_active":"2024-04-19T02:16:47.161923+0000","last_peered":"2024-04-19T02:16:47.161923+0000","last_clean":"2024-04-19T02:16:47.161923+0000","last_became_active":"2024-04-19T02:15:28.892881+0000","last_became_peered":"2024-04-19T02:15:28.892881+0000","last_unstale":"2024-04-19T02:16:47.161923+0000","last_undegraded":"2024-04-19T02:16:47.161923+0000","last_fullsized":"2024-04-19T02:16:47.161923+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.156447+0000","last_change":"2024-04-19T02:15:29.281652+0000","last_active":"2024-04-19T02:16:47.156447+0000","last_peered":"2024-04-19T02:16:47.156447+0000","last_clean":"2024-04-19T02:16:47.156447+0000","last_became_active":"2024-04-19T02:15:29.281175+0000","last_became_peered":"2024-04-19T02:15:29.281175+0000","last_unstale":"2024-04-19T02:16:47.156447+0000","last_undegraded":"2024-04-19T02:16:47.156447+0000","last_fullsized":"2024-04-19T02:16:47.156447+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:16.568764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":39,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.156574+0000","last_change":"2024-04-19T02:15:28.892058+0000","last_active":"2024-04-19T02:16:47.156574+0000","last_peered":"2024-04-19T02:16:47.156574+0000","last_clean":"2024-04-19T02:16:47.156574+0000","last_became_active":"2024-04-19T02:15:28.890877+0000","last_became_peered":"2024-04-19T02:15:28.890877+0000","last_unstale":"2024-04-19T02:16:47.156574+0000","last_undegraded":"2024-04-19T02:16:47.156574+0000","last_fullsized":"2024-04-19T02:16:47.156574+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:53.170180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.162891+0000","last_change":"2024-04-19T02:15:29.278810+0000","last_active":"2024-04-19T02:16:47.162891+0000","last_peered":"2024-04-19T02:16:47.162891+0000","last_clean":"2024-04-19T02:16:47.162891+0000","last_became_active":"2024-04-19T02:15:29.277913+0000","last_became_peered":"2024-04-19T02:15:29.277913+0000","last_unstale":"2024-04-19T02:16:47.162891+0000","last_undegraded":"2024-04-19T02:16:47.162891+0000","last_fullsized":"2024-04-19T02:16:47.162891+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:24.082666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":42,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.154677+0000","last_change":"2024-04-19T02:15:28.889132+0000","last_active":"2024-04-19T02:16:47.154677+0000","last_peered":"2024-04-19T02:16:47.154677+0000","last_clean":"2024-04-19T02:16:47.154677+0000","last_became_active":"2024-04-19T02:15:28.888926+0000","last_became_peered":"2024-04-19T02:15:28.888926+0000","last_unstale":"2024-04-19T02:16:47.154677+0000","last_undegraded":"2024-04-19T02:16:47.154677+0000","last_fullsized":"2024-04-19T02:16:47.154677+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.156447+0000","last_change":"2024-04-19T02:15:29.282776+0000","last_active":"2024-04-19T02:16:47.156447+0000","last_peered":"2024-04-19T02:16:47.156447+0000","last_clean":"2024-04-19T02:16:47.156447+0000","last_became_active":"2024-04-19T02:15:29.279382+0000","last_became_peered":"2024-04-19T02:15:29.279382+0000","last_unstale":"2024-04-19T02:16:47.156447+0000","last_undegraded":"2024-04-19T02:16:47.156447+0000","last_fullsized":"2024-04-19T02:16:47.156447+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.156306+0000","last_change":"2024-04-19T02:15:29.283537+0000","last_active":"2024-04-19T02:16:47.156306+0000","last_peered":"2024-04-19T02:16:47.156306+0000","last_clean":"2024-04-19T02:16:47.156306+0000","last_became_active":"2024-04-19T02:15:29.281801+0000","last_became_peered":"2024-04-19T02:15:29.281801+0000","last_unstale":"2024-04-19T02:16:47.156306+0000","last_undegraded":"2024-04-19T02:16:47.156306+0000","last_fullsized":"2024-04-19T02:16:47.156306+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.154400+0000","last_change":"2024-04-19T02:15:29.281560+0000","last_active":"2024-04-19T02:16:47.154400+0000","last_peered":"2024-04-19T02:16:47.154400+0000","last_clean":"2024-04-19T02:16:47.154400+0000","last_became_active":"2024-04-19T02:15:29.281261+0000","last_became_peered":"2024-04-19T02:15:29.281261+0000","last_unstale":"2024-04-19T02:16:47.154400+0000","last_undegraded":"2024-04-19T02:16:47.154400+0000","last_fullsized":"2024-04-19T02:16:47.154400+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.156243+0000","last_change":"2024-04-19T02:15:53.955913+0000","last_active":"2024-04-19T02:16:47.156243+0000","last_peered":"2024-04-19T02:16:47.156243+0000","last_clean":"2024-04-19T02:16:47.156243+0000","last_became_active":"2024-04-19T02:15:53.955676+0000","last_became_peered":"2024-04-19T02:15:53.955676+0000","last_unstale":"2024-04-19T02:16:47.156243+0000","last_undegraded":"2024-04-19T02:16:47.156243+0000","last_fullsized":"2024-04-19T02:16:47.156243+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:53:02.899902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.153943+0000","last_change":"2024-04-19T02:15:29.278702+0000","last_active":"2024-04-19T02:16:47.153943+0000","last_peered":"2024-04-19T02:16:47.153943+0000","last_clean":"2024-04-19T02:16:47.153943+0000","last_became_active":"2024-04-19T02:15:29.277756+0000","last_became_peered":"2024-04-19T02:15:29.277756+0000","last_unstale":"2024-04-19T02:16:47.153943+0000","last_undegraded":"2024-04-19T02:16:47.153943+0000","last_fullsized":"2024-04-19T02:16:47.153943+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.162242+0000","last_change":"2024-04-19T02:15:29.277568+0000","last_active":"2024-04-19T02:16:47.162242+0000","last_peered":"2024-04-19T02:16:47.162242+0000","last_clean":"2024-04-19T02:16:47.162242+0000","last_became_active":"2024-04-19T02:15:29.276725+0000","last_became_peered":"2024-04-19T02:15:29.276725+0000","last_unstale":"2024-04-19T02:16:47.162242+0000","last_undegraded":"2024-04-19T02:16:47.162242+0000","last_fullsized":"2024-04-19T02:16:47.162242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":8489992192,"num_objects":129547,"num_object_clones":0,"num_object_copies":259094,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":1870,"num_objects_unfound":0,"num_objects_dirty":129547,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129547,"num_write_kb":8291008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4542,"num_bytes_recovered":297664512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17378246656,"data_stored":17378246656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60146,"ondisk_log_size":60146,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738388,"num_pgs":84,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6859092,"kb_used_data":6665548,"kb_used_omap":1,"kb_used_meta":193534,"kb_avail":87512748,"statfs":{"total":96636764160,"available":89613053952,"internally_reserved":0,"allocated":6825521152,"data_stored":6825223044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":198179270},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.313,"15min":0.313},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.497,"5min":0.497,"15min":0.497},"last":0.17399999999999999},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.189}]},{"osd":1,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.222}]}]},{"osd":0,"up_from":8,"seq":34359738389,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5256308,"kb_used_data":5139048,"kb_used_omap":1,"kb_used_meta":117246,"kb_avail":89115532,"statfs":{"total":96636764160,"available":91254304768,"internally_reserved":0,"allocated":5262385152,"data_stored":5262060662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":120060358},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.185},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.27200000000000002}]},{"osd":2,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":2.1000000000000001,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.379}]}]},{"osd":1,"up_from":8,"seq":34359738388,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5196396,"kb_used_data":5044704,"kb_used_omap":1,"kb_used_meta":151678,"kb_avail":89175444,"statfs":{"total":96636764160,"available":91315654656,"internally_reserved":0,"allocated":5165776896,"data_stored":5165459982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":155318726},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:16:26 2024","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.16700000000000001},{"interface":"front","average":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"min":{"1min":0.16,"5min":0.16,"15min":0.16},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.191}]},{"osd":2,"last update":"Fri Apr 19 02:16:26 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.20799999999999999},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.224}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5318967296,"data_stored":5318967296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5172887552,"data_stored":5172887552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6886391808,"data_stored":6886391808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:16:54.875 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-19T02:16:54.963 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:54.963+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:55.017 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:55.018 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:55.030 INFO:tasks.radosbench.radosbench.0.smithi121.stdout:2024-04-19T02:16:55.031552+0000 min lat: 0.00120262 max lat: 2.06929 avg lat: 0.00716104 2024-04-19T02:16:55.030 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-19T02:16:55.030 INFO:tasks.radosbench.radosbench.0.smithi121.stdout: 60 4 134032 134028 139.601 127.188 0.0058939 0.00716104 2024-04-19T02:16:55.032 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:16:55.063 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:55.064+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:55.164 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:55.165+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:55.176 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:55.177 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:55.180 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T02:16:55.188 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:16:55.265 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:55.265+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:55.325 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:16:55.325 INFO:teuthology.orchestra.run.smithi121.stdout:{"fsid":"f6ab5dd0-bb9f-4b48-a9fc-4728c7955ca8","health":{"status":"HEALTH_WARN","checks":{"OSDMAP_FLAGS":{"severity":"HEALTH_WARN","summary":{"message":"noscrub flag(s) set","count":7},"muted":false}},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":100,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":43,"num_osds":3,"num_up_osds":3,"osd_up_since":1713492922,"num_in_osds":3,"osd_in_since":1713492915,"num_remapped_pgs":1},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":120},{"state_name":"active+remapped+backfilling","count":1}],"num_pgs":121,"num_pools":5,"num_objects":129571,"data_bytes":8490584922,"bytes_used":17727279104,"bytes_avail":272183013376,"bytes_total":289910292480,"misplaced_objects":1870,"misplaced_total":259142,"misplaced_ratio":0.0072161208912488138,"recovering_objects_per_sec":202,"recovering_bytes_per_sec":13276412,"recovering_keys_per_sec":0,"num_objects_recovered":1540,"num_bytes_recovered":100925440,"num_keys_recovered":0,"write_bytes_sec":172291625,"read_op_per_sec":0,"write_op_per_sec":2628},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4230}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-04-19T02:16:34.750409+0000","services":{}},"progress_events":{}} 2024-04-19T02:16:55.339 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-04-19T02:16:55.340 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:16:55.364 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:55.364 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:55.365 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:55.366+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:55.375 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:16:55.466 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:55.467+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:55.505 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:55.505 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:55.515 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:16:55.567 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:55.567+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:55.641 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:55.641 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:55.651 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:16:55.676 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:16:55.678 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-04-19T02:16:55.687 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":85,"stamp":"2024-04-19T02:16:54.753391+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":8490584922,"num_objects":129571,"num_object_clones":0,"num_object_copies":259142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":1870,"num_objects_unfound":0,"num_objects_dirty":129571,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":129795,"num_write_kb":8294482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4542,"num_bytes_recovered":297664512,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60342,"ondisk_log_size":60342,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":243,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":17311796,"kb_used_data":16849300,"kb_used_omap":4,"kb_used_meta":462459,"kb_avail":265803724,"statfs":{"total":289910292480,"available":272183013376,"internally_reserved":0,"allocated":17253683200,"data_stored":17252743688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":473558354},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1309736960,"num_objects":19985,"num_object_clones":0,"num_object_copies":39970,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-1112,"num_objects_unfound":0,"num_objects_dirty":19985,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19985,"num_write_kb":1279040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1540,"num_bytes_recovered":100925440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.601860"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.162613+0000","last_change":"2024-04-19T02:15:29.280412+0000","last_active":"2024-04-19T02:16:47.162613+0000","last_peered":"2024-04-19T02:16:47.162613+0000","last_clean":"2024-04-19T02:16:47.162613+0000","last_became_active":"2024-04-19T02:15:29.278762+0000","last_became_peered":"2024-04-19T02:15:29.278762+0000","last_unstale":"2024-04-19T02:16:47.162613+0000","last_undegraded":"2024-04-19T02:16:47.162613+0000","last_fullsized":"2024-04-19T02:16:47.162613+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:45.301675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.161503+0000","last_change":"2024-04-19T02:15:29.284695+0000","last_active":"2024-04-19T02:16:47.161503+0000","last_peered":"2024-04-19T02:16:47.161503+0000","last_clean":"2024-04-19T02:16:47.161503+0000","last_became_active":"2024-04-19T02:15:29.283468+0000","last_became_peered":"2024-04-19T02:15:29.283468+0000","last_unstale":"2024-04-19T02:16:47.161503+0000","last_undegraded":"2024-04-19T02:16:47.161503+0000","last_fullsized":"2024-04-19T02:16:47.161503+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.384881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.158515+0000","last_change":"2024-04-19T02:15:29.286709+0000","last_active":"2024-04-19T02:16:47.158515+0000","last_peered":"2024-04-19T02:16:47.158515+0000","last_clean":"2024-04-19T02:16:47.158515+0000","last_became_active":"2024-04-19T02:15:29.286169+0000","last_became_peered":"2024-04-19T02:15:29.286169+0000","last_unstale":"2024-04-19T02:16:47.158515+0000","last_undegraded":"2024-04-19T02:16:47.158515+0000","last_fullsized":"2024-04-19T02:16:47.158515+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:58.741466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.158231+0000","last_change":"2024-04-19T02:15:29.280131+0000","last_active":"2024-04-19T02:16:47.158231+0000","last_peered":"2024-04-19T02:16:47.158231+0000","last_clean":"2024-04-19T02:16:47.158231+0000","last_became_active":"2024-04-19T02:15:29.279388+0000","last_became_peered":"2024-04-19T02:15:29.279388+0000","last_unstale":"2024-04-19T02:16:47.158231+0000","last_undegraded":"2024-04-19T02:16:47.158231+0000","last_fullsized":"2024-04-19T02:16:47.158231+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:36:48.819486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.153795+0000","last_change":"2024-04-19T02:15:53.955892+0000","last_active":"2024-04-19T02:16:47.153795+0000","last_peered":"2024-04-19T02:16:47.153795+0000","last_clean":"2024-04-19T02:16:47.153795+0000","last_became_active":"2024-04-19T02:15:53.955553+0000","last_became_peered":"2024-04-19T02:15:53.955553+0000","last_unstale":"2024-04-19T02:16:47.153795+0000","last_undegraded":"2024-04-19T02:16:47.153795+0000","last_fullsized":"2024-04-19T02:16:47.153795+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:45:39.791209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.156629+0000","last_change":"2024-04-19T02:15:29.283908+0000","last_active":"2024-04-19T02:16:47.156629+0000","last_peered":"2024-04-19T02:16:47.156629+0000","last_clean":"2024-04-19T02:16:47.156629+0000","last_became_active":"2024-04-19T02:15:29.281729+0000","last_became_peered":"2024-04-19T02:15:29.281729+0000","last_unstale":"2024-04-19T02:16:47.156629+0000","last_undegraded":"2024-04-19T02:16:47.156629+0000","last_fullsized":"2024-04-19T02:16:47.156629+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:03:15.383476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.157088+0000","last_change":"2024-04-19T02:15:29.281253+0000","last_active":"2024-04-19T02:16:47.157088+0000","last_peered":"2024-04-19T02:16:47.157088+0000","last_clean":"2024-04-19T02:16:47.157088+0000","last_became_active":"2024-04-19T02:15:29.279951+0000","last_became_peered":"2024-04-19T02:15:29.279951+0000","last_unstale":"2024-04-19T02:16:47.157088+0000","last_undegraded":"2024-04-19T02:16:47.157088+0000","last_fullsized":"2024-04-19T02:16:47.157088+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.156107+0000","last_change":"2024-04-19T02:15:29.283952+0000","last_active":"2024-04-19T02:16:47.156107+0000","last_peered":"2024-04-19T02:16:47.156107+0000","last_clean":"2024-04-19T02:16:47.156107+0000","last_became_active":"2024-04-19T02:15:29.282721+0000","last_became_peered":"2024-04-19T02:15:29.282721+0000","last_unstale":"2024-04-19T02:16:47.156107+0000","last_undegraded":"2024-04-19T02:16:47.156107+0000","last_fullsized":"2024-04-19T02:16:47.156107+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:45.301675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.154394+0000","last_change":"2024-04-19T02:15:29.282150+0000","last_active":"2024-04-19T02:16:47.154394+0000","last_peered":"2024-04-19T02:16:47.154394+0000","last_clean":"2024-04-19T02:16:47.154394+0000","last_became_active":"2024-04-19T02:15:29.281538+0000","last_became_peered":"2024-04-19T02:15:29.281538+0000","last_unstale":"2024-04-19T02:16:47.154394+0000","last_undegraded":"2024-04-19T02:16:47.154394+0000","last_fullsized":"2024-04-19T02:16:47.154394+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.158086+0000","last_change":"2024-04-19T02:16:30.093524+0000","last_active":"2024-04-19T02:16:47.158086+0000","last_peered":"2024-04-19T02:16:47.158086+0000","last_clean":"2024-04-19T02:16:47.158086+0000","last_became_active":"2024-04-19T02:16:30.093344+0000","last_became_peered":"2024-04-19T02:16:30.093344+0000","last_unstale":"2024-04-19T02:16:47.158086+0000","last_undegraded":"2024-04-19T02:16:47.158086+0000","last_fullsized":"2024-04-19T02:16:47.158086+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:14:40.293159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.158423+0000","last_change":"2024-04-19T02:15:29.280606+0000","last_active":"2024-04-19T02:16:47.158423+0000","last_peered":"2024-04-19T02:16:47.158423+0000","last_clean":"2024-04-19T02:16:47.158423+0000","last_became_active":"2024-04-19T02:15:29.280151+0000","last_became_peered":"2024-04-19T02:15:29.280151+0000","last_unstale":"2024-04-19T02:16:47.158423+0000","last_undegraded":"2024-04-19T02:16:47.158423+0000","last_fullsized":"2024-04-19T02:16:47.158423+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:26:22.452488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.158064+0000","last_change":"2024-04-19T02:15:53.958876+0000","last_active":"2024-04-19T02:16:47.158064+0000","last_peered":"2024-04-19T02:16:47.158064+0000","last_clean":"2024-04-19T02:16:47.158064+0000","last_became_active":"2024-04-19T02:15:53.958626+0000","last_became_peered":"2024-04-19T02:15:53.958626+0000","last_unstale":"2024-04-19T02:16:47.158064+0000","last_undegraded":"2024-04-19T02:16:47.158064+0000","last_fullsized":"2024-04-19T02:16:47.158064+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:23:57.044018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.153544+0000","last_change":"2024-04-19T02:15:53.956801+0000","last_active":"2024-04-19T02:16:47.153544+0000","last_peered":"2024-04-19T02:16:47.153544+0000","last_clean":"2024-04-19T02:16:47.153544+0000","last_became_active":"2024-04-19T02:15:53.956620+0000","last_became_peered":"2024-04-19T02:15:53.956620+0000","last_unstale":"2024-04-19T02:16:47.153544+0000","last_undegraded":"2024-04-19T02:16:47.153544+0000","last_fullsized":"2024-04-19T02:16:47.153544+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:57:05.843101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.156618+0000","last_change":"2024-04-19T02:15:29.284262+0000","last_active":"2024-04-19T02:16:47.156618+0000","last_peered":"2024-04-19T02:16:47.156618+0000","last_clean":"2024-04-19T02:16:47.156618+0000","last_became_active":"2024-04-19T02:15:29.283121+0000","last_became_peered":"2024-04-19T02:15:29.283121+0000","last_unstale":"2024-04-19T02:16:47.156618+0000","last_undegraded":"2024-04-19T02:16:47.156618+0000","last_fullsized":"2024-04-19T02:16:47.156618+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.157163+0000","last_change":"2024-04-19T02:15:29.285139+0000","last_active":"2024-04-19T02:16:47.157163+0000","last_peered":"2024-04-19T02:16:47.157163+0000","last_clean":"2024-04-19T02:16:47.157163+0000","last_became_active":"2024-04-19T02:15:29.284649+0000","last_became_peered":"2024-04-19T02:15:29.284649+0000","last_unstale":"2024-04-19T02:16:47.157163+0000","last_undegraded":"2024-04-19T02:16:47.157163+0000","last_fullsized":"2024-04-19T02:16:47.157163+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.156149+0000","last_change":"2024-04-19T02:15:29.283648+0000","last_active":"2024-04-19T02:16:47.156149+0000","last_peered":"2024-04-19T02:16:47.156149+0000","last_clean":"2024-04-19T02:16:47.156149+0000","last_became_active":"2024-04-19T02:15:29.281606+0000","last_became_peered":"2024-04-19T02:15:29.281606+0000","last_unstale":"2024-04-19T02:16:47.156149+0000","last_undegraded":"2024-04-19T02:16:47.156149+0000","last_fullsized":"2024-04-19T02:16:47.156149+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.154380+0000","last_change":"2024-04-19T02:15:29.278673+0000","last_active":"2024-04-19T02:16:47.154380+0000","last_peered":"2024-04-19T02:16:47.154380+0000","last_clean":"2024-04-19T02:16:47.154380+0000","last_became_active":"2024-04-19T02:15:29.277699+0000","last_became_peered":"2024-04-19T02:15:29.277699+0000","last_unstale":"2024-04-19T02:16:47.154380+0000","last_undegraded":"2024-04-19T02:16:47.154380+0000","last_fullsized":"2024-04-19T02:16:47.154380+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.162012+0000","last_change":"2024-04-19T02:15:29.283341+0000","last_active":"2024-04-19T02:16:47.162012+0000","last_peered":"2024-04-19T02:16:47.162012+0000","last_clean":"2024-04-19T02:16:47.162012+0000","last_became_active":"2024-04-19T02:15:29.281591+0000","last_became_peered":"2024-04-19T02:15:29.281591+0000","last_unstale":"2024-04-19T02:16:47.162012+0000","last_undegraded":"2024-04-19T02:16:47.162012+0000","last_fullsized":"2024-04-19T02:16:47.162012+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:34.593754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.154400+0000","last_change":"2024-04-19T02:15:29.282110+0000","last_active":"2024-04-19T02:16:47.154400+0000","last_peered":"2024-04-19T02:16:47.154400+0000","last_clean":"2024-04-19T02:16:47.154400+0000","last_became_active":"2024-04-19T02:15:29.281716+0000","last_became_peered":"2024-04-19T02:15:29.281716+0000","last_unstale":"2024-04-19T02:16:47.154400+0000","last_undegraded":"2024-04-19T02:16:47.154400+0000","last_fullsized":"2024-04-19T02:16:47.154400+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.158153+0000","last_change":"2024-04-19T02:15:29.285237+0000","last_active":"2024-04-19T02:16:47.158153+0000","last_peered":"2024-04-19T02:16:47.158153+0000","last_clean":"2024-04-19T02:16:47.158153+0000","last_became_active":"2024-04-19T02:15:29.282790+0000","last_became_peered":"2024-04-19T02:15:29.282790+0000","last_unstale":"2024-04-19T02:16:47.158153+0000","last_undegraded":"2024-04-19T02:16:47.158153+0000","last_fullsized":"2024-04-19T02:16:47.158153+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.156856+0000","last_change":"2024-04-19T02:15:29.282609+0000","last_active":"2024-04-19T02:16:47.156856+0000","last_peered":"2024-04-19T02:16:47.156856+0000","last_clean":"2024-04-19T02:16:47.156856+0000","last_became_active":"2024-04-19T02:15:29.281665+0000","last_became_peered":"2024-04-19T02:15:29.281665+0000","last_unstale":"2024-04-19T02:16:47.156856+0000","last_undegraded":"2024-04-19T02:16:47.156856+0000","last_fullsized":"2024-04-19T02:16:47.156856+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.384881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.156287+0000","last_change":"2024-04-19T02:15:53.955813+0000","last_active":"2024-04-19T02:16:47.156287+0000","last_peered":"2024-04-19T02:16:47.156287+0000","last_clean":"2024-04-19T02:16:47.156287+0000","last_became_active":"2024-04-19T02:15:53.955614+0000","last_became_peered":"2024-04-19T02:15:53.955614+0000","last_unstale":"2024-04-19T02:16:47.156287+0000","last_undegraded":"2024-04-19T02:16:47.156287+0000","last_fullsized":"2024-04-19T02:16:47.156287+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:58:03.192647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.154568+0000","last_change":"2024-04-19T02:15:29.277109+0000","last_active":"2024-04-19T02:16:47.154568+0000","last_peered":"2024-04-19T02:16:47.154568+0000","last_clean":"2024-04-19T02:16:47.154568+0000","last_became_active":"2024-04-19T02:15:29.275417+0000","last_became_peered":"2024-04-19T02:15:29.275417+0000","last_unstale":"2024-04-19T02:16:47.154568+0000","last_undegraded":"2024-04-19T02:16:47.154568+0000","last_fullsized":"2024-04-19T02:16:47.154568+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.161575+0000","last_change":"2024-04-19T02:15:29.283266+0000","last_active":"2024-04-19T02:16:47.161575+0000","last_peered":"2024-04-19T02:16:47.161575+0000","last_clean":"2024-04-19T02:16:47.161575+0000","last_became_active":"2024-04-19T02:15:29.281505+0000","last_became_peered":"2024-04-19T02:15:29.281505+0000","last_unstale":"2024-04-19T02:16:47.161575+0000","last_undegraded":"2024-04-19T02:16:47.161575+0000","last_fullsized":"2024-04-19T02:16:47.161575+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.162603+0000","last_change":"2024-04-19T02:15:29.278084+0000","last_active":"2024-04-19T02:16:47.162603+0000","last_peered":"2024-04-19T02:16:47.162603+0000","last_clean":"2024-04-19T02:16:47.162603+0000","last_became_active":"2024-04-19T02:15:29.276952+0000","last_became_peered":"2024-04-19T02:15:29.276952+0000","last_unstale":"2024-04-19T02:16:47.162603+0000","last_undegraded":"2024-04-19T02:16:47.162603+0000","last_fullsized":"2024-04-19T02:16:47.162603+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.156579+0000","last_change":"2024-04-19T02:15:29.279904+0000","last_active":"2024-04-19T02:16:47.156579+0000","last_peered":"2024-04-19T02:16:47.156579+0000","last_clean":"2024-04-19T02:16:47.156579+0000","last_became_active":"2024-04-19T02:15:29.278938+0000","last_became_peered":"2024-04-19T02:15:29.278938+0000","last_unstale":"2024-04-19T02:16:47.156579+0000","last_undegraded":"2024-04-19T02:16:47.156579+0000","last_fullsized":"2024-04-19T02:16:47.156579+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.158445+0000","last_change":"2024-04-19T02:15:29.287389+0000","last_active":"2024-04-19T02:16:47.158445+0000","last_peered":"2024-04-19T02:16:47.158445+0000","last_clean":"2024-04-19T02:16:47.158445+0000","last_became_active":"2024-04-19T02:15:29.286431+0000","last_became_peered":"2024-04-19T02:15:29.286431+0000","last_unstale":"2024-04-19T02:16:47.158445+0000","last_undegraded":"2024-04-19T02:16:47.158445+0000","last_fullsized":"2024-04-19T02:16:47.158445+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:58:30.117887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.154147+0000","last_change":"2024-04-19T02:15:53.959207+0000","last_active":"2024-04-19T02:16:47.154147+0000","last_peered":"2024-04-19T02:16:47.154147+0000","last_clean":"2024-04-19T02:16:47.154147+0000","last_became_active":"2024-04-19T02:15:53.959007+0000","last_became_peered":"2024-04-19T02:15:53.959007+0000","last_unstale":"2024-04-19T02:16:47.154147+0000","last_undegraded":"2024-04-19T02:16:47.154147+0000","last_fullsized":"2024-04-19T02:16:47.154147+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:08:21.065077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.162118+0000","last_change":"2024-04-19T02:15:29.281792+0000","last_active":"2024-04-19T02:16:47.162118+0000","last_peered":"2024-04-19T02:16:47.162118+0000","last_clean":"2024-04-19T02:16:47.162118+0000","last_became_active":"2024-04-19T02:15:29.280479+0000","last_became_peered":"2024-04-19T02:15:29.280479+0000","last_unstale":"2024-04-19T02:16:47.162118+0000","last_undegraded":"2024-04-19T02:16:47.162118+0000","last_fullsized":"2024-04-19T02:16:47.162118+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.154641+0000","last_change":"2024-04-19T02:15:28.888778+0000","last_active":"2024-04-19T02:16:47.154641+0000","last_peered":"2024-04-19T02:16:47.154641+0000","last_clean":"2024-04-19T02:16:47.154641+0000","last_became_active":"2024-04-19T02:15:28.888543+0000","last_became_peered":"2024-04-19T02:15:28.888543+0000","last_unstale":"2024-04-19T02:16:47.154641+0000","last_undegraded":"2024-04-19T02:16:47.154641+0000","last_fullsized":"2024-04-19T02:16:47.154641+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:43:51.221619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.156422+0000","last_change":"2024-04-19T02:15:29.279986+0000","last_active":"2024-04-19T02:16:47.156422+0000","last_peered":"2024-04-19T02:16:47.156422+0000","last_clean":"2024-04-19T02:16:47.156422+0000","last_became_active":"2024-04-19T02:15:29.279690+0000","last_became_peered":"2024-04-19T02:15:29.279690+0000","last_unstale":"2024-04-19T02:16:47.156422+0000","last_undegraded":"2024-04-19T02:16:47.156422+0000","last_fullsized":"2024-04-19T02:16:47.156422+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.153659+0000","last_change":"2024-04-19T02:15:28.890463+0000","last_active":"2024-04-19T02:16:47.153659+0000","last_peered":"2024-04-19T02:16:47.153659+0000","last_clean":"2024-04-19T02:16:47.153659+0000","last_became_active":"2024-04-19T02:15:28.889777+0000","last_became_peered":"2024-04-19T02:15:28.889777+0000","last_unstale":"2024-04-19T02:16:47.153659+0000","last_undegraded":"2024-04-19T02:16:47.153659+0000","last_fullsized":"2024-04-19T02:16:47.153659+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:58:21.520250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.162543+0000","last_change":"2024-04-19T02:15:29.280879+0000","last_active":"2024-04-19T02:16:47.162543+0000","last_peered":"2024-04-19T02:16:47.162543+0000","last_clean":"2024-04-19T02:16:47.162543+0000","last_became_active":"2024-04-19T02:15:29.279314+0000","last_became_peered":"2024-04-19T02:15:29.279314+0000","last_unstale":"2024-04-19T02:16:47.162543+0000","last_undegraded":"2024-04-19T02:16:47.162543+0000","last_fullsized":"2024-04-19T02:16:47.162543+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.154754+0000","last_change":"2024-04-19T02:15:28.891867+0000","last_active":"2024-04-19T02:16:47.154754+0000","last_peered":"2024-04-19T02:16:47.154754+0000","last_clean":"2024-04-19T02:16:47.154754+0000","last_became_active":"2024-04-19T02:15:28.890806+0000","last_became_peered":"2024-04-19T02:15:28.890806+0000","last_unstale":"2024-04-19T02:16:47.154754+0000","last_undegraded":"2024-04-19T02:16:47.154754+0000","last_fullsized":"2024-04-19T02:16:47.154754+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:57.946581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.153573+0000","last_change":"2024-04-19T02:15:29.278148+0000","last_active":"2024-04-19T02:16:47.153573+0000","last_peered":"2024-04-19T02:16:47.153573+0000","last_clean":"2024-04-19T02:16:47.153573+0000","last_became_active":"2024-04-19T02:15:29.277402+0000","last_became_peered":"2024-04-19T02:15:29.277402+0000","last_unstale":"2024-04-19T02:16:47.153573+0000","last_undegraded":"2024-04-19T02:16:47.153573+0000","last_fullsized":"2024-04-19T02:16:47.153573+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.158404+0000","last_change":"2024-04-19T02:15:28.892905+0000","last_active":"2024-04-19T02:16:47.158404+0000","last_peered":"2024-04-19T02:16:47.158404+0000","last_clean":"2024-04-19T02:16:47.158404+0000","last_became_active":"2024-04-19T02:15:28.892541+0000","last_became_peered":"2024-04-19T02:15:28.892541+0000","last_unstale":"2024-04-19T02:16:47.158404+0000","last_undegraded":"2024-04-19T02:16:47.158404+0000","last_fullsized":"2024-04-19T02:16:47.158404+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:33.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.154906+0000","last_change":"2024-04-19T02:15:29.278810+0000","last_active":"2024-04-19T02:16:47.154906+0000","last_peered":"2024-04-19T02:16:47.154906+0000","last_clean":"2024-04-19T02:16:47.154906+0000","last_became_active":"2024-04-19T02:15:29.278093+0000","last_became_peered":"2024-04-19T02:15:29.278093+0000","last_unstale":"2024-04-19T02:16:47.154906+0000","last_undegraded":"2024-04-19T02:16:47.154906+0000","last_fullsized":"2024-04-19T02:16:47.154906+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:34.883207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":41,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.161807+0000","last_change":"2024-04-19T02:15:28.892937+0000","last_active":"2024-04-19T02:16:47.161807+0000","last_peered":"2024-04-19T02:16:47.161807+0000","last_clean":"2024-04-19T02:16:47.161807+0000","last_became_active":"2024-04-19T02:15:28.891440+0000","last_became_peered":"2024-04-19T02:15:28.891440+0000","last_unstale":"2024-04-19T02:16:47.161807+0000","last_undegraded":"2024-04-19T02:16:47.161807+0000","last_fullsized":"2024-04-19T02:16:47.161807+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.153935+0000","last_change":"2024-04-19T02:15:29.278404+0000","last_active":"2024-04-19T02:16:47.153935+0000","last_peered":"2024-04-19T02:16:47.153935+0000","last_clean":"2024-04-19T02:16:47.153935+0000","last_became_active":"2024-04-19T02:15:29.277460+0000","last_became_peered":"2024-04-19T02:15:29.277460+0000","last_unstale":"2024-04-19T02:16:47.153935+0000","last_undegraded":"2024-04-19T02:16:47.153935+0000","last_fullsized":"2024-04-19T02:16:47.153935+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.158160+0000","last_change":"2024-04-19T02:15:28.891097+0000","last_active":"2024-04-19T02:16:47.158160+0000","last_peered":"2024-04-19T02:16:47.158160+0000","last_clean":"2024-04-19T02:16:47.158160+0000","last_became_active":"2024-04-19T02:15:28.890795+0000","last_became_peered":"2024-04-19T02:15:28.890795+0000","last_unstale":"2024-04-19T02:16:47.158160+0000","last_undegraded":"2024-04-19T02:16:47.158160+0000","last_fullsized":"2024-04-19T02:16:47.158160+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.157166+0000","last_change":"2024-04-19T02:15:29.278546+0000","last_active":"2024-04-19T02:16:47.157166+0000","last_peered":"2024-04-19T02:16:47.157166+0000","last_clean":"2024-04-19T02:16:47.157166+0000","last_became_active":"2024-04-19T02:15:29.277547+0000","last_became_peered":"2024-04-19T02:15:29.277547+0000","last_unstale":"2024-04-19T02:16:47.157166+0000","last_undegraded":"2024-04-19T02:16:47.157166+0000","last_fullsized":"2024-04-19T02:16:47.157166+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.157091+0000","last_change":"2024-04-19T02:15:28.892977+0000","last_active":"2024-04-19T02:16:47.157091+0000","last_peered":"2024-04-19T02:16:47.157091+0000","last_clean":"2024-04-19T02:16:47.157091+0000","last_became_active":"2024-04-19T02:15:28.892636+0000","last_became_peered":"2024-04-19T02:15:28.892636+0000","last_unstale":"2024-04-19T02:16:47.157091+0000","last_undegraded":"2024-04-19T02:16:47.157091+0000","last_fullsized":"2024-04-19T02:16:47.157091+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:43:51.221619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.154009+0000","last_change":"2024-04-19T02:15:53.955655+0000","last_active":"2024-04-19T02:16:47.154009+0000","last_peered":"2024-04-19T02:16:47.154009+0000","last_clean":"2024-04-19T02:16:47.154009+0000","last_became_active":"2024-04-19T02:15:53.955382+0000","last_became_peered":"2024-04-19T02:15:53.955382+0000","last_unstale":"2024-04-19T02:16:47.154009+0000","last_undegraded":"2024-04-19T02:16:47.154009+0000","last_fullsized":"2024-04-19T02:16:47.154009+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:48.239260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.154067+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:16:47.154067+0000","last_peered":"2024-04-19T02:16:47.154067+0000","last_clean":"2024-04-19T02:16:47.154067+0000","last_became_active":"2024-04-19T02:15:28.890751+0000","last_became_peered":"2024-04-19T02:15:28.890751+0000","last_unstale":"2024-04-19T02:16:47.154067+0000","last_undegraded":"2024-04-19T02:16:47.154067+0000","last_fullsized":"2024-04-19T02:16:47.154067+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.154102+0000","last_change":"2024-04-19T02:15:53.957865+0000","last_active":"2024-04-19T02:16:47.154102+0000","last_peered":"2024-04-19T02:16:47.154102+0000","last_clean":"2024-04-19T02:16:47.154102+0000","last_became_active":"2024-04-19T02:15:53.957627+0000","last_became_peered":"2024-04-19T02:15:53.957627+0000","last_unstale":"2024-04-19T02:16:47.154102+0000","last_undegraded":"2024-04-19T02:16:47.154102+0000","last_fullsized":"2024-04-19T02:16:47.154102+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:16:45.799016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.162379+0000","last_change":"2024-04-19T02:15:28.892934+0000","last_active":"2024-04-19T02:16:47.162379+0000","last_peered":"2024-04-19T02:16:47.162379+0000","last_clean":"2024-04-19T02:16:47.162379+0000","last_became_active":"2024-04-19T02:15:28.891879+0000","last_became_peered":"2024-04-19T02:15:28.891879+0000","last_unstale":"2024-04-19T02:16:47.162379+0000","last_undegraded":"2024-04-19T02:16:47.162379+0000","last_fullsized":"2024-04-19T02:16:47.162379+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:10:12.514798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.156513+0000","last_change":"2024-04-19T02:15:29.279685+0000","last_active":"2024-04-19T02:16:47.156513+0000","last_peered":"2024-04-19T02:16:47.156513+0000","last_clean":"2024-04-19T02:16:47.156513+0000","last_became_active":"2024-04-19T02:15:29.278810+0000","last_became_peered":"2024-04-19T02:15:29.278810+0000","last_unstale":"2024-04-19T02:16:47.156513+0000","last_undegraded":"2024-04-19T02:16:47.156513+0000","last_fullsized":"2024-04-19T02:16:47.156513+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":46,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.156377+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:16:47.156377+0000","last_peered":"2024-04-19T02:16:47.156377+0000","last_clean":"2024-04-19T02:16:47.156377+0000","last_became_active":"2024-04-19T02:15:28.890882+0000","last_became_peered":"2024-04-19T02:15:28.890882+0000","last_unstale":"2024-04-19T02:16:47.156377+0000","last_undegraded":"2024-04-19T02:16:47.156377+0000","last_fullsized":"2024-04-19T02:16:47.156377+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:31.673938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.154938+0000","last_change":"2024-04-19T02:15:29.284258+0000","last_active":"2024-04-19T02:16:47.154938+0000","last_peered":"2024-04-19T02:16:47.154938+0000","last_clean":"2024-04-19T02:16:47.154938+0000","last_became_active":"2024-04-19T02:15:29.283995+0000","last_became_peered":"2024-04-19T02:15:29.283995+0000","last_unstale":"2024-04-19T02:16:47.154938+0000","last_undegraded":"2024-04-19T02:16:47.154938+0000","last_fullsized":"2024-04-19T02:16:47.154938+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:35.941308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"42'8232","reported_seq":8266,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-19T02:16:52.800593+0000","last_change":"2024-04-19T02:15:53.956977+0000","last_active":"2024-04-19T02:16:52.800593+0000","last_peered":"2024-04-19T02:16:52.800593+0000","last_clean":"2024-04-19T02:16:52.800593+0000","last_became_active":"2024-04-19T02:15:53.956730+0000","last_became_peered":"2024-04-19T02:15:53.956730+0000","last_unstale":"2024-04-19T02:16:52.800593+0000","last_undegraded":"2024-04-19T02:16:52.800593+0000","last_fullsized":"2024-04-19T02:16:52.800593+0000","mapping_epoch":16,"log_start":"27'4500","ondisk_log_start":"27'4500","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3732,"log_dups_size":0,"ondisk_log_size":3732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:56:46.323499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539492352,"num_objects":8232,"num_object_clones":0,"num_object_copies":16464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8232,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8232,"num_write_kb":526848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":39,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.158401+0000","last_change":"2024-04-19T02:15:28.890265+0000","last_active":"2024-04-19T02:16:47.158401+0000","last_peered":"2024-04-19T02:16:47.158401+0000","last_clean":"2024-04-19T02:16:47.158401+0000","last_became_active":"2024-04-19T02:15:28.890004+0000","last_became_peered":"2024-04-19T02:15:28.890004+0000","last_unstale":"2024-04-19T02:16:47.158401+0000","last_undegraded":"2024-04-19T02:16:47.158401+0000","last_fullsized":"2024-04-19T02:16:47.158401+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:02.517101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.161488+0000","last_change":"2024-04-19T02:15:29.285529+0000","last_active":"2024-04-19T02:16:47.161488+0000","last_peered":"2024-04-19T02:16:47.161488+0000","last_clean":"2024-04-19T02:16:47.161488+0000","last_became_active":"2024-04-19T02:15:29.285197+0000","last_became_peered":"2024-04-19T02:15:29.285197+0000","last_unstale":"2024-04-19T02:16:47.161488+0000","last_undegraded":"2024-04-19T02:16:47.161488+0000","last_fullsized":"2024-04-19T02:16:47.161488+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"42'8185","reported_seq":8219,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-19T02:16:52.749497+0000","last_change":"2024-04-19T02:15:53.958523+0000","last_active":"2024-04-19T02:16:52.749497+0000","last_peered":"2024-04-19T02:16:52.749497+0000","last_clean":"2024-04-19T02:16:52.749497+0000","last_became_active":"2024-04-19T02:15:53.957627+0000","last_became_peered":"2024-04-19T02:15:53.957627+0000","last_unstale":"2024-04-19T02:16:52.749497+0000","last_undegraded":"2024-04-19T02:16:52.749497+0000","last_fullsized":"2024-04-19T02:16:52.749497+0000","mapping_epoch":16,"log_start":"27'4247","ondisk_log_start":"27'4247","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3938,"log_dups_size":0,"ondisk_log_size":3938,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:59:55.120296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":536412160,"num_objects":8185,"num_object_clones":0,"num_object_copies":16370,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8185,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8185,"num_write_kb":523840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.161586+0000","last_change":"2024-04-19T02:15:28.893902+0000","last_active":"2024-04-19T02:16:47.161586+0000","last_peered":"2024-04-19T02:16:47.161586+0000","last_clean":"2024-04-19T02:16:47.161586+0000","last_became_active":"2024-04-19T02:15:28.893231+0000","last_became_peered":"2024-04-19T02:15:28.893231+0000","last_unstale":"2024-04-19T02:16:47.161586+0000","last_undegraded":"2024-04-19T02:16:47.161586+0000","last_fullsized":"2024-04-19T02:16:47.161586+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:23.658442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.162518+0000","last_change":"2024-04-19T02:15:29.282874+0000","last_active":"2024-04-19T02:16:47.162518+0000","last_peered":"2024-04-19T02:16:47.162518+0000","last_clean":"2024-04-19T02:16:47.162518+0000","last_became_active":"2024-04-19T02:15:29.281675+0000","last_became_peered":"2024-04-19T02:15:29.281675+0000","last_unstale":"2024-04-19T02:16:47.162518+0000","last_undegraded":"2024-04-19T02:16:47.162518+0000","last_fullsized":"2024-04-19T02:16:47.162518+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:35.941308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"42'8069","reported_seq":8103,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-19T02:16:52.761622+0000","last_change":"2024-04-19T02:15:53.958324+0000","last_active":"2024-04-19T02:16:52.761622+0000","last_peered":"2024-04-19T02:16:52.761622+0000","last_clean":"2024-04-19T02:16:52.761622+0000","last_became_active":"2024-04-19T02:15:53.957392+0000","last_became_peered":"2024-04-19T02:15:53.957392+0000","last_unstale":"2024-04-19T02:16:52.761622+0000","last_undegraded":"2024-04-19T02:16:52.761622+0000","last_fullsized":"2024-04-19T02:16:52.761622+0000","mapping_epoch":16,"log_start":"26'4100","ondisk_log_start":"26'4100","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3969,"log_dups_size":0,"ondisk_log_size":3969,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:12:58.132969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528809984,"num_objects":8069,"num_object_clones":0,"num_object_copies":16138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8069,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8069,"num_write_kb":516416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":39,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.158519+0000","last_change":"2024-04-19T02:15:28.891234+0000","last_active":"2024-04-19T02:16:47.158519+0000","last_peered":"2024-04-19T02:16:47.158519+0000","last_clean":"2024-04-19T02:16:47.158519+0000","last_became_active":"2024-04-19T02:15:28.890881+0000","last_became_peered":"2024-04-19T02:15:28.890881+0000","last_unstale":"2024-04-19T02:16:47.158519+0000","last_undegraded":"2024-04-19T02:16:47.158519+0000","last_fullsized":"2024-04-19T02:16:47.158519+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.156498+0000","last_change":"2024-04-19T02:15:29.281937+0000","last_active":"2024-04-19T02:16:47.156498+0000","last_peered":"2024-04-19T02:16:47.156498+0000","last_clean":"2024-04-19T02:16:47.156498+0000","last_became_active":"2024-04-19T02:15:29.280727+0000","last_became_peered":"2024-04-19T02:15:29.280727+0000","last_unstale":"2024-04-19T02:16:47.156498+0000","last_undegraded":"2024-04-19T02:16:47.156498+0000","last_fullsized":"2024-04-19T02:16:47.156498+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"42'8219","reported_seq":8253,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-19T02:16:52.794933+0000","last_change":"2024-04-19T02:15:53.959099+0000","last_active":"2024-04-19T02:16:52.794933+0000","last_peered":"2024-04-19T02:16:52.794933+0000","last_clean":"2024-04-19T02:16:52.794933+0000","last_became_active":"2024-04-19T02:15:53.958885+0000","last_became_peered":"2024-04-19T02:15:53.958885+0000","last_unstale":"2024-04-19T02:16:52.794933+0000","last_undegraded":"2024-04-19T02:16:52.794933+0000","last_fullsized":"2024-04-19T02:16:52.794933+0000","mapping_epoch":16,"log_start":"30'4600","ondisk_log_start":"30'4600","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3619,"log_dups_size":0,"ondisk_log_size":3619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:53:26.969927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":538640384,"num_objects":8219,"num_object_clones":0,"num_object_copies":16438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8219,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8219,"num_write_kb":526016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.157970+0000","last_change":"2024-04-19T02:15:28.892767+0000","last_active":"2024-04-19T02:16:47.157970+0000","last_peered":"2024-04-19T02:16:47.157970+0000","last_clean":"2024-04-19T02:16:47.157970+0000","last_became_active":"2024-04-19T02:15:28.892235+0000","last_became_peered":"2024-04-19T02:15:28.892235+0000","last_unstale":"2024-04-19T02:16:47.157970+0000","last_undegraded":"2024-04-19T02:16:47.157970+0000","last_fullsized":"2024-04-19T02:16:47.157970+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:37.690735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.153958+0000","last_change":"2024-04-19T02:15:29.279857+0000","last_active":"2024-04-19T02:16:47.153958+0000","last_peered":"2024-04-19T02:16:47.153958+0000","last_clean":"2024-04-19T02:16:47.153958+0000","last_became_active":"2024-04-19T02:15:29.279536+0000","last_became_peered":"2024-04-19T02:15:29.279536+0000","last_unstale":"2024-04-19T02:16:47.153958+0000","last_undegraded":"2024-04-19T02:16:47.153958+0000","last_fullsized":"2024-04-19T02:16:47.153958+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:00.191179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"42'8123","reported_seq":8155,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-19T02:16:52.789346+0000","last_change":"2024-04-19T02:15:53.957261+0000","last_active":"2024-04-19T02:16:52.789346+0000","last_peered":"2024-04-19T02:16:52.789346+0000","last_clean":"2024-04-19T02:16:52.789346+0000","last_became_active":"2024-04-19T02:15:53.957092+0000","last_became_peered":"2024-04-19T02:15:53.957092+0000","last_unstale":"2024-04-19T02:16:52.789346+0000","last_undegraded":"2024-04-19T02:16:52.789346+0000","last_fullsized":"2024-04-19T02:16:52.789346+0000","mapping_epoch":16,"log_start":"27'4413","ondisk_log_start":"27'4413","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3710,"log_dups_size":0,"ondisk_log_size":3710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:54:15.544923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":532348928,"num_objects":8123,"num_object_clones":0,"num_object_copies":16246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8123,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8123,"num_write_kb":519872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.153873+0000","last_change":"2024-04-19T02:15:28.891611+0000","last_active":"2024-04-19T02:16:47.153873+0000","last_peered":"2024-04-19T02:16:47.153873+0000","last_clean":"2024-04-19T02:16:47.153873+0000","last_became_active":"2024-04-19T02:15:28.890914+0000","last_became_peered":"2024-04-19T02:15:28.890914+0000","last_unstale":"2024-04-19T02:16:47.153873+0000","last_undegraded":"2024-04-19T02:16:47.153873+0000","last_fullsized":"2024-04-19T02:16:47.153873+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:37.690735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.157984+0000","last_change":"2024-04-19T02:15:29.285774+0000","last_active":"2024-04-19T02:16:47.157984+0000","last_peered":"2024-04-19T02:16:47.157984+0000","last_clean":"2024-04-19T02:16:47.157984+0000","last_became_active":"2024-04-19T02:15:29.284705+0000","last_became_peered":"2024-04-19T02:15:29.284705+0000","last_unstale":"2024-04-19T02:16:47.157984+0000","last_undegraded":"2024-04-19T02:16:47.157984+0000","last_fullsized":"2024-04-19T02:16:47.157984+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"42'8117","reported_seq":8151,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-19T02:16:52.781090+0000","last_change":"2024-04-19T02:15:53.955286+0000","last_active":"2024-04-19T02:16:52.781090+0000","last_peered":"2024-04-19T02:16:52.781090+0000","last_clean":"2024-04-19T02:16:52.781090+0000","last_became_active":"2024-04-19T02:15:53.955026+0000","last_became_peered":"2024-04-19T02:15:53.955026+0000","last_unstale":"2024-04-19T02:16:52.781090+0000","last_undegraded":"2024-04-19T02:16:52.781090+0000","last_fullsized":"2024-04-19T02:16:52.781090+0000","mapping_epoch":16,"log_start":"30'4500","ondisk_log_start":"30'4500","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3617,"log_dups_size":0,"ondisk_log_size":3617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:05:48.594301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":531955712,"num_objects":8117,"num_object_clones":0,"num_object_copies":16234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8117,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8117,"num_write_kb":519488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.156377+0000","last_change":"2024-04-19T02:15:28.892873+0000","last_active":"2024-04-19T02:16:47.156377+0000","last_peered":"2024-04-19T02:16:47.156377+0000","last_clean":"2024-04-19T02:16:47.156377+0000","last_became_active":"2024-04-19T02:15:28.892487+0000","last_became_peered":"2024-04-19T02:15:28.892487+0000","last_unstale":"2024-04-19T02:16:47.156377+0000","last_undegraded":"2024-04-19T02:16:47.156377+0000","last_fullsized":"2024-04-19T02:16:47.156377+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:35.412837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.158706+0000","last_change":"2024-04-19T02:15:29.285019+0000","last_active":"2024-04-19T02:16:47.158706+0000","last_peered":"2024-04-19T02:16:47.158706+0000","last_clean":"2024-04-19T02:16:47.158706+0000","last_became_active":"2024-04-19T02:15:29.284650+0000","last_became_peered":"2024-04-19T02:15:29.284650+0000","last_unstale":"2024-04-19T02:16:47.158706+0000","last_undegraded":"2024-04-19T02:16:47.158706+0000","last_fullsized":"2024-04-19T02:16:47.158706+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"42'8144","reported_seq":8177,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-19T02:16:52.817326+0000","last_change":"2024-04-19T02:15:53.957403+0000","last_active":"2024-04-19T02:16:52.817326+0000","last_peered":"2024-04-19T02:16:52.817326+0000","last_clean":"2024-04-19T02:16:52.817326+0000","last_became_active":"2024-04-19T02:15:53.957190+0000","last_became_peered":"2024-04-19T02:15:53.957190+0000","last_unstale":"2024-04-19T02:16:52.817326+0000","last_undegraded":"2024-04-19T02:16:52.817326+0000","last_fullsized":"2024-04-19T02:16:52.817326+0000","mapping_epoch":16,"log_start":"27'4401","ondisk_log_start":"27'4401","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3743,"log_dups_size":0,"ondisk_log_size":3743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:07:12.817884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":533725184,"num_objects":8144,"num_object_clones":0,"num_object_copies":16288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8144,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8144,"num_write_kb":521216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.157060+0000","last_change":"2024-04-19T02:15:53.956839+0000","last_active":"2024-04-19T02:16:47.157060+0000","last_peered":"2024-04-19T02:16:47.157060+0000","last_clean":"2024-04-19T02:16:47.157060+0000","last_became_active":"2024-04-19T02:15:53.956630+0000","last_became_peered":"2024-04-19T02:15:53.956630+0000","last_unstale":"2024-04-19T02:16:47.157060+0000","last_undegraded":"2024-04-19T02:16:47.157060+0000","last_fullsized":"2024-04-19T02:16:47.157060+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:47.229730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.158476+0000","last_change":"2024-04-19T02:15:29.287190+0000","last_active":"2024-04-19T02:16:47.158476+0000","last_peered":"2024-04-19T02:16:47.158476+0000","last_clean":"2024-04-19T02:16:47.158476+0000","last_became_active":"2024-04-19T02:15:29.286606+0000","last_became_peered":"2024-04-19T02:15:29.286606+0000","last_unstale":"2024-04-19T02:16:47.158476+0000","last_undegraded":"2024-04-19T02:16:47.158476+0000","last_fullsized":"2024-04-19T02:16:47.158476+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:28.387062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"42'7934","reported_seq":7968,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-19T02:16:52.758724+0000","last_change":"2024-04-19T02:15:53.958448+0000","last_active":"2024-04-19T02:16:52.758724+0000","last_peered":"2024-04-19T02:16:52.758724+0000","last_clean":"2024-04-19T02:16:52.758724+0000","last_became_active":"2024-04-19T02:15:53.957595+0000","last_became_peered":"2024-04-19T02:15:53.957595+0000","last_unstale":"2024-04-19T02:16:52.758724+0000","last_undegraded":"2024-04-19T02:16:52.758724+0000","last_fullsized":"2024-04-19T02:16:52.758724+0000","mapping_epoch":16,"log_start":"26'3944","ondisk_log_start":"26'3944","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3990,"log_dups_size":0,"ondisk_log_size":3990,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:26:31.855319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":519962624,"num_objects":7934,"num_object_clones":0,"num_object_copies":15868,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7934,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7934,"num_write_kb":507776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.161488+0000","last_change":"2024-04-19T02:15:28.894121+0000","last_active":"2024-04-19T02:16:47.161488+0000","last_peered":"2024-04-19T02:16:47.161488+0000","last_clean":"2024-04-19T02:16:47.161488+0000","last_became_active":"2024-04-19T02:15:28.893902+0000","last_became_peered":"2024-04-19T02:15:28.893902+0000","last_unstale":"2024-04-19T02:16:47.161488+0000","last_undegraded":"2024-04-19T02:16:47.161488+0000","last_fullsized":"2024-04-19T02:16:47.161488+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:10:35.146583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.154600+0000","last_change":"2024-04-19T02:15:29.282870+0000","last_active":"2024-04-19T02:16:47.154600+0000","last_peered":"2024-04-19T02:16:47.154600+0000","last_clean":"2024-04-19T02:16:47.154600+0000","last_became_active":"2024-04-19T02:15:29.281873+0000","last_became_peered":"2024-04-19T02:15:29.281873+0000","last_unstale":"2024-04-19T02:16:47.154600+0000","last_undegraded":"2024-04-19T02:16:47.154600+0000","last_fullsized":"2024-04-19T02:16:47.154600+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"42'8111","reported_seq":8142,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-19T02:16:52.799561+0000","last_change":"2024-04-19T02:15:53.955498+0000","last_active":"2024-04-19T02:16:52.799561+0000","last_peered":"2024-04-19T02:16:52.799561+0000","last_clean":"2024-04-19T02:16:52.799561+0000","last_became_active":"2024-04-19T02:15:53.954910+0000","last_became_peered":"2024-04-19T02:15:53.954910+0000","last_unstale":"2024-04-19T02:16:52.799561+0000","last_undegraded":"2024-04-19T02:16:52.799561+0000","last_fullsized":"2024-04-19T02:16:52.799561+0000","mapping_epoch":16,"log_start":"27'4500","ondisk_log_start":"27'4500","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3611,"log_dups_size":0,"ondisk_log_size":3611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:58:27.262672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":531562496,"num_objects":8111,"num_object_clones":0,"num_object_copies":16222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8111,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8111,"num_write_kb":519104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.154694+0000","last_change":"2024-04-19T02:15:24.527061+0000","last_active":"2024-04-19T02:16:47.154694+0000","last_peered":"2024-04-19T02:16:47.154694+0000","last_clean":"2024-04-19T02:16:47.154694+0000","last_became_active":"2024-04-19T02:15:24.526757+0000","last_became_peered":"2024-04-19T02:15:24.526757+0000","last_unstale":"2024-04-19T02:16:47.154694+0000","last_undegraded":"2024-04-19T02:16:47.154694+0000","last_fullsized":"2024-04-19T02:16:47.154694+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:17:13.649077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.158629+0000","last_change":"2024-04-19T02:15:28.892766+0000","last_active":"2024-04-19T02:16:47.158629+0000","last_peered":"2024-04-19T02:16:47.158629+0000","last_clean":"2024-04-19T02:16:47.158629+0000","last_became_active":"2024-04-19T02:15:28.892396+0000","last_became_peered":"2024-04-19T02:15:28.892396+0000","last_unstale":"2024-04-19T02:16:47.158629+0000","last_undegraded":"2024-04-19T02:16:47.158629+0000","last_fullsized":"2024-04-19T02:16:47.158629+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:57.946581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.161530+0000","last_change":"2024-04-19T02:15:29.277922+0000","last_active":"2024-04-19T02:16:47.161530+0000","last_peered":"2024-04-19T02:16:47.161530+0000","last_clean":"2024-04-19T02:16:47.161530+0000","last_became_active":"2024-04-19T02:15:29.276968+0000","last_became_peered":"2024-04-19T02:15:29.276968+0000","last_unstale":"2024-04-19T02:16:47.161530+0000","last_undegraded":"2024-04-19T02:16:47.161530+0000","last_fullsized":"2024-04-19T02:16:47.161530+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"42'8130","reported_seq":8164,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-19T02:16:52.780562+0000","last_change":"2024-04-19T02:15:53.955228+0000","last_active":"2024-04-19T02:16:52.780562+0000","last_peered":"2024-04-19T02:16:52.780562+0000","last_clean":"2024-04-19T02:16:52.780562+0000","last_became_active":"2024-04-19T02:15:53.954960+0000","last_became_peered":"2024-04-19T02:15:53.954960+0000","last_unstale":"2024-04-19T02:16:52.780562+0000","last_undegraded":"2024-04-19T02:16:52.780562+0000","last_fullsized":"2024-04-19T02:16:52.780562+0000","mapping_epoch":16,"log_start":"27'4500","ondisk_log_start":"27'4500","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3630,"log_dups_size":0,"ondisk_log_size":3630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:46:07.409922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":532807680,"num_objects":8130,"num_object_clones":0,"num_object_copies":16260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8130,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8130,"num_write_kb":520320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.156561+0000","last_change":"2024-04-19T02:15:24.530933+0000","last_active":"2024-04-19T02:16:47.156561+0000","last_peered":"2024-04-19T02:16:47.156561+0000","last_clean":"2024-04-19T02:16:47.156561+0000","last_became_active":"2024-04-19T02:15:24.530550+0000","last_became_peered":"2024-04-19T02:15:24.530550+0000","last_unstale":"2024-04-19T02:16:47.156561+0000","last_undegraded":"2024-04-19T02:16:47.156561+0000","last_fullsized":"2024-04-19T02:16:47.156561+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:18:15.194321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.156993+0000","last_change":"2024-04-19T02:15:28.893062+0000","last_active":"2024-04-19T02:16:47.156993+0000","last_peered":"2024-04-19T02:16:47.156993+0000","last_clean":"2024-04-19T02:16:47.156993+0000","last_became_active":"2024-04-19T02:15:28.892798+0000","last_became_peered":"2024-04-19T02:15:28.892798+0000","last_unstale":"2024-04-19T02:16:47.156993+0000","last_undegraded":"2024-04-19T02:16:47.156993+0000","last_fullsized":"2024-04-19T02:16:47.156993+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:53.170180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.154412+0000","last_change":"2024-04-19T02:15:29.278294+0000","last_active":"2024-04-19T02:16:47.154412+0000","last_peered":"2024-04-19T02:16:47.154412+0000","last_clean":"2024-04-19T02:16:47.154412+0000","last_became_active":"2024-04-19T02:15:29.277536+0000","last_became_peered":"2024-04-19T02:15:29.277536+0000","last_unstale":"2024-04-19T02:16:47.154412+0000","last_undegraded":"2024-04-19T02:16:47.154412+0000","last_fullsized":"2024-04-19T02:16:47.154412+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"42'8171","reported_seq":8205,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-19T02:16:52.772220+0000","last_change":"2024-04-19T02:15:53.956251+0000","last_active":"2024-04-19T02:16:52.772220+0000","last_peered":"2024-04-19T02:16:52.772220+0000","last_clean":"2024-04-19T02:16:52.772220+0000","last_became_active":"2024-04-19T02:15:53.955886+0000","last_became_peered":"2024-04-19T02:15:53.955886+0000","last_unstale":"2024-04-19T02:16:52.772220+0000","last_undegraded":"2024-04-19T02:16:52.772220+0000","last_fullsized":"2024-04-19T02:16:52.772220+0000","mapping_epoch":16,"log_start":"28'4500","ondisk_log_start":"28'4500","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3671,"log_dups_size":0,"ondisk_log_size":3671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:38:38.586906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":535494656,"num_objects":8171,"num_object_clones":0,"num_object_copies":16342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8171,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8171,"num_write_kb":522944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.154494+0000","last_change":"2024-04-19T02:15:24.527048+0000","last_active":"2024-04-19T02:16:47.154494+0000","last_peered":"2024-04-19T02:16:47.154494+0000","last_clean":"2024-04-19T02:16:47.154494+0000","last_became_active":"2024-04-19T02:15:24.526790+0000","last_became_peered":"2024-04-19T02:15:24.526790+0000","last_unstale":"2024-04-19T02:16:47.154494+0000","last_undegraded":"2024-04-19T02:16:47.154494+0000","last_fullsized":"2024-04-19T02:16:47.154494+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.155968+0000","last_change":"2024-04-19T02:15:53.956945+0000","last_active":"2024-04-19T02:16:47.155968+0000","last_peered":"2024-04-19T02:16:47.155968+0000","last_clean":"2024-04-19T02:16:47.155968+0000","last_became_active":"2024-04-19T02:15:53.956719+0000","last_became_peered":"2024-04-19T02:15:53.956719+0000","last_unstale":"2024-04-19T02:16:47.155968+0000","last_undegraded":"2024-04-19T02:16:47.155968+0000","last_fullsized":"2024-04-19T02:16:47.155968+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:00:37.754624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.154825+0000","last_change":"2024-04-19T02:15:29.282663+0000","last_active":"2024-04-19T02:16:47.154825+0000","last_peered":"2024-04-19T02:16:47.154825+0000","last_clean":"2024-04-19T02:16:47.154825+0000","last_became_active":"2024-04-19T02:15:29.282217+0000","last_became_peered":"2024-04-19T02:15:29.282217+0000","last_unstale":"2024-04-19T02:16:47.154825+0000","last_undegraded":"2024-04-19T02:16:47.154825+0000","last_fullsized":"2024-04-19T02:16:47.154825+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"42'8022","reported_seq":8055,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-19T02:16:52.770677+0000","last_change":"2024-04-19T02:15:53.958264+0000","last_active":"2024-04-19T02:16:52.770677+0000","last_peered":"2024-04-19T02:16:52.770677+0000","last_clean":"2024-04-19T02:16:52.770677+0000","last_became_active":"2024-04-19T02:15:53.956689+0000","last_became_peered":"2024-04-19T02:15:53.956689+0000","last_unstale":"2024-04-19T02:16:52.770677+0000","last_undegraded":"2024-04-19T02:16:52.770677+0000","last_fullsized":"2024-04-19T02:16:52.770677+0000","mapping_epoch":16,"log_start":"26'4100","ondisk_log_start":"26'4100","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3922,"log_dups_size":0,"ondisk_log_size":3922,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:24:32.928594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525729792,"num_objects":8022,"num_object_clones":0,"num_object_copies":16044,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8022,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8022,"num_write_kb":513408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.157068+0000","last_change":"2024-04-19T02:15:24.530924+0000","last_active":"2024-04-19T02:16:47.157068+0000","last_peered":"2024-04-19T02:16:47.157068+0000","last_clean":"2024-04-19T02:16:47.157068+0000","last_became_active":"2024-04-19T02:15:24.530551+0000","last_became_peered":"2024-04-19T02:15:24.530551+0000","last_unstale":"2024-04-19T02:16:47.157068+0000","last_undegraded":"2024-04-19T02:16:47.157068+0000","last_fullsized":"2024-04-19T02:16:47.157068+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:30.576946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":237,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.156188+0000","last_change":"2024-04-19T02:15:24.533634+0000","last_active":"2024-04-19T02:16:47.156188+0000","last_peered":"2024-04-19T02:16:47.156188+0000","last_clean":"2024-04-19T02:16:47.156188+0000","last_became_active":"2024-04-19T02:15:24.533420+0000","last_became_peered":"2024-04-19T02:15:24.533420+0000","last_unstale":"2024-04-19T02:16:47.156188+0000","last_undegraded":"2024-04-19T02:16:47.156188+0000","last_fullsized":"2024-04-19T02:16:47.156188+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.153857+0000","last_change":"2024-04-19T02:15:28.890244+0000","last_active":"2024-04-19T02:16:47.153857+0000","last_peered":"2024-04-19T02:16:47.153857+0000","last_clean":"2024-04-19T02:16:47.153857+0000","last_became_active":"2024-04-19T02:15:28.889831+0000","last_became_peered":"2024-04-19T02:15:28.889831+0000","last_unstale":"2024-04-19T02:16:47.153857+0000","last_undegraded":"2024-04-19T02:16:47.153857+0000","last_fullsized":"2024-04-19T02:16:47.153857+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.158627+0000","last_change":"2024-04-19T02:15:29.285015+0000","last_active":"2024-04-19T02:16:47.158627+0000","last_peered":"2024-04-19T02:16:47.158627+0000","last_clean":"2024-04-19T02:16:47.158627+0000","last_became_active":"2024-04-19T02:15:29.284164+0000","last_became_peered":"2024-04-19T02:15:29.284164+0000","last_unstale":"2024-04-19T02:16:47.158627+0000","last_undegraded":"2024-04-19T02:16:47.158627+0000","last_fullsized":"2024-04-19T02:16:47.158627+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:36.987844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"42'8076","reported_seq":8110,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-19T02:16:52.781288+0000","last_change":"2024-04-19T02:15:53.956463+0000","last_active":"2024-04-19T02:16:52.781288+0000","last_peered":"2024-04-19T02:16:52.781288+0000","last_clean":"2024-04-19T02:16:52.781288+0000","last_became_active":"2024-04-19T02:15:53.955819+0000","last_became_peered":"2024-04-19T02:15:53.955819+0000","last_unstale":"2024-04-19T02:16:52.781288+0000","last_undegraded":"2024-04-19T02:16:52.781288+0000","last_fullsized":"2024-04-19T02:16:52.781288+0000","mapping_epoch":16,"log_start":"27'4331","ondisk_log_start":"27'4331","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3745,"log_dups_size":0,"ondisk_log_size":3745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:46:07.409922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":529268736,"num_objects":8076,"num_object_clones":0,"num_object_copies":16152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8076,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8076,"num_write_kb":516864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.156221+0000","last_change":"2024-04-19T02:15:24.533912+0000","last_active":"2024-04-19T02:16:47.156221+0000","last_peered":"2024-04-19T02:16:47.156221+0000","last_clean":"2024-04-19T02:16:47.156221+0000","last_became_active":"2024-04-19T02:15:24.533580+0000","last_became_peered":"2024-04-19T02:15:24.533580+0000","last_unstale":"2024-04-19T02:16:47.156221+0000","last_undegraded":"2024-04-19T02:16:47.156221+0000","last_fullsized":"2024-04-19T02:16:47.156221+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:45.045477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.154317+0000","last_change":"2024-04-19T02:15:28.891889+0000","last_active":"2024-04-19T02:16:47.154317+0000","last_peered":"2024-04-19T02:16:47.154317+0000","last_clean":"2024-04-19T02:16:47.154317+0000","last_became_active":"2024-04-19T02:15:28.890919+0000","last_became_peered":"2024-04-19T02:15:28.890919+0000","last_unstale":"2024-04-19T02:16:47.154317+0000","last_undegraded":"2024-04-19T02:16:47.154317+0000","last_fullsized":"2024-04-19T02:16:47.154317+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:35.412837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.156318+0000","last_change":"2024-04-19T02:15:53.957881+0000","last_active":"2024-04-19T02:16:47.156318+0000","last_peered":"2024-04-19T02:16:47.156318+0000","last_clean":"2024-04-19T02:16:47.156318+0000","last_became_active":"2024-04-19T02:15:53.957657+0000","last_became_peered":"2024-04-19T02:15:53.957657+0000","last_unstale":"2024-04-19T02:16:47.156318+0000","last_undegraded":"2024-04-19T02:16:47.156318+0000","last_fullsized":"2024-04-19T02:16:47.156318+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:46.921714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"42'8119","reported_seq":8153,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-19T02:16:52.775173+0000","last_change":"2024-04-19T02:15:53.955068+0000","last_active":"2024-04-19T02:16:52.775173+0000","last_peered":"2024-04-19T02:16:52.775173+0000","last_clean":"2024-04-19T02:16:52.775173+0000","last_became_active":"2024-04-19T02:15:53.954721+0000","last_became_peered":"2024-04-19T02:15:53.954721+0000","last_unstale":"2024-04-19T02:16:52.775173+0000","last_undegraded":"2024-04-19T02:16:52.775173+0000","last_fullsized":"2024-04-19T02:16:52.775173+0000","mapping_epoch":16,"log_start":"27'4400","ondisk_log_start":"27'4400","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3719,"log_dups_size":0,"ondisk_log_size":3719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:18:29.742535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":532086784,"num_objects":8119,"num_object_clones":0,"num_object_copies":16238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8119,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8119,"num_write_kb":519616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.154227+0000","last_change":"2024-04-19T02:15:53.959105+0000","last_active":"2024-04-19T02:16:47.154227+0000","last_peered":"2024-04-19T02:16:47.154227+0000","last_clean":"2024-04-19T02:16:47.154227+0000","last_became_active":"2024-04-19T02:15:53.958836+0000","last_became_peered":"2024-04-19T02:15:53.958836+0000","last_unstale":"2024-04-19T02:16:47.154227+0000","last_undegraded":"2024-04-19T02:16:47.154227+0000","last_fullsized":"2024-04-19T02:16:47.154227+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:18:00.321514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.154433+0000","last_change":"2024-04-19T02:15:28.892125+0000","last_active":"2024-04-19T02:16:47.154433+0000","last_peered":"2024-04-19T02:16:47.154433+0000","last_clean":"2024-04-19T02:16:47.154433+0000","last_became_active":"2024-04-19T02:15:28.891300+0000","last_became_peered":"2024-04-19T02:15:28.891300+0000","last_unstale":"2024-04-19T02:16:47.154433+0000","last_undegraded":"2024-04-19T02:16:47.154433+0000","last_fullsized":"2024-04-19T02:16:47.154433+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.161728+0000","last_change":"2024-04-19T02:15:29.281694+0000","last_active":"2024-04-19T02:16:47.161728+0000","last_peered":"2024-04-19T02:16:47.161728+0000","last_clean":"2024-04-19T02:16:47.161728+0000","last_became_active":"2024-04-19T02:15:29.280519+0000","last_became_peered":"2024-04-19T02:15:29.280519+0000","last_unstale":"2024-04-19T02:16:47.161728+0000","last_undegraded":"2024-04-19T02:16:47.161728+0000","last_fullsized":"2024-04-19T02:16:47.161728+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:50.890545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"42'7925","reported_seq":17056,"reported_epoch":42,"state":"active+remapped+backfilling","last_fresh":"2024-04-19T02:16:52.805835+0000","last_change":"2024-04-19T02:16:30.103016+0000","last_active":"2024-04-19T02:16:52.805835+0000","last_peered":"2024-04-19T02:16:52.805835+0000","last_clean":"2024-04-19T02:16:22.050311+0000","last_became_active":"2024-04-19T02:16:24.119992+0000","last_became_peered":"2024-04-19T02:16:24.119992+0000","last_unstale":"2024-04-19T02:16:52.805835+0000","last_undegraded":"2024-04-19T02:16:52.805835+0000","last_fullsized":"2024-04-19T02:16:52.805835+0000","mapping_epoch":29,"log_start":"27'4337","ondisk_log_start":"27'4337","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3588,"log_dups_size":0,"ondisk_log_size":3588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:28.663111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":519372800,"num_objects":7925,"num_object_clones":0,"num_object_copies":15850,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":1870,"num_objects_unfound":0,"num_objects_dirty":7925,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7925,"num_write_kb":507200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4542,"num_bytes_recovered":297664512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[{"shards":"0,2","objects":7925}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.154523+0000","last_change":"2024-04-19T02:15:28.891702+0000","last_active":"2024-04-19T02:16:47.154523+0000","last_peered":"2024-04-19T02:16:47.154523+0000","last_clean":"2024-04-19T02:16:47.154523+0000","last_became_active":"2024-04-19T02:15:28.890743+0000","last_became_peered":"2024-04-19T02:15:28.890743+0000","last_unstale":"2024-04-19T02:16:47.154523+0000","last_undegraded":"2024-04-19T02:16:47.154523+0000","last_fullsized":"2024-04-19T02:16:47.154523+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.156492+0000","last_change":"2024-04-19T02:15:24.526845+0000","last_active":"2024-04-19T02:16:47.156492+0000","last_peered":"2024-04-19T02:16:47.156492+0000","last_clean":"2024-04-19T02:16:47.156492+0000","last_became_active":"2024-04-19T02:15:24.526500+0000","last_became_peered":"2024-04-19T02:15:24.526500+0000","last_unstale":"2024-04-19T02:16:47.156492+0000","last_undegraded":"2024-04-19T02:16:47.156492+0000","last_fullsized":"2024-04-19T02:16:47.156492+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:16.883355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.153528+0000","last_change":"2024-04-19T02:15:29.278686+0000","last_active":"2024-04-19T02:16:47.153528+0000","last_peered":"2024-04-19T02:16:47.153528+0000","last_clean":"2024-04-19T02:16:47.153528+0000","last_became_active":"2024-04-19T02:15:29.278108+0000","last_became_peered":"2024-04-19T02:15:29.278108+0000","last_unstale":"2024-04-19T02:16:47.153528+0000","last_undegraded":"2024-04-19T02:16:47.153528+0000","last_fullsized":"2024-04-19T02:16:47.153528+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:34.593754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"42'7970","reported_seq":8004,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-19T02:16:52.756515+0000","last_change":"2024-04-19T02:15:53.957269+0000","last_active":"2024-04-19T02:16:52.756515+0000","last_peered":"2024-04-19T02:16:52.756515+0000","last_clean":"2024-04-19T02:16:52.756515+0000","last_became_active":"2024-04-19T02:15:53.956554+0000","last_became_peered":"2024-04-19T02:15:53.956554+0000","last_unstale":"2024-04-19T02:16:52.756515+0000","last_undegraded":"2024-04-19T02:16:52.756515+0000","last_fullsized":"2024-04-19T02:16:52.756515+0000","mapping_epoch":16,"log_start":"26'4028","ondisk_log_start":"26'4028","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3942,"log_dups_size":0,"ondisk_log_size":3942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:29:38.789719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":522321920,"num_objects":7970,"num_object_clones":0,"num_object_copies":15940,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7970,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7970,"num_write_kb":510080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.158394+0000","last_change":"2024-04-19T02:15:24.533777+0000","last_active":"2024-04-19T02:16:47.158394+0000","last_peered":"2024-04-19T02:16:47.158394+0000","last_clean":"2024-04-19T02:16:47.158394+0000","last_became_active":"2024-04-19T02:15:24.533436+0000","last_became_peered":"2024-04-19T02:15:24.533436+0000","last_unstale":"2024-04-19T02:16:47.158394+0000","last_undegraded":"2024-04-19T02:16:47.158394+0000","last_fullsized":"2024-04-19T02:16:47.158394+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:53:25.922418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":39,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.156395+0000","last_change":"2024-04-19T02:15:28.891370+0000","last_active":"2024-04-19T02:16:47.156395+0000","last_peered":"2024-04-19T02:16:47.156395+0000","last_clean":"2024-04-19T02:16:47.156395+0000","last_became_active":"2024-04-19T02:15:28.890702+0000","last_became_peered":"2024-04-19T02:15:28.890702+0000","last_unstale":"2024-04-19T02:16:47.156395+0000","last_undegraded":"2024-04-19T02:16:47.156395+0000","last_fullsized":"2024-04-19T02:16:47.156395+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:33.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.162450+0000","last_change":"2024-04-19T02:15:29.282244+0000","last_active":"2024-04-19T02:16:47.162450+0000","last_peered":"2024-04-19T02:16:47.162450+0000","last_clean":"2024-04-19T02:16:47.162450+0000","last_became_active":"2024-04-19T02:15:29.280366+0000","last_became_peered":"2024-04-19T02:15:29.280366+0000","last_unstale":"2024-04-19T02:16:47.162450+0000","last_undegraded":"2024-04-19T02:16:47.162450+0000","last_fullsized":"2024-04-19T02:16:47.162450+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":39,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.161772+0000","last_change":"2024-04-19T02:15:28.893027+0000","last_active":"2024-04-19T02:16:47.161772+0000","last_peered":"2024-04-19T02:16:47.161772+0000","last_clean":"2024-04-19T02:16:47.161772+0000","last_became_active":"2024-04-19T02:15:28.892695+0000","last_became_peered":"2024-04-19T02:15:28.892695+0000","last_unstale":"2024-04-19T02:16:47.161772+0000","last_undegraded":"2024-04-19T02:16:47.161772+0000","last_fullsized":"2024-04-19T02:16:47.161772+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.162154+0000","last_change":"2024-04-19T02:15:29.283155+0000","last_active":"2024-04-19T02:16:47.162154+0000","last_peered":"2024-04-19T02:16:47.162154+0000","last_clean":"2024-04-19T02:16:47.162154+0000","last_became_active":"2024-04-19T02:15:29.281407+0000","last_became_peered":"2024-04-19T02:15:29.281407+0000","last_unstale":"2024-04-19T02:16:47.162154+0000","last_undegraded":"2024-04-19T02:16:47.162154+0000","last_fullsized":"2024-04-19T02:16:47.162154+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.158075+0000","last_change":"2024-04-19T02:15:28.893067+0000","last_active":"2024-04-19T02:16:47.158075+0000","last_peered":"2024-04-19T02:16:47.158075+0000","last_clean":"2024-04-19T02:16:47.158075+0000","last_became_active":"2024-04-19T02:15:28.892781+0000","last_became_peered":"2024-04-19T02:15:28.892781+0000","last_unstale":"2024-04-19T02:16:47.158075+0000","last_undegraded":"2024-04-19T02:16:47.158075+0000","last_fullsized":"2024-04-19T02:16:47.158075+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:54:15.590143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.156923+0000","last_change":"2024-04-19T02:15:29.281279+0000","last_active":"2024-04-19T02:16:47.156923+0000","last_peered":"2024-04-19T02:16:47.156923+0000","last_clean":"2024-04-19T02:16:47.156923+0000","last_became_active":"2024-04-19T02:15:29.279360+0000","last_became_peered":"2024-04-19T02:15:29.279360+0000","last_unstale":"2024-04-19T02:16:47.156923+0000","last_undegraded":"2024-04-19T02:16:47.156923+0000","last_fullsized":"2024-04-19T02:16:47.156923+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.161923+0000","last_change":"2024-04-19T02:15:28.893239+0000","last_active":"2024-04-19T02:16:47.161923+0000","last_peered":"2024-04-19T02:16:47.161923+0000","last_clean":"2024-04-19T02:16:47.161923+0000","last_became_active":"2024-04-19T02:15:28.892881+0000","last_became_peered":"2024-04-19T02:15:28.892881+0000","last_unstale":"2024-04-19T02:16:47.161923+0000","last_undegraded":"2024-04-19T02:16:47.161923+0000","last_fullsized":"2024-04-19T02:16:47.161923+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.156447+0000","last_change":"2024-04-19T02:15:29.281652+0000","last_active":"2024-04-19T02:16:47.156447+0000","last_peered":"2024-04-19T02:16:47.156447+0000","last_clean":"2024-04-19T02:16:47.156447+0000","last_became_active":"2024-04-19T02:15:29.281175+0000","last_became_peered":"2024-04-19T02:15:29.281175+0000","last_unstale":"2024-04-19T02:16:47.156447+0000","last_undegraded":"2024-04-19T02:16:47.156447+0000","last_fullsized":"2024-04-19T02:16:47.156447+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:16.568764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":39,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.156574+0000","last_change":"2024-04-19T02:15:28.892058+0000","last_active":"2024-04-19T02:16:47.156574+0000","last_peered":"2024-04-19T02:16:47.156574+0000","last_clean":"2024-04-19T02:16:47.156574+0000","last_became_active":"2024-04-19T02:15:28.890877+0000","last_became_peered":"2024-04-19T02:15:28.890877+0000","last_unstale":"2024-04-19T02:16:47.156574+0000","last_undegraded":"2024-04-19T02:16:47.156574+0000","last_fullsized":"2024-04-19T02:16:47.156574+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:53.170180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.162891+0000","last_change":"2024-04-19T02:15:29.278810+0000","last_active":"2024-04-19T02:16:47.162891+0000","last_peered":"2024-04-19T02:16:47.162891+0000","last_clean":"2024-04-19T02:16:47.162891+0000","last_became_active":"2024-04-19T02:15:29.277913+0000","last_became_peered":"2024-04-19T02:15:29.277913+0000","last_unstale":"2024-04-19T02:16:47.162891+0000","last_undegraded":"2024-04-19T02:16:47.162891+0000","last_fullsized":"2024-04-19T02:16:47.162891+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:24.082666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":42,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.154677+0000","last_change":"2024-04-19T02:15:28.889132+0000","last_active":"2024-04-19T02:16:47.154677+0000","last_peered":"2024-04-19T02:16:47.154677+0000","last_clean":"2024-04-19T02:16:47.154677+0000","last_became_active":"2024-04-19T02:15:28.888926+0000","last_became_peered":"2024-04-19T02:15:28.888926+0000","last_unstale":"2024-04-19T02:16:47.154677+0000","last_undegraded":"2024-04-19T02:16:47.154677+0000","last_fullsized":"2024-04-19T02:16:47.154677+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.156447+0000","last_change":"2024-04-19T02:15:29.282776+0000","last_active":"2024-04-19T02:16:47.156447+0000","last_peered":"2024-04-19T02:16:47.156447+0000","last_clean":"2024-04-19T02:16:47.156447+0000","last_became_active":"2024-04-19T02:15:29.279382+0000","last_became_peered":"2024-04-19T02:15:29.279382+0000","last_unstale":"2024-04-19T02:16:47.156447+0000","last_undegraded":"2024-04-19T02:16:47.156447+0000","last_fullsized":"2024-04-19T02:16:47.156447+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.156306+0000","last_change":"2024-04-19T02:15:29.283537+0000","last_active":"2024-04-19T02:16:47.156306+0000","last_peered":"2024-04-19T02:16:47.156306+0000","last_clean":"2024-04-19T02:16:47.156306+0000","last_became_active":"2024-04-19T02:15:29.281801+0000","last_became_peered":"2024-04-19T02:15:29.281801+0000","last_unstale":"2024-04-19T02:16:47.156306+0000","last_undegraded":"2024-04-19T02:16:47.156306+0000","last_fullsized":"2024-04-19T02:16:47.156306+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.154400+0000","last_change":"2024-04-19T02:15:29.281560+0000","last_active":"2024-04-19T02:16:47.154400+0000","last_peered":"2024-04-19T02:16:47.154400+0000","last_clean":"2024-04-19T02:16:47.154400+0000","last_became_active":"2024-04-19T02:15:29.281261+0000","last_became_peered":"2024-04-19T02:15:29.281261+0000","last_unstale":"2024-04-19T02:16:47.154400+0000","last_undegraded":"2024-04-19T02:16:47.154400+0000","last_fullsized":"2024-04-19T02:16:47.154400+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.156243+0000","last_change":"2024-04-19T02:15:53.955913+0000","last_active":"2024-04-19T02:16:47.156243+0000","last_peered":"2024-04-19T02:16:47.156243+0000","last_clean":"2024-04-19T02:16:47.156243+0000","last_became_active":"2024-04-19T02:15:53.955676+0000","last_became_peered":"2024-04-19T02:15:53.955676+0000","last_unstale":"2024-04-19T02:16:47.156243+0000","last_undegraded":"2024-04-19T02:16:47.156243+0000","last_fullsized":"2024-04-19T02:16:47.156243+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:53:02.899902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.153943+0000","last_change":"2024-04-19T02:15:29.278702+0000","last_active":"2024-04-19T02:16:47.153943+0000","last_peered":"2024-04-19T02:16:47.153943+0000","last_clean":"2024-04-19T02:16:47.153943+0000","last_became_active":"2024-04-19T02:15:29.277756+0000","last_became_peered":"2024-04-19T02:15:29.277756+0000","last_unstale":"2024-04-19T02:16:47.153943+0000","last_undegraded":"2024-04-19T02:16:47.153943+0000","last_fullsized":"2024-04-19T02:16:47.153943+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-19T02:16:47.162242+0000","last_change":"2024-04-19T02:15:29.277568+0000","last_active":"2024-04-19T02:16:47.162242+0000","last_peered":"2024-04-19T02:16:47.162242+0000","last_clean":"2024-04-19T02:16:47.162242+0000","last_became_active":"2024-04-19T02:15:29.276725+0000","last_became_peered":"2024-04-19T02:15:29.276725+0000","last_unstale":"2024-04-19T02:16:47.162242+0000","last_undegraded":"2024-04-19T02:16:47.162242+0000","last_fullsized":"2024-04-19T02:16:47.162242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":8489992192,"num_objects":129547,"num_object_clones":0,"num_object_copies":259094,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":1870,"num_objects_unfound":0,"num_objects_dirty":129547,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129547,"num_write_kb":8291008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4542,"num_bytes_recovered":297664512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17378246656,"data_stored":17378246656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60146,"ondisk_log_size":60146,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738388,"num_pgs":84,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6859092,"kb_used_data":6665548,"kb_used_omap":1,"kb_used_meta":193534,"kb_avail":87512748,"statfs":{"total":96636764160,"available":89613053952,"internally_reserved":0,"allocated":6825521152,"data_stored":6825223044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":198179270},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.313,"15min":0.313},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.497,"5min":0.497,"15min":0.497},"last":0.17399999999999999},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.189}]},{"osd":1,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.222}]}]},{"osd":0,"up_from":8,"seq":34359738389,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5256308,"kb_used_data":5139048,"kb_used_omap":1,"kb_used_meta":117246,"kb_avail":89115532,"statfs":{"total":96636764160,"available":91254304768,"internally_reserved":0,"allocated":5262385152,"data_stored":5262060662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":120060358},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.185},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.27200000000000002}]},{"osd":2,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":2.1000000000000001,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.379}]}]},{"osd":1,"up_from":8,"seq":34359738388,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5196396,"kb_used_data":5044704,"kb_used_omap":1,"kb_used_meta":151678,"kb_avail":89175444,"statfs":{"total":96636764160,"available":91315654656,"internally_reserved":0,"allocated":5165776896,"data_stored":5165459982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":155318726},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:16:26 2024","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.16700000000000001},{"interface":"front","average":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"min":{"1min":0.16,"5min":0.16,"15min":0.16},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.191}]},{"osd":2,"last update":"Fri Apr 19 02:16:26 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.20799999999999999},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.224}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5318967296,"data_stored":5318967296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5172887552,"data_stored":5172887552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6886391808,"data_stored":6886391808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:16:55.695 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:55.696+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:55.769 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:55.769+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:55.778 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:55.778 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:55.789 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:16:55.869 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:55.870+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:55.923 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:55.923 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:55.934 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:16:55.971 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:55.972+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:56.030 INFO:tasks.radosbench.radosbench.0.smithi121.stdout:Total time run: 60.0079 2024-04-19T02:16:56.030 INFO:tasks.radosbench.radosbench.0.smithi121.stdout:Total writes made: 134032 2024-04-19T02:16:56.031 INFO:tasks.radosbench.radosbench.0.smithi121.stdout:Write size: 65536 2024-04-19T02:16:56.031 INFO:tasks.radosbench.radosbench.0.smithi121.stdout:Object size: 65536 2024-04-19T02:16:56.031 INFO:tasks.radosbench.radosbench.0.smithi121.stdout:Bandwidth (MB/sec): 139.598 2024-04-19T02:16:56.031 INFO:tasks.radosbench.radosbench.0.smithi121.stdout:Stddev Bandwidth: 38.6997 2024-04-19T02:16:56.031 INFO:tasks.radosbench.radosbench.0.smithi121.stdout:Max bandwidth (MB/sec): 228.562 2024-04-19T02:16:56.031 INFO:tasks.radosbench.radosbench.0.smithi121.stdout:Min bandwidth (MB/sec): 0 2024-04-19T02:16:56.031 INFO:tasks.radosbench.radosbench.0.smithi121.stdout:Average IOPS: 2233 2024-04-19T02:16:56.031 INFO:tasks.radosbench.radosbench.0.smithi121.stdout:Stddev IOPS: 619.213 2024-04-19T02:16:56.031 INFO:tasks.radosbench.radosbench.0.smithi121.stdout:Max IOPS: 3657 2024-04-19T02:16:56.031 INFO:tasks.radosbench.radosbench.0.smithi121.stdout:Min IOPS: 0 2024-04-19T02:16:56.031 INFO:tasks.radosbench.radosbench.0.smithi121.stdout:Average Latency(s): 0.00716107 2024-04-19T02:16:56.031 INFO:tasks.radosbench.radosbench.0.smithi121.stdout:Stddev Latency(s): 0.0221894 2024-04-19T02:16:56.031 INFO:tasks.radosbench.radosbench.0.smithi121.stdout:Max latency(s): 2.06929 2024-04-19T02:16:56.031 INFO:tasks.radosbench.radosbench.0.smithi121.stdout:Min latency(s): 0.00120262 2024-04-19T02:16:56.036 INFO:tasks.radosbench.radosbench.0.smithi121.stdout:Cleaning up (deleting benchmark objects) 2024-04-19T02:16:56.072 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:56.072+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:56.082 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:56.082 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:56.096 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:16:56.174 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:56.174+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:56.175 INFO:teuthology.orchestra.run.smithi121.stderr:nodeep-scrub is set 2024-04-19T02:16:56.267 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:56.267 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:56.274 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:56.275+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:56.280 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:16:56.375 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:56.376+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:56.466 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:56.466 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:56.476 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:56.476+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:56.482 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:16:56.577 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:56.577+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:56.678 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:56.679+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:56.705 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:56.705 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:56.722 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:16:56.746 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:16:56.808 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:56.808+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:56.880 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:56.880+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:56.893 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:16:56.913 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:16:56.934 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2: {} 2024-04-19T02:16:56.935 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:16:56.935 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:16:56.935 INFO:teuthology.orchestra.run.smithi121.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:16:56.962 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-04-19T02:16:56.962 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 20, 2024-04-19T02:16:56.962 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 600, 2024-04-19T02:16:56.962 INFO:teuthology.orchestra.run.smithi177.stdout: "ops": [ 2024-04-19T02:16:56.963 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.963 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:61815 5.c 5:3ca8a794:::benchmark_data_smithi121_44835_object61814:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:16:56.963 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:17.482110+0000", 2024-04-19T02:16:56.963 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 39.478208918, 2024-04-19T02:16:56.963 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.021577559999999999, 2024-04-19T02:16:56.963 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:56.963 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:56.963 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:56.963 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:56.963 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:56.963 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 61815 2024-04-19T02:16:56.963 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.963 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:56.963 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.964 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:56.964 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482110+0000", 2024-04-19T02:16:56.964 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:56.964 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.964 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.964 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:56.964 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482110+0000", 2024-04-19T02:16:56.964 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:56.964 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.964 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.964 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:56.964 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482109+0000", 2024-04-19T02:16:56.964 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:56.964 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.964 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.965 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:56.965 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482197+0000", 2024-04-19T02:16:56.965 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.7405999999999996e-05 2024-04-19T02:16:56.965 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.965 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.965 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:56.965 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482206+0000", 2024-04-19T02:16:56.965 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.0010000000000007e-06 2024-04-19T02:16:56.965 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.965 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.965 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:56.965 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482211+0000", 2024-04-19T02:16:56.965 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.4569999999999996e-06 2024-04-19T02:16:56.965 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.965 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.966 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:56.966 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.489465+0000", 2024-04-19T02:16:56.966 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.007253776 2024-04-19T02:16:56.966 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.966 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.966 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:56.966 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.489582+0000", 2024-04-19T02:16:56.966 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00011669500000000001 2024-04-19T02:16:56.966 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.966 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.966 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:56.966 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.489684+0000", 2024-04-19T02:16:56.966 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000102533 2024-04-19T02:16:56.966 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.967 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.967 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:56.967 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.491836+0000", 2024-04-19T02:16:56.967 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0021516759999999999 2024-04-19T02:16:56.967 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.967 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.967 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:56.967 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503615+0000", 2024-04-19T02:16:56.967 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.011778906 2024-04-19T02:16:56.967 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.967 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.967 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:56.967 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503652+0000", 2024-04-19T02:16:56.967 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6622999999999998e-05 2024-04-19T02:16:56.967 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.967 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.968 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:56.968 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503688+0000", 2024-04-19T02:16:56.968 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6127000000000002e-05 2024-04-19T02:16:56.968 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:56.968 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:56.968 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:56.968 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.968 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.968 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:78247 5.c 5:3efb1468:::benchmark_data_smithi121_44835_object78246:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:56.968 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.116347+0000", 2024-04-19T02:16:56.968 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 29.843971863, 2024-04-19T02:16:56.968 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.032194436999999999, 2024-04-19T02:16:56.968 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:56.968 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:56.969 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:56.969 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:56.969 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:56.969 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 78247 2024-04-19T02:16:56.969 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.969 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:56.969 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.969 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:56.969 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116347+0000", 2024-04-19T02:16:56.969 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:56.969 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.969 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.969 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:56.969 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116347+0000", 2024-04-19T02:16:56.969 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:56.969 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.970 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.970 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:56.970 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116346+0000", 2024-04-19T02:16:56.970 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:56.970 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.970 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.970 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:56.970 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116370+0000", 2024-04-19T02:16:56.970 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.3892000000000001e-05 2024-04-19T02:16:56.970 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.970 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.970 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:56.970 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116385+0000", 2024-04-19T02:16:56.970 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.5162e-05 2024-04-19T02:16:56.971 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.971 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.971 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:56.971 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116394+0000", 2024-04-19T02:16:56.971 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.8000000000000004e-06 2024-04-19T02:16:56.971 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.971 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.971 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:56.971 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124856+0000", 2024-04-19T02:16:56.971 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0084622169999999993 2024-04-19T02:16:56.971 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.972 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.972 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:56.972 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124966+0000", 2024-04-19T02:16:56.972 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000109747 2024-04-19T02:16:56.972 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.972 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.972 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:56.972 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125216+0000", 2024-04-19T02:16:56.972 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000249545 2024-04-19T02:16:56.972 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.972 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.972 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:56.972 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.131713+0000", 2024-04-19T02:16:56.972 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0064972370000000003 2024-04-19T02:16:56.972 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.972 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.973 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:56.973 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148323+0000", 2024-04-19T02:16:56.973 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016609641000000001 2024-04-19T02:16:56.973 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.973 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.973 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:56.973 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148359+0000", 2024-04-19T02:16:56.973 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6412000000000003e-05 2024-04-19T02:16:56.973 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.973 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.973 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:56.973 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148542+0000", 2024-04-19T02:16:56.973 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00018265600000000001 2024-04-19T02:16:56.973 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:56.973 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:56.974 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:56.974 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.974 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.974 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:78248 5.c 5:30b7cc74:::benchmark_data_smithi121_44835_object78247:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:56.974 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.116471+0000", 2024-04-19T02:16:56.974 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 29.843848361999999, 2024-04-19T02:16:56.974 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.032127452000000001, 2024-04-19T02:16:56.974 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:56.974 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:56.974 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:56.974 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:56.974 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:56.974 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 78248 2024-04-19T02:16:56.974 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.975 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:56.975 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.975 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:56.975 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116471+0000", 2024-04-19T02:16:56.975 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:56.975 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.975 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.975 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:56.975 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116471+0000", 2024-04-19T02:16:56.975 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:56.975 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.976 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.976 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:56.976 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116470+0000", 2024-04-19T02:16:56.976 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:56.976 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.976 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.976 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:56.976 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116496+0000", 2024-04-19T02:16:56.976 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.5517e-05 2024-04-19T02:16:56.976 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.976 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.976 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:56.976 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116505+0000", 2024-04-19T02:16:56.976 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.9250000000000007e-06 2024-04-19T02:16:56.976 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.977 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.977 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:56.977 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116516+0000", 2024-04-19T02:16:56.977 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.012e-05 2024-04-19T02:16:56.977 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.977 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.977 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:56.977 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.127803+0000", 2024-04-19T02:16:56.977 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.011287523000000001 2024-04-19T02:16:56.977 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.977 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.977 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:56.977 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.127932+0000", 2024-04-19T02:16:56.977 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012848499999999999 2024-04-19T02:16:56.977 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.978 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.978 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:56.978 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128022+0000", 2024-04-19T02:16:56.978 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.0890000000000006e-05 2024-04-19T02:16:56.978 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.978 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.978 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:56.978 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.131909+0000", 2024-04-19T02:16:56.978 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0038864609999999999 2024-04-19T02:16:56.978 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.978 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.978 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:56.978 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148552+0000", 2024-04-19T02:16:56.979 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016643162999999999 2024-04-19T02:16:56.979 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.979 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.979 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:56.979 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148577+0000", 2024-04-19T02:16:56.979 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.5333999999999998e-05 2024-04-19T02:16:56.979 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.979 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.979 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:56.979 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148598+0000", 2024-04-19T02:16:56.979 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.0687999999999999e-05 2024-04-19T02:16:56.979 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:56.979 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:56.979 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:56.979 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.979 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.980 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:78258 5.a 5:549070de:::benchmark_data_smithi121_44835_object78257:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:56.980 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.124295+0000", 2024-04-19T02:16:56.980 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 29.836023816000001, 2024-04-19T02:16:56.980 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020189543000000001, 2024-04-19T02:16:56.980 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:56.980 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:56.980 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:56.980 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:56.980 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:56.980 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 78258 2024-04-19T02:16:56.980 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.980 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:56.980 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.980 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:56.980 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124295+0000", 2024-04-19T02:16:56.980 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:56.981 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.981 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.981 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:56.981 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124295+0000", 2024-04-19T02:16:56.981 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:56.981 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.981 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.981 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:56.981 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124294+0000", 2024-04-19T02:16:56.981 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:56.981 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.981 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.981 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:56.981 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124358+0000", 2024-04-19T02:16:56.981 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.4040000000000003e-05 2024-04-19T02:16:56.982 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.982 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.982 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:56.982 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124374+0000", 2024-04-19T02:16:56.982 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.5291e-05 2024-04-19T02:16:56.982 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.982 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.982 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:56.982 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124383+0000", 2024-04-19T02:16:56.982 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.8360000000000004e-06 2024-04-19T02:16:56.982 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.982 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.982 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:56.982 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124908+0000", 2024-04-19T02:16:56.982 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00052415700000000003 2024-04-19T02:16:56.983 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.983 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.983 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:56.983 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125023+0000", 2024-04-19T02:16:56.983 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00011506999999999999 2024-04-19T02:16:56.983 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.983 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.983 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:56.983 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125182+0000", 2024-04-19T02:16:56.983 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00015942500000000001 2024-04-19T02:16:56.983 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.983 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.983 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:56.983 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.129505+0000", 2024-04-19T02:16:56.984 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0043225080000000001 2024-04-19T02:16:56.984 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.984 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.984 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:56.984 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.144379+0000", 2024-04-19T02:16:56.984 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.014874263 2024-04-19T02:16:56.984 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.984 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.984 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:56.984 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.144444+0000", 2024-04-19T02:16:56.984 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.5451999999999996e-05 2024-04-19T02:16:56.984 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.984 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.984 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:56.984 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.144485+0000", 2024-04-19T02:16:56.984 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.0426999999999998e-05 2024-04-19T02:16:56.985 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:56.985 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:56.985 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:56.985 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.985 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.985 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:78259 5.4 e31/16 5:2aa344b2:::benchmark_data_smithi121_44835_object78258:head v 31'4849, mlcod=31'4843)", 2024-04-19T02:16:56.985 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.125675+0000", 2024-04-19T02:16:56.985 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 29.834643944, 2024-04-19T02:16:56.985 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.022419326, 2024-04-19T02:16:56.985 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:56.985 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:56.985 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:56.985 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.985 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:56.985 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125675+0000", 2024-04-19T02:16:56.986 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:56.986 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.986 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.986 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:56.986 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125675+0000", 2024-04-19T02:16:56.986 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:56.986 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.986 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.986 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:56.986 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125674+0000", 2024-04-19T02:16:56.986 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:56.986 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.986 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.986 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:56.986 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125723+0000", 2024-04-19T02:16:56.986 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.8998000000000001e-05 2024-04-19T02:16:56.987 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.987 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.987 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:56.987 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125733+0000", 2024-04-19T02:16:56.987 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.1379999999999996e-06 2024-04-19T02:16:56.987 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.987 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.987 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:56.987 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125740+0000", 2024-04-19T02:16:56.987 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.0779999999999998e-06 2024-04-19T02:16:56.987 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.987 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.987 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:56.987 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.129589+0000", 2024-04-19T02:16:56.987 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0038488910000000001 2024-04-19T02:16:56.988 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.988 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.988 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:56.988 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.129605+0000", 2024-04-19T02:16:56.988 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.6877000000000001e-05 2024-04-19T02:16:56.988 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.988 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.988 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:56.988 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148057+0000", 2024-04-19T02:16:56.988 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.018451624 2024-04-19T02:16:56.988 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.988 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.988 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:56.988 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148094+0000", 2024-04-19T02:16:56.989 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.7327999999999999e-05 2024-04-19T02:16:56.989 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:56.989 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:56.989 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:56.989 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.989 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.989 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:78263 5.1 5:8e231862:::benchmark_data_smithi121_44835_object78262:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:56.989 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.128154+0000", 2024-04-19T02:16:56.989 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 29.832164758000001, 2024-04-19T02:16:56.989 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020882214, 2024-04-19T02:16:56.989 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:56.989 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:56.989 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:56.989 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:56.989 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:56.990 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 78263 2024-04-19T02:16:56.990 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.990 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:56.990 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.990 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:56.990 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128154+0000", 2024-04-19T02:16:56.990 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:56.990 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.990 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.990 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:56.990 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128154+0000", 2024-04-19T02:16:56.990 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:56.990 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.990 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.991 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:56.991 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128153+0000", 2024-04-19T02:16:56.991 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:56.991 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.991 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.991 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:56.991 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128246+0000", 2024-04-19T02:16:56.991 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.302e-05 2024-04-19T02:16:56.991 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.991 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.991 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:56.991 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128263+0000", 2024-04-19T02:16:56.991 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.6753e-05 2024-04-19T02:16:56.991 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.991 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.992 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:56.992 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128271+0000", 2024-04-19T02:16:56.992 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.2290000000000003e-06 2024-04-19T02:16:56.992 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.992 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.992 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:56.992 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128459+0000", 2024-04-19T02:16:56.992 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00018772 2024-04-19T02:16:56.992 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.992 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.992 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:56.992 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128574+0000", 2024-04-19T02:16:56.992 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00011437700000000001 2024-04-19T02:16:56.992 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.992 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.992 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:56.993 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128696+0000", 2024-04-19T02:16:56.993 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000122831 2024-04-19T02:16:56.993 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.993 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.993 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:56.993 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.130816+0000", 2024-04-19T02:16:56.993 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0021196750000000001 2024-04-19T02:16:56.993 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.993 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.993 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:56.993 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.131859+0000", 2024-04-19T02:16:56.993 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0010434419999999999 2024-04-19T02:16:56.993 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.993 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.993 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:56.994 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148848+0000", 2024-04-19T02:16:56.994 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016988712 2024-04-19T02:16:56.994 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.994 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.994 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:56.994 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148905+0000", 2024-04-19T02:16:56.994 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.6722999999999999e-05 2024-04-19T02:16:56.994 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.994 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.994 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:56.994 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.149036+0000", 2024-04-19T02:16:56.994 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000131567 2024-04-19T02:16:56.994 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:56.994 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:56.995 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:56.995 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.995 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.995 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:78271 5.4 e31/16 5:2982d7a6:::benchmark_data_smithi121_44835_object78270:head v 31'4850, mlcod=31'4847)", 2024-04-19T02:16:56.995 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.132554+0000", 2024-04-19T02:16:56.995 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 29.827765224, 2024-04-19T02:16:56.995 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020294946000000001, 2024-04-19T02:16:56.995 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:56.995 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:56.995 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:56.995 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.995 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:56.995 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132554+0000", 2024-04-19T02:16:56.995 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:56.995 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.996 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.996 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:56.996 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132554+0000", 2024-04-19T02:16:56.996 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:56.996 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.996 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.996 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:56.996 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132553+0000", 2024-04-19T02:16:56.996 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:56.996 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.996 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.996 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:56.996 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132615+0000", 2024-04-19T02:16:56.996 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.1772000000000004e-05 2024-04-19T02:16:56.996 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.996 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.997 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:56.997 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132620+0000", 2024-04-19T02:16:56.997 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.0939999999999998e-06 2024-04-19T02:16:56.997 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.997 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.997 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:56.997 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132624+0000", 2024-04-19T02:16:56.997 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.2229999999999999e-06 2024-04-19T02:16:56.997 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.997 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.997 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:56.997 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132649+0000", 2024-04-19T02:16:56.997 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.5352000000000001e-05 2024-04-19T02:16:56.997 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.997 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.998 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:56.998 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132661+0000", 2024-04-19T02:16:56.998 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.1851999999999999e-05 2024-04-19T02:16:56.998 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.998 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.998 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:56.998 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.152820+0000", 2024-04-19T02:16:56.998 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020159369999999999 2024-04-19T02:16:56.998 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.998 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.998 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:56.998 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.152849+0000", 2024-04-19T02:16:56.998 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.868e-05 2024-04-19T02:16:56.998 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:56.999 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:56.999 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:56.999 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.999 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:56.999 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:94191 5.c 5:3155c784:::benchmark_data_smithi121_44835_object94190:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T02:16:56.999 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:34.963381+0000", 2024-04-19T02:16:56.999 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 21.996937539000001, 2024-04-19T02:16:56.999 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.021414343999999998, 2024-04-19T02:16:56.999 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:56.999 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:56.999 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:56.999 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:56.999 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:56.999 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 94191 2024-04-19T02:16:56.999 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:56.999 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:57.000 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.000 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:57.000 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.963381+0000", 2024-04-19T02:16:57.000 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:57.000 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.000 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.000 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:57.000 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.963381+0000", 2024-04-19T02:16:57.000 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:57.000 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.000 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.000 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:57.000 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.963381+0000", 2024-04-19T02:16:57.000 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:57.000 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.001 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.001 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:57.001 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.963457+0000", 2024-04-19T02:16:57.001 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.5827000000000004e-05 2024-04-19T02:16:57.001 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.001 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.001 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:57.001 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.963465+0000", 2024-04-19T02:16:57.001 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.2800000000000003e-06 2024-04-19T02:16:57.001 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.001 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.001 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.001 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.963470+0000", 2024-04-19T02:16:57.001 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.2310000000000004e-06 2024-04-19T02:16:57.001 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.002 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.002 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:57.002 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.969469+0000", 2024-04-19T02:16:57.002 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0059987169999999998 2024-04-19T02:16:57.002 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.002 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.002 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:57.002 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.969594+0000", 2024-04-19T02:16:57.002 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012517299999999999 2024-04-19T02:16:57.002 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.002 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.002 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:57.002 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.969759+0000", 2024-04-19T02:16:57.002 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00016459999999999999 2024-04-19T02:16:57.002 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.003 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.003 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.003 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.975130+0000", 2024-04-19T02:16:57.003 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0053717410000000002 2024-04-19T02:16:57.003 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.003 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.003 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:57.003 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.984704+0000", 2024-04-19T02:16:57.003 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.009573715 2024-04-19T02:16:57.003 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.003 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.003 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:57.003 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.984758+0000", 2024-04-19T02:16:57.003 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.4039000000000002e-05 2024-04-19T02:16:57.004 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.004 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.004 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:57.004 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.984796+0000", 2024-04-19T02:16:57.004 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.7619e-05 2024-04-19T02:16:57.004 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:57.004 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:57.004 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:57.004 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.004 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.004 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:94471 5.6 5:641302c2:::benchmark_data_smithi121_44835_object94470:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:57.004 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:35.112592+0000", 2024-04-19T02:16:57.004 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 21.847727474999999, 2024-04-19T02:16:57.004 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.023525194999999999, 2024-04-19T02:16:57.004 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:57.005 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.005 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:57.005 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:57.005 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:57.005 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 94471 2024-04-19T02:16:57.005 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.005 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:57.005 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.005 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:57.005 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.112592+0000", 2024-04-19T02:16:57.005 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:57.005 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.005 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.005 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:57.005 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.112592+0000", 2024-04-19T02:16:57.005 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:57.006 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.006 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.006 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:57.006 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.112591+0000", 2024-04-19T02:16:57.006 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:57.006 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.006 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.006 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:57.006 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.112621+0000", 2024-04-19T02:16:57.006 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.0701999999999998e-05 2024-04-19T02:16:57.006 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.006 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.006 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:57.006 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.112631+0000", 2024-04-19T02:16:57.006 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.3209999999999994e-06 2024-04-19T02:16:57.007 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.007 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.007 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.007 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.112638+0000", 2024-04-19T02:16:57.007 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.187e-06 2024-04-19T02:16:57.007 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.007 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.007 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:57.007 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.113893+0000", 2024-04-19T02:16:57.007 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0012553390000000001 2024-04-19T02:16:57.007 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.007 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.007 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:57.007 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.114012+0000", 2024-04-19T02:16:57.007 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000118638 2024-04-19T02:16:57.008 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.008 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.008 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:57.008 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.114151+0000", 2024-04-19T02:16:57.008 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00013928700000000001 2024-04-19T02:16:57.008 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.008 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.008 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.008 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.120607+0000", 2024-04-19T02:16:57.008 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0064559179999999997 2024-04-19T02:16:57.008 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.008 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.008 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:57.008 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136026+0000", 2024-04-19T02:16:57.008 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015418762000000001 2024-04-19T02:16:57.009 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.009 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.009 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:57.009 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136084+0000", 2024-04-19T02:16:57.009 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.8245000000000002e-05 2024-04-19T02:16:57.009 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.009 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.009 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:57.009 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136117+0000", 2024-04-19T02:16:57.009 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.2616000000000001e-05 2024-04-19T02:16:57.009 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:57.009 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:57.009 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:57.009 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.009 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.010 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:94468 5.2 e34/16 5:4f406431:::benchmark_data_smithi121_44835_object94467:head v 34'5918, mlcod=34'5914)", 2024-04-19T02:16:57.010 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:35.113059+0000", 2024-04-19T02:16:57.010 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 21.847260192, 2024-04-19T02:16:57.010 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.022987177000000001, 2024-04-19T02:16:57.010 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:57.010 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.010 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:57.010 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.010 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:57.010 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.113059+0000", 2024-04-19T02:16:57.010 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:57.010 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.010 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.010 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:57.010 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.113059+0000", 2024-04-19T02:16:57.010 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:57.011 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.011 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.011 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:57.011 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.113058+0000", 2024-04-19T02:16:57.011 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:57.011 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.011 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.011 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:57.011 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.113103+0000", 2024-04-19T02:16:57.011 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.4159000000000002e-05 2024-04-19T02:16:57.011 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.011 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.011 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:57.011 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.113110+0000", 2024-04-19T02:16:57.011 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.1049999999999997e-06 2024-04-19T02:16:57.012 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.012 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.012 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.012 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.113115+0000", 2024-04-19T02:16:57.012 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.3229999999999997e-06 2024-04-19T02:16:57.012 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.012 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.012 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:57.012 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.114338+0000", 2024-04-19T02:16:57.012 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.001223179 2024-04-19T02:16:57.012 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.012 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.012 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:57.012 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.114355+0000", 2024-04-19T02:16:57.012 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.6963999999999999e-05 2024-04-19T02:16:57.012 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.013 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.013 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:57.013 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136011+0000", 2024-04-19T02:16:57.013 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.021656102999999999 2024-04-19T02:16:57.013 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.013 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.013 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:57.013 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136046+0000", 2024-04-19T02:16:57.013 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.4802999999999999e-05 2024-04-19T02:16:57.013 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:57.013 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:57.013 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:57.013 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.013 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.013 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:94581 5.b e35/16 5:dc86d6e9:::benchmark_data_smithi121_44835_object94580:head v 35'5875, mlcod=35'5872)", 2024-04-19T02:16:57.013 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:35.181295+0000", 2024-04-19T02:16:57.014 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 21.779024153999998, 2024-04-19T02:16:57.014 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.02078327, 2024-04-19T02:16:57.014 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:57.014 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.014 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:57.014 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.014 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:57.014 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.181295+0000", 2024-04-19T02:16:57.014 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:57.014 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.014 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.014 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:57.014 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.181295+0000", 2024-04-19T02:16:57.014 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:57.015 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.015 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.015 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:57.015 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.181294+0000", 2024-04-19T02:16:57.015 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:57.015 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.015 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.015 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:57.015 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.181321+0000", 2024-04-19T02:16:57.015 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.6588999999999999e-05 2024-04-19T02:16:57.015 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.016 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.016 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:57.016 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.181329+0000", 2024-04-19T02:16:57.016 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.9289999999999998e-06 2024-04-19T02:16:57.016 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.016 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.016 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.016 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.181334+0000", 2024-04-19T02:16:57.016 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.2789999999999998e-06 2024-04-19T02:16:57.016 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.016 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.016 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:57.016 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.186093+0000", 2024-04-19T02:16:57.016 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0047585509999999998 2024-04-19T02:16:57.016 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.017 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.017 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:57.017 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.186111+0000", 2024-04-19T02:16:57.017 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.7901e-05 2024-04-19T02:16:57.017 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.017 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.017 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:57.017 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.202037+0000", 2024-04-19T02:16:57.017 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015926020999999999 2024-04-19T02:16:57.017 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.017 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.017 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:57.017 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.202078+0000", 2024-04-19T02:16:57.017 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.1424999999999997e-05 2024-04-19T02:16:57.017 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:57.018 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:57.018 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:57.018 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.018 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.018 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "MOSDPGPushReply(5.1 35/29 [PushReplyOp(5:860e8104:::benchmark_data_smithi121_44835_object52857:head)])", 2024-04-19T02:16:57.018 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:35.719222+0000", 2024-04-19T02:16:57.018 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 21.241097418999999, 2024-04-19T02:16:57.018 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.022063027999999998, 2024-04-19T02:16:57.018 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:57.018 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "reached pg", 2024-04-19T02:16:57.018 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:57.018 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.018 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:57.018 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.719222+0000", 2024-04-19T02:16:57.018 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:57.019 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.019 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.019 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:57.019 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.719222+0000", 2024-04-19T02:16:57.019 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:57.019 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.019 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.019 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:57.019 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.719221+0000", 2024-04-19T02:16:57.019 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967296 2024-04-19T02:16:57.019 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.019 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.019 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:57.019 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.719225+0000", 2024-04-19T02:16:57.019 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.5779999999999999e-06 2024-04-19T02:16:57.019 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.020 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.020 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:57.020 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.719232+0000", 2024-04-19T02:16:57.020 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.1319999999999996e-06 2024-04-19T02:16:57.020 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.020 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.020 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.020 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.719239+0000", 2024-04-19T02:16:57.020 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.8120000000000002e-06 2024-04-19T02:16:57.020 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.020 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.020 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:57.020 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.741004+0000", 2024-04-19T02:16:57.020 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.021764614000000002 2024-04-19T02:16:57.020 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.021 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.021 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:57.021 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.741285+0000", 2024-04-19T02:16:57.021 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000281079 2024-04-19T02:16:57.021 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:57.021 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:57.021 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:57.021 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.021 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.021 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:96375 5.1 5:84bae481:::benchmark_data_smithi121_44835_object96374:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:57.021 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:36.105748+0000", 2024-04-19T02:16:57.021 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 20.854571028999999, 2024-04-19T02:16:57.021 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.021551219999999999, 2024-04-19T02:16:57.021 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:57.021 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.022 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:57.022 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:57.022 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:57.022 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 96375 2024-04-19T02:16:57.022 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.022 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:57.022 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.022 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:57.022 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.105748+0000", 2024-04-19T02:16:57.022 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:57.022 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.022 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.022 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:57.022 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.105748+0000", 2024-04-19T02:16:57.022 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:57.023 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.023 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.023 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:57.023 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.105747+0000", 2024-04-19T02:16:57.023 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:57.023 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.023 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.023 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:57.023 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.105869+0000", 2024-04-19T02:16:57.023 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000121965 2024-04-19T02:16:57.023 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.023 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.023 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:57.023 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.105879+0000", 2024-04-19T02:16:57.023 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0049e-05 2024-04-19T02:16:57.024 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.024 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.024 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.024 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.105886+0000", 2024-04-19T02:16:57.024 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.0879999999999997e-06 2024-04-19T02:16:57.024 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.024 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.024 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:57.024 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.107778+0000", 2024-04-19T02:16:57.024 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0018912670000000001 2024-04-19T02:16:57.024 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.024 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.024 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:57.024 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.107885+0000", 2024-04-19T02:16:57.024 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000106982 2024-04-19T02:16:57.025 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.025 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.025 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:57.025 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.108016+0000", 2024-04-19T02:16:57.025 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000131581 2024-04-19T02:16:57.025 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.025 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.025 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:57.025 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.110857+0000", 2024-04-19T02:16:57.025 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.002840604 2024-04-19T02:16:57.025 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.025 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.025 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.025 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.118745+0000", 2024-04-19T02:16:57.025 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0078886970000000001 2024-04-19T02:16:57.025 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.026 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.026 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.026 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.127135+0000", 2024-04-19T02:16:57.026 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0083899939999999996 2024-04-19T02:16:57.026 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.026 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.026 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:57.026 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.127191+0000", 2024-04-19T02:16:57.026 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.5294000000000003e-05 2024-04-19T02:16:57.026 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.026 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.026 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:57.026 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.127299+0000", 2024-04-19T02:16:57.026 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000108439 2024-04-19T02:16:57.026 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:57.027 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:57.027 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:57.027 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.027 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.027 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:104186 5.1 5:8759ec67:::benchmark_data_smithi121_44835_object104185:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T02:16:57.027 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:40.086927+0000", 2024-04-19T02:16:57.027 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 16.873392188, 2024-04-19T02:16:57.027 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020306884000000001, 2024-04-19T02:16:57.027 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:57.027 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.027 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:57.027 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:57.027 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:57.027 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 104186 2024-04-19T02:16:57.027 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.028 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:57.028 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.028 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:57.028 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086927+0000", 2024-04-19T02:16:57.028 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:57.028 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.028 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.028 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:57.028 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086927+0000", 2024-04-19T02:16:57.028 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:57.028 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.028 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.028 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:57.028 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086926+0000", 2024-04-19T02:16:57.028 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:57.029 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.029 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.029 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:57.029 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086951+0000", 2024-04-19T02:16:57.029 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.5452e-05 2024-04-19T02:16:57.029 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.029 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.029 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:57.029 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086960+0000", 2024-04-19T02:16:57.029 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.1620000000000008e-06 2024-04-19T02:16:57.029 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.029 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.029 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.029 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086966+0000", 2024-04-19T02:16:57.029 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.0290000000000002e-06 2024-04-19T02:16:57.030 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.030 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.030 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:57.030 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.090593+0000", 2024-04-19T02:16:57.030 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0036272079999999998 2024-04-19T02:16:57.030 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.030 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.030 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:57.030 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.090699+0000", 2024-04-19T02:16:57.030 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000106001 2024-04-19T02:16:57.030 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.030 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.030 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:57.030 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.090842+0000", 2024-04-19T02:16:57.030 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00014270900000000001 2024-04-19T02:16:57.031 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.031 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.031 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:57.031 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.094673+0000", 2024-04-19T02:16:57.031 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0038316999999999999 2024-04-19T02:16:57.031 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.031 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.031 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.031 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.097494+0000", 2024-04-19T02:16:57.031 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0028205539999999999 2024-04-19T02:16:57.031 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.031 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.031 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.031 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.107075+0000", 2024-04-19T02:16:57.031 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0095813870000000002 2024-04-19T02:16:57.032 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.032 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.032 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:57.032 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.107127+0000", 2024-04-19T02:16:57.032 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.1498000000000001e-05 2024-04-19T02:16:57.032 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.032 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.032 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:57.032 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.107234+0000", 2024-04-19T02:16:57.032 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000107058 2024-04-19T02:16:57.032 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:57.032 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:57.032 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:57.032 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.032 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.032 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:104187 5.1 5:8636ab61:::benchmark_data_smithi121_44835_object104186:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T02:16:57.033 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:40.086972+0000", 2024-04-19T02:16:57.033 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 16.873346794, 2024-04-19T02:16:57.033 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020992607999999999, 2024-04-19T02:16:57.033 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:57.033 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.033 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:57.033 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:57.033 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:57.033 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 104187 2024-04-19T02:16:57.033 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.033 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:57.033 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.033 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:57.033 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086972+0000", 2024-04-19T02:16:57.033 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:57.034 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.034 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.034 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:57.034 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086972+0000", 2024-04-19T02:16:57.034 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:57.034 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.034 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.034 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:57.034 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086972+0000", 2024-04-19T02:16:57.034 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:57.034 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.034 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.034 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:57.034 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.087000+0000", 2024-04-19T02:16:57.034 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.8569e-05 2024-04-19T02:16:57.035 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.035 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.035 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:57.035 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.087007+0000", 2024-04-19T02:16:57.035 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.4280000000000001e-06 2024-04-19T02:16:57.035 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.035 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.035 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.035 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.087013+0000", 2024-04-19T02:16:57.035 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.3929999999999996e-06 2024-04-19T02:16:57.035 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.035 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.035 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:57.035 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.092659+0000", 2024-04-19T02:16:57.035 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0056460850000000003 2024-04-19T02:16:57.036 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.036 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.036 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:57.036 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.092780+0000", 2024-04-19T02:16:57.036 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012113200000000001 2024-04-19T02:16:57.036 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.036 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.036 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:57.036 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.092894+0000", 2024-04-19T02:16:57.036 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000113057 2024-04-19T02:16:57.036 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.036 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.036 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.036 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.097526+0000", 2024-04-19T02:16:57.036 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0046325940000000003 2024-04-19T02:16:57.037 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.037 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.037 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:57.037 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.097536+0000", 2024-04-19T02:16:57.037 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.4110000000000002e-06 2024-04-19T02:16:57.037 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.037 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.037 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.037 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.107809+0000", 2024-04-19T02:16:57.037 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.010273882999999999 2024-04-19T02:16:57.037 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.037 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.037 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:57.037 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.107864+0000", 2024-04-19T02:16:57.037 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.4792e-05 2024-04-19T02:16:57.038 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.038 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.038 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:57.038 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.107965+0000", 2024-04-19T02:16:57.038 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000100641 2024-04-19T02:16:57.038 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:57.038 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:57.038 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:57.038 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.038 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.038 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:113448 5.1 5:816781af:::benchmark_data_smithi121_44835_object113447:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T02:16:57.038 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:44.698272+0000", 2024-04-19T02:16:57.038 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 12.262046586, 2024-04-19T02:16:57.038 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.023047332, 2024-04-19T02:16:57.038 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:57.039 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.039 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:57.039 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:57.039 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:57.039 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 113448 2024-04-19T02:16:57.039 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.039 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:57.039 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.039 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:57.039 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.698272+0000", 2024-04-19T02:16:57.039 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:57.039 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.039 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.039 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:57.039 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.698272+0000", 2024-04-19T02:16:57.040 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:57.040 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.040 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.040 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:57.040 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.698272+0000", 2024-04-19T02:16:57.040 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:57.040 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.040 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.040 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:57.040 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.698307+0000", 2024-04-19T02:16:57.040 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.4712999999999998e-05 2024-04-19T02:16:57.040 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.040 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.040 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:57.040 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.698322+0000", 2024-04-19T02:16:57.041 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.5427999999999999e-05 2024-04-19T02:16:57.041 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.041 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.041 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.041 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.698328+0000", 2024-04-19T02:16:57.041 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.139e-06 2024-04-19T02:16:57.041 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.041 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.041 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:57.041 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.700548+0000", 2024-04-19T02:16:57.041 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.002219951 2024-04-19T02:16:57.041 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.041 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.041 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:57.042 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.700699+0000", 2024-04-19T02:16:57.042 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000151185 2024-04-19T02:16:57.042 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.042 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.042 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:57.042 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.700844+0000", 2024-04-19T02:16:57.042 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00014434800000000001 2024-04-19T02:16:57.042 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.042 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.042 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.042 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.705655+0000", 2024-04-19T02:16:57.042 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.004811503 2024-04-19T02:16:57.042 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.042 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.043 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.043 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.705933+0000", 2024-04-19T02:16:57.043 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00027823300000000002 2024-04-19T02:16:57.043 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.043 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.043 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:57.043 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.721130+0000", 2024-04-19T02:16:57.043 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015196708 2024-04-19T02:16:57.043 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.043 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.043 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:57.043 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.721197+0000", 2024-04-19T02:16:57.043 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.6928999999999996e-05 2024-04-19T02:16:57.043 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.043 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.044 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:57.044 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.721320+0000", 2024-04-19T02:16:57.044 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012277499999999999 2024-04-19T02:16:57.044 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:57.044 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:57.044 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:57.044 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.044 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.044 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:113660 5.1 5:80c3f0b7:::benchmark_data_smithi121_44835_object113659:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T02:16:57.044 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:44.810899+0000", 2024-04-19T02:16:57.044 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 12.149419968, 2024-04-19T02:16:57.044 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.023870918000000001, 2024-04-19T02:16:57.045 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:57.045 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.045 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:57.045 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:57.045 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:57.045 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 113660 2024-04-19T02:16:57.045 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.045 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:57.045 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.045 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:57.045 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.810899+0000", 2024-04-19T02:16:57.045 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:57.045 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.045 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.045 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:57.046 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.810899+0000", 2024-04-19T02:16:57.046 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:57.046 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.046 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.046 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:57.046 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.810898+0000", 2024-04-19T02:16:57.046 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:57.046 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.046 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.046 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:57.046 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.810972+0000", 2024-04-19T02:16:57.046 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.3306000000000006e-05 2024-04-19T02:16:57.046 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.046 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.046 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:57.047 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.810978+0000", 2024-04-19T02:16:57.047 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.319e-06 2024-04-19T02:16:57.047 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.047 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.047 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.047 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.810984+0000", 2024-04-19T02:16:57.047 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.1650000000000003e-06 2024-04-19T02:16:57.047 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.047 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.047 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:57.047 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.820088+0000", 2024-04-19T02:16:57.047 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0091040310000000003 2024-04-19T02:16:57.047 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.047 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.047 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:57.047 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.820245+0000", 2024-04-19T02:16:57.048 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000157155 2024-04-19T02:16:57.048 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.048 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.048 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:57.048 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.820444+0000", 2024-04-19T02:16:57.048 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00019840299999999999 2024-04-19T02:16:57.048 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.048 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.048 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.048 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.824507+0000", 2024-04-19T02:16:57.048 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0040632999999999997 2024-04-19T02:16:57.048 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.048 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.048 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:57.048 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.827337+0000", 2024-04-19T02:16:57.049 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0028301429999999998 2024-04-19T02:16:57.049 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.049 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.049 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.049 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.834600+0000", 2024-04-19T02:16:57.049 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.007263294 2024-04-19T02:16:57.049 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.049 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.049 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:57.049 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.834654+0000", 2024-04-19T02:16:57.049 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.3508999999999999e-05 2024-04-19T02:16:57.049 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.049 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.049 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:57.049 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.834770+0000", 2024-04-19T02:16:57.049 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000116075 2024-04-19T02:16:57.050 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:57.050 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:57.050 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:57.050 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.050 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.050 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:129052 5.1 5:81fcf9a6:::benchmark_data_smithi121_44835_object129051:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T02:16:57.050 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:52.546357+0000", 2024-04-19T02:16:57.050 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4.4139615729999999, 2024-04-19T02:16:57.050 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020114360000000001, 2024-04-19T02:16:57.050 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:57.050 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.050 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:57.050 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:57.050 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:57.050 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 129052 2024-04-19T02:16:57.050 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.051 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:57.051 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.051 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:57.051 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:52.546357+0000", 2024-04-19T02:16:57.051 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:57.051 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.051 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.051 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:57.051 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:52.546357+0000", 2024-04-19T02:16:57.051 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:57.051 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.051 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.051 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:57.051 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:52.546357+0000", 2024-04-19T02:16:57.052 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:57.052 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.052 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.052 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:57.052 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:52.546411+0000", 2024-04-19T02:16:57.052 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.4737000000000001e-05 2024-04-19T02:16:57.052 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.052 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.052 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:57.052 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:52.546427+0000", 2024-04-19T02:16:57.052 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.5722e-05 2024-04-19T02:16:57.052 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.052 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.052 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.053 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:52.546435+0000", 2024-04-19T02:16:57.053 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.8380000000000002e-06 2024-04-19T02:16:57.053 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.053 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.053 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:57.053 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:52.550064+0000", 2024-04-19T02:16:57.053 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0036286410000000002 2024-04-19T02:16:57.053 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.053 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.053 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:57.053 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:52.550188+0000", 2024-04-19T02:16:57.053 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012434999999999999 2024-04-19T02:16:57.053 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.053 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.053 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:57.054 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:52.550382+0000", 2024-04-19T02:16:57.054 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00019446200000000001 2024-04-19T02:16:57.054 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.054 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.054 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:57.054 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:52.553649+0000", 2024-04-19T02:16:57.054 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0032662699999999999 2024-04-19T02:16:57.054 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.054 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.054 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.054 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:52.556721+0000", 2024-04-19T02:16:57.054 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0030726740000000001 2024-04-19T02:16:57.054 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.054 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.054 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.055 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:52.566368+0000", 2024-04-19T02:16:57.055 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0096468999999999999 2024-04-19T02:16:57.055 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.055 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.055 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:57.055 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:52.566412+0000", 2024-04-19T02:16:57.055 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.3936000000000001e-05 2024-04-19T02:16:57.055 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.055 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.055 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:57.055 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:52.566472+0000", 2024-04-19T02:16:57.055 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.9608999999999998e-05 2024-04-19T02:16:57.055 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:57.055 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:57.055 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:57.056 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.056 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.056 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:130092 5.6 5:65fc2f1e:::benchmark_data_smithi121_44835_object130091:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T02:16:57.056 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:53.069891+0000", 2024-04-19T02:16:57.056 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 3.8904281759999999, 2024-04-19T02:16:57.056 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.023733942000000001, 2024-04-19T02:16:57.056 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:57.056 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.056 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:57.056 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:57.056 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:57.056 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 130092 2024-04-19T02:16:57.056 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.056 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:57.056 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.056 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:57.057 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.069891+0000", 2024-04-19T02:16:57.057 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:57.057 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.057 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.057 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:57.057 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.069891+0000", 2024-04-19T02:16:57.057 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:57.057 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.057 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.057 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:57.057 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.069890+0000", 2024-04-19T02:16:57.057 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:57.057 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.057 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.057 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:57.058 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.069910+0000", 2024-04-19T02:16:57.058 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.0378999999999999e-05 2024-04-19T02:16:57.058 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.058 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.058 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:57.058 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.069919+0000", 2024-04-19T02:16:57.058 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.6629999999999999e-06 2024-04-19T02:16:57.058 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.058 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.058 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.058 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.069926+0000", 2024-04-19T02:16:57.058 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.2509999999999997e-06 2024-04-19T02:16:57.058 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.058 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.059 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:57.059 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.069975+0000", 2024-04-19T02:16:57.059 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.8857999999999999e-05 2024-04-19T02:16:57.059 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.059 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.059 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:57.059 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.070131+0000", 2024-04-19T02:16:57.059 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00015667599999999999 2024-04-19T02:16:57.059 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.059 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.059 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:57.059 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.070290+0000", 2024-04-19T02:16:57.059 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00015898799999999999 2024-04-19T02:16:57.059 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.059 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.059 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.060 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.076926+0000", 2024-04-19T02:16:57.060 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0066357079999999997 2024-04-19T02:16:57.060 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.060 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.060 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:57.060 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.093570+0000", 2024-04-19T02:16:57.060 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016643425999999999 2024-04-19T02:16:57.060 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.060 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.060 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:57.060 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.093606+0000", 2024-04-19T02:16:57.060 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6520000000000003e-05 2024-04-19T02:16:57.060 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.060 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.060 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:57.061 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.093625+0000", 2024-04-19T02:16:57.061 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.8686999999999999e-05 2024-04-19T02:16:57.061 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:57.061 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:57.062 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:57.062 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.062 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.062 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:132350 5.1 5:887df61f:::benchmark_data_smithi121_44835_object132349:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T02:16:57.062 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:54.200508+0000", 2024-04-19T02:16:57.062 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 2.7598113949999998, 2024-04-19T02:16:57.062 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.021944229999999999, 2024-04-19T02:16:57.062 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:57.062 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.062 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:57.062 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:57.062 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:57.062 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 132350 2024-04-19T02:16:57.062 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.063 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:57.063 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.063 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:57.063 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:54.200508+0000", 2024-04-19T02:16:57.063 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:57.063 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.063 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.063 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:57.063 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:54.200508+0000", 2024-04-19T02:16:57.063 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:57.063 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.063 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.063 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:57.063 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:54.200507+0000", 2024-04-19T02:16:57.063 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:57.064 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.064 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.064 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:57.064 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:54.200649+0000", 2024-04-19T02:16:57.064 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00014184500000000001 2024-04-19T02:16:57.064 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.064 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.064 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:57.064 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:54.200656+0000", 2024-04-19T02:16:57.064 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.7190000000000004e-06 2024-04-19T02:16:57.064 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.064 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.064 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.064 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:54.200660+0000", 2024-04-19T02:16:57.064 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.7520000000000004e-06 2024-04-19T02:16:57.064 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.065 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.065 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:57.065 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:54.202388+0000", 2024-04-19T02:16:57.065 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.001727538 2024-04-19T02:16:57.065 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.065 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.065 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:57.065 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:54.202481+0000", 2024-04-19T02:16:57.065 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.2689999999999995e-05 2024-04-19T02:16:57.065 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.065 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.065 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:16:57.065 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:54.202585+0000", 2024-04-19T02:16:57.065 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000104447 2024-04-19T02:16:57.065 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.066 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.066 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.066 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:54.205182+0000", 2024-04-19T02:16:57.066 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0025966639999999998 2024-04-19T02:16:57.066 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.066 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.066 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.066 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:54.205211+0000", 2024-04-19T02:16:57.066 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.9037999999999999e-05 2024-04-19T02:16:57.066 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.066 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.066 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:16:57.066 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:54.222303+0000", 2024-04-19T02:16:57.066 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.017092594999999999 2024-04-19T02:16:57.067 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.067 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.067 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:16:57.067 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:54.222367+0000", 2024-04-19T02:16:57.067 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.3328000000000001e-05 2024-04-19T02:16:57.067 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:57.067 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:57.067 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:16:57.067 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:54.222452+0000", 2024-04-19T02:16:57.067 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.5286999999999998e-05 2024-04-19T02:16:57.067 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:57.067 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:57.067 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:57.067 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:57.067 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:57.067 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-04-19T02:16:57.069 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:16:57.070 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:57.069+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:57.169 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:57.170+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:57.233 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:16:57.233 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:16:57.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.233 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:136810 5.7 5:ebc8ef20:::benchmark_data_smithi121_44835_object2775:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-19T02:16:57.233 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:57.228476+0000", 2024-04-19T02:16:57.233 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0057050030000000002, 2024-04-19T02:16:57.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0057261730000000002, 2024-04-19T02:16:57.234 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:57.234 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:57.234 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:57.234 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:57.234 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:57.234 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136810 2024-04-19T02:16:57.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.234 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:57.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:57.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:57.228476+0000", 2024-04-19T02:16:57.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:57.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:57.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:57.228476+0000", 2024-04-19T02:16:57.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:57.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:57.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:57.228475+0000", 2024-04-19T02:16:57.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:57.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:57.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:57.228479+0000", 2024-04-19T02:16:57.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8809999999999998e-06 2024-04-19T02:16:57.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:57.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:57.228486+0000", 2024-04-19T02:16:57.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5089999999999996e-06 2024-04-19T02:16:57.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:57.228491+0000", 2024-04-19T02:16:57.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9910000000000002e-06 2024-04-19T02:16:57.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:57.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:57.228531+0000", 2024-04-19T02:16:57.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9530999999999998e-05 2024-04-19T02:16:57.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:57.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:57.228653+0000", 2024-04-19T02:16:57.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000121791 2024-04-19T02:16:57.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:57.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:57.228760+0000", 2024-04-19T02:16:57.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010707199999999999 2024-04-19T02:16:57.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:57.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:57.233236+0000", 2024-04-19T02:16:57.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0044766229999999999 2024-04-19T02:16:57.237 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:57.238 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:57.238 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:57.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.238 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:136813 5.7 5:e34e8fb6:::benchmark_data_smithi121_44835_object2778:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-19T02:16:57.238 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:57.228579+0000", 2024-04-19T02:16:57.238 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0056014400000000001, 2024-04-19T02:16:57.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0056784440000000004, 2024-04-19T02:16:57.238 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:57.238 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:57.238 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:57.238 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:57.238 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:57.239 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136813 2024-04-19T02:16:57.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.239 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:57.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:57.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:57.228579+0000", 2024-04-19T02:16:57.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:57.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:57.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:57.228579+0000", 2024-04-19T02:16:57.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:57.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:57.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:57.228578+0000", 2024-04-19T02:16:57.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:57.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:57.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:57.228587+0000", 2024-04-19T02:16:57.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2369999999999992e-06 2024-04-19T02:16:57.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:57.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:57.228597+0000", 2024-04-19T02:16:57.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0176e-05 2024-04-19T02:16:57.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:57.228605+0000", 2024-04-19T02:16:57.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8849999999999999e-06 2024-04-19T02:16:57.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:57.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:57.230903+0000", 2024-04-19T02:16:57.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002298034 2024-04-19T02:16:57.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:57.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:57.231029+0000", 2024-04-19T02:16:57.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012678599999999999 2024-04-19T02:16:57.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:57.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:57.231140+0000", 2024-04-19T02:16:57.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011008100000000001 2024-04-19T02:16:57.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:57.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:57.233300+0000", 2024-04-19T02:16:57.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021605109999999999 2024-04-19T02:16:57.242 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:57.242 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:57.242 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:57.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.242 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:136814 5.f 5:f5d557b6:::benchmark_data_smithi121_44835_object2779:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-19T02:16:57.242 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:57.228613+0000", 2024-04-19T02:16:57.242 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0055671089999999998, 2024-04-19T02:16:57.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0056913479999999997, 2024-04-19T02:16:57.243 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:57.243 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:57.243 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:57.243 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:57.243 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:57.243 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136814 2024-04-19T02:16:57.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.243 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:57.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:57.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:57.228613+0000", 2024-04-19T02:16:57.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:57.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:57.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:57.228613+0000", 2024-04-19T02:16:57.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:57.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:57.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:57.228613+0000", 2024-04-19T02:16:57.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:57.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:57.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:57.228616+0000", 2024-04-19T02:16:57.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7209999999999999e-06 2024-04-19T02:16:57.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:57.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:57.228624+0000", 2024-04-19T02:16:57.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8439999999999998e-06 2024-04-19T02:16:57.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:57.228629+0000", 2024-04-19T02:16:57.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6099999999999997e-06 2024-04-19T02:16:57.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:57.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:57.230885+0000", 2024-04-19T02:16:57.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022556799999999999 2024-04-19T02:16:57.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:57.246 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:57.231008+0000", 2024-04-19T02:16:57.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012352700000000001 2024-04-19T02:16:57.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:57.246 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:57.231106+0000", 2024-04-19T02:16:57.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7926999999999999e-05 2024-04-19T02:16:57.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:57.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:57.233304+0000", 2024-04-19T02:16:57.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021972509999999999 2024-04-19T02:16:57.247 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:57.247 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:57.247 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:57.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.247 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:136825 5.7 5:e4767d4d:::benchmark_data_smithi121_44835_object2790:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-19T02:16:57.247 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:57.233810+0000", 2024-04-19T02:16:57.247 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00037046399999999998, 2024-04-19T02:16:57.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00054140099999999995, 2024-04-19T02:16:57.247 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:57.247 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:57.247 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:57.248 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:57.248 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:57.248 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136825 2024-04-19T02:16:57.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.248 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:57.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:57.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:57.233810+0000", 2024-04-19T02:16:57.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:57.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:57.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:57.233810+0000", 2024-04-19T02:16:57.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:57.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:57.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:57.233809+0000", 2024-04-19T02:16:57.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:57.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:57.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:57.233814+0000", 2024-04-19T02:16:57.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7990000000000001e-06 2024-04-19T02:16:57.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:57.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:57.233822+0000", 2024-04-19T02:16:57.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9489999999999996e-06 2024-04-19T02:16:57.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:57.233828+0000", 2024-04-19T02:16:57.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5679999999999999e-06 2024-04-19T02:16:57.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:57.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:57.233855+0000", 2024-04-19T02:16:57.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7444e-05 2024-04-19T02:16:57.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:57.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:57.233932+0000", 2024-04-19T02:16:57.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7217000000000003e-05 2024-04-19T02:16:57.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:57.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:57.233999+0000", 2024-04-19T02:16:57.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6333000000000003e-05 2024-04-19T02:16:57.251 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:57.252 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:57.252 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:57.252 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:57.252 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-04-19T02:16:57.252 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 4 2024-04-19T02:16:57.252 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:16:57.253 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:16:57.271 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:57.271+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:57.372 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:57.372+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:57.422 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:16:57.422 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-04-19T02:16:57.422 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-04-19T02:16:57.422 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-04-19T02:16:57.423 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:16:57.436 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:16:57.479 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:57.480+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:57.573 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:57.574+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:57.603 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:16:57.603 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-04-19T02:16:57.603 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-04-19T02:16:57.603 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:16:57.604 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.604 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:57.604 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:16:57.604 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 88.332224925000006, 2024-04-19T02:16:57.604 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020307345000000001, 2024-04-19T02:16:57.604 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:57.604 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.604 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:57.604 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.604 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:57.604 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:16:57.604 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:57.604 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.604 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.604 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:57.605 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:16:57.605 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:57.605 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.605 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.605 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:57.605 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269791+0000", 2024-04-19T02:16:57.605 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:57.605 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.605 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.605 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:57.605 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269795+0000", 2024-04-19T02:16:57.605 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5619999999999999e-06 2024-04-19T02:16:57.605 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.605 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.605 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:57.606 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269802+0000", 2024-04-19T02:16:57.606 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8469999999999998e-06 2024-04-19T02:16:57.606 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.606 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.606 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.606 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269807+0000", 2024-04-19T02:16:57.606 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.707e-06 2024-04-19T02:16:57.606 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.606 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.606 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:57.606 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269950+0000", 2024-04-19T02:16:57.606 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000143313 2024-04-19T02:16:57.606 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.606 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.607 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:57.607 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269955+0000", 2024-04-19T02:16:57.607 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4029999999999998e-06 2024-04-19T02:16:57.607 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.607 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.607 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:57.607 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.283806+0000", 2024-04-19T02:16:57.607 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013850220999999999 2024-04-19T02:16:57.607 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.607 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.607 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:57.607 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.283896+0000", 2024-04-19T02:16:57.607 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0261999999999997e-05 2024-04-19T02:16:57.607 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.607 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.608 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:57.608 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284022+0000", 2024-04-19T02:16:57.608 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012641200000000001 2024-04-19T02:16:57.608 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.608 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.608 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.608 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289066+0000", 2024-04-19T02:16:57.608 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050438490000000004 2024-04-19T02:16:57.608 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.608 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.608 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:57.608 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290011+0000", 2024-04-19T02:16:57.608 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00094490700000000004 2024-04-19T02:16:57.608 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.608 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.609 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:57.609 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290054+0000", 2024-04-19T02:16:57.609 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.337e-05 2024-04-19T02:16:57.609 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.609 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.609 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:57.609 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290099+0000", 2024-04-19T02:16:57.609 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4987999999999997e-05 2024-04-19T02:16:57.609 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:57.609 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:57.609 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:57.609 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.609 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.609 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:57.609 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:16:57.610 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 88.332146995000002, 2024-04-19T02:16:57.610 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020331023, 2024-04-19T02:16:57.610 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:57.610 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.610 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:57.610 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.610 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:57.610 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:16:57.610 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:57.610 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.610 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.610 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:57.610 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:16:57.610 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:57.610 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.611 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.611 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:57.611 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269869+0000", 2024-04-19T02:16:57.611 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:57.611 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.611 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.611 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:57.611 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269873+0000", 2024-04-19T02:16:57.611 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0219999999999998e-06 2024-04-19T02:16:57.611 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.611 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.611 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:57.611 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269881+0000", 2024-04-19T02:16:57.611 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.79e-06 2024-04-19T02:16:57.612 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.612 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.612 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.612 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269887+0000", 2024-04-19T02:16:57.612 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7899999999999996e-06 2024-04-19T02:16:57.612 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.612 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.612 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:57.612 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269983+0000", 2024-04-19T02:16:57.612 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6057000000000005e-05 2024-04-19T02:16:57.612 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.612 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.612 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:57.612 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269986+0000", 2024-04-19T02:16:57.613 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9220000000000001e-06 2024-04-19T02:16:57.613 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.613 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.613 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:57.613 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284350+0000", 2024-04-19T02:16:57.613 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014364335000000001 2024-04-19T02:16:57.613 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.613 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.613 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:57.613 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284664+0000", 2024-04-19T02:16:57.613 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000313646 2024-04-19T02:16:57.613 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.613 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.613 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:57.613 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284794+0000", 2024-04-19T02:16:57.613 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129839 2024-04-19T02:16:57.614 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.614 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.614 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.614 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289107+0000", 2024-04-19T02:16:57.614 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0043127060000000004 2024-04-19T02:16:57.614 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.614 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.614 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:57.614 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290108+0000", 2024-04-19T02:16:57.614 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0010010590000000001 2024-04-19T02:16:57.614 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.614 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.615 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:57.615 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290144+0000", 2024-04-19T02:16:57.615 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6709999999999999e-05 2024-04-19T02:16:57.615 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.615 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.615 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:57.615 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290201+0000", 2024-04-19T02:16:57.615 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6654999999999999e-05 2024-04-19T02:16:57.615 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:57.615 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:57.615 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:57.615 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.615 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.615 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:57.615 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:16:57.616 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 88.332104654000005, 2024-04-19T02:16:57.616 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020507241999999998, 2024-04-19T02:16:57.616 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:57.616 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.616 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:57.616 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.616 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:57.616 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:16:57.616 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:57.616 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.616 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.616 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:57.616 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:16:57.617 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:57.617 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.617 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.617 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:57.617 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:16:57.617 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:57.617 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.617 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.617 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:57.617 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269915+0000", 2024-04-19T02:16:57.617 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.472e-06 2024-04-19T02:16:57.617 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.617 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.617 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:57.617 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269928+0000", 2024-04-19T02:16:57.617 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2979000000000001e-05 2024-04-19T02:16:57.618 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.618 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.618 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.618 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269935+0000", 2024-04-19T02:16:57.618 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8859999999999998e-06 2024-04-19T02:16:57.618 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.618 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.618 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:57.618 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270009+0000", 2024-04-19T02:16:57.618 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3429000000000005e-05 2024-04-19T02:16:57.618 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.618 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.618 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:57.618 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270013+0000", 2024-04-19T02:16:57.619 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2590000000000002e-06 2024-04-19T02:16:57.619 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.619 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.619 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:57.619 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285375+0000", 2024-04-19T02:16:57.619 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015362275999999999 2024-04-19T02:16:57.619 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.619 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.619 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:57.619 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285451+0000", 2024-04-19T02:16:57.619 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5338000000000003e-05 2024-04-19T02:16:57.619 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.619 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.619 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:57.620 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285562+0000", 2024-04-19T02:16:57.620 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000111285 2024-04-19T02:16:57.620 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.620 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.620 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.620 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289134+0000", 2024-04-19T02:16:57.620 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035719670000000001 2024-04-19T02:16:57.620 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.620 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.620 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:57.620 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290341+0000", 2024-04-19T02:16:57.620 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012074500000000001 2024-04-19T02:16:57.620 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.620 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.621 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:57.621 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290383+0000", 2024-04-19T02:16:57.621 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1386e-05 2024-04-19T02:16:57.621 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.621 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.621 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:57.621 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290419+0000", 2024-04-19T02:16:57.621 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6884000000000001e-05 2024-04-19T02:16:57.621 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:57.621 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:57.621 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:57.621 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.621 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.621 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:57.622 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269945+0000", 2024-04-19T02:16:57.622 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 88.332072072000003, 2024-04-19T02:16:57.622 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019709098000000001, 2024-04-19T02:16:57.622 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:57.622 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.622 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:57.622 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.622 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:57.622 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269945+0000", 2024-04-19T02:16:57.622 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:57.622 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.622 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.622 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:57.622 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269945+0000", 2024-04-19T02:16:57.623 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:57.623 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.623 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.623 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:57.623 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269944+0000", 2024-04-19T02:16:57.623 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:57.623 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.623 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.623 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:57.623 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269965+0000", 2024-04-19T02:16:57.623 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0803999999999999e-05 2024-04-19T02:16:57.623 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.623 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.623 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:57.623 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269973+0000", 2024-04-19T02:16:57.624 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3560000000000004e-06 2024-04-19T02:16:57.624 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.624 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.624 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.624 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269982+0000", 2024-04-19T02:16:57.624 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9600000000000006e-06 2024-04-19T02:16:57.624 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.624 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.624 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:57.624 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270014+0000", 2024-04-19T02:16:57.624 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2913000000000001e-05 2024-04-19T02:16:57.624 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.624 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.624 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:57.624 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270018+0000", 2024-04-19T02:16:57.625 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2200000000000001e-06 2024-04-19T02:16:57.625 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.625 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.625 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:57.625 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278999+0000", 2024-04-19T02:16:57.625 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0089818009999999993 2024-04-19T02:16:57.625 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.625 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.625 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:57.625 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.279088+0000", 2024-04-19T02:16:57.625 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8988999999999998e-05 2024-04-19T02:16:57.625 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.625 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.625 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:57.625 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.280160+0000", 2024-04-19T02:16:57.626 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001071572 2024-04-19T02:16:57.626 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.626 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.626 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.626 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288342+0000", 2024-04-19T02:16:57.626 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.008182468 2024-04-19T02:16:57.626 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.626 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.626 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:57.626 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289545+0000", 2024-04-19T02:16:57.626 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012026739999999999 2024-04-19T02:16:57.626 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.626 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.626 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:57.626 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289608+0000", 2024-04-19T02:16:57.627 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2904999999999995e-05 2024-04-19T02:16:57.627 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.627 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.627 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:57.627 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289654+0000", 2024-04-19T02:16:57.627 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5850000000000003e-05 2024-04-19T02:16:57.627 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:57.627 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:57.627 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:57.627 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.627 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.627 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:57.627 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:16:57.627 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 88.332026393999996, 2024-04-19T02:16:57.627 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022007204999999998, 2024-04-19T02:16:57.628 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:57.628 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.628 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:57.628 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.628 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:57.628 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:16:57.628 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:57.628 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.628 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.628 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:57.628 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:16:57.628 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:57.628 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.628 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.628 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:57.629 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269990+0000", 2024-04-19T02:16:57.629 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:57.629 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.629 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.629 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:57.629 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269999+0000", 2024-04-19T02:16:57.629 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9539999999999993e-06 2024-04-19T02:16:57.629 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.629 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.629 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:57.629 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270006+0000", 2024-04-19T02:16:57.629 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.216e-06 2024-04-19T02:16:57.629 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.629 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.629 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.630 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270012+0000", 2024-04-19T02:16:57.630 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5049999999999998e-06 2024-04-19T02:16:57.630 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.630 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.630 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:57.630 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270058+0000", 2024-04-19T02:16:57.630 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.634e-05 2024-04-19T02:16:57.630 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.630 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.630 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:57.630 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270064+0000", 2024-04-19T02:16:57.630 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0669999999999997e-06 2024-04-19T02:16:57.630 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.630 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.631 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:57.631 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287159+0000", 2024-04-19T02:16:57.631 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017095086999999998 2024-04-19T02:16:57.631 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.631 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.631 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:57.631 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287254+0000", 2024-04-19T02:16:57.631 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4716000000000006e-05 2024-04-19T02:16:57.631 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.631 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.631 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:57.631 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287389+0000", 2024-04-19T02:16:57.631 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013511900000000001 2024-04-19T02:16:57.631 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.631 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.632 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:57.632 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290481+0000", 2024-04-19T02:16:57.632 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030920169999999999 2024-04-19T02:16:57.632 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.632 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.632 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.632 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291931+0000", 2024-04-19T02:16:57.632 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001450118 2024-04-19T02:16:57.632 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.632 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.632 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:57.632 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291960+0000", 2024-04-19T02:16:57.632 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9096000000000001e-05 2024-04-19T02:16:57.632 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.632 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.632 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:57.633 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291998+0000", 2024-04-19T02:16:57.633 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7514e-05 2024-04-19T02:16:57.633 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:57.633 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:57.633 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:57.633 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.633 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.633 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:57.633 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:57.633 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 88.331965823000004, 2024-04-19T02:16:57.633 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020759494999999999, 2024-04-19T02:16:57.633 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:57.633 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.633 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:57.633 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.634 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:57.634 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:57.634 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:57.634 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.634 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.634 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:57.634 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:57.634 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:57.634 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.634 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.634 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:57.634 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:57.634 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:57.634 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.634 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.635 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:57.635 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270054+0000", 2024-04-19T02:16:57.635 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.27e-06 2024-04-19T02:16:57.635 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.635 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.635 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:57.635 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270061+0000", 2024-04-19T02:16:57.635 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1289999999999998e-06 2024-04-19T02:16:57.635 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.635 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.635 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.635 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270067+0000", 2024-04-19T02:16:57.635 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.207e-06 2024-04-19T02:16:57.635 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.636 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.636 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:57.636 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270105+0000", 2024-04-19T02:16:57.636 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7549999999999998e-05 2024-04-19T02:16:57.636 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.636 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.636 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:57.636 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270112+0000", 2024-04-19T02:16:57.636 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3200000000000002e-06 2024-04-19T02:16:57.636 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.636 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.636 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:57.636 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282454+0000", 2024-04-19T02:16:57.636 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012341569 2024-04-19T02:16:57.636 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.637 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.637 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:57.637 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282740+0000", 2024-04-19T02:16:57.637 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000286481 2024-04-19T02:16:57.637 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.637 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.637 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:57.637 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282879+0000", 2024-04-19T02:16:57.637 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013887799999999999 2024-04-19T02:16:57.637 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.637 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.637 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:57.637 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290325+0000", 2024-04-19T02:16:57.637 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074459779999999998 2024-04-19T02:16:57.637 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.638 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.638 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.638 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290759+0000", 2024-04-19T02:16:57.638 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000433688 2024-04-19T02:16:57.638 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.638 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.638 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:57.638 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290789+0000", 2024-04-19T02:16:57.638 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9960000000000001e-05 2024-04-19T02:16:57.638 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.638 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.638 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:57.638 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290811+0000", 2024-04-19T02:16:57.638 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1965999999999999e-05 2024-04-19T02:16:57.638 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:57.639 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:57.639 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:57.639 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.639 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.639 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:57.639 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:16:57.639 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 88.331915617999996, 2024-04-19T02:16:57.639 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020837887999999999, 2024-04-19T02:16:57.639 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:57.639 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.639 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:57.639 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.639 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:57.639 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:16:57.639 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:57.640 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.640 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.640 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:57.640 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:16:57.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:57.640 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.640 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.640 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:57.640 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:16:57.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:57.640 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.640 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.640 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:57.640 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270109+0000", 2024-04-19T02:16:57.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3110000000000006e-06 2024-04-19T02:16:57.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:57.641 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270117+0000", 2024-04-19T02:16:57.641 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0479999999999999e-06 2024-04-19T02:16:57.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.641 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270123+0000", 2024-04-19T02:16:57.641 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5500000000000002e-06 2024-04-19T02:16:57.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:57.641 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270150+0000", 2024-04-19T02:16:57.641 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7712000000000002e-05 2024-04-19T02:16:57.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.642 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:57.642 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270153+0000", 2024-04-19T02:16:57.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6089999999999999e-06 2024-04-19T02:16:57.642 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.642 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:57.642 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285958+0000", 2024-04-19T02:16:57.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015805274000000001 2024-04-19T02:16:57.642 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.642 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:57.642 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286126+0000", 2024-04-19T02:16:57.643 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016765700000000001 2024-04-19T02:16:57.643 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.643 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.643 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:57.643 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286296+0000", 2024-04-19T02:16:57.643 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017007 2024-04-19T02:16:57.643 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.643 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.643 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:57.643 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290426+0000", 2024-04-19T02:16:57.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041299839999999997 2024-04-19T02:16:57.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.644 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.644 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290867+0000", 2024-04-19T02:16:57.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00044083300000000001 2024-04-19T02:16:57.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.644 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:57.644 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290900+0000", 2024-04-19T02:16:57.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3380000000000002e-05 2024-04-19T02:16:57.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.644 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:57.644 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290939+0000", 2024-04-19T02:16:57.645 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8970000000000001e-05 2024-04-19T02:16:57.645 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:57.645 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:57.645 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:57.645 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.645 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.645 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:21 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:57.645 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:16:57.645 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 88.331826946000007, 2024-04-19T02:16:57.645 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020833187999999999, 2024-04-19T02:16:57.645 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:57.645 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:16:57.645 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:57.645 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.645 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:57.646 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:16:57.646 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:57.646 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.646 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:57.646 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:16:57.646 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:57.646 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.646 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:57.646 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270189+0000", 2024-04-19T02:16:57.646 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:57.646 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.647 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.647 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:57.647 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270192+0000", 2024-04-19T02:16:57.647 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7549999999999999e-06 2024-04-19T02:16:57.647 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.647 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.647 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:57.647 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270198+0000", 2024-04-19T02:16:57.647 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0859999999999998e-06 2024-04-19T02:16:57.647 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.647 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.647 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.647 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270204+0000", 2024-04-19T02:16:57.647 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1970000000000004e-06 2024-04-19T02:16:57.647 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.648 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.648 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:57.648 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270238+0000", 2024-04-19T02:16:57.648 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4282000000000001e-05 2024-04-19T02:16:57.648 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.648 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.648 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:57.648 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270240+0000", 2024-04-19T02:16:57.648 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3099999999999999e-06 2024-04-19T02:16:57.648 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.648 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.648 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:57.648 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287131+0000", 2024-04-19T02:16:57.648 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01689104 2024-04-19T02:16:57.648 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.649 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.649 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:57.649 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287262+0000", 2024-04-19T02:16:57.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130347 2024-04-19T02:16:57.649 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.649 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.649 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:57.649 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291023+0000", 2024-04-19T02:16:57.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037616350000000002 2024-04-19T02:16:57.649 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:57.649 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:57.649 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:57.649 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.649 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.649 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:16519 5.f 5:fc30d3a1:::benchmark_data_smithi121_44835_object16518:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:57.650 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.880723+0000", 2024-04-19T02:16:57.650 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 57.721294168, 2024-04-19T02:16:57.650 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020492519000000001, 2024-04-19T02:16:57.650 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:57.650 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.650 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:57.650 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:57.650 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:57.650 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16519 2024-04-19T02:16:57.650 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.650 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:57.650 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.650 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:57.650 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880723+0000", 2024-04-19T02:16:57.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:57.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:57.651 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880723+0000", 2024-04-19T02:16:57.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:57.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:57.651 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880722+0000", 2024-04-19T02:16:57.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:57.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:57.651 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880794+0000", 2024-04-19T02:16:57.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1515999999999998e-05 2024-04-19T02:16:57.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:57.652 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880805+0000", 2024-04-19T02:16:57.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1353e-05 2024-04-19T02:16:57.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.652 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880812+0000", 2024-04-19T02:16:57.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1230000000000002e-06 2024-04-19T02:16:57.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:57.652 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.890954+0000", 2024-04-19T02:16:57.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010142253 2024-04-19T02:16:57.653 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.653 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:57.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891079+0000", 2024-04-19T02:16:57.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000124917 2024-04-19T02:16:57.653 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.653 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:57.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891218+0000", 2024-04-19T02:16:57.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000138715 2024-04-19T02:16:57.653 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.653 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.897321+0000", 2024-04-19T02:16:57.654 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0061026830000000002 2024-04-19T02:16:57.654 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.654 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.654 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:57.654 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901137+0000", 2024-04-19T02:16:57.654 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038161699999999998 2024-04-19T02:16:57.654 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.654 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.654 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:57.654 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901181+0000", 2024-04-19T02:16:57.654 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4362e-05 2024-04-19T02:16:57.654 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.654 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.654 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:57.654 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901215+0000", 2024-04-19T02:16:57.655 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3929e-05 2024-04-19T02:16:57.655 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:57.655 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:57.655 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:57.655 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.655 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.655 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:16520 5.f 5:f0474691:::benchmark_data_smithi121_44835_object16519:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:16:57.655 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.880833+0000", 2024-04-19T02:16:57.655 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 57.721184153000003, 2024-04-19T02:16:57.655 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020460160000000002, 2024-04-19T02:16:57.655 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:57.655 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.655 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:57.655 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:57.656 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:57.656 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16520 2024-04-19T02:16:57.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.656 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:57.656 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.656 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:57.656 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880833+0000", 2024-04-19T02:16:57.656 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:57.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.656 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.656 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:57.656 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880833+0000", 2024-04-19T02:16:57.656 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:57.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.657 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.657 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:57.657 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880832+0000", 2024-04-19T02:16:57.657 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:57.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.657 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.657 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:57.657 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880909+0000", 2024-04-19T02:16:57.657 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7095000000000006e-05 2024-04-19T02:16:57.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.657 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.657 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:57.657 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880919+0000", 2024-04-19T02:16:57.657 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8919999999999995e-06 2024-04-19T02:16:57.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.658 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.658 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.658 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880927+0000", 2024-04-19T02:16:57.658 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8809999999999996e-06 2024-04-19T02:16:57.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.658 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.658 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:57.658 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891901+0000", 2024-04-19T02:16:57.658 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010974263999999999 2024-04-19T02:16:57.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.658 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.658 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:57.658 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.892021+0000", 2024-04-19T02:16:57.659 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120074 2024-04-19T02:16:57.659 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.659 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.659 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:57.659 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.892165+0000", 2024-04-19T02:16:57.659 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014328600000000001 2024-04-19T02:16:57.659 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.659 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.659 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.659 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.897347+0000", 2024-04-19T02:16:57.659 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.005182603 2024-04-19T02:16:57.659 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.659 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.659 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:57.660 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901224+0000", 2024-04-19T02:16:57.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038767620000000002 2024-04-19T02:16:57.660 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.660 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:57.660 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901264+0000", 2024-04-19T02:16:57.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9579000000000002e-05 2024-04-19T02:16:57.660 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.660 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:57.660 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901293+0000", 2024-04-19T02:16:57.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9300999999999999e-05 2024-04-19T02:16:57.660 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:57.660 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:57.660 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:57.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.661 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.661 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:44167 5.7 5:ef4300c4:::benchmark_data_smithi121_44835_object44166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:16:57.661 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:09.853830+0000", 2024-04-19T02:16:57.661 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.748186668999999, 2024-04-19T02:16:57.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020082104, 2024-04-19T02:16:57.661 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:57.661 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.661 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:57.661 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:57.661 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:57.661 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 44167 2024-04-19T02:16:57.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.661 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:57.661 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.661 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:57.662 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853830+0000", 2024-04-19T02:16:57.662 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:57.662 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.662 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.662 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:57.662 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853830+0000", 2024-04-19T02:16:57.662 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:57.662 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.662 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.662 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:57.662 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853829+0000", 2024-04-19T02:16:57.662 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:57.662 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.662 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.662 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:57.663 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853863+0000", 2024-04-19T02:16:57.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3151999999999997e-05 2024-04-19T02:16:57.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:57.663 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853873+0000", 2024-04-19T02:16:57.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0366e-05 2024-04-19T02:16:57.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.663 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853881+0000", 2024-04-19T02:16:57.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6539999999999999e-06 2024-04-19T02:16:57.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:57.664 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.859162+0000", 2024-04-19T02:16:57.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052810740000000002 2024-04-19T02:16:57.664 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.664 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.664 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:57.664 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.859303+0000", 2024-04-19T02:16:57.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000140975 2024-04-19T02:16:57.664 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.664 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.664 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:57.664 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.859460+0000", 2024-04-19T02:16:57.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015754199999999999 2024-04-19T02:16:57.664 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.664 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.664 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.665 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.865142+0000", 2024-04-19T02:16:57.665 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0056819130000000002 2024-04-19T02:16:57.665 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.665 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.665 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:57.665 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.873828+0000", 2024-04-19T02:16:57.665 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0086861799999999999 2024-04-19T02:16:57.665 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.665 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.665 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:57.665 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.873871+0000", 2024-04-19T02:16:57.665 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2624999999999999e-05 2024-04-19T02:16:57.665 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.665 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.665 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:57.666 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.873912+0000", 2024-04-19T02:16:57.666 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1486000000000002e-05 2024-04-19T02:16:57.666 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:57.666 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:57.666 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:57.666 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.666 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.666 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:53042 5.f 5:f744ac14:::benchmark_data_smithi121_44835_object53041:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T02:16:57.666 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:13.560196+0000", 2024-04-19T02:16:57.666 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 44.041820850000001, 2024-04-19T02:16:57.666 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020122021, 2024-04-19T02:16:57.666 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:57.667 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.667 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:57.667 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:57.667 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:57.667 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 53042 2024-04-19T02:16:57.667 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.667 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:57.667 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.667 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:57.667 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560196+0000", 2024-04-19T02:16:57.667 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:57.667 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.667 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.667 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:57.667 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560196+0000", 2024-04-19T02:16:57.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:57.668 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:57.668 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560195+0000", 2024-04-19T02:16:57.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:57.668 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:57.668 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560255+0000", 2024-04-19T02:16:57.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9441000000000002e-05 2024-04-19T02:16:57.668 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:57.669 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560264+0000", 2024-04-19T02:16:57.669 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1130000000000007e-06 2024-04-19T02:16:57.669 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.669 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.669 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.669 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560271+0000", 2024-04-19T02:16:57.669 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9800000000000001e-06 2024-04-19T02:16:57.669 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.669 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.669 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:57.669 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560312+0000", 2024-04-19T02:16:57.669 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0828999999999998e-05 2024-04-19T02:16:57.669 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.669 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.670 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:57.670 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560456+0000", 2024-04-19T02:16:57.670 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014474799999999999 2024-04-19T02:16:57.670 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.670 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.670 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:57.670 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560591+0000", 2024-04-19T02:16:57.670 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013482699999999999 2024-04-19T02:16:57.670 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.670 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.670 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.670 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.564799+0000", 2024-04-19T02:16:57.670 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042080080000000001 2024-04-19T02:16:57.670 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.671 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:57.671 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580233+0000", 2024-04-19T02:16:57.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015433715000000001 2024-04-19T02:16:57.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.671 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:57.671 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580280+0000", 2024-04-19T02:16:57.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6465000000000003e-05 2024-04-19T02:16:57.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.671 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:57.671 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580318+0000", 2024-04-19T02:16:57.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8557999999999999e-05 2024-04-19T02:16:57.671 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:57.672 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:57.672 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:57.672 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.672 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.672 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:85866 5.2 5:48b1d46d:::benchmark_data_smithi121_44835_object85865:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T02:16:57.672 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:30.771909+0000", 2024-04-19T02:16:57.672 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.830107578, 2024-04-19T02:16:57.672 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020516216, 2024-04-19T02:16:57.672 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:57.672 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.672 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:57.672 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:57.672 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:57.672 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 85866 2024-04-19T02:16:57.672 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.673 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:57.673 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.673 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:57.673 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771909+0000", 2024-04-19T02:16:57.673 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:57.673 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.673 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.673 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:57.673 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771909+0000", 2024-04-19T02:16:57.673 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:57.673 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.673 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.673 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:57.673 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771909+0000", 2024-04-19T02:16:57.673 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:57.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.674 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.674 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:57.674 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771952+0000", 2024-04-19T02:16:57.674 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2660000000000002e-05 2024-04-19T02:16:57.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.674 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.674 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:57.674 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771959+0000", 2024-04-19T02:16:57.674 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7670000000000003e-06 2024-04-19T02:16:57.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.674 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.674 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.674 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771966+0000", 2024-04-19T02:16:57.674 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.905e-06 2024-04-19T02:16:57.675 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.675 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.675 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:57.675 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771999+0000", 2024-04-19T02:16:57.675 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2360999999999997e-05 2024-04-19T02:16:57.675 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.675 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.675 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:57.675 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.772133+0000", 2024-04-19T02:16:57.675 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013398699999999999 2024-04-19T02:16:57.675 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.675 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.675 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:57.675 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.772280+0000", 2024-04-19T02:16:57.675 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000147198 2024-04-19T02:16:57.676 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.676 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.676 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:57.676 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.774312+0000", 2024-04-19T02:16:57.676 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020325339999999999 2024-04-19T02:16:57.676 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.676 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.676 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.676 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.792370+0000", 2024-04-19T02:16:57.676 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018057321000000001 2024-04-19T02:16:57.676 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.676 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.676 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:57.676 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.792403+0000", 2024-04-19T02:16:57.676 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3247000000000002e-05 2024-04-19T02:16:57.676 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.677 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.677 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:57.677 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.792426+0000", 2024-04-19T02:16:57.677 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2697999999999999e-05 2024-04-19T02:16:57.677 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:57.677 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:57.677 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:57.677 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.677 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.677 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:94468 5.2 5:4f406431:::benchmark_data_smithi121_44835_object94467:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T02:16:57.677 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:16:57.677 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.490587764000001, 2024-04-19T02:16:57.677 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024835144999999999, 2024-04-19T02:16:57.677 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:57.678 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.678 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:57.678 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:57.678 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:57.678 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 94468 2024-04-19T02:16:57.678 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.678 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:57.678 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.678 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:57.678 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:16:57.678 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:57.678 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.678 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.678 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:57.678 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:16:57.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:57.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.679 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.679 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:57.679 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:16:57.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:57.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.679 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.679 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:57.679 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111498+0000", 2024-04-19T02:16:57.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9529000000000005e-05 2024-04-19T02:16:57.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.679 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.679 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:57.679 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111506+0000", 2024-04-19T02:16:57.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9030000000000004e-06 2024-04-19T02:16:57.680 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.680 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.680 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111513+0000", 2024-04-19T02:16:57.680 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8759999999999999e-06 2024-04-19T02:16:57.680 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.680 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:57.680 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112466+0000", 2024-04-19T02:16:57.680 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00095318499999999995 2024-04-19T02:16:57.680 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.680 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:57.680 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112590+0000", 2024-04-19T02:16:57.681 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012380900000000001 2024-04-19T02:16:57.681 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.681 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.681 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:57.681 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112728+0000", 2024-04-19T02:16:57.681 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013753800000000001 2024-04-19T02:16:57.681 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.681 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.681 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:57.681 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115064+0000", 2024-04-19T02:16:57.681 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002336819 2024-04-19T02:16:57.681 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.681 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.681 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.682 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136207+0000", 2024-04-19T02:16:57.682 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021142942000000001 2024-04-19T02:16:57.682 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.682 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.682 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:57.682 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136241+0000", 2024-04-19T02:16:57.682 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3577000000000001e-05 2024-04-19T02:16:57.682 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.682 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.682 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:57.682 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136264+0000", 2024-04-19T02:16:57.682 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3421000000000002e-05 2024-04-19T02:16:57.682 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:57.682 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:57.683 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:57.683 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.683 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.683 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:94472 5.2 5:45b7e9be:::benchmark_data_smithi121_44835_object94471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:57.683 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:16:57.683 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.486941233, 2024-04-19T02:16:57.683 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021273843000000001, 2024-04-19T02:16:57.683 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:57.683 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.683 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:57.683 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:57.683 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:57.683 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 94472 2024-04-19T02:16:57.683 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.683 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:57.683 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.684 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:57.684 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:16:57.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:57.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.684 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:57.684 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:16:57.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:57.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.684 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:57.684 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115075+0000", 2024-04-19T02:16:57.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:57.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:57.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115161+0000", 2024-04-19T02:16:57.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6632000000000007e-05 2024-04-19T02:16:57.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:57.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115171+0000", 2024-04-19T02:16:57.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2969999999999992e-06 2024-04-19T02:16:57.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115178+0000", 2024-04-19T02:16:57.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7610000000000007e-06 2024-04-19T02:16:57.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:57.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115213+0000", 2024-04-19T02:16:57.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5000999999999999e-05 2024-04-19T02:16:57.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:57.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115303+0000", 2024-04-19T02:16:57.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9791999999999997e-05 2024-04-19T02:16:57.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:57.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115391+0000", 2024-04-19T02:16:57.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7559000000000007e-05 2024-04-19T02:16:57.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.687 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.687 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:57.687 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.117894+0000", 2024-04-19T02:16:57.687 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002503496 2024-04-19T02:16:57.687 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.687 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.687 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.687 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136297+0000", 2024-04-19T02:16:57.687 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018402335999999998 2024-04-19T02:16:57.687 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.687 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.687 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:57.687 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136327+0000", 2024-04-19T02:16:57.687 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0534999999999998e-05 2024-04-19T02:16:57.688 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.688 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.688 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:57.688 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136350+0000", 2024-04-19T02:16:57.688 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2427999999999999e-05 2024-04-19T02:16:57.688 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:57.688 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:57.688 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:57.688 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.688 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.688 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:96668 5.f 5:f48d3288:::benchmark_data_smithi121_44835_object96667:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-19T02:16:57.688 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:36.254669+0000", 2024-04-19T02:16:57.688 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.347348113999999, 2024-04-19T02:16:57.688 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019875075999999998, 2024-04-19T02:16:57.689 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:57.689 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.689 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:57.689 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:57.689 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:57.689 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 96668 2024-04-19T02:16:57.689 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.689 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:57.689 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.689 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:57.689 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254669+0000", 2024-04-19T02:16:57.689 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:57.689 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.689 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.690 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:57.690 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254669+0000", 2024-04-19T02:16:57.690 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:57.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.690 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.690 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:57.690 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254668+0000", 2024-04-19T02:16:57.690 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:57.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.690 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.690 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:57.690 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254738+0000", 2024-04-19T02:16:57.690 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9913000000000006e-05 2024-04-19T02:16:57.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.691 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.691 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:57.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254748+0000", 2024-04-19T02:16:57.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7429999999999997e-06 2024-04-19T02:16:57.691 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.691 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.691 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254754+0000", 2024-04-19T02:16:57.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3840000000000002e-06 2024-04-19T02:16:57.691 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.691 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.691 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:57.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.256882+0000", 2024-04-19T02:16:57.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021282950000000001 2024-04-19T02:16:57.692 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.692 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.692 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:57.692 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.257007+0000", 2024-04-19T02:16:57.692 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012430699999999999 2024-04-19T02:16:57.692 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.692 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.692 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:57.692 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.257150+0000", 2024-04-19T02:16:57.692 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014291999999999999 2024-04-19T02:16:57.692 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.692 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.692 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:57.693 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.261375+0000", 2024-04-19T02:16:57.693 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042252100000000001 2024-04-19T02:16:57.693 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.693 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.693 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.693 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.274489+0000", 2024-04-19T02:16:57.693 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013113915 2024-04-19T02:16:57.693 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.693 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.693 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:57.693 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.274521+0000", 2024-04-19T02:16:57.693 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2691999999999998e-05 2024-04-19T02:16:57.693 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.693 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.693 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:57.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.274544+0000", 2024-04-19T02:16:57.694 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2408999999999998e-05 2024-04-19T02:16:57.694 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:57.694 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:57.694 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:57.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.694 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:98093 5.f 5:fcbc05b3:::benchmark_data_smithi121_44835_object98092:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-19T02:16:57.694 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:36.938897+0000", 2024-04-19T02:16:57.694 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 20.663120267, 2024-04-19T02:16:57.694 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019526373, 2024-04-19T02:16:57.694 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:57.695 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.695 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:57.695 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:57.695 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:57.695 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 98093 2024-04-19T02:16:57.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.695 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:57.695 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.695 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:57.695 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.938897+0000", 2024-04-19T02:16:57.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:57.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.695 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.695 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:57.695 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.938897+0000", 2024-04-19T02:16:57.696 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:57.696 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.696 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.696 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:57.696 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.938896+0000", 2024-04-19T02:16:57.696 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:57.696 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.696 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.696 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:57.696 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.938920+0000", 2024-04-19T02:16:57.696 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3969e-05 2024-04-19T02:16:57.696 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.696 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.696 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:57.697 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.938927+0000", 2024-04-19T02:16:57.697 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4760000000000003e-06 2024-04-19T02:16:57.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.697 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.697 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.938930+0000", 2024-04-19T02:16:57.697 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7349999999999998e-06 2024-04-19T02:16:57.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.697 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:57.697 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.945557+0000", 2024-04-19T02:16:57.697 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0066265689999999997 2024-04-19T02:16:57.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.698 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:57.698 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.945653+0000", 2024-04-19T02:16:57.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5948999999999999e-05 2024-04-19T02:16:57.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.698 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:16:57.698 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.945739+0000", 2024-04-19T02:16:57.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6012000000000003e-05 2024-04-19T02:16:57.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.698 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:57.698 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.949258+0000", 2024-04-19T02:16:57.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035189140000000002 2024-04-19T02:16:57.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.958372+0000", 2024-04-19T02:16:57.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0091140430000000005 2024-04-19T02:16:57.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:57.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.958402+0000", 2024-04-19T02:16:57.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9879e-05 2024-04-19T02:16:57.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:57.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.958423+0000", 2024-04-19T02:16:57.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1206999999999999e-05 2024-04-19T02:16:57.700 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:57.700 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:57.700 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:57.700 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.700 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:129219 5.2 5:45e7e1f4:::benchmark_data_smithi121_44835_object129218:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T02:16:57.700 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:52.629592+0000", 2024-04-19T02:16:57.700 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.9724249799999996, 2024-04-19T02:16:57.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021099489999999999, 2024-04-19T02:16:57.700 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:57.700 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.700 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:57.700 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:57.700 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:57.700 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129219 2024-04-19T02:16:57.701 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.701 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:57.701 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.701 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:57.701 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629592+0000", 2024-04-19T02:16:57.701 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:57.701 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.701 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.701 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:57.701 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629592+0000", 2024-04-19T02:16:57.701 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:57.701 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.701 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.701 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:57.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629591+0000", 2024-04-19T02:16:57.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:57.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.702 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:57.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629618+0000", 2024-04-19T02:16:57.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6970000000000001e-05 2024-04-19T02:16:57.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.702 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:57.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629639+0000", 2024-04-19T02:16:57.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0701999999999999e-05 2024-04-19T02:16:57.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.702 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.703 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629645+0000", 2024-04-19T02:16:57.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2299999999999996e-06 2024-04-19T02:16:57.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.703 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:57.703 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.635658+0000", 2024-04-19T02:16:57.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0060127549999999998 2024-04-19T02:16:57.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.703 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:57.703 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.635811+0000", 2024-04-19T02:16:57.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015305700000000001 2024-04-19T02:16:57.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.703 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:57.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.635967+0000", 2024-04-19T02:16:57.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015578599999999999 2024-04-19T02:16:57.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:57.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.642488+0000", 2024-04-19T02:16:57.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0065215619999999998 2024-04-19T02:16:57.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650603+0000", 2024-04-19T02:16:57.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0081144900000000002 2024-04-19T02:16:57.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:57.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650652+0000", 2024-04-19T02:16:57.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9079999999999998e-05 2024-04-19T02:16:57.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.705 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:57.705 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650691+0000", 2024-04-19T02:16:57.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9501e-05 2024-04-19T02:16:57.705 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:57.705 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:57.705 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:57.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.705 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:129220 5.2 5:44721865:::benchmark_data_smithi121_44835_object129219:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T02:16:57.705 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:52.630382+0000", 2024-04-19T02:16:57.705 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.9716345769999997, 2024-04-19T02:16:57.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.02043969, 2024-04-19T02:16:57.706 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:57.706 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.706 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:57.706 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:57.706 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:57.706 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129220 2024-04-19T02:16:57.706 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.706 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:57.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.706 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:57.706 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.630382+0000", 2024-04-19T02:16:57.706 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:57.706 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.706 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:57.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.630382+0000", 2024-04-19T02:16:57.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:57.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:57.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.630382+0000", 2024-04-19T02:16:57.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:16:57.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:57.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.630451+0000", 2024-04-19T02:16:57.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9022000000000004e-05 2024-04-19T02:16:57.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:57.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.630460+0000", 2024-04-19T02:16:57.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7059999999999999e-06 2024-04-19T02:16:57.708 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.630466+0000", 2024-04-19T02:16:57.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4689999999999996e-06 2024-04-19T02:16:57.708 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:57.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.639381+0000", 2024-04-19T02:16:57.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0089152529999999997 2024-04-19T02:16:57.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.709 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:57.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.639492+0000", 2024-04-19T02:16:57.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011075500000000001 2024-04-19T02:16:57.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.709 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:57.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.639589+0000", 2024-04-19T02:16:57.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7157999999999994e-05 2024-04-19T02:16:57.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:57.710 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.646571+0000", 2024-04-19T02:16:57.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00698177 2024-04-19T02:16:57.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.710 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650743+0000", 2024-04-19T02:16:57.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041725909999999998 2024-04-19T02:16:57.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:57.710 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650785+0000", 2024-04-19T02:16:57.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2026e-05 2024-04-19T02:16:57.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.711 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:57.711 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650822+0000", 2024-04-19T02:16:57.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6689000000000001e-05 2024-04-19T02:16:57.711 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:57.711 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:57.711 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:57.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.711 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:130093 5.2 5:41dcb8a4:::benchmark_data_smithi121_44835_object130092:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T02:16:57.711 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:53.069964+0000", 2024-04-19T02:16:57.711 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.5320529799999996, 2024-04-19T02:16:57.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020424088, 2024-04-19T02:16:57.711 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:16:57.712 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:57.712 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:16:57.712 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:16:57.712 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:57.712 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 130093 2024-04-19T02:16:57.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.712 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:16:57.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:16:57.712 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.069964+0000", 2024-04-19T02:16:57.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:57.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:16:57.712 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.069964+0000", 2024-04-19T02:16:57.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:16:57.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:16:57.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.069963+0000", 2024-04-19T02:16:57.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:57.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:16:57.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.070064+0000", 2024-04-19T02:16:57.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100709 2024-04-19T02:16:57.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:16:57.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.070072+0000", 2024-04-19T02:16:57.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8339999999999999e-06 2024-04-19T02:16:57.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.714 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.070077+0000", 2024-04-19T02:16:57.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2399999999999998e-06 2024-04-19T02:16:57.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.714 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:16:57.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.071370+0000", 2024-04-19T02:16:57.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012926470000000001 2024-04-19T02:16:57.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.715 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:16:57.715 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.071497+0000", 2024-04-19T02:16:57.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000127701 2024-04-19T02:16:57.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.715 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:57.715 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.071662+0000", 2024-04-19T02:16:57.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016424300000000001 2024-04-19T02:16:57.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.715 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:16:57.715 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.077150+0000", 2024-04-19T02:16:57.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.005488031 2024-04-19T02:16:57.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.716 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:57.716 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.090305+0000", 2024-04-19T02:16:57.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013155622 2024-04-19T02:16:57.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.716 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:16:57.716 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.090352+0000", 2024-04-19T02:16:57.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6798999999999997e-05 2024-04-19T02:16:57.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:16:57.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:16:57.716 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:16:57.716 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.090388+0000", 2024-04-19T02:16:57.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5837999999999998e-05 2024-04-19T02:16:57.716 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:57.717 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:57.717 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:57.717 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:16:57.717 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:16:57.717 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:16:57.718 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:16:57.719 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:57.719+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:57.819 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:57.820+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:57.889 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:16:57.889 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:16:57.889 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.890 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:138345 5.b 5:d1cea6ba:::benchmark_data_smithi121_44835_object4310:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-19T02:16:57.890 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:57.882591+0000", 2024-04-19T02:16:57.890 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.007166632, 2024-04-19T02:16:57.890 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0072004829999999997, 2024-04-19T02:16:57.890 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:57.890 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:57.890 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:57.890 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:57.890 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:57.890 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 138345 2024-04-19T02:16:57.890 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.890 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:57.890 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.891 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:57.891 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.882591+0000", 2024-04-19T02:16:57.891 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:57.891 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.891 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.891 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:57.891 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.882591+0000", 2024-04-19T02:16:57.891 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:57.891 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.891 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.891 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:57.891 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.882590+0000", 2024-04-19T02:16:57.891 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:57.891 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.891 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.892 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:57.892 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.882594+0000", 2024-04-19T02:16:57.892 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6500000000000002e-06 2024-04-19T02:16:57.892 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.892 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.892 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:57.892 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.882603+0000", 2024-04-19T02:16:57.892 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0510000000000002e-06 2024-04-19T02:16:57.892 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.892 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.892 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.892 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.882608+0000", 2024-04-19T02:16:57.892 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2809999999999999e-06 2024-04-19T02:16:57.892 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.892 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.893 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:57.893 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.882638+0000", 2024-04-19T02:16:57.893 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9742000000000001e-05 2024-04-19T02:16:57.893 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.893 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.893 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:57.893 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.882720+0000", 2024-04-19T02:16:57.893 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2869999999999998e-05 2024-04-19T02:16:57.893 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.893 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.893 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:57.893 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.882788+0000", 2024-04-19T02:16:57.893 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.7175999999999995e-05 2024-04-19T02:16:57.893 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.894 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.894 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:57.894 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.885398+0000", 2024-04-19T02:16:57.894 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.002610163 2024-04-19T02:16:57.894 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:57.894 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:57.894 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:57.894 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.894 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.894 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:138349 5.b 5:d8818adf:::benchmark_data_smithi121_44835_object4314:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-19T02:16:57.894 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:57.882614+0000", 2024-04-19T02:16:57.894 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0071433419999999996, 2024-04-19T02:16:57.894 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0072639159999999996, 2024-04-19T02:16:57.894 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:57.895 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:57.895 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:57.895 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:57.895 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:57.895 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 138349 2024-04-19T02:16:57.895 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.895 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:57.895 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.895 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:57.895 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.882614+0000", 2024-04-19T02:16:57.895 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:57.895 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.896 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.896 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:57.896 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.882614+0000", 2024-04-19T02:16:57.896 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:57.896 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.896 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.896 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:57.896 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.882614+0000", 2024-04-19T02:16:57.896 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:57.896 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.896 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.896 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:57.896 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.882615+0000", 2024-04-19T02:16:57.896 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.581e-06 2024-04-19T02:16:57.896 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.896 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.897 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:57.897 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.882622+0000", 2024-04-19T02:16:57.897 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.0049999999999998e-06 2024-04-19T02:16:57.897 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.897 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.897 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.897 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.882626+0000", 2024-04-19T02:16:57.897 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.32e-06 2024-04-19T02:16:57.897 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.897 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.897 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:57.897 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.884110+0000", 2024-04-19T02:16:57.897 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0014847199999999999 2024-04-19T02:16:57.897 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.898 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.898 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:57.898 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.884220+0000", 2024-04-19T02:16:57.898 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000109926 2024-04-19T02:16:57.898 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.898 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.898 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:57.898 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.884331+0000", 2024-04-19T02:16:57.898 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011118199999999999 2024-04-19T02:16:57.898 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.898 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.898 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:57.898 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.888626+0000", 2024-04-19T02:16:57.898 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0042948650000000001 2024-04-19T02:16:57.899 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:57.899 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:57.899 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:57.899 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.899 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.899 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:138352 5.8 5:113221f7:::benchmark_data_smithi121_44835_object4317:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-19T02:16:57.899 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:57.883357+0000", 2024-04-19T02:16:57.899 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0064004120000000003, 2024-04-19T02:16:57.899 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0066000410000000001, 2024-04-19T02:16:57.899 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:57.899 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:57.899 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:57.899 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:57.900 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:57.900 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 138352 2024-04-19T02:16:57.900 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.900 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:57.900 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.900 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:57.900 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.883357+0000", 2024-04-19T02:16:57.900 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:57.900 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.900 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.900 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:57.900 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.883357+0000", 2024-04-19T02:16:57.900 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:57.900 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.901 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.901 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:57.901 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.883356+0000", 2024-04-19T02:16:57.901 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:57.901 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.901 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.901 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:57.901 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.883361+0000", 2024-04-19T02:16:57.901 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.3489999999999999e-06 2024-04-19T02:16:57.901 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.901 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.901 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:57.901 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.883371+0000", 2024-04-19T02:16:57.901 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.6739999999999992e-06 2024-04-19T02:16:57.901 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.902 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.902 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.902 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.883378+0000", 2024-04-19T02:16:57.902 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.2880000000000004e-06 2024-04-19T02:16:57.902 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.902 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.902 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:57.902 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.883414+0000", 2024-04-19T02:16:57.902 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5960000000000001e-05 2024-04-19T02:16:57.902 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.902 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.902 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:57.902 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.883526+0000", 2024-04-19T02:16:57.902 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000111847 2024-04-19T02:16:57.903 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.903 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.903 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:57.903 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.883630+0000", 2024-04-19T02:16:57.903 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000104289 2024-04-19T02:16:57.903 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.903 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.903 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:57.903 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.888729+0000", 2024-04-19T02:16:57.903 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0050984300000000001 2024-04-19T02:16:57.903 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:57.903 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:57.903 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:57.903 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.904 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.904 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:138360 5.9 e44/16 5:9058d520:::benchmark_data_smithi121_44835_object4325:head v 44'8775, mlcod=44'8773)", 2024-04-19T02:16:57.904 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:57.887853+0000", 2024-04-19T02:16:57.904 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0019043179999999999, 2024-04-19T02:16:57.904 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0021969149999999998, 2024-04-19T02:16:57.904 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:57.904 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:16:57.904 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:57.904 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.904 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:57.904 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.887853+0000", 2024-04-19T02:16:57.904 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:57.904 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.904 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.905 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:57.905 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.887853+0000", 2024-04-19T02:16:57.905 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:57.905 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.905 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.905 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:57.905 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.887852+0000", 2024-04-19T02:16:57.905 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:57.905 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.905 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.905 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:57.905 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.887857+0000", 2024-04-19T02:16:57.905 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2230000000000001e-06 2024-04-19T02:16:57.905 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.906 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.906 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:57.906 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.887864+0000", 2024-04-19T02:16:57.906 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.2280000000000001e-06 2024-04-19T02:16:57.906 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.906 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.906 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.906 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.887870+0000", 2024-04-19T02:16:57.906 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.8479999999999997e-06 2024-04-19T02:16:57.906 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.906 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.906 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:57.906 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.888521+0000", 2024-04-19T02:16:57.906 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00065106699999999997 2024-04-19T02:16:57.906 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.906 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.907 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:57.907 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.888540+0000", 2024-04-19T02:16:57.907 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.9412999999999999e-05 2024-04-19T02:16:57.907 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:57.907 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:57.907 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:57.907 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.907 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.907 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:138359 5.f e44/16 5:ff8ec520:::benchmark_data_smithi121_44835_object4324:head v 44'8719, mlcod=44'8717)", 2024-04-19T02:16:57.907 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:57.887948+0000", 2024-04-19T02:16:57.907 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.001809207, 2024-04-19T02:16:57.907 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0021849510000000001, 2024-04-19T02:16:57.907 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:57.907 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:16:57.907 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:57.907 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.908 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:57.908 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.887948+0000", 2024-04-19T02:16:57.908 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:57.908 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.908 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.908 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:57.908 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.887948+0000", 2024-04-19T02:16:57.908 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:57.908 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.908 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.908 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:57.908 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.887948+0000", 2024-04-19T02:16:57.908 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:57.908 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.908 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.908 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:57.908 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.887951+0000", 2024-04-19T02:16:57.909 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7450000000000001e-06 2024-04-19T02:16:57.909 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.909 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.909 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:57.909 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.887957+0000", 2024-04-19T02:16:57.909 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.4049999999999999e-06 2024-04-19T02:16:57.909 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.909 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.909 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.909 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.887962+0000", 2024-04-19T02:16:57.909 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.9980000000000003e-06 2024-04-19T02:16:57.909 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.909 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.909 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:57.909 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.887987+0000", 2024-04-19T02:16:57.909 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.5242999999999999e-05 2024-04-19T02:16:57.910 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.910 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.910 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:57.910 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.887999+0000", 2024-04-19T02:16:57.910 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1567e-05 2024-04-19T02:16:57.910 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:57.910 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:57.910 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:57.910 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.910 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.910 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:138364 5.e 5:7779c8b9:::benchmark_data_smithi121_44835_object4329:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-19T02:16:57.910 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:57.889219+0000", 2024-04-19T02:16:57.910 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.00053793000000000005, 2024-04-19T02:16:57.910 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00097593799999999998, 2024-04-19T02:16:57.910 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:57.911 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:57.911 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:57.911 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:57.911 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:57.911 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 138364 2024-04-19T02:16:57.911 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.911 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:57.911 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.911 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:57.911 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.889219+0000", 2024-04-19T02:16:57.911 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:57.911 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.911 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.911 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:57.912 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.889219+0000", 2024-04-19T02:16:57.912 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:57.912 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.912 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.912 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:57.912 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.889218+0000", 2024-04-19T02:16:57.912 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999986 2024-04-19T02:16:57.912 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.912 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.912 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:57.912 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.889223+0000", 2024-04-19T02:16:57.912 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.13e-06 2024-04-19T02:16:57.912 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.912 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.912 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:57.912 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.889238+0000", 2024-04-19T02:16:57.913 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.5321000000000001e-05 2024-04-19T02:16:57.913 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.913 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.913 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.913 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.889245+0000", 2024-04-19T02:16:57.913 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.0570000000000004e-06 2024-04-19T02:16:57.913 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.913 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.913 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:57.913 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.889285+0000", 2024-04-19T02:16:57.913 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9371e-05 2024-04-19T02:16:57.913 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.913 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.913 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:57.913 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.889373+0000", 2024-04-19T02:16:57.914 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.8632000000000001e-05 2024-04-19T02:16:57.914 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.914 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.914 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:57.914 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.889442+0000", 2024-04-19T02:16:57.914 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.8720999999999995e-05 2024-04-19T02:16:57.914 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:57.914 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:57.914 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:57.914 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.914 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.914 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:138366 5.e 5.8343cdee (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-19T02:16:57.914 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:57.889256+0000", 2024-04-19T02:16:57.915 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.00050145400000000003, 2024-04-19T02:16:57.915 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0010134930000000001, 2024-04-19T02:16:57.915 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:57.915 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "queued for pg", 2024-04-19T02:16:57.915 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:57.915 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:57.915 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:57.915 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 138366 2024-04-19T02:16:57.915 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.915 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:57.915 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.915 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:57.915 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.889256+0000", 2024-04-19T02:16:57.915 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:57.916 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.916 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.916 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:57.916 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.889256+0000", 2024-04-19T02:16:57.916 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:57.916 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.916 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.916 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:57.916 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.889255+0000", 2024-04-19T02:16:57.916 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:57.916 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.916 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.916 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:57.916 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.889258+0000", 2024-04-19T02:16:57.916 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9340000000000002e-06 2024-04-19T02:16:57.917 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.917 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.917 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:57.917 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.889264+0000", 2024-04-19T02:16:57.917 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.8150000000000002e-06 2024-04-19T02:16:57.917 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.917 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.917 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.917 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.889269+0000", 2024-04-19T02:16:57.917 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.9740000000000001e-06 2024-04-19T02:16:57.917 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:57.917 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:57.917 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:57.918 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.918 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.918 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:138363 5.9 e44/16 5:984c0664:::benchmark_data_smithi121_44835_object4328:head v 44'8776, mlcod=44'8773)", 2024-04-19T02:16:57.918 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:57.889566+0000", 2024-04-19T02:16:57.918 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.000190815, 2024-04-19T02:16:57.918 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00076011299999999998, 2024-04-19T02:16:57.918 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:57.918 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:16:57.918 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:57.918 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.918 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:57.918 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.889566+0000", 2024-04-19T02:16:57.918 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:57.919 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.919 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.919 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:57.919 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.889566+0000", 2024-04-19T02:16:57.919 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:57.919 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.919 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.919 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:57.919 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.889566+0000", 2024-04-19T02:16:57.919 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:57.919 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.919 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.919 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:57.919 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.889572+0000", 2024-04-19T02:16:57.919 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.0730000000000001e-06 2024-04-19T02:16:57.920 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.920 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.920 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:57.920 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.889581+0000", 2024-04-19T02:16:57.920 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3060000000000003e-06 2024-04-19T02:16:57.920 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.920 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.920 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:57.920 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.889588+0000", 2024-04-19T02:16:57.920 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.2750000000000001e-06 2024-04-19T02:16:57.920 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.920 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.920 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:57.920 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.890039+0000", 2024-04-19T02:16:57.920 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00045132499999999998 2024-04-19T02:16:57.920 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:57.921 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:57.921 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:57.921 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:57.890056+0000", 2024-04-19T02:16:57.921 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.7271000000000001e-05 2024-04-19T02:16:57.921 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:57.921 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:57.921 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:57.921 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:57.921 INFO:teuthology.orchestra.run.smithi174.stdout: ], 2024-04-19T02:16:57.921 INFO:teuthology.orchestra.run.smithi174.stdout: "num_ops": 8 2024-04-19T02:16:57.921 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:16:57.923 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:16:57.923 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:57.923+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:58.023 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:58.024+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:58.124 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:58.125+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:58.128 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:16:58.128 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [], 2024-04-19T02:16:58.128 INFO:teuthology.orchestra.run.smithi174.stdout: "complaint_time": 30, 2024-04-19T02:16:58.128 INFO:teuthology.orchestra.run.smithi174.stdout: "num_blocked_ops": 0 2024-04-19T02:16:58.128 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:16:58.142 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:16:58.187 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T02:16:58.226 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:58.227+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:58.327 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:58.328+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:58.355 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:16:58.355 INFO:teuthology.orchestra.run.smithi174.stdout: "size": 20, 2024-04-19T02:16:58.355 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 600, 2024-04-19T02:16:58.355 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:16:58.356 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.356 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:10 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:58.356 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269877+0000", 2024-04-19T02:16:58.356 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 89.083384323000004, 2024-04-19T02:16:58.356 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020732751000000001, 2024-04-19T02:16:58.356 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:58.356 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:58.356 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:58.356 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.356 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:58.356 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269877+0000", 2024-04-19T02:16:58.356 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:58.356 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.357 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.357 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:58.357 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269877+0000", 2024-04-19T02:16:58.357 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:58.357 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.357 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.357 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:58.357 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269875+0000", 2024-04-19T02:16:58.357 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:58.357 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.357 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.357 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:58.357 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269891+0000", 2024-04-19T02:16:58.358 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.5494000000000001e-05 2024-04-19T02:16:58.358 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.358 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.358 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:58.358 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269903+0000", 2024-04-19T02:16:58.358 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2003e-05 2024-04-19T02:16:58.358 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.358 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.358 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:58.358 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269914+0000", 2024-04-19T02:16:58.358 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0947e-05 2024-04-19T02:16:58.358 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.358 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.358 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:58.359 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269971+0000", 2024-04-19T02:16:58.359 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7036000000000001e-05 2024-04-19T02:16:58.359 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.359 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.359 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:16:58.359 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269979+0000", 2024-04-19T02:16:58.359 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.6660000000000008e-06 2024-04-19T02:16:58.359 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.359 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.359 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:58.359 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284891+0000", 2024-04-19T02:16:58.359 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014912584 2024-04-19T02:16:58.359 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.359 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.359 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:58.360 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285213+0000", 2024-04-19T02:16:58.360 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00032172199999999998 2024-04-19T02:16:58.360 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.360 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.360 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:58.360 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285357+0000", 2024-04-19T02:16:58.360 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014367899999999999 2024-04-19T02:16:58.360 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.360 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.360 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:58.360 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288883+0000", 2024-04-19T02:16:58.360 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0035268719999999999 2024-04-19T02:16:58.360 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.360 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.361 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:58.361 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290537+0000", 2024-04-19T02:16:58.361 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016537399999999999 2024-04-19T02:16:58.361 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.361 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.361 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:58.361 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290576+0000", 2024-04-19T02:16:58.361 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9266e-05 2024-04-19T02:16:58.361 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.361 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.361 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:58.361 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290609+0000", 2024-04-19T02:16:58.361 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2818000000000003e-05 2024-04-19T02:16:58.361 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:58.361 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:58.362 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:58.362 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.362 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.362 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:11 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:58.362 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:58.362 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 89.083331401999999, 2024-04-19T02:16:58.362 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020352748, 2024-04-19T02:16:58.362 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:58.362 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:58.362 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:58.362 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.362 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:58.362 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:58.363 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:58.363 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.363 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.363 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:58.363 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:58.363 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:58.363 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.363 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.363 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:58.363 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:16:58.363 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:58.363 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.363 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.363 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:58.364 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269933+0000", 2024-04-19T02:16:58.364 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2169999999999996e-06 2024-04-19T02:16:58.364 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.364 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.364 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:58.364 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269940+0000", 2024-04-19T02:16:58.364 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1500000000000002e-06 2024-04-19T02:16:58.364 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.364 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.364 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:58.364 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269948+0000", 2024-04-19T02:16:58.364 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.8690000000000004e-06 2024-04-19T02:16:58.364 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.364 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.365 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:58.365 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:16:58.365 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2994999999999997e-05 2024-04-19T02:16:58.365 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.365 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.365 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:16:58.365 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269997+0000", 2024-04-19T02:16:58.365 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.9020000000000004e-06 2024-04-19T02:16:58.365 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.365 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.365 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:58.365 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.282729+0000", 2024-04-19T02:16:58.365 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.012732537 2024-04-19T02:16:58.365 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.366 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.366 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:58.366 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.282838+0000", 2024-04-19T02:16:58.366 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000108298 2024-04-19T02:16:58.366 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.366 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.366 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:58.366 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.283002+0000", 2024-04-19T02:16:58.366 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00016466300000000001 2024-04-19T02:16:58.366 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.366 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.366 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:58.366 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288708+0000", 2024-04-19T02:16:58.366 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.005705066 2024-04-19T02:16:58.367 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.367 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.367 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:58.367 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290215+0000", 2024-04-19T02:16:58.367 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0015075010000000001 2024-04-19T02:16:58.367 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.367 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.367 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:58.367 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290259+0000", 2024-04-19T02:16:58.367 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3711999999999998e-05 2024-04-19T02:16:58.367 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.367 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.367 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:58.367 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290282+0000", 2024-04-19T02:16:58.368 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3458000000000001e-05 2024-04-19T02:16:58.368 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:58.368 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:58.368 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:58.368 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.368 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.368 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:14 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:58.368 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:58.368 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 89.083297611999996, 2024-04-19T02:16:58.368 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020137202, 2024-04-19T02:16:58.368 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:58.368 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:58.368 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:58.368 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.369 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:58.369 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:58.369 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:58.369 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.369 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.369 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:58.369 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:58.369 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:58.369 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.369 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.369 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:58.369 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:16:58.369 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:58.370 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.370 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.370 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:58.370 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269971+0000", 2024-04-19T02:16:58.370 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.5459999999999992e-06 2024-04-19T02:16:58.370 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.370 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.370 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:58.370 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269979+0000", 2024-04-19T02:16:58.370 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9130000000000003e-06 2024-04-19T02:16:58.370 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.370 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.370 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:58.370 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269986+0000", 2024-04-19T02:16:58.371 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.3779999999999998e-06 2024-04-19T02:16:58.371 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.371 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.371 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:58.371 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270030+0000", 2024-04-19T02:16:58.371 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3982e-05 2024-04-19T02:16:58.371 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.371 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.371 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:16:58.371 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270034+0000", 2024-04-19T02:16:58.371 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1779999999999996e-06 2024-04-19T02:16:58.371 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.371 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.371 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:58.372 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.277870+0000", 2024-04-19T02:16:58.372 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0078362150000000005 2024-04-19T02:16:58.372 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.372 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.372 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:58.372 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.278216+0000", 2024-04-19T02:16:58.372 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00034634999999999999 2024-04-19T02:16:58.372 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.372 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.372 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:58.372 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.278732+0000", 2024-04-19T02:16:58.372 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00051536099999999999 2024-04-19T02:16:58.372 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.372 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.372 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:58.373 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.287694+0000", 2024-04-19T02:16:58.373 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0089621019999999996 2024-04-19T02:16:58.373 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.373 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.373 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:58.373 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290026+0000", 2024-04-19T02:16:58.373 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0023323139999999998 2024-04-19T02:16:58.373 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.373 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.373 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:58.373 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290067+0000", 2024-04-19T02:16:58.373 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1043e-05 2024-04-19T02:16:58.373 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.373 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.374 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:58.374 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290100+0000", 2024-04-19T02:16:58.374 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3278999999999998e-05 2024-04-19T02:16:58.374 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:58.374 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:58.374 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:58.374 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.374 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.374 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:58.374 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:58.374 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 89.083265819999994, 2024-04-19T02:16:58.374 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020731702000000001, 2024-04-19T02:16:58.374 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:58.375 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:58.375 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:58.375 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.375 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:58.375 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:58.375 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:58.375 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.375 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.375 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:58.375 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:58.375 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:58.375 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.375 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.375 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:58.376 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:16:58.376 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:58.376 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.376 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.376 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:58.376 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269998+0000", 2024-04-19T02:16:58.376 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7100000000000001e-06 2024-04-19T02:16:58.376 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.376 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.376 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:58.376 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270005+0000", 2024-04-19T02:16:58.376 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.241e-06 2024-04-19T02:16:58.376 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.376 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.377 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:58.377 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270011+0000", 2024-04-19T02:16:58.377 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6279999999999999e-06 2024-04-19T02:16:58.377 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.377 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.377 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:58.377 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270046+0000", 2024-04-19T02:16:58.377 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5173999999999999e-05 2024-04-19T02:16:58.377 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.377 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.377 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:58.377 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:16:58.377 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0019999999999997e-06 2024-04-19T02:16:58.377 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.377 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.378 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:58.378 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285619+0000", 2024-04-19T02:16:58.378 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015567391 2024-04-19T02:16:58.378 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.378 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.378 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:58.378 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285671+0000", 2024-04-19T02:16:58.378 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2460999999999998e-05 2024-04-19T02:16:58.378 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.378 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.378 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:58.378 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285775+0000", 2024-04-19T02:16:58.378 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000103389 2024-04-19T02:16:58.378 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.379 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.379 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:58.379 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288934+0000", 2024-04-19T02:16:58.379 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0031595859999999998 2024-04-19T02:16:58.379 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.379 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.379 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:58.379 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290650+0000", 2024-04-19T02:16:58.379 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001716242 2024-04-19T02:16:58.379 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.379 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.379 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:58.379 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290692+0000", 2024-04-19T02:16:58.379 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1910999999999999e-05 2024-04-19T02:16:58.379 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.379 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.380 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:58.380 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290727+0000", 2024-04-19T02:16:58.380 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4412000000000002e-05 2024-04-19T02:16:58.380 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:58.380 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:58.380 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:58.380 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.380 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.380 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:58.380 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270019+0000", 2024-04-19T02:16:58.380 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 89.083242225000006, 2024-04-19T02:16:58.380 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020572014999999999, 2024-04-19T02:16:58.380 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:58.380 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:58.381 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:58.381 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.381 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:58.381 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270019+0000", 2024-04-19T02:16:58.381 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:58.381 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.381 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.381 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:58.381 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270019+0000", 2024-04-19T02:16:58.381 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:58.381 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.381 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.382 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:58.382 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270018+0000", 2024-04-19T02:16:58.382 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:58.382 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.382 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.382 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:58.382 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270021+0000", 2024-04-19T02:16:58.382 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0319999999999999e-06 2024-04-19T02:16:58.382 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.382 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.382 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:58.382 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270028+0000", 2024-04-19T02:16:58.382 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6189999999999996e-06 2024-04-19T02:16:58.383 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.383 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.383 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:58.383 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270035+0000", 2024-04-19T02:16:58.383 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1690000000000003e-06 2024-04-19T02:16:58.383 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.383 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.383 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:58.383 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270078+0000", 2024-04-19T02:16:58.383 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3061e-05 2024-04-19T02:16:58.383 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.383 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.383 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:58.383 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270082+0000", 2024-04-19T02:16:58.383 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4510000000000002e-06 2024-04-19T02:16:58.384 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.384 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.384 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:58.384 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284354+0000", 2024-04-19T02:16:58.384 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014271588999999999 2024-04-19T02:16:58.384 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.384 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.384 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:58.384 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284497+0000", 2024-04-19T02:16:58.384 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014335800000000001 2024-04-19T02:16:58.384 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.384 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.384 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:58.384 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284626+0000", 2024-04-19T02:16:58.385 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000128744 2024-04-19T02:16:58.385 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.385 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.385 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:58.385 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288844+0000", 2024-04-19T02:16:58.385 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00421807 2024-04-19T02:16:58.385 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.385 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.385 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:58.385 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290508+0000", 2024-04-19T02:16:58.385 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001663774 2024-04-19T02:16:58.385 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.385 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.385 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:58.385 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290556+0000", 2024-04-19T02:16:58.386 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.7599999999999998e-05 2024-04-19T02:16:58.386 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.386 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.386 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:58.386 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290591+0000", 2024-04-19T02:16:58.386 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5034999999999999e-05 2024-04-19T02:16:58.386 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:58.386 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:58.386 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:58.386 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.386 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.386 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:58.386 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:58.386 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 89.083219361999994, 2024-04-19T02:16:58.386 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020192280999999999, 2024-04-19T02:16:58.387 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:58.387 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:58.387 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:58.387 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.387 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:58.387 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:58.387 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:58.387 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.387 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.387 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:58.387 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:58.387 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:58.387 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.387 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.387 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:58.388 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:16:58.388 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:58.388 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.388 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.388 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:58.388 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270045+0000", 2024-04-19T02:16:58.388 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8680000000000001e-06 2024-04-19T02:16:58.388 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.388 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.388 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:58.388 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270052+0000", 2024-04-19T02:16:58.388 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.9999999999999999e-06 2024-04-19T02:16:58.388 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.389 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.389 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:58.389 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270056+0000", 2024-04-19T02:16:58.389 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4479999999999996e-06 2024-04-19T02:16:58.389 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.389 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.389 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:58.389 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270089+0000", 2024-04-19T02:16:58.389 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3071000000000002e-05 2024-04-19T02:16:58.389 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.389 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.389 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:58.389 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270092+0000", 2024-04-19T02:16:58.389 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9780000000000001e-06 2024-04-19T02:16:58.390 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.390 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.390 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:58.390 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.280632+0000", 2024-04-19T02:16:58.390 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010539712 2024-04-19T02:16:58.390 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.390 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.390 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:58.390 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.280743+0000", 2024-04-19T02:16:58.390 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000111048 2024-04-19T02:16:58.390 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.390 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.390 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:58.390 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.281531+0000", 2024-04-19T02:16:58.391 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00078738199999999999 2024-04-19T02:16:58.391 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.391 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.391 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:58.391 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.287949+0000", 2024-04-19T02:16:58.391 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0064185730000000003 2024-04-19T02:16:58.391 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.391 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.391 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:58.391 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290184+0000", 2024-04-19T02:16:58.391 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0022350849999999999 2024-04-19T02:16:58.391 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.391 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.392 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:58.392 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290209+0000", 2024-04-19T02:16:58.392 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4907000000000001e-05 2024-04-19T02:16:58.392 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.392 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.392 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:58.392 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290234+0000", 2024-04-19T02:16:58.392 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4666999999999999e-05 2024-04-19T02:16:58.392 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:58.392 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:58.392 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:58.392 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.392 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.392 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:19 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:16:58.393 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:58.393 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 89.083197896000001, 2024-04-19T02:16:58.393 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020818203, 2024-04-19T02:16:58.393 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:58.393 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:58.393 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:58.393 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.393 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:58.393 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:58.393 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:58.393 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.393 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.393 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:58.393 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:58.394 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:58.394 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.394 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.394 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:58.394 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:16:58.394 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:58.394 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.394 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.394 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:58.394 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270065+0000", 2024-04-19T02:16:58.394 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4310000000000001e-06 2024-04-19T02:16:58.394 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.394 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.394 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:58.395 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270070+0000", 2024-04-19T02:16:58.395 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2859999999999999e-06 2024-04-19T02:16:58.395 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.395 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.395 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:58.395 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270077+0000", 2024-04-19T02:16:58.395 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5270000000000004e-06 2024-04-19T02:16:58.395 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.395 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.395 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:58.395 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270107+0000", 2024-04-19T02:16:58.395 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0205999999999998e-05 2024-04-19T02:16:58.395 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.395 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.395 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:16:58.396 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270111+0000", 2024-04-19T02:16:58.396 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8650000000000003e-06 2024-04-19T02:16:58.396 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.396 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.396 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:58.396 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285936+0000", 2024-04-19T02:16:58.396 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015824677999999998 2024-04-19T02:16:58.396 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.396 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.396 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:58.396 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286007+0000", 2024-04-19T02:16:58.396 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1157999999999999e-05 2024-04-19T02:16:58.396 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.397 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.397 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:58.397 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286086+0000", 2024-04-19T02:16:58.397 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9084000000000004e-05 2024-04-19T02:16:58.397 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.397 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.397 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:58.397 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290740+0000", 2024-04-19T02:16:58.397 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0046543679999999999 2024-04-19T02:16:58.397 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.397 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.397 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:58.397 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290833+0000", 2024-04-19T02:16:58.397 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2551000000000002e-05 2024-04-19T02:16:58.398 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.398 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.398 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:58.398 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290859+0000", 2024-04-19T02:16:58.398 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.6696999999999999e-05 2024-04-19T02:16:58.398 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.398 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.398 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:58.398 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290881+0000", 2024-04-19T02:16:58.398 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1653000000000001e-05 2024-04-19T02:16:58.398 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:58.398 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:58.398 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:58.399 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.399 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.399 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:77622 5.8 5:166fbe77:::benchmark_data_smithi121_44835_object77621:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:58.399 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:16:58.399 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 31.547700959, 2024-04-19T02:16:58.399 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.021784694, 2024-04-19T02:16:58.399 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:58.399 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:58.399 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:58.399 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:58.399 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:58.399 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 77622 2024-04-19T02:16:58.399 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.399 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:58.399 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.400 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:58.400 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:16:58.400 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:58.400 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.400 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.400 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:58.400 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:16:58.400 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:58.400 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.400 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.400 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:58.400 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805559+0000", 2024-04-19T02:16:58.400 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:58.400 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.401 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.401 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:58.401 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805659+0000", 2024-04-19T02:16:58.401 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.9908000000000006e-05 2024-04-19T02:16:58.401 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.401 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.401 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:58.401 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805668+0000", 2024-04-19T02:16:58.401 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2129999999999997e-06 2024-04-19T02:16:58.401 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.401 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.401 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:58.401 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805673+0000", 2024-04-19T02:16:58.401 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0370000000000002e-06 2024-04-19T02:16:58.402 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.402 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.402 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:58.402 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812022+0000", 2024-04-19T02:16:58.402 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0063483239999999998 2024-04-19T02:16:58.402 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.402 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.402 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:58.402 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812129+0000", 2024-04-19T02:16:58.402 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010744200000000001 2024-04-19T02:16:58.402 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.402 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.402 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:58.402 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812252+0000", 2024-04-19T02:16:58.403 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000122519 2024-04-19T02:16:58.403 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.403 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.403 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:58.403 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.820979+0000", 2024-04-19T02:16:58.403 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0087272740000000001 2024-04-19T02:16:58.403 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.403 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.403 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:58.403 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827270+0000", 2024-04-19T02:16:58.403 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0062906239999999999 2024-04-19T02:16:58.403 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.403 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.403 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:58.403 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827309+0000", 2024-04-19T02:16:58.404 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9678999999999997e-05 2024-04-19T02:16:58.404 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.404 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.404 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:58.404 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827345+0000", 2024-04-19T02:16:58.404 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5308000000000001e-05 2024-04-19T02:16:58.404 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:58.404 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:58.404 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:58.404 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.404 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.404 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78224 5.4 5:26e797d5:::benchmark_data_smithi121_44835_object78223:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:58.404 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:16:58.404 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 31.246698760000001, 2024-04-19T02:16:58.404 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.021471998999999999, 2024-04-19T02:16:58.405 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:58.405 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:58.405 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:58.405 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:58.405 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:58.405 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78224 2024-04-19T02:16:58.405 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.405 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:58.405 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.405 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:58.405 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:16:58.405 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:58.405 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.406 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.406 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:58.406 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:16:58.406 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:58.406 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.406 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.406 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:58.406 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106561+0000", 2024-04-19T02:16:58.406 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:58.406 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.406 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.406 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:58.406 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106630+0000", 2024-04-19T02:16:58.406 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.8553999999999994e-05 2024-04-19T02:16:58.407 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.407 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.407 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:58.407 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106644+0000", 2024-04-19T02:16:58.407 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.4651000000000001e-05 2024-04-19T02:16:58.407 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.407 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.407 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:58.407 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106653+0000", 2024-04-19T02:16:58.407 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.6719999999999993e-06 2024-04-19T02:16:58.407 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.407 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.407 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:58.407 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106693+0000", 2024-04-19T02:16:58.407 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9978999999999998e-05 2024-04-19T02:16:58.408 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.408 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.408 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:58.408 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106840+0000", 2024-04-19T02:16:58.408 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0001473 2024-04-19T02:16:58.408 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.408 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.408 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:58.408 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106971+0000", 2024-04-19T02:16:58.408 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013051499999999999 2024-04-19T02:16:58.408 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.408 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.408 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:58.408 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.109047+0000", 2024-04-19T02:16:58.408 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.002076002 2024-04-19T02:16:58.409 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.409 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.409 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:58.409 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.127967+0000", 2024-04-19T02:16:58.409 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.018919780000000001 2024-04-19T02:16:58.409 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.409 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.409 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:58.409 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128004+0000", 2024-04-19T02:16:58.409 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7719000000000003e-05 2024-04-19T02:16:58.409 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.409 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.409 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:58.409 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128034+0000", 2024-04-19T02:16:58.409 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9651000000000001e-05 2024-04-19T02:16:58.410 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:58.410 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:58.410 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:58.410 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.410 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.410 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78259 5.4 5:2aa344b2:::benchmark_data_smithi121_44835_object78258:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:58.410 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:16:58.410 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 31.228003691000001, 2024-04-19T02:16:58.410 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022934350999999999, 2024-04-19T02:16:58.410 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:58.410 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:58.410 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:58.410 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:58.410 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:58.410 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78259 2024-04-19T02:16:58.411 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.411 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:58.411 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.411 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:58.411 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:16:58.411 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:58.411 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.411 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.411 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:58.411 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:16:58.411 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:58.411 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.411 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.411 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:58.411 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125256+0000", 2024-04-19T02:16:58.411 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:58.411 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.412 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.412 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:58.412 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125347+0000", 2024-04-19T02:16:58.412 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0470000000000006e-05 2024-04-19T02:16:58.412 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.412 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.412 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:58.412 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125358+0000", 2024-04-19T02:16:58.412 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1764e-05 2024-04-19T02:16:58.412 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.412 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.412 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:58.412 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125364+0000", 2024-04-19T02:16:58.412 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7189999999999998e-06 2024-04-19T02:16:58.412 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.412 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.413 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:58.413 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125391+0000", 2024-04-19T02:16:58.413 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7270000000000001e-05 2024-04-19T02:16:58.413 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.413 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.413 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:58.413 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125471+0000", 2024-04-19T02:16:58.413 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9209999999999995e-05 2024-04-19T02:16:58.413 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.413 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.413 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:58.413 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125559+0000", 2024-04-19T02:16:58.413 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.8689000000000004e-05 2024-04-19T02:16:58.413 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.414 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.414 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:58.414 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128164+0000", 2024-04-19T02:16:58.414 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0026050270000000002 2024-04-19T02:16:58.414 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.414 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.414 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:58.414 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148139+0000", 2024-04-19T02:16:58.414 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.019975050000000001 2024-04-19T02:16:58.414 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.414 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.414 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:58.414 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148169+0000", 2024-04-19T02:16:58.414 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0001e-05 2024-04-19T02:16:58.415 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.415 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.415 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:58.415 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148191+0000", 2024-04-19T02:16:58.415 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.2104999999999999e-05 2024-04-19T02:16:58.415 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:58.415 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:58.415 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:58.415 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.415 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.415 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78271 5.4 5:2982d7a6:::benchmark_data_smithi121_44835_object78270:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:58.415 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:16:58.415 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 31.221140461000001, 2024-04-19T02:16:58.416 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020841755999999999, 2024-04-19T02:16:58.416 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:58.416 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:58.416 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:58.416 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:58.416 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:58.416 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78271 2024-04-19T02:16:58.416 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.416 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:58.416 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.416 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:58.416 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:16:58.416 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:58.416 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.417 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.417 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:58.417 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:16:58.417 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:58.417 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.417 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.417 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:58.417 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132119+0000", 2024-04-19T02:16:58.417 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:58.417 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.417 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.417 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:58.418 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132185+0000", 2024-04-19T02:16:58.418 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5994000000000005e-05 2024-04-19T02:16:58.418 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.418 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.418 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:58.418 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132197+0000", 2024-04-19T02:16:58.418 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2091e-05 2024-04-19T02:16:58.418 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.418 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.418 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:58.418 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132206+0000", 2024-04-19T02:16:58.418 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.5099999999999998e-06 2024-04-19T02:16:58.418 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.418 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.419 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:58.419 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132242+0000", 2024-04-19T02:16:58.419 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5663000000000001e-05 2024-04-19T02:16:58.419 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.419 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.419 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:58.419 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132335+0000", 2024-04-19T02:16:58.419 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3275000000000004e-05 2024-04-19T02:16:58.419 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.419 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.419 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:58.419 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132432+0000", 2024-04-19T02:16:58.419 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7571000000000005e-05 2024-04-19T02:16:58.419 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.419 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.419 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:58.420 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.136706+0000", 2024-04-19T02:16:58.420 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0042738170000000001 2024-04-19T02:16:58.420 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.420 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.420 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:58.420 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152909+0000", 2024-04-19T02:16:58.420 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016202415000000001 2024-04-19T02:16:58.420 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.420 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.420 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:58.420 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152938+0000", 2024-04-19T02:16:58.420 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9740999999999999e-05 2024-04-19T02:16:58.420 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.420 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.421 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:58.421 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152962+0000", 2024-04-19T02:16:58.421 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3659000000000002e-05 2024-04-19T02:16:58.421 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:58.421 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:58.421 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:58.421 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.421 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.421 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78272 5.4 5:273e819a:::benchmark_data_smithi121_44835_object78271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:16:58.421 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:16:58.421 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 31.220651417999999, 2024-04-19T02:16:58.422 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022180163999999999, 2024-04-19T02:16:58.422 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:58.422 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:58.422 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:58.422 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:58.422 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:58.422 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78272 2024-04-19T02:16:58.422 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.422 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:58.422 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.422 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:58.422 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:16:58.423 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:58.423 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.423 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.423 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:58.423 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:16:58.423 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:58.423 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.423 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.423 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:58.423 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:16:58.423 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:58.423 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.423 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.423 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:58.424 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132690+0000", 2024-04-19T02:16:58.424 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0963000000000004e-05 2024-04-19T02:16:58.424 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.424 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.424 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:58.424 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132703+0000", 2024-04-19T02:16:58.424 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.3072e-05 2024-04-19T02:16:58.424 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.424 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.424 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:58.424 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132710+0000", 2024-04-19T02:16:58.424 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3100000000000003e-06 2024-04-19T02:16:58.424 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.424 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.424 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:58.425 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134005+0000", 2024-04-19T02:16:58.425 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001294513 2024-04-19T02:16:58.425 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.425 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.425 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:58.425 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134139+0000", 2024-04-19T02:16:58.425 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000134447 2024-04-19T02:16:58.425 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.425 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.425 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:58.425 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134284+0000", 2024-04-19T02:16:58.425 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014514399999999999 2024-04-19T02:16:58.425 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.426 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.426 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:58.426 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.139622+0000", 2024-04-19T02:16:58.426 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0053373830000000002 2024-04-19T02:16:58.426 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.426 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.426 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:58.426 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154737+0000", 2024-04-19T02:16:58.426 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015115195999999999 2024-04-19T02:16:58.426 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.426 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.427 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:58.427 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154768+0000", 2024-04-19T02:16:58.427 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0824999999999997e-05 2024-04-19T02:16:58.427 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.427 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.427 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:58.428 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154790+0000", 2024-04-19T02:16:58.428 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1999000000000001e-05 2024-04-19T02:16:58.428 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:58.428 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:58.428 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:58.428 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.428 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.428 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:94475 5.e 5:7a360208:::benchmark_data_smithi121_44835_object94474:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:58.428 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:35.118023+0000", 2024-04-19T02:16:58.428 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 23.235237477999998, 2024-04-19T02:16:58.428 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020591993999999999, 2024-04-19T02:16:58.428 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:58.429 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:58.429 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:58.429 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:58.429 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:58.429 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 94475 2024-04-19T02:16:58.429 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.429 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:58.429 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.429 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:58.429 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118023+0000", 2024-04-19T02:16:58.429 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:58.429 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.429 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.429 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:58.430 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118023+0000", 2024-04-19T02:16:58.430 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:58.430 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.430 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.430 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:58.430 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118023+0000", 2024-04-19T02:16:58.430 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:58.430 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.430 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.430 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:58.430 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118041+0000", 2024-04-19T02:16:58.430 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.8689999999999999e-05 2024-04-19T02:16:58.431 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.431 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.431 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:58.431 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118049+0000", 2024-04-19T02:16:58.431 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.5939999999999996e-06 2024-04-19T02:16:58.431 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.431 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.431 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:58.431 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118053+0000", 2024-04-19T02:16:58.431 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2080000000000002e-06 2024-04-19T02:16:58.431 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.431 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.432 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:58.432 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118093+0000", 2024-04-19T02:16:58.432 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9634e-05 2024-04-19T02:16:58.432 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.432 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.432 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:58.432 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118191+0000", 2024-04-19T02:16:58.432 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.8272999999999999e-05 2024-04-19T02:16:58.432 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.432 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.432 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:58.432 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118280+0000", 2024-04-19T02:16:58.433 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.8702999999999994e-05 2024-04-19T02:16:58.433 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.433 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.433 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:58.433 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.124833+0000", 2024-04-19T02:16:58.433 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0065528180000000002 2024-04-19T02:16:58.433 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.433 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.433 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:58.433 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.138520+0000", 2024-04-19T02:16:58.433 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.013686959 2024-04-19T02:16:58.433 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.433 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.434 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:58.434 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.138577+0000", 2024-04-19T02:16:58.434 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7689000000000003e-05 2024-04-19T02:16:58.434 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.434 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.434 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:58.434 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.138615+0000", 2024-04-19T02:16:58.434 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8016999999999999e-05 2024-04-19T02:16:58.434 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:58.434 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:58.434 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:58.434 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.434 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.435 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:94481 5.e 5:7b2fbebf:::benchmark_data_smithi121_44835_object94480:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:58.435 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:16:58.435 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 23.232015101000002, 2024-04-19T02:16:58.435 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020897846000000001, 2024-04-19T02:16:58.435 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:58.435 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:58.435 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:58.435 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:58.435 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:58.435 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 94481 2024-04-19T02:16:58.435 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.435 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:58.435 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.436 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:58.436 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:16:58.436 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:58.436 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.436 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.436 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:58.436 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:16:58.436 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:58.436 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.436 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.436 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:58.436 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121245+0000", 2024-04-19T02:16:58.436 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:58.437 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.437 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.437 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:58.437 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121273+0000", 2024-04-19T02:16:58.437 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7250000000000002e-05 2024-04-19T02:16:58.437 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.437 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.437 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:58.437 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121277+0000", 2024-04-19T02:16:58.437 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2860000000000001e-06 2024-04-19T02:16:58.437 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.437 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.438 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:58.438 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121280+0000", 2024-04-19T02:16:58.438 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2739999999999999e-06 2024-04-19T02:16:58.438 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.438 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.438 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:58.438 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121320+0000", 2024-04-19T02:16:58.438 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9879000000000002e-05 2024-04-19T02:16:58.438 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.438 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.438 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:58.438 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121448+0000", 2024-04-19T02:16:58.438 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012748800000000001 2024-04-19T02:16:58.438 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.439 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.439 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:58.439 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121595+0000", 2024-04-19T02:16:58.439 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014741299999999999 2024-04-19T02:16:58.439 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.439 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.439 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:58.439 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.127776+0000", 2024-04-19T02:16:58.439 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0061811360000000003 2024-04-19T02:16:58.439 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.439 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.439 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:58.439 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142073+0000", 2024-04-19T02:16:58.439 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014296959999999999 2024-04-19T02:16:58.440 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.440 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.440 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:58.440 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142106+0000", 2024-04-19T02:16:58.440 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3348e-05 2024-04-19T02:16:58.440 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.440 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.440 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:58.440 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142144+0000", 2024-04-19T02:16:58.440 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7153000000000002e-05 2024-04-19T02:16:58.440 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:58.440 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:58.440 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:58.441 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.441 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.441 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:94581 5.b 5:dc86d6e9:::benchmark_data_smithi121_44835_object94580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:58.441 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:16:58.441 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 23.173080528, 2024-04-19T02:16:58.441 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022099711000000001, 2024-04-19T02:16:58.441 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:58.441 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:58.441 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:58.441 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:58.441 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:58.441 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 94581 2024-04-19T02:16:58.442 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.442 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:58.442 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.442 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:58.442 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:16:58.442 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:58.442 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.442 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.442 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:58.442 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:16:58.442 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:58.442 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.442 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.443 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:58.443 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:16:58.443 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:58.443 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.443 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.443 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:58.443 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180253+0000", 2024-04-19T02:16:58.443 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3163000000000004e-05 2024-04-19T02:16:58.443 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.443 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.443 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:58.443 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180266+0000", 2024-04-19T02:16:58.443 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2886e-05 2024-04-19T02:16:58.444 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.444 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.444 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:58.444 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180273+0000", 2024-04-19T02:16:58.444 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.4059999999999999e-06 2024-04-19T02:16:58.444 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.444 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.444 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:58.444 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180646+0000", 2024-04-19T02:16:58.444 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00037283999999999999 2024-04-19T02:16:58.444 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.444 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.444 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:58.444 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180774+0000", 2024-04-19T02:16:58.444 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012793799999999999 2024-04-19T02:16:58.445 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.445 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.445 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:58.445 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180920+0000", 2024-04-19T02:16:58.445 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000146692 2024-04-19T02:16:58.445 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.445 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.445 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:58.445 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.183344+0000", 2024-04-19T02:16:58.445 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0024231669999999999 2024-04-19T02:16:58.446 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.446 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.446 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:58.446 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202196+0000", 2024-04-19T02:16:58.446 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.018852384 2024-04-19T02:16:58.446 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.446 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.446 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:58.446 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202241+0000", 2024-04-19T02:16:58.446 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4923999999999999e-05 2024-04-19T02:16:58.446 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.446 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.446 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:58.447 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202280+0000", 2024-04-19T02:16:58.447 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9096e-05 2024-04-19T02:16:58.447 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:58.447 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:58.447 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:58.447 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.447 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.447 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:96356 5.0 5:0a661b39:::benchmark_data_smithi121_44835_object96355:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:58.447 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:16:58.447 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 22.259867686, 2024-04-19T02:16:58.448 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020955516, 2024-04-19T02:16:58.448 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:58.448 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:58.448 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:58.448 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:58.448 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:58.448 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 96356 2024-04-19T02:16:58.448 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.448 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:58.448 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.449 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:58.449 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:16:58.449 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:58.449 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.449 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.449 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:58.449 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:16:58.449 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:58.449 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.449 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.449 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:58.449 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:16:58.449 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:58.449 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.450 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.450 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:58.450 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093455+0000", 2024-04-19T02:16:58.450 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.2205000000000005e-05 2024-04-19T02:16:58.450 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.450 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.450 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:58.450 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093464+0000", 2024-04-19T02:16:58.450 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3910000000000004e-06 2024-04-19T02:16:58.450 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.450 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.450 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:58.450 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093469+0000", 2024-04-19T02:16:58.450 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.7249999999999997e-06 2024-04-19T02:16:58.451 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.451 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.451 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:58.451 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099643+0000", 2024-04-19T02:16:58.451 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0061743359999999999 2024-04-19T02:16:58.451 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.451 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.451 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:58.451 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099774+0000", 2024-04-19T02:16:58.451 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013050599999999999 2024-04-19T02:16:58.451 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.451 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.451 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:58.451 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099917+0000", 2024-04-19T02:16:58.451 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000143187 2024-04-19T02:16:58.452 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.452 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.452 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:58.452 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.105432+0000", 2024-04-19T02:16:58.452 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.005514873 2024-04-19T02:16:58.452 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.452 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.452 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:58.452 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114264+0000", 2024-04-19T02:16:58.452 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.008831752 2024-04-19T02:16:58.452 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.452 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.452 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:58.452 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114300+0000", 2024-04-19T02:16:58.452 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6582000000000003e-05 2024-04-19T02:16:58.453 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.453 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.453 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:58.453 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114349+0000", 2024-04-19T02:16:58.453 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8579999999999999e-05 2024-04-19T02:16:58.453 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:58.453 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:58.453 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:58.453 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.453 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.453 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:96357 5.0 5:00efce8b:::benchmark_data_smithi121_44835_object96356:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:16:58.453 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:16:58.453 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 22.259788008000001, 2024-04-19T02:16:58.453 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020937471999999999, 2024-04-19T02:16:58.453 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:58.453 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:58.454 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:58.454 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:58.454 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:58.454 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 96357 2024-04-19T02:16:58.454 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.454 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:58.454 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.454 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:58.454 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:16:58.454 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:58.454 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.454 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.454 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:58.454 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:16:58.454 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:58.454 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.455 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.455 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:58.455 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093472+0000", 2024-04-19T02:16:58.455 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:58.455 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.455 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.455 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:58.455 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093513+0000", 2024-04-19T02:16:58.455 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0213000000000003e-05 2024-04-19T02:16:58.455 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.455 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.455 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:58.455 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093519+0000", 2024-04-19T02:16:58.455 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.066e-06 2024-04-19T02:16:58.456 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.456 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.456 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:58.456 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093525+0000", 2024-04-19T02:16:58.456 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.8170000000000004e-06 2024-04-19T02:16:58.456 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.456 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.456 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:58.456 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103412+0000", 2024-04-19T02:16:58.456 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0098872739999999997 2024-04-19T02:16:58.456 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.456 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.457 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:58.457 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103551+0000", 2024-04-19T02:16:58.457 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000139295 2024-04-19T02:16:58.457 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.457 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.457 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:58.457 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103701+0000", 2024-04-19T02:16:58.457 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014954599999999999 2024-04-19T02:16:58.457 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.457 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.457 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:58.457 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.108849+0000", 2024-04-19T02:16:58.457 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0051487199999999999 2024-04-19T02:16:58.457 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.457 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.458 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:58.458 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114355+0000", 2024-04-19T02:16:58.458 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0055052529999999999 2024-04-19T02:16:58.458 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.458 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.458 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:58.458 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114379+0000", 2024-04-19T02:16:58.458 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4275000000000001e-05 2024-04-19T02:16:58.458 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.458 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.458 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:58.458 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114410+0000", 2024-04-19T02:16:58.458 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1356999999999998e-05 2024-04-19T02:16:58.458 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:58.459 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:58.459 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:58.459 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.459 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.459 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:104431 5.8 5:14818e19:::benchmark_data_smithi121_44835_object104430:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T02:16:58.459 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:16:58.459 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 18.141875483, 2024-04-19T02:16:58.459 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022149528000000002, 2024-04-19T02:16:58.459 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:58.459 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:58.459 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:58.459 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:58.459 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:58.459 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 104431 2024-04-19T02:16:58.460 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.460 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:58.460 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.460 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:58.460 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:16:58.460 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:58.460 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.460 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.460 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:58.460 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:16:58.460 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:58.460 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.460 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.460 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:58.461 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211384+0000", 2024-04-19T02:16:58.461 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:16:58.461 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.461 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.461 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:58.461 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211458+0000", 2024-04-19T02:16:58.461 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3311000000000003e-05 2024-04-19T02:16:58.461 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.461 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.461 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:58.461 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211471+0000", 2024-04-19T02:16:58.461 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.3308e-05 2024-04-19T02:16:58.461 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.461 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.461 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:58.461 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211479+0000", 2024-04-19T02:16:58.462 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0909999999999993e-06 2024-04-19T02:16:58.462 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.462 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.462 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:58.462 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.221821+0000", 2024-04-19T02:16:58.462 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010341596999999999 2024-04-19T02:16:58.462 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.462 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.462 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:58.462 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.221966+0000", 2024-04-19T02:16:58.462 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000145167 2024-04-19T02:16:58.462 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.462 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.462 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:58.462 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.222077+0000", 2024-04-19T02:16:58.463 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011128000000000001 2024-04-19T02:16:58.463 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.463 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.463 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:58.463 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.228126+0000", 2024-04-19T02:16:58.463 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0060486710000000003 2024-04-19T02:16:58.463 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.463 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.463 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:58.463 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233449+0000", 2024-04-19T02:16:58.463 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0053231370000000004 2024-04-19T02:16:58.463 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.463 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.463 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:58.464 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233498+0000", 2024-04-19T02:16:58.464 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8798999999999998e-05 2024-04-19T02:16:58.464 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.464 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.464 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:58.464 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233535+0000", 2024-04-19T02:16:58.464 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7119000000000002e-05 2024-04-19T02:16:58.464 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:58.464 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:58.464 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:58.464 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.464 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.464 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:114200 5.8 5:1428c006:::benchmark_data_smithi121_44835_object114199:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T02:16:58.464 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:45.082288+0000", 2024-04-19T02:16:58.464 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 13.270972897, 2024-04-19T02:16:58.464 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020551719999999999, 2024-04-19T02:16:58.465 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:58.465 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:58.465 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:58.465 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:58.465 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:58.465 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 114200 2024-04-19T02:16:58.465 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.465 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:58.465 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.465 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:58.465 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.082288+0000", 2024-04-19T02:16:58.466 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:58.466 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.466 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.466 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:58.466 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.082288+0000", 2024-04-19T02:16:58.466 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:58.466 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.466 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.466 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:58.466 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.082287+0000", 2024-04-19T02:16:58.466 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:58.466 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.466 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.466 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:58.467 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.082345+0000", 2024-04-19T02:16:58.467 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7642999999999997e-05 2024-04-19T02:16:58.467 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.467 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.467 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:58.467 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.082351+0000", 2024-04-19T02:16:58.467 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.2999999999999998e-06 2024-04-19T02:16:58.467 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.467 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.467 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:58.467 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.082355+0000", 2024-04-19T02:16:58.467 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7890000000000001e-06 2024-04-19T02:16:58.467 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.467 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.468 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:58.468 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.085813+0000", 2024-04-19T02:16:58.468 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.003457636 2024-04-19T02:16:58.468 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.468 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.468 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:58.468 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.085918+0000", 2024-04-19T02:16:58.468 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010485299999999999 2024-04-19T02:16:58.468 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.468 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.468 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:58.468 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.086071+0000", 2024-04-19T02:16:58.468 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00015367199999999999 2024-04-19T02:16:58.468 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.468 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.469 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:58.469 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.092128+0000", 2024-04-19T02:16:58.469 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0060571080000000003 2024-04-19T02:16:58.469 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.469 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.469 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:58.469 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.102784+0000", 2024-04-19T02:16:58.469 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010656116 2024-04-19T02:16:58.469 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.469 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.469 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:58.469 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.102818+0000", 2024-04-19T02:16:58.469 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3661999999999997e-05 2024-04-19T02:16:58.469 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.470 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.470 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:58.470 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.102840+0000", 2024-04-19T02:16:58.470 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1509e-05 2024-04-19T02:16:58.470 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:58.470 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:58.470 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:58.470 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.470 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.470 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:121827 5.e 5:73ab8f20:::benchmark_data_smithi121_44835_object121826:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T02:16:58.470 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:48.926285+0000", 2024-04-19T02:16:58.470 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 9.4269755390000007, 2024-04-19T02:16:58.471 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020626592999999999, 2024-04-19T02:16:58.471 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:16:58.471 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:16:58.471 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:16:58.471 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:16:58.471 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:58.471 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 121827 2024-04-19T02:16:58.471 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.471 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:16:58.471 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.471 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:16:58.471 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.926285+0000", 2024-04-19T02:16:58.471 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:58.471 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.471 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.472 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:16:58.472 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.926285+0000", 2024-04-19T02:16:58.472 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:16:58.472 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.472 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.472 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:16:58.472 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.926285+0000", 2024-04-19T02:16:58.472 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:58.472 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.472 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.472 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:16:58.472 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.926306+0000", 2024-04-19T02:16:58.472 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.0659e-05 2024-04-19T02:16:58.473 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.473 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.473 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:16:58.473 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.926310+0000", 2024-04-19T02:16:58.473 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.374e-06 2024-04-19T02:16:58.473 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.473 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.473 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:16:58.473 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.926313+0000", 2024-04-19T02:16:58.473 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1879999999999998e-06 2024-04-19T02:16:58.473 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.473 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.473 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:16:58.474 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.930441+0000", 2024-04-19T02:16:58.474 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0041274220000000004 2024-04-19T02:16:58.474 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.474 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.474 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:16:58.474 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.930534+0000", 2024-04-19T02:16:58.474 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3834999999999999e-05 2024-04-19T02:16:58.474 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.474 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.474 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:16:58.474 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.930644+0000", 2024-04-19T02:16:58.474 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000110109 2024-04-19T02:16:58.474 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.475 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.475 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:58.475 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.933925+0000", 2024-04-19T02:16:58.475 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0032810349999999999 2024-04-19T02:16:58.475 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.475 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.475 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:16:58.475 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.946847+0000", 2024-04-19T02:16:58.475 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.012921807 2024-04-19T02:16:58.475 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.475 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.475 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:16:58.475 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.946875+0000", 2024-04-19T02:16:58.475 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7977e-05 2024-04-19T02:16:58.475 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:16:58.475 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:16:58.476 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:16:58.476 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.946912+0000", 2024-04-19T02:16:58.476 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6604999999999999e-05 2024-04-19T02:16:58.476 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:58.476 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:58.476 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:58.476 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:16:58.476 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:16:58.476 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:16:58.478 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:16:58.478 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:58.478+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:58.579 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:58.580+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:58.661 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-04-19T02:16:58.661 INFO:teuthology.orchestra.run.smithi177.stdout: "ops": [ 2024-04-19T02:16:58.661 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.661 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:140187 5.4 e44/16 5:2f7cadfc:::benchmark_data_smithi121_44835_object6152:head v 44'8739, mlcod=44'8736)", 2024-04-19T02:16:58.662 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:58.654867+0000", 2024-04-19T02:16:58.662 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0059217870000000004, 2024-04-19T02:16:58.662 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0059484760000000003, 2024-04-19T02:16:58.662 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:58.662 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:58.662 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:58.662 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.662 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:58.662 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.654867+0000", 2024-04-19T02:16:58.662 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:58.662 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.662 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.663 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:58.663 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.654867+0000", 2024-04-19T02:16:58.663 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:58.663 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.663 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.663 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:58.663 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.654867+0000", 2024-04-19T02:16:58.663 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:58.663 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.663 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.663 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:58.663 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.654872+0000", 2024-04-19T02:16:58.663 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.57e-06 2024-04-19T02:16:58.664 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.664 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.664 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:58.664 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.654881+0000", 2024-04-19T02:16:58.664 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.5210000000000002e-06 2024-04-19T02:16:58.664 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.664 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.664 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:58.664 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.654887+0000", 2024-04-19T02:16:58.664 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.7409999999999998e-06 2024-04-19T02:16:58.664 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.664 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.665 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:58.665 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.654915+0000", 2024-04-19T02:16:58.665 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.8527999999999999e-05 2024-04-19T02:16:58.665 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.665 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.665 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:58.665 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.654927+0000", 2024-04-19T02:16:58.665 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.1413999999999999e-05 2024-04-19T02:16:58.665 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:58.665 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:58.665 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:58.665 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.665 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.666 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:140189 5.4 e44/16 5:2b8c9c3a:::benchmark_data_smithi121_44835_object6154:head v 44'8740, mlcod=44'8736)", 2024-04-19T02:16:58.666 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:58.656780+0000", 2024-04-19T02:16:58.666 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0040094880000000003, 2024-04-19T02:16:58.666 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.004118666, 2024-04-19T02:16:58.666 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:58.666 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:58.666 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:58.666 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.666 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:58.666 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.656780+0000", 2024-04-19T02:16:58.666 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:58.666 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.667 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.667 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:58.667 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.656780+0000", 2024-04-19T02:16:58.667 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:58.667 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.667 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.667 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:58.667 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.656779+0000", 2024-04-19T02:16:58.667 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:58.667 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.667 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.668 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:58.668 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.656784+0000", 2024-04-19T02:16:58.668 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.7469999999999996e-06 2024-04-19T02:16:58.668 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.668 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.668 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:58.668 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.656790+0000", 2024-04-19T02:16:58.668 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.4359999999999999e-06 2024-04-19T02:16:58.668 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.668 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.668 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:58.668 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.656795+0000", 2024-04-19T02:16:58.669 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.2560000000000004e-06 2024-04-19T02:16:58.669 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.669 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.670 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:58.670 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.656821+0000", 2024-04-19T02:16:58.670 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.5859000000000001e-05 2024-04-19T02:16:58.670 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.670 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.670 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:58.670 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.656834+0000", 2024-04-19T02:16:58.670 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.3524e-05 2024-04-19T02:16:58.670 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:58.671 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:58.671 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:58.671 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.671 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.671 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:140191 5.c 5:3935819d:::benchmark_data_smithi121_44835_object6156:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-19T02:16:58.671 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:58.656997+0000", 2024-04-19T02:16:58.671 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0037917850000000002, 2024-04-19T02:16:58.671 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0039769369999999998, 2024-04-19T02:16:58.671 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:58.671 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:58.671 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:58.671 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:58.671 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:58.671 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 140191 2024-04-19T02:16:58.671 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.672 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:58.672 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.672 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:58.672 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.656997+0000", 2024-04-19T02:16:58.672 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:58.672 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.672 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.672 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:58.672 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.656997+0000", 2024-04-19T02:16:58.672 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:58.672 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.672 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.672 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:58.672 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.656997+0000", 2024-04-19T02:16:58.672 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:58.672 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.673 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.673 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:58.673 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.657000+0000", 2024-04-19T02:16:58.673 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.1990000000000002e-06 2024-04-19T02:16:58.673 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.673 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.673 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:58.673 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.657009+0000", 2024-04-19T02:16:58.673 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.0049999999999993e-06 2024-04-19T02:16:58.673 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.673 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.673 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:58.673 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.657015+0000", 2024-04-19T02:16:58.673 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.0759999999999999e-06 2024-04-19T02:16:58.673 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.674 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.674 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:58.674 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.657051+0000", 2024-04-19T02:16:58.674 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6198000000000001e-05 2024-04-19T02:16:58.674 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.674 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.674 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:58.674 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.657179+0000", 2024-04-19T02:16:58.674 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012744199999999999 2024-04-19T02:16:58.674 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.674 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.674 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:58.674 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.657296+0000", 2024-04-19T02:16:58.674 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000117619 2024-04-19T02:16:58.674 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.675 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.675 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:58.675 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.659107+0000", 2024-04-19T02:16:58.675 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0018109809999999999 2024-04-19T02:16:58.675 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:58.675 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:58.675 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:58.675 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.675 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.675 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:140192 5.4 e44/16 5:25555ce9:::benchmark_data_smithi121_44835_object6157:head v 44'8741, mlcod=44'8736)", 2024-04-19T02:16:58.675 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:58.658345+0000", 2024-04-19T02:16:58.675 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0024439090000000002, 2024-04-19T02:16:58.675 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0027245500000000001, 2024-04-19T02:16:58.675 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:58.675 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:58.676 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:58.676 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.676 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:58.676 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.658345+0000", 2024-04-19T02:16:58.676 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:58.676 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.676 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.676 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:58.676 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.658345+0000", 2024-04-19T02:16:58.676 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:58.676 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.676 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.676 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:58.676 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.658345+0000", 2024-04-19T02:16:58.676 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:58.676 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.677 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.677 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:58.677 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.658349+0000", 2024-04-19T02:16:58.677 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.3540000000000002e-06 2024-04-19T02:16:58.677 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.677 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.677 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:58.677 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.658356+0000", 2024-04-19T02:16:58.677 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.4969999999999998e-06 2024-04-19T02:16:58.677 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.677 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.677 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:58.677 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.658360+0000", 2024-04-19T02:16:58.677 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.6099999999999999e-06 2024-04-19T02:16:58.678 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.678 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.678 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:58.678 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.658385+0000", 2024-04-19T02:16:58.678 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.4896999999999999e-05 2024-04-19T02:16:58.678 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.678 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.678 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:58.678 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.658397+0000", 2024-04-19T02:16:58.678 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.2296000000000001e-05 2024-04-19T02:16:58.678 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:58.678 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:58.678 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:58.678 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.678 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.679 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop_reply(client.4549.0:140191 5.c e44/16 ondisk, result = 0)", 2024-04-19T02:16:58.679 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:58.658902+0000", 2024-04-19T02:16:58.679 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0018868439999999999, 2024-04-19T02:16:58.679 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0022445020000000002, 2024-04-19T02:16:58.679 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:58.679 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:58.679 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:58.679 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.679 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:58.679 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.658902+0000", 2024-04-19T02:16:58.679 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:58.679 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.679 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.679 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:58.679 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.658902+0000", 2024-04-19T02:16:58.680 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:58.680 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.680 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.680 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:58.680 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.658902+0000", 2024-04-19T02:16:58.680 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:58.680 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.680 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.680 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:58.680 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.658906+0000", 2024-04-19T02:16:58.680 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.9430000000000002e-06 2024-04-19T02:16:58.680 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.680 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.680 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:58.680 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.658913+0000", 2024-04-19T02:16:58.681 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.4950000000000002e-06 2024-04-19T02:16:58.681 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.681 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.681 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:58.681 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.658919+0000", 2024-04-19T02:16:58.681 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.784e-06 2024-04-19T02:16:58.681 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.681 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.681 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:58.681 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.659094+0000", 2024-04-19T02:16:58.681 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00017539300000000001 2024-04-19T02:16:58.681 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.681 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.681 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:58.681 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.659101+0000", 2024-04-19T02:16:58.681 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.9920000000000001e-06 2024-04-19T02:16:58.682 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:58.682 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:58.682 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:58.682 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.682 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.682 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:140196 5.5 5:a3727594:::benchmark_data_smithi121_44835_object6161:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-19T02:16:58.682 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:58.659213+0000", 2024-04-19T02:16:58.682 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.001575721, 2024-04-19T02:16:58.682 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0020180319999999999, 2024-04-19T02:16:58.682 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:58.682 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:58.682 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:58.682 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:58.682 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:58.682 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 140196 2024-04-19T02:16:58.683 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.683 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:58.683 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.683 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:58.683 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.659213+0000", 2024-04-19T02:16:58.683 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:58.684 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.684 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.684 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:58.684 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.659213+0000", 2024-04-19T02:16:58.684 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:58.684 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.684 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.684 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:58.684 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.659213+0000", 2024-04-19T02:16:58.684 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:58.684 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.684 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.684 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:58.684 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.659217+0000", 2024-04-19T02:16:58.684 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.8120000000000001e-06 2024-04-19T02:16:58.685 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.685 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.685 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:58.686 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.659228+0000", 2024-04-19T02:16:58.686 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.1066e-05 2024-04-19T02:16:58.686 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.686 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.686 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:58.686 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.659235+0000", 2024-04-19T02:16:58.686 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.7589999999999997e-06 2024-04-19T02:16:58.686 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.686 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.686 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:58.686 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.659277+0000", 2024-04-19T02:16:58.686 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.2039999999999997e-05 2024-04-19T02:16:58.686 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.686 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.687 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:58.687 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.659394+0000", 2024-04-19T02:16:58.687 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000116798 2024-04-19T02:16:58.687 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.687 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.687 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:58.687 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.659505+0000", 2024-04-19T02:16:58.687 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000110956 2024-04-19T02:16:58.687 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:58.687 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:58.687 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:58.687 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.687 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.687 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:140198 5.c 5:3dc39460:::benchmark_data_smithi121_44835_object6163:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-19T02:16:58.687 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:58.659245+0000", 2024-04-19T02:16:58.688 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.001543872, 2024-04-19T02:16:58.688 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0020785410000000002, 2024-04-19T02:16:58.688 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:58.688 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:58.688 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:58.688 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:58.688 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:58.688 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 140198 2024-04-19T02:16:58.688 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.688 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:58.688 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.688 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:58.688 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.659245+0000", 2024-04-19T02:16:58.688 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:58.688 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.688 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.689 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:58.689 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.659245+0000", 2024-04-19T02:16:58.689 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:58.689 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.689 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.689 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:58.689 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.659245+0000", 2024-04-19T02:16:58.689 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:58.689 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.689 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.689 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:58.689 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.659247+0000", 2024-04-19T02:16:58.689 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.1069999999999999e-06 2024-04-19T02:16:58.689 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.689 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.690 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:58.690 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.659253+0000", 2024-04-19T02:16:58.690 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.2020000000000001e-06 2024-04-19T02:16:58.690 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.690 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.690 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:58.690 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.659258+0000", 2024-04-19T02:16:58.690 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.933e-06 2024-04-19T02:16:58.690 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.690 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.690 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:58.690 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.659663+0000", 2024-04-19T02:16:58.690 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00040523600000000001 2024-04-19T02:16:58.690 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.690 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.690 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:58.691 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.659765+0000", 2024-04-19T02:16:58.691 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000101139 2024-04-19T02:16:58.691 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.691 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.691 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:58.691 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.659865+0000", 2024-04-19T02:16:58.691 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000100519 2024-04-19T02:16:58.691 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:58.691 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:58.691 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:58.691 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.691 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.691 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:140180 5.c 5:306c7fce:::benchmark_data_smithi121_44835_object6145:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-19T02:16:58.691 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:58.650837+0000", 2024-04-19T02:16:58.692 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0099525240000000008, 2024-04-19T02:16:58.692 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.010573076000000001, 2024-04-19T02:16:58.692 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:58.692 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:58.692 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:58.692 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:58.692 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:58.692 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 140180 2024-04-19T02:16:58.692 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.692 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:58.692 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.692 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:58.692 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.650837+0000", 2024-04-19T02:16:58.692 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:58.692 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.692 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.693 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:58.693 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.650837+0000", 2024-04-19T02:16:58.693 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:58.693 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.693 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.693 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:58.693 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.650836+0000", 2024-04-19T02:16:58.693 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:58.693 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.693 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.693 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:58.693 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.650840+0000", 2024-04-19T02:16:58.693 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.0489999999999997e-06 2024-04-19T02:16:58.693 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.693 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.693 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:58.694 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.650848+0000", 2024-04-19T02:16:58.694 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.1720000000000007e-06 2024-04-19T02:16:58.694 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.694 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.694 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:58.694 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.650859+0000", 2024-04-19T02:16:58.694 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0529e-05 2024-04-19T02:16:58.694 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.694 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.694 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:58.694 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.650906+0000", 2024-04-19T02:16:58.694 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.7524000000000001e-05 2024-04-19T02:16:58.694 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.694 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.694 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:58.695 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.651045+0000", 2024-04-19T02:16:58.695 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00013908599999999999 2024-04-19T02:16:58.695 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.695 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.695 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:58.695 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.651158+0000", 2024-04-19T02:16:58.695 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000112403 2024-04-19T02:16:58.695 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.695 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.695 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:58.695 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.655163+0000", 2024-04-19T02:16:58.695 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0040048899999999997 2024-04-19T02:16:58.695 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:58.695 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:58.695 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:58.695 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.696 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.696 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:140199 5.6 5:6ce1ad0c:::benchmark_data_smithi121_44835_object6164:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-19T02:16:58.696 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:58.659263+0000", 2024-04-19T02:16:58.696 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0015260930000000001, 2024-04-19T02:16:58.696 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0022399630000000002, 2024-04-19T02:16:58.696 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:58.696 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:58.696 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:58.696 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:58.696 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:58.696 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 140199 2024-04-19T02:16:58.696 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.696 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:58.696 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.696 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:58.697 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.659263+0000", 2024-04-19T02:16:58.697 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:58.697 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.697 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.697 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:58.697 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.659263+0000", 2024-04-19T02:16:58.697 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:58.697 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.697 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.697 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:58.697 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.659263+0000", 2024-04-19T02:16:58.697 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:58.697 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.697 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.697 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:58.697 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.659265+0000", 2024-04-19T02:16:58.698 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.8080000000000001e-06 2024-04-19T02:16:58.698 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.698 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.698 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:58.698 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.659270+0000", 2024-04-19T02:16:58.698 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.3639999999999998e-06 2024-04-19T02:16:58.698 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.698 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.698 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:58.698 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.659275+0000", 2024-04-19T02:16:58.698 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.7400000000000004e-06 2024-04-19T02:16:58.698 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.698 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.698 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:58.698 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.659332+0000", 2024-04-19T02:16:58.699 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.6975999999999998e-05 2024-04-19T02:16:58.699 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.699 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.699 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:58.699 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.659444+0000", 2024-04-19T02:16:58.699 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000112798 2024-04-19T02:16:58.699 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.699 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.699 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:58.699 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.659548+0000", 2024-04-19T02:16:58.699 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00010336900000000001 2024-04-19T02:16:58.699 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.699 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.699 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:58.699 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.661483+0000", 2024-04-19T02:16:58.699 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.001934907 2024-04-19T02:16:58.700 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:58.700 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:58.700 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:58.700 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.700 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.700 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:140193 5.8 e44/16 5:14ec140d:::benchmark_data_smithi121_44835_object6158:head v 44'8835, mlcod=44'8833)", 2024-04-19T02:16:58.700 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:58.659568+0000", 2024-04-19T02:16:58.700 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.001221375, 2024-04-19T02:16:58.700 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.002019805, 2024-04-19T02:16:58.700 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:58.700 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:58.700 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:58.700 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.700 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:58.700 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.659568+0000", 2024-04-19T02:16:58.701 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:58.701 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.701 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.701 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:58.701 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.659568+0000", 2024-04-19T02:16:58.701 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:58.701 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.701 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.701 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:58.701 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.659567+0000", 2024-04-19T02:16:58.701 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:58.701 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.701 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.701 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:58.701 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.659572+0000", 2024-04-19T02:16:58.701 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.0119999999999996e-06 2024-04-19T02:16:58.702 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.702 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.702 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:58.702 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.659579+0000", 2024-04-19T02:16:58.702 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.2310000000000001e-06 2024-04-19T02:16:58.702 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.702 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.702 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:58.702 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.659583+0000", 2024-04-19T02:16:58.702 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.5770000000000004e-06 2024-04-19T02:16:58.702 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.702 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.702 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:58.702 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.659612+0000", 2024-04-19T02:16:58.702 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.9179999999999998e-05 2024-04-19T02:16:58.703 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.703 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.703 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:58.703 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.659625+0000", 2024-04-19T02:16:58.703 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.2522e-05 2024-04-19T02:16:58.703 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:58.703 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:58.703 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:58.703 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.703 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.703 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:140183 5.c 5:332deefa:::benchmark_data_smithi121_44835_object6148:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-19T02:16:58.703 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:58.651178+0000", 2024-04-19T02:16:58.703 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0096113080000000007, 2024-04-19T02:16:58.703 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.010480945, 2024-04-19T02:16:58.703 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:58.704 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:58.704 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:58.704 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:58.704 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:58.704 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 140183 2024-04-19T02:16:58.704 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.704 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:58.704 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.704 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:58.704 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.651178+0000", 2024-04-19T02:16:58.704 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:58.704 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.704 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.704 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:58.704 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.651178+0000", 2024-04-19T02:16:58.704 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:58.705 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.705 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.705 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:58.705 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.651177+0000", 2024-04-19T02:16:58.705 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:58.705 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.705 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.705 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:58.705 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.651181+0000", 2024-04-19T02:16:58.705 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.3649999999999997e-06 2024-04-19T02:16:58.705 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.705 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.705 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:58.705 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.651190+0000", 2024-04-19T02:16:58.705 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.174e-06 2024-04-19T02:16:58.706 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.706 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.706 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:58.706 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.651197+0000", 2024-04-19T02:16:58.706 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.7030000000000006e-06 2024-04-19T02:16:58.706 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.706 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.706 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:58.706 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.652982+0000", 2024-04-19T02:16:58.706 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0017841689999999999 2024-04-19T02:16:58.706 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.706 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.706 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:58.706 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.653097+0000", 2024-04-19T02:16:58.706 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000115081 2024-04-19T02:16:58.706 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.707 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.707 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:58.707 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.653203+0000", 2024-04-19T02:16:58.707 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000106717 2024-04-19T02:16:58.707 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.707 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.707 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:16:58.707 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.655409+0000", 2024-04-19T02:16:58.707 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0022060360000000002 2024-04-19T02:16:58.707 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:58.707 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:58.707 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:58.707 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.707 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.707 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:140201 5.5 5:a49d1b67:::benchmark_data_smithi121_44835_object6166:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-19T02:16:58.708 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:58.660021+0000", 2024-04-19T02:16:58.708 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.00076774299999999998, 2024-04-19T02:16:58.708 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0017233579999999999, 2024-04-19T02:16:58.708 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:58.708 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:16:58.708 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:58.708 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:58.708 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:58.708 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 140201 2024-04-19T02:16:58.708 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.708 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:58.708 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.708 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:58.708 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.660021+0000", 2024-04-19T02:16:58.708 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:58.708 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.709 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.709 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:58.709 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.660021+0000", 2024-04-19T02:16:58.709 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:58.709 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.709 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.709 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:58.709 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.660021+0000", 2024-04-19T02:16:58.709 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:58.709 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.709 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.709 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:58.709 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.660025+0000", 2024-04-19T02:16:58.709 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.5800000000000002e-06 2024-04-19T02:16:58.709 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.710 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.710 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:58.710 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.660039+0000", 2024-04-19T02:16:58.710 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.4017e-05 2024-04-19T02:16:58.710 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.710 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.710 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:58.710 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.660051+0000", 2024-04-19T02:16:58.710 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.1681999999999999e-05 2024-04-19T02:16:58.710 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.710 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.710 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:58.710 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.660934+0000", 2024-04-19T02:16:58.710 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00088312999999999998 2024-04-19T02:16:58.710 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.711 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.711 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:58.711 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.661024+0000", 2024-04-19T02:16:58.711 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.0234000000000004e-05 2024-04-19T02:16:58.711 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.711 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.711 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:16:58.711 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.661127+0000", 2024-04-19T02:16:58.711 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00010244800000000001 2024-04-19T02:16:58.711 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:58.711 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:58.711 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:58.711 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.711 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.711 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:140194 5.8 e44/16 5:1527680d:::benchmark_data_smithi121_44835_object6159:head v 44'8836, mlcod=44'8833)", 2024-04-19T02:16:58.712 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:58.661357+0000", 2024-04-19T02:16:58.712 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4294967295.9994326, 2024-04-19T02:16:58.712 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00047694499999999999, 2024-04-19T02:16:58.712 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:58.712 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:16:58.712 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:58.712 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.712 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:58.712 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.661357+0000", 2024-04-19T02:16:58.712 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:58.712 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.712 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.712 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:58.712 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.661357+0000", 2024-04-19T02:16:58.712 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:58.712 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.713 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.713 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:58.713 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.661356+0000", 2024-04-19T02:16:58.713 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:16:58.713 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.713 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.713 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:58.713 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.661361+0000", 2024-04-19T02:16:58.713 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.3029999999999999e-06 2024-04-19T02:16:58.713 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.713 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.713 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:58.713 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.661368+0000", 2024-04-19T02:16:58.713 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.1229999999999997e-06 2024-04-19T02:16:58.713 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.714 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.714 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:58.714 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.661372+0000", 2024-04-19T02:16:58.714 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.4989999999999996e-06 2024-04-19T02:16:58.714 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.714 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.714 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:16:58.714 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.661399+0000", 2024-04-19T02:16:58.714 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.6811000000000001e-05 2024-04-19T02:16:58.714 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.714 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.714 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:16:58.714 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.661410+0000", 2024-04-19T02:16:58.714 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.1564e-05 2024-04-19T02:16:58.714 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:58.714 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:58.715 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:58.715 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.715 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.715 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:140203 5.5 5.cb648255 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-19T02:16:58.715 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:58.661792+0000", 2024-04-19T02:16:58.715 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4294967295.9989977, 2024-04-19T02:16:58.715 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00011516200000000001, 2024-04-19T02:16:58.715 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:16:58.715 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "queued for pg", 2024-04-19T02:16:58.715 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:16:58.715 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:16:58.715 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:16:58.715 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 140203 2024-04-19T02:16:58.715 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.715 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:16:58.716 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.716 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:16:58.716 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.661792+0000", 2024-04-19T02:16:58.716 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:58.716 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.716 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.716 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:16:58.716 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.661792+0000", 2024-04-19T02:16:58.716 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:16:58.716 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.716 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.716 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:16:58.716 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.661791+0000", 2024-04-19T02:16:58.716 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:16:58.716 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.717 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.717 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:16:58.717 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.661796+0000", 2024-04-19T02:16:58.717 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.9099999999999996e-06 2024-04-19T02:16:58.717 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.717 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.717 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:16:58.717 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.661806+0000", 2024-04-19T02:16:58.717 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.011e-05 2024-04-19T02:16:58.717 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:16:58.717 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:16:58.717 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:16:58.717 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:58.661814+0000", 2024-04-19T02:16:58.717 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.2339999999999994e-06 2024-04-19T02:16:58.717 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:58.717 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:16:58.718 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:58.718 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:16:58.718 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2024-04-19T02:16:58.718 INFO:teuthology.orchestra.run.smithi177.stdout: "num_ops": 14 2024-04-19T02:16:58.718 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-04-19T02:16:58.718 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:16:58.720 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:16:58.720 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:58.719+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:58.820 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:58.821+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:58.920 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:58.921+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:58.943 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-04-19T02:16:58.943 INFO:teuthology.orchestra.run.smithi177.stdout: "ops": [], 2024-04-19T02:16:58.943 INFO:teuthology.orchestra.run.smithi177.stdout: "complaint_time": 30, 2024-04-19T02:16:58.943 INFO:teuthology.orchestra.run.smithi177.stdout: "num_blocked_ops": 0 2024-04-19T02:16:58.943 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-04-19T02:16:58.947 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:16:58.956 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:16:59.042 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:59.042+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:59.064 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:16:59.066 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-04-19T02:16:59.075 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2024-04-19T02:16:58.754020+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":8513784690,"num_objects":129926,"num_object_clones":0,"num_object_copies":259852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":847,"num_objects_unfound":0,"num_objects_dirty":129926,"num_whiteouts":0,"num_read":137,"num_read_kb":119,"num_write":138412,"num_write_kb":8581523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5595,"num_bytes_recovered":366673920,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60159,"ondisk_log_size":60159,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":243,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":17734472,"kb_used_data":17224996,"kb_used_omap":4,"kb_used_meta":508411,"kb_avail":265381048,"statfs":{"total":289910292480,"available":271750193152,"internally_reserved":0,"allocated":17638395904,"data_stored":17637402576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":520613202},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,6,4,6,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":678428696,"num_objects":10353,"num_object_clones":0,"num_object_copies":20706,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-1612,"num_objects_unfound":0,"num_objects_dirty":10353,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":18615,"num_write_kb":926913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1822,"num_bytes_recovered":119406592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001236"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.168504+0000","last_change":"2024-04-19T02:15:29.280412+0000","last_active":"2024-04-19T02:16:53.168504+0000","last_peered":"2024-04-19T02:16:53.168504+0000","last_clean":"2024-04-19T02:16:53.168504+0000","last_became_active":"2024-04-19T02:15:29.278762+0000","last_became_peered":"2024-04-19T02:15:29.278762+0000","last_unstale":"2024-04-19T02:16:53.168504+0000","last_undegraded":"2024-04-19T02:16:53.168504+0000","last_fullsized":"2024-04-19T02:16:53.168504+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:45.301675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.166590+0000","last_change":"2024-04-19T02:15:29.284695+0000","last_active":"2024-04-19T02:16:53.166590+0000","last_peered":"2024-04-19T02:16:53.166590+0000","last_clean":"2024-04-19T02:16:53.166590+0000","last_became_active":"2024-04-19T02:15:29.283468+0000","last_became_peered":"2024-04-19T02:15:29.283468+0000","last_unstale":"2024-04-19T02:16:53.166590+0000","last_undegraded":"2024-04-19T02:16:53.166590+0000","last_fullsized":"2024-04-19T02:16:53.166590+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.384881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.172303+0000","last_change":"2024-04-19T02:15:29.286709+0000","last_active":"2024-04-19T02:16:53.172303+0000","last_peered":"2024-04-19T02:16:53.172303+0000","last_clean":"2024-04-19T02:16:53.172303+0000","last_became_active":"2024-04-19T02:15:29.286169+0000","last_became_peered":"2024-04-19T02:15:29.286169+0000","last_unstale":"2024-04-19T02:16:53.172303+0000","last_undegraded":"2024-04-19T02:16:53.172303+0000","last_fullsized":"2024-04-19T02:16:53.172303+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:58.741466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.172272+0000","last_change":"2024-04-19T02:15:29.280131+0000","last_active":"2024-04-19T02:16:53.172272+0000","last_peered":"2024-04-19T02:16:53.172272+0000","last_clean":"2024-04-19T02:16:53.172272+0000","last_became_active":"2024-04-19T02:15:29.279388+0000","last_became_peered":"2024-04-19T02:15:29.279388+0000","last_unstale":"2024-04-19T02:16:53.172272+0000","last_undegraded":"2024-04-19T02:16:53.172272+0000","last_fullsized":"2024-04-19T02:16:53.172272+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:36:48.819486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":38,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.173955+0000","last_change":"2024-04-19T02:15:53.955892+0000","last_active":"2024-04-19T02:16:53.173955+0000","last_peered":"2024-04-19T02:16:53.173955+0000","last_clean":"2024-04-19T02:16:53.173955+0000","last_became_active":"2024-04-19T02:15:53.955553+0000","last_became_peered":"2024-04-19T02:15:53.955553+0000","last_unstale":"2024-04-19T02:16:53.173955+0000","last_undegraded":"2024-04-19T02:16:53.173955+0000","last_fullsized":"2024-04-19T02:16:53.173955+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:45:39.791209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171426+0000","last_change":"2024-04-19T02:15:29.283908+0000","last_active":"2024-04-19T02:16:53.171426+0000","last_peered":"2024-04-19T02:16:53.171426+0000","last_clean":"2024-04-19T02:16:53.171426+0000","last_became_active":"2024-04-19T02:15:29.281729+0000","last_became_peered":"2024-04-19T02:15:29.281729+0000","last_unstale":"2024-04-19T02:16:53.171426+0000","last_undegraded":"2024-04-19T02:16:53.171426+0000","last_fullsized":"2024-04-19T02:16:53.171426+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:03:15.383476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171270+0000","last_change":"2024-04-19T02:15:29.281253+0000","last_active":"2024-04-19T02:16:53.171270+0000","last_peered":"2024-04-19T02:16:53.171270+0000","last_clean":"2024-04-19T02:16:53.171270+0000","last_became_active":"2024-04-19T02:15:29.279951+0000","last_became_peered":"2024-04-19T02:15:29.279951+0000","last_unstale":"2024-04-19T02:16:53.171270+0000","last_undegraded":"2024-04-19T02:16:53.171270+0000","last_fullsized":"2024-04-19T02:16:53.171270+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171170+0000","last_change":"2024-04-19T02:15:29.283952+0000","last_active":"2024-04-19T02:16:53.171170+0000","last_peered":"2024-04-19T02:16:53.171170+0000","last_clean":"2024-04-19T02:16:53.171170+0000","last_became_active":"2024-04-19T02:15:29.282721+0000","last_became_peered":"2024-04-19T02:15:29.282721+0000","last_unstale":"2024-04-19T02:16:53.171170+0000","last_undegraded":"2024-04-19T02:16:53.171170+0000","last_fullsized":"2024-04-19T02:16:53.171170+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:45.301675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.170137+0000","last_change":"2024-04-19T02:15:29.282150+0000","last_active":"2024-04-19T02:16:53.170137+0000","last_peered":"2024-04-19T02:16:53.170137+0000","last_clean":"2024-04-19T02:16:53.170137+0000","last_became_active":"2024-04-19T02:15:29.281538+0000","last_became_peered":"2024-04-19T02:15:29.281538+0000","last_unstale":"2024-04-19T02:16:53.170137+0000","last_undegraded":"2024-04-19T02:16:53.170137+0000","last_fullsized":"2024-04-19T02:16:53.170137+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.172047+0000","last_change":"2024-04-19T02:16:30.093524+0000","last_active":"2024-04-19T02:16:53.172047+0000","last_peered":"2024-04-19T02:16:53.172047+0000","last_clean":"2024-04-19T02:16:53.172047+0000","last_became_active":"2024-04-19T02:16:30.093344+0000","last_became_peered":"2024-04-19T02:16:30.093344+0000","last_unstale":"2024-04-19T02:16:53.172047+0000","last_undegraded":"2024-04-19T02:16:53.172047+0000","last_fullsized":"2024-04-19T02:16:53.172047+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:14:40.293159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.172181+0000","last_change":"2024-04-19T02:15:29.280606+0000","last_active":"2024-04-19T02:16:53.172181+0000","last_peered":"2024-04-19T02:16:53.172181+0000","last_clean":"2024-04-19T02:16:53.172181+0000","last_became_active":"2024-04-19T02:15:29.280151+0000","last_became_peered":"2024-04-19T02:15:29.280151+0000","last_unstale":"2024-04-19T02:16:53.172181+0000","last_undegraded":"2024-04-19T02:16:53.172181+0000","last_fullsized":"2024-04-19T02:16:53.172181+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:26:22.452488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":38,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.172018+0000","last_change":"2024-04-19T02:15:53.958876+0000","last_active":"2024-04-19T02:16:53.172018+0000","last_peered":"2024-04-19T02:16:53.172018+0000","last_clean":"2024-04-19T02:16:53.172018+0000","last_became_active":"2024-04-19T02:15:53.958626+0000","last_became_peered":"2024-04-19T02:15:53.958626+0000","last_unstale":"2024-04-19T02:16:53.172018+0000","last_undegraded":"2024-04-19T02:16:53.172018+0000","last_fullsized":"2024-04-19T02:16:53.172018+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:23:57.044018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":38,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.170972+0000","last_change":"2024-04-19T02:15:53.956801+0000","last_active":"2024-04-19T02:16:53.170972+0000","last_peered":"2024-04-19T02:16:53.170972+0000","last_clean":"2024-04-19T02:16:53.170972+0000","last_became_active":"2024-04-19T02:15:53.956620+0000","last_became_peered":"2024-04-19T02:15:53.956620+0000","last_unstale":"2024-04-19T02:16:53.170972+0000","last_undegraded":"2024-04-19T02:16:53.170972+0000","last_fullsized":"2024-04-19T02:16:53.170972+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:57:05.843101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171651+0000","last_change":"2024-04-19T02:15:29.284262+0000","last_active":"2024-04-19T02:16:53.171651+0000","last_peered":"2024-04-19T02:16:53.171651+0000","last_clean":"2024-04-19T02:16:53.171651+0000","last_became_active":"2024-04-19T02:15:29.283121+0000","last_became_peered":"2024-04-19T02:15:29.283121+0000","last_unstale":"2024-04-19T02:16:53.171651+0000","last_undegraded":"2024-04-19T02:16:53.171651+0000","last_fullsized":"2024-04-19T02:16:53.171651+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171369+0000","last_change":"2024-04-19T02:15:29.285139+0000","last_active":"2024-04-19T02:16:53.171369+0000","last_peered":"2024-04-19T02:16:53.171369+0000","last_clean":"2024-04-19T02:16:53.171369+0000","last_became_active":"2024-04-19T02:15:29.284649+0000","last_became_peered":"2024-04-19T02:15:29.284649+0000","last_unstale":"2024-04-19T02:16:53.171369+0000","last_undegraded":"2024-04-19T02:16:53.171369+0000","last_fullsized":"2024-04-19T02:16:53.171369+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171199+0000","last_change":"2024-04-19T02:15:29.283648+0000","last_active":"2024-04-19T02:16:53.171199+0000","last_peered":"2024-04-19T02:16:53.171199+0000","last_clean":"2024-04-19T02:16:53.171199+0000","last_became_active":"2024-04-19T02:15:29.281606+0000","last_became_peered":"2024-04-19T02:15:29.281606+0000","last_unstale":"2024-04-19T02:16:53.171199+0000","last_undegraded":"2024-04-19T02:16:53.171199+0000","last_fullsized":"2024-04-19T02:16:53.171199+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.170164+0000","last_change":"2024-04-19T02:15:29.278673+0000","last_active":"2024-04-19T02:16:53.170164+0000","last_peered":"2024-04-19T02:16:53.170164+0000","last_clean":"2024-04-19T02:16:53.170164+0000","last_became_active":"2024-04-19T02:15:29.277699+0000","last_became_peered":"2024-04-19T02:15:29.277699+0000","last_unstale":"2024-04-19T02:16:53.170164+0000","last_undegraded":"2024-04-19T02:16:53.170164+0000","last_fullsized":"2024-04-19T02:16:53.170164+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.166891+0000","last_change":"2024-04-19T02:15:29.283341+0000","last_active":"2024-04-19T02:16:53.166891+0000","last_peered":"2024-04-19T02:16:53.166891+0000","last_clean":"2024-04-19T02:16:53.166891+0000","last_became_active":"2024-04-19T02:15:29.281591+0000","last_became_peered":"2024-04-19T02:15:29.281591+0000","last_unstale":"2024-04-19T02:16:53.166891+0000","last_undegraded":"2024-04-19T02:16:53.166891+0000","last_fullsized":"2024-04-19T02:16:53.166891+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:34.593754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.169579+0000","last_change":"2024-04-19T02:15:29.282110+0000","last_active":"2024-04-19T02:16:53.169579+0000","last_peered":"2024-04-19T02:16:53.169579+0000","last_clean":"2024-04-19T02:16:53.169579+0000","last_became_active":"2024-04-19T02:15:29.281716+0000","last_became_peered":"2024-04-19T02:15:29.281716+0000","last_unstale":"2024-04-19T02:16:53.169579+0000","last_undegraded":"2024-04-19T02:16:53.169579+0000","last_fullsized":"2024-04-19T02:16:53.169579+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.172196+0000","last_change":"2024-04-19T02:15:29.285237+0000","last_active":"2024-04-19T02:16:53.172196+0000","last_peered":"2024-04-19T02:16:53.172196+0000","last_clean":"2024-04-19T02:16:53.172196+0000","last_became_active":"2024-04-19T02:15:29.282790+0000","last_became_peered":"2024-04-19T02:15:29.282790+0000","last_unstale":"2024-04-19T02:16:53.172196+0000","last_undegraded":"2024-04-19T02:16:53.172196+0000","last_fullsized":"2024-04-19T02:16:53.172196+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171642+0000","last_change":"2024-04-19T02:15:29.282609+0000","last_active":"2024-04-19T02:16:53.171642+0000","last_peered":"2024-04-19T02:16:53.171642+0000","last_clean":"2024-04-19T02:16:53.171642+0000","last_became_active":"2024-04-19T02:15:29.281665+0000","last_became_peered":"2024-04-19T02:15:29.281665+0000","last_unstale":"2024-04-19T02:16:53.171642+0000","last_undegraded":"2024-04-19T02:16:53.171642+0000","last_fullsized":"2024-04-19T02:16:53.171642+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.384881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":38,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171339+0000","last_change":"2024-04-19T02:15:53.955813+0000","last_active":"2024-04-19T02:16:53.171339+0000","last_peered":"2024-04-19T02:16:53.171339+0000","last_clean":"2024-04-19T02:16:53.171339+0000","last_became_active":"2024-04-19T02:15:53.955614+0000","last_became_peered":"2024-04-19T02:15:53.955614+0000","last_unstale":"2024-04-19T02:16:53.171339+0000","last_undegraded":"2024-04-19T02:16:53.171339+0000","last_fullsized":"2024-04-19T02:16:53.171339+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:58:03.192647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.169682+0000","last_change":"2024-04-19T02:15:29.277109+0000","last_active":"2024-04-19T02:16:53.169682+0000","last_peered":"2024-04-19T02:16:53.169682+0000","last_clean":"2024-04-19T02:16:53.169682+0000","last_became_active":"2024-04-19T02:15:29.275417+0000","last_became_peered":"2024-04-19T02:15:29.275417+0000","last_unstale":"2024-04-19T02:16:53.169682+0000","last_undegraded":"2024-04-19T02:16:53.169682+0000","last_fullsized":"2024-04-19T02:16:53.169682+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.166424+0000","last_change":"2024-04-19T02:15:29.283266+0000","last_active":"2024-04-19T02:16:53.166424+0000","last_peered":"2024-04-19T02:16:53.166424+0000","last_clean":"2024-04-19T02:16:53.166424+0000","last_became_active":"2024-04-19T02:15:29.281505+0000","last_became_peered":"2024-04-19T02:15:29.281505+0000","last_unstale":"2024-04-19T02:16:53.166424+0000","last_undegraded":"2024-04-19T02:16:53.166424+0000","last_fullsized":"2024-04-19T02:16:53.166424+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.168463+0000","last_change":"2024-04-19T02:15:29.278084+0000","last_active":"2024-04-19T02:16:53.168463+0000","last_peered":"2024-04-19T02:16:53.168463+0000","last_clean":"2024-04-19T02:16:53.168463+0000","last_became_active":"2024-04-19T02:15:29.276952+0000","last_became_peered":"2024-04-19T02:15:29.276952+0000","last_unstale":"2024-04-19T02:16:53.168463+0000","last_undegraded":"2024-04-19T02:16:53.168463+0000","last_fullsized":"2024-04-19T02:16:53.168463+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.174513+0000","last_change":"2024-04-19T02:15:29.279904+0000","last_active":"2024-04-19T02:16:53.174513+0000","last_peered":"2024-04-19T02:16:53.174513+0000","last_clean":"2024-04-19T02:16:53.174513+0000","last_became_active":"2024-04-19T02:15:29.278938+0000","last_became_peered":"2024-04-19T02:15:29.278938+0000","last_unstale":"2024-04-19T02:16:53.174513+0000","last_undegraded":"2024-04-19T02:16:53.174513+0000","last_fullsized":"2024-04-19T02:16:53.174513+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.172221+0000","last_change":"2024-04-19T02:15:29.287389+0000","last_active":"2024-04-19T02:16:53.172221+0000","last_peered":"2024-04-19T02:16:53.172221+0000","last_clean":"2024-04-19T02:16:53.172221+0000","last_became_active":"2024-04-19T02:15:29.286431+0000","last_became_peered":"2024-04-19T02:15:29.286431+0000","last_unstale":"2024-04-19T02:16:53.172221+0000","last_undegraded":"2024-04-19T02:16:53.172221+0000","last_fullsized":"2024-04-19T02:16:53.172221+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:58:30.117887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":38,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.169717+0000","last_change":"2024-04-19T02:15:53.959207+0000","last_active":"2024-04-19T02:16:53.169717+0000","last_peered":"2024-04-19T02:16:53.169717+0000","last_clean":"2024-04-19T02:16:53.169717+0000","last_became_active":"2024-04-19T02:15:53.959007+0000","last_became_peered":"2024-04-19T02:15:53.959007+0000","last_unstale":"2024-04-19T02:16:53.169717+0000","last_undegraded":"2024-04-19T02:16:53.169717+0000","last_fullsized":"2024-04-19T02:16:53.169717+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:08:21.065077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.167183+0000","last_change":"2024-04-19T02:15:29.281792+0000","last_active":"2024-04-19T02:16:53.167183+0000","last_peered":"2024-04-19T02:16:53.167183+0000","last_clean":"2024-04-19T02:16:53.167183+0000","last_became_active":"2024-04-19T02:15:29.280479+0000","last_became_peered":"2024-04-19T02:15:29.280479+0000","last_unstale":"2024-04-19T02:16:53.167183+0000","last_undegraded":"2024-04-19T02:16:53.167183+0000","last_fullsized":"2024-04-19T02:16:53.167183+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":40,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.169759+0000","last_change":"2024-04-19T02:15:28.888778+0000","last_active":"2024-04-19T02:16:53.169759+0000","last_peered":"2024-04-19T02:16:53.169759+0000","last_clean":"2024-04-19T02:16:53.169759+0000","last_became_active":"2024-04-19T02:15:28.888543+0000","last_became_peered":"2024-04-19T02:15:28.888543+0000","last_unstale":"2024-04-19T02:16:53.169759+0000","last_undegraded":"2024-04-19T02:16:53.169759+0000","last_fullsized":"2024-04-19T02:16:53.169759+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:43:51.221619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.174171+0000","last_change":"2024-04-19T02:15:29.279986+0000","last_active":"2024-04-19T02:16:53.174171+0000","last_peered":"2024-04-19T02:16:53.174171+0000","last_clean":"2024-04-19T02:16:53.174171+0000","last_became_active":"2024-04-19T02:15:29.279690+0000","last_became_peered":"2024-04-19T02:15:29.279690+0000","last_unstale":"2024-04-19T02:16:53.174171+0000","last_undegraded":"2024-04-19T02:16:53.174171+0000","last_fullsized":"2024-04-19T02:16:53.174171+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":40,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.174384+0000","last_change":"2024-04-19T02:15:28.890463+0000","last_active":"2024-04-19T02:16:53.174384+0000","last_peered":"2024-04-19T02:16:53.174384+0000","last_clean":"2024-04-19T02:16:53.174384+0000","last_became_active":"2024-04-19T02:15:28.889777+0000","last_became_peered":"2024-04-19T02:15:28.889777+0000","last_unstale":"2024-04-19T02:16:53.174384+0000","last_undegraded":"2024-04-19T02:16:53.174384+0000","last_fullsized":"2024-04-19T02:16:53.174384+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:58:21.520250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.168413+0000","last_change":"2024-04-19T02:15:29.280879+0000","last_active":"2024-04-19T02:16:53.168413+0000","last_peered":"2024-04-19T02:16:53.168413+0000","last_clean":"2024-04-19T02:16:53.168413+0000","last_became_active":"2024-04-19T02:15:29.279314+0000","last_became_peered":"2024-04-19T02:15:29.279314+0000","last_unstale":"2024-04-19T02:16:53.168413+0000","last_undegraded":"2024-04-19T02:16:53.168413+0000","last_fullsized":"2024-04-19T02:16:53.168413+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":40,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.170284+0000","last_change":"2024-04-19T02:15:28.891867+0000","last_active":"2024-04-19T02:16:53.170284+0000","last_peered":"2024-04-19T02:16:53.170284+0000","last_clean":"2024-04-19T02:16:53.170284+0000","last_became_active":"2024-04-19T02:15:28.890806+0000","last_became_peered":"2024-04-19T02:15:28.890806+0000","last_unstale":"2024-04-19T02:16:53.170284+0000","last_undegraded":"2024-04-19T02:16:53.170284+0000","last_fullsized":"2024-04-19T02:16:53.170284+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:57.946581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.174244+0000","last_change":"2024-04-19T02:15:29.278148+0000","last_active":"2024-04-19T02:16:53.174244+0000","last_peered":"2024-04-19T02:16:53.174244+0000","last_clean":"2024-04-19T02:16:53.174244+0000","last_became_active":"2024-04-19T02:15:29.277402+0000","last_became_peered":"2024-04-19T02:15:29.277402+0000","last_unstale":"2024-04-19T02:16:53.174244+0000","last_undegraded":"2024-04-19T02:16:53.174244+0000","last_fullsized":"2024-04-19T02:16:53.174244+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":40,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.172194+0000","last_change":"2024-04-19T02:15:28.892905+0000","last_active":"2024-04-19T02:16:53.172194+0000","last_peered":"2024-04-19T02:16:53.172194+0000","last_clean":"2024-04-19T02:16:53.172194+0000","last_became_active":"2024-04-19T02:15:28.892541+0000","last_became_peered":"2024-04-19T02:15:28.892541+0000","last_unstale":"2024-04-19T02:16:53.172194+0000","last_undegraded":"2024-04-19T02:16:53.172194+0000","last_fullsized":"2024-04-19T02:16:53.172194+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:33.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.169837+0000","last_change":"2024-04-19T02:15:29.278810+0000","last_active":"2024-04-19T02:16:53.169837+0000","last_peered":"2024-04-19T02:16:53.169837+0000","last_clean":"2024-04-19T02:16:53.169837+0000","last_became_active":"2024-04-19T02:15:29.278093+0000","last_became_peered":"2024-04-19T02:15:29.278093+0000","last_unstale":"2024-04-19T02:16:53.169837+0000","last_undegraded":"2024-04-19T02:16:53.169837+0000","last_fullsized":"2024-04-19T02:16:53.169837+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:34.883207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":43,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.166764+0000","last_change":"2024-04-19T02:15:28.892937+0000","last_active":"2024-04-19T02:16:53.166764+0000","last_peered":"2024-04-19T02:16:53.166764+0000","last_clean":"2024-04-19T02:16:53.166764+0000","last_became_active":"2024-04-19T02:15:28.891440+0000","last_became_peered":"2024-04-19T02:15:28.891440+0000","last_unstale":"2024-04-19T02:16:53.166764+0000","last_undegraded":"2024-04-19T02:16:53.166764+0000","last_fullsized":"2024-04-19T02:16:53.166764+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.169552+0000","last_change":"2024-04-19T02:15:29.278404+0000","last_active":"2024-04-19T02:16:53.169552+0000","last_peered":"2024-04-19T02:16:53.169552+0000","last_clean":"2024-04-19T02:16:53.169552+0000","last_became_active":"2024-04-19T02:15:29.277460+0000","last_became_peered":"2024-04-19T02:15:29.277460+0000","last_unstale":"2024-04-19T02:16:53.169552+0000","last_undegraded":"2024-04-19T02:16:53.169552+0000","last_fullsized":"2024-04-19T02:16:53.169552+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":46,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.172111+0000","last_change":"2024-04-19T02:15:28.891097+0000","last_active":"2024-04-19T02:16:53.172111+0000","last_peered":"2024-04-19T02:16:53.172111+0000","last_clean":"2024-04-19T02:16:53.172111+0000","last_became_active":"2024-04-19T02:15:28.890795+0000","last_became_peered":"2024-04-19T02:15:28.890795+0000","last_unstale":"2024-04-19T02:16:53.172111+0000","last_undegraded":"2024-04-19T02:16:53.172111+0000","last_fullsized":"2024-04-19T02:16:53.172111+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171835+0000","last_change":"2024-04-19T02:15:29.278546+0000","last_active":"2024-04-19T02:16:53.171835+0000","last_peered":"2024-04-19T02:16:53.171835+0000","last_clean":"2024-04-19T02:16:53.171835+0000","last_became_active":"2024-04-19T02:15:29.277547+0000","last_became_peered":"2024-04-19T02:15:29.277547+0000","last_unstale":"2024-04-19T02:16:53.171835+0000","last_undegraded":"2024-04-19T02:16:53.171835+0000","last_fullsized":"2024-04-19T02:16:53.171835+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":42,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171799+0000","last_change":"2024-04-19T02:15:28.892977+0000","last_active":"2024-04-19T02:16:53.171799+0000","last_peered":"2024-04-19T02:16:53.171799+0000","last_clean":"2024-04-19T02:16:53.171799+0000","last_became_active":"2024-04-19T02:15:28.892636+0000","last_became_peered":"2024-04-19T02:15:28.892636+0000","last_unstale":"2024-04-19T02:16:53.171799+0000","last_undegraded":"2024-04-19T02:16:53.171799+0000","last_fullsized":"2024-04-19T02:16:53.171799+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:43:51.221619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":38,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.170671+0000","last_change":"2024-04-19T02:15:53.955655+0000","last_active":"2024-04-19T02:16:53.170671+0000","last_peered":"2024-04-19T02:16:53.170671+0000","last_clean":"2024-04-19T02:16:53.170671+0000","last_became_active":"2024-04-19T02:15:53.955382+0000","last_became_peered":"2024-04-19T02:15:53.955382+0000","last_unstale":"2024-04-19T02:16:53.170671+0000","last_undegraded":"2024-04-19T02:16:53.170671+0000","last_fullsized":"2024-04-19T02:16:53.170671+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:48.239260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":40,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.169664+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:16:53.169664+0000","last_peered":"2024-04-19T02:16:53.169664+0000","last_clean":"2024-04-19T02:16:53.169664+0000","last_became_active":"2024-04-19T02:15:28.890751+0000","last_became_peered":"2024-04-19T02:15:28.890751+0000","last_unstale":"2024-04-19T02:16:53.169664+0000","last_undegraded":"2024-04-19T02:16:53.169664+0000","last_fullsized":"2024-04-19T02:16:53.169664+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":38,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.169285+0000","last_change":"2024-04-19T02:15:53.957865+0000","last_active":"2024-04-19T02:16:53.169285+0000","last_peered":"2024-04-19T02:16:53.169285+0000","last_clean":"2024-04-19T02:16:53.169285+0000","last_became_active":"2024-04-19T02:15:53.957627+0000","last_became_peered":"2024-04-19T02:15:53.957627+0000","last_unstale":"2024-04-19T02:16:53.169285+0000","last_undegraded":"2024-04-19T02:16:53.169285+0000","last_fullsized":"2024-04-19T02:16:53.169285+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:16:45.799016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":40,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.167415+0000","last_change":"2024-04-19T02:15:28.892934+0000","last_active":"2024-04-19T02:16:53.167415+0000","last_peered":"2024-04-19T02:16:53.167415+0000","last_clean":"2024-04-19T02:16:53.167415+0000","last_became_active":"2024-04-19T02:15:28.891879+0000","last_became_peered":"2024-04-19T02:15:28.891879+0000","last_unstale":"2024-04-19T02:16:53.167415+0000","last_undegraded":"2024-04-19T02:16:53.167415+0000","last_fullsized":"2024-04-19T02:16:53.167415+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:10:12.514798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.174363+0000","last_change":"2024-04-19T02:15:29.279685+0000","last_active":"2024-04-19T02:16:53.174363+0000","last_peered":"2024-04-19T02:16:53.174363+0000","last_clean":"2024-04-19T02:16:53.174363+0000","last_became_active":"2024-04-19T02:15:29.278810+0000","last_became_peered":"2024-04-19T02:15:29.278810+0000","last_unstale":"2024-04-19T02:16:53.174363+0000","last_undegraded":"2024-04-19T02:16:53.174363+0000","last_fullsized":"2024-04-19T02:16:53.174363+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":48,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171392+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:16:53.171392+0000","last_peered":"2024-04-19T02:16:53.171392+0000","last_clean":"2024-04-19T02:16:53.171392+0000","last_became_active":"2024-04-19T02:15:28.890882+0000","last_became_peered":"2024-04-19T02:15:28.890882+0000","last_unstale":"2024-04-19T02:16:53.171392+0000","last_undegraded":"2024-04-19T02:16:53.171392+0000","last_fullsized":"2024-04-19T02:16:53.171392+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:31.673938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.170353+0000","last_change":"2024-04-19T02:15:29.284258+0000","last_active":"2024-04-19T02:16:53.170353+0000","last_peered":"2024-04-19T02:16:53.170353+0000","last_clean":"2024-04-19T02:16:53.170353+0000","last_became_active":"2024-04-19T02:15:29.283995+0000","last_became_peered":"2024-04-19T02:15:29.283995+0000","last_unstale":"2024-04-19T02:16:53.170353+0000","last_undegraded":"2024-04-19T02:16:53.170353+0000","last_fullsized":"2024-04-19T02:16:53.170353+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:35.941308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"44'8760","reported_seq":8796,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.816923+0000","last_change":"2024-04-19T02:15:53.956977+0000","last_active":"2024-04-19T02:16:57.816923+0000","last_peered":"2024-04-19T02:16:57.816923+0000","last_clean":"2024-04-19T02:16:57.816923+0000","last_became_active":"2024-04-19T02:15:53.956730+0000","last_became_peered":"2024-04-19T02:15:53.956730+0000","last_unstale":"2024-04-19T02:16:57.816923+0000","last_undegraded":"2024-04-19T02:16:57.816923+0000","last_fullsized":"2024-04-19T02:16:57.816923+0000","mapping_epoch":16,"log_start":"31'5100","ondisk_log_start":"31'5100","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3660,"log_dups_size":0,"ondisk_log_size":3660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:56:46.323499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":541458432,"num_objects":8262,"num_object_clones":0,"num_object_copies":16524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8262,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8760,"num_write_kb":544704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":41,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.172528+0000","last_change":"2024-04-19T02:15:28.890265+0000","last_active":"2024-04-19T02:16:53.172528+0000","last_peered":"2024-04-19T02:16:53.172528+0000","last_clean":"2024-04-19T02:16:53.172528+0000","last_became_active":"2024-04-19T02:15:28.890004+0000","last_became_peered":"2024-04-19T02:15:28.890004+0000","last_unstale":"2024-04-19T02:16:53.172528+0000","last_undegraded":"2024-04-19T02:16:53.172528+0000","last_fullsized":"2024-04-19T02:16:53.172528+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:02.517101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.166202+0000","last_change":"2024-04-19T02:15:29.285529+0000","last_active":"2024-04-19T02:16:53.166202+0000","last_peered":"2024-04-19T02:16:53.166202+0000","last_clean":"2024-04-19T02:16:53.166202+0000","last_became_active":"2024-04-19T02:15:29.285197+0000","last_became_peered":"2024-04-19T02:15:29.285197+0000","last_unstale":"2024-04-19T02:16:53.166202+0000","last_undegraded":"2024-04-19T02:16:53.166202+0000","last_fullsized":"2024-04-19T02:16:53.166202+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"44'8710","reported_seq":8744,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.769806+0000","last_change":"2024-04-19T02:15:53.958523+0000","last_active":"2024-04-19T02:16:57.769806+0000","last_peered":"2024-04-19T02:16:57.769806+0000","last_clean":"2024-04-19T02:16:57.769806+0000","last_became_active":"2024-04-19T02:15:53.957627+0000","last_became_peered":"2024-04-19T02:15:53.957627+0000","last_unstale":"2024-04-19T02:16:57.769806+0000","last_undegraded":"2024-04-19T02:16:57.769806+0000","last_fullsized":"2024-04-19T02:16:57.769806+0000","mapping_epoch":16,"log_start":"30'4747","ondisk_log_start":"30'4747","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3963,"log_dups_size":0,"ondisk_log_size":3963,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:59:55.120296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":537526272,"num_objects":8202,"num_object_clones":0,"num_object_copies":16404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8202,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8710,"num_write_kb":541184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":42,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.166670+0000","last_change":"2024-04-19T02:15:28.893902+0000","last_active":"2024-04-19T02:16:53.166670+0000","last_peered":"2024-04-19T02:16:53.166670+0000","last_clean":"2024-04-19T02:16:53.166670+0000","last_became_active":"2024-04-19T02:15:28.893231+0000","last_became_peered":"2024-04-19T02:15:28.893231+0000","last_unstale":"2024-04-19T02:16:53.166670+0000","last_undegraded":"2024-04-19T02:16:53.166670+0000","last_fullsized":"2024-04-19T02:16:53.166670+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:23.658442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.167575+0000","last_change":"2024-04-19T02:15:29.282874+0000","last_active":"2024-04-19T02:16:53.167575+0000","last_peered":"2024-04-19T02:16:53.167575+0000","last_clean":"2024-04-19T02:16:53.167575+0000","last_became_active":"2024-04-19T02:15:29.281675+0000","last_became_peered":"2024-04-19T02:15:29.281675+0000","last_unstale":"2024-04-19T02:16:53.167575+0000","last_undegraded":"2024-04-19T02:16:53.167575+0000","last_fullsized":"2024-04-19T02:16:53.167575+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:35.941308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"44'8613","reported_seq":8649,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.772401+0000","last_change":"2024-04-19T02:15:53.958324+0000","last_active":"2024-04-19T02:16:57.772401+0000","last_peered":"2024-04-19T02:16:57.772401+0000","last_clean":"2024-04-19T02:16:57.772401+0000","last_became_active":"2024-04-19T02:15:53.957392+0000","last_became_peered":"2024-04-19T02:15:53.957392+0000","last_unstale":"2024-04-19T02:16:57.772401+0000","last_undegraded":"2024-04-19T02:16:57.772401+0000","last_fullsized":"2024-04-19T02:16:57.772401+0000","mapping_epoch":16,"log_start":"30'4700","ondisk_log_start":"30'4700","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3913,"log_dups_size":0,"ondisk_log_size":3913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:12:58.132969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":530776064,"num_objects":8099,"num_object_clones":0,"num_object_copies":16198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8099,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8613,"num_write_kb":534784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":41,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.172274+0000","last_change":"2024-04-19T02:15:28.891234+0000","last_active":"2024-04-19T02:16:53.172274+0000","last_peered":"2024-04-19T02:16:53.172274+0000","last_clean":"2024-04-19T02:16:53.172274+0000","last_became_active":"2024-04-19T02:15:28.890881+0000","last_became_peered":"2024-04-19T02:15:28.890881+0000","last_unstale":"2024-04-19T02:16:53.172274+0000","last_undegraded":"2024-04-19T02:16:53.172274+0000","last_fullsized":"2024-04-19T02:16:53.172274+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171564+0000","last_change":"2024-04-19T02:15:29.281937+0000","last_active":"2024-04-19T02:16:53.171564+0000","last_peered":"2024-04-19T02:16:53.171564+0000","last_clean":"2024-04-19T02:16:53.171564+0000","last_became_active":"2024-04-19T02:15:29.280727+0000","last_became_peered":"2024-04-19T02:15:29.280727+0000","last_unstale":"2024-04-19T02:16:53.171564+0000","last_undegraded":"2024-04-19T02:16:53.171564+0000","last_fullsized":"2024-04-19T02:16:53.171564+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"44'8756","reported_seq":8790,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.808004+0000","last_change":"2024-04-19T02:15:53.959099+0000","last_active":"2024-04-19T02:16:57.808004+0000","last_peered":"2024-04-19T02:16:57.808004+0000","last_clean":"2024-04-19T02:16:57.808004+0000","last_became_active":"2024-04-19T02:15:53.958885+0000","last_became_peered":"2024-04-19T02:15:53.958885+0000","last_unstale":"2024-04-19T02:16:57.808004+0000","last_undegraded":"2024-04-19T02:16:57.808004+0000","last_fullsized":"2024-04-19T02:16:57.808004+0000","mapping_epoch":16,"log_start":"31'5100","ondisk_log_start":"31'5100","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3656,"log_dups_size":0,"ondisk_log_size":3656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:53:26.969927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540672000,"num_objects":8250,"num_object_clones":0,"num_object_copies":16500,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8250,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8756,"num_write_kb":544192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":40,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171924+0000","last_change":"2024-04-19T02:15:28.892767+0000","last_active":"2024-04-19T02:16:53.171924+0000","last_peered":"2024-04-19T02:16:53.171924+0000","last_clean":"2024-04-19T02:16:53.171924+0000","last_became_active":"2024-04-19T02:15:28.892235+0000","last_became_peered":"2024-04-19T02:15:28.892235+0000","last_unstale":"2024-04-19T02:16:53.171924+0000","last_undegraded":"2024-04-19T02:16:53.171924+0000","last_fullsized":"2024-04-19T02:16:53.171924+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:37.690735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.174218+0000","last_change":"2024-04-19T02:15:29.279857+0000","last_active":"2024-04-19T02:16:53.174218+0000","last_peered":"2024-04-19T02:16:53.174218+0000","last_clean":"2024-04-19T02:16:53.174218+0000","last_became_active":"2024-04-19T02:15:29.279536+0000","last_became_peered":"2024-04-19T02:15:29.279536+0000","last_unstale":"2024-04-19T02:16:53.174218+0000","last_undegraded":"2024-04-19T02:16:53.174218+0000","last_fullsized":"2024-04-19T02:16:53.174218+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:00.191179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"44'8640","reported_seq":8677,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.819415+0000","last_change":"2024-04-19T02:15:53.957261+0000","last_active":"2024-04-19T02:16:57.819415+0000","last_peered":"2024-04-19T02:16:57.819415+0000","last_clean":"2024-04-19T02:16:57.819415+0000","last_became_active":"2024-04-19T02:15:53.957092+0000","last_became_peered":"2024-04-19T02:15:53.957092+0000","last_unstale":"2024-04-19T02:16:57.819415+0000","last_undegraded":"2024-04-19T02:16:57.819415+0000","last_fullsized":"2024-04-19T02:16:57.819415+0000","mapping_epoch":16,"log_start":"31'4913","ondisk_log_start":"31'4913","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3727,"log_dups_size":0,"ondisk_log_size":3727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:54:15.544923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":532086808,"num_objects":8120,"num_object_clones":0,"num_object_copies":16240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8120,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":8640,"num_write_kb":536257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":42,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.174091+0000","last_change":"2024-04-19T02:15:28.891611+0000","last_active":"2024-04-19T02:16:53.174091+0000","last_peered":"2024-04-19T02:16:53.174091+0000","last_clean":"2024-04-19T02:16:53.174091+0000","last_became_active":"2024-04-19T02:15:28.890914+0000","last_became_peered":"2024-04-19T02:15:28.890914+0000","last_unstale":"2024-04-19T02:16:53.174091+0000","last_undegraded":"2024-04-19T02:16:53.174091+0000","last_fullsized":"2024-04-19T02:16:53.174091+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:37.690735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171922+0000","last_change":"2024-04-19T02:15:29.285774+0000","last_active":"2024-04-19T02:16:53.171922+0000","last_peered":"2024-04-19T02:16:53.171922+0000","last_clean":"2024-04-19T02:16:53.171922+0000","last_became_active":"2024-04-19T02:15:29.284705+0000","last_became_peered":"2024-04-19T02:15:29.284705+0000","last_unstale":"2024-04-19T02:16:53.171922+0000","last_undegraded":"2024-04-19T02:16:53.171922+0000","last_fullsized":"2024-04-19T02:16:53.171922+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"44'8650","reported_seq":8686,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.769782+0000","last_change":"2024-04-19T02:15:53.955286+0000","last_active":"2024-04-19T02:16:57.769782+0000","last_peered":"2024-04-19T02:16:57.769782+0000","last_clean":"2024-04-19T02:16:57.769782+0000","last_became_active":"2024-04-19T02:15:53.955026+0000","last_became_peered":"2024-04-19T02:15:53.955026+0000","last_unstale":"2024-04-19T02:16:57.769782+0000","last_undegraded":"2024-04-19T02:16:57.769782+0000","last_fullsized":"2024-04-19T02:16:57.769782+0000","mapping_epoch":16,"log_start":"31'5000","ondisk_log_start":"31'5000","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3650,"log_dups_size":0,"ondisk_log_size":3650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:05:48.594301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":533856256,"num_objects":8146,"num_object_clones":0,"num_object_copies":16292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8146,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8650,"num_write_kb":537472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":40,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171468+0000","last_change":"2024-04-19T02:15:28.892873+0000","last_active":"2024-04-19T02:16:53.171468+0000","last_peered":"2024-04-19T02:16:53.171468+0000","last_clean":"2024-04-19T02:16:53.171468+0000","last_became_active":"2024-04-19T02:15:28.892487+0000","last_became_peered":"2024-04-19T02:15:28.892487+0000","last_unstale":"2024-04-19T02:16:53.171468+0000","last_undegraded":"2024-04-19T02:16:53.171468+0000","last_fullsized":"2024-04-19T02:16:53.171468+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:35.412837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.172462+0000","last_change":"2024-04-19T02:15:29.285019+0000","last_active":"2024-04-19T02:16:53.172462+0000","last_peered":"2024-04-19T02:16:53.172462+0000","last_clean":"2024-04-19T02:16:53.172462+0000","last_became_active":"2024-04-19T02:15:29.284650+0000","last_became_peered":"2024-04-19T02:15:29.284650+0000","last_unstale":"2024-04-19T02:16:53.172462+0000","last_undegraded":"2024-04-19T02:16:53.172462+0000","last_fullsized":"2024-04-19T02:16:53.172462+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"44'8714","reported_seq":8749,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.820770+0000","last_change":"2024-04-19T02:15:53.957403+0000","last_active":"2024-04-19T02:16:57.820770+0000","last_peered":"2024-04-19T02:16:57.820770+0000","last_clean":"2024-04-19T02:16:57.820770+0000","last_became_active":"2024-04-19T02:15:53.957190+0000","last_became_peered":"2024-04-19T02:15:53.957190+0000","last_unstale":"2024-04-19T02:16:57.820770+0000","last_undegraded":"2024-04-19T02:16:57.820770+0000","last_fullsized":"2024-04-19T02:16:57.820770+0000","mapping_epoch":16,"log_start":"31'5001","ondisk_log_start":"31'5001","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3713,"log_dups_size":0,"ondisk_log_size":3713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:07:12.817884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":534773760,"num_objects":8160,"num_object_clones":0,"num_object_copies":16320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8160,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8714,"num_write_kb":539968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171247+0000","last_change":"2024-04-19T02:15:53.956839+0000","last_active":"2024-04-19T02:16:53.171247+0000","last_peered":"2024-04-19T02:16:53.171247+0000","last_clean":"2024-04-19T02:16:53.171247+0000","last_became_active":"2024-04-19T02:15:53.956630+0000","last_became_peered":"2024-04-19T02:15:53.956630+0000","last_unstale":"2024-04-19T02:16:53.171247+0000","last_undegraded":"2024-04-19T02:16:53.171247+0000","last_fullsized":"2024-04-19T02:16:53.171247+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:47.229730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.172410+0000","last_change":"2024-04-19T02:15:29.287190+0000","last_active":"2024-04-19T02:16:53.172410+0000","last_peered":"2024-04-19T02:16:53.172410+0000","last_clean":"2024-04-19T02:16:53.172410+0000","last_became_active":"2024-04-19T02:15:29.286606+0000","last_became_peered":"2024-04-19T02:15:29.286606+0000","last_unstale":"2024-04-19T02:16:53.172410+0000","last_undegraded":"2024-04-19T02:16:53.172410+0000","last_fullsized":"2024-04-19T02:16:53.172410+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:28.387062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"44'8473","reported_seq":8508,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.786113+0000","last_change":"2024-04-19T02:15:53.958448+0000","last_active":"2024-04-19T02:16:57.786113+0000","last_peered":"2024-04-19T02:16:57.786113+0000","last_clean":"2024-04-19T02:16:57.786113+0000","last_became_active":"2024-04-19T02:15:53.957595+0000","last_became_peered":"2024-04-19T02:15:53.957595+0000","last_unstale":"2024-04-19T02:16:57.786113+0000","last_undegraded":"2024-04-19T02:16:57.786113+0000","last_fullsized":"2024-04-19T02:16:57.786113+0000","mapping_epoch":16,"log_start":"30'4544","ondisk_log_start":"30'4544","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3929,"log_dups_size":0,"ondisk_log_size":3929,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:26:31.855319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524222464,"num_objects":7999,"num_object_clones":0,"num_object_copies":15998,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7999,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8473,"num_write_kb":527104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":40,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.166343+0000","last_change":"2024-04-19T02:15:28.894121+0000","last_active":"2024-04-19T02:16:53.166343+0000","last_peered":"2024-04-19T02:16:53.166343+0000","last_clean":"2024-04-19T02:16:53.166343+0000","last_became_active":"2024-04-19T02:15:28.893902+0000","last_became_peered":"2024-04-19T02:15:28.893902+0000","last_unstale":"2024-04-19T02:16:53.166343+0000","last_undegraded":"2024-04-19T02:16:53.166343+0000","last_fullsized":"2024-04-19T02:16:53.166343+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:10:35.146583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.170213+0000","last_change":"2024-04-19T02:15:29.282870+0000","last_active":"2024-04-19T02:16:53.170213+0000","last_peered":"2024-04-19T02:16:53.170213+0000","last_clean":"2024-04-19T02:16:53.170213+0000","last_became_active":"2024-04-19T02:15:29.281873+0000","last_became_peered":"2024-04-19T02:15:29.281873+0000","last_unstale":"2024-04-19T02:16:53.170213+0000","last_undegraded":"2024-04-19T02:16:53.170213+0000","last_fullsized":"2024-04-19T02:16:53.170213+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"44'8624","reported_seq":8660,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.801450+0000","last_change":"2024-04-19T02:15:53.955498+0000","last_active":"2024-04-19T02:16:57.801450+0000","last_peered":"2024-04-19T02:16:57.801450+0000","last_clean":"2024-04-19T02:16:57.801450+0000","last_became_active":"2024-04-19T02:15:53.954910+0000","last_became_peered":"2024-04-19T02:15:53.954910+0000","last_unstale":"2024-04-19T02:16:57.801450+0000","last_undegraded":"2024-04-19T02:16:57.801450+0000","last_fullsized":"2024-04-19T02:16:57.801450+0000","mapping_epoch":16,"log_start":"31'5000","ondisk_log_start":"31'5000","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3624,"log_dups_size":0,"ondisk_log_size":3624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:58:27.262672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":530579456,"num_objects":8096,"num_object_clones":0,"num_object_copies":16192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8096,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8624,"num_write_kb":535040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171261+0000","last_change":"2024-04-19T02:15:24.527061+0000","last_active":"2024-04-19T02:16:53.171261+0000","last_peered":"2024-04-19T02:16:53.171261+0000","last_clean":"2024-04-19T02:16:53.171261+0000","last_became_active":"2024-04-19T02:15:24.526757+0000","last_became_peered":"2024-04-19T02:15:24.526757+0000","last_unstale":"2024-04-19T02:16:53.171261+0000","last_undegraded":"2024-04-19T02:16:53.171261+0000","last_fullsized":"2024-04-19T02:16:53.171261+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:17:13.649077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":40,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.172357+0000","last_change":"2024-04-19T02:15:28.892766+0000","last_active":"2024-04-19T02:16:53.172357+0000","last_peered":"2024-04-19T02:16:53.172357+0000","last_clean":"2024-04-19T02:16:53.172357+0000","last_became_active":"2024-04-19T02:15:28.892396+0000","last_became_peered":"2024-04-19T02:15:28.892396+0000","last_unstale":"2024-04-19T02:16:53.172357+0000","last_undegraded":"2024-04-19T02:16:53.172357+0000","last_fullsized":"2024-04-19T02:16:53.172357+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:57.946581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.167335+0000","last_change":"2024-04-19T02:15:29.277922+0000","last_active":"2024-04-19T02:16:53.167335+0000","last_peered":"2024-04-19T02:16:53.167335+0000","last_clean":"2024-04-19T02:16:53.167335+0000","last_became_active":"2024-04-19T02:15:29.276968+0000","last_became_peered":"2024-04-19T02:15:29.276968+0000","last_unstale":"2024-04-19T02:16:53.167335+0000","last_undegraded":"2024-04-19T02:16:53.167335+0000","last_fullsized":"2024-04-19T02:16:53.167335+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"44'8661","reported_seq":8697,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.804241+0000","last_change":"2024-04-19T02:15:53.955228+0000","last_active":"2024-04-19T02:16:57.804241+0000","last_peered":"2024-04-19T02:16:57.804241+0000","last_clean":"2024-04-19T02:16:57.804241+0000","last_became_active":"2024-04-19T02:15:53.954960+0000","last_became_peered":"2024-04-19T02:15:53.954960+0000","last_unstale":"2024-04-19T02:16:57.804241+0000","last_undegraded":"2024-04-19T02:16:57.804241+0000","last_fullsized":"2024-04-19T02:16:57.804241+0000","mapping_epoch":16,"log_start":"31'5000","ondisk_log_start":"31'5000","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3661,"log_dups_size":0,"ondisk_log_size":3661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:46:07.409922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":534446080,"num_objects":8155,"num_object_clones":0,"num_object_copies":16310,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8155,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8661,"num_write_kb":538112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171606+0000","last_change":"2024-04-19T02:15:24.530933+0000","last_active":"2024-04-19T02:16:53.171606+0000","last_peered":"2024-04-19T02:16:53.171606+0000","last_clean":"2024-04-19T02:16:53.171606+0000","last_became_active":"2024-04-19T02:15:24.530550+0000","last_became_peered":"2024-04-19T02:15:24.530550+0000","last_unstale":"2024-04-19T02:16:53.171606+0000","last_undegraded":"2024-04-19T02:16:53.171606+0000","last_fullsized":"2024-04-19T02:16:53.171606+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:18:15.194321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":40,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171720+0000","last_change":"2024-04-19T02:15:28.893062+0000","last_active":"2024-04-19T02:16:53.171720+0000","last_peered":"2024-04-19T02:16:53.171720+0000","last_clean":"2024-04-19T02:16:53.171720+0000","last_became_active":"2024-04-19T02:15:28.892798+0000","last_became_peered":"2024-04-19T02:15:28.892798+0000","last_unstale":"2024-04-19T02:16:53.171720+0000","last_undegraded":"2024-04-19T02:16:53.171720+0000","last_fullsized":"2024-04-19T02:16:53.171720+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:53.170180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171054+0000","last_change":"2024-04-19T02:15:29.278294+0000","last_active":"2024-04-19T02:16:53.171054+0000","last_peered":"2024-04-19T02:16:53.171054+0000","last_clean":"2024-04-19T02:16:53.171054+0000","last_became_active":"2024-04-19T02:15:29.277536+0000","last_became_peered":"2024-04-19T02:15:29.277536+0000","last_unstale":"2024-04-19T02:16:53.171054+0000","last_undegraded":"2024-04-19T02:16:53.171054+0000","last_fullsized":"2024-04-19T02:16:53.171054+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"44'8739","reported_seq":8775,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.798919+0000","last_change":"2024-04-19T02:15:53.956251+0000","last_active":"2024-04-19T02:16:57.798919+0000","last_peered":"2024-04-19T02:16:57.798919+0000","last_clean":"2024-04-19T02:16:57.798919+0000","last_became_active":"2024-04-19T02:15:53.955886+0000","last_became_peered":"2024-04-19T02:15:53.955886+0000","last_unstale":"2024-04-19T02:16:57.798919+0000","last_undegraded":"2024-04-19T02:16:57.798919+0000","last_fullsized":"2024-04-19T02:16:57.798919+0000","mapping_epoch":16,"log_start":"31'5100","ondisk_log_start":"31'5100","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3639,"log_dups_size":0,"ondisk_log_size":3639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:38:38.586906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":535101440,"num_objects":8165,"num_object_clones":0,"num_object_copies":16330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8165,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8739,"num_write_kb":540928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.169772+0000","last_change":"2024-04-19T02:15:24.527048+0000","last_active":"2024-04-19T02:16:53.169772+0000","last_peered":"2024-04-19T02:16:53.169772+0000","last_clean":"2024-04-19T02:16:53.169772+0000","last_became_active":"2024-04-19T02:15:24.526790+0000","last_became_peered":"2024-04-19T02:15:24.526790+0000","last_unstale":"2024-04-19T02:16:53.169772+0000","last_undegraded":"2024-04-19T02:16:53.169772+0000","last_fullsized":"2024-04-19T02:16:53.169772+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":38,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171085+0000","last_change":"2024-04-19T02:15:53.956945+0000","last_active":"2024-04-19T02:16:53.171085+0000","last_peered":"2024-04-19T02:16:53.171085+0000","last_clean":"2024-04-19T02:16:53.171085+0000","last_became_active":"2024-04-19T02:15:53.956719+0000","last_became_peered":"2024-04-19T02:15:53.956719+0000","last_unstale":"2024-04-19T02:16:53.171085+0000","last_undegraded":"2024-04-19T02:16:53.171085+0000","last_fullsized":"2024-04-19T02:16:53.171085+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:00:37.754624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.170311+0000","last_change":"2024-04-19T02:15:29.282663+0000","last_active":"2024-04-19T02:16:53.170311+0000","last_peered":"2024-04-19T02:16:53.170311+0000","last_clean":"2024-04-19T02:16:53.170311+0000","last_became_active":"2024-04-19T02:15:29.282217+0000","last_became_peered":"2024-04-19T02:15:29.282217+0000","last_unstale":"2024-04-19T02:16:53.170311+0000","last_undegraded":"2024-04-19T02:16:53.170311+0000","last_fullsized":"2024-04-19T02:16:53.170311+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"44'8599","reported_seq":8633,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.790356+0000","last_change":"2024-04-19T02:15:53.958264+0000","last_active":"2024-04-19T02:16:57.790356+0000","last_peered":"2024-04-19T02:16:57.790356+0000","last_clean":"2024-04-19T02:16:57.790356+0000","last_became_active":"2024-04-19T02:15:53.956689+0000","last_became_peered":"2024-04-19T02:15:53.956689+0000","last_unstale":"2024-04-19T02:16:57.790356+0000","last_undegraded":"2024-04-19T02:16:57.790356+0000","last_fullsized":"2024-04-19T02:16:57.790356+0000","mapping_epoch":16,"log_start":"30'4700","ondisk_log_start":"30'4700","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3899,"log_dups_size":0,"ondisk_log_size":3899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:24:32.928594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525139968,"num_objects":8013,"num_object_clones":0,"num_object_copies":16026,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8013,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8599,"num_write_kb":531584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":43,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171720+0000","last_change":"2024-04-19T02:15:24.530924+0000","last_active":"2024-04-19T02:16:53.171720+0000","last_peered":"2024-04-19T02:16:53.171720+0000","last_clean":"2024-04-19T02:16:53.171720+0000","last_became_active":"2024-04-19T02:15:24.530551+0000","last_became_peered":"2024-04-19T02:15:24.530551+0000","last_unstale":"2024-04-19T02:16:53.171720+0000","last_undegraded":"2024-04-19T02:16:53.171720+0000","last_fullsized":"2024-04-19T02:16:53.171720+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:30.576946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":239,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171259+0000","last_change":"2024-04-19T02:15:24.533634+0000","last_active":"2024-04-19T02:16:53.171259+0000","last_peered":"2024-04-19T02:16:53.171259+0000","last_clean":"2024-04-19T02:16:53.171259+0000","last_became_active":"2024-04-19T02:15:24.533420+0000","last_became_peered":"2024-04-19T02:15:24.533420+0000","last_unstale":"2024-04-19T02:16:53.171259+0000","last_undegraded":"2024-04-19T02:16:53.171259+0000","last_fullsized":"2024-04-19T02:16:53.171259+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":40,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.169484+0000","last_change":"2024-04-19T02:15:28.890244+0000","last_active":"2024-04-19T02:16:53.169484+0000","last_peered":"2024-04-19T02:16:53.169484+0000","last_clean":"2024-04-19T02:16:53.169484+0000","last_became_active":"2024-04-19T02:15:28.889831+0000","last_became_peered":"2024-04-19T02:15:28.889831+0000","last_unstale":"2024-04-19T02:16:53.169484+0000","last_undegraded":"2024-04-19T02:16:53.169484+0000","last_fullsized":"2024-04-19T02:16:53.169484+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.172375+0000","last_change":"2024-04-19T02:15:29.285015+0000","last_active":"2024-04-19T02:16:53.172375+0000","last_peered":"2024-04-19T02:16:53.172375+0000","last_clean":"2024-04-19T02:16:53.172375+0000","last_became_active":"2024-04-19T02:15:29.284164+0000","last_became_peered":"2024-04-19T02:15:29.284164+0000","last_unstale":"2024-04-19T02:16:53.172375+0000","last_undegraded":"2024-04-19T02:16:53.172375+0000","last_fullsized":"2024-04-19T02:16:53.172375+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:36.987844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"44'8601","reported_seq":8637,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.777061+0000","last_change":"2024-04-19T02:15:53.956463+0000","last_active":"2024-04-19T02:16:57.777061+0000","last_peered":"2024-04-19T02:16:57.777061+0000","last_clean":"2024-04-19T02:16:57.777061+0000","last_became_active":"2024-04-19T02:15:53.955819+0000","last_became_peered":"2024-04-19T02:15:53.955819+0000","last_unstale":"2024-04-19T02:16:57.777061+0000","last_undegraded":"2024-04-19T02:16:57.777061+0000","last_fullsized":"2024-04-19T02:16:57.777061+0000","mapping_epoch":16,"log_start":"31'4931","ondisk_log_start":"31'4931","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3670,"log_dups_size":0,"ondisk_log_size":3670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:46:07.409922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":530907136,"num_objects":8101,"num_object_clones":0,"num_object_copies":16202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8101,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8601,"num_write_kb":534464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171290+0000","last_change":"2024-04-19T02:15:24.533912+0000","last_active":"2024-04-19T02:16:53.171290+0000","last_peered":"2024-04-19T02:16:53.171290+0000","last_clean":"2024-04-19T02:16:53.171290+0000","last_became_active":"2024-04-19T02:15:24.533580+0000","last_became_peered":"2024-04-19T02:15:24.533580+0000","last_unstale":"2024-04-19T02:16:53.171290+0000","last_undegraded":"2024-04-19T02:16:53.171290+0000","last_fullsized":"2024-04-19T02:16:53.171290+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:45.045477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":40,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.168995+0000","last_change":"2024-04-19T02:15:28.891889+0000","last_active":"2024-04-19T02:16:53.168995+0000","last_peered":"2024-04-19T02:16:53.168995+0000","last_clean":"2024-04-19T02:16:53.168995+0000","last_became_active":"2024-04-19T02:15:28.890919+0000","last_became_peered":"2024-04-19T02:15:28.890919+0000","last_unstale":"2024-04-19T02:16:53.168995+0000","last_undegraded":"2024-04-19T02:16:53.168995+0000","last_fullsized":"2024-04-19T02:16:53.168995+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:35.412837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":38,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.173961+0000","last_change":"2024-04-19T02:15:53.957881+0000","last_active":"2024-04-19T02:16:53.173961+0000","last_peered":"2024-04-19T02:16:53.173961+0000","last_clean":"2024-04-19T02:16:53.173961+0000","last_became_active":"2024-04-19T02:15:53.957657+0000","last_became_peered":"2024-04-19T02:15:53.957657+0000","last_unstale":"2024-04-19T02:16:53.173961+0000","last_undegraded":"2024-04-19T02:16:53.173961+0000","last_fullsized":"2024-04-19T02:16:53.173961+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:46.921714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"44'8687","reported_seq":8723,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.814753+0000","last_change":"2024-04-19T02:15:53.955068+0000","last_active":"2024-04-19T02:16:57.814753+0000","last_peered":"2024-04-19T02:16:57.814753+0000","last_clean":"2024-04-19T02:16:57.814753+0000","last_became_active":"2024-04-19T02:15:53.954721+0000","last_became_peered":"2024-04-19T02:15:53.954721+0000","last_unstale":"2024-04-19T02:16:57.814753+0000","last_undegraded":"2024-04-19T02:16:57.814753+0000","last_fullsized":"2024-04-19T02:16:57.814753+0000","mapping_epoch":16,"log_start":"31'5000","ondisk_log_start":"31'5000","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3687,"log_dups_size":0,"ondisk_log_size":3687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:18:29.742535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":535494656,"num_objects":8171,"num_object_clones":0,"num_object_copies":16342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8171,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8687,"num_write_kb":539456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":38,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.169464+0000","last_change":"2024-04-19T02:15:53.959105+0000","last_active":"2024-04-19T02:16:53.169464+0000","last_peered":"2024-04-19T02:16:53.169464+0000","last_clean":"2024-04-19T02:16:53.169464+0000","last_became_active":"2024-04-19T02:15:53.958836+0000","last_became_peered":"2024-04-19T02:15:53.958836+0000","last_unstale":"2024-04-19T02:16:53.169464+0000","last_undegraded":"2024-04-19T02:16:53.169464+0000","last_fullsized":"2024-04-19T02:16:53.169464+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:18:00.321514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":40,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.170976+0000","last_change":"2024-04-19T02:15:28.892125+0000","last_active":"2024-04-19T02:16:53.170976+0000","last_peered":"2024-04-19T02:16:53.170976+0000","last_clean":"2024-04-19T02:16:53.170976+0000","last_became_active":"2024-04-19T02:15:28.891300+0000","last_became_peered":"2024-04-19T02:15:28.891300+0000","last_unstale":"2024-04-19T02:16:53.170976+0000","last_undegraded":"2024-04-19T02:16:53.170976+0000","last_fullsized":"2024-04-19T02:16:53.170976+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.166422+0000","last_change":"2024-04-19T02:15:29.281694+0000","last_active":"2024-04-19T02:16:53.166422+0000","last_peered":"2024-04-19T02:16:53.166422+0000","last_clean":"2024-04-19T02:16:53.166422+0000","last_became_active":"2024-04-19T02:15:29.280519+0000","last_became_peered":"2024-04-19T02:15:29.280519+0000","last_unstale":"2024-04-19T02:16:53.166422+0000","last_undegraded":"2024-04-19T02:16:53.166422+0000","last_fullsized":"2024-04-19T02:16:53.166422+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:50.890545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"44'8476","reported_seq":19714,"reported_epoch":44,"state":"active+remapped+backfilling","last_fresh":"2024-04-19T02:16:57.810189+0000","last_change":"2024-04-19T02:16:30.103016+0000","last_active":"2024-04-19T02:16:57.810189+0000","last_peered":"2024-04-19T02:16:57.810189+0000","last_clean":"2024-04-19T02:16:22.050311+0000","last_became_active":"2024-04-19T02:16:24.119992+0000","last_became_peered":"2024-04-19T02:16:24.119992+0000","last_unstale":"2024-04-19T02:16:57.810189+0000","last_undegraded":"2024-04-19T02:16:57.810189+0000","last_fullsized":"2024-04-19T02:16:57.810189+0000","mapping_epoch":29,"log_start":"31'4837","ondisk_log_start":"31'4837","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3639,"log_dups_size":0,"ondisk_log_size":3639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:28.663111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":521797632,"num_objects":7962,"num_object_clones":0,"num_object_copies":15924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":847,"num_objects_unfound":0,"num_objects_dirty":7962,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8476,"num_write_kb":526016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5595,"num_bytes_recovered":366673920,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[{"shards":"0,2","objects":7962}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":42,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.170212+0000","last_change":"2024-04-19T02:15:28.891702+0000","last_active":"2024-04-19T02:16:53.170212+0000","last_peered":"2024-04-19T02:16:53.170212+0000","last_clean":"2024-04-19T02:16:53.170212+0000","last_became_active":"2024-04-19T02:15:28.890743+0000","last_became_peered":"2024-04-19T02:15:28.890743+0000","last_unstale":"2024-04-19T02:16:53.170212+0000","last_undegraded":"2024-04-19T02:16:53.170212+0000","last_fullsized":"2024-04-19T02:16:53.170212+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.174289+0000","last_change":"2024-04-19T02:15:24.526845+0000","last_active":"2024-04-19T02:16:53.174289+0000","last_peered":"2024-04-19T02:16:53.174289+0000","last_clean":"2024-04-19T02:16:53.174289+0000","last_became_active":"2024-04-19T02:15:24.526500+0000","last_became_peered":"2024-04-19T02:15:24.526500+0000","last_unstale":"2024-04-19T02:16:53.174289+0000","last_undegraded":"2024-04-19T02:16:53.174289+0000","last_fullsized":"2024-04-19T02:16:53.174289+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:16.883355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.174094+0000","last_change":"2024-04-19T02:15:29.278686+0000","last_active":"2024-04-19T02:16:53.174094+0000","last_peered":"2024-04-19T02:16:53.174094+0000","last_clean":"2024-04-19T02:16:53.174094+0000","last_became_active":"2024-04-19T02:15:29.278108+0000","last_became_peered":"2024-04-19T02:15:29.278108+0000","last_unstale":"2024-04-19T02:16:53.174094+0000","last_undegraded":"2024-04-19T02:16:53.174094+0000","last_fullsized":"2024-04-19T02:16:53.174094+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:34.593754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"44'8461","reported_seq":8497,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.777014+0000","last_change":"2024-04-19T02:15:53.957269+0000","last_active":"2024-04-19T02:16:57.777014+0000","last_peered":"2024-04-19T02:16:57.777014+0000","last_clean":"2024-04-19T02:16:57.777014+0000","last_became_active":"2024-04-19T02:15:53.956554+0000","last_became_peered":"2024-04-19T02:15:53.956554+0000","last_unstale":"2024-04-19T02:16:57.777014+0000","last_undegraded":"2024-04-19T02:16:57.777014+0000","last_fullsized":"2024-04-19T02:16:57.777014+0000","mapping_epoch":16,"log_start":"30'4528","ondisk_log_start":"30'4528","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3933,"log_dups_size":0,"ondisk_log_size":3933,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:29:38.789719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524353536,"num_objects":8001,"num_object_clones":0,"num_object_copies":16002,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8001,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8461,"num_write_kb":526784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":43,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.172588+0000","last_change":"2024-04-19T02:15:24.533777+0000","last_active":"2024-04-19T02:16:53.172588+0000","last_peered":"2024-04-19T02:16:53.172588+0000","last_clean":"2024-04-19T02:16:53.172588+0000","last_became_active":"2024-04-19T02:15:24.533436+0000","last_became_peered":"2024-04-19T02:15:24.533436+0000","last_unstale":"2024-04-19T02:16:53.172588+0000","last_undegraded":"2024-04-19T02:16:53.172588+0000","last_fullsized":"2024-04-19T02:16:53.172588+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:53:25.922418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":41,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.174091+0000","last_change":"2024-04-19T02:15:28.891370+0000","last_active":"2024-04-19T02:16:53.174091+0000","last_peered":"2024-04-19T02:16:53.174091+0000","last_clean":"2024-04-19T02:16:53.174091+0000","last_became_active":"2024-04-19T02:15:28.890702+0000","last_became_peered":"2024-04-19T02:15:28.890702+0000","last_unstale":"2024-04-19T02:16:53.174091+0000","last_undegraded":"2024-04-19T02:16:53.174091+0000","last_fullsized":"2024-04-19T02:16:53.174091+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:33.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.167489+0000","last_change":"2024-04-19T02:15:29.282244+0000","last_active":"2024-04-19T02:16:53.167489+0000","last_peered":"2024-04-19T02:16:53.167489+0000","last_clean":"2024-04-19T02:16:53.167489+0000","last_became_active":"2024-04-19T02:15:29.280366+0000","last_became_peered":"2024-04-19T02:15:29.280366+0000","last_unstale":"2024-04-19T02:16:53.167489+0000","last_undegraded":"2024-04-19T02:16:53.167489+0000","last_fullsized":"2024-04-19T02:16:53.167489+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":41,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.166512+0000","last_change":"2024-04-19T02:15:28.893027+0000","last_active":"2024-04-19T02:16:53.166512+0000","last_peered":"2024-04-19T02:16:53.166512+0000","last_clean":"2024-04-19T02:16:53.166512+0000","last_became_active":"2024-04-19T02:15:28.892695+0000","last_became_peered":"2024-04-19T02:15:28.892695+0000","last_unstale":"2024-04-19T02:16:53.166512+0000","last_undegraded":"2024-04-19T02:16:53.166512+0000","last_fullsized":"2024-04-19T02:16:53.166512+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.167193+0000","last_change":"2024-04-19T02:15:29.283155+0000","last_active":"2024-04-19T02:16:53.167193+0000","last_peered":"2024-04-19T02:16:53.167193+0000","last_clean":"2024-04-19T02:16:53.167193+0000","last_became_active":"2024-04-19T02:15:29.281407+0000","last_became_peered":"2024-04-19T02:15:29.281407+0000","last_unstale":"2024-04-19T02:16:53.167193+0000","last_undegraded":"2024-04-19T02:16:53.167193+0000","last_fullsized":"2024-04-19T02:16:53.167193+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":42,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.172019+0000","last_change":"2024-04-19T02:15:28.893067+0000","last_active":"2024-04-19T02:16:53.172019+0000","last_peered":"2024-04-19T02:16:53.172019+0000","last_clean":"2024-04-19T02:16:53.172019+0000","last_became_active":"2024-04-19T02:15:28.892781+0000","last_became_peered":"2024-04-19T02:15:28.892781+0000","last_unstale":"2024-04-19T02:16:53.172019+0000","last_undegraded":"2024-04-19T02:16:53.172019+0000","last_fullsized":"2024-04-19T02:16:53.172019+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:54:15.590143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171647+0000","last_change":"2024-04-19T02:15:29.281279+0000","last_active":"2024-04-19T02:16:53.171647+0000","last_peered":"2024-04-19T02:16:53.171647+0000","last_clean":"2024-04-19T02:16:53.171647+0000","last_became_active":"2024-04-19T02:15:29.279360+0000","last_became_peered":"2024-04-19T02:15:29.279360+0000","last_unstale":"2024-04-19T02:16:53.171647+0000","last_undegraded":"2024-04-19T02:16:53.171647+0000","last_fullsized":"2024-04-19T02:16:53.171647+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":42,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.167058+0000","last_change":"2024-04-19T02:15:28.893239+0000","last_active":"2024-04-19T02:16:53.167058+0000","last_peered":"2024-04-19T02:16:53.167058+0000","last_clean":"2024-04-19T02:16:53.167058+0000","last_became_active":"2024-04-19T02:15:28.892881+0000","last_became_peered":"2024-04-19T02:15:28.892881+0000","last_unstale":"2024-04-19T02:16:53.167058+0000","last_undegraded":"2024-04-19T02:16:53.167058+0000","last_fullsized":"2024-04-19T02:16:53.167058+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171509+0000","last_change":"2024-04-19T02:15:29.281652+0000","last_active":"2024-04-19T02:16:53.171509+0000","last_peered":"2024-04-19T02:16:53.171509+0000","last_clean":"2024-04-19T02:16:53.171509+0000","last_became_active":"2024-04-19T02:15:29.281175+0000","last_became_peered":"2024-04-19T02:15:29.281175+0000","last_unstale":"2024-04-19T02:16:53.171509+0000","last_undegraded":"2024-04-19T02:16:53.171509+0000","last_fullsized":"2024-04-19T02:16:53.171509+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:16.568764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":41,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.174438+0000","last_change":"2024-04-19T02:15:28.892058+0000","last_active":"2024-04-19T02:16:53.174438+0000","last_peered":"2024-04-19T02:16:53.174438+0000","last_clean":"2024-04-19T02:16:53.174438+0000","last_became_active":"2024-04-19T02:15:28.890877+0000","last_became_peered":"2024-04-19T02:15:28.890877+0000","last_unstale":"2024-04-19T02:16:53.174438+0000","last_undegraded":"2024-04-19T02:16:53.174438+0000","last_fullsized":"2024-04-19T02:16:53.174438+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:53.170180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.167711+0000","last_change":"2024-04-19T02:15:29.278810+0000","last_active":"2024-04-19T02:16:53.167711+0000","last_peered":"2024-04-19T02:16:53.167711+0000","last_clean":"2024-04-19T02:16:53.167711+0000","last_became_active":"2024-04-19T02:15:29.277913+0000","last_became_peered":"2024-04-19T02:15:29.277913+0000","last_unstale":"2024-04-19T02:16:53.167711+0000","last_undegraded":"2024-04-19T02:16:53.167711+0000","last_fullsized":"2024-04-19T02:16:53.167711+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:24.082666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":44,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.170268+0000","last_change":"2024-04-19T02:15:28.889132+0000","last_active":"2024-04-19T02:16:53.170268+0000","last_peered":"2024-04-19T02:16:53.170268+0000","last_clean":"2024-04-19T02:16:53.170268+0000","last_became_active":"2024-04-19T02:15:28.888926+0000","last_became_peered":"2024-04-19T02:15:28.888926+0000","last_unstale":"2024-04-19T02:16:53.170268+0000","last_undegraded":"2024-04-19T02:16:53.170268+0000","last_fullsized":"2024-04-19T02:16:53.170268+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171485+0000","last_change":"2024-04-19T02:15:29.282776+0000","last_active":"2024-04-19T02:16:53.171485+0000","last_peered":"2024-04-19T02:16:53.171485+0000","last_clean":"2024-04-19T02:16:53.171485+0000","last_became_active":"2024-04-19T02:15:29.279382+0000","last_became_peered":"2024-04-19T02:15:29.279382+0000","last_unstale":"2024-04-19T02:16:53.171485+0000","last_undegraded":"2024-04-19T02:16:53.171485+0000","last_fullsized":"2024-04-19T02:16:53.171485+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171349+0000","last_change":"2024-04-19T02:15:29.283537+0000","last_active":"2024-04-19T02:16:53.171349+0000","last_peered":"2024-04-19T02:16:53.171349+0000","last_clean":"2024-04-19T02:16:53.171349+0000","last_became_active":"2024-04-19T02:15:29.281801+0000","last_became_peered":"2024-04-19T02:15:29.281801+0000","last_unstale":"2024-04-19T02:16:53.171349+0000","last_undegraded":"2024-04-19T02:16:53.171349+0000","last_fullsized":"2024-04-19T02:16:53.171349+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.169035+0000","last_change":"2024-04-19T02:15:29.281560+0000","last_active":"2024-04-19T02:16:53.169035+0000","last_peered":"2024-04-19T02:16:53.169035+0000","last_clean":"2024-04-19T02:16:53.169035+0000","last_became_active":"2024-04-19T02:15:29.281261+0000","last_became_peered":"2024-04-19T02:15:29.281261+0000","last_unstale":"2024-04-19T02:16:53.169035+0000","last_undegraded":"2024-04-19T02:16:53.169035+0000","last_fullsized":"2024-04-19T02:16:53.169035+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":38,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171279+0000","last_change":"2024-04-19T02:15:53.955913+0000","last_active":"2024-04-19T02:16:53.171279+0000","last_peered":"2024-04-19T02:16:53.171279+0000","last_clean":"2024-04-19T02:16:53.171279+0000","last_became_active":"2024-04-19T02:15:53.955676+0000","last_became_peered":"2024-04-19T02:15:53.955676+0000","last_unstale":"2024-04-19T02:16:53.171279+0000","last_undegraded":"2024-04-19T02:16:53.171279+0000","last_fullsized":"2024-04-19T02:16:53.171279+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:53:02.899902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.174288+0000","last_change":"2024-04-19T02:15:29.278702+0000","last_active":"2024-04-19T02:16:53.174288+0000","last_peered":"2024-04-19T02:16:53.174288+0000","last_clean":"2024-04-19T02:16:53.174288+0000","last_became_active":"2024-04-19T02:15:29.277756+0000","last_became_peered":"2024-04-19T02:15:29.277756+0000","last_unstale":"2024-04-19T02:16:53.174288+0000","last_undegraded":"2024-04-19T02:16:53.174288+0000","last_fullsized":"2024-04-19T02:16:53.174288+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.167249+0000","last_change":"2024-04-19T02:15:29.277568+0000","last_active":"2024-04-19T02:16:53.167249+0000","last_peered":"2024-04-19T02:16:53.167249+0000","last_clean":"2024-04-19T02:16:53.167249+0000","last_became_active":"2024-04-19T02:15:29.276725+0000","last_became_peered":"2024-04-19T02:15:29.276725+0000","last_unstale":"2024-04-19T02:16:53.167249+0000","last_undegraded":"2024-04-19T02:16:53.167249+0000","last_fullsized":"2024-04-19T02:16:53.167249+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":8513191960,"num_objects":129902,"num_object_clones":0,"num_object_copies":259804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":847,"num_objects_unfound":0,"num_objects_dirty":129902,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":138164,"num_write_kb":8578049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5595,"num_bytes_recovered":366673920,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17491697664,"data_stored":17491689520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":59963,"ondisk_log_size":59963,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738389,"num_pgs":84,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7039664,"kb_used_data":6813924,"kb_used_omap":1,"kb_used_meta":225534,"kb_avail":87332176,"statfs":{"total":96636764160,"available":89428148224,"internally_reserved":0,"allocated":6977458176,"data_stored":6977144844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":230947270},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,5,2,1,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.313,"15min":0.313},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.497,"5min":0.497,"15min":0.497},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.56399999999999995}]},{"osd":1,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.23699999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738390,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5419664,"kb_used_data":5271620,"kb_used_omap":1,"kb_used_meta":147582,"kb_avail":88952176,"statfs":{"total":96636764160,"available":91087028224,"internally_reserved":0,"allocated":5398138880,"data_stored":5397795094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":151124422},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,2,5],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.21099999999999999},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.19}]},{"osd":2,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":2.1000000000000001,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":0.20000000000000001},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.247}]}]},{"osd":1,"up_from":8,"seq":34359738389,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5275144,"kb_used_data":5139452,"kb_used_omap":1,"kb_used_meta":135294,"kb_avail":89096696,"statfs":{"total":96636764160,"available":91235016704,"internally_reserved":0,"allocated":5262798848,"data_stored":5262462638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":138541510},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:16:26 2024","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"min":{"1min":0.16,"5min":0.16,"15min":0.16},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.185}]},{"osd":2,"last update":"Fri Apr 19 02:16:26 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.223},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.19800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5330046976,"data_stored":5330042904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5258088448,"data_stored":5258084376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6903562240,"data_stored":6903562240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:16:59.080 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-19T02:16:59.097 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:16:59.118 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:16:59.122 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:59.123+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:59.139 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2: {} 2024-04-19T02:16:59.140 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:16:59.140 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:16:59.141 INFO:teuthology.orchestra.run.smithi121.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:16:59.183 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:59.183 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:59.189 INFO:teuthology.orchestra.run.smithi121.stderr:noscrub is unset 2024-04-19T02:16:59.197 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:16:59.240 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:59.241+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:59.324 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:59.324+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:59.361 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:59.362 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:59.374 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:16:59.426 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:59.425+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:59.521 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:16:59.521 INFO:teuthology.orchestra.run.smithi121.stdout:{"fsid":"f6ab5dd0-bb9f-4b48-a9fc-4728c7955ca8","health":{"status":"HEALTH_WARN","checks":{"OSDMAP_FLAGS":{"severity":"HEALTH_WARN","summary":{"message":"nodeep-scrub flag(s) set","count":12},"muted":false}},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":104,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":45,"num_osds":3,"num_up_osds":3,"osd_up_since":1713492922,"num_in_osds":3,"osd_in_since":1713492915,"num_remapped_pgs":1},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":120},{"state_name":"active+remapped+backfilling","count":1}],"num_pgs":121,"num_pools":5,"num_objects":129926,"data_bytes":8513784690,"bytes_used":18160099328,"bytes_avail":271750193152,"bytes_total":289910292480,"misplaced_objects":847,"misplaced_total":259852,"misplaced_ratio":0.0032595477425611504,"recovering_objects_per_sec":227,"recovering_bytes_per_sec":14923516,"recovering_keys_per_sec":0,"num_objects_recovered":1822,"num_bytes_recovered":119406592,"num_keys_recovered":0,"read_bytes_sec":127,"write_bytes_sec":118626522,"read_op_per_sec":0,"write_op_per_sec":2326},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4230}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-04-19T02:16:34.750409+0000","services":{}},"progress_events":{}} 2024-04-19T02:16:59.526 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:16:59.527+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:16:59.535 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-04-19T02:16:59.535 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:16:59.577 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:59.577 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:59.591 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:16:59.635 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:59.636+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:59.727 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:16:59.727+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:16:59.753 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:59.753 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:59.766 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:16:59.828 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:59.829+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:59.882 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:16:59.884 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-04-19T02:16:59.894 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2024-04-19T02:16:59.184683+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":8513784690,"num_objects":129926,"num_object_clones":0,"num_object_copies":259852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":847,"num_objects_unfound":0,"num_objects_dirty":129926,"num_whiteouts":0,"num_read":137,"num_read_kb":119,"num_write":138412,"num_write_kb":8581523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5595,"num_bytes_recovered":366673920,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60159,"ondisk_log_size":60159,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":243,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":17734472,"kb_used_data":17224996,"kb_used_omap":4,"kb_used_meta":508411,"kb_avail":265381048,"statfs":{"total":289910292480,"available":271750193152,"internally_reserved":0,"allocated":17638395904,"data_stored":17637402576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":520613202},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,6,4,6,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":678428696,"num_objects":10353,"num_object_clones":0,"num_object_copies":20706,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-1612,"num_objects_unfound":0,"num_objects_dirty":10353,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":18615,"num_write_kb":926913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1822,"num_bytes_recovered":119406592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.431586"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.168504+0000","last_change":"2024-04-19T02:15:29.280412+0000","last_active":"2024-04-19T02:16:53.168504+0000","last_peered":"2024-04-19T02:16:53.168504+0000","last_clean":"2024-04-19T02:16:53.168504+0000","last_became_active":"2024-04-19T02:15:29.278762+0000","last_became_peered":"2024-04-19T02:15:29.278762+0000","last_unstale":"2024-04-19T02:16:53.168504+0000","last_undegraded":"2024-04-19T02:16:53.168504+0000","last_fullsized":"2024-04-19T02:16:53.168504+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:45.301675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.166590+0000","last_change":"2024-04-19T02:15:29.284695+0000","last_active":"2024-04-19T02:16:53.166590+0000","last_peered":"2024-04-19T02:16:53.166590+0000","last_clean":"2024-04-19T02:16:53.166590+0000","last_became_active":"2024-04-19T02:15:29.283468+0000","last_became_peered":"2024-04-19T02:15:29.283468+0000","last_unstale":"2024-04-19T02:16:53.166590+0000","last_undegraded":"2024-04-19T02:16:53.166590+0000","last_fullsized":"2024-04-19T02:16:53.166590+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.384881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.172303+0000","last_change":"2024-04-19T02:15:29.286709+0000","last_active":"2024-04-19T02:16:53.172303+0000","last_peered":"2024-04-19T02:16:53.172303+0000","last_clean":"2024-04-19T02:16:53.172303+0000","last_became_active":"2024-04-19T02:15:29.286169+0000","last_became_peered":"2024-04-19T02:15:29.286169+0000","last_unstale":"2024-04-19T02:16:53.172303+0000","last_undegraded":"2024-04-19T02:16:53.172303+0000","last_fullsized":"2024-04-19T02:16:53.172303+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:58.741466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.172272+0000","last_change":"2024-04-19T02:15:29.280131+0000","last_active":"2024-04-19T02:16:53.172272+0000","last_peered":"2024-04-19T02:16:53.172272+0000","last_clean":"2024-04-19T02:16:53.172272+0000","last_became_active":"2024-04-19T02:15:29.279388+0000","last_became_peered":"2024-04-19T02:15:29.279388+0000","last_unstale":"2024-04-19T02:16:53.172272+0000","last_undegraded":"2024-04-19T02:16:53.172272+0000","last_fullsized":"2024-04-19T02:16:53.172272+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:36:48.819486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":38,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.173955+0000","last_change":"2024-04-19T02:15:53.955892+0000","last_active":"2024-04-19T02:16:53.173955+0000","last_peered":"2024-04-19T02:16:53.173955+0000","last_clean":"2024-04-19T02:16:53.173955+0000","last_became_active":"2024-04-19T02:15:53.955553+0000","last_became_peered":"2024-04-19T02:15:53.955553+0000","last_unstale":"2024-04-19T02:16:53.173955+0000","last_undegraded":"2024-04-19T02:16:53.173955+0000","last_fullsized":"2024-04-19T02:16:53.173955+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:45:39.791209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171426+0000","last_change":"2024-04-19T02:15:29.283908+0000","last_active":"2024-04-19T02:16:53.171426+0000","last_peered":"2024-04-19T02:16:53.171426+0000","last_clean":"2024-04-19T02:16:53.171426+0000","last_became_active":"2024-04-19T02:15:29.281729+0000","last_became_peered":"2024-04-19T02:15:29.281729+0000","last_unstale":"2024-04-19T02:16:53.171426+0000","last_undegraded":"2024-04-19T02:16:53.171426+0000","last_fullsized":"2024-04-19T02:16:53.171426+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:03:15.383476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171270+0000","last_change":"2024-04-19T02:15:29.281253+0000","last_active":"2024-04-19T02:16:53.171270+0000","last_peered":"2024-04-19T02:16:53.171270+0000","last_clean":"2024-04-19T02:16:53.171270+0000","last_became_active":"2024-04-19T02:15:29.279951+0000","last_became_peered":"2024-04-19T02:15:29.279951+0000","last_unstale":"2024-04-19T02:16:53.171270+0000","last_undegraded":"2024-04-19T02:16:53.171270+0000","last_fullsized":"2024-04-19T02:16:53.171270+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171170+0000","last_change":"2024-04-19T02:15:29.283952+0000","last_active":"2024-04-19T02:16:53.171170+0000","last_peered":"2024-04-19T02:16:53.171170+0000","last_clean":"2024-04-19T02:16:53.171170+0000","last_became_active":"2024-04-19T02:15:29.282721+0000","last_became_peered":"2024-04-19T02:15:29.282721+0000","last_unstale":"2024-04-19T02:16:53.171170+0000","last_undegraded":"2024-04-19T02:16:53.171170+0000","last_fullsized":"2024-04-19T02:16:53.171170+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:45.301675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.170137+0000","last_change":"2024-04-19T02:15:29.282150+0000","last_active":"2024-04-19T02:16:53.170137+0000","last_peered":"2024-04-19T02:16:53.170137+0000","last_clean":"2024-04-19T02:16:53.170137+0000","last_became_active":"2024-04-19T02:15:29.281538+0000","last_became_peered":"2024-04-19T02:15:29.281538+0000","last_unstale":"2024-04-19T02:16:53.170137+0000","last_undegraded":"2024-04-19T02:16:53.170137+0000","last_fullsized":"2024-04-19T02:16:53.170137+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.172047+0000","last_change":"2024-04-19T02:16:30.093524+0000","last_active":"2024-04-19T02:16:53.172047+0000","last_peered":"2024-04-19T02:16:53.172047+0000","last_clean":"2024-04-19T02:16:53.172047+0000","last_became_active":"2024-04-19T02:16:30.093344+0000","last_became_peered":"2024-04-19T02:16:30.093344+0000","last_unstale":"2024-04-19T02:16:53.172047+0000","last_undegraded":"2024-04-19T02:16:53.172047+0000","last_fullsized":"2024-04-19T02:16:53.172047+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:14:40.293159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.172181+0000","last_change":"2024-04-19T02:15:29.280606+0000","last_active":"2024-04-19T02:16:53.172181+0000","last_peered":"2024-04-19T02:16:53.172181+0000","last_clean":"2024-04-19T02:16:53.172181+0000","last_became_active":"2024-04-19T02:15:29.280151+0000","last_became_peered":"2024-04-19T02:15:29.280151+0000","last_unstale":"2024-04-19T02:16:53.172181+0000","last_undegraded":"2024-04-19T02:16:53.172181+0000","last_fullsized":"2024-04-19T02:16:53.172181+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:26:22.452488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":38,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.172018+0000","last_change":"2024-04-19T02:15:53.958876+0000","last_active":"2024-04-19T02:16:53.172018+0000","last_peered":"2024-04-19T02:16:53.172018+0000","last_clean":"2024-04-19T02:16:53.172018+0000","last_became_active":"2024-04-19T02:15:53.958626+0000","last_became_peered":"2024-04-19T02:15:53.958626+0000","last_unstale":"2024-04-19T02:16:53.172018+0000","last_undegraded":"2024-04-19T02:16:53.172018+0000","last_fullsized":"2024-04-19T02:16:53.172018+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:23:57.044018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":38,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.170972+0000","last_change":"2024-04-19T02:15:53.956801+0000","last_active":"2024-04-19T02:16:53.170972+0000","last_peered":"2024-04-19T02:16:53.170972+0000","last_clean":"2024-04-19T02:16:53.170972+0000","last_became_active":"2024-04-19T02:15:53.956620+0000","last_became_peered":"2024-04-19T02:15:53.956620+0000","last_unstale":"2024-04-19T02:16:53.170972+0000","last_undegraded":"2024-04-19T02:16:53.170972+0000","last_fullsized":"2024-04-19T02:16:53.170972+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:57:05.843101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171651+0000","last_change":"2024-04-19T02:15:29.284262+0000","last_active":"2024-04-19T02:16:53.171651+0000","last_peered":"2024-04-19T02:16:53.171651+0000","last_clean":"2024-04-19T02:16:53.171651+0000","last_became_active":"2024-04-19T02:15:29.283121+0000","last_became_peered":"2024-04-19T02:15:29.283121+0000","last_unstale":"2024-04-19T02:16:53.171651+0000","last_undegraded":"2024-04-19T02:16:53.171651+0000","last_fullsized":"2024-04-19T02:16:53.171651+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171369+0000","last_change":"2024-04-19T02:15:29.285139+0000","last_active":"2024-04-19T02:16:53.171369+0000","last_peered":"2024-04-19T02:16:53.171369+0000","last_clean":"2024-04-19T02:16:53.171369+0000","last_became_active":"2024-04-19T02:15:29.284649+0000","last_became_peered":"2024-04-19T02:15:29.284649+0000","last_unstale":"2024-04-19T02:16:53.171369+0000","last_undegraded":"2024-04-19T02:16:53.171369+0000","last_fullsized":"2024-04-19T02:16:53.171369+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171199+0000","last_change":"2024-04-19T02:15:29.283648+0000","last_active":"2024-04-19T02:16:53.171199+0000","last_peered":"2024-04-19T02:16:53.171199+0000","last_clean":"2024-04-19T02:16:53.171199+0000","last_became_active":"2024-04-19T02:15:29.281606+0000","last_became_peered":"2024-04-19T02:15:29.281606+0000","last_unstale":"2024-04-19T02:16:53.171199+0000","last_undegraded":"2024-04-19T02:16:53.171199+0000","last_fullsized":"2024-04-19T02:16:53.171199+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.170164+0000","last_change":"2024-04-19T02:15:29.278673+0000","last_active":"2024-04-19T02:16:53.170164+0000","last_peered":"2024-04-19T02:16:53.170164+0000","last_clean":"2024-04-19T02:16:53.170164+0000","last_became_active":"2024-04-19T02:15:29.277699+0000","last_became_peered":"2024-04-19T02:15:29.277699+0000","last_unstale":"2024-04-19T02:16:53.170164+0000","last_undegraded":"2024-04-19T02:16:53.170164+0000","last_fullsized":"2024-04-19T02:16:53.170164+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.166891+0000","last_change":"2024-04-19T02:15:29.283341+0000","last_active":"2024-04-19T02:16:53.166891+0000","last_peered":"2024-04-19T02:16:53.166891+0000","last_clean":"2024-04-19T02:16:53.166891+0000","last_became_active":"2024-04-19T02:15:29.281591+0000","last_became_peered":"2024-04-19T02:15:29.281591+0000","last_unstale":"2024-04-19T02:16:53.166891+0000","last_undegraded":"2024-04-19T02:16:53.166891+0000","last_fullsized":"2024-04-19T02:16:53.166891+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:34.593754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.169579+0000","last_change":"2024-04-19T02:15:29.282110+0000","last_active":"2024-04-19T02:16:53.169579+0000","last_peered":"2024-04-19T02:16:53.169579+0000","last_clean":"2024-04-19T02:16:53.169579+0000","last_became_active":"2024-04-19T02:15:29.281716+0000","last_became_peered":"2024-04-19T02:15:29.281716+0000","last_unstale":"2024-04-19T02:16:53.169579+0000","last_undegraded":"2024-04-19T02:16:53.169579+0000","last_fullsized":"2024-04-19T02:16:53.169579+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.172196+0000","last_change":"2024-04-19T02:15:29.285237+0000","last_active":"2024-04-19T02:16:53.172196+0000","last_peered":"2024-04-19T02:16:53.172196+0000","last_clean":"2024-04-19T02:16:53.172196+0000","last_became_active":"2024-04-19T02:15:29.282790+0000","last_became_peered":"2024-04-19T02:15:29.282790+0000","last_unstale":"2024-04-19T02:16:53.172196+0000","last_undegraded":"2024-04-19T02:16:53.172196+0000","last_fullsized":"2024-04-19T02:16:53.172196+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171642+0000","last_change":"2024-04-19T02:15:29.282609+0000","last_active":"2024-04-19T02:16:53.171642+0000","last_peered":"2024-04-19T02:16:53.171642+0000","last_clean":"2024-04-19T02:16:53.171642+0000","last_became_active":"2024-04-19T02:15:29.281665+0000","last_became_peered":"2024-04-19T02:15:29.281665+0000","last_unstale":"2024-04-19T02:16:53.171642+0000","last_undegraded":"2024-04-19T02:16:53.171642+0000","last_fullsized":"2024-04-19T02:16:53.171642+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.384881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":38,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171339+0000","last_change":"2024-04-19T02:15:53.955813+0000","last_active":"2024-04-19T02:16:53.171339+0000","last_peered":"2024-04-19T02:16:53.171339+0000","last_clean":"2024-04-19T02:16:53.171339+0000","last_became_active":"2024-04-19T02:15:53.955614+0000","last_became_peered":"2024-04-19T02:15:53.955614+0000","last_unstale":"2024-04-19T02:16:53.171339+0000","last_undegraded":"2024-04-19T02:16:53.171339+0000","last_fullsized":"2024-04-19T02:16:53.171339+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:58:03.192647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.169682+0000","last_change":"2024-04-19T02:15:29.277109+0000","last_active":"2024-04-19T02:16:53.169682+0000","last_peered":"2024-04-19T02:16:53.169682+0000","last_clean":"2024-04-19T02:16:53.169682+0000","last_became_active":"2024-04-19T02:15:29.275417+0000","last_became_peered":"2024-04-19T02:15:29.275417+0000","last_unstale":"2024-04-19T02:16:53.169682+0000","last_undegraded":"2024-04-19T02:16:53.169682+0000","last_fullsized":"2024-04-19T02:16:53.169682+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.166424+0000","last_change":"2024-04-19T02:15:29.283266+0000","last_active":"2024-04-19T02:16:53.166424+0000","last_peered":"2024-04-19T02:16:53.166424+0000","last_clean":"2024-04-19T02:16:53.166424+0000","last_became_active":"2024-04-19T02:15:29.281505+0000","last_became_peered":"2024-04-19T02:15:29.281505+0000","last_unstale":"2024-04-19T02:16:53.166424+0000","last_undegraded":"2024-04-19T02:16:53.166424+0000","last_fullsized":"2024-04-19T02:16:53.166424+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.168463+0000","last_change":"2024-04-19T02:15:29.278084+0000","last_active":"2024-04-19T02:16:53.168463+0000","last_peered":"2024-04-19T02:16:53.168463+0000","last_clean":"2024-04-19T02:16:53.168463+0000","last_became_active":"2024-04-19T02:15:29.276952+0000","last_became_peered":"2024-04-19T02:15:29.276952+0000","last_unstale":"2024-04-19T02:16:53.168463+0000","last_undegraded":"2024-04-19T02:16:53.168463+0000","last_fullsized":"2024-04-19T02:16:53.168463+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.174513+0000","last_change":"2024-04-19T02:15:29.279904+0000","last_active":"2024-04-19T02:16:53.174513+0000","last_peered":"2024-04-19T02:16:53.174513+0000","last_clean":"2024-04-19T02:16:53.174513+0000","last_became_active":"2024-04-19T02:15:29.278938+0000","last_became_peered":"2024-04-19T02:15:29.278938+0000","last_unstale":"2024-04-19T02:16:53.174513+0000","last_undegraded":"2024-04-19T02:16:53.174513+0000","last_fullsized":"2024-04-19T02:16:53.174513+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.172221+0000","last_change":"2024-04-19T02:15:29.287389+0000","last_active":"2024-04-19T02:16:53.172221+0000","last_peered":"2024-04-19T02:16:53.172221+0000","last_clean":"2024-04-19T02:16:53.172221+0000","last_became_active":"2024-04-19T02:15:29.286431+0000","last_became_peered":"2024-04-19T02:15:29.286431+0000","last_unstale":"2024-04-19T02:16:53.172221+0000","last_undegraded":"2024-04-19T02:16:53.172221+0000","last_fullsized":"2024-04-19T02:16:53.172221+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:58:30.117887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":38,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.169717+0000","last_change":"2024-04-19T02:15:53.959207+0000","last_active":"2024-04-19T02:16:53.169717+0000","last_peered":"2024-04-19T02:16:53.169717+0000","last_clean":"2024-04-19T02:16:53.169717+0000","last_became_active":"2024-04-19T02:15:53.959007+0000","last_became_peered":"2024-04-19T02:15:53.959007+0000","last_unstale":"2024-04-19T02:16:53.169717+0000","last_undegraded":"2024-04-19T02:16:53.169717+0000","last_fullsized":"2024-04-19T02:16:53.169717+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:08:21.065077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.167183+0000","last_change":"2024-04-19T02:15:29.281792+0000","last_active":"2024-04-19T02:16:53.167183+0000","last_peered":"2024-04-19T02:16:53.167183+0000","last_clean":"2024-04-19T02:16:53.167183+0000","last_became_active":"2024-04-19T02:15:29.280479+0000","last_became_peered":"2024-04-19T02:15:29.280479+0000","last_unstale":"2024-04-19T02:16:53.167183+0000","last_undegraded":"2024-04-19T02:16:53.167183+0000","last_fullsized":"2024-04-19T02:16:53.167183+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":40,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.169759+0000","last_change":"2024-04-19T02:15:28.888778+0000","last_active":"2024-04-19T02:16:53.169759+0000","last_peered":"2024-04-19T02:16:53.169759+0000","last_clean":"2024-04-19T02:16:53.169759+0000","last_became_active":"2024-04-19T02:15:28.888543+0000","last_became_peered":"2024-04-19T02:15:28.888543+0000","last_unstale":"2024-04-19T02:16:53.169759+0000","last_undegraded":"2024-04-19T02:16:53.169759+0000","last_fullsized":"2024-04-19T02:16:53.169759+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:43:51.221619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.174171+0000","last_change":"2024-04-19T02:15:29.279986+0000","last_active":"2024-04-19T02:16:53.174171+0000","last_peered":"2024-04-19T02:16:53.174171+0000","last_clean":"2024-04-19T02:16:53.174171+0000","last_became_active":"2024-04-19T02:15:29.279690+0000","last_became_peered":"2024-04-19T02:15:29.279690+0000","last_unstale":"2024-04-19T02:16:53.174171+0000","last_undegraded":"2024-04-19T02:16:53.174171+0000","last_fullsized":"2024-04-19T02:16:53.174171+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":40,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.174384+0000","last_change":"2024-04-19T02:15:28.890463+0000","last_active":"2024-04-19T02:16:53.174384+0000","last_peered":"2024-04-19T02:16:53.174384+0000","last_clean":"2024-04-19T02:16:53.174384+0000","last_became_active":"2024-04-19T02:15:28.889777+0000","last_became_peered":"2024-04-19T02:15:28.889777+0000","last_unstale":"2024-04-19T02:16:53.174384+0000","last_undegraded":"2024-04-19T02:16:53.174384+0000","last_fullsized":"2024-04-19T02:16:53.174384+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:58:21.520250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.168413+0000","last_change":"2024-04-19T02:15:29.280879+0000","last_active":"2024-04-19T02:16:53.168413+0000","last_peered":"2024-04-19T02:16:53.168413+0000","last_clean":"2024-04-19T02:16:53.168413+0000","last_became_active":"2024-04-19T02:15:29.279314+0000","last_became_peered":"2024-04-19T02:15:29.279314+0000","last_unstale":"2024-04-19T02:16:53.168413+0000","last_undegraded":"2024-04-19T02:16:53.168413+0000","last_fullsized":"2024-04-19T02:16:53.168413+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":40,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.170284+0000","last_change":"2024-04-19T02:15:28.891867+0000","last_active":"2024-04-19T02:16:53.170284+0000","last_peered":"2024-04-19T02:16:53.170284+0000","last_clean":"2024-04-19T02:16:53.170284+0000","last_became_active":"2024-04-19T02:15:28.890806+0000","last_became_peered":"2024-04-19T02:15:28.890806+0000","last_unstale":"2024-04-19T02:16:53.170284+0000","last_undegraded":"2024-04-19T02:16:53.170284+0000","last_fullsized":"2024-04-19T02:16:53.170284+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:57.946581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.174244+0000","last_change":"2024-04-19T02:15:29.278148+0000","last_active":"2024-04-19T02:16:53.174244+0000","last_peered":"2024-04-19T02:16:53.174244+0000","last_clean":"2024-04-19T02:16:53.174244+0000","last_became_active":"2024-04-19T02:15:29.277402+0000","last_became_peered":"2024-04-19T02:15:29.277402+0000","last_unstale":"2024-04-19T02:16:53.174244+0000","last_undegraded":"2024-04-19T02:16:53.174244+0000","last_fullsized":"2024-04-19T02:16:53.174244+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":40,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.172194+0000","last_change":"2024-04-19T02:15:28.892905+0000","last_active":"2024-04-19T02:16:53.172194+0000","last_peered":"2024-04-19T02:16:53.172194+0000","last_clean":"2024-04-19T02:16:53.172194+0000","last_became_active":"2024-04-19T02:15:28.892541+0000","last_became_peered":"2024-04-19T02:15:28.892541+0000","last_unstale":"2024-04-19T02:16:53.172194+0000","last_undegraded":"2024-04-19T02:16:53.172194+0000","last_fullsized":"2024-04-19T02:16:53.172194+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:33.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.169837+0000","last_change":"2024-04-19T02:15:29.278810+0000","last_active":"2024-04-19T02:16:53.169837+0000","last_peered":"2024-04-19T02:16:53.169837+0000","last_clean":"2024-04-19T02:16:53.169837+0000","last_became_active":"2024-04-19T02:15:29.278093+0000","last_became_peered":"2024-04-19T02:15:29.278093+0000","last_unstale":"2024-04-19T02:16:53.169837+0000","last_undegraded":"2024-04-19T02:16:53.169837+0000","last_fullsized":"2024-04-19T02:16:53.169837+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:34.883207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":43,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.166764+0000","last_change":"2024-04-19T02:15:28.892937+0000","last_active":"2024-04-19T02:16:53.166764+0000","last_peered":"2024-04-19T02:16:53.166764+0000","last_clean":"2024-04-19T02:16:53.166764+0000","last_became_active":"2024-04-19T02:15:28.891440+0000","last_became_peered":"2024-04-19T02:15:28.891440+0000","last_unstale":"2024-04-19T02:16:53.166764+0000","last_undegraded":"2024-04-19T02:16:53.166764+0000","last_fullsized":"2024-04-19T02:16:53.166764+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.169552+0000","last_change":"2024-04-19T02:15:29.278404+0000","last_active":"2024-04-19T02:16:53.169552+0000","last_peered":"2024-04-19T02:16:53.169552+0000","last_clean":"2024-04-19T02:16:53.169552+0000","last_became_active":"2024-04-19T02:15:29.277460+0000","last_became_peered":"2024-04-19T02:15:29.277460+0000","last_unstale":"2024-04-19T02:16:53.169552+0000","last_undegraded":"2024-04-19T02:16:53.169552+0000","last_fullsized":"2024-04-19T02:16:53.169552+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":46,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.172111+0000","last_change":"2024-04-19T02:15:28.891097+0000","last_active":"2024-04-19T02:16:53.172111+0000","last_peered":"2024-04-19T02:16:53.172111+0000","last_clean":"2024-04-19T02:16:53.172111+0000","last_became_active":"2024-04-19T02:15:28.890795+0000","last_became_peered":"2024-04-19T02:15:28.890795+0000","last_unstale":"2024-04-19T02:16:53.172111+0000","last_undegraded":"2024-04-19T02:16:53.172111+0000","last_fullsized":"2024-04-19T02:16:53.172111+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171835+0000","last_change":"2024-04-19T02:15:29.278546+0000","last_active":"2024-04-19T02:16:53.171835+0000","last_peered":"2024-04-19T02:16:53.171835+0000","last_clean":"2024-04-19T02:16:53.171835+0000","last_became_active":"2024-04-19T02:15:29.277547+0000","last_became_peered":"2024-04-19T02:15:29.277547+0000","last_unstale":"2024-04-19T02:16:53.171835+0000","last_undegraded":"2024-04-19T02:16:53.171835+0000","last_fullsized":"2024-04-19T02:16:53.171835+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":42,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171799+0000","last_change":"2024-04-19T02:15:28.892977+0000","last_active":"2024-04-19T02:16:53.171799+0000","last_peered":"2024-04-19T02:16:53.171799+0000","last_clean":"2024-04-19T02:16:53.171799+0000","last_became_active":"2024-04-19T02:15:28.892636+0000","last_became_peered":"2024-04-19T02:15:28.892636+0000","last_unstale":"2024-04-19T02:16:53.171799+0000","last_undegraded":"2024-04-19T02:16:53.171799+0000","last_fullsized":"2024-04-19T02:16:53.171799+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:43:51.221619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":38,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.170671+0000","last_change":"2024-04-19T02:15:53.955655+0000","last_active":"2024-04-19T02:16:53.170671+0000","last_peered":"2024-04-19T02:16:53.170671+0000","last_clean":"2024-04-19T02:16:53.170671+0000","last_became_active":"2024-04-19T02:15:53.955382+0000","last_became_peered":"2024-04-19T02:15:53.955382+0000","last_unstale":"2024-04-19T02:16:53.170671+0000","last_undegraded":"2024-04-19T02:16:53.170671+0000","last_fullsized":"2024-04-19T02:16:53.170671+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:48.239260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":40,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.169664+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:16:53.169664+0000","last_peered":"2024-04-19T02:16:53.169664+0000","last_clean":"2024-04-19T02:16:53.169664+0000","last_became_active":"2024-04-19T02:15:28.890751+0000","last_became_peered":"2024-04-19T02:15:28.890751+0000","last_unstale":"2024-04-19T02:16:53.169664+0000","last_undegraded":"2024-04-19T02:16:53.169664+0000","last_fullsized":"2024-04-19T02:16:53.169664+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":38,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.169285+0000","last_change":"2024-04-19T02:15:53.957865+0000","last_active":"2024-04-19T02:16:53.169285+0000","last_peered":"2024-04-19T02:16:53.169285+0000","last_clean":"2024-04-19T02:16:53.169285+0000","last_became_active":"2024-04-19T02:15:53.957627+0000","last_became_peered":"2024-04-19T02:15:53.957627+0000","last_unstale":"2024-04-19T02:16:53.169285+0000","last_undegraded":"2024-04-19T02:16:53.169285+0000","last_fullsized":"2024-04-19T02:16:53.169285+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:16:45.799016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":40,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.167415+0000","last_change":"2024-04-19T02:15:28.892934+0000","last_active":"2024-04-19T02:16:53.167415+0000","last_peered":"2024-04-19T02:16:53.167415+0000","last_clean":"2024-04-19T02:16:53.167415+0000","last_became_active":"2024-04-19T02:15:28.891879+0000","last_became_peered":"2024-04-19T02:15:28.891879+0000","last_unstale":"2024-04-19T02:16:53.167415+0000","last_undegraded":"2024-04-19T02:16:53.167415+0000","last_fullsized":"2024-04-19T02:16:53.167415+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:10:12.514798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.174363+0000","last_change":"2024-04-19T02:15:29.279685+0000","last_active":"2024-04-19T02:16:53.174363+0000","last_peered":"2024-04-19T02:16:53.174363+0000","last_clean":"2024-04-19T02:16:53.174363+0000","last_became_active":"2024-04-19T02:15:29.278810+0000","last_became_peered":"2024-04-19T02:15:29.278810+0000","last_unstale":"2024-04-19T02:16:53.174363+0000","last_undegraded":"2024-04-19T02:16:53.174363+0000","last_fullsized":"2024-04-19T02:16:53.174363+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":48,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171392+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:16:53.171392+0000","last_peered":"2024-04-19T02:16:53.171392+0000","last_clean":"2024-04-19T02:16:53.171392+0000","last_became_active":"2024-04-19T02:15:28.890882+0000","last_became_peered":"2024-04-19T02:15:28.890882+0000","last_unstale":"2024-04-19T02:16:53.171392+0000","last_undegraded":"2024-04-19T02:16:53.171392+0000","last_fullsized":"2024-04-19T02:16:53.171392+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:31.673938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.170353+0000","last_change":"2024-04-19T02:15:29.284258+0000","last_active":"2024-04-19T02:16:53.170353+0000","last_peered":"2024-04-19T02:16:53.170353+0000","last_clean":"2024-04-19T02:16:53.170353+0000","last_became_active":"2024-04-19T02:15:29.283995+0000","last_became_peered":"2024-04-19T02:15:29.283995+0000","last_unstale":"2024-04-19T02:16:53.170353+0000","last_undegraded":"2024-04-19T02:16:53.170353+0000","last_fullsized":"2024-04-19T02:16:53.170353+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:35.941308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"44'8760","reported_seq":8796,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.816923+0000","last_change":"2024-04-19T02:15:53.956977+0000","last_active":"2024-04-19T02:16:57.816923+0000","last_peered":"2024-04-19T02:16:57.816923+0000","last_clean":"2024-04-19T02:16:57.816923+0000","last_became_active":"2024-04-19T02:15:53.956730+0000","last_became_peered":"2024-04-19T02:15:53.956730+0000","last_unstale":"2024-04-19T02:16:57.816923+0000","last_undegraded":"2024-04-19T02:16:57.816923+0000","last_fullsized":"2024-04-19T02:16:57.816923+0000","mapping_epoch":16,"log_start":"31'5100","ondisk_log_start":"31'5100","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3660,"log_dups_size":0,"ondisk_log_size":3660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:56:46.323499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":541458432,"num_objects":8262,"num_object_clones":0,"num_object_copies":16524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8262,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8760,"num_write_kb":544704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":41,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.172528+0000","last_change":"2024-04-19T02:15:28.890265+0000","last_active":"2024-04-19T02:16:53.172528+0000","last_peered":"2024-04-19T02:16:53.172528+0000","last_clean":"2024-04-19T02:16:53.172528+0000","last_became_active":"2024-04-19T02:15:28.890004+0000","last_became_peered":"2024-04-19T02:15:28.890004+0000","last_unstale":"2024-04-19T02:16:53.172528+0000","last_undegraded":"2024-04-19T02:16:53.172528+0000","last_fullsized":"2024-04-19T02:16:53.172528+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:02.517101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.166202+0000","last_change":"2024-04-19T02:15:29.285529+0000","last_active":"2024-04-19T02:16:53.166202+0000","last_peered":"2024-04-19T02:16:53.166202+0000","last_clean":"2024-04-19T02:16:53.166202+0000","last_became_active":"2024-04-19T02:15:29.285197+0000","last_became_peered":"2024-04-19T02:15:29.285197+0000","last_unstale":"2024-04-19T02:16:53.166202+0000","last_undegraded":"2024-04-19T02:16:53.166202+0000","last_fullsized":"2024-04-19T02:16:53.166202+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"44'8710","reported_seq":8744,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.769806+0000","last_change":"2024-04-19T02:15:53.958523+0000","last_active":"2024-04-19T02:16:57.769806+0000","last_peered":"2024-04-19T02:16:57.769806+0000","last_clean":"2024-04-19T02:16:57.769806+0000","last_became_active":"2024-04-19T02:15:53.957627+0000","last_became_peered":"2024-04-19T02:15:53.957627+0000","last_unstale":"2024-04-19T02:16:57.769806+0000","last_undegraded":"2024-04-19T02:16:57.769806+0000","last_fullsized":"2024-04-19T02:16:57.769806+0000","mapping_epoch":16,"log_start":"30'4747","ondisk_log_start":"30'4747","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3963,"log_dups_size":0,"ondisk_log_size":3963,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:59:55.120296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":537526272,"num_objects":8202,"num_object_clones":0,"num_object_copies":16404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8202,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8710,"num_write_kb":541184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":42,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.166670+0000","last_change":"2024-04-19T02:15:28.893902+0000","last_active":"2024-04-19T02:16:53.166670+0000","last_peered":"2024-04-19T02:16:53.166670+0000","last_clean":"2024-04-19T02:16:53.166670+0000","last_became_active":"2024-04-19T02:15:28.893231+0000","last_became_peered":"2024-04-19T02:15:28.893231+0000","last_unstale":"2024-04-19T02:16:53.166670+0000","last_undegraded":"2024-04-19T02:16:53.166670+0000","last_fullsized":"2024-04-19T02:16:53.166670+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:23.658442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.167575+0000","last_change":"2024-04-19T02:15:29.282874+0000","last_active":"2024-04-19T02:16:53.167575+0000","last_peered":"2024-04-19T02:16:53.167575+0000","last_clean":"2024-04-19T02:16:53.167575+0000","last_became_active":"2024-04-19T02:15:29.281675+0000","last_became_peered":"2024-04-19T02:15:29.281675+0000","last_unstale":"2024-04-19T02:16:53.167575+0000","last_undegraded":"2024-04-19T02:16:53.167575+0000","last_fullsized":"2024-04-19T02:16:53.167575+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:35.941308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"44'8613","reported_seq":8649,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.772401+0000","last_change":"2024-04-19T02:15:53.958324+0000","last_active":"2024-04-19T02:16:57.772401+0000","last_peered":"2024-04-19T02:16:57.772401+0000","last_clean":"2024-04-19T02:16:57.772401+0000","last_became_active":"2024-04-19T02:15:53.957392+0000","last_became_peered":"2024-04-19T02:15:53.957392+0000","last_unstale":"2024-04-19T02:16:57.772401+0000","last_undegraded":"2024-04-19T02:16:57.772401+0000","last_fullsized":"2024-04-19T02:16:57.772401+0000","mapping_epoch":16,"log_start":"30'4700","ondisk_log_start":"30'4700","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3913,"log_dups_size":0,"ondisk_log_size":3913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:12:58.132969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":530776064,"num_objects":8099,"num_object_clones":0,"num_object_copies":16198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8099,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8613,"num_write_kb":534784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":41,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.172274+0000","last_change":"2024-04-19T02:15:28.891234+0000","last_active":"2024-04-19T02:16:53.172274+0000","last_peered":"2024-04-19T02:16:53.172274+0000","last_clean":"2024-04-19T02:16:53.172274+0000","last_became_active":"2024-04-19T02:15:28.890881+0000","last_became_peered":"2024-04-19T02:15:28.890881+0000","last_unstale":"2024-04-19T02:16:53.172274+0000","last_undegraded":"2024-04-19T02:16:53.172274+0000","last_fullsized":"2024-04-19T02:16:53.172274+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171564+0000","last_change":"2024-04-19T02:15:29.281937+0000","last_active":"2024-04-19T02:16:53.171564+0000","last_peered":"2024-04-19T02:16:53.171564+0000","last_clean":"2024-04-19T02:16:53.171564+0000","last_became_active":"2024-04-19T02:15:29.280727+0000","last_became_peered":"2024-04-19T02:15:29.280727+0000","last_unstale":"2024-04-19T02:16:53.171564+0000","last_undegraded":"2024-04-19T02:16:53.171564+0000","last_fullsized":"2024-04-19T02:16:53.171564+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"44'8756","reported_seq":8790,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.808004+0000","last_change":"2024-04-19T02:15:53.959099+0000","last_active":"2024-04-19T02:16:57.808004+0000","last_peered":"2024-04-19T02:16:57.808004+0000","last_clean":"2024-04-19T02:16:57.808004+0000","last_became_active":"2024-04-19T02:15:53.958885+0000","last_became_peered":"2024-04-19T02:15:53.958885+0000","last_unstale":"2024-04-19T02:16:57.808004+0000","last_undegraded":"2024-04-19T02:16:57.808004+0000","last_fullsized":"2024-04-19T02:16:57.808004+0000","mapping_epoch":16,"log_start":"31'5100","ondisk_log_start":"31'5100","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3656,"log_dups_size":0,"ondisk_log_size":3656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:53:26.969927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540672000,"num_objects":8250,"num_object_clones":0,"num_object_copies":16500,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8250,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8756,"num_write_kb":544192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":40,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171924+0000","last_change":"2024-04-19T02:15:28.892767+0000","last_active":"2024-04-19T02:16:53.171924+0000","last_peered":"2024-04-19T02:16:53.171924+0000","last_clean":"2024-04-19T02:16:53.171924+0000","last_became_active":"2024-04-19T02:15:28.892235+0000","last_became_peered":"2024-04-19T02:15:28.892235+0000","last_unstale":"2024-04-19T02:16:53.171924+0000","last_undegraded":"2024-04-19T02:16:53.171924+0000","last_fullsized":"2024-04-19T02:16:53.171924+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:37.690735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.174218+0000","last_change":"2024-04-19T02:15:29.279857+0000","last_active":"2024-04-19T02:16:53.174218+0000","last_peered":"2024-04-19T02:16:53.174218+0000","last_clean":"2024-04-19T02:16:53.174218+0000","last_became_active":"2024-04-19T02:15:29.279536+0000","last_became_peered":"2024-04-19T02:15:29.279536+0000","last_unstale":"2024-04-19T02:16:53.174218+0000","last_undegraded":"2024-04-19T02:16:53.174218+0000","last_fullsized":"2024-04-19T02:16:53.174218+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:00.191179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"44'8640","reported_seq":8677,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.819415+0000","last_change":"2024-04-19T02:15:53.957261+0000","last_active":"2024-04-19T02:16:57.819415+0000","last_peered":"2024-04-19T02:16:57.819415+0000","last_clean":"2024-04-19T02:16:57.819415+0000","last_became_active":"2024-04-19T02:15:53.957092+0000","last_became_peered":"2024-04-19T02:15:53.957092+0000","last_unstale":"2024-04-19T02:16:57.819415+0000","last_undegraded":"2024-04-19T02:16:57.819415+0000","last_fullsized":"2024-04-19T02:16:57.819415+0000","mapping_epoch":16,"log_start":"31'4913","ondisk_log_start":"31'4913","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3727,"log_dups_size":0,"ondisk_log_size":3727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:54:15.544923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":532086808,"num_objects":8120,"num_object_clones":0,"num_object_copies":16240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8120,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":8640,"num_write_kb":536257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":42,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.174091+0000","last_change":"2024-04-19T02:15:28.891611+0000","last_active":"2024-04-19T02:16:53.174091+0000","last_peered":"2024-04-19T02:16:53.174091+0000","last_clean":"2024-04-19T02:16:53.174091+0000","last_became_active":"2024-04-19T02:15:28.890914+0000","last_became_peered":"2024-04-19T02:15:28.890914+0000","last_unstale":"2024-04-19T02:16:53.174091+0000","last_undegraded":"2024-04-19T02:16:53.174091+0000","last_fullsized":"2024-04-19T02:16:53.174091+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:37.690735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171922+0000","last_change":"2024-04-19T02:15:29.285774+0000","last_active":"2024-04-19T02:16:53.171922+0000","last_peered":"2024-04-19T02:16:53.171922+0000","last_clean":"2024-04-19T02:16:53.171922+0000","last_became_active":"2024-04-19T02:15:29.284705+0000","last_became_peered":"2024-04-19T02:15:29.284705+0000","last_unstale":"2024-04-19T02:16:53.171922+0000","last_undegraded":"2024-04-19T02:16:53.171922+0000","last_fullsized":"2024-04-19T02:16:53.171922+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"44'8650","reported_seq":8686,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.769782+0000","last_change":"2024-04-19T02:15:53.955286+0000","last_active":"2024-04-19T02:16:57.769782+0000","last_peered":"2024-04-19T02:16:57.769782+0000","last_clean":"2024-04-19T02:16:57.769782+0000","last_became_active":"2024-04-19T02:15:53.955026+0000","last_became_peered":"2024-04-19T02:15:53.955026+0000","last_unstale":"2024-04-19T02:16:57.769782+0000","last_undegraded":"2024-04-19T02:16:57.769782+0000","last_fullsized":"2024-04-19T02:16:57.769782+0000","mapping_epoch":16,"log_start":"31'5000","ondisk_log_start":"31'5000","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3650,"log_dups_size":0,"ondisk_log_size":3650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:05:48.594301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":533856256,"num_objects":8146,"num_object_clones":0,"num_object_copies":16292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8146,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8650,"num_write_kb":537472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":40,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171468+0000","last_change":"2024-04-19T02:15:28.892873+0000","last_active":"2024-04-19T02:16:53.171468+0000","last_peered":"2024-04-19T02:16:53.171468+0000","last_clean":"2024-04-19T02:16:53.171468+0000","last_became_active":"2024-04-19T02:15:28.892487+0000","last_became_peered":"2024-04-19T02:15:28.892487+0000","last_unstale":"2024-04-19T02:16:53.171468+0000","last_undegraded":"2024-04-19T02:16:53.171468+0000","last_fullsized":"2024-04-19T02:16:53.171468+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:35.412837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.172462+0000","last_change":"2024-04-19T02:15:29.285019+0000","last_active":"2024-04-19T02:16:53.172462+0000","last_peered":"2024-04-19T02:16:53.172462+0000","last_clean":"2024-04-19T02:16:53.172462+0000","last_became_active":"2024-04-19T02:15:29.284650+0000","last_became_peered":"2024-04-19T02:15:29.284650+0000","last_unstale":"2024-04-19T02:16:53.172462+0000","last_undegraded":"2024-04-19T02:16:53.172462+0000","last_fullsized":"2024-04-19T02:16:53.172462+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"44'8714","reported_seq":8749,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.820770+0000","last_change":"2024-04-19T02:15:53.957403+0000","last_active":"2024-04-19T02:16:57.820770+0000","last_peered":"2024-04-19T02:16:57.820770+0000","last_clean":"2024-04-19T02:16:57.820770+0000","last_became_active":"2024-04-19T02:15:53.957190+0000","last_became_peered":"2024-04-19T02:15:53.957190+0000","last_unstale":"2024-04-19T02:16:57.820770+0000","last_undegraded":"2024-04-19T02:16:57.820770+0000","last_fullsized":"2024-04-19T02:16:57.820770+0000","mapping_epoch":16,"log_start":"31'5001","ondisk_log_start":"31'5001","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3713,"log_dups_size":0,"ondisk_log_size":3713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:07:12.817884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":534773760,"num_objects":8160,"num_object_clones":0,"num_object_copies":16320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8160,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8714,"num_write_kb":539968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171247+0000","last_change":"2024-04-19T02:15:53.956839+0000","last_active":"2024-04-19T02:16:53.171247+0000","last_peered":"2024-04-19T02:16:53.171247+0000","last_clean":"2024-04-19T02:16:53.171247+0000","last_became_active":"2024-04-19T02:15:53.956630+0000","last_became_peered":"2024-04-19T02:15:53.956630+0000","last_unstale":"2024-04-19T02:16:53.171247+0000","last_undegraded":"2024-04-19T02:16:53.171247+0000","last_fullsized":"2024-04-19T02:16:53.171247+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:47.229730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.172410+0000","last_change":"2024-04-19T02:15:29.287190+0000","last_active":"2024-04-19T02:16:53.172410+0000","last_peered":"2024-04-19T02:16:53.172410+0000","last_clean":"2024-04-19T02:16:53.172410+0000","last_became_active":"2024-04-19T02:15:29.286606+0000","last_became_peered":"2024-04-19T02:15:29.286606+0000","last_unstale":"2024-04-19T02:16:53.172410+0000","last_undegraded":"2024-04-19T02:16:53.172410+0000","last_fullsized":"2024-04-19T02:16:53.172410+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:28.387062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"44'8473","reported_seq":8508,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.786113+0000","last_change":"2024-04-19T02:15:53.958448+0000","last_active":"2024-04-19T02:16:57.786113+0000","last_peered":"2024-04-19T02:16:57.786113+0000","last_clean":"2024-04-19T02:16:57.786113+0000","last_became_active":"2024-04-19T02:15:53.957595+0000","last_became_peered":"2024-04-19T02:15:53.957595+0000","last_unstale":"2024-04-19T02:16:57.786113+0000","last_undegraded":"2024-04-19T02:16:57.786113+0000","last_fullsized":"2024-04-19T02:16:57.786113+0000","mapping_epoch":16,"log_start":"30'4544","ondisk_log_start":"30'4544","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3929,"log_dups_size":0,"ondisk_log_size":3929,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:26:31.855319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524222464,"num_objects":7999,"num_object_clones":0,"num_object_copies":15998,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7999,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8473,"num_write_kb":527104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":40,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.166343+0000","last_change":"2024-04-19T02:15:28.894121+0000","last_active":"2024-04-19T02:16:53.166343+0000","last_peered":"2024-04-19T02:16:53.166343+0000","last_clean":"2024-04-19T02:16:53.166343+0000","last_became_active":"2024-04-19T02:15:28.893902+0000","last_became_peered":"2024-04-19T02:15:28.893902+0000","last_unstale":"2024-04-19T02:16:53.166343+0000","last_undegraded":"2024-04-19T02:16:53.166343+0000","last_fullsized":"2024-04-19T02:16:53.166343+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:10:35.146583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.170213+0000","last_change":"2024-04-19T02:15:29.282870+0000","last_active":"2024-04-19T02:16:53.170213+0000","last_peered":"2024-04-19T02:16:53.170213+0000","last_clean":"2024-04-19T02:16:53.170213+0000","last_became_active":"2024-04-19T02:15:29.281873+0000","last_became_peered":"2024-04-19T02:15:29.281873+0000","last_unstale":"2024-04-19T02:16:53.170213+0000","last_undegraded":"2024-04-19T02:16:53.170213+0000","last_fullsized":"2024-04-19T02:16:53.170213+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"44'8624","reported_seq":8660,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.801450+0000","last_change":"2024-04-19T02:15:53.955498+0000","last_active":"2024-04-19T02:16:57.801450+0000","last_peered":"2024-04-19T02:16:57.801450+0000","last_clean":"2024-04-19T02:16:57.801450+0000","last_became_active":"2024-04-19T02:15:53.954910+0000","last_became_peered":"2024-04-19T02:15:53.954910+0000","last_unstale":"2024-04-19T02:16:57.801450+0000","last_undegraded":"2024-04-19T02:16:57.801450+0000","last_fullsized":"2024-04-19T02:16:57.801450+0000","mapping_epoch":16,"log_start":"31'5000","ondisk_log_start":"31'5000","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3624,"log_dups_size":0,"ondisk_log_size":3624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:58:27.262672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":530579456,"num_objects":8096,"num_object_clones":0,"num_object_copies":16192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8096,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8624,"num_write_kb":535040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171261+0000","last_change":"2024-04-19T02:15:24.527061+0000","last_active":"2024-04-19T02:16:53.171261+0000","last_peered":"2024-04-19T02:16:53.171261+0000","last_clean":"2024-04-19T02:16:53.171261+0000","last_became_active":"2024-04-19T02:15:24.526757+0000","last_became_peered":"2024-04-19T02:15:24.526757+0000","last_unstale":"2024-04-19T02:16:53.171261+0000","last_undegraded":"2024-04-19T02:16:53.171261+0000","last_fullsized":"2024-04-19T02:16:53.171261+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:17:13.649077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":40,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.172357+0000","last_change":"2024-04-19T02:15:28.892766+0000","last_active":"2024-04-19T02:16:53.172357+0000","last_peered":"2024-04-19T02:16:53.172357+0000","last_clean":"2024-04-19T02:16:53.172357+0000","last_became_active":"2024-04-19T02:15:28.892396+0000","last_became_peered":"2024-04-19T02:15:28.892396+0000","last_unstale":"2024-04-19T02:16:53.172357+0000","last_undegraded":"2024-04-19T02:16:53.172357+0000","last_fullsized":"2024-04-19T02:16:53.172357+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:57.946581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.167335+0000","last_change":"2024-04-19T02:15:29.277922+0000","last_active":"2024-04-19T02:16:53.167335+0000","last_peered":"2024-04-19T02:16:53.167335+0000","last_clean":"2024-04-19T02:16:53.167335+0000","last_became_active":"2024-04-19T02:15:29.276968+0000","last_became_peered":"2024-04-19T02:15:29.276968+0000","last_unstale":"2024-04-19T02:16:53.167335+0000","last_undegraded":"2024-04-19T02:16:53.167335+0000","last_fullsized":"2024-04-19T02:16:53.167335+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"44'8661","reported_seq":8697,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.804241+0000","last_change":"2024-04-19T02:15:53.955228+0000","last_active":"2024-04-19T02:16:57.804241+0000","last_peered":"2024-04-19T02:16:57.804241+0000","last_clean":"2024-04-19T02:16:57.804241+0000","last_became_active":"2024-04-19T02:15:53.954960+0000","last_became_peered":"2024-04-19T02:15:53.954960+0000","last_unstale":"2024-04-19T02:16:57.804241+0000","last_undegraded":"2024-04-19T02:16:57.804241+0000","last_fullsized":"2024-04-19T02:16:57.804241+0000","mapping_epoch":16,"log_start":"31'5000","ondisk_log_start":"31'5000","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3661,"log_dups_size":0,"ondisk_log_size":3661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:46:07.409922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":534446080,"num_objects":8155,"num_object_clones":0,"num_object_copies":16310,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8155,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8661,"num_write_kb":538112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171606+0000","last_change":"2024-04-19T02:15:24.530933+0000","last_active":"2024-04-19T02:16:53.171606+0000","last_peered":"2024-04-19T02:16:53.171606+0000","last_clean":"2024-04-19T02:16:53.171606+0000","last_became_active":"2024-04-19T02:15:24.530550+0000","last_became_peered":"2024-04-19T02:15:24.530550+0000","last_unstale":"2024-04-19T02:16:53.171606+0000","last_undegraded":"2024-04-19T02:16:53.171606+0000","last_fullsized":"2024-04-19T02:16:53.171606+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:18:15.194321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":40,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171720+0000","last_change":"2024-04-19T02:15:28.893062+0000","last_active":"2024-04-19T02:16:53.171720+0000","last_peered":"2024-04-19T02:16:53.171720+0000","last_clean":"2024-04-19T02:16:53.171720+0000","last_became_active":"2024-04-19T02:15:28.892798+0000","last_became_peered":"2024-04-19T02:15:28.892798+0000","last_unstale":"2024-04-19T02:16:53.171720+0000","last_undegraded":"2024-04-19T02:16:53.171720+0000","last_fullsized":"2024-04-19T02:16:53.171720+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:53.170180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171054+0000","last_change":"2024-04-19T02:15:29.278294+0000","last_active":"2024-04-19T02:16:53.171054+0000","last_peered":"2024-04-19T02:16:53.171054+0000","last_clean":"2024-04-19T02:16:53.171054+0000","last_became_active":"2024-04-19T02:15:29.277536+0000","last_became_peered":"2024-04-19T02:15:29.277536+0000","last_unstale":"2024-04-19T02:16:53.171054+0000","last_undegraded":"2024-04-19T02:16:53.171054+0000","last_fullsized":"2024-04-19T02:16:53.171054+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"44'8739","reported_seq":8775,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.798919+0000","last_change":"2024-04-19T02:15:53.956251+0000","last_active":"2024-04-19T02:16:57.798919+0000","last_peered":"2024-04-19T02:16:57.798919+0000","last_clean":"2024-04-19T02:16:57.798919+0000","last_became_active":"2024-04-19T02:15:53.955886+0000","last_became_peered":"2024-04-19T02:15:53.955886+0000","last_unstale":"2024-04-19T02:16:57.798919+0000","last_undegraded":"2024-04-19T02:16:57.798919+0000","last_fullsized":"2024-04-19T02:16:57.798919+0000","mapping_epoch":16,"log_start":"31'5100","ondisk_log_start":"31'5100","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3639,"log_dups_size":0,"ondisk_log_size":3639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:38:38.586906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":535101440,"num_objects":8165,"num_object_clones":0,"num_object_copies":16330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8165,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8739,"num_write_kb":540928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.169772+0000","last_change":"2024-04-19T02:15:24.527048+0000","last_active":"2024-04-19T02:16:53.169772+0000","last_peered":"2024-04-19T02:16:53.169772+0000","last_clean":"2024-04-19T02:16:53.169772+0000","last_became_active":"2024-04-19T02:15:24.526790+0000","last_became_peered":"2024-04-19T02:15:24.526790+0000","last_unstale":"2024-04-19T02:16:53.169772+0000","last_undegraded":"2024-04-19T02:16:53.169772+0000","last_fullsized":"2024-04-19T02:16:53.169772+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":38,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171085+0000","last_change":"2024-04-19T02:15:53.956945+0000","last_active":"2024-04-19T02:16:53.171085+0000","last_peered":"2024-04-19T02:16:53.171085+0000","last_clean":"2024-04-19T02:16:53.171085+0000","last_became_active":"2024-04-19T02:15:53.956719+0000","last_became_peered":"2024-04-19T02:15:53.956719+0000","last_unstale":"2024-04-19T02:16:53.171085+0000","last_undegraded":"2024-04-19T02:16:53.171085+0000","last_fullsized":"2024-04-19T02:16:53.171085+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:00:37.754624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.170311+0000","last_change":"2024-04-19T02:15:29.282663+0000","last_active":"2024-04-19T02:16:53.170311+0000","last_peered":"2024-04-19T02:16:53.170311+0000","last_clean":"2024-04-19T02:16:53.170311+0000","last_became_active":"2024-04-19T02:15:29.282217+0000","last_became_peered":"2024-04-19T02:15:29.282217+0000","last_unstale":"2024-04-19T02:16:53.170311+0000","last_undegraded":"2024-04-19T02:16:53.170311+0000","last_fullsized":"2024-04-19T02:16:53.170311+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"44'8599","reported_seq":8633,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.790356+0000","last_change":"2024-04-19T02:15:53.958264+0000","last_active":"2024-04-19T02:16:57.790356+0000","last_peered":"2024-04-19T02:16:57.790356+0000","last_clean":"2024-04-19T02:16:57.790356+0000","last_became_active":"2024-04-19T02:15:53.956689+0000","last_became_peered":"2024-04-19T02:15:53.956689+0000","last_unstale":"2024-04-19T02:16:57.790356+0000","last_undegraded":"2024-04-19T02:16:57.790356+0000","last_fullsized":"2024-04-19T02:16:57.790356+0000","mapping_epoch":16,"log_start":"30'4700","ondisk_log_start":"30'4700","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3899,"log_dups_size":0,"ondisk_log_size":3899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:24:32.928594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525139968,"num_objects":8013,"num_object_clones":0,"num_object_copies":16026,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8013,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8599,"num_write_kb":531584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":43,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171720+0000","last_change":"2024-04-19T02:15:24.530924+0000","last_active":"2024-04-19T02:16:53.171720+0000","last_peered":"2024-04-19T02:16:53.171720+0000","last_clean":"2024-04-19T02:16:53.171720+0000","last_became_active":"2024-04-19T02:15:24.530551+0000","last_became_peered":"2024-04-19T02:15:24.530551+0000","last_unstale":"2024-04-19T02:16:53.171720+0000","last_undegraded":"2024-04-19T02:16:53.171720+0000","last_fullsized":"2024-04-19T02:16:53.171720+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:30.576946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":239,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171259+0000","last_change":"2024-04-19T02:15:24.533634+0000","last_active":"2024-04-19T02:16:53.171259+0000","last_peered":"2024-04-19T02:16:53.171259+0000","last_clean":"2024-04-19T02:16:53.171259+0000","last_became_active":"2024-04-19T02:15:24.533420+0000","last_became_peered":"2024-04-19T02:15:24.533420+0000","last_unstale":"2024-04-19T02:16:53.171259+0000","last_undegraded":"2024-04-19T02:16:53.171259+0000","last_fullsized":"2024-04-19T02:16:53.171259+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":40,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.169484+0000","last_change":"2024-04-19T02:15:28.890244+0000","last_active":"2024-04-19T02:16:53.169484+0000","last_peered":"2024-04-19T02:16:53.169484+0000","last_clean":"2024-04-19T02:16:53.169484+0000","last_became_active":"2024-04-19T02:15:28.889831+0000","last_became_peered":"2024-04-19T02:15:28.889831+0000","last_unstale":"2024-04-19T02:16:53.169484+0000","last_undegraded":"2024-04-19T02:16:53.169484+0000","last_fullsized":"2024-04-19T02:16:53.169484+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.172375+0000","last_change":"2024-04-19T02:15:29.285015+0000","last_active":"2024-04-19T02:16:53.172375+0000","last_peered":"2024-04-19T02:16:53.172375+0000","last_clean":"2024-04-19T02:16:53.172375+0000","last_became_active":"2024-04-19T02:15:29.284164+0000","last_became_peered":"2024-04-19T02:15:29.284164+0000","last_unstale":"2024-04-19T02:16:53.172375+0000","last_undegraded":"2024-04-19T02:16:53.172375+0000","last_fullsized":"2024-04-19T02:16:53.172375+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:36.987844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"44'8601","reported_seq":8637,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.777061+0000","last_change":"2024-04-19T02:15:53.956463+0000","last_active":"2024-04-19T02:16:57.777061+0000","last_peered":"2024-04-19T02:16:57.777061+0000","last_clean":"2024-04-19T02:16:57.777061+0000","last_became_active":"2024-04-19T02:15:53.955819+0000","last_became_peered":"2024-04-19T02:15:53.955819+0000","last_unstale":"2024-04-19T02:16:57.777061+0000","last_undegraded":"2024-04-19T02:16:57.777061+0000","last_fullsized":"2024-04-19T02:16:57.777061+0000","mapping_epoch":16,"log_start":"31'4931","ondisk_log_start":"31'4931","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3670,"log_dups_size":0,"ondisk_log_size":3670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:46:07.409922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":530907136,"num_objects":8101,"num_object_clones":0,"num_object_copies":16202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8101,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8601,"num_write_kb":534464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171290+0000","last_change":"2024-04-19T02:15:24.533912+0000","last_active":"2024-04-19T02:16:53.171290+0000","last_peered":"2024-04-19T02:16:53.171290+0000","last_clean":"2024-04-19T02:16:53.171290+0000","last_became_active":"2024-04-19T02:15:24.533580+0000","last_became_peered":"2024-04-19T02:15:24.533580+0000","last_unstale":"2024-04-19T02:16:53.171290+0000","last_undegraded":"2024-04-19T02:16:53.171290+0000","last_fullsized":"2024-04-19T02:16:53.171290+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:45.045477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":40,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.168995+0000","last_change":"2024-04-19T02:15:28.891889+0000","last_active":"2024-04-19T02:16:53.168995+0000","last_peered":"2024-04-19T02:16:53.168995+0000","last_clean":"2024-04-19T02:16:53.168995+0000","last_became_active":"2024-04-19T02:15:28.890919+0000","last_became_peered":"2024-04-19T02:15:28.890919+0000","last_unstale":"2024-04-19T02:16:53.168995+0000","last_undegraded":"2024-04-19T02:16:53.168995+0000","last_fullsized":"2024-04-19T02:16:53.168995+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:35.412837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":38,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.173961+0000","last_change":"2024-04-19T02:15:53.957881+0000","last_active":"2024-04-19T02:16:53.173961+0000","last_peered":"2024-04-19T02:16:53.173961+0000","last_clean":"2024-04-19T02:16:53.173961+0000","last_became_active":"2024-04-19T02:15:53.957657+0000","last_became_peered":"2024-04-19T02:15:53.957657+0000","last_unstale":"2024-04-19T02:16:53.173961+0000","last_undegraded":"2024-04-19T02:16:53.173961+0000","last_fullsized":"2024-04-19T02:16:53.173961+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:46.921714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"44'8687","reported_seq":8723,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.814753+0000","last_change":"2024-04-19T02:15:53.955068+0000","last_active":"2024-04-19T02:16:57.814753+0000","last_peered":"2024-04-19T02:16:57.814753+0000","last_clean":"2024-04-19T02:16:57.814753+0000","last_became_active":"2024-04-19T02:15:53.954721+0000","last_became_peered":"2024-04-19T02:15:53.954721+0000","last_unstale":"2024-04-19T02:16:57.814753+0000","last_undegraded":"2024-04-19T02:16:57.814753+0000","last_fullsized":"2024-04-19T02:16:57.814753+0000","mapping_epoch":16,"log_start":"31'5000","ondisk_log_start":"31'5000","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3687,"log_dups_size":0,"ondisk_log_size":3687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:18:29.742535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":535494656,"num_objects":8171,"num_object_clones":0,"num_object_copies":16342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8171,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8687,"num_write_kb":539456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":38,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.169464+0000","last_change":"2024-04-19T02:15:53.959105+0000","last_active":"2024-04-19T02:16:53.169464+0000","last_peered":"2024-04-19T02:16:53.169464+0000","last_clean":"2024-04-19T02:16:53.169464+0000","last_became_active":"2024-04-19T02:15:53.958836+0000","last_became_peered":"2024-04-19T02:15:53.958836+0000","last_unstale":"2024-04-19T02:16:53.169464+0000","last_undegraded":"2024-04-19T02:16:53.169464+0000","last_fullsized":"2024-04-19T02:16:53.169464+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:18:00.321514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":40,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.170976+0000","last_change":"2024-04-19T02:15:28.892125+0000","last_active":"2024-04-19T02:16:53.170976+0000","last_peered":"2024-04-19T02:16:53.170976+0000","last_clean":"2024-04-19T02:16:53.170976+0000","last_became_active":"2024-04-19T02:15:28.891300+0000","last_became_peered":"2024-04-19T02:15:28.891300+0000","last_unstale":"2024-04-19T02:16:53.170976+0000","last_undegraded":"2024-04-19T02:16:53.170976+0000","last_fullsized":"2024-04-19T02:16:53.170976+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.166422+0000","last_change":"2024-04-19T02:15:29.281694+0000","last_active":"2024-04-19T02:16:53.166422+0000","last_peered":"2024-04-19T02:16:53.166422+0000","last_clean":"2024-04-19T02:16:53.166422+0000","last_became_active":"2024-04-19T02:15:29.280519+0000","last_became_peered":"2024-04-19T02:15:29.280519+0000","last_unstale":"2024-04-19T02:16:53.166422+0000","last_undegraded":"2024-04-19T02:16:53.166422+0000","last_fullsized":"2024-04-19T02:16:53.166422+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:50.890545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"44'8476","reported_seq":19714,"reported_epoch":44,"state":"active+remapped+backfilling","last_fresh":"2024-04-19T02:16:57.810189+0000","last_change":"2024-04-19T02:16:30.103016+0000","last_active":"2024-04-19T02:16:57.810189+0000","last_peered":"2024-04-19T02:16:57.810189+0000","last_clean":"2024-04-19T02:16:22.050311+0000","last_became_active":"2024-04-19T02:16:24.119992+0000","last_became_peered":"2024-04-19T02:16:24.119992+0000","last_unstale":"2024-04-19T02:16:57.810189+0000","last_undegraded":"2024-04-19T02:16:57.810189+0000","last_fullsized":"2024-04-19T02:16:57.810189+0000","mapping_epoch":29,"log_start":"31'4837","ondisk_log_start":"31'4837","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3639,"log_dups_size":0,"ondisk_log_size":3639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:28.663111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":521797632,"num_objects":7962,"num_object_clones":0,"num_object_copies":15924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":847,"num_objects_unfound":0,"num_objects_dirty":7962,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8476,"num_write_kb":526016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5595,"num_bytes_recovered":366673920,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[{"shards":"0,2","objects":7962}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":42,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.170212+0000","last_change":"2024-04-19T02:15:28.891702+0000","last_active":"2024-04-19T02:16:53.170212+0000","last_peered":"2024-04-19T02:16:53.170212+0000","last_clean":"2024-04-19T02:16:53.170212+0000","last_became_active":"2024-04-19T02:15:28.890743+0000","last_became_peered":"2024-04-19T02:15:28.890743+0000","last_unstale":"2024-04-19T02:16:53.170212+0000","last_undegraded":"2024-04-19T02:16:53.170212+0000","last_fullsized":"2024-04-19T02:16:53.170212+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.174289+0000","last_change":"2024-04-19T02:15:24.526845+0000","last_active":"2024-04-19T02:16:53.174289+0000","last_peered":"2024-04-19T02:16:53.174289+0000","last_clean":"2024-04-19T02:16:53.174289+0000","last_became_active":"2024-04-19T02:15:24.526500+0000","last_became_peered":"2024-04-19T02:15:24.526500+0000","last_unstale":"2024-04-19T02:16:53.174289+0000","last_undegraded":"2024-04-19T02:16:53.174289+0000","last_fullsized":"2024-04-19T02:16:53.174289+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:16.883355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.174094+0000","last_change":"2024-04-19T02:15:29.278686+0000","last_active":"2024-04-19T02:16:53.174094+0000","last_peered":"2024-04-19T02:16:53.174094+0000","last_clean":"2024-04-19T02:16:53.174094+0000","last_became_active":"2024-04-19T02:15:29.278108+0000","last_became_peered":"2024-04-19T02:15:29.278108+0000","last_unstale":"2024-04-19T02:16:53.174094+0000","last_undegraded":"2024-04-19T02:16:53.174094+0000","last_fullsized":"2024-04-19T02:16:53.174094+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:34.593754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"44'8461","reported_seq":8497,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T02:16:57.777014+0000","last_change":"2024-04-19T02:15:53.957269+0000","last_active":"2024-04-19T02:16:57.777014+0000","last_peered":"2024-04-19T02:16:57.777014+0000","last_clean":"2024-04-19T02:16:57.777014+0000","last_became_active":"2024-04-19T02:15:53.956554+0000","last_became_peered":"2024-04-19T02:15:53.956554+0000","last_unstale":"2024-04-19T02:16:57.777014+0000","last_undegraded":"2024-04-19T02:16:57.777014+0000","last_fullsized":"2024-04-19T02:16:57.777014+0000","mapping_epoch":16,"log_start":"30'4528","ondisk_log_start":"30'4528","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3933,"log_dups_size":0,"ondisk_log_size":3933,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:29:38.789719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524353536,"num_objects":8001,"num_object_clones":0,"num_object_copies":16002,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8001,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8461,"num_write_kb":526784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":43,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.172588+0000","last_change":"2024-04-19T02:15:24.533777+0000","last_active":"2024-04-19T02:16:53.172588+0000","last_peered":"2024-04-19T02:16:53.172588+0000","last_clean":"2024-04-19T02:16:53.172588+0000","last_became_active":"2024-04-19T02:15:24.533436+0000","last_became_peered":"2024-04-19T02:15:24.533436+0000","last_unstale":"2024-04-19T02:16:53.172588+0000","last_undegraded":"2024-04-19T02:16:53.172588+0000","last_fullsized":"2024-04-19T02:16:53.172588+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:53:25.922418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":41,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.174091+0000","last_change":"2024-04-19T02:15:28.891370+0000","last_active":"2024-04-19T02:16:53.174091+0000","last_peered":"2024-04-19T02:16:53.174091+0000","last_clean":"2024-04-19T02:16:53.174091+0000","last_became_active":"2024-04-19T02:15:28.890702+0000","last_became_peered":"2024-04-19T02:15:28.890702+0000","last_unstale":"2024-04-19T02:16:53.174091+0000","last_undegraded":"2024-04-19T02:16:53.174091+0000","last_fullsized":"2024-04-19T02:16:53.174091+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:33.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.167489+0000","last_change":"2024-04-19T02:15:29.282244+0000","last_active":"2024-04-19T02:16:53.167489+0000","last_peered":"2024-04-19T02:16:53.167489+0000","last_clean":"2024-04-19T02:16:53.167489+0000","last_became_active":"2024-04-19T02:15:29.280366+0000","last_became_peered":"2024-04-19T02:15:29.280366+0000","last_unstale":"2024-04-19T02:16:53.167489+0000","last_undegraded":"2024-04-19T02:16:53.167489+0000","last_fullsized":"2024-04-19T02:16:53.167489+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":41,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.166512+0000","last_change":"2024-04-19T02:15:28.893027+0000","last_active":"2024-04-19T02:16:53.166512+0000","last_peered":"2024-04-19T02:16:53.166512+0000","last_clean":"2024-04-19T02:16:53.166512+0000","last_became_active":"2024-04-19T02:15:28.892695+0000","last_became_peered":"2024-04-19T02:15:28.892695+0000","last_unstale":"2024-04-19T02:16:53.166512+0000","last_undegraded":"2024-04-19T02:16:53.166512+0000","last_fullsized":"2024-04-19T02:16:53.166512+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.167193+0000","last_change":"2024-04-19T02:15:29.283155+0000","last_active":"2024-04-19T02:16:53.167193+0000","last_peered":"2024-04-19T02:16:53.167193+0000","last_clean":"2024-04-19T02:16:53.167193+0000","last_became_active":"2024-04-19T02:15:29.281407+0000","last_became_peered":"2024-04-19T02:15:29.281407+0000","last_unstale":"2024-04-19T02:16:53.167193+0000","last_undegraded":"2024-04-19T02:16:53.167193+0000","last_fullsized":"2024-04-19T02:16:53.167193+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":42,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.172019+0000","last_change":"2024-04-19T02:15:28.893067+0000","last_active":"2024-04-19T02:16:53.172019+0000","last_peered":"2024-04-19T02:16:53.172019+0000","last_clean":"2024-04-19T02:16:53.172019+0000","last_became_active":"2024-04-19T02:15:28.892781+0000","last_became_peered":"2024-04-19T02:15:28.892781+0000","last_unstale":"2024-04-19T02:16:53.172019+0000","last_undegraded":"2024-04-19T02:16:53.172019+0000","last_fullsized":"2024-04-19T02:16:53.172019+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:54:15.590143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171647+0000","last_change":"2024-04-19T02:15:29.281279+0000","last_active":"2024-04-19T02:16:53.171647+0000","last_peered":"2024-04-19T02:16:53.171647+0000","last_clean":"2024-04-19T02:16:53.171647+0000","last_became_active":"2024-04-19T02:15:29.279360+0000","last_became_peered":"2024-04-19T02:15:29.279360+0000","last_unstale":"2024-04-19T02:16:53.171647+0000","last_undegraded":"2024-04-19T02:16:53.171647+0000","last_fullsized":"2024-04-19T02:16:53.171647+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":42,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.167058+0000","last_change":"2024-04-19T02:15:28.893239+0000","last_active":"2024-04-19T02:16:53.167058+0000","last_peered":"2024-04-19T02:16:53.167058+0000","last_clean":"2024-04-19T02:16:53.167058+0000","last_became_active":"2024-04-19T02:15:28.892881+0000","last_became_peered":"2024-04-19T02:15:28.892881+0000","last_unstale":"2024-04-19T02:16:53.167058+0000","last_undegraded":"2024-04-19T02:16:53.167058+0000","last_fullsized":"2024-04-19T02:16:53.167058+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171509+0000","last_change":"2024-04-19T02:15:29.281652+0000","last_active":"2024-04-19T02:16:53.171509+0000","last_peered":"2024-04-19T02:16:53.171509+0000","last_clean":"2024-04-19T02:16:53.171509+0000","last_became_active":"2024-04-19T02:15:29.281175+0000","last_became_peered":"2024-04-19T02:15:29.281175+0000","last_unstale":"2024-04-19T02:16:53.171509+0000","last_undegraded":"2024-04-19T02:16:53.171509+0000","last_fullsized":"2024-04-19T02:16:53.171509+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:16.568764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":41,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.174438+0000","last_change":"2024-04-19T02:15:28.892058+0000","last_active":"2024-04-19T02:16:53.174438+0000","last_peered":"2024-04-19T02:16:53.174438+0000","last_clean":"2024-04-19T02:16:53.174438+0000","last_became_active":"2024-04-19T02:15:28.890877+0000","last_became_peered":"2024-04-19T02:15:28.890877+0000","last_unstale":"2024-04-19T02:16:53.174438+0000","last_undegraded":"2024-04-19T02:16:53.174438+0000","last_fullsized":"2024-04-19T02:16:53.174438+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:53.170180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.167711+0000","last_change":"2024-04-19T02:15:29.278810+0000","last_active":"2024-04-19T02:16:53.167711+0000","last_peered":"2024-04-19T02:16:53.167711+0000","last_clean":"2024-04-19T02:16:53.167711+0000","last_became_active":"2024-04-19T02:15:29.277913+0000","last_became_peered":"2024-04-19T02:15:29.277913+0000","last_unstale":"2024-04-19T02:16:53.167711+0000","last_undegraded":"2024-04-19T02:16:53.167711+0000","last_fullsized":"2024-04-19T02:16:53.167711+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:24.082666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":44,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.170268+0000","last_change":"2024-04-19T02:15:28.889132+0000","last_active":"2024-04-19T02:16:53.170268+0000","last_peered":"2024-04-19T02:16:53.170268+0000","last_clean":"2024-04-19T02:16:53.170268+0000","last_became_active":"2024-04-19T02:15:28.888926+0000","last_became_peered":"2024-04-19T02:15:28.888926+0000","last_unstale":"2024-04-19T02:16:53.170268+0000","last_undegraded":"2024-04-19T02:16:53.170268+0000","last_fullsized":"2024-04-19T02:16:53.170268+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171485+0000","last_change":"2024-04-19T02:15:29.282776+0000","last_active":"2024-04-19T02:16:53.171485+0000","last_peered":"2024-04-19T02:16:53.171485+0000","last_clean":"2024-04-19T02:16:53.171485+0000","last_became_active":"2024-04-19T02:15:29.279382+0000","last_became_peered":"2024-04-19T02:15:29.279382+0000","last_unstale":"2024-04-19T02:16:53.171485+0000","last_undegraded":"2024-04-19T02:16:53.171485+0000","last_fullsized":"2024-04-19T02:16:53.171485+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171349+0000","last_change":"2024-04-19T02:15:29.283537+0000","last_active":"2024-04-19T02:16:53.171349+0000","last_peered":"2024-04-19T02:16:53.171349+0000","last_clean":"2024-04-19T02:16:53.171349+0000","last_became_active":"2024-04-19T02:15:29.281801+0000","last_became_peered":"2024-04-19T02:15:29.281801+0000","last_unstale":"2024-04-19T02:16:53.171349+0000","last_undegraded":"2024-04-19T02:16:53.171349+0000","last_fullsized":"2024-04-19T02:16:53.171349+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.169035+0000","last_change":"2024-04-19T02:15:29.281560+0000","last_active":"2024-04-19T02:16:53.169035+0000","last_peered":"2024-04-19T02:16:53.169035+0000","last_clean":"2024-04-19T02:16:53.169035+0000","last_became_active":"2024-04-19T02:15:29.281261+0000","last_became_peered":"2024-04-19T02:15:29.281261+0000","last_unstale":"2024-04-19T02:16:53.169035+0000","last_undegraded":"2024-04-19T02:16:53.169035+0000","last_fullsized":"2024-04-19T02:16:53.169035+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":38,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.171279+0000","last_change":"2024-04-19T02:15:53.955913+0000","last_active":"2024-04-19T02:16:53.171279+0000","last_peered":"2024-04-19T02:16:53.171279+0000","last_clean":"2024-04-19T02:16:53.171279+0000","last_became_active":"2024-04-19T02:15:53.955676+0000","last_became_peered":"2024-04-19T02:15:53.955676+0000","last_unstale":"2024-04-19T02:16:53.171279+0000","last_undegraded":"2024-04-19T02:16:53.171279+0000","last_fullsized":"2024-04-19T02:16:53.171279+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:53:02.899902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.174288+0000","last_change":"2024-04-19T02:15:29.278702+0000","last_active":"2024-04-19T02:16:53.174288+0000","last_peered":"2024-04-19T02:16:53.174288+0000","last_clean":"2024-04-19T02:16:53.174288+0000","last_became_active":"2024-04-19T02:15:29.277756+0000","last_became_peered":"2024-04-19T02:15:29.277756+0000","last_unstale":"2024-04-19T02:16:53.174288+0000","last_undegraded":"2024-04-19T02:16:53.174288+0000","last_fullsized":"2024-04-19T02:16:53.174288+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-19T02:16:53.167249+0000","last_change":"2024-04-19T02:15:29.277568+0000","last_active":"2024-04-19T02:16:53.167249+0000","last_peered":"2024-04-19T02:16:53.167249+0000","last_clean":"2024-04-19T02:16:53.167249+0000","last_became_active":"2024-04-19T02:15:29.276725+0000","last_became_peered":"2024-04-19T02:15:29.276725+0000","last_unstale":"2024-04-19T02:16:53.167249+0000","last_undegraded":"2024-04-19T02:16:53.167249+0000","last_fullsized":"2024-04-19T02:16:53.167249+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":8513191960,"num_objects":129902,"num_object_clones":0,"num_object_copies":259804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":847,"num_objects_unfound":0,"num_objects_dirty":129902,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":138164,"num_write_kb":8578049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5595,"num_bytes_recovered":366673920,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17491697664,"data_stored":17491689520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":59963,"ondisk_log_size":59963,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738389,"num_pgs":84,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7039664,"kb_used_data":6813924,"kb_used_omap":1,"kb_used_meta":225534,"kb_avail":87332176,"statfs":{"total":96636764160,"available":89428148224,"internally_reserved":0,"allocated":6977458176,"data_stored":6977144844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":230947270},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,5,2,1,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.313,"15min":0.313},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.497,"5min":0.497,"15min":0.497},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.56399999999999995}]},{"osd":1,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.23699999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738390,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5419664,"kb_used_data":5271620,"kb_used_omap":1,"kb_used_meta":147582,"kb_avail":88952176,"statfs":{"total":96636764160,"available":91087028224,"internally_reserved":0,"allocated":5398138880,"data_stored":5397795094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":151124422},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,2,5],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.21099999999999999},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.19}]},{"osd":2,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":2.1000000000000001,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":0.20000000000000001},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.247}]}]},{"osd":1,"up_from":8,"seq":34359738389,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5275144,"kb_used_data":5139452,"kb_used_omap":1,"kb_used_meta":135294,"kb_avail":89096696,"statfs":{"total":96636764160,"available":91235016704,"internally_reserved":0,"allocated":5262798848,"data_stored":5262462638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":138541510},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:16:26 2024","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"min":{"1min":0.16,"5min":0.16,"15min":0.16},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.185}]},{"osd":2,"last update":"Fri Apr 19 02:16:26 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.223},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.19800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5330046976,"data_stored":5330042904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5258088448,"data_stored":5258084376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6903562240,"data_stored":6903562240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:16:59.929 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:16:59.930+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:16:59.932 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:16:59.933 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:16:59.949 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:17:00.030 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:00.031+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:00.111 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:00.111 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:00.125 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:17:00.131 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:17:00.130+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:17:00.233 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:00.234+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:00.293 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:00.293 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:00.306 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:00.347 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:00.348+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:00.436 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:17:00.435+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:17:00.492 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:00.492 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:00.508 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:00.536 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:00.536+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:00.637 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:00.638+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:00.731 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:00.731 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:00.740 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:17:00.740+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:17:00.745 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:00.838 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:00.839+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:00.939 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:00.940+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:00.964 INFO:teuthology.orchestra.run.smithi177.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:00.964 INFO:teuthology.orchestra.run.smithi177.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:00.979 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:01.040 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:01.041+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:01.141 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:01.142+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:01.146 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:01.146 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:01.152 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:17:01.160 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:01.202 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T02:17:01.241 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:17:01.241+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:17:01.307 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:17:01.325 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:01.325 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-04-19T02:17:01.325 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-04-19T02:17:01.325 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-04-19T02:17:01.325 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:01.328 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:17:01.339 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:01.343 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:01.344+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:01.350 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2: {} 2024-04-19T02:17:01.351 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:17:01.352 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:17:01.352 INFO:teuthology.orchestra.run.smithi121.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:17:01.443 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:17:01.443+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:17:01.502 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:01.502 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-04-19T02:17:01.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-04-19T02:17:01.502 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:17:01.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.502 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:01.502 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:17:01.502 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 92.230786878000004, 2024-04-19T02:17:01.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020307345000000001, 2024-04-19T02:17:01.503 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:01.503 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:01.503 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:01.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:01.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:17:01.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:01.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:01.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:17:01.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:01.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:01.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269791+0000", 2024-04-19T02:17:01.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:01.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:01.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269795+0000", 2024-04-19T02:17:01.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5619999999999999e-06 2024-04-19T02:17:01.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:01.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269802+0000", 2024-04-19T02:17:01.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8469999999999998e-06 2024-04-19T02:17:01.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.505 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.505 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269807+0000", 2024-04-19T02:17:01.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.707e-06 2024-04-19T02:17:01.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.505 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:01.505 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269950+0000", 2024-04-19T02:17:01.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000143313 2024-04-19T02:17:01.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.505 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:01.505 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269955+0000", 2024-04-19T02:17:01.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4029999999999998e-06 2024-04-19T02:17:01.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:01.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.283806+0000", 2024-04-19T02:17:01.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013850220999999999 2024-04-19T02:17:01.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:01.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.283896+0000", 2024-04-19T02:17:01.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0261999999999997e-05 2024-04-19T02:17:01.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:01.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284022+0000", 2024-04-19T02:17:01.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012641200000000001 2024-04-19T02:17:01.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:01.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289066+0000", 2024-04-19T02:17:01.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050438490000000004 2024-04-19T02:17:01.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:01.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290011+0000", 2024-04-19T02:17:01.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00094490700000000004 2024-04-19T02:17:01.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:01.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290054+0000", 2024-04-19T02:17:01.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.337e-05 2024-04-19T02:17:01.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:01.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290099+0000", 2024-04-19T02:17:01.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4987999999999997e-05 2024-04-19T02:17:01.508 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:01.508 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:01.508 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:01.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.508 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:01.508 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:17:01.508 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 92.230708948, 2024-04-19T02:17:01.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020331023, 2024-04-19T02:17:01.508 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:01.508 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:01.509 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:01.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.509 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:01.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:17:01.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:01.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.509 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:01.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:17:01.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:01.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.509 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:01.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269869+0000", 2024-04-19T02:17:01.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:01.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.510 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.510 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:01.510 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269873+0000", 2024-04-19T02:17:01.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0219999999999998e-06 2024-04-19T02:17:01.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.510 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.510 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:01.510 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269881+0000", 2024-04-19T02:17:01.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.79e-06 2024-04-19T02:17:01.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.510 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.510 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.510 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269887+0000", 2024-04-19T02:17:01.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7899999999999996e-06 2024-04-19T02:17:01.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:01.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269983+0000", 2024-04-19T02:17:01.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6057000000000005e-05 2024-04-19T02:17:01.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:01.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269986+0000", 2024-04-19T02:17:01.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9220000000000001e-06 2024-04-19T02:17:01.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:01.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284350+0000", 2024-04-19T02:17:01.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014364335000000001 2024-04-19T02:17:01.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:01.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284664+0000", 2024-04-19T02:17:01.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000313646 2024-04-19T02:17:01.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:01.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284794+0000", 2024-04-19T02:17:01.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129839 2024-04-19T02:17:01.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:01.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289107+0000", 2024-04-19T02:17:01.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0043127060000000004 2024-04-19T02:17:01.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:01.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290108+0000", 2024-04-19T02:17:01.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0010010590000000001 2024-04-19T02:17:01.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:01.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290144+0000", 2024-04-19T02:17:01.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6709999999999999e-05 2024-04-19T02:17:01.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:01.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290201+0000", 2024-04-19T02:17:01.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6654999999999999e-05 2024-04-19T02:17:01.514 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:01.514 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:01.514 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:01.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.514 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:01.514 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:17:01.514 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 92.230666607000003, 2024-04-19T02:17:01.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020507241999999998, 2024-04-19T02:17:01.514 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:01.514 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:01.514 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:01.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:01.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:17:01.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:01.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:01.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:17:01.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:01.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:01.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:17:01.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:01.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.516 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:01.516 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269915+0000", 2024-04-19T02:17:01.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.472e-06 2024-04-19T02:17:01.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.516 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:01.516 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269928+0000", 2024-04-19T02:17:01.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2979000000000001e-05 2024-04-19T02:17:01.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.516 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.516 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269935+0000", 2024-04-19T02:17:01.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8859999999999998e-06 2024-04-19T02:17:01.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.516 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:01.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270009+0000", 2024-04-19T02:17:01.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3429000000000005e-05 2024-04-19T02:17:01.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:01.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270013+0000", 2024-04-19T02:17:01.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2590000000000002e-06 2024-04-19T02:17:01.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:01.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285375+0000", 2024-04-19T02:17:01.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015362275999999999 2024-04-19T02:17:01.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:01.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285451+0000", 2024-04-19T02:17:01.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5338000000000003e-05 2024-04-19T02:17:01.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:01.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285562+0000", 2024-04-19T02:17:01.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000111285 2024-04-19T02:17:01.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:01.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289134+0000", 2024-04-19T02:17:01.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035719670000000001 2024-04-19T02:17:01.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:01.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290341+0000", 2024-04-19T02:17:01.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012074500000000001 2024-04-19T02:17:01.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:01.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290383+0000", 2024-04-19T02:17:01.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1386e-05 2024-04-19T02:17:01.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:01.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290419+0000", 2024-04-19T02:17:01.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6884000000000001e-05 2024-04-19T02:17:01.519 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:01.520 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:01.520 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:01.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.520 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:01.520 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269945+0000", 2024-04-19T02:17:01.520 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 92.230634025000001, 2024-04-19T02:17:01.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019709098000000001, 2024-04-19T02:17:01.520 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:01.520 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:01.520 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:01.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.520 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:01.520 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269945+0000", 2024-04-19T02:17:01.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:01.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:01.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269945+0000", 2024-04-19T02:17:01.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:01.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:01.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269944+0000", 2024-04-19T02:17:01.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:01.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.522 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:01.522 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269965+0000", 2024-04-19T02:17:01.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0803999999999999e-05 2024-04-19T02:17:01.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.522 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.522 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:01.522 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269973+0000", 2024-04-19T02:17:01.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3560000000000004e-06 2024-04-19T02:17:01.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.522 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.522 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.522 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269982+0000", 2024-04-19T02:17:01.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9600000000000006e-06 2024-04-19T02:17:01.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.522 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:01.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270014+0000", 2024-04-19T02:17:01.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2913000000000001e-05 2024-04-19T02:17:01.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:01.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270018+0000", 2024-04-19T02:17:01.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2200000000000001e-06 2024-04-19T02:17:01.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:01.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278999+0000", 2024-04-19T02:17:01.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0089818009999999993 2024-04-19T02:17:01.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.524 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:01.524 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.279088+0000", 2024-04-19T02:17:01.524 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8988999999999998e-05 2024-04-19T02:17:01.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.524 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:01.524 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.280160+0000", 2024-04-19T02:17:01.524 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001071572 2024-04-19T02:17:01.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.524 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:01.524 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288342+0000", 2024-04-19T02:17:01.524 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.008182468 2024-04-19T02:17:01.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.525 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:01.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289545+0000", 2024-04-19T02:17:01.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012026739999999999 2024-04-19T02:17:01.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.525 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:01.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289608+0000", 2024-04-19T02:17:01.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2904999999999995e-05 2024-04-19T02:17:01.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.525 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:01.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289654+0000", 2024-04-19T02:17:01.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5850000000000003e-05 2024-04-19T02:17:01.525 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:01.526 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:01.526 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:01.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.526 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:01.526 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:17:01.526 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 92.230588346999994, 2024-04-19T02:17:01.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022007204999999998, 2024-04-19T02:17:01.526 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:01.526 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:01.526 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:01.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.526 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:01.526 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:17:01.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:01.527 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:01.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:17:01.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:01.527 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:01.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269990+0000", 2024-04-19T02:17:01.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:01.527 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:01.528 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269999+0000", 2024-04-19T02:17:01.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9539999999999993e-06 2024-04-19T02:17:01.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.528 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:01.528 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270006+0000", 2024-04-19T02:17:01.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.216e-06 2024-04-19T02:17:01.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.528 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.528 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270012+0000", 2024-04-19T02:17:01.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5049999999999998e-06 2024-04-19T02:17:01.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.528 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:01.529 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270058+0000", 2024-04-19T02:17:01.529 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.634e-05 2024-04-19T02:17:01.529 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.529 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.529 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:01.529 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270064+0000", 2024-04-19T02:17:01.529 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0669999999999997e-06 2024-04-19T02:17:01.529 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.529 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.529 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:01.529 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287159+0000", 2024-04-19T02:17:01.529 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017095086999999998 2024-04-19T02:17:01.529 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.529 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.529 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:01.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287254+0000", 2024-04-19T02:17:01.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4716000000000006e-05 2024-04-19T02:17:01.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.530 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:01.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287389+0000", 2024-04-19T02:17:01.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013511900000000001 2024-04-19T02:17:01.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.530 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:01.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290481+0000", 2024-04-19T02:17:01.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030920169999999999 2024-04-19T02:17:01.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:01.531 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291931+0000", 2024-04-19T02:17:01.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001450118 2024-04-19T02:17:01.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:01.531 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291960+0000", 2024-04-19T02:17:01.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9096000000000001e-05 2024-04-19T02:17:01.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:01.531 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291998+0000", 2024-04-19T02:17:01.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7514e-05 2024-04-19T02:17:01.531 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:01.532 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:01.532 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:01.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.532 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:01.532 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:17:01.532 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 92.230527776000002, 2024-04-19T02:17:01.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020759494999999999, 2024-04-19T02:17:01.532 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:01.532 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:01.532 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:01.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.532 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:01.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:17:01.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:01.533 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.533 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.533 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:01.533 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:17:01.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:01.533 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.533 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.533 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:01.533 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:17:01.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:01.533 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.533 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.533 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:01.534 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270054+0000", 2024-04-19T02:17:01.534 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.27e-06 2024-04-19T02:17:01.534 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.534 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.534 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:01.534 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270061+0000", 2024-04-19T02:17:01.534 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1289999999999998e-06 2024-04-19T02:17:01.534 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.534 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.534 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.534 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270067+0000", 2024-04-19T02:17:01.534 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.207e-06 2024-04-19T02:17:01.534 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.534 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.534 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:01.535 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270105+0000", 2024-04-19T02:17:01.535 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7549999999999998e-05 2024-04-19T02:17:01.535 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.535 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.535 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:01.535 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270112+0000", 2024-04-19T02:17:01.535 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3200000000000002e-06 2024-04-19T02:17:01.535 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.535 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.535 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:01.535 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282454+0000", 2024-04-19T02:17:01.535 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012341569 2024-04-19T02:17:01.535 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.535 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.536 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:01.536 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282740+0000", 2024-04-19T02:17:01.536 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000286481 2024-04-19T02:17:01.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.536 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:01.536 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282879+0000", 2024-04-19T02:17:01.536 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013887799999999999 2024-04-19T02:17:01.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.536 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:01.536 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290325+0000", 2024-04-19T02:17:01.536 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074459779999999998 2024-04-19T02:17:01.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:01.537 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290759+0000", 2024-04-19T02:17:01.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000433688 2024-04-19T02:17:01.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:01.537 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290789+0000", 2024-04-19T02:17:01.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9960000000000001e-05 2024-04-19T02:17:01.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:01.537 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290811+0000", 2024-04-19T02:17:01.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1965999999999999e-05 2024-04-19T02:17:01.537 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:01.538 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:01.538 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:01.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.538 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.538 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:01.538 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:17:01.538 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 92.230477570999994, 2024-04-19T02:17:01.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020837887999999999, 2024-04-19T02:17:01.538 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:01.538 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:01.538 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:01.538 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.538 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:01.538 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:17:01.539 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:01.539 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.539 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.539 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:01.539 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:17:01.539 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:01.539 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.539 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.539 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:01.539 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:17:01.539 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:01.539 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.539 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.539 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:01.539 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270109+0000", 2024-04-19T02:17:01.540 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3110000000000006e-06 2024-04-19T02:17:01.540 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.540 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.540 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:01.540 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270117+0000", 2024-04-19T02:17:01.540 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0479999999999999e-06 2024-04-19T02:17:01.540 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.540 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.540 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.540 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270123+0000", 2024-04-19T02:17:01.540 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5500000000000002e-06 2024-04-19T02:17:01.540 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.540 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.540 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:01.541 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270150+0000", 2024-04-19T02:17:01.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7712000000000002e-05 2024-04-19T02:17:01.541 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.541 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.541 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:01.541 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270153+0000", 2024-04-19T02:17:01.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6089999999999999e-06 2024-04-19T02:17:01.541 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.541 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.541 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:01.541 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285958+0000", 2024-04-19T02:17:01.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015805274000000001 2024-04-19T02:17:01.541 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.541 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.541 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:01.542 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286126+0000", 2024-04-19T02:17:01.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016765700000000001 2024-04-19T02:17:01.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.542 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:01.542 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286296+0000", 2024-04-19T02:17:01.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017007 2024-04-19T02:17:01.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.542 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:01.542 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290426+0000", 2024-04-19T02:17:01.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041299839999999997 2024-04-19T02:17:01.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.543 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.543 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:01.543 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290867+0000", 2024-04-19T02:17:01.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00044083300000000001 2024-04-19T02:17:01.543 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.543 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.543 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:01.543 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290900+0000", 2024-04-19T02:17:01.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3380000000000002e-05 2024-04-19T02:17:01.543 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.543 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.543 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:01.543 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290939+0000", 2024-04-19T02:17:01.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8970000000000001e-05 2024-04-19T02:17:01.543 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:01.544 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:01.544 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:01.544 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.544 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.544 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:21 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:01.544 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:17:01.544 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 92.230388899000005, 2024-04-19T02:17:01.544 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020833187999999999, 2024-04-19T02:17:01.544 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:01.544 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:01.544 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:01.544 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.544 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:01.544 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:17:01.544 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:01.544 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.545 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.545 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:01.545 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:17:01.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:01.545 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.545 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.545 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:01.545 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270189+0000", 2024-04-19T02:17:01.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:01.545 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.545 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.545 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:01.545 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270192+0000", 2024-04-19T02:17:01.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7549999999999999e-06 2024-04-19T02:17:01.545 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.546 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:01.546 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270198+0000", 2024-04-19T02:17:01.546 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0859999999999998e-06 2024-04-19T02:17:01.546 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.546 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.546 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270204+0000", 2024-04-19T02:17:01.546 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1970000000000004e-06 2024-04-19T02:17:01.546 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.546 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:01.546 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270238+0000", 2024-04-19T02:17:01.546 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4282000000000001e-05 2024-04-19T02:17:01.547 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.547 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.547 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:01.547 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270240+0000", 2024-04-19T02:17:01.547 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3099999999999999e-06 2024-04-19T02:17:01.547 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.547 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.547 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:01.547 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287131+0000", 2024-04-19T02:17:01.547 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01689104 2024-04-19T02:17:01.547 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.547 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.547 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:01.547 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287262+0000", 2024-04-19T02:17:01.547 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130347 2024-04-19T02:17:01.548 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.548 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.548 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:01.548 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291023+0000", 2024-04-19T02:17:01.548 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037616350000000002 2024-04-19T02:17:01.548 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:01.548 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:01.548 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:01.548 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.548 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.548 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:16519 5.f 5:fc30d3a1:::benchmark_data_smithi121_44835_object16518:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:17:01.548 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.880723+0000", 2024-04-19T02:17:01.548 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 61.619856120999998, 2024-04-19T02:17:01.548 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020492519000000001, 2024-04-19T02:17:01.548 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:01.549 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:01.549 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:01.549 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:01.549 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:01.549 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16519 2024-04-19T02:17:01.549 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.549 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:01.549 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.549 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:01.549 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880723+0000", 2024-04-19T02:17:01.549 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:01.549 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.549 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.549 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:01.550 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880723+0000", 2024-04-19T02:17:01.550 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:01.550 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.550 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.550 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:01.550 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880722+0000", 2024-04-19T02:17:01.550 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:01.550 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.550 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.550 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:01.550 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880794+0000", 2024-04-19T02:17:01.550 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1515999999999998e-05 2024-04-19T02:17:01.550 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.550 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.551 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:01.551 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880805+0000", 2024-04-19T02:17:01.551 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1353e-05 2024-04-19T02:17:01.551 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.551 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.551 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.551 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880812+0000", 2024-04-19T02:17:01.551 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1230000000000002e-06 2024-04-19T02:17:01.551 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.551 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.551 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:01.551 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.890954+0000", 2024-04-19T02:17:01.551 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010142253 2024-04-19T02:17:01.551 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.551 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.552 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:01.552 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891079+0000", 2024-04-19T02:17:01.552 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000124917 2024-04-19T02:17:01.552 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.552 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.552 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:01.552 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891218+0000", 2024-04-19T02:17:01.552 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000138715 2024-04-19T02:17:01.552 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.552 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.552 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:01.552 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.897321+0000", 2024-04-19T02:17:01.552 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0061026830000000002 2024-04-19T02:17:01.552 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.552 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.552 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:01.553 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901137+0000", 2024-04-19T02:17:01.553 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038161699999999998 2024-04-19T02:17:01.553 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.553 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.553 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:01.553 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901181+0000", 2024-04-19T02:17:01.553 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4362e-05 2024-04-19T02:17:01.553 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.553 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.553 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:01.553 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901215+0000", 2024-04-19T02:17:01.553 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3929e-05 2024-04-19T02:17:01.553 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:01.553 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:01.553 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:01.554 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.554 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.554 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:16520 5.f 5:f0474691:::benchmark_data_smithi121_44835_object16519:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:17:01.554 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.880833+0000", 2024-04-19T02:17:01.554 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 61.619746106000001, 2024-04-19T02:17:01.554 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020460160000000002, 2024-04-19T02:17:01.554 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:01.554 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:01.554 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:01.554 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:01.554 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:01.554 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16520 2024-04-19T02:17:01.554 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.555 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:01.555 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.555 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:01.555 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880833+0000", 2024-04-19T02:17:01.555 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:01.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.555 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.555 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:01.555 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880833+0000", 2024-04-19T02:17:01.555 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:01.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.555 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.555 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:01.555 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880832+0000", 2024-04-19T02:17:01.555 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:01.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.556 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.556 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:01.556 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880909+0000", 2024-04-19T02:17:01.556 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7095000000000006e-05 2024-04-19T02:17:01.556 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.556 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.556 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:01.556 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880919+0000", 2024-04-19T02:17:01.556 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8919999999999995e-06 2024-04-19T02:17:01.556 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.556 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.556 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.556 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880927+0000", 2024-04-19T02:17:01.556 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8809999999999996e-06 2024-04-19T02:17:01.557 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.557 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.557 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:01.557 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891901+0000", 2024-04-19T02:17:01.557 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010974263999999999 2024-04-19T02:17:01.557 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.557 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.557 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:01.557 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.892021+0000", 2024-04-19T02:17:01.557 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120074 2024-04-19T02:17:01.557 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.557 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.557 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:01.557 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.892165+0000", 2024-04-19T02:17:01.557 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014328600000000001 2024-04-19T02:17:01.558 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.558 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.558 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:01.558 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.897347+0000", 2024-04-19T02:17:01.558 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.005182603 2024-04-19T02:17:01.558 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.558 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.558 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:01.558 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901224+0000", 2024-04-19T02:17:01.558 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038767620000000002 2024-04-19T02:17:01.558 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.558 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.558 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:01.558 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901264+0000", 2024-04-19T02:17:01.559 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9579000000000002e-05 2024-04-19T02:17:01.559 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.559 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.559 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:01.559 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901293+0000", 2024-04-19T02:17:01.559 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9300999999999999e-05 2024-04-19T02:17:01.559 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:01.559 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:01.559 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:01.559 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.559 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.559 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:44167 5.7 5:ef4300c4:::benchmark_data_smithi121_44835_object44166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:17:01.559 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:09.853830+0000", 2024-04-19T02:17:01.559 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 51.646748621999997, 2024-04-19T02:17:01.560 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020082104, 2024-04-19T02:17:01.560 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:01.560 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:01.560 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:01.560 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:01.560 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:01.560 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 44167 2024-04-19T02:17:01.560 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.560 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:01.560 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.560 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:01.560 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853830+0000", 2024-04-19T02:17:01.560 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:01.560 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.561 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.561 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:01.561 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853830+0000", 2024-04-19T02:17:01.561 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:01.561 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.561 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.561 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:01.561 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853829+0000", 2024-04-19T02:17:01.561 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:01.561 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.561 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.561 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:01.561 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853863+0000", 2024-04-19T02:17:01.561 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3151999999999997e-05 2024-04-19T02:17:01.561 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.562 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.562 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:01.562 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853873+0000", 2024-04-19T02:17:01.562 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0366e-05 2024-04-19T02:17:01.562 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.562 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.562 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.562 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853881+0000", 2024-04-19T02:17:01.562 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6539999999999999e-06 2024-04-19T02:17:01.562 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.562 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.562 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:01.562 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.859162+0000", 2024-04-19T02:17:01.563 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052810740000000002 2024-04-19T02:17:01.563 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.563 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.563 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:01.563 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.859303+0000", 2024-04-19T02:17:01.563 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000140975 2024-04-19T02:17:01.563 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.563 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.563 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:01.563 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.859460+0000", 2024-04-19T02:17:01.563 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015754199999999999 2024-04-19T02:17:01.564 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.564 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.564 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:01.564 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.865142+0000", 2024-04-19T02:17:01.564 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0056819130000000002 2024-04-19T02:17:01.564 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.564 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.564 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:01.564 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.873828+0000", 2024-04-19T02:17:01.564 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0086861799999999999 2024-04-19T02:17:01.564 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.564 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.564 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:01.564 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.873871+0000", 2024-04-19T02:17:01.564 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2624999999999999e-05 2024-04-19T02:17:01.565 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.565 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.565 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:01.565 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.873912+0000", 2024-04-19T02:17:01.565 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1486000000000002e-05 2024-04-19T02:17:01.565 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:01.565 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:01.565 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:01.565 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.565 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.565 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:53042 5.f 5:f744ac14:::benchmark_data_smithi121_44835_object53041:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T02:17:01.565 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:13.560196+0000", 2024-04-19T02:17:01.565 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.940382802999999, 2024-04-19T02:17:01.566 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020122021, 2024-04-19T02:17:01.566 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:01.566 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:01.566 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:01.566 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:01.566 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:01.566 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 53042 2024-04-19T02:17:01.566 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.566 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:01.566 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.566 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:01.566 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560196+0000", 2024-04-19T02:17:01.566 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:01.566 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.566 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.567 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:01.567 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560196+0000", 2024-04-19T02:17:01.567 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:01.567 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.567 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.567 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:01.567 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560195+0000", 2024-04-19T02:17:01.567 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:01.567 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.567 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.567 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:01.567 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560255+0000", 2024-04-19T02:17:01.567 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9441000000000002e-05 2024-04-19T02:17:01.567 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.567 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.568 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:01.568 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560264+0000", 2024-04-19T02:17:01.568 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1130000000000007e-06 2024-04-19T02:17:01.568 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.568 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.568 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.568 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560271+0000", 2024-04-19T02:17:01.568 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9800000000000001e-06 2024-04-19T02:17:01.568 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.568 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.568 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:01.568 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560312+0000", 2024-04-19T02:17:01.568 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0828999999999998e-05 2024-04-19T02:17:01.568 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.568 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.569 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:01.569 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560456+0000", 2024-04-19T02:17:01.569 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014474799999999999 2024-04-19T02:17:01.569 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.569 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.569 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:01.569 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560591+0000", 2024-04-19T02:17:01.569 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013482699999999999 2024-04-19T02:17:01.569 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.569 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.569 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:01.569 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.564799+0000", 2024-04-19T02:17:01.569 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042080080000000001 2024-04-19T02:17:01.569 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.569 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.570 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:01.570 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580233+0000", 2024-04-19T02:17:01.570 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015433715000000001 2024-04-19T02:17:01.570 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.570 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.570 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:01.570 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580280+0000", 2024-04-19T02:17:01.570 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6465000000000003e-05 2024-04-19T02:17:01.570 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.570 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.570 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:01.570 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580318+0000", 2024-04-19T02:17:01.570 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8557999999999999e-05 2024-04-19T02:17:01.570 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:01.571 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:01.571 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:01.571 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.571 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.571 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:85866 5.2 5:48b1d46d:::benchmark_data_smithi121_44835_object85865:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T02:17:01.571 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:30.771909+0000", 2024-04-19T02:17:01.571 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.728669531000001, 2024-04-19T02:17:01.571 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020516216, 2024-04-19T02:17:01.571 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:01.571 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:01.571 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:01.571 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:01.571 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:01.571 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 85866 2024-04-19T02:17:01.571 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.572 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:01.572 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.572 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:01.572 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771909+0000", 2024-04-19T02:17:01.572 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:01.572 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.572 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.572 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:01.572 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771909+0000", 2024-04-19T02:17:01.572 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:01.572 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.572 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.572 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:01.572 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771909+0000", 2024-04-19T02:17:01.572 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:01.573 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.573 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.573 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:01.573 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771952+0000", 2024-04-19T02:17:01.573 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2660000000000002e-05 2024-04-19T02:17:01.573 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.573 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.573 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:01.573 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771959+0000", 2024-04-19T02:17:01.573 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7670000000000003e-06 2024-04-19T02:17:01.573 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.573 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.573 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.573 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771966+0000", 2024-04-19T02:17:01.573 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.905e-06 2024-04-19T02:17:01.574 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.574 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.574 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:01.574 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771999+0000", 2024-04-19T02:17:01.574 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2360999999999997e-05 2024-04-19T02:17:01.574 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.574 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.574 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:01.574 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.772133+0000", 2024-04-19T02:17:01.574 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013398699999999999 2024-04-19T02:17:01.574 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.574 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.574 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:01.574 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.772280+0000", 2024-04-19T02:17:01.575 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000147198 2024-04-19T02:17:01.575 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.575 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.575 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:01.575 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.774312+0000", 2024-04-19T02:17:01.575 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020325339999999999 2024-04-19T02:17:01.575 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.575 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.575 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:01.575 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.792370+0000", 2024-04-19T02:17:01.575 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018057321000000001 2024-04-19T02:17:01.575 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.575 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.575 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:01.575 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.792403+0000", 2024-04-19T02:17:01.576 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3247000000000002e-05 2024-04-19T02:17:01.576 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.576 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.576 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:01.576 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.792426+0000", 2024-04-19T02:17:01.576 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2697999999999999e-05 2024-04-19T02:17:01.576 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:01.576 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:01.576 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:01.576 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.576 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.576 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:94468 5.2 5:4f406431:::benchmark_data_smithi121_44835_object94467:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T02:17:01.576 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:17:01.576 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.389149716999999, 2024-04-19T02:17:01.577 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024835144999999999, 2024-04-19T02:17:01.577 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:01.577 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:01.577 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:01.577 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:01.577 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:01.577 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 94468 2024-04-19T02:17:01.577 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.577 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:01.577 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.577 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:01.577 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:17:01.578 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:01.578 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.578 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.578 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:01.578 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:17:01.578 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:01.578 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.578 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.578 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:01.578 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:17:01.578 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:01.578 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.578 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.578 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:01.578 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111498+0000", 2024-04-19T02:17:01.579 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9529000000000005e-05 2024-04-19T02:17:01.579 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.579 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.579 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:01.579 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111506+0000", 2024-04-19T02:17:01.579 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9030000000000004e-06 2024-04-19T02:17:01.579 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.579 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.579 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.579 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111513+0000", 2024-04-19T02:17:01.579 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8759999999999999e-06 2024-04-19T02:17:01.579 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.579 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.579 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:01.579 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112466+0000", 2024-04-19T02:17:01.580 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00095318499999999995 2024-04-19T02:17:01.580 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.580 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.580 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:01.580 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112590+0000", 2024-04-19T02:17:01.580 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012380900000000001 2024-04-19T02:17:01.580 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.580 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.580 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:01.580 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112728+0000", 2024-04-19T02:17:01.580 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013753800000000001 2024-04-19T02:17:01.580 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.580 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.580 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:01.581 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115064+0000", 2024-04-19T02:17:01.581 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002336819 2024-04-19T02:17:01.581 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.581 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.581 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:01.581 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136207+0000", 2024-04-19T02:17:01.581 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021142942000000001 2024-04-19T02:17:01.581 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.581 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.581 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:01.581 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136241+0000", 2024-04-19T02:17:01.581 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3577000000000001e-05 2024-04-19T02:17:01.581 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.581 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.581 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:01.582 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136264+0000", 2024-04-19T02:17:01.582 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3421000000000002e-05 2024-04-19T02:17:01.582 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:01.582 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:01.582 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:01.582 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.582 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.582 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:94472 5.2 5:45b7e9be:::benchmark_data_smithi121_44835_object94471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:01.583 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:17:01.583 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.385503186000001, 2024-04-19T02:17:01.583 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021273843000000001, 2024-04-19T02:17:01.583 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:01.583 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:01.583 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:01.583 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:01.583 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:01.583 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 94472 2024-04-19T02:17:01.583 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.583 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:01.583 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.583 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:01.583 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:17:01.584 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:01.584 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.584 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.584 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:01.584 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:17:01.584 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:01.584 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.584 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.584 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:01.584 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115075+0000", 2024-04-19T02:17:01.584 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:01.584 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.584 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.584 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:01.585 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115161+0000", 2024-04-19T02:17:01.587 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6632000000000007e-05 2024-04-19T02:17:01.587 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.587 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.587 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:01.587 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115171+0000", 2024-04-19T02:17:01.587 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2969999999999992e-06 2024-04-19T02:17:01.587 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.587 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.587 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.588 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115178+0000", 2024-04-19T02:17:01.588 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7610000000000007e-06 2024-04-19T02:17:01.588 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.588 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.588 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:01.588 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115213+0000", 2024-04-19T02:17:01.588 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5000999999999999e-05 2024-04-19T02:17:01.588 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.588 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.588 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:01.588 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115303+0000", 2024-04-19T02:17:01.588 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9791999999999997e-05 2024-04-19T02:17:01.588 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.588 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.588 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:01.589 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115391+0000", 2024-04-19T02:17:01.589 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7559000000000007e-05 2024-04-19T02:17:01.589 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.589 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.589 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:01.590 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.117894+0000", 2024-04-19T02:17:01.590 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002503496 2024-04-19T02:17:01.590 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.590 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.590 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:01.590 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136297+0000", 2024-04-19T02:17:01.590 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018402335999999998 2024-04-19T02:17:01.590 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.590 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.590 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:01.590 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136327+0000", 2024-04-19T02:17:01.590 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0534999999999998e-05 2024-04-19T02:17:01.590 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.590 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.591 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:01.591 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136350+0000", 2024-04-19T02:17:01.591 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2427999999999999e-05 2024-04-19T02:17:01.591 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:01.591 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:01.591 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:01.591 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.591 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.591 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:96668 5.f 5:f48d3288:::benchmark_data_smithi121_44835_object96667:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-19T02:17:01.591 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:36.254669+0000", 2024-04-19T02:17:01.591 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.245910067000001, 2024-04-19T02:17:01.591 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019875075999999998, 2024-04-19T02:17:01.591 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:01.591 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:01.591 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:01.592 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:01.592 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:01.592 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 96668 2024-04-19T02:17:01.592 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.592 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:01.592 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.592 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:01.592 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254669+0000", 2024-04-19T02:17:01.592 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:01.592 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.592 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.592 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:01.592 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254669+0000", 2024-04-19T02:17:01.592 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:01.592 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.595 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.595 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:01.595 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254668+0000", 2024-04-19T02:17:01.595 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:01.595 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.595 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.595 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:01.595 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254738+0000", 2024-04-19T02:17:01.595 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9913000000000006e-05 2024-04-19T02:17:01.595 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.595 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.595 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:01.596 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254748+0000", 2024-04-19T02:17:01.596 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7429999999999997e-06 2024-04-19T02:17:01.596 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.596 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.596 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.596 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254754+0000", 2024-04-19T02:17:01.596 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3840000000000002e-06 2024-04-19T02:17:01.596 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.596 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.596 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:01.597 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.256882+0000", 2024-04-19T02:17:01.597 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021282950000000001 2024-04-19T02:17:01.597 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.597 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.597 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:01.597 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.257007+0000", 2024-04-19T02:17:01.597 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012430699999999999 2024-04-19T02:17:01.597 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.597 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.597 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:01.597 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.257150+0000", 2024-04-19T02:17:01.597 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014291999999999999 2024-04-19T02:17:01.597 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.597 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.597 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:01.598 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.261375+0000", 2024-04-19T02:17:01.598 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042252100000000001 2024-04-19T02:17:01.598 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.598 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.598 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:01.598 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.274489+0000", 2024-04-19T02:17:01.598 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013113915 2024-04-19T02:17:01.598 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.598 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.598 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:01.598 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.274521+0000", 2024-04-19T02:17:01.598 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2691999999999998e-05 2024-04-19T02:17:01.598 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.599 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.599 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:01.599 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.274544+0000", 2024-04-19T02:17:01.599 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2408999999999998e-05 2024-04-19T02:17:01.599 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:01.599 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:01.599 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:01.599 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.599 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.599 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:98093 5.f 5:fcbc05b3:::benchmark_data_smithi121_44835_object98092:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-19T02:17:01.599 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:36.938897+0000", 2024-04-19T02:17:01.599 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 24.561682220000002, 2024-04-19T02:17:01.599 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019526373, 2024-04-19T02:17:01.599 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:01.600 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:01.600 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:01.600 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:01.600 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:01.600 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 98093 2024-04-19T02:17:01.600 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.600 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:01.600 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.600 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:01.600 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.938897+0000", 2024-04-19T02:17:01.600 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:01.600 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.600 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.600 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:01.600 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.938897+0000", 2024-04-19T02:17:01.601 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:01.601 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.601 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.601 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:01.601 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.938896+0000", 2024-04-19T02:17:01.601 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:01.601 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.601 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.601 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:01.601 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.938920+0000", 2024-04-19T02:17:01.601 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3969e-05 2024-04-19T02:17:01.601 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.601 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.601 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:01.602 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.938927+0000", 2024-04-19T02:17:01.602 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4760000000000003e-06 2024-04-19T02:17:01.602 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.602 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.602 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.602 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.938930+0000", 2024-04-19T02:17:01.602 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7349999999999998e-06 2024-04-19T02:17:01.602 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.602 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.602 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:01.602 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.945557+0000", 2024-04-19T02:17:01.602 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0066265689999999997 2024-04-19T02:17:01.602 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.602 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.603 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:01.603 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.945653+0000", 2024-04-19T02:17:01.603 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5948999999999999e-05 2024-04-19T02:17:01.603 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.603 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.603 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:01.603 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.945739+0000", 2024-04-19T02:17:01.603 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6012000000000003e-05 2024-04-19T02:17:01.603 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.603 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.603 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:01.603 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.949258+0000", 2024-04-19T02:17:01.603 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035189140000000002 2024-04-19T02:17:01.603 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.604 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.604 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:01.604 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.958372+0000", 2024-04-19T02:17:01.604 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0091140430000000005 2024-04-19T02:17:01.604 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.604 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.604 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:01.604 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.958402+0000", 2024-04-19T02:17:01.604 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9879e-05 2024-04-19T02:17:01.604 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.604 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.604 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:01.604 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.958423+0000", 2024-04-19T02:17:01.604 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1206999999999999e-05 2024-04-19T02:17:01.604 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:01.605 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:01.605 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:01.605 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.605 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.605 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:129219 5.2 5:45e7e1f4:::benchmark_data_smithi121_44835_object129218:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T02:17:01.605 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:52.629592+0000", 2024-04-19T02:17:01.605 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.8709869329999993, 2024-04-19T02:17:01.605 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021099489999999999, 2024-04-19T02:17:01.605 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:01.605 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:01.605 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:01.605 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:01.605 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:01.605 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129219 2024-04-19T02:17:01.606 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.606 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:01.606 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.606 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:01.606 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629592+0000", 2024-04-19T02:17:01.606 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:01.606 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.606 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.606 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:01.606 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629592+0000", 2024-04-19T02:17:01.606 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:01.606 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.606 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.606 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:01.606 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629591+0000", 2024-04-19T02:17:01.607 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:01.607 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.607 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.607 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:01.607 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629618+0000", 2024-04-19T02:17:01.607 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6970000000000001e-05 2024-04-19T02:17:01.607 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.607 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.607 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:01.607 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629639+0000", 2024-04-19T02:17:01.607 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0701999999999999e-05 2024-04-19T02:17:01.607 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.607 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.607 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.608 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629645+0000", 2024-04-19T02:17:01.608 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2299999999999996e-06 2024-04-19T02:17:01.608 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.608 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.608 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:01.608 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.635658+0000", 2024-04-19T02:17:01.608 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0060127549999999998 2024-04-19T02:17:01.608 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.608 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.608 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:01.608 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.635811+0000", 2024-04-19T02:17:01.608 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015305700000000001 2024-04-19T02:17:01.608 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.608 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.608 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:01.609 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.635967+0000", 2024-04-19T02:17:01.609 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015578599999999999 2024-04-19T02:17:01.609 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.609 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.609 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:01.609 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.642488+0000", 2024-04-19T02:17:01.609 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0065215619999999998 2024-04-19T02:17:01.609 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.609 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.609 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:01.609 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650603+0000", 2024-04-19T02:17:01.609 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0081144900000000002 2024-04-19T02:17:01.609 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.609 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.610 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:01.610 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650652+0000", 2024-04-19T02:17:01.610 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9079999999999998e-05 2024-04-19T02:17:01.610 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.610 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.610 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:01.610 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650691+0000", 2024-04-19T02:17:01.610 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9501e-05 2024-04-19T02:17:01.610 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:01.610 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:01.610 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:01.610 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.610 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.610 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:129220 5.2 5:44721865:::benchmark_data_smithi121_44835_object129219:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T02:17:01.610 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:52.630382+0000", 2024-04-19T02:17:01.611 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.8701965299999994, 2024-04-19T02:17:01.611 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.02043969, 2024-04-19T02:17:01.611 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:01.611 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:01.611 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:01.611 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:01.611 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:01.611 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129220 2024-04-19T02:17:01.611 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.611 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:01.611 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.611 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:01.611 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.630382+0000", 2024-04-19T02:17:01.611 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:01.611 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.612 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.612 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:01.612 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.630382+0000", 2024-04-19T02:17:01.612 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:01.612 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.612 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.612 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:01.612 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.630382+0000", 2024-04-19T02:17:01.612 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:01.612 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.612 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.612 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:01.612 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.630451+0000", 2024-04-19T02:17:01.612 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9022000000000004e-05 2024-04-19T02:17:01.612 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.613 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.613 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:01.613 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.630460+0000", 2024-04-19T02:17:01.613 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7059999999999999e-06 2024-04-19T02:17:01.613 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.613 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.613 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.613 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.630466+0000", 2024-04-19T02:17:01.613 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4689999999999996e-06 2024-04-19T02:17:01.613 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.613 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.613 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:01.613 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.639381+0000", 2024-04-19T02:17:01.613 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0089152529999999997 2024-04-19T02:17:01.614 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.614 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.614 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:01.614 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.639492+0000", 2024-04-19T02:17:01.614 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011075500000000001 2024-04-19T02:17:01.614 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.614 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.614 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:01.614 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.639589+0000", 2024-04-19T02:17:01.614 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7157999999999994e-05 2024-04-19T02:17:01.614 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.614 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.614 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:01.614 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.646571+0000", 2024-04-19T02:17:01.615 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00698177 2024-04-19T02:17:01.615 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.615 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.615 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:01.615 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650743+0000", 2024-04-19T02:17:01.615 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041725909999999998 2024-04-19T02:17:01.615 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.615 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.615 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:01.615 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650785+0000", 2024-04-19T02:17:01.615 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2026e-05 2024-04-19T02:17:01.615 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.615 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.615 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:01.615 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650822+0000", 2024-04-19T02:17:01.616 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6689000000000001e-05 2024-04-19T02:17:01.616 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:01.616 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:01.616 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:01.616 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.616 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.616 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:130093 5.2 5:41dcb8a4:::benchmark_data_smithi121_44835_object130092:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T02:17:01.616 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:53.069964+0000", 2024-04-19T02:17:01.616 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.4306149329999993, 2024-04-19T02:17:01.616 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020424088, 2024-04-19T02:17:01.616 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:01.616 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:01.616 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:01.616 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:01.616 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:01.617 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 130093 2024-04-19T02:17:01.617 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.617 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:01.617 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.617 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:01.617 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.069964+0000", 2024-04-19T02:17:01.617 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:01.617 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.617 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.617 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:01.617 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.069964+0000", 2024-04-19T02:17:01.617 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:01.617 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.617 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.617 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:01.618 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.069963+0000", 2024-04-19T02:17:01.618 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:01.618 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.618 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.618 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:01.618 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.070064+0000", 2024-04-19T02:17:01.618 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100709 2024-04-19T02:17:01.618 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.618 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.618 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:01.618 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.070072+0000", 2024-04-19T02:17:01.618 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8339999999999999e-06 2024-04-19T02:17:01.618 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.618 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.619 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.619 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.070077+0000", 2024-04-19T02:17:01.619 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2399999999999998e-06 2024-04-19T02:17:01.619 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.619 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.619 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:01.619 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.071370+0000", 2024-04-19T02:17:01.619 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012926470000000001 2024-04-19T02:17:01.619 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.619 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.619 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:01.619 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.071497+0000", 2024-04-19T02:17:01.619 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000127701 2024-04-19T02:17:01.619 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.619 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.620 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:01.620 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.071662+0000", 2024-04-19T02:17:01.620 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016424300000000001 2024-04-19T02:17:01.620 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.620 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.620 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:01.620 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.077150+0000", 2024-04-19T02:17:01.620 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.005488031 2024-04-19T02:17:01.620 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.620 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.620 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:01.620 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.090305+0000", 2024-04-19T02:17:01.620 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013155622 2024-04-19T02:17:01.620 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.621 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.621 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:01.621 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.090352+0000", 2024-04-19T02:17:01.621 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6798999999999997e-05 2024-04-19T02:17:01.621 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:01.621 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:01.621 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:01.621 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.090388+0000", 2024-04-19T02:17:01.621 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5837999999999998e-05 2024-04-19T02:17:01.621 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:01.621 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:01.621 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:01.621 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:01.621 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:01.622 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:01.623 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:17:01.624 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:01.624+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:01.724 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:01.725+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:01.797 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:17:01.798 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:17:01.798 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.798 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:147635 5.0 5:014a5932:::benchmark_data_smithi121_44835_object13600:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-19T02:17:01.798 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:01.792439+0000", 2024-04-19T02:17:01.798 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0058567589999999996, 2024-04-19T02:17:01.798 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0058772479999999998, 2024-04-19T02:17:01.798 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:01.798 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:01.798 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:01.798 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:01.798 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:01.799 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 147635 2024-04-19T02:17:01.799 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.799 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:01.799 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.799 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:01.799 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.792439+0000", 2024-04-19T02:17:01.799 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:01.799 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.799 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.799 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:01.799 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.792439+0000", 2024-04-19T02:17:01.799 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:01.799 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.799 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.799 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:01.800 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.792438+0000", 2024-04-19T02:17:01.800 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:01.800 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.800 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.800 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:01.800 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.792443+0000", 2024-04-19T02:17:01.800 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8119999999999998e-06 2024-04-19T02:17:01.800 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.800 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.800 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:01.800 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.792451+0000", 2024-04-19T02:17:01.800 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9370000000000004e-06 2024-04-19T02:17:01.800 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.800 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.801 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.801 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.792456+0000", 2024-04-19T02:17:01.801 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.9849999999999997e-06 2024-04-19T02:17:01.801 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.801 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.801 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:01.801 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.792489+0000", 2024-04-19T02:17:01.801 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3206e-05 2024-04-19T02:17:01.801 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.801 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.801 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:01.801 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.792567+0000", 2024-04-19T02:17:01.801 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.7640999999999997e-05 2024-04-19T02:17:01.801 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.801 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.802 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:01.802 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.792632+0000", 2024-04-19T02:17:01.802 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5318e-05 2024-04-19T02:17:01.802 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:01.802 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:01.802 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:01.802 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.802 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.802 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:147636 5.8 5:18fe4e69:::benchmark_data_smithi121_44835_object13601:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-19T02:17:01.802 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:01.792464+0000", 2024-04-19T02:17:01.802 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.005831452, 2024-04-19T02:17:01.802 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0059020299999999999, 2024-04-19T02:17:01.802 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:01.802 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:01.803 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:01.803 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:01.803 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:01.803 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 147636 2024-04-19T02:17:01.803 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.803 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:01.803 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.803 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:01.803 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.792464+0000", 2024-04-19T02:17:01.803 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:01.803 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.803 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.803 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:01.803 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.792464+0000", 2024-04-19T02:17:01.803 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:01.804 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.804 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.804 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:01.804 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.792464+0000", 2024-04-19T02:17:01.804 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:01.804 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.804 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.804 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:01.804 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.792466+0000", 2024-04-19T02:17:01.804 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.278e-06 2024-04-19T02:17:01.804 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.804 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.804 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:01.804 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.792472+0000", 2024-04-19T02:17:01.805 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.0209999999999996e-06 2024-04-19T02:17:01.805 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.805 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.805 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.805 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.792478+0000", 2024-04-19T02:17:01.805 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.2940000000000002e-06 2024-04-19T02:17:01.805 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.805 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.805 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:01.805 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.792517+0000", 2024-04-19T02:17:01.805 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8544999999999998e-05 2024-04-19T02:17:01.805 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.805 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.805 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:01.805 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.792646+0000", 2024-04-19T02:17:01.806 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000128522 2024-04-19T02:17:01.806 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.806 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.806 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:01.806 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.792764+0000", 2024-04-19T02:17:01.806 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000118774 2024-04-19T02:17:01.806 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:01.806 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:01.806 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:01.806 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.806 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.806 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:147637 5.d e45/16 5:bdfa6058:::benchmark_data_smithi121_44835_object13602:head v 45'9227, mlcod=45'9225)", 2024-04-19T02:17:01.806 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:01.792858+0000", 2024-04-19T02:17:01.807 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0054380950000000004, 2024-04-19T02:17:01.807 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0055547139999999997, 2024-04-19T02:17:01.807 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:01.807 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:01.807 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:01.807 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.807 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:01.807 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.792858+0000", 2024-04-19T02:17:01.807 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:01.807 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.807 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.807 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:01.807 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.792858+0000", 2024-04-19T02:17:01.807 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:01.808 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.808 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.808 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:01.808 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.792857+0000", 2024-04-19T02:17:01.808 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:01.808 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.808 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.808 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:01.808 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.792863+0000", 2024-04-19T02:17:01.808 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.0580000000000003e-06 2024-04-19T02:17:01.808 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.808 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.808 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:01.808 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.792872+0000", 2024-04-19T02:17:01.808 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.833e-06 2024-04-19T02:17:01.808 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.809 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.809 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.809 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.792878+0000", 2024-04-19T02:17:01.809 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.9710000000000001e-06 2024-04-19T02:17:01.809 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.809 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.809 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:01.809 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.792931+0000", 2024-04-19T02:17:01.809 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.3557999999999998e-05 2024-04-19T02:17:01.809 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.809 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.809 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:01.809 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.792952+0000", 2024-04-19T02:17:01.809 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.0220999999999998e-05 2024-04-19T02:17:01.810 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:01.810 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:01.810 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:01.810 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.810 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.810 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:147638 5.d e45/16 5:b05091a5:::benchmark_data_smithi121_44835_object13603:head v 45'9228, mlcod=45'9225)", 2024-04-19T02:17:01.810 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:01.794898+0000", 2024-04-19T02:17:01.810 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0033979710000000001, 2024-04-19T02:17:01.810 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.003549782, 2024-04-19T02:17:01.810 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:01.810 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:01.810 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:01.810 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.810 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:01.810 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.794898+0000", 2024-04-19T02:17:01.811 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:01.811 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.811 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.811 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:01.811 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.794898+0000", 2024-04-19T02:17:01.811 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:01.811 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.811 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.811 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:01.811 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.794897+0000", 2024-04-19T02:17:01.811 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:01.811 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.811 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.811 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:01.811 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.794902+0000", 2024-04-19T02:17:01.812 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8280000000000002e-06 2024-04-19T02:17:01.812 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.812 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.812 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:01.812 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.794908+0000", 2024-04-19T02:17:01.812 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.1290000000000001e-06 2024-04-19T02:17:01.812 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.812 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.812 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.812 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.794912+0000", 2024-04-19T02:17:01.812 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2719999999999999e-06 2024-04-19T02:17:01.812 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.812 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.812 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:01.813 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.794947+0000", 2024-04-19T02:17:01.813 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4378999999999997e-05 2024-04-19T02:17:01.813 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.813 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.813 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:01.813 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.794964+0000", 2024-04-19T02:17:01.813 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.7645000000000001e-05 2024-04-19T02:17:01.813 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:01.813 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:01.813 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:01.813 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.813 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.813 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:147639 5.9 e45/16 5:9248df8c:::benchmark_data_smithi121_44835_object13604:head v 45'9371, mlcod=45'9369)", 2024-04-19T02:17:01.813 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:01.795023+0000", 2024-04-19T02:17:01.813 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0032724500000000001, 2024-04-19T02:17:01.814 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0034605590000000002, 2024-04-19T02:17:01.814 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:01.814 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:01.814 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:01.814 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.814 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:01.814 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.795023+0000", 2024-04-19T02:17:01.814 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:01.814 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.814 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.814 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:01.814 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.795023+0000", 2024-04-19T02:17:01.814 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:01.814 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.815 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.815 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:01.815 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.795023+0000", 2024-04-19T02:17:01.815 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:01.815 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.815 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.815 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:01.815 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.795026+0000", 2024-04-19T02:17:01.815 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4450000000000001e-06 2024-04-19T02:17:01.815 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.815 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.815 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:01.815 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.795030+0000", 2024-04-19T02:17:01.815 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1749999999999998e-06 2024-04-19T02:17:01.815 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.815 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.816 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.816 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.795033+0000", 2024-04-19T02:17:01.816 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9550000000000001e-06 2024-04-19T02:17:01.816 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.816 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.816 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:01.816 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.795313+0000", 2024-04-19T02:17:01.816 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000279595 2024-04-19T02:17:01.816 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.816 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.816 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:01.816 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.795332+0000", 2024-04-19T02:17:01.816 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.8745000000000001e-05 2024-04-19T02:17:01.816 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:01.816 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:01.817 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:01.817 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.817 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.817 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:147642 5.9 e45/16 5:9e1967f2:::benchmark_data_smithi121_44835_object13607:head v 45'9372, mlcod=45'9369)", 2024-04-19T02:17:01.817 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:01.796903+0000", 2024-04-19T02:17:01.817 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0013924440000000001, 2024-04-19T02:17:01.817 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016155200000000001, 2024-04-19T02:17:01.817 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:01.817 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:01.817 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:01.817 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.817 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:01.817 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.796903+0000", 2024-04-19T02:17:01.817 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:01.817 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.817 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.818 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:01.818 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.796903+0000", 2024-04-19T02:17:01.818 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:01.818 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.818 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.818 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:01.818 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.796903+0000", 2024-04-19T02:17:01.818 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:01.818 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.818 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.818 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:01.818 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.796908+0000", 2024-04-19T02:17:01.818 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2989999999999996e-06 2024-04-19T02:17:01.818 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.818 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.819 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:01.819 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.796917+0000", 2024-04-19T02:17:01.819 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.5019999999999998e-06 2024-04-19T02:17:01.819 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.819 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.819 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.819 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.796923+0000", 2024-04-19T02:17:01.819 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.3890000000000004e-06 2024-04-19T02:17:01.819 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.819 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.819 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:01.819 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.796954+0000", 2024-04-19T02:17:01.819 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1010000000000003e-05 2024-04-19T02:17:01.819 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.819 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.820 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:01.820 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.796973+0000", 2024-04-19T02:17:01.820 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.8807000000000001e-05 2024-04-19T02:17:01.820 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:01.820 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:01.820 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:01.820 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.820 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.820 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:147645 5.8 5:14359bf2:::benchmark_data_smithi121_44835_object13610:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-19T02:17:01.820 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:01.797003+0000", 2024-04-19T02:17:01.820 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.001292339, 2024-04-19T02:17:01.820 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0015503800000000001, 2024-04-19T02:17:01.820 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:01.820 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:01.820 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:01.821 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:01.821 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:01.821 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 147645 2024-04-19T02:17:01.821 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.821 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:01.821 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.821 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:01.821 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.797003+0000", 2024-04-19T02:17:01.821 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:01.821 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.821 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.821 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:01.821 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.797003+0000", 2024-04-19T02:17:01.821 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:01.821 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.821 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.822 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:01.822 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.797003+0000", 2024-04-19T02:17:01.822 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:01.822 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.822 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.822 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:01.822 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.797006+0000", 2024-04-19T02:17:01.822 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2799999999999999e-06 2024-04-19T02:17:01.822 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.822 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.822 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:01.822 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.797012+0000", 2024-04-19T02:17:01.823 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.8309999999999997e-06 2024-04-19T02:17:01.823 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.823 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.823 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.823 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.797016+0000", 2024-04-19T02:17:01.823 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.5079999999999999e-06 2024-04-19T02:17:01.823 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.823 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.823 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:01.823 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.797059+0000", 2024-04-19T02:17:01.823 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2701999999999999e-05 2024-04-19T02:17:01.823 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.823 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.823 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:01.823 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.797189+0000", 2024-04-19T02:17:01.823 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000130405 2024-04-19T02:17:01.824 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.824 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.824 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:01.824 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.797321+0000", 2024-04-19T02:17:01.824 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000131118 2024-04-19T02:17:01.824 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:01.824 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:01.824 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:01.824 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.824 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.824 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:147643 5.d e45/16 5:b39b5f75:::benchmark_data_smithi121_44835_object13608:head v 45'9229, mlcod=45'9225)", 2024-04-19T02:17:01.824 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:01.797031+0000", 2024-04-19T02:17:01.824 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.001264806, 2024-04-19T02:17:01.824 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0015664279999999999, 2024-04-19T02:17:01.825 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:01.825 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:01.825 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:01.825 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.825 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:01.825 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.797031+0000", 2024-04-19T02:17:01.825 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:01.825 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.825 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.825 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:01.825 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.797031+0000", 2024-04-19T02:17:01.825 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:01.825 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.825 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.826 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:01.826 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.797031+0000", 2024-04-19T02:17:01.826 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:01.826 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.826 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.826 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:01.826 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.797034+0000", 2024-04-19T02:17:01.826 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.242e-06 2024-04-19T02:17:01.826 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.826 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.826 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:01.826 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.797038+0000", 2024-04-19T02:17:01.826 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.737e-06 2024-04-19T02:17:01.826 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.827 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.827 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.827 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.797043+0000", 2024-04-19T02:17:01.827 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0839999999999999e-06 2024-04-19T02:17:01.827 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.827 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.827 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:01.827 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.797072+0000", 2024-04-19T02:17:01.827 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9470000000000001e-05 2024-04-19T02:17:01.827 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.827 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.827 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:01.827 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.797089+0000", 2024-04-19T02:17:01.827 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.6963e-05 2024-04-19T02:17:01.827 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:01.828 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:01.828 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:01.828 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.828 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.828 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:147646 5.e 5:7ba622b2:::benchmark_data_smithi121_44835_object13611:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-19T02:17:01.828 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:01.798229+0000", 2024-04-19T02:17:01.828 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 6.6919000000000001e-05, 2024-04-19T02:17:01.828 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00040683000000000001, 2024-04-19T02:17:01.828 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:01.828 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:01.828 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:01.828 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:01.828 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:01.828 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 147646 2024-04-19T02:17:01.828 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.829 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:01.829 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.829 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:01.829 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.798229+0000", 2024-04-19T02:17:01.829 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:01.829 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.829 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.829 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:01.829 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.798229+0000", 2024-04-19T02:17:01.829 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:01.829 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.829 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.829 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:01.829 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.798228+0000", 2024-04-19T02:17:01.829 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:01.829 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.830 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.830 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:01.830 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.798232+0000", 2024-04-19T02:17:01.830 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3730000000000003e-06 2024-04-19T02:17:01.830 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.830 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.830 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:01.830 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.798243+0000", 2024-04-19T02:17:01.830 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0726e-05 2024-04-19T02:17:01.830 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.830 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.830 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:01.830 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.798251+0000", 2024-04-19T02:17:01.830 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9699999999999999e-06 2024-04-19T02:17:01.830 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.831 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.831 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:01.831 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.798293+0000", 2024-04-19T02:17:01.831 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2447000000000002e-05 2024-04-19T02:17:01.831 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.831 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.831 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:01.831 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.798424+0000", 2024-04-19T02:17:01.831 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013076299999999999 2024-04-19T02:17:01.831 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:01.831 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:01.831 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:01.831 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:01.798543+0000", 2024-04-19T02:17:01.831 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011843799999999999 2024-04-19T02:17:01.831 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:01.832 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:01.832 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:01.832 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:01.832 INFO:teuthology.orchestra.run.smithi174.stdout: ], 2024-04-19T02:17:01.832 INFO:teuthology.orchestra.run.smithi174.stdout: "num_ops": 9 2024-04-19T02:17:01.832 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:17:01.833 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:17:01.834 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:01.834+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:01.934 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:01.935+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:02.036 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:02.037+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:02.046 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:17:02.046 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [], 2024-04-19T02:17:02.046 INFO:teuthology.orchestra.run.smithi174.stdout: "complaint_time": 30, 2024-04-19T02:17:02.046 INFO:teuthology.orchestra.run.smithi174.stdout: "num_blocked_ops": 0 2024-04-19T02:17:02.046 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:17:02.060 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:17:02.152 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:02.149+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:02.215 INFO:teuthology.orchestra.run.smithi121.stderr:nodeep-scrub is unset 2024-04-19T02:17:02.238 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:02.240+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:02.272 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:17:02.272 INFO:teuthology.orchestra.run.smithi174.stdout: "size": 20, 2024-04-19T02:17:02.272 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 600, 2024-04-19T02:17:02.272 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:17:02.272 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.272 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:10 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:02.272 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269877+0000", 2024-04-19T02:17:02.272 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 93.000978013999998, 2024-04-19T02:17:02.272 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020732751000000001, 2024-04-19T02:17:02.273 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:02.273 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:02.273 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:02.273 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.273 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:02.273 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269877+0000", 2024-04-19T02:17:02.273 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:02.273 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.273 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.273 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:02.273 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269877+0000", 2024-04-19T02:17:02.273 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:02.273 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.273 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.274 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:02.274 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269875+0000", 2024-04-19T02:17:02.274 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:02.274 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.274 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.274 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:02.274 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269891+0000", 2024-04-19T02:17:02.274 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.5494000000000001e-05 2024-04-19T02:17:02.274 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.274 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.274 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:02.274 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269903+0000", 2024-04-19T02:17:02.274 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2003e-05 2024-04-19T02:17:02.274 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.275 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.275 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:02.275 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269914+0000", 2024-04-19T02:17:02.275 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0947e-05 2024-04-19T02:17:02.275 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.275 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.275 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:02.275 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269971+0000", 2024-04-19T02:17:02.275 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7036000000000001e-05 2024-04-19T02:17:02.275 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.275 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.275 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:17:02.275 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269979+0000", 2024-04-19T02:17:02.275 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.6660000000000008e-06 2024-04-19T02:17:02.275 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.276 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.276 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:02.276 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284891+0000", 2024-04-19T02:17:02.276 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014912584 2024-04-19T02:17:02.276 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.276 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.276 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:02.276 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285213+0000", 2024-04-19T02:17:02.276 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00032172199999999998 2024-04-19T02:17:02.276 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.276 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.276 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:02.276 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285357+0000", 2024-04-19T02:17:02.276 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014367899999999999 2024-04-19T02:17:02.277 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.277 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.277 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:02.277 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288883+0000", 2024-04-19T02:17:02.277 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0035268719999999999 2024-04-19T02:17:02.277 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.277 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.277 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:02.277 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290537+0000", 2024-04-19T02:17:02.277 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016537399999999999 2024-04-19T02:17:02.277 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.277 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.277 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:02.277 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290576+0000", 2024-04-19T02:17:02.278 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9266e-05 2024-04-19T02:17:02.278 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.278 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.278 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:02.278 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290609+0000", 2024-04-19T02:17:02.278 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2818000000000003e-05 2024-04-19T02:17:02.278 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:02.278 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:02.278 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:02.278 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.278 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.278 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:11 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:02.278 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:17:02.278 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 93.000925093000006, 2024-04-19T02:17:02.278 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020352748, 2024-04-19T02:17:02.279 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:02.279 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:02.279 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:02.279 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.279 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:02.279 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:17:02.279 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:02.279 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.279 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.279 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:02.279 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:17:02.279 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:02.279 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.279 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.279 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:02.280 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:17:02.280 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:02.280 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.280 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.280 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:02.280 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269933+0000", 2024-04-19T02:17:02.280 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2169999999999996e-06 2024-04-19T02:17:02.280 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.280 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.280 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:02.280 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269940+0000", 2024-04-19T02:17:02.280 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1500000000000002e-06 2024-04-19T02:17:02.280 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.280 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.280 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:02.281 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269948+0000", 2024-04-19T02:17:02.281 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.8690000000000004e-06 2024-04-19T02:17:02.281 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.281 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.281 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:02.281 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:17:02.281 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2994999999999997e-05 2024-04-19T02:17:02.281 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.281 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.281 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:17:02.281 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269997+0000", 2024-04-19T02:17:02.281 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.9020000000000004e-06 2024-04-19T02:17:02.281 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.281 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.281 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:02.281 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.282729+0000", 2024-04-19T02:17:02.282 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.012732537 2024-04-19T02:17:02.282 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.282 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.282 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:02.282 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.282838+0000", 2024-04-19T02:17:02.282 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000108298 2024-04-19T02:17:02.282 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.282 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.282 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:02.282 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.283002+0000", 2024-04-19T02:17:02.282 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00016466300000000001 2024-04-19T02:17:02.282 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.282 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.282 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:02.283 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288708+0000", 2024-04-19T02:17:02.283 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.005705066 2024-04-19T02:17:02.283 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.283 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.283 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:02.283 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290215+0000", 2024-04-19T02:17:02.283 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0015075010000000001 2024-04-19T02:17:02.283 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.283 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.283 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:02.283 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290259+0000", 2024-04-19T02:17:02.283 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3711999999999998e-05 2024-04-19T02:17:02.283 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.283 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.283 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:02.283 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290282+0000", 2024-04-19T02:17:02.284 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3458000000000001e-05 2024-04-19T02:17:02.284 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:02.284 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:02.284 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:02.284 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.284 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.284 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:14 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:02.284 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:17:02.284 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 93.000891303000003, 2024-04-19T02:17:02.284 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020137202, 2024-04-19T02:17:02.284 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:02.284 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:02.284 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:02.284 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.284 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:02.285 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:17:02.285 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:02.285 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.285 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.285 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:02.285 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:17:02.285 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:02.285 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.285 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.285 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:02.285 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:17:02.285 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:02.285 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.285 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.286 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:02.286 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269971+0000", 2024-04-19T02:17:02.286 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.5459999999999992e-06 2024-04-19T02:17:02.286 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.286 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.286 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:02.286 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269979+0000", 2024-04-19T02:17:02.286 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9130000000000003e-06 2024-04-19T02:17:02.286 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.286 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.286 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:02.286 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269986+0000", 2024-04-19T02:17:02.286 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.3779999999999998e-06 2024-04-19T02:17:02.287 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.287 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.287 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:02.287 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270030+0000", 2024-04-19T02:17:02.287 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3982e-05 2024-04-19T02:17:02.287 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.287 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.287 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:17:02.287 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270034+0000", 2024-04-19T02:17:02.288 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1779999999999996e-06 2024-04-19T02:17:02.288 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.288 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.288 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:02.288 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.277870+0000", 2024-04-19T02:17:02.288 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0078362150000000005 2024-04-19T02:17:02.288 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.288 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.288 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:02.288 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.278216+0000", 2024-04-19T02:17:02.288 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00034634999999999999 2024-04-19T02:17:02.288 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.288 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.288 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:02.288 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.278732+0000", 2024-04-19T02:17:02.289 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00051536099999999999 2024-04-19T02:17:02.289 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.289 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.289 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:02.289 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.287694+0000", 2024-04-19T02:17:02.289 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0089621019999999996 2024-04-19T02:17:02.289 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.289 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.289 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:02.289 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290026+0000", 2024-04-19T02:17:02.289 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0023323139999999998 2024-04-19T02:17:02.289 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.289 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.289 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:02.290 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290067+0000", 2024-04-19T02:17:02.290 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1043e-05 2024-04-19T02:17:02.290 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.290 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.290 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:02.290 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290100+0000", 2024-04-19T02:17:02.290 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3278999999999998e-05 2024-04-19T02:17:02.290 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:02.290 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:02.290 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:02.290 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.290 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.290 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:02.290 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:17:02.291 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 93.000859511000002, 2024-04-19T02:17:02.291 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020731702000000001, 2024-04-19T02:17:02.291 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:02.291 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:02.291 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:02.291 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.291 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:02.291 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:17:02.291 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:02.291 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.291 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.291 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:02.291 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:17:02.291 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:02.291 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.292 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.292 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:02.292 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:17:02.292 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:02.292 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.292 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.292 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:02.292 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269998+0000", 2024-04-19T02:17:02.292 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7100000000000001e-06 2024-04-19T02:17:02.292 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.292 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.292 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:02.292 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270005+0000", 2024-04-19T02:17:02.292 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.241e-06 2024-04-19T02:17:02.292 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.293 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.293 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:02.293 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270011+0000", 2024-04-19T02:17:02.293 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6279999999999999e-06 2024-04-19T02:17:02.293 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.293 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.293 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:02.293 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270046+0000", 2024-04-19T02:17:02.293 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5173999999999999e-05 2024-04-19T02:17:02.293 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.293 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.293 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:02.293 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:17:02.293 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0019999999999997e-06 2024-04-19T02:17:02.293 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.294 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.294 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:02.294 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285619+0000", 2024-04-19T02:17:02.294 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015567391 2024-04-19T02:17:02.294 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.294 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.294 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:02.294 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285671+0000", 2024-04-19T02:17:02.294 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2460999999999998e-05 2024-04-19T02:17:02.294 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.294 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.294 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:02.294 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285775+0000", 2024-04-19T02:17:02.294 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000103389 2024-04-19T02:17:02.295 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.295 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.295 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:02.295 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288934+0000", 2024-04-19T02:17:02.295 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0031595859999999998 2024-04-19T02:17:02.295 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.295 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.295 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:02.295 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290650+0000", 2024-04-19T02:17:02.295 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001716242 2024-04-19T02:17:02.295 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.295 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.295 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:02.295 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290692+0000", 2024-04-19T02:17:02.295 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1910999999999999e-05 2024-04-19T02:17:02.296 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.296 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.296 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:02.296 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290727+0000", 2024-04-19T02:17:02.296 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4412000000000002e-05 2024-04-19T02:17:02.296 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:02.296 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:02.296 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:02.296 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.296 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.296 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:02.296 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270019+0000", 2024-04-19T02:17:02.297 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 93.000835916, 2024-04-19T02:17:02.297 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020572014999999999, 2024-04-19T02:17:02.297 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:02.297 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:02.297 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:02.297 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.297 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:02.297 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270019+0000", 2024-04-19T02:17:02.297 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:02.297 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.297 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.297 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:02.297 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270019+0000", 2024-04-19T02:17:02.297 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:02.297 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.298 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.298 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:02.298 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270018+0000", 2024-04-19T02:17:02.298 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:02.298 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.298 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.298 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:02.298 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270021+0000", 2024-04-19T02:17:02.298 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0319999999999999e-06 2024-04-19T02:17:02.298 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.298 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.298 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:02.298 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270028+0000", 2024-04-19T02:17:02.298 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6189999999999996e-06 2024-04-19T02:17:02.299 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.299 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.299 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:02.299 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270035+0000", 2024-04-19T02:17:02.299 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1690000000000003e-06 2024-04-19T02:17:02.299 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.299 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.299 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:02.299 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270078+0000", 2024-04-19T02:17:02.299 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3061e-05 2024-04-19T02:17:02.299 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.299 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.299 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:02.299 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270082+0000", 2024-04-19T02:17:02.299 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4510000000000002e-06 2024-04-19T02:17:02.300 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.300 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.300 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:02.300 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284354+0000", 2024-04-19T02:17:02.300 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014271588999999999 2024-04-19T02:17:02.300 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.300 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.300 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:02.300 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284497+0000", 2024-04-19T02:17:02.300 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014335800000000001 2024-04-19T02:17:02.300 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.300 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.300 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:02.300 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284626+0000", 2024-04-19T02:17:02.300 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000128744 2024-04-19T02:17:02.301 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.301 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.301 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:02.301 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288844+0000", 2024-04-19T02:17:02.301 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00421807 2024-04-19T02:17:02.301 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.301 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.301 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:02.301 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290508+0000", 2024-04-19T02:17:02.301 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001663774 2024-04-19T02:17:02.301 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.301 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.301 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:02.301 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290556+0000", 2024-04-19T02:17:02.302 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.7599999999999998e-05 2024-04-19T02:17:02.302 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.302 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.302 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:02.302 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290591+0000", 2024-04-19T02:17:02.302 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5034999999999999e-05 2024-04-19T02:17:02.302 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:02.302 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:02.302 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:02.302 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.302 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.302 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:02.302 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:17:02.302 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 93.000813053000002, 2024-04-19T02:17:02.303 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020192280999999999, 2024-04-19T02:17:02.303 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:02.303 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:02.303 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:02.303 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.303 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:02.303 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:17:02.303 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:02.303 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.303 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.303 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:02.303 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:17:02.303 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:02.303 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.303 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.304 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:02.304 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:17:02.304 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:02.304 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.304 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.304 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:02.304 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270045+0000", 2024-04-19T02:17:02.304 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8680000000000001e-06 2024-04-19T02:17:02.304 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.304 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.304 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:02.304 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270052+0000", 2024-04-19T02:17:02.304 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.9999999999999999e-06 2024-04-19T02:17:02.304 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.304 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.305 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:02.305 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270056+0000", 2024-04-19T02:17:02.305 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4479999999999996e-06 2024-04-19T02:17:02.305 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.305 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.305 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:02.305 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270089+0000", 2024-04-19T02:17:02.305 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3071000000000002e-05 2024-04-19T02:17:02.305 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.305 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.305 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:02.305 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270092+0000", 2024-04-19T02:17:02.305 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9780000000000001e-06 2024-04-19T02:17:02.305 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.305 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.306 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:02.306 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.280632+0000", 2024-04-19T02:17:02.306 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010539712 2024-04-19T02:17:02.306 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.306 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.306 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:02.306 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.280743+0000", 2024-04-19T02:17:02.306 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000111048 2024-04-19T02:17:02.306 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.306 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.306 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:02.306 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.281531+0000", 2024-04-19T02:17:02.306 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00078738199999999999 2024-04-19T02:17:02.306 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.307 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.307 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:02.307 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.287949+0000", 2024-04-19T02:17:02.307 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0064185730000000003 2024-04-19T02:17:02.307 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.307 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.307 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:02.307 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290184+0000", 2024-04-19T02:17:02.307 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0022350849999999999 2024-04-19T02:17:02.307 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.307 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.307 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:02.307 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290209+0000", 2024-04-19T02:17:02.307 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4907000000000001e-05 2024-04-19T02:17:02.307 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.308 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.308 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:02.308 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290234+0000", 2024-04-19T02:17:02.308 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4666999999999999e-05 2024-04-19T02:17:02.308 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:02.308 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:02.308 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:02.308 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.308 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.308 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:19 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:02.308 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:17:02.308 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 93.000791586999995, 2024-04-19T02:17:02.308 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020818203, 2024-04-19T02:17:02.308 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:02.308 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:02.309 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:02.309 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.309 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:02.309 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:17:02.309 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:02.309 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.309 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.309 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:02.309 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:17:02.309 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:02.309 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.309 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.309 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:02.309 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:17:02.309 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:02.309 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.310 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.310 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:02.310 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270065+0000", 2024-04-19T02:17:02.310 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4310000000000001e-06 2024-04-19T02:17:02.310 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.310 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.310 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:02.310 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270070+0000", 2024-04-19T02:17:02.310 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2859999999999999e-06 2024-04-19T02:17:02.310 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.310 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.310 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:02.310 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270077+0000", 2024-04-19T02:17:02.310 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5270000000000004e-06 2024-04-19T02:17:02.311 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.311 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.311 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:02.311 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270107+0000", 2024-04-19T02:17:02.311 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0205999999999998e-05 2024-04-19T02:17:02.311 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.311 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.311 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:02.311 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270111+0000", 2024-04-19T02:17:02.311 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8650000000000003e-06 2024-04-19T02:17:02.311 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.311 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.311 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:02.311 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285936+0000", 2024-04-19T02:17:02.312 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015824677999999998 2024-04-19T02:17:02.312 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.312 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.312 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:02.312 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286007+0000", 2024-04-19T02:17:02.312 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1157999999999999e-05 2024-04-19T02:17:02.312 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.312 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.312 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:02.312 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286086+0000", 2024-04-19T02:17:02.312 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9084000000000004e-05 2024-04-19T02:17:02.312 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.312 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.312 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:02.312 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290740+0000", 2024-04-19T02:17:02.313 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0046543679999999999 2024-04-19T02:17:02.313 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.313 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.313 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:02.313 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290833+0000", 2024-04-19T02:17:02.313 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2551000000000002e-05 2024-04-19T02:17:02.313 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.313 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.313 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:02.313 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290859+0000", 2024-04-19T02:17:02.313 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.6696999999999999e-05 2024-04-19T02:17:02.313 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.313 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.313 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:02.313 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290881+0000", 2024-04-19T02:17:02.313 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1653000000000001e-05 2024-04-19T02:17:02.314 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:02.314 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:02.314 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:02.314 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.314 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.314 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:77622 5.8 5:166fbe77:::benchmark_data_smithi121_44835_object77621:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:02.314 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:17:02.314 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 35.465294649999997, 2024-04-19T02:17:02.314 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.021784694, 2024-04-19T02:17:02.314 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:02.314 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:02.314 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:02.314 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:02.314 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:02.315 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 77622 2024-04-19T02:17:02.315 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.315 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:02.315 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.315 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:02.315 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:17:02.315 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:02.315 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.315 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.315 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:02.315 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:17:02.315 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:02.315 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.315 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.316 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:02.316 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805559+0000", 2024-04-19T02:17:02.316 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:02.316 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.316 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.316 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:02.316 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805659+0000", 2024-04-19T02:17:02.316 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.9908000000000006e-05 2024-04-19T02:17:02.316 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.316 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.316 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:02.316 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805668+0000", 2024-04-19T02:17:02.316 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2129999999999997e-06 2024-04-19T02:17:02.316 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.317 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.317 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:02.317 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805673+0000", 2024-04-19T02:17:02.317 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0370000000000002e-06 2024-04-19T02:17:02.317 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.317 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.317 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:02.317 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812022+0000", 2024-04-19T02:17:02.317 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0063483239999999998 2024-04-19T02:17:02.317 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.317 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.317 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:02.317 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812129+0000", 2024-04-19T02:17:02.317 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010744200000000001 2024-04-19T02:17:02.317 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.317 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.318 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:02.318 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812252+0000", 2024-04-19T02:17:02.318 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000122519 2024-04-19T02:17:02.318 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.318 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.318 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:02.318 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.820979+0000", 2024-04-19T02:17:02.318 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0087272740000000001 2024-04-19T02:17:02.318 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.318 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.318 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:02.318 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827270+0000", 2024-04-19T02:17:02.318 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0062906239999999999 2024-04-19T02:17:02.318 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.319 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.319 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:02.319 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827309+0000", 2024-04-19T02:17:02.319 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9678999999999997e-05 2024-04-19T02:17:02.319 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.319 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.319 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:02.319 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827345+0000", 2024-04-19T02:17:02.319 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5308000000000001e-05 2024-04-19T02:17:02.319 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:02.319 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:02.319 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:02.319 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.319 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.319 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78224 5.4 5:26e797d5:::benchmark_data_smithi121_44835_object78223:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:02.320 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:17:02.320 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 35.164292451000001, 2024-04-19T02:17:02.320 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.021471998999999999, 2024-04-19T02:17:02.320 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:02.320 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:02.320 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:02.320 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:02.320 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:02.320 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78224 2024-04-19T02:17:02.320 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.320 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:02.320 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.320 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:02.320 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:17:02.320 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:02.321 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.321 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.321 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:02.321 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:17:02.321 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:02.321 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.321 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.321 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:02.321 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106561+0000", 2024-04-19T02:17:02.321 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:02.321 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.321 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.321 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:02.321 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106630+0000", 2024-04-19T02:17:02.321 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.8553999999999994e-05 2024-04-19T02:17:02.322 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.322 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.322 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:02.322 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106644+0000", 2024-04-19T02:17:02.322 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.4651000000000001e-05 2024-04-19T02:17:02.322 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.322 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.322 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:02.322 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106653+0000", 2024-04-19T02:17:02.322 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.6719999999999993e-06 2024-04-19T02:17:02.322 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.322 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.322 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:02.322 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106693+0000", 2024-04-19T02:17:02.322 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9978999999999998e-05 2024-04-19T02:17:02.323 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.323 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.323 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:02.323 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106840+0000", 2024-04-19T02:17:02.323 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0001473 2024-04-19T02:17:02.323 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.323 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.323 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:02.323 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106971+0000", 2024-04-19T02:17:02.323 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013051499999999999 2024-04-19T02:17:02.323 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.323 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.323 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:02.323 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.109047+0000", 2024-04-19T02:17:02.323 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.002076002 2024-04-19T02:17:02.324 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.324 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.324 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:02.324 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.127967+0000", 2024-04-19T02:17:02.324 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.018919780000000001 2024-04-19T02:17:02.324 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.324 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.324 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:02.324 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128004+0000", 2024-04-19T02:17:02.324 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7719000000000003e-05 2024-04-19T02:17:02.324 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.324 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.324 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:02.324 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128034+0000", 2024-04-19T02:17:02.325 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9651000000000001e-05 2024-04-19T02:17:02.325 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:02.325 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:02.325 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:02.325 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.325 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.325 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78259 5.4 5:2aa344b2:::benchmark_data_smithi121_44835_object78258:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:02.325 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:17:02.325 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 35.145597381999998, 2024-04-19T02:17:02.325 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022934350999999999, 2024-04-19T02:17:02.325 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:02.325 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:02.325 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:02.325 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:02.326 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:02.326 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78259 2024-04-19T02:17:02.326 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.326 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:02.326 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.326 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:02.326 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:17:02.326 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:02.326 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.326 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.326 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:02.326 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:17:02.326 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:02.326 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.327 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.327 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:02.327 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125256+0000", 2024-04-19T02:17:02.327 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:02.327 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.327 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.327 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:02.327 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125347+0000", 2024-04-19T02:17:02.327 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0470000000000006e-05 2024-04-19T02:17:02.327 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.327 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.327 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:02.327 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125358+0000", 2024-04-19T02:17:02.327 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1764e-05 2024-04-19T02:17:02.327 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.328 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.328 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:02.328 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125364+0000", 2024-04-19T02:17:02.328 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7189999999999998e-06 2024-04-19T02:17:02.328 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.328 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.328 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:02.328 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125391+0000", 2024-04-19T02:17:02.328 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7270000000000001e-05 2024-04-19T02:17:02.328 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.328 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.328 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:02.328 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125471+0000", 2024-04-19T02:17:02.328 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9209999999999995e-05 2024-04-19T02:17:02.328 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.329 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.329 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:02.329 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125559+0000", 2024-04-19T02:17:02.329 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.8689000000000004e-05 2024-04-19T02:17:02.329 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.329 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.329 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:02.329 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128164+0000", 2024-04-19T02:17:02.329 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0026050270000000002 2024-04-19T02:17:02.329 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.329 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.329 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:02.329 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148139+0000", 2024-04-19T02:17:02.329 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.019975050000000001 2024-04-19T02:17:02.329 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.329 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.330 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:02.330 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148169+0000", 2024-04-19T02:17:02.330 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0001e-05 2024-04-19T02:17:02.330 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.330 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.330 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:02.330 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148191+0000", 2024-04-19T02:17:02.330 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.2104999999999999e-05 2024-04-19T02:17:02.330 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:02.330 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:02.330 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:02.330 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.330 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.330 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78271 5.4 5:2982d7a6:::benchmark_data_smithi121_44835_object78270:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:02.330 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:17:02.331 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 35.138734151999998, 2024-04-19T02:17:02.331 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020841755999999999, 2024-04-19T02:17:02.331 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:02.331 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:02.331 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:02.331 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:02.331 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:02.331 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78271 2024-04-19T02:17:02.331 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.331 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:02.331 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.331 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:02.331 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:17:02.331 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:02.332 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.332 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.332 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:02.332 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:17:02.332 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:02.332 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.332 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.332 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:02.332 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132119+0000", 2024-04-19T02:17:02.332 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:02.332 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.332 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.332 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:02.332 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132185+0000", 2024-04-19T02:17:02.332 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5994000000000005e-05 2024-04-19T02:17:02.333 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.333 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.333 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:02.333 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132197+0000", 2024-04-19T02:17:02.333 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2091e-05 2024-04-19T02:17:02.333 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.333 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.333 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:02.333 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132206+0000", 2024-04-19T02:17:02.333 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.5099999999999998e-06 2024-04-19T02:17:02.333 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.333 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.333 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:02.333 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132242+0000", 2024-04-19T02:17:02.334 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5663000000000001e-05 2024-04-19T02:17:02.334 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.334 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.334 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:02.334 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132335+0000", 2024-04-19T02:17:02.334 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3275000000000004e-05 2024-04-19T02:17:02.334 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.334 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.334 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:02.334 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132432+0000", 2024-04-19T02:17:02.334 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7571000000000005e-05 2024-04-19T02:17:02.334 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.334 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.334 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:02.334 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.136706+0000", 2024-04-19T02:17:02.335 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0042738170000000001 2024-04-19T02:17:02.335 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.335 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.335 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:02.335 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152909+0000", 2024-04-19T02:17:02.335 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016202415000000001 2024-04-19T02:17:02.335 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.335 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.335 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:02.335 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152938+0000", 2024-04-19T02:17:02.335 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9740999999999999e-05 2024-04-19T02:17:02.335 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.335 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.335 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:02.336 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152962+0000", 2024-04-19T02:17:02.336 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3659000000000002e-05 2024-04-19T02:17:02.336 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:02.336 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:02.336 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:02.336 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.336 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.336 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78272 5.4 5:273e819a:::benchmark_data_smithi121_44835_object78271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:02.336 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:02.336 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 35.138245109000003, 2024-04-19T02:17:02.336 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022180163999999999, 2024-04-19T02:17:02.336 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:02.336 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:02.336 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:02.336 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:02.337 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:02.337 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78272 2024-04-19T02:17:02.337 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.337 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:02.337 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.337 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:02.337 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:02.337 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:02.337 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.337 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.337 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:02.337 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:02.337 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:02.337 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.337 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.338 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:02.338 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:02.338 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:02.338 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.338 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.338 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:02.338 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132690+0000", 2024-04-19T02:17:02.338 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0963000000000004e-05 2024-04-19T02:17:02.338 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.338 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.338 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:02.338 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132703+0000", 2024-04-19T02:17:02.338 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.3072e-05 2024-04-19T02:17:02.338 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.339 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.339 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:02.339 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132710+0000", 2024-04-19T02:17:02.339 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3100000000000003e-06 2024-04-19T02:17:02.339 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.339 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.339 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:02.339 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134005+0000", 2024-04-19T02:17:02.339 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001294513 2024-04-19T02:17:02.339 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.339 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.339 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:02.339 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134139+0000", 2024-04-19T02:17:02.339 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000134447 2024-04-19T02:17:02.339 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.339 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.340 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:02.340 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134284+0000", 2024-04-19T02:17:02.340 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014514399999999999 2024-04-19T02:17:02.340 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.340 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.340 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:02.340 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.139622+0000", 2024-04-19T02:17:02.340 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0053373830000000002 2024-04-19T02:17:02.340 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.340 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.340 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:02.340 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154737+0000", 2024-04-19T02:17:02.340 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015115195999999999 2024-04-19T02:17:02.340 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.340 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.341 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:02.341 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154768+0000", 2024-04-19T02:17:02.341 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0824999999999997e-05 2024-04-19T02:17:02.341 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.341 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.341 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:02.341 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154790+0000", 2024-04-19T02:17:02.341 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1999000000000001e-05 2024-04-19T02:17:02.341 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:02.341 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:02.341 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:02.341 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.341 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.341 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:94475 5.e 5:7a360208:::benchmark_data_smithi121_44835_object94474:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:02.341 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:35.118023+0000", 2024-04-19T02:17:02.342 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 27.152831168999999, 2024-04-19T02:17:02.342 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020591993999999999, 2024-04-19T02:17:02.342 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:02.342 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:02.342 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:02.342 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:02.342 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:02.342 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 94475 2024-04-19T02:17:02.342 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.342 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:02.342 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.342 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:02.342 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118023+0000", 2024-04-19T02:17:02.342 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:02.342 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.343 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.343 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:02.343 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118023+0000", 2024-04-19T02:17:02.343 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:02.343 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.343 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.343 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:02.343 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118023+0000", 2024-04-19T02:17:02.343 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:02.343 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.343 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.343 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:02.343 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118041+0000", 2024-04-19T02:17:02.343 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.8689999999999999e-05 2024-04-19T02:17:02.343 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.343 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.344 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:02.344 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118049+0000", 2024-04-19T02:17:02.344 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.5939999999999996e-06 2024-04-19T02:17:02.344 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.344 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.344 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:02.344 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118053+0000", 2024-04-19T02:17:02.344 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2080000000000002e-06 2024-04-19T02:17:02.344 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.344 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.344 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:02.344 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118093+0000", 2024-04-19T02:17:02.344 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9634e-05 2024-04-19T02:17:02.344 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.344 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.345 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:02.345 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118191+0000", 2024-04-19T02:17:02.345 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.8272999999999999e-05 2024-04-19T02:17:02.345 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.345 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.345 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:02.345 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118280+0000", 2024-04-19T02:17:02.345 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.8702999999999994e-05 2024-04-19T02:17:02.345 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.345 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.345 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:02.345 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.124833+0000", 2024-04-19T02:17:02.345 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0065528180000000002 2024-04-19T02:17:02.345 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.345 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.346 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:02.346 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.138520+0000", 2024-04-19T02:17:02.346 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.013686959 2024-04-19T02:17:02.346 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.346 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.346 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:02.346 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.138577+0000", 2024-04-19T02:17:02.346 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7689000000000003e-05 2024-04-19T02:17:02.346 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.346 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.346 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:02.346 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.138615+0000", 2024-04-19T02:17:02.346 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8016999999999999e-05 2024-04-19T02:17:02.346 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:02.346 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:02.347 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:02.347 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.347 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.347 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:94481 5.e 5:7b2fbebf:::benchmark_data_smithi121_44835_object94480:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:02.347 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:17:02.347 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 27.149608791999999, 2024-04-19T02:17:02.347 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020897846000000001, 2024-04-19T02:17:02.347 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:02.347 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:02.347 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:02.347 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:02.347 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:02.347 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 94481 2024-04-19T02:17:02.347 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.347 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:02.348 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.348 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:02.348 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:17:02.348 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:02.348 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.348 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.348 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:02.348 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:17:02.348 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:02.348 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.348 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.348 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:02.348 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121245+0000", 2024-04-19T02:17:02.348 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:02.348 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.349 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.349 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:02.349 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121273+0000", 2024-04-19T02:17:02.349 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7250000000000002e-05 2024-04-19T02:17:02.349 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.349 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.349 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:02.349 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121277+0000", 2024-04-19T02:17:02.349 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2860000000000001e-06 2024-04-19T02:17:02.349 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.349 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.349 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:02.349 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121280+0000", 2024-04-19T02:17:02.349 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2739999999999999e-06 2024-04-19T02:17:02.350 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.350 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.350 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:02.350 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121320+0000", 2024-04-19T02:17:02.350 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9879000000000002e-05 2024-04-19T02:17:02.350 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.350 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.350 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:02.350 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121448+0000", 2024-04-19T02:17:02.350 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012748800000000001 2024-04-19T02:17:02.350 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.350 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.350 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:02.350 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121595+0000", 2024-04-19T02:17:02.351 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014741299999999999 2024-04-19T02:17:02.351 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.351 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.351 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:02.351 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.127776+0000", 2024-04-19T02:17:02.351 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0061811360000000003 2024-04-19T02:17:02.351 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.351 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.351 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:02.351 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142073+0000", 2024-04-19T02:17:02.351 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014296959999999999 2024-04-19T02:17:02.351 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.351 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.352 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:02.352 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142106+0000", 2024-04-19T02:17:02.352 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3348e-05 2024-04-19T02:17:02.352 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.352 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.352 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:02.352 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142144+0000", 2024-04-19T02:17:02.352 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7153000000000002e-05 2024-04-19T02:17:02.352 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:02.352 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:02.352 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:02.352 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.352 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.352 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:94581 5.b 5:dc86d6e9:::benchmark_data_smithi121_44835_object94580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:02.353 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:02.353 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 27.090674219, 2024-04-19T02:17:02.353 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022099711000000001, 2024-04-19T02:17:02.353 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:02.353 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:02.353 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:02.353 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:02.353 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:02.353 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 94581 2024-04-19T02:17:02.353 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.353 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:02.353 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.353 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:02.354 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:02.354 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:02.354 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.354 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.354 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:02.354 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:02.354 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:02.354 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.354 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.354 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:02.354 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:02.354 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:02.354 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.354 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.355 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:02.355 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180253+0000", 2024-04-19T02:17:02.355 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3163000000000004e-05 2024-04-19T02:17:02.355 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.355 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.355 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:02.355 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180266+0000", 2024-04-19T02:17:02.355 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2886e-05 2024-04-19T02:17:02.355 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.355 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.355 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:02.355 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180273+0000", 2024-04-19T02:17:02.355 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.4059999999999999e-06 2024-04-19T02:17:02.355 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.356 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.356 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:02.356 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180646+0000", 2024-04-19T02:17:02.356 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00037283999999999999 2024-04-19T02:17:02.356 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.356 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.356 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:02.356 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180774+0000", 2024-04-19T02:17:02.356 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012793799999999999 2024-04-19T02:17:02.356 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.356 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.356 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:02.356 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180920+0000", 2024-04-19T02:17:02.356 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000146692 2024-04-19T02:17:02.356 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.357 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.357 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:02.357 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.183344+0000", 2024-04-19T02:17:02.357 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0024231669999999999 2024-04-19T02:17:02.357 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.357 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.357 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:02.357 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202196+0000", 2024-04-19T02:17:02.357 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.018852384 2024-04-19T02:17:02.357 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.357 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.357 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:02.357 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202241+0000", 2024-04-19T02:17:02.357 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4923999999999999e-05 2024-04-19T02:17:02.358 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.358 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.358 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:02.358 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202280+0000", 2024-04-19T02:17:02.358 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9096e-05 2024-04-19T02:17:02.358 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:02.358 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:02.358 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:02.358 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.358 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.358 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:96356 5.0 5:0a661b39:::benchmark_data_smithi121_44835_object96355:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:02.358 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:17:02.358 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 26.177461377, 2024-04-19T02:17:02.358 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020955516, 2024-04-19T02:17:02.359 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:02.359 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:02.359 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:02.359 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:02.359 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:02.359 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 96356 2024-04-19T02:17:02.359 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.359 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:02.359 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.359 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:02.359 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:17:02.359 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:02.359 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.359 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.360 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:02.360 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:17:02.360 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:02.360 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.360 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.360 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:02.360 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:17:02.360 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:02.360 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.360 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.360 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:02.360 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093455+0000", 2024-04-19T02:17:02.360 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.2205000000000005e-05 2024-04-19T02:17:02.360 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.360 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.361 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:02.361 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093464+0000", 2024-04-19T02:17:02.361 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3910000000000004e-06 2024-04-19T02:17:02.361 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.361 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.361 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:02.361 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093469+0000", 2024-04-19T02:17:02.361 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.7249999999999997e-06 2024-04-19T02:17:02.361 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.361 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.361 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:02.361 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099643+0000", 2024-04-19T02:17:02.361 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0061743359999999999 2024-04-19T02:17:02.361 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.361 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.362 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:02.362 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099774+0000", 2024-04-19T02:17:02.362 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013050599999999999 2024-04-19T02:17:02.362 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.362 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.362 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:02.362 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099917+0000", 2024-04-19T02:17:02.362 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000143187 2024-04-19T02:17:02.362 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.362 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.362 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:02.362 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.105432+0000", 2024-04-19T02:17:02.362 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.005514873 2024-04-19T02:17:02.362 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.363 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.363 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:02.363 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114264+0000", 2024-04-19T02:17:02.363 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.008831752 2024-04-19T02:17:02.363 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.363 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.363 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:02.363 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114300+0000", 2024-04-19T02:17:02.363 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6582000000000003e-05 2024-04-19T02:17:02.363 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.363 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.363 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:02.363 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114349+0000", 2024-04-19T02:17:02.363 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8579999999999999e-05 2024-04-19T02:17:02.364 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:02.364 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:02.364 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:02.364 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.364 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.364 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:96357 5.0 5:00efce8b:::benchmark_data_smithi121_44835_object96356:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:02.364 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:17:02.364 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 26.177381699000001, 2024-04-19T02:17:02.364 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020937471999999999, 2024-04-19T02:17:02.364 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:02.364 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:02.364 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:02.364 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:02.364 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:02.365 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 96357 2024-04-19T02:17:02.365 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.365 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:02.365 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.365 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:02.365 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:17:02.365 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:02.365 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.365 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.365 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:02.365 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:17:02.365 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:02.365 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.365 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.366 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:02.366 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093472+0000", 2024-04-19T02:17:02.366 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:02.366 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.366 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.366 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:02.366 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093513+0000", 2024-04-19T02:17:02.366 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0213000000000003e-05 2024-04-19T02:17:02.366 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.366 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.366 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:02.366 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093519+0000", 2024-04-19T02:17:02.366 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.066e-06 2024-04-19T02:17:02.366 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.367 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.367 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:02.367 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093525+0000", 2024-04-19T02:17:02.367 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.8170000000000004e-06 2024-04-19T02:17:02.367 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.367 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.367 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:02.367 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103412+0000", 2024-04-19T02:17:02.367 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0098872739999999997 2024-04-19T02:17:02.367 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.367 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.367 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:02.367 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103551+0000", 2024-04-19T02:17:02.367 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000139295 2024-04-19T02:17:02.368 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.368 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.368 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:02.368 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103701+0000", 2024-04-19T02:17:02.368 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014954599999999999 2024-04-19T02:17:02.368 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.368 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.368 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:02.368 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.108849+0000", 2024-04-19T02:17:02.368 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0051487199999999999 2024-04-19T02:17:02.368 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.368 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.368 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:02.368 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114355+0000", 2024-04-19T02:17:02.368 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0055052529999999999 2024-04-19T02:17:02.369 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.369 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.369 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:02.369 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114379+0000", 2024-04-19T02:17:02.369 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4275000000000001e-05 2024-04-19T02:17:02.369 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.369 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.369 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:02.369 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114410+0000", 2024-04-19T02:17:02.369 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1356999999999998e-05 2024-04-19T02:17:02.369 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:02.369 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:02.369 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:02.369 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.370 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.370 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:104431 5.8 5:14818e19:::benchmark_data_smithi121_44835_object104430:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T02:17:02.370 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:17:02.370 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 22.059469174, 2024-04-19T02:17:02.370 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022149528000000002, 2024-04-19T02:17:02.370 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:02.370 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:02.370 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:02.370 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:02.370 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:02.370 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 104431 2024-04-19T02:17:02.370 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.370 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:02.370 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.371 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:02.371 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:17:02.371 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:02.371 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.371 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.371 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:02.371 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:17:02.371 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:02.371 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.371 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.371 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:02.371 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211384+0000", 2024-04-19T02:17:02.371 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:02.371 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.371 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.371 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:02.372 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211458+0000", 2024-04-19T02:17:02.372 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3311000000000003e-05 2024-04-19T02:17:02.372 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.372 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.372 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:02.372 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211471+0000", 2024-04-19T02:17:02.372 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.3308e-05 2024-04-19T02:17:02.372 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.372 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.372 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:02.372 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211479+0000", 2024-04-19T02:17:02.372 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0909999999999993e-06 2024-04-19T02:17:02.372 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.372 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.373 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:02.373 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.221821+0000", 2024-04-19T02:17:02.373 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010341596999999999 2024-04-19T02:17:02.373 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.373 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.373 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:02.373 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.221966+0000", 2024-04-19T02:17:02.373 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000145167 2024-04-19T02:17:02.373 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.373 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.373 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:02.373 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.222077+0000", 2024-04-19T02:17:02.373 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011128000000000001 2024-04-19T02:17:02.373 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.373 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.373 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:02.373 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.228126+0000", 2024-04-19T02:17:02.374 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0060486710000000003 2024-04-19T02:17:02.374 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.374 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.374 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:02.374 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233449+0000", 2024-04-19T02:17:02.374 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0053231370000000004 2024-04-19T02:17:02.374 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.374 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.374 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:02.374 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233498+0000", 2024-04-19T02:17:02.374 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8798999999999998e-05 2024-04-19T02:17:02.374 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.374 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.374 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:02.374 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233535+0000", 2024-04-19T02:17:02.375 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7119000000000002e-05 2024-04-19T02:17:02.375 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:02.375 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:02.375 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:02.375 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.375 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.375 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:114200 5.8 5:1428c006:::benchmark_data_smithi121_44835_object114199:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T02:17:02.375 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:45.082288+0000", 2024-04-19T02:17:02.375 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 17.188566588, 2024-04-19T02:17:02.375 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020551719999999999, 2024-04-19T02:17:02.375 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:02.375 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:02.375 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:02.375 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:02.375 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:02.376 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 114200 2024-04-19T02:17:02.376 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.376 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:02.376 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.376 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:02.376 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.082288+0000", 2024-04-19T02:17:02.376 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:02.376 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.376 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.376 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:02.376 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.082288+0000", 2024-04-19T02:17:02.376 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:02.376 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.376 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.376 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:02.376 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.082287+0000", 2024-04-19T02:17:02.377 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:02.377 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.377 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.377 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:02.377 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.082345+0000", 2024-04-19T02:17:02.377 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7642999999999997e-05 2024-04-19T02:17:02.377 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.377 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.377 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:02.377 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.082351+0000", 2024-04-19T02:17:02.377 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.2999999999999998e-06 2024-04-19T02:17:02.377 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.377 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.377 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:02.378 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.082355+0000", 2024-04-19T02:17:02.378 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7890000000000001e-06 2024-04-19T02:17:02.378 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.378 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.378 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:02.378 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.085813+0000", 2024-04-19T02:17:02.378 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.003457636 2024-04-19T02:17:02.378 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.378 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.378 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:02.378 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.085918+0000", 2024-04-19T02:17:02.378 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010485299999999999 2024-04-19T02:17:02.378 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.378 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.379 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:02.379 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.086071+0000", 2024-04-19T02:17:02.379 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00015367199999999999 2024-04-19T02:17:02.379 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.379 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.379 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:02.379 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.092128+0000", 2024-04-19T02:17:02.379 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0060571080000000003 2024-04-19T02:17:02.379 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.379 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.379 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:02.379 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.102784+0000", 2024-04-19T02:17:02.379 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010656116 2024-04-19T02:17:02.380 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.380 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.380 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:02.380 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.102818+0000", 2024-04-19T02:17:02.380 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3661999999999997e-05 2024-04-19T02:17:02.380 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.380 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.380 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:02.380 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.102840+0000", 2024-04-19T02:17:02.380 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1509e-05 2024-04-19T02:17:02.380 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:02.380 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:02.380 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:02.380 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.381 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.381 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:121827 5.e 5:73ab8f20:::benchmark_data_smithi121_44835_object121826:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T02:17:02.381 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:48.926285+0000", 2024-04-19T02:17:02.381 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 13.344569229999999, 2024-04-19T02:17:02.381 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020626592999999999, 2024-04-19T02:17:02.381 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:02.381 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:02.381 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:02.381 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:02.381 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:02.381 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 121827 2024-04-19T02:17:02.381 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.381 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:02.381 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.381 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:02.382 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.926285+0000", 2024-04-19T02:17:02.382 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:02.382 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.382 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.382 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:02.382 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.926285+0000", 2024-04-19T02:17:02.382 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:02.382 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.382 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.382 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:02.382 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.926285+0000", 2024-04-19T02:17:02.382 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:02.382 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.382 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.382 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:02.383 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.926306+0000", 2024-04-19T02:17:02.383 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.0659e-05 2024-04-19T02:17:02.383 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.383 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.383 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:02.383 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.926310+0000", 2024-04-19T02:17:02.383 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.374e-06 2024-04-19T02:17:02.383 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.383 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.383 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:02.383 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.926313+0000", 2024-04-19T02:17:02.383 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1879999999999998e-06 2024-04-19T02:17:02.383 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.383 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.383 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:02.384 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.930441+0000", 2024-04-19T02:17:02.384 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0041274220000000004 2024-04-19T02:17:02.384 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.384 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.384 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:02.384 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.930534+0000", 2024-04-19T02:17:02.384 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3834999999999999e-05 2024-04-19T02:17:02.384 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.384 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.384 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:02.384 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.930644+0000", 2024-04-19T02:17:02.384 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000110109 2024-04-19T02:17:02.384 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.384 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.385 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:02.385 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.933925+0000", 2024-04-19T02:17:02.385 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0032810349999999999 2024-04-19T02:17:02.385 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.385 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.385 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:02.385 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.946847+0000", 2024-04-19T02:17:02.385 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.012921807 2024-04-19T02:17:02.385 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.385 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.385 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:02.385 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.946875+0000", 2024-04-19T02:17:02.385 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7977e-05 2024-04-19T02:17:02.385 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:02.385 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:02.386 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:02.386 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.946912+0000", 2024-04-19T02:17:02.386 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6604999999999999e-05 2024-04-19T02:17:02.386 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:02.386 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:02.386 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:02.386 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:02.386 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:02.386 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:17:02.388 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:17:02.388 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:02.388+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:02.488 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:02.489+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:02.576 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-04-19T02:17:02.576 INFO:teuthology.orchestra.run.smithi177.stdout: "ops": [ 2024-04-19T02:17:02.576 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.576 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:149466 5.5 5:a7a7664d:::benchmark_data_smithi121_44835_object15431:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T02:17:02.576 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:17:02.569396+0000", 2024-04-19T02:17:02.576 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0062716780000000001, 2024-04-19T02:17:02.577 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.006297357, 2024-04-19T02:17:02.577 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:17:02.577 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:02.577 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:17:02.577 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:17:02.577 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:02.577 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 149466 2024-04-19T02:17:02.578 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.578 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:17:02.578 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.578 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:17:02.578 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.569396+0000", 2024-04-19T02:17:02.578 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:02.578 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.579 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.579 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:17:02.579 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.569396+0000", 2024-04-19T02:17:02.579 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:02.579 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.579 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.580 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:17:02.580 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.569395+0000", 2024-04-19T02:17:02.580 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:17:02.580 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.580 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.580 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:17:02.580 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.569399+0000", 2024-04-19T02:17:02.581 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.2819999999999998e-06 2024-04-19T02:17:02.581 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.581 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.581 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:17:02.581 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.569410+0000", 2024-04-19T02:17:02.581 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0587e-05 2024-04-19T02:17:02.582 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.582 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.582 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:17:02.582 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.569418+0000", 2024-04-19T02:17:02.582 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.8809999999999996e-06 2024-04-19T02:17:02.582 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.582 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.582 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:17:02.582 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.569444+0000", 2024-04-19T02:17:02.582 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.6071000000000002e-05 2024-04-19T02:17:02.583 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.583 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.583 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:17:02.583 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.569561+0000", 2024-04-19T02:17:02.583 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00011766599999999999 2024-04-19T02:17:02.583 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.583 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.584 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:02.584 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.569669+0000", 2024-04-19T02:17:02.584 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000108216 2024-04-19T02:17:02.584 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.584 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.584 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:17:02.584 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.573818+0000", 2024-04-19T02:17:02.584 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0041488009999999997 2024-04-19T02:17:02.584 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:02.584 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:17:02.585 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:02.585 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.585 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.585 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:149471 5.3 5:c456ac14:::benchmark_data_smithi121_44835_object15436:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T02:17:02.585 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:17:02.569464+0000", 2024-04-19T02:17:02.585 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0062033599999999998, 2024-04-19T02:17:02.585 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0063191870000000004, 2024-04-19T02:17:02.585 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:17:02.585 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:02.585 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:17:02.585 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:17:02.585 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:02.586 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 149471 2024-04-19T02:17:02.586 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.586 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:17:02.586 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.586 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:17:02.586 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.569464+0000", 2024-04-19T02:17:02.586 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:02.586 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.586 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.586 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:17:02.586 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.569464+0000", 2024-04-19T02:17:02.586 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:02.586 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.587 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.587 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:17:02.587 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.569464+0000", 2024-04-19T02:17:02.587 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:02.587 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.587 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.587 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:17:02.587 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.569466+0000", 2024-04-19T02:17:02.587 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.0849999999999999e-06 2024-04-19T02:17:02.587 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.587 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.588 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:17:02.588 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.569472+0000", 2024-04-19T02:17:02.588 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.2160000000000003e-06 2024-04-19T02:17:02.588 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.588 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.588 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:17:02.588 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.569477+0000", 2024-04-19T02:17:02.588 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.0839999999999999e-06 2024-04-19T02:17:02.588 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.588 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.588 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:17:02.588 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.571640+0000", 2024-04-19T02:17:02.588 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00216314 2024-04-19T02:17:02.588 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.588 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.588 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:17:02.589 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.571777+0000", 2024-04-19T02:17:02.589 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00013728300000000001 2024-04-19T02:17:02.589 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.589 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.589 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:02.589 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.571894+0000", 2024-04-19T02:17:02.589 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000116512 2024-04-19T02:17:02.589 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:02.589 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:17:02.589 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:02.589 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.589 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.589 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:149474 5.1 5:8c93350f:::benchmark_data_smithi121_44835_object15439:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T02:17:02.589 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:17:02.570863+0000", 2024-04-19T02:17:02.590 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0048039049999999998, 2024-04-19T02:17:02.590 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0049993310000000001, 2024-04-19T02:17:02.590 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:17:02.590 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:02.590 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:17:02.590 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:17:02.590 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:02.590 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 149474 2024-04-19T02:17:02.590 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.590 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:17:02.590 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.590 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:17:02.590 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.570863+0000", 2024-04-19T02:17:02.591 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:02.591 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.591 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.591 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:17:02.591 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.570863+0000", 2024-04-19T02:17:02.591 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:02.591 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.591 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.591 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:17:02.591 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.570863+0000", 2024-04-19T02:17:02.591 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:02.591 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.591 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.591 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:17:02.591 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.570866+0000", 2024-04-19T02:17:02.592 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.4020000000000002e-06 2024-04-19T02:17:02.592 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.592 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.592 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:17:02.592 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.570872+0000", 2024-04-19T02:17:02.592 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.806e-06 2024-04-19T02:17:02.592 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.592 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.592 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:17:02.592 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.570876+0000", 2024-04-19T02:17:02.592 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.7440000000000001e-06 2024-04-19T02:17:02.592 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.592 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.592 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:17:02.592 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.570912+0000", 2024-04-19T02:17:02.593 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6260000000000002e-05 2024-04-19T02:17:02.593 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.593 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.593 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:17:02.593 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.570999+0000", 2024-04-19T02:17:02.593 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.6975e-05 2024-04-19T02:17:02.593 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.594 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.594 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:17:02.594 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.571073+0000", 2024-04-19T02:17:02.594 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.3629999999999998e-05 2024-04-19T02:17:02.594 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.594 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.594 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:02.594 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.574166+0000", 2024-04-19T02:17:02.594 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0030933340000000001 2024-04-19T02:17:02.595 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:02.595 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:17:02.595 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:02.595 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.595 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.595 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:149475 5.6 5:6be6895c:::benchmark_data_smithi121_44835_object15440:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T02:17:02.595 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:17:02.570884+0000", 2024-04-19T02:17:02.595 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0047834280000000002, 2024-04-19T02:17:02.595 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0050932659999999999, 2024-04-19T02:17:02.595 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:17:02.595 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:02.595 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:17:02.595 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:17:02.595 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:02.595 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 149475 2024-04-19T02:17:02.596 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.596 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:17:02.596 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.596 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:17:02.596 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.570884+0000", 2024-04-19T02:17:02.596 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:02.596 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.596 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.596 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:17:02.596 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.570884+0000", 2024-04-19T02:17:02.596 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:02.596 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.596 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.596 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:17:02.596 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.570884+0000", 2024-04-19T02:17:02.597 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:02.597 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.597 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.597 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:17:02.597 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.570886+0000", 2024-04-19T02:17:02.597 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.1710000000000001e-06 2024-04-19T02:17:02.597 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.597 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.597 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:17:02.597 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.570891+0000", 2024-04-19T02:17:02.598 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.5799999999999999e-06 2024-04-19T02:17:02.598 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.598 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.598 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:17:02.598 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.570897+0000", 2024-04-19T02:17:02.598 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.6069999999999998e-06 2024-04-19T02:17:02.598 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.598 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.598 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:17:02.598 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.571921+0000", 2024-04-19T02:17:02.598 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0010241370000000001 2024-04-19T02:17:02.598 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.598 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.599 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:17:02.599 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.572026+0000", 2024-04-19T02:17:02.599 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00010516199999999999 2024-04-19T02:17:02.599 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.599 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.599 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:02.599 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.572129+0000", 2024-04-19T02:17:02.599 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000103068 2024-04-19T02:17:02.599 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:02.599 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:17:02.599 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:02.599 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.599 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.599 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:149476 5.6 5:628640ec:::benchmark_data_smithi121_44835_object15441:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T02:17:02.599 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:17:02.571345+0000", 2024-04-19T02:17:02.600 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0043223080000000004, 2024-04-19T02:17:02.600 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0047163379999999996, 2024-04-19T02:17:02.600 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:17:02.600 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:02.600 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:17:02.600 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:17:02.600 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:02.600 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 149476 2024-04-19T02:17:02.600 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.600 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:17:02.600 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.600 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:17:02.600 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.571345+0000", 2024-04-19T02:17:02.601 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:02.601 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.601 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.601 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:17:02.601 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.571345+0000", 2024-04-19T02:17:02.601 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:02.601 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.601 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.601 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:17:02.601 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.571344+0000", 2024-04-19T02:17:02.601 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:17:02.601 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.601 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.601 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:17:02.602 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.571348+0000", 2024-04-19T02:17:02.602 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.177e-06 2024-04-19T02:17:02.602 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.602 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.602 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:17:02.602 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.571359+0000", 2024-04-19T02:17:02.602 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0657e-05 2024-04-19T02:17:02.602 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.602 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.602 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:17:02.602 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.571366+0000", 2024-04-19T02:17:02.602 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.9550000000000003e-06 2024-04-19T02:17:02.603 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.603 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.603 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:17:02.603 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.573711+0000", 2024-04-19T02:17:02.603 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0023451940000000001 2024-04-19T02:17:02.603 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.603 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.603 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:17:02.604 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.573841+0000", 2024-04-19T02:17:02.604 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012984800000000001 2024-04-19T02:17:02.604 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.604 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.604 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:02.604 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.573963+0000", 2024-04-19T02:17:02.605 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012242000000000001 2024-04-19T02:17:02.605 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:02.605 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:17:02.605 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:02.605 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.605 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.606 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:149482 5.1 5:80c5ba6d:::benchmark_data_smithi121_44835_object15447:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T02:17:02.606 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:17:02.574309+0000", 2024-04-19T02:17:02.606 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0013578259999999999, 2024-04-19T02:17:02.606 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0018322119999999999, 2024-04-19T02:17:02.606 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:17:02.606 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:02.607 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:17:02.607 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:17:02.607 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:02.607 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 149482 2024-04-19T02:17:02.607 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.607 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:17:02.608 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.608 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:17:02.608 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.574309+0000", 2024-04-19T02:17:02.608 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:02.608 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.608 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.608 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:17:02.608 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.574309+0000", 2024-04-19T02:17:02.608 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:02.609 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.609 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.609 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:17:02.609 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.574309+0000", 2024-04-19T02:17:02.609 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:17:02.609 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.609 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.609 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:17:02.609 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.574313+0000", 2024-04-19T02:17:02.609 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.9700000000000001e-06 2024-04-19T02:17:02.609 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.609 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.610 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:17:02.610 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.574322+0000", 2024-04-19T02:17:02.610 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.9019999999999994e-06 2024-04-19T02:17:02.610 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.610 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.610 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:17:02.610 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.574330+0000", 2024-04-19T02:17:02.610 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.2250000000000003e-06 2024-04-19T02:17:02.610 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.611 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.611 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:17:02.611 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.574355+0000", 2024-04-19T02:17:02.611 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.5089999999999999e-05 2024-04-19T02:17:02.611 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.611 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.611 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:17:02.611 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.574443+0000", 2024-04-19T02:17:02.611 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.8472000000000003e-05 2024-04-19T02:17:02.611 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.611 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.611 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:17:02.612 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.574522+0000", 2024-04-19T02:17:02.612 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.9184999999999995e-05 2024-04-19T02:17:02.612 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:02.612 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:17:02.612 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:02.612 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.612 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.612 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:149483 5.1 5:83fabab2:::benchmark_data_smithi121_44835_object15448:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T02:17:02.612 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:17:02.574341+0000", 2024-04-19T02:17:02.612 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.001326425, 2024-04-19T02:17:02.612 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.001879295, 2024-04-19T02:17:02.612 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:17:02.612 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "reached pg", 2024-04-19T02:17:02.612 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:17:02.613 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:17:02.613 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:02.613 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 149483 2024-04-19T02:17:02.613 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.613 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:17:02.613 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.613 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:17:02.613 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.574341+0000", 2024-04-19T02:17:02.613 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:02.613 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.613 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.613 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:17:02.613 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.574341+0000", 2024-04-19T02:17:02.614 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:02.614 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.614 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.614 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:17:02.614 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.574340+0000", 2024-04-19T02:17:02.614 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:02.614 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.614 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.614 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:17:02.614 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.574343+0000", 2024-04-19T02:17:02.614 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.4049999999999998e-06 2024-04-19T02:17:02.615 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.615 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.615 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:17:02.615 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.574349+0000", 2024-04-19T02:17:02.615 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.0109999999999997e-06 2024-04-19T02:17:02.615 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.615 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.615 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:17:02.615 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.574355+0000", 2024-04-19T02:17:02.615 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.6550000000000001e-06 2024-04-19T02:17:02.615 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.615 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.615 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:17:02.615 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.576140+0000", 2024-04-19T02:17:02.616 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0017856689999999999 2024-04-19T02:17:02.616 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:02.616 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:17:02.616 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:02.616 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.616 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.616 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:149480 5.7 e46/16 5:ed1dbae6:::benchmark_data_smithi121_44835_object15445:head v 46'9301, mlcod=46'9299)", 2024-04-19T02:17:02.616 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:17:02.574518+0000", 2024-04-19T02:17:02.616 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.0011495520000000001, 2024-04-19T02:17:02.616 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.001768843, 2024-04-19T02:17:02.616 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:17:02.616 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:17:02.616 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:17:02.616 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.616 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:17:02.616 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.574518+0000", 2024-04-19T02:17:02.617 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:02.617 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.617 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.617 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:17:02.617 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.574518+0000", 2024-04-19T02:17:02.617 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:02.617 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.617 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.617 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:17:02.617 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.574517+0000", 2024-04-19T02:17:02.617 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:02.617 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.617 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.617 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:17:02.617 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.574522+0000", 2024-04-19T02:17:02.618 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.9869999999999999e-06 2024-04-19T02:17:02.618 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.618 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.618 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:17:02.618 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.574529+0000", 2024-04-19T02:17:02.618 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.2269999999999996e-06 2024-04-19T02:17:02.618 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.618 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.618 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:17:02.618 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.574535+0000", 2024-04-19T02:17:02.618 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.1819999999999997e-06 2024-04-19T02:17:02.618 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.618 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.618 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:17:02.619 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.574571+0000", 2024-04-19T02:17:02.619 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6455999999999998e-05 2024-04-19T02:17:02.619 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.619 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.619 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:17:02.619 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.574591+0000", 2024-04-19T02:17:02.619 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.9743000000000001e-05 2024-04-19T02:17:02.619 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:02.619 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:17:02.619 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:02.619 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.619 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.619 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:149479 5.e e46/16 5:71e4eec6:::benchmark_data_smithi121_44835_object15444:head v 46'9147, mlcod=46'9145)", 2024-04-19T02:17:02.619 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:17:02.574536+0000", 2024-04-19T02:17:02.620 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 0.001131433, 2024-04-19T02:17:02.620 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0018138430000000001, 2024-04-19T02:17:02.620 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:17:02.620 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:17:02.620 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:17:02.620 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.620 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:17:02.620 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.574536+0000", 2024-04-19T02:17:02.620 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:02.620 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.620 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.620 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:17:02.620 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.574536+0000", 2024-04-19T02:17:02.620 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:02.620 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.621 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.621 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:17:02.621 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.574535+0000", 2024-04-19T02:17:02.621 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:02.621 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.621 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.621 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:17:02.621 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.574541+0000", 2024-04-19T02:17:02.621 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.8980000000000001e-06 2024-04-19T02:17:02.621 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.621 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.621 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:17:02.621 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.574552+0000", 2024-04-19T02:17:02.621 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0805000000000001e-05 2024-04-19T02:17:02.621 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.622 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.622 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:17:02.622 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.574559+0000", 2024-04-19T02:17:02.622 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.6619999999999999e-06 2024-04-19T02:17:02.622 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.622 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.622 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:17:02.622 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.574591+0000", 2024-04-19T02:17:02.622 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.2500999999999999e-05 2024-04-19T02:17:02.622 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.622 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.622 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:17:02.622 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.574609+0000", 2024-04-19T02:17:02.622 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.7640999999999999e-05 2024-04-19T02:17:02.623 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:02.623 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:17:02.623 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:02.623 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.623 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.623 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:149485 5.2 e46/16 5:400490e1:::benchmark_data_smithi121_44835_object15450:head v 46'9435, mlcod=46'9432)", 2024-04-19T02:17:02.623 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:17:02.575984+0000", 2024-04-19T02:17:02.623 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4294967295.9996839, 2024-04-19T02:17:02.623 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00045651699999999998, 2024-04-19T02:17:02.623 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:17:02.623 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:17:02.623 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:17:02.623 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.623 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:17:02.623 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.575984+0000", 2024-04-19T02:17:02.624 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:02.624 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.624 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.624 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:17:02.624 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.575984+0000", 2024-04-19T02:17:02.624 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:02.624 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.624 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.624 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:17:02.624 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.575983+0000", 2024-04-19T02:17:02.624 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:02.624 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.624 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.624 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:17:02.624 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.575989+0000", 2024-04-19T02:17:02.625 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.5459999999999999e-06 2024-04-19T02:17:02.625 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.625 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.625 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:17:02.625 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.576002+0000", 2024-04-19T02:17:02.625 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.3305000000000001e-05 2024-04-19T02:17:02.625 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.625 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.625 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:17:02.625 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.576008+0000", 2024-04-19T02:17:02.625 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.4500000000000001e-06 2024-04-19T02:17:02.625 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.625 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.625 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:17:02.625 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.576214+0000", 2024-04-19T02:17:02.626 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00020604600000000001 2024-04-19T02:17:02.626 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.626 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.626 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:17:02.626 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.576231+0000", 2024-04-19T02:17:02.626 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.6498999999999999e-05 2024-04-19T02:17:02.626 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:02.626 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:17:02.626 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:02.626 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.626 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.626 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:149484 5.7 e46/16 5:e5661f4f:::benchmark_data_smithi121_44835_object15449:head v 46'9302, mlcod=46'9299)", 2024-04-19T02:17:02.626 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:17:02.576205+0000", 2024-04-19T02:17:02.626 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 4294967295.9994626, 2024-04-19T02:17:02.627 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00027493400000000001, 2024-04-19T02:17:02.627 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:17:02.627 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "started", 2024-04-19T02:17:02.627 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:17:02.627 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.627 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:17:02.627 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.576205+0000", 2024-04-19T02:17:02.627 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:02.627 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.627 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.627 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:17:02.627 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.576205+0000", 2024-04-19T02:17:02.627 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:02.627 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.627 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.628 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:17:02.628 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.576204+0000", 2024-04-19T02:17:02.628 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:02.628 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.628 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.628 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:17:02.628 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.576209+0000", 2024-04-19T02:17:02.628 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.6040000000000003e-06 2024-04-19T02:17:02.628 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.628 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.628 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:17:02.628 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.576217+0000", 2024-04-19T02:17:02.628 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.8140000000000007e-06 2024-04-19T02:17:02.628 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.628 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.629 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:17:02.629 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.576224+0000", 2024-04-19T02:17:02.629 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.6800000000000004e-06 2024-04-19T02:17:02.629 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.629 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.629 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:17:02.629 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.576265+0000", 2024-04-19T02:17:02.629 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.0862999999999998e-05 2024-04-19T02:17:02.629 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:02.629 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:02.629 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:17:02.629 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:17:02.576284+0000", 2024-04-19T02:17:02.629 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.8984999999999999e-05 2024-04-19T02:17:02.629 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:02.629 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:17:02.630 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:02.630 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:02.630 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2024-04-19T02:17:02.630 INFO:teuthology.orchestra.run.smithi177.stdout: "num_ops": 11 2024-04-19T02:17:02.630 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-04-19T02:17:02.631 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:02.632+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:02.632 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T02:17:02.733 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:02.733+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:02.815 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-04-19T02:17:02.815 INFO:teuthology.orchestra.run.smithi177.stdout: "ops": [], 2024-04-19T02:17:02.815 INFO:teuthology.orchestra.run.smithi177.stdout: "complaint_time": 30, 2024-04-19T02:17:02.816 INFO:teuthology.orchestra.run.smithi177.stdout: "num_blocked_ops": 0 2024-04-19T02:17:02.816 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-04-19T02:17:02.827 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T02:17:02.873 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:17:02.872+0000 7f1d2d960700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41506) UID: 0 2024-04-19T02:17:02.902 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:17:02.934 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:02.935+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:03.006 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-04-19T02:17:03.006 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 20, 2024-04-19T02:17:03.006 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 600, 2024-04-19T02:17:03.006 INFO:teuthology.orchestra.run.smithi177.stdout: "ops": [ 2024-04-19T02:17:03.006 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.006 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:61815 5.c 5:3ca8a794:::benchmark_data_smithi121_44835_object61814:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T02:17:03.007 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:17.482110+0000", 2024-04-19T02:17:03.007 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 45.522509352999997, 2024-04-19T02:17:03.007 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.021577559999999999, 2024-04-19T02:17:03.007 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:17:03.007 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:03.007 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:17:03.007 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:17:03.007 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:03.007 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 61815 2024-04-19T02:17:03.007 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.007 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:17:03.007 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.007 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:17:03.008 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482110+0000", 2024-04-19T02:17:03.008 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:03.008 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.008 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.008 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:17:03.008 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482110+0000", 2024-04-19T02:17:03.008 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:03.008 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.008 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.008 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:17:03.008 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482109+0000", 2024-04-19T02:17:03.008 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:03.008 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.009 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.009 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:17:03.009 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482197+0000", 2024-04-19T02:17:03.009 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.7405999999999996e-05 2024-04-19T02:17:03.009 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.009 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.009 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:17:03.009 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482206+0000", 2024-04-19T02:17:03.009 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.0010000000000007e-06 2024-04-19T02:17:03.009 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.009 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.009 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:17:03.009 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.482211+0000", 2024-04-19T02:17:03.009 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.4569999999999996e-06 2024-04-19T02:17:03.009 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.010 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.010 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:17:03.010 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.489465+0000", 2024-04-19T02:17:03.010 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.007253776 2024-04-19T02:17:03.010 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.010 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.010 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:17:03.010 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.489582+0000", 2024-04-19T02:17:03.010 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00011669500000000001 2024-04-19T02:17:03.010 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.010 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.010 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:03.010 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.489684+0000", 2024-04-19T02:17:03.010 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000102533 2024-04-19T02:17:03.011 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.011 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.011 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:03.011 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.491836+0000", 2024-04-19T02:17:03.011 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0021516759999999999 2024-04-19T02:17:03.011 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.011 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.011 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:17:03.011 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503615+0000", 2024-04-19T02:17:03.011 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.011778906 2024-04-19T02:17:03.011 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.011 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.011 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:17:03.011 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503652+0000", 2024-04-19T02:17:03.011 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6622999999999998e-05 2024-04-19T02:17:03.012 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.012 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.012 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:17:03.012 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:17.503688+0000", 2024-04-19T02:17:03.012 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6127000000000002e-05 2024-04-19T02:17:03.012 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:03.012 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:17:03.012 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:03.012 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.012 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.012 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:78247 5.c 5:3efb1468:::benchmark_data_smithi121_44835_object78246:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:03.012 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.116347+0000", 2024-04-19T02:17:03.012 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 35.888272297999997, 2024-04-19T02:17:03.012 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.032194436999999999, 2024-04-19T02:17:03.012 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:17:03.013 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:03.013 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:17:03.013 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:17:03.013 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:03.013 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 78247 2024-04-19T02:17:03.013 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.013 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:17:03.013 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.013 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:17:03.013 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116347+0000", 2024-04-19T02:17:03.013 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:03.013 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.013 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.013 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:17:03.014 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116347+0000", 2024-04-19T02:17:03.014 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:03.014 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.014 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.014 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:17:03.014 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116346+0000", 2024-04-19T02:17:03.014 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:17:03.014 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.014 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.014 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:17:03.014 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116370+0000", 2024-04-19T02:17:03.014 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.3892000000000001e-05 2024-04-19T02:17:03.015 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.015 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.015 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:17:03.015 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116385+0000", 2024-04-19T02:17:03.015 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.5162e-05 2024-04-19T02:17:03.015 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.015 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.015 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:17:03.015 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116394+0000", 2024-04-19T02:17:03.015 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.8000000000000004e-06 2024-04-19T02:17:03.015 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.015 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.015 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:17:03.015 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124856+0000", 2024-04-19T02:17:03.015 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0084622169999999993 2024-04-19T02:17:03.015 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.016 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.016 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:17:03.016 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124966+0000", 2024-04-19T02:17:03.016 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000109747 2024-04-19T02:17:03.016 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.016 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.016 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:03.016 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125216+0000", 2024-04-19T02:17:03.016 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000249545 2024-04-19T02:17:03.016 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.016 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.016 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:03.016 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.131713+0000", 2024-04-19T02:17:03.016 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0064972370000000003 2024-04-19T02:17:03.016 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.017 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.017 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:17:03.017 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148323+0000", 2024-04-19T02:17:03.017 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016609641000000001 2024-04-19T02:17:03.017 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.017 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.017 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:17:03.017 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148359+0000", 2024-04-19T02:17:03.017 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6412000000000003e-05 2024-04-19T02:17:03.017 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.017 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.017 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:17:03.017 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148542+0000", 2024-04-19T02:17:03.017 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00018265600000000001 2024-04-19T02:17:03.017 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:03.017 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:17:03.018 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:03.018 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.018 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.018 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:78248 5.c 5:30b7cc74:::benchmark_data_smithi121_44835_object78247:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:03.018 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.116471+0000", 2024-04-19T02:17:03.018 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 35.888148796999999, 2024-04-19T02:17:03.018 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.032127452000000001, 2024-04-19T02:17:03.018 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:17:03.018 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:03.018 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:17:03.018 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:17:03.018 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:03.018 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 78248 2024-04-19T02:17:03.018 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.018 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:17:03.019 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.019 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:17:03.019 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116471+0000", 2024-04-19T02:17:03.019 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:03.019 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.019 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.019 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:17:03.019 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116471+0000", 2024-04-19T02:17:03.019 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:03.019 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.019 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.019 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:17:03.019 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116470+0000", 2024-04-19T02:17:03.020 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:03.020 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.020 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.020 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:17:03.020 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116496+0000", 2024-04-19T02:17:03.020 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.5517e-05 2024-04-19T02:17:03.020 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.020 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.020 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:17:03.020 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116505+0000", 2024-04-19T02:17:03.020 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.9250000000000007e-06 2024-04-19T02:17:03.020 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.020 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.020 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:17:03.021 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.116516+0000", 2024-04-19T02:17:03.021 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.012e-05 2024-04-19T02:17:03.021 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.021 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.021 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:17:03.021 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.127803+0000", 2024-04-19T02:17:03.021 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.011287523000000001 2024-04-19T02:17:03.021 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.021 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.021 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:17:03.021 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.127932+0000", 2024-04-19T02:17:03.021 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012848499999999999 2024-04-19T02:17:03.021 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.021 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.021 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:03.022 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128022+0000", 2024-04-19T02:17:03.022 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.0890000000000006e-05 2024-04-19T02:17:03.022 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.022 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.022 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:03.022 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.131909+0000", 2024-04-19T02:17:03.022 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0038864609999999999 2024-04-19T02:17:03.022 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.022 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.022 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:17:03.022 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148552+0000", 2024-04-19T02:17:03.022 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016643162999999999 2024-04-19T02:17:03.022 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.023 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.023 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:17:03.023 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148577+0000", 2024-04-19T02:17:03.023 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.5333999999999998e-05 2024-04-19T02:17:03.023 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.023 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.023 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:17:03.023 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148598+0000", 2024-04-19T02:17:03.023 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.0687999999999999e-05 2024-04-19T02:17:03.023 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:03.024 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:17:03.024 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:03.024 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.024 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.024 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:78258 5.a 5:549070de:::benchmark_data_smithi121_44835_object78257:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:03.024 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.124295+0000", 2024-04-19T02:17:03.024 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 35.880324250999998, 2024-04-19T02:17:03.024 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020189543000000001, 2024-04-19T02:17:03.024 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:17:03.024 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:03.024 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:17:03.024 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:17:03.024 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:03.024 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 78258 2024-04-19T02:17:03.025 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.025 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:17:03.025 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.025 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:17:03.025 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124295+0000", 2024-04-19T02:17:03.025 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:03.025 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.025 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.025 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:17:03.025 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124295+0000", 2024-04-19T02:17:03.025 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:03.025 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.025 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.025 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:17:03.026 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124294+0000", 2024-04-19T02:17:03.026 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:17:03.026 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.026 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.026 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:17:03.026 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124358+0000", 2024-04-19T02:17:03.026 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.4040000000000003e-05 2024-04-19T02:17:03.026 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.026 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.026 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:17:03.026 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124374+0000", 2024-04-19T02:17:03.026 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.5291e-05 2024-04-19T02:17:03.026 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.026 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.026 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:17:03.027 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124383+0000", 2024-04-19T02:17:03.027 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.8360000000000004e-06 2024-04-19T02:17:03.027 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.027 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.027 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:17:03.027 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.124908+0000", 2024-04-19T02:17:03.027 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00052415700000000003 2024-04-19T02:17:03.027 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.027 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.027 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:17:03.027 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125023+0000", 2024-04-19T02:17:03.027 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00011506999999999999 2024-04-19T02:17:03.027 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.027 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.027 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:03.028 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125182+0000", 2024-04-19T02:17:03.028 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00015942500000000001 2024-04-19T02:17:03.028 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.028 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.028 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:03.028 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.129505+0000", 2024-04-19T02:17:03.028 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0043225080000000001 2024-04-19T02:17:03.028 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.028 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.028 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:17:03.028 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.144379+0000", 2024-04-19T02:17:03.028 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.014874263 2024-04-19T02:17:03.028 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.028 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.028 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:17:03.029 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.144444+0000", 2024-04-19T02:17:03.029 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.5451999999999996e-05 2024-04-19T02:17:03.029 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.029 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.029 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:17:03.029 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.144485+0000", 2024-04-19T02:17:03.029 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.0426999999999998e-05 2024-04-19T02:17:03.029 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:03.029 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:17:03.029 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:03.029 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.029 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.029 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:78259 5.4 e31/16 5:2aa344b2:::benchmark_data_smithi121_44835_object78258:head v 31'4849, mlcod=31'4843)", 2024-04-19T02:17:03.029 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.125675+0000", 2024-04-19T02:17:03.030 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 35.878944379000004, 2024-04-19T02:17:03.030 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.022419326, 2024-04-19T02:17:03.030 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:17:03.030 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:03.030 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:17:03.030 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.030 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:17:03.030 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125675+0000", 2024-04-19T02:17:03.030 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:03.030 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.030 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.030 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:17:03.030 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125675+0000", 2024-04-19T02:17:03.031 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:03.031 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.031 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.031 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:17:03.031 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125674+0000", 2024-04-19T02:17:03.031 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:03.031 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.031 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.031 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:17:03.031 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125723+0000", 2024-04-19T02:17:03.031 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.8998000000000001e-05 2024-04-19T02:17:03.031 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.031 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.031 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:17:03.032 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125733+0000", 2024-04-19T02:17:03.032 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.1379999999999996e-06 2024-04-19T02:17:03.032 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.032 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.032 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:17:03.032 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.125740+0000", 2024-04-19T02:17:03.032 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.0779999999999998e-06 2024-04-19T02:17:03.032 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.032 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.032 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:17:03.032 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.129589+0000", 2024-04-19T02:17:03.032 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0038488910000000001 2024-04-19T02:17:03.033 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.033 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.033 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:17:03.033 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.129605+0000", 2024-04-19T02:17:03.033 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.6877000000000001e-05 2024-04-19T02:17:03.033 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.033 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.033 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:17:03.033 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148057+0000", 2024-04-19T02:17:03.033 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.018451624 2024-04-19T02:17:03.033 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.033 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.033 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:17:03.033 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148094+0000", 2024-04-19T02:17:03.034 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.7327999999999999e-05 2024-04-19T02:17:03.034 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:03.034 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:17:03.034 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:03.034 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.034 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.034 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:78263 5.1 5:8e231862:::benchmark_data_smithi121_44835_object78262:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:03.034 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.128154+0000", 2024-04-19T02:17:03.034 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 35.876465193000001, 2024-04-19T02:17:03.034 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020882214, 2024-04-19T02:17:03.034 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:17:03.034 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:03.034 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:17:03.035 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:17:03.035 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:03.035 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 78263 2024-04-19T02:17:03.035 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.035 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:17:03.035 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.035 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:17:03.035 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128154+0000", 2024-04-19T02:17:03.035 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:03.035 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.035 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.035 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:17:03.035 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128154+0000", 2024-04-19T02:17:03.035 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:03.036 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.036 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.036 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:17:03.036 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128153+0000", 2024-04-19T02:17:03.036 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:17:03.036 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.036 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.036 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:17:03.036 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128246+0000", 2024-04-19T02:17:03.036 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.302e-05 2024-04-19T02:17:03.036 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.036 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.036 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:17:03.036 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128263+0000", 2024-04-19T02:17:03.037 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.6753e-05 2024-04-19T02:17:03.037 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.037 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.037 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:17:03.037 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128271+0000", 2024-04-19T02:17:03.037 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.2290000000000003e-06 2024-04-19T02:17:03.037 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.037 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.037 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:17:03.037 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128459+0000", 2024-04-19T02:17:03.037 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00018772 2024-04-19T02:17:03.037 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.037 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.038 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:17:03.038 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128574+0000", 2024-04-19T02:17:03.038 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00011437700000000001 2024-04-19T02:17:03.038 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.038 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.038 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:17:03.038 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.128696+0000", 2024-04-19T02:17:03.038 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000122831 2024-04-19T02:17:03.038 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.038 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.038 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:03.038 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.130816+0000", 2024-04-19T02:17:03.038 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0021196750000000001 2024-04-19T02:17:03.038 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.039 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.039 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:03.039 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.131859+0000", 2024-04-19T02:17:03.039 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0010434419999999999 2024-04-19T02:17:03.039 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.039 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.039 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:17:03.039 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148848+0000", 2024-04-19T02:17:03.039 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016988712 2024-04-19T02:17:03.039 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.039 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.039 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:17:03.039 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.148905+0000", 2024-04-19T02:17:03.039 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.6722999999999999e-05 2024-04-19T02:17:03.040 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.040 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.040 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:17:03.040 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.149036+0000", 2024-04-19T02:17:03.040 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000131567 2024-04-19T02:17:03.040 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:03.040 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:17:03.040 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:03.040 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.040 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.040 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:78271 5.4 e31/16 5:2982d7a6:::benchmark_data_smithi121_44835_object78270:head v 31'4850, mlcod=31'4847)", 2024-04-19T02:17:03.040 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:27.132554+0000", 2024-04-19T02:17:03.040 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 35.872065659, 2024-04-19T02:17:03.040 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020294946000000001, 2024-04-19T02:17:03.040 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:17:03.041 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:03.041 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:17:03.041 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.041 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:17:03.041 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132554+0000", 2024-04-19T02:17:03.041 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:03.041 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.041 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.041 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:17:03.041 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132554+0000", 2024-04-19T02:17:03.041 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:03.041 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.041 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.041 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:17:03.041 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132553+0000", 2024-04-19T02:17:03.042 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:03.042 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.042 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.042 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:17:03.042 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132615+0000", 2024-04-19T02:17:03.042 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.1772000000000004e-05 2024-04-19T02:17:03.042 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.042 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.042 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:17:03.042 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132620+0000", 2024-04-19T02:17:03.042 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.0939999999999998e-06 2024-04-19T02:17:03.042 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.042 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.042 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:17:03.043 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132624+0000", 2024-04-19T02:17:03.043 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.2229999999999999e-06 2024-04-19T02:17:03.043 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.043 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.043 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:17:03.043 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132649+0000", 2024-04-19T02:17:03.043 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.5352000000000001e-05 2024-04-19T02:17:03.043 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.043 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.043 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:17:03.043 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.132661+0000", 2024-04-19T02:17:03.043 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.1851999999999999e-05 2024-04-19T02:17:03.043 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.043 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.043 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:17:03.044 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.152820+0000", 2024-04-19T02:17:03.044 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020159369999999999 2024-04-19T02:17:03.044 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.044 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.044 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:17:03.044 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:27.152849+0000", 2024-04-19T02:17:03.044 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.868e-05 2024-04-19T02:17:03.044 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:03.044 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:17:03.044 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:03.044 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.044 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.044 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:94191 5.c 5:3155c784:::benchmark_data_smithi121_44835_object94190:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T02:17:03.044 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:34.963381+0000", 2024-04-19T02:17:03.044 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 28.041237974000001, 2024-04-19T02:17:03.045 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.021414343999999998, 2024-04-19T02:17:03.045 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:17:03.045 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:03.045 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:17:03.045 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:17:03.045 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:03.045 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 94191 2024-04-19T02:17:03.045 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.045 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:17:03.045 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.045 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:17:03.045 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.963381+0000", 2024-04-19T02:17:03.045 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:03.045 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.045 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.046 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:17:03.046 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.963381+0000", 2024-04-19T02:17:03.046 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:03.046 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.046 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.046 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:17:03.046 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.963381+0000", 2024-04-19T02:17:03.046 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:03.046 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.046 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.046 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:17:03.046 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.963457+0000", 2024-04-19T02:17:03.046 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.5827000000000004e-05 2024-04-19T02:17:03.046 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.047 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.047 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:17:03.047 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.963465+0000", 2024-04-19T02:17:03.047 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.2800000000000003e-06 2024-04-19T02:17:03.047 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.047 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.047 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:17:03.047 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.963470+0000", 2024-04-19T02:17:03.047 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.2310000000000004e-06 2024-04-19T02:17:03.047 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.047 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.047 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:17:03.047 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.969469+0000", 2024-04-19T02:17:03.047 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0059987169999999998 2024-04-19T02:17:03.047 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.048 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.048 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:17:03.048 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.969594+0000", 2024-04-19T02:17:03.048 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012517299999999999 2024-04-19T02:17:03.048 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.048 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.048 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:03.048 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.969759+0000", 2024-04-19T02:17:03.048 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00016459999999999999 2024-04-19T02:17:03.048 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.048 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.048 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:03.048 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.975130+0000", 2024-04-19T02:17:03.049 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0053717410000000002 2024-04-19T02:17:03.049 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.049 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.049 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:17:03.049 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.984704+0000", 2024-04-19T02:17:03.049 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.009573715 2024-04-19T02:17:03.049 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.049 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.049 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:17:03.049 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.984758+0000", 2024-04-19T02:17:03.049 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.4039000000000002e-05 2024-04-19T02:17:03.049 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.049 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.049 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:17:03.049 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:34.984796+0000", 2024-04-19T02:17:03.050 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.7619e-05 2024-04-19T02:17:03.050 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:03.050 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:17:03.050 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:03.050 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.050 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.050 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:94471 5.6 5:641302c2:::benchmark_data_smithi121_44835_object94470:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:03.050 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:35.112592+0000", 2024-04-19T02:17:03.050 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 27.892027909999999, 2024-04-19T02:17:03.050 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.023525194999999999, 2024-04-19T02:17:03.050 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:17:03.050 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:03.050 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:17:03.050 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:17:03.051 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:03.051 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 94471 2024-04-19T02:17:03.051 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.051 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:17:03.051 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.051 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:17:03.051 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.112592+0000", 2024-04-19T02:17:03.051 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:03.051 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.051 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.051 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:17:03.051 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.112592+0000", 2024-04-19T02:17:03.051 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:03.051 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.051 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.052 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:17:03.052 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.112591+0000", 2024-04-19T02:17:03.052 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:17:03.052 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.052 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.052 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:17:03.052 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.112621+0000", 2024-04-19T02:17:03.052 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.0701999999999998e-05 2024-04-19T02:17:03.052 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.052 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.052 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:17:03.052 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.112631+0000", 2024-04-19T02:17:03.052 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.3209999999999994e-06 2024-04-19T02:17:03.052 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.052 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.053 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:17:03.053 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.112638+0000", 2024-04-19T02:17:03.053 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.187e-06 2024-04-19T02:17:03.053 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.053 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.053 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:17:03.053 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.113893+0000", 2024-04-19T02:17:03.053 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0012553390000000001 2024-04-19T02:17:03.053 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.053 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.053 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:17:03.053 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.114012+0000", 2024-04-19T02:17:03.053 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000118638 2024-04-19T02:17:03.053 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.053 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.054 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:03.054 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.114151+0000", 2024-04-19T02:17:03.054 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00013928700000000001 2024-04-19T02:17:03.054 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.054 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.054 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:03.054 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.120607+0000", 2024-04-19T02:17:03.054 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0064559179999999997 2024-04-19T02:17:03.054 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.054 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.054 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:17:03.054 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136026+0000", 2024-04-19T02:17:03.054 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015418762000000001 2024-04-19T02:17:03.054 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.054 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.055 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:17:03.055 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136084+0000", 2024-04-19T02:17:03.055 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.8245000000000002e-05 2024-04-19T02:17:03.055 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.055 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.055 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:17:03.055 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136117+0000", 2024-04-19T02:17:03.055 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.2616000000000001e-05 2024-04-19T02:17:03.055 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:03.055 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:17:03.055 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:03.055 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.055 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.055 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:94468 5.2 e34/16 5:4f406431:::benchmark_data_smithi121_44835_object94467:head v 34'5918, mlcod=34'5914)", 2024-04-19T02:17:03.056 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:35.113059+0000", 2024-04-19T02:17:03.056 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 27.891560627, 2024-04-19T02:17:03.056 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.022987177000000001, 2024-04-19T02:17:03.056 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:17:03.056 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:03.056 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:17:03.056 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.056 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:17:03.056 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.113059+0000", 2024-04-19T02:17:03.056 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:03.056 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.056 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.056 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:17:03.056 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.113059+0000", 2024-04-19T02:17:03.056 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:03.056 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.057 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.057 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:17:03.057 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.113058+0000", 2024-04-19T02:17:03.057 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:03.057 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.057 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.057 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:17:03.057 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.113103+0000", 2024-04-19T02:17:03.057 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.4159000000000002e-05 2024-04-19T02:17:03.057 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.057 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.057 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:17:03.057 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.113110+0000", 2024-04-19T02:17:03.057 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.1049999999999997e-06 2024-04-19T02:17:03.058 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.058 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.058 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:17:03.058 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.113115+0000", 2024-04-19T02:17:03.058 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.3229999999999997e-06 2024-04-19T02:17:03.058 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.058 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.058 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:17:03.058 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.114338+0000", 2024-04-19T02:17:03.058 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.001223179 2024-04-19T02:17:03.058 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.058 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.058 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:17:03.058 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.114355+0000", 2024-04-19T02:17:03.058 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.6963999999999999e-05 2024-04-19T02:17:03.059 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.059 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.059 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:17:03.059 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136011+0000", 2024-04-19T02:17:03.059 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.021656102999999999 2024-04-19T02:17:03.059 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.059 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.059 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:17:03.059 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.136046+0000", 2024-04-19T02:17:03.059 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.4802999999999999e-05 2024-04-19T02:17:03.059 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:03.059 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:17:03.059 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:03.059 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.060 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.060 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_repop(client.4549.0:94581 5.b e35/16 5:dc86d6e9:::benchmark_data_smithi121_44835_object94580:head v 35'5875, mlcod=35'5872)", 2024-04-19T02:17:03.060 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:35.181295+0000", 2024-04-19T02:17:03.060 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 27.823324588999998, 2024-04-19T02:17:03.060 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.02078327, 2024-04-19T02:17:03.060 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:17:03.060 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:03.060 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:17:03.060 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.060 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:17:03.060 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.181295+0000", 2024-04-19T02:17:03.060 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:03.060 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.061 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.061 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:17:03.061 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.181295+0000", 2024-04-19T02:17:03.061 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:03.061 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.061 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.061 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:17:03.061 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.181294+0000", 2024-04-19T02:17:03.061 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:03.061 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.061 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.061 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:17:03.061 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.181321+0000", 2024-04-19T02:17:03.061 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.6588999999999999e-05 2024-04-19T02:17:03.061 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.062 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.062 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:17:03.062 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.181329+0000", 2024-04-19T02:17:03.062 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.9289999999999998e-06 2024-04-19T02:17:03.062 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.062 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.062 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:17:03.062 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.181334+0000", 2024-04-19T02:17:03.062 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.2789999999999998e-06 2024-04-19T02:17:03.062 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.062 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.062 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:17:03.062 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.186093+0000", 2024-04-19T02:17:03.062 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0047585509999999998 2024-04-19T02:17:03.063 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.063 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.063 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:17:03.063 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.186111+0000", 2024-04-19T02:17:03.063 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.7901e-05 2024-04-19T02:17:03.063 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.063 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.063 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:17:03.063 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.202037+0000", 2024-04-19T02:17:03.063 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015926020999999999 2024-04-19T02:17:03.063 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.063 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.063 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:17:03.064 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.202078+0000", 2024-04-19T02:17:03.064 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.1424999999999997e-05 2024-04-19T02:17:03.064 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:03.064 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:17:03.064 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:03.064 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.064 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.064 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "MOSDPGPushReply(5.1 35/29 [PushReplyOp(5:860e8104:::benchmark_data_smithi121_44835_object52857:head)])", 2024-04-19T02:17:03.064 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:35.719222+0000", 2024-04-19T02:17:03.064 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 27.285397853999999, 2024-04-19T02:17:03.064 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.022063027999999998, 2024-04-19T02:17:03.064 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:17:03.064 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "reached pg", 2024-04-19T02:17:03.064 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:17:03.064 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.064 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:17:03.065 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.719222+0000", 2024-04-19T02:17:03.065 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:03.065 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.065 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.065 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:17:03.065 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.719222+0000", 2024-04-19T02:17:03.065 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:03.065 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.065 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.065 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:17:03.065 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.719221+0000", 2024-04-19T02:17:03.065 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967296 2024-04-19T02:17:03.065 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.065 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.065 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:17:03.066 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.719225+0000", 2024-04-19T02:17:03.066 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.5779999999999999e-06 2024-04-19T02:17:03.066 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.066 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.066 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:17:03.066 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.719232+0000", 2024-04-19T02:17:03.066 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.1319999999999996e-06 2024-04-19T02:17:03.066 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.066 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.066 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:17:03.066 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.719239+0000", 2024-04-19T02:17:03.066 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.8120000000000002e-06 2024-04-19T02:17:03.066 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.066 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.067 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:17:03.067 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.741004+0000", 2024-04-19T02:17:03.067 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.021764614000000002 2024-04-19T02:17:03.067 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.067 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.067 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:17:03.067 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:35.741285+0000", 2024-04-19T02:17:03.067 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000281079 2024-04-19T02:17:03.067 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:03.067 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:17:03.067 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:03.067 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.067 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.068 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:96375 5.1 5:84bae481:::benchmark_data_smithi121_44835_object96374:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:03.068 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:36.105748+0000", 2024-04-19T02:17:03.068 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 26.898871463999999, 2024-04-19T02:17:03.068 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.021551219999999999, 2024-04-19T02:17:03.068 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:17:03.068 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:03.068 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:17:03.068 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:17:03.068 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:03.068 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 96375 2024-04-19T02:17:03.068 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.068 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:17:03.068 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.068 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:17:03.068 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.105748+0000", 2024-04-19T02:17:03.069 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:03.069 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.069 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.069 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:17:03.069 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.105748+0000", 2024-04-19T02:17:03.069 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:03.069 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.069 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.069 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:17:03.069 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.105747+0000", 2024-04-19T02:17:03.069 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:17:03.069 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.069 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.069 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:17:03.069 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.105869+0000", 2024-04-19T02:17:03.070 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000121965 2024-04-19T02:17:03.070 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.070 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.070 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:17:03.070 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.105879+0000", 2024-04-19T02:17:03.070 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.0049e-05 2024-04-19T02:17:03.070 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.070 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.070 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:17:03.070 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.105886+0000", 2024-04-19T02:17:03.070 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.0879999999999997e-06 2024-04-19T02:17:03.070 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.070 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.070 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:17:03.071 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.107778+0000", 2024-04-19T02:17:03.071 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0018912670000000001 2024-04-19T02:17:03.071 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.071 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.071 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:17:03.071 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.107885+0000", 2024-04-19T02:17:03.071 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000106982 2024-04-19T02:17:03.071 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.071 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.071 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:17:03.071 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.108016+0000", 2024-04-19T02:17:03.071 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000131581 2024-04-19T02:17:03.071 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.071 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.072 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:17:03.072 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.110857+0000", 2024-04-19T02:17:03.072 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.002840604 2024-04-19T02:17:03.072 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.072 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.072 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:03.072 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.118745+0000", 2024-04-19T02:17:03.072 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0078886970000000001 2024-04-19T02:17:03.072 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.072 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.072 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:03.072 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.127135+0000", 2024-04-19T02:17:03.072 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0083899939999999996 2024-04-19T02:17:03.072 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.073 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.073 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:17:03.073 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.127191+0000", 2024-04-19T02:17:03.073 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.5294000000000003e-05 2024-04-19T02:17:03.073 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.073 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.073 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:17:03.073 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:36.127299+0000", 2024-04-19T02:17:03.073 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000108439 2024-04-19T02:17:03.073 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:03.073 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:17:03.073 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:03.074 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.074 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.074 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:104186 5.1 5:8759ec67:::benchmark_data_smithi121_44835_object104185:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T02:17:03.074 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:40.086927+0000", 2024-04-19T02:17:03.074 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 22.917692623000001, 2024-04-19T02:17:03.074 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020306884000000001, 2024-04-19T02:17:03.074 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:17:03.074 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:03.074 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:17:03.074 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:17:03.074 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:03.074 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 104186 2024-04-19T02:17:03.074 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.075 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:17:03.075 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.075 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:17:03.075 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086927+0000", 2024-04-19T02:17:03.075 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:03.075 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.075 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.075 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:17:03.075 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086927+0000", 2024-04-19T02:17:03.075 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:03.075 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.075 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.075 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:17:03.076 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086926+0000", 2024-04-19T02:17:03.076 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:17:03.076 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.076 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.076 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:17:03.076 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086951+0000", 2024-04-19T02:17:03.076 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.5452e-05 2024-04-19T02:17:03.076 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.076 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.076 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:17:03.076 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086960+0000", 2024-04-19T02:17:03.076 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.1620000000000008e-06 2024-04-19T02:17:03.076 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.076 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.076 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:17:03.077 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086966+0000", 2024-04-19T02:17:03.077 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.0290000000000002e-06 2024-04-19T02:17:03.077 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.077 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.077 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:17:03.077 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.090593+0000", 2024-04-19T02:17:03.077 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0036272079999999998 2024-04-19T02:17:03.077 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.077 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.077 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:17:03.077 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.090699+0000", 2024-04-19T02:17:03.077 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000106001 2024-04-19T02:17:03.077 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.077 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.078 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:17:03.078 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.090842+0000", 2024-04-19T02:17:03.078 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00014270900000000001 2024-04-19T02:17:03.078 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.078 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.078 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:17:03.078 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.094673+0000", 2024-04-19T02:17:03.078 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0038316999999999999 2024-04-19T02:17:03.078 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.078 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.078 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:03.078 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.097494+0000", 2024-04-19T02:17:03.078 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0028205539999999999 2024-04-19T02:17:03.079 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.079 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.079 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:03.079 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.107075+0000", 2024-04-19T02:17:03.079 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0095813870000000002 2024-04-19T02:17:03.079 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.079 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.079 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:17:03.079 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.107127+0000", 2024-04-19T02:17:03.079 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.1498000000000001e-05 2024-04-19T02:17:03.079 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.079 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.079 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:17:03.079 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.107234+0000", 2024-04-19T02:17:03.080 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000107058 2024-04-19T02:17:03.080 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:03.080 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:17:03.080 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:03.080 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.080 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.080 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:104187 5.1 5:8636ab61:::benchmark_data_smithi121_44835_object104186:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T02:17:03.080 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:40.086972+0000", 2024-04-19T02:17:03.080 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 22.917647229, 2024-04-19T02:17:03.080 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020992607999999999, 2024-04-19T02:17:03.080 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:17:03.080 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:03.080 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:17:03.081 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:17:03.081 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:03.081 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 104187 2024-04-19T02:17:03.081 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.081 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:17:03.081 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.081 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:17:03.081 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086972+0000", 2024-04-19T02:17:03.081 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:03.081 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.081 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.081 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:17:03.081 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086972+0000", 2024-04-19T02:17:03.081 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:03.082 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.082 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.082 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:17:03.082 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.086972+0000", 2024-04-19T02:17:03.082 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:03.082 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.082 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.082 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:17:03.082 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.087000+0000", 2024-04-19T02:17:03.082 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.8569e-05 2024-04-19T02:17:03.082 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.082 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.082 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:17:03.083 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.087007+0000", 2024-04-19T02:17:03.083 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.4280000000000001e-06 2024-04-19T02:17:03.083 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.083 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.083 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:17:03.083 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.087013+0000", 2024-04-19T02:17:03.083 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.3929999999999996e-06 2024-04-19T02:17:03.083 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.083 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.083 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:17:03.083 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.092659+0000", 2024-04-19T02:17:03.083 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0056460850000000003 2024-04-19T02:17:03.083 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.083 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.083 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:17:03.083 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.092780+0000", 2024-04-19T02:17:03.084 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012113200000000001 2024-04-19T02:17:03.084 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.084 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.084 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:17:03.084 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.092894+0000", 2024-04-19T02:17:03.084 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000113057 2024-04-19T02:17:03.084 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.084 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.084 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:03.084 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.097526+0000", 2024-04-19T02:17:03.084 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0046325940000000003 2024-04-19T02:17:03.084 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.084 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.084 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:17:03.085 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.097536+0000", 2024-04-19T02:17:03.085 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.4110000000000002e-06 2024-04-19T02:17:03.085 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.085 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.085 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:03.085 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.107809+0000", 2024-04-19T02:17:03.085 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.010273882999999999 2024-04-19T02:17:03.085 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.085 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.085 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:17:03.085 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.107864+0000", 2024-04-19T02:17:03.085 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.4792e-05 2024-04-19T02:17:03.085 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.085 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.085 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:17:03.085 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:40.107965+0000", 2024-04-19T02:17:03.086 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000100641 2024-04-19T02:17:03.086 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:03.086 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:17:03.086 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:03.086 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.086 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.086 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:113448 5.1 5:816781af:::benchmark_data_smithi121_44835_object113447:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T02:17:03.086 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:44.698272+0000", 2024-04-19T02:17:03.086 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 18.306347021000001, 2024-04-19T02:17:03.086 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.023047332, 2024-04-19T02:17:03.086 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:17:03.086 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:03.086 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:17:03.086 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:17:03.087 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:03.087 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 113448 2024-04-19T02:17:03.087 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.087 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:17:03.087 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.087 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:17:03.087 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.698272+0000", 2024-04-19T02:17:03.087 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:03.087 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.087 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.087 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:17:03.087 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.698272+0000", 2024-04-19T02:17:03.087 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:03.087 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.087 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.088 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:17:03.088 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.698272+0000", 2024-04-19T02:17:03.088 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:03.088 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.088 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.088 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:17:03.088 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.698307+0000", 2024-04-19T02:17:03.088 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.4712999999999998e-05 2024-04-19T02:17:03.088 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.088 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.088 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:17:03.088 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.698322+0000", 2024-04-19T02:17:03.088 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.5427999999999999e-05 2024-04-19T02:17:03.088 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.088 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.089 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:17:03.089 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.698328+0000", 2024-04-19T02:17:03.089 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.139e-06 2024-04-19T02:17:03.089 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.089 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.089 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:17:03.089 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.700548+0000", 2024-04-19T02:17:03.089 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.002219951 2024-04-19T02:17:03.089 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.089 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.089 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:17:03.089 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.700699+0000", 2024-04-19T02:17:03.089 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000151185 2024-04-19T02:17:03.089 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.089 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.090 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:17:03.090 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.700844+0000", 2024-04-19T02:17:03.090 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00014434800000000001 2024-04-19T02:17:03.090 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.090 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.090 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:03.090 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.705655+0000", 2024-04-19T02:17:03.090 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.004811503 2024-04-19T02:17:03.090 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.090 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.090 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:03.090 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.705933+0000", 2024-04-19T02:17:03.090 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00027823300000000002 2024-04-19T02:17:03.090 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.090 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.091 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:17:03.091 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.721130+0000", 2024-04-19T02:17:03.091 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.015196708 2024-04-19T02:17:03.091 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.091 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.091 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:17:03.091 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.721197+0000", 2024-04-19T02:17:03.091 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.6928999999999996e-05 2024-04-19T02:17:03.091 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.091 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.091 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:17:03.091 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.721320+0000", 2024-04-19T02:17:03.091 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012277499999999999 2024-04-19T02:17:03.091 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:03.091 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:17:03.092 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:03.092 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.092 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.092 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:113660 5.1 5:80c3f0b7:::benchmark_data_smithi121_44835_object113659:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T02:17:03.092 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:44.810899+0000", 2024-04-19T02:17:03.092 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 18.193720403, 2024-04-19T02:17:03.092 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.023870918000000001, 2024-04-19T02:17:03.092 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:17:03.092 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:03.092 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:17:03.092 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:17:03.092 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:03.092 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 113660 2024-04-19T02:17:03.092 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.092 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:17:03.093 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.093 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:17:03.093 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.810899+0000", 2024-04-19T02:17:03.093 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:03.093 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.093 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.093 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:17:03.093 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.810899+0000", 2024-04-19T02:17:03.093 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:03.093 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.093 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.093 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:17:03.093 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.810898+0000", 2024-04-19T02:17:03.093 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:17:03.093 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.094 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.094 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:17:03.094 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.810972+0000", 2024-04-19T02:17:03.094 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.3306000000000006e-05 2024-04-19T02:17:03.094 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.094 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.094 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:17:03.094 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.810978+0000", 2024-04-19T02:17:03.094 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.319e-06 2024-04-19T02:17:03.094 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.094 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.094 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:17:03.094 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.810984+0000", 2024-04-19T02:17:03.094 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.1650000000000003e-06 2024-04-19T02:17:03.095 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.095 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.095 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:17:03.095 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.820088+0000", 2024-04-19T02:17:03.095 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0091040310000000003 2024-04-19T02:17:03.095 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.095 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.095 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:17:03.095 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.820245+0000", 2024-04-19T02:17:03.095 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000157155 2024-04-19T02:17:03.095 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.095 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.095 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:17:03.095 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.820444+0000", 2024-04-19T02:17:03.095 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00019840299999999999 2024-04-19T02:17:03.096 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.096 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.096 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:03.096 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.824507+0000", 2024-04-19T02:17:03.096 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0040632999999999997 2024-04-19T02:17:03.096 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.096 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.096 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:17:03.096 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.827337+0000", 2024-04-19T02:17:03.096 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0028301429999999998 2024-04-19T02:17:03.096 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.096 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.096 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:03.096 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.834600+0000", 2024-04-19T02:17:03.096 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.007263294 2024-04-19T02:17:03.097 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.097 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.097 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:17:03.097 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.834654+0000", 2024-04-19T02:17:03.097 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.3508999999999999e-05 2024-04-19T02:17:03.097 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.097 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.097 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:17:03.097 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:44.834770+0000", 2024-04-19T02:17:03.097 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000116075 2024-04-19T02:17:03.097 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:03.097 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:17:03.097 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:03.097 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.097 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.098 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:129052 5.1 5:81fcf9a6:::benchmark_data_smithi121_44835_object129051:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T02:17:03.098 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:52.546357+0000", 2024-04-19T02:17:03.098 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 10.458262008, 2024-04-19T02:17:03.098 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.020114360000000001, 2024-04-19T02:17:03.098 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:17:03.098 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:03.098 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:17:03.098 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:17:03.098 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:03.098 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 129052 2024-04-19T02:17:03.098 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.098 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:17:03.098 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.098 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:17:03.098 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:52.546357+0000", 2024-04-19T02:17:03.099 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:03.099 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.099 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.099 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:17:03.099 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:52.546357+0000", 2024-04-19T02:17:03.099 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:03.099 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.099 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.099 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:17:03.099 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:52.546357+0000", 2024-04-19T02:17:03.099 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.999999 2024-04-19T02:17:03.099 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.099 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.099 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:17:03.100 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:52.546411+0000", 2024-04-19T02:17:03.100 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.4737000000000001e-05 2024-04-19T02:17:03.100 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.100 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.100 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:17:03.100 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:52.546427+0000", 2024-04-19T02:17:03.100 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.5722e-05 2024-04-19T02:17:03.100 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.100 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.100 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:17:03.100 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:52.546435+0000", 2024-04-19T02:17:03.100 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.8380000000000002e-06 2024-04-19T02:17:03.100 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.100 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.101 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:17:03.101 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:52.550064+0000", 2024-04-19T02:17:03.101 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0036286410000000002 2024-04-19T02:17:03.101 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.101 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.101 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:17:03.101 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:52.550188+0000", 2024-04-19T02:17:03.101 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00012434999999999999 2024-04-19T02:17:03.101 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.101 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.101 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:17:03.101 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:52.550382+0000", 2024-04-19T02:17:03.101 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00019446200000000001 2024-04-19T02:17:03.101 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.101 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.101 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:17:03.102 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:52.553649+0000", 2024-04-19T02:17:03.102 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0032662699999999999 2024-04-19T02:17:03.102 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.102 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.102 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:03.102 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:52.556721+0000", 2024-04-19T02:17:03.102 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0030726740000000001 2024-04-19T02:17:03.102 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.102 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.102 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:03.102 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:52.566368+0000", 2024-04-19T02:17:03.102 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0096468999999999999 2024-04-19T02:17:03.102 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.105 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.105 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:17:03.106 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:52.566412+0000", 2024-04-19T02:17:03.106 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.3936000000000001e-05 2024-04-19T02:17:03.106 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.106 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.106 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:17:03.106 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:52.566472+0000", 2024-04-19T02:17:03.106 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 5.9608999999999998e-05 2024-04-19T02:17:03.106 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:03.106 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:17:03.106 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:03.106 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.106 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.106 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:130092 5.6 5:65fc2f1e:::benchmark_data_smithi121_44835_object130091:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T02:17:03.106 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:53.069891+0000", 2024-04-19T02:17:03.107 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 9.9347286110000006, 2024-04-19T02:17:03.107 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.023733942000000001, 2024-04-19T02:17:03.107 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:17:03.107 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:03.107 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:17:03.107 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:17:03.107 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:03.107 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 130092 2024-04-19T02:17:03.107 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.107 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:17:03.107 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.107 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:17:03.107 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.069891+0000", 2024-04-19T02:17:03.107 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:03.107 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.108 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.108 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:17:03.108 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.069891+0000", 2024-04-19T02:17:03.108 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:03.108 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.108 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.108 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:17:03.108 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.069890+0000", 2024-04-19T02:17:03.108 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:03.108 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.108 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.108 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:17:03.108 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.069910+0000", 2024-04-19T02:17:03.108 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.0378999999999999e-05 2024-04-19T02:17:03.108 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.109 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.109 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:17:03.109 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.069919+0000", 2024-04-19T02:17:03.109 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.6629999999999999e-06 2024-04-19T02:17:03.109 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.109 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.109 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:17:03.109 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.069926+0000", 2024-04-19T02:17:03.109 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 7.2509999999999997e-06 2024-04-19T02:17:03.109 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.109 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.109 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:17:03.109 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.069975+0000", 2024-04-19T02:17:03.109 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.8857999999999999e-05 2024-04-19T02:17:03.109 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.110 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.110 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:17:03.110 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.070131+0000", 2024-04-19T02:17:03.110 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00015667599999999999 2024-04-19T02:17:03.110 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.110 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.110 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:03.110 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.070290+0000", 2024-04-19T02:17:03.110 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00015898799999999999 2024-04-19T02:17:03.110 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.110 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.110 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:03.110 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.076926+0000", 2024-04-19T02:17:03.110 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0066357079999999997 2024-04-19T02:17:03.110 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.111 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.111 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:17:03.111 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.093570+0000", 2024-04-19T02:17:03.111 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.016643425999999999 2024-04-19T02:17:03.111 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.111 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.111 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:17:03.111 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.093606+0000", 2024-04-19T02:17:03.111 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 3.6520000000000003e-05 2024-04-19T02:17:03.111 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.111 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.111 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:17:03.111 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:53.093625+0000", 2024-04-19T02:17:03.111 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 1.8686999999999999e-05 2024-04-19T02:17:03.111 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:03.112 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:17:03.112 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:03.112 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.112 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.112 INFO:teuthology.orchestra.run.smithi177.stdout: "description": "osd_op(client.4549.0:132350 5.1 5:887df61f:::benchmark_data_smithi121_44835_object132349:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T02:17:03.112 INFO:teuthology.orchestra.run.smithi177.stdout: "initiated_at": "2024-04-19T02:16:54.200508+0000", 2024-04-19T02:17:03.112 INFO:teuthology.orchestra.run.smithi177.stdout: "age": 8.8041118300000001, 2024-04-19T02:17:03.112 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.021944229999999999, 2024-04-19T02:17:03.112 INFO:teuthology.orchestra.run.smithi177.stdout: "type_data": { 2024-04-19T02:17:03.112 INFO:teuthology.orchestra.run.smithi177.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:03.112 INFO:teuthology.orchestra.run.smithi177.stdout: "client_info": { 2024-04-19T02:17:03.112 INFO:teuthology.orchestra.run.smithi177.stdout: "client": "client.4549", 2024-04-19T02:17:03.112 INFO:teuthology.orchestra.run.smithi177.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:03.112 INFO:teuthology.orchestra.run.smithi177.stdout: "tid": 132350 2024-04-19T02:17:03.112 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.112 INFO:teuthology.orchestra.run.smithi177.stdout: "events": [ 2024-04-19T02:17:03.113 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.113 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "initiated", 2024-04-19T02:17:03.113 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:54.200508+0000", 2024-04-19T02:17:03.113 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:03.113 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.113 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.113 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "throttled", 2024-04-19T02:17:03.113 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:54.200508+0000", 2024-04-19T02:17:03.113 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0 2024-04-19T02:17:03.113 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.113 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.113 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "header_read", 2024-04-19T02:17:03.113 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:54.200507+0000", 2024-04-19T02:17:03.113 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:03.113 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.114 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.114 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "all_read", 2024-04-19T02:17:03.114 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:54.200649+0000", 2024-04-19T02:17:03.114 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.00014184500000000001 2024-04-19T02:17:03.114 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.114 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.114 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "dispatched", 2024-04-19T02:17:03.114 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:54.200656+0000", 2024-04-19T02:17:03.114 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.7190000000000004e-06 2024-04-19T02:17:03.114 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.114 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.114 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "queued_for_pg", 2024-04-19T02:17:03.114 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:54.200660+0000", 2024-04-19T02:17:03.114 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 4.7520000000000004e-06 2024-04-19T02:17:03.114 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.115 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.115 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "reached_pg", 2024-04-19T02:17:03.115 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:54.202388+0000", 2024-04-19T02:17:03.115 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.001727538 2024-04-19T02:17:03.115 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.115 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.115 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "started", 2024-04-19T02:17:03.115 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:54.202481+0000", 2024-04-19T02:17:03.115 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 9.2689999999999995e-05 2024-04-19T02:17:03.115 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.115 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.115 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "waiting for subops from 0,1", 2024-04-19T02:17:03.115 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:54.202585+0000", 2024-04-19T02:17:03.115 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.000104447 2024-04-19T02:17:03.116 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.116 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.116 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:03.116 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:54.205182+0000", 2024-04-19T02:17:03.116 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.0025966639999999998 2024-04-19T02:17:03.116 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.116 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.116 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:03.116 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:54.205211+0000", 2024-04-19T02:17:03.116 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 2.9037999999999999e-05 2024-04-19T02:17:03.116 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.116 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.116 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "op_commit", 2024-04-19T02:17:03.116 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:54.222303+0000", 2024-04-19T02:17:03.116 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 0.017092594999999999 2024-04-19T02:17:03.116 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.117 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.117 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "commit_sent", 2024-04-19T02:17:03.117 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:54.222367+0000", 2024-04-19T02:17:03.117 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 6.3328000000000001e-05 2024-04-19T02:17:03.117 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-04-19T02:17:03.117 INFO:teuthology.orchestra.run.smithi177.stdout: { 2024-04-19T02:17:03.117 INFO:teuthology.orchestra.run.smithi177.stdout: "event": "done", 2024-04-19T02:17:03.117 INFO:teuthology.orchestra.run.smithi177.stdout: "time": "2024-04-19T02:16:54.222452+0000", 2024-04-19T02:17:03.117 INFO:teuthology.orchestra.run.smithi177.stdout: "duration": 8.5286999999999998e-05 2024-04-19T02:17:03.117 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:03.117 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:17:03.117 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:03.117 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-04-19T02:17:03.117 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-04-19T02:17:03.117 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-04-19T02:17:03.119 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:03.119+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:03.119 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:03.220 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:03.221+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:03.254 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:17:03.256 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-04-19T02:17:03.264 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2024-04-19T02:17:03.220005+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":7735806834,"num_objects":118055,"num_object_clones":0,"num_object_copies":236110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":118055,"num_whiteouts":0,"num_read":137,"num_read_kb":119,"num_write":150283,"num_write_kb":8581523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6394,"num_bytes_recovered":419037184,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60030,"ondisk_log_size":60030,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":243,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":16251584,"kb_used_data":15706336,"kb_used_omap":4,"kb_used_meta":544507,"kb_avail":266863936,"statfs":{"total":289910292480,"available":273268670464,"internally_reserved":0,"allocated":16083288064,"data_stored":16082256676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":557575506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,3,4,7],"upper_bound":16},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-754778088,"num_objects":-11516,"num_object_clones":0,"num_object_copies":-23032,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-1870,"num_objects_unfound":0,"num_objects_dirty":-11516,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20488,"num_write_kb":287041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1852,"num_bytes_recovered":121372672,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.466307"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.189410+0000","last_change":"2024-04-19T02:15:29.280412+0000","last_active":"2024-04-19T02:16:59.189410+0000","last_peered":"2024-04-19T02:16:59.189410+0000","last_clean":"2024-04-19T02:16:59.189410+0000","last_became_active":"2024-04-19T02:15:29.278762+0000","last_became_peered":"2024-04-19T02:15:29.278762+0000","last_unstale":"2024-04-19T02:16:59.189410+0000","last_undegraded":"2024-04-19T02:16:59.189410+0000","last_fullsized":"2024-04-19T02:16:59.189410+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:45.301675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.188874+0000","last_change":"2024-04-19T02:15:29.284695+0000","last_active":"2024-04-19T02:16:59.188874+0000","last_peered":"2024-04-19T02:16:59.188874+0000","last_clean":"2024-04-19T02:16:59.188874+0000","last_became_active":"2024-04-19T02:15:29.283468+0000","last_became_peered":"2024-04-19T02:15:29.283468+0000","last_unstale":"2024-04-19T02:16:59.188874+0000","last_undegraded":"2024-04-19T02:16:59.188874+0000","last_fullsized":"2024-04-19T02:16:59.188874+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.384881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.197586+0000","last_change":"2024-04-19T02:15:29.286709+0000","last_active":"2024-04-19T02:16:59.197586+0000","last_peered":"2024-04-19T02:16:59.197586+0000","last_clean":"2024-04-19T02:16:59.197586+0000","last_became_active":"2024-04-19T02:15:29.286169+0000","last_became_peered":"2024-04-19T02:15:29.286169+0000","last_unstale":"2024-04-19T02:16:59.197586+0000","last_undegraded":"2024-04-19T02:16:59.197586+0000","last_fullsized":"2024-04-19T02:16:59.197586+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:58.741466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.198328+0000","last_change":"2024-04-19T02:15:29.280131+0000","last_active":"2024-04-19T02:16:59.198328+0000","last_peered":"2024-04-19T02:16:59.198328+0000","last_clean":"2024-04-19T02:16:59.198328+0000","last_became_active":"2024-04-19T02:15:29.279388+0000","last_became_peered":"2024-04-19T02:15:29.279388+0000","last_unstale":"2024-04-19T02:16:59.198328+0000","last_undegraded":"2024-04-19T02:16:59.198328+0000","last_fullsized":"2024-04-19T02:16:59.198328+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:36:48.819486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":40,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.196376+0000","last_change":"2024-04-19T02:15:53.955892+0000","last_active":"2024-04-19T02:16:59.196376+0000","last_peered":"2024-04-19T02:16:59.196376+0000","last_clean":"2024-04-19T02:16:59.196376+0000","last_became_active":"2024-04-19T02:15:53.955553+0000","last_became_peered":"2024-04-19T02:15:53.955553+0000","last_unstale":"2024-04-19T02:16:59.196376+0000","last_undegraded":"2024-04-19T02:16:59.196376+0000","last_fullsized":"2024-04-19T02:16:59.196376+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:45:39.791209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.196372+0000","last_change":"2024-04-19T02:15:29.283908+0000","last_active":"2024-04-19T02:16:59.196372+0000","last_peered":"2024-04-19T02:16:59.196372+0000","last_clean":"2024-04-19T02:16:59.196372+0000","last_became_active":"2024-04-19T02:15:29.281729+0000","last_became_peered":"2024-04-19T02:15:29.281729+0000","last_unstale":"2024-04-19T02:16:59.196372+0000","last_undegraded":"2024-04-19T02:16:59.196372+0000","last_fullsized":"2024-04-19T02:16:59.196372+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:03:15.383476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.196348+0000","last_change":"2024-04-19T02:15:29.281253+0000","last_active":"2024-04-19T02:16:59.196348+0000","last_peered":"2024-04-19T02:16:59.196348+0000","last_clean":"2024-04-19T02:16:59.196348+0000","last_became_active":"2024-04-19T02:15:29.279951+0000","last_became_peered":"2024-04-19T02:15:29.279951+0000","last_unstale":"2024-04-19T02:16:59.196348+0000","last_undegraded":"2024-04-19T02:16:59.196348+0000","last_fullsized":"2024-04-19T02:16:59.196348+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.196086+0000","last_change":"2024-04-19T02:15:29.283952+0000","last_active":"2024-04-19T02:16:59.196086+0000","last_peered":"2024-04-19T02:16:59.196086+0000","last_clean":"2024-04-19T02:16:59.196086+0000","last_became_active":"2024-04-19T02:15:29.282721+0000","last_became_peered":"2024-04-19T02:15:29.282721+0000","last_unstale":"2024-04-19T02:16:59.196086+0000","last_undegraded":"2024-04-19T02:16:59.196086+0000","last_fullsized":"2024-04-19T02:16:59.196086+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:02:45.301675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.195038+0000","last_change":"2024-04-19T02:15:29.282150+0000","last_active":"2024-04-19T02:16:59.195038+0000","last_peered":"2024-04-19T02:16:59.195038+0000","last_clean":"2024-04-19T02:16:59.195038+0000","last_became_active":"2024-04-19T02:15:29.281538+0000","last_became_peered":"2024-04-19T02:15:29.281538+0000","last_unstale":"2024-04-19T02:16:59.195038+0000","last_undegraded":"2024-04-19T02:16:59.195038+0000","last_fullsized":"2024-04-19T02:16:59.195038+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":23,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.196799+0000","last_change":"2024-04-19T02:16:30.093524+0000","last_active":"2024-04-19T02:16:59.196799+0000","last_peered":"2024-04-19T02:16:59.196799+0000","last_clean":"2024-04-19T02:16:59.196799+0000","last_became_active":"2024-04-19T02:16:30.093344+0000","last_became_peered":"2024-04-19T02:16:30.093344+0000","last_unstale":"2024-04-19T02:16:59.196799+0000","last_undegraded":"2024-04-19T02:16:59.196799+0000","last_fullsized":"2024-04-19T02:16:59.196799+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:14:40.293159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.197464+0000","last_change":"2024-04-19T02:15:29.280606+0000","last_active":"2024-04-19T02:16:59.197464+0000","last_peered":"2024-04-19T02:16:59.197464+0000","last_clean":"2024-04-19T02:16:59.197464+0000","last_became_active":"2024-04-19T02:15:29.280151+0000","last_became_peered":"2024-04-19T02:15:29.280151+0000","last_unstale":"2024-04-19T02:16:59.197464+0000","last_undegraded":"2024-04-19T02:16:59.197464+0000","last_fullsized":"2024-04-19T02:16:59.197464+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:26:22.452488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":40,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.198136+0000","last_change":"2024-04-19T02:15:53.958876+0000","last_active":"2024-04-19T02:16:59.198136+0000","last_peered":"2024-04-19T02:16:59.198136+0000","last_clean":"2024-04-19T02:16:59.198136+0000","last_became_active":"2024-04-19T02:15:53.958626+0000","last_became_peered":"2024-04-19T02:15:53.958626+0000","last_unstale":"2024-04-19T02:16:59.198136+0000","last_undegraded":"2024-04-19T02:16:59.198136+0000","last_fullsized":"2024-04-19T02:16:59.198136+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:23:57.044018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":40,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.194561+0000","last_change":"2024-04-19T02:15:53.956801+0000","last_active":"2024-04-19T02:16:59.194561+0000","last_peered":"2024-04-19T02:16:59.194561+0000","last_clean":"2024-04-19T02:16:59.194561+0000","last_became_active":"2024-04-19T02:15:53.956620+0000","last_became_peered":"2024-04-19T02:15:53.956620+0000","last_unstale":"2024-04-19T02:16:59.194561+0000","last_undegraded":"2024-04-19T02:16:59.194561+0000","last_fullsized":"2024-04-19T02:16:59.194561+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:57:05.843101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.196835+0000","last_change":"2024-04-19T02:15:29.284262+0000","last_active":"2024-04-19T02:16:59.196835+0000","last_peered":"2024-04-19T02:16:59.196835+0000","last_clean":"2024-04-19T02:16:59.196835+0000","last_became_active":"2024-04-19T02:15:29.283121+0000","last_became_peered":"2024-04-19T02:15:29.283121+0000","last_unstale":"2024-04-19T02:16:59.196835+0000","last_undegraded":"2024-04-19T02:16:59.196835+0000","last_fullsized":"2024-04-19T02:16:59.196835+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.196465+0000","last_change":"2024-04-19T02:15:29.285139+0000","last_active":"2024-04-19T02:16:59.196465+0000","last_peered":"2024-04-19T02:16:59.196465+0000","last_clean":"2024-04-19T02:16:59.196465+0000","last_became_active":"2024-04-19T02:15:29.284649+0000","last_became_peered":"2024-04-19T02:15:29.284649+0000","last_unstale":"2024-04-19T02:16:59.196465+0000","last_undegraded":"2024-04-19T02:16:59.196465+0000","last_fullsized":"2024-04-19T02:16:59.196465+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.196107+0000","last_change":"2024-04-19T02:15:29.283648+0000","last_active":"2024-04-19T02:16:59.196107+0000","last_peered":"2024-04-19T02:16:59.196107+0000","last_clean":"2024-04-19T02:16:59.196107+0000","last_became_active":"2024-04-19T02:15:29.281606+0000","last_became_peered":"2024-04-19T02:15:29.281606+0000","last_unstale":"2024-04-19T02:16:59.196107+0000","last_undegraded":"2024-04-19T02:16:59.196107+0000","last_fullsized":"2024-04-19T02:16:59.196107+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:20.850218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.195147+0000","last_change":"2024-04-19T02:15:29.278673+0000","last_active":"2024-04-19T02:16:59.195147+0000","last_peered":"2024-04-19T02:16:59.195147+0000","last_clean":"2024-04-19T02:16:59.195147+0000","last_became_active":"2024-04-19T02:15:29.277699+0000","last_became_peered":"2024-04-19T02:15:29.277699+0000","last_unstale":"2024-04-19T02:16:59.195147+0000","last_undegraded":"2024-04-19T02:16:59.195147+0000","last_fullsized":"2024-04-19T02:16:59.195147+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.189101+0000","last_change":"2024-04-19T02:15:29.283341+0000","last_active":"2024-04-19T02:16:59.189101+0000","last_peered":"2024-04-19T02:16:59.189101+0000","last_clean":"2024-04-19T02:16:59.189101+0000","last_became_active":"2024-04-19T02:15:29.281591+0000","last_became_peered":"2024-04-19T02:15:29.281591+0000","last_unstale":"2024-04-19T02:16:59.189101+0000","last_undegraded":"2024-04-19T02:16:59.189101+0000","last_fullsized":"2024-04-19T02:16:59.189101+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:34.593754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.195370+0000","last_change":"2024-04-19T02:15:29.282110+0000","last_active":"2024-04-19T02:16:59.195370+0000","last_peered":"2024-04-19T02:16:59.195370+0000","last_clean":"2024-04-19T02:16:59.195370+0000","last_became_active":"2024-04-19T02:15:29.281716+0000","last_became_peered":"2024-04-19T02:15:29.281716+0000","last_unstale":"2024-04-19T02:16:59.195370+0000","last_undegraded":"2024-04-19T02:16:59.195370+0000","last_fullsized":"2024-04-19T02:16:59.195370+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.198288+0000","last_change":"2024-04-19T02:15:29.285237+0000","last_active":"2024-04-19T02:16:59.198288+0000","last_peered":"2024-04-19T02:16:59.198288+0000","last_clean":"2024-04-19T02:16:59.198288+0000","last_became_active":"2024-04-19T02:15:29.282790+0000","last_became_peered":"2024-04-19T02:15:29.282790+0000","last_unstale":"2024-04-19T02:16:59.198288+0000","last_undegraded":"2024-04-19T02:16:59.198288+0000","last_fullsized":"2024-04-19T02:16:59.198288+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.196471+0000","last_change":"2024-04-19T02:15:29.282609+0000","last_active":"2024-04-19T02:16:59.196471+0000","last_peered":"2024-04-19T02:16:59.196471+0000","last_clean":"2024-04-19T02:16:59.196471+0000","last_became_active":"2024-04-19T02:15:29.281665+0000","last_became_peered":"2024-04-19T02:15:29.281665+0000","last_unstale":"2024-04-19T02:16:59.196471+0000","last_undegraded":"2024-04-19T02:16:59.196471+0000","last_fullsized":"2024-04-19T02:16:59.196471+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.384881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":40,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.196306+0000","last_change":"2024-04-19T02:15:53.955813+0000","last_active":"2024-04-19T02:16:59.196306+0000","last_peered":"2024-04-19T02:16:59.196306+0000","last_clean":"2024-04-19T02:16:59.196306+0000","last_became_active":"2024-04-19T02:15:53.955614+0000","last_became_peered":"2024-04-19T02:15:53.955614+0000","last_unstale":"2024-04-19T02:16:59.196306+0000","last_undegraded":"2024-04-19T02:16:59.196306+0000","last_fullsized":"2024-04-19T02:16:59.196306+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:58:03.192647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.194663+0000","last_change":"2024-04-19T02:15:29.277109+0000","last_active":"2024-04-19T02:16:59.194663+0000","last_peered":"2024-04-19T02:16:59.194663+0000","last_clean":"2024-04-19T02:16:59.194663+0000","last_became_active":"2024-04-19T02:15:29.275417+0000","last_became_peered":"2024-04-19T02:15:29.275417+0000","last_unstale":"2024-04-19T02:16:59.194663+0000","last_undegraded":"2024-04-19T02:16:59.194663+0000","last_fullsized":"2024-04-19T02:16:59.194663+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.188642+0000","last_change":"2024-04-19T02:15:29.283266+0000","last_active":"2024-04-19T02:16:59.188642+0000","last_peered":"2024-04-19T02:16:59.188642+0000","last_clean":"2024-04-19T02:16:59.188642+0000","last_became_active":"2024-04-19T02:15:29.281505+0000","last_became_peered":"2024-04-19T02:15:29.281505+0000","last_unstale":"2024-04-19T02:16:59.188642+0000","last_undegraded":"2024-04-19T02:16:59.188642+0000","last_fullsized":"2024-04-19T02:16:59.188642+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.189357+0000","last_change":"2024-04-19T02:15:29.278084+0000","last_active":"2024-04-19T02:16:59.189357+0000","last_peered":"2024-04-19T02:16:59.189357+0000","last_clean":"2024-04-19T02:16:59.189357+0000","last_became_active":"2024-04-19T02:15:29.276952+0000","last_became_peered":"2024-04-19T02:15:29.276952+0000","last_unstale":"2024-04-19T02:16:59.189357+0000","last_undegraded":"2024-04-19T02:16:59.189357+0000","last_fullsized":"2024-04-19T02:16:59.189357+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.195611+0000","last_change":"2024-04-19T02:15:29.279904+0000","last_active":"2024-04-19T02:16:59.195611+0000","last_peered":"2024-04-19T02:16:59.195611+0000","last_clean":"2024-04-19T02:16:59.195611+0000","last_became_active":"2024-04-19T02:15:29.278938+0000","last_became_peered":"2024-04-19T02:15:29.278938+0000","last_unstale":"2024-04-19T02:16:59.195611+0000","last_undegraded":"2024-04-19T02:16:59.195611+0000","last_fullsized":"2024-04-19T02:16:59.195611+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.197508+0000","last_change":"2024-04-19T02:15:29.287389+0000","last_active":"2024-04-19T02:16:59.197508+0000","last_peered":"2024-04-19T02:16:59.197508+0000","last_clean":"2024-04-19T02:16:59.197508+0000","last_became_active":"2024-04-19T02:15:29.286431+0000","last_became_peered":"2024-04-19T02:15:29.286431+0000","last_unstale":"2024-04-19T02:16:59.197508+0000","last_undegraded":"2024-04-19T02:16:59.197508+0000","last_fullsized":"2024-04-19T02:16:59.197508+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:58:30.117887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":40,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.194740+0000","last_change":"2024-04-19T02:15:53.959207+0000","last_active":"2024-04-19T02:16:59.194740+0000","last_peered":"2024-04-19T02:16:59.194740+0000","last_clean":"2024-04-19T02:16:59.194740+0000","last_became_active":"2024-04-19T02:15:53.959007+0000","last_became_peered":"2024-04-19T02:15:53.959007+0000","last_unstale":"2024-04-19T02:16:59.194740+0000","last_undegraded":"2024-04-19T02:16:59.194740+0000","last_fullsized":"2024-04-19T02:16:59.194740+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:08:21.065077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.189644+0000","last_change":"2024-04-19T02:15:29.281792+0000","last_active":"2024-04-19T02:16:59.189644+0000","last_peered":"2024-04-19T02:16:59.189644+0000","last_clean":"2024-04-19T02:16:59.189644+0000","last_became_active":"2024-04-19T02:15:29.280479+0000","last_became_peered":"2024-04-19T02:15:29.280479+0000","last_unstale":"2024-04-19T02:16:59.189644+0000","last_undegraded":"2024-04-19T02:16:59.189644+0000","last_fullsized":"2024-04-19T02:16:59.189644+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":42,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.194740+0000","last_change":"2024-04-19T02:15:28.888778+0000","last_active":"2024-04-19T02:16:59.194740+0000","last_peered":"2024-04-19T02:16:59.194740+0000","last_clean":"2024-04-19T02:16:59.194740+0000","last_became_active":"2024-04-19T02:15:28.888543+0000","last_became_peered":"2024-04-19T02:15:28.888543+0000","last_unstale":"2024-04-19T02:16:59.194740+0000","last_undegraded":"2024-04-19T02:16:59.194740+0000","last_fullsized":"2024-04-19T02:16:59.194740+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:43:51.221619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.195170+0000","last_change":"2024-04-19T02:15:29.279986+0000","last_active":"2024-04-19T02:16:59.195170+0000","last_peered":"2024-04-19T02:16:59.195170+0000","last_clean":"2024-04-19T02:16:59.195170+0000","last_became_active":"2024-04-19T02:15:29.279690+0000","last_became_peered":"2024-04-19T02:15:29.279690+0000","last_unstale":"2024-04-19T02:16:59.195170+0000","last_undegraded":"2024-04-19T02:16:59.195170+0000","last_fullsized":"2024-04-19T02:16:59.195170+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":42,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.196008+0000","last_change":"2024-04-19T02:15:28.890463+0000","last_active":"2024-04-19T02:16:59.196008+0000","last_peered":"2024-04-19T02:16:59.196008+0000","last_clean":"2024-04-19T02:16:59.196008+0000","last_became_active":"2024-04-19T02:15:28.889777+0000","last_became_peered":"2024-04-19T02:15:28.889777+0000","last_unstale":"2024-04-19T02:16:59.196008+0000","last_undegraded":"2024-04-19T02:16:59.196008+0000","last_fullsized":"2024-04-19T02:16:59.196008+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:58:21.520250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.189353+0000","last_change":"2024-04-19T02:15:29.280879+0000","last_active":"2024-04-19T02:16:59.189353+0000","last_peered":"2024-04-19T02:16:59.189353+0000","last_clean":"2024-04-19T02:16:59.189353+0000","last_became_active":"2024-04-19T02:15:29.279314+0000","last_became_peered":"2024-04-19T02:15:29.279314+0000","last_unstale":"2024-04-19T02:16:59.189353+0000","last_undegraded":"2024-04-19T02:16:59.189353+0000","last_fullsized":"2024-04-19T02:16:59.189353+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":42,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.196938+0000","last_change":"2024-04-19T02:15:28.891867+0000","last_active":"2024-04-19T02:16:59.196938+0000","last_peered":"2024-04-19T02:16:59.196938+0000","last_clean":"2024-04-19T02:16:59.196938+0000","last_became_active":"2024-04-19T02:15:28.890806+0000","last_became_peered":"2024-04-19T02:15:28.890806+0000","last_unstale":"2024-04-19T02:16:59.196938+0000","last_undegraded":"2024-04-19T02:16:59.196938+0000","last_fullsized":"2024-04-19T02:16:59.196938+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:57.946581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.195936+0000","last_change":"2024-04-19T02:15:29.278148+0000","last_active":"2024-04-19T02:16:59.195936+0000","last_peered":"2024-04-19T02:16:59.195936+0000","last_clean":"2024-04-19T02:16:59.195936+0000","last_became_active":"2024-04-19T02:15:29.277402+0000","last_became_peered":"2024-04-19T02:15:29.277402+0000","last_unstale":"2024-04-19T02:16:59.195936+0000","last_undegraded":"2024-04-19T02:16:59.195936+0000","last_fullsized":"2024-04-19T02:16:59.195936+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":42,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.196929+0000","last_change":"2024-04-19T02:15:28.892905+0000","last_active":"2024-04-19T02:16:59.196929+0000","last_peered":"2024-04-19T02:16:59.196929+0000","last_clean":"2024-04-19T02:16:59.196929+0000","last_became_active":"2024-04-19T02:15:28.892541+0000","last_became_peered":"2024-04-19T02:15:28.892541+0000","last_unstale":"2024-04-19T02:16:59.196929+0000","last_undegraded":"2024-04-19T02:16:59.196929+0000","last_fullsized":"2024-04-19T02:16:59.196929+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:33.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.194865+0000","last_change":"2024-04-19T02:15:29.278810+0000","last_active":"2024-04-19T02:16:59.194865+0000","last_peered":"2024-04-19T02:16:59.194865+0000","last_clean":"2024-04-19T02:16:59.194865+0000","last_became_active":"2024-04-19T02:15:29.278093+0000","last_became_peered":"2024-04-19T02:15:29.278093+0000","last_unstale":"2024-04-19T02:16:59.194865+0000","last_undegraded":"2024-04-19T02:16:59.194865+0000","last_fullsized":"2024-04-19T02:16:59.194865+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:34.883207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":45,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.189459+0000","last_change":"2024-04-19T02:15:28.892937+0000","last_active":"2024-04-19T02:16:59.189459+0000","last_peered":"2024-04-19T02:16:59.189459+0000","last_clean":"2024-04-19T02:16:59.189459+0000","last_became_active":"2024-04-19T02:15:28.891440+0000","last_became_peered":"2024-04-19T02:15:28.891440+0000","last_unstale":"2024-04-19T02:16:59.189459+0000","last_undegraded":"2024-04-19T02:16:59.189459+0000","last_fullsized":"2024-04-19T02:16:59.189459+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.194542+0000","last_change":"2024-04-19T02:15:29.278404+0000","last_active":"2024-04-19T02:16:59.194542+0000","last_peered":"2024-04-19T02:16:59.194542+0000","last_clean":"2024-04-19T02:16:59.194542+0000","last_became_active":"2024-04-19T02:15:29.277460+0000","last_became_peered":"2024-04-19T02:15:29.277460+0000","last_unstale":"2024-04-19T02:16:59.194542+0000","last_undegraded":"2024-04-19T02:16:59.194542+0000","last_fullsized":"2024-04-19T02:16:59.194542+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":48,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.198218+0000","last_change":"2024-04-19T02:15:28.891097+0000","last_active":"2024-04-19T02:16:59.198218+0000","last_peered":"2024-04-19T02:16:59.198218+0000","last_clean":"2024-04-19T02:16:59.198218+0000","last_became_active":"2024-04-19T02:15:28.890795+0000","last_became_peered":"2024-04-19T02:15:28.890795+0000","last_unstale":"2024-04-19T02:16:59.198218+0000","last_undegraded":"2024-04-19T02:16:59.198218+0000","last_fullsized":"2024-04-19T02:16:59.198218+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.196804+0000","last_change":"2024-04-19T02:15:29.278546+0000","last_active":"2024-04-19T02:16:59.196804+0000","last_peered":"2024-04-19T02:16:59.196804+0000","last_clean":"2024-04-19T02:16:59.196804+0000","last_became_active":"2024-04-19T02:15:29.277547+0000","last_became_peered":"2024-04-19T02:15:29.277547+0000","last_unstale":"2024-04-19T02:16:59.196804+0000","last_undegraded":"2024-04-19T02:16:59.196804+0000","last_fullsized":"2024-04-19T02:16:59.196804+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":44,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.196878+0000","last_change":"2024-04-19T02:15:28.892977+0000","last_active":"2024-04-19T02:16:59.196878+0000","last_peered":"2024-04-19T02:16:59.196878+0000","last_clean":"2024-04-19T02:16:59.196878+0000","last_became_active":"2024-04-19T02:15:28.892636+0000","last_became_peered":"2024-04-19T02:15:28.892636+0000","last_unstale":"2024-04-19T02:16:59.196878+0000","last_undegraded":"2024-04-19T02:16:59.196878+0000","last_fullsized":"2024-04-19T02:16:59.196878+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:43:51.221619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":40,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.194885+0000","last_change":"2024-04-19T02:15:53.955655+0000","last_active":"2024-04-19T02:16:59.194885+0000","last_peered":"2024-04-19T02:16:59.194885+0000","last_clean":"2024-04-19T02:16:59.194885+0000","last_became_active":"2024-04-19T02:15:53.955382+0000","last_became_peered":"2024-04-19T02:15:53.955382+0000","last_unstale":"2024-04-19T02:16:59.194885+0000","last_undegraded":"2024-04-19T02:16:59.194885+0000","last_fullsized":"2024-04-19T02:16:59.194885+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:48.239260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":42,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.194661+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:16:59.194661+0000","last_peered":"2024-04-19T02:16:59.194661+0000","last_clean":"2024-04-19T02:16:59.194661+0000","last_became_active":"2024-04-19T02:15:28.890751+0000","last_became_peered":"2024-04-19T02:15:28.890751+0000","last_unstale":"2024-04-19T02:16:59.194661+0000","last_undegraded":"2024-04-19T02:16:59.194661+0000","last_fullsized":"2024-04-19T02:16:59.194661+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":40,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.194632+0000","last_change":"2024-04-19T02:15:53.957865+0000","last_active":"2024-04-19T02:16:59.194632+0000","last_peered":"2024-04-19T02:16:59.194632+0000","last_clean":"2024-04-19T02:16:59.194632+0000","last_became_active":"2024-04-19T02:15:53.957627+0000","last_became_peered":"2024-04-19T02:15:53.957627+0000","last_unstale":"2024-04-19T02:16:59.194632+0000","last_undegraded":"2024-04-19T02:16:59.194632+0000","last_fullsized":"2024-04-19T02:16:59.194632+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:16:45.799016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":42,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.188603+0000","last_change":"2024-04-19T02:15:28.892934+0000","last_active":"2024-04-19T02:16:59.188603+0000","last_peered":"2024-04-19T02:16:59.188603+0000","last_clean":"2024-04-19T02:16:59.188603+0000","last_became_active":"2024-04-19T02:15:28.891879+0000","last_became_peered":"2024-04-19T02:15:28.891879+0000","last_unstale":"2024-04-19T02:16:59.188603+0000","last_undegraded":"2024-04-19T02:16:59.188603+0000","last_fullsized":"2024-04-19T02:16:59.188603+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:10:12.514798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.195382+0000","last_change":"2024-04-19T02:15:29.279685+0000","last_active":"2024-04-19T02:16:59.195382+0000","last_peered":"2024-04-19T02:16:59.195382+0000","last_clean":"2024-04-19T02:16:59.195382+0000","last_became_active":"2024-04-19T02:15:29.278810+0000","last_became_peered":"2024-04-19T02:15:29.278810+0000","last_unstale":"2024-04-19T02:16:59.195382+0000","last_undegraded":"2024-04-19T02:16:59.195382+0000","last_fullsized":"2024-04-19T02:16:59.195382+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":50,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.196713+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:16:59.196713+0000","last_peered":"2024-04-19T02:16:59.196713+0000","last_clean":"2024-04-19T02:16:59.196713+0000","last_became_active":"2024-04-19T02:15:28.890882+0000","last_became_peered":"2024-04-19T02:15:28.890882+0000","last_unstale":"2024-04-19T02:16:59.196713+0000","last_undegraded":"2024-04-19T02:16:59.196713+0000","last_fullsized":"2024-04-19T02:16:59.196713+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:31.673938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.197085+0000","last_change":"2024-04-19T02:15:29.284258+0000","last_active":"2024-04-19T02:16:59.197085+0000","last_peered":"2024-04-19T02:16:59.197085+0000","last_clean":"2024-04-19T02:16:59.197085+0000","last_became_active":"2024-04-19T02:15:29.283995+0000","last_became_peered":"2024-04-19T02:15:29.283995+0000","last_unstale":"2024-04-19T02:16:59.197085+0000","last_undegraded":"2024-04-19T02:16:59.197085+0000","last_fullsized":"2024-04-19T02:16:59.197085+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:35.941308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"46'9519","reported_seq":9557,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-19T02:17:02.813973+0000","last_change":"2024-04-19T02:15:53.956977+0000","last_active":"2024-04-19T02:17:02.813973+0000","last_peered":"2024-04-19T02:17:02.813973+0000","last_clean":"2024-04-19T02:17:02.813973+0000","last_became_active":"2024-04-19T02:15:53.956730+0000","last_became_peered":"2024-04-19T02:15:53.956730+0000","last_unstale":"2024-04-19T02:17:02.813973+0000","last_undegraded":"2024-04-19T02:17:02.813973+0000","last_fullsized":"2024-04-19T02:17:02.813973+0000","mapping_epoch":16,"log_start":"34'5800","ondisk_log_start":"34'5800","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3719,"log_dups_size":0,"ondisk_log_size":3719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:56:46.323499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":491716608,"num_objects":7503,"num_object_clones":0,"num_object_copies":15006,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7503,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9519,"num_write_kb":544704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":43,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.197455+0000","last_change":"2024-04-19T02:15:28.890265+0000","last_active":"2024-04-19T02:16:59.197455+0000","last_peered":"2024-04-19T02:16:59.197455+0000","last_clean":"2024-04-19T02:16:59.197455+0000","last_became_active":"2024-04-19T02:15:28.890004+0000","last_became_peered":"2024-04-19T02:15:28.890004+0000","last_unstale":"2024-04-19T02:16:59.197455+0000","last_undegraded":"2024-04-19T02:16:59.197455+0000","last_fullsized":"2024-04-19T02:16:59.197455+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:02.517101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.188470+0000","last_change":"2024-04-19T02:15:29.285529+0000","last_active":"2024-04-19T02:16:59.188470+0000","last_peered":"2024-04-19T02:16:59.188470+0000","last_clean":"2024-04-19T02:16:59.188470+0000","last_became_active":"2024-04-19T02:15:29.285197+0000","last_became_peered":"2024-04-19T02:15:29.285197+0000","last_unstale":"2024-04-19T02:16:59.188470+0000","last_undegraded":"2024-04-19T02:16:59.188470+0000","last_fullsized":"2024-04-19T02:16:59.188470+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"46'9466","reported_seq":9504,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-19T02:17:02.775234+0000","last_change":"2024-04-19T02:15:53.958523+0000","last_active":"2024-04-19T02:17:02.775234+0000","last_peered":"2024-04-19T02:17:02.775234+0000","last_clean":"2024-04-19T02:17:02.775234+0000","last_became_active":"2024-04-19T02:15:53.957627+0000","last_became_peered":"2024-04-19T02:15:53.957627+0000","last_unstale":"2024-04-19T02:17:02.775234+0000","last_undegraded":"2024-04-19T02:17:02.775234+0000","last_fullsized":"2024-04-19T02:17:02.775234+0000","mapping_epoch":16,"log_start":"33'5547","ondisk_log_start":"33'5547","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3919,"log_dups_size":0,"ondisk_log_size":3919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:59:55.120296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":487981056,"num_objects":7446,"num_object_clones":0,"num_object_copies":14892,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7446,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9466,"num_write_kb":541184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":44,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.188958+0000","last_change":"2024-04-19T02:15:28.893902+0000","last_active":"2024-04-19T02:16:59.188958+0000","last_peered":"2024-04-19T02:16:59.188958+0000","last_clean":"2024-04-19T02:16:59.188958+0000","last_became_active":"2024-04-19T02:15:28.893231+0000","last_became_peered":"2024-04-19T02:15:28.893231+0000","last_unstale":"2024-04-19T02:16:59.188958+0000","last_undegraded":"2024-04-19T02:16:59.188958+0000","last_fullsized":"2024-04-19T02:16:59.188958+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:23.658442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.189030+0000","last_change":"2024-04-19T02:15:29.282874+0000","last_active":"2024-04-19T02:16:59.189030+0000","last_peered":"2024-04-19T02:16:59.189030+0000","last_clean":"2024-04-19T02:16:59.189030+0000","last_became_active":"2024-04-19T02:15:29.281675+0000","last_became_peered":"2024-04-19T02:15:29.281675+0000","last_unstale":"2024-04-19T02:16:59.189030+0000","last_undegraded":"2024-04-19T02:16:59.189030+0000","last_fullsized":"2024-04-19T02:16:59.189030+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:35.941308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"46'9396","reported_seq":9434,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-19T02:17:02.761910+0000","last_change":"2024-04-19T02:15:53.958324+0000","last_active":"2024-04-19T02:17:02.761910+0000","last_peered":"2024-04-19T02:17:02.761910+0000","last_clean":"2024-04-19T02:17:02.761910+0000","last_became_active":"2024-04-19T02:15:53.957392+0000","last_became_peered":"2024-04-19T02:15:53.957392+0000","last_unstale":"2024-04-19T02:17:02.761910+0000","last_undegraded":"2024-04-19T02:17:02.761910+0000","last_fullsized":"2024-04-19T02:17:02.761910+0000","mapping_epoch":16,"log_start":"33'5400","ondisk_log_start":"33'5400","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3996,"log_dups_size":0,"ondisk_log_size":3996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:12:58.132969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":479461376,"num_objects":7316,"num_object_clones":0,"num_object_copies":14632,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7316,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9396,"num_write_kb":534784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":43,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.197514+0000","last_change":"2024-04-19T02:15:28.891234+0000","last_active":"2024-04-19T02:16:59.197514+0000","last_peered":"2024-04-19T02:16:59.197514+0000","last_clean":"2024-04-19T02:16:59.197514+0000","last_became_active":"2024-04-19T02:15:28.890881+0000","last_became_peered":"2024-04-19T02:15:28.890881+0000","last_unstale":"2024-04-19T02:16:59.197514+0000","last_undegraded":"2024-04-19T02:16:59.197514+0000","last_fullsized":"2024-04-19T02:16:59.197514+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.196580+0000","last_change":"2024-04-19T02:15:29.281937+0000","last_active":"2024-04-19T02:16:59.196580+0000","last_peered":"2024-04-19T02:16:59.196580+0000","last_clean":"2024-04-19T02:16:59.196580+0000","last_became_active":"2024-04-19T02:15:29.280727+0000","last_became_peered":"2024-04-19T02:15:29.280727+0000","last_unstale":"2024-04-19T02:16:59.196580+0000","last_undegraded":"2024-04-19T02:16:59.196580+0000","last_fullsized":"2024-04-19T02:16:59.196580+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"46'9534","reported_seq":9572,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-19T02:17:02.799926+0000","last_change":"2024-04-19T02:15:53.959099+0000","last_active":"2024-04-19T02:17:02.799926+0000","last_peered":"2024-04-19T02:17:02.799926+0000","last_clean":"2024-04-19T02:17:02.799926+0000","last_became_active":"2024-04-19T02:15:53.958885+0000","last_became_peered":"2024-04-19T02:15:53.958885+0000","last_unstale":"2024-04-19T02:17:02.799926+0000","last_undegraded":"2024-04-19T02:17:02.799926+0000","last_fullsized":"2024-04-19T02:17:02.799926+0000","mapping_epoch":16,"log_start":"34'5900","ondisk_log_start":"34'5900","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3634,"log_dups_size":0,"ondisk_log_size":3634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:53:26.969927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":489684992,"num_objects":7472,"num_object_clones":0,"num_object_copies":14944,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7472,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9534,"num_write_kb":544192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":42,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.198093+0000","last_change":"2024-04-19T02:15:28.892767+0000","last_active":"2024-04-19T02:16:59.198093+0000","last_peered":"2024-04-19T02:16:59.198093+0000","last_clean":"2024-04-19T02:16:59.198093+0000","last_became_active":"2024-04-19T02:15:28.892235+0000","last_became_peered":"2024-04-19T02:15:28.892235+0000","last_unstale":"2024-04-19T02:16:59.198093+0000","last_undegraded":"2024-04-19T02:16:59.198093+0000","last_fullsized":"2024-04-19T02:16:59.198093+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:37.690735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.196538+0000","last_change":"2024-04-19T02:15:29.279857+0000","last_active":"2024-04-19T02:16:59.196538+0000","last_peered":"2024-04-19T02:16:59.196538+0000","last_clean":"2024-04-19T02:16:59.196538+0000","last_became_active":"2024-04-19T02:15:29.279536+0000","last_became_peered":"2024-04-19T02:15:29.279536+0000","last_unstale":"2024-04-19T02:16:59.196538+0000","last_undegraded":"2024-04-19T02:16:59.196538+0000","last_fullsized":"2024-04-19T02:16:59.196538+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:00.191179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"46'9379","reported_seq":9418,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-19T02:17:02.817518+0000","last_change":"2024-04-19T02:15:53.957261+0000","last_active":"2024-04-19T02:17:02.817518+0000","last_peered":"2024-04-19T02:17:02.817518+0000","last_clean":"2024-04-19T02:17:02.817518+0000","last_became_active":"2024-04-19T02:15:53.957092+0000","last_became_peered":"2024-04-19T02:15:53.957092+0000","last_unstale":"2024-04-19T02:17:02.817518+0000","last_undegraded":"2024-04-19T02:17:02.817518+0000","last_fullsized":"2024-04-19T02:17:02.817518+0000","mapping_epoch":16,"log_start":"34'5713","ondisk_log_start":"34'5713","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3666,"log_dups_size":0,"ondisk_log_size":3666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:54:15.544923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":483655704,"num_objects":7381,"num_object_clones":0,"num_object_copies":14762,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7381,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9379,"num_write_kb":536257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":44,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.196501+0000","last_change":"2024-04-19T02:15:28.891611+0000","last_active":"2024-04-19T02:16:59.196501+0000","last_peered":"2024-04-19T02:16:59.196501+0000","last_clean":"2024-04-19T02:16:59.196501+0000","last_became_active":"2024-04-19T02:15:28.890914+0000","last_became_peered":"2024-04-19T02:15:28.890914+0000","last_unstale":"2024-04-19T02:16:59.196501+0000","last_undegraded":"2024-04-19T02:16:59.196501+0000","last_fullsized":"2024-04-19T02:16:59.196501+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:37.690735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.198138+0000","last_change":"2024-04-19T02:15:29.285774+0000","last_active":"2024-04-19T02:16:59.198138+0000","last_peered":"2024-04-19T02:16:59.198138+0000","last_clean":"2024-04-19T02:16:59.198138+0000","last_became_active":"2024-04-19T02:15:29.284705+0000","last_became_peered":"2024-04-19T02:15:29.284705+0000","last_unstale":"2024-04-19T02:16:59.198138+0000","last_undegraded":"2024-04-19T02:16:59.198138+0000","last_fullsized":"2024-04-19T02:16:59.198138+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:36.848188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"46'9404","reported_seq":9442,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-19T02:17:02.819766+0000","last_change":"2024-04-19T02:15:53.955286+0000","last_active":"2024-04-19T02:17:02.819766+0000","last_peered":"2024-04-19T02:17:02.819766+0000","last_clean":"2024-04-19T02:17:02.819766+0000","last_became_active":"2024-04-19T02:15:53.955026+0000","last_became_peered":"2024-04-19T02:15:53.955026+0000","last_unstale":"2024-04-19T02:17:02.819766+0000","last_undegraded":"2024-04-19T02:17:02.819766+0000","last_fullsized":"2024-04-19T02:17:02.819766+0000","mapping_epoch":16,"log_start":"34'5800","ondisk_log_start":"34'5800","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3604,"log_dups_size":0,"ondisk_log_size":3604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:05:48.594301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":484442112,"num_objects":7392,"num_object_clones":0,"num_object_copies":14784,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7392,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9404,"num_write_kb":537472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":42,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.196431+0000","last_change":"2024-04-19T02:15:28.892873+0000","last_active":"2024-04-19T02:16:59.196431+0000","last_peered":"2024-04-19T02:16:59.196431+0000","last_clean":"2024-04-19T02:16:59.196431+0000","last_became_active":"2024-04-19T02:15:28.892487+0000","last_became_peered":"2024-04-19T02:15:28.892487+0000","last_unstale":"2024-04-19T02:16:59.196431+0000","last_undegraded":"2024-04-19T02:16:59.196431+0000","last_fullsized":"2024-04-19T02:16:59.196431+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:35.412837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.197668+0000","last_change":"2024-04-19T02:15:29.285019+0000","last_active":"2024-04-19T02:16:59.197668+0000","last_peered":"2024-04-19T02:16:59.197668+0000","last_clean":"2024-04-19T02:16:59.197668+0000","last_became_active":"2024-04-19T02:15:29.284650+0000","last_became_peered":"2024-04-19T02:15:29.284650+0000","last_unstale":"2024-04-19T02:16:59.197668+0000","last_undegraded":"2024-04-19T02:16:59.197668+0000","last_fullsized":"2024-04-19T02:16:59.197668+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"46'9424","reported_seq":9460,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-19T02:17:02.824543+0000","last_change":"2024-04-19T02:15:53.957403+0000","last_active":"2024-04-19T02:17:02.824543+0000","last_peered":"2024-04-19T02:17:02.824543+0000","last_clean":"2024-04-19T02:17:02.824543+0000","last_became_active":"2024-04-19T02:15:53.957190+0000","last_became_peered":"2024-04-19T02:15:53.957190+0000","last_unstale":"2024-04-19T02:17:02.824543+0000","last_undegraded":"2024-04-19T02:17:02.824543+0000","last_fullsized":"2024-04-19T02:17:02.824543+0000","mapping_epoch":16,"log_start":"34'5701","ondisk_log_start":"34'5701","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3723,"log_dups_size":0,"ondisk_log_size":3723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:07:12.817884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":488243200,"num_objects":7450,"num_object_clones":0,"num_object_copies":14900,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7450,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9424,"num_write_kb":539968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":40,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.196271+0000","last_change":"2024-04-19T02:15:53.956839+0000","last_active":"2024-04-19T02:16:59.196271+0000","last_peered":"2024-04-19T02:16:59.196271+0000","last_clean":"2024-04-19T02:16:59.196271+0000","last_became_active":"2024-04-19T02:15:53.956630+0000","last_became_peered":"2024-04-19T02:15:53.956630+0000","last_unstale":"2024-04-19T02:16:59.196271+0000","last_undegraded":"2024-04-19T02:16:59.196271+0000","last_fullsized":"2024-04-19T02:16:59.196271+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:47.229730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.196965+0000","last_change":"2024-04-19T02:15:29.287190+0000","last_active":"2024-04-19T02:16:59.196965+0000","last_peered":"2024-04-19T02:16:59.196965+0000","last_clean":"2024-04-19T02:16:59.196965+0000","last_became_active":"2024-04-19T02:15:29.286606+0000","last_became_peered":"2024-04-19T02:15:29.286606+0000","last_unstale":"2024-04-19T02:16:59.196965+0000","last_undegraded":"2024-04-19T02:16:59.196965+0000","last_fullsized":"2024-04-19T02:16:59.196965+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:28.387062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"46'9182","reported_seq":9220,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-19T02:17:02.784411+0000","last_change":"2024-04-19T02:15:53.958448+0000","last_active":"2024-04-19T02:17:02.784411+0000","last_peered":"2024-04-19T02:17:02.784411+0000","last_clean":"2024-04-19T02:17:02.784411+0000","last_became_active":"2024-04-19T02:15:53.957595+0000","last_became_peered":"2024-04-19T02:15:53.957595+0000","last_unstale":"2024-04-19T02:17:02.784411+0000","last_undegraded":"2024-04-19T02:17:02.784411+0000","last_fullsized":"2024-04-19T02:17:02.784411+0000","mapping_epoch":16,"log_start":"33'5244","ondisk_log_start":"33'5244","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3938,"log_dups_size":0,"ondisk_log_size":3938,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:26:31.855319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":477757440,"num_objects":7290,"num_object_clones":0,"num_object_copies":14580,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7290,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9182,"num_write_kb":527104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":42,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.188705+0000","last_change":"2024-04-19T02:15:28.894121+0000","last_active":"2024-04-19T02:16:59.188705+0000","last_peered":"2024-04-19T02:16:59.188705+0000","last_clean":"2024-04-19T02:16:59.188705+0000","last_became_active":"2024-04-19T02:15:28.893902+0000","last_became_peered":"2024-04-19T02:15:28.893902+0000","last_unstale":"2024-04-19T02:16:59.188705+0000","last_undegraded":"2024-04-19T02:16:59.188705+0000","last_fullsized":"2024-04-19T02:16:59.188705+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:10:35.146583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.195252+0000","last_change":"2024-04-19T02:15:29.282870+0000","last_active":"2024-04-19T02:16:59.195252+0000","last_peered":"2024-04-19T02:16:59.195252+0000","last_clean":"2024-04-19T02:16:59.195252+0000","last_became_active":"2024-04-19T02:15:29.281873+0000","last_became_peered":"2024-04-19T02:15:29.281873+0000","last_unstale":"2024-04-19T02:16:59.195252+0000","last_undegraded":"2024-04-19T02:16:59.195252+0000","last_fullsized":"2024-04-19T02:16:59.195252+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"46'9388","reported_seq":9426,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-19T02:17:02.803830+0000","last_change":"2024-04-19T02:15:53.955498+0000","last_active":"2024-04-19T02:17:02.803830+0000","last_peered":"2024-04-19T02:17:02.803830+0000","last_clean":"2024-04-19T02:17:02.803830+0000","last_became_active":"2024-04-19T02:15:53.954910+0000","last_became_peered":"2024-04-19T02:15:53.954910+0000","last_unstale":"2024-04-19T02:17:02.803830+0000","last_undegraded":"2024-04-19T02:17:02.803830+0000","last_fullsized":"2024-04-19T02:17:02.803830+0000","mapping_epoch":16,"log_start":"34'5800","ondisk_log_start":"34'5800","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3588,"log_dups_size":0,"ondisk_log_size":3588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:58:27.262672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":480509952,"num_objects":7332,"num_object_clones":0,"num_object_copies":14664,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7332,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9388,"num_write_kb":535040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.195863+0000","last_change":"2024-04-19T02:15:24.527061+0000","last_active":"2024-04-19T02:16:59.195863+0000","last_peered":"2024-04-19T02:16:59.195863+0000","last_clean":"2024-04-19T02:16:59.195863+0000","last_became_active":"2024-04-19T02:15:24.526757+0000","last_became_peered":"2024-04-19T02:15:24.526757+0000","last_unstale":"2024-04-19T02:16:59.195863+0000","last_undegraded":"2024-04-19T02:16:59.195863+0000","last_fullsized":"2024-04-19T02:16:59.195863+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:17:13.649077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":42,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.197570+0000","last_change":"2024-04-19T02:15:28.892766+0000","last_active":"2024-04-19T02:16:59.197570+0000","last_peered":"2024-04-19T02:16:59.197570+0000","last_clean":"2024-04-19T02:16:59.197570+0000","last_became_active":"2024-04-19T02:15:28.892396+0000","last_became_peered":"2024-04-19T02:15:28.892396+0000","last_unstale":"2024-04-19T02:16:59.197570+0000","last_undegraded":"2024-04-19T02:16:59.197570+0000","last_fullsized":"2024-04-19T02:16:59.197570+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:57.946581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.188835+0000","last_change":"2024-04-19T02:15:29.277922+0000","last_active":"2024-04-19T02:16:59.188835+0000","last_peered":"2024-04-19T02:16:59.188835+0000","last_clean":"2024-04-19T02:16:59.188835+0000","last_became_active":"2024-04-19T02:15:29.276968+0000","last_became_peered":"2024-04-19T02:15:29.276968+0000","last_unstale":"2024-04-19T02:16:59.188835+0000","last_undegraded":"2024-04-19T02:16:59.188835+0000","last_fullsized":"2024-04-19T02:16:59.188835+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"46'9400","reported_seq":9438,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-19T02:17:02.795302+0000","last_change":"2024-04-19T02:15:53.955228+0000","last_active":"2024-04-19T02:17:02.795302+0000","last_peered":"2024-04-19T02:17:02.795302+0000","last_clean":"2024-04-19T02:17:02.795302+0000","last_became_active":"2024-04-19T02:15:53.954960+0000","last_became_peered":"2024-04-19T02:15:53.954960+0000","last_unstale":"2024-04-19T02:17:02.795302+0000","last_undegraded":"2024-04-19T02:17:02.795302+0000","last_fullsized":"2024-04-19T02:17:02.795302+0000","mapping_epoch":16,"log_start":"34'5800","ondisk_log_start":"34'5800","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3600,"log_dups_size":0,"ondisk_log_size":3600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:46:07.409922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":486014976,"num_objects":7416,"num_object_clones":0,"num_object_copies":14832,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7416,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9400,"num_write_kb":538112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.196759+0000","last_change":"2024-04-19T02:15:24.530933+0000","last_active":"2024-04-19T02:16:59.196759+0000","last_peered":"2024-04-19T02:16:59.196759+0000","last_clean":"2024-04-19T02:16:59.196759+0000","last_became_active":"2024-04-19T02:15:24.530550+0000","last_became_peered":"2024-04-19T02:15:24.530550+0000","last_unstale":"2024-04-19T02:16:59.196759+0000","last_undegraded":"2024-04-19T02:16:59.196759+0000","last_fullsized":"2024-04-19T02:16:59.196759+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:18:15.194321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":42,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.196656+0000","last_change":"2024-04-19T02:15:28.893062+0000","last_active":"2024-04-19T02:16:59.196656+0000","last_peered":"2024-04-19T02:16:59.196656+0000","last_clean":"2024-04-19T02:16:59.196656+0000","last_became_active":"2024-04-19T02:15:28.892798+0000","last_became_peered":"2024-04-19T02:15:28.892798+0000","last_unstale":"2024-04-19T02:16:59.196656+0000","last_undegraded":"2024-04-19T02:16:59.196656+0000","last_fullsized":"2024-04-19T02:16:59.196656+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:53.170180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.195660+0000","last_change":"2024-04-19T02:15:29.278294+0000","last_active":"2024-04-19T02:16:59.195660+0000","last_peered":"2024-04-19T02:16:59.195660+0000","last_clean":"2024-04-19T02:16:59.195660+0000","last_became_active":"2024-04-19T02:15:29.277536+0000","last_became_peered":"2024-04-19T02:15:29.277536+0000","last_unstale":"2024-04-19T02:16:59.195660+0000","last_undegraded":"2024-04-19T02:16:59.195660+0000","last_fullsized":"2024-04-19T02:16:59.195660+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"46'9443","reported_seq":9481,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-19T02:17:02.812392+0000","last_change":"2024-04-19T02:15:53.956251+0000","last_active":"2024-04-19T02:17:02.812392+0000","last_peered":"2024-04-19T02:17:02.812392+0000","last_clean":"2024-04-19T02:17:02.812392+0000","last_became_active":"2024-04-19T02:15:53.955886+0000","last_became_peered":"2024-04-19T02:15:53.955886+0000","last_unstale":"2024-04-19T02:17:02.812392+0000","last_undegraded":"2024-04-19T02:17:02.812392+0000","last_fullsized":"2024-04-19T02:17:02.812392+0000","mapping_epoch":16,"log_start":"34'5800","ondisk_log_start":"34'5800","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3643,"log_dups_size":0,"ondisk_log_size":3643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:38:38.586906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":488964096,"num_objects":7461,"num_object_clones":0,"num_object_copies":14922,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7461,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9443,"num_write_kb":540928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.194819+0000","last_change":"2024-04-19T02:15:24.527048+0000","last_active":"2024-04-19T02:16:59.194819+0000","last_peered":"2024-04-19T02:16:59.194819+0000","last_clean":"2024-04-19T02:16:59.194819+0000","last_became_active":"2024-04-19T02:15:24.526790+0000","last_became_peered":"2024-04-19T02:15:24.526790+0000","last_unstale":"2024-04-19T02:16:59.194819+0000","last_undegraded":"2024-04-19T02:16:59.194819+0000","last_fullsized":"2024-04-19T02:16:59.194819+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":40,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.196011+0000","last_change":"2024-04-19T02:15:53.956945+0000","last_active":"2024-04-19T02:16:59.196011+0000","last_peered":"2024-04-19T02:16:59.196011+0000","last_clean":"2024-04-19T02:16:59.196011+0000","last_became_active":"2024-04-19T02:15:53.956719+0000","last_became_peered":"2024-04-19T02:15:53.956719+0000","last_unstale":"2024-04-19T02:16:59.196011+0000","last_undegraded":"2024-04-19T02:16:59.196011+0000","last_fullsized":"2024-04-19T02:16:59.196011+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:00:37.754624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.197014+0000","last_change":"2024-04-19T02:15:29.282663+0000","last_active":"2024-04-19T02:16:59.197014+0000","last_peered":"2024-04-19T02:16:59.197014+0000","last_clean":"2024-04-19T02:16:59.197014+0000","last_became_active":"2024-04-19T02:15:29.282217+0000","last_became_peered":"2024-04-19T02:15:29.282217+0000","last_unstale":"2024-04-19T02:16:59.197014+0000","last_undegraded":"2024-04-19T02:16:59.197014+0000","last_fullsized":"2024-04-19T02:16:59.197014+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"46'9299","reported_seq":9335,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-19T02:17:02.790846+0000","last_change":"2024-04-19T02:15:53.958264+0000","last_active":"2024-04-19T02:17:02.790846+0000","last_peered":"2024-04-19T02:17:02.790846+0000","last_clean":"2024-04-19T02:17:02.790846+0000","last_became_active":"2024-04-19T02:15:53.956689+0000","last_became_peered":"2024-04-19T02:15:53.956689+0000","last_unstale":"2024-04-19T02:17:02.790846+0000","last_undegraded":"2024-04-19T02:17:02.790846+0000","last_fullsized":"2024-04-19T02:17:02.790846+0000","mapping_epoch":16,"log_start":"33'5400","ondisk_log_start":"33'5400","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3899,"log_dups_size":0,"ondisk_log_size":3899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:24:32.928594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":479264768,"num_objects":7313,"num_object_clones":0,"num_object_copies":14626,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7313,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9299,"num_write_kb":531584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.196666+0000","last_change":"2024-04-19T02:15:24.530924+0000","last_active":"2024-04-19T02:16:59.196666+0000","last_peered":"2024-04-19T02:16:59.196666+0000","last_clean":"2024-04-19T02:16:59.196666+0000","last_became_active":"2024-04-19T02:15:24.530551+0000","last_became_peered":"2024-04-19T02:15:24.530551+0000","last_unstale":"2024-04-19T02:16:59.196666+0000","last_undegraded":"2024-04-19T02:16:59.196666+0000","last_fullsized":"2024-04-19T02:16:59.196666+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:30.576946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":241,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.196177+0000","last_change":"2024-04-19T02:15:24.533634+0000","last_active":"2024-04-19T02:16:59.196177+0000","last_peered":"2024-04-19T02:16:59.196177+0000","last_clean":"2024-04-19T02:16:59.196177+0000","last_became_active":"2024-04-19T02:15:24.533420+0000","last_became_peered":"2024-04-19T02:15:24.533420+0000","last_unstale":"2024-04-19T02:16:59.196177+0000","last_undegraded":"2024-04-19T02:16:59.196177+0000","last_fullsized":"2024-04-19T02:16:59.196177+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":42,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.194468+0000","last_change":"2024-04-19T02:15:28.890244+0000","last_active":"2024-04-19T02:16:59.194468+0000","last_peered":"2024-04-19T02:16:59.194468+0000","last_clean":"2024-04-19T02:16:59.194468+0000","last_became_active":"2024-04-19T02:15:28.889831+0000","last_became_peered":"2024-04-19T02:15:28.889831+0000","last_unstale":"2024-04-19T02:16:59.194468+0000","last_undegraded":"2024-04-19T02:16:59.194468+0000","last_fullsized":"2024-04-19T02:16:59.194468+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.197620+0000","last_change":"2024-04-19T02:15:29.285015+0000","last_active":"2024-04-19T02:16:59.197620+0000","last_peered":"2024-04-19T02:16:59.197620+0000","last_clean":"2024-04-19T02:16:59.197620+0000","last_became_active":"2024-04-19T02:15:29.284164+0000","last_became_peered":"2024-04-19T02:15:29.284164+0000","last_unstale":"2024-04-19T02:16:59.197620+0000","last_undegraded":"2024-04-19T02:16:59.197620+0000","last_fullsized":"2024-04-19T02:16:59.197620+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:36.987844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"46'9333","reported_seq":9371,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-19T02:17:02.813460+0000","last_change":"2024-04-19T02:15:53.956463+0000","last_active":"2024-04-19T02:17:02.813460+0000","last_peered":"2024-04-19T02:17:02.813460+0000","last_clean":"2024-04-19T02:17:02.813460+0000","last_became_active":"2024-04-19T02:15:53.955819+0000","last_became_peered":"2024-04-19T02:15:53.955819+0000","last_unstale":"2024-04-19T02:17:02.813460+0000","last_undegraded":"2024-04-19T02:17:02.813460+0000","last_fullsized":"2024-04-19T02:17:02.813460+0000","mapping_epoch":16,"log_start":"34'5631","ondisk_log_start":"34'5631","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3702,"log_dups_size":0,"ondisk_log_size":3702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:46:07.409922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482934784,"num_objects":7369,"num_object_clones":0,"num_object_copies":14738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7369,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9333,"num_write_kb":534464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.196176+0000","last_change":"2024-04-19T02:15:24.533912+0000","last_active":"2024-04-19T02:16:59.196176+0000","last_peered":"2024-04-19T02:16:59.196176+0000","last_clean":"2024-04-19T02:16:59.196176+0000","last_became_active":"2024-04-19T02:15:24.533580+0000","last_became_peered":"2024-04-19T02:15:24.533580+0000","last_unstale":"2024-04-19T02:16:59.196176+0000","last_undegraded":"2024-04-19T02:16:59.196176+0000","last_fullsized":"2024-04-19T02:16:59.196176+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:45.045477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":42,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.194526+0000","last_change":"2024-04-19T02:15:28.891889+0000","last_active":"2024-04-19T02:16:59.194526+0000","last_peered":"2024-04-19T02:16:59.194526+0000","last_clean":"2024-04-19T02:16:59.194526+0000","last_became_active":"2024-04-19T02:15:28.890919+0000","last_became_peered":"2024-04-19T02:15:28.890919+0000","last_unstale":"2024-04-19T02:16:59.194526+0000","last_undegraded":"2024-04-19T02:16:59.194526+0000","last_fullsized":"2024-04-19T02:16:59.194526+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:35.412837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":40,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.195420+0000","last_change":"2024-04-19T02:15:53.957881+0000","last_active":"2024-04-19T02:16:59.195420+0000","last_peered":"2024-04-19T02:16:59.195420+0000","last_clean":"2024-04-19T02:16:59.195420+0000","last_became_active":"2024-04-19T02:15:53.957657+0000","last_became_peered":"2024-04-19T02:15:53.957657+0000","last_unstale":"2024-04-19T02:16:59.195420+0000","last_undegraded":"2024-04-19T02:16:59.195420+0000","last_fullsized":"2024-04-19T02:16:59.195420+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:46.921714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"46'9463","reported_seq":9501,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-19T02:17:02.818083+0000","last_change":"2024-04-19T02:15:53.955068+0000","last_active":"2024-04-19T02:17:02.818083+0000","last_peered":"2024-04-19T02:17:02.818083+0000","last_clean":"2024-04-19T02:17:02.818083+0000","last_became_active":"2024-04-19T02:15:53.954721+0000","last_became_peered":"2024-04-19T02:15:53.954721+0000","last_unstale":"2024-04-19T02:17:02.818083+0000","last_undegraded":"2024-04-19T02:17:02.818083+0000","last_fullsized":"2024-04-19T02:17:02.818083+0000","mapping_epoch":16,"log_start":"34'5800","ondisk_log_start":"34'5800","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3663,"log_dups_size":0,"ondisk_log_size":3663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:18:29.742535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":484638720,"num_objects":7395,"num_object_clones":0,"num_object_copies":14790,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7395,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9463,"num_write_kb":539456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":40,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.195092+0000","last_change":"2024-04-19T02:15:53.959105+0000","last_active":"2024-04-19T02:16:59.195092+0000","last_peered":"2024-04-19T02:16:59.195092+0000","last_clean":"2024-04-19T02:16:59.195092+0000","last_became_active":"2024-04-19T02:15:53.958836+0000","last_became_peered":"2024-04-19T02:15:53.958836+0000","last_unstale":"2024-04-19T02:16:59.195092+0000","last_undegraded":"2024-04-19T02:16:59.195092+0000","last_fullsized":"2024-04-19T02:16:59.195092+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:18:00.321514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":42,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.195550+0000","last_change":"2024-04-19T02:15:28.892125+0000","last_active":"2024-04-19T02:16:59.195550+0000","last_peered":"2024-04-19T02:16:59.195550+0000","last_clean":"2024-04-19T02:16:59.195550+0000","last_became_active":"2024-04-19T02:15:28.891300+0000","last_became_peered":"2024-04-19T02:15:28.891300+0000","last_unstale":"2024-04-19T02:16:59.195550+0000","last_undegraded":"2024-04-19T02:16:59.195550+0000","last_fullsized":"2024-04-19T02:16:59.195550+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.188942+0000","last_change":"2024-04-19T02:15:29.281694+0000","last_active":"2024-04-19T02:16:59.188942+0000","last_peered":"2024-04-19T02:16:59.188942+0000","last_clean":"2024-04-19T02:16:59.188942+0000","last_became_active":"2024-04-19T02:15:29.280519+0000","last_became_peered":"2024-04-19T02:15:29.280519+0000","last_unstale":"2024-04-19T02:16:59.188942+0000","last_undegraded":"2024-04-19T02:16:59.188942+0000","last_fullsized":"2024-04-19T02:16:59.188942+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:50.890545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"46'9217","reported_seq":22058,"reported_epoch":46,"state":"active+clean+remapped","last_fresh":"2024-04-19T02:17:02.816709+0000","last_change":"2024-04-19T02:17:02.791542+0000","last_active":"2024-04-19T02:17:02.816709+0000","last_peered":"2024-04-19T02:17:02.816709+0000","last_clean":"2024-04-19T02:17:02.816709+0000","last_became_active":"2024-04-19T02:16:24.119992+0000","last_became_peered":"2024-04-19T02:16:24.119992+0000","last_unstale":"2024-04-19T02:17:02.816709+0000","last_undegraded":"2024-04-19T02:17:02.816709+0000","last_fullsized":"2024-04-19T02:17:02.816709+0000","mapping_epoch":29,"log_start":"34'5637","ondisk_log_start":"34'5637","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3580,"log_dups_size":0,"ondisk_log_size":3580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:28.663111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":473235456,"num_objects":7221,"num_object_clones":0,"num_object_copies":14442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7221,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9217,"num_write_kb":526016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6394,"num_bytes_recovered":419037184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,0],"avail_no_missing":["2","0","1"],"object_location_counts":[{"shards":"0,2","objects":7221}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":44,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.195234+0000","last_change":"2024-04-19T02:15:28.891702+0000","last_active":"2024-04-19T02:16:59.195234+0000","last_peered":"2024-04-19T02:16:59.195234+0000","last_clean":"2024-04-19T02:16:59.195234+0000","last_became_active":"2024-04-19T02:15:28.890743+0000","last_became_peered":"2024-04-19T02:15:28.890743+0000","last_unstale":"2024-04-19T02:16:59.195234+0000","last_undegraded":"2024-04-19T02:16:59.195234+0000","last_fullsized":"2024-04-19T02:16:59.195234+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.195306+0000","last_change":"2024-04-19T02:15:24.526845+0000","last_active":"2024-04-19T02:16:59.195306+0000","last_peered":"2024-04-19T02:16:59.195306+0000","last_clean":"2024-04-19T02:16:59.195306+0000","last_became_active":"2024-04-19T02:15:24.526500+0000","last_became_peered":"2024-04-19T02:15:24.526500+0000","last_unstale":"2024-04-19T02:16:59.195306+0000","last_undegraded":"2024-04-19T02:16:59.195306+0000","last_fullsized":"2024-04-19T02:16:59.195306+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:16.883355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.195896+0000","last_change":"2024-04-19T02:15:29.278686+0000","last_active":"2024-04-19T02:16:59.195896+0000","last_peered":"2024-04-19T02:16:59.195896+0000","last_clean":"2024-04-19T02:16:59.195896+0000","last_became_active":"2024-04-19T02:15:29.278108+0000","last_became_peered":"2024-04-19T02:15:29.278108+0000","last_unstale":"2024-04-19T02:16:59.195896+0000","last_undegraded":"2024-04-19T02:16:59.195896+0000","last_fullsized":"2024-04-19T02:16:59.195896+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:34.593754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"46'9188","reported_seq":9226,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-19T02:17:02.784430+0000","last_change":"2024-04-19T02:15:53.957269+0000","last_active":"2024-04-19T02:17:02.784430+0000","last_peered":"2024-04-19T02:17:02.784430+0000","last_clean":"2024-04-19T02:17:02.784430+0000","last_became_active":"2024-04-19T02:15:53.956554+0000","last_became_peered":"2024-04-19T02:15:53.956554+0000","last_unstale":"2024-04-19T02:17:02.784430+0000","last_undegraded":"2024-04-19T02:17:02.784430+0000","last_fullsized":"2024-04-19T02:17:02.784430+0000","mapping_epoch":16,"log_start":"33'5228","ondisk_log_start":"33'5228","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:52.941742+0000","last_clean_scrub_stamp":"2024-04-19T02:15:52.941742+0000","objects_scrubbed":0,"log_size":3960,"log_dups_size":0,"ondisk_log_size":3960,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:29:38.789719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":476708864,"num_objects":7274,"num_object_clones":0,"num_object_copies":14548,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7274,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9188,"num_write_kb":526784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":45,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.197528+0000","last_change":"2024-04-19T02:15:24.533777+0000","last_active":"2024-04-19T02:16:59.197528+0000","last_peered":"2024-04-19T02:16:59.197528+0000","last_clean":"2024-04-19T02:16:59.197528+0000","last_became_active":"2024-04-19T02:15:24.533436+0000","last_became_peered":"2024-04-19T02:15:24.533436+0000","last_unstale":"2024-04-19T02:16:59.197528+0000","last_undegraded":"2024-04-19T02:16:59.197528+0000","last_fullsized":"2024-04-19T02:16:59.197528+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:53:25.922418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":43,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.195095+0000","last_change":"2024-04-19T02:15:28.891370+0000","last_active":"2024-04-19T02:16:59.195095+0000","last_peered":"2024-04-19T02:16:59.195095+0000","last_clean":"2024-04-19T02:16:59.195095+0000","last_became_active":"2024-04-19T02:15:28.890702+0000","last_became_peered":"2024-04-19T02:15:28.890702+0000","last_unstale":"2024-04-19T02:16:59.195095+0000","last_undegraded":"2024-04-19T02:16:59.195095+0000","last_fullsized":"2024-04-19T02:16:59.195095+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:33.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.188703+0000","last_change":"2024-04-19T02:15:29.282244+0000","last_active":"2024-04-19T02:16:59.188703+0000","last_peered":"2024-04-19T02:16:59.188703+0000","last_clean":"2024-04-19T02:16:59.188703+0000","last_became_active":"2024-04-19T02:15:29.280366+0000","last_became_peered":"2024-04-19T02:15:29.280366+0000","last_unstale":"2024-04-19T02:16:59.188703+0000","last_undegraded":"2024-04-19T02:16:59.188703+0000","last_fullsized":"2024-04-19T02:16:59.188703+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":43,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.189003+0000","last_change":"2024-04-19T02:15:28.893027+0000","last_active":"2024-04-19T02:16:59.189003+0000","last_peered":"2024-04-19T02:16:59.189003+0000","last_clean":"2024-04-19T02:16:59.189003+0000","last_became_active":"2024-04-19T02:15:28.892695+0000","last_became_peered":"2024-04-19T02:15:28.892695+0000","last_unstale":"2024-04-19T02:16:59.189003+0000","last_undegraded":"2024-04-19T02:16:59.189003+0000","last_fullsized":"2024-04-19T02:16:59.189003+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.189234+0000","last_change":"2024-04-19T02:15:29.283155+0000","last_active":"2024-04-19T02:16:59.189234+0000","last_peered":"2024-04-19T02:16:59.189234+0000","last_clean":"2024-04-19T02:16:59.189234+0000","last_became_active":"2024-04-19T02:15:29.281407+0000","last_became_peered":"2024-04-19T02:15:29.281407+0000","last_unstale":"2024-04-19T02:16:59.189234+0000","last_undegraded":"2024-04-19T02:16:59.189234+0000","last_fullsized":"2024-04-19T02:16:59.189234+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":44,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.198233+0000","last_change":"2024-04-19T02:15:28.893067+0000","last_active":"2024-04-19T02:16:59.198233+0000","last_peered":"2024-04-19T02:16:59.198233+0000","last_clean":"2024-04-19T02:16:59.198233+0000","last_became_active":"2024-04-19T02:15:28.892781+0000","last_became_peered":"2024-04-19T02:15:28.892781+0000","last_unstale":"2024-04-19T02:16:59.198233+0000","last_undegraded":"2024-04-19T02:16:59.198233+0000","last_fullsized":"2024-04-19T02:16:59.198233+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:54:15.590143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.196551+0000","last_change":"2024-04-19T02:15:29.281279+0000","last_active":"2024-04-19T02:16:59.196551+0000","last_peered":"2024-04-19T02:16:59.196551+0000","last_clean":"2024-04-19T02:16:59.196551+0000","last_became_active":"2024-04-19T02:15:29.279360+0000","last_became_peered":"2024-04-19T02:15:29.279360+0000","last_unstale":"2024-04-19T02:16:59.196551+0000","last_undegraded":"2024-04-19T02:16:59.196551+0000","last_fullsized":"2024-04-19T02:16:59.196551+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:59.152243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":44,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.189565+0000","last_change":"2024-04-19T02:15:28.893239+0000","last_active":"2024-04-19T02:16:59.189565+0000","last_peered":"2024-04-19T02:16:59.189565+0000","last_clean":"2024-04-19T02:16:59.189565+0000","last_became_active":"2024-04-19T02:15:28.892881+0000","last_became_peered":"2024-04-19T02:15:28.892881+0000","last_unstale":"2024-04-19T02:16:59.189565+0000","last_undegraded":"2024-04-19T02:16:59.189565+0000","last_fullsized":"2024-04-19T02:16:59.189565+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.196509+0000","last_change":"2024-04-19T02:15:29.281652+0000","last_active":"2024-04-19T02:16:59.196509+0000","last_peered":"2024-04-19T02:16:59.196509+0000","last_clean":"2024-04-19T02:16:59.196509+0000","last_became_active":"2024-04-19T02:15:29.281175+0000","last_became_peered":"2024-04-19T02:15:29.281175+0000","last_unstale":"2024-04-19T02:16:59.196509+0000","last_undegraded":"2024-04-19T02:16:59.196509+0000","last_fullsized":"2024-04-19T02:16:59.196509+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:16.568764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":43,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.195510+0000","last_change":"2024-04-19T02:15:28.892058+0000","last_active":"2024-04-19T02:16:59.195510+0000","last_peered":"2024-04-19T02:16:59.195510+0000","last_clean":"2024-04-19T02:16:59.195510+0000","last_became_active":"2024-04-19T02:15:28.890877+0000","last_became_peered":"2024-04-19T02:15:28.890877+0000","last_unstale":"2024-04-19T02:16:59.195510+0000","last_undegraded":"2024-04-19T02:16:59.195510+0000","last_fullsized":"2024-04-19T02:16:59.195510+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:53.170180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.188867+0000","last_change":"2024-04-19T02:15:29.278810+0000","last_active":"2024-04-19T02:16:59.188867+0000","last_peered":"2024-04-19T02:16:59.188867+0000","last_clean":"2024-04-19T02:16:59.188867+0000","last_became_active":"2024-04-19T02:15:29.277913+0000","last_became_peered":"2024-04-19T02:15:29.277913+0000","last_unstale":"2024-04-19T02:16:59.188867+0000","last_undegraded":"2024-04-19T02:16:59.188867+0000","last_fullsized":"2024-04-19T02:16:59.188867+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:24.082666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":46,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.196943+0000","last_change":"2024-04-19T02:15:28.889132+0000","last_active":"2024-04-19T02:16:59.196943+0000","last_peered":"2024-04-19T02:16:59.196943+0000","last_clean":"2024-04-19T02:16:59.196943+0000","last_became_active":"2024-04-19T02:15:28.888926+0000","last_became_peered":"2024-04-19T02:15:28.888926+0000","last_unstale":"2024-04-19T02:16:59.196943+0000","last_undegraded":"2024-04-19T02:16:59.196943+0000","last_fullsized":"2024-04-19T02:16:59.196943+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.196331+0000","last_change":"2024-04-19T02:15:29.282776+0000","last_active":"2024-04-19T02:16:59.196331+0000","last_peered":"2024-04-19T02:16:59.196331+0000","last_clean":"2024-04-19T02:16:59.196331+0000","last_became_active":"2024-04-19T02:15:29.279382+0000","last_became_peered":"2024-04-19T02:15:29.279382+0000","last_unstale":"2024-04-19T02:16:59.196331+0000","last_undegraded":"2024-04-19T02:16:59.196331+0000","last_fullsized":"2024-04-19T02:16:59.196331+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.196257+0000","last_change":"2024-04-19T02:15:29.283537+0000","last_active":"2024-04-19T02:16:59.196257+0000","last_peered":"2024-04-19T02:16:59.196257+0000","last_clean":"2024-04-19T02:16:59.196257+0000","last_became_active":"2024-04-19T02:15:29.281801+0000","last_became_peered":"2024-04-19T02:15:29.281801+0000","last_unstale":"2024-04-19T02:16:59.196257+0000","last_undegraded":"2024-04-19T02:16:59.196257+0000","last_fullsized":"2024-04-19T02:16:59.196257+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:02.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.194586+0000","last_change":"2024-04-19T02:15:29.281560+0000","last_active":"2024-04-19T02:16:59.194586+0000","last_peered":"2024-04-19T02:16:59.194586+0000","last_clean":"2024-04-19T02:16:59.194586+0000","last_became_active":"2024-04-19T02:15:29.281261+0000","last_became_peered":"2024-04-19T02:15:29.281261+0000","last_unstale":"2024-04-19T02:16:59.194586+0000","last_undegraded":"2024-04-19T02:16:59.194586+0000","last_fullsized":"2024-04-19T02:16:59.194586+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":40,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.196257+0000","last_change":"2024-04-19T02:15:53.955913+0000","last_active":"2024-04-19T02:16:59.196257+0000","last_peered":"2024-04-19T02:16:59.196257+0000","last_clean":"2024-04-19T02:16:59.196257+0000","last_became_active":"2024-04-19T02:15:53.955676+0000","last_became_peered":"2024-04-19T02:15:53.955676+0000","last_unstale":"2024-04-19T02:16:59.196257+0000","last_undegraded":"2024-04-19T02:16:59.196257+0000","last_fullsized":"2024-04-19T02:16:59.196257+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:53:02.899902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.196572+0000","last_change":"2024-04-19T02:15:29.278702+0000","last_active":"2024-04-19T02:16:59.196572+0000","last_peered":"2024-04-19T02:16:59.196572+0000","last_clean":"2024-04-19T02:16:59.196572+0000","last_became_active":"2024-04-19T02:15:29.277756+0000","last_became_peered":"2024-04-19T02:15:29.277756+0000","last_unstale":"2024-04-19T02:16:59.196572+0000","last_undegraded":"2024-04-19T02:16:59.196572+0000","last_fullsized":"2024-04-19T02:16:59.196572+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:48:24.530770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T02:16:59.189279+0000","last_change":"2024-04-19T02:15:29.277568+0000","last_active":"2024-04-19T02:16:59.189279+0000","last_peered":"2024-04-19T02:16:59.189279+0000","last_clean":"2024-04-19T02:16:59.189279+0000","last_became_active":"2024-04-19T02:15:29.276725+0000","last_became_peered":"2024-04-19T02:15:29.276725+0000","last_unstale":"2024-04-19T02:16:59.189279+0000","last_undegraded":"2024-04-19T02:16:59.189279+0000","last_fullsized":"2024-04-19T02:16:59.189279+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":7735214104,"num_objects":118031,"num_object_clones":0,"num_object_copies":236062,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":118031,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":150035,"num_write_kb":8578049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6394,"num_bytes_recovered":419037184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15943213056,"data_stored":15943204912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":59834,"ondisk_log_size":59834,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738390,"num_pgs":84,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6412872,"kb_used_data":6186748,"kb_used_omap":1,"kb_used_meta":225534,"kb_avail":87958968,"statfs":{"total":96636764160,"available":90069983232,"internally_reserved":0,"allocated":6335229952,"data_stored":6334901396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":230947270},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2,2,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.313,"15min":0.313},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.497,"5min":0.497,"15min":0.497},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.19400000000000001}]},{"osd":1,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.20699999999999999},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.24199999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738391,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4945624,"kb_used_data":4798032,"kb_used_omap":1,"kb_used_meta":147582,"kb_avail":89426216,"statfs":{"total":96636764160,"available":91572445184,"internally_reserved":0,"allocated":4913184768,"data_stored":4912833370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":151124422},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,2,5],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.21099999999999999},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.19}]},{"osd":2,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":2.1000000000000001,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":0.20000000000000001},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.247}]}]},{"osd":1,"up_from":8,"seq":34359738390,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4893088,"kb_used_data":4721556,"kb_used_omap":1,"kb_used_meta":171390,"kb_avail":89478752,"statfs":{"total":96636764160,"available":91626242048,"internally_reserved":0,"allocated":4834873344,"data_stored":4834521910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":175503814},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:16:26 2024","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.185},{"interface":"front","average":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"min":{"1min":0.16,"5min":0.16,"15min":0.16},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.20300000000000001}]},{"osd":2,"last update":"Fri Apr 19 02:16:26 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":1.3939999999999999},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.22800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4843966464,"data_stored":4843962392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4829155328,"data_stored":4829151256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6270091264,"data_stored":6270091264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:17:03.273 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-19T02:17:03.273 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T02:17:03.273 INFO:tasks.thrashosds.thrasher:Killing osd 2, live_osds are [0, 1, 2] 2024-04-19T02:17:03.273 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.2 doing powercycle of ubuntu@smithi177.front.sepia.ceph.com 2024-04-19T02:17:03.273 INFO:teuthology.orchestra.console.smithi177:Power off 2024-04-19T02:17:03.273 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-19T02:17:03.287 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:03.287 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-04-19T02:17:03.288 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-04-19T02:17:03.288 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:03.299 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:03.300 DEBUG:teuthology.orchestra.console.smithi177:power off output: Chassis Power Control: Down/Off 2024-04-19T02:17:03.300 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T02:17:03.326 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on 2024-04-19T02:17:03.352 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:03.353+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:03.363 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:17:03.422 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:03.423+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:03.443 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:03.444 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-04-19T02:17:03.444 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-04-19T02:17:03.444 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-04-19T02:17:03.444 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:03.453 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:03.505 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:17:03.523 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:03.525+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:03.524 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:17:03.543 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2: {} 2024-04-19T02:17:03.545 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:17:03.545 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:17:03.545 INFO:teuthology.orchestra.run.smithi121.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:17:03.620 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:03.620 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:03.624 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:03.625+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:03.630 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:17:03.725 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:03.726+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:03.770 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:03.771 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:03.781 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:17:03.826 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:03.826+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:03.926 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:03.928+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:03.952 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:03.953 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:03.964 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:17:04.028 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:04.028+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:04.128 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:04.129+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:04.131 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:04.132 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:04.141 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:04.227 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T02:17:04.229 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:04.230+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:04.282 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:04.282 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:04.297 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:04.331 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:04.331+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:04.431 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:04.432+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:04.509 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:04.509 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:04.523 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:04.567 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:04.568+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:04.633 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:04.634+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:04.690 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:04.690 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:04.705 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:17:04.747 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:04.748+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:04.835 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:04.836+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:04.870 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:04.871 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:04.885 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:17:04.935 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:04.936+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:05.036 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:05.037+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:05.092 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:05.093 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:05.106 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:17:05.137 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:05.138+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:05.238 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:05.239+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:05.240 INFO:teuthology.orchestra.run.smithi121.stderr:noscrub is set 2024-04-19T02:17:05.313 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:05.313 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:05.326 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:05.367 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:05.368+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:05.440 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:05.441+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:05.486 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:05.486 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:05.500 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:05.541 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:05.542+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:05.556 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:17:05.642 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:05.643+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:05.702 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:05.702 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:05.705 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:17:05.715 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:05.725 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:17:05.743 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:05.744+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:05.747 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2: {} 2024-04-19T02:17:05.748 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:17:05.748 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:17:05.748 INFO:teuthology.orchestra.run.smithi121.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T02:17:05.844 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:05.845+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:05.920 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:05.920 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-04-19T02:17:05.920 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-04-19T02:17:05.920 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:17:05.920 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.920 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:05.921 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:17:05.921 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 96.648113066999997, 2024-04-19T02:17:05.921 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020307345000000001, 2024-04-19T02:17:05.921 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:05.921 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:05.921 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:05.921 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.921 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:05.921 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:17:05.921 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:05.921 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.921 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.921 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:05.921 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:17:05.921 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:05.922 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.922 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.922 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:05.922 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269791+0000", 2024-04-19T02:17:05.922 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:05.922 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.922 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.922 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:05.922 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269795+0000", 2024-04-19T02:17:05.922 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5619999999999999e-06 2024-04-19T02:17:05.922 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.922 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.922 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:05.923 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269802+0000", 2024-04-19T02:17:05.923 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8469999999999998e-06 2024-04-19T02:17:05.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.923 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.923 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:05.923 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269807+0000", 2024-04-19T02:17:05.923 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.707e-06 2024-04-19T02:17:05.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.923 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.923 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:05.923 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269950+0000", 2024-04-19T02:17:05.923 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000143313 2024-04-19T02:17:05.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.923 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.924 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:05.924 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269955+0000", 2024-04-19T02:17:05.924 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4029999999999998e-06 2024-04-19T02:17:05.924 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.924 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.924 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:05.924 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.283806+0000", 2024-04-19T02:17:05.924 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013850220999999999 2024-04-19T02:17:05.924 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.924 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.924 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:05.924 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.283896+0000", 2024-04-19T02:17:05.924 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0261999999999997e-05 2024-04-19T02:17:05.924 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.924 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.925 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:05.925 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284022+0000", 2024-04-19T02:17:05.925 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012641200000000001 2024-04-19T02:17:05.925 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.925 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.925 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:05.925 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289066+0000", 2024-04-19T02:17:05.925 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050438490000000004 2024-04-19T02:17:05.925 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.925 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.925 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:05.925 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290011+0000", 2024-04-19T02:17:05.925 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00094490700000000004 2024-04-19T02:17:05.925 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.925 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.926 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:05.926 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290054+0000", 2024-04-19T02:17:05.926 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.337e-05 2024-04-19T02:17:05.926 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.926 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.926 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:05.926 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290099+0000", 2024-04-19T02:17:05.926 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4987999999999997e-05 2024-04-19T02:17:05.926 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:05.926 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:05.926 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:05.926 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.926 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.927 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:05.927 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:17:05.927 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 96.648035136999994, 2024-04-19T02:17:05.927 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020331023, 2024-04-19T02:17:05.927 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:05.927 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:05.927 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:05.927 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.927 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:05.927 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:17:05.927 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:05.928 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.928 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.928 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:05.928 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:17:05.928 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:05.928 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.928 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.928 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:05.928 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269869+0000", 2024-04-19T02:17:05.928 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:05.928 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.928 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.928 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:05.928 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269873+0000", 2024-04-19T02:17:05.929 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0219999999999998e-06 2024-04-19T02:17:05.929 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.929 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.929 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:05.929 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269881+0000", 2024-04-19T02:17:05.929 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.79e-06 2024-04-19T02:17:05.929 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.929 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.929 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:05.929 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269887+0000", 2024-04-19T02:17:05.929 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7899999999999996e-06 2024-04-19T02:17:05.929 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.929 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.929 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:05.929 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269983+0000", 2024-04-19T02:17:05.930 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6057000000000005e-05 2024-04-19T02:17:05.930 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.930 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.930 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:05.930 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269986+0000", 2024-04-19T02:17:05.930 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9220000000000001e-06 2024-04-19T02:17:05.930 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.930 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.930 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:05.930 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284350+0000", 2024-04-19T02:17:05.930 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014364335000000001 2024-04-19T02:17:05.930 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.930 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.930 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:05.931 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284664+0000", 2024-04-19T02:17:05.931 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000313646 2024-04-19T02:17:05.931 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.931 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.931 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:05.931 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284794+0000", 2024-04-19T02:17:05.931 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129839 2024-04-19T02:17:05.931 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.931 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.931 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:05.931 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289107+0000", 2024-04-19T02:17:05.931 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0043127060000000004 2024-04-19T02:17:05.931 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.931 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.931 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:05.932 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290108+0000", 2024-04-19T02:17:05.932 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0010010590000000001 2024-04-19T02:17:05.932 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.932 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.932 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:05.932 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290144+0000", 2024-04-19T02:17:05.932 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6709999999999999e-05 2024-04-19T02:17:05.932 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.932 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.932 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:05.932 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290201+0000", 2024-04-19T02:17:05.932 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6654999999999999e-05 2024-04-19T02:17:05.932 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:05.932 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:05.933 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:05.933 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.933 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.933 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:05.933 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:17:05.933 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 96.647992795999997, 2024-04-19T02:17:05.933 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020507241999999998, 2024-04-19T02:17:05.933 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:05.933 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:05.933 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:05.933 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.933 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:05.933 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:17:05.933 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:05.934 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.934 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.934 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:05.934 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:17:05.934 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:05.934 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.934 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.934 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:05.934 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:17:05.934 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:05.934 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.934 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.934 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:05.934 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269915+0000", 2024-04-19T02:17:05.935 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.472e-06 2024-04-19T02:17:05.935 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.935 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.935 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:05.935 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269928+0000", 2024-04-19T02:17:05.935 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2979000000000001e-05 2024-04-19T02:17:05.935 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.935 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.935 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:05.935 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269935+0000", 2024-04-19T02:17:05.935 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8859999999999998e-06 2024-04-19T02:17:05.935 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.935 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.935 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:05.936 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270009+0000", 2024-04-19T02:17:05.936 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3429000000000005e-05 2024-04-19T02:17:05.936 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.936 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.936 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:05.936 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270013+0000", 2024-04-19T02:17:05.936 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2590000000000002e-06 2024-04-19T02:17:05.936 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.936 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.936 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:05.936 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285375+0000", 2024-04-19T02:17:05.936 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015362275999999999 2024-04-19T02:17:05.936 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.936 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.936 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:05.937 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285451+0000", 2024-04-19T02:17:05.937 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5338000000000003e-05 2024-04-19T02:17:05.937 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.937 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.937 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:05.937 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285562+0000", 2024-04-19T02:17:05.937 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000111285 2024-04-19T02:17:05.937 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.937 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.937 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:05.937 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289134+0000", 2024-04-19T02:17:05.937 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035719670000000001 2024-04-19T02:17:05.937 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.937 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.937 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:05.938 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290341+0000", 2024-04-19T02:17:05.938 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012074500000000001 2024-04-19T02:17:05.938 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.938 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.938 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:05.938 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290383+0000", 2024-04-19T02:17:05.938 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1386e-05 2024-04-19T02:17:05.938 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.938 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.938 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:05.938 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290419+0000", 2024-04-19T02:17:05.938 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6884000000000001e-05 2024-04-19T02:17:05.938 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:05.938 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:05.939 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:05.939 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.939 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.939 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:05.939 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269945+0000", 2024-04-19T02:17:05.939 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 96.647960213999994, 2024-04-19T02:17:05.939 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019709098000000001, 2024-04-19T02:17:05.939 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:05.939 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:05.939 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:05.939 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.939 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:05.939 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269945+0000", 2024-04-19T02:17:05.939 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:05.939 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.940 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.940 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:05.940 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269945+0000", 2024-04-19T02:17:05.940 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:05.940 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.940 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.940 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:05.940 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269944+0000", 2024-04-19T02:17:05.940 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:05.940 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.940 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.940 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:05.940 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269965+0000", 2024-04-19T02:17:05.940 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0803999999999999e-05 2024-04-19T02:17:05.941 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.941 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.941 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:05.941 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269973+0000", 2024-04-19T02:17:05.941 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3560000000000004e-06 2024-04-19T02:17:05.941 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.941 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.941 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:05.941 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269982+0000", 2024-04-19T02:17:05.941 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9600000000000006e-06 2024-04-19T02:17:05.941 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.941 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.941 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:05.941 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270014+0000", 2024-04-19T02:17:05.941 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2913000000000001e-05 2024-04-19T02:17:05.942 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.942 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.942 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:05.942 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270018+0000", 2024-04-19T02:17:05.942 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2200000000000001e-06 2024-04-19T02:17:05.942 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.942 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.942 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:05.942 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.278999+0000", 2024-04-19T02:17:05.942 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0089818009999999993 2024-04-19T02:17:05.942 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.942 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.942 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:05.942 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.279088+0000", 2024-04-19T02:17:05.943 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8988999999999998e-05 2024-04-19T02:17:05.943 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.943 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.943 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:05.943 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.280160+0000", 2024-04-19T02:17:05.943 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001071572 2024-04-19T02:17:05.943 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.943 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.943 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:05.943 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.288342+0000", 2024-04-19T02:17:05.943 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.008182468 2024-04-19T02:17:05.943 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.943 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.943 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:05.943 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289545+0000", 2024-04-19T02:17:05.944 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012026739999999999 2024-04-19T02:17:05.944 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.944 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.944 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:05.944 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289608+0000", 2024-04-19T02:17:05.944 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2904999999999995e-05 2024-04-19T02:17:05.944 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.944 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.944 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:05.944 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289654+0000", 2024-04-19T02:17:05.944 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5850000000000003e-05 2024-04-19T02:17:05.944 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:05.944 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:05.944 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:05.944 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.944 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.945 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:05.945 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:17:05.945 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 96.647914536000002, 2024-04-19T02:17:05.945 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022007204999999998, 2024-04-19T02:17:05.945 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:05.945 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:05.945 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:05.945 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.945 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:05.945 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:17:05.945 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:05.945 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.945 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.945 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:05.945 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:17:05.946 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:05.946 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.946 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.946 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:05.946 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269990+0000", 2024-04-19T02:17:05.946 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:05.946 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.946 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.946 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:05.946 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269999+0000", 2024-04-19T02:17:05.946 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9539999999999993e-06 2024-04-19T02:17:05.946 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.946 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.946 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:05.947 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270006+0000", 2024-04-19T02:17:05.947 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.216e-06 2024-04-19T02:17:05.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.947 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:05.947 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270012+0000", 2024-04-19T02:17:05.947 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5049999999999998e-06 2024-04-19T02:17:05.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.947 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:05.947 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270058+0000", 2024-04-19T02:17:05.947 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.634e-05 2024-04-19T02:17:05.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.947 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:05.948 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270064+0000", 2024-04-19T02:17:05.948 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0669999999999997e-06 2024-04-19T02:17:05.948 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.948 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.948 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:05.948 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287159+0000", 2024-04-19T02:17:05.948 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017095086999999998 2024-04-19T02:17:05.948 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.948 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.948 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:05.948 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287254+0000", 2024-04-19T02:17:05.948 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4716000000000006e-05 2024-04-19T02:17:05.948 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.948 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.949 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:05.949 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287389+0000", 2024-04-19T02:17:05.949 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013511900000000001 2024-04-19T02:17:05.949 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.949 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.949 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:05.949 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290481+0000", 2024-04-19T02:17:05.949 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030920169999999999 2024-04-19T02:17:05.949 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.949 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.949 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:05.949 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291931+0000", 2024-04-19T02:17:05.949 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001450118 2024-04-19T02:17:05.949 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.949 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.950 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:05.950 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291960+0000", 2024-04-19T02:17:05.950 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9096000000000001e-05 2024-04-19T02:17:05.950 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.950 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.950 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:05.950 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291998+0000", 2024-04-19T02:17:05.950 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7514e-05 2024-04-19T02:17:05.950 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:05.950 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:05.950 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:05.950 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.950 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.950 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:05.951 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:17:05.951 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 96.647853964999996, 2024-04-19T02:17:05.951 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020759494999999999, 2024-04-19T02:17:05.951 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:05.951 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:05.951 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:05.951 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.951 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:05.951 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:17:05.951 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:05.951 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.951 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.951 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:05.951 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:17:05.951 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:05.952 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.952 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.952 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:05.952 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:17:05.952 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:05.952 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.952 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.952 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:05.952 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270054+0000", 2024-04-19T02:17:05.952 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.27e-06 2024-04-19T02:17:05.952 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.952 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.952 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:05.952 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270061+0000", 2024-04-19T02:17:05.952 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1289999999999998e-06 2024-04-19T02:17:05.953 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.953 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.953 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:05.953 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270067+0000", 2024-04-19T02:17:05.953 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.207e-06 2024-04-19T02:17:05.953 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.953 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.953 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:05.953 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270105+0000", 2024-04-19T02:17:05.953 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7549999999999998e-05 2024-04-19T02:17:05.953 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.953 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.953 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:05.953 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270112+0000", 2024-04-19T02:17:05.953 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3200000000000002e-06 2024-04-19T02:17:05.954 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.954 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.954 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:05.954 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282454+0000", 2024-04-19T02:17:05.954 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012341569 2024-04-19T02:17:05.954 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.954 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.954 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:05.954 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282740+0000", 2024-04-19T02:17:05.954 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000286481 2024-04-19T02:17:05.954 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.954 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.954 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:05.954 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282879+0000", 2024-04-19T02:17:05.955 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013887799999999999 2024-04-19T02:17:05.955 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.955 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.955 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:05.955 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290325+0000", 2024-04-19T02:17:05.955 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074459779999999998 2024-04-19T02:17:05.955 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.955 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.955 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:05.955 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290759+0000", 2024-04-19T02:17:05.955 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000433688 2024-04-19T02:17:05.955 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.955 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.955 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:05.955 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290789+0000", 2024-04-19T02:17:05.956 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9960000000000001e-05 2024-04-19T02:17:05.956 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.956 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.956 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:05.956 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290811+0000", 2024-04-19T02:17:05.956 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1965999999999999e-05 2024-04-19T02:17:05.956 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:05.956 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:05.956 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:05.956 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.956 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.956 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:05.956 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:17:05.956 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 96.647803760000002, 2024-04-19T02:17:05.956 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020837887999999999, 2024-04-19T02:17:05.957 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:05.957 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:05.957 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:05.957 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.957 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:05.957 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:17:05.957 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:05.957 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.957 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.957 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:05.957 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:17:05.957 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:05.957 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.957 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.957 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:05.958 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:17:05.958 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:05.958 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.958 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.958 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:05.958 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270109+0000", 2024-04-19T02:17:05.958 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3110000000000006e-06 2024-04-19T02:17:05.958 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.958 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.958 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:05.958 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270117+0000", 2024-04-19T02:17:05.958 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0479999999999999e-06 2024-04-19T02:17:05.958 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.958 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.959 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:05.959 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270123+0000", 2024-04-19T02:17:05.959 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5500000000000002e-06 2024-04-19T02:17:05.959 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.959 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.959 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:05.959 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270150+0000", 2024-04-19T02:17:05.959 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7712000000000002e-05 2024-04-19T02:17:05.959 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.959 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.959 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:05.959 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270153+0000", 2024-04-19T02:17:05.959 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6089999999999999e-06 2024-04-19T02:17:05.959 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.959 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.960 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:05.960 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285958+0000", 2024-04-19T02:17:05.960 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015805274000000001 2024-04-19T02:17:05.960 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.960 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.960 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:05.960 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286126+0000", 2024-04-19T02:17:05.960 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016765700000000001 2024-04-19T02:17:05.960 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.960 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.960 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:05.960 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286296+0000", 2024-04-19T02:17:05.960 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017007 2024-04-19T02:17:05.960 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.961 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.961 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:05.961 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290426+0000", 2024-04-19T02:17:05.961 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041299839999999997 2024-04-19T02:17:05.961 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.961 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.961 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:05.961 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290867+0000", 2024-04-19T02:17:05.961 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00044083300000000001 2024-04-19T02:17:05.961 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.961 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.961 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:05.961 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290900+0000", 2024-04-19T02:17:05.961 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3380000000000002e-05 2024-04-19T02:17:05.961 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.961 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.962 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:05.962 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290939+0000", 2024-04-19T02:17:05.962 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8970000000000001e-05 2024-04-19T02:17:05.962 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:05.962 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:05.962 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:05.962 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.962 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.962 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:21 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:05.962 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:17:05.962 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 96.647715087999998, 2024-04-19T02:17:05.962 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020833187999999999, 2024-04-19T02:17:05.962 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:05.962 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:05.963 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:05.963 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.963 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:05.963 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:17:05.963 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:05.963 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.963 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.963 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:05.963 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:17:05.963 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:05.963 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.963 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.963 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:05.963 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270189+0000", 2024-04-19T02:17:05.963 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:05.964 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.964 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.964 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:05.964 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270192+0000", 2024-04-19T02:17:05.964 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7549999999999999e-06 2024-04-19T02:17:05.964 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.964 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.964 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:05.964 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270198+0000", 2024-04-19T02:17:05.964 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0859999999999998e-06 2024-04-19T02:17:05.964 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.964 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.964 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:05.964 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270204+0000", 2024-04-19T02:17:05.964 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1970000000000004e-06 2024-04-19T02:17:05.965 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.965 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.965 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:05.965 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270238+0000", 2024-04-19T02:17:05.965 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4282000000000001e-05 2024-04-19T02:17:05.965 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.965 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.965 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:05.965 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270240+0000", 2024-04-19T02:17:05.965 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3099999999999999e-06 2024-04-19T02:17:05.965 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.965 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.965 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:05.965 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287131+0000", 2024-04-19T02:17:05.966 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01689104 2024-04-19T02:17:05.966 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.966 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.966 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:05.966 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287262+0000", 2024-04-19T02:17:05.966 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130347 2024-04-19T02:17:05.966 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.966 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.966 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:05.966 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291023+0000", 2024-04-19T02:17:05.966 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037616350000000002 2024-04-19T02:17:05.966 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:05.966 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:05.966 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:05.967 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.967 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.967 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:16519 5.f 5:fc30d3a1:::benchmark_data_smithi121_44835_object16518:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:17:05.967 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.880723+0000", 2024-04-19T02:17:05.967 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 66.037182310000006, 2024-04-19T02:17:05.967 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020492519000000001, 2024-04-19T02:17:05.967 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:05.967 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:05.967 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:05.967 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:05.967 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:05.967 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16519 2024-04-19T02:17:05.967 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.967 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:05.968 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.968 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:05.968 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880723+0000", 2024-04-19T02:17:05.968 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:05.968 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.968 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.968 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:05.968 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880723+0000", 2024-04-19T02:17:05.968 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:05.968 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.968 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.968 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:05.968 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880722+0000", 2024-04-19T02:17:05.968 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:05.969 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.969 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.969 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:05.969 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880794+0000", 2024-04-19T02:17:05.969 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1515999999999998e-05 2024-04-19T02:17:05.969 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.969 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.969 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:05.969 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880805+0000", 2024-04-19T02:17:05.969 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1353e-05 2024-04-19T02:17:05.969 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.969 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.969 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:05.969 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880812+0000", 2024-04-19T02:17:05.969 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1230000000000002e-06 2024-04-19T02:17:05.970 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.970 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.970 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:05.970 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.890954+0000", 2024-04-19T02:17:05.970 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010142253 2024-04-19T02:17:05.970 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.970 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.970 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:05.970 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891079+0000", 2024-04-19T02:17:05.970 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000124917 2024-04-19T02:17:05.970 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.970 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.970 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:05.970 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891218+0000", 2024-04-19T02:17:05.971 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000138715 2024-04-19T02:17:05.971 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.971 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.971 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:05.971 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.897321+0000", 2024-04-19T02:17:05.971 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0061026830000000002 2024-04-19T02:17:05.971 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.971 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.971 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:05.971 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901137+0000", 2024-04-19T02:17:05.971 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038161699999999998 2024-04-19T02:17:05.971 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.971 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.971 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:05.971 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901181+0000", 2024-04-19T02:17:05.971 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4362e-05 2024-04-19T02:17:05.972 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.972 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.972 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:05.972 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901215+0000", 2024-04-19T02:17:05.972 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3929e-05 2024-04-19T02:17:05.972 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:05.972 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:05.972 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:05.972 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.972 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.972 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:16520 5.f 5:f0474691:::benchmark_data_smithi121_44835_object16519:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:17:05.972 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.880833+0000", 2024-04-19T02:17:05.972 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 66.037072295000002, 2024-04-19T02:17:05.972 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020460160000000002, 2024-04-19T02:17:05.972 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:05.973 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:05.973 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:05.973 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:05.973 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:05.973 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16520 2024-04-19T02:17:05.973 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.973 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:05.973 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.973 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:05.973 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880833+0000", 2024-04-19T02:17:05.973 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:05.973 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.973 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.973 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:05.974 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880833+0000", 2024-04-19T02:17:05.974 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:05.974 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.974 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.974 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:05.974 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880832+0000", 2024-04-19T02:17:05.974 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:05.974 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.974 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.974 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:05.974 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880909+0000", 2024-04-19T02:17:05.974 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7095000000000006e-05 2024-04-19T02:17:05.974 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.974 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.975 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:05.975 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880919+0000", 2024-04-19T02:17:05.975 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8919999999999995e-06 2024-04-19T02:17:05.978 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.978 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.978 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:05.978 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880927+0000", 2024-04-19T02:17:05.978 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8809999999999996e-06 2024-04-19T02:17:05.978 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.978 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.978 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:05.978 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891901+0000", 2024-04-19T02:17:05.978 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010974263999999999 2024-04-19T02:17:05.978 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.978 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.979 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:05.979 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.892021+0000", 2024-04-19T02:17:05.979 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120074 2024-04-19T02:17:05.979 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.979 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.979 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:05.979 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.892165+0000", 2024-04-19T02:17:05.979 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014328600000000001 2024-04-19T02:17:05.979 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.979 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.979 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:05.979 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.897347+0000", 2024-04-19T02:17:05.979 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.005182603 2024-04-19T02:17:05.979 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.979 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.980 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:05.980 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901224+0000", 2024-04-19T02:17:05.980 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038767620000000002 2024-04-19T02:17:05.980 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.980 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.980 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:05.980 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901264+0000", 2024-04-19T02:17:05.980 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9579000000000002e-05 2024-04-19T02:17:05.980 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.980 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.980 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:05.980 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901293+0000", 2024-04-19T02:17:05.980 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9300999999999999e-05 2024-04-19T02:17:05.980 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:05.980 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:05.981 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:05.981 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.981 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.981 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:44167 5.7 5:ef4300c4:::benchmark_data_smithi121_44835_object44166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:17:05.981 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:09.853830+0000", 2024-04-19T02:17:05.981 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 56.064074810999998, 2024-04-19T02:17:05.981 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020082104, 2024-04-19T02:17:05.981 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:05.981 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:05.981 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:05.981 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:05.981 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:05.981 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 44167 2024-04-19T02:17:05.981 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.981 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:05.982 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.982 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:05.982 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853830+0000", 2024-04-19T02:17:05.982 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:05.982 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.982 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.982 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:05.982 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853830+0000", 2024-04-19T02:17:05.982 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:05.982 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.982 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.982 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:05.982 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853829+0000", 2024-04-19T02:17:05.982 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:05.983 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.983 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.983 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:05.983 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853863+0000", 2024-04-19T02:17:05.983 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3151999999999997e-05 2024-04-19T02:17:05.983 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.983 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.983 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:05.983 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853873+0000", 2024-04-19T02:17:05.983 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0366e-05 2024-04-19T02:17:05.983 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.983 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.983 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:05.983 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853881+0000", 2024-04-19T02:17:05.983 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6539999999999999e-06 2024-04-19T02:17:05.984 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.984 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.984 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:05.984 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.859162+0000", 2024-04-19T02:17:05.984 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052810740000000002 2024-04-19T02:17:05.984 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.984 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.984 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:05.984 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.859303+0000", 2024-04-19T02:17:05.984 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000140975 2024-04-19T02:17:05.984 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.984 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.984 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:05.984 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.859460+0000", 2024-04-19T02:17:05.984 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015754199999999999 2024-04-19T02:17:05.984 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.985 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.985 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:05.985 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.865142+0000", 2024-04-19T02:17:05.985 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0056819130000000002 2024-04-19T02:17:05.985 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.985 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.985 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:05.985 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.873828+0000", 2024-04-19T02:17:05.985 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0086861799999999999 2024-04-19T02:17:05.985 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.985 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.985 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:05.985 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.873871+0000", 2024-04-19T02:17:05.985 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2624999999999999e-05 2024-04-19T02:17:05.985 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.986 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.986 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:05.986 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.873912+0000", 2024-04-19T02:17:05.986 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1486000000000002e-05 2024-04-19T02:17:05.986 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:05.986 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:05.986 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:05.986 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.986 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.986 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:53042 5.f 5:f744ac14:::benchmark_data_smithi121_44835_object53041:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T02:17:05.986 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:13.560196+0000", 2024-04-19T02:17:05.986 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 52.357708991999999, 2024-04-19T02:17:05.986 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020122021, 2024-04-19T02:17:05.986 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:05.987 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:05.987 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:05.987 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:05.987 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:05.987 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 53042 2024-04-19T02:17:05.987 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.987 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:05.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.987 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:05.987 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560196+0000", 2024-04-19T02:17:05.987 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:05.987 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.987 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:05.987 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560196+0000", 2024-04-19T02:17:05.988 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:05.988 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.988 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:05.988 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560195+0000", 2024-04-19T02:17:05.988 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:05.988 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.988 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:05.988 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560255+0000", 2024-04-19T02:17:05.988 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9441000000000002e-05 2024-04-19T02:17:05.988 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.988 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:05.989 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560264+0000", 2024-04-19T02:17:05.989 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1130000000000007e-06 2024-04-19T02:17:05.989 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.989 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.989 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:05.989 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560271+0000", 2024-04-19T02:17:05.989 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9800000000000001e-06 2024-04-19T02:17:05.989 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.989 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.989 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:05.989 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560312+0000", 2024-04-19T02:17:05.989 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0828999999999998e-05 2024-04-19T02:17:05.989 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.989 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.989 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:05.990 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560456+0000", 2024-04-19T02:17:05.990 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014474799999999999 2024-04-19T02:17:05.990 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.990 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.990 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:05.990 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560591+0000", 2024-04-19T02:17:05.990 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013482699999999999 2024-04-19T02:17:05.990 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.990 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.990 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:05.990 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.564799+0000", 2024-04-19T02:17:05.990 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042080080000000001 2024-04-19T02:17:05.990 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.990 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.991 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:05.991 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580233+0000", 2024-04-19T02:17:05.991 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015433715000000001 2024-04-19T02:17:05.991 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.991 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.991 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:05.991 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580280+0000", 2024-04-19T02:17:05.991 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6465000000000003e-05 2024-04-19T02:17:05.991 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.991 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.991 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:05.991 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580318+0000", 2024-04-19T02:17:05.991 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8557999999999999e-05 2024-04-19T02:17:05.991 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:05.991 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:05.992 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:05.992 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.992 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.992 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:85866 5.2 5:48b1d46d:::benchmark_data_smithi121_44835_object85865:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T02:17:05.992 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:30.771909+0000", 2024-04-19T02:17:05.992 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 35.145995720000002, 2024-04-19T02:17:05.992 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020516216, 2024-04-19T02:17:05.992 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:05.992 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:05.992 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:05.992 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:05.992 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:05.992 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 85866 2024-04-19T02:17:05.992 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.992 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:05.993 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.993 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:05.993 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771909+0000", 2024-04-19T02:17:05.993 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:05.993 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.993 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.993 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:05.993 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771909+0000", 2024-04-19T02:17:05.993 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:05.993 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.993 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.993 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:05.993 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771909+0000", 2024-04-19T02:17:05.993 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:05.993 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.994 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.994 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:05.994 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771952+0000", 2024-04-19T02:17:05.994 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2660000000000002e-05 2024-04-19T02:17:05.994 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.994 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.994 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:05.994 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771959+0000", 2024-04-19T02:17:05.994 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7670000000000003e-06 2024-04-19T02:17:05.994 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.994 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.994 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:05.994 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771966+0000", 2024-04-19T02:17:05.994 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.905e-06 2024-04-19T02:17:05.995 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.995 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:05.995 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771999+0000", 2024-04-19T02:17:05.995 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2360999999999997e-05 2024-04-19T02:17:05.995 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.995 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:05.995 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.772133+0000", 2024-04-19T02:17:05.995 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013398699999999999 2024-04-19T02:17:05.995 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.995 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:05.995 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.772280+0000", 2024-04-19T02:17:05.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000147198 2024-04-19T02:17:05.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.996 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:05.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.774312+0000", 2024-04-19T02:17:05.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020325339999999999 2024-04-19T02:17:05.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.996 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:05.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.792370+0000", 2024-04-19T02:17:05.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018057321000000001 2024-04-19T02:17:05.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.996 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:05.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.792403+0000", 2024-04-19T02:17:05.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3247000000000002e-05 2024-04-19T02:17:05.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:05.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.792426+0000", 2024-04-19T02:17:05.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2697999999999999e-05 2024-04-19T02:17:05.997 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:05.997 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:05.997 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:05.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.997 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:94468 5.2 5:4f406431:::benchmark_data_smithi121_44835_object94467:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T02:17:05.997 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:17:05.997 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.806475905999999, 2024-04-19T02:17:05.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024835144999999999, 2024-04-19T02:17:05.998 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:05.998 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:05.998 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:05.998 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:05.998 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:05.998 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 94468 2024-04-19T02:17:05.998 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.998 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:05.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.998 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:05.998 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:17:05.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:05.998 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:05.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:17:05.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:05.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:05.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:17:05.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:05.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:05.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:05.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111498+0000", 2024-04-19T02:17:05.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9529000000000005e-05 2024-04-19T02:17:05.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:05.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:06.000 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111506+0000", 2024-04-19T02:17:06.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9030000000000004e-06 2024-04-19T02:17:06.000 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.000 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.000 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111513+0000", 2024-04-19T02:17:06.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8759999999999999e-06 2024-04-19T02:17:06.000 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.000 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:06.000 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112466+0000", 2024-04-19T02:17:06.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00095318499999999995 2024-04-19T02:17:06.000 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.000 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:06.001 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112590+0000", 2024-04-19T02:17:06.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012380900000000001 2024-04-19T02:17:06.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:06.001 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112728+0000", 2024-04-19T02:17:06.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013753800000000001 2024-04-19T02:17:06.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:06.001 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115064+0000", 2024-04-19T02:17:06.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002336819 2024-04-19T02:17:06.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.002 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:06.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136207+0000", 2024-04-19T02:17:06.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021142942000000001 2024-04-19T02:17:06.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.002 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:06.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136241+0000", 2024-04-19T02:17:06.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3577000000000001e-05 2024-04-19T02:17:06.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.002 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:06.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136264+0000", 2024-04-19T02:17:06.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3421000000000002e-05 2024-04-19T02:17:06.003 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:06.003 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:06.003 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:06.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.003 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:94472 5.2 5:45b7e9be:::benchmark_data_smithi121_44835_object94471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:06.003 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:17:06.003 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.802829375000002, 2024-04-19T02:17:06.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021273843000000001, 2024-04-19T02:17:06.003 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:06.003 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.003 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:06.003 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:06.003 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:06.003 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 94472 2024-04-19T02:17:06.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.004 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:06.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.004 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:06.004 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:17:06.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:06.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.004 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:06.004 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:17:06.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:06.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.005 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:06.005 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115075+0000", 2024-04-19T02:17:06.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:06.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.005 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:06.005 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115161+0000", 2024-04-19T02:17:06.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6632000000000007e-05 2024-04-19T02:17:06.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.005 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:06.005 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115171+0000", 2024-04-19T02:17:06.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2969999999999992e-06 2024-04-19T02:17:06.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115178+0000", 2024-04-19T02:17:06.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7610000000000007e-06 2024-04-19T02:17:06.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:06.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115213+0000", 2024-04-19T02:17:06.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5000999999999999e-05 2024-04-19T02:17:06.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:06.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115303+0000", 2024-04-19T02:17:06.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9791999999999997e-05 2024-04-19T02:17:06.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.007 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:06.007 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115391+0000", 2024-04-19T02:17:06.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7559000000000007e-05 2024-04-19T02:17:06.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.007 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:06.007 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.117894+0000", 2024-04-19T02:17:06.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002503496 2024-04-19T02:17:06.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.007 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:06.007 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136297+0000", 2024-04-19T02:17:06.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018402335999999998 2024-04-19T02:17:06.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:06.008 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136327+0000", 2024-04-19T02:17:06.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0534999999999998e-05 2024-04-19T02:17:06.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:06.008 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136350+0000", 2024-04-19T02:17:06.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2427999999999999e-05 2024-04-19T02:17:06.008 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:06.008 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:06.008 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:06.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.009 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:96668 5.f 5:f48d3288:::benchmark_data_smithi121_44835_object96667:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-19T02:17:06.009 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:36.254669+0000", 2024-04-19T02:17:06.009 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 29.663236256000001, 2024-04-19T02:17:06.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019875075999999998, 2024-04-19T02:17:06.009 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:06.009 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.009 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:06.009 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:06.009 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:06.009 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 96668 2024-04-19T02:17:06.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.009 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:06.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.010 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:06.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254669+0000", 2024-04-19T02:17:06.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:06.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.010 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:06.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254669+0000", 2024-04-19T02:17:06.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:06.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.010 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:06.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254668+0000", 2024-04-19T02:17:06.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:06.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.011 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:06.011 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254738+0000", 2024-04-19T02:17:06.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9913000000000006e-05 2024-04-19T02:17:06.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.011 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:06.011 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254748+0000", 2024-04-19T02:17:06.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7429999999999997e-06 2024-04-19T02:17:06.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.011 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.011 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254754+0000", 2024-04-19T02:17:06.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3840000000000002e-06 2024-04-19T02:17:06.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.012 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:06.012 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.256882+0000", 2024-04-19T02:17:06.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021282950000000001 2024-04-19T02:17:06.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.012 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:06.012 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.257007+0000", 2024-04-19T02:17:06.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012430699999999999 2024-04-19T02:17:06.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.012 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:06.012 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.257150+0000", 2024-04-19T02:17:06.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014291999999999999 2024-04-19T02:17:06.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:06.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.261375+0000", 2024-04-19T02:17:06.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042252100000000001 2024-04-19T02:17:06.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:06.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.274489+0000", 2024-04-19T02:17:06.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013113915 2024-04-19T02:17:06.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:06.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.274521+0000", 2024-04-19T02:17:06.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2691999999999998e-05 2024-04-19T02:17:06.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:06.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.274544+0000", 2024-04-19T02:17:06.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2408999999999998e-05 2024-04-19T02:17:06.014 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:06.014 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:06.014 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:06.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.014 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:98093 5.f 5:fcbc05b3:::benchmark_data_smithi121_44835_object98092:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-19T02:17:06.014 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:36.938897+0000", 2024-04-19T02:17:06.014 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.979008408999999, 2024-04-19T02:17:06.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019526373, 2024-04-19T02:17:06.015 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:06.015 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.015 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:06.015 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:06.015 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:06.015 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 98093 2024-04-19T02:17:06.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.015 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:06.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:06.015 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.938897+0000", 2024-04-19T02:17:06.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:06.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:06.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.938897+0000", 2024-04-19T02:17:06.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:06.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:06.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.938896+0000", 2024-04-19T02:17:06.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:06.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:06.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.938920+0000", 2024-04-19T02:17:06.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3969e-05 2024-04-19T02:17:06.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.017 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:06.017 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.938927+0000", 2024-04-19T02:17:06.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4760000000000003e-06 2024-04-19T02:17:06.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.017 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.017 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.938930+0000", 2024-04-19T02:17:06.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7349999999999998e-06 2024-04-19T02:17:06.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.017 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:06.017 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.945557+0000", 2024-04-19T02:17:06.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0066265689999999997 2024-04-19T02:17:06.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:06.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.945653+0000", 2024-04-19T02:17:06.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5948999999999999e-05 2024-04-19T02:17:06.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:06.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.945739+0000", 2024-04-19T02:17:06.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6012000000000003e-05 2024-04-19T02:17:06.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:06.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.949258+0000", 2024-04-19T02:17:06.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035189140000000002 2024-04-19T02:17:06.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:06.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.958372+0000", 2024-04-19T02:17:06.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0091140430000000005 2024-04-19T02:17:06.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:06.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.958402+0000", 2024-04-19T02:17:06.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9879e-05 2024-04-19T02:17:06.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:06.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.958423+0000", 2024-04-19T02:17:06.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1206999999999999e-05 2024-04-19T02:17:06.019 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:06.020 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:06.020 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:06.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.020 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:129219 5.2 5:45e7e1f4:::benchmark_data_smithi121_44835_object129218:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T02:17:06.020 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:52.629592+0000", 2024-04-19T02:17:06.020 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.288313122, 2024-04-19T02:17:06.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021099489999999999, 2024-04-19T02:17:06.020 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:06.020 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.020 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:06.020 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:06.020 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:06.020 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129219 2024-04-19T02:17:06.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.021 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:06.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:06.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629592+0000", 2024-04-19T02:17:06.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:06.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:06.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629592+0000", 2024-04-19T02:17:06.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:06.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:06.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629591+0000", 2024-04-19T02:17:06.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:06.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.022 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:06.022 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629618+0000", 2024-04-19T02:17:06.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6970000000000001e-05 2024-04-19T02:17:06.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.022 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:06.022 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629639+0000", 2024-04-19T02:17:06.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0701999999999999e-05 2024-04-19T02:17:06.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.022 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.022 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629645+0000", 2024-04-19T02:17:06.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2299999999999996e-06 2024-04-19T02:17:06.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:06.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.635658+0000", 2024-04-19T02:17:06.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0060127549999999998 2024-04-19T02:17:06.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:06.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.635811+0000", 2024-04-19T02:17:06.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015305700000000001 2024-04-19T02:17:06.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:06.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.635967+0000", 2024-04-19T02:17:06.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015578599999999999 2024-04-19T02:17:06.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:06.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.642488+0000", 2024-04-19T02:17:06.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0065215619999999998 2024-04-19T02:17:06.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:06.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650603+0000", 2024-04-19T02:17:06.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0081144900000000002 2024-04-19T02:17:06.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:06.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650652+0000", 2024-04-19T02:17:06.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9079999999999998e-05 2024-04-19T02:17:06.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:06.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650691+0000", 2024-04-19T02:17:06.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9501e-05 2024-04-19T02:17:06.025 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:06.025 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:06.025 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:06.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.025 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:129220 5.2 5:44721865:::benchmark_data_smithi121_44835_object129219:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T02:17:06.025 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:52.630382+0000", 2024-04-19T02:17:06.025 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.287522719, 2024-04-19T02:17:06.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.02043969, 2024-04-19T02:17:06.026 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:06.026 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.026 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:06.026 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:06.026 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:06.026 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129220 2024-04-19T02:17:06.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.026 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:06.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.026 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:06.026 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.630382+0000", 2024-04-19T02:17:06.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:06.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:06.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.630382+0000", 2024-04-19T02:17:06.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:06.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:06.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.630382+0000", 2024-04-19T02:17:06.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:06.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:06.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.630451+0000", 2024-04-19T02:17:06.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9022000000000004e-05 2024-04-19T02:17:06.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:06.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.630460+0000", 2024-04-19T02:17:06.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7059999999999999e-06 2024-04-19T02:17:06.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.630466+0000", 2024-04-19T02:17:06.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4689999999999996e-06 2024-04-19T02:17:06.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:06.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.639381+0000", 2024-04-19T02:17:06.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0089152529999999997 2024-04-19T02:17:06.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:06.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.639492+0000", 2024-04-19T02:17:06.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011075500000000001 2024-04-19T02:17:06.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:06.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.639589+0000", 2024-04-19T02:17:06.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7157999999999994e-05 2024-04-19T02:17:06.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:06.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.646571+0000", 2024-04-19T02:17:06.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00698177 2024-04-19T02:17:06.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.030 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:06.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650743+0000", 2024-04-19T02:17:06.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041725909999999998 2024-04-19T02:17:06.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.030 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:06.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650785+0000", 2024-04-19T02:17:06.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2026e-05 2024-04-19T02:17:06.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.030 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:06.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650822+0000", 2024-04-19T02:17:06.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6689000000000001e-05 2024-04-19T02:17:06.031 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:06.031 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:06.031 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:06.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.031 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:130093 5.2 5:41dcb8a4:::benchmark_data_smithi121_44835_object130092:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T02:17:06.031 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:53.069964+0000", 2024-04-19T02:17:06.031 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 12.847941122, 2024-04-19T02:17:06.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020424088, 2024-04-19T02:17:06.031 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:06.031 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.031 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:06.031 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:06.031 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:06.032 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 130093 2024-04-19T02:17:06.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.032 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:06.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:06.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.069964+0000", 2024-04-19T02:17:06.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:06.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:06.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.069964+0000", 2024-04-19T02:17:06.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:06.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:06.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.069963+0000", 2024-04-19T02:17:06.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:06.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:06.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.070064+0000", 2024-04-19T02:17:06.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100709 2024-04-19T02:17:06.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:06.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.070072+0000", 2024-04-19T02:17:06.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8339999999999999e-06 2024-04-19T02:17:06.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.070077+0000", 2024-04-19T02:17:06.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2399999999999998e-06 2024-04-19T02:17:06.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:06.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.071370+0000", 2024-04-19T02:17:06.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012926470000000001 2024-04-19T02:17:06.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:06.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.071497+0000", 2024-04-19T02:17:06.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000127701 2024-04-19T02:17:06.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:06.035 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.071662+0000", 2024-04-19T02:17:06.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016424300000000001 2024-04-19T02:17:06.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.035 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:06.035 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.077150+0000", 2024-04-19T02:17:06.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.005488031 2024-04-19T02:17:06.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.035 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:06.035 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.090305+0000", 2024-04-19T02:17:06.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013155622 2024-04-19T02:17:06.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.035 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:06.036 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.090352+0000", 2024-04-19T02:17:06.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6798999999999997e-05 2024-04-19T02:17:06.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.036 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:06.036 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.090388+0000", 2024-04-19T02:17:06.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5837999999999998e-05 2024-04-19T02:17:06.036 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:06.036 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:06.036 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:06.036 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:06.036 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:06.036 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:06.038 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:17:06.038 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:06.038+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:06.138 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:06.140+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:06.215 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:17:06.216 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:17:06.216 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.216 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:155856 5.e 5:70a5ab9f:::benchmark_data_smithi121_44835_object21821:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:06.216 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.207028+0000", 2024-04-19T02:17:06.216 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0077405529999999998, 2024-04-19T02:17:06.216 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.007765376, 2024-04-19T02:17:06.216 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:06.216 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:06.216 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:06.216 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:06.216 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:06.216 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 155856 2024-04-19T02:17:06.216 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.216 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:06.217 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.217 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:06.217 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.207028+0000", 2024-04-19T02:17:06.217 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.217 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.217 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.217 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:06.217 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.207028+0000", 2024-04-19T02:17:06.217 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.217 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.217 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.217 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:06.217 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.207027+0000", 2024-04-19T02:17:06.217 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999986 2024-04-19T02:17:06.217 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.218 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.218 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:06.218 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.207032+0000", 2024-04-19T02:17:06.218 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.6110000000000001e-06 2024-04-19T02:17:06.218 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.218 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.218 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:06.218 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.207043+0000", 2024-04-19T02:17:06.218 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0730999999999999e-05 2024-04-19T02:17:06.218 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.218 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.218 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.218 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.207055+0000", 2024-04-19T02:17:06.218 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1606999999999999e-05 2024-04-19T02:17:06.219 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.219 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.219 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:06.219 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.207104+0000", 2024-04-19T02:17:06.219 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.9783000000000001e-05 2024-04-19T02:17:06.219 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.219 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.219 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:06.219 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.207239+0000", 2024-04-19T02:17:06.219 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013479599999999999 2024-04-19T02:17:06.219 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.219 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.219 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:06.219 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.207359+0000", 2024-04-19T02:17:06.219 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011968699999999999 2024-04-19T02:17:06.219 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.220 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.220 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:06.220 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.213360+0000", 2024-04-19T02:17:06.220 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0060009399999999997 2024-04-19T02:17:06.220 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.220 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:06.220 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.220 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.220 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.220 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:155862 5.e 5:7f302f3e:::benchmark_data_smithi121_44835_object21827:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:06.220 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.207319+0000", 2024-04-19T02:17:06.220 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0074500479999999999, 2024-04-19T02:17:06.220 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0075727199999999998, 2024-04-19T02:17:06.220 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:06.220 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:06.221 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:06.221 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:06.221 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:06.221 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 155862 2024-04-19T02:17:06.221 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.221 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:06.221 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.221 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:06.221 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.207319+0000", 2024-04-19T02:17:06.221 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.221 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.221 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.221 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:06.221 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.207319+0000", 2024-04-19T02:17:06.221 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.222 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.222 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.222 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:06.222 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.207318+0000", 2024-04-19T02:17:06.222 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:06.222 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.222 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.222 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:06.222 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.207321+0000", 2024-04-19T02:17:06.222 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1389999999999999e-06 2024-04-19T02:17:06.222 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.222 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.222 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:06.222 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.207326+0000", 2024-04-19T02:17:06.222 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.186e-06 2024-04-19T02:17:06.223 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.223 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.223 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.223 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.207330+0000", 2024-04-19T02:17:06.223 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9219999999999999e-06 2024-04-19T02:17:06.223 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.223 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.223 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:06.223 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.208997+0000", 2024-04-19T02:17:06.223 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001667087 2024-04-19T02:17:06.223 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.223 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.223 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:06.223 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.209137+0000", 2024-04-19T02:17:06.223 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000140075 2024-04-19T02:17:06.223 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.224 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.224 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:06.224 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.209243+0000", 2024-04-19T02:17:06.224 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010586600000000001 2024-04-19T02:17:06.224 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.224 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.224 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:06.224 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.213367+0000", 2024-04-19T02:17:06.224 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0041233720000000001 2024-04-19T02:17:06.224 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.224 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:06.224 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.224 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.224 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.224 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:155867 5.e 5:77882d7f:::benchmark_data_smithi121_44835_object21832:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:06.225 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.208369+0000", 2024-04-19T02:17:06.225 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0063997350000000001, 2024-04-19T02:17:06.225 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0066095629999999997, 2024-04-19T02:17:06.225 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:06.225 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:06.225 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:06.225 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:06.225 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:06.225 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 155867 2024-04-19T02:17:06.225 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.225 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:06.225 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.225 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:06.225 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.208369+0000", 2024-04-19T02:17:06.225 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.226 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.226 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.226 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:06.226 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.208369+0000", 2024-04-19T02:17:06.226 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.226 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.226 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.226 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:06.226 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.208368+0000", 2024-04-19T02:17:06.226 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:06.226 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.226 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.226 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:06.226 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.208373+0000", 2024-04-19T02:17:06.226 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.6840000000000004e-06 2024-04-19T02:17:06.226 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.227 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.227 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:06.227 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.208383+0000", 2024-04-19T02:17:06.227 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0196e-05 2024-04-19T02:17:06.227 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.227 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.227 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.227 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.208390+0000", 2024-04-19T02:17:06.227 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.0500000000000003e-06 2024-04-19T02:17:06.227 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.227 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.227 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:06.227 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.210522+0000", 2024-04-19T02:17:06.227 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.002131736 2024-04-19T02:17:06.227 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.228 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.228 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:06.228 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.210605+0000", 2024-04-19T02:17:06.228 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2979999999999995e-05 2024-04-19T02:17:06.228 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.228 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.228 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:06.228 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.210673+0000", 2024-04-19T02:17:06.228 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.7772000000000001e-05 2024-04-19T02:17:06.228 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.228 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:06.228 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.228 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.228 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.228 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:155868 5.0 5:0d7d73a2:::benchmark_data_smithi121_44835_object21833:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:06.229 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.210490+0000", 2024-04-19T02:17:06.229 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0042787759999999998, 2024-04-19T02:17:06.229 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0045765930000000003, 2024-04-19T02:17:06.229 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:06.229 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:06.229 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:06.229 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:06.229 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:06.229 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 155868 2024-04-19T02:17:06.229 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.229 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:06.229 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.229 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:06.229 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.210490+0000", 2024-04-19T02:17:06.229 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.230 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.230 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.230 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:06.230 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.210490+0000", 2024-04-19T02:17:06.230 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.230 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.230 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.230 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:06.230 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.210489+0000", 2024-04-19T02:17:06.230 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:06.230 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.230 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.230 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:06.230 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.210496+0000", 2024-04-19T02:17:06.231 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.2749999999999998e-06 2024-04-19T02:17:06.231 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.231 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.231 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:06.231 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.210511+0000", 2024-04-19T02:17:06.231 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.4878999999999999e-05 2024-04-19T02:17:06.231 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.231 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.231 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.231 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.210518+0000", 2024-04-19T02:17:06.231 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.9399999999999996e-06 2024-04-19T02:17:06.231 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.231 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.231 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:06.231 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.210562+0000", 2024-04-19T02:17:06.231 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3736999999999998e-05 2024-04-19T02:17:06.232 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.232 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.232 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:06.232 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.210706+0000", 2024-04-19T02:17:06.232 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000144308 2024-04-19T02:17:06.232 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.232 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.232 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:06.232 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.210840+0000", 2024-04-19T02:17:06.232 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000134282 2024-04-19T02:17:06.232 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.232 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.232 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:06.232 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.215055+0000", 2024-04-19T02:17:06.232 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0042146529999999996 2024-04-19T02:17:06.233 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.233 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:06.233 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.233 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.233 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.233 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:155873 5.e 5:7e959efb:::benchmark_data_smithi121_44835_object21838:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:06.233 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.210874+0000", 2024-04-19T02:17:06.233 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0038941900000000001, 2024-04-19T02:17:06.233 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0043152750000000004, 2024-04-19T02:17:06.233 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:06.233 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:06.233 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:06.233 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:06.233 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:06.233 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 155873 2024-04-19T02:17:06.233 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.234 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:06.234 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.234 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:06.234 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.210874+0000", 2024-04-19T02:17:06.234 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.234 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.234 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.234 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:06.234 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.210874+0000", 2024-04-19T02:17:06.234 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.234 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.234 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.234 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:06.234 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.210874+0000", 2024-04-19T02:17:06.235 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:06.235 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.235 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.235 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:06.235 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.210879+0000", 2024-04-19T02:17:06.235 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.9389999999999996e-06 2024-04-19T02:17:06.235 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.235 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.235 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:06.235 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.210888+0000", 2024-04-19T02:17:06.235 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.5410000000000006e-06 2024-04-19T02:17:06.235 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.235 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.235 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.235 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.210896+0000", 2024-04-19T02:17:06.236 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.4000000000000003e-06 2024-04-19T02:17:06.236 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.236 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.236 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:06.236 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.212021+0000", 2024-04-19T02:17:06.236 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00112528 2024-04-19T02:17:06.236 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.236 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.236 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:06.236 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.212127+0000", 2024-04-19T02:17:06.236 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000105722 2024-04-19T02:17:06.236 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.236 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.236 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:06.236 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.212234+0000", 2024-04-19T02:17:06.237 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000107571 2024-04-19T02:17:06.237 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.237 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:06.237 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.237 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.237 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.237 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:155872 5.9 e49/16 5:977fcefa:::benchmark_data_smithi121_44835_object21837:head v 49'9900, mlcod=49'9898)", 2024-04-19T02:17:06.237 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.211028+0000", 2024-04-19T02:17:06.237 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0037406119999999999, 2024-04-19T02:17:06.237 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0042656250000000003, 2024-04-19T02:17:06.237 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:06.237 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:06.237 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:06.237 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.237 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:06.238 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.211028+0000", 2024-04-19T02:17:06.238 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.238 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.238 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.238 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:06.238 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.211028+0000", 2024-04-19T02:17:06.238 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.238 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.238 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.238 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:06.238 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.211028+0000", 2024-04-19T02:17:06.238 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967296 2024-04-19T02:17:06.238 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.238 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.238 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:06.239 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.211031+0000", 2024-04-19T02:17:06.239 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.241e-06 2024-04-19T02:17:06.239 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.239 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.239 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:06.239 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.211036+0000", 2024-04-19T02:17:06.239 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0019999999999997e-06 2024-04-19T02:17:06.239 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.239 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.239 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.239 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.211041+0000", 2024-04-19T02:17:06.239 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.3199999999999999e-06 2024-04-19T02:17:06.239 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.239 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.239 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:06.240 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.211067+0000", 2024-04-19T02:17:06.240 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.5825000000000001e-05 2024-04-19T02:17:06.240 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.240 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.240 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:06.240 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.211084+0000", 2024-04-19T02:17:06.240 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.7073999999999999e-05 2024-04-19T02:17:06.240 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.240 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:06.240 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.240 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.240 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.240 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:155875 5.0 5:06ad95ea:::benchmark_data_smithi121_44835_object21840:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:06.240 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.212127+0000", 2024-04-19T02:17:06.240 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0026416339999999999, 2024-04-19T02:17:06.240 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.003240457, 2024-04-19T02:17:06.241 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:06.241 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:06.241 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:06.241 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:06.241 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:06.241 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 155875 2024-04-19T02:17:06.241 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.241 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:06.241 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.241 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:06.241 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.212127+0000", 2024-04-19T02:17:06.241 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.241 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.241 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.242 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:06.242 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.212127+0000", 2024-04-19T02:17:06.242 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.242 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.242 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.242 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:06.242 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.212126+0000", 2024-04-19T02:17:06.242 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:06.242 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.242 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.242 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:06.242 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.212131+0000", 2024-04-19T02:17:06.242 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2039999999999996e-06 2024-04-19T02:17:06.242 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.242 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.243 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:06.243 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.212141+0000", 2024-04-19T02:17:06.243 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2690000000000005e-06 2024-04-19T02:17:06.243 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.243 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.243 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.243 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.212148+0000", 2024-04-19T02:17:06.243 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.4270000000000002e-06 2024-04-19T02:17:06.243 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.243 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.243 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:06.243 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.213008+0000", 2024-04-19T02:17:06.243 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00086014999999999996 2024-04-19T02:17:06.243 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.243 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.243 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:06.244 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.213134+0000", 2024-04-19T02:17:06.244 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012572899999999999 2024-04-19T02:17:06.244 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.244 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.244 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:06.244 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.213260+0000", 2024-04-19T02:17:06.244 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012637299999999999 2024-04-19T02:17:06.244 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.244 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:06.244 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.244 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.244 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.244 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:155877 5.e 5:768cae16:::benchmark_data_smithi121_44835_object21842:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:06.244 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.212162+0000", 2024-04-19T02:17:06.244 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0026071359999999999, 2024-04-19T02:17:06.245 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0032951959999999998, 2024-04-19T02:17:06.245 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:06.245 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:06.245 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:06.245 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:06.245 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:06.245 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 155877 2024-04-19T02:17:06.245 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.245 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:06.245 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.245 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:06.245 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.212162+0000", 2024-04-19T02:17:06.245 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.245 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.245 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.245 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:06.246 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.212162+0000", 2024-04-19T02:17:06.246 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.246 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.246 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.246 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:06.246 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.212161+0000", 2024-04-19T02:17:06.246 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:06.246 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.246 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.246 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:06.246 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.212164+0000", 2024-04-19T02:17:06.246 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0419999999999998e-06 2024-04-19T02:17:06.246 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.246 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.246 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:06.247 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.212174+0000", 2024-04-19T02:17:06.247 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0209e-05 2024-04-19T02:17:06.247 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.247 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.247 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.247 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.212180+0000", 2024-04-19T02:17:06.247 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.5210000000000002e-06 2024-04-19T02:17:06.247 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.247 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.247 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:06.247 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.213393+0000", 2024-04-19T02:17:06.247 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001212826 2024-04-19T02:17:06.247 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.247 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.247 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:06.248 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.213529+0000", 2024-04-19T02:17:06.248 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013630599999999999 2024-04-19T02:17:06.248 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.248 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.248 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:06.248 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.213644+0000", 2024-04-19T02:17:06.248 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000115254 2024-04-19T02:17:06.248 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.248 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:06.248 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.248 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.248 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.248 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:155879 5.0 5:0ac1f4b5:::benchmark_data_smithi121_44835_object21844:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:06.248 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.213250+0000", 2024-04-19T02:17:06.248 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0015186939999999999, 2024-04-19T02:17:06.249 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.002296597, 2024-04-19T02:17:06.249 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:06.249 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:06.249 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:06.249 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:06.249 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:06.249 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 155879 2024-04-19T02:17:06.249 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.249 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:06.249 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.249 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:06.249 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.213250+0000", 2024-04-19T02:17:06.249 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.249 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.249 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.249 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:06.250 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.213250+0000", 2024-04-19T02:17:06.250 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.250 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.250 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.250 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:06.250 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.213249+0000", 2024-04-19T02:17:06.250 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:06.250 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.250 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.250 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:06.250 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.213253+0000", 2024-04-19T02:17:06.250 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3919999999999999e-06 2024-04-19T02:17:06.250 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.250 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.250 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:06.251 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.213259+0000", 2024-04-19T02:17:06.251 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.2729999999999999e-06 2024-04-19T02:17:06.251 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.251 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.251 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.251 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.213264+0000", 2024-04-19T02:17:06.251 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.639e-06 2024-04-19T02:17:06.251 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.251 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.251 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:06.251 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.215245+0000", 2024-04-19T02:17:06.251 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001981001 2024-04-19T02:17:06.251 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.251 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.251 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:06.251 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.215387+0000", 2024-04-19T02:17:06.252 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014234299999999999 2024-04-19T02:17:06.252 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.252 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.252 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:06.252 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.215507+0000", 2024-04-19T02:17:06.252 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000120068 2024-04-19T02:17:06.252 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.252 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:06.252 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.252 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.252 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.252 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:155878 5.d e49/16 5:b205eec1:::benchmark_data_smithi121_44835_object21843:head v 49'9737, mlcod=49'9735)", 2024-04-19T02:17:06.252 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.213447+0000", 2024-04-19T02:17:06.252 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0013215550000000001, 2024-04-19T02:17:06.252 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0021856290000000001, 2024-04-19T02:17:06.253 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:06.253 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:06.253 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:06.253 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.253 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:06.253 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.213447+0000", 2024-04-19T02:17:06.253 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.253 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.253 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.253 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:06.253 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.213447+0000", 2024-04-19T02:17:06.253 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.253 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.253 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.253 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:06.254 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.213447+0000", 2024-04-19T02:17:06.254 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:06.254 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.254 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.254 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:06.254 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.213454+0000", 2024-04-19T02:17:06.254 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.4660000000000002e-06 2024-04-19T02:17:06.254 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.254 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.254 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:06.254 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.213461+0000", 2024-04-19T02:17:06.254 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.8040000000000004e-06 2024-04-19T02:17:06.254 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.254 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.255 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.255 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.213465+0000", 2024-04-19T02:17:06.255 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3059999999999999e-06 2024-04-19T02:17:06.255 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.255 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.255 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:06.255 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.213496+0000", 2024-04-19T02:17:06.255 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1043000000000001e-05 2024-04-19T02:17:06.255 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.255 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.255 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:06.255 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.213512+0000", 2024-04-19T02:17:06.255 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.5998000000000002e-05 2024-04-19T02:17:06.255 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.255 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:06.255 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.256 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.256 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.256 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:155880 5.9 e49/16 5:98496351:::benchmark_data_smithi121_44835_object21845:head v 49'9901, mlcod=49'9898)", 2024-04-19T02:17:06.256 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.213761+0000", 2024-04-19T02:17:06.256 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0010078369999999999, 2024-04-19T02:17:06.256 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0019309900000000001, 2024-04-19T02:17:06.256 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:06.256 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:06.256 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:06.256 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.256 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:06.256 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.213761+0000", 2024-04-19T02:17:06.256 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.256 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.256 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.257 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:06.257 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.213761+0000", 2024-04-19T02:17:06.257 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.257 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.257 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.257 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:06.257 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.213760+0000", 2024-04-19T02:17:06.257 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:06.257 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.257 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.257 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:06.257 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.213768+0000", 2024-04-19T02:17:06.257 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1489999999999997e-06 2024-04-19T02:17:06.257 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.257 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.257 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:06.258 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.213776+0000", 2024-04-19T02:17:06.258 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.1329999999999999e-06 2024-04-19T02:17:06.258 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.258 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.258 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.258 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.213783+0000", 2024-04-19T02:17:06.258 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.0979999999999996e-06 2024-04-19T02:17:06.258 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.258 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.258 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:06.258 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.214262+0000", 2024-04-19T02:17:06.258 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00047956099999999998 2024-04-19T02:17:06.258 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.258 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.258 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:06.259 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.214279+0000", 2024-04-19T02:17:06.259 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.6986e-05 2024-04-19T02:17:06.259 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.259 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:06.259 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.259 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.259 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.259 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:155881 5.4 5:27470f0f:::benchmark_data_smithi121_44835_object21846:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:06.259 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.214196+0000", 2024-04-19T02:17:06.259 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.00057227000000000005, 2024-04-19T02:17:06.259 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0015554970000000001, 2024-04-19T02:17:06.259 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:06.259 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:06.259 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:06.259 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:06.260 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:06.260 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 155881 2024-04-19T02:17:06.260 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.260 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:06.260 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.260 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:06.260 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.214196+0000", 2024-04-19T02:17:06.260 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.260 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.260 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.260 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:06.260 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.214196+0000", 2024-04-19T02:17:06.260 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.260 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.260 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.260 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:06.261 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.214196+0000", 2024-04-19T02:17:06.261 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:06.261 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.261 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.261 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:06.261 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.214200+0000", 2024-04-19T02:17:06.261 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8700000000000002e-06 2024-04-19T02:17:06.261 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.261 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.261 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:06.261 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.214212+0000", 2024-04-19T02:17:06.261 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.207e-05 2024-04-19T02:17:06.261 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.261 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.261 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.262 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.214219+0000", 2024-04-19T02:17:06.262 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3300000000000001e-06 2024-04-19T02:17:06.262 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.262 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.262 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:06.262 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.214265+0000", 2024-04-19T02:17:06.262 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.6187999999999999e-05 2024-04-19T02:17:06.262 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.262 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.262 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:06.262 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.214395+0000", 2024-04-19T02:17:06.262 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012971700000000001 2024-04-19T02:17:06.262 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.262 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.262 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:06.263 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.214510+0000", 2024-04-19T02:17:06.263 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000115124 2024-04-19T02:17:06.263 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.263 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:06.263 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.263 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.263 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.263 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:155883 5.e 5:73dcbe3a:::benchmark_data_smithi121_44835_object21848:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:06.263 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.214893+0000", 2024-04-19T02:17:06.263 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 4294967295.999876, 2024-04-19T02:17:06.263 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00093198599999999999, 2024-04-19T02:17:06.263 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:06.263 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:06.263 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:06.263 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:06.264 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:06.264 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 155883 2024-04-19T02:17:06.264 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.264 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:06.264 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.264 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:06.264 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.214893+0000", 2024-04-19T02:17:06.264 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.264 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.264 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.264 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:06.264 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.214893+0000", 2024-04-19T02:17:06.264 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.264 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.264 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.265 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:06.265 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.214892+0000", 2024-04-19T02:17:06.265 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:06.265 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.265 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.265 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:06.265 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.214898+0000", 2024-04-19T02:17:06.265 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.8390000000000003e-06 2024-04-19T02:17:06.265 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.265 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.265 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:06.265 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.214909+0000", 2024-04-19T02:17:06.265 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1605e-05 2024-04-19T02:17:06.265 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.265 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.265 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.266 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.214917+0000", 2024-04-19T02:17:06.266 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.8120000000000008e-06 2024-04-19T02:17:06.266 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.266 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.266 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:06.266 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.214983+0000", 2024-04-19T02:17:06.266 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6295000000000001e-05 2024-04-19T02:17:06.266 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.266 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.266 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:06.266 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.215090+0000", 2024-04-19T02:17:06.266 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000106026 2024-04-19T02:17:06.266 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.266 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.266 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:06.267 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.215193+0000", 2024-04-19T02:17:06.267 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000103115 2024-04-19T02:17:06.267 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.267 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:06.267 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.267 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.267 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.267 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop_reply(client.4549.0:155856 5.e e49/16)", 2024-04-19T02:17:06.267 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.214953+0000", 2024-04-19T02:17:06.267 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 4294967295.9998159, 2024-04-19T02:17:06.267 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00094412399999999996, 2024-04-19T02:17:06.267 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:06.267 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "queued for pg", 2024-04-19T02:17:06.267 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:06.267 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.268 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:06.268 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.214953+0000", 2024-04-19T02:17:06.268 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.268 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.268 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.268 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:06.268 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.214953+0000", 2024-04-19T02:17:06.268 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.268 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.268 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.268 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:06.268 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.214952+0000", 2024-04-19T02:17:06.268 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:06.268 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.269 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.269 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:06.269 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.214957+0000", 2024-04-19T02:17:06.269 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0350000000000001e-06 2024-04-19T02:17:06.269 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.269 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.269 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:06.269 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.214966+0000", 2024-04-19T02:17:06.269 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.5149999999999995e-06 2024-04-19T02:17:06.269 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.269 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.269 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.269 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.214973+0000", 2024-04-19T02:17:06.269 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5640000000000002e-06 2024-04-19T02:17:06.269 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.269 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:06.270 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.270 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.270 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.270 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop_reply(client.4549.0:155862 5.e e49/16)", 2024-04-19T02:17:06.270 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.214979+0000", 2024-04-19T02:17:06.270 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 4294967295.9997897, 2024-04-19T02:17:06.270 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00096284400000000003, 2024-04-19T02:17:06.270 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:06.270 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "queued for pg", 2024-04-19T02:17:06.270 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:06.270 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.270 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:06.270 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.214979+0000", 2024-04-19T02:17:06.270 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.271 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.271 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.271 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:06.271 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.214979+0000", 2024-04-19T02:17:06.271 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.271 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.271 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.271 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:06.271 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.214979+0000", 2024-04-19T02:17:06.271 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:06.271 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.271 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.271 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:06.271 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.214981+0000", 2024-04-19T02:17:06.271 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.182e-06 2024-04-19T02:17:06.271 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.272 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.272 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:06.272 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.214987+0000", 2024-04-19T02:17:06.272 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.8490000000000002e-06 2024-04-19T02:17:06.272 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.272 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.272 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.272 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.214991+0000", 2024-04-19T02:17:06.272 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1799999999999998e-06 2024-04-19T02:17:06.272 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.272 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:06.272 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.272 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.272 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.272 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop_reply(client.4549.0:155867 5.e e49/16)", 2024-04-19T02:17:06.273 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.214996+0000", 2024-04-19T02:17:06.273 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 4294967295.9997725, 2024-04-19T02:17:06.273 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00099647400000000001, 2024-04-19T02:17:06.273 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:06.273 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "queued for pg", 2024-04-19T02:17:06.273 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:06.273 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.273 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:06.273 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.214996+0000", 2024-04-19T02:17:06.273 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.273 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.273 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.273 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:06.273 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.214996+0000", 2024-04-19T02:17:06.273 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.274 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.274 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.274 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:06.274 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.214996+0000", 2024-04-19T02:17:06.274 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967296 2024-04-19T02:17:06.274 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.274 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.274 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:06.274 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.214998+0000", 2024-04-19T02:17:06.274 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.8810000000000001e-06 2024-04-19T02:17:06.274 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.274 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.274 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:06.274 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.215003+0000", 2024-04-19T02:17:06.275 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2290000000000002e-06 2024-04-19T02:17:06.275 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.275 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.275 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.275 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.215007+0000", 2024-04-19T02:17:06.275 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1150000000000004e-06 2024-04-19T02:17:06.275 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.275 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:06.275 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.275 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.275 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.275 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop_reply(client.4549.0:155873 5.e e49/16)", 2024-04-19T02:17:06.275 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.215011+0000", 2024-04-19T02:17:06.275 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 4294967295.9997578, 2024-04-19T02:17:06.276 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0010271869999999999, 2024-04-19T02:17:06.276 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:06.276 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "queued for pg", 2024-04-19T02:17:06.276 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:06.276 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.276 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:06.276 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.215011+0000", 2024-04-19T02:17:06.276 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.276 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.276 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.276 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:06.276 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.215011+0000", 2024-04-19T02:17:06.276 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.276 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.276 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.277 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:06.277 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.215011+0000", 2024-04-19T02:17:06.277 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967296 2024-04-19T02:17:06.277 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.277 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.277 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:06.277 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.215013+0000", 2024-04-19T02:17:06.277 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.669e-06 2024-04-19T02:17:06.277 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.277 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.277 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:06.277 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.215018+0000", 2024-04-19T02:17:06.277 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2390000000000002e-06 2024-04-19T02:17:06.277 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.278 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.278 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.278 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.215022+0000", 2024-04-19T02:17:06.278 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1049999999999997e-06 2024-04-19T02:17:06.278 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.278 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:06.278 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.278 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.278 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.278 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop_reply(client.4549.0:155875 5.0 e49/16)", 2024-04-19T02:17:06.278 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.215178+0000", 2024-04-19T02:17:06.278 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 4294967295.9995904, 2024-04-19T02:17:06.278 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000910158, 2024-04-19T02:17:06.278 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:06.278 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "queued for pg", 2024-04-19T02:17:06.279 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:06.279 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.279 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:06.279 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.215178+0000", 2024-04-19T02:17:06.279 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.279 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.279 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.279 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:06.279 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.215178+0000", 2024-04-19T02:17:06.279 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.279 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.279 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.279 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:06.279 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.215178+0000", 2024-04-19T02:17:06.280 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:06.280 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.280 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.280 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:06.280 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.215181+0000", 2024-04-19T02:17:06.280 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2119999999999999e-06 2024-04-19T02:17:06.280 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.280 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.280 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:06.280 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.215188+0000", 2024-04-19T02:17:06.280 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.7730000000000002e-06 2024-04-19T02:17:06.280 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.280 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.280 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.281 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.215192+0000", 2024-04-19T02:17:06.281 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0799999999999999e-06 2024-04-19T02:17:06.281 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.281 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:06.281 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.281 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.281 INFO:teuthology.orchestra.run.smithi174.stdout: ], 2024-04-19T02:17:06.281 INFO:teuthology.orchestra.run.smithi174.stdout: "num_ops": 18 2024-04-19T02:17:06.281 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:17:06.282 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:06.283+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:06.283 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:17:06.383 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:06.384+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:06.484 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:06.485+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:06.487 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:17:06.487 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [], 2024-04-19T02:17:06.487 INFO:teuthology.orchestra.run.smithi174.stdout: "complaint_time": 30, 2024-04-19T02:17:06.487 INFO:teuthology.orchestra.run.smithi174.stdout: "num_blocked_ops": 0 2024-04-19T02:17:06.487 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:17:06.500 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:17:06.585 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:06.586+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:06.671 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:17:06.671 INFO:teuthology.orchestra.run.smithi174.stdout: "size": 20, 2024-04-19T02:17:06.671 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 600, 2024-04-19T02:17:06.671 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:17:06.671 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.672 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:10 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:06.672 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269877+0000", 2024-04-19T02:17:06.672 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 97.399516778999995, 2024-04-19T02:17:06.672 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020732751000000001, 2024-04-19T02:17:06.672 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:06.672 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.672 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:06.672 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.672 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:06.672 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269877+0000", 2024-04-19T02:17:06.672 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.672 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.672 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.672 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:06.673 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269877+0000", 2024-04-19T02:17:06.673 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.673 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.673 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.673 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:06.673 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269875+0000", 2024-04-19T02:17:06.673 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:06.673 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.673 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.673 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:06.673 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269891+0000", 2024-04-19T02:17:06.673 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.5494000000000001e-05 2024-04-19T02:17:06.673 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.673 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.674 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:06.674 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269903+0000", 2024-04-19T02:17:06.674 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2003e-05 2024-04-19T02:17:06.674 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.674 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.674 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.674 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269914+0000", 2024-04-19T02:17:06.674 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0947e-05 2024-04-19T02:17:06.674 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.674 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.674 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:06.674 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269971+0000", 2024-04-19T02:17:06.675 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7036000000000001e-05 2024-04-19T02:17:06.675 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.675 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.675 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:17:06.675 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269979+0000", 2024-04-19T02:17:06.675 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.6660000000000008e-06 2024-04-19T02:17:06.675 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.675 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.675 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:06.675 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284891+0000", 2024-04-19T02:17:06.675 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014912584 2024-04-19T02:17:06.675 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.675 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.675 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:06.676 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285213+0000", 2024-04-19T02:17:06.676 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00032172199999999998 2024-04-19T02:17:06.676 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.676 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.676 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:06.676 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285357+0000", 2024-04-19T02:17:06.676 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014367899999999999 2024-04-19T02:17:06.676 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.676 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.676 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:06.676 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288883+0000", 2024-04-19T02:17:06.676 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0035268719999999999 2024-04-19T02:17:06.676 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.676 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.676 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:06.677 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290537+0000", 2024-04-19T02:17:06.677 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016537399999999999 2024-04-19T02:17:06.677 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.677 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.677 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:06.677 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290576+0000", 2024-04-19T02:17:06.677 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9266e-05 2024-04-19T02:17:06.677 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.677 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.677 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:06.677 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290609+0000", 2024-04-19T02:17:06.677 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2818000000000003e-05 2024-04-19T02:17:06.677 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.677 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:06.677 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.678 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.678 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.678 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:11 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:06.678 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:17:06.678 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 97.399463858000004, 2024-04-19T02:17:06.678 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020352748, 2024-04-19T02:17:06.678 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:06.678 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.678 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:06.678 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.678 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:06.678 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:17:06.678 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.678 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.678 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.679 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:06.679 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:17:06.679 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.679 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.679 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.679 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:06.679 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269929+0000", 2024-04-19T02:17:06.679 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:06.679 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.679 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.679 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:06.679 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269933+0000", 2024-04-19T02:17:06.679 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2169999999999996e-06 2024-04-19T02:17:06.679 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.679 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.680 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:06.680 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269940+0000", 2024-04-19T02:17:06.680 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1500000000000002e-06 2024-04-19T02:17:06.680 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.680 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.680 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.680 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269948+0000", 2024-04-19T02:17:06.680 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.8690000000000004e-06 2024-04-19T02:17:06.680 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.680 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.680 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:06.680 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:17:06.680 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2994999999999997e-05 2024-04-19T02:17:06.680 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.680 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.681 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:17:06.681 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269997+0000", 2024-04-19T02:17:06.681 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.9020000000000004e-06 2024-04-19T02:17:06.681 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.681 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.681 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:06.681 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.282729+0000", 2024-04-19T02:17:06.681 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.012732537 2024-04-19T02:17:06.681 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.681 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.681 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:06.681 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.282838+0000", 2024-04-19T02:17:06.681 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000108298 2024-04-19T02:17:06.681 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.681 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.682 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:06.682 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.283002+0000", 2024-04-19T02:17:06.682 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00016466300000000001 2024-04-19T02:17:06.682 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.682 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.682 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:06.682 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288708+0000", 2024-04-19T02:17:06.682 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.005705066 2024-04-19T02:17:06.682 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.682 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.682 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:06.682 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290215+0000", 2024-04-19T02:17:06.682 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0015075010000000001 2024-04-19T02:17:06.682 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.683 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.683 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:06.683 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290259+0000", 2024-04-19T02:17:06.683 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3711999999999998e-05 2024-04-19T02:17:06.683 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.683 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.683 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:06.683 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290282+0000", 2024-04-19T02:17:06.683 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3458000000000001e-05 2024-04-19T02:17:06.683 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.683 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:06.683 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.683 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.683 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.683 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:14 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:06.684 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:17:06.684 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 97.399430068000001, 2024-04-19T02:17:06.684 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020137202, 2024-04-19T02:17:06.684 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:06.684 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.684 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:06.684 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.684 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:06.684 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:17:06.684 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.684 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.684 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.684 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:06.684 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:17:06.685 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.685 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.685 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.685 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:06.685 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269963+0000", 2024-04-19T02:17:06.685 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:06.685 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.685 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.685 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:06.685 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269971+0000", 2024-04-19T02:17:06.685 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.5459999999999992e-06 2024-04-19T02:17:06.685 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.685 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.685 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:06.685 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269979+0000", 2024-04-19T02:17:06.686 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9130000000000003e-06 2024-04-19T02:17:06.686 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.686 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.686 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.686 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269986+0000", 2024-04-19T02:17:06.686 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.3779999999999998e-06 2024-04-19T02:17:06.686 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.686 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.686 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:06.686 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270030+0000", 2024-04-19T02:17:06.686 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3982e-05 2024-04-19T02:17:06.686 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.686 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.686 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op must wait for map", 2024-04-19T02:17:06.687 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270034+0000", 2024-04-19T02:17:06.687 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1779999999999996e-06 2024-04-19T02:17:06.687 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.687 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.687 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:06.687 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.277870+0000", 2024-04-19T02:17:06.687 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0078362150000000005 2024-04-19T02:17:06.687 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.687 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.687 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:06.687 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.278216+0000", 2024-04-19T02:17:06.687 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00034634999999999999 2024-04-19T02:17:06.687 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.687 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.688 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:06.688 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.278732+0000", 2024-04-19T02:17:06.688 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00051536099999999999 2024-04-19T02:17:06.688 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.688 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.688 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:06.688 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.287694+0000", 2024-04-19T02:17:06.688 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0089621019999999996 2024-04-19T02:17:06.688 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.688 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.688 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:06.688 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290026+0000", 2024-04-19T02:17:06.688 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0023323139999999998 2024-04-19T02:17:06.688 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.688 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.689 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:06.689 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290067+0000", 2024-04-19T02:17:06.689 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1043e-05 2024-04-19T02:17:06.689 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.689 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.689 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:06.689 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290100+0000", 2024-04-19T02:17:06.689 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3278999999999998e-05 2024-04-19T02:17:06.689 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.689 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:06.689 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.689 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.689 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.689 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:06.689 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:17:06.690 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 97.399398275999999, 2024-04-19T02:17:06.690 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020731702000000001, 2024-04-19T02:17:06.690 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:06.690 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.690 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:06.690 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.690 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:06.690 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:17:06.690 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.690 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.690 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.690 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:06.690 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:17:06.690 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.691 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.691 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.691 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:06.691 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269995+0000", 2024-04-19T02:17:06.691 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:06.691 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.691 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.691 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:06.691 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.269998+0000", 2024-04-19T02:17:06.691 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7100000000000001e-06 2024-04-19T02:17:06.691 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.691 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.691 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:06.691 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270005+0000", 2024-04-19T02:17:06.691 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.241e-06 2024-04-19T02:17:06.692 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.692 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.692 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.692 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270011+0000", 2024-04-19T02:17:06.692 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6279999999999999e-06 2024-04-19T02:17:06.692 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.692 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.692 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:06.692 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270046+0000", 2024-04-19T02:17:06.692 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5173999999999999e-05 2024-04-19T02:17:06.692 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.692 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.692 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:06.692 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:17:06.692 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0019999999999997e-06 2024-04-19T02:17:06.692 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.693 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.693 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:06.693 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285619+0000", 2024-04-19T02:17:06.693 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015567391 2024-04-19T02:17:06.693 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.693 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.693 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:06.693 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285671+0000", 2024-04-19T02:17:06.693 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2460999999999998e-05 2024-04-19T02:17:06.693 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.693 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.693 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:06.693 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285775+0000", 2024-04-19T02:17:06.693 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000103389 2024-04-19T02:17:06.693 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.694 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.694 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:06.694 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288934+0000", 2024-04-19T02:17:06.694 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0031595859999999998 2024-04-19T02:17:06.694 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.694 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.694 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:06.694 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290650+0000", 2024-04-19T02:17:06.694 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001716242 2024-04-19T02:17:06.694 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.694 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.694 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:06.694 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290692+0000", 2024-04-19T02:17:06.694 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1910999999999999e-05 2024-04-19T02:17:06.695 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.695 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.695 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:06.695 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290727+0000", 2024-04-19T02:17:06.695 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4412000000000002e-05 2024-04-19T02:17:06.695 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.695 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:06.695 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.695 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.695 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.695 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:06.695 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270019+0000", 2024-04-19T02:17:06.695 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 97.399374680999998, 2024-04-19T02:17:06.695 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020572014999999999, 2024-04-19T02:17:06.696 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:06.696 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.696 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:06.696 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.696 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:06.696 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270019+0000", 2024-04-19T02:17:06.696 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.696 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.696 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.696 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:06.696 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270019+0000", 2024-04-19T02:17:06.696 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.696 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.696 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.697 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:06.697 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270018+0000", 2024-04-19T02:17:06.697 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:06.697 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.697 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.697 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:06.697 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270021+0000", 2024-04-19T02:17:06.697 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0319999999999999e-06 2024-04-19T02:17:06.697 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.697 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.697 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:06.697 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270028+0000", 2024-04-19T02:17:06.697 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6189999999999996e-06 2024-04-19T02:17:06.697 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.698 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.698 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.698 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270035+0000", 2024-04-19T02:17:06.698 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1690000000000003e-06 2024-04-19T02:17:06.698 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.698 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.698 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:06.698 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270078+0000", 2024-04-19T02:17:06.698 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3061e-05 2024-04-19T02:17:06.698 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.698 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.698 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:06.698 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270082+0000", 2024-04-19T02:17:06.698 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4510000000000002e-06 2024-04-19T02:17:06.699 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.699 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.699 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:06.699 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284354+0000", 2024-04-19T02:17:06.699 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014271588999999999 2024-04-19T02:17:06.699 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.699 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.699 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:06.699 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284497+0000", 2024-04-19T02:17:06.699 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014335800000000001 2024-04-19T02:17:06.699 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.699 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.699 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:06.699 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.284626+0000", 2024-04-19T02:17:06.699 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000128744 2024-04-19T02:17:06.700 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.700 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.700 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:06.700 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.288844+0000", 2024-04-19T02:17:06.700 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00421807 2024-04-19T02:17:06.700 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.700 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.700 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:06.700 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290508+0000", 2024-04-19T02:17:06.700 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001663774 2024-04-19T02:17:06.700 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.700 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.700 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:06.700 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290556+0000", 2024-04-19T02:17:06.701 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.7599999999999998e-05 2024-04-19T02:17:06.701 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.701 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.701 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:06.701 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290591+0000", 2024-04-19T02:17:06.701 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5034999999999999e-05 2024-04-19T02:17:06.701 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.701 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:06.701 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.701 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.701 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.701 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:06.701 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:17:06.701 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 97.399351818, 2024-04-19T02:17:06.701 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020192280999999999, 2024-04-19T02:17:06.702 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:06.702 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.702 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:06.702 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.702 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:06.702 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:17:06.702 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.702 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.702 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.702 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:06.702 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:17:06.702 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.702 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.702 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.703 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:06.703 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270041+0000", 2024-04-19T02:17:06.703 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:06.703 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.703 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.703 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:06.703 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270045+0000", 2024-04-19T02:17:06.703 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8680000000000001e-06 2024-04-19T02:17:06.703 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.703 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.703 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:06.703 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270052+0000", 2024-04-19T02:17:06.703 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.9999999999999999e-06 2024-04-19T02:17:06.703 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.704 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.704 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.704 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270056+0000", 2024-04-19T02:17:06.704 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4479999999999996e-06 2024-04-19T02:17:06.704 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.704 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.704 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:06.704 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270089+0000", 2024-04-19T02:17:06.704 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3071000000000002e-05 2024-04-19T02:17:06.704 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.704 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.704 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:06.704 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270092+0000", 2024-04-19T02:17:06.704 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9780000000000001e-06 2024-04-19T02:17:06.704 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.705 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.705 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:06.705 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.280632+0000", 2024-04-19T02:17:06.705 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010539712 2024-04-19T02:17:06.705 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.705 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.705 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:06.705 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.280743+0000", 2024-04-19T02:17:06.705 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000111048 2024-04-19T02:17:06.705 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.705 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.705 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:06.705 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.281531+0000", 2024-04-19T02:17:06.705 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00078738199999999999 2024-04-19T02:17:06.706 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.706 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.706 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:06.706 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.287949+0000", 2024-04-19T02:17:06.706 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0064185730000000003 2024-04-19T02:17:06.706 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.706 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.706 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:06.706 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290184+0000", 2024-04-19T02:17:06.706 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0022350849999999999 2024-04-19T02:17:06.706 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.706 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.706 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:06.707 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290209+0000", 2024-04-19T02:17:06.707 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4907000000000001e-05 2024-04-19T02:17:06.707 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.707 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.707 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:06.707 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290234+0000", 2024-04-19T02:17:06.707 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4666999999999999e-05 2024-04-19T02:17:06.707 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.707 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:06.707 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.707 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.707 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.707 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:19 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:06.707 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:17:06.707 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 97.399330352000007, 2024-04-19T02:17:06.708 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020818203, 2024-04-19T02:17:06.708 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:06.708 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.708 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:06.708 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.708 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:06.708 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:17:06.708 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.708 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.708 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.708 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:06.708 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:17:06.708 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.708 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.709 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.709 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:06.709 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:17:06.709 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:06.709 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.709 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.709 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:06.709 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270065+0000", 2024-04-19T02:17:06.709 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4310000000000001e-06 2024-04-19T02:17:06.709 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.709 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.709 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:06.709 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270070+0000", 2024-04-19T02:17:06.709 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2859999999999999e-06 2024-04-19T02:17:06.709 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.710 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.710 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.710 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270077+0000", 2024-04-19T02:17:06.710 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5270000000000004e-06 2024-04-19T02:17:06.710 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.710 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.710 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:06.710 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270107+0000", 2024-04-19T02:17:06.710 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0205999999999998e-05 2024-04-19T02:17:06.710 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.710 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.710 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:06.710 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270111+0000", 2024-04-19T02:17:06.710 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8650000000000003e-06 2024-04-19T02:17:06.710 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.711 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.711 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:06.711 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285936+0000", 2024-04-19T02:17:06.711 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015824677999999998 2024-04-19T02:17:06.711 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.711 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.711 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:06.711 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286007+0000", 2024-04-19T02:17:06.711 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1157999999999999e-05 2024-04-19T02:17:06.711 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.711 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.711 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:06.711 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286086+0000", 2024-04-19T02:17:06.712 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9084000000000004e-05 2024-04-19T02:17:06.712 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.712 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.712 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:06.712 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290740+0000", 2024-04-19T02:17:06.712 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0046543679999999999 2024-04-19T02:17:06.712 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.712 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.712 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:06.712 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290833+0000", 2024-04-19T02:17:06.712 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2551000000000002e-05 2024-04-19T02:17:06.712 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.712 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.712 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:06.713 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290859+0000", 2024-04-19T02:17:06.713 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.6696999999999999e-05 2024-04-19T02:17:06.713 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.713 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.713 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:06.713 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290881+0000", 2024-04-19T02:17:06.713 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1653000000000001e-05 2024-04-19T02:17:06.713 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.713 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:06.713 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.713 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.713 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.713 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:77622 5.8 5:166fbe77:::benchmark_data_smithi121_44835_object77621:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:06.713 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:17:06.714 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 39.863833415000002, 2024-04-19T02:17:06.714 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.021784694, 2024-04-19T02:17:06.714 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:06.714 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.714 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:06.714 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:06.714 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:06.714 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 77622 2024-04-19T02:17:06.714 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.714 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:06.714 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.714 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:06.714 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:17:06.715 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.715 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.715 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.715 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:06.715 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:17:06.715 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.715 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.715 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.715 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:06.715 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805559+0000", 2024-04-19T02:17:06.715 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:06.715 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.715 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.716 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:06.716 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805659+0000", 2024-04-19T02:17:06.716 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.9908000000000006e-05 2024-04-19T02:17:06.716 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.716 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.716 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:06.716 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805668+0000", 2024-04-19T02:17:06.716 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2129999999999997e-06 2024-04-19T02:17:06.716 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.716 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.716 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.716 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805673+0000", 2024-04-19T02:17:06.716 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0370000000000002e-06 2024-04-19T02:17:06.716 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.717 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.717 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:06.717 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812022+0000", 2024-04-19T02:17:06.717 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0063483239999999998 2024-04-19T02:17:06.717 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.717 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.717 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:06.717 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812129+0000", 2024-04-19T02:17:06.717 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010744200000000001 2024-04-19T02:17:06.717 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.717 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.717 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:06.717 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812252+0000", 2024-04-19T02:17:06.717 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000122519 2024-04-19T02:17:06.717 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.718 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.718 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:06.718 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.820979+0000", 2024-04-19T02:17:06.718 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0087272740000000001 2024-04-19T02:17:06.718 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.718 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.718 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:06.718 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827270+0000", 2024-04-19T02:17:06.718 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0062906239999999999 2024-04-19T02:17:06.718 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.718 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.718 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:06.718 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827309+0000", 2024-04-19T02:17:06.718 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9678999999999997e-05 2024-04-19T02:17:06.719 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.719 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.719 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:06.719 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827345+0000", 2024-04-19T02:17:06.719 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5308000000000001e-05 2024-04-19T02:17:06.719 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.719 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:06.719 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.719 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.719 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.719 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78224 5.4 5:26e797d5:::benchmark_data_smithi121_44835_object78223:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:06.719 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:17:06.719 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 39.562831215999999, 2024-04-19T02:17:06.719 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.021471998999999999, 2024-04-19T02:17:06.719 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:06.719 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.720 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:06.720 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:06.720 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:06.720 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78224 2024-04-19T02:17:06.720 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.720 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:06.720 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.720 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:06.720 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:17:06.720 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.720 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.720 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.720 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:06.720 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:17:06.720 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.721 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.721 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.721 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:06.721 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106561+0000", 2024-04-19T02:17:06.721 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:06.721 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.721 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.721 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:06.721 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106630+0000", 2024-04-19T02:17:06.721 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.8553999999999994e-05 2024-04-19T02:17:06.721 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.721 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.721 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:06.721 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106644+0000", 2024-04-19T02:17:06.722 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.4651000000000001e-05 2024-04-19T02:17:06.722 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.722 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.722 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.722 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106653+0000", 2024-04-19T02:17:06.722 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.6719999999999993e-06 2024-04-19T02:17:06.722 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.722 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.722 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:06.722 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106693+0000", 2024-04-19T02:17:06.722 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9978999999999998e-05 2024-04-19T02:17:06.722 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.722 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.722 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:06.723 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106840+0000", 2024-04-19T02:17:06.723 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0001473 2024-04-19T02:17:06.723 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.723 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.723 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:06.723 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106971+0000", 2024-04-19T02:17:06.723 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013051499999999999 2024-04-19T02:17:06.723 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.723 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.723 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:06.723 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.109047+0000", 2024-04-19T02:17:06.723 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.002076002 2024-04-19T02:17:06.723 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.723 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.723 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:06.723 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.127967+0000", 2024-04-19T02:17:06.724 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.018919780000000001 2024-04-19T02:17:06.724 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.724 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.724 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:06.724 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128004+0000", 2024-04-19T02:17:06.724 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7719000000000003e-05 2024-04-19T02:17:06.724 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.724 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.724 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:06.724 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128034+0000", 2024-04-19T02:17:06.724 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9651000000000001e-05 2024-04-19T02:17:06.724 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.724 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:06.724 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.724 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.725 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.725 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78259 5.4 5:2aa344b2:::benchmark_data_smithi121_44835_object78258:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:06.725 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:17:06.725 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 39.544136147000003, 2024-04-19T02:17:06.725 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022934350999999999, 2024-04-19T02:17:06.725 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:06.725 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.725 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:06.725 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:06.725 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:06.725 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78259 2024-04-19T02:17:06.725 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.725 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:06.725 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.726 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:06.726 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:17:06.726 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.726 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.726 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.726 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:06.726 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:17:06.726 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.726 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.726 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.726 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:06.726 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125256+0000", 2024-04-19T02:17:06.726 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:06.726 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.727 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.727 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:06.727 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125347+0000", 2024-04-19T02:17:06.727 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0470000000000006e-05 2024-04-19T02:17:06.727 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.727 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.727 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:06.727 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125358+0000", 2024-04-19T02:17:06.727 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1764e-05 2024-04-19T02:17:06.727 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.727 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.727 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.727 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125364+0000", 2024-04-19T02:17:06.727 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7189999999999998e-06 2024-04-19T02:17:06.728 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.728 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.728 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:06.728 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125391+0000", 2024-04-19T02:17:06.728 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7270000000000001e-05 2024-04-19T02:17:06.728 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.728 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.728 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:06.728 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125471+0000", 2024-04-19T02:17:06.728 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9209999999999995e-05 2024-04-19T02:17:06.728 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.728 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.728 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:06.729 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125559+0000", 2024-04-19T02:17:06.729 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.8689000000000004e-05 2024-04-19T02:17:06.729 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.729 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.729 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:06.729 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128164+0000", 2024-04-19T02:17:06.729 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0026050270000000002 2024-04-19T02:17:06.729 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.729 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.729 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:06.729 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148139+0000", 2024-04-19T02:17:06.729 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.019975050000000001 2024-04-19T02:17:06.729 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.730 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.730 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:06.730 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148169+0000", 2024-04-19T02:17:06.730 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0001e-05 2024-04-19T02:17:06.730 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.730 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.730 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:06.730 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148191+0000", 2024-04-19T02:17:06.730 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.2104999999999999e-05 2024-04-19T02:17:06.730 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.730 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:06.730 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.731 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.731 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.731 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78271 5.4 5:2982d7a6:::benchmark_data_smithi121_44835_object78270:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:06.731 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:17:06.731 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 39.537272917000003, 2024-04-19T02:17:06.731 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020841755999999999, 2024-04-19T02:17:06.731 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:06.731 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.731 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:06.731 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:06.731 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:06.731 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78271 2024-04-19T02:17:06.731 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.732 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:06.732 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.732 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:06.732 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:17:06.732 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.732 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.732 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.732 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:06.732 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:17:06.732 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.732 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.733 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.733 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:06.733 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132119+0000", 2024-04-19T02:17:06.733 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:06.733 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.733 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.733 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:06.733 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132185+0000", 2024-04-19T02:17:06.733 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5994000000000005e-05 2024-04-19T02:17:06.733 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.733 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.733 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:06.733 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132197+0000", 2024-04-19T02:17:06.733 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2091e-05 2024-04-19T02:17:06.734 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.734 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.734 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.734 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132206+0000", 2024-04-19T02:17:06.734 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.5099999999999998e-06 2024-04-19T02:17:06.734 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.734 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.734 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:06.734 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132242+0000", 2024-04-19T02:17:06.734 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5663000000000001e-05 2024-04-19T02:17:06.734 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.734 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.734 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:06.735 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132335+0000", 2024-04-19T02:17:06.735 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3275000000000004e-05 2024-04-19T02:17:06.735 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.735 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.735 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:06.735 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132432+0000", 2024-04-19T02:17:06.735 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7571000000000005e-05 2024-04-19T02:17:06.735 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.735 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.735 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:06.735 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.136706+0000", 2024-04-19T02:17:06.735 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0042738170000000001 2024-04-19T02:17:06.735 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.736 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.736 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:06.736 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152909+0000", 2024-04-19T02:17:06.736 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016202415000000001 2024-04-19T02:17:06.736 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.736 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.736 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:06.736 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152938+0000", 2024-04-19T02:17:06.736 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9740999999999999e-05 2024-04-19T02:17:06.736 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.736 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.736 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:06.736 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152962+0000", 2024-04-19T02:17:06.737 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3659000000000002e-05 2024-04-19T02:17:06.737 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.737 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:06.737 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.737 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.737 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.737 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78272 5.4 5:273e819a:::benchmark_data_smithi121_44835_object78271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:06.737 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:06.737 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 39.536783874000001, 2024-04-19T02:17:06.737 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022180163999999999, 2024-04-19T02:17:06.737 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:06.737 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.737 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:06.737 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:06.738 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:06.738 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78272 2024-04-19T02:17:06.738 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.738 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:06.738 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.738 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:06.738 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:06.738 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.738 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.738 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.738 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:06.738 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:06.738 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.739 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.739 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.739 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:06.739 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:06.739 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:06.739 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.739 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.739 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:06.739 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132690+0000", 2024-04-19T02:17:06.739 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0963000000000004e-05 2024-04-19T02:17:06.739 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.739 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.739 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:06.739 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132703+0000", 2024-04-19T02:17:06.740 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.3072e-05 2024-04-19T02:17:06.740 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.740 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.740 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.740 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132710+0000", 2024-04-19T02:17:06.740 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3100000000000003e-06 2024-04-19T02:17:06.740 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.740 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.740 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:06.740 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134005+0000", 2024-04-19T02:17:06.740 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001294513 2024-04-19T02:17:06.740 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.740 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.740 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:06.740 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134139+0000", 2024-04-19T02:17:06.740 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000134447 2024-04-19T02:17:06.741 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.741 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.741 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:06.741 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134284+0000", 2024-04-19T02:17:06.741 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014514399999999999 2024-04-19T02:17:06.741 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.741 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.741 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:06.741 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.139622+0000", 2024-04-19T02:17:06.741 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0053373830000000002 2024-04-19T02:17:06.741 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.741 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.741 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:06.741 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154737+0000", 2024-04-19T02:17:06.741 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015115195999999999 2024-04-19T02:17:06.741 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.741 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.742 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:06.742 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154768+0000", 2024-04-19T02:17:06.742 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0824999999999997e-05 2024-04-19T02:17:06.742 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.742 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.742 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:06.742 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154790+0000", 2024-04-19T02:17:06.742 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1999000000000001e-05 2024-04-19T02:17:06.742 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.742 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:06.742 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.742 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.742 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.742 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:94475 5.e 5:7a360208:::benchmark_data_smithi121_44835_object94474:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:06.743 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:35.118023+0000", 2024-04-19T02:17:06.743 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 31.551369934, 2024-04-19T02:17:06.743 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020591993999999999, 2024-04-19T02:17:06.743 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:06.743 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.743 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:06.743 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:06.743 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:06.743 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 94475 2024-04-19T02:17:06.743 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.743 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:06.743 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.743 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:06.743 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118023+0000", 2024-04-19T02:17:06.743 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.743 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.744 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.744 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:06.744 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118023+0000", 2024-04-19T02:17:06.744 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.744 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.744 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.744 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:06.744 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118023+0000", 2024-04-19T02:17:06.744 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:06.744 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.744 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.744 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:06.744 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118041+0000", 2024-04-19T02:17:06.744 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.8689999999999999e-05 2024-04-19T02:17:06.745 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.745 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.745 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:06.745 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118049+0000", 2024-04-19T02:17:06.745 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.5939999999999996e-06 2024-04-19T02:17:06.745 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.745 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.745 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.745 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118053+0000", 2024-04-19T02:17:06.745 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2080000000000002e-06 2024-04-19T02:17:06.745 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.745 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.745 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:06.745 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118093+0000", 2024-04-19T02:17:06.745 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9634e-05 2024-04-19T02:17:06.745 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.745 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.746 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:06.746 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118191+0000", 2024-04-19T02:17:06.746 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.8272999999999999e-05 2024-04-19T02:17:06.746 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.746 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.746 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:06.746 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.118280+0000", 2024-04-19T02:17:06.746 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.8702999999999994e-05 2024-04-19T02:17:06.746 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.746 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.746 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:06.746 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.124833+0000", 2024-04-19T02:17:06.746 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0065528180000000002 2024-04-19T02:17:06.746 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.746 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.747 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:06.747 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.138520+0000", 2024-04-19T02:17:06.747 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.013686959 2024-04-19T02:17:06.747 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.747 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.747 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:06.747 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.138577+0000", 2024-04-19T02:17:06.747 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7689000000000003e-05 2024-04-19T02:17:06.747 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.747 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.747 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:06.747 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.138615+0000", 2024-04-19T02:17:06.747 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8016999999999999e-05 2024-04-19T02:17:06.747 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.747 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:06.748 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.748 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.748 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.748 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:94481 5.e 5:7b2fbebf:::benchmark_data_smithi121_44835_object94480:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:06.748 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:17:06.748 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 31.548147557, 2024-04-19T02:17:06.748 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020897846000000001, 2024-04-19T02:17:06.748 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:06.748 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.748 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:06.748 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:06.748 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:06.748 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 94481 2024-04-19T02:17:06.748 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.748 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:06.748 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.749 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:06.749 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:17:06.749 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.749 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.749 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.749 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:06.749 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:17:06.749 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.749 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.749 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.749 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:06.749 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121245+0000", 2024-04-19T02:17:06.749 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:06.749 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.749 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.750 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:06.750 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121273+0000", 2024-04-19T02:17:06.750 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7250000000000002e-05 2024-04-19T02:17:06.750 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.750 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.750 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:06.750 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121277+0000", 2024-04-19T02:17:06.750 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2860000000000001e-06 2024-04-19T02:17:06.750 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.750 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.750 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.750 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121280+0000", 2024-04-19T02:17:06.750 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2739999999999999e-06 2024-04-19T02:17:06.750 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.751 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.751 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:06.751 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121320+0000", 2024-04-19T02:17:06.751 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9879000000000002e-05 2024-04-19T02:17:06.751 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.751 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.751 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:06.751 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121448+0000", 2024-04-19T02:17:06.751 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012748800000000001 2024-04-19T02:17:06.751 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.751 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.751 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:06.751 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121595+0000", 2024-04-19T02:17:06.751 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014741299999999999 2024-04-19T02:17:06.751 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.752 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.752 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:06.752 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.127776+0000", 2024-04-19T02:17:06.752 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0061811360000000003 2024-04-19T02:17:06.752 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.752 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.752 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:06.752 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142073+0000", 2024-04-19T02:17:06.752 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014296959999999999 2024-04-19T02:17:06.752 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.752 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.752 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:06.752 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142106+0000", 2024-04-19T02:17:06.753 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3348e-05 2024-04-19T02:17:06.753 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.753 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.753 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:06.753 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142144+0000", 2024-04-19T02:17:06.753 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7153000000000002e-05 2024-04-19T02:17:06.753 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.753 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:06.753 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.753 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.753 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.753 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:94581 5.b 5:dc86d6e9:::benchmark_data_smithi121_44835_object94580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:06.753 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:06.753 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 31.489212984000002, 2024-04-19T02:17:06.754 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022099711000000001, 2024-04-19T02:17:06.754 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:06.754 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.754 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:06.754 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:06.754 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:06.754 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 94581 2024-04-19T02:17:06.754 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.754 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:06.754 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.754 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:06.754 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:06.754 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.755 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.755 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.755 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:06.755 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:06.755 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.755 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.755 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.755 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:06.755 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:06.755 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:06.755 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.755 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.755 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:06.755 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180253+0000", 2024-04-19T02:17:06.755 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3163000000000004e-05 2024-04-19T02:17:06.756 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.756 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.756 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:06.756 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180266+0000", 2024-04-19T02:17:06.756 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2886e-05 2024-04-19T02:17:06.756 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.756 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.756 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.756 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180273+0000", 2024-04-19T02:17:06.756 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.4059999999999999e-06 2024-04-19T02:17:06.756 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.756 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.756 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:06.756 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180646+0000", 2024-04-19T02:17:06.756 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00037283999999999999 2024-04-19T02:17:06.757 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.757 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.757 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:06.757 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180774+0000", 2024-04-19T02:17:06.757 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012793799999999999 2024-04-19T02:17:06.757 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.757 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.757 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:06.757 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180920+0000", 2024-04-19T02:17:06.757 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000146692 2024-04-19T02:17:06.757 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.757 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.758 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:06.758 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.183344+0000", 2024-04-19T02:17:06.758 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0024231669999999999 2024-04-19T02:17:06.758 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.758 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.758 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:06.758 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202196+0000", 2024-04-19T02:17:06.758 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.018852384 2024-04-19T02:17:06.758 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.758 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.758 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:06.758 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202241+0000", 2024-04-19T02:17:06.758 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4923999999999999e-05 2024-04-19T02:17:06.759 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.759 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.759 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:06.759 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202280+0000", 2024-04-19T02:17:06.759 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9096e-05 2024-04-19T02:17:06.759 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.759 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:06.759 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.759 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.759 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.759 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:96356 5.0 5:0a661b39:::benchmark_data_smithi121_44835_object96355:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:06.759 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:17:06.759 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 30.576000142000002, 2024-04-19T02:17:06.759 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020955516, 2024-04-19T02:17:06.759 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:06.760 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.760 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:06.760 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:06.760 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:06.760 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 96356 2024-04-19T02:17:06.760 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.760 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:06.760 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.760 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:06.760 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:17:06.760 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.760 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.760 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.760 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:06.761 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:17:06.761 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.761 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.761 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.761 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:06.761 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:17:06.761 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:06.761 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.761 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.761 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:06.761 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093455+0000", 2024-04-19T02:17:06.761 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.2205000000000005e-05 2024-04-19T02:17:06.761 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.761 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.761 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:06.762 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093464+0000", 2024-04-19T02:17:06.762 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3910000000000004e-06 2024-04-19T02:17:06.762 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.762 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.762 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.762 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093469+0000", 2024-04-19T02:17:06.762 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.7249999999999997e-06 2024-04-19T02:17:06.762 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.762 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.762 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:06.762 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099643+0000", 2024-04-19T02:17:06.762 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0061743359999999999 2024-04-19T02:17:06.762 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.762 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.763 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:06.763 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099774+0000", 2024-04-19T02:17:06.763 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013050599999999999 2024-04-19T02:17:06.763 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.763 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.763 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:06.763 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099917+0000", 2024-04-19T02:17:06.763 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000143187 2024-04-19T02:17:06.763 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.763 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.763 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:06.763 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.105432+0000", 2024-04-19T02:17:06.763 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.005514873 2024-04-19T02:17:06.763 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.763 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.763 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:06.764 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114264+0000", 2024-04-19T02:17:06.764 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.008831752 2024-04-19T02:17:06.764 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.764 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.764 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:06.764 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114300+0000", 2024-04-19T02:17:06.764 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6582000000000003e-05 2024-04-19T02:17:06.764 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.764 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.764 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:06.764 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114349+0000", 2024-04-19T02:17:06.764 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8579999999999999e-05 2024-04-19T02:17:06.764 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.764 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:06.764 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.765 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.765 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.765 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:96357 5.0 5:00efce8b:::benchmark_data_smithi121_44835_object96356:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:06.765 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:17:06.765 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 30.575920463999999, 2024-04-19T02:17:06.765 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020937471999999999, 2024-04-19T02:17:06.765 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:06.765 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.765 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:06.765 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:06.765 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:06.765 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 96357 2024-04-19T02:17:06.765 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.765 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:06.765 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.766 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:06.766 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:17:06.766 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.766 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.766 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.766 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:06.766 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:17:06.766 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.766 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.766 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.766 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:06.766 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093472+0000", 2024-04-19T02:17:06.766 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:06.766 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.767 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.767 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:06.767 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093513+0000", 2024-04-19T02:17:06.767 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0213000000000003e-05 2024-04-19T02:17:06.767 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.767 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.767 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:06.767 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093519+0000", 2024-04-19T02:17:06.767 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.066e-06 2024-04-19T02:17:06.767 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.767 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.767 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.767 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093525+0000", 2024-04-19T02:17:06.767 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.8170000000000004e-06 2024-04-19T02:17:06.767 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.768 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.768 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:06.768 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103412+0000", 2024-04-19T02:17:06.768 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0098872739999999997 2024-04-19T02:17:06.768 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.768 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.768 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:06.768 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103551+0000", 2024-04-19T02:17:06.768 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000139295 2024-04-19T02:17:06.768 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.768 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.768 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:06.768 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103701+0000", 2024-04-19T02:17:06.768 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014954599999999999 2024-04-19T02:17:06.768 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.769 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.769 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:06.769 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.108849+0000", 2024-04-19T02:17:06.769 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0051487199999999999 2024-04-19T02:17:06.769 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.769 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.769 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:06.769 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114355+0000", 2024-04-19T02:17:06.769 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0055052529999999999 2024-04-19T02:17:06.769 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.769 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.769 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:06.769 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114379+0000", 2024-04-19T02:17:06.769 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4275000000000001e-05 2024-04-19T02:17:06.770 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.770 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.770 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:06.770 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114410+0000", 2024-04-19T02:17:06.770 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1356999999999998e-05 2024-04-19T02:17:06.770 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.770 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:06.770 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.770 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.770 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.770 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:104431 5.8 5:14818e19:::benchmark_data_smithi121_44835_object104430:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T02:17:06.770 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:17:06.770 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 26.458007939000002, 2024-04-19T02:17:06.770 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022149528000000002, 2024-04-19T02:17:06.771 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:06.771 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.771 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:06.771 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:06.771 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:06.771 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 104431 2024-04-19T02:17:06.771 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.771 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:06.771 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.771 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:06.771 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:17:06.771 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.771 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.771 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.771 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:06.772 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:17:06.772 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.772 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.772 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.772 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:06.772 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211384+0000", 2024-04-19T02:17:06.772 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:06.772 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.772 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.772 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:06.772 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211458+0000", 2024-04-19T02:17:06.772 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3311000000000003e-05 2024-04-19T02:17:06.772 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.772 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.772 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:06.772 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211471+0000", 2024-04-19T02:17:06.773 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.3308e-05 2024-04-19T02:17:06.773 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.773 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.773 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.773 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211479+0000", 2024-04-19T02:17:06.773 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0909999999999993e-06 2024-04-19T02:17:06.773 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.773 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.773 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:06.773 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.221821+0000", 2024-04-19T02:17:06.773 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010341596999999999 2024-04-19T02:17:06.773 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.773 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.773 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:06.773 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.221966+0000", 2024-04-19T02:17:06.774 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000145167 2024-04-19T02:17:06.774 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.774 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.774 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:06.774 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.222077+0000", 2024-04-19T02:17:06.774 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011128000000000001 2024-04-19T02:17:06.774 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.774 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.774 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:06.774 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.228126+0000", 2024-04-19T02:17:06.774 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0060486710000000003 2024-04-19T02:17:06.774 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.774 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.774 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:06.774 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233449+0000", 2024-04-19T02:17:06.775 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0053231370000000004 2024-04-19T02:17:06.775 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.775 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.775 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:06.775 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233498+0000", 2024-04-19T02:17:06.775 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8798999999999998e-05 2024-04-19T02:17:06.775 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.775 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.775 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:06.775 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233535+0000", 2024-04-19T02:17:06.775 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7119000000000002e-05 2024-04-19T02:17:06.775 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.775 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:06.775 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.775 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.775 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.775 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:114200 5.8 5:1428c006:::benchmark_data_smithi121_44835_object114199:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T02:17:06.776 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:45.082288+0000", 2024-04-19T02:17:06.776 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 21.587105352999998, 2024-04-19T02:17:06.776 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020551719999999999, 2024-04-19T02:17:06.776 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:06.776 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.776 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:06.776 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:06.776 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:06.776 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 114200 2024-04-19T02:17:06.776 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.776 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:06.776 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.776 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:06.777 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.082288+0000", 2024-04-19T02:17:06.777 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.777 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.777 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.777 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:06.777 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.082288+0000", 2024-04-19T02:17:06.777 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.777 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.777 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.777 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:06.777 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.082287+0000", 2024-04-19T02:17:06.777 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:06.777 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.778 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.778 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:06.778 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.082345+0000", 2024-04-19T02:17:06.778 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7642999999999997e-05 2024-04-19T02:17:06.778 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.778 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.778 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:06.778 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.082351+0000", 2024-04-19T02:17:06.778 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.2999999999999998e-06 2024-04-19T02:17:06.778 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.778 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.778 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.778 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.082355+0000", 2024-04-19T02:17:06.778 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7890000000000001e-06 2024-04-19T02:17:06.779 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.779 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.779 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:06.779 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.085813+0000", 2024-04-19T02:17:06.779 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.003457636 2024-04-19T02:17:06.779 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.779 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.779 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:06.779 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.085918+0000", 2024-04-19T02:17:06.779 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010485299999999999 2024-04-19T02:17:06.779 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.779 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.779 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:06.779 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.086071+0000", 2024-04-19T02:17:06.779 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00015367199999999999 2024-04-19T02:17:06.780 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.780 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.780 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:06.780 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.092128+0000", 2024-04-19T02:17:06.780 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0060571080000000003 2024-04-19T02:17:06.780 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.780 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.780 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:06.780 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.102784+0000", 2024-04-19T02:17:06.780 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010656116 2024-04-19T02:17:06.780 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.780 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.780 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:06.780 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.102818+0000", 2024-04-19T02:17:06.780 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3661999999999997e-05 2024-04-19T02:17:06.781 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.781 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.781 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:06.781 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:45.102840+0000", 2024-04-19T02:17:06.781 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1509e-05 2024-04-19T02:17:06.781 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.781 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:06.781 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.781 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.781 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.781 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:121827 5.e 5:73ab8f20:::benchmark_data_smithi121_44835_object121826:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T02:17:06.781 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:48.926285+0000", 2024-04-19T02:17:06.781 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 17.743107994999999, 2024-04-19T02:17:06.781 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020626592999999999, 2024-04-19T02:17:06.781 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:06.782 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:06.782 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:06.782 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:06.782 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:06.782 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 121827 2024-04-19T02:17:06.782 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.782 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:06.782 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.782 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:06.782 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.926285+0000", 2024-04-19T02:17:06.782 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.782 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.782 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.783 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:06.783 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.926285+0000", 2024-04-19T02:17:06.783 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:06.783 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.783 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.783 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:06.783 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.926285+0000", 2024-04-19T02:17:06.783 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:06.783 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.783 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.783 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:06.783 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.926306+0000", 2024-04-19T02:17:06.783 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.0659e-05 2024-04-19T02:17:06.783 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.783 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.784 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:06.784 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.926310+0000", 2024-04-19T02:17:06.784 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.374e-06 2024-04-19T02:17:06.784 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.784 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.784 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.784 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.926313+0000", 2024-04-19T02:17:06.784 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1879999999999998e-06 2024-04-19T02:17:06.784 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.784 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.784 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:06.784 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.930441+0000", 2024-04-19T02:17:06.784 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0041274220000000004 2024-04-19T02:17:06.784 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.785 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.785 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:06.785 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.930534+0000", 2024-04-19T02:17:06.785 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3834999999999999e-05 2024-04-19T02:17:06.785 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.785 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.785 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:06.785 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.930644+0000", 2024-04-19T02:17:06.785 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000110109 2024-04-19T02:17:06.785 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.785 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.785 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:06.785 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.933925+0000", 2024-04-19T02:17:06.785 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0032810349999999999 2024-04-19T02:17:06.785 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.786 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.786 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:06.786 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.946847+0000", 2024-04-19T02:17:06.786 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.012921807 2024-04-19T02:17:06.786 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.786 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.786 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:06.786 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.946875+0000", 2024-04-19T02:17:06.786 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7977e-05 2024-04-19T02:17:06.786 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:06.786 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:06.786 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:06.786 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:48.946912+0000", 2024-04-19T02:17:06.786 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6604999999999999e-05 2024-04-19T02:17:06.787 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.787 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:06.787 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.787 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:06.787 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:06.787 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:17:06.788 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:06.789+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:06.789 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:06.888 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:06.889+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:06.940 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:06.940 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:17:06.940 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.940 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:157515 5.7 5:e8e900cb:::benchmark_data_smithi121_44835_object23480:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:06.941 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:06.926738+0000", 2024-04-19T02:17:06.941 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.014875793, 2024-04-19T02:17:06.941 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014895515999999999, 2024-04-19T02:17:06.941 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:06.941 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:06.941 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:06.941 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:06.941 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:06.941 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 157515 2024-04-19T02:17:06.941 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.941 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:06.941 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.941 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:06.941 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.926738+0000", 2024-04-19T02:17:06.941 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:06.942 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.942 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.942 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:06.942 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.926738+0000", 2024-04-19T02:17:06.942 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:06.942 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.942 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.942 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:06.942 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.926738+0000", 2024-04-19T02:17:06.942 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:06.942 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.942 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.942 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:06.943 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.926741+0000", 2024-04-19T02:17:06.943 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5779999999999999e-06 2024-04-19T02:17:06.943 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.943 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.943 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:06.943 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.926749+0000", 2024-04-19T02:17:06.943 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5750000000000003e-06 2024-04-19T02:17:06.943 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.943 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.943 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.943 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.926754+0000", 2024-04-19T02:17:06.943 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7049999999999998e-06 2024-04-19T02:17:06.943 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.943 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.943 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:06.944 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.926784+0000", 2024-04-19T02:17:06.944 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0618999999999999e-05 2024-04-19T02:17:06.944 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.944 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.944 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:06.944 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.926868+0000", 2024-04-19T02:17:06.944 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4320000000000006e-05 2024-04-19T02:17:06.944 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.944 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.944 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:06.944 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.926935+0000", 2024-04-19T02:17:06.944 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6066000000000001e-05 2024-04-19T02:17:06.944 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.944 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.944 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:06.945 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.928603+0000", 2024-04-19T02:17:06.945 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0016686170000000001 2024-04-19T02:17:06.945 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:06.945 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:06.945 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:06.945 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.945 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.945 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:157521 5.d 5:ba82e5be:::benchmark_data_smithi121_44835_object23486:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:06.945 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:06.939250+0000", 2024-04-19T02:17:06.945 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0023644859999999998, 2024-04-19T02:17:06.945 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0024370279999999999, 2024-04-19T02:17:06.945 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:06.945 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:06.945 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:06.945 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:06.946 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:06.946 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 157521 2024-04-19T02:17:06.946 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.946 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:06.946 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.946 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:06.946 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.939250+0000", 2024-04-19T02:17:06.946 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:06.946 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.946 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.946 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:06.946 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.939250+0000", 2024-04-19T02:17:06.946 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:06.946 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.947 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:06.947 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.939249+0000", 2024-04-19T02:17:06.947 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:06.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.947 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:06.947 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.939253+0000", 2024-04-19T02:17:06.947 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4469999999999999e-06 2024-04-19T02:17:06.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.947 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:06.947 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.939264+0000", 2024-04-19T02:17:06.947 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0413e-05 2024-04-19T02:17:06.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.948 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:06.948 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.939269+0000", 2024-04-19T02:17:06.948 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5629999999999999e-06 2024-04-19T02:17:06.948 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.948 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.948 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:06.948 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.939329+0000", 2024-04-19T02:17:06.948 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0136999999999997e-05 2024-04-19T02:17:06.948 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.948 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.948 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:06.948 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.939409+0000", 2024-04-19T02:17:06.948 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9373000000000001e-05 2024-04-19T02:17:06.948 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.948 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.948 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:06.949 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.939471+0000", 2024-04-19T02:17:06.949 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2234000000000001e-05 2024-04-19T02:17:06.949 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:06.949 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:06.949 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:06.949 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.941150+0000", 2024-04-19T02:17:06.949 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0016789789999999999 2024-04-19T02:17:06.949 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:06.949 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:06.949 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:06.949 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:06.949 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-04-19T02:17:06.949 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 2 2024-04-19T02:17:06.949 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:06.952 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:06.994 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:06.995+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:07.090 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:07.091+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:07.158 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:07.158 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-04-19T02:17:07.158 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-04-19T02:17:07.158 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-04-19T02:17:07.158 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:07.171 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:07.217 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:07.216+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:07.252 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T02:17:07.292 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:07.293+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:07.320 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:07.320 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-04-19T02:17:07.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-04-19T02:17:07.320 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:17:07.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.320 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:07.320 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:17:07.320 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 98.049378465999993, 2024-04-19T02:17:07.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020307345000000001, 2024-04-19T02:17:07.320 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:07.320 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:07.320 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:07.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:07.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:17:07.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:07.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:07.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:17:07.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:07.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:07.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269791+0000", 2024-04-19T02:17:07.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:07.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:07.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269795+0000", 2024-04-19T02:17:07.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5619999999999999e-06 2024-04-19T02:17:07.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.322 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:07.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269802+0000", 2024-04-19T02:17:07.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8469999999999998e-06 2024-04-19T02:17:07.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.322 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:07.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269807+0000", 2024-04-19T02:17:07.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.707e-06 2024-04-19T02:17:07.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:07.323 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269950+0000", 2024-04-19T02:17:07.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000143313 2024-04-19T02:17:07.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:07.323 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269955+0000", 2024-04-19T02:17:07.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4029999999999998e-06 2024-04-19T02:17:07.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:07.323 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.283806+0000", 2024-04-19T02:17:07.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013850220999999999 2024-04-19T02:17:07.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:07.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.283896+0000", 2024-04-19T02:17:07.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0261999999999997e-05 2024-04-19T02:17:07.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:07.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284022+0000", 2024-04-19T02:17:07.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012641200000000001 2024-04-19T02:17:07.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:07.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289066+0000", 2024-04-19T02:17:07.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050438490000000004 2024-04-19T02:17:07.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:07.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290011+0000", 2024-04-19T02:17:07.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00094490700000000004 2024-04-19T02:17:07.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:07.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290054+0000", 2024-04-19T02:17:07.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.337e-05 2024-04-19T02:17:07.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:07.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290099+0000", 2024-04-19T02:17:07.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4987999999999997e-05 2024-04-19T02:17:07.326 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:07.326 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:07.326 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:07.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.326 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:07.326 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:17:07.327 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 98.049300536000004, 2024-04-19T02:17:07.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020331023, 2024-04-19T02:17:07.327 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:07.327 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:07.327 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:07.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.327 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:07.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:17:07.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:07.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:07.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:17:07.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:07.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:07.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269869+0000", 2024-04-19T02:17:07.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:07.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:07.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269873+0000", 2024-04-19T02:17:07.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0219999999999998e-06 2024-04-19T02:17:07.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:07.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269881+0000", 2024-04-19T02:17:07.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.79e-06 2024-04-19T02:17:07.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:07.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269887+0000", 2024-04-19T02:17:07.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7899999999999996e-06 2024-04-19T02:17:07.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:07.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269983+0000", 2024-04-19T02:17:07.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6057000000000005e-05 2024-04-19T02:17:07.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:07.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269986+0000", 2024-04-19T02:17:07.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9220000000000001e-06 2024-04-19T02:17:07.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:07.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284350+0000", 2024-04-19T02:17:07.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014364335000000001 2024-04-19T02:17:07.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.331 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:07.331 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284664+0000", 2024-04-19T02:17:07.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000313646 2024-04-19T02:17:07.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.331 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:07.331 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284794+0000", 2024-04-19T02:17:07.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129839 2024-04-19T02:17:07.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.331 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:07.331 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289107+0000", 2024-04-19T02:17:07.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0043127060000000004 2024-04-19T02:17:07.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.332 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:07.332 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290108+0000", 2024-04-19T02:17:07.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0010010590000000001 2024-04-19T02:17:07.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.332 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:07.332 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290144+0000", 2024-04-19T02:17:07.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6709999999999999e-05 2024-04-19T02:17:07.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.332 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:07.332 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290201+0000", 2024-04-19T02:17:07.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6654999999999999e-05 2024-04-19T02:17:07.332 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:07.333 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:07.333 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:07.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.333 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:07.333 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:17:07.333 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 98.049258194999993, 2024-04-19T02:17:07.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020507241999999998, 2024-04-19T02:17:07.333 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:07.333 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:07.333 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:07.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:07.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:17:07.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:07.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:07.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:17:07.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:07.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:07.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:17:07.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:07.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:07.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269915+0000", 2024-04-19T02:17:07.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.472e-06 2024-04-19T02:17:07.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.335 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:07.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269928+0000", 2024-04-19T02:17:07.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2979000000000001e-05 2024-04-19T02:17:07.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.335 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:07.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269935+0000", 2024-04-19T02:17:07.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8859999999999998e-06 2024-04-19T02:17:07.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.336 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:07.336 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270009+0000", 2024-04-19T02:17:07.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3429000000000005e-05 2024-04-19T02:17:07.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.336 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.336 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:07.336 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270013+0000", 2024-04-19T02:17:07.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2590000000000002e-06 2024-04-19T02:17:07.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.336 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.336 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:07.336 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285375+0000", 2024-04-19T02:17:07.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015362275999999999 2024-04-19T02:17:07.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.336 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.336 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:07.337 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285451+0000", 2024-04-19T02:17:07.337 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5338000000000003e-05 2024-04-19T02:17:07.337 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.337 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.337 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:07.337 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285562+0000", 2024-04-19T02:17:07.337 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000111285 2024-04-19T02:17:07.337 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.337 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.337 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:07.337 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289134+0000", 2024-04-19T02:17:07.337 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035719670000000001 2024-04-19T02:17:07.337 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.337 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.337 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:07.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290341+0000", 2024-04-19T02:17:07.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012074500000000001 2024-04-19T02:17:07.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:07.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290383+0000", 2024-04-19T02:17:07.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1386e-05 2024-04-19T02:17:07.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:07.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290419+0000", 2024-04-19T02:17:07.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6884000000000001e-05 2024-04-19T02:17:07.338 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:07.338 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:07.338 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:07.339 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.339 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.339 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:07.339 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:17:07.339 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 98.049179934999998, 2024-04-19T02:17:07.339 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022007204999999998, 2024-04-19T02:17:07.339 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:07.339 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:07.339 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:07.339 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.339 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:07.339 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:17:07.339 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:07.339 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.340 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:07.340 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:17:07.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:07.340 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.340 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:07.340 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269990+0000", 2024-04-19T02:17:07.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:07.340 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.340 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:07.340 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269999+0000", 2024-04-19T02:17:07.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9539999999999993e-06 2024-04-19T02:17:07.340 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.341 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:07.341 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270006+0000", 2024-04-19T02:17:07.341 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.216e-06 2024-04-19T02:17:07.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.341 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.341 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:07.341 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270012+0000", 2024-04-19T02:17:07.341 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5049999999999998e-06 2024-04-19T02:17:07.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.341 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.341 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:07.341 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270058+0000", 2024-04-19T02:17:07.341 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.634e-05 2024-04-19T02:17:07.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.342 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:07.342 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270064+0000", 2024-04-19T02:17:07.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0669999999999997e-06 2024-04-19T02:17:07.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.342 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:07.342 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287159+0000", 2024-04-19T02:17:07.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017095086999999998 2024-04-19T02:17:07.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.342 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:07.342 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287254+0000", 2024-04-19T02:17:07.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4716000000000006e-05 2024-04-19T02:17:07.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:07.343 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287389+0000", 2024-04-19T02:17:07.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013511900000000001 2024-04-19T02:17:07.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:07.343 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290481+0000", 2024-04-19T02:17:07.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030920169999999999 2024-04-19T02:17:07.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:07.343 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291931+0000", 2024-04-19T02:17:07.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001450118 2024-04-19T02:17:07.344 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:07.344 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291960+0000", 2024-04-19T02:17:07.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9096000000000001e-05 2024-04-19T02:17:07.344 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:07.344 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291998+0000", 2024-04-19T02:17:07.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7514e-05 2024-04-19T02:17:07.344 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:07.344 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:07.344 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:07.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.345 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:07.345 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:17:07.345 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 98.049119364000006, 2024-04-19T02:17:07.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020759494999999999, 2024-04-19T02:17:07.345 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:07.345 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:07.345 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:07.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.345 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:07.345 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:17:07.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:07.346 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.346 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:07.346 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:17:07.346 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:07.346 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.346 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:07.346 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:17:07.346 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:07.346 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.346 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:07.346 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270054+0000", 2024-04-19T02:17:07.346 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.27e-06 2024-04-19T02:17:07.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.347 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:07.347 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270061+0000", 2024-04-19T02:17:07.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1289999999999998e-06 2024-04-19T02:17:07.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.347 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:07.347 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270067+0000", 2024-04-19T02:17:07.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.207e-06 2024-04-19T02:17:07.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.347 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:07.347 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270105+0000", 2024-04-19T02:17:07.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7549999999999998e-05 2024-04-19T02:17:07.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.348 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:07.348 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270112+0000", 2024-04-19T02:17:07.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3200000000000002e-06 2024-04-19T02:17:07.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.348 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:07.348 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282454+0000", 2024-04-19T02:17:07.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012341569 2024-04-19T02:17:07.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.348 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:07.348 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282740+0000", 2024-04-19T02:17:07.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000286481 2024-04-19T02:17:07.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:07.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282879+0000", 2024-04-19T02:17:07.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013887799999999999 2024-04-19T02:17:07.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:07.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290325+0000", 2024-04-19T02:17:07.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074459779999999998 2024-04-19T02:17:07.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:07.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290759+0000", 2024-04-19T02:17:07.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000433688 2024-04-19T02:17:07.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:07.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290789+0000", 2024-04-19T02:17:07.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9960000000000001e-05 2024-04-19T02:17:07.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:07.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290811+0000", 2024-04-19T02:17:07.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1965999999999999e-05 2024-04-19T02:17:07.350 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:07.350 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:07.350 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:07.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.350 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:07.351 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:17:07.351 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 98.049069158999998, 2024-04-19T02:17:07.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020837887999999999, 2024-04-19T02:17:07.351 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:07.351 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:07.351 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:07.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:07.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:17:07.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:07.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:07.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:17:07.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:07.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.352 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:07.352 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:17:07.352 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:07.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.352 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:07.352 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270109+0000", 2024-04-19T02:17:07.352 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3110000000000006e-06 2024-04-19T02:17:07.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.352 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:07.352 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270117+0000", 2024-04-19T02:17:07.352 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0479999999999999e-06 2024-04-19T02:17:07.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.353 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.353 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:07.353 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270123+0000", 2024-04-19T02:17:07.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5500000000000002e-06 2024-04-19T02:17:07.353 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.353 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.353 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:07.353 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270150+0000", 2024-04-19T02:17:07.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7712000000000002e-05 2024-04-19T02:17:07.353 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.353 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.353 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:07.353 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270153+0000", 2024-04-19T02:17:07.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6089999999999999e-06 2024-04-19T02:17:07.354 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.354 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.354 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:07.354 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285958+0000", 2024-04-19T02:17:07.354 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015805274000000001 2024-04-19T02:17:07.354 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.354 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.354 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:07.354 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286126+0000", 2024-04-19T02:17:07.354 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016765700000000001 2024-04-19T02:17:07.354 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.354 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.354 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:07.354 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286296+0000", 2024-04-19T02:17:07.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017007 2024-04-19T02:17:07.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:07.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290426+0000", 2024-04-19T02:17:07.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041299839999999997 2024-04-19T02:17:07.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:07.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290867+0000", 2024-04-19T02:17:07.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00044083300000000001 2024-04-19T02:17:07.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:07.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290900+0000", 2024-04-19T02:17:07.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3380000000000002e-05 2024-04-19T02:17:07.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.356 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:07.356 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290939+0000", 2024-04-19T02:17:07.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8970000000000001e-05 2024-04-19T02:17:07.356 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:07.356 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:07.356 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:07.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.356 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:21 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:07.356 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:17:07.356 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 98.048980486999994, 2024-04-19T02:17:07.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020833187999999999, 2024-04-19T02:17:07.357 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:07.357 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:07.357 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:07.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:07.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:17:07.357 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:07.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:07.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:17:07.357 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:07.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:07.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270189+0000", 2024-04-19T02:17:07.358 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:07.358 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.358 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.358 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:07.358 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270192+0000", 2024-04-19T02:17:07.358 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7549999999999999e-06 2024-04-19T02:17:07.358 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.358 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.358 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:07.358 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270198+0000", 2024-04-19T02:17:07.358 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0859999999999998e-06 2024-04-19T02:17:07.358 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.358 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.358 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:07.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270204+0000", 2024-04-19T02:17:07.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1970000000000004e-06 2024-04-19T02:17:07.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.359 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:07.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270238+0000", 2024-04-19T02:17:07.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4282000000000001e-05 2024-04-19T02:17:07.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.359 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:07.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270240+0000", 2024-04-19T02:17:07.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3099999999999999e-06 2024-04-19T02:17:07.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.359 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:07.360 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287131+0000", 2024-04-19T02:17:07.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01689104 2024-04-19T02:17:07.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.360 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:07.360 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287262+0000", 2024-04-19T02:17:07.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130347 2024-04-19T02:17:07.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.360 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:07.360 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291023+0000", 2024-04-19T02:17:07.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037616350000000002 2024-04-19T02:17:07.360 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:07.360 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:07.360 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:07.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.361 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.361 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:16519 5.f 5:fc30d3a1:::benchmark_data_smithi121_44835_object16518:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:17:07.361 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.880723+0000", 2024-04-19T02:17:07.361 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 67.438447709000002, 2024-04-19T02:17:07.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020492519000000001, 2024-04-19T02:17:07.361 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:07.361 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:07.361 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:07.361 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:07.361 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:07.362 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16519 2024-04-19T02:17:07.362 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.362 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:07.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:07.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880723+0000", 2024-04-19T02:17:07.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:07.362 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:07.363 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880723+0000", 2024-04-19T02:17:07.363 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:07.363 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.363 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.363 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:07.363 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880722+0000", 2024-04-19T02:17:07.363 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:07.363 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.363 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.363 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:07.363 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880794+0000", 2024-04-19T02:17:07.364 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1515999999999998e-05 2024-04-19T02:17:07.364 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.364 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.364 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:07.364 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880805+0000", 2024-04-19T02:17:07.364 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1353e-05 2024-04-19T02:17:07.364 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.364 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.364 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:07.364 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880812+0000", 2024-04-19T02:17:07.364 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1230000000000002e-06 2024-04-19T02:17:07.364 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.364 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.365 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:07.365 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.890954+0000", 2024-04-19T02:17:07.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010142253 2024-04-19T02:17:07.365 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.365 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.365 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:07.365 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891079+0000", 2024-04-19T02:17:07.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000124917 2024-04-19T02:17:07.365 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.365 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.365 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:07.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891218+0000", 2024-04-19T02:17:07.366 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000138715 2024-04-19T02:17:07.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:07.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.897321+0000", 2024-04-19T02:17:07.366 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0061026830000000002 2024-04-19T02:17:07.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:07.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901137+0000", 2024-04-19T02:17:07.366 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038161699999999998 2024-04-19T02:17:07.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.367 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.367 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:07.367 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901181+0000", 2024-04-19T02:17:07.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4362e-05 2024-04-19T02:17:07.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.367 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.367 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:07.367 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901215+0000", 2024-04-19T02:17:07.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3929e-05 2024-04-19T02:17:07.367 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:07.367 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:07.368 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:07.368 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.368 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.368 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:16520 5.f 5:f0474691:::benchmark_data_smithi121_44835_object16519:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:17:07.368 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.880833+0000", 2024-04-19T02:17:07.368 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 67.438337693999998, 2024-04-19T02:17:07.368 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020460160000000002, 2024-04-19T02:17:07.368 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:07.368 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:07.368 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:07.368 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:07.368 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:07.369 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16520 2024-04-19T02:17:07.369 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.369 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:07.369 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.369 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:07.369 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880833+0000", 2024-04-19T02:17:07.369 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:07.369 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.369 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.369 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:07.369 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880833+0000", 2024-04-19T02:17:07.369 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:07.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.370 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:07.370 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880832+0000", 2024-04-19T02:17:07.370 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:07.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.370 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:07.370 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880909+0000", 2024-04-19T02:17:07.370 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7095000000000006e-05 2024-04-19T02:17:07.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.371 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.371 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:07.371 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880919+0000", 2024-04-19T02:17:07.371 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8919999999999995e-06 2024-04-19T02:17:07.371 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.371 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.371 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:07.371 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880927+0000", 2024-04-19T02:17:07.371 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8809999999999996e-06 2024-04-19T02:17:07.371 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.371 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.371 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:07.371 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891901+0000", 2024-04-19T02:17:07.372 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010974263999999999 2024-04-19T02:17:07.372 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.372 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.372 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:07.372 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.892021+0000", 2024-04-19T02:17:07.372 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120074 2024-04-19T02:17:07.372 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.372 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.372 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:07.372 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.892165+0000", 2024-04-19T02:17:07.372 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014328600000000001 2024-04-19T02:17:07.373 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.373 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.373 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:07.373 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.897347+0000", 2024-04-19T02:17:07.373 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.005182603 2024-04-19T02:17:07.373 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.373 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.373 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:07.373 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901224+0000", 2024-04-19T02:17:07.373 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038767620000000002 2024-04-19T02:17:07.374 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.374 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.374 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:07.374 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901264+0000", 2024-04-19T02:17:07.374 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9579000000000002e-05 2024-04-19T02:17:07.374 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.374 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.374 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:07.374 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901293+0000", 2024-04-19T02:17:07.374 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9300999999999999e-05 2024-04-19T02:17:07.374 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:07.374 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:07.375 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:07.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.375 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:44167 5.7 5:ef4300c4:::benchmark_data_smithi121_44835_object44166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:17:07.375 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:09.853830+0000", 2024-04-19T02:17:07.375 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 57.465340210000001, 2024-04-19T02:17:07.375 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020082104, 2024-04-19T02:17:07.375 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:07.375 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:07.375 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:07.375 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:07.376 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:07.376 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 44167 2024-04-19T02:17:07.376 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.376 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:07.376 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.376 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:07.376 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853830+0000", 2024-04-19T02:17:07.376 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:07.376 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.376 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.376 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:07.376 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853830+0000", 2024-04-19T02:17:07.376 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:07.377 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.377 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.377 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:07.377 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853829+0000", 2024-04-19T02:17:07.377 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:07.377 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.377 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.377 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:07.377 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853863+0000", 2024-04-19T02:17:07.377 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3151999999999997e-05 2024-04-19T02:17:07.377 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.377 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.378 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:07.378 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853873+0000", 2024-04-19T02:17:07.378 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0366e-05 2024-04-19T02:17:07.378 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.378 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:07.378 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853881+0000", 2024-04-19T02:17:07.378 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6539999999999999e-06 2024-04-19T02:17:07.378 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.378 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:07.378 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.859162+0000", 2024-04-19T02:17:07.379 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052810740000000002 2024-04-19T02:17:07.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.379 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.379 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:07.379 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.859303+0000", 2024-04-19T02:17:07.379 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000140975 2024-04-19T02:17:07.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.379 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.379 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:07.379 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.859460+0000", 2024-04-19T02:17:07.379 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015754199999999999 2024-04-19T02:17:07.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.380 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.380 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:07.380 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.865142+0000", 2024-04-19T02:17:07.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0056819130000000002 2024-04-19T02:17:07.380 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.380 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.380 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:07.380 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.873828+0000", 2024-04-19T02:17:07.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0086861799999999999 2024-04-19T02:17:07.380 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.380 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.380 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:07.381 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.873871+0000", 2024-04-19T02:17:07.381 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2624999999999999e-05 2024-04-19T02:17:07.381 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.381 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.381 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:07.381 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.873912+0000", 2024-04-19T02:17:07.381 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1486000000000002e-05 2024-04-19T02:17:07.381 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:07.381 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:07.381 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:07.381 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.382 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.382 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:53042 5.f 5:f744ac14:::benchmark_data_smithi121_44835_object53041:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T02:17:07.382 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:13.560196+0000", 2024-04-19T02:17:07.382 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 53.758974391000002, 2024-04-19T02:17:07.382 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020122021, 2024-04-19T02:17:07.382 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:07.382 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:07.382 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:07.382 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:07.382 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:07.382 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 53042 2024-04-19T02:17:07.383 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.383 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:07.383 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.383 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:07.383 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560196+0000", 2024-04-19T02:17:07.383 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:07.383 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.383 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.383 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:07.383 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560196+0000", 2024-04-19T02:17:07.383 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:07.383 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.384 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.384 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:07.384 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560195+0000", 2024-04-19T02:17:07.384 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:07.384 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.384 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.384 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:07.384 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560255+0000", 2024-04-19T02:17:07.384 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9441000000000002e-05 2024-04-19T02:17:07.384 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.384 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.384 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:07.385 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560264+0000", 2024-04-19T02:17:07.385 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1130000000000007e-06 2024-04-19T02:17:07.385 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.385 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.385 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:07.385 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560271+0000", 2024-04-19T02:17:07.385 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9800000000000001e-06 2024-04-19T02:17:07.385 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.385 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.385 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:07.385 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560312+0000", 2024-04-19T02:17:07.385 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0828999999999998e-05 2024-04-19T02:17:07.385 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.385 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.386 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:07.386 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560456+0000", 2024-04-19T02:17:07.386 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014474799999999999 2024-04-19T02:17:07.386 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.386 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.386 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:07.386 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560591+0000", 2024-04-19T02:17:07.386 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013482699999999999 2024-04-19T02:17:07.386 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.386 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.386 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:07.386 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.564799+0000", 2024-04-19T02:17:07.386 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042080080000000001 2024-04-19T02:17:07.387 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.387 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.387 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:07.387 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580233+0000", 2024-04-19T02:17:07.387 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015433715000000001 2024-04-19T02:17:07.387 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.387 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.387 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:07.387 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580280+0000", 2024-04-19T02:17:07.387 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6465000000000003e-05 2024-04-19T02:17:07.387 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.387 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.388 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:07.388 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580318+0000", 2024-04-19T02:17:07.388 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8557999999999999e-05 2024-04-19T02:17:07.388 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:07.388 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:07.388 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:07.388 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.388 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.388 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:85866 5.2 5:48b1d46d:::benchmark_data_smithi121_44835_object85865:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T02:17:07.388 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:30.771909+0000", 2024-04-19T02:17:07.388 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 36.547261118999998, 2024-04-19T02:17:07.388 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020516216, 2024-04-19T02:17:07.388 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:07.388 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:07.388 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:07.389 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:07.389 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:07.389 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 85866 2024-04-19T02:17:07.389 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.389 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:07.389 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.389 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:07.389 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771909+0000", 2024-04-19T02:17:07.389 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:07.389 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.389 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.389 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:07.390 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771909+0000", 2024-04-19T02:17:07.390 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:07.390 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.390 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.390 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:07.390 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771909+0000", 2024-04-19T02:17:07.390 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:07.390 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.390 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.390 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:07.390 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771952+0000", 2024-04-19T02:17:07.390 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2660000000000002e-05 2024-04-19T02:17:07.390 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.391 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.391 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:07.391 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771959+0000", 2024-04-19T02:17:07.391 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7670000000000003e-06 2024-04-19T02:17:07.391 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.391 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.391 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:07.391 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771966+0000", 2024-04-19T02:17:07.391 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.905e-06 2024-04-19T02:17:07.391 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.391 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.391 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:07.391 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771999+0000", 2024-04-19T02:17:07.391 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2360999999999997e-05 2024-04-19T02:17:07.392 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.392 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.392 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:07.392 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.772133+0000", 2024-04-19T02:17:07.392 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013398699999999999 2024-04-19T02:17:07.392 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.392 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.392 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:07.392 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.772280+0000", 2024-04-19T02:17:07.392 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000147198 2024-04-19T02:17:07.392 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.392 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.393 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:07.393 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.774312+0000", 2024-04-19T02:17:07.393 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020325339999999999 2024-04-19T02:17:07.393 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.393 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.393 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:07.393 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.792370+0000", 2024-04-19T02:17:07.393 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018057321000000001 2024-04-19T02:17:07.393 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.393 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.393 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:07.393 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.792403+0000", 2024-04-19T02:17:07.394 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3247000000000002e-05 2024-04-19T02:17:07.394 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.394 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.394 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:07.394 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.792426+0000", 2024-04-19T02:17:07.394 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2697999999999999e-05 2024-04-19T02:17:07.394 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:07.394 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:07.394 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:07.394 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.394 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.394 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:94468 5.2 5:4f406431:::benchmark_data_smithi121_44835_object94467:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T02:17:07.395 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:17:07.395 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.207741304999999, 2024-04-19T02:17:07.395 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024835144999999999, 2024-04-19T02:17:07.395 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:07.395 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:07.395 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:07.395 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:07.395 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:07.395 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 94468 2024-04-19T02:17:07.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.395 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:07.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.395 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:07.395 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:17:07.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:07.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.396 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:07.396 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:17:07.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:07.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.396 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:07.396 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:17:07.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:07.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.397 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.397 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:07.397 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111498+0000", 2024-04-19T02:17:07.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9529000000000005e-05 2024-04-19T02:17:07.397 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.397 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.397 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:07.397 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111506+0000", 2024-04-19T02:17:07.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9030000000000004e-06 2024-04-19T02:17:07.397 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.397 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.397 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:07.397 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111513+0000", 2024-04-19T02:17:07.398 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8759999999999999e-06 2024-04-19T02:17:07.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:07.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112466+0000", 2024-04-19T02:17:07.398 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00095318499999999995 2024-04-19T02:17:07.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:07.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112590+0000", 2024-04-19T02:17:07.398 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012380900000000001 2024-04-19T02:17:07.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.399 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:07.399 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112728+0000", 2024-04-19T02:17:07.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013753800000000001 2024-04-19T02:17:07.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.399 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:07.399 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115064+0000", 2024-04-19T02:17:07.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002336819 2024-04-19T02:17:07.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.399 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:07.400 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136207+0000", 2024-04-19T02:17:07.400 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021142942000000001 2024-04-19T02:17:07.400 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.400 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.400 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:07.400 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136241+0000", 2024-04-19T02:17:07.400 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3577000000000001e-05 2024-04-19T02:17:07.400 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.400 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.400 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:07.400 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136264+0000", 2024-04-19T02:17:07.400 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3421000000000002e-05 2024-04-19T02:17:07.400 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:07.400 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:07.401 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:07.401 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.401 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.401 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:94472 5.2 5:45b7e9be:::benchmark_data_smithi121_44835_object94471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:07.401 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:17:07.401 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.204094773999998, 2024-04-19T02:17:07.401 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021273843000000001, 2024-04-19T02:17:07.401 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:07.401 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:07.401 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:07.401 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:07.402 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:07.402 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 94472 2024-04-19T02:17:07.402 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.402 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:07.402 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.402 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:07.402 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:17:07.402 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:07.402 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.402 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:07.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:17:07.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:07.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:07.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115075+0000", 2024-04-19T02:17:07.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:07.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:07.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115161+0000", 2024-04-19T02:17:07.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6632000000000007e-05 2024-04-19T02:17:07.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:07.404 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115171+0000", 2024-04-19T02:17:07.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2969999999999992e-06 2024-04-19T02:17:07.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:07.404 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115178+0000", 2024-04-19T02:17:07.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7610000000000007e-06 2024-04-19T02:17:07.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:07.404 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115213+0000", 2024-04-19T02:17:07.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5000999999999999e-05 2024-04-19T02:17:07.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.405 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.405 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:07.405 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115303+0000", 2024-04-19T02:17:07.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9791999999999997e-05 2024-04-19T02:17:07.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.405 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.405 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:07.405 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115391+0000", 2024-04-19T02:17:07.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7559000000000007e-05 2024-04-19T02:17:07.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.405 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.405 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:07.406 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.117894+0000", 2024-04-19T02:17:07.406 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002503496 2024-04-19T02:17:07.406 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.406 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:07.406 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136297+0000", 2024-04-19T02:17:07.406 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018402335999999998 2024-04-19T02:17:07.406 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.406 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:07.406 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136327+0000", 2024-04-19T02:17:07.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0534999999999998e-05 2024-04-19T02:17:07.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.407 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:07.407 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136350+0000", 2024-04-19T02:17:07.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2427999999999999e-05 2024-04-19T02:17:07.407 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:07.407 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:07.407 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:07.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.407 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:96668 5.f 5:f48d3288:::benchmark_data_smithi121_44835_object96667:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-19T02:17:07.407 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:36.254669+0000", 2024-04-19T02:17:07.407 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 31.064501655000001, 2024-04-19T02:17:07.408 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019875075999999998, 2024-04-19T02:17:07.408 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:07.408 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:07.408 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:07.408 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:07.408 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:07.408 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 96668 2024-04-19T02:17:07.408 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.408 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:07.408 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.408 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:07.408 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254669+0000", 2024-04-19T02:17:07.408 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:07.409 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.409 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.409 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:07.409 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254669+0000", 2024-04-19T02:17:07.409 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:07.409 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.409 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.409 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:07.409 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254668+0000", 2024-04-19T02:17:07.409 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:07.409 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.409 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.410 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:07.410 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254738+0000", 2024-04-19T02:17:07.410 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9913000000000006e-05 2024-04-19T02:17:07.410 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.410 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.410 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:07.410 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254748+0000", 2024-04-19T02:17:07.410 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7429999999999997e-06 2024-04-19T02:17:07.410 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.410 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.410 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:07.410 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254754+0000", 2024-04-19T02:17:07.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3840000000000002e-06 2024-04-19T02:17:07.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.411 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:07.411 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.256882+0000", 2024-04-19T02:17:07.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021282950000000001 2024-04-19T02:17:07.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.411 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:07.411 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.257007+0000", 2024-04-19T02:17:07.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012430699999999999 2024-04-19T02:17:07.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.412 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:07.412 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.257150+0000", 2024-04-19T02:17:07.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014291999999999999 2024-04-19T02:17:07.412 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.412 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:07.412 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.261375+0000", 2024-04-19T02:17:07.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042252100000000001 2024-04-19T02:17:07.412 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.412 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:07.412 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.274489+0000", 2024-04-19T02:17:07.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013113915 2024-04-19T02:17:07.413 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.413 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.413 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:07.413 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.274521+0000", 2024-04-19T02:17:07.413 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2691999999999998e-05 2024-04-19T02:17:07.413 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.413 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.413 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:07.413 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.274544+0000", 2024-04-19T02:17:07.413 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2408999999999998e-05 2024-04-19T02:17:07.413 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:07.413 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:07.414 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:07.414 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.414 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.414 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:129219 5.2 5:45e7e1f4:::benchmark_data_smithi121_44835_object129218:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T02:17:07.414 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:52.629592+0000", 2024-04-19T02:17:07.414 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 14.689578521, 2024-04-19T02:17:07.414 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021099489999999999, 2024-04-19T02:17:07.414 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:07.414 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:07.414 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:07.414 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:07.415 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:07.415 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129219 2024-04-19T02:17:07.415 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.415 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:07.415 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.415 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:07.415 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629592+0000", 2024-04-19T02:17:07.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:07.415 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.415 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.415 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:07.415 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629592+0000", 2024-04-19T02:17:07.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:07.416 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.416 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:07.416 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629591+0000", 2024-04-19T02:17:07.416 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:07.416 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.416 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:07.416 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629618+0000", 2024-04-19T02:17:07.416 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6970000000000001e-05 2024-04-19T02:17:07.416 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.416 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:07.417 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629639+0000", 2024-04-19T02:17:07.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0701999999999999e-05 2024-04-19T02:17:07.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.417 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.417 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:07.417 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629645+0000", 2024-04-19T02:17:07.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2299999999999996e-06 2024-04-19T02:17:07.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.417 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.417 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:07.417 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.635658+0000", 2024-04-19T02:17:07.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0060127549999999998 2024-04-19T02:17:07.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.418 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:07.418 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.635811+0000", 2024-04-19T02:17:07.418 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015305700000000001 2024-04-19T02:17:07.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.418 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:07.418 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.635967+0000", 2024-04-19T02:17:07.418 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015578599999999999 2024-04-19T02:17:07.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:07.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.642488+0000", 2024-04-19T02:17:07.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0065215619999999998 2024-04-19T02:17:07.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:07.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650603+0000", 2024-04-19T02:17:07.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0081144900000000002 2024-04-19T02:17:07.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:07.420 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650652+0000", 2024-04-19T02:17:07.420 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9079999999999998e-05 2024-04-19T02:17:07.420 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.420 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.420 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:07.420 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650691+0000", 2024-04-19T02:17:07.420 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9501e-05 2024-04-19T02:17:07.420 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:07.420 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:07.420 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:07.420 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.421 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.421 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:129220 5.2 5:44721865:::benchmark_data_smithi121_44835_object129219:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T02:17:07.421 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:52.630382+0000", 2024-04-19T02:17:07.421 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 14.688788118, 2024-04-19T02:17:07.421 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.02043969, 2024-04-19T02:17:07.421 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:07.421 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:07.421 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:07.421 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:07.421 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:07.421 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129220 2024-04-19T02:17:07.421 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.422 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:07.422 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.422 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:07.422 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.630382+0000", 2024-04-19T02:17:07.422 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:07.422 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.422 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.422 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:07.422 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.630382+0000", 2024-04-19T02:17:07.422 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:07.422 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.422 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.423 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:07.423 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.630382+0000", 2024-04-19T02:17:07.423 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:07.423 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.423 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.423 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:07.423 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.630451+0000", 2024-04-19T02:17:07.423 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9022000000000004e-05 2024-04-19T02:17:07.423 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.423 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.423 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:07.423 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.630460+0000", 2024-04-19T02:17:07.424 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7059999999999999e-06 2024-04-19T02:17:07.424 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.424 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.424 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:07.424 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.630466+0000", 2024-04-19T02:17:07.424 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4689999999999996e-06 2024-04-19T02:17:07.424 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.424 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.424 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:07.424 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.639381+0000", 2024-04-19T02:17:07.424 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0089152529999999997 2024-04-19T02:17:07.424 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:07.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.639492+0000", 2024-04-19T02:17:07.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011075500000000001 2024-04-19T02:17:07.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:07.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.639589+0000", 2024-04-19T02:17:07.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7157999999999994e-05 2024-04-19T02:17:07.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:07.426 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.646571+0000", 2024-04-19T02:17:07.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00698177 2024-04-19T02:17:07.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:07.426 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650743+0000", 2024-04-19T02:17:07.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041725909999999998 2024-04-19T02:17:07.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:07.426 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650785+0000", 2024-04-19T02:17:07.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2026e-05 2024-04-19T02:17:07.427 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.427 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.427 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:07.427 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650822+0000", 2024-04-19T02:17:07.427 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6689000000000001e-05 2024-04-19T02:17:07.427 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:07.427 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:07.427 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:07.427 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.427 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.427 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:130093 5.2 5:41dcb8a4:::benchmark_data_smithi121_44835_object130092:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T02:17:07.428 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:53.069964+0000", 2024-04-19T02:17:07.428 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 14.249206521, 2024-04-19T02:17:07.428 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020424088, 2024-04-19T02:17:07.428 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:07.428 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:07.428 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:07.428 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:07.428 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:07.428 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 130093 2024-04-19T02:17:07.428 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.428 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:07.428 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.428 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:07.429 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.069964+0000", 2024-04-19T02:17:07.429 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:07.429 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.429 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.429 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:07.429 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.069964+0000", 2024-04-19T02:17:07.429 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:07.429 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.429 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.429 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:07.430 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.069963+0000", 2024-04-19T02:17:07.430 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:07.430 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.430 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.430 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:07.430 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.070064+0000", 2024-04-19T02:17:07.430 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100709 2024-04-19T02:17:07.430 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.430 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.430 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:07.430 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.070072+0000", 2024-04-19T02:17:07.430 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8339999999999999e-06 2024-04-19T02:17:07.431 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.431 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.431 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:07.431 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.070077+0000", 2024-04-19T02:17:07.431 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2399999999999998e-06 2024-04-19T02:17:07.431 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.431 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.431 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:07.431 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.071370+0000", 2024-04-19T02:17:07.431 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012926470000000001 2024-04-19T02:17:07.431 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.431 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.432 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:07.432 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.071497+0000", 2024-04-19T02:17:07.432 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000127701 2024-04-19T02:17:07.432 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.432 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.432 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:07.432 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.071662+0000", 2024-04-19T02:17:07.432 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016424300000000001 2024-04-19T02:17:07.432 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.432 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.432 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:07.432 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.077150+0000", 2024-04-19T02:17:07.433 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.005488031 2024-04-19T02:17:07.433 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.433 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.433 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:07.433 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.090305+0000", 2024-04-19T02:17:07.433 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013155622 2024-04-19T02:17:07.433 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.433 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.433 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:07.433 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.090352+0000", 2024-04-19T02:17:07.433 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6798999999999997e-05 2024-04-19T02:17:07.433 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.433 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.434 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:07.434 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.090388+0000", 2024-04-19T02:17:07.434 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5837999999999998e-05 2024-04-19T02:17:07.434 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:07.434 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:07.434 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:07.434 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.434 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.434 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:157448 5.7 5:ed833a19:::benchmark_data_smithi121_44835_object23413:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:07.434 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:06.870566+0000", 2024-04-19T02:17:07.435 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.44860393999999998, 2024-04-19T02:17:07.435 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023031238999999998, 2024-04-19T02:17:07.435 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:07.435 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:07.435 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:07.435 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:07.435 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:07.435 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 157448 2024-04-19T02:17:07.435 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.435 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:07.435 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.435 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:07.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870566+0000", 2024-04-19T02:17:07.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:07.436 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.436 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.436 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:07.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870566+0000", 2024-04-19T02:17:07.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:07.436 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.436 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.436 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:07.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870566+0000", 2024-04-19T02:17:07.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:07.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.437 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.437 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:07.437 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870570+0000", 2024-04-19T02:17:07.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1620000000000001e-06 2024-04-19T02:17:07.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.437 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.437 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:07.437 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870577+0000", 2024-04-19T02:17:07.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2069999999999998e-06 2024-04-19T02:17:07.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.438 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.438 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:07.438 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870587+0000", 2024-04-19T02:17:07.438 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6919999999999997e-06 2024-04-19T02:17:07.438 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.438 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.438 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:07.438 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870615+0000", 2024-04-19T02:17:07.438 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8351999999999999e-05 2024-04-19T02:17:07.438 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.438 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.438 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:07.439 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870715+0000", 2024-04-19T02:17:07.439 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9624999999999996e-05 2024-04-19T02:17:07.439 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.439 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.439 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:07.439 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870805+0000", 2024-04-19T02:17:07.439 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0067000000000004e-05 2024-04-19T02:17:07.439 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.439 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.439 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:07.439 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.872773+0000", 2024-04-19T02:17:07.439 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001968605 2024-04-19T02:17:07.440 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.440 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.440 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:07.440 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.893514+0000", 2024-04-19T02:17:07.440 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020740082999999999 2024-04-19T02:17:07.440 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.440 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.440 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:07.440 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.893558+0000", 2024-04-19T02:17:07.440 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4110999999999998e-05 2024-04-19T02:17:07.440 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.440 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.441 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:07.441 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.893598+0000", 2024-04-19T02:17:07.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0077000000000003e-05 2024-04-19T02:17:07.441 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:07.441 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:07.441 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:07.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.441 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:157498 5.7 5:eb39b43d:::benchmark_data_smithi121_44835_object23463:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:07.441 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:06.911721+0000", 2024-04-19T02:17:07.441 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.40744929499999999, 2024-04-19T02:17:07.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023313438999999998, 2024-04-19T02:17:07.441 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:07.441 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:07.442 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:07.442 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:07.442 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:07.442 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 157498 2024-04-19T02:17:07.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.442 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:07.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.442 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:07.442 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911721+0000", 2024-04-19T02:17:07.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:07.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.443 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:07.443 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911721+0000", 2024-04-19T02:17:07.443 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:07.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.443 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:07.443 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911720+0000", 2024-04-19T02:17:07.443 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:07.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.443 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:07.443 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911726+0000", 2024-04-19T02:17:07.443 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3179999999999997e-06 2024-04-19T02:17:07.444 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.444 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.444 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:07.444 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911746+0000", 2024-04-19T02:17:07.444 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0574e-05 2024-04-19T02:17:07.444 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.444 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.444 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:07.444 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911757+0000", 2024-04-19T02:17:07.444 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0959e-05 2024-04-19T02:17:07.444 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.444 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.444 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:07.444 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911795+0000", 2024-04-19T02:17:07.445 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7589999999999998e-05 2024-04-19T02:17:07.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.445 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.445 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:07.445 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911912+0000", 2024-04-19T02:17:07.445 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117625 2024-04-19T02:17:07.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.445 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.445 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:07.445 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.912250+0000", 2024-04-19T02:17:07.445 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00033710599999999999 2024-04-19T02:17:07.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.445 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.446 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:07.446 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.915540+0000", 2024-04-19T02:17:07.446 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032909559999999998 2024-04-19T02:17:07.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.446 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:07.446 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.934984+0000", 2024-04-19T02:17:07.446 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019443670999999999 2024-04-19T02:17:07.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.446 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:07.446 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.935013+0000", 2024-04-19T02:17:07.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8464999999999999e-05 2024-04-19T02:17:07.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:07.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:07.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:07.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.935035+0000", 2024-04-19T02:17:07.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1954e-05 2024-04-19T02:17:07.447 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:07.447 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:07.447 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:07.447 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:07.447 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:07.447 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:07.448 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T02:17:07.457 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:07.458+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:07.459 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:17:07.557 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on 2024-04-19T02:17:07.558 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:07.559+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:07.588 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:17:07.588 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:17:07.588 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.588 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:158156 5.4 5:22f927ad:::benchmark_data_smithi121_44835_object24121:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:07.588 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:07.238827+0000", 2024-04-19T02:17:07.588 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.35005484399999998, 2024-04-19T02:17:07.588 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.35007947900000003, 2024-04-19T02:17:07.588 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:07.588 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for peered", 2024-04-19T02:17:07.588 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:07.588 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:07.589 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:07.589 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 158156 2024-04-19T02:17:07.589 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.589 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:07.589 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.589 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:07.589 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:07.238827+0000", 2024-04-19T02:17:07.589 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:07.589 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.589 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.589 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:07.589 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:07.238827+0000", 2024-04-19T02:17:07.589 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:07.589 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.590 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.590 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:07.590 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:07.238827+0000", 2024-04-19T02:17:07.590 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:07.590 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.590 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.590 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:07.590 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:07.238831+0000", 2024-04-19T02:17:07.590 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.6519999999999997e-06 2024-04-19T02:17:07.590 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.590 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.590 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:07.590 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:07.238842+0000", 2024-04-19T02:17:07.590 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1090000000000001e-05 2024-04-19T02:17:07.591 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.591 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.591 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:07.591 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:07.238849+0000", 2024-04-19T02:17:07.591 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.024e-06 2024-04-19T02:17:07.591 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.591 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.591 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:07.591 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:07.238885+0000", 2024-04-19T02:17:07.591 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6195000000000002e-05 2024-04-19T02:17:07.591 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.591 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.591 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:07.591 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:07.238974+0000", 2024-04-19T02:17:07.592 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.8022999999999994e-05 2024-04-19T02:17:07.592 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.592 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.592 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:07.592 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:07.239043+0000", 2024-04-19T02:17:07.592 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.9332000000000006e-05 2024-04-19T02:17:07.592 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.592 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.592 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:07.592 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:07.245398+0000", 2024-04-19T02:17:07.592 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0063549110000000004 2024-04-19T02:17:07.592 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.592 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.592 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:07.592 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:07.257029+0000", 2024-04-19T02:17:07.593 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.011631058 2024-04-19T02:17:07.593 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.593 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.593 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for peered", 2024-04-19T02:17:07.593 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:07.257034+0000", 2024-04-19T02:17:07.593 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0440000000000003e-06 2024-04-19T02:17:07.593 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:07.593 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:07.593 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:07.593 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.593 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.593 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:158160 5.8 5:1460a73a:::benchmark_data_smithi121_44835_object24125:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:07.593 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:07.239603+0000", 2024-04-19T02:17:07.593 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.34927925900000001, 2024-04-19T02:17:07.593 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.34936226599999998, 2024-04-19T02:17:07.594 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:07.594 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for peered", 2024-04-19T02:17:07.594 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:07.594 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:07.594 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:07.594 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 158160 2024-04-19T02:17:07.594 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.594 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:07.594 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.594 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:07.594 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:07.239603+0000", 2024-04-19T02:17:07.594 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:07.594 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.594 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.595 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:07.595 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:07.239603+0000", 2024-04-19T02:17:07.595 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:07.595 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.595 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.595 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:07.595 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:07.239602+0000", 2024-04-19T02:17:07.595 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:07.595 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.595 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.595 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:07.595 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:07.239607+0000", 2024-04-19T02:17:07.595 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.6789999999999996e-06 2024-04-19T02:17:07.595 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.596 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.596 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:07.596 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:07.239618+0000", 2024-04-19T02:17:07.596 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1002000000000001e-05 2024-04-19T02:17:07.596 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.596 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.596 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:07.596 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:07.239624+0000", 2024-04-19T02:17:07.596 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.3230000000000003e-06 2024-04-19T02:17:07.596 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.596 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.596 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:07.596 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:07.239655+0000", 2024-04-19T02:17:07.596 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1346000000000001e-05 2024-04-19T02:17:07.596 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.597 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.597 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:07.597 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:07.239759+0000", 2024-04-19T02:17:07.597 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010333800000000001 2024-04-19T02:17:07.597 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.597 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.597 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:07.597 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:07.239821+0000", 2024-04-19T02:17:07.597 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.2631000000000004e-05 2024-04-19T02:17:07.597 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.597 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.597 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:07.597 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:07.245450+0000", 2024-04-19T02:17:07.597 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0056289640000000002 2024-04-19T02:17:07.597 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.598 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.598 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:07.598 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:07.256259+0000", 2024-04-19T02:17:07.598 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010808995 2024-04-19T02:17:07.598 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.598 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.598 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for peered", 2024-04-19T02:17:07.598 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:07.256277+0000", 2024-04-19T02:17:07.598 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.8105999999999999e-05 2024-04-19T02:17:07.598 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:07.598 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:07.598 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:07.598 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.598 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.598 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:158162 5.b 5:d5728536:::benchmark_data_smithi121_44835_object24127:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:07.599 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:07.239698+0000", 2024-04-19T02:17:07.599 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.34918402599999998, 2024-04-19T02:17:07.599 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.34931709, 2024-04-19T02:17:07.599 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:07.599 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for peered", 2024-04-19T02:17:07.599 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:07.599 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:07.599 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:07.599 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 158162 2024-04-19T02:17:07.599 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.599 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:07.599 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.599 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:07.599 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:07.239698+0000", 2024-04-19T02:17:07.599 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:07.600 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.600 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.600 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:07.600 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:07.239698+0000", 2024-04-19T02:17:07.600 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:07.600 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.600 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.600 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:07.600 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:07.239697+0000", 2024-04-19T02:17:07.600 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:07.600 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.600 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.600 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:07.600 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:07.239701+0000", 2024-04-19T02:17:07.601 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8670000000000004e-06 2024-04-19T02:17:07.601 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.601 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.601 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:07.601 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:07.239711+0000", 2024-04-19T02:17:07.601 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.4439999999999997e-06 2024-04-19T02:17:07.601 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.601 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.601 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:07.601 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:07.239724+0000", 2024-04-19T02:17:07.601 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.3505e-05 2024-04-19T02:17:07.601 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.601 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.601 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:07.602 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:07.239781+0000", 2024-04-19T02:17:07.602 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.6292000000000002e-05 2024-04-19T02:17:07.602 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.602 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.602 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:07.602 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:07.239903+0000", 2024-04-19T02:17:07.602 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0001228 2024-04-19T02:17:07.602 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.602 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.602 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:07.602 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:07.240015+0000", 2024-04-19T02:17:07.602 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011175000000000001 2024-04-19T02:17:07.602 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.602 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.602 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:07.603 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:07.245447+0000", 2024-04-19T02:17:07.603 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0054317100000000002 2024-04-19T02:17:07.603 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.603 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.603 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:07.603 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:07.256730+0000", 2024-04-19T02:17:07.603 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.011282955000000001 2024-04-19T02:17:07.603 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.603 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.603 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for peered", 2024-04-19T02:17:07.603 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:07.256739+0000", 2024-04-19T02:17:07.603 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.5829999999999996e-06 2024-04-19T02:17:07.603 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:07.603 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:07.603 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:07.604 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.604 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.604 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:158155 5.1 5.a6377a81 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e50)", 2024-04-19T02:17:07.604 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:07.256575+0000", 2024-04-19T02:17:07.604 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.33230756500000003, 2024-04-19T02:17:07.604 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.33248984399999998, 2024-04-19T02:17:07.604 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:07.604 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for peered", 2024-04-19T02:17:07.604 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:07.604 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:07.604 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:07.604 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 158155 2024-04-19T02:17:07.604 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.604 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:07.604 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.605 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:07.605 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:07.256575+0000", 2024-04-19T02:17:07.605 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:07.605 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.605 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.605 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:07.605 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:07.256575+0000", 2024-04-19T02:17:07.605 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:07.605 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.605 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.605 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:07.605 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:07.256573+0000", 2024-04-19T02:17:07.605 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:07.605 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.605 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.606 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:07.606 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:07.256582+0000", 2024-04-19T02:17:07.606 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3190000000000001e-06 2024-04-19T02:17:07.606 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.606 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.606 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:07.606 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:07.256595+0000", 2024-04-19T02:17:07.606 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.3093e-05 2024-04-19T02:17:07.606 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.606 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.606 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:07.606 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:07.256605+0000", 2024-04-19T02:17:07.606 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.6500000000000008e-06 2024-04-19T02:17:07.606 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.607 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.607 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:07.607 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:07.256677+0000", 2024-04-19T02:17:07.607 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.2135e-05 2024-04-19T02:17:07.607 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.607 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.607 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for peered", 2024-04-19T02:17:07.607 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:07.256686+0000", 2024-04-19T02:17:07.607 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.8419999999999994e-06 2024-04-19T02:17:07.607 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:07.607 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:07.607 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:07.607 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.607 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.607 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:158159 5.1 5.e9fe2dc1 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e50)", 2024-04-19T02:17:07.607 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:07.256619+0000", 2024-04-19T02:17:07.608 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.33226271600000001, 2024-04-19T02:17:07.608 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.33248022399999999, 2024-04-19T02:17:07.608 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:07.608 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "waiting for peered", 2024-04-19T02:17:07.608 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:07.608 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:07.608 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:07.608 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 158159 2024-04-19T02:17:07.608 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.608 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:07.608 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.608 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:07.608 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:07.256619+0000", 2024-04-19T02:17:07.608 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:07.609 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.609 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.609 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:07.609 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:07.256619+0000", 2024-04-19T02:17:07.609 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:07.609 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.609 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.609 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:07.609 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:07.256619+0000", 2024-04-19T02:17:07.609 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:07.609 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.609 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.609 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:07.609 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:07.256622+0000", 2024-04-19T02:17:07.610 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1030000000000002e-06 2024-04-19T02:17:07.610 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.610 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.610 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:07.610 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:07.256629+0000", 2024-04-19T02:17:07.610 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.7950000000000002e-06 2024-04-19T02:17:07.610 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.610 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.610 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:07.610 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:07.256635+0000", 2024-04-19T02:17:07.610 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5849999999999996e-06 2024-04-19T02:17:07.610 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.610 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.610 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:07.611 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:07.256709+0000", 2024-04-19T02:17:07.611 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3220999999999996e-05 2024-04-19T02:17:07.611 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:07.611 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:07.611 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for peered", 2024-04-19T02:17:07.611 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:07.256714+0000", 2024-04-19T02:17:07.611 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.8429999999999998e-06 2024-04-19T02:17:07.611 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:07.611 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:07.611 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:07.611 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:07.611 INFO:teuthology.orchestra.run.smithi174.stdout: ], 2024-04-19T02:17:07.611 INFO:teuthology.orchestra.run.smithi174.stdout: "num_ops": 5 2024-04-19T02:17:07.611 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:17:07.614 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:17:07.658 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:07.659+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:07.759 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:07.760+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:07.760 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:17:07.780 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:17:07.781 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [], 2024-04-19T02:17:07.781 INFO:teuthology.orchestra.run.smithi174.stdout: "complaint_time": 30, 2024-04-19T02:17:07.781 INFO:teuthology.orchestra.run.smithi174.stdout: "num_blocked_ops": 0 2024-04-19T02:17:07.781 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:17:07.791 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:17:07.875 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:07.876+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:07.903 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:17:07.922 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:17:07.923 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:17:07.923 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:17:07.923 INFO:teuthology.orchestra.run.smithi121.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T02:17:07.925 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:17:07.926 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:17:07.959 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:07.959 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:07.960 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:07.961+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:07.968 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:08.061 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:08.062+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:08.108 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:08.109 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:08.119 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:08.162 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:08.163+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:08.245 INFO:teuthology.orchestra.run.smithi121.stderr:nodeep-scrub is set 2024-04-19T02:17:08.250 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:08.250 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:08.263 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:08.263+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:08.264 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:08.363 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:08.364+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:08.464 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:08.465+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:08.473 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:08.474 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:08.487 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:17:08.536 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-04-19T02:17:08.564 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:08.566+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:08.656 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:08.656 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:08.665 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:08.666+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:08.671 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:17:08.766 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:08.767+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:08.867 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:08.868+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:08.883 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:08.883 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:08.897 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:17:08.967 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:08.969+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:09.067 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:09.067 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:09.068 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:09.070+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:09.081 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:09.169 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:09.170+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:09.245 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:09.245 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:09.259 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:09.300 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:09.301+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:09.372 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:09.373+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:09.467 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:09.467 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:09.473 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:09.474+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:09.480 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:09.574 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:09.575+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:09.675 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:09.676+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:09.685 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:09.685 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:09.698 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:17:09.776 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:09.777+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:09.849 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:09.849 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:09.859 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:17:09.900 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:09.901+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:09.927 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:17:09.977 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:09.979+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:10.070 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:10.071 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:10.073 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:17:10.080 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:10.080+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:10.087 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:17:10.092 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:17:10.093 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:17:10.093 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:17:10.093 INFO:teuthology.orchestra.run.smithi121.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T02:17:10.095 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:17:10.096 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:17:10.180 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:10.181+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:10.257 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T02:17:10.282 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:10.284+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:10.297 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:17:10.297 INFO:teuthology.orchestra.run.smithi174.stdout: "size": 20, 2024-04-19T02:17:10.297 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 600, 2024-04-19T02:17:10.297 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:17:10.297 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.297 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:19 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:10.297 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:17:10.298 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 101.025868891, 2024-04-19T02:17:10.298 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020818203, 2024-04-19T02:17:10.298 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:10.298 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:10.298 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:10.298 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.298 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:10.298 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:17:10.298 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:10.298 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.298 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.298 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:10.298 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:17:10.298 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:10.299 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.299 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.299 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:10.299 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:17:10.299 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:10.299 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.299 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.299 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:10.299 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270065+0000", 2024-04-19T02:17:10.299 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4310000000000001e-06 2024-04-19T02:17:10.299 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.299 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.299 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:10.300 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270070+0000", 2024-04-19T02:17:10.300 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2859999999999999e-06 2024-04-19T02:17:10.300 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.300 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.300 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.300 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270077+0000", 2024-04-19T02:17:10.300 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5270000000000004e-06 2024-04-19T02:17:10.300 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.300 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.300 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:10.300 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270107+0000", 2024-04-19T02:17:10.300 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0205999999999998e-05 2024-04-19T02:17:10.300 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.300 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.300 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:10.300 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270111+0000", 2024-04-19T02:17:10.301 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8650000000000003e-06 2024-04-19T02:17:10.301 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.301 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.301 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:10.301 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285936+0000", 2024-04-19T02:17:10.301 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015824677999999998 2024-04-19T02:17:10.301 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.301 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.301 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:10.301 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286007+0000", 2024-04-19T02:17:10.301 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1157999999999999e-05 2024-04-19T02:17:10.301 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.301 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.301 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:10.301 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286086+0000", 2024-04-19T02:17:10.302 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9084000000000004e-05 2024-04-19T02:17:10.302 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.302 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.302 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:10.302 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290740+0000", 2024-04-19T02:17:10.302 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0046543679999999999 2024-04-19T02:17:10.302 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.302 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.302 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:10.302 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290833+0000", 2024-04-19T02:17:10.302 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2551000000000002e-05 2024-04-19T02:17:10.302 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.302 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.302 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:10.303 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290859+0000", 2024-04-19T02:17:10.303 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.6696999999999999e-05 2024-04-19T02:17:10.303 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.303 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.303 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:10.303 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290881+0000", 2024-04-19T02:17:10.303 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1653000000000001e-05 2024-04-19T02:17:10.303 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:10.303 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:10.303 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:10.303 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.303 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.303 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:77622 5.8 5:166fbe77:::benchmark_data_smithi121_44835_object77621:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:10.303 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:17:10.303 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 43.490371953999997, 2024-04-19T02:17:10.304 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.021784694, 2024-04-19T02:17:10.304 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:10.304 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:10.304 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:10.304 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:10.304 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:10.304 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 77622 2024-04-19T02:17:10.304 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.304 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:10.304 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.304 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:10.304 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:17:10.304 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:10.305 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.305 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.305 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:10.305 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:17:10.305 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:10.305 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.305 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.305 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:10.305 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805559+0000", 2024-04-19T02:17:10.305 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:10.305 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.305 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.305 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:10.305 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805659+0000", 2024-04-19T02:17:10.305 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.9908000000000006e-05 2024-04-19T02:17:10.305 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.306 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.306 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:10.306 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805668+0000", 2024-04-19T02:17:10.306 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2129999999999997e-06 2024-04-19T02:17:10.306 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.306 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.306 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.306 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805673+0000", 2024-04-19T02:17:10.306 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0370000000000002e-06 2024-04-19T02:17:10.306 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.306 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.306 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:10.306 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812022+0000", 2024-04-19T02:17:10.306 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0063483239999999998 2024-04-19T02:17:10.307 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.307 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.307 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:10.307 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812129+0000", 2024-04-19T02:17:10.307 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010744200000000001 2024-04-19T02:17:10.307 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.307 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.307 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:10.307 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812252+0000", 2024-04-19T02:17:10.307 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000122519 2024-04-19T02:17:10.307 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.307 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.307 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:10.307 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.820979+0000", 2024-04-19T02:17:10.307 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0087272740000000001 2024-04-19T02:17:10.307 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.308 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.308 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:10.308 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827270+0000", 2024-04-19T02:17:10.308 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0062906239999999999 2024-04-19T02:17:10.308 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.308 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.308 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:10.308 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827309+0000", 2024-04-19T02:17:10.308 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9678999999999997e-05 2024-04-19T02:17:10.308 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.308 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.308 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:10.308 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827345+0000", 2024-04-19T02:17:10.308 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5308000000000001e-05 2024-04-19T02:17:10.308 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:10.309 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:10.309 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:10.309 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.309 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.309 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78224 5.4 5:26e797d5:::benchmark_data_smithi121_44835_object78223:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:10.309 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:17:10.309 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 43.189369755000001, 2024-04-19T02:17:10.309 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.021471998999999999, 2024-04-19T02:17:10.309 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:10.309 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:10.309 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:10.309 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:10.309 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:10.309 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78224 2024-04-19T02:17:10.309 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.310 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:10.310 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.310 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:10.310 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:17:10.310 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:10.310 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.310 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.310 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:10.310 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:17:10.310 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:10.310 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.310 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.310 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:10.310 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106561+0000", 2024-04-19T02:17:10.311 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:10.311 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.311 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.311 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:10.311 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106630+0000", 2024-04-19T02:17:10.311 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.8553999999999994e-05 2024-04-19T02:17:10.311 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.311 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.311 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:10.311 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106644+0000", 2024-04-19T02:17:10.311 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.4651000000000001e-05 2024-04-19T02:17:10.311 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.311 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.311 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.311 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106653+0000", 2024-04-19T02:17:10.312 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.6719999999999993e-06 2024-04-19T02:17:10.312 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.312 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.312 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:10.312 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106693+0000", 2024-04-19T02:17:10.312 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9978999999999998e-05 2024-04-19T02:17:10.312 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.312 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.312 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:10.312 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106840+0000", 2024-04-19T02:17:10.312 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0001473 2024-04-19T02:17:10.312 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.312 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.312 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:10.313 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106971+0000", 2024-04-19T02:17:10.313 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013051499999999999 2024-04-19T02:17:10.313 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.313 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.313 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:10.313 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.109047+0000", 2024-04-19T02:17:10.313 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.002076002 2024-04-19T02:17:10.313 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.313 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.313 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:10.313 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.127967+0000", 2024-04-19T02:17:10.313 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.018919780000000001 2024-04-19T02:17:10.313 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.313 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.313 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:10.314 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128004+0000", 2024-04-19T02:17:10.314 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7719000000000003e-05 2024-04-19T02:17:10.314 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.314 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.314 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:10.314 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128034+0000", 2024-04-19T02:17:10.314 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9651000000000001e-05 2024-04-19T02:17:10.314 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:10.314 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:10.314 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:10.314 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.314 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.314 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78259 5.4 5:2aa344b2:::benchmark_data_smithi121_44835_object78258:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:10.314 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:17:10.314 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 43.170674685999998, 2024-04-19T02:17:10.315 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022934350999999999, 2024-04-19T02:17:10.315 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:10.315 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:10.315 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:10.315 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:10.315 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:10.315 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78259 2024-04-19T02:17:10.315 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.315 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:10.315 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.315 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:10.315 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:17:10.315 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:10.315 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.315 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.316 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:10.316 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:17:10.316 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:10.316 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.316 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.316 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:10.316 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125256+0000", 2024-04-19T02:17:10.316 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:10.316 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.316 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.316 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:10.316 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125347+0000", 2024-04-19T02:17:10.316 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0470000000000006e-05 2024-04-19T02:17:10.316 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.316 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.316 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:10.317 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125358+0000", 2024-04-19T02:17:10.317 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1764e-05 2024-04-19T02:17:10.317 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.317 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.317 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.317 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125364+0000", 2024-04-19T02:17:10.317 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7189999999999998e-06 2024-04-19T02:17:10.317 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.317 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.317 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:10.317 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125391+0000", 2024-04-19T02:17:10.317 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7270000000000001e-05 2024-04-19T02:17:10.317 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.317 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.317 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:10.318 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125471+0000", 2024-04-19T02:17:10.318 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9209999999999995e-05 2024-04-19T02:17:10.318 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.318 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.318 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:10.318 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125559+0000", 2024-04-19T02:17:10.318 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.8689000000000004e-05 2024-04-19T02:17:10.318 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.318 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.318 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:10.318 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128164+0000", 2024-04-19T02:17:10.318 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0026050270000000002 2024-04-19T02:17:10.318 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.318 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.318 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:10.319 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148139+0000", 2024-04-19T02:17:10.319 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.019975050000000001 2024-04-19T02:17:10.319 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.319 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.319 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:10.319 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148169+0000", 2024-04-19T02:17:10.319 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0001e-05 2024-04-19T02:17:10.319 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.319 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.319 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:10.319 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148191+0000", 2024-04-19T02:17:10.319 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.2104999999999999e-05 2024-04-19T02:17:10.319 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:10.319 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:10.319 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:10.320 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.320 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.320 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78271 5.4 5:2982d7a6:::benchmark_data_smithi121_44835_object78270:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:10.320 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:17:10.320 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 43.163811455999998, 2024-04-19T02:17:10.320 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020841755999999999, 2024-04-19T02:17:10.320 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:10.320 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:10.320 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:10.320 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:10.320 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:10.320 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78271 2024-04-19T02:17:10.320 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.320 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:10.320 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.320 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:10.321 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:17:10.321 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:10.321 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.321 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.321 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:10.321 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:17:10.321 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:10.321 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.321 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.321 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:10.321 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132119+0000", 2024-04-19T02:17:10.321 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:10.321 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.321 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.321 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:10.322 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132185+0000", 2024-04-19T02:17:10.322 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5994000000000005e-05 2024-04-19T02:17:10.322 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.322 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.322 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:10.322 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132197+0000", 2024-04-19T02:17:10.322 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2091e-05 2024-04-19T02:17:10.322 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.322 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.322 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.322 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132206+0000", 2024-04-19T02:17:10.322 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.5099999999999998e-06 2024-04-19T02:17:10.322 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.322 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.323 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:10.323 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132242+0000", 2024-04-19T02:17:10.323 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5663000000000001e-05 2024-04-19T02:17:10.323 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.323 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.323 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:10.323 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132335+0000", 2024-04-19T02:17:10.323 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3275000000000004e-05 2024-04-19T02:17:10.323 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.323 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.323 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:10.323 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132432+0000", 2024-04-19T02:17:10.323 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7571000000000005e-05 2024-04-19T02:17:10.323 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.323 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.324 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:10.324 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.136706+0000", 2024-04-19T02:17:10.324 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0042738170000000001 2024-04-19T02:17:10.324 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.324 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.324 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:10.324 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152909+0000", 2024-04-19T02:17:10.324 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016202415000000001 2024-04-19T02:17:10.324 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.324 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.324 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:10.324 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152938+0000", 2024-04-19T02:17:10.324 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9740999999999999e-05 2024-04-19T02:17:10.324 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.324 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.325 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:10.325 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152962+0000", 2024-04-19T02:17:10.325 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3659000000000002e-05 2024-04-19T02:17:10.325 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:10.325 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:10.325 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:10.325 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.325 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.325 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78272 5.4 5:273e819a:::benchmark_data_smithi121_44835_object78271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:10.325 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:10.325 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 43.163322413000003, 2024-04-19T02:17:10.325 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022180163999999999, 2024-04-19T02:17:10.325 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:10.325 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:10.325 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:10.326 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:10.326 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:10.326 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78272 2024-04-19T02:17:10.326 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.326 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:10.326 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.326 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:10.326 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:10.326 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:10.326 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.326 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.326 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:10.326 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:10.326 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:10.326 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.327 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.327 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:10.327 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:10.327 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:10.327 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.327 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.327 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:10.327 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132690+0000", 2024-04-19T02:17:10.327 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0963000000000004e-05 2024-04-19T02:17:10.327 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.327 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.327 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:10.327 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132703+0000", 2024-04-19T02:17:10.327 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.3072e-05 2024-04-19T02:17:10.327 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.328 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.328 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.328 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132710+0000", 2024-04-19T02:17:10.328 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3100000000000003e-06 2024-04-19T02:17:10.328 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.328 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.328 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:10.328 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134005+0000", 2024-04-19T02:17:10.328 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001294513 2024-04-19T02:17:10.328 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.328 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.328 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:10.328 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134139+0000", 2024-04-19T02:17:10.328 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000134447 2024-04-19T02:17:10.328 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.329 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.329 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:10.329 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134284+0000", 2024-04-19T02:17:10.329 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014514399999999999 2024-04-19T02:17:10.329 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.329 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.329 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:10.329 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.139622+0000", 2024-04-19T02:17:10.329 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0053373830000000002 2024-04-19T02:17:10.329 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.329 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.329 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:10.329 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154737+0000", 2024-04-19T02:17:10.329 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015115195999999999 2024-04-19T02:17:10.329 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.330 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.330 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:10.330 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154768+0000", 2024-04-19T02:17:10.330 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0824999999999997e-05 2024-04-19T02:17:10.330 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.330 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.330 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:10.330 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154790+0000", 2024-04-19T02:17:10.330 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1999000000000001e-05 2024-04-19T02:17:10.330 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:10.330 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:10.330 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:10.330 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.330 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.330 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:94481 5.e 5:7b2fbebf:::benchmark_data_smithi121_44835_object94480:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:10.331 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:17:10.331 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 35.174686096000002, 2024-04-19T02:17:10.331 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020897846000000001, 2024-04-19T02:17:10.331 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:10.331 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:10.331 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:10.331 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:10.331 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:10.331 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 94481 2024-04-19T02:17:10.331 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.331 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:10.331 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.331 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:10.331 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:17:10.331 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:10.332 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.332 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.332 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:10.332 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:17:10.332 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:10.332 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.332 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.332 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:10.332 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121245+0000", 2024-04-19T02:17:10.332 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:10.332 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.332 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.332 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:10.332 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121273+0000", 2024-04-19T02:17:10.333 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7250000000000002e-05 2024-04-19T02:17:10.333 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.333 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.333 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:10.333 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121277+0000", 2024-04-19T02:17:10.333 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2860000000000001e-06 2024-04-19T02:17:10.333 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.333 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.333 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.333 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121280+0000", 2024-04-19T02:17:10.333 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2739999999999999e-06 2024-04-19T02:17:10.333 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.333 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.333 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:10.333 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121320+0000", 2024-04-19T02:17:10.334 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9879000000000002e-05 2024-04-19T02:17:10.334 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.334 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.334 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:10.334 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121448+0000", 2024-04-19T02:17:10.334 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012748800000000001 2024-04-19T02:17:10.334 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.334 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.334 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:10.334 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121595+0000", 2024-04-19T02:17:10.334 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014741299999999999 2024-04-19T02:17:10.334 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.334 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.334 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:10.335 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.127776+0000", 2024-04-19T02:17:10.335 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0061811360000000003 2024-04-19T02:17:10.335 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.335 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.335 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:10.335 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142073+0000", 2024-04-19T02:17:10.335 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014296959999999999 2024-04-19T02:17:10.335 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.335 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.335 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:10.335 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142106+0000", 2024-04-19T02:17:10.335 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3348e-05 2024-04-19T02:17:10.335 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.335 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.336 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:10.336 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142144+0000", 2024-04-19T02:17:10.336 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7153000000000002e-05 2024-04-19T02:17:10.336 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:10.336 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:10.336 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:10.336 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.336 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.336 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:94581 5.b 5:dc86d6e9:::benchmark_data_smithi121_44835_object94580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:10.336 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:10.336 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 35.115751523, 2024-04-19T02:17:10.336 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022099711000000001, 2024-04-19T02:17:10.336 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:10.336 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:10.336 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:10.337 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:10.337 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:10.337 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 94581 2024-04-19T02:17:10.337 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.337 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:10.337 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.337 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:10.337 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:10.337 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:10.337 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.337 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.337 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:10.337 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:10.337 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:10.337 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.338 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.338 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:10.338 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:10.338 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:10.338 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.338 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.338 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:10.338 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180253+0000", 2024-04-19T02:17:10.338 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3163000000000004e-05 2024-04-19T02:17:10.338 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.338 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.338 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:10.338 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180266+0000", 2024-04-19T02:17:10.338 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2886e-05 2024-04-19T02:17:10.338 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.339 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.339 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.339 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180273+0000", 2024-04-19T02:17:10.339 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.4059999999999999e-06 2024-04-19T02:17:10.339 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.339 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.339 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:10.339 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180646+0000", 2024-04-19T02:17:10.339 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00037283999999999999 2024-04-19T02:17:10.339 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.339 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.340 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:10.340 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180774+0000", 2024-04-19T02:17:10.340 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012793799999999999 2024-04-19T02:17:10.340 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.340 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.340 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:10.340 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180920+0000", 2024-04-19T02:17:10.340 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000146692 2024-04-19T02:17:10.340 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.340 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.340 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:10.340 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.183344+0000", 2024-04-19T02:17:10.341 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0024231669999999999 2024-04-19T02:17:10.341 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.341 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.341 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:10.341 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202196+0000", 2024-04-19T02:17:10.341 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.018852384 2024-04-19T02:17:10.341 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.341 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.341 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:10.341 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202241+0000", 2024-04-19T02:17:10.341 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4923999999999999e-05 2024-04-19T02:17:10.341 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.341 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.341 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:10.342 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202280+0000", 2024-04-19T02:17:10.342 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9096e-05 2024-04-19T02:17:10.342 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:10.342 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:10.342 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:10.342 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.342 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.342 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:96356 5.0 5:0a661b39:::benchmark_data_smithi121_44835_object96355:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:10.342 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:17:10.342 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 34.202538681, 2024-04-19T02:17:10.342 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020955516, 2024-04-19T02:17:10.342 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:10.342 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:10.342 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:10.343 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:10.343 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:10.343 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 96356 2024-04-19T02:17:10.343 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.343 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:10.343 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.343 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:10.343 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:17:10.343 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:10.343 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.343 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.343 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:10.344 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:17:10.344 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:10.344 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.344 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.344 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:10.344 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:17:10.344 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:10.344 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.344 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.344 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:10.344 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093455+0000", 2024-04-19T02:17:10.344 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.2205000000000005e-05 2024-04-19T02:17:10.344 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.344 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.345 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:10.345 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093464+0000", 2024-04-19T02:17:10.345 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3910000000000004e-06 2024-04-19T02:17:10.345 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.345 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.345 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.345 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093469+0000", 2024-04-19T02:17:10.345 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.7249999999999997e-06 2024-04-19T02:17:10.345 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.345 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.345 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:10.345 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099643+0000", 2024-04-19T02:17:10.345 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0061743359999999999 2024-04-19T02:17:10.345 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.345 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.346 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:10.346 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099774+0000", 2024-04-19T02:17:10.346 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013050599999999999 2024-04-19T02:17:10.346 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.346 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.346 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:10.346 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099917+0000", 2024-04-19T02:17:10.346 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000143187 2024-04-19T02:17:10.346 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.346 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.346 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:10.346 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.105432+0000", 2024-04-19T02:17:10.346 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.005514873 2024-04-19T02:17:10.346 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.347 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.347 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:10.347 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114264+0000", 2024-04-19T02:17:10.347 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.008831752 2024-04-19T02:17:10.347 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.347 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.347 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:10.347 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114300+0000", 2024-04-19T02:17:10.347 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6582000000000003e-05 2024-04-19T02:17:10.347 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.347 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.347 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:10.347 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114349+0000", 2024-04-19T02:17:10.347 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8579999999999999e-05 2024-04-19T02:17:10.348 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:10.348 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:10.348 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:10.348 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.348 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.348 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:96357 5.0 5:00efce8b:::benchmark_data_smithi121_44835_object96356:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:10.348 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:17:10.348 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 34.202459003000001, 2024-04-19T02:17:10.348 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020937471999999999, 2024-04-19T02:17:10.348 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:10.348 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:10.348 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:10.348 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:10.348 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:10.348 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 96357 2024-04-19T02:17:10.349 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.349 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:10.349 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.349 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:10.349 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:17:10.349 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:10.349 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.349 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.349 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:10.349 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:17:10.349 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:10.349 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.349 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.349 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:10.350 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093472+0000", 2024-04-19T02:17:10.350 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:10.350 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.350 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.350 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:10.350 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093513+0000", 2024-04-19T02:17:10.350 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0213000000000003e-05 2024-04-19T02:17:10.350 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.350 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.350 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:10.350 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093519+0000", 2024-04-19T02:17:10.350 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.066e-06 2024-04-19T02:17:10.350 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.350 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.350 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.351 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093525+0000", 2024-04-19T02:17:10.351 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.8170000000000004e-06 2024-04-19T02:17:10.351 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.351 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.351 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:10.351 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103412+0000", 2024-04-19T02:17:10.351 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0098872739999999997 2024-04-19T02:17:10.351 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.351 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.351 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:10.351 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103551+0000", 2024-04-19T02:17:10.351 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000139295 2024-04-19T02:17:10.351 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.351 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.351 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:10.352 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103701+0000", 2024-04-19T02:17:10.352 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014954599999999999 2024-04-19T02:17:10.352 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.352 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.352 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:10.352 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.108849+0000", 2024-04-19T02:17:10.352 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0051487199999999999 2024-04-19T02:17:10.352 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.352 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.352 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:10.352 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114355+0000", 2024-04-19T02:17:10.352 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0055052529999999999 2024-04-19T02:17:10.352 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.352 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.352 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:10.352 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114379+0000", 2024-04-19T02:17:10.353 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4275000000000001e-05 2024-04-19T02:17:10.353 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.353 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.353 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:10.353 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114410+0000", 2024-04-19T02:17:10.353 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1356999999999998e-05 2024-04-19T02:17:10.353 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:10.353 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:10.353 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:10.353 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.353 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.353 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:104431 5.8 5:14818e19:::benchmark_data_smithi121_44835_object104430:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T02:17:10.353 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:17:10.353 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 30.084546478, 2024-04-19T02:17:10.353 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022149528000000002, 2024-04-19T02:17:10.354 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:10.354 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:10.354 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:10.354 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:10.354 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:10.354 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 104431 2024-04-19T02:17:10.354 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.354 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:10.354 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.354 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:10.354 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:17:10.354 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:10.354 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.354 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.354 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:10.355 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:17:10.355 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:10.355 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.355 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.355 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:10.355 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211384+0000", 2024-04-19T02:17:10.355 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:10.355 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.355 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.355 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:10.355 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211458+0000", 2024-04-19T02:17:10.355 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3311000000000003e-05 2024-04-19T02:17:10.355 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.355 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.355 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:10.356 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211471+0000", 2024-04-19T02:17:10.356 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.3308e-05 2024-04-19T02:17:10.356 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.356 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.356 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.356 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211479+0000", 2024-04-19T02:17:10.356 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0909999999999993e-06 2024-04-19T02:17:10.356 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.356 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.356 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:10.356 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.221821+0000", 2024-04-19T02:17:10.356 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010341596999999999 2024-04-19T02:17:10.356 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.356 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.356 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:10.357 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.221966+0000", 2024-04-19T02:17:10.357 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000145167 2024-04-19T02:17:10.357 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.357 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.357 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:10.357 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.222077+0000", 2024-04-19T02:17:10.357 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011128000000000001 2024-04-19T02:17:10.357 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.357 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.357 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:10.357 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.228126+0000", 2024-04-19T02:17:10.357 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0060486710000000003 2024-04-19T02:17:10.357 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.357 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.357 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:10.358 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233449+0000", 2024-04-19T02:17:10.358 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0053231370000000004 2024-04-19T02:17:10.358 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.358 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.358 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:10.358 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233498+0000", 2024-04-19T02:17:10.358 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8798999999999998e-05 2024-04-19T02:17:10.358 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.358 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.358 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:10.358 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233535+0000", 2024-04-19T02:17:10.358 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7119000000000002e-05 2024-04-19T02:17:10.358 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:10.358 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:10.358 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:10.359 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.359 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.359 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157437 5.e 5:78833a3d:::benchmark_data_smithi121_44835_object23402:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:10.359 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.859854+0000", 2024-04-19T02:17:10.359 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 3.4360777059999998, 2024-04-19T02:17:10.359 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.025859589999999998, 2024-04-19T02:17:10.359 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:10.359 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:10.359 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:10.359 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:10.359 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:10.359 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157437 2024-04-19T02:17:10.359 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.359 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:10.359 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.360 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:10.360 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859854+0000", 2024-04-19T02:17:10.360 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:10.360 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.360 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.360 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:10.360 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859854+0000", 2024-04-19T02:17:10.360 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:10.360 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.360 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.360 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:10.360 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859853+0000", 2024-04-19T02:17:10.360 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:10.360 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.360 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.361 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:10.361 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859857+0000", 2024-04-19T02:17:10.361 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8789999999999996e-06 2024-04-19T02:17:10.361 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.361 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.361 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:10.361 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859865+0000", 2024-04-19T02:17:10.361 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.1880000000000002e-06 2024-04-19T02:17:10.361 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.361 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.361 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.361 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859873+0000", 2024-04-19T02:17:10.361 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.2980000000000003e-06 2024-04-19T02:17:10.361 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.361 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.362 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:10.362 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859908+0000", 2024-04-19T02:17:10.362 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5682999999999997e-05 2024-04-19T02:17:10.362 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.362 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.362 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:10.362 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.860046+0000", 2024-04-19T02:17:10.362 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013714200000000001 2024-04-19T02:17:10.362 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.362 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.362 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:10.362 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.860153+0000", 2024-04-19T02:17:10.362 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010725700000000001 2024-04-19T02:17:10.363 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.363 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.363 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:10.363 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.862008+0000", 2024-04-19T02:17:10.363 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001855179 2024-04-19T02:17:10.363 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.363 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.363 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:10.363 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.885629+0000", 2024-04-19T02:17:10.363 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.023621428 2024-04-19T02:17:10.363 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.363 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.363 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:10.363 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.885676+0000", 2024-04-19T02:17:10.364 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.6371e-05 2024-04-19T02:17:10.364 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.364 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.364 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:10.364 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.885714+0000", 2024-04-19T02:17:10.364 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7907000000000001e-05 2024-04-19T02:17:10.364 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:10.364 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:10.364 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:10.364 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.364 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.364 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157438 5.0 5:01944e77:::benchmark_data_smithi121_44835_object23403:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:10.364 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.864095+0000", 2024-04-19T02:17:10.364 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 3.4318364219999999, 2024-04-19T02:17:10.364 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.032015298999999997, 2024-04-19T02:17:10.365 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:10.365 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:10.365 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:10.365 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:10.365 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:10.365 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157438 2024-04-19T02:17:10.365 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.365 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:10.365 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.365 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:10.365 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864095+0000", 2024-04-19T02:17:10.365 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:10.365 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.365 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.366 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:10.366 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864095+0000", 2024-04-19T02:17:10.366 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:10.366 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.366 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.366 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:10.366 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864094+0000", 2024-04-19T02:17:10.366 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:10.366 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.366 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.366 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:10.366 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864102+0000", 2024-04-19T02:17:10.366 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.6629999999999993e-06 2024-04-19T02:17:10.366 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.367 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.367 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:10.367 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864113+0000", 2024-04-19T02:17:10.367 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1185999999999999e-05 2024-04-19T02:17:10.367 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.367 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.367 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.367 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864119+0000", 2024-04-19T02:17:10.367 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.224e-06 2024-04-19T02:17:10.367 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.367 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.367 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:10.367 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864151+0000", 2024-04-19T02:17:10.367 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1395e-05 2024-04-19T02:17:10.367 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.368 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.368 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:10.368 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864275+0000", 2024-04-19T02:17:10.368 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012431399999999999 2024-04-19T02:17:10.368 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.368 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.368 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:10.368 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864341+0000", 2024-04-19T02:17:10.368 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6146e-05 2024-04-19T02:17:10.368 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.368 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.368 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:10.368 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.866040+0000", 2024-04-19T02:17:10.368 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016991879999999999 2024-04-19T02:17:10.368 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.368 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.369 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:10.369 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896055+0000", 2024-04-19T02:17:10.369 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.030014886000000001 2024-04-19T02:17:10.369 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.369 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.369 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:10.369 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896087+0000", 2024-04-19T02:17:10.369 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1761000000000003e-05 2024-04-19T02:17:10.369 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.369 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.369 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:10.369 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896111+0000", 2024-04-19T02:17:10.369 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3623999999999999e-05 2024-04-19T02:17:10.369 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:10.369 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:10.370 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:10.370 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.370 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.370 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157439 5.e 5:79eb9d3c:::benchmark_data_smithi121_44835_object23404:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:10.370 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:10.370 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 3.4318053470000001, 2024-04-19T02:17:10.370 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.027045244, 2024-04-19T02:17:10.370 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:10.370 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:10.370 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:10.370 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:10.370 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:10.370 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157439 2024-04-19T02:17:10.370 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.371 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:10.371 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.371 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:10.371 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:10.371 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:10.371 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.371 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.371 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:10.371 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:10.371 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:10.371 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.371 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.371 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:10.371 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:10.371 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:10.371 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.372 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.372 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:10.372 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864128+0000", 2024-04-19T02:17:10.372 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.911e-06 2024-04-19T02:17:10.372 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.372 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.372 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:10.372 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864136+0000", 2024-04-19T02:17:10.372 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2609999999999993e-06 2024-04-19T02:17:10.372 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.372 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.372 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.372 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864140+0000", 2024-04-19T02:17:10.372 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5530000000000001e-06 2024-04-19T02:17:10.373 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.373 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.373 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:10.373 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864169+0000", 2024-04-19T02:17:10.373 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.8932e-05 2024-04-19T02:17:10.373 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.373 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.373 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:10.373 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864267+0000", 2024-04-19T02:17:10.373 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7969999999999999e-05 2024-04-19T02:17:10.373 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.373 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.373 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:10.373 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864339+0000", 2024-04-19T02:17:10.373 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.2280999999999995e-05 2024-04-19T02:17:10.374 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.374 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.374 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:10.374 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.865763+0000", 2024-04-19T02:17:10.374 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0014236310000000001 2024-04-19T02:17:10.374 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.374 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.374 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:10.374 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.891093+0000", 2024-04-19T02:17:10.374 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.025330571 2024-04-19T02:17:10.374 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.374 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.374 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:10.374 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.891137+0000", 2024-04-19T02:17:10.375 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3980999999999998e-05 2024-04-19T02:17:10.375 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.375 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.375 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:10.375 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.891172+0000", 2024-04-19T02:17:10.375 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4465000000000003e-05 2024-04-19T02:17:10.375 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:10.375 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:10.375 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:10.375 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.375 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.375 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157442 5.0 5:0062b73f:::benchmark_data_smithi121_44835_object23407:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:10.375 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.867065+0000", 2024-04-19T02:17:10.375 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 3.4288666970000001, 2024-04-19T02:17:10.376 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.029165542999999999, 2024-04-19T02:17:10.376 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:10.376 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:10.376 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:10.376 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:10.376 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:10.376 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157442 2024-04-19T02:17:10.376 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.376 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:10.376 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.376 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:10.376 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867065+0000", 2024-04-19T02:17:10.376 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:10.376 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.376 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.376 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:10.377 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867065+0000", 2024-04-19T02:17:10.377 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:10.377 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.377 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.377 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:10.377 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867064+0000", 2024-04-19T02:17:10.377 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:10.377 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.377 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.377 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:10.377 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867069+0000", 2024-04-19T02:17:10.377 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4549999999999997e-06 2024-04-19T02:17:10.377 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.377 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.377 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:10.378 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867080+0000", 2024-04-19T02:17:10.378 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0797e-05 2024-04-19T02:17:10.378 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.378 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.378 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.378 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867088+0000", 2024-04-19T02:17:10.378 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9729999999999997e-06 2024-04-19T02:17:10.378 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.378 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.378 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:10.378 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867121+0000", 2024-04-19T02:17:10.378 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2920000000000003e-05 2024-04-19T02:17:10.378 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.378 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.378 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:10.379 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867203+0000", 2024-04-19T02:17:10.379 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2578999999999997e-05 2024-04-19T02:17:10.379 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.379 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.379 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:10.379 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867386+0000", 2024-04-19T02:17:10.379 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00018237400000000001 2024-04-19T02:17:10.379 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.379 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.379 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:10.379 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.869338+0000", 2024-04-19T02:17:10.379 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0019521160000000001 2024-04-19T02:17:10.379 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.379 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.379 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:10.380 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896150+0000", 2024-04-19T02:17:10.380 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.026812074000000002 2024-04-19T02:17:10.380 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.380 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.380 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:10.380 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896191+0000", 2024-04-19T02:17:10.380 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1192000000000001e-05 2024-04-19T02:17:10.380 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.380 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.380 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:10.380 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896231+0000", 2024-04-19T02:17:10.380 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9764000000000001e-05 2024-04-19T02:17:10.380 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:10.380 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:10.381 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:10.381 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.381 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.381 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157499 5.8 5:1c3aa38a:::benchmark_data_smithi121_44835_object23464:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:10.381 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.913447+0000", 2024-04-19T02:17:10.381 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 3.3824851250000001, 2024-04-19T02:17:10.381 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.024508188, 2024-04-19T02:17:10.381 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:10.381 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:10.381 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:10.381 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:10.381 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:10.381 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157499 2024-04-19T02:17:10.381 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.381 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:10.381 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.382 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:10.382 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913447+0000", 2024-04-19T02:17:10.382 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:10.382 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.382 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.382 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:10.382 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913447+0000", 2024-04-19T02:17:10.382 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:10.382 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.382 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.382 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:10.383 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913446+0000", 2024-04-19T02:17:10.383 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:10.383 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.383 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.383 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:10.383 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913451+0000", 2024-04-19T02:17:10.383 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.677e-06 2024-04-19T02:17:10.383 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.383 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.383 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:10.383 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913461+0000", 2024-04-19T02:17:10.383 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.8859999999999999e-06 2024-04-19T02:17:10.383 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.383 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.383 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.384 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913467+0000", 2024-04-19T02:17:10.384 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.0800000000000002e-06 2024-04-19T02:17:10.384 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.384 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.384 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:10.384 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913513+0000", 2024-04-19T02:17:10.384 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.5707000000000001e-05 2024-04-19T02:17:10.384 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.384 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.384 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:10.384 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913637+0000", 2024-04-19T02:17:10.384 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012379200000000001 2024-04-19T02:17:10.384 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.384 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.384 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:10.385 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913747+0000", 2024-04-19T02:17:10.385 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000110071 2024-04-19T02:17:10.385 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.385 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.385 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:10.385 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915674+0000", 2024-04-19T02:17:10.385 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0019270789999999999 2024-04-19T02:17:10.385 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.385 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.385 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:10.385 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937902+0000", 2024-04-19T02:17:10.385 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022228286 2024-04-19T02:17:10.385 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.385 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.385 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:10.385 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937931+0000", 2024-04-19T02:17:10.386 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9122e-05 2024-04-19T02:17:10.386 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.386 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.386 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:10.386 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937955+0000", 2024-04-19T02:17:10.386 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3591000000000002e-05 2024-04-19T02:17:10.386 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:10.386 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:10.386 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:10.386 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.386 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.386 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157500 5.0 5:0969ec74:::benchmark_data_smithi121_44835_object23465:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:10.386 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.913476+0000", 2024-04-19T02:17:10.386 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 3.382456259, 2024-04-19T02:17:10.386 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.024497596, 2024-04-19T02:17:10.387 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:10.387 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:10.387 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:10.387 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:10.387 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:10.387 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157500 2024-04-19T02:17:10.387 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.387 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:10.387 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.387 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:10.387 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913476+0000", 2024-04-19T02:17:10.387 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:10.387 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.387 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.388 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:10.388 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913476+0000", 2024-04-19T02:17:10.388 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:10.388 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.388 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.388 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:10.388 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913475+0000", 2024-04-19T02:17:10.388 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:10.388 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.388 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.388 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:10.388 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913478+0000", 2024-04-19T02:17:10.388 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.2670000000000001e-06 2024-04-19T02:17:10.388 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.388 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.389 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:10.389 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913481+0000", 2024-04-19T02:17:10.389 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6899999999999998e-06 2024-04-19T02:17:10.389 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.389 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.389 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.389 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913485+0000", 2024-04-19T02:17:10.389 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1230000000000002e-06 2024-04-19T02:17:10.389 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.389 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.389 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:10.389 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913526+0000", 2024-04-19T02:17:10.389 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.104e-05 2024-04-19T02:17:10.389 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.389 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.390 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:10.390 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913606+0000", 2024-04-19T02:17:10.390 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9510000000000003e-05 2024-04-19T02:17:10.390 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.390 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.390 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:10.390 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913671+0000", 2024-04-19T02:17:10.390 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.4838000000000005e-05 2024-04-19T02:17:10.390 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.390 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.390 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:10.390 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915348+0000", 2024-04-19T02:17:10.390 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016769860000000001 2024-04-19T02:17:10.390 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.390 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.391 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:10.391 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937897+0000", 2024-04-19T02:17:10.391 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022548902999999999 2024-04-19T02:17:10.391 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.391 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.391 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:10.391 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937938+0000", 2024-04-19T02:17:10.391 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1499999999999999e-05 2024-04-19T02:17:10.391 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.391 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.391 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:10.391 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937973+0000", 2024-04-19T02:17:10.391 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5057e-05 2024-04-19T02:17:10.391 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:10.391 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:10.392 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:10.392 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.392 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.392 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157501 5.4 5:26661819:::benchmark_data_smithi121_44835_object23466:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:10.392 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.914839+0000", 2024-04-19T02:17:10.392 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 3.3810929650000001, 2024-04-19T02:17:10.392 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.028504224000000002, 2024-04-19T02:17:10.392 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:10.392 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:10.392 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:10.392 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:10.392 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:10.392 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157501 2024-04-19T02:17:10.392 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.392 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:10.393 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.393 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:10.393 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914839+0000", 2024-04-19T02:17:10.393 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:10.393 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.393 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.393 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:10.393 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914839+0000", 2024-04-19T02:17:10.393 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:10.393 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.393 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.393 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:10.393 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914838+0000", 2024-04-19T02:17:10.393 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:10.393 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.394 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.394 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:10.394 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914841+0000", 2024-04-19T02:17:10.394 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.706e-06 2024-04-19T02:17:10.394 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.394 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.394 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:10.394 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914848+0000", 2024-04-19T02:17:10.394 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.7429999999999996e-06 2024-04-19T02:17:10.394 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.395 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.395 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.395 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914852+0000", 2024-04-19T02:17:10.395 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0810000000000004e-06 2024-04-19T02:17:10.395 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.395 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.395 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:10.395 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914892+0000", 2024-04-19T02:17:10.395 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9957999999999999e-05 2024-04-19T02:17:10.395 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.395 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.395 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:10.395 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915008+0000", 2024-04-19T02:17:10.395 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000116401 2024-04-19T02:17:10.396 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.396 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.396 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:10.396 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915125+0000", 2024-04-19T02:17:10.396 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011622500000000001 2024-04-19T02:17:10.396 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.396 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.396 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:10.396 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916663+0000", 2024-04-19T02:17:10.396 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0015381310000000001 2024-04-19T02:17:10.396 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.396 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.396 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:10.396 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943114+0000", 2024-04-19T02:17:10.396 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.026451125999999998 2024-04-19T02:17:10.396 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.397 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.397 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:10.397 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943245+0000", 2024-04-19T02:17:10.397 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000131645 2024-04-19T02:17:10.397 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.397 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.397 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:10.397 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943343+0000", 2024-04-19T02:17:10.397 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7604999999999998e-05 2024-04-19T02:17:10.397 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:10.397 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:10.397 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:10.397 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.397 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.397 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157507 5.b 5:de8840a2:::benchmark_data_smithi121_44835_object23472:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:10.398 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:10.398 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 3.3795286839999998, 2024-04-19T02:17:10.398 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022544518999999999, 2024-04-19T02:17:10.398 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:10.398 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:10.398 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:10.398 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:10.398 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:10.398 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157507 2024-04-19T02:17:10.398 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.398 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:10.398 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.398 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:10.398 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:10.398 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:10.399 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.399 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.399 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:10.399 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:10.399 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:10.399 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.399 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.399 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:10.399 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:10.399 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:10.399 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.399 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.399 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:10.399 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916406+0000", 2024-04-19T02:17:10.399 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4589999999999998e-06 2024-04-19T02:17:10.400 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.400 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.400 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:10.400 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916415+0000", 2024-04-19T02:17:10.400 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3910000000000004e-06 2024-04-19T02:17:10.400 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.400 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.400 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.400 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916421+0000", 2024-04-19T02:17:10.400 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.6130000000000003e-06 2024-04-19T02:17:10.400 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.400 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.400 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:10.400 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916448+0000", 2024-04-19T02:17:10.400 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7277999999999999e-05 2024-04-19T02:17:10.401 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.401 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.401 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:10.401 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916539+0000", 2024-04-19T02:17:10.401 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0855999999999999e-05 2024-04-19T02:17:10.401 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.401 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.401 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:10.401 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916605+0000", 2024-04-19T02:17:10.401 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6141000000000003e-05 2024-04-19T02:17:10.401 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.401 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.401 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:10.401 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918276+0000", 2024-04-19T02:17:10.401 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001670726 2024-04-19T02:17:10.402 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.402 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.402 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:10.402 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.938888+0000", 2024-04-19T02:17:10.402 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020612042000000001 2024-04-19T02:17:10.402 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.402 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.402 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:10.402 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.938924+0000", 2024-04-19T02:17:10.402 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5692999999999999e-05 2024-04-19T02:17:10.402 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.402 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.402 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:10.402 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.938948+0000", 2024-04-19T02:17:10.403 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3879e-05 2024-04-19T02:17:10.403 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:10.403 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:10.403 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:10.403 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.403 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.403 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157509 5.8 5:1dca85d0:::benchmark_data_smithi121_44835_object23474:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:10.403 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:10.403 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 3.3771004379999998, 2024-04-19T02:17:10.403 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.024511807, 2024-04-19T02:17:10.403 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:10.403 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:10.403 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:10.403 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:10.403 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:10.403 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157509 2024-04-19T02:17:10.404 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.404 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:10.404 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.404 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:10.404 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:10.404 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:10.404 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.404 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.404 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:10.404 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:10.404 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:10.404 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.404 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.404 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:10.404 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:10.405 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:10.405 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.405 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.405 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:10.405 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918834+0000", 2024-04-19T02:17:10.405 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9409999999999999e-06 2024-04-19T02:17:10.405 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.405 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.405 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:10.405 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918859+0000", 2024-04-19T02:17:10.405 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.5245999999999999e-05 2024-04-19T02:17:10.405 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.405 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.405 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.405 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918864+0000", 2024-04-19T02:17:10.406 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.1819999999999997e-06 2024-04-19T02:17:10.406 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.406 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.406 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:10.406 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918900+0000", 2024-04-19T02:17:10.406 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5327000000000002e-05 2024-04-19T02:17:10.406 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.406 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.406 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:10.406 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.919024+0000", 2024-04-19T02:17:10.406 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012400900000000001 2024-04-19T02:17:10.406 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.406 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.406 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:10.406 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.919136+0000", 2024-04-19T02:17:10.407 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000111987 2024-04-19T02:17:10.407 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.407 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.407 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:10.407 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.922096+0000", 2024-04-19T02:17:10.407 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0029607079999999998 2024-04-19T02:17:10.407 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.407 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.407 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:10.407 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943120+0000", 2024-04-19T02:17:10.407 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.021023995 2024-04-19T02:17:10.407 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.407 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.407 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:10.407 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943255+0000", 2024-04-19T02:17:10.408 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013502100000000001 2024-04-19T02:17:10.408 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:10.408 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:10.408 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:10.408 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943343+0000", 2024-04-19T02:17:10.408 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.7931999999999998e-05 2024-04-19T02:17:10.408 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:10.408 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:10.408 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:10.408 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:10.408 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:10.408 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:17:10.410 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:10.411+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:10.410 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:10.511 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:10.512+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:10.583 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:10.583 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:17:10.583 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.583 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:164185 5.7 5:ed263aed:::benchmark_data_smithi121_44835_object30150:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T02:17:10.583 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:10.582445+0000", 2024-04-19T02:17:10.583 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00029580699999999998, 2024-04-19T02:17:10.584 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00032288, 2024-04-19T02:17:10.584 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:10.584 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:10.584 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:10.584 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:10.584 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:10.584 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 164185 2024-04-19T02:17:10.584 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.584 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:10.584 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.584 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:10.584 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.582445+0000", 2024-04-19T02:17:10.584 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:10.584 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.585 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.585 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:10.585 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.582445+0000", 2024-04-19T02:17:10.585 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:10.585 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.585 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.585 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:10.585 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.582445+0000", 2024-04-19T02:17:10.585 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:10.585 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.585 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.585 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:10.585 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.582449+0000", 2024-04-19T02:17:10.585 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6820000000000002e-06 2024-04-19T02:17:10.585 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.586 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.586 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:10.586 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.582460+0000", 2024-04-19T02:17:10.586 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0329000000000001e-05 2024-04-19T02:17:10.586 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.586 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.586 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.586 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.582467+0000", 2024-04-19T02:17:10.586 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6029999999999999e-06 2024-04-19T02:17:10.586 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.586 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.586 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:10.586 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.582502+0000", 2024-04-19T02:17:10.586 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4388999999999999e-05 2024-04-19T02:17:10.587 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.587 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.587 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:10.587 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.582616+0000", 2024-04-19T02:17:10.587 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011396999999999999 2024-04-19T02:17:10.587 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:10.587 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:10.587 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:10.587 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.587 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.587 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:164187 5.f 5:fff519e3:::benchmark_data_smithi121_44835_object30152:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T02:17:10.587 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:10.582483+0000", 2024-04-19T02:17:10.587 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00025862599999999997, 2024-04-19T02:17:10.587 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00036709200000000002, 2024-04-19T02:17:10.587 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:10.588 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:10.588 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:10.588 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:10.588 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:10.588 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 164187 2024-04-19T02:17:10.588 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.588 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:10.588 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.588 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:10.588 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.582483+0000", 2024-04-19T02:17:10.588 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:10.588 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.589 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.589 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:10.589 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.582483+0000", 2024-04-19T02:17:10.589 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:10.589 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.589 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.589 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:10.589 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.582482+0000", 2024-04-19T02:17:10.589 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:10.589 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.589 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.589 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:10.590 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.582485+0000", 2024-04-19T02:17:10.590 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1350000000000001e-06 2024-04-19T02:17:10.590 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.590 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.590 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:10.590 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.582492+0000", 2024-04-19T02:17:10.590 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3269999999999997e-06 2024-04-19T02:17:10.590 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.590 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.590 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.590 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.582497+0000", 2024-04-19T02:17:10.590 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5940000000000001e-06 2024-04-19T02:17:10.590 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.590 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.590 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:10.591 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.582537+0000", 2024-04-19T02:17:10.591 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9589000000000003e-05 2024-04-19T02:17:10.591 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.591 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.591 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:10.591 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.582673+0000", 2024-04-19T02:17:10.591 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000135819 2024-04-19T02:17:10.591 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.591 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.591 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:10.591 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.582785+0000", 2024-04-19T02:17:10.591 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000112303 2024-04-19T02:17:10.591 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:10.591 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:10.591 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:10.592 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.592 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.592 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:164167 5.9 5:976d8146:::benchmark_data_smithi121_44835_object30132:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T02:17:10.592 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:10.576156+0000", 2024-04-19T02:17:10.592 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0065855169999999999, 2024-04-19T02:17:10.592 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00677219, 2024-04-19T02:17:10.592 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:10.592 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:10.592 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:10.592 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:10.592 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:10.592 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 164167 2024-04-19T02:17:10.592 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.592 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:10.593 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.593 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:10.593 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.576156+0000", 2024-04-19T02:17:10.593 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:10.593 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.593 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.593 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:10.593 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.576156+0000", 2024-04-19T02:17:10.593 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:10.593 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.593 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.593 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:10.593 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.576155+0000", 2024-04-19T02:17:10.593 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:10.593 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.594 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.594 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:10.594 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.576158+0000", 2024-04-19T02:17:10.594 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4609999999999998e-06 2024-04-19T02:17:10.594 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.594 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.594 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:10.594 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.576163+0000", 2024-04-19T02:17:10.594 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5029999999999997e-06 2024-04-19T02:17:10.594 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.594 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.594 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.594 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.576168+0000", 2024-04-19T02:17:10.594 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7110000000000003e-06 2024-04-19T02:17:10.594 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.595 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.595 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:10.595 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.576202+0000", 2024-04-19T02:17:10.595 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3710000000000001e-05 2024-04-19T02:17:10.595 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.595 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.595 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:10.595 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.576309+0000", 2024-04-19T02:17:10.595 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107304 2024-04-19T02:17:10.595 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.595 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.596 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:10.596 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.576412+0000", 2024-04-19T02:17:10.596 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010264699999999999 2024-04-19T02:17:10.596 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.596 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.596 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:10.596 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.582210+0000", 2024-04-19T02:17:10.596 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0057987910000000002 2024-04-19T02:17:10.596 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:10.596 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:10.596 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:10.596 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.596 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.596 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:164168 5.9 5:9ac5333d:::benchmark_data_smithi121_44835_object30133:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T02:17:10.596 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:10.576179+0000", 2024-04-19T02:17:10.597 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0065625880000000003, 2024-04-19T02:17:10.597 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.006827418, 2024-04-19T02:17:10.597 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:10.597 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:10.597 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:10.597 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:10.597 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:10.597 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 164168 2024-04-19T02:17:10.597 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.597 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:10.598 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.598 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:10.598 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.576179+0000", 2024-04-19T02:17:10.598 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:10.598 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.598 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.598 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:10.598 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.576179+0000", 2024-04-19T02:17:10.598 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:10.598 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.598 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.598 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:10.598 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.576178+0000", 2024-04-19T02:17:10.598 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:10.598 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.599 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.599 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:10.599 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.576181+0000", 2024-04-19T02:17:10.599 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3180000000000001e-06 2024-04-19T02:17:10.599 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.599 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.599 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:10.599 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.576187+0000", 2024-04-19T02:17:10.599 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.455e-06 2024-04-19T02:17:10.599 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.599 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.599 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.599 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.576192+0000", 2024-04-19T02:17:10.599 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5159999999999996e-06 2024-04-19T02:17:10.599 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.600 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.600 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:10.600 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.580136+0000", 2024-04-19T02:17:10.600 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039446159999999997 2024-04-19T02:17:10.600 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.600 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.600 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:10.600 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.580249+0000", 2024-04-19T02:17:10.600 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000112823 2024-04-19T02:17:10.600 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.600 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.600 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:10.600 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.580353+0000", 2024-04-19T02:17:10.600 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000103832 2024-04-19T02:17:10.600 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:10.600 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:10.601 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:10.601 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.601 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.601 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:164173 5.c 5:33894eec:::benchmark_data_smithi121_44835_object30138:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T02:17:10.601 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:10.577227+0000", 2024-04-19T02:17:10.601 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0055147260000000002, 2024-04-19T02:17:10.601 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0058544740000000001, 2024-04-19T02:17:10.601 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:10.601 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:10.601 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:10.601 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:10.601 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:10.601 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 164173 2024-04-19T02:17:10.601 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.601 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:10.602 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.602 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:10.602 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.577227+0000", 2024-04-19T02:17:10.602 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:10.602 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.602 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.602 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:10.602 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.577227+0000", 2024-04-19T02:17:10.602 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:10.602 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.602 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.602 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:10.602 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.577226+0000", 2024-04-19T02:17:10.602 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:10.602 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.603 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.603 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:10.603 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.577231+0000", 2024-04-19T02:17:10.603 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4480000000000002e-06 2024-04-19T02:17:10.603 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.603 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.603 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:10.603 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.577243+0000", 2024-04-19T02:17:10.603 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2079000000000001e-05 2024-04-19T02:17:10.603 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.603 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.603 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.603 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.577251+0000", 2024-04-19T02:17:10.603 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9929999999999995e-06 2024-04-19T02:17:10.603 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.603 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.604 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:10.604 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.580289+0000", 2024-04-19T02:17:10.604 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030377490000000002 2024-04-19T02:17:10.604 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.604 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.604 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:10.604 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.580403+0000", 2024-04-19T02:17:10.604 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011450700000000001 2024-04-19T02:17:10.604 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:10.604 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:10.604 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:10.604 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.604 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.605 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:164174 5.7 5:eff15d11:::benchmark_data_smithi121_44835_object30139:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T02:17:10.605 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:10.577998+0000", 2024-04-19T02:17:10.605 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0047428879999999998, 2024-04-19T02:17:10.605 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051499500000000004, 2024-04-19T02:17:10.605 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:10.605 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:10.605 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:10.605 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:10.605 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:10.605 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 164174 2024-04-19T02:17:10.605 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.605 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:10.605 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.605 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:10.605 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.577998+0000", 2024-04-19T02:17:10.606 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:10.606 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.606 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.606 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:10.606 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.577998+0000", 2024-04-19T02:17:10.606 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:10.606 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.606 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.606 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:10.606 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.577998+0000", 2024-04-19T02:17:10.606 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:10.606 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.606 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.606 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:10.606 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.578003+0000", 2024-04-19T02:17:10.607 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0300000000000001e-06 2024-04-19T02:17:10.607 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.607 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.607 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:10.607 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.578013+0000", 2024-04-19T02:17:10.607 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0213e-05 2024-04-19T02:17:10.607 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.607 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.607 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.607 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.578022+0000", 2024-04-19T02:17:10.607 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7250000000000003e-06 2024-04-19T02:17:10.607 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.607 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.607 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:10.607 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.578064+0000", 2024-04-19T02:17:10.607 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2454999999999999e-05 2024-04-19T02:17:10.608 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.608 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.608 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:10.608 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.578200+0000", 2024-04-19T02:17:10.608 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000135427 2024-04-19T02:17:10.608 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:10.608 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:10.608 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:10.608 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.608 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.608 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:164175 5.f 5:f4a198a4:::benchmark_data_smithi121_44835_object30140:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T02:17:10.608 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:10.578031+0000", 2024-04-19T02:17:10.608 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0047098740000000002, 2024-04-19T02:17:10.608 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051829720000000001, 2024-04-19T02:17:10.608 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:10.608 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:10.609 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:10.609 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:10.609 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:10.609 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 164175 2024-04-19T02:17:10.609 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.609 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:10.609 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.609 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:10.609 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.578031+0000", 2024-04-19T02:17:10.609 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:10.609 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.609 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.609 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:10.609 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.578031+0000", 2024-04-19T02:17:10.609 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:10.610 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.610 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.610 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:10.610 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.578031+0000", 2024-04-19T02:17:10.610 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:10.610 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.610 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.610 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:10.610 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.578033+0000", 2024-04-19T02:17:10.610 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4830000000000002e-06 2024-04-19T02:17:10.610 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.610 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.610 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:10.610 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.578039+0000", 2024-04-19T02:17:10.610 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8499999999999999e-06 2024-04-19T02:17:10.611 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.611 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.611 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.611 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.578044+0000", 2024-04-19T02:17:10.611 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8130000000000003e-06 2024-04-19T02:17:10.611 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.611 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.611 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:10.611 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.578104+0000", 2024-04-19T02:17:10.611 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0222e-05 2024-04-19T02:17:10.611 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.611 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.611 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:10.611 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.578237+0000", 2024-04-19T02:17:10.611 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013283899999999999 2024-04-19T02:17:10.612 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.612 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.612 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:10.612 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.578348+0000", 2024-04-19T02:17:10.612 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000110448 2024-04-19T02:17:10.612 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.612 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.612 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:10.612 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.582255+0000", 2024-04-19T02:17:10.612 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039073040000000003 2024-04-19T02:17:10.612 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:10.612 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:10.612 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:10.612 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.612 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.613 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:164176 5.f 5:f96089fd:::benchmark_data_smithi121_44835_object30141:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T02:17:10.613 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:10.578057+0000", 2024-04-19T02:17:10.613 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0046840500000000004, 2024-04-19T02:17:10.613 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052370990000000003, 2024-04-19T02:17:10.613 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:10.613 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:10.613 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:10.613 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:10.613 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:10.613 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 164176 2024-04-19T02:17:10.613 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.613 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:10.613 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.613 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:10.613 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.578057+0000", 2024-04-19T02:17:10.614 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:10.614 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.614 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.614 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:10.614 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.578057+0000", 2024-04-19T02:17:10.614 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:10.614 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.614 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.614 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:10.614 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.578057+0000", 2024-04-19T02:17:10.614 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:10.614 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.614 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.614 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:10.614 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.578059+0000", 2024-04-19T02:17:10.615 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3350000000000001e-06 2024-04-19T02:17:10.615 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.615 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.615 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:10.615 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.578066+0000", 2024-04-19T02:17:10.615 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6680000000000004e-06 2024-04-19T02:17:10.615 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.615 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.615 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.615 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.578071+0000", 2024-04-19T02:17:10.615 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3759999999999999e-06 2024-04-19T02:17:10.615 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.615 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.615 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:10.615 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.579837+0000", 2024-04-19T02:17:10.616 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017660200000000001 2024-04-19T02:17:10.616 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.616 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.616 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:10.616 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.579994+0000", 2024-04-19T02:17:10.616 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015679999999999999 2024-04-19T02:17:10.616 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.616 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.616 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:10.616 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.580110+0000", 2024-04-19T02:17:10.616 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011569399999999999 2024-04-19T02:17:10.616 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.617 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.617 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:10.617 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.582258+0000", 2024-04-19T02:17:10.617 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021478449999999998 2024-04-19T02:17:10.617 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:10.617 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:10.617 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:10.617 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.617 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.617 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:164177 5.2 5:49f8b4d1:::benchmark_data_smithi121_44835_object30142:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T02:17:10.617 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:10.578125+0000", 2024-04-19T02:17:10.617 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0046162779999999997, 2024-04-19T02:17:10.617 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052478009999999999, 2024-04-19T02:17:10.618 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:10.618 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:10.618 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:10.618 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:10.618 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:10.618 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 164177 2024-04-19T02:17:10.618 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.618 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:10.618 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.618 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:10.618 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.578125+0000", 2024-04-19T02:17:10.618 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:10.618 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.618 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.619 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:10.619 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.578125+0000", 2024-04-19T02:17:10.619 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:10.619 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.619 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.619 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:10.619 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.578124+0000", 2024-04-19T02:17:10.619 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:10.619 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.619 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.619 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:10.619 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.578128+0000", 2024-04-19T02:17:10.619 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1389999999999999e-06 2024-04-19T02:17:10.619 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.619 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.620 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:10.620 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.578135+0000", 2024-04-19T02:17:10.620 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5560000000000002e-06 2024-04-19T02:17:10.620 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.620 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.620 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.620 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.578142+0000", 2024-04-19T02:17:10.620 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6189999999999996e-06 2024-04-19T02:17:10.620 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.620 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.620 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:10.620 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.578179+0000", 2024-04-19T02:17:10.620 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.752e-05 2024-04-19T02:17:10.620 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.620 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.621 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:10.621 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.578300+0000", 2024-04-19T02:17:10.621 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120982 2024-04-19T02:17:10.621 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:10.621 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:10.621 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:10.621 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.621 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.621 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:164179 5.6 5:6d74a92c:::benchmark_data_smithi121_44835_object30144:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T02:17:10.621 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:10.578179+0000", 2024-04-19T02:17:10.621 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0045620189999999996, 2024-04-19T02:17:10.621 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052589539999999997, 2024-04-19T02:17:10.621 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:10.621 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:10.621 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:10.622 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:10.622 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:10.622 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 164179 2024-04-19T02:17:10.622 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.622 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:10.622 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.622 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:10.622 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.578179+0000", 2024-04-19T02:17:10.622 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:10.622 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.622 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.622 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:10.622 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.578179+0000", 2024-04-19T02:17:10.622 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:10.622 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.623 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.623 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:10.623 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.578179+0000", 2024-04-19T02:17:10.623 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:10.623 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.623 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.623 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:10.623 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.578182+0000", 2024-04-19T02:17:10.623 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0680000000000001e-06 2024-04-19T02:17:10.623 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.623 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.623 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:10.623 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.578189+0000", 2024-04-19T02:17:10.623 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5050000000000001e-06 2024-04-19T02:17:10.624 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.624 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.624 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.624 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.578195+0000", 2024-04-19T02:17:10.624 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3159999999999996e-06 2024-04-19T02:17:10.624 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.624 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.624 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:10.624 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.580045+0000", 2024-04-19T02:17:10.624 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0018498900000000001 2024-04-19T02:17:10.624 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.624 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.624 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:10.624 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.580169+0000", 2024-04-19T02:17:10.624 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012493500000000001 2024-04-19T02:17:10.625 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:10.625 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:10.625 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:10.625 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.625 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.625 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:164181 5.2 5:40998ade:::benchmark_data_smithi121_44835_object30146:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T02:17:10.625 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:10.580066+0000", 2024-04-19T02:17:10.625 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0026757389999999999, 2024-04-19T02:17:10.625 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0034393819999999999, 2024-04-19T02:17:10.625 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:10.625 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:10.625 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:10.626 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:10.626 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:10.626 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 164181 2024-04-19T02:17:10.626 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.626 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:10.626 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.626 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:10.626 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.580066+0000", 2024-04-19T02:17:10.626 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:10.626 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.626 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.626 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:10.626 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.580066+0000", 2024-04-19T02:17:10.626 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:10.627 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.627 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.628 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:10.628 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.580065+0000", 2024-04-19T02:17:10.628 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:10.628 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.628 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.628 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:10.628 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.580069+0000", 2024-04-19T02:17:10.628 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4789999999999998e-06 2024-04-19T02:17:10.628 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.628 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.628 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:10.628 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.580078+0000", 2024-04-19T02:17:10.628 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9330000000000007e-06 2024-04-19T02:17:10.628 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.629 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.629 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.629 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.580093+0000", 2024-04-19T02:17:10.629 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4568e-05 2024-04-19T02:17:10.629 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.629 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.629 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:10.629 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.580283+0000", 2024-04-19T02:17:10.629 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000190726 2024-04-19T02:17:10.629 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.629 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.629 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:10.629 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.580403+0000", 2024-04-19T02:17:10.629 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011971799999999999 2024-04-19T02:17:10.630 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:10.630 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:10.630 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:10.630 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.630 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.630 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:164182 5.9 5:93e87b81:::benchmark_data_smithi121_44835_object30147:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T02:17:10.630 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:10.580158+0000", 2024-04-19T02:17:10.630 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0025831729999999998, 2024-04-19T02:17:10.630 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003412506, 2024-04-19T02:17:10.630 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:10.630 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:10.630 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:10.630 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:10.630 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:10.631 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 164182 2024-04-19T02:17:10.631 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.631 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:10.631 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.631 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:10.631 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.580158+0000", 2024-04-19T02:17:10.631 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:10.631 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.631 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.631 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:10.631 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.580158+0000", 2024-04-19T02:17:10.631 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:10.631 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.631 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.631 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:10.632 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.580157+0000", 2024-04-19T02:17:10.632 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:10.632 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.632 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.632 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:10.632 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.580162+0000", 2024-04-19T02:17:10.632 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2300000000000002e-06 2024-04-19T02:17:10.632 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.632 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.632 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:10.632 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.580169+0000", 2024-04-19T02:17:10.632 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5100000000000001e-06 2024-04-19T02:17:10.632 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.632 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.633 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.633 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.580176+0000", 2024-04-19T02:17:10.633 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4420000000000003e-06 2024-04-19T02:17:10.633 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.633 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.633 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:10.633 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.582233+0000", 2024-04-19T02:17:10.633 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020573309999999999 2024-04-19T02:17:10.633 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.633 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.633 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:10.633 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.582326+0000", 2024-04-19T02:17:10.633 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2629999999999999e-05 2024-04-19T02:17:10.633 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.633 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.634 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:10.634 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.582390+0000", 2024-04-19T02:17:10.634 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4144000000000001e-05 2024-04-19T02:17:10.634 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:10.634 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:10.634 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:10.634 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.634 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.635 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:164183 5.2 5:4e8a0a3f:::benchmark_data_smithi121_44835_object30148:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T02:17:10.635 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:10.581063+0000", 2024-04-19T02:17:10.635 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0016786640000000001, 2024-04-19T02:17:10.635 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0025854530000000001, 2024-04-19T02:17:10.635 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:10.635 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:10.635 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:10.635 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:10.635 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:10.635 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 164183 2024-04-19T02:17:10.635 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.635 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:10.635 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.635 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:10.636 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.581063+0000", 2024-04-19T02:17:10.636 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:10.636 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.636 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.636 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:10.636 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.581063+0000", 2024-04-19T02:17:10.636 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:10.636 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.636 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.636 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:10.636 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.581062+0000", 2024-04-19T02:17:10.636 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:10.636 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.636 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.636 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:10.637 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.581067+0000", 2024-04-19T02:17:10.637 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0470000000000001e-06 2024-04-19T02:17:10.637 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.637 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.637 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:10.637 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.581078+0000", 2024-04-19T02:17:10.637 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1143e-05 2024-04-19T02:17:10.637 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.637 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.637 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:10.637 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.581085+0000", 2024-04-19T02:17:10.637 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.99e-06 2024-04-19T02:17:10.637 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.637 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.638 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:10.638 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.582023+0000", 2024-04-19T02:17:10.638 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00093791899999999995 2024-04-19T02:17:10.638 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:10.638 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:10.638 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:10.638 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:10.582155+0000", 2024-04-19T02:17:10.638 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013253000000000001 2024-04-19T02:17:10.638 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:10.638 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:10.638 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:10.638 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:10.638 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-04-19T02:17:10.638 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 13 2024-04-19T02:17:10.639 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:10.640 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:10.641 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:10.640+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:10.741 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:10.742+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:10.842 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:10.844+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:10.856 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:10.856 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-04-19T02:17:10.856 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-04-19T02:17:10.856 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-04-19T02:17:10.856 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:10.871 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:10.955 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:10.956+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:11.045 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:11.046+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:11.088 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:11.088 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-04-19T02:17:11.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-04-19T02:17:11.088 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:17:11.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.088 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:11.088 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:17:11.089 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 101.817349376, 2024-04-19T02:17:11.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020307345000000001, 2024-04-19T02:17:11.089 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:11.089 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:11.089 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:11.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:11.089 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:17:11.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:11.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:11.089 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269792+0000", 2024-04-19T02:17:11.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:11.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:11.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269791+0000", 2024-04-19T02:17:11.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:11.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:11.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269795+0000", 2024-04-19T02:17:11.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5619999999999999e-06 2024-04-19T02:17:11.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:11.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269802+0000", 2024-04-19T02:17:11.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8469999999999998e-06 2024-04-19T02:17:11.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.091 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:11.091 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269807+0000", 2024-04-19T02:17:11.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.707e-06 2024-04-19T02:17:11.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.091 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:11.091 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269950+0000", 2024-04-19T02:17:11.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000143313 2024-04-19T02:17:11.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.091 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:11.091 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269955+0000", 2024-04-19T02:17:11.092 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4029999999999998e-06 2024-04-19T02:17:11.092 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.092 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.092 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:11.092 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.283806+0000", 2024-04-19T02:17:11.092 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013850220999999999 2024-04-19T02:17:11.092 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.092 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.092 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:11.092 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.283896+0000", 2024-04-19T02:17:11.092 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0261999999999997e-05 2024-04-19T02:17:11.092 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.092 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.093 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:11.093 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284022+0000", 2024-04-19T02:17:11.093 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012641200000000001 2024-04-19T02:17:11.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.093 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:11.093 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289066+0000", 2024-04-19T02:17:11.093 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050438490000000004 2024-04-19T02:17:11.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.093 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:11.093 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290011+0000", 2024-04-19T02:17:11.093 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00094490700000000004 2024-04-19T02:17:11.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.094 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:11.094 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290054+0000", 2024-04-19T02:17:11.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.337e-05 2024-04-19T02:17:11.094 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.094 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:11.094 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290099+0000", 2024-04-19T02:17:11.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4987999999999997e-05 2024-04-19T02:17:11.094 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:11.094 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:11.094 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:11.094 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.095 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:11.095 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:17:11.095 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 101.81727144600001, 2024-04-19T02:17:11.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020331023, 2024-04-19T02:17:11.095 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:11.095 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:11.095 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:11.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:11.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:17:11.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:11.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:11.096 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269870+0000", 2024-04-19T02:17:11.096 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:11.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.096 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:11.096 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269869+0000", 2024-04-19T02:17:11.096 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:11.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.096 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:11.096 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269873+0000", 2024-04-19T02:17:11.096 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0219999999999998e-06 2024-04-19T02:17:11.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.096 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:11.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269881+0000", 2024-04-19T02:17:11.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.79e-06 2024-04-19T02:17:11.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:11.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269887+0000", 2024-04-19T02:17:11.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7899999999999996e-06 2024-04-19T02:17:11.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:11.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269983+0000", 2024-04-19T02:17:11.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6057000000000005e-05 2024-04-19T02:17:11.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:11.098 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269986+0000", 2024-04-19T02:17:11.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9220000000000001e-06 2024-04-19T02:17:11.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.098 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:11.098 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284350+0000", 2024-04-19T02:17:11.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014364335000000001 2024-04-19T02:17:11.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.098 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:11.098 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284664+0000", 2024-04-19T02:17:11.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000313646 2024-04-19T02:17:11.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:11.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.284794+0000", 2024-04-19T02:17:11.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129839 2024-04-19T02:17:11.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:11.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289107+0000", 2024-04-19T02:17:11.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0043127060000000004 2024-04-19T02:17:11.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:11.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290108+0000", 2024-04-19T02:17:11.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0010010590000000001 2024-04-19T02:17:11.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.100 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.100 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:11.100 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290144+0000", 2024-04-19T02:17:11.100 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6709999999999999e-05 2024-04-19T02:17:11.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.100 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.100 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:11.100 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290201+0000", 2024-04-19T02:17:11.100 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6654999999999999e-05 2024-04-19T02:17:11.100 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:11.100 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:11.100 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:11.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.101 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:11.101 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:17:11.101 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 101.817229105, 2024-04-19T02:17:11.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020507241999999998, 2024-04-19T02:17:11.101 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:11.101 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:11.101 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:11.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.101 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:11.101 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:17:11.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:11.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:11.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:17:11.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:11.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:11.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269912+0000", 2024-04-19T02:17:11.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:11.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:11.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269915+0000", 2024-04-19T02:17:11.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.472e-06 2024-04-19T02:17:11.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:11.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269928+0000", 2024-04-19T02:17:11.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2979000000000001e-05 2024-04-19T02:17:11.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:11.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269935+0000", 2024-04-19T02:17:11.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8859999999999998e-06 2024-04-19T02:17:11.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:11.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270009+0000", 2024-04-19T02:17:11.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3429000000000005e-05 2024-04-19T02:17:11.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:11.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270013+0000", 2024-04-19T02:17:11.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2590000000000002e-06 2024-04-19T02:17:11.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:11.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285375+0000", 2024-04-19T02:17:11.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015362275999999999 2024-04-19T02:17:11.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:11.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285451+0000", 2024-04-19T02:17:11.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5338000000000003e-05 2024-04-19T02:17:11.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:11.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285562+0000", 2024-04-19T02:17:11.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000111285 2024-04-19T02:17:11.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:11.106 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.289134+0000", 2024-04-19T02:17:11.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035719670000000001 2024-04-19T02:17:11.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.106 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:11.106 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290341+0000", 2024-04-19T02:17:11.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012074500000000001 2024-04-19T02:17:11.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.106 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:11.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290383+0000", 2024-04-19T02:17:11.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1386e-05 2024-04-19T02:17:11.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:11.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290419+0000", 2024-04-19T02:17:11.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6884000000000001e-05 2024-04-19T02:17:11.107 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:11.107 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:11.107 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:11.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.107 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:11.107 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:17:11.107 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 101.817150845, 2024-04-19T02:17:11.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022007204999999998, 2024-04-19T02:17:11.108 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:11.108 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:11.108 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:11.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:11.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:17:11.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:11.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:11.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:17:11.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:11.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:11.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269990+0000", 2024-04-19T02:17:11.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:11.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:11.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269999+0000", 2024-04-19T02:17:11.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9539999999999993e-06 2024-04-19T02:17:11.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:11.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270006+0000", 2024-04-19T02:17:11.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.216e-06 2024-04-19T02:17:11.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.110 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:11.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270012+0000", 2024-04-19T02:17:11.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5049999999999998e-06 2024-04-19T02:17:11.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.110 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:11.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270058+0000", 2024-04-19T02:17:11.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.634e-05 2024-04-19T02:17:11.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.110 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:11.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270064+0000", 2024-04-19T02:17:11.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0669999999999997e-06 2024-04-19T02:17:11.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:11.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287159+0000", 2024-04-19T02:17:11.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017095086999999998 2024-04-19T02:17:11.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:11.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287254+0000", 2024-04-19T02:17:11.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4716000000000006e-05 2024-04-19T02:17:11.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:11.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287389+0000", 2024-04-19T02:17:11.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013511900000000001 2024-04-19T02:17:11.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:11.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290481+0000", 2024-04-19T02:17:11.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030920169999999999 2024-04-19T02:17:11.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:11.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291931+0000", 2024-04-19T02:17:11.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001450118 2024-04-19T02:17:11.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:11.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291960+0000", 2024-04-19T02:17:11.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9096000000000001e-05 2024-04-19T02:17:11.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:11.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291998+0000", 2024-04-19T02:17:11.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7514e-05 2024-04-19T02:17:11.113 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:11.113 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:11.113 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:11.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.113 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:11.113 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:17:11.113 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 101.81709027399999, 2024-04-19T02:17:11.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020759494999999999, 2024-04-19T02:17:11.113 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:11.113 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:11.113 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:11.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.114 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:11.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:17:11.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:11.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.114 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:11.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:17:11.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:11.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.114 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:11.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270051+0000", 2024-04-19T02:17:11.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:11.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:11.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270054+0000", 2024-04-19T02:17:11.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.27e-06 2024-04-19T02:17:11.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:11.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270061+0000", 2024-04-19T02:17:11.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1289999999999998e-06 2024-04-19T02:17:11.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:11.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270067+0000", 2024-04-19T02:17:11.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.207e-06 2024-04-19T02:17:11.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:11.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270105+0000", 2024-04-19T02:17:11.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7549999999999998e-05 2024-04-19T02:17:11.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:11.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270112+0000", 2024-04-19T02:17:11.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3200000000000002e-06 2024-04-19T02:17:11.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.117 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:11.117 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282454+0000", 2024-04-19T02:17:11.117 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012341569 2024-04-19T02:17:11.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.117 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:11.117 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282740+0000", 2024-04-19T02:17:11.117 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000286481 2024-04-19T02:17:11.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.117 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:11.117 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.282879+0000", 2024-04-19T02:17:11.117 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013887799999999999 2024-04-19T02:17:11.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:11.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290325+0000", 2024-04-19T02:17:11.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074459779999999998 2024-04-19T02:17:11.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:11.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290759+0000", 2024-04-19T02:17:11.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000433688 2024-04-19T02:17:11.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:11.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290789+0000", 2024-04-19T02:17:11.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9960000000000001e-05 2024-04-19T02:17:11.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:11.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290811+0000", 2024-04-19T02:17:11.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1965999999999999e-05 2024-04-19T02:17:11.119 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:11.119 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:11.119 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:11.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.119 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:11.119 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:17:11.119 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 101.817040069, 2024-04-19T02:17:11.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020837887999999999, 2024-04-19T02:17:11.119 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:11.120 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:11.120 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:11.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:11.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:17:11.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:11.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:11.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:17:11.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:11.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:11.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:17:11.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:11.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:11.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270109+0000", 2024-04-19T02:17:11.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3110000000000006e-06 2024-04-19T02:17:11.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:11.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270117+0000", 2024-04-19T02:17:11.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0479999999999999e-06 2024-04-19T02:17:11.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:11.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270123+0000", 2024-04-19T02:17:11.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5500000000000002e-06 2024-04-19T02:17:11.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:11.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270150+0000", 2024-04-19T02:17:11.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7712000000000002e-05 2024-04-19T02:17:11.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:11.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270153+0000", 2024-04-19T02:17:11.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6089999999999999e-06 2024-04-19T02:17:11.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.123 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:11.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285958+0000", 2024-04-19T02:17:11.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015805274000000001 2024-04-19T02:17:11.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.123 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:11.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286126+0000", 2024-04-19T02:17:11.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016765700000000001 2024-04-19T02:17:11.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.123 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:11.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286296+0000", 2024-04-19T02:17:11.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017007 2024-04-19T02:17:11.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:11.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290426+0000", 2024-04-19T02:17:11.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041299839999999997 2024-04-19T02:17:11.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:11.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290867+0000", 2024-04-19T02:17:11.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00044083300000000001 2024-04-19T02:17:11.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:11.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290900+0000", 2024-04-19T02:17:11.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3380000000000002e-05 2024-04-19T02:17:11.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:11.125 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290939+0000", 2024-04-19T02:17:11.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8970000000000001e-05 2024-04-19T02:17:11.125 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:11.125 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:11.125 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:11.125 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.125 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.125 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:21 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:11.125 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:17:11.125 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 101.816951397, 2024-04-19T02:17:11.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020833187999999999, 2024-04-19T02:17:11.125 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:11.125 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:11.125 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:11.125 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.126 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:11.126 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:17:11.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:11.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.126 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:11.126 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:17:11.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:11.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.126 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:11.126 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270189+0000", 2024-04-19T02:17:11.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:11.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:11.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270192+0000", 2024-04-19T02:17:11.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7549999999999999e-06 2024-04-19T02:17:11.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:11.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270198+0000", 2024-04-19T02:17:11.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0859999999999998e-06 2024-04-19T02:17:11.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:11.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270204+0000", 2024-04-19T02:17:11.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1970000000000004e-06 2024-04-19T02:17:11.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:11.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270238+0000", 2024-04-19T02:17:11.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4282000000000001e-05 2024-04-19T02:17:11.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:11.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270240+0000", 2024-04-19T02:17:11.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3099999999999999e-06 2024-04-19T02:17:11.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:11.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287131+0000", 2024-04-19T02:17:11.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01689104 2024-04-19T02:17:11.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.129 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:11.129 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287262+0000", 2024-04-19T02:17:11.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130347 2024-04-19T02:17:11.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.129 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:11.129 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291023+0000", 2024-04-19T02:17:11.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037616350000000002 2024-04-19T02:17:11.129 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:11.129 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:11.129 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:11.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.129 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:16519 5.f 5:fc30d3a1:::benchmark_data_smithi121_44835_object16518:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:17:11.130 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.880723+0000", 2024-04-19T02:17:11.130 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 71.206418619000004, 2024-04-19T02:17:11.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020492519000000001, 2024-04-19T02:17:11.130 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:11.130 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:11.130 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:11.130 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:11.130 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:11.130 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16519 2024-04-19T02:17:11.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.130 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:11.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.130 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:11.130 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880723+0000", 2024-04-19T02:17:11.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:11.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:11.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880723+0000", 2024-04-19T02:17:11.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:11.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:11.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880722+0000", 2024-04-19T02:17:11.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:11.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:11.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880794+0000", 2024-04-19T02:17:11.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1515999999999998e-05 2024-04-19T02:17:11.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.132 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:11.132 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880805+0000", 2024-04-19T02:17:11.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1353e-05 2024-04-19T02:17:11.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.132 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:11.132 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880812+0000", 2024-04-19T02:17:11.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1230000000000002e-06 2024-04-19T02:17:11.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.132 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:11.133 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.890954+0000", 2024-04-19T02:17:11.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010142253 2024-04-19T02:17:11.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.133 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:11.133 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891079+0000", 2024-04-19T02:17:11.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000124917 2024-04-19T02:17:11.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.133 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:11.133 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891218+0000", 2024-04-19T02:17:11.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000138715 2024-04-19T02:17:11.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.133 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:11.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.897321+0000", 2024-04-19T02:17:11.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0061026830000000002 2024-04-19T02:17:11.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:11.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901137+0000", 2024-04-19T02:17:11.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038161699999999998 2024-04-19T02:17:11.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:11.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901181+0000", 2024-04-19T02:17:11.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4362e-05 2024-04-19T02:17:11.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:11.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901215+0000", 2024-04-19T02:17:11.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3929e-05 2024-04-19T02:17:11.135 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:11.135 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:11.135 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:11.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.135 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:16520 5.f 5:f0474691:::benchmark_data_smithi121_44835_object16519:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-19T02:17:11.135 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:59.880833+0000", 2024-04-19T02:17:11.135 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 71.206308604, 2024-04-19T02:17:11.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020460160000000002, 2024-04-19T02:17:11.135 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:11.135 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:11.135 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:11.136 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:11.136 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:11.136 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16520 2024-04-19T02:17:11.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.136 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:11.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.136 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:11.136 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880833+0000", 2024-04-19T02:17:11.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:11.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.136 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:11.136 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880833+0000", 2024-04-19T02:17:11.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:11.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:11.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880832+0000", 2024-04-19T02:17:11.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:11.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:11.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880909+0000", 2024-04-19T02:17:11.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7095000000000006e-05 2024-04-19T02:17:11.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:11.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880919+0000", 2024-04-19T02:17:11.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8919999999999995e-06 2024-04-19T02:17:11.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.138 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:11.138 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.880927+0000", 2024-04-19T02:17:11.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8809999999999996e-06 2024-04-19T02:17:11.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.138 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:11.138 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.891901+0000", 2024-04-19T02:17:11.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010974263999999999 2024-04-19T02:17:11.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.138 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:11.138 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.892021+0000", 2024-04-19T02:17:11.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120074 2024-04-19T02:17:11.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:11.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.892165+0000", 2024-04-19T02:17:11.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014328600000000001 2024-04-19T02:17:11.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:11.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.897347+0000", 2024-04-19T02:17:11.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.005182603 2024-04-19T02:17:11.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:11.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901224+0000", 2024-04-19T02:17:11.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038767620000000002 2024-04-19T02:17:11.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:11.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901264+0000", 2024-04-19T02:17:11.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9579000000000002e-05 2024-04-19T02:17:11.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:11.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:59.901293+0000", 2024-04-19T02:17:11.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9300999999999999e-05 2024-04-19T02:17:11.140 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:11.140 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:11.140 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:11.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.140 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:44167 5.7 5:ef4300c4:::benchmark_data_smithi121_44835_object44166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-19T02:17:11.140 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:09.853830+0000", 2024-04-19T02:17:11.141 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 61.233311120000003, 2024-04-19T02:17:11.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020082104, 2024-04-19T02:17:11.141 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:11.141 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:11.141 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:11.141 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:11.141 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:11.141 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 44167 2024-04-19T02:17:11.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.141 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:11.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:11.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853830+0000", 2024-04-19T02:17:11.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:11.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.142 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:11.142 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853830+0000", 2024-04-19T02:17:11.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:11.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.142 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:11.142 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853829+0000", 2024-04-19T02:17:11.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:11.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.142 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:11.142 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853863+0000", 2024-04-19T02:17:11.143 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3151999999999997e-05 2024-04-19T02:17:11.143 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.143 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.143 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:11.143 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853873+0000", 2024-04-19T02:17:11.143 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0366e-05 2024-04-19T02:17:11.143 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.143 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.143 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:11.143 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.853881+0000", 2024-04-19T02:17:11.143 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6539999999999999e-06 2024-04-19T02:17:11.143 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.143 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.143 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:11.144 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.859162+0000", 2024-04-19T02:17:11.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052810740000000002 2024-04-19T02:17:11.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.144 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:11.144 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.859303+0000", 2024-04-19T02:17:11.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000140975 2024-04-19T02:17:11.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.144 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:11.144 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.859460+0000", 2024-04-19T02:17:11.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015754199999999999 2024-04-19T02:17:11.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.144 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:11.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.865142+0000", 2024-04-19T02:17:11.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0056819130000000002 2024-04-19T02:17:11.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:11.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.873828+0000", 2024-04-19T02:17:11.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0086861799999999999 2024-04-19T02:17:11.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:11.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.873871+0000", 2024-04-19T02:17:11.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2624999999999999e-05 2024-04-19T02:17:11.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:11.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:09.873912+0000", 2024-04-19T02:17:11.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1486000000000002e-05 2024-04-19T02:17:11.146 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:11.146 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:11.146 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:11.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.146 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:53042 5.f 5:f744ac14:::benchmark_data_smithi121_44835_object53041:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T02:17:11.146 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:13.560196+0000", 2024-04-19T02:17:11.146 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 57.526945300999998, 2024-04-19T02:17:11.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020122021, 2024-04-19T02:17:11.146 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:11.146 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:11.146 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:11.147 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:11.147 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:11.147 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 53042 2024-04-19T02:17:11.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.147 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:11.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.147 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:11.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560196+0000", 2024-04-19T02:17:11.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:11.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.147 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:11.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560196+0000", 2024-04-19T02:17:11.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:11.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:11.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560195+0000", 2024-04-19T02:17:11.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:11.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:11.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560255+0000", 2024-04-19T02:17:11.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9441000000000002e-05 2024-04-19T02:17:11.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:11.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560264+0000", 2024-04-19T02:17:11.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1130000000000007e-06 2024-04-19T02:17:11.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:11.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560271+0000", 2024-04-19T02:17:11.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9800000000000001e-06 2024-04-19T02:17:11.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:11.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560312+0000", 2024-04-19T02:17:11.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0828999999999998e-05 2024-04-19T02:17:11.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:11.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560456+0000", 2024-04-19T02:17:11.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014474799999999999 2024-04-19T02:17:11.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:11.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.560591+0000", 2024-04-19T02:17:11.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013482699999999999 2024-04-19T02:17:11.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:11.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.564799+0000", 2024-04-19T02:17:11.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042080080000000001 2024-04-19T02:17:11.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:11.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580233+0000", 2024-04-19T02:17:11.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015433715000000001 2024-04-19T02:17:11.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:11.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580280+0000", 2024-04-19T02:17:11.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6465000000000003e-05 2024-04-19T02:17:11.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:11.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:13.580318+0000", 2024-04-19T02:17:11.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8557999999999999e-05 2024-04-19T02:17:11.151 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:11.151 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:11.151 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:11.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.151 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:85866 5.2 5:48b1d46d:::benchmark_data_smithi121_44835_object85865:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T02:17:11.152 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:30.771909+0000", 2024-04-19T02:17:11.152 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.315232029000001, 2024-04-19T02:17:11.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020516216, 2024-04-19T02:17:11.152 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:11.152 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:11.152 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:11.152 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:11.152 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:11.152 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 85866 2024-04-19T02:17:11.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.152 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:11.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:11.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771909+0000", 2024-04-19T02:17:11.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:11.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:11.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771909+0000", 2024-04-19T02:17:11.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:11.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:11.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771909+0000", 2024-04-19T02:17:11.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:11.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:11.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771952+0000", 2024-04-19T02:17:11.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2660000000000002e-05 2024-04-19T02:17:11.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:11.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771959+0000", 2024-04-19T02:17:11.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7670000000000003e-06 2024-04-19T02:17:11.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:11.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771966+0000", 2024-04-19T02:17:11.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.905e-06 2024-04-19T02:17:11.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:11.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.771999+0000", 2024-04-19T02:17:11.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2360999999999997e-05 2024-04-19T02:17:11.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:11.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.772133+0000", 2024-04-19T02:17:11.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013398699999999999 2024-04-19T02:17:11.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:11.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.772280+0000", 2024-04-19T02:17:11.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000147198 2024-04-19T02:17:11.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:11.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.774312+0000", 2024-04-19T02:17:11.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020325339999999999 2024-04-19T02:17:11.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:11.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.792370+0000", 2024-04-19T02:17:11.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018057321000000001 2024-04-19T02:17:11.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:11.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.792403+0000", 2024-04-19T02:17:11.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3247000000000002e-05 2024-04-19T02:17:11.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:11.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:30.792426+0000", 2024-04-19T02:17:11.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2697999999999999e-05 2024-04-19T02:17:11.157 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:11.157 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:11.157 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:11.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.157 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:94468 5.2 5:4f406431:::benchmark_data_smithi121_44835_object94467:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T02:17:11.157 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:17:11.157 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 35.975712215000001, 2024-04-19T02:17:11.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024835144999999999, 2024-04-19T02:17:11.158 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:11.158 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:11.158 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:11.158 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:11.158 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:11.158 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 94468 2024-04-19T02:17:11.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.158 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:11.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:11.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:17:11.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:11.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:11.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:17:11.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:11.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:11.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:17:11.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:11.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:11.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111498+0000", 2024-04-19T02:17:11.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9529000000000005e-05 2024-04-19T02:17:11.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:11.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111506+0000", 2024-04-19T02:17:11.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9030000000000004e-06 2024-04-19T02:17:11.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:11.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111513+0000", 2024-04-19T02:17:11.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8759999999999999e-06 2024-04-19T02:17:11.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:11.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112466+0000", 2024-04-19T02:17:11.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00095318499999999995 2024-04-19T02:17:11.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:11.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112590+0000", 2024-04-19T02:17:11.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012380900000000001 2024-04-19T02:17:11.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:11.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112728+0000", 2024-04-19T02:17:11.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013753800000000001 2024-04-19T02:17:11.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:11.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115064+0000", 2024-04-19T02:17:11.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002336819 2024-04-19T02:17:11.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:11.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136207+0000", 2024-04-19T02:17:11.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021142942000000001 2024-04-19T02:17:11.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:11.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136241+0000", 2024-04-19T02:17:11.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3577000000000001e-05 2024-04-19T02:17:11.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:11.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136264+0000", 2024-04-19T02:17:11.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3421000000000002e-05 2024-04-19T02:17:11.163 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:11.163 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:11.163 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:11.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.163 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:94472 5.2 5:45b7e9be:::benchmark_data_smithi121_44835_object94471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:11.163 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:17:11.163 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 35.972065684, 2024-04-19T02:17:11.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021273843000000001, 2024-04-19T02:17:11.163 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:11.163 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:11.163 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:11.163 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:11.163 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:11.163 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 94472 2024-04-19T02:17:11.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.164 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:11.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.164 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:11.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:17:11.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:11.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.164 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:11.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:17:11.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:11.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.164 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:11.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115075+0000", 2024-04-19T02:17:11.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:11.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:11.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115161+0000", 2024-04-19T02:17:11.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6632000000000007e-05 2024-04-19T02:17:11.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:11.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115171+0000", 2024-04-19T02:17:11.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2969999999999992e-06 2024-04-19T02:17:11.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:11.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115178+0000", 2024-04-19T02:17:11.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7610000000000007e-06 2024-04-19T02:17:11.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:11.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115213+0000", 2024-04-19T02:17:11.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5000999999999999e-05 2024-04-19T02:17:11.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:11.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115303+0000", 2024-04-19T02:17:11.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9791999999999997e-05 2024-04-19T02:17:11.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:11.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115391+0000", 2024-04-19T02:17:11.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7559000000000007e-05 2024-04-19T02:17:11.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:11.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.117894+0000", 2024-04-19T02:17:11.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002503496 2024-04-19T02:17:11.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:11.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136297+0000", 2024-04-19T02:17:11.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018402335999999998 2024-04-19T02:17:11.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:11.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136327+0000", 2024-04-19T02:17:11.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0534999999999998e-05 2024-04-19T02:17:11.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:11.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136350+0000", 2024-04-19T02:17:11.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2427999999999999e-05 2024-04-19T02:17:11.168 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:11.168 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:11.168 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:11.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.169 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:96668 5.f 5:f48d3288:::benchmark_data_smithi121_44835_object96667:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-19T02:17:11.169 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:36.254669+0000", 2024-04-19T02:17:11.169 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.832472565000003, 2024-04-19T02:17:11.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019875075999999998, 2024-04-19T02:17:11.169 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:11.169 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:11.169 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:11.169 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:11.169 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:11.169 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 96668 2024-04-19T02:17:11.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.169 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:11.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:11.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254669+0000", 2024-04-19T02:17:11.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:11.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:11.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254669+0000", 2024-04-19T02:17:11.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:11.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:11.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254668+0000", 2024-04-19T02:17:11.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:11.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:11.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254738+0000", 2024-04-19T02:17:11.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9913000000000006e-05 2024-04-19T02:17:11.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:11.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254748+0000", 2024-04-19T02:17:11.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7429999999999997e-06 2024-04-19T02:17:11.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:11.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.254754+0000", 2024-04-19T02:17:11.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3840000000000002e-06 2024-04-19T02:17:11.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:11.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.256882+0000", 2024-04-19T02:17:11.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021282950000000001 2024-04-19T02:17:11.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:11.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.257007+0000", 2024-04-19T02:17:11.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012430699999999999 2024-04-19T02:17:11.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:11.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.257150+0000", 2024-04-19T02:17:11.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014291999999999999 2024-04-19T02:17:11.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:11.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.261375+0000", 2024-04-19T02:17:11.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042252100000000001 2024-04-19T02:17:11.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:11.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.274489+0000", 2024-04-19T02:17:11.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013113915 2024-04-19T02:17:11.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:11.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.274521+0000", 2024-04-19T02:17:11.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2691999999999998e-05 2024-04-19T02:17:11.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.174 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:11.174 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:36.274544+0000", 2024-04-19T02:17:11.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2408999999999998e-05 2024-04-19T02:17:11.174 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:11.174 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:11.174 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:11.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.174 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:129219 5.2 5:45e7e1f4:::benchmark_data_smithi121_44835_object129218:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T02:17:11.174 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:52.629592+0000", 2024-04-19T02:17:11.174 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.457549431, 2024-04-19T02:17:11.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021099489999999999, 2024-04-19T02:17:11.174 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:11.175 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:11.175 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:11.175 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:11.175 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:11.175 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129219 2024-04-19T02:17:11.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.175 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:11.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:11.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629592+0000", 2024-04-19T02:17:11.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:11.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:11.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629592+0000", 2024-04-19T02:17:11.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:11.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:11.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629591+0000", 2024-04-19T02:17:11.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:11.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:11.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629618+0000", 2024-04-19T02:17:11.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6970000000000001e-05 2024-04-19T02:17:11.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:11.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629639+0000", 2024-04-19T02:17:11.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0701999999999999e-05 2024-04-19T02:17:11.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:11.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629645+0000", 2024-04-19T02:17:11.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2299999999999996e-06 2024-04-19T02:17:11.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:11.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.635658+0000", 2024-04-19T02:17:11.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0060127549999999998 2024-04-19T02:17:11.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:11.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.635811+0000", 2024-04-19T02:17:11.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015305700000000001 2024-04-19T02:17:11.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:11.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.635967+0000", 2024-04-19T02:17:11.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015578599999999999 2024-04-19T02:17:11.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:11.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.642488+0000", 2024-04-19T02:17:11.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0065215619999999998 2024-04-19T02:17:11.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:11.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650603+0000", 2024-04-19T02:17:11.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0081144900000000002 2024-04-19T02:17:11.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:11.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650652+0000", 2024-04-19T02:17:11.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9079999999999998e-05 2024-04-19T02:17:11.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:11.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650691+0000", 2024-04-19T02:17:11.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9501e-05 2024-04-19T02:17:11.179 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:11.179 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:11.179 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:11.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.179 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:129220 5.2 5:44721865:::benchmark_data_smithi121_44835_object129219:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T02:17:11.180 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:52.630382+0000", 2024-04-19T02:17:11.180 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.456759028, 2024-04-19T02:17:11.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.02043969, 2024-04-19T02:17:11.180 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:11.180 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:11.180 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:11.180 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:11.180 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:11.180 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129220 2024-04-19T02:17:11.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.180 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:11.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:11.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.630382+0000", 2024-04-19T02:17:11.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:11.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:11.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.630382+0000", 2024-04-19T02:17:11.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:11.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:11.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.630382+0000", 2024-04-19T02:17:11.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:11.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:11.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.630451+0000", 2024-04-19T02:17:11.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9022000000000004e-05 2024-04-19T02:17:11.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:11.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.630460+0000", 2024-04-19T02:17:11.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7059999999999999e-06 2024-04-19T02:17:11.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:11.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.630466+0000", 2024-04-19T02:17:11.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4689999999999996e-06 2024-04-19T02:17:11.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:11.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.639381+0000", 2024-04-19T02:17:11.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0089152529999999997 2024-04-19T02:17:11.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:11.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.639492+0000", 2024-04-19T02:17:11.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011075500000000001 2024-04-19T02:17:11.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:11.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.639589+0000", 2024-04-19T02:17:11.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7157999999999994e-05 2024-04-19T02:17:11.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:11.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.646571+0000", 2024-04-19T02:17:11.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00698177 2024-04-19T02:17:11.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:11.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650743+0000", 2024-04-19T02:17:11.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041725909999999998 2024-04-19T02:17:11.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:11.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650785+0000", 2024-04-19T02:17:11.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2026e-05 2024-04-19T02:17:11.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:11.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650822+0000", 2024-04-19T02:17:11.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6689000000000001e-05 2024-04-19T02:17:11.185 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:11.185 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:11.185 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:11.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.186 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:130093 5.2 5:41dcb8a4:::benchmark_data_smithi121_44835_object130092:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T02:17:11.186 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:53.069964+0000", 2024-04-19T02:17:11.186 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.017177431, 2024-04-19T02:17:11.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020424088, 2024-04-19T02:17:11.186 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:11.186 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:11.186 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:11.186 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:11.186 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:11.186 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 130093 2024-04-19T02:17:11.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.186 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:11.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:11.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.069964+0000", 2024-04-19T02:17:11.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:11.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:11.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.069964+0000", 2024-04-19T02:17:11.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:11.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:11.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.069963+0000", 2024-04-19T02:17:11.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:11.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:11.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.070064+0000", 2024-04-19T02:17:11.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100709 2024-04-19T02:17:11.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:11.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.070072+0000", 2024-04-19T02:17:11.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8339999999999999e-06 2024-04-19T02:17:11.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:11.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.070077+0000", 2024-04-19T02:17:11.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2399999999999998e-06 2024-04-19T02:17:11.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:11.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.071370+0000", 2024-04-19T02:17:11.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012926470000000001 2024-04-19T02:17:11.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:11.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.071497+0000", 2024-04-19T02:17:11.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000127701 2024-04-19T02:17:11.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:11.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.071662+0000", 2024-04-19T02:17:11.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016424300000000001 2024-04-19T02:17:11.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:11.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.077150+0000", 2024-04-19T02:17:11.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.005488031 2024-04-19T02:17:11.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:11.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.090305+0000", 2024-04-19T02:17:11.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013155622 2024-04-19T02:17:11.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:11.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.090352+0000", 2024-04-19T02:17:11.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6798999999999997e-05 2024-04-19T02:17:11.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:11.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:53.090388+0000", 2024-04-19T02:17:11.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5837999999999998e-05 2024-04-19T02:17:11.191 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:11.191 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:11.191 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:11.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.191 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:157448 5.7 5:ed833a19:::benchmark_data_smithi121_44835_object23413:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:11.191 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:06.870566+0000", 2024-04-19T02:17:11.191 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.2165748499999998, 2024-04-19T02:17:11.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023031238999999998, 2024-04-19T02:17:11.191 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:11.191 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:11.191 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:11.192 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:11.192 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:11.192 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 157448 2024-04-19T02:17:11.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.192 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:11.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:11.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870566+0000", 2024-04-19T02:17:11.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:11.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:11.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870566+0000", 2024-04-19T02:17:11.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:11.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:11.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870566+0000", 2024-04-19T02:17:11.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:11.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:11.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870570+0000", 2024-04-19T02:17:11.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1620000000000001e-06 2024-04-19T02:17:11.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:11.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870577+0000", 2024-04-19T02:17:11.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2069999999999998e-06 2024-04-19T02:17:11.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:11.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870587+0000", 2024-04-19T02:17:11.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6919999999999997e-06 2024-04-19T02:17:11.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:11.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870615+0000", 2024-04-19T02:17:11.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8351999999999999e-05 2024-04-19T02:17:11.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:11.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870715+0000", 2024-04-19T02:17:11.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9624999999999996e-05 2024-04-19T02:17:11.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:11.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870805+0000", 2024-04-19T02:17:11.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0067000000000004e-05 2024-04-19T02:17:11.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:11.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.872773+0000", 2024-04-19T02:17:11.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001968605 2024-04-19T02:17:11.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:11.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.893514+0000", 2024-04-19T02:17:11.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020740082999999999 2024-04-19T02:17:11.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:11.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.893558+0000", 2024-04-19T02:17:11.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4110999999999998e-05 2024-04-19T02:17:11.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:11.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.893598+0000", 2024-04-19T02:17:11.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0077000000000003e-05 2024-04-19T02:17:11.196 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:11.196 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:11.196 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:11.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.196 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:157498 5.7 5:eb39b43d:::benchmark_data_smithi121_44835_object23463:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:11.196 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:06.911721+0000", 2024-04-19T02:17:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.175420205, 2024-04-19T02:17:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023313438999999998, 2024-04-19T02:17:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 157498 2024-04-19T02:17:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911721+0000", 2024-04-19T02:17:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:11.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911721+0000", 2024-04-19T02:17:11.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:11.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:11.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911720+0000", 2024-04-19T02:17:11.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:11.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:11.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911726+0000", 2024-04-19T02:17:11.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3179999999999997e-06 2024-04-19T02:17:11.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:11.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911746+0000", 2024-04-19T02:17:11.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0574e-05 2024-04-19T02:17:11.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:11.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911757+0000", 2024-04-19T02:17:11.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0959e-05 2024-04-19T02:17:11.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:11.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911795+0000", 2024-04-19T02:17:11.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7589999999999998e-05 2024-04-19T02:17:11.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:11.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911912+0000", 2024-04-19T02:17:11.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117625 2024-04-19T02:17:11.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:11.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.912250+0000", 2024-04-19T02:17:11.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00033710599999999999 2024-04-19T02:17:11.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:11.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.915540+0000", 2024-04-19T02:17:11.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032909559999999998 2024-04-19T02:17:11.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:11.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.934984+0000", 2024-04-19T02:17:11.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019443670999999999 2024-04-19T02:17:11.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:11.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.935013+0000", 2024-04-19T02:17:11.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8464999999999999e-05 2024-04-19T02:17:11.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:11.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:11.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:11.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.935035+0000", 2024-04-19T02:17:11.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1954e-05 2024-04-19T02:17:11.201 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:11.201 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:11.202 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:11.202 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:11.202 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:11.202 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:11.203 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:17:11.204 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:11.204+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:11.255 INFO:teuthology.orchestra.run.smithi121.stderr:noscrub is unset 2024-04-19T02:17:11.305 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:11.307+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:11.375 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:17:11.376 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:17:11.376 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.376 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:166378 5.0 5:0aa6c91a:::benchmark_data_smithi121_44835_object32343:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:11.376 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:11.374120+0000", 2024-04-19T02:17:11.376 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0021683879999999998, 2024-04-19T02:17:11.376 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0021970190000000001, 2024-04-19T02:17:11.376 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:11.376 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:11.376 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:11.376 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:11.376 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:11.376 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 166378 2024-04-19T02:17:11.376 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.376 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:11.377 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.377 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:11.377 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:11.374120+0000", 2024-04-19T02:17:11.377 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:11.377 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.377 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.377 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:11.377 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:11.374120+0000", 2024-04-19T02:17:11.377 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:11.377 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.377 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.377 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:11.377 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:11.374119+0000", 2024-04-19T02:17:11.377 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:11.377 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.378 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.378 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:11.378 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:11.374124+0000", 2024-04-19T02:17:11.378 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.6199999999999998e-06 2024-04-19T02:17:11.378 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.378 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.378 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:11.378 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:11.374136+0000", 2024-04-19T02:17:11.378 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2102e-05 2024-04-19T02:17:11.378 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.378 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.378 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:11.378 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:11.374144+0000", 2024-04-19T02:17:11.378 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.3559999999999993e-06 2024-04-19T02:17:11.379 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.379 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.379 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:11.379 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:11.374194+0000", 2024-04-19T02:17:11.379 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.9768999999999997e-05 2024-04-19T02:17:11.379 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.379 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.379 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:11.379 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:11.374310+0000", 2024-04-19T02:17:11.379 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000116193 2024-04-19T02:17:11.379 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.379 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:11.379 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.379 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.380 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.380 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:166379 5.f e52/16 5:fc6b6fc6:::benchmark_data_smithi121_44835_object32344:head v 52'10484, mlcod=52'10482)", 2024-04-19T02:17:11.380 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:11.375767+0000", 2024-04-19T02:17:11.380 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.00052146500000000004, 2024-04-19T02:17:11.380 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00062334499999999998, 2024-04-19T02:17:11.380 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:11.380 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:11.380 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:11.380 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.380 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:11.380 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:11.375767+0000", 2024-04-19T02:17:11.380 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:11.380 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.380 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.380 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:11.381 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:11.375767+0000", 2024-04-19T02:17:11.381 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:11.381 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.381 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.381 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:11.381 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:11.375766+0000", 2024-04-19T02:17:11.381 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:11.381 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.381 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.381 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:11.381 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:11.375773+0000", 2024-04-19T02:17:11.381 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.9840000000000004e-06 2024-04-19T02:17:11.381 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.381 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.381 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:11.382 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:11.375783+0000", 2024-04-19T02:17:11.382 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.6420000000000002e-06 2024-04-19T02:17:11.382 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.382 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.382 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:11.382 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:11.375789+0000", 2024-04-19T02:17:11.382 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.2559999999999999e-06 2024-04-19T02:17:11.382 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.382 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.382 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:11.382 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:11.375834+0000", 2024-04-19T02:17:11.382 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4433e-05 2024-04-19T02:17:11.382 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.382 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.383 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:11.383 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:11.375855+0000", 2024-04-19T02:17:11.383 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.128e-05 2024-04-19T02:17:11.383 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.383 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:11.383 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.383 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.383 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.383 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:166382 5.d e52/16 5:b1f12f78:::benchmark_data_smithi121_44835_object32347:head v 52'10376, mlcod=52'10374)", 2024-04-19T02:17:11.383 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:11.375803+0000", 2024-04-19T02:17:11.383 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.00048530300000000003, 2024-04-19T02:17:11.383 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000645478, 2024-04-19T02:17:11.383 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:11.383 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:11.383 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:11.384 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.384 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:11.384 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:11.375803+0000", 2024-04-19T02:17:11.384 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:11.384 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.384 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.384 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:11.384 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:11.375803+0000", 2024-04-19T02:17:11.384 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:11.384 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.385 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.385 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:11.385 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:11.375803+0000", 2024-04-19T02:17:11.385 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:11.385 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.385 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.385 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:11.385 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:11.375807+0000", 2024-04-19T02:17:11.386 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6859999999999999e-06 2024-04-19T02:17:11.386 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.386 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.386 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:11.386 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:11.375813+0000", 2024-04-19T02:17:11.386 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.3029999999999996e-06 2024-04-19T02:17:11.386 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.386 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.386 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:11.386 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:11.375818+0000", 2024-04-19T02:17:11.386 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8659999999999997e-06 2024-04-19T02:17:11.386 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.386 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.386 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:11.386 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:11.375856+0000", 2024-04-19T02:17:11.387 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7873000000000001e-05 2024-04-19T02:17:11.387 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.387 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.387 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:11.387 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:11.375875+0000", 2024-04-19T02:17:11.387 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.9695e-05 2024-04-19T02:17:11.387 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.387 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:11.387 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.387 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.387 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.387 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:166383 5.9 e52/16 5:99146e24:::benchmark_data_smithi121_44835_object32348:head v 52'10572, mlcod=52'10569)", 2024-04-19T02:17:11.387 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:11.375825+0000", 2024-04-19T02:17:11.387 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.00046375399999999998, 2024-04-19T02:17:11.387 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000681209, 2024-04-19T02:17:11.388 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:11.388 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:11.388 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:11.388 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.388 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:11.388 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:11.375825+0000", 2024-04-19T02:17:11.388 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:11.388 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.388 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.388 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:11.388 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:11.375825+0000", 2024-04-19T02:17:11.388 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:11.388 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.388 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.388 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:11.388 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:11.375825+0000", 2024-04-19T02:17:11.389 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967296 2024-04-19T02:17:11.389 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.389 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.389 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:11.389 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:11.375831+0000", 2024-04-19T02:17:11.389 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.9190000000000004e-06 2024-04-19T02:17:11.389 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.389 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.389 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:11.389 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:11.375836+0000", 2024-04-19T02:17:11.389 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2499999999999997e-06 2024-04-19T02:17:11.389 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.389 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.389 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:11.390 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:11.375840+0000", 2024-04-19T02:17:11.390 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4959999999999998e-06 2024-04-19T02:17:11.390 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.390 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.390 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:11.390 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:11.375868+0000", 2024-04-19T02:17:11.390 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7806000000000001e-05 2024-04-19T02:17:11.390 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.390 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.390 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:11.390 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:11.375883+0000", 2024-04-19T02:17:11.390 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.4859e-05 2024-04-19T02:17:11.390 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.390 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:11.390 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.391 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.391 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.391 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:166375 5.b 5:d64aa54c:::benchmark_data_smithi121_44835_object32340:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:11.391 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:11.373303+0000", 2024-04-19T02:17:11.391 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0029855889999999999, 2024-04-19T02:17:11.391 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.003264037, 2024-04-19T02:17:11.391 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:11.391 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:11.391 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:11.391 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:11.391 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:11.391 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 166375 2024-04-19T02:17:11.391 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.391 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:11.392 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.392 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:11.392 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:11.373303+0000", 2024-04-19T02:17:11.392 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:11.392 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.392 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.392 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:11.392 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:11.373303+0000", 2024-04-19T02:17:11.392 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:11.392 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.392 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.392 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:11.392 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:11.373302+0000", 2024-04-19T02:17:11.392 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:11.392 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.392 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.393 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:11.393 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:11.373307+0000", 2024-04-19T02:17:11.393 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0989999999999998e-06 2024-04-19T02:17:11.393 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.393 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.393 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:11.393 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:11.373318+0000", 2024-04-19T02:17:11.393 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0781000000000001e-05 2024-04-19T02:17:11.393 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.393 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.393 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:11.393 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:11.373324+0000", 2024-04-19T02:17:11.393 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.066e-06 2024-04-19T02:17:11.393 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.393 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.393 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:11.394 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:11.373355+0000", 2024-04-19T02:17:11.394 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0446e-05 2024-04-19T02:17:11.394 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.394 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.394 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:11.394 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:11.373471+0000", 2024-04-19T02:17:11.394 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000116895 2024-04-19T02:17:11.394 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.394 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:11.394 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.394 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.394 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.394 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:166376 5.4 5:29ad513e:::benchmark_data_smithi121_44835_object32341:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:11.395 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:11.373333+0000", 2024-04-19T02:17:11.395 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0029552070000000001, 2024-04-19T02:17:11.395 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0032982089999999999, 2024-04-19T02:17:11.395 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:11.395 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:11.395 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:11.395 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:11.395 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:11.395 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 166376 2024-04-19T02:17:11.395 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.395 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:11.395 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.395 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:11.395 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:11.373333+0000", 2024-04-19T02:17:11.395 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:11.396 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.396 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.396 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:11.396 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:11.373333+0000", 2024-04-19T02:17:11.396 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:11.396 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.396 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.396 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:11.396 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:11.373333+0000", 2024-04-19T02:17:11.396 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:11.396 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.396 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.396 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:11.396 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:11.373335+0000", 2024-04-19T02:17:11.396 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1519999999999999e-06 2024-04-19T02:17:11.397 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.397 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.397 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:11.397 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:11.373340+0000", 2024-04-19T02:17:11.397 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8219999999999997e-06 2024-04-19T02:17:11.397 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.397 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.397 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:11.397 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:11.373343+0000", 2024-04-19T02:17:11.397 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2200000000000001e-06 2024-04-19T02:17:11.397 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.397 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.397 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:11.397 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:11.373378+0000", 2024-04-19T02:17:11.397 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5182999999999998e-05 2024-04-19T02:17:11.397 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.398 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.398 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:11.398 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:11.373486+0000", 2024-04-19T02:17:11.398 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000107957 2024-04-19T02:17:11.398 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.398 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:11.398 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.398 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.398 INFO:teuthology.orchestra.run.smithi174.stdout: ], 2024-04-19T02:17:11.398 INFO:teuthology.orchestra.run.smithi174.stdout: "num_ops": 6 2024-04-19T02:17:11.398 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:17:11.399 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:17:11.405 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:11.406+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:11.505 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:11.506+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:11.558 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T02:17:11.606 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:11.607+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:11.613 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:17:11.613 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [], 2024-04-19T02:17:11.613 INFO:teuthology.orchestra.run.smithi174.stdout: "complaint_time": 30, 2024-04-19T02:17:11.613 INFO:teuthology.orchestra.run.smithi174.stdout: "num_blocked_ops": 0 2024-04-19T02:17:11.613 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:17:11.627 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:17:11.668 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off 2024-04-19T02:17:11.707 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:11.708+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:11.769 INFO:teuthology.orchestra.console.smithi177:Power off completed 2024-04-19T02:17:11.808 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:11.809+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:11.813 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:17:11.813 INFO:teuthology.orchestra.run.smithi174.stdout: "size": 20, 2024-04-19T02:17:11.814 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 600, 2024-04-19T02:17:11.814 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:17:11.814 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.814 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:19 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:11.814 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:17:11.814 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 102.54172650300001, 2024-04-19T02:17:11.814 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020818203, 2024-04-19T02:17:11.814 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:11.814 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:11.815 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:11.815 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.815 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:11.815 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:17:11.815 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:11.815 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.816 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.816 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:11.816 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:17:11.816 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:11.816 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.816 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.816 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:11.816 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:17:11.816 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:11.816 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.817 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.817 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:11.817 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270065+0000", 2024-04-19T02:17:11.817 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4310000000000001e-06 2024-04-19T02:17:11.817 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.817 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.817 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:11.817 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270070+0000", 2024-04-19T02:17:11.817 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2859999999999999e-06 2024-04-19T02:17:11.817 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.817 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.817 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:11.817 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270077+0000", 2024-04-19T02:17:11.817 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5270000000000004e-06 2024-04-19T02:17:11.817 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.818 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.818 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:11.818 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270107+0000", 2024-04-19T02:17:11.818 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0205999999999998e-05 2024-04-19T02:17:11.818 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.818 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.818 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:11.818 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270111+0000", 2024-04-19T02:17:11.818 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8650000000000003e-06 2024-04-19T02:17:11.818 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.818 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.818 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:11.818 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285936+0000", 2024-04-19T02:17:11.818 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015824677999999998 2024-04-19T02:17:11.819 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.819 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.819 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:11.819 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286007+0000", 2024-04-19T02:17:11.819 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1157999999999999e-05 2024-04-19T02:17:11.819 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.819 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.819 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:11.819 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286086+0000", 2024-04-19T02:17:11.819 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9084000000000004e-05 2024-04-19T02:17:11.819 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.819 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.820 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:11.820 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290740+0000", 2024-04-19T02:17:11.820 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0046543679999999999 2024-04-19T02:17:11.820 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.820 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.820 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:11.820 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290833+0000", 2024-04-19T02:17:11.820 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2551000000000002e-05 2024-04-19T02:17:11.820 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.820 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.820 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:11.821 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290859+0000", 2024-04-19T02:17:11.821 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.6696999999999999e-05 2024-04-19T02:17:11.821 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.821 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.821 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:11.821 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290881+0000", 2024-04-19T02:17:11.821 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1653000000000001e-05 2024-04-19T02:17:11.821 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.821 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:11.821 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.821 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.821 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.821 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:77622 5.8 5:166fbe77:::benchmark_data_smithi121_44835_object77621:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:11.821 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:17:11.822 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 45.006229566000002, 2024-04-19T02:17:11.822 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.021784694, 2024-04-19T02:17:11.822 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:11.822 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:11.822 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:11.822 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:11.822 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:11.822 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 77622 2024-04-19T02:17:11.822 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.822 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:11.822 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.822 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:11.822 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:17:11.823 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:11.823 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.823 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.823 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:11.823 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:17:11.823 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:11.823 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.823 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.823 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:11.823 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805559+0000", 2024-04-19T02:17:11.823 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:11.823 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.824 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.824 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:11.824 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805659+0000", 2024-04-19T02:17:11.824 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.9908000000000006e-05 2024-04-19T02:17:11.824 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.824 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.824 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:11.825 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805668+0000", 2024-04-19T02:17:11.825 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2129999999999997e-06 2024-04-19T02:17:11.825 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.825 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.825 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:11.825 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805673+0000", 2024-04-19T02:17:11.825 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0370000000000002e-06 2024-04-19T02:17:11.825 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.825 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.825 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:11.825 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812022+0000", 2024-04-19T02:17:11.825 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0063483239999999998 2024-04-19T02:17:11.825 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.825 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.825 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:11.826 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812129+0000", 2024-04-19T02:17:11.826 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010744200000000001 2024-04-19T02:17:11.826 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.826 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.826 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:11.826 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812252+0000", 2024-04-19T02:17:11.826 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000122519 2024-04-19T02:17:11.826 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.826 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.826 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:11.826 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.820979+0000", 2024-04-19T02:17:11.826 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0087272740000000001 2024-04-19T02:17:11.826 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.826 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.827 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:11.827 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827270+0000", 2024-04-19T02:17:11.827 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0062906239999999999 2024-04-19T02:17:11.827 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.827 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.827 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:11.827 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827309+0000", 2024-04-19T02:17:11.827 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9678999999999997e-05 2024-04-19T02:17:11.827 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.827 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.828 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:11.828 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827345+0000", 2024-04-19T02:17:11.828 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5308000000000001e-05 2024-04-19T02:17:11.828 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.828 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:11.828 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.828 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.828 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.828 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78224 5.4 5:26e797d5:::benchmark_data_smithi121_44835_object78223:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:11.828 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:17:11.828 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 44.705227366999999, 2024-04-19T02:17:11.828 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.021471998999999999, 2024-04-19T02:17:11.828 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:11.829 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:11.829 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:11.829 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:11.829 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:11.829 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78224 2024-04-19T02:17:11.829 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.829 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:11.829 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.829 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:11.829 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:17:11.829 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:11.829 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.830 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.830 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:11.830 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:17:11.830 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:11.830 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.830 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.830 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:11.830 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106561+0000", 2024-04-19T02:17:11.830 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:11.830 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.830 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.830 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:11.830 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106630+0000", 2024-04-19T02:17:11.831 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.8553999999999994e-05 2024-04-19T02:17:11.831 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.831 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.831 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:11.831 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106644+0000", 2024-04-19T02:17:11.831 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.4651000000000001e-05 2024-04-19T02:17:11.831 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.831 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.831 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:11.831 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106653+0000", 2024-04-19T02:17:11.831 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.6719999999999993e-06 2024-04-19T02:17:11.831 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.831 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.831 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:11.832 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106693+0000", 2024-04-19T02:17:11.832 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9978999999999998e-05 2024-04-19T02:17:11.832 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.832 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.832 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:11.832 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106840+0000", 2024-04-19T02:17:11.832 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0001473 2024-04-19T02:17:11.832 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.832 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.832 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:11.832 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106971+0000", 2024-04-19T02:17:11.832 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013051499999999999 2024-04-19T02:17:11.832 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.832 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.832 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:11.833 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.109047+0000", 2024-04-19T02:17:11.833 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.002076002 2024-04-19T02:17:11.833 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.833 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.833 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:11.833 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.127967+0000", 2024-04-19T02:17:11.833 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.018919780000000001 2024-04-19T02:17:11.833 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.833 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.833 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:11.833 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128004+0000", 2024-04-19T02:17:11.833 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7719000000000003e-05 2024-04-19T02:17:11.833 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.834 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.834 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:11.834 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128034+0000", 2024-04-19T02:17:11.834 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9651000000000001e-05 2024-04-19T02:17:11.834 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.834 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:11.834 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.834 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.834 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.834 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78259 5.4 5:2aa344b2:::benchmark_data_smithi121_44835_object78258:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:11.834 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:17:11.834 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 44.686532298000003, 2024-04-19T02:17:11.834 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022934350999999999, 2024-04-19T02:17:11.835 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:11.835 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:11.835 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:11.835 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:11.835 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:11.835 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78259 2024-04-19T02:17:11.835 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.835 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:11.835 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.835 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:11.835 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:17:11.835 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:11.836 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.836 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.836 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:11.836 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:17:11.836 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:11.836 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.836 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.836 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:11.836 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125256+0000", 2024-04-19T02:17:11.836 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:11.836 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.836 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.836 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:11.836 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125347+0000", 2024-04-19T02:17:11.836 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0470000000000006e-05 2024-04-19T02:17:11.837 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.837 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.837 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:11.837 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125358+0000", 2024-04-19T02:17:11.837 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1764e-05 2024-04-19T02:17:11.837 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.837 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.837 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:11.837 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125364+0000", 2024-04-19T02:17:11.837 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7189999999999998e-06 2024-04-19T02:17:11.837 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.837 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.837 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:11.837 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125391+0000", 2024-04-19T02:17:11.837 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7270000000000001e-05 2024-04-19T02:17:11.837 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.838 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.838 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:11.838 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125471+0000", 2024-04-19T02:17:11.838 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9209999999999995e-05 2024-04-19T02:17:11.838 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.838 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.838 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:11.838 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125559+0000", 2024-04-19T02:17:11.838 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.8689000000000004e-05 2024-04-19T02:17:11.838 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.838 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.838 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:11.838 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128164+0000", 2024-04-19T02:17:11.839 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0026050270000000002 2024-04-19T02:17:11.839 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.839 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.839 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:11.839 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148139+0000", 2024-04-19T02:17:11.839 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.019975050000000001 2024-04-19T02:17:11.839 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.839 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.839 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:11.839 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148169+0000", 2024-04-19T02:17:11.839 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0001e-05 2024-04-19T02:17:11.839 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.839 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.839 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:11.839 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148191+0000", 2024-04-19T02:17:11.840 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.2104999999999999e-05 2024-04-19T02:17:11.840 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.840 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:11.840 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.840 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.840 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.840 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78271 5.4 5:2982d7a6:::benchmark_data_smithi121_44835_object78270:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:11.840 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:17:11.840 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 44.679669068000003, 2024-04-19T02:17:11.840 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020841755999999999, 2024-04-19T02:17:11.840 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:11.840 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:11.840 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:11.840 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:11.840 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:11.840 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78271 2024-04-19T02:17:11.841 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.841 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:11.841 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.841 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:11.841 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:17:11.841 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:11.841 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.841 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.841 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:11.841 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:17:11.841 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:11.841 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.841 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.841 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:11.841 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132119+0000", 2024-04-19T02:17:11.841 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:11.841 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.842 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.842 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:11.842 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132185+0000", 2024-04-19T02:17:11.842 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5994000000000005e-05 2024-04-19T02:17:11.842 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.842 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.842 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:11.842 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132197+0000", 2024-04-19T02:17:11.842 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2091e-05 2024-04-19T02:17:11.842 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.842 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.842 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:11.842 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132206+0000", 2024-04-19T02:17:11.842 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.5099999999999998e-06 2024-04-19T02:17:11.843 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.843 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.843 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:11.843 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132242+0000", 2024-04-19T02:17:11.843 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5663000000000001e-05 2024-04-19T02:17:11.843 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.843 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.843 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:11.843 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132335+0000", 2024-04-19T02:17:11.843 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3275000000000004e-05 2024-04-19T02:17:11.843 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.843 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.843 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:11.843 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132432+0000", 2024-04-19T02:17:11.844 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7571000000000005e-05 2024-04-19T02:17:11.844 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.844 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.844 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:11.844 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.136706+0000", 2024-04-19T02:17:11.844 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0042738170000000001 2024-04-19T02:17:11.844 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.844 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.844 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:11.844 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152909+0000", 2024-04-19T02:17:11.844 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016202415000000001 2024-04-19T02:17:11.844 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.844 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.844 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:11.844 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152938+0000", 2024-04-19T02:17:11.845 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9740999999999999e-05 2024-04-19T02:17:11.845 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.845 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.845 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:11.845 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152962+0000", 2024-04-19T02:17:11.845 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3659000000000002e-05 2024-04-19T02:17:11.845 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.845 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:11.845 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.845 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.845 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.845 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78272 5.4 5:273e819a:::benchmark_data_smithi121_44835_object78271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:11.845 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:11.845 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 44.679180025000001, 2024-04-19T02:17:11.845 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022180163999999999, 2024-04-19T02:17:11.846 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:11.846 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:11.846 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:11.846 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:11.846 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:11.846 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78272 2024-04-19T02:17:11.846 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.846 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:11.846 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.846 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:11.846 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:11.846 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:11.846 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.846 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.847 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:11.847 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:11.847 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:11.847 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.847 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.847 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:11.847 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:11.847 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:11.847 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.847 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.847 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:11.847 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132690+0000", 2024-04-19T02:17:11.847 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0963000000000004e-05 2024-04-19T02:17:11.847 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.847 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.847 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:11.848 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132703+0000", 2024-04-19T02:17:11.848 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.3072e-05 2024-04-19T02:17:11.848 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.848 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.848 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:11.848 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132710+0000", 2024-04-19T02:17:11.848 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3100000000000003e-06 2024-04-19T02:17:11.848 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.848 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.848 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:11.848 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134005+0000", 2024-04-19T02:17:11.848 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001294513 2024-04-19T02:17:11.848 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.848 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.848 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:11.849 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134139+0000", 2024-04-19T02:17:11.849 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000134447 2024-04-19T02:17:11.849 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.849 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.849 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:11.849 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134284+0000", 2024-04-19T02:17:11.849 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014514399999999999 2024-04-19T02:17:11.849 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.849 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.849 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:11.849 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.139622+0000", 2024-04-19T02:17:11.849 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0053373830000000002 2024-04-19T02:17:11.849 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.849 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.850 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:11.850 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154737+0000", 2024-04-19T02:17:11.850 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015115195999999999 2024-04-19T02:17:11.850 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.850 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.850 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:11.850 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154768+0000", 2024-04-19T02:17:11.850 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0824999999999997e-05 2024-04-19T02:17:11.850 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.850 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.850 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:11.850 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154790+0000", 2024-04-19T02:17:11.850 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1999000000000001e-05 2024-04-19T02:17:11.850 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.851 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:11.851 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.851 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.851 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.851 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:94481 5.e 5:7b2fbebf:::benchmark_data_smithi121_44835_object94480:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:11.851 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:17:11.851 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 36.690543708, 2024-04-19T02:17:11.851 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020897846000000001, 2024-04-19T02:17:11.851 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:11.851 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:11.851 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:11.851 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:11.851 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:11.851 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 94481 2024-04-19T02:17:11.851 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.851 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:11.852 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.852 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:11.852 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:17:11.852 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:11.852 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.852 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.852 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:11.852 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:17:11.852 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:11.852 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.852 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.852 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:11.852 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121245+0000", 2024-04-19T02:17:11.852 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:11.852 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.853 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.853 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:11.853 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121273+0000", 2024-04-19T02:17:11.853 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7250000000000002e-05 2024-04-19T02:17:11.853 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.853 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.853 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:11.853 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121277+0000", 2024-04-19T02:17:11.853 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2860000000000001e-06 2024-04-19T02:17:11.853 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.853 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.853 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:11.853 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121280+0000", 2024-04-19T02:17:11.853 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2739999999999999e-06 2024-04-19T02:17:11.853 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.854 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.854 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:11.854 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121320+0000", 2024-04-19T02:17:11.854 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9879000000000002e-05 2024-04-19T02:17:11.854 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.854 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.854 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:11.854 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121448+0000", 2024-04-19T02:17:11.854 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012748800000000001 2024-04-19T02:17:11.854 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.854 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.854 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:11.854 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121595+0000", 2024-04-19T02:17:11.855 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014741299999999999 2024-04-19T02:17:11.855 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.855 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.855 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:11.855 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.127776+0000", 2024-04-19T02:17:11.855 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0061811360000000003 2024-04-19T02:17:11.855 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.855 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.855 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:11.855 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142073+0000", 2024-04-19T02:17:11.855 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014296959999999999 2024-04-19T02:17:11.855 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.855 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.856 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:11.856 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142106+0000", 2024-04-19T02:17:11.856 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3348e-05 2024-04-19T02:17:11.856 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.856 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.856 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:11.856 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142144+0000", 2024-04-19T02:17:11.856 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7153000000000002e-05 2024-04-19T02:17:11.856 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.857 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:11.857 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.857 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.857 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.857 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:94581 5.b 5:dc86d6e9:::benchmark_data_smithi121_44835_object94580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:11.857 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:11.857 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 36.631609134999998, 2024-04-19T02:17:11.857 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022099711000000001, 2024-04-19T02:17:11.857 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:11.857 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:11.857 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:11.857 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:11.857 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:11.857 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 94581 2024-04-19T02:17:11.858 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.858 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:11.858 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.858 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:11.858 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:11.858 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:11.858 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.858 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.858 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:11.858 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:11.858 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:11.859 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.859 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.859 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:11.859 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:11.859 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:11.859 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.859 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.859 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:11.859 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180253+0000", 2024-04-19T02:17:11.859 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3163000000000004e-05 2024-04-19T02:17:11.859 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.859 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.859 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:11.859 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180266+0000", 2024-04-19T02:17:11.859 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2886e-05 2024-04-19T02:17:11.860 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.860 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.860 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:11.860 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180273+0000", 2024-04-19T02:17:11.860 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.4059999999999999e-06 2024-04-19T02:17:11.860 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.860 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.860 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:11.860 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180646+0000", 2024-04-19T02:17:11.860 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00037283999999999999 2024-04-19T02:17:11.860 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.860 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.860 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:11.860 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180774+0000", 2024-04-19T02:17:11.861 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012793799999999999 2024-04-19T02:17:11.861 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.861 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.861 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:11.861 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180920+0000", 2024-04-19T02:17:11.861 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000146692 2024-04-19T02:17:11.861 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.861 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.861 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:11.861 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.183344+0000", 2024-04-19T02:17:11.861 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0024231669999999999 2024-04-19T02:17:11.861 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.861 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.861 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:11.862 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202196+0000", 2024-04-19T02:17:11.862 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.018852384 2024-04-19T02:17:11.862 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.862 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.862 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:11.862 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202241+0000", 2024-04-19T02:17:11.862 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4923999999999999e-05 2024-04-19T02:17:11.862 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.862 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.862 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:11.862 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202280+0000", 2024-04-19T02:17:11.863 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9096e-05 2024-04-19T02:17:11.863 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.863 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:11.863 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.863 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.863 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.863 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:96356 5.0 5:0a661b39:::benchmark_data_smithi121_44835_object96355:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:11.863 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:17:11.864 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 35.718396292999998, 2024-04-19T02:17:11.864 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020955516, 2024-04-19T02:17:11.864 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:11.864 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:11.864 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:11.864 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:11.864 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:11.864 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 96356 2024-04-19T02:17:11.865 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.865 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:11.865 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.865 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:11.865 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:17:11.865 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:11.865 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.865 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.866 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:11.866 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:17:11.866 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:11.866 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.866 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.866 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:11.866 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:17:11.867 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:11.867 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.867 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.867 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:11.867 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093455+0000", 2024-04-19T02:17:11.867 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.2205000000000005e-05 2024-04-19T02:17:11.867 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.868 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.868 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:11.868 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093464+0000", 2024-04-19T02:17:11.868 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3910000000000004e-06 2024-04-19T02:17:11.868 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.868 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.868 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:11.869 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093469+0000", 2024-04-19T02:17:11.869 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.7249999999999997e-06 2024-04-19T02:17:11.869 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.869 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.869 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:11.869 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099643+0000", 2024-04-19T02:17:11.869 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0061743359999999999 2024-04-19T02:17:11.869 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.870 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.870 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:11.870 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099774+0000", 2024-04-19T02:17:11.870 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013050599999999999 2024-04-19T02:17:11.870 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.870 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.871 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:11.871 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099917+0000", 2024-04-19T02:17:11.871 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000143187 2024-04-19T02:17:11.871 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.871 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.871 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:11.871 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.105432+0000", 2024-04-19T02:17:11.871 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.005514873 2024-04-19T02:17:11.871 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.872 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.872 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:11.872 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114264+0000", 2024-04-19T02:17:11.872 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.008831752 2024-04-19T02:17:11.872 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.872 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.872 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:11.873 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114300+0000", 2024-04-19T02:17:11.873 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6582000000000003e-05 2024-04-19T02:17:11.873 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.873 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.873 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:11.873 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114349+0000", 2024-04-19T02:17:11.873 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8579999999999999e-05 2024-04-19T02:17:11.874 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.874 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:11.874 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.874 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.874 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.874 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:96357 5.0 5:00efce8b:::benchmark_data_smithi121_44835_object96356:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:11.874 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:17:11.875 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 35.718316614999999, 2024-04-19T02:17:11.875 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020937471999999999, 2024-04-19T02:17:11.875 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:11.875 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:11.875 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:11.875 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:11.875 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:11.875 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 96357 2024-04-19T02:17:11.875 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.875 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:11.876 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.876 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:11.876 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:17:11.876 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:11.876 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.876 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.876 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:11.876 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:17:11.876 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:11.876 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.876 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.876 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:11.876 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093472+0000", 2024-04-19T02:17:11.876 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:11.876 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.877 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.877 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:11.877 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093513+0000", 2024-04-19T02:17:11.877 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0213000000000003e-05 2024-04-19T02:17:11.877 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.877 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.877 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:11.877 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093519+0000", 2024-04-19T02:17:11.877 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.066e-06 2024-04-19T02:17:11.877 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.877 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.877 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:11.877 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093525+0000", 2024-04-19T02:17:11.877 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.8170000000000004e-06 2024-04-19T02:17:11.877 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.878 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.878 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:11.878 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103412+0000", 2024-04-19T02:17:11.878 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0098872739999999997 2024-04-19T02:17:11.878 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.878 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.878 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:11.878 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103551+0000", 2024-04-19T02:17:11.878 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000139295 2024-04-19T02:17:11.878 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.878 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.878 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:11.878 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103701+0000", 2024-04-19T02:17:11.878 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014954599999999999 2024-04-19T02:17:11.879 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.879 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.879 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:11.879 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.108849+0000", 2024-04-19T02:17:11.879 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0051487199999999999 2024-04-19T02:17:11.879 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.879 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.879 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:11.879 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114355+0000", 2024-04-19T02:17:11.879 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0055052529999999999 2024-04-19T02:17:11.879 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.879 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.879 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:11.879 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114379+0000", 2024-04-19T02:17:11.879 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4275000000000001e-05 2024-04-19T02:17:11.880 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.880 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.880 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:11.880 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114410+0000", 2024-04-19T02:17:11.880 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1356999999999998e-05 2024-04-19T02:17:11.880 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.880 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:11.880 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.880 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.880 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.880 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:104431 5.8 5:14818e19:::benchmark_data_smithi121_44835_object104430:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T02:17:11.880 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:17:11.880 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 31.600404090000001, 2024-04-19T02:17:11.880 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022149528000000002, 2024-04-19T02:17:11.880 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:11.881 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:11.881 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:11.881 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:11.881 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:11.881 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 104431 2024-04-19T02:17:11.881 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.881 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:11.881 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.881 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:11.881 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:17:11.881 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:11.881 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.881 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.881 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:11.881 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:17:11.882 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:11.882 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.882 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.882 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:11.882 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211384+0000", 2024-04-19T02:17:11.882 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:11.882 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.882 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.882 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:11.882 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211458+0000", 2024-04-19T02:17:11.882 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3311000000000003e-05 2024-04-19T02:17:11.882 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.882 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.882 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:11.883 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211471+0000", 2024-04-19T02:17:11.883 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.3308e-05 2024-04-19T02:17:11.883 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.883 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.883 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:11.883 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211479+0000", 2024-04-19T02:17:11.883 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0909999999999993e-06 2024-04-19T02:17:11.883 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.883 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.883 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:11.883 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.221821+0000", 2024-04-19T02:17:11.883 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010341596999999999 2024-04-19T02:17:11.883 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.883 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.883 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:11.884 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.221966+0000", 2024-04-19T02:17:11.884 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000145167 2024-04-19T02:17:11.884 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.884 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.884 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:11.884 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.222077+0000", 2024-04-19T02:17:11.884 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011128000000000001 2024-04-19T02:17:11.884 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.884 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.884 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:11.885 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.228126+0000", 2024-04-19T02:17:11.885 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0060486710000000003 2024-04-19T02:17:11.885 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.885 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.885 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:11.885 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233449+0000", 2024-04-19T02:17:11.885 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0053231370000000004 2024-04-19T02:17:11.886 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.886 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.886 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:11.886 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233498+0000", 2024-04-19T02:17:11.886 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8798999999999998e-05 2024-04-19T02:17:11.886 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.886 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.886 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:11.886 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233535+0000", 2024-04-19T02:17:11.886 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7119000000000002e-05 2024-04-19T02:17:11.887 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.887 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:11.887 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.887 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.887 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.887 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157437 5.e 5:78833a3d:::benchmark_data_smithi121_44835_object23402:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:11.887 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.859854+0000", 2024-04-19T02:17:11.887 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 4.9519353180000003, 2024-04-19T02:17:11.887 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.025859589999999998, 2024-04-19T02:17:11.887 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:11.887 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:11.888 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:11.888 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:11.888 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:11.888 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157437 2024-04-19T02:17:11.888 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.888 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:11.888 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.889 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:11.889 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859854+0000", 2024-04-19T02:17:11.889 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:11.889 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.889 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.889 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:11.889 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859854+0000", 2024-04-19T02:17:11.889 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:11.889 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.889 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.890 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:11.890 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859853+0000", 2024-04-19T02:17:11.890 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:11.890 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.890 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.890 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:11.890 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859857+0000", 2024-04-19T02:17:11.890 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8789999999999996e-06 2024-04-19T02:17:11.890 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.890 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.890 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:11.890 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859865+0000", 2024-04-19T02:17:11.891 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.1880000000000002e-06 2024-04-19T02:17:11.891 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.891 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.891 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:11.891 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859873+0000", 2024-04-19T02:17:11.891 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.2980000000000003e-06 2024-04-19T02:17:11.891 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.891 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.891 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:11.891 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859908+0000", 2024-04-19T02:17:11.891 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5682999999999997e-05 2024-04-19T02:17:11.891 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.891 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.891 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:11.892 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.860046+0000", 2024-04-19T02:17:11.892 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013714200000000001 2024-04-19T02:17:11.892 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.892 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.892 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:11.892 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.860153+0000", 2024-04-19T02:17:11.892 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010725700000000001 2024-04-19T02:17:11.892 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.892 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.892 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:11.892 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.862008+0000", 2024-04-19T02:17:11.892 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001855179 2024-04-19T02:17:11.892 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.892 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.893 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:11.893 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.885629+0000", 2024-04-19T02:17:11.893 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.023621428 2024-04-19T02:17:11.893 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.893 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.893 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:11.893 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.885676+0000", 2024-04-19T02:17:11.893 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.6371e-05 2024-04-19T02:17:11.893 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.893 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.893 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:11.893 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.885714+0000", 2024-04-19T02:17:11.893 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7907000000000001e-05 2024-04-19T02:17:11.893 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.894 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:11.894 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.894 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.894 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.894 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157438 5.0 5:01944e77:::benchmark_data_smithi121_44835_object23403:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:11.894 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.864095+0000", 2024-04-19T02:17:11.894 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 4.9476940339999995, 2024-04-19T02:17:11.894 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.032015298999999997, 2024-04-19T02:17:11.894 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:11.894 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:11.894 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:11.895 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:11.895 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:11.895 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157438 2024-04-19T02:17:11.895 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.895 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:11.895 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.895 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:11.895 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864095+0000", 2024-04-19T02:17:11.895 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:11.895 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.895 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.895 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:11.895 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864095+0000", 2024-04-19T02:17:11.896 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:11.896 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.896 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.896 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:11.896 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864094+0000", 2024-04-19T02:17:11.896 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:11.896 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.896 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.896 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:11.896 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864102+0000", 2024-04-19T02:17:11.896 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.6629999999999993e-06 2024-04-19T02:17:11.897 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.897 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.897 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:11.897 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864113+0000", 2024-04-19T02:17:11.897 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1185999999999999e-05 2024-04-19T02:17:11.897 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.897 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.897 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:11.897 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864119+0000", 2024-04-19T02:17:11.897 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.224e-06 2024-04-19T02:17:11.897 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.897 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.897 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:11.897 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864151+0000", 2024-04-19T02:17:11.898 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1395e-05 2024-04-19T02:17:11.898 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.898 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.898 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:11.898 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864275+0000", 2024-04-19T02:17:11.898 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012431399999999999 2024-04-19T02:17:11.898 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.898 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.898 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:11.898 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864341+0000", 2024-04-19T02:17:11.899 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6146e-05 2024-04-19T02:17:11.899 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.899 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.899 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:11.899 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.866040+0000", 2024-04-19T02:17:11.899 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016991879999999999 2024-04-19T02:17:11.899 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.899 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.899 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:11.900 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896055+0000", 2024-04-19T02:17:11.900 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.030014886000000001 2024-04-19T02:17:11.900 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.900 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.900 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:11.900 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896087+0000", 2024-04-19T02:17:11.900 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1761000000000003e-05 2024-04-19T02:17:11.900 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.900 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.900 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:11.900 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896111+0000", 2024-04-19T02:17:11.900 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3623999999999999e-05 2024-04-19T02:17:11.900 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.900 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:11.901 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.901 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.901 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.901 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157439 5.e 5:79eb9d3c:::benchmark_data_smithi121_44835_object23404:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:11.901 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:11.901 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 4.9476629589999996, 2024-04-19T02:17:11.901 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.027045244, 2024-04-19T02:17:11.901 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:11.901 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:11.901 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:11.901 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:11.901 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:11.901 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157439 2024-04-19T02:17:11.901 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.901 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:11.901 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.902 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:11.902 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:11.902 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:11.902 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.902 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.902 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:11.902 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:11.902 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:11.902 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.902 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.902 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:11.902 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:11.902 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:11.903 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.903 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.903 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:11.903 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864128+0000", 2024-04-19T02:17:11.903 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.911e-06 2024-04-19T02:17:11.903 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.904 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.904 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:11.904 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864136+0000", 2024-04-19T02:17:11.904 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2609999999999993e-06 2024-04-19T02:17:11.904 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.904 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.905 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:11.905 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864140+0000", 2024-04-19T02:17:11.905 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5530000000000001e-06 2024-04-19T02:17:11.905 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.905 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.905 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:11.905 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864169+0000", 2024-04-19T02:17:11.905 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.8932e-05 2024-04-19T02:17:11.905 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.906 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.906 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:11.906 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864267+0000", 2024-04-19T02:17:11.906 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7969999999999999e-05 2024-04-19T02:17:11.906 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.906 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.906 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:11.906 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864339+0000", 2024-04-19T02:17:11.906 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.2280999999999995e-05 2024-04-19T02:17:11.906 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.906 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.906 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:11.907 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.865763+0000", 2024-04-19T02:17:11.907 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0014236310000000001 2024-04-19T02:17:11.907 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.907 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.907 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:11.907 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.891093+0000", 2024-04-19T02:17:11.907 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.025330571 2024-04-19T02:17:11.907 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.907 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.907 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:11.907 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.891137+0000", 2024-04-19T02:17:11.907 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3980999999999998e-05 2024-04-19T02:17:11.907 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.907 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.908 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:11.908 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.891172+0000", 2024-04-19T02:17:11.908 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4465000000000003e-05 2024-04-19T02:17:11.908 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.908 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:11.908 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.908 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.908 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.908 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157442 5.0 5:0062b73f:::benchmark_data_smithi121_44835_object23407:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:11.908 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.867065+0000", 2024-04-19T02:17:11.908 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 4.9447243089999997, 2024-04-19T02:17:11.909 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.029165542999999999, 2024-04-19T02:17:11.909 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:11.909 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:11.909 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:11.909 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:11.909 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:11.909 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157442 2024-04-19T02:17:11.909 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.909 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:11.909 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.909 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:11.909 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867065+0000", 2024-04-19T02:17:11.909 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:11.910 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.910 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.910 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:11.910 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867065+0000", 2024-04-19T02:17:11.910 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:11.910 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.910 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.910 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:11.911 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867064+0000", 2024-04-19T02:17:11.911 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:11.911 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.911 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.911 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:11.911 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867069+0000", 2024-04-19T02:17:11.911 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4549999999999997e-06 2024-04-19T02:17:11.911 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.911 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.911 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:11.911 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867080+0000", 2024-04-19T02:17:11.911 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0797e-05 2024-04-19T02:17:11.911 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.911 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.911 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:11.912 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867088+0000", 2024-04-19T02:17:11.912 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9729999999999997e-06 2024-04-19T02:17:11.912 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.912 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.912 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:11.912 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867121+0000", 2024-04-19T02:17:11.912 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2920000000000003e-05 2024-04-19T02:17:11.912 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.912 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.912 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:11.912 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867203+0000", 2024-04-19T02:17:11.912 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2578999999999997e-05 2024-04-19T02:17:11.912 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.912 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.912 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:11.912 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867386+0000", 2024-04-19T02:17:11.913 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00018237400000000001 2024-04-19T02:17:11.913 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.913 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.913 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:11.913 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.869338+0000", 2024-04-19T02:17:11.913 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0019521160000000001 2024-04-19T02:17:11.913 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.913 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.913 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:11.913 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896150+0000", 2024-04-19T02:17:11.913 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.026812074000000002 2024-04-19T02:17:11.913 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.913 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.913 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:11.913 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896191+0000", 2024-04-19T02:17:11.914 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1192000000000001e-05 2024-04-19T02:17:11.914 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.914 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.914 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:11.914 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896231+0000", 2024-04-19T02:17:11.914 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9764000000000001e-05 2024-04-19T02:17:11.914 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.914 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:11.914 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.914 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.914 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.914 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157499 5.8 5:1c3aa38a:::benchmark_data_smithi121_44835_object23464:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:11.914 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.913447+0000", 2024-04-19T02:17:11.914 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 4.8983427370000001, 2024-04-19T02:17:11.915 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.024508188, 2024-04-19T02:17:11.915 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:11.915 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:11.915 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:11.915 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:11.915 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:11.915 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157499 2024-04-19T02:17:11.915 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.915 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:11.915 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.915 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:11.915 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913447+0000", 2024-04-19T02:17:11.915 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:11.915 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.918 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.918 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:11.918 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913447+0000", 2024-04-19T02:17:11.918 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:11.918 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.918 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.918 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:11.919 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913446+0000", 2024-04-19T02:17:11.919 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:11.919 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.919 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.919 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:11.919 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913451+0000", 2024-04-19T02:17:11.919 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.677e-06 2024-04-19T02:17:11.919 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.919 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.919 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:11.919 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913461+0000", 2024-04-19T02:17:11.919 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.8859999999999999e-06 2024-04-19T02:17:11.919 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.919 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.919 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:11.919 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913467+0000", 2024-04-19T02:17:11.920 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.0800000000000002e-06 2024-04-19T02:17:11.920 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.920 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.920 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:11.920 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913513+0000", 2024-04-19T02:17:11.920 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.5707000000000001e-05 2024-04-19T02:17:11.920 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.920 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.920 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:11.920 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913637+0000", 2024-04-19T02:17:11.921 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012379200000000001 2024-04-19T02:17:11.921 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.921 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.921 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:11.921 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913747+0000", 2024-04-19T02:17:11.921 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000110071 2024-04-19T02:17:11.921 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.921 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.921 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:11.921 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915674+0000", 2024-04-19T02:17:11.921 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0019270789999999999 2024-04-19T02:17:11.922 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.922 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.922 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:11.922 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937902+0000", 2024-04-19T02:17:11.922 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022228286 2024-04-19T02:17:11.922 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.922 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.922 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:11.922 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937931+0000", 2024-04-19T02:17:11.922 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9122e-05 2024-04-19T02:17:11.922 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.922 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.922 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:11.922 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937955+0000", 2024-04-19T02:17:11.922 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3591000000000002e-05 2024-04-19T02:17:11.923 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.923 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:11.923 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.923 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.923 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.923 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157500 5.0 5:0969ec74:::benchmark_data_smithi121_44835_object23465:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:11.923 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.913476+0000", 2024-04-19T02:17:11.923 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 4.898313871, 2024-04-19T02:17:11.923 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.024497596, 2024-04-19T02:17:11.923 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:11.923 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:11.923 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:11.923 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:11.923 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:11.923 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157500 2024-04-19T02:17:11.924 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.924 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:11.924 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.924 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:11.924 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913476+0000", 2024-04-19T02:17:11.924 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:11.924 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.924 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.924 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:11.924 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913476+0000", 2024-04-19T02:17:11.924 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:11.924 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.924 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.924 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:11.924 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913475+0000", 2024-04-19T02:17:11.925 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:11.925 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.925 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.925 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:11.925 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913478+0000", 2024-04-19T02:17:11.925 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.2670000000000001e-06 2024-04-19T02:17:11.925 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.925 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.925 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:11.925 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913481+0000", 2024-04-19T02:17:11.925 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6899999999999998e-06 2024-04-19T02:17:11.925 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.925 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.925 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:11.926 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913485+0000", 2024-04-19T02:17:11.926 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1230000000000002e-06 2024-04-19T02:17:11.926 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.926 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.926 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:11.926 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913526+0000", 2024-04-19T02:17:11.926 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.104e-05 2024-04-19T02:17:11.926 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.926 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.926 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:11.926 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913606+0000", 2024-04-19T02:17:11.926 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9510000000000003e-05 2024-04-19T02:17:11.926 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.926 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.926 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:11.927 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913671+0000", 2024-04-19T02:17:11.927 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.4838000000000005e-05 2024-04-19T02:17:11.927 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.927 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.927 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:11.927 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915348+0000", 2024-04-19T02:17:11.927 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016769860000000001 2024-04-19T02:17:11.927 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.927 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.927 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:11.927 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937897+0000", 2024-04-19T02:17:11.927 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022548902999999999 2024-04-19T02:17:11.927 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.927 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.927 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:11.928 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937938+0000", 2024-04-19T02:17:11.928 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1499999999999999e-05 2024-04-19T02:17:11.928 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.928 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.928 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:11.928 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937973+0000", 2024-04-19T02:17:11.928 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5057e-05 2024-04-19T02:17:11.928 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.928 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:11.928 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.928 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.928 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.928 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157501 5.4 5:26661819:::benchmark_data_smithi121_44835_object23466:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:11.928 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.914839+0000", 2024-04-19T02:17:11.928 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 4.8969505770000001, 2024-04-19T02:17:11.929 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.028504224000000002, 2024-04-19T02:17:11.929 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:11.929 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:11.929 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:11.929 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:11.929 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:11.929 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157501 2024-04-19T02:17:11.929 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.929 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:11.929 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.929 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:11.929 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914839+0000", 2024-04-19T02:17:11.929 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:11.929 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.929 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.930 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:11.930 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914839+0000", 2024-04-19T02:17:11.930 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:11.930 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.930 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.930 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:11.930 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914838+0000", 2024-04-19T02:17:11.930 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:11.930 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.930 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.930 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:11.930 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914841+0000", 2024-04-19T02:17:11.930 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.706e-06 2024-04-19T02:17:11.930 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.931 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.931 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:11.931 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914848+0000", 2024-04-19T02:17:11.931 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.7429999999999996e-06 2024-04-19T02:17:11.931 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.931 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.931 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:11.931 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914852+0000", 2024-04-19T02:17:11.931 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0810000000000004e-06 2024-04-19T02:17:11.931 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.931 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.931 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:11.931 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914892+0000", 2024-04-19T02:17:11.931 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9957999999999999e-05 2024-04-19T02:17:11.931 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.932 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.932 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:11.932 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915008+0000", 2024-04-19T02:17:11.932 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000116401 2024-04-19T02:17:11.932 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.932 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.932 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:11.932 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915125+0000", 2024-04-19T02:17:11.932 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011622500000000001 2024-04-19T02:17:11.932 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.932 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.932 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:11.932 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916663+0000", 2024-04-19T02:17:11.932 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0015381310000000001 2024-04-19T02:17:11.932 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.933 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.933 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:11.933 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943114+0000", 2024-04-19T02:17:11.933 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.026451125999999998 2024-04-19T02:17:11.933 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.933 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.933 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:11.933 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943245+0000", 2024-04-19T02:17:11.933 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000131645 2024-04-19T02:17:11.933 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.933 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.933 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:11.933 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943343+0000", 2024-04-19T02:17:11.933 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7604999999999998e-05 2024-04-19T02:17:11.933 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.934 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:11.934 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.934 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.934 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.934 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157507 5.b 5:de8840a2:::benchmark_data_smithi121_44835_object23472:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:11.934 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:11.934 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 4.8953862959999999, 2024-04-19T02:17:11.934 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022544518999999999, 2024-04-19T02:17:11.934 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:11.934 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:11.934 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:11.934 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:11.934 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:11.934 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157507 2024-04-19T02:17:11.934 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.934 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:11.935 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.935 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:11.935 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:11.935 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:11.935 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.935 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.935 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:11.935 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:11.935 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:11.935 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.935 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.935 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:11.935 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:11.935 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:11.935 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.936 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.936 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:11.936 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916406+0000", 2024-04-19T02:17:11.936 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4589999999999998e-06 2024-04-19T02:17:11.936 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.936 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.936 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:11.936 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916415+0000", 2024-04-19T02:17:11.936 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3910000000000004e-06 2024-04-19T02:17:11.936 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.936 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.936 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:11.936 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916421+0000", 2024-04-19T02:17:11.936 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.6130000000000003e-06 2024-04-19T02:17:11.936 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.936 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.937 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:11.937 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916448+0000", 2024-04-19T02:17:11.937 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7277999999999999e-05 2024-04-19T02:17:11.937 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.937 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.937 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:11.937 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916539+0000", 2024-04-19T02:17:11.937 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0855999999999999e-05 2024-04-19T02:17:11.937 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.937 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.937 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:11.937 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916605+0000", 2024-04-19T02:17:11.937 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6141000000000003e-05 2024-04-19T02:17:11.937 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.937 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.938 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:11.938 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918276+0000", 2024-04-19T02:17:11.938 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001670726 2024-04-19T02:17:11.938 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.938 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.938 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:11.938 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.938888+0000", 2024-04-19T02:17:11.938 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020612042000000001 2024-04-19T02:17:11.938 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.938 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.938 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:11.938 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.938924+0000", 2024-04-19T02:17:11.938 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5692999999999999e-05 2024-04-19T02:17:11.938 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.938 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.939 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:11.939 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.938948+0000", 2024-04-19T02:17:11.939 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3879e-05 2024-04-19T02:17:11.939 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.939 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:11.939 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.939 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.939 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.939 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157509 5.8 5:1dca85d0:::benchmark_data_smithi121_44835_object23474:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:11.939 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:11.939 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 4.8929580499999998, 2024-04-19T02:17:11.939 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.024511807, 2024-04-19T02:17:11.939 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:11.939 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:11.939 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:11.940 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:11.940 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:11.940 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157509 2024-04-19T02:17:11.940 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.940 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:11.940 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.940 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:11.940 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:11.940 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:11.940 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.940 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.940 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:11.940 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:11.940 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:11.940 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.941 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.941 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:11.941 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:11.941 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:11.941 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.941 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.941 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:11.941 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918834+0000", 2024-04-19T02:17:11.941 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9409999999999999e-06 2024-04-19T02:17:11.941 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.941 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.941 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:11.941 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918859+0000", 2024-04-19T02:17:11.941 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.5245999999999999e-05 2024-04-19T02:17:11.941 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.942 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.942 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:11.942 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918864+0000", 2024-04-19T02:17:11.942 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.1819999999999997e-06 2024-04-19T02:17:11.942 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.942 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.942 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:11.942 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918900+0000", 2024-04-19T02:17:11.942 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5327000000000002e-05 2024-04-19T02:17:11.942 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.942 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.942 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:11.942 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.919024+0000", 2024-04-19T02:17:11.942 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012400900000000001 2024-04-19T02:17:11.942 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.943 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.943 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:11.943 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.919136+0000", 2024-04-19T02:17:11.943 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000111987 2024-04-19T02:17:11.943 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.943 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.943 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:11.943 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.922096+0000", 2024-04-19T02:17:11.943 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0029607079999999998 2024-04-19T02:17:11.943 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.943 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.943 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:11.943 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943120+0000", 2024-04-19T02:17:11.943 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.021023995 2024-04-19T02:17:11.944 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.944 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.944 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:11.944 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943255+0000", 2024-04-19T02:17:11.944 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013502100000000001 2024-04-19T02:17:11.944 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:11.944 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:11.944 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:11.944 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943343+0000", 2024-04-19T02:17:11.944 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.7931999999999998e-05 2024-04-19T02:17:11.944 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.944 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:11.944 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.944 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:11.944 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:11.945 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:17:11.946 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:11.947+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:11.946 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:12.047 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:12.048+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:12.097 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:17:12.104 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:12.105 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:17:12.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.105 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168377 5.d 5:b1f3fb6d:::benchmark_data_smithi121_44835_object34342:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:12.105 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069470+0000", 2024-04-19T02:17:12.105 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.035793143999999999, 2024-04-19T02:17:12.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035819402, 2024-04-19T02:17:12.105 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:12.105 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:12.105 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:12.105 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:12.105 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:12.105 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168377 2024-04-19T02:17:12.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.105 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:12.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:12.106 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069470+0000", 2024-04-19T02:17:12.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:12.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.106 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:12.106 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069470+0000", 2024-04-19T02:17:12.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:12.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.106 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:12.106 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069469+0000", 2024-04-19T02:17:12.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:12.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.106 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:12.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069473+0000", 2024-04-19T02:17:12.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4580000000000002e-06 2024-04-19T02:17:12.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:12.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069482+0000", 2024-04-19T02:17:12.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2839999999999995e-06 2024-04-19T02:17:12.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:12.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069489+0000", 2024-04-19T02:17:12.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3579999999999997e-06 2024-04-19T02:17:12.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:12.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069559+0000", 2024-04-19T02:17:12.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9678000000000006e-05 2024-04-19T02:17:12.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:12.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069683+0000", 2024-04-19T02:17:12.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012359400000000001 2024-04-19T02:17:12.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:12.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069759+0000", 2024-04-19T02:17:12.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6834000000000003e-05 2024-04-19T02:17:12.108 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:12.108 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:12.108 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:12.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.109 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168379 5.d 5:bcd492dd:::benchmark_data_smithi121_44835_object34344:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:12.109 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069502+0000", 2024-04-19T02:17:12.109 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.035761091000000002, 2024-04-19T02:17:12.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035836452999999997, 2024-04-19T02:17:12.109 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:12.109 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:12.109 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:12.109 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:12.109 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:12.109 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168379 2024-04-19T02:17:12.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.109 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:12.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:12.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069502+0000", 2024-04-19T02:17:12.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:12.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.110 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:12.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069502+0000", 2024-04-19T02:17:12.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:12.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.110 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:12.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069501+0000", 2024-04-19T02:17:12.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:12.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.110 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:12.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069504+0000", 2024-04-19T02:17:12.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9289999999999998e-06 2024-04-19T02:17:12.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:12.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069511+0000", 2024-04-19T02:17:12.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1909999999999997e-06 2024-04-19T02:17:12.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:12.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069517+0000", 2024-04-19T02:17:12.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0789999999999997e-06 2024-04-19T02:17:12.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:12.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071081+0000", 2024-04-19T02:17:12.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0015646550000000001 2024-04-19T02:17:12.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:12.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071195+0000", 2024-04-19T02:17:12.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011399400000000001 2024-04-19T02:17:12.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:12.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071293+0000", 2024-04-19T02:17:12.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7938999999999999e-05 2024-04-19T02:17:12.112 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:12.112 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:12.112 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:12.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.113 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168381 5.d 5:bcbab0e3:::benchmark_data_smithi121_44835_object34346:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:12.113 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:12.113 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.035741673000000002, 2024-04-19T02:17:12.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035858581, 2024-04-19T02:17:12.113 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:12.113 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:12.113 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:12.113 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:12.113 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:12.113 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168381 2024-04-19T02:17:12.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.113 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:12.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:12.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:12.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:12.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.114 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:12.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:12.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:12.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.114 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:12.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:12.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:12.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:12.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069523+0000", 2024-04-19T02:17:12.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.244e-06 2024-04-19T02:17:12.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:12.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069528+0000", 2024-04-19T02:17:12.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0669999999999999e-06 2024-04-19T02:17:12.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:12.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069533+0000", 2024-04-19T02:17:12.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4680000000000003e-06 2024-04-19T02:17:12.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:12.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072637+0000", 2024-04-19T02:17:12.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031040429999999999 2024-04-19T02:17:12.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:12.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072710+0000", 2024-04-19T02:17:12.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3045000000000003e-05 2024-04-19T02:17:12.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:12.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072775+0000", 2024-04-19T02:17:12.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5034000000000001e-05 2024-04-19T02:17:12.116 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:12.116 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:12.116 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:12.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.117 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168382 5.f 5:f2599a15:::benchmark_data_smithi121_44835_object34347:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:12.117 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069556+0000", 2024-04-19T02:17:12.117 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.035707266000000001, 2024-04-19T02:17:12.117 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035864192000000003, 2024-04-19T02:17:12.117 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:12.117 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:12.117 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:12.117 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:12.117 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:12.117 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168382 2024-04-19T02:17:12.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.117 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:12.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:12.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069556+0000", 2024-04-19T02:17:12.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:12.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:12.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069556+0000", 2024-04-19T02:17:12.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:12.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:12.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069555+0000", 2024-04-19T02:17:12.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:12.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:12.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069558+0000", 2024-04-19T02:17:12.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7879999999999998e-06 2024-04-19T02:17:12.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:12.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069566+0000", 2024-04-19T02:17:12.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6149999999999999e-06 2024-04-19T02:17:12.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:12.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069571+0000", 2024-04-19T02:17:12.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5509999999999999e-06 2024-04-19T02:17:12.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:12.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069618+0000", 2024-04-19T02:17:12.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6964e-05 2024-04-19T02:17:12.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:12.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069744+0000", 2024-04-19T02:17:12.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012577199999999999 2024-04-19T02:17:12.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:12.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.070116+0000", 2024-04-19T02:17:12.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000372407 2024-04-19T02:17:12.120 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:12.120 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:12.121 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:12.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.121 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168383 5.d 5:bbd9496c:::benchmark_data_smithi121_44835_object34348:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:12.121 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069581+0000", 2024-04-19T02:17:12.121 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.035682378000000001, 2024-04-19T02:17:12.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035882643999999998, 2024-04-19T02:17:12.121 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:12.121 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:12.121 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:12.121 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:12.121 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:12.121 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168383 2024-04-19T02:17:12.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.121 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:12.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:12.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069581+0000", 2024-04-19T02:17:12.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:12.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:12.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069581+0000", 2024-04-19T02:17:12.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:12.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:12.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069580+0000", 2024-04-19T02:17:12.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:12.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.123 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:12.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069589+0000", 2024-04-19T02:17:12.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6750000000000008e-06 2024-04-19T02:17:12.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.123 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:12.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069596+0000", 2024-04-19T02:17:12.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7360000000000004e-06 2024-04-19T02:17:12.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.125 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.125 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:12.125 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069601+0000", 2024-04-19T02:17:12.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0479999999999998e-06 2024-04-19T02:17:12.125 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.125 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.125 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:12.125 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.073854+0000", 2024-04-19T02:17:12.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042531920000000003 2024-04-19T02:17:12.125 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.125 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.125 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:12.126 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.073952+0000", 2024-04-19T02:17:12.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7851999999999998e-05 2024-04-19T02:17:12.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.126 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:12.126 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074012+0000", 2024-04-19T02:17:12.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0225e-05 2024-04-19T02:17:12.126 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:12.126 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:12.126 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:12.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.126 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168384 5.7 5:ed638f84:::benchmark_data_smithi121_44835_object34349:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:12.126 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069612+0000", 2024-04-19T02:17:12.127 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.035651324999999998, 2024-04-19T02:17:12.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035892081999999999, 2024-04-19T02:17:12.127 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:12.127 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:12.127 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:12.127 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:12.127 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:12.127 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168384 2024-04-19T02:17:12.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.127 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:12.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:12.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069612+0000", 2024-04-19T02:17:12.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:12.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:12.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069612+0000", 2024-04-19T02:17:12.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:12.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:12.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069611+0000", 2024-04-19T02:17:12.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:12.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:12.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069614+0000", 2024-04-19T02:17:12.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7819999999999998e-06 2024-04-19T02:17:12.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.129 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:12.129 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069623+0000", 2024-04-19T02:17:12.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6989999999999992e-06 2024-04-19T02:17:12.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.129 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:12.129 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069628+0000", 2024-04-19T02:17:12.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4999999999999999e-06 2024-04-19T02:17:12.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.129 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:12.129 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069662+0000", 2024-04-19T02:17:12.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3319999999999999e-05 2024-04-19T02:17:12.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.130 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:12.130 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069782+0000", 2024-04-19T02:17:12.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120547 2024-04-19T02:17:12.130 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:12.130 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:12.130 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:12.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.130 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168385 5.d 5.967eb44d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:12.130 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:12.130 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.035627885999999998, 2024-04-19T02:17:12.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035904119999999998, 2024-04-19T02:17:12.130 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:12.130 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-04-19T02:17:12.130 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:12.131 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:12.131 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:12.131 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168385 2024-04-19T02:17:12.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.131 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:12.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:12.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:12.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:12.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:12.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:12.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:12.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:12.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:12.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:12.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.132 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:12.132 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069637+0000", 2024-04-19T02:17:12.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.576e-06 2024-04-19T02:17:12.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.132 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:12.132 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069643+0000", 2024-04-19T02:17:12.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8030000000000002e-06 2024-04-19T02:17:12.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.132 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:12.132 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069648+0000", 2024-04-19T02:17:12.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0889999999999999e-06 2024-04-19T02:17:12.133 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:12.133 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:12.133 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:12.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.133 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168386 5.5 5.4185b345 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:12.133 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069653+0000", 2024-04-19T02:17:12.133 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.035610418999999997, 2024-04-19T02:17:12.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035916991000000002, 2024-04-19T02:17:12.133 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:12.133 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-04-19T02:17:12.133 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:12.133 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:12.133 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:12.134 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168386 2024-04-19T02:17:12.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.134 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:12.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:12.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069653+0000", 2024-04-19T02:17:12.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:12.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:12.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069653+0000", 2024-04-19T02:17:12.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:12.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:12.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069652+0000", 2024-04-19T02:17:12.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:12.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:12.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069654+0000", 2024-04-19T02:17:12.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1220000000000002e-06 2024-04-19T02:17:12.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:12.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069660+0000", 2024-04-19T02:17:12.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5890000000000002e-06 2024-04-19T02:17:12.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.136 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:12.136 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069665+0000", 2024-04-19T02:17:12.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.989e-06 2024-04-19T02:17:12.136 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:12.136 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:12.136 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:12.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.136 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168387 5.f 5:ff36d1d9:::benchmark_data_smithi121_44835_object34352:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:12.136 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:12.136 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.035593584999999997, 2024-04-19T02:17:12.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035938842999999998, 2024-04-19T02:17:12.136 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:12.136 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:12.136 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:12.136 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:12.137 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:12.137 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168387 2024-04-19T02:17:12.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.137 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:12.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:12.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:12.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:12.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:12.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:12.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:12.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:12.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:12.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:12.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.138 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:12.138 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069671+0000", 2024-04-19T02:17:12.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1739999999999999e-06 2024-04-19T02:17:12.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.138 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:12.138 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069677+0000", 2024-04-19T02:17:12.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4519999999999996e-06 2024-04-19T02:17:12.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.138 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:12.138 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069682+0000", 2024-04-19T02:17:12.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5400000000000003e-06 2024-04-19T02:17:12.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:12.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072634+0000", 2024-04-19T02:17:12.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0029521510000000001 2024-04-19T02:17:12.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:12.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072706+0000", 2024-04-19T02:17:12.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1996999999999995e-05 2024-04-19T02:17:12.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:12.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072772+0000", 2024-04-19T02:17:12.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5380000000000001e-05 2024-04-19T02:17:12.140 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:12.140 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:12.140 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:12.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.140 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168389 5.2 5:4bcb87b1:::benchmark_data_smithi121_44835_object34354:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:12.140 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.071719+0000", 2024-04-19T02:17:12.140 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.033544488999999997, 2024-04-19T02:17:12.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.033930184000000002, 2024-04-19T02:17:12.140 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:12.140 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:12.140 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:12.140 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:12.141 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:12.141 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168389 2024-04-19T02:17:12.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.141 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:12.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:12.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071719+0000", 2024-04-19T02:17:12.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:12.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:12.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071719+0000", 2024-04-19T02:17:12.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:12.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.142 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:12.142 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071718+0000", 2024-04-19T02:17:12.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:12.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.142 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:12.142 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071722+0000", 2024-04-19T02:17:12.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8590000000000004e-06 2024-04-19T02:17:12.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.142 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:12.142 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071730+0000", 2024-04-19T02:17:12.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8569999999999995e-06 2024-04-19T02:17:12.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.143 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.143 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:12.143 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071736+0000", 2024-04-19T02:17:12.143 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.127e-06 2024-04-19T02:17:12.143 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.143 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.143 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:12.143 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071769+0000", 2024-04-19T02:17:12.143 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3052000000000001e-05 2024-04-19T02:17:12.143 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.143 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.143 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:12.143 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071843+0000", 2024-04-19T02:17:12.143 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3683000000000006e-05 2024-04-19T02:17:12.143 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:12.144 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:12.144 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:12.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.144 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168391 5.3 5:c5d9b5e1:::benchmark_data_smithi121_44835_object34356:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:12.144 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.074402+0000", 2024-04-19T02:17:12.144 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.03086065, 2024-04-19T02:17:12.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.031282452000000002, 2024-04-19T02:17:12.144 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:12.144 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:12.144 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:12.144 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:12.144 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:12.144 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168391 2024-04-19T02:17:12.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.144 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:12.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:12.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074402+0000", 2024-04-19T02:17:12.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:12.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:12.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074402+0000", 2024-04-19T02:17:12.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:12.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:12.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074401+0000", 2024-04-19T02:17:12.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:12.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:12.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074406+0000", 2024-04-19T02:17:12.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5879999999999999e-06 2024-04-19T02:17:12.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:12.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074414+0000", 2024-04-19T02:17:12.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8599999999999993e-06 2024-04-19T02:17:12.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:12.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074420+0000", 2024-04-19T02:17:12.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6350000000000003e-06 2024-04-19T02:17:12.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.147 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:12.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074453+0000", 2024-04-19T02:17:12.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3874000000000001e-05 2024-04-19T02:17:12.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:12.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:12.147 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:12.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074531+0000", 2024-04-19T02:17:12.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7999999999999999e-05 2024-04-19T02:17:12.147 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:12.147 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:12.147 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:12.147 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:12.147 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-04-19T02:17:12.147 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 11 2024-04-19T02:17:12.148 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:12.149 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:12.149 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:12.150+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:12.245 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:17:12.249 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:12.251+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:12.266 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:17:12.266 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:17:12.266 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:17:12.266 INFO:teuthology.orchestra.run.smithi121.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T02:17:12.269 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:17:12.269 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:17:12.324 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:12.324 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:12.339 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:12.384 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:12.384+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:12.451 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:12.452+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:12.519 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:12.519 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:12.534 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:17:12.578 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:12.579+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:12.652 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:12.653+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:12.714 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:12.715 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:12.731 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:17:12.754 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:12.754+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:12.855 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:12.857+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:12.951 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:12.951 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:12.955 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:12.957+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:12.967 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:17:13.059 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:13.061+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:13.157 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:13.158+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:13.183 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:13.183 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:13.198 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:13.258 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:13.260+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:13.267 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T02:17:13.360 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:13.361+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:13.372 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:13.372 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:13.386 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:13.470 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:13.471+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:13.562 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:13.562+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:13.595 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:13.595 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:13.610 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:13.695 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:13.696+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:13.762 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:13.764+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:13.821 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:13.821 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:13.835 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:17:13.876 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:13.877+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:13.967 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:13.966+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:14.015 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:14.015 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:14.028 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:17:14.069 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:14.070+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:14.168 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:14.169+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:14.244 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:14.244 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:14.256 INFO:teuthology.orchestra.run.smithi121.stderr:nodeep-scrub is unset 2024-04-19T02:17:14.261 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:17:14.270 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:17:14.305 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:14.306+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:14.343 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~6s 2024-04-19T02:17:14.370 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:14.369+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:14.415 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:17:14.434 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:14.435 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:14.436 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:17:14.437 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:17:14.437 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:17:14.437 INFO:teuthology.orchestra.run.smithi121.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T02:17:14.439 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:17:14.440 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:17:14.450 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:14.494 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:14.495+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:14.570 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:14.570+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:14.629 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:14.629 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:17:14.629 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.629 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:175498 5.f 5:fca8da80:::benchmark_data_smithi121_44835_object41463:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T02:17:14.630 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:14.623198+0000", 2024-04-19T02:17:14.630 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0068925790000000002, 2024-04-19T02:17:14.630 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.006912423, 2024-04-19T02:17:14.630 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:14.630 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:14.630 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:14.630 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:14.630 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:14.630 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 175498 2024-04-19T02:17:14.630 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.630 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:14.630 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.631 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:14.631 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.623198+0000", 2024-04-19T02:17:14.631 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:14.631 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.631 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.631 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:14.631 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.623198+0000", 2024-04-19T02:17:14.631 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:14.631 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.631 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.631 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:14.631 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.623197+0000", 2024-04-19T02:17:14.631 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:14.632 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.632 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.632 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:14.632 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.623202+0000", 2024-04-19T02:17:14.632 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1080000000000001e-06 2024-04-19T02:17:14.632 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.632 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.632 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:14.632 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.623214+0000", 2024-04-19T02:17:14.632 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1445e-05 2024-04-19T02:17:14.632 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.632 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.633 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:14.633 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.623222+0000", 2024-04-19T02:17:14.633 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8720000000000002e-06 2024-04-19T02:17:14.633 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.633 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.633 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:14.633 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.623261+0000", 2024-04-19T02:17:14.633 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9771000000000003e-05 2024-04-19T02:17:14.633 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.633 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.633 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:14.633 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.623388+0000", 2024-04-19T02:17:14.633 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000126258 2024-04-19T02:17:14.633 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.634 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.634 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:14.634 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.623502+0000", 2024-04-19T02:17:14.634 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011485999999999999 2024-04-19T02:17:14.634 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.634 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.634 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:14.634 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.625562+0000", 2024-04-19T02:17:14.634 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002059735 2024-04-19T02:17:14.634 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:14.634 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:14.635 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:14.635 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.635 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.635 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:175506 5.9 5:9cc94065:::benchmark_data_smithi121_44835_object41471:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T02:17:14.635 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:14.624790+0000", 2024-04-19T02:17:14.635 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0053007510000000002, 2024-04-19T02:17:14.635 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.005375276, 2024-04-19T02:17:14.635 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:14.635 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:14.635 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:14.635 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:14.635 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:14.635 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 175506 2024-04-19T02:17:14.636 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.636 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:14.636 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.636 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:14.636 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.624790+0000", 2024-04-19T02:17:14.636 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:14.636 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.636 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.636 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:14.636 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.624790+0000", 2024-04-19T02:17:14.636 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:14.636 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.637 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.637 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:14.637 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.624789+0000", 2024-04-19T02:17:14.637 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:14.637 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.637 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.637 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:14.637 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.624792+0000", 2024-04-19T02:17:14.637 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1300000000000001e-06 2024-04-19T02:17:14.637 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.637 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.637 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:14.638 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.624802+0000", 2024-04-19T02:17:14.638 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6870000000000006e-06 2024-04-19T02:17:14.638 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.638 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.638 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:14.638 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.624816+0000", 2024-04-19T02:17:14.638 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3360000000000001e-05 2024-04-19T02:17:14.638 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.638 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.638 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:14.638 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.624849+0000", 2024-04-19T02:17:14.638 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3816000000000003e-05 2024-04-19T02:17:14.639 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.639 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.639 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:14.639 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.624961+0000", 2024-04-19T02:17:14.639 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011148499999999999 2024-04-19T02:17:14.639 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.639 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.639 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:14.639 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.625066+0000", 2024-04-19T02:17:14.639 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010480300000000001 2024-04-19T02:17:14.639 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.639 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.639 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:14.640 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.628142+0000", 2024-04-19T02:17:14.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030766750000000001 2024-04-19T02:17:14.640 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:14.640 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:14.640 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:14.640 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.640 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.640 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:175509 5.f 5:fb57569f:::benchmark_data_smithi121_44835_object41474:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T02:17:14.640 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:14.625785+0000", 2024-04-19T02:17:14.640 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0043052530000000002, 2024-04-19T02:17:14.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0044265679999999996, 2024-04-19T02:17:14.640 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:14.641 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:14.641 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:14.641 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:14.641 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:14.641 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 175509 2024-04-19T02:17:14.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.641 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:14.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:14.641 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.625785+0000", 2024-04-19T02:17:14.641 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:14.642 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.642 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:14.642 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.625785+0000", 2024-04-19T02:17:14.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:14.642 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.642 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:14.642 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.625785+0000", 2024-04-19T02:17:14.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:14.642 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.643 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.643 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:14.643 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.625788+0000", 2024-04-19T02:17:14.643 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9050000000000001e-06 2024-04-19T02:17:14.643 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.643 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.643 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:14.643 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.625794+0000", 2024-04-19T02:17:14.643 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1820000000000003e-06 2024-04-19T02:17:14.643 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.643 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.643 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:14.643 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.625799+0000", 2024-04-19T02:17:14.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7820000000000001e-06 2024-04-19T02:17:14.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.644 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:14.644 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.625836+0000", 2024-04-19T02:17:14.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7089999999999999e-05 2024-04-19T02:17:14.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.644 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:14.644 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.625966+0000", 2024-04-19T02:17:14.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130748 2024-04-19T02:17:14.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.645 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:14.645 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.626069+0000", 2024-04-19T02:17:14.645 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010210299999999999 2024-04-19T02:17:14.645 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.645 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.645 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:14.645 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.629424+0000", 2024-04-19T02:17:14.645 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003355701 2024-04-19T02:17:14.645 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:14.645 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:14.645 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:14.646 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.646 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:175510 5.f 5:f37aa32d:::benchmark_data_smithi121_44835_object41475:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T02:17:14.646 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:14.626127+0000", 2024-04-19T02:17:14.646 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0039636589999999996, 2024-04-19T02:17:14.646 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041417310000000001, 2024-04-19T02:17:14.646 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:14.646 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:14.646 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:14.646 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:14.646 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:14.647 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 175510 2024-04-19T02:17:14.647 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.647 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:14.647 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.647 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:14.647 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.626127+0000", 2024-04-19T02:17:14.647 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:14.647 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.647 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.647 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:14.647 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.626127+0000", 2024-04-19T02:17:14.647 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:14.647 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.647 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.648 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:14.648 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.626126+0000", 2024-04-19T02:17:14.648 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:14.648 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.648 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.648 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:14.648 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.626130+0000", 2024-04-19T02:17:14.648 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1049999999999997e-06 2024-04-19T02:17:14.648 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.648 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.648 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:14.649 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.626139+0000", 2024-04-19T02:17:14.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9060000000000008e-06 2024-04-19T02:17:14.649 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.649 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.649 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:14.649 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.626146+0000", 2024-04-19T02:17:14.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8310000000000003e-06 2024-04-19T02:17:14.649 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.649 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.649 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:14.649 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.627887+0000", 2024-04-19T02:17:14.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001740763 2024-04-19T02:17:14.650 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.650 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.650 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:14.650 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.628005+0000", 2024-04-19T02:17:14.650 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011806 2024-04-19T02:17:14.650 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.650 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.650 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:14.650 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.628107+0000", 2024-04-19T02:17:14.650 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010248500000000001 2024-04-19T02:17:14.650 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.650 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:14.651 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.629692+0000", 2024-04-19T02:17:14.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001584313 2024-04-19T02:17:14.651 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:14.651 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:14.651 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:14.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.651 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:175512 5.9 5:9c9c69ab:::benchmark_data_smithi121_44835_object41477:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T02:17:14.651 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:14.626684+0000", 2024-04-19T02:17:14.651 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0034063069999999999, 2024-04-19T02:17:14.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003634487, 2024-04-19T02:17:14.651 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:14.651 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:14.652 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:14.652 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:14.652 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:14.652 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 175512 2024-04-19T02:17:14.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.652 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:14.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:14.652 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.626684+0000", 2024-04-19T02:17:14.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:14.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.653 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:14.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.626684+0000", 2024-04-19T02:17:14.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:14.653 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.653 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:14.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.626683+0000", 2024-04-19T02:17:14.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:14.653 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.653 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:14.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.626688+0000", 2024-04-19T02:17:14.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0419999999999996e-06 2024-04-19T02:17:14.654 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.654 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.654 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:14.654 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.626696+0000", 2024-04-19T02:17:14.654 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5490000000000006e-06 2024-04-19T02:17:14.654 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.654 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.654 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:14.654 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.626702+0000", 2024-04-19T02:17:14.654 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2929999999999997e-06 2024-04-19T02:17:14.654 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.655 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.655 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:14.655 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.626769+0000", 2024-04-19T02:17:14.655 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7136000000000002e-05 2024-04-19T02:17:14.655 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.655 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.655 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:14.655 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.626859+0000", 2024-04-19T02:17:14.655 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9446999999999999e-05 2024-04-19T02:17:14.655 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.655 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.656 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:14.656 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.626922+0000", 2024-04-19T02:17:14.656 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2730000000000004e-05 2024-04-19T02:17:14.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.656 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.656 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:14.656 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.628586+0000", 2024-04-19T02:17:14.656 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0016644609999999999 2024-04-19T02:17:14.656 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:14.656 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:14.656 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:14.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.657 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.657 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:175520 5.d 5:b0fd7666:::benchmark_data_smithi121_44835_object41485:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T02:17:14.657 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:14.630301+0000", 2024-04-19T02:17:14.657 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9997892, 2024-04-19T02:17:14.657 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4900999999999994e-05, 2024-04-19T02:17:14.657 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:14.657 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-04-19T02:17:14.657 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:14.657 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:14.657 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:14.657 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 175520 2024-04-19T02:17:14.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.658 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:14.658 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.658 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:14.658 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.630301+0000", 2024-04-19T02:17:14.658 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:14.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.658 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.658 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:14.658 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.630301+0000", 2024-04-19T02:17:14.658 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:14.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.658 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.658 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:14.659 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.630301+0000", 2024-04-19T02:17:14.659 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:14.659 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.659 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.659 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:14.659 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.630305+0000", 2024-04-19T02:17:14.659 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1230000000000002e-06 2024-04-19T02:17:14.659 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.659 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.659 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:14.659 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.630313+0000", 2024-04-19T02:17:14.659 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5830000000000007e-06 2024-04-19T02:17:14.659 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.660 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:14.660 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.630319+0000", 2024-04-19T02:17:14.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.446e-06 2024-04-19T02:17:14.660 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:14.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:14.660 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:14.660 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:14.630346+0000", 2024-04-19T02:17:14.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7067e-05 2024-04-19T02:17:14.660 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:14.660 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:14.661 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:14.661 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:14.661 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-04-19T02:17:14.661 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 6 2024-04-19T02:17:14.661 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:14.662 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:14.704 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:14.705+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:14.771 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:14.772+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:14.872 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:14.873+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:14.881 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:14.882 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-04-19T02:17:14.882 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-04-19T02:17:14.882 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-04-19T02:17:14.882 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:14.896 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:14.981 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:14.982+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:15.073 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:15.075+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:15.108 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:15.108 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-04-19T02:17:15.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-04-19T02:17:15.108 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:17:15.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.108 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:15.108 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:17:15.108 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 105.836856686, 2024-04-19T02:17:15.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022007204999999998, 2024-04-19T02:17:15.108 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:15.109 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:15.109 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:15.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:15.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:17:15.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:15.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:15.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:17:15.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:15.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:15.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269990+0000", 2024-04-19T02:17:15.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:15.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.110 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:15.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269999+0000", 2024-04-19T02:17:15.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9539999999999993e-06 2024-04-19T02:17:15.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.110 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:15.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270006+0000", 2024-04-19T02:17:15.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.216e-06 2024-04-19T02:17:15.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270012+0000", 2024-04-19T02:17:15.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5049999999999998e-06 2024-04-19T02:17:15.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:15.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270058+0000", 2024-04-19T02:17:15.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.634e-05 2024-04-19T02:17:15.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:15.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270064+0000", 2024-04-19T02:17:15.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0669999999999997e-06 2024-04-19T02:17:15.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:15.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287159+0000", 2024-04-19T02:17:15.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017095086999999998 2024-04-19T02:17:15.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:15.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287254+0000", 2024-04-19T02:17:15.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4716000000000006e-05 2024-04-19T02:17:15.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:15.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287389+0000", 2024-04-19T02:17:15.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013511900000000001 2024-04-19T02:17:15.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:15.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290481+0000", 2024-04-19T02:17:15.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030920169999999999 2024-04-19T02:17:15.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:15.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291931+0000", 2024-04-19T02:17:15.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001450118 2024-04-19T02:17:15.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.114 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:15.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291960+0000", 2024-04-19T02:17:15.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9096000000000001e-05 2024-04-19T02:17:15.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.114 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:15.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291998+0000", 2024-04-19T02:17:15.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7514e-05 2024-04-19T02:17:15.114 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:15.115 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:15.115 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:15.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.115 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:15.115 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:17:15.115 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 105.83674591, 2024-04-19T02:17:15.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020837887999999999, 2024-04-19T02:17:15.115 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:15.115 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:15.115 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:15.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:15.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:17:15.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:15.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:15.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:17:15.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:15.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:15.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:17:15.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:15.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:15.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270109+0000", 2024-04-19T02:17:15.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3110000000000006e-06 2024-04-19T02:17:15.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.117 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:15.117 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270117+0000", 2024-04-19T02:17:15.117 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0479999999999999e-06 2024-04-19T02:17:15.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.117 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.117 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270123+0000", 2024-04-19T02:17:15.117 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5500000000000002e-06 2024-04-19T02:17:15.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.117 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:15.117 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270150+0000", 2024-04-19T02:17:15.117 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7712000000000002e-05 2024-04-19T02:17:15.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:15.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270153+0000", 2024-04-19T02:17:15.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6089999999999999e-06 2024-04-19T02:17:15.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:15.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285958+0000", 2024-04-19T02:17:15.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015805274000000001 2024-04-19T02:17:15.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:15.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286126+0000", 2024-04-19T02:17:15.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016765700000000001 2024-04-19T02:17:15.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:15.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286296+0000", 2024-04-19T02:17:15.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017007 2024-04-19T02:17:15.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:15.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290426+0000", 2024-04-19T02:17:15.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041299839999999997 2024-04-19T02:17:15.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:15.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290867+0000", 2024-04-19T02:17:15.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00044083300000000001 2024-04-19T02:17:15.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:15.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290900+0000", 2024-04-19T02:17:15.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3380000000000002e-05 2024-04-19T02:17:15.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:15.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290939+0000", 2024-04-19T02:17:15.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8970000000000001e-05 2024-04-19T02:17:15.120 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:15.121 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:15.121 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:15.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.121 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:21 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:15.121 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:17:15.121 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 105.836657238, 2024-04-19T02:17:15.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020833187999999999, 2024-04-19T02:17:15.121 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:15.121 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:15.121 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:15.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:15.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:17:15.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:15.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:15.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:17:15.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:15.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:15.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270189+0000", 2024-04-19T02:17:15.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:15.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.123 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:15.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270192+0000", 2024-04-19T02:17:15.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7549999999999999e-06 2024-04-19T02:17:15.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.123 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:15.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270198+0000", 2024-04-19T02:17:15.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0859999999999998e-06 2024-04-19T02:17:15.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.123 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270204+0000", 2024-04-19T02:17:15.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1970000000000004e-06 2024-04-19T02:17:15.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:15.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270238+0000", 2024-04-19T02:17:15.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4282000000000001e-05 2024-04-19T02:17:15.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:15.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270240+0000", 2024-04-19T02:17:15.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3099999999999999e-06 2024-04-19T02:17:15.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:15.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287131+0000", 2024-04-19T02:17:15.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01689104 2024-04-19T02:17:15.125 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.125 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.125 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:15.125 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287262+0000", 2024-04-19T02:17:15.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130347 2024-04-19T02:17:15.125 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.125 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.125 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:15.125 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291023+0000", 2024-04-19T02:17:15.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037616350000000002 2024-04-19T02:17:15.125 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:15.125 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:15.125 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:15.125 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.126 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:94468 5.2 5:4f406431:::benchmark_data_smithi121_44835_object94467:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T02:17:15.126 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:17:15.126 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 39.995418055999998, 2024-04-19T02:17:15.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024835144999999999, 2024-04-19T02:17:15.126 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:15.126 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:15.126 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:15.126 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:15.126 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:15.126 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 94468 2024-04-19T02:17:15.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.126 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:15.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:15.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:17:15.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:15.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:15.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:17:15.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:15.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:15.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:17:15.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:15.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:15.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111498+0000", 2024-04-19T02:17:15.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9529000000000005e-05 2024-04-19T02:17:15.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:15.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111506+0000", 2024-04-19T02:17:15.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9030000000000004e-06 2024-04-19T02:17:15.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111513+0000", 2024-04-19T02:17:15.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8759999999999999e-06 2024-04-19T02:17:15.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.129 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:15.129 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112466+0000", 2024-04-19T02:17:15.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00095318499999999995 2024-04-19T02:17:15.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.129 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:15.129 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112590+0000", 2024-04-19T02:17:15.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012380900000000001 2024-04-19T02:17:15.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.129 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:15.130 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112728+0000", 2024-04-19T02:17:15.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013753800000000001 2024-04-19T02:17:15.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.130 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:15.130 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115064+0000", 2024-04-19T02:17:15.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002336819 2024-04-19T02:17:15.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.130 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:15.130 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136207+0000", 2024-04-19T02:17:15.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021142942000000001 2024-04-19T02:17:15.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:15.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136241+0000", 2024-04-19T02:17:15.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3577000000000001e-05 2024-04-19T02:17:15.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:15.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136264+0000", 2024-04-19T02:17:15.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3421000000000002e-05 2024-04-19T02:17:15.131 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:15.131 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:15.131 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:15.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.131 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:94472 5.2 5:45b7e9be:::benchmark_data_smithi121_44835_object94471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:15.132 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:17:15.132 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 39.991771524999997, 2024-04-19T02:17:15.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021273843000000001, 2024-04-19T02:17:15.132 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:15.132 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:15.132 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:15.132 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:15.132 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:15.132 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 94472 2024-04-19T02:17:15.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.132 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:15.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.132 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:15.132 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:17:15.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:15.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.133 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:15.133 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:17:15.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:15.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.133 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:15.133 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115075+0000", 2024-04-19T02:17:15.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:15.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.133 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:15.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115161+0000", 2024-04-19T02:17:15.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6632000000000007e-05 2024-04-19T02:17:15.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:15.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115171+0000", 2024-04-19T02:17:15.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2969999999999992e-06 2024-04-19T02:17:15.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115178+0000", 2024-04-19T02:17:15.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7610000000000007e-06 2024-04-19T02:17:15.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:15.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115213+0000", 2024-04-19T02:17:15.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5000999999999999e-05 2024-04-19T02:17:15.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:15.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115303+0000", 2024-04-19T02:17:15.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9791999999999997e-05 2024-04-19T02:17:15.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:15.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115391+0000", 2024-04-19T02:17:15.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7559000000000007e-05 2024-04-19T02:17:15.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.136 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:15.136 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.117894+0000", 2024-04-19T02:17:15.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002503496 2024-04-19T02:17:15.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.136 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:15.136 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136297+0000", 2024-04-19T02:17:15.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018402335999999998 2024-04-19T02:17:15.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.136 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:15.136 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136327+0000", 2024-04-19T02:17:15.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0534999999999998e-05 2024-04-19T02:17:15.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:15.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136350+0000", 2024-04-19T02:17:15.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2427999999999999e-05 2024-04-19T02:17:15.137 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:15.137 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:15.137 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:15.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.137 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:129219 5.2 5:45e7e1f4:::benchmark_data_smithi121_44835_object129218:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T02:17:15.137 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:52.629592+0000", 2024-04-19T02:17:15.137 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.477255272000001, 2024-04-19T02:17:15.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021099489999999999, 2024-04-19T02:17:15.138 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:15.138 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:15.138 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:15.138 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:15.138 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:15.138 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129219 2024-04-19T02:17:15.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.138 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:15.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.138 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:15.138 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629592+0000", 2024-04-19T02:17:15.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:15.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:15.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629592+0000", 2024-04-19T02:17:15.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:15.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:15.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629591+0000", 2024-04-19T02:17:15.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:15.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:15.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629618+0000", 2024-04-19T02:17:15.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6970000000000001e-05 2024-04-19T02:17:15.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:15.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629639+0000", 2024-04-19T02:17:15.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0701999999999999e-05 2024-04-19T02:17:15.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629645+0000", 2024-04-19T02:17:15.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2299999999999996e-06 2024-04-19T02:17:15.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:15.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.635658+0000", 2024-04-19T02:17:15.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0060127549999999998 2024-04-19T02:17:15.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:15.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.635811+0000", 2024-04-19T02:17:15.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015305700000000001 2024-04-19T02:17:15.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:15.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.635967+0000", 2024-04-19T02:17:15.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015578599999999999 2024-04-19T02:17:15.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:15.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.642488+0000", 2024-04-19T02:17:15.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0065215619999999998 2024-04-19T02:17:15.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:15.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650603+0000", 2024-04-19T02:17:15.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0081144900000000002 2024-04-19T02:17:15.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.142 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:15.142 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650652+0000", 2024-04-19T02:17:15.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9079999999999998e-05 2024-04-19T02:17:15.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.142 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:15.142 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650691+0000", 2024-04-19T02:17:15.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9501e-05 2024-04-19T02:17:15.142 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:15.142 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:15.142 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:15.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.142 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:157448 5.7 5:ed833a19:::benchmark_data_smithi121_44835_object23413:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:15.143 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:06.870566+0000", 2024-04-19T02:17:15.143 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.2362806909999993, 2024-04-19T02:17:15.143 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023031238999999998, 2024-04-19T02:17:15.143 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:15.143 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:15.143 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:15.143 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:15.143 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:15.143 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 157448 2024-04-19T02:17:15.143 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.143 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:15.143 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.143 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:15.143 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870566+0000", 2024-04-19T02:17:15.143 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:15.143 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.144 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:15.144 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870566+0000", 2024-04-19T02:17:15.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:15.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.144 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:15.144 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870566+0000", 2024-04-19T02:17:15.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:15.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.144 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:15.144 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870570+0000", 2024-04-19T02:17:15.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1620000000000001e-06 2024-04-19T02:17:15.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:15.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870577+0000", 2024-04-19T02:17:15.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2069999999999998e-06 2024-04-19T02:17:15.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870587+0000", 2024-04-19T02:17:15.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6919999999999997e-06 2024-04-19T02:17:15.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:15.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870615+0000", 2024-04-19T02:17:15.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8351999999999999e-05 2024-04-19T02:17:15.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:15.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870715+0000", 2024-04-19T02:17:15.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9624999999999996e-05 2024-04-19T02:17:15.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:15.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870805+0000", 2024-04-19T02:17:15.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0067000000000004e-05 2024-04-19T02:17:15.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:15.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.872773+0000", 2024-04-19T02:17:15.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001968605 2024-04-19T02:17:15.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:15.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.893514+0000", 2024-04-19T02:17:15.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020740082999999999 2024-04-19T02:17:15.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.147 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:15.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.893558+0000", 2024-04-19T02:17:15.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4110999999999998e-05 2024-04-19T02:17:15.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.147 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:15.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.893598+0000", 2024-04-19T02:17:15.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0077000000000003e-05 2024-04-19T02:17:15.147 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:15.147 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:15.147 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:15.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.148 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:157498 5.7 5:eb39b43d:::benchmark_data_smithi121_44835_object23463:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:15.148 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:06.911721+0000", 2024-04-19T02:17:15.148 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.1951260460000004, 2024-04-19T02:17:15.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023313438999999998, 2024-04-19T02:17:15.148 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:15.148 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:15.148 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:15.148 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:15.148 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:15.148 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 157498 2024-04-19T02:17:15.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.148 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:15.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:15.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911721+0000", 2024-04-19T02:17:15.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:15.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:15.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911721+0000", 2024-04-19T02:17:15.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:15.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:15.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911720+0000", 2024-04-19T02:17:15.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:15.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:15.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911726+0000", 2024-04-19T02:17:15.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3179999999999997e-06 2024-04-19T02:17:15.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:15.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911746+0000", 2024-04-19T02:17:15.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0574e-05 2024-04-19T02:17:15.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911757+0000", 2024-04-19T02:17:15.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0959e-05 2024-04-19T02:17:15.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:15.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911795+0000", 2024-04-19T02:17:15.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7589999999999998e-05 2024-04-19T02:17:15.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:15.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911912+0000", 2024-04-19T02:17:15.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117625 2024-04-19T02:17:15.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:15.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.912250+0000", 2024-04-19T02:17:15.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00033710599999999999 2024-04-19T02:17:15.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:15.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.915540+0000", 2024-04-19T02:17:15.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032909559999999998 2024-04-19T02:17:15.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:15.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.934984+0000", 2024-04-19T02:17:15.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019443670999999999 2024-04-19T02:17:15.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:15.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.935013+0000", 2024-04-19T02:17:15.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8464999999999999e-05 2024-04-19T02:17:15.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:15.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.935035+0000", 2024-04-19T02:17:15.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1954e-05 2024-04-19T02:17:15.153 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:15.153 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:15.153 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:15.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.153 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168377 5.d 5:b1f3fb6d:::benchmark_data_smithi121_44835_object34342:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:15.153 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069470+0000", 2024-04-19T02:17:15.153 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.037377314, 2024-04-19T02:17:15.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050516473999999999, 2024-04-19T02:17:15.153 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:15.153 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:15.153 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:15.153 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:15.154 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:15.154 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168377 2024-04-19T02:17:15.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.154 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:15.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:15.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069470+0000", 2024-04-19T02:17:15.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:15.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:15.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069470+0000", 2024-04-19T02:17:15.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:15.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:15.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069469+0000", 2024-04-19T02:17:15.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:15.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:15.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069473+0000", 2024-04-19T02:17:15.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4580000000000002e-06 2024-04-19T02:17:15.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:15.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069482+0000", 2024-04-19T02:17:15.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2839999999999995e-06 2024-04-19T02:17:15.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069489+0000", 2024-04-19T02:17:15.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3579999999999997e-06 2024-04-19T02:17:15.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:15.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069559+0000", 2024-04-19T02:17:15.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9678000000000006e-05 2024-04-19T02:17:15.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:15.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069683+0000", 2024-04-19T02:17:15.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012359400000000001 2024-04-19T02:17:15.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:15.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069759+0000", 2024-04-19T02:17:15.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6834000000000003e-05 2024-04-19T02:17:15.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:15.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119871+0000", 2024-04-19T02:17:15.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050111392999999997 2024-04-19T02:17:15.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:15.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119932+0000", 2024-04-19T02:17:15.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1209000000000003e-05 2024-04-19T02:17:15.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:15.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119962+0000", 2024-04-19T02:17:15.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9717999999999999e-05 2024-04-19T02:17:15.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:15.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119986+0000", 2024-04-19T02:17:15.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4549000000000002e-05 2024-04-19T02:17:15.158 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:15.158 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:15.158 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:15.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.158 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168379 5.d 5:bcd492dd:::benchmark_data_smithi121_44835_object34344:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:15.158 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069502+0000", 2024-04-19T02:17:15.158 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.037345261, 2024-04-19T02:17:15.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050544645999999999, 2024-04-19T02:17:15.158 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:15.158 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:15.159 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:15.159 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:15.159 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:15.159 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168379 2024-04-19T02:17:15.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.159 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:15.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:15.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069502+0000", 2024-04-19T02:17:15.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:15.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:15.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069502+0000", 2024-04-19T02:17:15.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:15.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:15.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069501+0000", 2024-04-19T02:17:15.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:15.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:15.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069504+0000", 2024-04-19T02:17:15.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9289999999999998e-06 2024-04-19T02:17:15.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:15.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069511+0000", 2024-04-19T02:17:15.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1909999999999997e-06 2024-04-19T02:17:15.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069517+0000", 2024-04-19T02:17:15.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0789999999999997e-06 2024-04-19T02:17:15.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:15.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071081+0000", 2024-04-19T02:17:15.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0015646550000000001 2024-04-19T02:17:15.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:15.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071195+0000", 2024-04-19T02:17:15.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011399400000000001 2024-04-19T02:17:15.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:15.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071293+0000", 2024-04-19T02:17:15.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7938999999999999e-05 2024-04-19T02:17:15.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:15.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119898+0000", 2024-04-19T02:17:15.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.048604808999999999 2024-04-19T02:17:15.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:15.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119993+0000", 2024-04-19T02:17:15.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5224999999999997e-05 2024-04-19T02:17:15.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:15.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120024+0000", 2024-04-19T02:17:15.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0580999999999997e-05 2024-04-19T02:17:15.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:15.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120047+0000", 2024-04-19T02:17:15.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2725e-05 2024-04-19T02:17:15.163 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:15.163 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:15.163 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:15.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.164 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168381 5.d 5:bcbab0e3:::benchmark_data_smithi121_44835_object34346:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:15.164 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:15.164 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.0373258430000001, 2024-04-19T02:17:15.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050574694000000003, 2024-04-19T02:17:15.164 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:15.164 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:15.164 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:15.164 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:15.164 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:15.164 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168381 2024-04-19T02:17:15.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.164 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:15.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:15.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:15.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:15.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:15.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:15.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:15.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:15.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:15.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:15.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:15.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069523+0000", 2024-04-19T02:17:15.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.244e-06 2024-04-19T02:17:15.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:15.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069528+0000", 2024-04-19T02:17:15.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0669999999999999e-06 2024-04-19T02:17:15.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069533+0000", 2024-04-19T02:17:15.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4680000000000003e-06 2024-04-19T02:17:15.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:15.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072637+0000", 2024-04-19T02:17:15.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031040429999999999 2024-04-19T02:17:15.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:15.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072710+0000", 2024-04-19T02:17:15.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3045000000000003e-05 2024-04-19T02:17:15.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:15.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072775+0000", 2024-04-19T02:17:15.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5034000000000001e-05 2024-04-19T02:17:15.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:15.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119925+0000", 2024-04-19T02:17:15.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.047150594999999997 2024-04-19T02:17:15.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:15.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120055+0000", 2024-04-19T02:17:15.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129288 2024-04-19T02:17:15.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:15.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120077+0000", 2024-04-19T02:17:15.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1759e-05 2024-04-19T02:17:15.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:15.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120096+0000", 2024-04-19T02:17:15.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9524000000000001e-05 2024-04-19T02:17:15.169 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:15.169 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:15.169 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:15.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.170 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168382 5.f 5:f2599a15:::benchmark_data_smithi121_44835_object34347:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:15.170 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069556+0000", 2024-04-19T02:17:15.170 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.0372914359999998, 2024-04-19T02:17:15.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050009713999999997, 2024-04-19T02:17:15.170 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:15.170 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:15.170 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:15.170 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:15.170 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:15.170 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168382 2024-04-19T02:17:15.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.170 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:15.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:15.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069556+0000", 2024-04-19T02:17:15.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:15.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:15.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069556+0000", 2024-04-19T02:17:15.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:15.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:15.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069555+0000", 2024-04-19T02:17:15.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:15.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:15.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069558+0000", 2024-04-19T02:17:15.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7879999999999998e-06 2024-04-19T02:17:15.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:15.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069566+0000", 2024-04-19T02:17:15.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6149999999999999e-06 2024-04-19T02:17:15.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069571+0000", 2024-04-19T02:17:15.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5509999999999999e-06 2024-04-19T02:17:15.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:15.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069618+0000", 2024-04-19T02:17:15.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6964e-05 2024-04-19T02:17:15.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:15.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069744+0000", 2024-04-19T02:17:15.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012577199999999999 2024-04-19T02:17:15.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:15.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.070116+0000", 2024-04-19T02:17:15.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000372407 2024-04-19T02:17:15.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.174 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:15.174 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117511+0000", 2024-04-19T02:17:15.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.047394935999999999 2024-04-19T02:17:15.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.174 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:15.174 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119484+0000", 2024-04-19T02:17:15.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019722310000000001 2024-04-19T02:17:15.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.174 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:15.174 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119525+0000", 2024-04-19T02:17:15.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1035999999999998e-05 2024-04-19T02:17:15.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:15.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119565+0000", 2024-04-19T02:17:15.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0859000000000003e-05 2024-04-19T02:17:15.175 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:15.175 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:15.175 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:15.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.175 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168383 5.d 5:bbd9496c:::benchmark_data_smithi121_44835_object34348:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:15.175 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069581+0000", 2024-04-19T02:17:15.175 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.0372665479999998, 2024-04-19T02:17:15.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050607278999999998, 2024-04-19T02:17:15.175 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:15.176 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:15.176 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:15.176 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:15.176 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:15.176 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168383 2024-04-19T02:17:15.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.176 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:15.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:15.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069581+0000", 2024-04-19T02:17:15.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:15.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:15.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069581+0000", 2024-04-19T02:17:15.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:15.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:15.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069580+0000", 2024-04-19T02:17:15.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:15.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:15.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069589+0000", 2024-04-19T02:17:15.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6750000000000008e-06 2024-04-19T02:17:15.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:15.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069596+0000", 2024-04-19T02:17:15.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7360000000000004e-06 2024-04-19T02:17:15.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069601+0000", 2024-04-19T02:17:15.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0479999999999998e-06 2024-04-19T02:17:15.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:15.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.073854+0000", 2024-04-19T02:17:15.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042531920000000003 2024-04-19T02:17:15.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:15.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.073952+0000", 2024-04-19T02:17:15.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7851999999999998e-05 2024-04-19T02:17:15.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:15.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074012+0000", 2024-04-19T02:17:15.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0225e-05 2024-04-19T02:17:15.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:15.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120102+0000", 2024-04-19T02:17:15.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.046090150000000003 2024-04-19T02:17:15.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:15.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120129+0000", 2024-04-19T02:17:15.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7228000000000001e-05 2024-04-19T02:17:15.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:15.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120157+0000", 2024-04-19T02:17:15.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7165000000000002e-05 2024-04-19T02:17:15.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:15.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120188+0000", 2024-04-19T02:17:15.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1418000000000003e-05 2024-04-19T02:17:15.181 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:15.181 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:15.181 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:15.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.181 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168384 5.7 5:ed638f84:::benchmark_data_smithi121_44835_object34349:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:15.181 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069612+0000", 2024-04-19T02:17:15.181 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.037235495, 2024-04-19T02:17:15.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049863376000000001, 2024-04-19T02:17:15.181 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:15.181 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:15.181 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:15.182 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:15.182 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:15.182 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168384 2024-04-19T02:17:15.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.182 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:15.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:15.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069612+0000", 2024-04-19T02:17:15.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:15.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:15.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069612+0000", 2024-04-19T02:17:15.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:15.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:15.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069611+0000", 2024-04-19T02:17:15.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:15.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:15.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069614+0000", 2024-04-19T02:17:15.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7819999999999998e-06 2024-04-19T02:17:15.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:15.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069623+0000", 2024-04-19T02:17:15.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6989999999999992e-06 2024-04-19T02:17:15.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069628+0000", 2024-04-19T02:17:15.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4999999999999999e-06 2024-04-19T02:17:15.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:15.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069662+0000", 2024-04-19T02:17:15.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3319999999999999e-05 2024-04-19T02:17:15.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:15.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069782+0000", 2024-04-19T02:17:15.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120547 2024-04-19T02:17:15.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:15.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119338+0000", 2024-04-19T02:17:15.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049556141999999997 2024-04-19T02:17:15.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:15.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119388+0000", 2024-04-19T02:17:15.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9866e-05 2024-04-19T02:17:15.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:15.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119475+0000", 2024-04-19T02:17:15.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6929999999999996e-05 2024-04-19T02:17:15.186 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:15.186 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:15.186 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:15.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.186 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168385 5.d 5:b22d7e69:::benchmark_data_smithi121_44835_object34350:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:15.186 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:15.186 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.037212056, 2024-04-19T02:17:15.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.055438508999999997, 2024-04-19T02:17:15.187 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:15.187 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:15.187 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:15.187 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:15.187 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:15.187 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168385 2024-04-19T02:17:15.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.187 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:15.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:15.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:15.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:15.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:15.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:15.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:15.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:15.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:15.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:15.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:15.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069637+0000", 2024-04-19T02:17:15.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.576e-06 2024-04-19T02:17:15.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:15.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069643+0000", 2024-04-19T02:17:15.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8030000000000002e-06 2024-04-19T02:17:15.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069648+0000", 2024-04-19T02:17:15.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0889999999999999e-06 2024-04-19T02:17:15.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:15.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117534+0000", 2024-04-19T02:17:15.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.047886390000000001 2024-04-19T02:17:15.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:15.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117670+0000", 2024-04-19T02:17:15.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000135969 2024-04-19T02:17:15.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:15.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117803+0000", 2024-04-19T02:17:15.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000132955 2024-04-19T02:17:15.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:15.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120501+0000", 2024-04-19T02:17:15.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026978050000000002 2024-04-19T02:17:15.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:15.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.125026+0000", 2024-04-19T02:17:15.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045244589999999998 2024-04-19T02:17:15.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:15.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.125049+0000", 2024-04-19T02:17:15.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3807000000000001e-05 2024-04-19T02:17:15.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:15.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.125074+0000", 2024-04-19T02:17:15.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4175000000000001e-05 2024-04-19T02:17:15.192 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:15.192 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:15.192 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:15.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.192 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168386 5.5 5:a2cda182:::benchmark_data_smithi121_44835_object34351:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:15.192 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069653+0000", 2024-04-19T02:17:15.192 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.0371945889999998, 2024-04-19T02:17:15.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058748884000000001, 2024-04-19T02:17:15.192 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:15.192 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:15.192 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:15.192 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:15.192 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:15.192 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168386 2024-04-19T02:17:15.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.193 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:15.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:15.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069653+0000", 2024-04-19T02:17:15.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:15.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:15.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069653+0000", 2024-04-19T02:17:15.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:15.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:15.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069652+0000", 2024-04-19T02:17:15.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:15.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:15.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069654+0000", 2024-04-19T02:17:15.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1220000000000002e-06 2024-04-19T02:17:15.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:15.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069660+0000", 2024-04-19T02:17:15.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5890000000000002e-06 2024-04-19T02:17:15.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069665+0000", 2024-04-19T02:17:15.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.989e-06 2024-04-19T02:17:15.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:15.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120220+0000", 2024-04-19T02:17:15.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050555061999999998 2024-04-19T02:17:15.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:15.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120329+0000", 2024-04-19T02:17:15.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010922200000000001 2024-04-19T02:17:15.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:15.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.128293+0000", 2024-04-19T02:17:15.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079640279999999997 2024-04-19T02:17:15.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:15.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.128336+0000", 2024-04-19T02:17:15.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2245e-05 2024-04-19T02:17:15.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:15.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.128401+0000", 2024-04-19T02:17:15.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5975000000000004e-05 2024-04-19T02:17:15.197 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:15.197 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:15.197 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:15.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.197 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168387 5.f 5:ff36d1d9:::benchmark_data_smithi121_44835_object34352:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:15.197 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:15.197 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.0371777550000001, 2024-04-19T02:17:15.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049975358999999997, 2024-04-19T02:17:15.197 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:15.198 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:15.198 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:15.198 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:15.198 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:15.198 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168387 2024-04-19T02:17:15.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.198 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:15.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:15.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:15.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:15.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:15.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:15.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:15.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:15.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:15.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:15.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:15.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069671+0000", 2024-04-19T02:17:15.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1739999999999999e-06 2024-04-19T02:17:15.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:15.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069677+0000", 2024-04-19T02:17:15.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4519999999999996e-06 2024-04-19T02:17:15.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069682+0000", 2024-04-19T02:17:15.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5400000000000003e-06 2024-04-19T02:17:15.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:15.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072634+0000", 2024-04-19T02:17:15.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0029521510000000001 2024-04-19T02:17:15.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:15.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072706+0000", 2024-04-19T02:17:15.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1996999999999995e-05 2024-04-19T02:17:15.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:15.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072772+0000", 2024-04-19T02:17:15.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5380000000000001e-05 2024-04-19T02:17:15.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:15.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117549+0000", 2024-04-19T02:17:15.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044777124000000001 2024-04-19T02:17:15.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:15.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119572+0000", 2024-04-19T02:17:15.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002022893 2024-04-19T02:17:15.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:15.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119613+0000", 2024-04-19T02:17:15.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0849999999999997e-05 2024-04-19T02:17:15.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:15.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119645+0000", 2024-04-19T02:17:15.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2113000000000002e-05 2024-04-19T02:17:15.203 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:15.203 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:15.203 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:15.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.203 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168389 5.2 5:4bcb87b1:::benchmark_data_smithi121_44835_object34354:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:15.203 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.071719+0000", 2024-04-19T02:17:15.203 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.0351286590000002, 2024-04-19T02:17:15.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.048248604, 2024-04-19T02:17:15.203 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:15.203 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:15.203 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:15.204 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:15.204 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:15.204 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168389 2024-04-19T02:17:15.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.204 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:15.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:15.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071719+0000", 2024-04-19T02:17:15.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:15.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:15.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071719+0000", 2024-04-19T02:17:15.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:15.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:15.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071718+0000", 2024-04-19T02:17:15.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:15.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:15.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071722+0000", 2024-04-19T02:17:15.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8590000000000004e-06 2024-04-19T02:17:15.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:15.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071730+0000", 2024-04-19T02:17:15.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8569999999999995e-06 2024-04-19T02:17:15.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071736+0000", 2024-04-19T02:17:15.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.127e-06 2024-04-19T02:17:15.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:15.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071769+0000", 2024-04-19T02:17:15.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3052000000000001e-05 2024-04-19T02:17:15.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:15.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071843+0000", 2024-04-19T02:17:15.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3683000000000006e-05 2024-04-19T02:17:15.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:15.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119852+0000", 2024-04-19T02:17:15.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.048009353999999997 2024-04-19T02:17:15.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:15.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119896+0000", 2024-04-19T02:17:15.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3102000000000002e-05 2024-04-19T02:17:15.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:15.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119967+0000", 2024-04-19T02:17:15.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1589999999999997e-05 2024-04-19T02:17:15.208 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:15.208 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:15.208 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:15.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.208 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168391 5.3 5:c5d9b5e1:::benchmark_data_smithi121_44835_object34356:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:15.208 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.074402+0000", 2024-04-19T02:17:15.208 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.0324448199999998, 2024-04-19T02:17:15.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.045426756999999998, 2024-04-19T02:17:15.209 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:15.209 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:15.209 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:15.209 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:15.209 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:15.209 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168391 2024-04-19T02:17:15.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.209 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:15.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:15.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074402+0000", 2024-04-19T02:17:15.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:15.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:15.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074402+0000", 2024-04-19T02:17:15.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:15.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:15.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074401+0000", 2024-04-19T02:17:15.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:15.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:15.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074406+0000", 2024-04-19T02:17:15.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5879999999999999e-06 2024-04-19T02:17:15.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:15.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074414+0000", 2024-04-19T02:17:15.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8599999999999993e-06 2024-04-19T02:17:15.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074420+0000", 2024-04-19T02:17:15.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6350000000000003e-06 2024-04-19T02:17:15.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:15.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074453+0000", 2024-04-19T02:17:15.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3874000000000001e-05 2024-04-19T02:17:15.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:15.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074531+0000", 2024-04-19T02:17:15.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7999999999999999e-05 2024-04-19T02:17:15.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:15.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119717+0000", 2024-04-19T02:17:15.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.045185395000000003 2024-04-19T02:17:15.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:15.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119756+0000", 2024-04-19T02:17:15.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9110000000000003e-05 2024-04-19T02:17:15.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:15.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119829+0000", 2024-04-19T02:17:15.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3238000000000006e-05 2024-04-19T02:17:15.213 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:15.213 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:15.214 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:15.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.214 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4549.0:168377 5.d e52/16 ondisk, result = 0)", 2024-04-19T02:17:15.214 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.077260+0000", 2024-04-19T02:17:15.214 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.0295870790000001, 2024-04-19T02:17:15.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042613204000000002, 2024-04-19T02:17:15.214 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:15.214 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:15.214 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:15.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:15.214 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.077260+0000", 2024-04-19T02:17:15.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:15.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:15.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.077260+0000", 2024-04-19T02:17:15.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:15.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:15.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.077259+0000", 2024-04-19T02:17:15.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:15.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:15.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.077267+0000", 2024-04-19T02:17:15.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6799999999999993e-06 2024-04-19T02:17:15.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:15.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117372+0000", 2024-04-19T02:17:15.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040105342000000002 2024-04-19T02:17:15.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117389+0000", 2024-04-19T02:17:15.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6711e-05 2024-04-19T02:17:15.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:15.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119862+0000", 2024-04-19T02:17:15.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0024730580000000002 2024-04-19T02:17:15.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:15.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119867+0000", 2024-04-19T02:17:15.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1590000000000001e-06 2024-04-19T02:17:15.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:15.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:15.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:15.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119873+0000", 2024-04-19T02:17:15.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1410000000000002e-06 2024-04-19T02:17:15.218 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:15.218 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:15.218 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:15.218 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:15.218 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:15.218 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:15.219 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:15.219+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:15.220 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:17:15.320 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:15.321+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:15.403 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:17:15.404 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:17:15.404 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.404 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:177648 5.8 5:15cb6857:::benchmark_data_smithi121_44835_object43613:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T02:17:15.404 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:15.400261+0000", 2024-04-19T02:17:15.404 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.003316154, 2024-04-19T02:17:15.404 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0033366260000000001, 2024-04-19T02:17:15.404 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:15.404 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:15.404 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:15.404 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:15.404 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:15.405 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 177648 2024-04-19T02:17:15.405 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.405 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:15.405 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.405 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:15.405 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.400261+0000", 2024-04-19T02:17:15.405 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.405 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.405 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.405 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:15.405 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.400261+0000", 2024-04-19T02:17:15.405 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.405 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.405 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.406 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:15.406 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.400260+0000", 2024-04-19T02:17:15.406 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:15.406 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.406 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.406 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:15.406 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.400265+0000", 2024-04-19T02:17:15.406 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.7520000000000004e-06 2024-04-19T02:17:15.406 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.406 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.406 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:15.406 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.400275+0000", 2024-04-19T02:17:15.406 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7089999999999997e-06 2024-04-19T02:17:15.406 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.407 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.407 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.407 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.400282+0000", 2024-04-19T02:17:15.407 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.9879999999999998e-06 2024-04-19T02:17:15.407 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.407 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.407 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:15.407 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.400972+0000", 2024-04-19T02:17:15.407 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00069054499999999998 2024-04-19T02:17:15.407 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.407 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.407 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:15.407 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.401118+0000", 2024-04-19T02:17:15.407 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014573400000000001 2024-04-19T02:17:15.407 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.408 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:15.408 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.408 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.408 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.408 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:177640 5.f e53/16 5:ff69716f:::benchmark_data_smithi121_44835_object43605:head v 53'11191, mlcod=53'11187)", 2024-04-19T02:17:15.408 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:15.400433+0000", 2024-04-19T02:17:15.408 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0031441659999999999, 2024-04-19T02:17:15.408 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.003212585, 2024-04-19T02:17:15.408 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:15.408 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:15.408 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:15.408 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.408 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:15.408 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.400433+0000", 2024-04-19T02:17:15.408 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.409 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.409 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.409 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:15.409 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.400433+0000", 2024-04-19T02:17:15.409 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.409 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.409 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.409 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:15.409 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.400433+0000", 2024-04-19T02:17:15.409 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:15.409 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.409 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.409 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:15.409 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.400439+0000", 2024-04-19T02:17:15.409 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.8839999999999997e-06 2024-04-19T02:17:15.409 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.410 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.410 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:15.410 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.400448+0000", 2024-04-19T02:17:15.410 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.7609999999999996e-06 2024-04-19T02:17:15.410 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.410 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.410 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.410 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.400453+0000", 2024-04-19T02:17:15.410 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2320000000000001e-06 2024-04-19T02:17:15.410 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.410 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.410 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:15.410 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.400484+0000", 2024-04-19T02:17:15.411 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0409999999999999e-05 2024-04-19T02:17:15.411 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.411 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.411 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:15.411 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.400502+0000", 2024-04-19T02:17:15.411 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.8569000000000001e-05 2024-04-19T02:17:15.411 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.411 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:15.411 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.411 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.411 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.411 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:177649 5.4 5:28da1a6e:::benchmark_data_smithi121_44835_object43614:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T02:17:15.411 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:15.401689+0000", 2024-04-19T02:17:15.411 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0018884590000000001, 2024-04-19T02:17:15.411 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0020050469999999998, 2024-04-19T02:17:15.412 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:15.412 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:15.412 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:15.412 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:15.412 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:15.412 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 177649 2024-04-19T02:17:15.412 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.412 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:15.412 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.412 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:15.412 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.401689+0000", 2024-04-19T02:17:15.412 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.412 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.412 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.412 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:15.413 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.401689+0000", 2024-04-19T02:17:15.413 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.413 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.413 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.413 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:15.413 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.401688+0000", 2024-04-19T02:17:15.413 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:15.413 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.413 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.413 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:15.413 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.401692+0000", 2024-04-19T02:17:15.413 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.07e-06 2024-04-19T02:17:15.413 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.413 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.413 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:15.414 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.401701+0000", 2024-04-19T02:17:15.414 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.7069999999999998e-06 2024-04-19T02:17:15.414 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.414 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.414 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.414 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.401708+0000", 2024-04-19T02:17:15.414 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.7619999999999998e-06 2024-04-19T02:17:15.414 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.414 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.414 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:15.414 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.401748+0000", 2024-04-19T02:17:15.414 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0673999999999997e-05 2024-04-19T02:17:15.414 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.414 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.414 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:15.415 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.401838+0000", 2024-04-19T02:17:15.415 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.9176000000000001e-05 2024-04-19T02:17:15.415 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.415 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:15.415 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.415 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.415 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.415 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:177650 5.0 5:0bc250b4:::benchmark_data_smithi121_44835_object43615:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T02:17:15.415 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:15.401718+0000", 2024-04-19T02:17:15.415 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0018596400000000001, 2024-04-19T02:17:15.416 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0020518670000000002, 2024-04-19T02:17:15.416 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:15.416 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:15.416 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:15.416 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:15.416 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:15.416 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 177650 2024-04-19T02:17:15.416 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.416 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:15.416 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.416 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:15.416 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.401718+0000", 2024-04-19T02:17:15.416 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.416 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.416 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.417 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:15.417 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.401718+0000", 2024-04-19T02:17:15.417 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.417 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.417 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.417 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:15.417 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.401717+0000", 2024-04-19T02:17:15.417 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:15.417 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.417 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.417 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:15.417 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.401719+0000", 2024-04-19T02:17:15.417 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.855e-06 2024-04-19T02:17:15.417 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.417 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.418 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:15.418 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.401724+0000", 2024-04-19T02:17:15.418 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.7859999999999996e-06 2024-04-19T02:17:15.418 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.418 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.418 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.418 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.401727+0000", 2024-04-19T02:17:15.418 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2430000000000001e-06 2024-04-19T02:17:15.418 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.418 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.418 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:15.418 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.401753+0000", 2024-04-19T02:17:15.418 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.5845000000000001e-05 2024-04-19T02:17:15.418 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.418 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.419 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:15.419 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.401840+0000", 2024-04-19T02:17:15.419 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.7323000000000004e-05 2024-04-19T02:17:15.419 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.419 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:15.419 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.419 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.419 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.419 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:177641 5.f e53/16 5:fcf74ecf:::benchmark_data_smithi121_44835_object43606:head v 53'11192, mlcod=53'11187)", 2024-04-19T02:17:15.419 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:15.401832+0000", 2024-04-19T02:17:15.419 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.00174537, 2024-04-19T02:17:15.419 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0020138349999999998, 2024-04-19T02:17:15.419 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:15.419 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:15.419 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:15.420 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.420 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:15.420 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.401832+0000", 2024-04-19T02:17:15.420 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.420 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.420 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.420 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:15.420 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.401832+0000", 2024-04-19T02:17:15.420 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.420 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.420 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.420 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:15.420 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.401831+0000", 2024-04-19T02:17:15.420 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:15.420 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.421 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.421 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:15.421 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.401837+0000", 2024-04-19T02:17:15.421 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.3040000000000004e-06 2024-04-19T02:17:15.421 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.421 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.421 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:15.421 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.401844+0000", 2024-04-19T02:17:15.421 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.2429999999999999e-06 2024-04-19T02:17:15.421 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.421 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.421 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.421 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.401850+0000", 2024-04-19T02:17:15.421 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.8880000000000002e-06 2024-04-19T02:17:15.421 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.422 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.422 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:15.422 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.401883+0000", 2024-04-19T02:17:15.422 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3581999999999998e-05 2024-04-19T02:17:15.422 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.422 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.422 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:15.422 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.401902+0000", 2024-04-19T02:17:15.422 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.8879e-05 2024-04-19T02:17:15.422 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.422 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:15.422 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.422 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.422 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.423 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:177655 5.e 5:76296aba:::benchmark_data_smithi121_44835_object43620:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T02:17:15.423 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:15.402692+0000", 2024-04-19T02:17:15.423 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.00088526999999999996, 2024-04-19T02:17:15.423 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0012233330000000001, 2024-04-19T02:17:15.423 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:15.423 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:15.423 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:15.423 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:15.423 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:15.424 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 177655 2024-04-19T02:17:15.424 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.424 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:15.424 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.424 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:15.424 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.402692+0000", 2024-04-19T02:17:15.424 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.424 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.424 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.424 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:15.424 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.402692+0000", 2024-04-19T02:17:15.424 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.424 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.424 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.425 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:15.425 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.402691+0000", 2024-04-19T02:17:15.425 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:15.425 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.425 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.425 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:15.425 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.402695+0000", 2024-04-19T02:17:15.425 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2740000000000001e-06 2024-04-19T02:17:15.425 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.425 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.425 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:15.425 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.402705+0000", 2024-04-19T02:17:15.425 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.645e-06 2024-04-19T02:17:15.425 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.425 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.426 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.426 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.402713+0000", 2024-04-19T02:17:15.426 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.7060000000000004e-06 2024-04-19T02:17:15.426 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.426 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.426 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:15.426 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.402753+0000", 2024-04-19T02:17:15.426 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0775000000000002e-05 2024-04-19T02:17:15.426 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.426 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.426 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:15.427 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.402865+0000", 2024-04-19T02:17:15.427 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000111308 2024-04-19T02:17:15.427 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.427 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:15.427 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.427 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.427 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.427 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:177656 5.0 5:0f043319:::benchmark_data_smithi121_44835_object43621:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T02:17:15.427 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:15.402787+0000", 2024-04-19T02:17:15.427 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.00079010400000000002, 2024-04-19T02:17:15.427 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001207297, 2024-04-19T02:17:15.427 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:15.427 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:15.427 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:15.427 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:15.428 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:15.428 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 177656 2024-04-19T02:17:15.428 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.428 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:15.428 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.428 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:15.428 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.402787+0000", 2024-04-19T02:17:15.428 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.428 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.428 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.428 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:15.428 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.402787+0000", 2024-04-19T02:17:15.428 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.428 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.428 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.429 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:15.429 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.402787+0000", 2024-04-19T02:17:15.429 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:15.429 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.429 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.429 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:15.429 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.402790+0000", 2024-04-19T02:17:15.429 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.118e-06 2024-04-19T02:17:15.429 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.429 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.429 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:15.429 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.402797+0000", 2024-04-19T02:17:15.429 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.4680000000000003e-06 2024-04-19T02:17:15.429 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.429 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.430 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.430 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.402804+0000", 2024-04-19T02:17:15.430 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.596e-06 2024-04-19T02:17:15.430 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.430 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.430 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:15.430 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.403698+0000", 2024-04-19T02:17:15.430 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00089416699999999997 2024-04-19T02:17:15.430 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.430 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.430 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:15.430 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.403842+0000", 2024-04-19T02:17:15.430 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000144055 2024-04-19T02:17:15.430 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.430 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:15.431 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.431 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.431 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.431 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:177654 5.9 e53/16 5:961545de:::benchmark_data_smithi121_44835_object43619:head v 53'11303, mlcod=53'11301)", 2024-04-19T02:17:15.431 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:15.402846+0000", 2024-04-19T02:17:15.431 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.00073142200000000002, 2024-04-19T02:17:15.431 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001223088, 2024-04-19T02:17:15.431 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:15.431 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:15.431 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:15.431 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.431 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:15.431 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.402846+0000", 2024-04-19T02:17:15.431 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.431 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.432 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.432 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:15.432 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.402846+0000", 2024-04-19T02:17:15.432 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.432 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.432 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.432 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:15.432 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.402845+0000", 2024-04-19T02:17:15.432 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:15.432 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.432 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.432 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:15.432 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.402850+0000", 2024-04-19T02:17:15.432 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2259999999999999e-06 2024-04-19T02:17:15.432 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.433 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.433 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:15.433 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.402856+0000", 2024-04-19T02:17:15.433 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.7410000000000003e-06 2024-04-19T02:17:15.433 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.433 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.433 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.433 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.402861+0000", 2024-04-19T02:17:15.433 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.1080000000000001e-06 2024-04-19T02:17:15.433 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.433 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.433 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:15.433 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.403268+0000", 2024-04-19T02:17:15.433 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000406981 2024-04-19T02:17:15.434 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.434 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.434 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:15.434 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.403286+0000", 2024-04-19T02:17:15.434 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.7991000000000001e-05 2024-04-19T02:17:15.434 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.434 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:15.434 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.434 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.434 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.435 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:177657 5.4 5:2e01598d:::benchmark_data_smithi121_44835_object43622:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T02:17:15.435 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:15.403294+0000", 2024-04-19T02:17:15.435 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.000283658, 2024-04-19T02:17:15.435 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000835832, 2024-04-19T02:17:15.435 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:15.435 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:15.435 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:15.435 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:15.435 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:15.435 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 177657 2024-04-19T02:17:15.435 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.435 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:15.435 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.436 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:15.436 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.403294+0000", 2024-04-19T02:17:15.436 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.436 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.436 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.436 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:15.436 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.403294+0000", 2024-04-19T02:17:15.436 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.436 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.436 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.436 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:15.436 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.403293+0000", 2024-04-19T02:17:15.436 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:15.436 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.436 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.437 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:15.437 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.403297+0000", 2024-04-19T02:17:15.437 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2490000000000003e-06 2024-04-19T02:17:15.437 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.437 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.437 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:15.437 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.403306+0000", 2024-04-19T02:17:15.437 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.5089999999999993e-06 2024-04-19T02:17:15.437 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.437 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.437 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.437 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.403312+0000", 2024-04-19T02:17:15.437 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6889999999999998e-06 2024-04-19T02:17:15.437 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.438 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.438 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:15.438 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.403700+0000", 2024-04-19T02:17:15.438 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00038733499999999999 2024-04-19T02:17:15.438 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.438 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.438 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:15.438 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.403822+0000", 2024-04-19T02:17:15.438 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012272499999999999 2024-04-19T02:17:15.438 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.438 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:15.438 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.438 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.438 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.439 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:177645 5.f e53/16 5:fdb8ce93:::benchmark_data_smithi121_44835_object43610:head v 53'11193, mlcod=53'11188)", 2024-04-19T02:17:15.439 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:15.403499+0000", 2024-04-19T02:17:15.439 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 7.8147999999999998e-05, 2024-04-19T02:17:15.439 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00069514999999999996, 2024-04-19T02:17:15.439 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:15.439 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:15.439 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:15.439 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.439 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:15.439 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.403499+0000", 2024-04-19T02:17:15.439 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.439 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.439 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.439 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:15.440 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.403499+0000", 2024-04-19T02:17:15.440 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.440 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.440 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.440 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:15.440 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.403499+0000", 2024-04-19T02:17:15.440 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:15.440 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.440 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.440 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:15.440 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.403503+0000", 2024-04-19T02:17:15.440 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.6890000000000003e-06 2024-04-19T02:17:15.440 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.440 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.440 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:15.441 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.403512+0000", 2024-04-19T02:17:15.441 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.7010000000000002e-06 2024-04-19T02:17:15.441 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.441 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.441 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.441 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.403518+0000", 2024-04-19T02:17:15.441 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.8200000000000002e-06 2024-04-19T02:17:15.441 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.441 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.441 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:15.441 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.403555+0000", 2024-04-19T02:17:15.441 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7311999999999998e-05 2024-04-19T02:17:15.441 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.441 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.442 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:15.442 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.403576+0000", 2024-04-19T02:17:15.442 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.0409999999999999e-05 2024-04-19T02:17:15.442 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.442 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:15.442 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.442 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.442 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.442 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:177636 5.0 5:09baedb1:::benchmark_data_smithi121_44835_object43601:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T02:17:15.442 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:15.396608+0000", 2024-04-19T02:17:15.442 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0069697969999999998, 2024-04-19T02:17:15.442 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.007654241, 2024-04-19T02:17:15.442 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:15.442 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:15.442 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:15.443 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:15.443 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:15.443 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 177636 2024-04-19T02:17:15.443 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.443 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:15.443 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.443 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:15.443 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.396608+0000", 2024-04-19T02:17:15.443 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.443 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.443 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.443 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:15.443 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.396608+0000", 2024-04-19T02:17:15.443 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.444 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.444 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.444 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:15.444 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.396607+0000", 2024-04-19T02:17:15.444 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:15.444 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.444 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.444 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:15.444 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.396611+0000", 2024-04-19T02:17:15.444 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2610000000000004e-06 2024-04-19T02:17:15.444 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.444 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.444 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:15.444 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.396620+0000", 2024-04-19T02:17:15.445 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2590000000000006e-06 2024-04-19T02:17:15.445 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.445 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.445 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.445 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.396630+0000", 2024-04-19T02:17:15.445 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.8179999999999999e-06 2024-04-19T02:17:15.445 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.445 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.445 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:15.445 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.396672+0000", 2024-04-19T02:17:15.445 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2258000000000001e-05 2024-04-19T02:17:15.445 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.445 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.446 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:15.446 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.396818+0000", 2024-04-19T02:17:15.446 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014536 2024-04-19T02:17:15.446 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.446 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:15.446 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.446 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.446 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.446 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:177642 5.8 5:1068feb1:::benchmark_data_smithi121_44835_object43607:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T02:17:15.446 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:15.398896+0000", 2024-04-19T02:17:15.446 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0046817569999999999, 2024-04-19T02:17:15.446 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0054325650000000003, 2024-04-19T02:17:15.446 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:15.446 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:15.447 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:15.447 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:15.447 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:15.447 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 177642 2024-04-19T02:17:15.447 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.447 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:15.447 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.447 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:15.447 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.398896+0000", 2024-04-19T02:17:15.447 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.447 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.447 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.447 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:15.447 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.398896+0000", 2024-04-19T02:17:15.448 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.448 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.448 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.448 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:15.448 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.398895+0000", 2024-04-19T02:17:15.448 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:15.448 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.448 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.448 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:15.448 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.398899+0000", 2024-04-19T02:17:15.448 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.799e-06 2024-04-19T02:17:15.448 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.448 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.448 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:15.449 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.398908+0000", 2024-04-19T02:17:15.449 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.4159999999999993e-06 2024-04-19T02:17:15.449 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.449 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.449 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.449 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.398915+0000", 2024-04-19T02:17:15.449 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6939999999999998e-06 2024-04-19T02:17:15.449 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.449 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.449 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:15.449 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.398957+0000", 2024-04-19T02:17:15.449 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2366000000000001e-05 2024-04-19T02:17:15.449 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.449 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.450 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:15.450 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:15.399094+0000", 2024-04-19T02:17:15.450 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000137133 2024-04-19T02:17:15.450 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.450 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:15.450 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.450 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.450 INFO:teuthology.orchestra.run.smithi174.stdout: ], 2024-04-19T02:17:15.450 INFO:teuthology.orchestra.run.smithi174.stdout: "num_ops": 12 2024-04-19T02:17:15.450 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:17:15.452 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:17:15.452 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:15.451+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:15.552 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:15.553+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:15.653 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:15.653+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:15.658 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:17:15.658 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [], 2024-04-19T02:17:15.659 INFO:teuthology.orchestra.run.smithi174.stdout: "complaint_time": 30, 2024-04-19T02:17:15.659 INFO:teuthology.orchestra.run.smithi174.stdout: "num_blocked_ops": 0 2024-04-19T02:17:15.659 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:17:15.671 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:17:15.754 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:15.755+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:15.855 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:15.856+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:15.886 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:17:15.886 INFO:teuthology.orchestra.run.smithi174.stdout: "size": 20, 2024-04-19T02:17:15.886 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 600, 2024-04-19T02:17:15.886 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:17:15.886 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.886 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:19 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:15.886 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:17:15.886 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 106.614361794, 2024-04-19T02:17:15.886 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020818203, 2024-04-19T02:17:15.886 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:15.886 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:15.887 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:15.887 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.887 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:15.887 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:17:15.887 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.887 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.887 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.887 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:15.887 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:17:15.887 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.887 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.887 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.887 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:15.887 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:17:15.888 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:15.888 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.888 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.888 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:15.888 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270065+0000", 2024-04-19T02:17:15.888 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4310000000000001e-06 2024-04-19T02:17:15.888 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.888 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.888 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:15.888 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270070+0000", 2024-04-19T02:17:15.888 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2859999999999999e-06 2024-04-19T02:17:15.888 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.888 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.888 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.888 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270077+0000", 2024-04-19T02:17:15.888 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5270000000000004e-06 2024-04-19T02:17:15.889 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.889 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.889 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:15.889 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270107+0000", 2024-04-19T02:17:15.889 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0205999999999998e-05 2024-04-19T02:17:15.889 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.889 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.889 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:15.889 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270111+0000", 2024-04-19T02:17:15.889 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8650000000000003e-06 2024-04-19T02:17:15.889 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.889 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.889 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:15.889 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285936+0000", 2024-04-19T02:17:15.889 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015824677999999998 2024-04-19T02:17:15.889 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.890 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.890 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:15.890 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286007+0000", 2024-04-19T02:17:15.890 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1157999999999999e-05 2024-04-19T02:17:15.890 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.890 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.890 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:15.890 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286086+0000", 2024-04-19T02:17:15.890 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9084000000000004e-05 2024-04-19T02:17:15.890 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.890 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.890 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:15.890 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290740+0000", 2024-04-19T02:17:15.890 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0046543679999999999 2024-04-19T02:17:15.891 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.891 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.891 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:15.891 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290833+0000", 2024-04-19T02:17:15.891 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2551000000000002e-05 2024-04-19T02:17:15.891 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.891 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.891 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:15.891 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290859+0000", 2024-04-19T02:17:15.891 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.6696999999999999e-05 2024-04-19T02:17:15.891 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.891 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.891 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:15.891 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290881+0000", 2024-04-19T02:17:15.891 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1653000000000001e-05 2024-04-19T02:17:15.891 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.892 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:15.892 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.892 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.892 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.892 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:77622 5.8 5:166fbe77:::benchmark_data_smithi121_44835_object77621:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:15.892 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:17:15.892 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 49.078864856999999, 2024-04-19T02:17:15.892 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.021784694, 2024-04-19T02:17:15.892 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:15.892 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:15.892 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:15.892 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:15.892 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:15.892 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 77622 2024-04-19T02:17:15.892 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.893 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:15.893 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.893 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:15.893 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:17:15.893 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.893 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.893 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.893 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:15.893 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:17:15.893 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.893 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.893 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.893 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:15.893 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805559+0000", 2024-04-19T02:17:15.893 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:15.894 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.894 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.894 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:15.894 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805659+0000", 2024-04-19T02:17:15.894 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.9908000000000006e-05 2024-04-19T02:17:15.894 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.894 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.894 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:15.894 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805668+0000", 2024-04-19T02:17:15.894 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2129999999999997e-06 2024-04-19T02:17:15.894 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.894 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.894 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.894 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805673+0000", 2024-04-19T02:17:15.895 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0370000000000002e-06 2024-04-19T02:17:15.895 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.895 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.895 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:15.895 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812022+0000", 2024-04-19T02:17:15.895 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0063483239999999998 2024-04-19T02:17:15.895 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.895 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.895 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:15.895 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812129+0000", 2024-04-19T02:17:15.895 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010744200000000001 2024-04-19T02:17:15.895 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.895 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.895 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:15.896 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812252+0000", 2024-04-19T02:17:15.896 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000122519 2024-04-19T02:17:15.896 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.896 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.896 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:15.896 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.820979+0000", 2024-04-19T02:17:15.896 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0087272740000000001 2024-04-19T02:17:15.896 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.896 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.896 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:15.896 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827270+0000", 2024-04-19T02:17:15.896 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0062906239999999999 2024-04-19T02:17:15.896 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.896 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.896 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:15.896 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827309+0000", 2024-04-19T02:17:15.897 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9678999999999997e-05 2024-04-19T02:17:15.897 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.897 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.897 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:15.897 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827345+0000", 2024-04-19T02:17:15.897 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5308000000000001e-05 2024-04-19T02:17:15.897 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.897 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:15.897 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.897 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.897 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.897 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78224 5.4 5:26e797d5:::benchmark_data_smithi121_44835_object78223:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:15.897 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:17:15.897 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 48.777862657999997, 2024-04-19T02:17:15.897 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.021471998999999999, 2024-04-19T02:17:15.897 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:15.898 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:15.898 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:15.898 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:15.898 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:15.898 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78224 2024-04-19T02:17:15.898 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.898 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:15.898 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.898 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:15.898 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:17:15.898 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.898 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.898 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.898 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:15.899 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:17:15.899 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.899 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.899 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.899 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:15.899 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106561+0000", 2024-04-19T02:17:15.899 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:15.899 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.899 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.899 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:15.899 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106630+0000", 2024-04-19T02:17:15.899 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.8553999999999994e-05 2024-04-19T02:17:15.899 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.899 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.899 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:15.899 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106644+0000", 2024-04-19T02:17:15.899 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.4651000000000001e-05 2024-04-19T02:17:15.899 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.900 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.900 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.900 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106653+0000", 2024-04-19T02:17:15.900 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.6719999999999993e-06 2024-04-19T02:17:15.900 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.900 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.900 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:15.900 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106693+0000", 2024-04-19T02:17:15.900 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9978999999999998e-05 2024-04-19T02:17:15.900 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.900 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.900 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:15.900 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106840+0000", 2024-04-19T02:17:15.900 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0001473 2024-04-19T02:17:15.900 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.901 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.901 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:15.901 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106971+0000", 2024-04-19T02:17:15.901 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013051499999999999 2024-04-19T02:17:15.901 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.901 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.901 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:15.901 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.109047+0000", 2024-04-19T02:17:15.901 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.002076002 2024-04-19T02:17:15.901 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.901 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.901 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:15.901 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.127967+0000", 2024-04-19T02:17:15.901 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.018919780000000001 2024-04-19T02:17:15.901 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.901 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.901 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:15.902 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128004+0000", 2024-04-19T02:17:15.902 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7719000000000003e-05 2024-04-19T02:17:15.902 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.902 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.902 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:15.902 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128034+0000", 2024-04-19T02:17:15.902 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9651000000000001e-05 2024-04-19T02:17:15.902 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.902 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:15.902 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.902 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.902 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.902 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78259 5.4 5:2aa344b2:::benchmark_data_smithi121_44835_object78258:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:15.902 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:17:15.902 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 48.759167589, 2024-04-19T02:17:15.902 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022934350999999999, 2024-04-19T02:17:15.903 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:15.903 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:15.903 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:15.903 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:15.903 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:15.903 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78259 2024-04-19T02:17:15.903 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.903 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:15.903 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.903 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:15.903 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:17:15.903 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.903 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.903 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.903 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:15.903 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:17:15.904 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.904 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.904 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.904 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:15.904 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125256+0000", 2024-04-19T02:17:15.904 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:15.904 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.904 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.904 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:15.904 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125347+0000", 2024-04-19T02:17:15.904 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0470000000000006e-05 2024-04-19T02:17:15.904 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.904 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.904 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:15.904 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125358+0000", 2024-04-19T02:17:15.904 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1764e-05 2024-04-19T02:17:15.905 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.905 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.905 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.905 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125364+0000", 2024-04-19T02:17:15.905 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7189999999999998e-06 2024-04-19T02:17:15.905 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.905 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.905 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:15.905 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125391+0000", 2024-04-19T02:17:15.905 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7270000000000001e-05 2024-04-19T02:17:15.905 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.905 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.905 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:15.905 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125471+0000", 2024-04-19T02:17:15.905 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9209999999999995e-05 2024-04-19T02:17:15.905 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.906 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.906 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:15.906 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125559+0000", 2024-04-19T02:17:15.906 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.8689000000000004e-05 2024-04-19T02:17:15.906 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.906 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.906 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:15.906 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128164+0000", 2024-04-19T02:17:15.906 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0026050270000000002 2024-04-19T02:17:15.906 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.906 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.906 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:15.906 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148139+0000", 2024-04-19T02:17:15.906 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.019975050000000001 2024-04-19T02:17:15.906 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.907 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.907 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:15.907 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148169+0000", 2024-04-19T02:17:15.907 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0001e-05 2024-04-19T02:17:15.907 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.907 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.907 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:15.907 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148191+0000", 2024-04-19T02:17:15.907 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.2104999999999999e-05 2024-04-19T02:17:15.907 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.907 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:15.907 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.907 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.907 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.907 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78271 5.4 5:2982d7a6:::benchmark_data_smithi121_44835_object78270:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:15.907 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:17:15.907 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 48.752304359, 2024-04-19T02:17:15.908 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020841755999999999, 2024-04-19T02:17:15.908 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:15.908 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:15.908 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:15.908 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:15.908 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:15.908 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78271 2024-04-19T02:17:15.908 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.908 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:15.908 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.908 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:15.908 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:17:15.908 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.908 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.908 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.909 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:15.909 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:17:15.909 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.909 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.909 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.909 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:15.909 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132119+0000", 2024-04-19T02:17:15.909 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:15.909 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.909 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.909 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:15.909 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132185+0000", 2024-04-19T02:17:15.909 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5994000000000005e-05 2024-04-19T02:17:15.909 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.909 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.909 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:15.909 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132197+0000", 2024-04-19T02:17:15.909 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2091e-05 2024-04-19T02:17:15.910 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.910 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.910 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.910 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132206+0000", 2024-04-19T02:17:15.910 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.5099999999999998e-06 2024-04-19T02:17:15.910 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.910 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.910 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:15.910 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132242+0000", 2024-04-19T02:17:15.910 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5663000000000001e-05 2024-04-19T02:17:15.910 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.910 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.910 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:15.910 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132335+0000", 2024-04-19T02:17:15.911 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3275000000000004e-05 2024-04-19T02:17:15.911 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.911 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.911 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:15.911 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132432+0000", 2024-04-19T02:17:15.911 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7571000000000005e-05 2024-04-19T02:17:15.911 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.911 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.911 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:15.911 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.136706+0000", 2024-04-19T02:17:15.911 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0042738170000000001 2024-04-19T02:17:15.911 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.911 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.911 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:15.911 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152909+0000", 2024-04-19T02:17:15.911 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016202415000000001 2024-04-19T02:17:15.911 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.912 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.912 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:15.912 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152938+0000", 2024-04-19T02:17:15.912 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9740999999999999e-05 2024-04-19T02:17:15.912 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.912 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.912 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:15.912 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152962+0000", 2024-04-19T02:17:15.912 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3659000000000002e-05 2024-04-19T02:17:15.912 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.912 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:15.912 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.912 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.912 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.912 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78272 5.4 5:273e819a:::benchmark_data_smithi121_44835_object78271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:15.912 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:15.912 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 48.751815315999998, 2024-04-19T02:17:15.912 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022180163999999999, 2024-04-19T02:17:15.913 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:15.913 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:15.913 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:15.913 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:15.913 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:15.913 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78272 2024-04-19T02:17:15.913 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.913 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:15.913 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.913 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:15.913 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:15.913 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.913 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.913 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.913 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:15.914 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:15.914 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.914 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.914 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.914 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:15.914 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:15.914 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:15.914 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.914 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.914 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:15.914 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132690+0000", 2024-04-19T02:17:15.914 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0963000000000004e-05 2024-04-19T02:17:15.914 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.914 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.914 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:15.915 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132703+0000", 2024-04-19T02:17:15.915 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.3072e-05 2024-04-19T02:17:15.915 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.915 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.915 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.915 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132710+0000", 2024-04-19T02:17:15.915 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3100000000000003e-06 2024-04-19T02:17:15.915 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.915 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.915 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:15.915 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134005+0000", 2024-04-19T02:17:15.915 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001294513 2024-04-19T02:17:15.915 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.915 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.915 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:15.915 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134139+0000", 2024-04-19T02:17:15.915 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000134447 2024-04-19T02:17:15.916 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.916 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.916 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:15.916 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134284+0000", 2024-04-19T02:17:15.916 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014514399999999999 2024-04-19T02:17:15.916 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.916 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.916 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:15.916 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.139622+0000", 2024-04-19T02:17:15.916 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0053373830000000002 2024-04-19T02:17:15.916 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.916 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.916 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:15.916 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154737+0000", 2024-04-19T02:17:15.916 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015115195999999999 2024-04-19T02:17:15.916 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.917 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.917 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:15.917 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154768+0000", 2024-04-19T02:17:15.917 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0824999999999997e-05 2024-04-19T02:17:15.917 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.917 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.917 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:15.917 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154790+0000", 2024-04-19T02:17:15.917 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1999000000000001e-05 2024-04-19T02:17:15.917 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.917 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:15.917 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.917 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.917 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.917 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:94481 5.e 5:7b2fbebf:::benchmark_data_smithi121_44835_object94480:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:15.917 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:17:15.917 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 40.763178998999997, 2024-04-19T02:17:15.918 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020897846000000001, 2024-04-19T02:17:15.918 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:15.918 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:15.918 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:15.918 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:15.918 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:15.918 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 94481 2024-04-19T02:17:15.918 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.918 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:15.918 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.918 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:15.918 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:17:15.918 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.918 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.919 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.919 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:15.919 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:17:15.919 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.919 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.919 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.919 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:15.919 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121245+0000", 2024-04-19T02:17:15.919 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:15.919 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.919 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.919 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:15.919 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121273+0000", 2024-04-19T02:17:15.919 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7250000000000002e-05 2024-04-19T02:17:15.919 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.919 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.920 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:15.920 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121277+0000", 2024-04-19T02:17:15.920 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2860000000000001e-06 2024-04-19T02:17:15.920 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.920 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.920 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.920 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121280+0000", 2024-04-19T02:17:15.920 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2739999999999999e-06 2024-04-19T02:17:15.920 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.920 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.920 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:15.920 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121320+0000", 2024-04-19T02:17:15.920 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9879000000000002e-05 2024-04-19T02:17:15.920 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.920 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.920 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:15.920 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121448+0000", 2024-04-19T02:17:15.920 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012748800000000001 2024-04-19T02:17:15.921 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.921 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.921 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:15.921 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121595+0000", 2024-04-19T02:17:15.921 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014741299999999999 2024-04-19T02:17:15.921 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.921 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.921 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:15.921 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.127776+0000", 2024-04-19T02:17:15.921 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0061811360000000003 2024-04-19T02:17:15.921 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.921 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.921 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:15.921 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142073+0000", 2024-04-19T02:17:15.921 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014296959999999999 2024-04-19T02:17:15.921 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.922 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.922 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:15.922 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142106+0000", 2024-04-19T02:17:15.922 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3348e-05 2024-04-19T02:17:15.922 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.922 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.922 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:15.922 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142144+0000", 2024-04-19T02:17:15.922 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7153000000000002e-05 2024-04-19T02:17:15.922 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.922 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:15.922 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.922 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.922 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.922 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:94581 5.b 5:dc86d6e9:::benchmark_data_smithi121_44835_object94580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:15.923 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:15.923 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 40.704244426000002, 2024-04-19T02:17:15.923 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022099711000000001, 2024-04-19T02:17:15.923 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:15.923 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:15.923 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:15.923 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:15.923 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:15.923 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 94581 2024-04-19T02:17:15.923 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.923 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:15.923 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.923 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:15.923 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:15.923 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.923 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.923 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.924 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:15.924 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:15.924 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.924 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.924 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.924 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:15.924 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:15.924 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:15.924 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.924 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.924 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:15.924 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180253+0000", 2024-04-19T02:17:15.924 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3163000000000004e-05 2024-04-19T02:17:15.924 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.924 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.924 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:15.925 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180266+0000", 2024-04-19T02:17:15.925 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2886e-05 2024-04-19T02:17:15.925 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.925 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.925 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.925 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180273+0000", 2024-04-19T02:17:15.925 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.4059999999999999e-06 2024-04-19T02:17:15.925 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.925 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.925 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:15.925 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180646+0000", 2024-04-19T02:17:15.925 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00037283999999999999 2024-04-19T02:17:15.925 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.925 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.925 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:15.925 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180774+0000", 2024-04-19T02:17:15.925 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012793799999999999 2024-04-19T02:17:15.926 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.926 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.926 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:15.926 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180920+0000", 2024-04-19T02:17:15.926 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000146692 2024-04-19T02:17:15.926 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.926 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.926 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:15.926 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.183344+0000", 2024-04-19T02:17:15.926 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0024231669999999999 2024-04-19T02:17:15.926 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.926 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.926 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:15.926 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202196+0000", 2024-04-19T02:17:15.927 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.018852384 2024-04-19T02:17:15.927 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.927 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.927 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:15.927 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202241+0000", 2024-04-19T02:17:15.927 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4923999999999999e-05 2024-04-19T02:17:15.927 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.927 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.927 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:15.927 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202280+0000", 2024-04-19T02:17:15.927 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9096e-05 2024-04-19T02:17:15.927 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.927 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:15.927 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.927 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.927 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.927 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:96356 5.0 5:0a661b39:::benchmark_data_smithi121_44835_object96355:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:15.928 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:17:15.928 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 39.791031584000002, 2024-04-19T02:17:15.928 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020955516, 2024-04-19T02:17:15.928 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:15.928 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:15.928 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:15.928 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:15.928 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:15.928 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 96356 2024-04-19T02:17:15.928 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.928 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:15.928 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.928 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:15.928 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:17:15.928 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.928 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.929 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.929 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:15.929 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:17:15.929 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.929 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.929 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.929 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:15.929 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:17:15.929 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:15.929 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.929 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.929 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:15.929 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093455+0000", 2024-04-19T02:17:15.929 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.2205000000000005e-05 2024-04-19T02:17:15.929 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.930 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.930 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:15.930 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093464+0000", 2024-04-19T02:17:15.930 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3910000000000004e-06 2024-04-19T02:17:15.930 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.930 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.930 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.930 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093469+0000", 2024-04-19T02:17:15.930 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.7249999999999997e-06 2024-04-19T02:17:15.930 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.930 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.930 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:15.930 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099643+0000", 2024-04-19T02:17:15.930 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0061743359999999999 2024-04-19T02:17:15.930 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.930 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.931 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:15.931 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099774+0000", 2024-04-19T02:17:15.931 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013050599999999999 2024-04-19T02:17:15.931 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.931 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.931 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:15.931 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099917+0000", 2024-04-19T02:17:15.931 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000143187 2024-04-19T02:17:15.931 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.931 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.931 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:15.931 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.105432+0000", 2024-04-19T02:17:15.931 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.005514873 2024-04-19T02:17:15.931 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.931 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.931 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:15.931 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114264+0000", 2024-04-19T02:17:15.932 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.008831752 2024-04-19T02:17:15.932 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.932 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.932 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:15.932 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114300+0000", 2024-04-19T02:17:15.932 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6582000000000003e-05 2024-04-19T02:17:15.932 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.932 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.932 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:15.932 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114349+0000", 2024-04-19T02:17:15.932 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8579999999999999e-05 2024-04-19T02:17:15.932 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.932 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:15.932 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.932 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.932 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.932 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:96357 5.0 5:00efce8b:::benchmark_data_smithi121_44835_object96356:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:15.932 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:17:15.933 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 39.790951905999997, 2024-04-19T02:17:15.933 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020937471999999999, 2024-04-19T02:17:15.933 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:15.933 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:15.933 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:15.933 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:15.933 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:15.933 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 96357 2024-04-19T02:17:15.933 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.933 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:15.933 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.933 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:15.933 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:17:15.933 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.933 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.933 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.933 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:15.934 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:17:15.934 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.934 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.934 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.934 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:15.934 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093472+0000", 2024-04-19T02:17:15.934 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:15.934 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.934 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.934 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:15.934 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093513+0000", 2024-04-19T02:17:15.934 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0213000000000003e-05 2024-04-19T02:17:15.934 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.934 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.934 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:15.935 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093519+0000", 2024-04-19T02:17:15.935 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.066e-06 2024-04-19T02:17:15.935 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.935 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.935 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.935 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093525+0000", 2024-04-19T02:17:15.935 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.8170000000000004e-06 2024-04-19T02:17:15.935 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.935 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.935 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:15.935 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103412+0000", 2024-04-19T02:17:15.935 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0098872739999999997 2024-04-19T02:17:15.935 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.935 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.935 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:15.935 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103551+0000", 2024-04-19T02:17:15.936 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000139295 2024-04-19T02:17:15.936 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.936 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.936 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:15.936 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103701+0000", 2024-04-19T02:17:15.936 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014954599999999999 2024-04-19T02:17:15.936 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.936 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.936 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:15.936 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.108849+0000", 2024-04-19T02:17:15.936 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0051487199999999999 2024-04-19T02:17:15.936 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.936 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.936 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:15.936 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114355+0000", 2024-04-19T02:17:15.936 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0055052529999999999 2024-04-19T02:17:15.936 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.937 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.937 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:15.937 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114379+0000", 2024-04-19T02:17:15.937 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4275000000000001e-05 2024-04-19T02:17:15.937 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.937 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.937 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:15.937 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114410+0000", 2024-04-19T02:17:15.937 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1356999999999998e-05 2024-04-19T02:17:15.937 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.937 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:15.937 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.937 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.937 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.937 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:104431 5.8 5:14818e19:::benchmark_data_smithi121_44835_object104430:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T02:17:15.937 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:17:15.938 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 35.673039381000002, 2024-04-19T02:17:15.938 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022149528000000002, 2024-04-19T02:17:15.938 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:15.938 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:15.938 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:15.938 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:15.938 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:15.938 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 104431 2024-04-19T02:17:15.938 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.938 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:15.938 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.938 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:15.938 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:17:15.938 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.938 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.939 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.939 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:15.939 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:17:15.939 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.939 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.939 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.939 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:15.939 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211384+0000", 2024-04-19T02:17:15.939 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:15.939 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.939 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.939 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:15.939 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211458+0000", 2024-04-19T02:17:15.939 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3311000000000003e-05 2024-04-19T02:17:15.939 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.940 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.940 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:15.940 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211471+0000", 2024-04-19T02:17:15.940 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.3308e-05 2024-04-19T02:17:15.940 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.940 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.940 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.940 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211479+0000", 2024-04-19T02:17:15.940 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0909999999999993e-06 2024-04-19T02:17:15.940 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.940 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.940 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:15.940 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.221821+0000", 2024-04-19T02:17:15.940 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010341596999999999 2024-04-19T02:17:15.940 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.941 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.941 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:15.941 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.221966+0000", 2024-04-19T02:17:15.941 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000145167 2024-04-19T02:17:15.941 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.941 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.941 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:15.941 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.222077+0000", 2024-04-19T02:17:15.941 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011128000000000001 2024-04-19T02:17:15.941 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.941 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.941 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:15.941 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.228126+0000", 2024-04-19T02:17:15.941 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0060486710000000003 2024-04-19T02:17:15.941 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.941 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.942 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:15.942 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233449+0000", 2024-04-19T02:17:15.942 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0053231370000000004 2024-04-19T02:17:15.942 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.942 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.942 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:15.942 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233498+0000", 2024-04-19T02:17:15.942 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8798999999999998e-05 2024-04-19T02:17:15.942 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.942 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.942 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:15.942 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233535+0000", 2024-04-19T02:17:15.942 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7119000000000002e-05 2024-04-19T02:17:15.942 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.943 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:15.943 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.943 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.943 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.943 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157437 5.e 5:78833a3d:::benchmark_data_smithi121_44835_object23402:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:15.943 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.859854+0000", 2024-04-19T02:17:15.943 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 9.0245706089999995, 2024-04-19T02:17:15.943 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.025859589999999998, 2024-04-19T02:17:15.943 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:15.943 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:15.943 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:15.943 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:15.943 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:15.943 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157437 2024-04-19T02:17:15.943 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.943 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:15.944 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.944 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:15.944 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859854+0000", 2024-04-19T02:17:15.944 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.944 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.944 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.944 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:15.944 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859854+0000", 2024-04-19T02:17:15.944 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.944 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.944 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.944 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:15.944 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859853+0000", 2024-04-19T02:17:15.944 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:15.945 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.945 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.945 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:15.945 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859857+0000", 2024-04-19T02:17:15.945 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8789999999999996e-06 2024-04-19T02:17:15.945 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.945 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.945 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:15.945 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859865+0000", 2024-04-19T02:17:15.945 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.1880000000000002e-06 2024-04-19T02:17:15.945 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.945 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.945 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.945 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859873+0000", 2024-04-19T02:17:15.945 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.2980000000000003e-06 2024-04-19T02:17:15.946 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.946 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.946 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:15.946 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859908+0000", 2024-04-19T02:17:15.946 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5682999999999997e-05 2024-04-19T02:17:15.946 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.946 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.946 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:15.946 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.860046+0000", 2024-04-19T02:17:15.946 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013714200000000001 2024-04-19T02:17:15.946 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.946 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.946 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:15.946 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.860153+0000", 2024-04-19T02:17:15.946 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010725700000000001 2024-04-19T02:17:15.947 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.947 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.947 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:15.947 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.862008+0000", 2024-04-19T02:17:15.947 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001855179 2024-04-19T02:17:15.947 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.947 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.947 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:15.947 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.885629+0000", 2024-04-19T02:17:15.947 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.023621428 2024-04-19T02:17:15.947 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.947 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.947 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:15.947 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.885676+0000", 2024-04-19T02:17:15.947 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.6371e-05 2024-04-19T02:17:15.947 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.948 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.948 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:15.948 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.885714+0000", 2024-04-19T02:17:15.948 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7907000000000001e-05 2024-04-19T02:17:15.948 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.948 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:15.948 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.948 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.948 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.948 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157438 5.0 5:01944e77:::benchmark_data_smithi121_44835_object23403:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:15.948 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.864095+0000", 2024-04-19T02:17:15.948 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 9.0203293250000005, 2024-04-19T02:17:15.948 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.032015298999999997, 2024-04-19T02:17:15.948 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:15.948 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:15.949 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:15.949 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:15.949 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:15.949 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157438 2024-04-19T02:17:15.949 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.949 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:15.949 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.949 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:15.949 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864095+0000", 2024-04-19T02:17:15.949 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.949 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.949 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.949 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:15.949 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864095+0000", 2024-04-19T02:17:15.949 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.949 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.949 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.949 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:15.950 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864094+0000", 2024-04-19T02:17:15.950 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:15.950 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.950 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.950 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:15.950 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864102+0000", 2024-04-19T02:17:15.950 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.6629999999999993e-06 2024-04-19T02:17:15.950 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.950 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.950 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:15.950 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864113+0000", 2024-04-19T02:17:15.950 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1185999999999999e-05 2024-04-19T02:17:15.950 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.950 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.950 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.950 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864119+0000", 2024-04-19T02:17:15.951 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.224e-06 2024-04-19T02:17:15.951 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.951 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.951 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:15.951 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864151+0000", 2024-04-19T02:17:15.951 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1395e-05 2024-04-19T02:17:15.951 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.951 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.951 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:15.951 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864275+0000", 2024-04-19T02:17:15.951 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012431399999999999 2024-04-19T02:17:15.951 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.951 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.951 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:15.951 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864341+0000", 2024-04-19T02:17:15.951 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6146e-05 2024-04-19T02:17:15.952 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.952 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.952 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:15.952 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.866040+0000", 2024-04-19T02:17:15.952 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016991879999999999 2024-04-19T02:17:15.952 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.952 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.952 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:15.952 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896055+0000", 2024-04-19T02:17:15.952 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.030014886000000001 2024-04-19T02:17:15.952 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.952 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.952 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:15.952 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896087+0000", 2024-04-19T02:17:15.952 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1761000000000003e-05 2024-04-19T02:17:15.952 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.952 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.953 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:15.953 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896111+0000", 2024-04-19T02:17:15.953 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3623999999999999e-05 2024-04-19T02:17:15.953 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.953 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:15.953 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.953 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.953 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.953 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157439 5.e 5:79eb9d3c:::benchmark_data_smithi121_44835_object23404:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:15.953 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:15.953 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 9.0202982499999997, 2024-04-19T02:17:15.953 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.027045244, 2024-04-19T02:17:15.953 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:15.953 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:15.953 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:15.954 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:15.954 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:15.954 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157439 2024-04-19T02:17:15.954 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.954 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:15.954 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.954 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:15.954 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:15.954 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.954 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.954 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.954 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:15.954 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:15.954 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.954 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.954 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.955 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:15.955 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:15.955 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:15.955 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.955 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.955 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:15.955 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864128+0000", 2024-04-19T02:17:15.955 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.911e-06 2024-04-19T02:17:15.955 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.955 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.955 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:15.955 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864136+0000", 2024-04-19T02:17:15.955 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2609999999999993e-06 2024-04-19T02:17:15.955 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.955 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.955 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.955 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864140+0000", 2024-04-19T02:17:15.956 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5530000000000001e-06 2024-04-19T02:17:15.956 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.956 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.956 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:15.956 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864169+0000", 2024-04-19T02:17:15.956 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.8932e-05 2024-04-19T02:17:15.956 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.956 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.956 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:15.956 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864267+0000", 2024-04-19T02:17:15.956 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7969999999999999e-05 2024-04-19T02:17:15.956 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.956 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.956 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:15.956 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864339+0000", 2024-04-19T02:17:15.956 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.2280999999999995e-05 2024-04-19T02:17:15.956 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.957 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.957 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:15.957 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.865763+0000", 2024-04-19T02:17:15.957 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0014236310000000001 2024-04-19T02:17:15.957 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.957 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.957 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:15.957 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.891093+0000", 2024-04-19T02:17:15.957 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.025330571 2024-04-19T02:17:15.957 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.957 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.957 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:15.957 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.891137+0000", 2024-04-19T02:17:15.957 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3980999999999998e-05 2024-04-19T02:17:15.957 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.957 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.958 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:15.958 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.891172+0000", 2024-04-19T02:17:15.958 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4465000000000003e-05 2024-04-19T02:17:15.958 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.958 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:15.958 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.958 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.958 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.958 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157442 5.0 5:0062b73f:::benchmark_data_smithi121_44835_object23407:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:15.958 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.867065+0000", 2024-04-19T02:17:15.958 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 9.0173596000000007, 2024-04-19T02:17:15.958 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.029165542999999999, 2024-04-19T02:17:15.958 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:15.958 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:15.959 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:15.959 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:15.959 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:15.959 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157442 2024-04-19T02:17:15.959 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.959 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:15.959 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.959 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:15.959 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867065+0000", 2024-04-19T02:17:15.959 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.959 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.959 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.959 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:15.959 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867065+0000", 2024-04-19T02:17:15.959 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.959 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.960 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.960 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:15.960 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867064+0000", 2024-04-19T02:17:15.960 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:15.960 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.960 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.960 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:15.960 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867069+0000", 2024-04-19T02:17:15.960 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4549999999999997e-06 2024-04-19T02:17:15.960 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.960 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.960 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:15.960 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867080+0000", 2024-04-19T02:17:15.960 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0797e-05 2024-04-19T02:17:15.960 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.960 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.961 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.961 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867088+0000", 2024-04-19T02:17:15.961 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9729999999999997e-06 2024-04-19T02:17:15.961 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.961 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.961 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:15.961 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867121+0000", 2024-04-19T02:17:15.961 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2920000000000003e-05 2024-04-19T02:17:15.961 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.961 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.961 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:15.961 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867203+0000", 2024-04-19T02:17:15.961 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2578999999999997e-05 2024-04-19T02:17:15.961 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.961 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.962 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:15.962 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867386+0000", 2024-04-19T02:17:15.962 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00018237400000000001 2024-04-19T02:17:15.962 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.962 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.962 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:15.962 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.869338+0000", 2024-04-19T02:17:15.962 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0019521160000000001 2024-04-19T02:17:15.962 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.962 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.962 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:15.962 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896150+0000", 2024-04-19T02:17:15.962 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.026812074000000002 2024-04-19T02:17:15.962 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.962 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.963 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:15.963 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896191+0000", 2024-04-19T02:17:15.963 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1192000000000001e-05 2024-04-19T02:17:15.963 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.963 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.963 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:15.963 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896231+0000", 2024-04-19T02:17:15.963 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9764000000000001e-05 2024-04-19T02:17:15.963 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.963 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:15.963 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.963 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.963 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.963 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157499 5.8 5:1c3aa38a:::benchmark_data_smithi121_44835_object23464:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:15.963 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.913447+0000", 2024-04-19T02:17:15.963 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 8.9709780279999993, 2024-04-19T02:17:15.964 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.024508188, 2024-04-19T02:17:15.964 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:15.964 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:15.964 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:15.964 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:15.964 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:15.964 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157499 2024-04-19T02:17:15.964 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.964 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:15.964 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.964 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:15.964 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913447+0000", 2024-04-19T02:17:15.964 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.964 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.964 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.964 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:15.965 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913447+0000", 2024-04-19T02:17:15.965 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.965 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.965 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.965 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:15.965 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913446+0000", 2024-04-19T02:17:15.965 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:15.965 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.965 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.965 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:15.965 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913451+0000", 2024-04-19T02:17:15.965 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.677e-06 2024-04-19T02:17:15.965 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.965 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.965 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:15.965 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913461+0000", 2024-04-19T02:17:15.965 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.8859999999999999e-06 2024-04-19T02:17:15.966 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.966 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.966 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.966 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913467+0000", 2024-04-19T02:17:15.966 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.0800000000000002e-06 2024-04-19T02:17:15.966 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.966 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.966 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:15.966 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913513+0000", 2024-04-19T02:17:15.966 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.5707000000000001e-05 2024-04-19T02:17:15.966 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.966 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.966 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:15.966 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913637+0000", 2024-04-19T02:17:15.967 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012379200000000001 2024-04-19T02:17:15.967 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.967 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.967 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:15.967 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913747+0000", 2024-04-19T02:17:15.967 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000110071 2024-04-19T02:17:15.967 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.967 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.967 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:15.967 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915674+0000", 2024-04-19T02:17:15.967 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0019270789999999999 2024-04-19T02:17:15.967 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.967 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.967 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:15.967 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937902+0000", 2024-04-19T02:17:15.967 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022228286 2024-04-19T02:17:15.968 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.968 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.968 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:15.968 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937931+0000", 2024-04-19T02:17:15.968 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9122e-05 2024-04-19T02:17:15.968 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.968 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.968 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:15.968 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937955+0000", 2024-04-19T02:17:15.968 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3591000000000002e-05 2024-04-19T02:17:15.968 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.968 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:15.968 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.968 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.968 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.969 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157500 5.0 5:0969ec74:::benchmark_data_smithi121_44835_object23465:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:15.969 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.913476+0000", 2024-04-19T02:17:15.969 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 8.9709491620000001, 2024-04-19T02:17:15.969 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.024497596, 2024-04-19T02:17:15.969 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:15.969 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:15.969 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:15.969 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:15.969 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:15.969 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157500 2024-04-19T02:17:15.969 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.969 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:15.969 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.969 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:15.969 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913476+0000", 2024-04-19T02:17:15.969 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.970 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.970 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.970 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:15.970 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913476+0000", 2024-04-19T02:17:15.970 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.970 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.970 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.970 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:15.970 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913475+0000", 2024-04-19T02:17:15.970 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:15.970 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.970 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.970 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:15.971 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913478+0000", 2024-04-19T02:17:15.971 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.2670000000000001e-06 2024-04-19T02:17:15.971 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.971 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.971 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:15.971 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913481+0000", 2024-04-19T02:17:15.971 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6899999999999998e-06 2024-04-19T02:17:15.971 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.971 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.971 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.971 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913485+0000", 2024-04-19T02:17:15.971 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1230000000000002e-06 2024-04-19T02:17:15.971 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.971 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.971 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:15.972 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913526+0000", 2024-04-19T02:17:15.972 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.104e-05 2024-04-19T02:17:15.972 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.972 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.972 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:15.972 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913606+0000", 2024-04-19T02:17:15.972 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9510000000000003e-05 2024-04-19T02:17:15.972 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.972 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.972 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:15.972 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913671+0000", 2024-04-19T02:17:15.972 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.4838000000000005e-05 2024-04-19T02:17:15.972 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.972 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.972 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:15.972 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915348+0000", 2024-04-19T02:17:15.973 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016769860000000001 2024-04-19T02:17:15.973 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.973 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.973 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:15.973 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937897+0000", 2024-04-19T02:17:15.973 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022548902999999999 2024-04-19T02:17:15.973 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.973 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.973 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:15.973 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937938+0000", 2024-04-19T02:17:15.973 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1499999999999999e-05 2024-04-19T02:17:15.973 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.973 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.973 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:15.973 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937973+0000", 2024-04-19T02:17:15.973 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5057e-05 2024-04-19T02:17:15.974 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.974 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:15.974 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.974 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.974 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.974 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157501 5.4 5:26661819:::benchmark_data_smithi121_44835_object23466:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:15.974 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.914839+0000", 2024-04-19T02:17:15.974 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 8.9695858679999994, 2024-04-19T02:17:15.974 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.028504224000000002, 2024-04-19T02:17:15.974 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:15.974 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:15.974 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:15.974 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:15.974 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:15.975 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157501 2024-04-19T02:17:15.975 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.975 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:15.975 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.975 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:15.975 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914839+0000", 2024-04-19T02:17:15.975 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.975 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.975 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.975 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:15.975 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914839+0000", 2024-04-19T02:17:15.975 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.975 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.975 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.975 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:15.975 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914838+0000", 2024-04-19T02:17:15.976 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:15.976 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.976 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.976 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:15.976 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914841+0000", 2024-04-19T02:17:15.976 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.706e-06 2024-04-19T02:17:15.976 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.976 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.976 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:15.976 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914848+0000", 2024-04-19T02:17:15.976 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.7429999999999996e-06 2024-04-19T02:17:15.976 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.976 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.976 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.976 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914852+0000", 2024-04-19T02:17:15.976 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0810000000000004e-06 2024-04-19T02:17:15.977 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.977 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.977 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:15.977 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914892+0000", 2024-04-19T02:17:15.977 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9957999999999999e-05 2024-04-19T02:17:15.977 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.977 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.977 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:15.977 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915008+0000", 2024-04-19T02:17:15.977 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000116401 2024-04-19T02:17:15.977 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.977 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.977 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:15.977 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915125+0000", 2024-04-19T02:17:15.977 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011622500000000001 2024-04-19T02:17:15.977 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.978 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.978 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:15.978 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916663+0000", 2024-04-19T02:17:15.978 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0015381310000000001 2024-04-19T02:17:15.978 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.978 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.978 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:15.978 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943114+0000", 2024-04-19T02:17:15.978 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.026451125999999998 2024-04-19T02:17:15.978 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.978 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.978 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:15.978 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943245+0000", 2024-04-19T02:17:15.978 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000131645 2024-04-19T02:17:15.979 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.979 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.979 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:15.979 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943343+0000", 2024-04-19T02:17:15.979 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7604999999999998e-05 2024-04-19T02:17:15.979 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.979 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:15.979 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.979 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.979 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.979 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157507 5.b 5:de8840a2:::benchmark_data_smithi121_44835_object23472:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:15.979 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:15.979 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 8.9680215869999991, 2024-04-19T02:17:15.979 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022544518999999999, 2024-04-19T02:17:15.979 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:15.979 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:15.980 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:15.980 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:15.980 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:15.980 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157507 2024-04-19T02:17:15.980 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.980 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:15.980 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.980 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:15.980 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:15.980 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.980 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.980 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.980 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:15.980 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:15.980 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.980 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.981 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.981 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:15.981 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:15.981 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:15.981 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.981 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.981 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:15.981 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916406+0000", 2024-04-19T02:17:15.981 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4589999999999998e-06 2024-04-19T02:17:15.981 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.981 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.981 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:15.981 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916415+0000", 2024-04-19T02:17:15.981 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3910000000000004e-06 2024-04-19T02:17:15.981 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.981 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.982 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.982 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916421+0000", 2024-04-19T02:17:15.982 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.6130000000000003e-06 2024-04-19T02:17:15.982 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.982 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.982 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:15.982 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916448+0000", 2024-04-19T02:17:15.982 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7277999999999999e-05 2024-04-19T02:17:15.982 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.982 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.982 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:15.982 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916539+0000", 2024-04-19T02:17:15.982 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0855999999999999e-05 2024-04-19T02:17:15.982 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.983 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.983 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:15.983 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916605+0000", 2024-04-19T02:17:15.983 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6141000000000003e-05 2024-04-19T02:17:15.983 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.983 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.983 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:15.983 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918276+0000", 2024-04-19T02:17:15.983 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001670726 2024-04-19T02:17:15.983 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.983 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.983 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:15.983 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.938888+0000", 2024-04-19T02:17:15.983 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020612042000000001 2024-04-19T02:17:15.983 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.983 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.984 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:15.984 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.938924+0000", 2024-04-19T02:17:15.984 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5692999999999999e-05 2024-04-19T02:17:15.984 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.984 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.984 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:15.984 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.938948+0000", 2024-04-19T02:17:15.984 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3879e-05 2024-04-19T02:17:15.984 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.984 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:15.984 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.984 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.984 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.984 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157509 5.8 5:1dca85d0:::benchmark_data_smithi121_44835_object23474:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:15.984 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:15.985 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 8.9655933409999999, 2024-04-19T02:17:15.985 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.024511807, 2024-04-19T02:17:15.985 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:15.985 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:15.985 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:15.985 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:15.985 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:15.985 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157509 2024-04-19T02:17:15.985 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.985 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:15.985 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.985 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:15.985 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:15.985 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.985 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.985 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.985 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:15.986 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:15.986 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:15.986 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.986 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.986 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:15.986 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:15.986 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:15.986 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.986 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.986 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:15.986 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918834+0000", 2024-04-19T02:17:15.986 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9409999999999999e-06 2024-04-19T02:17:15.986 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.986 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.986 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:15.986 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918859+0000", 2024-04-19T02:17:15.987 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.5245999999999999e-05 2024-04-19T02:17:15.987 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.987 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.987 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:15.987 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918864+0000", 2024-04-19T02:17:15.987 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.1819999999999997e-06 2024-04-19T02:17:15.987 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.987 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.987 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:15.987 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918900+0000", 2024-04-19T02:17:15.987 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5327000000000002e-05 2024-04-19T02:17:15.987 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.987 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.987 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:15.987 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.919024+0000", 2024-04-19T02:17:15.987 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012400900000000001 2024-04-19T02:17:15.987 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.988 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.988 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:15.988 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.919136+0000", 2024-04-19T02:17:15.988 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000111987 2024-04-19T02:17:15.988 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.988 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.988 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:15.988 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.922096+0000", 2024-04-19T02:17:15.988 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0029607079999999998 2024-04-19T02:17:15.988 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.988 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.988 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:15.988 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943120+0000", 2024-04-19T02:17:15.988 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.021023995 2024-04-19T02:17:15.988 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.989 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.989 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:15.989 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943255+0000", 2024-04-19T02:17:15.989 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013502100000000001 2024-04-19T02:17:15.989 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:15.989 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:15.989 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:15.989 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943343+0000", 2024-04-19T02:17:15.989 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.7931999999999998e-05 2024-04-19T02:17:15.989 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.989 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:15.989 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.989 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:15.989 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:15.989 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:17:15.991 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:15.991+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:15.991 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:16.092 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:16.092+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:16.167 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:16.167 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:17:16.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.167 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:179757 5.f 5:f4fe69f4:::benchmark_data_smithi121_44835_object45722:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T02:17:16.167 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:16.160362+0000", 2024-04-19T02:17:16.167 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0062550180000000002, 2024-04-19T02:17:16.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0062816690000000001, 2024-04-19T02:17:16.167 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:16.167 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:16.167 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:16.167 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:16.167 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:16.168 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 179757 2024-04-19T02:17:16.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.168 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:16.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:16.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.160362+0000", 2024-04-19T02:17:16.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:16.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:16.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.160362+0000", 2024-04-19T02:17:16.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:16.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:16.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.160362+0000", 2024-04-19T02:17:16.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:16.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:16.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.160365+0000", 2024-04-19T02:17:16.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1889999999999999e-06 2024-04-19T02:17:16.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:16.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.160374+0000", 2024-04-19T02:17:16.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7139999999999999e-06 2024-04-19T02:17:16.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:16.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.160378+0000", 2024-04-19T02:17:16.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9040000000000002e-06 2024-04-19T02:17:16.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:16.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.160394+0000", 2024-04-19T02:17:16.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6599000000000002e-05 2024-04-19T02:17:16.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:16.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.160462+0000", 2024-04-19T02:17:16.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7892999999999995e-05 2024-04-19T02:17:16.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:16.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.160523+0000", 2024-04-19T02:17:16.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0684999999999999e-05 2024-04-19T02:17:16.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:16.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.163791+0000", 2024-04-19T02:17:16.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032678270000000001 2024-04-19T02:17:16.171 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:16.171 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:16.171 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:16.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.171 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:179758 5.d 5:b1d066b6:::benchmark_data_smithi121_44835_object45723:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T02:17:16.171 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:16.160385+0000", 2024-04-19T02:17:16.172 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0062321449999999997, 2024-04-19T02:17:16.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0063543970000000003, 2024-04-19T02:17:16.172 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:16.172 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:16.172 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:16.172 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:16.172 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:16.172 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 179758 2024-04-19T02:17:16.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.172 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:16.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:16.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.160385+0000", 2024-04-19T02:17:16.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:16.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:16.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.160385+0000", 2024-04-19T02:17:16.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:16.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:16.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.160385+0000", 2024-04-19T02:17:16.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:16.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:16.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.160387+0000", 2024-04-19T02:17:16.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1100000000000001e-06 2024-04-19T02:17:16.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.174 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:16.174 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.160391+0000", 2024-04-19T02:17:16.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4800000000000001e-06 2024-04-19T02:17:16.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.174 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:16.174 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.160394+0000", 2024-04-19T02:17:16.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9799999999999998e-06 2024-04-19T02:17:16.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.174 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:16.174 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.161638+0000", 2024-04-19T02:17:16.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001244691 2024-04-19T02:17:16.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:16.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.161766+0000", 2024-04-19T02:17:16.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000127386 2024-04-19T02:17:16.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:16.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.161868+0000", 2024-04-19T02:17:16.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010244899999999999 2024-04-19T02:17:16.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:16.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.166112+0000", 2024-04-19T02:17:16.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042441789999999998 2024-04-19T02:17:16.175 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:16.176 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:16.176 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:16.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.176 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:179759 5.9 5:9f53e264:::benchmark_data_smithi121_44835_object45724:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T02:17:16.176 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:16.160498+0000", 2024-04-19T02:17:16.176 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0061190369999999999, 2024-04-19T02:17:16.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0063038720000000003, 2024-04-19T02:17:16.176 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:16.176 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:16.176 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:16.176 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:16.176 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:16.176 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 179759 2024-04-19T02:17:16.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.177 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:16.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:16.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.160498+0000", 2024-04-19T02:17:16.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:16.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:16.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.160498+0000", 2024-04-19T02:17:16.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:16.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:16.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.160498+0000", 2024-04-19T02:17:16.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:16.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:16.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.160501+0000", 2024-04-19T02:17:16.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9239999999999999e-06 2024-04-19T02:17:16.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:16.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.160506+0000", 2024-04-19T02:17:16.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7230000000000004e-06 2024-04-19T02:17:16.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:16.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.160509+0000", 2024-04-19T02:17:16.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8990000000000003e-06 2024-04-19T02:17:16.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:16.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.160536+0000", 2024-04-19T02:17:16.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6168000000000001e-05 2024-04-19T02:17:16.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:16.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.160623+0000", 2024-04-19T02:17:16.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7131000000000003e-05 2024-04-19T02:17:16.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:16.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.160694+0000", 2024-04-19T02:17:16.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1267999999999996e-05 2024-04-19T02:17:16.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:16.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.166774+0000", 2024-04-19T02:17:16.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.006080266 2024-04-19T02:17:16.180 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:16.180 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:16.180 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:16.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.180 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:179760 5.3 5:ce9cad0a:::benchmark_data_smithi121_44835_object45725:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T02:17:16.180 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:16.161733+0000", 2024-04-19T02:17:16.180 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.004884462, 2024-04-19T02:17:16.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051664559999999998, 2024-04-19T02:17:16.180 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:16.180 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:16.180 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:16.180 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:16.180 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:16.181 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 179760 2024-04-19T02:17:16.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.181 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:16.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:16.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.161733+0000", 2024-04-19T02:17:16.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:16.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:16.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.161733+0000", 2024-04-19T02:17:16.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:16.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:16.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.161732+0000", 2024-04-19T02:17:16.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:16.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:16.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.161738+0000", 2024-04-19T02:17:16.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7660000000000004e-06 2024-04-19T02:17:16.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:16.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.161747+0000", 2024-04-19T02:17:16.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1409999999999994e-06 2024-04-19T02:17:16.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:16.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.161754+0000", 2024-04-19T02:17:16.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0049999999999998e-06 2024-04-19T02:17:16.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:16.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.161787+0000", 2024-04-19T02:17:16.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2911999999999999e-05 2024-04-19T02:17:16.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:16.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.161878+0000", 2024-04-19T02:17:16.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1184e-05 2024-04-19T02:17:16.183 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:16.183 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:16.183 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:16.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.183 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:179762 5.f 5:f8e7dfd7:::benchmark_data_smithi121_44835_object45727:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T02:17:16.184 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:16.162109+0000", 2024-04-19T02:17:16.184 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.004508672, 2024-04-19T02:17:16.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0048671920000000002, 2024-04-19T02:17:16.184 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:16.184 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:16.184 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:16.184 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:16.184 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:16.184 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 179762 2024-04-19T02:17:16.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.184 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:16.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:16.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.162109+0000", 2024-04-19T02:17:16.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:16.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:16.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.162109+0000", 2024-04-19T02:17:16.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:16.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:16.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.162108+0000", 2024-04-19T02:17:16.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:16.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:16.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.162113+0000", 2024-04-19T02:17:16.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6070000000000001e-06 2024-04-19T02:17:16.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:16.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.162122+0000", 2024-04-19T02:17:16.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5130000000000002e-06 2024-04-19T02:17:16.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:16.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.162129+0000", 2024-04-19T02:17:16.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0709999999999997e-06 2024-04-19T02:17:16.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:16.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.162166+0000", 2024-04-19T02:17:16.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7033000000000003e-05 2024-04-19T02:17:16.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:16.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.162238+0000", 2024-04-19T02:17:16.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2003999999999997e-05 2024-04-19T02:17:16.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:16.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.162300+0000", 2024-04-19T02:17:16.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2006000000000002e-05 2024-04-19T02:17:16.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:16.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.166144+0000", 2024-04-19T02:17:16.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003843782 2024-04-19T02:17:16.188 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:16.188 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:16.188 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:16.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.188 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:179763 5.3 5:cca93662:::benchmark_data_smithi121_44835_object45728:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T02:17:16.188 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:16.162139+0000", 2024-04-19T02:17:16.188 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.004478409, 2024-04-19T02:17:16.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0049256639999999997, 2024-04-19T02:17:16.188 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:16.188 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:16.188 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:16.188 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:16.188 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:16.188 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 179763 2024-04-19T02:17:16.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.189 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:16.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:16.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.162139+0000", 2024-04-19T02:17:16.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:16.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:16.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.162139+0000", 2024-04-19T02:17:16.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:16.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:16.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.162139+0000", 2024-04-19T02:17:16.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:16.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:16.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.162141+0000", 2024-04-19T02:17:16.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4509999999999999e-06 2024-04-19T02:17:16.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:16.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.162148+0000", 2024-04-19T02:17:16.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6370000000000002e-06 2024-04-19T02:17:16.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:16.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.162154+0000", 2024-04-19T02:17:16.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1979999999999998e-06 2024-04-19T02:17:16.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:16.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.163356+0000", 2024-04-19T02:17:16.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001202383 2024-04-19T02:17:16.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:16.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.163465+0000", 2024-04-19T02:17:16.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000108206 2024-04-19T02:17:16.191 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:16.191 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:16.191 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:16.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.192 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:179765 5.c 5:3726b0ef:::benchmark_data_smithi121_44835_object45730:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T02:17:16.192 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:16.163912+0000", 2024-04-19T02:17:16.192 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.002705196, 2024-04-19T02:17:16.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003234032, 2024-04-19T02:17:16.192 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:16.192 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:16.192 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:16.192 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:16.192 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:16.192 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 179765 2024-04-19T02:17:16.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.192 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:16.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:16.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.163912+0000", 2024-04-19T02:17:16.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:16.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:16.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.163912+0000", 2024-04-19T02:17:16.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:16.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:16.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.163912+0000", 2024-04-19T02:17:16.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:16.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:16.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.163915+0000", 2024-04-19T02:17:16.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7479999999999999e-06 2024-04-19T02:17:16.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:16.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.163922+0000", 2024-04-19T02:17:16.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7390000000000002e-06 2024-04-19T02:17:16.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:16.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.163927+0000", 2024-04-19T02:17:16.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5029999999999999e-06 2024-04-19T02:17:16.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:16.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.163950+0000", 2024-04-19T02:17:16.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.296e-05 2024-04-19T02:17:16.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:16.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.164031+0000", 2024-04-19T02:17:16.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0944000000000003e-05 2024-04-19T02:17:16.195 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:16.195 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:16.195 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:16.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.196 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:179766 5.2 5:4b83cf55:::benchmark_data_smithi121_44835_object45731:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T02:17:16.196 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:16.163932+0000", 2024-04-19T02:17:16.196 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.002685111, 2024-04-19T02:17:16.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003286013, 2024-04-19T02:17:16.196 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:16.196 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:16.196 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:16.196 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:16.196 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:16.196 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 179766 2024-04-19T02:17:16.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.196 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:16.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:16.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.163932+0000", 2024-04-19T02:17:16.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:16.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:16.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.163932+0000", 2024-04-19T02:17:16.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:16.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:16.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.163932+0000", 2024-04-19T02:17:16.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:16.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:16.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.163934+0000", 2024-04-19T02:17:16.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2069999999999998e-06 2024-04-19T02:17:16.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:16.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.163940+0000", 2024-04-19T02:17:16.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4090000000000002e-06 2024-04-19T02:17:16.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:16.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.163945+0000", 2024-04-19T02:17:16.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8899999999999998e-06 2024-04-19T02:17:16.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:16.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.163981+0000", 2024-04-19T02:17:16.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6195000000000002e-05 2024-04-19T02:17:16.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:16.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.164055+0000", 2024-04-19T02:17:16.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4752000000000005e-05 2024-04-19T02:17:16.199 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:16.199 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:16.199 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:16.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.199 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:179768 5.6 5:65342f5c:::benchmark_data_smithi121_44835_object45733:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T02:17:16.199 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:16.163952+0000", 2024-04-19T02:17:16.200 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0026656729999999999, 2024-04-19T02:17:16.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033354719999999999, 2024-04-19T02:17:16.200 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:16.200 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:16.200 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:16.200 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:16.200 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:16.200 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 179768 2024-04-19T02:17:16.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.200 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:16.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:16.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.163952+0000", 2024-04-19T02:17:16.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:16.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:16.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.163952+0000", 2024-04-19T02:17:16.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:16.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:16.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.163951+0000", 2024-04-19T02:17:16.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:16.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:16.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.163954+0000", 2024-04-19T02:17:16.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3989999999999998e-06 2024-04-19T02:17:16.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:16.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.163960+0000", 2024-04-19T02:17:16.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2149999999999998e-06 2024-04-19T02:17:16.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:16.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.163966+0000", 2024-04-19T02:17:16.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6509999999999998e-06 2024-04-19T02:17:16.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:16.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.164002+0000", 2024-04-19T02:17:16.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6134000000000003e-05 2024-04-19T02:17:16.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:16.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.164122+0000", 2024-04-19T02:17:16.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012020500000000001 2024-04-19T02:17:16.203 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:16.203 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:16.203 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:16.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.203 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:179769 5.9 5:9842dc6d:::benchmark_data_smithi121_44835_object45734:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T02:17:16.203 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:16.164763+0000", 2024-04-19T02:17:16.203 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0018547769999999999, 2024-04-19T02:17:16.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0025925649999999998, 2024-04-19T02:17:16.203 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:16.204 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:16.204 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:16.204 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:16.204 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:16.204 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 179769 2024-04-19T02:17:16.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.204 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:16.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:16.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.164763+0000", 2024-04-19T02:17:16.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:16.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:16.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.164763+0000", 2024-04-19T02:17:16.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:16.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:16.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.164762+0000", 2024-04-19T02:17:16.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:16.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:16.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.164767+0000", 2024-04-19T02:17:16.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7509999999999999e-06 2024-04-19T02:17:16.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:16.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.164777+0000", 2024-04-19T02:17:16.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0030000000000001e-05 2024-04-19T02:17:16.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:16.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.164784+0000", 2024-04-19T02:17:16.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0299999999999996e-06 2024-04-19T02:17:16.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:16.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.164823+0000", 2024-04-19T02:17:16.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9406000000000002e-05 2024-04-19T02:17:16.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:16.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.164930+0000", 2024-04-19T02:17:16.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010647 2024-04-19T02:17:16.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:16.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.165031+0000", 2024-04-19T02:17:16.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010118799999999999 2024-04-19T02:17:16.207 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:16.207 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:16.207 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:16.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.207 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:179772 5.3 5:ccdb9842:::benchmark_data_smithi121_44835_object45737:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T02:17:16.207 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:16.166311+0000", 2024-04-19T02:17:16.207 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00030668999999999998, 2024-04-19T02:17:16.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0011247220000000001, 2024-04-19T02:17:16.208 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:16.208 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:16.208 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:16.208 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:16.208 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:16.208 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 179772 2024-04-19T02:17:16.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.208 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:16.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:16.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.166311+0000", 2024-04-19T02:17:16.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:16.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:16.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.166311+0000", 2024-04-19T02:17:16.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:16.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:16.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.166310+0000", 2024-04-19T02:17:16.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:16.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:16.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.166314+0000", 2024-04-19T02:17:16.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9519999999999996e-06 2024-04-19T02:17:16.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:16.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.166322+0000", 2024-04-19T02:17:16.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6279999999999996e-06 2024-04-19T02:17:16.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:16.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.166326+0000", 2024-04-19T02:17:16.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.51e-06 2024-04-19T02:17:16.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:16.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.166356+0000", 2024-04-19T02:17:16.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0074e-05 2024-04-19T02:17:16.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:16.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.166433+0000", 2024-04-19T02:17:16.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7247000000000001e-05 2024-04-19T02:17:16.211 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:16.211 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:16.211 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:16.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.211 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:179773 5.9 5:9cb50f1f:::benchmark_data_smithi121_44835_object45738:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T02:17:16.211 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:16.166336+0000", 2024-04-19T02:17:16.211 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00028103500000000001, 2024-04-19T02:17:16.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001183091, 2024-04-19T02:17:16.211 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:16.211 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:16.211 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:16.212 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:16.212 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:16.212 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 179773 2024-04-19T02:17:16.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.212 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:16.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:16.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.166336+0000", 2024-04-19T02:17:16.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:16.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:16.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.166336+0000", 2024-04-19T02:17:16.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:16.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:16.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.166336+0000", 2024-04-19T02:17:16.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:16.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:16.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.166338+0000", 2024-04-19T02:17:16.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1969999999999999e-06 2024-04-19T02:17:16.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:16.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.166344+0000", 2024-04-19T02:17:16.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.071e-06 2024-04-19T02:17:16.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:16.214 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.166348+0000", 2024-04-19T02:17:16.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2600000000000001e-06 2024-04-19T02:17:16.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:16.214 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.166806+0000", 2024-04-19T02:17:16.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00045808399999999999 2024-04-19T02:17:16.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:16.214 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.166939+0000", 2024-04-19T02:17:16.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013287499999999999 2024-04-19T02:17:16.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:16.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:16.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:16.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:16.167064+0000", 2024-04-19T02:17:16.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012562900000000001 2024-04-19T02:17:16.215 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:16.215 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:16.215 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:16.215 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:16.215 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-04-19T02:17:16.215 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 12 2024-04-19T02:17:16.215 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:16.216 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:16.216+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:16.217 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:16.268 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T02:17:16.317 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:16.318+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:16.417 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:16.418+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:16.433 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:16.433 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-04-19T02:17:16.434 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-04-19T02:17:16.434 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-04-19T02:17:16.434 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:16.441 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:17:16.446 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:16.530 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:16.531+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:16.592 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:17:16.612 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:17:16.613 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:17:16.613 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:17:16.613 INFO:teuthology.orchestra.run.smithi121.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T02:17:16.615 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:17:16.616 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:17:16.619 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:16.619+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:16.656 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:16.656 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:16.670 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:17:16.720 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:16.720+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:16.822 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:16.822+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:16.860 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:16.861 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:16.870 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:17:16.921 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:16.922+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:16.946 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [2] live_osds: [0, 1] 2024-04-19T02:17:16.946 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T02:17:16.946 INFO:tasks.thrashosds.thrasher:Setting full ratio to .001 2024-04-19T02:17:16.946 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set-full-ratio .001 2024-04-19T02:17:17.022 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:17.022+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:17.088 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:17.089 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:17.103 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:17:17.123 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:17.124+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:17.224 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:17.224+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:17.271 INFO:teuthology.orchestra.run.smithi121.stderr:noscrub is set 2024-04-19T02:17:17.321 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:17.321 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:17.324 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:17.324+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:17.336 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:17.425 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:17.426+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:17.510 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:17.511 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:17.524 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:17.565 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:17.566+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:17.627 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:17.627+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:17.728 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:17.729+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:17.736 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:17.736 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:17.751 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:17.829 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:17.829+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:17.929 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:17.930+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:17.961 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:17.961 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:17.976 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:17:18.031 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:18.031+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:18.131 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:18.132+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:18.154 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:18.155 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:18.169 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:17:18.232 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:18.233+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:18.263 INFO:tasks.ceph.mon.a.smithi121.stderr:2024-04-19T02:17:18.264+0000 7fb03886c700 -1 log_channel(cluster) log [ERR] : Health check failed: full ratio(s) out of order (OSD_OUT_OF_ORDER_FULL) 2024-04-19T02:17:18.269 INFO:teuthology.orchestra.run.smithi121.stderr:osd set-full-ratio 0.001 2024-04-19T02:17:18.333 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:18.333+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:18.383 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:18.383 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:18.399 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:17:18.440 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:18.440+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:18.535 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:18.535+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:18.614 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:18.614 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:18.616 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:17:18.628 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:18.636 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:18.636+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:18.736 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:18.737+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:18.768 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:17:18.787 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:17:18.788 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:17:18.788 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:17:18.788 INFO:teuthology.orchestra.run.smithi121.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T02:17:18.791 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:17:18.791 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:17:18.804 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:18.804 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:17:18.804 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.804 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:187247 5.3 5:c32cea62:::benchmark_data_smithi121_44835_object53212:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T02:17:18.804 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:18.795472+0000", 2024-04-19T02:17:18.804 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0083652629999999995, 2024-04-19T02:17:18.804 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00838356, 2024-04-19T02:17:18.804 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:18.804 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:18.804 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:18.804 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:18.805 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:18.805 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 187247 2024-04-19T02:17:18.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.805 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:18.805 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.805 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:18.805 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.795472+0000", 2024-04-19T02:17:18.805 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:18.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.805 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.805 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:18.806 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.795472+0000", 2024-04-19T02:17:18.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:18.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.806 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:18.806 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.795472+0000", 2024-04-19T02:17:18.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:18.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.806 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:18.806 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.795474+0000", 2024-04-19T02:17:18.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8090000000000001e-06 2024-04-19T02:17:18.807 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.807 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.807 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:18.807 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.795478+0000", 2024-04-19T02:17:18.807 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9729999999999999e-06 2024-04-19T02:17:18.807 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.807 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.807 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:18.807 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.795481+0000", 2024-04-19T02:17:18.807 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1669999999999999e-06 2024-04-19T02:17:18.807 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.807 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.807 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:18.807 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.797518+0000", 2024-04-19T02:17:18.808 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020365890000000001 2024-04-19T02:17:18.808 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.808 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.808 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:18.808 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.797670+0000", 2024-04-19T02:17:18.808 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015236899999999999 2024-04-19T02:17:18.808 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:18.808 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:18.808 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:18.808 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.809 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.809 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:187256 5.f 5:f920a302:::benchmark_data_smithi121_44835_object53221:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T02:17:18.809 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:18.799551+0000", 2024-04-19T02:17:18.809 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0042858030000000004, 2024-04-19T02:17:18.809 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0043509580000000003, 2024-04-19T02:17:18.809 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:18.809 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:18.810 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:18.810 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:18.810 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:18.810 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 187256 2024-04-19T02:17:18.810 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.810 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:18.810 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.810 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:18.810 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.799551+0000", 2024-04-19T02:17:18.810 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:18.810 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.810 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.810 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:18.810 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.799551+0000", 2024-04-19T02:17:18.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:18.811 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.811 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:18.811 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.799550+0000", 2024-04-19T02:17:18.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:18.811 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.811 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:18.811 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.799556+0000", 2024-04-19T02:17:18.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3959999999999997e-06 2024-04-19T02:17:18.811 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.812 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:18.812 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.799566+0000", 2024-04-19T02:17:18.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7040000000000006e-06 2024-04-19T02:17:18.812 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.812 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.812 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:18.812 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.799572+0000", 2024-04-19T02:17:18.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1469999999999998e-06 2024-04-19T02:17:18.812 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.812 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.812 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:18.812 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.799603+0000", 2024-04-19T02:17:18.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1662999999999998e-05 2024-04-19T02:17:18.812 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:18.813 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.799714+0000", 2024-04-19T02:17:18.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000110627 2024-04-19T02:17:18.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:18.813 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.799846+0000", 2024-04-19T02:17:18.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000132435 2024-04-19T02:17:18.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:18.814 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.803740+0000", 2024-04-19T02:17:18.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003893185 2024-04-19T02:17:18.814 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:18.814 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:18.814 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:18.814 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.814 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.814 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:187257 5.2 5:4d0f72c1:::benchmark_data_smithi121_44835_object53222:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T02:17:18.814 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:18.799627+0000", 2024-04-19T02:17:18.814 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0042099349999999997, 2024-04-19T02:17:18.815 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0043221889999999997, 2024-04-19T02:17:18.815 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:18.815 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:18.815 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:18.815 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:18.815 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:18.815 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 187257 2024-04-19T02:17:18.815 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.815 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:18.815 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:18.816 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.799627+0000", 2024-04-19T02:17:18.816 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:18.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:18.816 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.799627+0000", 2024-04-19T02:17:18.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:18.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.817 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:18.817 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.799627+0000", 2024-04-19T02:17:18.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:18.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.817 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:18.817 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.799630+0000", 2024-04-19T02:17:18.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2559999999999998e-06 2024-04-19T02:17:18.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:18.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.799635+0000", 2024-04-19T02:17:18.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9509999999999997e-06 2024-04-19T02:17:18.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:18.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.799638+0000", 2024-04-19T02:17:18.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.394e-06 2024-04-19T02:17:18.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:18.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.799677+0000", 2024-04-19T02:17:18.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8942000000000001e-05 2024-04-19T02:17:18.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:18.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.799815+0000", 2024-04-19T02:17:18.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013745900000000001 2024-04-19T02:17:18.819 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:18.819 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:18.819 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:18.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.819 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:187259 5.9 5:9cafd6c4:::benchmark_data_smithi121_44835_object53224:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T02:17:18.819 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:18.801971+0000", 2024-04-19T02:17:18.820 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.001865752, 2024-04-19T02:17:18.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020168009999999999, 2024-04-19T02:17:18.820 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:18.820 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:18.820 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:18.820 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:18.820 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:18.820 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 187259 2024-04-19T02:17:18.820 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.820 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:18.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.820 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:18.821 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.801971+0000", 2024-04-19T02:17:18.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:18.821 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.821 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:18.821 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.801971+0000", 2024-04-19T02:17:18.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:18.821 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.821 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:18.821 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.801970+0000", 2024-04-19T02:17:18.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:18.821 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.822 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:18.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.801976+0000", 2024-04-19T02:17:18.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7570000000000001e-06 2024-04-19T02:17:18.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.822 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:18.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.801986+0000", 2024-04-19T02:17:18.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5869999999999999e-06 2024-04-19T02:17:18.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.822 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:18.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.801993+0000", 2024-04-19T02:17:18.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0260000000000002e-06 2024-04-19T02:17:18.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:18.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.802021+0000", 2024-04-19T02:17:18.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8051e-05 2024-04-19T02:17:18.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:18.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.802128+0000", 2024-04-19T02:17:18.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107124 2024-04-19T02:17:18.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.824 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.824 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:18.824 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.802239+0000", 2024-04-19T02:17:18.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011095999999999999 2024-04-19T02:17:18.824 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:18.824 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:18.824 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:18.824 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.824 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.824 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:187260 5.f 5:f900242f:::benchmark_data_smithi121_44835_object53225:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T02:17:18.824 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:18.802003+0000", 2024-04-19T02:17:18.824 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.001834053, 2024-04-19T02:17:18.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020298270000000001, 2024-04-19T02:17:18.825 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:18.825 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:18.825 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:18.825 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:18.825 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:18.825 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 187260 2024-04-19T02:17:18.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.825 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:18.825 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.825 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:18.825 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.802003+0000", 2024-04-19T02:17:18.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:18.826 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.826 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.826 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:18.826 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.802003+0000", 2024-04-19T02:17:18.826 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:18.826 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.826 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.826 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:18.826 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.802003+0000", 2024-04-19T02:17:18.826 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:18.826 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.826 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.826 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:18.827 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.802005+0000", 2024-04-19T02:17:18.827 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6730000000000001e-06 2024-04-19T02:17:18.827 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.827 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.827 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:18.827 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.802012+0000", 2024-04-19T02:17:18.827 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2770000000000002e-06 2024-04-19T02:17:18.827 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.827 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.827 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:18.827 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.802026+0000", 2024-04-19T02:17:18.827 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4258e-05 2024-04-19T02:17:18.828 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.828 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.828 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:18.828 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.802064+0000", 2024-04-19T02:17:18.828 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8439000000000002e-05 2024-04-19T02:17:18.828 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.828 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.828 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:18.828 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.802185+0000", 2024-04-19T02:17:18.828 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120994 2024-04-19T02:17:18.828 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.828 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.828 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:18.829 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.802300+0000", 2024-04-19T02:17:18.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011493900000000001 2024-04-19T02:17:18.829 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:18.829 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:18.829 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:18.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.829 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:187262 5.7 5:eb27bf42:::benchmark_data_smithi121_44835_object53227:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T02:17:18.829 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:18.802035+0000", 2024-04-19T02:17:18.829 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0018024530000000001, 2024-04-19T02:17:18.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020408140000000002, 2024-04-19T02:17:18.829 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:18.829 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:18.830 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:18.830 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:18.830 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:18.830 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 187262 2024-04-19T02:17:18.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.830 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:18.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.830 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:18.830 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.802035+0000", 2024-04-19T02:17:18.830 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:18.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.831 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:18.831 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.802035+0000", 2024-04-19T02:17:18.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:18.831 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.831 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.831 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:18.831 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.802034+0000", 2024-04-19T02:17:18.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:18.831 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.831 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.831 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:18.831 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.802037+0000", 2024-04-19T02:17:18.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7130000000000001e-06 2024-04-19T02:17:18.831 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.832 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:18.832 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.802044+0000", 2024-04-19T02:17:18.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7270000000000001e-06 2024-04-19T02:17:18.832 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.832 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:18.832 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.802049+0000", 2024-04-19T02:17:18.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.916e-06 2024-04-19T02:17:18.832 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.832 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:18.832 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.802087+0000", 2024-04-19T02:17:18.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8346000000000002e-05 2024-04-19T02:17:18.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.833 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:18.833 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.802200+0000", 2024-04-19T02:17:18.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000112891 2024-04-19T02:17:18.833 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:18.833 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:18.833 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:18.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.833 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:187263 5.5 5:ae3131ab:::benchmark_data_smithi121_44835_object53228:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T02:17:18.834 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:18.802063+0000", 2024-04-19T02:17:18.834 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0017741499999999999, 2024-04-19T02:17:18.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020705929999999999, 2024-04-19T02:17:18.834 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:18.834 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:18.834 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:18.834 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:18.834 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:18.834 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 187263 2024-04-19T02:17:18.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.834 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:18.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:18.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.802063+0000", 2024-04-19T02:17:18.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:18.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:18.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.802063+0000", 2024-04-19T02:17:18.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:18.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:18.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.802063+0000", 2024-04-19T02:17:18.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:18.836 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.836 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.836 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:18.836 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.802065+0000", 2024-04-19T02:17:18.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4949999999999998e-06 2024-04-19T02:17:18.836 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.836 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.836 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:18.836 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.802072+0000", 2024-04-19T02:17:18.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5810000000000002e-06 2024-04-19T02:17:18.836 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.836 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.837 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:18.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.802077+0000", 2024-04-19T02:17:18.837 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1019999999999996e-06 2024-04-19T02:17:18.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.838 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:18.838 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.802142+0000", 2024-04-19T02:17:18.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4937999999999994e-05 2024-04-19T02:17:18.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.838 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:18.838 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.802269+0000", 2024-04-19T02:17:18.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012705 2024-04-19T02:17:18.839 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:18.839 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:18.839 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:18.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.839 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.839 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:187264 5.7 5:e5a3d892:::benchmark_data_smithi121_44835_object53229:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T02:17:18.839 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:18.802143+0000", 2024-04-19T02:17:18.839 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0016941829999999999, 2024-04-19T02:17:18.839 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020767820000000001, 2024-04-19T02:17:18.839 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:18.839 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-04-19T02:17:18.839 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:18.839 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:18.839 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:18.840 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 187264 2024-04-19T02:17:18.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.840 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:18.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.840 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:18.840 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.802143+0000", 2024-04-19T02:17:18.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:18.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.840 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:18.840 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.802143+0000", 2024-04-19T02:17:18.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:18.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.840 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:18.841 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.802143+0000", 2024-04-19T02:17:18.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:18.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.841 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:18.841 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.802146+0000", 2024-04-19T02:17:18.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9699999999999999e-06 2024-04-19T02:17:18.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.841 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:18.841 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.802154+0000", 2024-04-19T02:17:18.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1459999999999996e-06 2024-04-19T02:17:18.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:18.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.802159+0000", 2024-04-19T02:17:18.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5249999999999996e-06 2024-04-19T02:17:18.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:18.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.804169+0000", 2024-04-19T02:17:18.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020102359999999999 2024-04-19T02:17:18.842 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:18.842 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:18.842 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:18.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.843 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:187266 5.7 5.c44cc2a7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T02:17:18.843 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:18.802166+0000", 2024-04-19T02:17:18.843 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0016710869999999999, 2024-04-19T02:17:18.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021234890000000001, 2024-04-19T02:17:18.843 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:18.843 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-04-19T02:17:18.843 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:18.843 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:18.843 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:18.843 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 187266 2024-04-19T02:17:18.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.843 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:18.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:18.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.802166+0000", 2024-04-19T02:17:18.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:18.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:18.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.802166+0000", 2024-04-19T02:17:18.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:18.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:18.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.802166+0000", 2024-04-19T02:17:18.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:18.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.845 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:18.845 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.802169+0000", 2024-04-19T02:17:18.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8940000000000002e-06 2024-04-19T02:17:18.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.845 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:18.845 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.802174+0000", 2024-04-19T02:17:18.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9510000000000003e-06 2024-04-19T02:17:18.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.845 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:18.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.802179+0000", 2024-04-19T02:17:18.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7700000000000001e-06 2024-04-19T02:17:18.846 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:18.846 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:18.846 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:18.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.846 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:187268 5.2 5:484f7651:::benchmark_data_smithi121_44835_object53233:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T02:17:18.846 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:18.802187+0000", 2024-04-19T02:17:18.846 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0016503240000000001, 2024-04-19T02:17:18.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021696369999999999, 2024-04-19T02:17:18.846 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:18.846 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:18.846 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:18.847 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:18.847 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:18.847 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 187268 2024-04-19T02:17:18.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.847 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:18.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:18.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.802187+0000", 2024-04-19T02:17:18.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:18.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:18.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.802187+0000", 2024-04-19T02:17:18.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:18.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:18.848 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.802187+0000", 2024-04-19T02:17:18.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:18.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:18.848 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.802189+0000", 2024-04-19T02:17:18.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5780000000000001e-06 2024-04-19T02:17:18.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:18.848 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.802195+0000", 2024-04-19T02:17:18.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3890000000000004e-06 2024-04-19T02:17:18.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.849 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:18.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.802199+0000", 2024-04-19T02:17:18.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4909999999999999e-06 2024-04-19T02:17:18.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.849 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:18.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.802238+0000", 2024-04-19T02:17:18.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8596000000000001e-05 2024-04-19T02:17:18.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.849 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:18.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.802361+0000", 2024-04-19T02:17:18.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012347399999999999 2024-04-19T02:17:18.850 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:18.850 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:18.850 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:18.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.850 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:187269 5.5 5:af3f41a7:::benchmark_data_smithi121_44835_object53234:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T02:17:18.850 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:18.803943+0000", 2024-04-19T02:17:18.850 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9998946, 2024-04-19T02:17:18.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00050307200000000002, 2024-04-19T02:17:18.850 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:18.850 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:18.850 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:18.851 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:18.851 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:18.851 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 187269 2024-04-19T02:17:18.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.851 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:18.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:18.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.803943+0000", 2024-04-19T02:17:18.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:18.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:18.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.803943+0000", 2024-04-19T02:17:18.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:18.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.852 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:18.852 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.803942+0000", 2024-04-19T02:17:18.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:18.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.852 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:18.852 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.803947+0000", 2024-04-19T02:17:18.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0509999999999996e-06 2024-04-19T02:17:18.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.852 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:18.852 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.803957+0000", 2024-04-19T02:17:18.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0168e-05 2024-04-19T02:17:18.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:18.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.803965+0000", 2024-04-19T02:17:18.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4390000000000003e-06 2024-04-19T02:17:18.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:18.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.804144+0000", 2024-04-19T02:17:18.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000179698 2024-04-19T02:17:18.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:18.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:18.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:18.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:18.804268+0000", 2024-04-19T02:17:18.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012414699999999999 2024-04-19T02:17:18.854 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:18.854 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:18.854 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:18.854 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:18.854 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-04-19T02:17:18.854 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 11 2024-04-19T02:17:18.854 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:18.855 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:18.855+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:18.856 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:18.956 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:18.956+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:19.025 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:19.026 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-04-19T02:17:19.026 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-04-19T02:17:19.026 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-04-19T02:17:19.026 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:19.040 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:19.058 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:19.057+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:19.158 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:19.158+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:19.216 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:19.216 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-04-19T02:17:19.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-04-19T02:17:19.217 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:17:19.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.217 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:19.217 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:17:19.217 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 109.94519885699999, 2024-04-19T02:17:19.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022007204999999998, 2024-04-19T02:17:19.217 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:19.217 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:19.217 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:19.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:19.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:17:19.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:19.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:19.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:17:19.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:19.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:19.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269990+0000", 2024-04-19T02:17:19.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:19.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:19.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269999+0000", 2024-04-19T02:17:19.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9539999999999993e-06 2024-04-19T02:17:19.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:19.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270006+0000", 2024-04-19T02:17:19.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.216e-06 2024-04-19T02:17:19.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270012+0000", 2024-04-19T02:17:19.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5049999999999998e-06 2024-04-19T02:17:19.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:19.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270058+0000", 2024-04-19T02:17:19.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.634e-05 2024-04-19T02:17:19.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:19.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270064+0000", 2024-04-19T02:17:19.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0669999999999997e-06 2024-04-19T02:17:19.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:19.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287159+0000", 2024-04-19T02:17:19.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017095086999999998 2024-04-19T02:17:19.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:19.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287254+0000", 2024-04-19T02:17:19.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4716000000000006e-05 2024-04-19T02:17:19.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:19.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287389+0000", 2024-04-19T02:17:19.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013511900000000001 2024-04-19T02:17:19.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:19.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290481+0000", 2024-04-19T02:17:19.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030920169999999999 2024-04-19T02:17:19.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:19.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291931+0000", 2024-04-19T02:17:19.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001450118 2024-04-19T02:17:19.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:19.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291960+0000", 2024-04-19T02:17:19.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9096000000000001e-05 2024-04-19T02:17:19.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:19.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291998+0000", 2024-04-19T02:17:19.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7514e-05 2024-04-19T02:17:19.222 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:19.222 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:19.222 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:19.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.223 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:19.223 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:17:19.223 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 109.94508808099999, 2024-04-19T02:17:19.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020837887999999999, 2024-04-19T02:17:19.223 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:19.223 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:19.223 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:19.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.223 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:19.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:17:19.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:19.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.223 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:19.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:17:19.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:19.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:19.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:17:19.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:19.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:19.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270109+0000", 2024-04-19T02:17:19.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3110000000000006e-06 2024-04-19T02:17:19.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:19.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270117+0000", 2024-04-19T02:17:19.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0479999999999999e-06 2024-04-19T02:17:19.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270123+0000", 2024-04-19T02:17:19.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5500000000000002e-06 2024-04-19T02:17:19.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:19.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270150+0000", 2024-04-19T02:17:19.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7712000000000002e-05 2024-04-19T02:17:19.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:19.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270153+0000", 2024-04-19T02:17:19.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6089999999999999e-06 2024-04-19T02:17:19.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:19.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285958+0000", 2024-04-19T02:17:19.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015805274000000001 2024-04-19T02:17:19.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:19.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286126+0000", 2024-04-19T02:17:19.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016765700000000001 2024-04-19T02:17:19.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:19.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286296+0000", 2024-04-19T02:17:19.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017007 2024-04-19T02:17:19.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:19.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290426+0000", 2024-04-19T02:17:19.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041299839999999997 2024-04-19T02:17:19.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:19.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290867+0000", 2024-04-19T02:17:19.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00044083300000000001 2024-04-19T02:17:19.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:19.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290900+0000", 2024-04-19T02:17:19.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3380000000000002e-05 2024-04-19T02:17:19.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.228 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:19.228 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290939+0000", 2024-04-19T02:17:19.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8970000000000001e-05 2024-04-19T02:17:19.228 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:19.228 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:19.228 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:19.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.228 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:21 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:19.228 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:17:19.228 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 109.944999409, 2024-04-19T02:17:19.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020833187999999999, 2024-04-19T02:17:19.228 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:19.228 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:19.228 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:19.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:19.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:17:19.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:19.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:19.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:17:19.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:19.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:19.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270189+0000", 2024-04-19T02:17:19.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:19.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:19.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270192+0000", 2024-04-19T02:17:19.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7549999999999999e-06 2024-04-19T02:17:19.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:19.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270198+0000", 2024-04-19T02:17:19.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0859999999999998e-06 2024-04-19T02:17:19.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270204+0000", 2024-04-19T02:17:19.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1970000000000004e-06 2024-04-19T02:17:19.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:19.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270238+0000", 2024-04-19T02:17:19.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4282000000000001e-05 2024-04-19T02:17:19.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:19.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270240+0000", 2024-04-19T02:17:19.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3099999999999999e-06 2024-04-19T02:17:19.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:19.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287131+0000", 2024-04-19T02:17:19.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01689104 2024-04-19T02:17:19.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:19.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287262+0000", 2024-04-19T02:17:19.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130347 2024-04-19T02:17:19.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:19.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291023+0000", 2024-04-19T02:17:19.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037616350000000002 2024-04-19T02:17:19.232 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:19.232 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:19.232 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:19.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.232 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:94468 5.2 5:4f406431:::benchmark_data_smithi121_44835_object94467:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T02:17:19.232 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:17:19.233 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 44.103760227000002, 2024-04-19T02:17:19.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024835144999999999, 2024-04-19T02:17:19.233 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:19.233 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:19.233 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:19.233 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:19.233 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:19.233 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 94468 2024-04-19T02:17:19.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.233 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:19.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:19.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:17:19.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:19.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:19.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:17:19.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:19.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:19.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:17:19.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:19.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:19.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111498+0000", 2024-04-19T02:17:19.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9529000000000005e-05 2024-04-19T02:17:19.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:19.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111506+0000", 2024-04-19T02:17:19.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9030000000000004e-06 2024-04-19T02:17:19.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111513+0000", 2024-04-19T02:17:19.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8759999999999999e-06 2024-04-19T02:17:19.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:19.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112466+0000", 2024-04-19T02:17:19.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00095318499999999995 2024-04-19T02:17:19.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:19.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112590+0000", 2024-04-19T02:17:19.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012380900000000001 2024-04-19T02:17:19.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:19.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112728+0000", 2024-04-19T02:17:19.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013753800000000001 2024-04-19T02:17:19.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:19.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115064+0000", 2024-04-19T02:17:19.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002336819 2024-04-19T02:17:19.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:19.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136207+0000", 2024-04-19T02:17:19.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021142942000000001 2024-04-19T02:17:19.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:19.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136241+0000", 2024-04-19T02:17:19.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3577000000000001e-05 2024-04-19T02:17:19.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:19.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136264+0000", 2024-04-19T02:17:19.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3421000000000002e-05 2024-04-19T02:17:19.237 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:19.237 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:19.237 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:19.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.238 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:94472 5.2 5:45b7e9be:::benchmark_data_smithi121_44835_object94471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:19.238 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:17:19.238 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 44.100113696000001, 2024-04-19T02:17:19.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021273843000000001, 2024-04-19T02:17:19.238 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:19.238 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:19.238 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:19.238 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:19.238 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:19.238 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 94472 2024-04-19T02:17:19.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.239 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:19.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:19.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:17:19.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:19.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:19.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:17:19.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:19.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:19.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115075+0000", 2024-04-19T02:17:19.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:19.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:19.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115161+0000", 2024-04-19T02:17:19.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6632000000000007e-05 2024-04-19T02:17:19.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:19.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115171+0000", 2024-04-19T02:17:19.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2969999999999992e-06 2024-04-19T02:17:19.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115178+0000", 2024-04-19T02:17:19.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7610000000000007e-06 2024-04-19T02:17:19.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:19.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115213+0000", 2024-04-19T02:17:19.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5000999999999999e-05 2024-04-19T02:17:19.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:19.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115303+0000", 2024-04-19T02:17:19.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9791999999999997e-05 2024-04-19T02:17:19.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:19.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115391+0000", 2024-04-19T02:17:19.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7559000000000007e-05 2024-04-19T02:17:19.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:19.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.117894+0000", 2024-04-19T02:17:19.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002503496 2024-04-19T02:17:19.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:19.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136297+0000", 2024-04-19T02:17:19.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018402335999999998 2024-04-19T02:17:19.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:19.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136327+0000", 2024-04-19T02:17:19.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0534999999999998e-05 2024-04-19T02:17:19.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:19.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136350+0000", 2024-04-19T02:17:19.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2427999999999999e-05 2024-04-19T02:17:19.243 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:19.243 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:19.243 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:19.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.243 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:129219 5.2 5:45e7e1f4:::benchmark_data_smithi121_44835_object129218:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T02:17:19.243 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:52.629592+0000", 2024-04-19T02:17:19.243 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.585597443000001, 2024-04-19T02:17:19.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021099489999999999, 2024-04-19T02:17:19.244 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:19.244 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:19.244 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:19.244 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:19.244 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:19.244 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129219 2024-04-19T02:17:19.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.244 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:19.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:19.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629592+0000", 2024-04-19T02:17:19.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:19.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:19.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629592+0000", 2024-04-19T02:17:19.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:19.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:19.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629591+0000", 2024-04-19T02:17:19.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:19.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:19.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629618+0000", 2024-04-19T02:17:19.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6970000000000001e-05 2024-04-19T02:17:19.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:19.246 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629639+0000", 2024-04-19T02:17:19.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0701999999999999e-05 2024-04-19T02:17:19.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.246 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629645+0000", 2024-04-19T02:17:19.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2299999999999996e-06 2024-04-19T02:17:19.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:19.246 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.635658+0000", 2024-04-19T02:17:19.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0060127549999999998 2024-04-19T02:17:19.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:19.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.635811+0000", 2024-04-19T02:17:19.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015305700000000001 2024-04-19T02:17:19.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:19.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.635967+0000", 2024-04-19T02:17:19.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015578599999999999 2024-04-19T02:17:19.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:19.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.642488+0000", 2024-04-19T02:17:19.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0065215619999999998 2024-04-19T02:17:19.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:19.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650603+0000", 2024-04-19T02:17:19.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0081144900000000002 2024-04-19T02:17:19.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:19.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650652+0000", 2024-04-19T02:17:19.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9079999999999998e-05 2024-04-19T02:17:19.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:19.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650691+0000", 2024-04-19T02:17:19.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9501e-05 2024-04-19T02:17:19.248 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:19.249 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:19.249 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:19.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.249 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:157448 5.7 5:ed833a19:::benchmark_data_smithi121_44835_object23413:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:19.249 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:06.870566+0000", 2024-04-19T02:17:19.249 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 12.344622862, 2024-04-19T02:17:19.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023031238999999998, 2024-04-19T02:17:19.249 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:19.249 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:19.249 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:19.249 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:19.249 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:19.249 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 157448 2024-04-19T02:17:19.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.249 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:19.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:19.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870566+0000", 2024-04-19T02:17:19.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:19.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:19.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870566+0000", 2024-04-19T02:17:19.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:19.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:19.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870566+0000", 2024-04-19T02:17:19.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:19.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:19.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870570+0000", 2024-04-19T02:17:19.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1620000000000001e-06 2024-04-19T02:17:19.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:19.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870577+0000", 2024-04-19T02:17:19.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2069999999999998e-06 2024-04-19T02:17:19.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870587+0000", 2024-04-19T02:17:19.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6919999999999997e-06 2024-04-19T02:17:19.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:19.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870615+0000", 2024-04-19T02:17:19.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8351999999999999e-05 2024-04-19T02:17:19.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:19.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870715+0000", 2024-04-19T02:17:19.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9624999999999996e-05 2024-04-19T02:17:19.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:19.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870805+0000", 2024-04-19T02:17:19.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0067000000000004e-05 2024-04-19T02:17:19.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:19.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.872773+0000", 2024-04-19T02:17:19.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001968605 2024-04-19T02:17:19.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:19.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.893514+0000", 2024-04-19T02:17:19.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020740082999999999 2024-04-19T02:17:19.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:19.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.893558+0000", 2024-04-19T02:17:19.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4110999999999998e-05 2024-04-19T02:17:19.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:19.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.893598+0000", 2024-04-19T02:17:19.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0077000000000003e-05 2024-04-19T02:17:19.254 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:19.254 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:19.254 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:19.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.255 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:157498 5.7 5:eb39b43d:::benchmark_data_smithi121_44835_object23463:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:19.255 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:06.911721+0000", 2024-04-19T02:17:19.255 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 12.303468217000001, 2024-04-19T02:17:19.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023313438999999998, 2024-04-19T02:17:19.255 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:19.255 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:19.255 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:19.255 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:19.255 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:19.255 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 157498 2024-04-19T02:17:19.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.255 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:19.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:19.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911721+0000", 2024-04-19T02:17:19.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:19.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:19.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911721+0000", 2024-04-19T02:17:19.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:19.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:19.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911720+0000", 2024-04-19T02:17:19.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:19.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:19.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911726+0000", 2024-04-19T02:17:19.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3179999999999997e-06 2024-04-19T02:17:19.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:19.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911746+0000", 2024-04-19T02:17:19.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0574e-05 2024-04-19T02:17:19.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911757+0000", 2024-04-19T02:17:19.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0959e-05 2024-04-19T02:17:19.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:19.258 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911795+0000", 2024-04-19T02:17:19.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7589999999999998e-05 2024-04-19T02:17:19.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:19.258 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911912+0000", 2024-04-19T02:17:19.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117625 2024-04-19T02:17:19.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:19.258 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.912250+0000", 2024-04-19T02:17:19.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00033710599999999999 2024-04-19T02:17:19.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:19.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.915540+0000", 2024-04-19T02:17:19.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032909559999999998 2024-04-19T02:17:19.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:19.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.934984+0000", 2024-04-19T02:17:19.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019443670999999999 2024-04-19T02:17:19.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:19.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.935013+0000", 2024-04-19T02:17:19.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8464999999999999e-05 2024-04-19T02:17:19.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.260 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.260 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:19.260 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.935035+0000", 2024-04-19T02:17:19.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1954e-05 2024-04-19T02:17:19.260 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:19.260 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:19.260 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:19.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.260 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.260 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168377 5.d 5:b1f3fb6d:::benchmark_data_smithi121_44835_object34342:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:19.260 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069470+0000", 2024-04-19T02:17:19.260 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 7.1457194849999999, 2024-04-19T02:17:19.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050516473999999999, 2024-04-19T02:17:19.261 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:19.261 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:19.261 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:19.261 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:19.261 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:19.261 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168377 2024-04-19T02:17:19.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.261 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:19.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:19.261 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069470+0000", 2024-04-19T02:17:19.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:19.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:19.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069470+0000", 2024-04-19T02:17:19.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:19.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.262 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:19.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069469+0000", 2024-04-19T02:17:19.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:19.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.262 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:19.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069473+0000", 2024-04-19T02:17:19.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4580000000000002e-06 2024-04-19T02:17:19.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.263 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.263 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:19.263 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069482+0000", 2024-04-19T02:17:19.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2839999999999995e-06 2024-04-19T02:17:19.263 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.263 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.263 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.263 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069489+0000", 2024-04-19T02:17:19.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3579999999999997e-06 2024-04-19T02:17:19.263 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.263 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.263 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:19.263 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069559+0000", 2024-04-19T02:17:19.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9678000000000006e-05 2024-04-19T02:17:19.264 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.264 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.264 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:19.264 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069683+0000", 2024-04-19T02:17:19.264 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012359400000000001 2024-04-19T02:17:19.264 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.264 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.264 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:19.264 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069759+0000", 2024-04-19T02:17:19.264 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6834000000000003e-05 2024-04-19T02:17:19.264 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.264 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.264 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:19.264 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119871+0000", 2024-04-19T02:17:19.264 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050111392999999997 2024-04-19T02:17:19.264 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.265 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:19.265 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119932+0000", 2024-04-19T02:17:19.265 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1209000000000003e-05 2024-04-19T02:17:19.265 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.265 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:19.265 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119962+0000", 2024-04-19T02:17:19.265 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9717999999999999e-05 2024-04-19T02:17:19.265 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.265 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:19.265 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119986+0000", 2024-04-19T02:17:19.265 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4549000000000002e-05 2024-04-19T02:17:19.265 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:19.266 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:19.266 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:19.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.266 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168379 5.d 5:bcd492dd:::benchmark_data_smithi121_44835_object34344:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:19.266 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069502+0000", 2024-04-19T02:17:19.266 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 7.1456874319999999, 2024-04-19T02:17:19.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050544645999999999, 2024-04-19T02:17:19.266 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:19.266 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:19.266 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:19.266 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:19.266 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:19.267 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168379 2024-04-19T02:17:19.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.267 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:19.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:19.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069502+0000", 2024-04-19T02:17:19.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:19.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:19.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069502+0000", 2024-04-19T02:17:19.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:19.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.268 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:19.268 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069501+0000", 2024-04-19T02:17:19.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:19.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.268 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.268 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:19.268 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069504+0000", 2024-04-19T02:17:19.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9289999999999998e-06 2024-04-19T02:17:19.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.268 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.268 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:19.268 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069511+0000", 2024-04-19T02:17:19.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1909999999999997e-06 2024-04-19T02:17:19.269 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.269 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.269 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069517+0000", 2024-04-19T02:17:19.269 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0789999999999997e-06 2024-04-19T02:17:19.269 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.269 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:19.269 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071081+0000", 2024-04-19T02:17:19.269 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0015646550000000001 2024-04-19T02:17:19.269 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.269 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:19.269 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071195+0000", 2024-04-19T02:17:19.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011399400000000001 2024-04-19T02:17:19.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:19.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071293+0000", 2024-04-19T02:17:19.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7938999999999999e-05 2024-04-19T02:17:19.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:19.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119898+0000", 2024-04-19T02:17:19.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.048604808999999999 2024-04-19T02:17:19.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.271 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:19.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119993+0000", 2024-04-19T02:17:19.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5224999999999997e-05 2024-04-19T02:17:19.271 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.271 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:19.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120024+0000", 2024-04-19T02:17:19.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0580999999999997e-05 2024-04-19T02:17:19.271 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.271 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:19.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120047+0000", 2024-04-19T02:17:19.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2725e-05 2024-04-19T02:17:19.271 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:19.271 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:19.272 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:19.272 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.272 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.272 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168381 5.d 5:bcbab0e3:::benchmark_data_smithi121_44835_object34346:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:19.272 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:19.272 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 7.145668014, 2024-04-19T02:17:19.272 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050574694000000003, 2024-04-19T02:17:19.272 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:19.272 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:19.272 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:19.272 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:19.272 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:19.272 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168381 2024-04-19T02:17:19.272 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.272 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:19.273 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.273 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:19.273 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:19.273 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:19.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.273 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.273 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:19.273 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:19.273 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:19.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.273 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.273 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:19.273 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:19.273 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:19.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:19.274 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069523+0000", 2024-04-19T02:17:19.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.244e-06 2024-04-19T02:17:19.274 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:19.274 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069528+0000", 2024-04-19T02:17:19.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0669999999999999e-06 2024-04-19T02:17:19.274 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.274 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069533+0000", 2024-04-19T02:17:19.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4680000000000003e-06 2024-04-19T02:17:19.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:19.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072637+0000", 2024-04-19T02:17:19.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031040429999999999 2024-04-19T02:17:19.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:19.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072710+0000", 2024-04-19T02:17:19.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3045000000000003e-05 2024-04-19T02:17:19.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:19.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072775+0000", 2024-04-19T02:17:19.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5034000000000001e-05 2024-04-19T02:17:19.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:19.276 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119925+0000", 2024-04-19T02:17:19.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.047150594999999997 2024-04-19T02:17:19.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:19.276 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120055+0000", 2024-04-19T02:17:19.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129288 2024-04-19T02:17:19.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:19.276 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120077+0000", 2024-04-19T02:17:19.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1759e-05 2024-04-19T02:17:19.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.277 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:19.277 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120096+0000", 2024-04-19T02:17:19.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9524000000000001e-05 2024-04-19T02:17:19.277 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:19.277 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:19.277 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:19.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.277 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168382 5.f 5:f2599a15:::benchmark_data_smithi121_44835_object34347:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:19.277 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069556+0000", 2024-04-19T02:17:19.277 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 7.1456336069999997, 2024-04-19T02:17:19.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050009713999999997, 2024-04-19T02:17:19.278 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:19.278 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:19.278 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:19.278 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:19.278 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:19.278 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168382 2024-04-19T02:17:19.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.278 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:19.278 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:19.278 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069556+0000", 2024-04-19T02:17:19.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:19.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.278 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:19.279 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069556+0000", 2024-04-19T02:17:19.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:19.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.279 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:19.279 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069555+0000", 2024-04-19T02:17:19.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:19.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.279 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:19.279 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069558+0000", 2024-04-19T02:17:19.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7879999999999998e-06 2024-04-19T02:17:19.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.279 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:19.280 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069566+0000", 2024-04-19T02:17:19.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6149999999999999e-06 2024-04-19T02:17:19.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.280 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.280 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069571+0000", 2024-04-19T02:17:19.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5509999999999999e-06 2024-04-19T02:17:19.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.280 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:19.280 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069618+0000", 2024-04-19T02:17:19.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6964e-05 2024-04-19T02:17:19.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.280 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:19.281 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069744+0000", 2024-04-19T02:17:19.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012577199999999999 2024-04-19T02:17:19.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.281 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:19.281 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.070116+0000", 2024-04-19T02:17:19.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000372407 2024-04-19T02:17:19.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.281 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:19.281 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117511+0000", 2024-04-19T02:17:19.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.047394935999999999 2024-04-19T02:17:19.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.281 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:19.281 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119484+0000", 2024-04-19T02:17:19.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019722310000000001 2024-04-19T02:17:19.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:19.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119525+0000", 2024-04-19T02:17:19.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1035999999999998e-05 2024-04-19T02:17:19.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:19.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119565+0000", 2024-04-19T02:17:19.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0859000000000003e-05 2024-04-19T02:17:19.282 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:19.282 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:19.282 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:19.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.283 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168383 5.d 5:bbd9496c:::benchmark_data_smithi121_44835_object34348:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:19.283 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069581+0000", 2024-04-19T02:17:19.283 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 7.1456087190000002, 2024-04-19T02:17:19.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050607278999999998, 2024-04-19T02:17:19.283 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:19.283 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:19.283 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:19.283 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:19.283 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:19.283 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168383 2024-04-19T02:17:19.283 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.283 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:19.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.283 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:19.284 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069581+0000", 2024-04-19T02:17:19.284 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:19.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.284 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:19.284 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069581+0000", 2024-04-19T02:17:19.284 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:19.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.284 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:19.284 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069580+0000", 2024-04-19T02:17:19.284 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:19.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.284 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:19.284 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069589+0000", 2024-04-19T02:17:19.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6750000000000008e-06 2024-04-19T02:17:19.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:19.285 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069596+0000", 2024-04-19T02:17:19.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7360000000000004e-06 2024-04-19T02:17:19.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.285 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069601+0000", 2024-04-19T02:17:19.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0479999999999998e-06 2024-04-19T02:17:19.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:19.285 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.073854+0000", 2024-04-19T02:17:19.286 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042531920000000003 2024-04-19T02:17:19.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.286 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:19.286 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.073952+0000", 2024-04-19T02:17:19.286 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7851999999999998e-05 2024-04-19T02:17:19.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.286 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:19.286 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074012+0000", 2024-04-19T02:17:19.286 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0225e-05 2024-04-19T02:17:19.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.286 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:19.286 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120102+0000", 2024-04-19T02:17:19.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.046090150000000003 2024-04-19T02:17:19.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.287 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:19.287 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120129+0000", 2024-04-19T02:17:19.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7228000000000001e-05 2024-04-19T02:17:19.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.287 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:19.287 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120157+0000", 2024-04-19T02:17:19.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7165000000000002e-05 2024-04-19T02:17:19.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.287 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:19.287 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120188+0000", 2024-04-19T02:17:19.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1418000000000003e-05 2024-04-19T02:17:19.288 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:19.288 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:19.288 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:19.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.288 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168384 5.7 5:ed638f84:::benchmark_data_smithi121_44835_object34349:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:19.288 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069612+0000", 2024-04-19T02:17:19.288 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 7.1455776660000003, 2024-04-19T02:17:19.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049863376000000001, 2024-04-19T02:17:19.288 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:19.288 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:19.288 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:19.288 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:19.288 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:19.288 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168384 2024-04-19T02:17:19.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.289 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:19.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.289 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:19.289 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069612+0000", 2024-04-19T02:17:19.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:19.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.289 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:19.289 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069612+0000", 2024-04-19T02:17:19.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:19.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.289 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:19.289 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069611+0000", 2024-04-19T02:17:19.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:19.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.290 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:19.290 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069614+0000", 2024-04-19T02:17:19.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7819999999999998e-06 2024-04-19T02:17:19.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.290 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:19.290 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069623+0000", 2024-04-19T02:17:19.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6989999999999992e-06 2024-04-19T02:17:19.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.290 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.290 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069628+0000", 2024-04-19T02:17:19.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4999999999999999e-06 2024-04-19T02:17:19.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:19.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069662+0000", 2024-04-19T02:17:19.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3319999999999999e-05 2024-04-19T02:17:19.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:19.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069782+0000", 2024-04-19T02:17:19.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120547 2024-04-19T02:17:19.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:19.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119338+0000", 2024-04-19T02:17:19.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049556141999999997 2024-04-19T02:17:19.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.292 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:19.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119388+0000", 2024-04-19T02:17:19.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9866e-05 2024-04-19T02:17:19.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.292 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:19.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119475+0000", 2024-04-19T02:17:19.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6929999999999996e-05 2024-04-19T02:17:19.292 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:19.292 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:19.292 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:19.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.293 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168385 5.d 5:b22d7e69:::benchmark_data_smithi121_44835_object34350:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:19.293 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:19.293 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 7.1455542269999999, 2024-04-19T02:17:19.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.055438508999999997, 2024-04-19T02:17:19.293 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:19.293 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:19.293 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:19.293 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:19.293 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:19.293 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168385 2024-04-19T02:17:19.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.294 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:19.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:19.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:19.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:19.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:19.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:19.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:19.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:19.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:19.295 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:19.295 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.295 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:19.295 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069637+0000", 2024-04-19T02:17:19.295 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.576e-06 2024-04-19T02:17:19.295 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.295 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:19.295 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069643+0000", 2024-04-19T02:17:19.295 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8030000000000002e-06 2024-04-19T02:17:19.295 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.295 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.295 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069648+0000", 2024-04-19T02:17:19.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0889999999999999e-06 2024-04-19T02:17:19.296 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.296 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.296 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:19.296 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117534+0000", 2024-04-19T02:17:19.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.047886390000000001 2024-04-19T02:17:19.296 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.296 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.296 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:19.296 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117670+0000", 2024-04-19T02:17:19.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000135969 2024-04-19T02:17:19.296 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.296 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.296 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:19.296 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117803+0000", 2024-04-19T02:17:19.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000132955 2024-04-19T02:17:19.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:19.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120501+0000", 2024-04-19T02:17:19.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026978050000000002 2024-04-19T02:17:19.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:19.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.125026+0000", 2024-04-19T02:17:19.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045244589999999998 2024-04-19T02:17:19.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:19.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.125049+0000", 2024-04-19T02:17:19.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3807000000000001e-05 2024-04-19T02:17:19.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:19.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.125074+0000", 2024-04-19T02:17:19.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4175000000000001e-05 2024-04-19T02:17:19.298 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:19.298 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:19.298 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:19.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.298 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168386 5.5 5:a2cda182:::benchmark_data_smithi121_44835_object34351:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:19.298 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069653+0000", 2024-04-19T02:17:19.298 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 7.1455367599999997, 2024-04-19T02:17:19.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058748884000000001, 2024-04-19T02:17:19.298 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:19.298 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:19.299 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:19.299 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:19.299 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:19.299 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168386 2024-04-19T02:17:19.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.299 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:19.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.299 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:19.299 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069653+0000", 2024-04-19T02:17:19.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:19.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.299 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:19.299 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069653+0000", 2024-04-19T02:17:19.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:19.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.300 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:19.300 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069652+0000", 2024-04-19T02:17:19.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:19.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.300 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:19.300 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069654+0000", 2024-04-19T02:17:19.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1220000000000002e-06 2024-04-19T02:17:19.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.300 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:19.300 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069660+0000", 2024-04-19T02:17:19.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5890000000000002e-06 2024-04-19T02:17:19.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069665+0000", 2024-04-19T02:17:19.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.989e-06 2024-04-19T02:17:19.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:19.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120220+0000", 2024-04-19T02:17:19.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050555061999999998 2024-04-19T02:17:19.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:19.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120329+0000", 2024-04-19T02:17:19.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010922200000000001 2024-04-19T02:17:19.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:19.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.128293+0000", 2024-04-19T02:17:19.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079640279999999997 2024-04-19T02:17:19.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:19.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.128336+0000", 2024-04-19T02:17:19.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2245e-05 2024-04-19T02:17:19.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.303 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:19.303 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.128401+0000", 2024-04-19T02:17:19.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5975000000000004e-05 2024-04-19T02:17:19.303 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:19.303 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:19.303 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:19.303 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.303 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168387 5.f 5:ff36d1d9:::benchmark_data_smithi121_44835_object34352:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:19.303 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:19.303 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 7.1455199260000004, 2024-04-19T02:17:19.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049975358999999997, 2024-04-19T02:17:19.304 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:19.304 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:19.304 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:19.304 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:19.304 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:19.304 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168387 2024-04-19T02:17:19.304 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.304 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:19.304 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.304 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:19.304 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:19.304 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:19.304 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.304 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.304 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:19.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:19.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:19.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:19.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:19.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:19.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:19.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069671+0000", 2024-04-19T02:17:19.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1739999999999999e-06 2024-04-19T02:17:19.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:19.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069677+0000", 2024-04-19T02:17:19.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4519999999999996e-06 2024-04-19T02:17:19.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069682+0000", 2024-04-19T02:17:19.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5400000000000003e-06 2024-04-19T02:17:19.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:19.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072634+0000", 2024-04-19T02:17:19.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0029521510000000001 2024-04-19T02:17:19.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.307 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:19.307 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072706+0000", 2024-04-19T02:17:19.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1996999999999995e-05 2024-04-19T02:17:19.307 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.307 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:19.307 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072772+0000", 2024-04-19T02:17:19.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5380000000000001e-05 2024-04-19T02:17:19.307 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.307 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:19.307 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117549+0000", 2024-04-19T02:17:19.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044777124000000001 2024-04-19T02:17:19.308 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.308 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.308 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:19.308 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119572+0000", 2024-04-19T02:17:19.308 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002022893 2024-04-19T02:17:19.308 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.308 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.308 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:19.308 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119613+0000", 2024-04-19T02:17:19.308 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0849999999999997e-05 2024-04-19T02:17:19.308 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.308 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.308 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:19.308 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119645+0000", 2024-04-19T02:17:19.309 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2113000000000002e-05 2024-04-19T02:17:19.309 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:19.309 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:19.309 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:19.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.309 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.309 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168389 5.2 5:4bcb87b1:::benchmark_data_smithi121_44835_object34354:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:19.309 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.071719+0000", 2024-04-19T02:17:19.309 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 7.14347083, 2024-04-19T02:17:19.309 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.048248604, 2024-04-19T02:17:19.309 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:19.309 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:19.309 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:19.309 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:19.309 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:19.310 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168389 2024-04-19T02:17:19.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.310 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:19.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:19.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071719+0000", 2024-04-19T02:17:19.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:19.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:19.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071719+0000", 2024-04-19T02:17:19.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:19.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:19.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071718+0000", 2024-04-19T02:17:19.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:19.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:19.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071722+0000", 2024-04-19T02:17:19.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8590000000000004e-06 2024-04-19T02:17:19.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:19.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071730+0000", 2024-04-19T02:17:19.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8569999999999995e-06 2024-04-19T02:17:19.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071736+0000", 2024-04-19T02:17:19.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.127e-06 2024-04-19T02:17:19.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:19.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071769+0000", 2024-04-19T02:17:19.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3052000000000001e-05 2024-04-19T02:17:19.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:19.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071843+0000", 2024-04-19T02:17:19.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3683000000000006e-05 2024-04-19T02:17:19.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.313 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.313 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:19.313 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119852+0000", 2024-04-19T02:17:19.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.048009353999999997 2024-04-19T02:17:19.313 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.313 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.313 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:19.313 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119896+0000", 2024-04-19T02:17:19.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3102000000000002e-05 2024-04-19T02:17:19.313 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.313 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.313 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:19.313 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119967+0000", 2024-04-19T02:17:19.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1589999999999997e-05 2024-04-19T02:17:19.313 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:19.314 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:19.314 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:19.314 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.314 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.314 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168391 5.3 5:c5d9b5e1:::benchmark_data_smithi121_44835_object34356:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:19.314 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.074402+0000", 2024-04-19T02:17:19.314 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 7.1407869909999997, 2024-04-19T02:17:19.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.045426756999999998, 2024-04-19T02:17:19.314 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:19.314 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:19.314 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:19.314 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:19.314 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:19.314 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168391 2024-04-19T02:17:19.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.315 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:19.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:19.315 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074402+0000", 2024-04-19T02:17:19.315 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:19.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:19.315 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074402+0000", 2024-04-19T02:17:19.315 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:19.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:19.315 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074401+0000", 2024-04-19T02:17:19.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:19.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.316 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:19.316 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074406+0000", 2024-04-19T02:17:19.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5879999999999999e-06 2024-04-19T02:17:19.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.316 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:19.316 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074414+0000", 2024-04-19T02:17:19.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8599999999999993e-06 2024-04-19T02:17:19.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.316 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.316 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074420+0000", 2024-04-19T02:17:19.317 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6350000000000003e-06 2024-04-19T02:17:19.317 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.317 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.317 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:19.317 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074453+0000", 2024-04-19T02:17:19.317 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3874000000000001e-05 2024-04-19T02:17:19.317 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.317 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.317 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:19.317 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074531+0000", 2024-04-19T02:17:19.317 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7999999999999999e-05 2024-04-19T02:17:19.317 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.317 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.317 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:19.317 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119717+0000", 2024-04-19T02:17:19.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.045185395000000003 2024-04-19T02:17:19.318 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.318 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.318 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:19.318 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119756+0000", 2024-04-19T02:17:19.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9110000000000003e-05 2024-04-19T02:17:19.318 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.318 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.318 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:19.318 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119829+0000", 2024-04-19T02:17:19.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3238000000000006e-05 2024-04-19T02:17:19.318 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:19.318 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:19.318 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:19.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.319 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4549.0:168377 5.d e52/16 ondisk, result = 0)", 2024-04-19T02:17:19.319 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.077260+0000", 2024-04-19T02:17:19.319 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 7.13792925, 2024-04-19T02:17:19.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042613204000000002, 2024-04-19T02:17:19.319 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:19.319 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:19.319 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:19.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:19.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.077260+0000", 2024-04-19T02:17:19.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:19.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:19.320 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.077260+0000", 2024-04-19T02:17:19.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:19.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:19.320 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.077259+0000", 2024-04-19T02:17:19.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:19.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:19.320 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.077267+0000", 2024-04-19T02:17:19.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6799999999999993e-06 2024-04-19T02:17:19.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:19.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117372+0000", 2024-04-19T02:17:19.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040105342000000002 2024-04-19T02:17:19.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117389+0000", 2024-04-19T02:17:19.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6711e-05 2024-04-19T02:17:19.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:19.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119862+0000", 2024-04-19T02:17:19.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0024730580000000002 2024-04-19T02:17:19.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:19.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119867+0000", 2024-04-19T02:17:19.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1590000000000001e-06 2024-04-19T02:17:19.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:19.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:19.322 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:19.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119873+0000", 2024-04-19T02:17:19.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1410000000000002e-06 2024-04-19T02:17:19.322 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:19.322 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:19.322 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:19.322 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:19.322 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:19.322 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:19.323 INFO:tasks.thrashosds.thrasher:Setting full ratio back to .95 2024-04-19T02:17:19.323 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set-full-ratio .95 2024-04-19T02:17:19.323 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T02:17:19.325 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:17:19.325 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:19.324+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:19.424 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:19.425+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:19.497 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:17:19.498 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:17:19.498 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.498 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:189201 5.4 5:23557d03:::benchmark_data_smithi121_44835_object55166:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T02:17:19.498 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:19.493193+0000", 2024-04-19T02:17:19.498 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0049281439999999998, 2024-04-19T02:17:19.498 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0049569790000000002, 2024-04-19T02:17:19.498 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:19.498 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:19.498 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:19.498 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:19.498 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:19.498 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 189201 2024-04-19T02:17:19.498 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.499 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:19.499 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.499 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:19.499 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.493193+0000", 2024-04-19T02:17:19.499 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:19.499 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.499 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.499 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:19.499 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.493193+0000", 2024-04-19T02:17:19.499 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:19.499 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.499 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.499 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:19.500 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.493192+0000", 2024-04-19T02:17:19.500 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:19.500 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.500 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.500 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:19.500 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.493196+0000", 2024-04-19T02:17:19.500 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0380000000000001e-06 2024-04-19T02:17:19.500 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.500 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.500 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:19.500 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.493205+0000", 2024-04-19T02:17:19.500 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.4870000000000008e-06 2024-04-19T02:17:19.500 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.500 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.501 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.501 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.493216+0000", 2024-04-19T02:17:19.501 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0265000000000001e-05 2024-04-19T02:17:19.501 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.501 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.501 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:19.501 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.493249+0000", 2024-04-19T02:17:19.501 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2824000000000003e-05 2024-04-19T02:17:19.501 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.501 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.501 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:19.501 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.493335+0000", 2024-04-19T02:17:19.501 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.6633999999999998e-05 2024-04-19T02:17:19.501 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:19.501 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:19.502 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:19.502 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.502 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.502 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:189204 5.4 5:2c69a805:::benchmark_data_smithi121_44835_object55169:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T02:17:19.502 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:19.494992+0000", 2024-04-19T02:17:19.502 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0031286249999999999, 2024-04-19T02:17:19.502 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0032542090000000001, 2024-04-19T02:17:19.502 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:19.502 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:19.502 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:19.502 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:19.502 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:19.502 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 189204 2024-04-19T02:17:19.502 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.503 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:19.503 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.503 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:19.503 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.494992+0000", 2024-04-19T02:17:19.503 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:19.503 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.503 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.503 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:19.503 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.494992+0000", 2024-04-19T02:17:19.503 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:19.503 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.503 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.503 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:19.503 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.494991+0000", 2024-04-19T02:17:19.503 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:19.504 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.504 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.504 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:19.504 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.494996+0000", 2024-04-19T02:17:19.504 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1980000000000003e-06 2024-04-19T02:17:19.504 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.504 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.504 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:19.504 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.495004+0000", 2024-04-19T02:17:19.504 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.3529999999999995e-06 2024-04-19T02:17:19.504 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.504 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.504 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.504 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.495012+0000", 2024-04-19T02:17:19.505 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.6279999999999996e-06 2024-04-19T02:17:19.505 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.505 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.505 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:19.505 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.495040+0000", 2024-04-19T02:17:19.505 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.8637e-05 2024-04-19T02:17:19.505 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.505 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.505 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:19.505 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.495118+0000", 2024-04-19T02:17:19.505 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.7272000000000001e-05 2024-04-19T02:17:19.505 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:19.505 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:19.505 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:19.505 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.506 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.506 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:189210 5.4 5:213754cb:::benchmark_data_smithi121_44835_object55175:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T02:17:19.506 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:19.497113+0000", 2024-04-19T02:17:19.506 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.00100749, 2024-04-19T02:17:19.506 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0012281530000000001, 2024-04-19T02:17:19.506 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:19.506 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:19.506 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:19.506 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:19.506 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:19.506 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 189210 2024-04-19T02:17:19.506 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.506 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:19.506 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.507 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:19.507 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.497113+0000", 2024-04-19T02:17:19.507 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:19.507 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.507 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.507 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:19.507 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.497113+0000", 2024-04-19T02:17:19.507 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:19.507 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.507 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.507 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:19.507 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.497112+0000", 2024-04-19T02:17:19.507 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:19.507 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.508 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.508 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:19.508 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.497118+0000", 2024-04-19T02:17:19.508 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7930000000000003e-06 2024-04-19T02:17:19.508 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.508 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.508 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:19.508 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.497136+0000", 2024-04-19T02:17:19.508 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.8122e-05 2024-04-19T02:17:19.508 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.508 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.508 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.508 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.497146+0000", 2024-04-19T02:17:19.508 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3640000000000005e-06 2024-04-19T02:17:19.509 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.509 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.509 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:19.509 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.497174+0000", 2024-04-19T02:17:19.509 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.8246e-05 2024-04-19T02:17:19.509 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.509 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.509 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:19.509 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.497283+0000", 2024-04-19T02:17:19.509 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010901899999999999 2024-04-19T02:17:19.509 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:19.509 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:19.509 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:19.509 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.509 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.510 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:189212 5.a 5:50f0e39b:::benchmark_data_smithi121_44835_object55177:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T02:17:19.510 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:19.498139+0000", 2024-04-19T02:17:19.510 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 4294967295.9999824, 2024-04-19T02:17:19.510 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00028355900000000001, 2024-04-19T02:17:19.510 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:19.510 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:19.510 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:19.510 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:19.510 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:19.510 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 189212 2024-04-19T02:17:19.510 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.510 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:19.510 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.510 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:19.511 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.498139+0000", 2024-04-19T02:17:19.511 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:19.511 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.511 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.511 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:19.511 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.498139+0000", 2024-04-19T02:17:19.511 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:19.511 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.511 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.511 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:19.511 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.498138+0000", 2024-04-19T02:17:19.511 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:19.512 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.512 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.512 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:19.512 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.498142+0000", 2024-04-19T02:17:19.512 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.493e-06 2024-04-19T02:17:19.512 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.512 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.512 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:19.512 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.498152+0000", 2024-04-19T02:17:19.512 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.6600000000000007e-06 2024-04-19T02:17:19.512 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.512 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.512 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.512 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.498159+0000", 2024-04-19T02:17:19.513 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.267e-06 2024-04-19T02:17:19.513 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.513 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.513 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:19.513 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.498208+0000", 2024-04-19T02:17:19.513 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8272999999999997e-05 2024-04-19T02:17:19.513 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.513 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.513 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:19.513 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.498330+0000", 2024-04-19T02:17:19.513 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000122168 2024-04-19T02:17:19.513 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:19.513 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:19.513 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:19.513 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.514 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.514 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:189213 5.e 5:7d7d9b97:::benchmark_data_smithi121_44835_object55178:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T02:17:19.514 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:19.498177+0000", 2024-04-19T02:17:19.514 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 4294967295.9999437, 2024-04-19T02:17:19.514 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00034154299999999998, 2024-04-19T02:17:19.514 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:19.514 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:19.514 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:19.514 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:19.514 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:19.514 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 189213 2024-04-19T02:17:19.514 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.514 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:19.514 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.514 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:19.515 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.498177+0000", 2024-04-19T02:17:19.515 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:19.515 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.515 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.515 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:19.515 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.498177+0000", 2024-04-19T02:17:19.515 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:19.515 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.515 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.515 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:19.516 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.498177+0000", 2024-04-19T02:17:19.516 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:19.516 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.516 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.516 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:19.516 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.498180+0000", 2024-04-19T02:17:19.516 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.8729999999999999e-06 2024-04-19T02:17:19.516 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.516 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.516 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:19.516 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.498188+0000", 2024-04-19T02:17:19.516 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.1259999999999998e-06 2024-04-19T02:17:19.516 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.516 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.516 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.517 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.498194+0000", 2024-04-19T02:17:19.517 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.2539999999999998e-06 2024-04-19T02:17:19.517 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.517 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.517 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:19.517 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.498230+0000", 2024-04-19T02:17:19.517 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6118999999999998e-05 2024-04-19T02:17:19.517 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.517 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.517 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:19.517 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.498346+0000", 2024-04-19T02:17:19.517 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000116416 2024-04-19T02:17:19.517 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:19.517 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:19.517 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:19.518 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.518 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.518 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:189215 5.1 5:80c9f2e1:::benchmark_data_smithi121_44835_object55180:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T02:17:19.518 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:19.498202+0000", 2024-04-19T02:17:19.518 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 4294967295.9999189, 2024-04-19T02:17:19.518 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00040155300000000002, 2024-04-19T02:17:19.518 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:19.518 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:19.518 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:19.518 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:19.518 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:19.518 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 189215 2024-04-19T02:17:19.518 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.518 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:19.519 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.519 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:19.519 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.498202+0000", 2024-04-19T02:17:19.519 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:19.519 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.519 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.519 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:19.519 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.498202+0000", 2024-04-19T02:17:19.519 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:19.519 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.519 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.519 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:19.519 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.498201+0000", 2024-04-19T02:17:19.519 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:19.519 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.520 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.520 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:19.520 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.498204+0000", 2024-04-19T02:17:19.520 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.897e-06 2024-04-19T02:17:19.520 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.520 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.520 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:19.520 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.498211+0000", 2024-04-19T02:17:19.520 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.4389999999999997e-06 2024-04-19T02:17:19.520 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.520 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.520 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.520 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.498216+0000", 2024-04-19T02:17:19.520 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2170000000000002e-06 2024-04-19T02:17:19.520 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.521 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.521 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:19.521 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.498250+0000", 2024-04-19T02:17:19.521 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4425999999999999e-05 2024-04-19T02:17:19.521 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.521 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.521 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:19.521 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.498352+0000", 2024-04-19T02:17:19.521 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000101686 2024-04-19T02:17:19.521 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:19.521 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:19.521 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:19.521 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.521 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.521 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:189214 5.f e55/16 5:fbff3fae:::benchmark_data_smithi121_44835_object55179:head v 55'11914, mlcod=55'11912)", 2024-04-19T02:17:19.522 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:19.498452+0000", 2024-04-19T02:17:19.522 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 4294967295.9996686, 2024-04-19T02:17:19.522 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000227412, 2024-04-19T02:17:19.522 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:19.522 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:19.522 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:19.522 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.522 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:19.522 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.498452+0000", 2024-04-19T02:17:19.522 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:19.522 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.522 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.522 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:19.522 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.498452+0000", 2024-04-19T02:17:19.522 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:19.523 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.523 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.523 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:19.523 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.498451+0000", 2024-04-19T02:17:19.523 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:19.523 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.523 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.523 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:19.523 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.498459+0000", 2024-04-19T02:17:19.523 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.8359999999999992e-06 2024-04-19T02:17:19.523 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.523 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.523 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:19.523 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.498468+0000", 2024-04-19T02:17:19.523 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.8529999999999998e-06 2024-04-19T02:17:19.524 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.524 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.524 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.524 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.498474+0000", 2024-04-19T02:17:19.524 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.2600000000000002e-06 2024-04-19T02:17:19.524 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.524 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.524 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:19.524 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.498512+0000", 2024-04-19T02:17:19.524 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7494999999999999e-05 2024-04-19T02:17:19.524 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.524 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.524 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:19.524 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:19.498532+0000", 2024-04-19T02:17:19.524 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.0361999999999999e-05 2024-04-19T02:17:19.524 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:19.525 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:19.525 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:19.525 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:19.525 INFO:teuthology.orchestra.run.smithi174.stdout: ], 2024-04-19T02:17:19.525 INFO:teuthology.orchestra.run.smithi174.stdout: "num_ops": 7 2024-04-19T02:17:19.525 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:17:19.526 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:17:19.527 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:19.526+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:19.627 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:19.627+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:19.728 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:19.728+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:19.745 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:17:19.745 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [], 2024-04-19T02:17:19.745 INFO:teuthology.orchestra.run.smithi174.stdout: "complaint_time": 30, 2024-04-19T02:17:19.745 INFO:teuthology.orchestra.run.smithi174.stdout: "num_blocked_ops": 0 2024-04-19T02:17:19.745 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:17:19.759 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:17:19.842 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:19.843+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:19.930 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:19.931+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:19.982 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:17:19.983 INFO:teuthology.orchestra.run.smithi174.stdout: "size": 20, 2024-04-19T02:17:19.983 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 600, 2024-04-19T02:17:19.983 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:17:19.983 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.983 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:19 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:19.983 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:17:19.983 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 110.71070825, 2024-04-19T02:17:19.983 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020818203, 2024-04-19T02:17:19.983 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:19.983 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:19.983 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:19.983 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.983 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:19.983 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:17:19.984 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:19.984 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.984 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.984 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:19.984 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:17:19.984 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:19.984 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.984 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.984 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:19.984 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:17:19.984 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:19.984 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.984 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.984 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:19.984 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270065+0000", 2024-04-19T02:17:19.984 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4310000000000001e-06 2024-04-19T02:17:19.985 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.985 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.985 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:19.985 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270070+0000", 2024-04-19T02:17:19.985 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2859999999999999e-06 2024-04-19T02:17:19.985 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.985 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.985 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.985 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270077+0000", 2024-04-19T02:17:19.985 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5270000000000004e-06 2024-04-19T02:17:19.985 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.985 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.985 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:19.985 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270107+0000", 2024-04-19T02:17:19.986 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0205999999999998e-05 2024-04-19T02:17:19.986 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.986 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.986 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:19.986 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270111+0000", 2024-04-19T02:17:19.986 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8650000000000003e-06 2024-04-19T02:17:19.986 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.986 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.986 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:19.986 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285936+0000", 2024-04-19T02:17:19.986 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015824677999999998 2024-04-19T02:17:19.986 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.986 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.986 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:19.987 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286007+0000", 2024-04-19T02:17:19.987 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1157999999999999e-05 2024-04-19T02:17:19.987 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.987 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.987 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:19.987 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286086+0000", 2024-04-19T02:17:19.987 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9084000000000004e-05 2024-04-19T02:17:19.987 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.987 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.987 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:19.987 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290740+0000", 2024-04-19T02:17:19.987 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0046543679999999999 2024-04-19T02:17:19.987 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.987 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.988 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:19.988 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290833+0000", 2024-04-19T02:17:19.988 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2551000000000002e-05 2024-04-19T02:17:19.988 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.988 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.988 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:19.988 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290859+0000", 2024-04-19T02:17:19.988 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.6696999999999999e-05 2024-04-19T02:17:19.988 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.988 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.988 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:19.988 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290881+0000", 2024-04-19T02:17:19.988 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1653000000000001e-05 2024-04-19T02:17:19.988 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:19.989 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:19.989 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:19.989 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.989 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.989 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:77622 5.8 5:166fbe77:::benchmark_data_smithi121_44835_object77621:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:19.989 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:17:19.989 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 53.175211312999998, 2024-04-19T02:17:19.989 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.021784694, 2024-04-19T02:17:19.989 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:19.989 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:19.989 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:19.989 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:19.989 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:19.989 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 77622 2024-04-19T02:17:19.990 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.990 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:19.990 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.990 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:19.990 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:17:19.990 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:19.990 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.990 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.990 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:19.990 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:17:19.990 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:19.990 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.990 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.990 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:19.991 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805559+0000", 2024-04-19T02:17:19.991 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:19.991 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.991 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.991 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:19.991 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805659+0000", 2024-04-19T02:17:19.991 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.9908000000000006e-05 2024-04-19T02:17:19.991 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.991 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.991 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:19.991 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805668+0000", 2024-04-19T02:17:19.991 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2129999999999997e-06 2024-04-19T02:17:19.991 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.991 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.991 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.991 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805673+0000", 2024-04-19T02:17:19.992 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0370000000000002e-06 2024-04-19T02:17:19.992 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.992 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.992 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:19.992 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812022+0000", 2024-04-19T02:17:19.992 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0063483239999999998 2024-04-19T02:17:19.992 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.992 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.992 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:19.992 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812129+0000", 2024-04-19T02:17:19.992 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010744200000000001 2024-04-19T02:17:19.992 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.992 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.992 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:19.992 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812252+0000", 2024-04-19T02:17:19.992 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000122519 2024-04-19T02:17:19.993 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.993 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.993 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:19.993 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.820979+0000", 2024-04-19T02:17:19.993 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0087272740000000001 2024-04-19T02:17:19.993 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.993 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.993 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:19.993 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827270+0000", 2024-04-19T02:17:19.993 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0062906239999999999 2024-04-19T02:17:19.993 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.993 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.993 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:19.993 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827309+0000", 2024-04-19T02:17:19.993 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9678999999999997e-05 2024-04-19T02:17:19.993 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.994 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.994 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:19.994 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827345+0000", 2024-04-19T02:17:19.994 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5308000000000001e-05 2024-04-19T02:17:19.994 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:19.994 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:19.994 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:19.994 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.994 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.994 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78224 5.4 5:26e797d5:::benchmark_data_smithi121_44835_object78223:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:19.994 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:17:19.994 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 52.874209114000003, 2024-04-19T02:17:19.994 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.021471998999999999, 2024-04-19T02:17:19.994 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:19.994 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:19.995 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:19.995 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:19.995 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:19.995 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78224 2024-04-19T02:17:19.995 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.995 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:19.995 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.995 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:19.995 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:17:19.995 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:19.995 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.995 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.995 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:19.996 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:17:19.996 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:19.996 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.996 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.996 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:19.996 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106561+0000", 2024-04-19T02:17:19.996 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:19.996 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.996 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.996 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:19.996 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106630+0000", 2024-04-19T02:17:19.996 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.8553999999999994e-05 2024-04-19T02:17:19.996 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.996 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.997 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:19.997 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106644+0000", 2024-04-19T02:17:19.997 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.4651000000000001e-05 2024-04-19T02:17:19.997 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.997 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.997 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:19.997 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106653+0000", 2024-04-19T02:17:19.997 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.6719999999999993e-06 2024-04-19T02:17:19.997 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.997 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.997 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:19.997 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106693+0000", 2024-04-19T02:17:19.997 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9978999999999998e-05 2024-04-19T02:17:19.997 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.997 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.998 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:19.998 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106840+0000", 2024-04-19T02:17:19.998 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0001473 2024-04-19T02:17:19.998 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.998 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.998 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:19.998 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106971+0000", 2024-04-19T02:17:19.998 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013051499999999999 2024-04-19T02:17:19.998 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.998 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.998 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:19.998 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.109047+0000", 2024-04-19T02:17:19.998 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.002076002 2024-04-19T02:17:19.998 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.998 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.999 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:19.999 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.127967+0000", 2024-04-19T02:17:19.999 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.018919780000000001 2024-04-19T02:17:19.999 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.999 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.999 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:19.999 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128004+0000", 2024-04-19T02:17:19.999 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7719000000000003e-05 2024-04-19T02:17:19.999 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:19.999 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:19.999 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:19.999 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128034+0000", 2024-04-19T02:17:19.999 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9651000000000001e-05 2024-04-19T02:17:19.999 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:19.999 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:19.999 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:19.999 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.000 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.000 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78259 5.4 5:2aa344b2:::benchmark_data_smithi121_44835_object78258:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:20.000 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:17:20.000 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 52.855514045, 2024-04-19T02:17:20.000 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022934350999999999, 2024-04-19T02:17:20.000 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:20.000 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:20.000 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:20.000 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:20.000 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:20.000 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78259 2024-04-19T02:17:20.000 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.000 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:20.000 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.000 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:20.000 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:17:20.000 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:20.001 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.001 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.001 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:20.001 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:17:20.001 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:20.001 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.001 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.001 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:20.001 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125256+0000", 2024-04-19T02:17:20.001 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:20.001 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.001 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.001 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:20.001 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125347+0000", 2024-04-19T02:17:20.001 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0470000000000006e-05 2024-04-19T02:17:20.001 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.002 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.002 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:20.002 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125358+0000", 2024-04-19T02:17:20.002 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1764e-05 2024-04-19T02:17:20.002 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.002 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.002 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:20.002 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125364+0000", 2024-04-19T02:17:20.002 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7189999999999998e-06 2024-04-19T02:17:20.002 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.002 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.002 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:20.002 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125391+0000", 2024-04-19T02:17:20.003 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7270000000000001e-05 2024-04-19T02:17:20.003 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.003 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.003 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:20.003 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125471+0000", 2024-04-19T02:17:20.003 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9209999999999995e-05 2024-04-19T02:17:20.003 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.003 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.003 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:20.003 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125559+0000", 2024-04-19T02:17:20.003 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.8689000000000004e-05 2024-04-19T02:17:20.003 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.003 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.003 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:20.003 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128164+0000", 2024-04-19T02:17:20.003 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0026050270000000002 2024-04-19T02:17:20.003 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.004 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.004 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:20.004 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148139+0000", 2024-04-19T02:17:20.004 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.019975050000000001 2024-04-19T02:17:20.004 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.004 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.004 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:20.004 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148169+0000", 2024-04-19T02:17:20.004 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0001e-05 2024-04-19T02:17:20.004 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.004 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.004 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:20.004 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148191+0000", 2024-04-19T02:17:20.004 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.2104999999999999e-05 2024-04-19T02:17:20.004 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:20.005 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:20.005 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:20.005 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.005 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.005 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78271 5.4 5:2982d7a6:::benchmark_data_smithi121_44835_object78270:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:20.005 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:17:20.005 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 52.848650814999999, 2024-04-19T02:17:20.005 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020841755999999999, 2024-04-19T02:17:20.005 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:20.005 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:20.005 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:20.005 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:20.005 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:20.005 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78271 2024-04-19T02:17:20.005 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.005 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:20.006 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.006 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:20.006 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:17:20.006 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:20.006 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.006 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.006 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:20.006 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:17:20.006 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:20.006 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.006 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.006 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:20.006 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132119+0000", 2024-04-19T02:17:20.006 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:20.007 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.007 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.007 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:20.007 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132185+0000", 2024-04-19T02:17:20.007 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5994000000000005e-05 2024-04-19T02:17:20.007 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.007 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.007 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:20.007 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132197+0000", 2024-04-19T02:17:20.007 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2091e-05 2024-04-19T02:17:20.007 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.007 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.007 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:20.008 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132206+0000", 2024-04-19T02:17:20.008 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.5099999999999998e-06 2024-04-19T02:17:20.008 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.008 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.008 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:20.008 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132242+0000", 2024-04-19T02:17:20.008 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5663000000000001e-05 2024-04-19T02:17:20.008 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.008 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.008 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:20.008 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132335+0000", 2024-04-19T02:17:20.008 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3275000000000004e-05 2024-04-19T02:17:20.008 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.008 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.008 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:20.009 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132432+0000", 2024-04-19T02:17:20.009 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7571000000000005e-05 2024-04-19T02:17:20.009 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.009 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.009 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:20.009 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.136706+0000", 2024-04-19T02:17:20.009 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0042738170000000001 2024-04-19T02:17:20.009 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.009 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.009 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:20.009 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152909+0000", 2024-04-19T02:17:20.009 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016202415000000001 2024-04-19T02:17:20.009 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.009 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.009 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:20.009 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152938+0000", 2024-04-19T02:17:20.010 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9740999999999999e-05 2024-04-19T02:17:20.010 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.010 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.010 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:20.010 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152962+0000", 2024-04-19T02:17:20.010 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3659000000000002e-05 2024-04-19T02:17:20.010 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:20.010 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:20.010 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:20.010 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.010 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.010 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78272 5.4 5:273e819a:::benchmark_data_smithi121_44835_object78271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:20.010 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:20.010 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 52.848161771999997, 2024-04-19T02:17:20.011 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022180163999999999, 2024-04-19T02:17:20.011 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:20.011 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:20.011 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:20.011 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:20.011 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:20.011 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78272 2024-04-19T02:17:20.011 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.011 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:20.011 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.011 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:20.011 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:20.011 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:20.011 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.011 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.012 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:20.012 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:20.012 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:20.012 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.012 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.012 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:20.012 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:20.012 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:20.012 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.012 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.012 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:20.012 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132690+0000", 2024-04-19T02:17:20.012 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0963000000000004e-05 2024-04-19T02:17:20.012 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.012 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.013 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:20.013 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132703+0000", 2024-04-19T02:17:20.013 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.3072e-05 2024-04-19T02:17:20.013 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.013 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.013 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:20.013 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132710+0000", 2024-04-19T02:17:20.013 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3100000000000003e-06 2024-04-19T02:17:20.013 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.013 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.013 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:20.013 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134005+0000", 2024-04-19T02:17:20.013 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001294513 2024-04-19T02:17:20.014 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.014 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.014 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:20.014 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134139+0000", 2024-04-19T02:17:20.014 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000134447 2024-04-19T02:17:20.014 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.014 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.014 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:20.014 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134284+0000", 2024-04-19T02:17:20.014 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014514399999999999 2024-04-19T02:17:20.014 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.014 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.014 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:20.015 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.139622+0000", 2024-04-19T02:17:20.015 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0053373830000000002 2024-04-19T02:17:20.015 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.015 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.015 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:20.015 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154737+0000", 2024-04-19T02:17:20.015 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015115195999999999 2024-04-19T02:17:20.015 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.015 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.015 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:20.015 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154768+0000", 2024-04-19T02:17:20.015 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0824999999999997e-05 2024-04-19T02:17:20.015 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.015 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.016 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:20.016 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154790+0000", 2024-04-19T02:17:20.016 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1999000000000001e-05 2024-04-19T02:17:20.016 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:20.016 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:20.016 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:20.016 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.016 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.016 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:94481 5.e 5:7b2fbebf:::benchmark_data_smithi121_44835_object94480:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:20.016 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:17:20.016 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 44.859525454999996, 2024-04-19T02:17:20.016 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020897846000000001, 2024-04-19T02:17:20.016 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:20.016 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:20.016 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:20.017 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:20.017 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:20.017 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 94481 2024-04-19T02:17:20.017 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.017 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:20.017 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.017 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:20.017 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:17:20.017 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:20.017 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.017 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.017 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:20.017 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:17:20.017 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:20.017 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.018 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.018 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:20.018 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121245+0000", 2024-04-19T02:17:20.018 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:20.018 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.018 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.018 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:20.018 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121273+0000", 2024-04-19T02:17:20.018 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7250000000000002e-05 2024-04-19T02:17:20.018 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.018 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.018 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:20.018 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121277+0000", 2024-04-19T02:17:20.018 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2860000000000001e-06 2024-04-19T02:17:20.019 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.019 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.019 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:20.019 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121280+0000", 2024-04-19T02:17:20.019 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2739999999999999e-06 2024-04-19T02:17:20.019 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.019 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.019 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:20.019 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121320+0000", 2024-04-19T02:17:20.019 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9879000000000002e-05 2024-04-19T02:17:20.019 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.019 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.019 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:20.019 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121448+0000", 2024-04-19T02:17:20.019 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012748800000000001 2024-04-19T02:17:20.019 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.020 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.020 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:20.020 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121595+0000", 2024-04-19T02:17:20.020 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014741299999999999 2024-04-19T02:17:20.020 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.020 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.020 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:20.020 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.127776+0000", 2024-04-19T02:17:20.020 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0061811360000000003 2024-04-19T02:17:20.020 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.020 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.020 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:20.020 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142073+0000", 2024-04-19T02:17:20.020 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014296959999999999 2024-04-19T02:17:20.020 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.021 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.021 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:20.021 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142106+0000", 2024-04-19T02:17:20.021 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3348e-05 2024-04-19T02:17:20.021 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.021 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.021 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:20.021 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142144+0000", 2024-04-19T02:17:20.021 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7153000000000002e-05 2024-04-19T02:17:20.021 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:20.021 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:20.021 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:20.021 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.021 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.021 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:94581 5.b 5:dc86d6e9:::benchmark_data_smithi121_44835_object94580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:20.022 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:20.022 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 44.800590882000002, 2024-04-19T02:17:20.022 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022099711000000001, 2024-04-19T02:17:20.022 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:20.022 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:20.022 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:20.022 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:20.022 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:20.022 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 94581 2024-04-19T02:17:20.022 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.022 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:20.022 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.023 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:20.023 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:20.023 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:20.023 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.023 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.023 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:20.023 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:20.023 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:20.023 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.023 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.023 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:20.023 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:20.023 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:20.024 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.024 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.024 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:20.024 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180253+0000", 2024-04-19T02:17:20.024 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3163000000000004e-05 2024-04-19T02:17:20.024 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.024 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.024 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:20.024 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180266+0000", 2024-04-19T02:17:20.024 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2886e-05 2024-04-19T02:17:20.024 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.024 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.024 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:20.024 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180273+0000", 2024-04-19T02:17:20.024 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.4059999999999999e-06 2024-04-19T02:17:20.025 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.025 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.025 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:20.025 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180646+0000", 2024-04-19T02:17:20.025 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00037283999999999999 2024-04-19T02:17:20.025 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.025 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.025 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:20.025 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180774+0000", 2024-04-19T02:17:20.025 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012793799999999999 2024-04-19T02:17:20.025 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.025 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.025 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:20.025 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180920+0000", 2024-04-19T02:17:20.025 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000146692 2024-04-19T02:17:20.026 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.026 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.026 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:20.026 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.183344+0000", 2024-04-19T02:17:20.026 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0024231669999999999 2024-04-19T02:17:20.026 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.026 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.026 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:20.026 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202196+0000", 2024-04-19T02:17:20.026 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.018852384 2024-04-19T02:17:20.026 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.026 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.026 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:20.027 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202241+0000", 2024-04-19T02:17:20.027 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4923999999999999e-05 2024-04-19T02:17:20.027 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.027 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.027 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:20.027 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202280+0000", 2024-04-19T02:17:20.027 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9096e-05 2024-04-19T02:17:20.027 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:20.027 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:20.027 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:20.027 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.027 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.027 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:96356 5.0 5:0a661b39:::benchmark_data_smithi121_44835_object96355:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:20.027 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:17:20.027 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 43.887378040000002, 2024-04-19T02:17:20.027 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020955516, 2024-04-19T02:17:20.028 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:20.028 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:20.028 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:20.028 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:20.028 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:20.028 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 96356 2024-04-19T02:17:20.028 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.028 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:20.028 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.028 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:20.028 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:17:20.028 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:20.028 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.028 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.028 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:20.029 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:17:20.029 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:20.029 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.029 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.029 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:20.029 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:17:20.029 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:20.029 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.029 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.029 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:20.029 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093455+0000", 2024-04-19T02:17:20.029 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.2205000000000005e-05 2024-04-19T02:17:20.030 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.030 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.030 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:20.030 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093464+0000", 2024-04-19T02:17:20.030 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3910000000000004e-06 2024-04-19T02:17:20.030 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.030 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.030 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:20.030 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093469+0000", 2024-04-19T02:17:20.030 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.7249999999999997e-06 2024-04-19T02:17:20.030 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.030 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.030 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:20.030 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099643+0000", 2024-04-19T02:17:20.030 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0061743359999999999 2024-04-19T02:17:20.031 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.031 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.031 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:20.031 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099774+0000", 2024-04-19T02:17:20.031 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013050599999999999 2024-04-19T02:17:20.031 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.031 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.031 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:20.031 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099917+0000", 2024-04-19T02:17:20.031 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000143187 2024-04-19T02:17:20.031 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.031 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.031 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:20.031 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.105432+0000", 2024-04-19T02:17:20.031 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.005514873 2024-04-19T02:17:20.032 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.032 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.032 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:20.032 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114264+0000", 2024-04-19T02:17:20.032 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.008831752 2024-04-19T02:17:20.032 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.032 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.032 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:20.032 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114300+0000", 2024-04-19T02:17:20.032 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6582000000000003e-05 2024-04-19T02:17:20.032 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.032 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.032 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:20.032 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114349+0000", 2024-04-19T02:17:20.032 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8579999999999999e-05 2024-04-19T02:17:20.032 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:20.033 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:20.033 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:20.033 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.033 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.033 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:96357 5.0 5:00efce8b:::benchmark_data_smithi121_44835_object96356:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:20.033 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:17:20.033 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 43.887298362000003, 2024-04-19T02:17:20.033 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020937471999999999, 2024-04-19T02:17:20.033 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:20.033 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:20.033 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:20.033 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:20.033 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:20.033 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 96357 2024-04-19T02:17:20.033 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.034 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:20.034 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.034 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:20.034 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:17:20.034 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:20.034 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.034 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.034 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:20.034 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:17:20.034 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:20.034 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.034 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.034 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:20.034 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093472+0000", 2024-04-19T02:17:20.034 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:20.035 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.035 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.035 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:20.035 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093513+0000", 2024-04-19T02:17:20.035 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0213000000000003e-05 2024-04-19T02:17:20.035 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.035 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.035 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:20.035 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093519+0000", 2024-04-19T02:17:20.035 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.066e-06 2024-04-19T02:17:20.035 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.035 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.035 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:20.035 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093525+0000", 2024-04-19T02:17:20.036 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.8170000000000004e-06 2024-04-19T02:17:20.036 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.036 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.036 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:20.036 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103412+0000", 2024-04-19T02:17:20.036 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0098872739999999997 2024-04-19T02:17:20.036 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.036 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.036 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:20.036 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103551+0000", 2024-04-19T02:17:20.036 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000139295 2024-04-19T02:17:20.036 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.036 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.036 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:20.036 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103701+0000", 2024-04-19T02:17:20.037 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014954599999999999 2024-04-19T02:17:20.037 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.037 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.037 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:20.037 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.108849+0000", 2024-04-19T02:17:20.037 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0051487199999999999 2024-04-19T02:17:20.037 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.037 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.037 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:20.037 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114355+0000", 2024-04-19T02:17:20.037 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0055052529999999999 2024-04-19T02:17:20.037 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.037 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.037 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:20.038 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114379+0000", 2024-04-19T02:17:20.038 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4275000000000001e-05 2024-04-19T02:17:20.038 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.038 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.038 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:20.038 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114410+0000", 2024-04-19T02:17:20.038 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1356999999999998e-05 2024-04-19T02:17:20.038 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:20.038 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:20.038 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:20.038 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.038 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.038 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:104431 5.8 5:14818e19:::benchmark_data_smithi121_44835_object104430:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T02:17:20.039 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:17:20.039 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 39.769385837000002, 2024-04-19T02:17:20.039 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022149528000000002, 2024-04-19T02:17:20.039 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:20.039 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:20.039 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:20.039 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:20.039 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:20.039 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 104431 2024-04-19T02:17:20.039 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.039 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:20.039 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.039 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:20.039 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:17:20.039 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:20.040 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.040 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.040 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:20.040 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:17:20.040 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:20.040 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.040 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.040 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:20.040 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211384+0000", 2024-04-19T02:17:20.040 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:20.040 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.040 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.040 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:20.040 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211458+0000", 2024-04-19T02:17:20.040 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3311000000000003e-05 2024-04-19T02:17:20.040 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.041 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.041 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:20.041 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211471+0000", 2024-04-19T02:17:20.041 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.3308e-05 2024-04-19T02:17:20.041 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.041 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.041 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:20.041 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211479+0000", 2024-04-19T02:17:20.041 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0909999999999993e-06 2024-04-19T02:17:20.041 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.041 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.041 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:20.041 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.221821+0000", 2024-04-19T02:17:20.041 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010341596999999999 2024-04-19T02:17:20.042 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.042 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.042 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:20.042 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.221966+0000", 2024-04-19T02:17:20.042 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000145167 2024-04-19T02:17:20.042 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.042 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.042 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:20.042 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.222077+0000", 2024-04-19T02:17:20.042 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011128000000000001 2024-04-19T02:17:20.042 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.042 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.042 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:20.042 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.228126+0000", 2024-04-19T02:17:20.043 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0060486710000000003 2024-04-19T02:17:20.043 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.043 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.043 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:20.043 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233449+0000", 2024-04-19T02:17:20.043 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0053231370000000004 2024-04-19T02:17:20.043 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.043 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.043 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:20.043 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233498+0000", 2024-04-19T02:17:20.043 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8798999999999998e-05 2024-04-19T02:17:20.043 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.043 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.043 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:20.044 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233535+0000", 2024-04-19T02:17:20.044 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7119000000000002e-05 2024-04-19T02:17:20.044 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:20.044 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:20.044 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:20.044 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.044 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.044 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157437 5.e 5:78833a3d:::benchmark_data_smithi121_44835_object23402:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:20.044 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.859854+0000", 2024-04-19T02:17:20.044 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 13.120917065, 2024-04-19T02:17:20.044 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.025859589999999998, 2024-04-19T02:17:20.044 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:20.044 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:20.044 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:20.044 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:20.044 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:20.045 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157437 2024-04-19T02:17:20.045 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.045 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:20.045 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.045 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:20.045 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859854+0000", 2024-04-19T02:17:20.045 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:20.045 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.045 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.045 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:20.045 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859854+0000", 2024-04-19T02:17:20.045 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:20.045 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.045 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.045 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:20.046 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859853+0000", 2024-04-19T02:17:20.046 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:20.046 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.046 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.046 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:20.046 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859857+0000", 2024-04-19T02:17:20.046 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8789999999999996e-06 2024-04-19T02:17:20.046 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.046 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.046 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:20.046 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859865+0000", 2024-04-19T02:17:20.046 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.1880000000000002e-06 2024-04-19T02:17:20.046 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.046 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.046 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:20.047 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859873+0000", 2024-04-19T02:17:20.047 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.2980000000000003e-06 2024-04-19T02:17:20.047 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.047 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.047 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:20.047 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859908+0000", 2024-04-19T02:17:20.047 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5682999999999997e-05 2024-04-19T02:17:20.047 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.047 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.047 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:20.047 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.860046+0000", 2024-04-19T02:17:20.047 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013714200000000001 2024-04-19T02:17:20.047 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.048 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.048 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:20.048 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.860153+0000", 2024-04-19T02:17:20.048 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010725700000000001 2024-04-19T02:17:20.048 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.048 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.048 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:20.048 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.862008+0000", 2024-04-19T02:17:20.048 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001855179 2024-04-19T02:17:20.048 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.048 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.048 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:20.048 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.885629+0000", 2024-04-19T02:17:20.048 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.023621428 2024-04-19T02:17:20.048 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.049 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.049 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:20.049 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.885676+0000", 2024-04-19T02:17:20.049 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.6371e-05 2024-04-19T02:17:20.049 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.049 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.049 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:20.049 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.885714+0000", 2024-04-19T02:17:20.049 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7907000000000001e-05 2024-04-19T02:17:20.049 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:20.049 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:20.049 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:20.049 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.050 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.050 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157438 5.0 5:01944e77:::benchmark_data_smithi121_44835_object23403:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:20.050 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.864095+0000", 2024-04-19T02:17:20.050 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 13.116675781, 2024-04-19T02:17:20.050 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.032015298999999997, 2024-04-19T02:17:20.050 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:20.050 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:20.050 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:20.050 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:20.050 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:20.050 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157438 2024-04-19T02:17:20.050 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.050 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:20.050 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.051 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:20.051 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864095+0000", 2024-04-19T02:17:20.051 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:20.051 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.051 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.051 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:20.051 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864095+0000", 2024-04-19T02:17:20.051 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:20.051 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.051 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.051 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:20.051 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864094+0000", 2024-04-19T02:17:20.051 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:20.051 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.052 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.052 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:20.052 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864102+0000", 2024-04-19T02:17:20.052 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.6629999999999993e-06 2024-04-19T02:17:20.052 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.052 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.052 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:20.052 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864113+0000", 2024-04-19T02:17:20.052 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1185999999999999e-05 2024-04-19T02:17:20.052 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.052 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.052 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:20.052 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864119+0000", 2024-04-19T02:17:20.052 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.224e-06 2024-04-19T02:17:20.053 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.053 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.053 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:20.053 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864151+0000", 2024-04-19T02:17:20.053 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1395e-05 2024-04-19T02:17:20.053 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.053 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.053 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:20.053 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864275+0000", 2024-04-19T02:17:20.053 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012431399999999999 2024-04-19T02:17:20.053 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.053 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.053 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:20.054 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864341+0000", 2024-04-19T02:17:20.054 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6146e-05 2024-04-19T02:17:20.054 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.054 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.054 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:20.054 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.866040+0000", 2024-04-19T02:17:20.054 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016991879999999999 2024-04-19T02:17:20.054 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.054 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.054 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:20.054 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896055+0000", 2024-04-19T02:17:20.054 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.030014886000000001 2024-04-19T02:17:20.054 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.054 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.054 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:20.055 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896087+0000", 2024-04-19T02:17:20.055 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1761000000000003e-05 2024-04-19T02:17:20.055 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.055 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.055 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:20.055 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896111+0000", 2024-04-19T02:17:20.055 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3623999999999999e-05 2024-04-19T02:17:20.055 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:20.055 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:20.055 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:20.055 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.055 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.055 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157439 5.e 5:79eb9d3c:::benchmark_data_smithi121_44835_object23404:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:20.055 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:20.055 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 13.116644706000001, 2024-04-19T02:17:20.056 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.027045244, 2024-04-19T02:17:20.056 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:20.056 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:20.056 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:20.056 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:20.056 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:20.056 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157439 2024-04-19T02:17:20.056 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.056 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:20.056 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.056 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:20.056 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:20.056 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:20.056 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.056 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.056 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:20.057 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:20.057 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:20.057 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.057 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.057 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:20.057 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:20.057 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:20.057 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.057 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.057 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:20.057 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864128+0000", 2024-04-19T02:17:20.057 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.911e-06 2024-04-19T02:17:20.057 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.057 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.057 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:20.058 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864136+0000", 2024-04-19T02:17:20.058 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2609999999999993e-06 2024-04-19T02:17:20.058 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.058 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.058 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:20.058 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864140+0000", 2024-04-19T02:17:20.058 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5530000000000001e-06 2024-04-19T02:17:20.058 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.058 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.058 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:20.058 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864169+0000", 2024-04-19T02:17:20.058 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.8932e-05 2024-04-19T02:17:20.058 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.058 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.058 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:20.058 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864267+0000", 2024-04-19T02:17:20.059 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7969999999999999e-05 2024-04-19T02:17:20.059 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.059 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.059 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:20.059 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864339+0000", 2024-04-19T02:17:20.059 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.2280999999999995e-05 2024-04-19T02:17:20.059 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.059 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.059 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:20.059 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.865763+0000", 2024-04-19T02:17:20.059 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0014236310000000001 2024-04-19T02:17:20.059 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.059 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.059 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:20.059 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.891093+0000", 2024-04-19T02:17:20.060 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.025330571 2024-04-19T02:17:20.060 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.060 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.060 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:20.060 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.891137+0000", 2024-04-19T02:17:20.060 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3980999999999998e-05 2024-04-19T02:17:20.060 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.060 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.060 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:20.060 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.891172+0000", 2024-04-19T02:17:20.060 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4465000000000003e-05 2024-04-19T02:17:20.060 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:20.060 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:20.060 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:20.060 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.061 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.061 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157442 5.0 5:0062b73f:::benchmark_data_smithi121_44835_object23407:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:20.061 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.867065+0000", 2024-04-19T02:17:20.061 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 13.113706056, 2024-04-19T02:17:20.061 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.029165542999999999, 2024-04-19T02:17:20.061 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:20.061 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:20.061 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:20.061 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:20.061 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:20.061 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157442 2024-04-19T02:17:20.061 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.061 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:20.061 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.061 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:20.062 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867065+0000", 2024-04-19T02:17:20.062 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:20.062 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.062 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.062 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:20.062 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867065+0000", 2024-04-19T02:17:20.062 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:20.062 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.062 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.063 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:20.063 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867064+0000", 2024-04-19T02:17:20.063 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:20.063 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.063 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.063 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:20.063 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867069+0000", 2024-04-19T02:17:20.063 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4549999999999997e-06 2024-04-19T02:17:20.063 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.064 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.064 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:20.064 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867080+0000", 2024-04-19T02:17:20.064 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0797e-05 2024-04-19T02:17:20.064 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.064 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.064 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:20.064 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867088+0000", 2024-04-19T02:17:20.064 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9729999999999997e-06 2024-04-19T02:17:20.064 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.064 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.064 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:20.064 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867121+0000", 2024-04-19T02:17:20.064 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2920000000000003e-05 2024-04-19T02:17:20.064 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.064 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.065 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:20.065 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867203+0000", 2024-04-19T02:17:20.065 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2578999999999997e-05 2024-04-19T02:17:20.065 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.065 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.065 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:20.065 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867386+0000", 2024-04-19T02:17:20.065 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00018237400000000001 2024-04-19T02:17:20.065 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.065 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.065 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:20.065 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.869338+0000", 2024-04-19T02:17:20.065 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0019521160000000001 2024-04-19T02:17:20.065 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.065 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.066 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:20.066 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896150+0000", 2024-04-19T02:17:20.066 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.026812074000000002 2024-04-19T02:17:20.066 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.066 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.066 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:20.066 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896191+0000", 2024-04-19T02:17:20.066 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1192000000000001e-05 2024-04-19T02:17:20.066 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.066 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.066 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:20.066 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896231+0000", 2024-04-19T02:17:20.066 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9764000000000001e-05 2024-04-19T02:17:20.066 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:20.067 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:20.067 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:20.067 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.067 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.067 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157499 5.8 5:1c3aa38a:::benchmark_data_smithi121_44835_object23464:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:20.067 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.913447+0000", 2024-04-19T02:17:20.067 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 13.067324484, 2024-04-19T02:17:20.067 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.024508188, 2024-04-19T02:17:20.067 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:20.067 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:20.067 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:20.067 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:20.067 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:20.067 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157499 2024-04-19T02:17:20.067 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.068 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:20.068 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.068 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:20.068 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913447+0000", 2024-04-19T02:17:20.068 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:20.068 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.068 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.068 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:20.068 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913447+0000", 2024-04-19T02:17:20.068 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:20.068 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.068 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.068 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:20.068 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913446+0000", 2024-04-19T02:17:20.068 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:20.069 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.069 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.069 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:20.069 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913451+0000", 2024-04-19T02:17:20.069 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.677e-06 2024-04-19T02:17:20.069 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.069 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.069 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:20.069 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913461+0000", 2024-04-19T02:17:20.069 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.8859999999999999e-06 2024-04-19T02:17:20.069 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.069 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.069 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:20.069 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913467+0000", 2024-04-19T02:17:20.069 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.0800000000000002e-06 2024-04-19T02:17:20.070 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.070 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.070 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:20.070 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913513+0000", 2024-04-19T02:17:20.070 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.5707000000000001e-05 2024-04-19T02:17:20.070 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.070 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.070 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:20.070 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913637+0000", 2024-04-19T02:17:20.070 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012379200000000001 2024-04-19T02:17:20.070 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.070 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.070 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:20.070 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913747+0000", 2024-04-19T02:17:20.071 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000110071 2024-04-19T02:17:20.071 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.071 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.071 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:20.071 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915674+0000", 2024-04-19T02:17:20.071 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0019270789999999999 2024-04-19T02:17:20.071 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.071 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.071 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:20.071 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937902+0000", 2024-04-19T02:17:20.071 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022228286 2024-04-19T02:17:20.071 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.071 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.071 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:20.071 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937931+0000", 2024-04-19T02:17:20.072 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9122e-05 2024-04-19T02:17:20.072 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.072 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.072 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:20.072 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937955+0000", 2024-04-19T02:17:20.072 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3591000000000002e-05 2024-04-19T02:17:20.072 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:20.072 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:20.072 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:20.072 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.072 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.072 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157500 5.0 5:0969ec74:::benchmark_data_smithi121_44835_object23465:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:20.072 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.913476+0000", 2024-04-19T02:17:20.072 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 13.067295617999999, 2024-04-19T02:17:20.072 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.024497596, 2024-04-19T02:17:20.073 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:20.073 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:20.073 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:20.073 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:20.073 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:20.073 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157500 2024-04-19T02:17:20.073 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.073 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:20.073 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.073 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:20.073 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913476+0000", 2024-04-19T02:17:20.073 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:20.073 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.073 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.074 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:20.074 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913476+0000", 2024-04-19T02:17:20.074 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:20.074 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.074 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.074 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:20.074 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913475+0000", 2024-04-19T02:17:20.074 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:20.074 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.074 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.074 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:20.074 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913478+0000", 2024-04-19T02:17:20.074 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.2670000000000001e-06 2024-04-19T02:17:20.075 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.075 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.075 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:20.075 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913481+0000", 2024-04-19T02:17:20.075 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6899999999999998e-06 2024-04-19T02:17:20.075 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.075 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.075 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:20.075 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913485+0000", 2024-04-19T02:17:20.075 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1230000000000002e-06 2024-04-19T02:17:20.075 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.075 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.075 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:20.075 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913526+0000", 2024-04-19T02:17:20.075 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.104e-05 2024-04-19T02:17:20.076 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.076 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.076 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:20.076 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913606+0000", 2024-04-19T02:17:20.076 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9510000000000003e-05 2024-04-19T02:17:20.076 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.076 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.076 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:20.076 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913671+0000", 2024-04-19T02:17:20.076 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.4838000000000005e-05 2024-04-19T02:17:20.076 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.076 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.076 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:20.076 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915348+0000", 2024-04-19T02:17:20.076 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016769860000000001 2024-04-19T02:17:20.077 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.077 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.077 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:20.077 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937897+0000", 2024-04-19T02:17:20.077 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022548902999999999 2024-04-19T02:17:20.077 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.077 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.077 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:20.077 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937938+0000", 2024-04-19T02:17:20.077 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1499999999999999e-05 2024-04-19T02:17:20.077 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.077 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.077 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:20.077 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937973+0000", 2024-04-19T02:17:20.077 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5057e-05 2024-04-19T02:17:20.078 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:20.078 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:20.078 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:20.078 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.078 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.078 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157501 5.4 5:26661819:::benchmark_data_smithi121_44835_object23466:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:20.078 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.914839+0000", 2024-04-19T02:17:20.078 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 13.065932324, 2024-04-19T02:17:20.078 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.028504224000000002, 2024-04-19T02:17:20.078 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:20.078 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:20.078 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:20.078 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:20.078 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:20.078 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157501 2024-04-19T02:17:20.079 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.079 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:20.079 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.079 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:20.079 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914839+0000", 2024-04-19T02:17:20.079 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:20.079 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.079 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.079 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:20.079 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914839+0000", 2024-04-19T02:17:20.079 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:20.079 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.079 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.080 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:20.080 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914838+0000", 2024-04-19T02:17:20.080 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:20.080 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.080 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.080 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:20.080 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914841+0000", 2024-04-19T02:17:20.080 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.706e-06 2024-04-19T02:17:20.080 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.080 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.080 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:20.080 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914848+0000", 2024-04-19T02:17:20.080 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.7429999999999996e-06 2024-04-19T02:17:20.080 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.081 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.081 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:20.081 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914852+0000", 2024-04-19T02:17:20.081 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0810000000000004e-06 2024-04-19T02:17:20.081 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.081 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.081 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:20.081 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914892+0000", 2024-04-19T02:17:20.081 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9957999999999999e-05 2024-04-19T02:17:20.081 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.081 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.081 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:20.081 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915008+0000", 2024-04-19T02:17:20.081 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000116401 2024-04-19T02:17:20.082 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.082 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.082 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:20.082 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915125+0000", 2024-04-19T02:17:20.082 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011622500000000001 2024-04-19T02:17:20.082 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.082 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.082 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:20.082 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916663+0000", 2024-04-19T02:17:20.082 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0015381310000000001 2024-04-19T02:17:20.082 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.082 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.082 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:20.083 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943114+0000", 2024-04-19T02:17:20.083 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.026451125999999998 2024-04-19T02:17:20.083 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.083 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.083 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:20.083 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943245+0000", 2024-04-19T02:17:20.083 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000131645 2024-04-19T02:17:20.083 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.083 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.083 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:20.083 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943343+0000", 2024-04-19T02:17:20.083 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7604999999999998e-05 2024-04-19T02:17:20.083 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:20.083 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:20.084 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:20.084 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.084 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.084 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157507 5.b 5:de8840a2:::benchmark_data_smithi121_44835_object23472:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:20.084 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:20.084 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 13.064368043, 2024-04-19T02:17:20.084 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022544518999999999, 2024-04-19T02:17:20.084 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:20.084 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:20.084 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:20.084 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:20.084 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:20.084 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157507 2024-04-19T02:17:20.084 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.084 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:20.085 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.085 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:20.085 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:20.085 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:20.085 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.085 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.085 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:20.085 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:20.085 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:20.085 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.085 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.085 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:20.085 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:20.085 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:20.086 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.086 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.086 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:20.086 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916406+0000", 2024-04-19T02:17:20.086 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4589999999999998e-06 2024-04-19T02:17:20.086 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.086 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.086 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:20.086 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916415+0000", 2024-04-19T02:17:20.086 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3910000000000004e-06 2024-04-19T02:17:20.086 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.086 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.086 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:20.086 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916421+0000", 2024-04-19T02:17:20.087 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.6130000000000003e-06 2024-04-19T02:17:20.087 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.087 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.087 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:20.087 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916448+0000", 2024-04-19T02:17:20.087 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7277999999999999e-05 2024-04-19T02:17:20.087 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.087 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.087 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:20.087 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916539+0000", 2024-04-19T02:17:20.087 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0855999999999999e-05 2024-04-19T02:17:20.087 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.087 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.088 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:20.088 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916605+0000", 2024-04-19T02:17:20.088 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6141000000000003e-05 2024-04-19T02:17:20.088 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.088 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.088 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:20.088 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918276+0000", 2024-04-19T02:17:20.088 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001670726 2024-04-19T02:17:20.088 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.088 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.088 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:20.088 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.938888+0000", 2024-04-19T02:17:20.088 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020612042000000001 2024-04-19T02:17:20.088 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.089 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.089 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:20.089 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.938924+0000", 2024-04-19T02:17:20.089 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5692999999999999e-05 2024-04-19T02:17:20.089 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.089 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.089 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:20.089 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.938948+0000", 2024-04-19T02:17:20.089 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3879e-05 2024-04-19T02:17:20.089 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:20.089 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:20.089 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:20.089 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.089 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.089 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157509 5.8 5:1dca85d0:::benchmark_data_smithi121_44835_object23474:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:20.090 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:20.090 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 13.061939797000001, 2024-04-19T02:17:20.090 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.024511807, 2024-04-19T02:17:20.090 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:20.090 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:20.090 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:20.090 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:20.090 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:20.090 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157509 2024-04-19T02:17:20.090 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.090 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:20.091 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.091 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:20.091 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:20.091 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:20.091 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.091 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.091 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:20.091 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:20.091 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:20.091 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.091 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.091 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:20.091 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:20.091 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:20.091 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.092 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.092 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:20.092 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918834+0000", 2024-04-19T02:17:20.092 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9409999999999999e-06 2024-04-19T02:17:20.092 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.092 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.092 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:20.092 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918859+0000", 2024-04-19T02:17:20.092 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.5245999999999999e-05 2024-04-19T02:17:20.092 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.092 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.092 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:20.092 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918864+0000", 2024-04-19T02:17:20.092 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.1819999999999997e-06 2024-04-19T02:17:20.093 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.093 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.093 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:20.093 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918900+0000", 2024-04-19T02:17:20.093 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5327000000000002e-05 2024-04-19T02:17:20.093 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.093 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.093 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:20.093 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.919024+0000", 2024-04-19T02:17:20.093 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012400900000000001 2024-04-19T02:17:20.093 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.093 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.093 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:20.093 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.919136+0000", 2024-04-19T02:17:20.094 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000111987 2024-04-19T02:17:20.094 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.094 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.094 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:20.094 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.922096+0000", 2024-04-19T02:17:20.094 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0029607079999999998 2024-04-19T02:17:20.094 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.094 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.094 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:20.094 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943120+0000", 2024-04-19T02:17:20.094 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.021023995 2024-04-19T02:17:20.094 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.094 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.094 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:20.095 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943255+0000", 2024-04-19T02:17:20.095 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013502100000000001 2024-04-19T02:17:20.095 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:20.095 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:20.095 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:20.095 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943343+0000", 2024-04-19T02:17:20.095 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.7931999999999998e-05 2024-04-19T02:17:20.095 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:20.095 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:20.095 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:20.095 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:20.095 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:20.095 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:17:20.097 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:20.098 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:20.097+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:20.197 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~12s 2024-04-19T02:17:20.197 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:20.198+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:20.276 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:20.276 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:17:20.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.277 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:191432 5.3 5:c2f12544:::benchmark_data_smithi121_44835_object57397:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T02:17:20.277 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:20.270520+0000", 2024-04-19T02:17:20.277 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0060327319999999999, 2024-04-19T02:17:20.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0060520089999999997, 2024-04-19T02:17:20.277 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:20.277 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:20.277 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:20.277 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:20.277 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:20.277 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 191432 2024-04-19T02:17:20.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.277 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:20.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:20.278 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.270520+0000", 2024-04-19T02:17:20.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.278 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:20.278 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.270520+0000", 2024-04-19T02:17:20.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.278 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.279 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:20.279 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.270519+0000", 2024-04-19T02:17:20.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:20.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.279 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:20.279 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.270524+0000", 2024-04-19T02:17:20.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1549999999999998e-06 2024-04-19T02:17:20.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.279 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:20.279 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.270533+0000", 2024-04-19T02:17:20.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2189999999999993e-06 2024-04-19T02:17:20.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.280 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:20.280 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.270540+0000", 2024-04-19T02:17:20.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1080000000000004e-06 2024-04-19T02:17:20.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.280 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:20.280 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.270574+0000", 2024-04-19T02:17:20.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3351e-05 2024-04-19T02:17:20.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.280 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:20.280 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.270665+0000", 2024-04-19T02:17:20.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1336999999999996e-05 2024-04-19T02:17:20.281 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.281 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:20.281 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.281 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:191433 5.d 5:bb6fabbc:::benchmark_data_smithi121_44835_object57398:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T02:17:20.281 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:20.270549+0000", 2024-04-19T02:17:20.281 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0060032899999999997, 2024-04-19T02:17:20.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0060863899999999997, 2024-04-19T02:17:20.281 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:20.281 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:20.281 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:20.281 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:20.281 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:20.282 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 191433 2024-04-19T02:17:20.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.282 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:20.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:20.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.270549+0000", 2024-04-19T02:17:20.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:20.283 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.270549+0000", 2024-04-19T02:17:20.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.283 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.283 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:20.283 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.270549+0000", 2024-04-19T02:17:20.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:20.283 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.283 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:20.283 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.270551+0000", 2024-04-19T02:17:20.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6560000000000001e-06 2024-04-19T02:17:20.283 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.283 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:20.284 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.270558+0000", 2024-04-19T02:17:20.284 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.815e-06 2024-04-19T02:17:20.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.284 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:20.284 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.270564+0000", 2024-04-19T02:17:20.284 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2700000000000001e-06 2024-04-19T02:17:20.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.284 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:20.284 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.270605+0000", 2024-04-19T02:17:20.284 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0774e-05 2024-04-19T02:17:20.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:20.285 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.270734+0000", 2024-04-19T02:17:20.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0001293 2024-04-19T02:17:20.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:20.285 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.270859+0000", 2024-04-19T02:17:20.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012483899999999999 2024-04-19T02:17:20.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:20.286 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.276342+0000", 2024-04-19T02:17:20.286 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.005482748 2024-04-19T02:17:20.286 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.286 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:20.286 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.286 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:191435 5.d 5:b515055d:::benchmark_data_smithi121_44835_object57400:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T02:17:20.286 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:20.273648+0000", 2024-04-19T02:17:20.286 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0029042629999999998, 2024-04-19T02:17:20.286 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003084584, 2024-04-19T02:17:20.286 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:20.287 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:20.287 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:20.287 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:20.287 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:20.287 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 191435 2024-04-19T02:17:20.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.287 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:20.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.287 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:20.287 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273648+0000", 2024-04-19T02:17:20.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.287 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:20.287 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273648+0000", 2024-04-19T02:17:20.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:20.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273648+0000", 2024-04-19T02:17:20.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:20.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:20.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273652+0000", 2024-04-19T02:17:20.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9400000000000004e-06 2024-04-19T02:17:20.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:20.289 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273664+0000", 2024-04-19T02:17:20.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2784e-05 2024-04-19T02:17:20.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.289 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:20.289 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273670+0000", 2024-04-19T02:17:20.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5969999999999999e-06 2024-04-19T02:17:20.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.289 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:20.289 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273714+0000", 2024-04-19T02:17:20.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4397999999999997e-05 2024-04-19T02:17:20.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.289 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:20.290 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273839+0000", 2024-04-19T02:17:20.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012428600000000001 2024-04-19T02:17:20.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.290 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:20.290 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273964+0000", 2024-04-19T02:17:20.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012495400000000001 2024-04-19T02:17:20.290 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.290 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:20.290 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.290 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:191436 5.c 5:39b5f58a:::benchmark_data_smithi121_44835_object57401:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T02:17:20.291 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:20.273677+0000", 2024-04-19T02:17:20.291 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0028759369999999999, 2024-04-19T02:17:20.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003153954, 2024-04-19T02:17:20.291 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:20.291 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:20.291 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:20.291 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:20.291 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:20.291 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 191436 2024-04-19T02:17:20.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.291 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:20.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:20.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273677+0000", 2024-04-19T02:17:20.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.292 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:20.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273677+0000", 2024-04-19T02:17:20.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.292 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:20.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273676+0000", 2024-04-19T02:17:20.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:20.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.293 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:20.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273678+0000", 2024-04-19T02:17:20.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2869999999999999e-06 2024-04-19T02:17:20.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.293 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:20.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273686+0000", 2024-04-19T02:17:20.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7219999999999999e-06 2024-04-19T02:17:20.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:20.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273690+0000", 2024-04-19T02:17:20.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3510000000000002e-06 2024-04-19T02:17:20.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:20.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273714+0000", 2024-04-19T02:17:20.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4297000000000001e-05 2024-04-19T02:17:20.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.295 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:20.295 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273832+0000", 2024-04-19T02:17:20.295 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000118214 2024-04-19T02:17:20.295 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.295 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:20.295 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.295 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.295 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:191437 5.9 5:9b175299:::benchmark_data_smithi121_44835_object57402:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T02:17:20.295 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:20.273694+0000", 2024-04-19T02:17:20.295 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0028581079999999998, 2024-04-19T02:17:20.295 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003219609, 2024-04-19T02:17:20.295 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:20.295 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:20.296 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:20.296 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:20.296 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:20.296 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 191437 2024-04-19T02:17:20.296 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.296 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:20.296 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.296 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:20.296 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273694+0000", 2024-04-19T02:17:20.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:20.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273694+0000", 2024-04-19T02:17:20.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:20.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273694+0000", 2024-04-19T02:17:20.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:20.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:20.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273696+0000", 2024-04-19T02:17:20.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.939e-06 2024-04-19T02:17:20.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:20.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273702+0000", 2024-04-19T02:17:20.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8730000000000004e-06 2024-04-19T02:17:20.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:20.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273707+0000", 2024-04-19T02:17:20.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1680000000000003e-06 2024-04-19T02:17:20.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.299 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:20.299 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273744+0000", 2024-04-19T02:17:20.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6699000000000002e-05 2024-04-19T02:17:20.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.299 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:20.299 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273868+0000", 2024-04-19T02:17:20.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012448099999999999 2024-04-19T02:17:20.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.299 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:20.299 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273975+0000", 2024-04-19T02:17:20.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107039 2024-04-19T02:17:20.299 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.300 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:20.300 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.300 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:191438 5.f 5:f3de6c08:::benchmark_data_smithi121_44835_object57403:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T02:17:20.300 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:20.273714+0000", 2024-04-19T02:17:20.300 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0028380279999999998, 2024-04-19T02:17:20.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032595050000000002, 2024-04-19T02:17:20.300 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:20.300 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:20.300 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:20.300 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:20.300 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:20.301 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 191438 2024-04-19T02:17:20.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.301 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:20.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:20.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273714+0000", 2024-04-19T02:17:20.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:20.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273714+0000", 2024-04-19T02:17:20.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:20.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273714+0000", 2024-04-19T02:17:20.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:20.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:20.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273716+0000", 2024-04-19T02:17:20.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7209999999999999e-06 2024-04-19T02:17:20.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:20.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273720+0000", 2024-04-19T02:17:20.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0670000000000002e-06 2024-04-19T02:17:20.303 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.303 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:20.303 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273723+0000", 2024-04-19T02:17:20.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9730000000000002e-06 2024-04-19T02:17:20.303 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.303 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:20.303 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273751+0000", 2024-04-19T02:17:20.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7821999999999999e-05 2024-04-19T02:17:20.303 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.303 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:20.304 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273855+0000", 2024-04-19T02:17:20.304 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104706 2024-04-19T02:17:20.304 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.304 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.304 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:20.304 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273955+0000", 2024-04-19T02:17:20.304 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9320000000000005e-05 2024-04-19T02:17:20.304 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.304 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:20.304 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.304 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.304 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.304 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:191442 5.2 5:49fdf73b:::benchmark_data_smithi121_44835_object57407:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T02:17:20.304 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:20.273729+0000", 2024-04-19T02:17:20.305 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0028238809999999999, 2024-04-19T02:17:20.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032872209999999999, 2024-04-19T02:17:20.305 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:20.305 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:20.305 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:20.305 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:20.305 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:20.305 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 191442 2024-04-19T02:17:20.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.305 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:20.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:20.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273729+0000", 2024-04-19T02:17:20.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:20.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273729+0000", 2024-04-19T02:17:20.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:20.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273728+0000", 2024-04-19T02:17:20.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:20.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.307 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:20.307 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273737+0000", 2024-04-19T02:17:20.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3869999999999995e-06 2024-04-19T02:17:20.307 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.307 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:20.307 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273744+0000", 2024-04-19T02:17:20.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8099999999999998e-06 2024-04-19T02:17:20.307 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.307 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:20.308 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273748+0000", 2024-04-19T02:17:20.308 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.225e-06 2024-04-19T02:17:20.308 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.308 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.308 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:20.308 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273779+0000", 2024-04-19T02:17:20.308 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1767999999999998e-05 2024-04-19T02:17:20.308 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.308 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.308 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:20.308 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273871+0000", 2024-04-19T02:17:20.308 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1973999999999997e-05 2024-04-19T02:17:20.308 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.308 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:20.308 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.308 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.309 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.309 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:191443 5.5 5:a3424246:::benchmark_data_smithi121_44835_object57408:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T02:17:20.309 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:20.273754+0000", 2024-04-19T02:17:20.309 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0027984049999999999, 2024-04-19T02:17:20.309 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033015969999999999, 2024-04-19T02:17:20.309 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:20.309 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:20.309 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:20.309 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:20.309 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:20.309 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 191443 2024-04-19T02:17:20.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.309 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:20.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:20.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273754+0000", 2024-04-19T02:17:20.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:20.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273754+0000", 2024-04-19T02:17:20.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:20.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273754+0000", 2024-04-19T02:17:20.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:20.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:20.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273756+0000", 2024-04-19T02:17:20.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3290000000000001e-06 2024-04-19T02:17:20.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:20.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273763+0000", 2024-04-19T02:17:20.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8449999999999997e-06 2024-04-19T02:17:20.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:20.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273768+0000", 2024-04-19T02:17:20.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1150000000000002e-06 2024-04-19T02:17:20.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:20.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.275349+0000", 2024-04-19T02:17:20.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001580889 2024-04-19T02:17:20.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:20.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.275486+0000", 2024-04-19T02:17:20.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013762900000000001 2024-04-19T02:17:20.312 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.313 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:20.313 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.313 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.313 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.313 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:191444 5.c 5:30718079:::benchmark_data_smithi121_44835_object57409:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T02:17:20.313 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:20.273775+0000", 2024-04-19T02:17:20.313 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.002778001, 2024-04-19T02:17:20.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033343880000000002, 2024-04-19T02:17:20.313 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:20.313 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:20.313 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:20.313 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:20.313 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:20.313 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 191444 2024-04-19T02:17:20.314 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.314 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:20.314 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.314 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:20.314 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273775+0000", 2024-04-19T02:17:20.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.314 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.314 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.314 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:20.314 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273775+0000", 2024-04-19T02:17:20.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.314 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.314 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:20.315 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273774+0000", 2024-04-19T02:17:20.315 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:20.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:20.315 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273776+0000", 2024-04-19T02:17:20.315 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2570000000000002e-06 2024-04-19T02:17:20.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:20.315 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273782+0000", 2024-04-19T02:17:20.315 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4450000000000004e-06 2024-04-19T02:17:20.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.316 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:20.316 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.273787+0000", 2024-04-19T02:17:20.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.091e-06 2024-04-19T02:17:20.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.316 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:20.316 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.275358+0000", 2024-04-19T02:17:20.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00157128 2024-04-19T02:17:20.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.316 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:20.316 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.275471+0000", 2024-04-19T02:17:20.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011288 2024-04-19T02:17:20.316 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.316 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:20.317 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.317 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.317 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.317 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:191445 5.d 5:b2f4c779:::benchmark_data_smithi121_44835_object57410:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T02:17:20.317 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:20.276601+0000", 2024-04-19T02:17:20.317 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9999514, 2024-04-19T02:17:20.317 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00057937600000000004, 2024-04-19T02:17:20.317 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:20.317 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:20.317 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:20.317 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:20.317 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:20.317 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 191445 2024-04-19T02:17:20.317 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.318 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:20.318 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.318 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:20.318 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.276601+0000", 2024-04-19T02:17:20.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.318 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.318 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.318 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:20.318 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.276601+0000", 2024-04-19T02:17:20.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.318 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.318 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.318 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:20.318 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.276600+0000", 2024-04-19T02:17:20.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:20.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:20.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.276605+0000", 2024-04-19T02:17:20.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0420000000000002e-06 2024-04-19T02:17:20.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:20.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.276614+0000", 2024-04-19T02:17:20.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0929999999999992e-06 2024-04-19T02:17:20.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:20.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.276621+0000", 2024-04-19T02:17:20.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6409999999999996e-06 2024-04-19T02:17:20.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:20.320 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.276651+0000", 2024-04-19T02:17:20.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0258999999999999e-05 2024-04-19T02:17:20.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:20.320 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.276727+0000", 2024-04-19T02:17:20.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5636000000000006e-05 2024-04-19T02:17:20.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:20.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.276793+0000", 2024-04-19T02:17:20.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6061000000000003e-05 2024-04-19T02:17:20.321 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.321 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:20.321 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.321 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:191446 5.c 5:397822ce:::benchmark_data_smithi121_44835_object57411:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T02:17:20.321 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:20.276629+0000", 2024-04-19T02:17:20.321 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9999237, 2024-04-19T02:17:20.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00061911099999999999, 2024-04-19T02:17:20.321 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:20.321 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:20.321 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:20.322 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:20.322 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:20.322 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 191446 2024-04-19T02:17:20.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.322 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:20.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.322 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:20.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.276629+0000", 2024-04-19T02:17:20.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.322 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:20.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.276629+0000", 2024-04-19T02:17:20.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:20.323 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.276628+0000", 2024-04-19T02:17:20.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:20.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:20.323 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.276631+0000", 2024-04-19T02:17:20.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.261e-06 2024-04-19T02:17:20.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:20.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.276638+0000", 2024-04-19T02:17:20.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0469999999999996e-06 2024-04-19T02:17:20.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:20.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.276642+0000", 2024-04-19T02:17:20.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.78e-06 2024-04-19T02:17:20.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:20.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.276699+0000", 2024-04-19T02:17:20.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6076999999999999e-05 2024-04-19T02:17:20.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:20.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:20.276770+0000", 2024-04-19T02:17:20.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1635000000000001e-05 2024-04-19T02:17:20.325 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.325 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:20.325 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.325 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.325 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-04-19T02:17:20.325 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 11 2024-04-19T02:17:20.325 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:20.326 INFO:teuthology.orchestra.run.smithi121.stderr:nodeep-scrub is set 2024-04-19T02:17:20.328 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:20.328 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:20.327+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:20.328 INFO:teuthology.orchestra.run.smithi121.stderr:osd set-full-ratio 0.95 2024-04-19T02:17:20.428 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:20.428+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:20.528 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:20.529+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:20.536 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:20.536 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-04-19T02:17:20.536 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-04-19T02:17:20.536 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-04-19T02:17:20.536 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:20.551 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:20.629 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:20.629+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:20.730 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:20.730+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:20.770 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:20.770 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-04-19T02:17:20.770 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-04-19T02:17:20.770 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:17:20.770 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.770 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:20.770 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:17:20.770 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 111.498279692, 2024-04-19T02:17:20.771 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022007204999999998, 2024-04-19T02:17:20.771 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:20.771 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:20.771 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:20.771 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.771 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:20.771 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:17:20.771 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.771 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.771 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:20.771 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:17:20.771 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.771 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.772 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:20.772 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269990+0000", 2024-04-19T02:17:20.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:20.772 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.772 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:20.772 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269999+0000", 2024-04-19T02:17:20.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9539999999999993e-06 2024-04-19T02:17:20.772 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:20.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270006+0000", 2024-04-19T02:17:20.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.216e-06 2024-04-19T02:17:20.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:20.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270012+0000", 2024-04-19T02:17:20.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5049999999999998e-06 2024-04-19T02:17:20.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:20.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270058+0000", 2024-04-19T02:17:20.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.634e-05 2024-04-19T02:17:20.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:20.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270064+0000", 2024-04-19T02:17:20.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0669999999999997e-06 2024-04-19T02:17:20.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:20.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287159+0000", 2024-04-19T02:17:20.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017095086999999998 2024-04-19T02:17:20.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:20.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287254+0000", 2024-04-19T02:17:20.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4716000000000006e-05 2024-04-19T02:17:20.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:20.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287389+0000", 2024-04-19T02:17:20.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013511900000000001 2024-04-19T02:17:20.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:20.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290481+0000", 2024-04-19T02:17:20.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030920169999999999 2024-04-19T02:17:20.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:20.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291931+0000", 2024-04-19T02:17:20.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001450118 2024-04-19T02:17:20.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.776 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:20.776 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291960+0000", 2024-04-19T02:17:20.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9096000000000001e-05 2024-04-19T02:17:20.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.776 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:20.776 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291998+0000", 2024-04-19T02:17:20.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7514e-05 2024-04-19T02:17:20.776 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.776 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:20.776 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.777 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.777 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:20.777 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:17:20.777 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 111.498168916, 2024-04-19T02:17:20.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020837887999999999, 2024-04-19T02:17:20.777 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:20.777 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:20.777 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:20.777 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.777 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:20.777 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:17:20.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.777 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:20.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:17:20.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:20.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:17:20.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:20.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:20.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270109+0000", 2024-04-19T02:17:20.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3110000000000006e-06 2024-04-19T02:17:20.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:20.779 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270117+0000", 2024-04-19T02:17:20.779 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0479999999999999e-06 2024-04-19T02:17:20.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:20.779 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270123+0000", 2024-04-19T02:17:20.779 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5500000000000002e-06 2024-04-19T02:17:20.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:20.779 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270150+0000", 2024-04-19T02:17:20.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7712000000000002e-05 2024-04-19T02:17:20.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.780 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:20.780 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270153+0000", 2024-04-19T02:17:20.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6089999999999999e-06 2024-04-19T02:17:20.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.780 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:20.780 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285958+0000", 2024-04-19T02:17:20.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015805274000000001 2024-04-19T02:17:20.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.780 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:20.780 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286126+0000", 2024-04-19T02:17:20.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016765700000000001 2024-04-19T02:17:20.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.781 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:20.781 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286296+0000", 2024-04-19T02:17:20.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017007 2024-04-19T02:17:20.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.781 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:20.781 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290426+0000", 2024-04-19T02:17:20.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041299839999999997 2024-04-19T02:17:20.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.781 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:20.781 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290867+0000", 2024-04-19T02:17:20.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00044083300000000001 2024-04-19T02:17:20.782 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.782 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.782 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:20.782 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290900+0000", 2024-04-19T02:17:20.782 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3380000000000002e-05 2024-04-19T02:17:20.782 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.782 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.782 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:20.782 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290939+0000", 2024-04-19T02:17:20.782 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8970000000000001e-05 2024-04-19T02:17:20.782 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.782 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:20.782 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.782 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.783 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.783 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:21 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:20.783 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:17:20.783 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 111.49808024399999, 2024-04-19T02:17:20.783 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020833187999999999, 2024-04-19T02:17:20.783 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:20.783 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:20.783 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:20.783 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.783 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:20.783 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:17:20.783 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.783 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.783 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.783 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:20.784 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:17:20.784 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.784 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:20.784 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270189+0000", 2024-04-19T02:17:20.784 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:20.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.784 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:20.784 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270192+0000", 2024-04-19T02:17:20.784 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7549999999999999e-06 2024-04-19T02:17:20.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.785 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:20.785 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270198+0000", 2024-04-19T02:17:20.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0859999999999998e-06 2024-04-19T02:17:20.785 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.785 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.785 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:20.785 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270204+0000", 2024-04-19T02:17:20.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1970000000000004e-06 2024-04-19T02:17:20.785 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.785 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.785 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:20.785 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270238+0000", 2024-04-19T02:17:20.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4282000000000001e-05 2024-04-19T02:17:20.785 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.785 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.785 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:20.785 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270240+0000", 2024-04-19T02:17:20.786 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3099999999999999e-06 2024-04-19T02:17:20.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.786 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:20.786 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287131+0000", 2024-04-19T02:17:20.786 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01689104 2024-04-19T02:17:20.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.786 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:20.786 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287262+0000", 2024-04-19T02:17:20.786 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130347 2024-04-19T02:17:20.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.786 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:20.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291023+0000", 2024-04-19T02:17:20.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037616350000000002 2024-04-19T02:17:20.787 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.787 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:20.787 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.787 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:94468 5.2 5:4f406431:::benchmark_data_smithi121_44835_object94467:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T02:17:20.787 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:17:20.787 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 45.656841061999998, 2024-04-19T02:17:20.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024835144999999999, 2024-04-19T02:17:20.787 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:20.787 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:20.787 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:20.787 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:20.788 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:20.788 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 94468 2024-04-19T02:17:20.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.788 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:20.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.788 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:20.788 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:17:20.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.788 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:20.788 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:17:20.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:20.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:17:20.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:20.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:20.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111498+0000", 2024-04-19T02:17:20.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9529000000000005e-05 2024-04-19T02:17:20.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:20.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111506+0000", 2024-04-19T02:17:20.790 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9030000000000004e-06 2024-04-19T02:17:20.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.790 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:20.790 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111513+0000", 2024-04-19T02:17:20.790 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8759999999999999e-06 2024-04-19T02:17:20.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.790 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:20.790 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112466+0000", 2024-04-19T02:17:20.790 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00095318499999999995 2024-04-19T02:17:20.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.791 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:20.791 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112590+0000", 2024-04-19T02:17:20.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012380900000000001 2024-04-19T02:17:20.791 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.791 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.791 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:20.791 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112728+0000", 2024-04-19T02:17:20.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013753800000000001 2024-04-19T02:17:20.791 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.791 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.791 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:20.791 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115064+0000", 2024-04-19T02:17:20.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002336819 2024-04-19T02:17:20.792 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.792 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.792 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:20.792 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136207+0000", 2024-04-19T02:17:20.792 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021142942000000001 2024-04-19T02:17:20.792 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.792 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.792 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:20.792 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136241+0000", 2024-04-19T02:17:20.792 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3577000000000001e-05 2024-04-19T02:17:20.792 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.792 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.792 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:20.792 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136264+0000", 2024-04-19T02:17:20.793 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3421000000000002e-05 2024-04-19T02:17:20.793 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.793 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:20.793 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.793 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.793 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:94472 5.2 5:45b7e9be:::benchmark_data_smithi121_44835_object94471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:20.793 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:17:20.793 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 45.653194530999997, 2024-04-19T02:17:20.793 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021273843000000001, 2024-04-19T02:17:20.793 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:20.793 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:20.793 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:20.793 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:20.794 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:20.794 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 94472 2024-04-19T02:17:20.794 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.794 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:20.794 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.794 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:20.794 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:17:20.794 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.794 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.794 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.794 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:20.794 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:17:20.794 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.794 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.795 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.795 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:20.795 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115075+0000", 2024-04-19T02:17:20.795 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:20.795 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.795 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.795 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:20.795 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115161+0000", 2024-04-19T02:17:20.795 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6632000000000007e-05 2024-04-19T02:17:20.795 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.795 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.795 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:20.795 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115171+0000", 2024-04-19T02:17:20.795 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2969999999999992e-06 2024-04-19T02:17:20.795 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.795 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.795 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:20.796 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115178+0000", 2024-04-19T02:17:20.796 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7610000000000007e-06 2024-04-19T02:17:20.796 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.796 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.796 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:20.796 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115213+0000", 2024-04-19T02:17:20.796 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5000999999999999e-05 2024-04-19T02:17:20.796 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.796 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.796 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:20.796 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115303+0000", 2024-04-19T02:17:20.796 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9791999999999997e-05 2024-04-19T02:17:20.796 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.796 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.797 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:20.797 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115391+0000", 2024-04-19T02:17:20.797 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7559000000000007e-05 2024-04-19T02:17:20.797 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.797 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.797 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:20.797 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.117894+0000", 2024-04-19T02:17:20.797 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002503496 2024-04-19T02:17:20.797 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.797 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.797 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:20.797 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136297+0000", 2024-04-19T02:17:20.797 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018402335999999998 2024-04-19T02:17:20.797 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.797 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.798 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:20.798 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136327+0000", 2024-04-19T02:17:20.798 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0534999999999998e-05 2024-04-19T02:17:20.798 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.798 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.798 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:20.798 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136350+0000", 2024-04-19T02:17:20.798 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2427999999999999e-05 2024-04-19T02:17:20.798 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.798 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:20.798 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.798 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.798 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.798 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:129219 5.2 5:45e7e1f4:::benchmark_data_smithi121_44835_object129218:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T02:17:20.799 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:52.629592+0000", 2024-04-19T02:17:20.799 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.138678278, 2024-04-19T02:17:20.799 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021099489999999999, 2024-04-19T02:17:20.799 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:20.799 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:20.799 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:20.799 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:20.799 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:20.799 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129219 2024-04-19T02:17:20.799 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.799 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:20.799 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.799 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:20.799 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629592+0000", 2024-04-19T02:17:20.799 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.800 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.800 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.800 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:20.800 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629592+0000", 2024-04-19T02:17:20.800 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.800 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.800 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.800 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:20.800 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629591+0000", 2024-04-19T02:17:20.800 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:20.800 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.800 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.800 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:20.800 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629618+0000", 2024-04-19T02:17:20.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6970000000000001e-05 2024-04-19T02:17:20.801 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.801 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:20.801 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629639+0000", 2024-04-19T02:17:20.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0701999999999999e-05 2024-04-19T02:17:20.801 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.801 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:20.801 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629645+0000", 2024-04-19T02:17:20.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2299999999999996e-06 2024-04-19T02:17:20.801 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.801 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:20.801 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.635658+0000", 2024-04-19T02:17:20.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0060127549999999998 2024-04-19T02:17:20.802 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.802 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.802 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:20.802 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.635811+0000", 2024-04-19T02:17:20.802 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015305700000000001 2024-04-19T02:17:20.802 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.802 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.802 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:20.802 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.635967+0000", 2024-04-19T02:17:20.802 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015578599999999999 2024-04-19T02:17:20.802 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.802 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.802 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:20.802 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.642488+0000", 2024-04-19T02:17:20.803 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0065215619999999998 2024-04-19T02:17:20.803 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.803 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.803 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:20.803 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650603+0000", 2024-04-19T02:17:20.803 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0081144900000000002 2024-04-19T02:17:20.803 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.803 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.803 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:20.803 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650652+0000", 2024-04-19T02:17:20.803 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9079999999999998e-05 2024-04-19T02:17:20.803 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.803 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.803 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:20.803 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650691+0000", 2024-04-19T02:17:20.803 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9501e-05 2024-04-19T02:17:20.804 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.804 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:20.804 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.804 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.804 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.804 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:157448 5.7 5:ed833a19:::benchmark_data_smithi121_44835_object23413:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:20.804 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:06.870566+0000", 2024-04-19T02:17:20.804 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.897703697000001, 2024-04-19T02:17:20.804 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023031238999999998, 2024-04-19T02:17:20.804 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:20.804 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:20.804 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:20.804 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:20.804 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:20.804 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 157448 2024-04-19T02:17:20.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.805 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:20.805 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.805 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:20.805 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870566+0000", 2024-04-19T02:17:20.805 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.805 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.805 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:20.805 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870566+0000", 2024-04-19T02:17:20.805 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.805 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.805 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:20.805 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870566+0000", 2024-04-19T02:17:20.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:20.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.806 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:20.806 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870570+0000", 2024-04-19T02:17:20.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1620000000000001e-06 2024-04-19T02:17:20.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.806 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:20.806 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870577+0000", 2024-04-19T02:17:20.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2069999999999998e-06 2024-04-19T02:17:20.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.806 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:20.806 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870587+0000", 2024-04-19T02:17:20.807 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6919999999999997e-06 2024-04-19T02:17:20.807 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.807 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.807 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:20.807 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870615+0000", 2024-04-19T02:17:20.807 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8351999999999999e-05 2024-04-19T02:17:20.807 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.807 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.807 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:20.807 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870715+0000", 2024-04-19T02:17:20.807 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9624999999999996e-05 2024-04-19T02:17:20.807 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.807 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.807 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:20.807 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870805+0000", 2024-04-19T02:17:20.807 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0067000000000004e-05 2024-04-19T02:17:20.808 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.808 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.808 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:20.808 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.872773+0000", 2024-04-19T02:17:20.808 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001968605 2024-04-19T02:17:20.808 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.808 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.808 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:20.808 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.893514+0000", 2024-04-19T02:17:20.808 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020740082999999999 2024-04-19T02:17:20.808 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.808 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.808 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:20.808 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.893558+0000", 2024-04-19T02:17:20.809 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4110999999999998e-05 2024-04-19T02:17:20.809 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.809 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.809 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:20.809 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.893598+0000", 2024-04-19T02:17:20.809 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0077000000000003e-05 2024-04-19T02:17:20.809 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.809 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:20.809 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.809 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.809 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.809 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:157498 5.7 5:eb39b43d:::benchmark_data_smithi121_44835_object23463:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:20.809 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:06.911721+0000", 2024-04-19T02:17:20.809 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.856549052, 2024-04-19T02:17:20.809 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023313438999999998, 2024-04-19T02:17:20.809 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:20.810 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:20.810 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:20.810 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:20.810 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:20.810 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 157498 2024-04-19T02:17:20.810 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.810 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:20.810 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.810 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:20.810 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911721+0000", 2024-04-19T02:17:20.810 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.810 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.810 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.810 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:20.811 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911721+0000", 2024-04-19T02:17:20.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.811 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.811 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:20.811 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911720+0000", 2024-04-19T02:17:20.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:20.811 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.811 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:20.811 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911726+0000", 2024-04-19T02:17:20.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3179999999999997e-06 2024-04-19T02:17:20.811 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.811 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:20.812 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911746+0000", 2024-04-19T02:17:20.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0574e-05 2024-04-19T02:17:20.812 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.812 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.812 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:20.812 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911757+0000", 2024-04-19T02:17:20.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0959e-05 2024-04-19T02:17:20.812 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.812 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.812 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:20.812 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911795+0000", 2024-04-19T02:17:20.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7589999999999998e-05 2024-04-19T02:17:20.812 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.812 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.812 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:20.812 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911912+0000", 2024-04-19T02:17:20.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117625 2024-04-19T02:17:20.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:20.813 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.912250+0000", 2024-04-19T02:17:20.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00033710599999999999 2024-04-19T02:17:20.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:20.813 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.915540+0000", 2024-04-19T02:17:20.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032909559999999998 2024-04-19T02:17:20.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:20.814 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.934984+0000", 2024-04-19T02:17:20.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019443670999999999 2024-04-19T02:17:20.814 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.814 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.814 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:20.814 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.935013+0000", 2024-04-19T02:17:20.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8464999999999999e-05 2024-04-19T02:17:20.814 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.814 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.814 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:20.814 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.935035+0000", 2024-04-19T02:17:20.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1954e-05 2024-04-19T02:17:20.815 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.815 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:20.815 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.815 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.815 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.815 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168377 5.d 5:b1f3fb6d:::benchmark_data_smithi121_44835_object34342:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:20.815 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069470+0000", 2024-04-19T02:17:20.815 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.6988003200000001, 2024-04-19T02:17:20.815 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050516473999999999, 2024-04-19T02:17:20.815 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:20.815 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:20.815 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:20.815 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:20.815 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:20.816 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168377 2024-04-19T02:17:20.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.816 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:20.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:20.816 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069470+0000", 2024-04-19T02:17:20.816 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:20.816 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069470+0000", 2024-04-19T02:17:20.816 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.817 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:20.817 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069469+0000", 2024-04-19T02:17:20.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:20.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.817 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:20.817 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069473+0000", 2024-04-19T02:17:20.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4580000000000002e-06 2024-04-19T02:17:20.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.817 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:20.817 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069482+0000", 2024-04-19T02:17:20.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2839999999999995e-06 2024-04-19T02:17:20.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:20.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069489+0000", 2024-04-19T02:17:20.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3579999999999997e-06 2024-04-19T02:17:20.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:20.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069559+0000", 2024-04-19T02:17:20.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9678000000000006e-05 2024-04-19T02:17:20.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:20.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069683+0000", 2024-04-19T02:17:20.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012359400000000001 2024-04-19T02:17:20.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:20.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069759+0000", 2024-04-19T02:17:20.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6834000000000003e-05 2024-04-19T02:17:20.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:20.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119871+0000", 2024-04-19T02:17:20.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050111392999999997 2024-04-19T02:17:20.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:20.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119932+0000", 2024-04-19T02:17:20.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1209000000000003e-05 2024-04-19T02:17:20.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.820 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:20.820 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119962+0000", 2024-04-19T02:17:20.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9717999999999999e-05 2024-04-19T02:17:20.820 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.820 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:20.820 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119986+0000", 2024-04-19T02:17:20.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4549000000000002e-05 2024-04-19T02:17:20.820 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.820 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:20.820 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.820 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.821 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168379 5.d 5:bcd492dd:::benchmark_data_smithi121_44835_object34344:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:20.821 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069502+0000", 2024-04-19T02:17:20.821 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.6987682670000002, 2024-04-19T02:17:20.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050544645999999999, 2024-04-19T02:17:20.821 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:20.821 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:20.821 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:20.821 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:20.821 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:20.821 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168379 2024-04-19T02:17:20.821 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.821 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:20.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.821 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:20.821 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069502+0000", 2024-04-19T02:17:20.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.822 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:20.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069502+0000", 2024-04-19T02:17:20.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.822 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:20.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069501+0000", 2024-04-19T02:17:20.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:20.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.822 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:20.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069504+0000", 2024-04-19T02:17:20.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9289999999999998e-06 2024-04-19T02:17:20.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:20.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069511+0000", 2024-04-19T02:17:20.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1909999999999997e-06 2024-04-19T02:17:20.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:20.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069517+0000", 2024-04-19T02:17:20.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0789999999999997e-06 2024-04-19T02:17:20.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.824 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:20.824 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071081+0000", 2024-04-19T02:17:20.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0015646550000000001 2024-04-19T02:17:20.824 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.824 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.824 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:20.824 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071195+0000", 2024-04-19T02:17:20.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011399400000000001 2024-04-19T02:17:20.824 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.824 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.824 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:20.824 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071293+0000", 2024-04-19T02:17:20.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7938999999999999e-05 2024-04-19T02:17:20.824 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.825 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.825 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:20.825 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119898+0000", 2024-04-19T02:17:20.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.048604808999999999 2024-04-19T02:17:20.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.825 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.825 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:20.825 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119993+0000", 2024-04-19T02:17:20.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5224999999999997e-05 2024-04-19T02:17:20.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.825 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.825 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:20.825 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120024+0000", 2024-04-19T02:17:20.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0580999999999997e-05 2024-04-19T02:17:20.826 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.826 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.826 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:20.826 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120047+0000", 2024-04-19T02:17:20.826 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2725e-05 2024-04-19T02:17:20.826 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.826 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:20.826 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.826 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.826 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.826 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168381 5.d 5:bcbab0e3:::benchmark_data_smithi121_44835_object34346:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:20.826 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:20.826 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.6987488489999993, 2024-04-19T02:17:20.826 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050574694000000003, 2024-04-19T02:17:20.827 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:20.827 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:20.827 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:20.827 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:20.827 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:20.827 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168381 2024-04-19T02:17:20.827 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.827 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:20.827 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.827 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:20.827 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:20.827 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.827 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.827 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.827 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:20.828 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:20.828 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.828 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.828 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.828 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:20.828 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:20.828 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:20.828 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.828 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.828 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:20.828 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069523+0000", 2024-04-19T02:17:20.828 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.244e-06 2024-04-19T02:17:20.828 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.828 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.828 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:20.829 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069528+0000", 2024-04-19T02:17:20.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0669999999999999e-06 2024-04-19T02:17:20.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.829 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:20.829 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069533+0000", 2024-04-19T02:17:20.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4680000000000003e-06 2024-04-19T02:17:20.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.829 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:20.829 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072637+0000", 2024-04-19T02:17:20.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031040429999999999 2024-04-19T02:17:20.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.829 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:20.829 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072710+0000", 2024-04-19T02:17:20.830 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3045000000000003e-05 2024-04-19T02:17:20.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.830 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:20.830 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072775+0000", 2024-04-19T02:17:20.830 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5034000000000001e-05 2024-04-19T02:17:20.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.830 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:20.830 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119925+0000", 2024-04-19T02:17:20.830 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.047150594999999997 2024-04-19T02:17:20.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.831 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:20.831 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120055+0000", 2024-04-19T02:17:20.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129288 2024-04-19T02:17:20.831 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.831 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.831 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:20.831 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120077+0000", 2024-04-19T02:17:20.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1759e-05 2024-04-19T02:17:20.831 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.831 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.831 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:20.831 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120096+0000", 2024-04-19T02:17:20.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9524000000000001e-05 2024-04-19T02:17:20.831 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.832 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:20.832 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.832 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.832 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168382 5.f 5:f2599a15:::benchmark_data_smithi121_44835_object34347:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:20.832 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069556+0000", 2024-04-19T02:17:20.832 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.698714442, 2024-04-19T02:17:20.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050009713999999997, 2024-04-19T02:17:20.832 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:20.832 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:20.832 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:20.832 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:20.832 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:20.832 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168382 2024-04-19T02:17:20.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.833 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:20.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.833 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:20.833 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069556+0000", 2024-04-19T02:17:20.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.833 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:20.833 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069556+0000", 2024-04-19T02:17:20.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.833 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:20.833 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069555+0000", 2024-04-19T02:17:20.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:20.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:20.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069558+0000", 2024-04-19T02:17:20.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7879999999999998e-06 2024-04-19T02:17:20.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:20.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069566+0000", 2024-04-19T02:17:20.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6149999999999999e-06 2024-04-19T02:17:20.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:20.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069571+0000", 2024-04-19T02:17:20.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5509999999999999e-06 2024-04-19T02:17:20.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:20.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069618+0000", 2024-04-19T02:17:20.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6964e-05 2024-04-19T02:17:20.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:20.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069744+0000", 2024-04-19T02:17:20.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012577199999999999 2024-04-19T02:17:20.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.836 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.836 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:20.836 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.070116+0000", 2024-04-19T02:17:20.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000372407 2024-04-19T02:17:20.836 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.836 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.836 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:20.836 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117511+0000", 2024-04-19T02:17:20.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.047394935999999999 2024-04-19T02:17:20.836 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.836 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.836 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:20.836 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119484+0000", 2024-04-19T02:17:20.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019722310000000001 2024-04-19T02:17:20.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.837 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:20.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119525+0000", 2024-04-19T02:17:20.837 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1035999999999998e-05 2024-04-19T02:17:20.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.837 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:20.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119565+0000", 2024-04-19T02:17:20.837 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0859000000000003e-05 2024-04-19T02:17:20.837 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.837 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:20.837 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.838 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168383 5.d 5:bbd9496c:::benchmark_data_smithi121_44835_object34348:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:20.838 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069581+0000", 2024-04-19T02:17:20.838 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.6986895539999995, 2024-04-19T02:17:20.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050607278999999998, 2024-04-19T02:17:20.838 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:20.838 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:20.838 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:20.838 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:20.838 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:20.838 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168383 2024-04-19T02:17:20.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.838 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:20.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.839 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:20.839 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069581+0000", 2024-04-19T02:17:20.839 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.839 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.839 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:20.839 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069581+0000", 2024-04-19T02:17:20.839 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.839 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.839 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:20.839 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069580+0000", 2024-04-19T02:17:20.839 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:20.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.839 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.839 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:20.840 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069589+0000", 2024-04-19T02:17:20.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6750000000000008e-06 2024-04-19T02:17:20.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.840 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:20.840 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069596+0000", 2024-04-19T02:17:20.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7360000000000004e-06 2024-04-19T02:17:20.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.840 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:20.840 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069601+0000", 2024-04-19T02:17:20.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0479999999999998e-06 2024-04-19T02:17:20.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.840 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:20.840 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.073854+0000", 2024-04-19T02:17:20.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042531920000000003 2024-04-19T02:17:20.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.841 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:20.841 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.073952+0000", 2024-04-19T02:17:20.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7851999999999998e-05 2024-04-19T02:17:20.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.841 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:20.841 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074012+0000", 2024-04-19T02:17:20.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0225e-05 2024-04-19T02:17:20.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.841 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:20.841 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120102+0000", 2024-04-19T02:17:20.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.046090150000000003 2024-04-19T02:17:20.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:20.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120129+0000", 2024-04-19T02:17:20.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7228000000000001e-05 2024-04-19T02:17:20.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:20.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120157+0000", 2024-04-19T02:17:20.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7165000000000002e-05 2024-04-19T02:17:20.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.843 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:20.843 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120188+0000", 2024-04-19T02:17:20.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1418000000000003e-05 2024-04-19T02:17:20.843 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.843 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:20.843 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.843 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168384 5.7 5:ed638f84:::benchmark_data_smithi121_44835_object34349:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:20.843 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069612+0000", 2024-04-19T02:17:20.843 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.6986585010000006, 2024-04-19T02:17:20.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049863376000000001, 2024-04-19T02:17:20.843 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:20.844 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:20.844 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:20.844 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:20.844 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:20.844 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168384 2024-04-19T02:17:20.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.844 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:20.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:20.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069612+0000", 2024-04-19T02:17:20.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:20.845 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069612+0000", 2024-04-19T02:17:20.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.845 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:20.845 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069611+0000", 2024-04-19T02:17:20.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:20.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.845 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:20.845 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069614+0000", 2024-04-19T02:17:20.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7819999999999998e-06 2024-04-19T02:17:20.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.845 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:20.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069623+0000", 2024-04-19T02:17:20.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6989999999999992e-06 2024-04-19T02:17:20.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.846 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:20.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069628+0000", 2024-04-19T02:17:20.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4999999999999999e-06 2024-04-19T02:17:20.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.846 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:20.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069662+0000", 2024-04-19T02:17:20.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3319999999999999e-05 2024-04-19T02:17:20.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:20.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069782+0000", 2024-04-19T02:17:20.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120547 2024-04-19T02:17:20.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:20.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119338+0000", 2024-04-19T02:17:20.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049556141999999997 2024-04-19T02:17:20.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:20.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119388+0000", 2024-04-19T02:17:20.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9866e-05 2024-04-19T02:17:20.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:20.848 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119475+0000", 2024-04-19T02:17:20.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6929999999999996e-05 2024-04-19T02:17:20.848 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.848 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:20.848 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.848 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168385 5.d 5:b22d7e69:::benchmark_data_smithi121_44835_object34350:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:20.848 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:20.848 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.6986350619999993, 2024-04-19T02:17:20.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.055438508999999997, 2024-04-19T02:17:20.848 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:20.849 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:20.849 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:20.849 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:20.849 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:20.849 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168385 2024-04-19T02:17:20.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.849 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:20.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.849 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:20.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:20.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.850 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:20.850 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:20.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.850 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:20.850 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:20.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:20.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.850 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:20.850 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069637+0000", 2024-04-19T02:17:20.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.576e-06 2024-04-19T02:17:20.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:20.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069643+0000", 2024-04-19T02:17:20.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8030000000000002e-06 2024-04-19T02:17:20.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:20.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069648+0000", 2024-04-19T02:17:20.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0889999999999999e-06 2024-04-19T02:17:20.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:20.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117534+0000", 2024-04-19T02:17:20.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.047886390000000001 2024-04-19T02:17:20.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.852 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:20.852 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117670+0000", 2024-04-19T02:17:20.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000135969 2024-04-19T02:17:20.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.852 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:20.852 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117803+0000", 2024-04-19T02:17:20.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000132955 2024-04-19T02:17:20.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.852 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:20.852 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120501+0000", 2024-04-19T02:17:20.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026978050000000002 2024-04-19T02:17:20.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:20.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.125026+0000", 2024-04-19T02:17:20.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045244589999999998 2024-04-19T02:17:20.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:20.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.125049+0000", 2024-04-19T02:17:20.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3807000000000001e-05 2024-04-19T02:17:20.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:20.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.125074+0000", 2024-04-19T02:17:20.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4175000000000001e-05 2024-04-19T02:17:20.853 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.854 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:20.854 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.854 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.854 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168386 5.5 5:a2cda182:::benchmark_data_smithi121_44835_object34351:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:20.854 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069653+0000", 2024-04-19T02:17:20.854 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.698617595, 2024-04-19T02:17:20.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058748884000000001, 2024-04-19T02:17:20.854 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:20.854 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:20.854 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:20.854 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:20.854 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:20.854 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168386 2024-04-19T02:17:20.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.855 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:20.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.855 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:20.855 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069653+0000", 2024-04-19T02:17:20.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.855 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:20.855 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069653+0000", 2024-04-19T02:17:20.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.855 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:20.855 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069652+0000", 2024-04-19T02:17:20.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:20.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:20.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069654+0000", 2024-04-19T02:17:20.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1220000000000002e-06 2024-04-19T02:17:20.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:20.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069660+0000", 2024-04-19T02:17:20.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5890000000000002e-06 2024-04-19T02:17:20.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:20.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069665+0000", 2024-04-19T02:17:20.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.989e-06 2024-04-19T02:17:20.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:20.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120220+0000", 2024-04-19T02:17:20.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050555061999999998 2024-04-19T02:17:20.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:20.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120329+0000", 2024-04-19T02:17:20.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010922200000000001 2024-04-19T02:17:20.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:20.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.128293+0000", 2024-04-19T02:17:20.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079640279999999997 2024-04-19T02:17:20.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:20.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.128336+0000", 2024-04-19T02:17:20.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2245e-05 2024-04-19T02:17:20.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:20.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.128401+0000", 2024-04-19T02:17:20.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5975000000000004e-05 2024-04-19T02:17:20.858 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.859 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:20.859 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.859 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168387 5.f 5:ff36d1d9:::benchmark_data_smithi121_44835_object34352:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:20.859 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:20.859 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.6986007609999998, 2024-04-19T02:17:20.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049975358999999997, 2024-04-19T02:17:20.859 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:20.859 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:20.859 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:20.859 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:20.859 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:20.859 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168387 2024-04-19T02:17:20.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.859 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:20.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:20.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:20.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:20.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:20.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:20.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:20.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:20.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:20.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069671+0000", 2024-04-19T02:17:20.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1739999999999999e-06 2024-04-19T02:17:20.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:20.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069677+0000", 2024-04-19T02:17:20.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4519999999999996e-06 2024-04-19T02:17:20.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:20.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069682+0000", 2024-04-19T02:17:20.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5400000000000003e-06 2024-04-19T02:17:20.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:20.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072634+0000", 2024-04-19T02:17:20.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0029521510000000001 2024-04-19T02:17:20.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:20.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072706+0000", 2024-04-19T02:17:20.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1996999999999995e-05 2024-04-19T02:17:20.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:20.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072772+0000", 2024-04-19T02:17:20.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5380000000000001e-05 2024-04-19T02:17:20.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.863 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:20.863 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117549+0000", 2024-04-19T02:17:20.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044777124000000001 2024-04-19T02:17:20.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.863 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:20.863 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119572+0000", 2024-04-19T02:17:20.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002022893 2024-04-19T02:17:20.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.863 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:20.863 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119613+0000", 2024-04-19T02:17:20.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0849999999999997e-05 2024-04-19T02:17:20.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:20.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119645+0000", 2024-04-19T02:17:20.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2113000000000002e-05 2024-04-19T02:17:20.864 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.864 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:20.864 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.864 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168389 5.2 5:4bcb87b1:::benchmark_data_smithi121_44835_object34354:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:20.864 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.071719+0000", 2024-04-19T02:17:20.864 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.6965516649999994, 2024-04-19T02:17:20.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.048248604, 2024-04-19T02:17:20.864 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:20.864 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:20.865 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:20.865 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:20.865 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:20.865 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168389 2024-04-19T02:17:20.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.865 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:20.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:20.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071719+0000", 2024-04-19T02:17:20.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:20.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071719+0000", 2024-04-19T02:17:20.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:20.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071718+0000", 2024-04-19T02:17:20.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:20.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:20.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071722+0000", 2024-04-19T02:17:20.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8590000000000004e-06 2024-04-19T02:17:20.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:20.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071730+0000", 2024-04-19T02:17:20.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8569999999999995e-06 2024-04-19T02:17:20.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.867 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:20.867 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071736+0000", 2024-04-19T02:17:20.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.127e-06 2024-04-19T02:17:20.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.867 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:20.867 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071769+0000", 2024-04-19T02:17:20.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3052000000000001e-05 2024-04-19T02:17:20.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.867 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:20.867 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071843+0000", 2024-04-19T02:17:20.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3683000000000006e-05 2024-04-19T02:17:20.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:20.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119852+0000", 2024-04-19T02:17:20.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.048009353999999997 2024-04-19T02:17:20.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:20.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119896+0000", 2024-04-19T02:17:20.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3102000000000002e-05 2024-04-19T02:17:20.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:20.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119967+0000", 2024-04-19T02:17:20.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1589999999999997e-05 2024-04-19T02:17:20.869 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.869 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:20.869 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.869 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168391 5.3 5:c5d9b5e1:::benchmark_data_smithi121_44835_object34356:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:20.869 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.074402+0000", 2024-04-19T02:17:20.869 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.693867826, 2024-04-19T02:17:20.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.045426756999999998, 2024-04-19T02:17:20.869 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:20.869 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:20.869 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:20.869 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:20.869 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:20.869 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168391 2024-04-19T02:17:20.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.870 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:20.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:20.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074402+0000", 2024-04-19T02:17:20.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:20.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074402+0000", 2024-04-19T02:17:20.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:20.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074401+0000", 2024-04-19T02:17:20.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:20.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:20.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074406+0000", 2024-04-19T02:17:20.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5879999999999999e-06 2024-04-19T02:17:20.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:20.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074414+0000", 2024-04-19T02:17:20.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8599999999999993e-06 2024-04-19T02:17:20.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:20.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074420+0000", 2024-04-19T02:17:20.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6350000000000003e-06 2024-04-19T02:17:20.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:20.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074453+0000", 2024-04-19T02:17:20.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3874000000000001e-05 2024-04-19T02:17:20.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:20.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074531+0000", 2024-04-19T02:17:20.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7999999999999999e-05 2024-04-19T02:17:20.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:20.873 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119717+0000", 2024-04-19T02:17:20.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.045185395000000003 2024-04-19T02:17:20.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.873 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:20.873 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119756+0000", 2024-04-19T02:17:20.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9110000000000003e-05 2024-04-19T02:17:20.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.873 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:20.873 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119829+0000", 2024-04-19T02:17:20.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3238000000000006e-05 2024-04-19T02:17:20.873 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.873 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:20.873 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.874 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4549.0:168377 5.d e52/16 ondisk, result = 0)", 2024-04-19T02:17:20.874 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.077260+0000", 2024-04-19T02:17:20.874 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.6910100850000003, 2024-04-19T02:17:20.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042613204000000002, 2024-04-19T02:17:20.874 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:20.874 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:20.874 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:20.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:20.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.077260+0000", 2024-04-19T02:17:20.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:20.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.077260+0000", 2024-04-19T02:17:20.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:20.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:20.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.077259+0000", 2024-04-19T02:17:20.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:20.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:20.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.077267+0000", 2024-04-19T02:17:20.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6799999999999993e-06 2024-04-19T02:17:20.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.876 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:20.876 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117372+0000", 2024-04-19T02:17:20.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040105342000000002 2024-04-19T02:17:20.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.876 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:20.876 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117389+0000", 2024-04-19T02:17:20.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6711e-05 2024-04-19T02:17:20.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.876 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:20.876 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119862+0000", 2024-04-19T02:17:20.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0024730580000000002 2024-04-19T02:17:20.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:20.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119867+0000", 2024-04-19T02:17:20.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1590000000000001e-06 2024-04-19T02:17:20.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:20.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:20.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:20.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119873+0000", 2024-04-19T02:17:20.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1410000000000002e-06 2024-04-19T02:17:20.877 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.877 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:20.877 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.877 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:20.877 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:20.877 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:20.878 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:17:20.880 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:17:20.881 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:20.879+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:20.980 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:20.980+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:21.026 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:17:21.047 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:17:21.048 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:17:21.048 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:17:21.048 INFO:teuthology.orchestra.run.smithi121.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T02:17:21.050 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:17:21.051 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:17:21.060 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:21.061 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:21.070 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:17:21.114 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:21.114+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:21.181 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:21.182+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:21.245 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:21.245 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:21.254 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:17:21.282 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:21.283+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:21.383 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:21.383+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:21.468 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:21.468 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:21.485 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:21.485 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:21.483+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:21.588 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:21.586+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:21.656 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:21.657 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:21.671 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:21.685 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:21.685+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:21.788 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:21.789+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:21.884 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:21.884 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:21.887 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:21.888+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:21.898 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:21.988 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:21.988+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:22.089 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:22.090+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:22.106 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:22.107 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:22.121 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:17:22.190 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:22.191+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:22.291 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:22.291+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:22.301 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:22.301 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:22.315 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:17:22.329 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T02:17:22.400 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:22.401+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:22.493 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:22.494+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:22.531 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:22.531 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:22.545 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:17:22.594 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:22.595+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:22.695 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:22.696+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:22.762 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:22.762 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:22.777 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:22.796 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:22.796+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:22.896 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:22.897+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:22.945 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:22.946 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:22.961 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:23.005 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:23.005+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:23.051 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:17:23.099 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:23.100+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:23.179 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:23.179 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:23.193 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:23.198 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:17:23.199 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:23.199+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:23.219 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:17:23.219 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:17:23.220 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:17:23.220 INFO:teuthology.orchestra.run.smithi121.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T02:17:23.222 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:17:23.223 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:17:23.300 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:23.301+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:23.308 INFO:teuthology.orchestra.run.smithi121.stderr:noscrub is unset 2024-04-19T02:17:23.401 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:23.401+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:23.415 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:23.415 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-04-19T02:17:23.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-04-19T02:17:23.415 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:17:23.415 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.415 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:23.415 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:17:23.415 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 114.144036081, 2024-04-19T02:17:23.416 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022007204999999998, 2024-04-19T02:17:23.416 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:23.416 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:23.416 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:23.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.416 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:23.416 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:17:23.416 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:23.416 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.416 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:23.416 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:17:23.416 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:23.416 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.417 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:23.417 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269990+0000", 2024-04-19T02:17:23.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:23.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.417 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.417 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:23.417 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269999+0000", 2024-04-19T02:17:23.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9539999999999993e-06 2024-04-19T02:17:23.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.417 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.417 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:23.417 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270006+0000", 2024-04-19T02:17:23.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.216e-06 2024-04-19T02:17:23.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.418 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.418 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270012+0000", 2024-04-19T02:17:23.418 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5049999999999998e-06 2024-04-19T02:17:23.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.418 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:23.418 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270058+0000", 2024-04-19T02:17:23.418 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.634e-05 2024-04-19T02:17:23.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.418 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:23.418 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270064+0000", 2024-04-19T02:17:23.418 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0669999999999997e-06 2024-04-19T02:17:23.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:23.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287159+0000", 2024-04-19T02:17:23.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017095086999999998 2024-04-19T02:17:23.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:23.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287254+0000", 2024-04-19T02:17:23.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4716000000000006e-05 2024-04-19T02:17:23.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:23.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287389+0000", 2024-04-19T02:17:23.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013511900000000001 2024-04-19T02:17:23.420 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.420 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.420 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:23.420 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290481+0000", 2024-04-19T02:17:23.420 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030920169999999999 2024-04-19T02:17:23.420 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.420 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.420 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:23.420 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291931+0000", 2024-04-19T02:17:23.420 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001450118 2024-04-19T02:17:23.420 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.420 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.420 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:23.420 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291960+0000", 2024-04-19T02:17:23.420 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9096000000000001e-05 2024-04-19T02:17:23.420 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.421 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.421 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:23.421 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291998+0000", 2024-04-19T02:17:23.421 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7514e-05 2024-04-19T02:17:23.421 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:23.421 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:23.421 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:23.421 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.421 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.421 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:23.421 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:17:23.421 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 114.143925305, 2024-04-19T02:17:23.421 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020837887999999999, 2024-04-19T02:17:23.421 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:23.421 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:23.422 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:23.422 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.422 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:23.422 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:17:23.422 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:23.422 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.422 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.422 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:23.422 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:17:23.422 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:23.422 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.422 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.422 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:23.422 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:17:23.422 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:23.423 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.423 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.423 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:23.423 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270109+0000", 2024-04-19T02:17:23.423 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3110000000000006e-06 2024-04-19T02:17:23.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:23.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270117+0000", 2024-04-19T02:17:23.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0479999999999999e-06 2024-04-19T02:17:23.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.426 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270123+0000", 2024-04-19T02:17:23.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5500000000000002e-06 2024-04-19T02:17:23.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:23.426 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270150+0000", 2024-04-19T02:17:23.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7712000000000002e-05 2024-04-19T02:17:23.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:23.426 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270153+0000", 2024-04-19T02:17:23.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6089999999999999e-06 2024-04-19T02:17:23.427 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.427 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.427 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:23.427 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285958+0000", 2024-04-19T02:17:23.427 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015805274000000001 2024-04-19T02:17:23.427 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.427 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.427 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:23.427 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286126+0000", 2024-04-19T02:17:23.427 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016765700000000001 2024-04-19T02:17:23.427 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.427 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.427 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:23.427 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286296+0000", 2024-04-19T02:17:23.427 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017007 2024-04-19T02:17:23.428 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.428 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.428 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:23.428 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290426+0000", 2024-04-19T02:17:23.428 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041299839999999997 2024-04-19T02:17:23.428 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.428 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.428 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:23.428 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290867+0000", 2024-04-19T02:17:23.428 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00044083300000000001 2024-04-19T02:17:23.428 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.428 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.428 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:23.428 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290900+0000", 2024-04-19T02:17:23.429 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3380000000000002e-05 2024-04-19T02:17:23.429 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.429 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.429 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:23.429 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290939+0000", 2024-04-19T02:17:23.429 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8970000000000001e-05 2024-04-19T02:17:23.429 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:23.429 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:23.429 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:23.429 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.429 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.429 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:21 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:23.429 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:17:23.429 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 114.14383663300001, 2024-04-19T02:17:23.430 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020833187999999999, 2024-04-19T02:17:23.430 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:23.430 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:23.430 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:23.430 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.430 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:23.430 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:17:23.430 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:23.430 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.430 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.430 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:23.431 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:17:23.431 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:23.431 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.431 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.431 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:23.431 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270189+0000", 2024-04-19T02:17:23.431 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:23.431 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.432 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.432 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:23.432 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270192+0000", 2024-04-19T02:17:23.432 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7549999999999999e-06 2024-04-19T02:17:23.432 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.432 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.432 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:23.432 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270198+0000", 2024-04-19T02:17:23.432 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0859999999999998e-06 2024-04-19T02:17:23.432 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.432 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.432 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.432 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270204+0000", 2024-04-19T02:17:23.433 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1970000000000004e-06 2024-04-19T02:17:23.433 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.433 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.433 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:23.433 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270238+0000", 2024-04-19T02:17:23.433 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4282000000000001e-05 2024-04-19T02:17:23.433 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.433 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.433 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:23.433 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270240+0000", 2024-04-19T02:17:23.433 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3099999999999999e-06 2024-04-19T02:17:23.433 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.433 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.433 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:23.433 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287131+0000", 2024-04-19T02:17:23.433 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01689104 2024-04-19T02:17:23.434 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.434 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.434 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:23.434 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287262+0000", 2024-04-19T02:17:23.434 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130347 2024-04-19T02:17:23.434 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.434 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.434 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:23.434 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291023+0000", 2024-04-19T02:17:23.434 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037616350000000002 2024-04-19T02:17:23.434 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:23.434 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:23.434 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:23.434 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.434 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.435 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:94468 5.2 5:4f406431:::benchmark_data_smithi121_44835_object94467:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T02:17:23.435 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:17:23.435 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 48.302597450999997, 2024-04-19T02:17:23.435 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024835144999999999, 2024-04-19T02:17:23.435 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:23.435 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:23.435 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:23.435 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:23.435 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:23.435 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 94468 2024-04-19T02:17:23.435 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.435 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:23.435 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.435 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:23.435 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:17:23.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:23.436 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.436 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.436 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:23.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:17:23.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:23.436 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.436 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.436 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:23.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:17:23.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:23.436 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.436 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.436 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:23.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111498+0000", 2024-04-19T02:17:23.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9529000000000005e-05 2024-04-19T02:17:23.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.437 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.437 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:23.437 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111506+0000", 2024-04-19T02:17:23.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9030000000000004e-06 2024-04-19T02:17:23.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.437 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.437 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.437 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111513+0000", 2024-04-19T02:17:23.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8759999999999999e-06 2024-04-19T02:17:23.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.437 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.437 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:23.437 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112466+0000", 2024-04-19T02:17:23.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00095318499999999995 2024-04-19T02:17:23.438 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.438 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.438 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:23.438 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112590+0000", 2024-04-19T02:17:23.438 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012380900000000001 2024-04-19T02:17:23.438 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.438 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.438 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:23.438 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112728+0000", 2024-04-19T02:17:23.438 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013753800000000001 2024-04-19T02:17:23.438 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.438 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.438 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:23.439 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115064+0000", 2024-04-19T02:17:23.439 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002336819 2024-04-19T02:17:23.439 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.439 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.439 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:23.439 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136207+0000", 2024-04-19T02:17:23.439 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021142942000000001 2024-04-19T02:17:23.439 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.439 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.439 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:23.439 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136241+0000", 2024-04-19T02:17:23.439 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3577000000000001e-05 2024-04-19T02:17:23.439 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.439 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.439 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:23.440 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136264+0000", 2024-04-19T02:17:23.440 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3421000000000002e-05 2024-04-19T02:17:23.440 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:23.440 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:23.440 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:23.440 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.440 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.440 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:94472 5.2 5:45b7e9be:::benchmark_data_smithi121_44835_object94471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:23.440 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:17:23.440 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 48.298950920000003, 2024-04-19T02:17:23.440 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021273843000000001, 2024-04-19T02:17:23.440 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:23.440 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:23.440 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:23.440 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:23.441 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:23.441 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 94472 2024-04-19T02:17:23.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.441 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:23.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.441 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:23.441 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:17:23.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:23.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.441 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:23.441 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:17:23.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:23.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.441 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:23.442 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115075+0000", 2024-04-19T02:17:23.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:23.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.442 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:23.442 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115161+0000", 2024-04-19T02:17:23.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6632000000000007e-05 2024-04-19T02:17:23.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.442 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:23.442 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115171+0000", 2024-04-19T02:17:23.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2969999999999992e-06 2024-04-19T02:17:23.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.443 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.443 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115178+0000", 2024-04-19T02:17:23.443 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7610000000000007e-06 2024-04-19T02:17:23.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.443 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:23.443 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115213+0000", 2024-04-19T02:17:23.443 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5000999999999999e-05 2024-04-19T02:17:23.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.443 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:23.443 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115303+0000", 2024-04-19T02:17:23.443 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9791999999999997e-05 2024-04-19T02:17:23.444 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.444 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.444 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:23.444 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115391+0000", 2024-04-19T02:17:23.444 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7559000000000007e-05 2024-04-19T02:17:23.444 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.444 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.444 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:23.444 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.117894+0000", 2024-04-19T02:17:23.444 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002503496 2024-04-19T02:17:23.444 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.444 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.444 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:23.444 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136297+0000", 2024-04-19T02:17:23.444 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018402335999999998 2024-04-19T02:17:23.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.445 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.445 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:23.445 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136327+0000", 2024-04-19T02:17:23.445 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0534999999999998e-05 2024-04-19T02:17:23.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.445 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.445 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:23.445 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136350+0000", 2024-04-19T02:17:23.445 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2427999999999999e-05 2024-04-19T02:17:23.445 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:23.445 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:23.445 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:23.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.445 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.446 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:129219 5.2 5:45e7e1f4:::benchmark_data_smithi121_44835_object129218:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T02:17:23.446 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:52.629592+0000", 2024-04-19T02:17:23.446 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.784434666999999, 2024-04-19T02:17:23.446 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021099489999999999, 2024-04-19T02:17:23.446 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:23.446 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:23.446 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:23.446 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:23.446 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:23.446 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129219 2024-04-19T02:17:23.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.446 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:23.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:23.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629592+0000", 2024-04-19T02:17:23.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:23.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:23.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629592+0000", 2024-04-19T02:17:23.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:23.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:23.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629591+0000", 2024-04-19T02:17:23.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:23.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.448 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:23.448 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629618+0000", 2024-04-19T02:17:23.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6970000000000001e-05 2024-04-19T02:17:23.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.448 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:23.448 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629639+0000", 2024-04-19T02:17:23.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0701999999999999e-05 2024-04-19T02:17:23.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.448 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.448 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629645+0000", 2024-04-19T02:17:23.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2299999999999996e-06 2024-04-19T02:17:23.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.449 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:23.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.635658+0000", 2024-04-19T02:17:23.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0060127549999999998 2024-04-19T02:17:23.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.449 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:23.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.635811+0000", 2024-04-19T02:17:23.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015305700000000001 2024-04-19T02:17:23.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.449 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:23.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.635967+0000", 2024-04-19T02:17:23.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015578599999999999 2024-04-19T02:17:23.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.450 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:23.450 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.642488+0000", 2024-04-19T02:17:23.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0065215619999999998 2024-04-19T02:17:23.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.450 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:23.450 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650603+0000", 2024-04-19T02:17:23.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0081144900000000002 2024-04-19T02:17:23.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.450 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:23.450 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650652+0000", 2024-04-19T02:17:23.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9079999999999998e-05 2024-04-19T02:17:23.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.451 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:23.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650691+0000", 2024-04-19T02:17:23.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9501e-05 2024-04-19T02:17:23.451 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:23.451 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:23.451 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:23.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.451 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:157448 5.7 5:ed833a19:::benchmark_data_smithi121_44835_object23413:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:23.451 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:06.870566+0000", 2024-04-19T02:17:23.451 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 16.543460086, 2024-04-19T02:17:23.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023031238999999998, 2024-04-19T02:17:23.452 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:23.452 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:23.452 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:23.452 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:23.452 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:23.452 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 157448 2024-04-19T02:17:23.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.452 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:23.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:23.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870566+0000", 2024-04-19T02:17:23.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:23.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:23.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870566+0000", 2024-04-19T02:17:23.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:23.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:23.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870566+0000", 2024-04-19T02:17:23.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:23.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:23.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870570+0000", 2024-04-19T02:17:23.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1620000000000001e-06 2024-04-19T02:17:23.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.454 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:23.454 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870577+0000", 2024-04-19T02:17:23.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2069999999999998e-06 2024-04-19T02:17:23.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.454 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.454 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870587+0000", 2024-04-19T02:17:23.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6919999999999997e-06 2024-04-19T02:17:23.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.454 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:23.454 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870615+0000", 2024-04-19T02:17:23.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8351999999999999e-05 2024-04-19T02:17:23.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:23.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870715+0000", 2024-04-19T02:17:23.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9624999999999996e-05 2024-04-19T02:17:23.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:23.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870805+0000", 2024-04-19T02:17:23.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0067000000000004e-05 2024-04-19T02:17:23.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:23.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.872773+0000", 2024-04-19T02:17:23.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001968605 2024-04-19T02:17:23.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:23.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.893514+0000", 2024-04-19T02:17:23.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020740082999999999 2024-04-19T02:17:23.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:23.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.893558+0000", 2024-04-19T02:17:23.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4110999999999998e-05 2024-04-19T02:17:23.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:23.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.893598+0000", 2024-04-19T02:17:23.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0077000000000003e-05 2024-04-19T02:17:23.457 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:23.457 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:23.457 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:23.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.457 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:157498 5.7 5:eb39b43d:::benchmark_data_smithi121_44835_object23463:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:23.457 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:06.911721+0000", 2024-04-19T02:17:23.457 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 16.502305441000001, 2024-04-19T02:17:23.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023313438999999998, 2024-04-19T02:17:23.457 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:23.457 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:23.457 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:23.457 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:23.458 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:23.458 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 157498 2024-04-19T02:17:23.458 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.458 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:23.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.458 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:23.458 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911721+0000", 2024-04-19T02:17:23.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:23.458 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.458 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:23.458 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911721+0000", 2024-04-19T02:17:23.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:23.458 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:23.459 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911720+0000", 2024-04-19T02:17:23.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:23.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:23.459 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911726+0000", 2024-04-19T02:17:23.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3179999999999997e-06 2024-04-19T02:17:23.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:23.459 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911746+0000", 2024-04-19T02:17:23.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0574e-05 2024-04-19T02:17:23.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911757+0000", 2024-04-19T02:17:23.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0959e-05 2024-04-19T02:17:23.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:23.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911795+0000", 2024-04-19T02:17:23.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7589999999999998e-05 2024-04-19T02:17:23.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:23.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911912+0000", 2024-04-19T02:17:23.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117625 2024-04-19T02:17:23.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:23.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.912250+0000", 2024-04-19T02:17:23.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00033710599999999999 2024-04-19T02:17:23.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:23.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.915540+0000", 2024-04-19T02:17:23.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032909559999999998 2024-04-19T02:17:23.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:23.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.934984+0000", 2024-04-19T02:17:23.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019443670999999999 2024-04-19T02:17:23.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:23.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.935013+0000", 2024-04-19T02:17:23.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8464999999999999e-05 2024-04-19T02:17:23.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.462 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:23.462 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.935035+0000", 2024-04-19T02:17:23.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1954e-05 2024-04-19T02:17:23.462 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:23.462 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:23.462 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:23.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.462 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168377 5.d 5:b1f3fb6d:::benchmark_data_smithi121_44835_object34342:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:23.462 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069470+0000", 2024-04-19T02:17:23.462 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 11.344556709000001, 2024-04-19T02:17:23.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050516473999999999, 2024-04-19T02:17:23.462 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:23.463 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:23.463 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:23.463 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:23.463 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:23.463 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168377 2024-04-19T02:17:23.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.463 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:23.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.463 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:23.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069470+0000", 2024-04-19T02:17:23.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:23.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.463 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:23.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069470+0000", 2024-04-19T02:17:23.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:23.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:23.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069469+0000", 2024-04-19T02:17:23.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:23.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:23.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069473+0000", 2024-04-19T02:17:23.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4580000000000002e-06 2024-04-19T02:17:23.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:23.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069482+0000", 2024-04-19T02:17:23.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2839999999999995e-06 2024-04-19T02:17:23.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069489+0000", 2024-04-19T02:17:23.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3579999999999997e-06 2024-04-19T02:17:23.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:23.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069559+0000", 2024-04-19T02:17:23.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9678000000000006e-05 2024-04-19T02:17:23.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:23.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069683+0000", 2024-04-19T02:17:23.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012359400000000001 2024-04-19T02:17:23.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:23.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069759+0000", 2024-04-19T02:17:23.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6834000000000003e-05 2024-04-19T02:17:23.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:23.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119871+0000", 2024-04-19T02:17:23.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050111392999999997 2024-04-19T02:17:23.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:23.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119932+0000", 2024-04-19T02:17:23.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1209000000000003e-05 2024-04-19T02:17:23.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:23.467 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119962+0000", 2024-04-19T02:17:23.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9717999999999999e-05 2024-04-19T02:17:23.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:23.467 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119986+0000", 2024-04-19T02:17:23.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4549000000000002e-05 2024-04-19T02:17:23.467 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:23.467 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:23.467 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:23.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.467 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168379 5.d 5:bcd492dd:::benchmark_data_smithi121_44835_object34344:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:23.468 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069502+0000", 2024-04-19T02:17:23.468 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 11.344524656000001, 2024-04-19T02:17:23.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050544645999999999, 2024-04-19T02:17:23.468 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:23.468 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:23.468 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:23.468 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:23.468 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:23.468 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168379 2024-04-19T02:17:23.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.468 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:23.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.468 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:23.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069502+0000", 2024-04-19T02:17:23.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:23.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:23.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069502+0000", 2024-04-19T02:17:23.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:23.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:23.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069501+0000", 2024-04-19T02:17:23.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:23.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:23.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069504+0000", 2024-04-19T02:17:23.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9289999999999998e-06 2024-04-19T02:17:23.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:23.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069511+0000", 2024-04-19T02:17:23.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1909999999999997e-06 2024-04-19T02:17:23.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069517+0000", 2024-04-19T02:17:23.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0789999999999997e-06 2024-04-19T02:17:23.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.471 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:23.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071081+0000", 2024-04-19T02:17:23.471 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0015646550000000001 2024-04-19T02:17:23.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.471 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:23.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071195+0000", 2024-04-19T02:17:23.471 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011399400000000001 2024-04-19T02:17:23.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.471 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:23.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071293+0000", 2024-04-19T02:17:23.471 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7938999999999999e-05 2024-04-19T02:17:23.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:23.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119898+0000", 2024-04-19T02:17:23.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.048604808999999999 2024-04-19T02:17:23.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:23.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119993+0000", 2024-04-19T02:17:23.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5224999999999997e-05 2024-04-19T02:17:23.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:23.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120024+0000", 2024-04-19T02:17:23.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0580999999999997e-05 2024-04-19T02:17:23.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:23.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120047+0000", 2024-04-19T02:17:23.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2725e-05 2024-04-19T02:17:23.473 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:23.473 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:23.473 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:23.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.473 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168381 5.d 5:bcbab0e3:::benchmark_data_smithi121_44835_object34346:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:23.473 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:23.473 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 11.344505238, 2024-04-19T02:17:23.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050574694000000003, 2024-04-19T02:17:23.473 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:23.473 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:23.474 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:23.474 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:23.474 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:23.474 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168381 2024-04-19T02:17:23.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.474 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:23.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.474 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:23.474 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:23.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:23.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.474 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:23.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:23.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:23.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:23.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:23.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:23.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:23.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069523+0000", 2024-04-19T02:17:23.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.244e-06 2024-04-19T02:17:23.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:23.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069528+0000", 2024-04-19T02:17:23.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0669999999999999e-06 2024-04-19T02:17:23.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069533+0000", 2024-04-19T02:17:23.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4680000000000003e-06 2024-04-19T02:17:23.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:23.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072637+0000", 2024-04-19T02:17:23.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031040429999999999 2024-04-19T02:17:23.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:23.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072710+0000", 2024-04-19T02:17:23.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3045000000000003e-05 2024-04-19T02:17:23.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:23.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072775+0000", 2024-04-19T02:17:23.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5034000000000001e-05 2024-04-19T02:17:23.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:23.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119925+0000", 2024-04-19T02:17:23.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.047150594999999997 2024-04-19T02:17:23.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:23.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120055+0000", 2024-04-19T02:17:23.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129288 2024-04-19T02:17:23.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:23.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120077+0000", 2024-04-19T02:17:23.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1759e-05 2024-04-19T02:17:23.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:23.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120096+0000", 2024-04-19T02:17:23.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9524000000000001e-05 2024-04-19T02:17:23.478 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:23.479 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:23.479 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:23.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.479 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168382 5.f 5:f2599a15:::benchmark_data_smithi121_44835_object34347:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:23.479 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069556+0000", 2024-04-19T02:17:23.479 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 11.344470831000001, 2024-04-19T02:17:23.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050009713999999997, 2024-04-19T02:17:23.479 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:23.479 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:23.479 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:23.479 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:23.479 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:23.479 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168382 2024-04-19T02:17:23.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.480 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:23.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:23.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069556+0000", 2024-04-19T02:17:23.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:23.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:23.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069556+0000", 2024-04-19T02:17:23.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:23.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:23.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069555+0000", 2024-04-19T02:17:23.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:23.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:23.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069558+0000", 2024-04-19T02:17:23.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7879999999999998e-06 2024-04-19T02:17:23.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:23.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069566+0000", 2024-04-19T02:17:23.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6149999999999999e-06 2024-04-19T02:17:23.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069571+0000", 2024-04-19T02:17:23.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5509999999999999e-06 2024-04-19T02:17:23.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:23.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069618+0000", 2024-04-19T02:17:23.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6964e-05 2024-04-19T02:17:23.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:23.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069744+0000", 2024-04-19T02:17:23.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012577199999999999 2024-04-19T02:17:23.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:23.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.070116+0000", 2024-04-19T02:17:23.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000372407 2024-04-19T02:17:23.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:23.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117511+0000", 2024-04-19T02:17:23.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.047394935999999999 2024-04-19T02:17:23.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:23.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119484+0000", 2024-04-19T02:17:23.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019722310000000001 2024-04-19T02:17:23.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:23.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119525+0000", 2024-04-19T02:17:23.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1035999999999998e-05 2024-04-19T02:17:23.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.484 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:23.484 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119565+0000", 2024-04-19T02:17:23.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0859000000000003e-05 2024-04-19T02:17:23.484 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:23.484 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:23.484 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:23.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.484 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168383 5.d 5:bbd9496c:::benchmark_data_smithi121_44835_object34348:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:23.484 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069581+0000", 2024-04-19T02:17:23.484 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 11.344445943, 2024-04-19T02:17:23.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050607278999999998, 2024-04-19T02:17:23.485 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:23.485 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:23.485 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:23.485 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:23.485 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:23.485 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168383 2024-04-19T02:17:23.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.485 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:23.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:23.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069581+0000", 2024-04-19T02:17:23.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:23.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:23.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069581+0000", 2024-04-19T02:17:23.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:23.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:23.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069580+0000", 2024-04-19T02:17:23.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:23.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:23.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069589+0000", 2024-04-19T02:17:23.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6750000000000008e-06 2024-04-19T02:17:23.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:23.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069596+0000", 2024-04-19T02:17:23.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7360000000000004e-06 2024-04-19T02:17:23.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069601+0000", 2024-04-19T02:17:23.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0479999999999998e-06 2024-04-19T02:17:23.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:23.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.073854+0000", 2024-04-19T02:17:23.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042531920000000003 2024-04-19T02:17:23.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:23.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.073952+0000", 2024-04-19T02:17:23.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7851999999999998e-05 2024-04-19T02:17:23.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:23.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074012+0000", 2024-04-19T02:17:23.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0225e-05 2024-04-19T02:17:23.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:23.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120102+0000", 2024-04-19T02:17:23.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.046090150000000003 2024-04-19T02:17:23.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:23.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120129+0000", 2024-04-19T02:17:23.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7228000000000001e-05 2024-04-19T02:17:23.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:23.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120157+0000", 2024-04-19T02:17:23.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7165000000000002e-05 2024-04-19T02:17:23.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:23.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120188+0000", 2024-04-19T02:17:23.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1418000000000003e-05 2024-04-19T02:17:23.489 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:23.490 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:23.490 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:23.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.490 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168384 5.7 5:ed638f84:::benchmark_data_smithi121_44835_object34349:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:23.490 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069612+0000", 2024-04-19T02:17:23.490 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 11.344414889999999, 2024-04-19T02:17:23.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049863376000000001, 2024-04-19T02:17:23.490 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:23.490 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:23.490 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:23.490 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:23.490 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:23.491 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168384 2024-04-19T02:17:23.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.491 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:23.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:23.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069612+0000", 2024-04-19T02:17:23.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:23.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:23.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069612+0000", 2024-04-19T02:17:23.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:23.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:23.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069611+0000", 2024-04-19T02:17:23.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:23.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:23.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069614+0000", 2024-04-19T02:17:23.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7819999999999998e-06 2024-04-19T02:17:23.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:23.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069623+0000", 2024-04-19T02:17:23.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6989999999999992e-06 2024-04-19T02:17:23.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069628+0000", 2024-04-19T02:17:23.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4999999999999999e-06 2024-04-19T02:17:23.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:23.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069662+0000", 2024-04-19T02:17:23.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3319999999999999e-05 2024-04-19T02:17:23.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:23.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069782+0000", 2024-04-19T02:17:23.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120547 2024-04-19T02:17:23.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:23.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119338+0000", 2024-04-19T02:17:23.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049556141999999997 2024-04-19T02:17:23.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:23.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119388+0000", 2024-04-19T02:17:23.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9866e-05 2024-04-19T02:17:23.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:23.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119475+0000", 2024-04-19T02:17:23.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6929999999999996e-05 2024-04-19T02:17:23.494 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:23.495 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:23.495 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:23.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.495 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168385 5.d 5:b22d7e69:::benchmark_data_smithi121_44835_object34350:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:23.495 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:23.495 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 11.344391451, 2024-04-19T02:17:23.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.055438508999999997, 2024-04-19T02:17:23.495 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:23.495 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:23.495 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:23.495 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:23.495 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:23.495 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168385 2024-04-19T02:17:23.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.495 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:23.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:23.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:23.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:23.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:23.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:23.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:23.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:23.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:23.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:23.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:23.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069637+0000", 2024-04-19T02:17:23.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.576e-06 2024-04-19T02:17:23.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:23.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069643+0000", 2024-04-19T02:17:23.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8030000000000002e-06 2024-04-19T02:17:23.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069648+0000", 2024-04-19T02:17:23.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0889999999999999e-06 2024-04-19T02:17:23.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:23.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117534+0000", 2024-04-19T02:17:23.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.047886390000000001 2024-04-19T02:17:23.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:23.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117670+0000", 2024-04-19T02:17:23.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000135969 2024-04-19T02:17:23.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:23.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117803+0000", 2024-04-19T02:17:23.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000132955 2024-04-19T02:17:23.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:23.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120501+0000", 2024-04-19T02:17:23.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026978050000000002 2024-04-19T02:17:23.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:23.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.125026+0000", 2024-04-19T02:17:23.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045244589999999998 2024-04-19T02:17:23.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:23.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.125049+0000", 2024-04-19T02:17:23.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3807000000000001e-05 2024-04-19T02:17:23.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.500 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:23.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.125074+0000", 2024-04-19T02:17:23.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4175000000000001e-05 2024-04-19T02:17:23.500 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:23.500 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:23.500 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:23.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.500 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168386 5.5 5:a2cda182:::benchmark_data_smithi121_44835_object34351:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:23.500 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069653+0000", 2024-04-19T02:17:23.500 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 11.344373984000001, 2024-04-19T02:17:23.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058748884000000001, 2024-04-19T02:17:23.501 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:23.501 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:23.501 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:23.501 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:23.501 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:23.501 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168386 2024-04-19T02:17:23.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.501 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:23.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:23.501 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069653+0000", 2024-04-19T02:17:23.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:23.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:23.501 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069653+0000", 2024-04-19T02:17:23.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:23.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:23.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069652+0000", 2024-04-19T02:17:23.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:23.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:23.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069654+0000", 2024-04-19T02:17:23.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1220000000000002e-06 2024-04-19T02:17:23.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:23.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069660+0000", 2024-04-19T02:17:23.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5890000000000002e-06 2024-04-19T02:17:23.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069665+0000", 2024-04-19T02:17:23.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.989e-06 2024-04-19T02:17:23.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:23.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120220+0000", 2024-04-19T02:17:23.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050555061999999998 2024-04-19T02:17:23.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:23.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120329+0000", 2024-04-19T02:17:23.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010922200000000001 2024-04-19T02:17:23.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:23.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.128293+0000", 2024-04-19T02:17:23.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079640279999999997 2024-04-19T02:17:23.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:23.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.128336+0000", 2024-04-19T02:17:23.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2245e-05 2024-04-19T02:17:23.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:23.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.128401+0000", 2024-04-19T02:17:23.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5975000000000004e-05 2024-04-19T02:17:23.505 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:23.505 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:23.505 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:23.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.505 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168387 5.f 5:ff36d1d9:::benchmark_data_smithi121_44835_object34352:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:23.505 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:23.505 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 11.34435715, 2024-04-19T02:17:23.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049975358999999997, 2024-04-19T02:17:23.505 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:23.505 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:23.505 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:23.505 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:23.505 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:23.506 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168387 2024-04-19T02:17:23.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.506 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:23.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:23.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:23.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:23.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:23.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:23.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:23.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:23.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:23.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:23.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:23.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069671+0000", 2024-04-19T02:17:23.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1739999999999999e-06 2024-04-19T02:17:23.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:23.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069677+0000", 2024-04-19T02:17:23.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4519999999999996e-06 2024-04-19T02:17:23.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069682+0000", 2024-04-19T02:17:23.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5400000000000003e-06 2024-04-19T02:17:23.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:23.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072634+0000", 2024-04-19T02:17:23.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0029521510000000001 2024-04-19T02:17:23.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:23.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072706+0000", 2024-04-19T02:17:23.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1996999999999995e-05 2024-04-19T02:17:23.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.509 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:23.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072772+0000", 2024-04-19T02:17:23.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5380000000000001e-05 2024-04-19T02:17:23.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.509 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:23.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117549+0000", 2024-04-19T02:17:23.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044777124000000001 2024-04-19T02:17:23.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.509 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:23.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119572+0000", 2024-04-19T02:17:23.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002022893 2024-04-19T02:17:23.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.510 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:23.510 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119613+0000", 2024-04-19T02:17:23.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0849999999999997e-05 2024-04-19T02:17:23.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.510 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.510 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:23.510 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119645+0000", 2024-04-19T02:17:23.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2113000000000002e-05 2024-04-19T02:17:23.510 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:23.510 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:23.510 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:23.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.510 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.511 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168389 5.2 5:4bcb87b1:::benchmark_data_smithi121_44835_object34354:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:23.511 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.071719+0000", 2024-04-19T02:17:23.511 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 11.342308054, 2024-04-19T02:17:23.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.048248604, 2024-04-19T02:17:23.511 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:23.511 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:23.511 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:23.511 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:23.511 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:23.511 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168389 2024-04-19T02:17:23.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.511 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:23.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:23.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071719+0000", 2024-04-19T02:17:23.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:23.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:23.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071719+0000", 2024-04-19T02:17:23.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:23.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:23.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071718+0000", 2024-04-19T02:17:23.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:23.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:23.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071722+0000", 2024-04-19T02:17:23.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8590000000000004e-06 2024-04-19T02:17:23.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:23.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071730+0000", 2024-04-19T02:17:23.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8569999999999995e-06 2024-04-19T02:17:23.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071736+0000", 2024-04-19T02:17:23.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.127e-06 2024-04-19T02:17:23.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:23.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071769+0000", 2024-04-19T02:17:23.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3052000000000001e-05 2024-04-19T02:17:23.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:23.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071843+0000", 2024-04-19T02:17:23.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3683000000000006e-05 2024-04-19T02:17:23.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:23.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119852+0000", 2024-04-19T02:17:23.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.048009353999999997 2024-04-19T02:17:23.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:23.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119896+0000", 2024-04-19T02:17:23.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3102000000000002e-05 2024-04-19T02:17:23.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:23.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119967+0000", 2024-04-19T02:17:23.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1589999999999997e-05 2024-04-19T02:17:23.515 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:23.515 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:23.515 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:23.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.515 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168391 5.3 5:c5d9b5e1:::benchmark_data_smithi121_44835_object34356:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:23.516 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.074402+0000", 2024-04-19T02:17:23.516 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 11.339624215000001, 2024-04-19T02:17:23.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.045426756999999998, 2024-04-19T02:17:23.516 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:23.516 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:23.516 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:23.516 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:23.516 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:23.516 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168391 2024-04-19T02:17:23.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.516 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:23.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.516 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:23.516 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074402+0000", 2024-04-19T02:17:23.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:23.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:23.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074402+0000", 2024-04-19T02:17:23.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:23.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:23.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074401+0000", 2024-04-19T02:17:23.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:23.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:23.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074406+0000", 2024-04-19T02:17:23.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5879999999999999e-06 2024-04-19T02:17:23.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:23.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074414+0000", 2024-04-19T02:17:23.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8599999999999993e-06 2024-04-19T02:17:23.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074420+0000", 2024-04-19T02:17:23.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6350000000000003e-06 2024-04-19T02:17:23.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:23.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074453+0000", 2024-04-19T02:17:23.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3874000000000001e-05 2024-04-19T02:17:23.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:23.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074531+0000", 2024-04-19T02:17:23.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7999999999999999e-05 2024-04-19T02:17:23.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:23.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119717+0000", 2024-04-19T02:17:23.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.045185395000000003 2024-04-19T02:17:23.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:23.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119756+0000", 2024-04-19T02:17:23.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9110000000000003e-05 2024-04-19T02:17:23.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.520 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:23.520 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119829+0000", 2024-04-19T02:17:23.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3238000000000006e-05 2024-04-19T02:17:23.520 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:23.520 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:23.520 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:23.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.520 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4549.0:168377 5.d e52/16 ondisk, result = 0)", 2024-04-19T02:17:23.520 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.077260+0000", 2024-04-19T02:17:23.520 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 11.336766473999999, 2024-04-19T02:17:23.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042613204000000002, 2024-04-19T02:17:23.520 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:23.520 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:23.521 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:23.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:23.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.077260+0000", 2024-04-19T02:17:23.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:23.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:23.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.077260+0000", 2024-04-19T02:17:23.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:23.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:23.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.077259+0000", 2024-04-19T02:17:23.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:23.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.522 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.522 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:23.522 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.077267+0000", 2024-04-19T02:17:23.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6799999999999993e-06 2024-04-19T02:17:23.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.522 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.522 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:23.522 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117372+0000", 2024-04-19T02:17:23.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040105342000000002 2024-04-19T02:17:23.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.522 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.522 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.522 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117389+0000", 2024-04-19T02:17:23.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6711e-05 2024-04-19T02:17:23.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:23.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119862+0000", 2024-04-19T02:17:23.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0024730580000000002 2024-04-19T02:17:23.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:23.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119867+0000", 2024-04-19T02:17:23.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1590000000000001e-06 2024-04-19T02:17:23.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:23.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:23.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:23.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119873+0000", 2024-04-19T02:17:23.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1410000000000002e-06 2024-04-19T02:17:23.524 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:23.524 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:23.524 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:23.524 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:23.524 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:23.524 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:23.526 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:17:23.526 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:23.526+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:23.628 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:23.628+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:23.698 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:17:23.698 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:17:23.698 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.698 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:201042 5.1 5:87e776c9:::benchmark_data_smithi121_44835_object67007:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:17:23.698 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:23.692249+0000", 2024-04-19T02:17:23.698 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0058405389999999996, 2024-04-19T02:17:23.698 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0058669509999999996, 2024-04-19T02:17:23.698 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:23.698 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:23.699 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:23.699 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:23.699 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:23.699 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 201042 2024-04-19T02:17:23.699 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.699 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:23.699 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.699 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:23.699 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.692249+0000", 2024-04-19T02:17:23.699 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:23.699 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.699 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.699 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:23.699 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.692249+0000", 2024-04-19T02:17:23.699 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:23.700 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.700 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.700 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:23.700 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.692249+0000", 2024-04-19T02:17:23.700 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:23.700 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.700 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.700 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:23.700 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.692256+0000", 2024-04-19T02:17:23.700 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.2429999999999999e-06 2024-04-19T02:17:23.700 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.700 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.700 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:23.700 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.692268+0000", 2024-04-19T02:17:23.700 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1834999999999999e-05 2024-04-19T02:17:23.700 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.700 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.701 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.701 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.692275+0000", 2024-04-19T02:17:23.701 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.8569999999999997e-06 2024-04-19T02:17:23.701 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.701 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.701 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:23.701 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.693529+0000", 2024-04-19T02:17:23.701 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0012546650000000001 2024-04-19T02:17:23.701 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.701 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.701 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:23.701 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.693650+0000", 2024-04-19T02:17:23.701 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000120921 2024-04-19T02:17:23.701 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:23.701 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:23.701 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:23.702 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.702 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.702 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:201043 5.b 5:d0c20666:::benchmark_data_smithi121_44835_object67008:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:17:23.702 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:23.693457+0000", 2024-04-19T02:17:23.702 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0046331230000000003, 2024-04-19T02:17:23.702 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0047536139999999998, 2024-04-19T02:17:23.702 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:23.702 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:23.702 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:23.702 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:23.702 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:23.702 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 201043 2024-04-19T02:17:23.702 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.702 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:23.703 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.703 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:23.703 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.693457+0000", 2024-04-19T02:17:23.703 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:23.703 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.703 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.703 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:23.703 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.693457+0000", 2024-04-19T02:17:23.703 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:23.703 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.703 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.703 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:23.703 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.693456+0000", 2024-04-19T02:17:23.703 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:23.703 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.703 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.704 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:23.704 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.693461+0000", 2024-04-19T02:17:23.704 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.3839999999999996e-06 2024-04-19T02:17:23.704 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.704 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.704 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:23.704 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.693475+0000", 2024-04-19T02:17:23.704 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.3351e-05 2024-04-19T02:17:23.704 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.704 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.704 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.704 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.693482+0000", 2024-04-19T02:17:23.704 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.7570000000000004e-06 2024-04-19T02:17:23.704 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.704 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.705 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:23.705 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.695211+0000", 2024-04-19T02:17:23.705 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00172886 2024-04-19T02:17:23.705 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.705 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.705 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:23.705 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.695327+0000", 2024-04-19T02:17:23.705 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000115696 2024-04-19T02:17:23.705 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:23.705 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:23.705 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:23.705 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.705 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.705 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:201047 5.8 5:190efc05:::benchmark_data_smithi121_44835_object67012:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:17:23.705 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:23.694959+0000", 2024-04-19T02:17:23.706 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0031313629999999999, 2024-04-19T02:17:23.706 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0033167280000000001, 2024-04-19T02:17:23.706 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:23.706 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:23.706 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:23.706 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:23.706 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:23.706 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 201047 2024-04-19T02:17:23.706 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.706 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:23.706 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.706 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:23.706 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.694959+0000", 2024-04-19T02:17:23.706 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:23.707 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.707 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.707 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:23.707 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.694959+0000", 2024-04-19T02:17:23.707 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:23.707 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.707 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.707 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:23.707 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.694958+0000", 2024-04-19T02:17:23.707 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:23.707 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.707 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.707 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:23.707 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.694962+0000", 2024-04-19T02:17:23.707 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3000000000000003e-06 2024-04-19T02:17:23.708 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.708 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.708 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:23.708 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.694974+0000", 2024-04-19T02:17:23.708 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1387e-05 2024-04-19T02:17:23.708 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.708 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.708 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.708 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.694981+0000", 2024-04-19T02:17:23.708 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1069999999999999e-06 2024-04-19T02:17:23.708 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.708 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.708 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:23.708 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.695223+0000", 2024-04-19T02:17:23.708 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00024199200000000001 2024-04-19T02:17:23.709 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.709 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.709 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:23.709 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.695344+0000", 2024-04-19T02:17:23.709 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012180000000000001 2024-04-19T02:17:23.709 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:23.709 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:23.709 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:23.709 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.709 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.709 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:201046 5.d e57/16 5:b9ac741c:::benchmark_data_smithi121_44835_object67011:head v 57'12566, mlcod=57'12564)", 2024-04-19T02:17:23.709 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:23.695210+0000", 2024-04-19T02:17:23.709 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.002879749, 2024-04-19T02:17:23.709 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0031035469999999999, 2024-04-19T02:17:23.709 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:23.710 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:23.710 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:23.710 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.710 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:23.710 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.695210+0000", 2024-04-19T02:17:23.710 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:23.710 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.710 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.710 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:23.710 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.695210+0000", 2024-04-19T02:17:23.710 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:23.710 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.710 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.710 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:23.710 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.695210+0000", 2024-04-19T02:17:23.711 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:23.711 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.711 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.711 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:23.711 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.695216+0000", 2024-04-19T02:17:23.711 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.7000000000000002e-06 2024-04-19T02:17:23.711 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.711 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.711 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:23.711 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.695230+0000", 2024-04-19T02:17:23.711 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.4049000000000001e-05 2024-04-19T02:17:23.711 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.711 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.711 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.711 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.695237+0000", 2024-04-19T02:17:23.712 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.2820000000000002e-06 2024-04-19T02:17:23.712 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.712 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.712 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:23.712 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.695272+0000", 2024-04-19T02:17:23.712 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5629000000000001e-05 2024-04-19T02:17:23.712 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.712 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.712 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:23.712 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.695291+0000", 2024-04-19T02:17:23.712 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.8960000000000001e-05 2024-04-19T02:17:23.712 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:23.712 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:23.712 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:23.712 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.713 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.713 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:201050 5.4 5:27dc1372:::benchmark_data_smithi121_44835_object67015:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:17:23.713 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:23.695452+0000", 2024-04-19T02:17:23.713 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.002637581, 2024-04-19T02:17:23.713 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.002896624, 2024-04-19T02:17:23.713 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:23.713 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:23.713 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:23.713 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:23.713 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:23.713 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 201050 2024-04-19T02:17:23.713 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.713 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:23.713 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.714 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:23.714 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.695452+0000", 2024-04-19T02:17:23.714 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:23.714 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.714 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.714 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:23.714 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.695452+0000", 2024-04-19T02:17:23.714 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:23.714 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.714 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.714 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:23.714 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.695452+0000", 2024-04-19T02:17:23.714 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:23.714 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.714 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.715 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:23.715 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.695456+0000", 2024-04-19T02:17:23.715 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0600000000000001e-06 2024-04-19T02:17:23.715 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.715 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.715 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:23.715 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.695466+0000", 2024-04-19T02:17:23.715 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0198e-05 2024-04-19T02:17:23.715 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.715 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.715 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.715 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.695474+0000", 2024-04-19T02:17:23.715 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.7009999999999996e-06 2024-04-19T02:17:23.715 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.716 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.716 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:23.716 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.695518+0000", 2024-04-19T02:17:23.716 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4416000000000003e-05 2024-04-19T02:17:23.716 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.716 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.716 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:23.716 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.695654+0000", 2024-04-19T02:17:23.716 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000136021 2024-04-19T02:17:23.716 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:23.716 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:23.716 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:23.716 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.716 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.716 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:201052 5.a 5:5c0e1b5b:::benchmark_data_smithi121_44835_object67017:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:17:23.716 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:23.695646+0000", 2024-04-19T02:17:23.717 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0024438089999999999, 2024-04-19T02:17:23.717 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0027402070000000001, 2024-04-19T02:17:23.717 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:23.717 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:23.717 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:23.717 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:23.717 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:23.717 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 201052 2024-04-19T02:17:23.717 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.717 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:23.717 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.717 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:23.717 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.695646+0000", 2024-04-19T02:17:23.717 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:23.717 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.718 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.718 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:23.718 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.695646+0000", 2024-04-19T02:17:23.718 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:23.718 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.718 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.718 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:23.718 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.695646+0000", 2024-04-19T02:17:23.718 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:23.718 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.718 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.718 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:23.718 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.695649+0000", 2024-04-19T02:17:23.718 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5540000000000002e-06 2024-04-19T02:17:23.719 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.719 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.719 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:23.719 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.695657+0000", 2024-04-19T02:17:23.719 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0169999999999996e-06 2024-04-19T02:17:23.719 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.719 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.719 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.719 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.695664+0000", 2024-04-19T02:17:23.719 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.4219999999999997e-06 2024-04-19T02:17:23.719 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.719 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.719 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:23.719 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.695714+0000", 2024-04-19T02:17:23.719 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0037999999999998e-05 2024-04-19T02:17:23.719 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.720 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.720 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:23.720 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.695829+0000", 2024-04-19T02:17:23.720 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000115047 2024-04-19T02:17:23.720 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:23.720 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:23.720 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:23.720 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.720 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.720 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:201053 5.1 5:88620d05:::benchmark_data_smithi121_44835_object67018:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:17:23.720 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:23.697591+0000", 2024-04-19T02:17:23.720 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.00049861700000000003, 2024-04-19T02:17:23.720 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00083680099999999997, 2024-04-19T02:17:23.720 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:23.720 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:23.721 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:23.721 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:23.721 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:23.721 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 201053 2024-04-19T02:17:23.721 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.721 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:23.721 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.721 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:23.721 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.697591+0000", 2024-04-19T02:17:23.721 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:23.721 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.721 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.721 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:23.721 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.697591+0000", 2024-04-19T02:17:23.722 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:23.722 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.722 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.722 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:23.722 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.697590+0000", 2024-04-19T02:17:23.722 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:23.722 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.722 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.722 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:23.722 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.697596+0000", 2024-04-19T02:17:23.722 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.395e-06 2024-04-19T02:17:23.722 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.722 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.722 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:23.722 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.697606+0000", 2024-04-19T02:17:23.723 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0413e-05 2024-04-19T02:17:23.723 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.723 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.723 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.723 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.697614+0000", 2024-04-19T02:17:23.723 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2260000000000005e-06 2024-04-19T02:17:23.723 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.723 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.723 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:23.723 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.697659+0000", 2024-04-19T02:17:23.723 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4898000000000003e-05 2024-04-19T02:17:23.723 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.723 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.723 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:23.723 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.697795+0000", 2024-04-19T02:17:23.724 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000135549 2024-04-19T02:17:23.724 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:23.724 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:23.724 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:23.724 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.724 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.724 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:201054 5.0 5:04aaa32b:::benchmark_data_smithi121_44835_object67019:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:17:23.724 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:23.697698+0000", 2024-04-19T02:17:23.724 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.00039208299999999999, 2024-04-19T02:17:23.724 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000804005, 2024-04-19T02:17:23.724 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:23.724 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:23.724 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:23.724 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:23.725 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:23.725 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 201054 2024-04-19T02:17:23.725 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.725 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:23.725 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.725 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:23.725 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.697698+0000", 2024-04-19T02:17:23.725 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:23.725 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.725 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.725 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:23.725 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.697698+0000", 2024-04-19T02:17:23.725 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:23.725 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.725 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.726 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:23.726 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.697697+0000", 2024-04-19T02:17:23.726 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:23.726 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.726 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.726 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:23.726 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.697702+0000", 2024-04-19T02:17:23.726 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2050000000000004e-06 2024-04-19T02:17:23.726 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.726 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.726 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:23.726 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.697710+0000", 2024-04-19T02:17:23.726 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.6349999999999995e-06 2024-04-19T02:17:23.726 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.726 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.727 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.727 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.697716+0000", 2024-04-19T02:17:23.727 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.5960000000000003e-06 2024-04-19T02:17:23.727 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.727 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.727 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:23.727 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.697752+0000", 2024-04-19T02:17:23.727 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5843000000000002e-05 2024-04-19T02:17:23.727 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.727 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.727 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:23.727 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.697832+0000", 2024-04-19T02:17:23.727 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0634000000000001e-05 2024-04-19T02:17:23.727 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:23.727 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:23.728 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:23.728 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.728 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.728 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:201055 5.1 5.cc705181 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:17:23.728 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:23.697722+0000", 2024-04-19T02:17:23.728 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.00036757499999999998, 2024-04-19T02:17:23.728 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00085452200000000003, 2024-04-19T02:17:23.728 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:23.728 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "queued for pg", 2024-04-19T02:17:23.728 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:23.728 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:23.728 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:23.728 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 201055 2024-04-19T02:17:23.728 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.728 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:23.728 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.729 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:23.729 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.697722+0000", 2024-04-19T02:17:23.729 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:23.729 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.729 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.729 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:23.729 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.697722+0000", 2024-04-19T02:17:23.729 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:23.729 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.729 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.729 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:23.729 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.697722+0000", 2024-04-19T02:17:23.729 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:23.729 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.729 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.730 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:23.730 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.697724+0000", 2024-04-19T02:17:23.730 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.9970000000000001e-06 2024-04-19T02:17:23.730 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.730 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.730 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:23.730 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.697728+0000", 2024-04-19T02:17:23.730 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5020000000000001e-06 2024-04-19T02:17:23.730 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.730 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.730 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.730 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.697731+0000", 2024-04-19T02:17:23.730 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4170000000000001e-06 2024-04-19T02:17:23.730 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:23.730 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:23.731 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:23.731 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.731 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.731 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:201056 5.8 5:1099e002:::benchmark_data_smithi121_44835_object67021:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:17:23.731 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:23.698404+0000", 2024-04-19T02:17:23.731 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 4294967295.9996858, 2024-04-19T02:17:23.731 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000240988, 2024-04-19T02:17:23.731 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:23.731 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:23.731 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:23.731 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:23.731 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:23.731 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 201056 2024-04-19T02:17:23.731 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.731 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:23.731 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.732 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:23.732 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.698404+0000", 2024-04-19T02:17:23.732 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:23.732 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.732 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.732 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:23.732 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.698404+0000", 2024-04-19T02:17:23.732 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:23.732 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.732 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.732 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:23.732 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.698404+0000", 2024-04-19T02:17:23.732 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:23.732 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.733 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.733 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:23.733 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.698409+0000", 2024-04-19T02:17:23.733 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.9880000000000004e-06 2024-04-19T02:17:23.733 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.733 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.733 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:23.733 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.698419+0000", 2024-04-19T02:17:23.733 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0910000000000001e-05 2024-04-19T02:17:23.733 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.733 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.733 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.733 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.698427+0000", 2024-04-19T02:17:23.733 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1430000000000001e-06 2024-04-19T02:17:23.733 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.734 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.734 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:23.734 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.698456+0000", 2024-04-19T02:17:23.734 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9054e-05 2024-04-19T02:17:23.734 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.734 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.734 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:23.734 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.698535+0000", 2024-04-19T02:17:23.734 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9343000000000003e-05 2024-04-19T02:17:23.734 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:23.734 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:23.734 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:23.734 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.734 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.734 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:201034 5.8 5:194eb4c6:::benchmark_data_smithi121_44835_object66999:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:17:23.735 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:23.690970+0000", 2024-04-19T02:17:23.735 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0071199890000000002, 2024-04-19T02:17:23.735 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0077400530000000002, 2024-04-19T02:17:23.735 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:23.735 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:23.735 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:23.735 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:23.735 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:23.735 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 201034 2024-04-19T02:17:23.735 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.735 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:23.735 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.735 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:23.735 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.690970+0000", 2024-04-19T02:17:23.735 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:23.736 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.736 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.736 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:23.736 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.690970+0000", 2024-04-19T02:17:23.736 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:23.736 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.736 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.736 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:23.736 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.690970+0000", 2024-04-19T02:17:23.736 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:23.736 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.736 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.736 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:23.736 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.690972+0000", 2024-04-19T02:17:23.737 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.559e-06 2024-04-19T02:17:23.737 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.737 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.737 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:23.737 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.690979+0000", 2024-04-19T02:17:23.737 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6420000000000001e-06 2024-04-19T02:17:23.737 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.737 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.737 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:23.737 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.690984+0000", 2024-04-19T02:17:23.737 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.5330000000000002e-06 2024-04-19T02:17:23.737 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.737 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.737 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:23.737 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.693244+0000", 2024-04-19T02:17:23.738 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.002260228 2024-04-19T02:17:23.738 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:23.738 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:23.738 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:23.738 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:23.693380+0000", 2024-04-19T02:17:23.738 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013531900000000001 2024-04-19T02:17:23.738 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:23.738 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:23.738 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:23.738 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:23.738 INFO:teuthology.orchestra.run.smithi174.stdout: ], 2024-04-19T02:17:23.738 INFO:teuthology.orchestra.run.smithi174.stdout: "num_ops": 11 2024-04-19T02:17:23.738 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:17:23.739 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:23.740+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:23.740 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:17:23.842 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:23.842+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:23.942 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:23.943+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:23.957 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:17:23.957 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [], 2024-04-19T02:17:23.957 INFO:teuthology.orchestra.run.smithi174.stdout: "complaint_time": 30, 2024-04-19T02:17:23.957 INFO:teuthology.orchestra.run.smithi174.stdout: "num_blocked_ops": 0 2024-04-19T02:17:23.957 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:17:23.970 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:17:24.045 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:24.044+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:24.144 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:24.145+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:24.188 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:17:24.188 INFO:teuthology.orchestra.run.smithi174.stdout: "size": 20, 2024-04-19T02:17:24.188 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 600, 2024-04-19T02:17:24.188 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:17:24.188 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.188 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:19 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:24.189 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:17:24.189 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 114.917010547, 2024-04-19T02:17:24.189 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020818203, 2024-04-19T02:17:24.189 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:24.189 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:24.189 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:24.189 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.189 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:24.189 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:17:24.189 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:24.189 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.189 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.189 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:24.189 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:17:24.190 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:24.190 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.190 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.190 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:24.190 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:17:24.190 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:24.190 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.190 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.190 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:24.190 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270065+0000", 2024-04-19T02:17:24.190 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4310000000000001e-06 2024-04-19T02:17:24.190 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.191 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.191 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:24.191 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270070+0000", 2024-04-19T02:17:24.191 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2859999999999999e-06 2024-04-19T02:17:24.191 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.191 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.191 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:24.191 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270077+0000", 2024-04-19T02:17:24.191 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5270000000000004e-06 2024-04-19T02:17:24.191 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.191 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.191 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:24.191 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270107+0000", 2024-04-19T02:17:24.191 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0205999999999998e-05 2024-04-19T02:17:24.191 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.192 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.192 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:24.192 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270111+0000", 2024-04-19T02:17:24.192 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8650000000000003e-06 2024-04-19T02:17:24.192 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.192 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.192 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:24.192 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285936+0000", 2024-04-19T02:17:24.192 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015824677999999998 2024-04-19T02:17:24.192 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.192 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.192 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:24.192 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286007+0000", 2024-04-19T02:17:24.192 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1157999999999999e-05 2024-04-19T02:17:24.192 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.193 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.193 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:24.193 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286086+0000", 2024-04-19T02:17:24.193 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9084000000000004e-05 2024-04-19T02:17:24.193 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.193 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.193 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:24.193 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290740+0000", 2024-04-19T02:17:24.193 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0046543679999999999 2024-04-19T02:17:24.193 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.193 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.193 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:24.193 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290833+0000", 2024-04-19T02:17:24.193 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2551000000000002e-05 2024-04-19T02:17:24.193 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.194 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.194 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:24.194 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290859+0000", 2024-04-19T02:17:24.194 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.6696999999999999e-05 2024-04-19T02:17:24.194 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.194 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.194 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:24.194 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290881+0000", 2024-04-19T02:17:24.194 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1653000000000001e-05 2024-04-19T02:17:24.194 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:24.194 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:24.194 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:24.194 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.194 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.194 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:77622 5.8 5:166fbe77:::benchmark_data_smithi121_44835_object77621:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:24.195 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:17:24.195 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 57.381513609999999, 2024-04-19T02:17:24.195 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.021784694, 2024-04-19T02:17:24.195 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:24.195 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:24.195 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:24.195 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:24.195 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:24.195 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 77622 2024-04-19T02:17:24.195 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.195 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:24.195 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.195 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:24.195 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:17:24.195 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:24.196 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.196 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.196 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:24.196 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:17:24.196 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:24.196 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.196 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.196 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:24.196 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805559+0000", 2024-04-19T02:17:24.196 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:24.196 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.197 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.197 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:24.197 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805659+0000", 2024-04-19T02:17:24.197 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.9908000000000006e-05 2024-04-19T02:17:24.197 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.197 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.197 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:24.197 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805668+0000", 2024-04-19T02:17:24.197 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2129999999999997e-06 2024-04-19T02:17:24.197 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.197 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.197 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:24.197 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805673+0000", 2024-04-19T02:17:24.197 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0370000000000002e-06 2024-04-19T02:17:24.198 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.198 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.198 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:24.198 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812022+0000", 2024-04-19T02:17:24.198 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0063483239999999998 2024-04-19T02:17:24.198 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.198 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.198 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:24.198 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812129+0000", 2024-04-19T02:17:24.198 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010744200000000001 2024-04-19T02:17:24.198 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.198 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.198 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:24.198 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812252+0000", 2024-04-19T02:17:24.198 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000122519 2024-04-19T02:17:24.199 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.199 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.199 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:24.199 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.820979+0000", 2024-04-19T02:17:24.199 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0087272740000000001 2024-04-19T02:17:24.199 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.199 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.199 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:24.199 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827270+0000", 2024-04-19T02:17:24.199 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0062906239999999999 2024-04-19T02:17:24.199 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.199 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.199 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:24.199 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827309+0000", 2024-04-19T02:17:24.199 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9678999999999997e-05 2024-04-19T02:17:24.200 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.200 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.200 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:24.200 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827345+0000", 2024-04-19T02:17:24.200 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5308000000000001e-05 2024-04-19T02:17:24.200 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:24.200 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:24.200 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:24.200 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.200 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.200 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78224 5.4 5:26e797d5:::benchmark_data_smithi121_44835_object78223:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:24.200 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:17:24.200 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 57.080511411000003, 2024-04-19T02:17:24.200 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.021471998999999999, 2024-04-19T02:17:24.200 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:24.201 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:24.201 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:24.201 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:24.201 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:24.201 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78224 2024-04-19T02:17:24.201 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.201 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:24.201 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.201 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:24.201 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:17:24.201 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:24.201 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.201 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.201 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:24.201 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:17:24.202 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:24.202 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.202 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.202 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:24.202 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106561+0000", 2024-04-19T02:17:24.202 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:24.202 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.202 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.202 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:24.202 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106630+0000", 2024-04-19T02:17:24.202 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.8553999999999994e-05 2024-04-19T02:17:24.202 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.202 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.202 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:24.202 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106644+0000", 2024-04-19T02:17:24.203 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.4651000000000001e-05 2024-04-19T02:17:24.203 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.203 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.203 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:24.203 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106653+0000", 2024-04-19T02:17:24.203 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.6719999999999993e-06 2024-04-19T02:17:24.203 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.203 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.203 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:24.203 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106693+0000", 2024-04-19T02:17:24.203 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9978999999999998e-05 2024-04-19T02:17:24.203 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.203 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.203 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:24.204 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106840+0000", 2024-04-19T02:17:24.204 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0001473 2024-04-19T02:17:24.204 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.204 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.204 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:24.204 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106971+0000", 2024-04-19T02:17:24.204 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013051499999999999 2024-04-19T02:17:24.204 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.204 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.204 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:24.204 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.109047+0000", 2024-04-19T02:17:24.204 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.002076002 2024-04-19T02:17:24.204 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.204 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.205 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:24.205 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.127967+0000", 2024-04-19T02:17:24.205 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.018919780000000001 2024-04-19T02:17:24.205 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.205 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.205 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:24.205 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128004+0000", 2024-04-19T02:17:24.205 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7719000000000003e-05 2024-04-19T02:17:24.205 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.205 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.205 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:24.205 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128034+0000", 2024-04-19T02:17:24.205 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9651000000000001e-05 2024-04-19T02:17:24.205 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:24.205 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:24.205 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:24.206 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.206 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.206 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78259 5.4 5:2aa344b2:::benchmark_data_smithi121_44835_object78258:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:24.206 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:17:24.206 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 57.061816342, 2024-04-19T02:17:24.206 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022934350999999999, 2024-04-19T02:17:24.206 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:24.206 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:24.206 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:24.206 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:24.206 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:24.206 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78259 2024-04-19T02:17:24.206 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.206 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:24.207 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.207 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:24.207 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:17:24.207 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:24.207 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.207 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.207 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:24.207 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:17:24.207 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:24.207 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.207 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.207 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:24.207 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125256+0000", 2024-04-19T02:17:24.207 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:24.207 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.208 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.208 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:24.208 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125347+0000", 2024-04-19T02:17:24.208 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0470000000000006e-05 2024-04-19T02:17:24.208 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.208 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.208 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:24.208 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125358+0000", 2024-04-19T02:17:24.208 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1764e-05 2024-04-19T02:17:24.208 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.208 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.208 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:24.208 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125364+0000", 2024-04-19T02:17:24.208 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7189999999999998e-06 2024-04-19T02:17:24.208 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.208 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.208 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:24.209 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125391+0000", 2024-04-19T02:17:24.209 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7270000000000001e-05 2024-04-19T02:17:24.209 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.209 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.209 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:24.209 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125471+0000", 2024-04-19T02:17:24.209 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9209999999999995e-05 2024-04-19T02:17:24.209 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.209 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.209 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:24.209 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125559+0000", 2024-04-19T02:17:24.209 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.8689000000000004e-05 2024-04-19T02:17:24.209 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.209 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.210 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:24.210 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128164+0000", 2024-04-19T02:17:24.210 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0026050270000000002 2024-04-19T02:17:24.210 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.210 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.210 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:24.210 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148139+0000", 2024-04-19T02:17:24.210 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.019975050000000001 2024-04-19T02:17:24.210 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.210 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.210 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:24.210 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148169+0000", 2024-04-19T02:17:24.210 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0001e-05 2024-04-19T02:17:24.210 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.211 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.211 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:24.211 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148191+0000", 2024-04-19T02:17:24.211 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.2104999999999999e-05 2024-04-19T02:17:24.211 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:24.211 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:24.211 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:24.211 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.211 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.211 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78271 5.4 5:2982d7a6:::benchmark_data_smithi121_44835_object78270:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:24.211 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:17:24.211 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 57.054953112, 2024-04-19T02:17:24.211 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020841755999999999, 2024-04-19T02:17:24.211 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:24.212 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:24.212 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:24.212 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:24.212 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:24.212 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78271 2024-04-19T02:17:24.212 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.212 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:24.212 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.212 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:24.212 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:17:24.212 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:24.212 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.212 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.212 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:24.212 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:17:24.213 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:24.213 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.213 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.213 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:24.213 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132119+0000", 2024-04-19T02:17:24.213 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:24.213 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.213 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.213 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:24.213 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132185+0000", 2024-04-19T02:17:24.213 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5994000000000005e-05 2024-04-19T02:17:24.213 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.213 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.213 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:24.213 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132197+0000", 2024-04-19T02:17:24.213 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2091e-05 2024-04-19T02:17:24.214 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.214 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.214 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:24.214 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132206+0000", 2024-04-19T02:17:24.214 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.5099999999999998e-06 2024-04-19T02:17:24.214 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.214 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.214 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:24.214 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132242+0000", 2024-04-19T02:17:24.214 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5663000000000001e-05 2024-04-19T02:17:24.214 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.214 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.214 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:24.215 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132335+0000", 2024-04-19T02:17:24.215 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3275000000000004e-05 2024-04-19T02:17:24.215 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.215 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.215 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:24.215 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132432+0000", 2024-04-19T02:17:24.215 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7571000000000005e-05 2024-04-19T02:17:24.215 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.215 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.215 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:24.215 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.136706+0000", 2024-04-19T02:17:24.215 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0042738170000000001 2024-04-19T02:17:24.215 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.215 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.215 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:24.216 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152909+0000", 2024-04-19T02:17:24.216 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016202415000000001 2024-04-19T02:17:24.216 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.216 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.216 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:24.216 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152938+0000", 2024-04-19T02:17:24.216 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9740999999999999e-05 2024-04-19T02:17:24.216 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.216 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.216 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:24.216 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152962+0000", 2024-04-19T02:17:24.216 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3659000000000002e-05 2024-04-19T02:17:24.216 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:24.216 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:24.217 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:24.217 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.217 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.217 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78272 5.4 5:273e819a:::benchmark_data_smithi121_44835_object78271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:24.217 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:24.217 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 57.054464068999998, 2024-04-19T02:17:24.217 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022180163999999999, 2024-04-19T02:17:24.217 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:24.217 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:24.217 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:24.217 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:24.217 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:24.217 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78272 2024-04-19T02:17:24.217 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.217 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:24.217 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.217 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:24.218 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:24.218 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:24.218 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.218 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.218 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:24.218 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:24.218 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:24.218 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.218 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.218 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:24.218 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:24.218 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:24.218 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.218 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.219 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:24.219 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132690+0000", 2024-04-19T02:17:24.219 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0963000000000004e-05 2024-04-19T02:17:24.219 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.219 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.219 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:24.219 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132703+0000", 2024-04-19T02:17:24.219 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.3072e-05 2024-04-19T02:17:24.219 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.219 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.219 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:24.219 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132710+0000", 2024-04-19T02:17:24.219 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3100000000000003e-06 2024-04-19T02:17:24.219 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.219 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.220 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:24.220 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134005+0000", 2024-04-19T02:17:24.220 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001294513 2024-04-19T02:17:24.220 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.220 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.220 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:24.220 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134139+0000", 2024-04-19T02:17:24.220 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000134447 2024-04-19T02:17:24.220 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.220 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.220 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:24.220 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134284+0000", 2024-04-19T02:17:24.220 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014514399999999999 2024-04-19T02:17:24.221 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.221 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.221 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:24.221 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.139622+0000", 2024-04-19T02:17:24.221 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0053373830000000002 2024-04-19T02:17:24.221 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.221 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.221 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:24.221 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154737+0000", 2024-04-19T02:17:24.221 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015115195999999999 2024-04-19T02:17:24.221 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.221 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.221 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:24.221 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154768+0000", 2024-04-19T02:17:24.222 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0824999999999997e-05 2024-04-19T02:17:24.222 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.222 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.222 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:24.222 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154790+0000", 2024-04-19T02:17:24.222 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1999000000000001e-05 2024-04-19T02:17:24.222 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:24.222 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:24.222 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:24.222 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.222 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.222 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:94481 5.e 5:7b2fbebf:::benchmark_data_smithi121_44835_object94480:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:24.222 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:17:24.223 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 49.065827751999997, 2024-04-19T02:17:24.223 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020897846000000001, 2024-04-19T02:17:24.223 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:24.223 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:24.223 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:24.223 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:24.223 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:24.223 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 94481 2024-04-19T02:17:24.223 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.223 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:24.223 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.223 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:24.223 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:17:24.223 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:24.223 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.224 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.224 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:24.224 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:17:24.224 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:24.224 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.224 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.224 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:24.224 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121245+0000", 2024-04-19T02:17:24.224 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:24.224 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.224 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.224 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:24.224 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121273+0000", 2024-04-19T02:17:24.224 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7250000000000002e-05 2024-04-19T02:17:24.224 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.224 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.225 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:24.225 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121277+0000", 2024-04-19T02:17:24.225 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2860000000000001e-06 2024-04-19T02:17:24.225 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.225 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.225 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:24.225 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121280+0000", 2024-04-19T02:17:24.225 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2739999999999999e-06 2024-04-19T02:17:24.225 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.225 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.225 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:24.225 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121320+0000", 2024-04-19T02:17:24.225 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9879000000000002e-05 2024-04-19T02:17:24.225 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.225 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.225 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:24.226 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121448+0000", 2024-04-19T02:17:24.226 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012748800000000001 2024-04-19T02:17:24.226 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.226 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.226 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:24.226 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121595+0000", 2024-04-19T02:17:24.226 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014741299999999999 2024-04-19T02:17:24.226 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.226 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.226 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:24.226 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.127776+0000", 2024-04-19T02:17:24.226 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0061811360000000003 2024-04-19T02:17:24.226 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.226 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.227 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:24.227 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142073+0000", 2024-04-19T02:17:24.227 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014296959999999999 2024-04-19T02:17:24.227 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.227 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.227 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:24.227 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142106+0000", 2024-04-19T02:17:24.227 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3348e-05 2024-04-19T02:17:24.227 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.227 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.227 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:24.227 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142144+0000", 2024-04-19T02:17:24.227 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7153000000000002e-05 2024-04-19T02:17:24.227 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:24.227 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:24.227 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:24.228 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.228 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.228 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:94581 5.b 5:dc86d6e9:::benchmark_data_smithi121_44835_object94580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:24.228 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:24.228 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 49.006893179000002, 2024-04-19T02:17:24.228 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022099711000000001, 2024-04-19T02:17:24.228 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:24.228 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:24.228 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:24.228 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:24.228 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:24.228 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 94581 2024-04-19T02:17:24.228 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.228 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:24.228 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.228 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:24.229 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:24.229 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:24.229 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.229 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.229 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:24.229 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:24.229 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:24.229 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.229 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.229 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:24.229 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:24.229 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:24.229 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.229 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.229 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:24.229 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180253+0000", 2024-04-19T02:17:24.229 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3163000000000004e-05 2024-04-19T02:17:24.230 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.230 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.230 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:24.230 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180266+0000", 2024-04-19T02:17:24.230 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2886e-05 2024-04-19T02:17:24.230 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.230 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.230 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:24.230 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180273+0000", 2024-04-19T02:17:24.230 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.4059999999999999e-06 2024-04-19T02:17:24.230 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.230 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.230 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:24.230 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180646+0000", 2024-04-19T02:17:24.231 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00037283999999999999 2024-04-19T02:17:24.231 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.231 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.231 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:24.231 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180774+0000", 2024-04-19T02:17:24.231 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012793799999999999 2024-04-19T02:17:24.231 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.231 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.231 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:24.231 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180920+0000", 2024-04-19T02:17:24.231 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000146692 2024-04-19T02:17:24.231 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.231 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.231 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:24.231 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.183344+0000", 2024-04-19T02:17:24.231 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0024231669999999999 2024-04-19T02:17:24.232 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.232 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.232 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:24.232 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202196+0000", 2024-04-19T02:17:24.232 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.018852384 2024-04-19T02:17:24.232 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.232 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.232 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:24.232 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202241+0000", 2024-04-19T02:17:24.232 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4923999999999999e-05 2024-04-19T02:17:24.232 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.232 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.232 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:24.232 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202280+0000", 2024-04-19T02:17:24.232 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9096e-05 2024-04-19T02:17:24.232 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:24.232 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:24.233 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:24.233 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.233 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.233 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:96356 5.0 5:0a661b39:::benchmark_data_smithi121_44835_object96355:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:24.233 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:17:24.233 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 48.093680337000002, 2024-04-19T02:17:24.233 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020955516, 2024-04-19T02:17:24.233 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:24.233 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:24.233 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:24.233 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:24.233 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:24.233 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 96356 2024-04-19T02:17:24.233 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.234 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:24.234 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.234 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:24.234 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:17:24.234 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:24.234 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.234 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.234 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:24.234 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:17:24.234 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:24.234 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.234 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.234 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:24.235 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:17:24.235 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:24.235 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.235 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.235 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:24.235 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093455+0000", 2024-04-19T02:17:24.235 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.2205000000000005e-05 2024-04-19T02:17:24.235 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.235 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.235 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:24.235 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093464+0000", 2024-04-19T02:17:24.235 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3910000000000004e-06 2024-04-19T02:17:24.235 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.235 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.235 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:24.235 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093469+0000", 2024-04-19T02:17:24.236 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.7249999999999997e-06 2024-04-19T02:17:24.236 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.236 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.236 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:24.236 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099643+0000", 2024-04-19T02:17:24.236 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0061743359999999999 2024-04-19T02:17:24.236 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.236 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.236 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:24.236 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099774+0000", 2024-04-19T02:17:24.236 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013050599999999999 2024-04-19T02:17:24.236 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.236 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.236 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:24.237 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099917+0000", 2024-04-19T02:17:24.237 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000143187 2024-04-19T02:17:24.237 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.237 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.237 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:24.237 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.105432+0000", 2024-04-19T02:17:24.237 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.005514873 2024-04-19T02:17:24.237 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.237 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.237 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:24.237 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114264+0000", 2024-04-19T02:17:24.237 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.008831752 2024-04-19T02:17:24.237 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.237 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.237 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:24.237 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114300+0000", 2024-04-19T02:17:24.238 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6582000000000003e-05 2024-04-19T02:17:24.238 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.238 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.238 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:24.238 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114349+0000", 2024-04-19T02:17:24.238 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8579999999999999e-05 2024-04-19T02:17:24.238 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:24.238 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:24.238 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:24.238 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.238 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.238 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:96357 5.0 5:00efce8b:::benchmark_data_smithi121_44835_object96356:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:24.238 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:17:24.238 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 48.093600659000003, 2024-04-19T02:17:24.238 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020937471999999999, 2024-04-19T02:17:24.238 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:24.239 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:24.239 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:24.239 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:24.239 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:24.239 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 96357 2024-04-19T02:17:24.239 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.239 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:24.239 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.239 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:24.239 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:17:24.239 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:24.239 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.239 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.239 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:24.239 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:17:24.239 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:24.239 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.240 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.240 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:24.240 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093472+0000", 2024-04-19T02:17:24.240 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:24.240 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.240 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.240 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:24.240 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093513+0000", 2024-04-19T02:17:24.240 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0213000000000003e-05 2024-04-19T02:17:24.240 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.240 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.240 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:24.240 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093519+0000", 2024-04-19T02:17:24.240 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.066e-06 2024-04-19T02:17:24.241 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.241 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.241 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:24.241 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093525+0000", 2024-04-19T02:17:24.241 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.8170000000000004e-06 2024-04-19T02:17:24.241 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.241 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.241 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:24.241 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103412+0000", 2024-04-19T02:17:24.241 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0098872739999999997 2024-04-19T02:17:24.241 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.241 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.241 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:24.242 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103551+0000", 2024-04-19T02:17:24.242 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000139295 2024-04-19T02:17:24.242 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.242 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.242 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:24.242 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103701+0000", 2024-04-19T02:17:24.242 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014954599999999999 2024-04-19T02:17:24.242 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.242 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.242 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:24.242 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.108849+0000", 2024-04-19T02:17:24.242 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0051487199999999999 2024-04-19T02:17:24.242 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.242 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.242 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:24.243 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114355+0000", 2024-04-19T02:17:24.243 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0055052529999999999 2024-04-19T02:17:24.243 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.243 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.243 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:24.243 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114379+0000", 2024-04-19T02:17:24.243 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4275000000000001e-05 2024-04-19T02:17:24.243 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.243 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.243 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:24.243 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114410+0000", 2024-04-19T02:17:24.243 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1356999999999998e-05 2024-04-19T02:17:24.243 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:24.243 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:24.243 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:24.244 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.244 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.244 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:104431 5.8 5:14818e19:::benchmark_data_smithi121_44835_object104430:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T02:17:24.244 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:17:24.244 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 43.975688134000002, 2024-04-19T02:17:24.244 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022149528000000002, 2024-04-19T02:17:24.244 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:24.244 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:24.244 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:24.244 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:24.244 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:24.244 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 104431 2024-04-19T02:17:24.244 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.244 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:24.244 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.244 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:24.245 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:17:24.245 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:24.245 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.245 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.245 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:24.245 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:17:24.245 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:24.245 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.245 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.245 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:24.245 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211384+0000", 2024-04-19T02:17:24.245 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:24.245 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.245 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.245 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:24.245 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211458+0000", 2024-04-19T02:17:24.245 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3311000000000003e-05 2024-04-19T02:17:24.245 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.246 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.246 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:24.246 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211471+0000", 2024-04-19T02:17:24.246 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.3308e-05 2024-04-19T02:17:24.246 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.246 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.246 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:24.246 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211479+0000", 2024-04-19T02:17:24.246 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0909999999999993e-06 2024-04-19T02:17:24.246 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.246 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.246 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:24.246 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.221821+0000", 2024-04-19T02:17:24.246 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010341596999999999 2024-04-19T02:17:24.246 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.247 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.247 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:24.247 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.221966+0000", 2024-04-19T02:17:24.247 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000145167 2024-04-19T02:17:24.247 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.247 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.247 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:24.247 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.222077+0000", 2024-04-19T02:17:24.247 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011128000000000001 2024-04-19T02:17:24.247 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.247 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.247 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:24.247 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.228126+0000", 2024-04-19T02:17:24.247 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0060486710000000003 2024-04-19T02:17:24.247 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.247 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.248 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:24.248 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233449+0000", 2024-04-19T02:17:24.248 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0053231370000000004 2024-04-19T02:17:24.248 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.248 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.248 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:24.248 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233498+0000", 2024-04-19T02:17:24.248 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8798999999999998e-05 2024-04-19T02:17:24.248 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.248 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.248 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:24.248 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233535+0000", 2024-04-19T02:17:24.248 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7119000000000002e-05 2024-04-19T02:17:24.248 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:24.248 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:24.248 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:24.249 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.249 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.249 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157437 5.e 5:78833a3d:::benchmark_data_smithi121_44835_object23402:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:24.249 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.859854+0000", 2024-04-19T02:17:24.249 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 17.327219362000001, 2024-04-19T02:17:24.249 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.025859589999999998, 2024-04-19T02:17:24.249 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:24.249 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:24.249 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:24.249 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:24.249 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:24.249 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157437 2024-04-19T02:17:24.249 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.249 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:24.249 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.250 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:24.250 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859854+0000", 2024-04-19T02:17:24.250 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:24.250 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.250 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.250 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:24.250 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859854+0000", 2024-04-19T02:17:24.250 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:24.250 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.250 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.250 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:24.250 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859853+0000", 2024-04-19T02:17:24.250 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:24.250 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.250 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.250 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:24.251 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859857+0000", 2024-04-19T02:17:24.251 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8789999999999996e-06 2024-04-19T02:17:24.251 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.251 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.251 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:24.251 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859865+0000", 2024-04-19T02:17:24.251 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.1880000000000002e-06 2024-04-19T02:17:24.251 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.251 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.251 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:24.251 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859873+0000", 2024-04-19T02:17:24.251 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.2980000000000003e-06 2024-04-19T02:17:24.251 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.251 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.251 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:24.252 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859908+0000", 2024-04-19T02:17:24.252 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5682999999999997e-05 2024-04-19T02:17:24.252 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.252 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.252 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:24.252 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.860046+0000", 2024-04-19T02:17:24.252 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013714200000000001 2024-04-19T02:17:24.252 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.252 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.252 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:24.252 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.860153+0000", 2024-04-19T02:17:24.252 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010725700000000001 2024-04-19T02:17:24.252 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.252 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.252 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:24.252 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.862008+0000", 2024-04-19T02:17:24.252 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001855179 2024-04-19T02:17:24.253 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.253 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.253 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:24.253 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.885629+0000", 2024-04-19T02:17:24.253 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.023621428 2024-04-19T02:17:24.253 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.253 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.253 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:24.253 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.885676+0000", 2024-04-19T02:17:24.253 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.6371e-05 2024-04-19T02:17:24.253 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.253 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.253 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:24.253 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.885714+0000", 2024-04-19T02:17:24.253 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7907000000000001e-05 2024-04-19T02:17:24.254 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:24.254 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:24.254 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:24.254 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.254 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.254 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157438 5.0 5:01944e77:::benchmark_data_smithi121_44835_object23403:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:24.254 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.864095+0000", 2024-04-19T02:17:24.254 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 17.322978077999998, 2024-04-19T02:17:24.254 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.032015298999999997, 2024-04-19T02:17:24.254 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:24.254 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:24.254 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:24.254 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:24.254 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:24.255 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157438 2024-04-19T02:17:24.255 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.255 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:24.255 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.255 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:24.255 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864095+0000", 2024-04-19T02:17:24.255 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:24.255 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.255 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.255 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:24.255 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864095+0000", 2024-04-19T02:17:24.255 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:24.255 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.255 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.255 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:24.255 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864094+0000", 2024-04-19T02:17:24.255 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:24.256 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.256 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.256 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:24.256 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864102+0000", 2024-04-19T02:17:24.256 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.6629999999999993e-06 2024-04-19T02:17:24.256 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.256 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.256 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:24.256 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864113+0000", 2024-04-19T02:17:24.256 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1185999999999999e-05 2024-04-19T02:17:24.256 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.256 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.256 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:24.256 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864119+0000", 2024-04-19T02:17:24.256 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.224e-06 2024-04-19T02:17:24.257 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.257 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.257 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:24.257 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864151+0000", 2024-04-19T02:17:24.257 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1395e-05 2024-04-19T02:17:24.257 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.257 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.257 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:24.257 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864275+0000", 2024-04-19T02:17:24.257 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012431399999999999 2024-04-19T02:17:24.257 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.257 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.257 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:24.257 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864341+0000", 2024-04-19T02:17:24.257 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6146e-05 2024-04-19T02:17:24.257 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.258 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.258 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:24.258 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.866040+0000", 2024-04-19T02:17:24.258 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016991879999999999 2024-04-19T02:17:24.258 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.258 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.258 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:24.258 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896055+0000", 2024-04-19T02:17:24.258 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.030014886000000001 2024-04-19T02:17:24.258 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.258 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.259 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:24.259 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896087+0000", 2024-04-19T02:17:24.259 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1761000000000003e-05 2024-04-19T02:17:24.259 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.259 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.259 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:24.259 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896111+0000", 2024-04-19T02:17:24.259 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3623999999999999e-05 2024-04-19T02:17:24.259 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:24.259 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:24.259 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:24.259 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.259 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.260 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157439 5.e 5:79eb9d3c:::benchmark_data_smithi121_44835_object23404:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:24.260 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:24.260 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 17.322947002999999, 2024-04-19T02:17:24.260 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.027045244, 2024-04-19T02:17:24.260 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:24.260 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:24.260 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:24.260 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:24.260 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:24.260 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157439 2024-04-19T02:17:24.260 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.260 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:24.260 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.261 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:24.261 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:24.261 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:24.261 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.261 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.261 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:24.261 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:24.261 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:24.261 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.261 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.261 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:24.261 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:24.261 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:24.261 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.261 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.262 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:24.262 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864128+0000", 2024-04-19T02:17:24.262 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.911e-06 2024-04-19T02:17:24.262 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.262 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.262 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:24.262 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864136+0000", 2024-04-19T02:17:24.262 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2609999999999993e-06 2024-04-19T02:17:24.262 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.262 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.262 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:24.262 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864140+0000", 2024-04-19T02:17:24.263 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5530000000000001e-06 2024-04-19T02:17:24.263 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.263 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.263 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:24.263 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864169+0000", 2024-04-19T02:17:24.263 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.8932e-05 2024-04-19T02:17:24.263 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.263 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.263 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:24.263 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864267+0000", 2024-04-19T02:17:24.263 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7969999999999999e-05 2024-04-19T02:17:24.263 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.263 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.263 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:24.263 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864339+0000", 2024-04-19T02:17:24.263 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.2280999999999995e-05 2024-04-19T02:17:24.264 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.264 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.264 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:24.264 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.865763+0000", 2024-04-19T02:17:24.264 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0014236310000000001 2024-04-19T02:17:24.264 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.264 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.264 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:24.264 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.891093+0000", 2024-04-19T02:17:24.264 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.025330571 2024-04-19T02:17:24.264 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.264 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.264 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:24.264 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.891137+0000", 2024-04-19T02:17:24.265 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3980999999999998e-05 2024-04-19T02:17:24.265 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.265 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.265 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:24.265 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.891172+0000", 2024-04-19T02:17:24.265 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4465000000000003e-05 2024-04-19T02:17:24.265 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:24.265 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:24.265 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:24.265 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.265 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.265 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157442 5.0 5:0062b73f:::benchmark_data_smithi121_44835_object23407:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:24.265 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.867065+0000", 2024-04-19T02:17:24.265 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 17.320008352999999, 2024-04-19T02:17:24.265 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.029165542999999999, 2024-04-19T02:17:24.265 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:24.266 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:24.266 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:24.266 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:24.266 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:24.266 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157442 2024-04-19T02:17:24.266 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.266 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:24.266 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.266 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:24.266 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867065+0000", 2024-04-19T02:17:24.266 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:24.266 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.266 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.266 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:24.267 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867065+0000", 2024-04-19T02:17:24.267 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:24.267 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.267 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.267 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:24.267 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867064+0000", 2024-04-19T02:17:24.267 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:24.267 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.267 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.267 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:24.267 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867069+0000", 2024-04-19T02:17:24.267 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4549999999999997e-06 2024-04-19T02:17:24.267 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.267 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.267 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:24.267 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867080+0000", 2024-04-19T02:17:24.268 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0797e-05 2024-04-19T02:17:24.268 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.268 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.268 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:24.268 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867088+0000", 2024-04-19T02:17:24.268 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9729999999999997e-06 2024-04-19T02:17:24.268 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.268 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.268 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:24.268 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867121+0000", 2024-04-19T02:17:24.268 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2920000000000003e-05 2024-04-19T02:17:24.268 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.269 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.269 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:24.269 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867203+0000", 2024-04-19T02:17:24.269 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2578999999999997e-05 2024-04-19T02:17:24.269 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.269 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.269 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:24.269 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867386+0000", 2024-04-19T02:17:24.269 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00018237400000000001 2024-04-19T02:17:24.269 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.269 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.269 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:24.269 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.869338+0000", 2024-04-19T02:17:24.270 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0019521160000000001 2024-04-19T02:17:24.270 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.270 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.270 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:24.270 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896150+0000", 2024-04-19T02:17:24.270 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.026812074000000002 2024-04-19T02:17:24.270 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.270 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.270 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:24.270 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896191+0000", 2024-04-19T02:17:24.270 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1192000000000001e-05 2024-04-19T02:17:24.270 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.270 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.270 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:24.271 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896231+0000", 2024-04-19T02:17:24.271 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9764000000000001e-05 2024-04-19T02:17:24.271 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:24.271 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:24.271 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:24.271 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.271 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.271 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157499 5.8 5:1c3aa38a:::benchmark_data_smithi121_44835_object23464:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:24.271 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.913447+0000", 2024-04-19T02:17:24.271 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 17.273626781000001, 2024-04-19T02:17:24.271 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.024508188, 2024-04-19T02:17:24.271 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:24.271 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:24.271 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:24.272 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:24.272 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:24.272 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157499 2024-04-19T02:17:24.272 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.272 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:24.272 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.272 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:24.272 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913447+0000", 2024-04-19T02:17:24.272 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:24.272 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.272 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.272 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:24.272 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913447+0000", 2024-04-19T02:17:24.272 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:24.272 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.273 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.273 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:24.273 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913446+0000", 2024-04-19T02:17:24.273 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:24.273 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.273 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.273 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:24.273 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913451+0000", 2024-04-19T02:17:24.273 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.677e-06 2024-04-19T02:17:24.273 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.273 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.273 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:24.273 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913461+0000", 2024-04-19T02:17:24.273 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.8859999999999999e-06 2024-04-19T02:17:24.273 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.274 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.274 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:24.274 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913467+0000", 2024-04-19T02:17:24.274 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.0800000000000002e-06 2024-04-19T02:17:24.274 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.274 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.274 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:24.274 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913513+0000", 2024-04-19T02:17:24.274 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.5707000000000001e-05 2024-04-19T02:17:24.274 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.274 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.274 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:24.274 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913637+0000", 2024-04-19T02:17:24.274 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012379200000000001 2024-04-19T02:17:24.275 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.275 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.275 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:24.275 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913747+0000", 2024-04-19T02:17:24.275 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000110071 2024-04-19T02:17:24.275 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.275 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.275 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:24.275 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915674+0000", 2024-04-19T02:17:24.275 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0019270789999999999 2024-04-19T02:17:24.275 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.275 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.275 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:24.275 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937902+0000", 2024-04-19T02:17:24.275 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022228286 2024-04-19T02:17:24.276 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.276 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.276 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:24.276 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937931+0000", 2024-04-19T02:17:24.276 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9122e-05 2024-04-19T02:17:24.276 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.276 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.276 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:24.276 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937955+0000", 2024-04-19T02:17:24.276 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3591000000000002e-05 2024-04-19T02:17:24.276 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:24.276 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:24.276 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:24.276 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.276 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.277 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157500 5.0 5:0969ec74:::benchmark_data_smithi121_44835_object23465:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:24.277 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.913476+0000", 2024-04-19T02:17:24.277 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 17.273597915, 2024-04-19T02:17:24.277 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.024497596, 2024-04-19T02:17:24.277 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:24.277 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:24.277 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:24.277 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:24.277 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:24.277 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157500 2024-04-19T02:17:24.277 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.277 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:24.277 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.277 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:24.277 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913476+0000", 2024-04-19T02:17:24.277 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:24.278 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.278 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.278 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:24.278 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913476+0000", 2024-04-19T02:17:24.278 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:24.278 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.278 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.278 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:24.278 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913475+0000", 2024-04-19T02:17:24.278 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:24.278 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.278 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.278 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:24.278 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913478+0000", 2024-04-19T02:17:24.279 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.2670000000000001e-06 2024-04-19T02:17:24.279 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.279 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.279 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:24.279 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913481+0000", 2024-04-19T02:17:24.279 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6899999999999998e-06 2024-04-19T02:17:24.279 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.279 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.279 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:24.279 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913485+0000", 2024-04-19T02:17:24.279 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1230000000000002e-06 2024-04-19T02:17:24.279 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.279 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.279 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:24.280 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913526+0000", 2024-04-19T02:17:24.280 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.104e-05 2024-04-19T02:17:24.280 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.280 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.280 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:24.280 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913606+0000", 2024-04-19T02:17:24.280 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9510000000000003e-05 2024-04-19T02:17:24.280 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.280 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.280 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:24.280 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913671+0000", 2024-04-19T02:17:24.280 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.4838000000000005e-05 2024-04-19T02:17:24.280 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.280 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.280 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:24.281 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915348+0000", 2024-04-19T02:17:24.281 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016769860000000001 2024-04-19T02:17:24.281 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.281 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.281 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:24.281 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937897+0000", 2024-04-19T02:17:24.281 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022548902999999999 2024-04-19T02:17:24.281 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.281 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.281 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:24.281 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937938+0000", 2024-04-19T02:17:24.281 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1499999999999999e-05 2024-04-19T02:17:24.281 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.282 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.282 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:24.282 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937973+0000", 2024-04-19T02:17:24.282 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5057e-05 2024-04-19T02:17:24.282 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:24.282 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:24.282 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:24.282 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.282 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.282 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157501 5.4 5:26661819:::benchmark_data_smithi121_44835_object23466:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:24.282 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.914839+0000", 2024-04-19T02:17:24.282 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 17.272234620999999, 2024-04-19T02:17:24.282 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.028504224000000002, 2024-04-19T02:17:24.283 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:24.283 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:24.283 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:24.283 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:24.283 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:24.283 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157501 2024-04-19T02:17:24.283 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.283 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:24.283 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.283 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:24.283 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914839+0000", 2024-04-19T02:17:24.283 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:24.283 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.284 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.284 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:24.284 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914839+0000", 2024-04-19T02:17:24.284 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:24.284 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.284 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.284 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:24.284 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914838+0000", 2024-04-19T02:17:24.284 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:24.284 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.284 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.284 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:24.284 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914841+0000", 2024-04-19T02:17:24.284 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.706e-06 2024-04-19T02:17:24.285 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.285 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.285 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:24.285 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914848+0000", 2024-04-19T02:17:24.285 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.7429999999999996e-06 2024-04-19T02:17:24.285 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.285 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.285 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:24.285 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914852+0000", 2024-04-19T02:17:24.285 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0810000000000004e-06 2024-04-19T02:17:24.285 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.285 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.285 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:24.285 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914892+0000", 2024-04-19T02:17:24.285 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9957999999999999e-05 2024-04-19T02:17:24.285 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.286 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.286 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:24.286 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915008+0000", 2024-04-19T02:17:24.286 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000116401 2024-04-19T02:17:24.286 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.286 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.286 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:24.286 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915125+0000", 2024-04-19T02:17:24.286 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011622500000000001 2024-04-19T02:17:24.286 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.286 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.286 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:24.286 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916663+0000", 2024-04-19T02:17:24.286 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0015381310000000001 2024-04-19T02:17:24.287 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.287 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.287 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:24.287 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943114+0000", 2024-04-19T02:17:24.287 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.026451125999999998 2024-04-19T02:17:24.287 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.287 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.287 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:24.287 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943245+0000", 2024-04-19T02:17:24.287 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000131645 2024-04-19T02:17:24.287 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.287 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.287 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:24.287 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943343+0000", 2024-04-19T02:17:24.287 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7604999999999998e-05 2024-04-19T02:17:24.287 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:24.288 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:24.288 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:24.288 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.288 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.288 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157507 5.b 5:de8840a2:::benchmark_data_smithi121_44835_object23472:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:24.288 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:24.288 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 17.270670339999999, 2024-04-19T02:17:24.288 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022544518999999999, 2024-04-19T02:17:24.288 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:24.288 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:24.288 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:24.288 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:24.288 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:24.288 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157507 2024-04-19T02:17:24.288 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.289 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:24.289 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.289 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:24.289 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:24.289 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:24.289 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.289 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.289 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:24.289 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:24.289 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:24.289 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.289 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.289 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:24.289 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:24.289 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:24.289 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.289 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.290 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:24.290 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916406+0000", 2024-04-19T02:17:24.290 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4589999999999998e-06 2024-04-19T02:17:24.290 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.290 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.290 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:24.290 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916415+0000", 2024-04-19T02:17:24.290 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3910000000000004e-06 2024-04-19T02:17:24.290 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.290 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.290 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:24.290 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916421+0000", 2024-04-19T02:17:24.290 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.6130000000000003e-06 2024-04-19T02:17:24.290 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.291 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.291 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:24.291 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916448+0000", 2024-04-19T02:17:24.291 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7277999999999999e-05 2024-04-19T02:17:24.291 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.291 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.291 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:24.291 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916539+0000", 2024-04-19T02:17:24.291 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0855999999999999e-05 2024-04-19T02:17:24.291 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.291 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.291 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:24.291 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916605+0000", 2024-04-19T02:17:24.291 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6141000000000003e-05 2024-04-19T02:17:24.291 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.291 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.292 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:24.292 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918276+0000", 2024-04-19T02:17:24.292 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001670726 2024-04-19T02:17:24.292 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.292 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.292 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:24.292 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.938888+0000", 2024-04-19T02:17:24.292 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020612042000000001 2024-04-19T02:17:24.292 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.292 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.292 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:24.292 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.938924+0000", 2024-04-19T02:17:24.292 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5692999999999999e-05 2024-04-19T02:17:24.292 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.292 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.293 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:24.293 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.938948+0000", 2024-04-19T02:17:24.293 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3879e-05 2024-04-19T02:17:24.293 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:24.293 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:24.293 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:24.293 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.293 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.293 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157509 5.8 5:1dca85d0:::benchmark_data_smithi121_44835_object23474:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:24.293 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:24.293 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 17.268242094000001, 2024-04-19T02:17:24.293 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.024511807, 2024-04-19T02:17:24.293 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:24.293 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:24.293 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:24.294 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:24.294 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:24.294 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157509 2024-04-19T02:17:24.294 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.294 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:24.294 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.294 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:24.294 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:24.294 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:24.294 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.294 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.294 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:24.294 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:24.294 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:24.294 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.294 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.295 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:24.295 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:24.295 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:24.295 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.295 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.295 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:24.295 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918834+0000", 2024-04-19T02:17:24.295 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9409999999999999e-06 2024-04-19T02:17:24.295 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.295 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.295 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:24.295 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918859+0000", 2024-04-19T02:17:24.295 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.5245999999999999e-05 2024-04-19T02:17:24.295 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.295 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.295 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:24.296 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918864+0000", 2024-04-19T02:17:24.296 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.1819999999999997e-06 2024-04-19T02:17:24.296 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.296 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.296 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:24.296 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918900+0000", 2024-04-19T02:17:24.296 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5327000000000002e-05 2024-04-19T02:17:24.296 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.296 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.296 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:24.296 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.919024+0000", 2024-04-19T02:17:24.296 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012400900000000001 2024-04-19T02:17:24.296 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.296 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.297 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:24.297 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.919136+0000", 2024-04-19T02:17:24.297 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000111987 2024-04-19T02:17:24.297 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.297 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.297 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:24.297 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.922096+0000", 2024-04-19T02:17:24.297 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0029607079999999998 2024-04-19T02:17:24.297 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.297 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.297 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:24.297 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943120+0000", 2024-04-19T02:17:24.297 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.021023995 2024-04-19T02:17:24.297 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.297 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.298 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:24.298 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943255+0000", 2024-04-19T02:17:24.298 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013502100000000001 2024-04-19T02:17:24.298 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:24.298 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:24.298 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:24.298 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943343+0000", 2024-04-19T02:17:24.298 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.7931999999999998e-05 2024-04-19T02:17:24.298 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:24.298 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:24.298 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:24.298 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:24.298 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:24.298 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:17:24.300 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:24.300+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:24.300 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:24.401 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:24.402+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:24.475 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:24.475 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:17:24.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.476 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:203262 5.c 5:348efa3d:::benchmark_data_smithi121_44835_object69227:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:17:24.476 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:24.471568+0000", 2024-04-19T02:17:24.476 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.001414921, 2024-04-19T02:17:24.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001435158, 2024-04-19T02:17:24.476 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:24.476 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:24.476 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:24.476 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:24.476 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:24.476 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 203262 2024-04-19T02:17:24.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.476 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:24.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:24.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471568+0000", 2024-04-19T02:17:24.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:24.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:24.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471568+0000", 2024-04-19T02:17:24.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:24.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:24.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471567+0000", 2024-04-19T02:17:24.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:24.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:24.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471570+0000", 2024-04-19T02:17:24.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1339999999999998e-06 2024-04-19T02:17:24.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:24.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471574+0000", 2024-04-19T02:17:24.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8690000000000003e-06 2024-04-19T02:17:24.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:24.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471577+0000", 2024-04-19T02:17:24.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7690000000000001e-06 2024-04-19T02:17:24.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:24.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471614+0000", 2024-04-19T02:17:24.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6770000000000002e-05 2024-04-19T02:17:24.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:24.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471725+0000", 2024-04-19T02:17:24.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000110982 2024-04-19T02:17:24.480 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:24.480 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:24.480 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:24.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.480 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:203264 5.d 5:b1b8d5e8:::benchmark_data_smithi121_44835_object69229:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:17:24.480 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:24.471588+0000", 2024-04-19T02:17:24.480 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0013944929999999999, 2024-04-19T02:17:24.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001461188, 2024-04-19T02:17:24.480 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:24.480 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:24.480 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:24.481 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:24.481 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:24.481 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 203264 2024-04-19T02:17:24.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.481 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:24.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:24.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471588+0000", 2024-04-19T02:17:24.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:24.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:24.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471588+0000", 2024-04-19T02:17:24.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:24.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:24.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471588+0000", 2024-04-19T02:17:24.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:24.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:24.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471590+0000", 2024-04-19T02:17:24.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6279999999999999e-06 2024-04-19T02:17:24.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:24.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471593+0000", 2024-04-19T02:17:24.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9339999999999999e-06 2024-04-19T02:17:24.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:24.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471599+0000", 2024-04-19T02:17:24.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3299999999999998e-06 2024-04-19T02:17:24.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:24.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471627+0000", 2024-04-19T02:17:24.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8186000000000001e-05 2024-04-19T02:17:24.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:24.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471717+0000", 2024-04-19T02:17:24.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9869000000000003e-05 2024-04-19T02:17:24.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.484 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:24.484 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471781+0000", 2024-04-19T02:17:24.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3740999999999998e-05 2024-04-19T02:17:24.484 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:24.484 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:24.484 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:24.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.484 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:203266 5.5 5:ad2a2d4e:::benchmark_data_smithi121_44835_object69231:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:17:24.484 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:24.471607+0000", 2024-04-19T02:17:24.484 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0013753870000000001, 2024-04-19T02:17:24.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0015028929999999999, 2024-04-19T02:17:24.485 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:24.485 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:24.485 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:24.485 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:24.485 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:24.485 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 203266 2024-04-19T02:17:24.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.485 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:24.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:24.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471607+0000", 2024-04-19T02:17:24.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:24.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:24.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471607+0000", 2024-04-19T02:17:24.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:24.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:24.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471607+0000", 2024-04-19T02:17:24.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:24.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:24.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471609+0000", 2024-04-19T02:17:24.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.526e-06 2024-04-19T02:17:24.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:24.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471615+0000", 2024-04-19T02:17:24.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0070000000000003e-06 2024-04-19T02:17:24.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:24.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471621+0000", 2024-04-19T02:17:24.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1880000000000001e-06 2024-04-19T02:17:24.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:24.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471858+0000", 2024-04-19T02:17:24.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000237538 2024-04-19T02:17:24.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:24.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471968+0000", 2024-04-19T02:17:24.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109428 2024-04-19T02:17:24.488 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:24.488 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:24.488 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:24.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.488 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4549.0:203248 5.f e57/16)", 2024-04-19T02:17:24.488 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:24.471631+0000", 2024-04-19T02:17:24.488 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0013520310000000001, 2024-04-19T02:17:24.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0015452160000000001, 2024-04-19T02:17:24.489 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:24.489 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-04-19T02:17:24.489 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:24.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:24.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471631+0000", 2024-04-19T02:17:24.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:24.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:24.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471631+0000", 2024-04-19T02:17:24.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:24.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:24.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471630+0000", 2024-04-19T02:17:24.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:24.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:24.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471633+0000", 2024-04-19T02:17:24.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4990000000000001e-06 2024-04-19T02:17:24.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:24.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471638+0000", 2024-04-19T02:17:24.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3770000000000004e-06 2024-04-19T02:17:24.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:24.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471643+0000", 2024-04-19T02:17:24.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8760000000000004e-06 2024-04-19T02:17:24.491 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:24.491 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:24.491 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:24.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.491 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:203248 5.f 5:fef37f22:::benchmark_data_smithi121_44835_object69213:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:17:24.491 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:24.465329+0000", 2024-04-19T02:17:24.491 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0076534910000000001, 2024-04-19T02:17:24.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079049559999999994, 2024-04-19T02:17:24.492 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:24.492 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:24.492 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:24.492 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:24.492 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:24.492 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 203248 2024-04-19T02:17:24.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.492 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:24.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:24.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.465329+0000", 2024-04-19T02:17:24.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:24.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:24.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.465329+0000", 2024-04-19T02:17:24.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:24.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:24.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.465328+0000", 2024-04-19T02:17:24.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:24.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:24.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.465333+0000", 2024-04-19T02:17:24.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1470000000000003e-06 2024-04-19T02:17:24.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:24.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.465338+0000", 2024-04-19T02:17:24.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8980000000000001e-06 2024-04-19T02:17:24.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:24.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.465343+0000", 2024-04-19T02:17:24.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0829999999999997e-06 2024-04-19T02:17:24.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:24.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.465364+0000", 2024-04-19T02:17:24.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1539000000000002e-05 2024-04-19T02:17:24.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:24.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.465437+0000", 2024-04-19T02:17:24.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2520000000000004e-05 2024-04-19T02:17:24.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:24.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.465499+0000", 2024-04-19T02:17:24.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2719999999999996e-05 2024-04-19T02:17:24.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:24.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.467984+0000", 2024-04-19T02:17:24.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0024846009999999999 2024-04-19T02:17:24.496 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:24.496 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:24.496 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:24.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.496 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:203256 5.f 5:fa944de7:::benchmark_data_smithi121_44835_object69221:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:17:24.496 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:24.469586+0000", 2024-04-19T02:17:24.497 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0033962139999999998, 2024-04-19T02:17:24.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037389440000000001, 2024-04-19T02:17:24.497 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:24.497 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:24.497 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:24.497 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:24.497 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:24.497 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 203256 2024-04-19T02:17:24.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.497 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:24.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:24.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.469586+0000", 2024-04-19T02:17:24.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:24.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:24.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.469586+0000", 2024-04-19T02:17:24.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:24.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:24.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.469586+0000", 2024-04-19T02:17:24.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:24.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:24.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.469589+0000", 2024-04-19T02:17:24.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.117e-06 2024-04-19T02:17:24.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:24.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.469596+0000", 2024-04-19T02:17:24.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8199999999999999e-06 2024-04-19T02:17:24.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:24.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.469601+0000", 2024-04-19T02:17:24.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3519999999999997e-06 2024-04-19T02:17:24.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.500 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:24.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.469626+0000", 2024-04-19T02:17:24.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5304999999999999e-05 2024-04-19T02:17:24.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.500 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:24.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.469699+0000", 2024-04-19T02:17:24.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2523999999999999e-05 2024-04-19T02:17:24.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.500 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:24.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.469761+0000", 2024-04-19T02:17:24.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1892999999999998e-05 2024-04-19T02:17:24.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:24.501 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471032+0000", 2024-04-19T02:17:24.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001271194 2024-04-19T02:17:24.501 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:24.501 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:24.501 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:24.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.501 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:203259 5.2 5:48df5e02:::benchmark_data_smithi121_44835_object69224:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:17:24.501 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:24.471154+0000", 2024-04-19T02:17:24.501 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.001828243, 2024-04-19T02:17:24.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022564970000000001, 2024-04-19T02:17:24.502 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:24.502 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:24.502 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:24.502 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:24.502 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:24.502 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 203259 2024-04-19T02:17:24.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.502 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:24.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:24.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471154+0000", 2024-04-19T02:17:24.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:24.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:24.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471154+0000", 2024-04-19T02:17:24.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:24.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:24.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471154+0000", 2024-04-19T02:17:24.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:24.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:24.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471158+0000", 2024-04-19T02:17:24.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0690000000000003e-06 2024-04-19T02:17:24.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:24.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471166+0000", 2024-04-19T02:17:24.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9910000000000002e-06 2024-04-19T02:17:24.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:24.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471171+0000", 2024-04-19T02:17:24.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1320000000000002e-06 2024-04-19T02:17:24.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.505 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:24.505 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471203+0000", 2024-04-19T02:17:24.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2227999999999997e-05 2024-04-19T02:17:24.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.505 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:24.505 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471277+0000", 2024-04-19T02:17:24.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4165999999999994e-05 2024-04-19T02:17:24.505 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:24.505 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:24.505 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:24.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.505 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:203260 5.3 5:c4090e0a:::benchmark_data_smithi121_44835_object69225:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:17:24.505 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:24.471181+0000", 2024-04-19T02:17:24.506 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00180141, 2024-04-19T02:17:24.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022988420000000002, 2024-04-19T02:17:24.506 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:24.506 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:24.506 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:24.506 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:24.506 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:24.506 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 203260 2024-04-19T02:17:24.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.506 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:24.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:24.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471181+0000", 2024-04-19T02:17:24.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:24.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:24.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471181+0000", 2024-04-19T02:17:24.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:24.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:24.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471181+0000", 2024-04-19T02:17:24.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:24.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:24.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471183+0000", 2024-04-19T02:17:24.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1399999999999998e-06 2024-04-19T02:17:24.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:24.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471187+0000", 2024-04-19T02:17:24.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8240000000000001e-06 2024-04-19T02:17:24.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.509 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:24.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471191+0000", 2024-04-19T02:17:24.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9700000000000001e-06 2024-04-19T02:17:24.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.509 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:24.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471226+0000", 2024-04-19T02:17:24.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5074000000000003e-05 2024-04-19T02:17:24.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.509 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:24.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471319+0000", 2024-04-19T02:17:24.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3487999999999997e-05 2024-04-19T02:17:24.509 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:24.510 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:24.510 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:24.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.510 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.510 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:203261 5.f 5:fd00b78a:::benchmark_data_smithi121_44835_object69226:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:17:24.510 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:24.471548+0000", 2024-04-19T02:17:24.510 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0014341919999999999, 2024-04-19T02:17:24.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019987529999999998, 2024-04-19T02:17:24.510 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:24.510 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:24.510 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:24.510 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:24.511 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:24.511 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 203261 2024-04-19T02:17:24.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.511 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:24.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:24.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471548+0000", 2024-04-19T02:17:24.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:24.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:24.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471548+0000", 2024-04-19T02:17:24.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:24.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:24.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471548+0000", 2024-04-19T02:17:24.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:24.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:24.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471551+0000", 2024-04-19T02:17:24.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1259999999999998e-06 2024-04-19T02:17:24.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:24.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471558+0000", 2024-04-19T02:17:24.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6730000000000003e-06 2024-04-19T02:17:24.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:24.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471562+0000", 2024-04-19T02:17:24.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.296e-06 2024-04-19T02:17:24.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:24.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471603+0000", 2024-04-19T02:17:24.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1316000000000002e-05 2024-04-19T02:17:24.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:24.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471721+0000", 2024-04-19T02:17:24.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117719 2024-04-19T02:17:24.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:24.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:24.471826+0000", 2024-04-19T02:17:24.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104541 2024-04-19T02:17:24.514 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:24.515 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:24.515 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:24.515 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:24.515 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-04-19T02:17:24.515 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 9 2024-04-19T02:17:24.515 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:24.518 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:24.518 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:24.517+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:24.617 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:24.618+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:24.719 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:24.719+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:24.735 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:24.735 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-04-19T02:17:24.735 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-04-19T02:17:24.735 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-04-19T02:17:24.735 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:24.749 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:24.820 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:24.820+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:24.921 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:24.922+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:24.930 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:24.930 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-04-19T02:17:24.930 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-04-19T02:17:24.930 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:17:24.930 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.930 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:24.930 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:17:24.930 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 115.658492866, 2024-04-19T02:17:24.930 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022007204999999998, 2024-04-19T02:17:24.930 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:24.931 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:24.931 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:24.931 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.931 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:24.931 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:17:24.931 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:24.931 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.931 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.931 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:24.931 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:17:24.931 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:24.931 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.931 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.931 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:24.931 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269990+0000", 2024-04-19T02:17:24.931 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:24.932 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.932 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.932 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:24.932 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269999+0000", 2024-04-19T02:17:24.932 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9539999999999993e-06 2024-04-19T02:17:24.932 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.932 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.932 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:24.932 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270006+0000", 2024-04-19T02:17:24.932 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.216e-06 2024-04-19T02:17:24.932 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.932 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.932 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:24.932 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270012+0000", 2024-04-19T02:17:24.932 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5049999999999998e-06 2024-04-19T02:17:24.932 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.933 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.933 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:24.933 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270058+0000", 2024-04-19T02:17:24.933 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.634e-05 2024-04-19T02:17:24.933 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.933 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.933 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:24.933 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270064+0000", 2024-04-19T02:17:24.933 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0669999999999997e-06 2024-04-19T02:17:24.933 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.934 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.934 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:24.934 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287159+0000", 2024-04-19T02:17:24.934 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017095086999999998 2024-04-19T02:17:24.934 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.934 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.934 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:24.934 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287254+0000", 2024-04-19T02:17:24.934 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4716000000000006e-05 2024-04-19T02:17:24.934 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.934 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.934 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:24.934 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287389+0000", 2024-04-19T02:17:24.934 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013511900000000001 2024-04-19T02:17:24.934 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.935 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.935 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:24.935 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290481+0000", 2024-04-19T02:17:24.935 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030920169999999999 2024-04-19T02:17:24.935 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.935 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.935 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:24.935 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291931+0000", 2024-04-19T02:17:24.935 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001450118 2024-04-19T02:17:24.935 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.935 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.935 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:24.935 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291960+0000", 2024-04-19T02:17:24.935 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9096000000000001e-05 2024-04-19T02:17:24.936 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.936 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.936 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:24.936 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291998+0000", 2024-04-19T02:17:24.936 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7514e-05 2024-04-19T02:17:24.936 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:24.936 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:24.936 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:24.936 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.936 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.936 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:24.936 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:17:24.936 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 115.65838209, 2024-04-19T02:17:24.936 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020837887999999999, 2024-04-19T02:17:24.936 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:24.937 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:24.937 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:24.937 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.937 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:24.937 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:17:24.937 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:24.937 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.937 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.937 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:24.937 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:17:24.937 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:24.937 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.937 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.937 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:24.938 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:17:24.938 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:24.938 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.938 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.938 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:24.938 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270109+0000", 2024-04-19T02:17:24.938 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3110000000000006e-06 2024-04-19T02:17:24.938 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.938 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.938 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:24.938 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270117+0000", 2024-04-19T02:17:24.938 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0479999999999999e-06 2024-04-19T02:17:24.938 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.938 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.938 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:24.939 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270123+0000", 2024-04-19T02:17:24.939 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5500000000000002e-06 2024-04-19T02:17:24.939 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.939 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.939 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:24.939 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270150+0000", 2024-04-19T02:17:24.939 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7712000000000002e-05 2024-04-19T02:17:24.939 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.939 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.939 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:24.939 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270153+0000", 2024-04-19T02:17:24.939 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6089999999999999e-06 2024-04-19T02:17:24.939 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.939 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.939 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:24.940 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285958+0000", 2024-04-19T02:17:24.940 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015805274000000001 2024-04-19T02:17:24.940 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.940 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.940 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:24.940 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286126+0000", 2024-04-19T02:17:24.940 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016765700000000001 2024-04-19T02:17:24.940 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.940 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.940 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:24.940 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286296+0000", 2024-04-19T02:17:24.940 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017007 2024-04-19T02:17:24.940 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.940 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.940 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:24.940 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290426+0000", 2024-04-19T02:17:24.941 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041299839999999997 2024-04-19T02:17:24.941 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.941 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.941 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:24.941 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290867+0000", 2024-04-19T02:17:24.941 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00044083300000000001 2024-04-19T02:17:24.941 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.941 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.941 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:24.941 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290900+0000", 2024-04-19T02:17:24.941 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3380000000000002e-05 2024-04-19T02:17:24.941 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.941 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.941 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:24.941 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290939+0000", 2024-04-19T02:17:24.941 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8970000000000001e-05 2024-04-19T02:17:24.941 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:24.942 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:24.942 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:24.942 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.942 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.942 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:21 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:24.942 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:17:24.942 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 115.658293418, 2024-04-19T02:17:24.942 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020833187999999999, 2024-04-19T02:17:24.942 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:24.942 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:24.942 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:24.942 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.942 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:24.942 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:17:24.943 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:24.943 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.943 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.943 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:24.943 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:17:24.943 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:24.943 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.943 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.943 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:24.943 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270189+0000", 2024-04-19T02:17:24.943 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:24.943 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.943 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.943 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:24.944 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270192+0000", 2024-04-19T02:17:24.944 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7549999999999999e-06 2024-04-19T02:17:24.944 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.944 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.944 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:24.944 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270198+0000", 2024-04-19T02:17:24.944 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0859999999999998e-06 2024-04-19T02:17:24.944 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.944 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.944 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:24.944 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270204+0000", 2024-04-19T02:17:24.944 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1970000000000004e-06 2024-04-19T02:17:24.944 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.944 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.944 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:24.944 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270238+0000", 2024-04-19T02:17:24.945 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4282000000000001e-05 2024-04-19T02:17:24.945 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.945 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.945 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:24.945 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270240+0000", 2024-04-19T02:17:24.945 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3099999999999999e-06 2024-04-19T02:17:24.945 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.945 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.945 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:24.945 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287131+0000", 2024-04-19T02:17:24.945 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01689104 2024-04-19T02:17:24.945 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.945 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.945 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:24.945 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287262+0000", 2024-04-19T02:17:24.946 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130347 2024-04-19T02:17:24.946 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.946 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.946 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:24.946 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291023+0000", 2024-04-19T02:17:24.946 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037616350000000002 2024-04-19T02:17:24.946 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:24.946 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:24.946 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:24.946 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.946 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.946 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:94468 5.2 5:4f406431:::benchmark_data_smithi121_44835_object94467:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T02:17:24.946 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:17:24.946 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 49.817054235999997, 2024-04-19T02:17:24.946 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024835144999999999, 2024-04-19T02:17:24.947 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:24.947 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:24.947 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:24.947 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:24.947 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:24.947 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 94468 2024-04-19T02:17:24.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.947 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:24.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.947 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:24.947 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:17:24.947 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:24.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.947 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:24.948 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:17:24.948 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:24.948 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.948 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.948 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:24.948 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:17:24.948 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:24.948 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.948 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.948 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:24.948 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111498+0000", 2024-04-19T02:17:24.948 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9529000000000005e-05 2024-04-19T02:17:24.948 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.948 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.949 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:24.949 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111506+0000", 2024-04-19T02:17:24.949 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9030000000000004e-06 2024-04-19T02:17:24.949 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.949 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.949 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:24.949 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111513+0000", 2024-04-19T02:17:24.949 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8759999999999999e-06 2024-04-19T02:17:24.949 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.949 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.949 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:24.949 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112466+0000", 2024-04-19T02:17:24.949 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00095318499999999995 2024-04-19T02:17:24.949 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.949 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.950 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:24.950 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112590+0000", 2024-04-19T02:17:24.950 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012380900000000001 2024-04-19T02:17:24.950 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.950 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.950 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:24.950 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112728+0000", 2024-04-19T02:17:24.950 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013753800000000001 2024-04-19T02:17:24.950 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.950 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.950 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:24.950 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115064+0000", 2024-04-19T02:17:24.950 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002336819 2024-04-19T02:17:24.950 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.950 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.951 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:24.951 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136207+0000", 2024-04-19T02:17:24.951 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021142942000000001 2024-04-19T02:17:24.951 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.951 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.951 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:24.951 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136241+0000", 2024-04-19T02:17:24.951 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3577000000000001e-05 2024-04-19T02:17:24.951 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.951 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.951 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:24.951 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136264+0000", 2024-04-19T02:17:24.951 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3421000000000002e-05 2024-04-19T02:17:24.951 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:24.951 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:24.952 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:24.952 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.952 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.952 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:94472 5.2 5:45b7e9be:::benchmark_data_smithi121_44835_object94471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:24.952 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:17:24.952 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 49.813407705000003, 2024-04-19T02:17:24.952 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021273843000000001, 2024-04-19T02:17:24.952 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:24.952 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:24.952 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:24.952 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:24.952 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:24.952 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 94472 2024-04-19T02:17:24.952 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.953 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:24.953 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.953 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:24.953 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:17:24.953 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:24.953 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.953 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.953 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:24.953 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:17:24.953 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:24.953 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.953 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.953 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:24.953 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115075+0000", 2024-04-19T02:17:24.953 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:24.953 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.954 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.954 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:24.954 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115161+0000", 2024-04-19T02:17:24.954 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6632000000000007e-05 2024-04-19T02:17:24.954 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.954 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.954 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:24.954 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115171+0000", 2024-04-19T02:17:24.954 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2969999999999992e-06 2024-04-19T02:17:24.954 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.954 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.954 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:24.954 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115178+0000", 2024-04-19T02:17:24.954 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7610000000000007e-06 2024-04-19T02:17:24.954 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.955 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.955 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:24.955 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115213+0000", 2024-04-19T02:17:24.955 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5000999999999999e-05 2024-04-19T02:17:24.955 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.955 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.955 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:24.955 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115303+0000", 2024-04-19T02:17:24.955 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9791999999999997e-05 2024-04-19T02:17:24.955 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.955 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.955 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:24.955 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115391+0000", 2024-04-19T02:17:24.955 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7559000000000007e-05 2024-04-19T02:17:24.956 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.956 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.956 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:24.956 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.117894+0000", 2024-04-19T02:17:24.956 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002503496 2024-04-19T02:17:24.956 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.956 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.956 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:24.956 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136297+0000", 2024-04-19T02:17:24.956 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018402335999999998 2024-04-19T02:17:24.956 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.956 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.956 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:24.956 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136327+0000", 2024-04-19T02:17:24.956 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0534999999999998e-05 2024-04-19T02:17:24.957 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.957 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.957 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:24.957 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136350+0000", 2024-04-19T02:17:24.957 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2427999999999999e-05 2024-04-19T02:17:24.957 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:24.957 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:24.957 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:24.957 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.957 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.957 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:129219 5.2 5:45e7e1f4:::benchmark_data_smithi121_44835_object129218:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T02:17:24.957 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:52.629592+0000", 2024-04-19T02:17:24.957 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.298891451999999, 2024-04-19T02:17:24.957 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021099489999999999, 2024-04-19T02:17:24.957 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:24.958 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:24.958 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:24.958 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:24.958 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:24.958 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129219 2024-04-19T02:17:24.958 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.958 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:24.958 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.958 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:24.958 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629592+0000", 2024-04-19T02:17:24.958 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:24.958 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.958 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.958 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:24.958 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629592+0000", 2024-04-19T02:17:24.959 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:24.959 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.959 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.959 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:24.959 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629591+0000", 2024-04-19T02:17:24.959 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:24.959 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.959 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.959 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:24.959 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629618+0000", 2024-04-19T02:17:24.959 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6970000000000001e-05 2024-04-19T02:17:24.959 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.959 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.959 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:24.959 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629639+0000", 2024-04-19T02:17:24.959 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0701999999999999e-05 2024-04-19T02:17:24.960 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.960 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.960 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:24.960 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629645+0000", 2024-04-19T02:17:24.960 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2299999999999996e-06 2024-04-19T02:17:24.960 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.960 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.960 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:24.960 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.635658+0000", 2024-04-19T02:17:24.960 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0060127549999999998 2024-04-19T02:17:24.960 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.960 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.960 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:24.960 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.635811+0000", 2024-04-19T02:17:24.960 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015305700000000001 2024-04-19T02:17:24.960 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.961 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.961 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:24.961 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.635967+0000", 2024-04-19T02:17:24.961 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015578599999999999 2024-04-19T02:17:24.961 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.961 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.961 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:24.961 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.642488+0000", 2024-04-19T02:17:24.961 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0065215619999999998 2024-04-19T02:17:24.961 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.961 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.961 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:24.961 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650603+0000", 2024-04-19T02:17:24.961 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0081144900000000002 2024-04-19T02:17:24.961 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.962 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.962 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:24.962 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650652+0000", 2024-04-19T02:17:24.962 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9079999999999998e-05 2024-04-19T02:17:24.962 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.962 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.962 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:24.962 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650691+0000", 2024-04-19T02:17:24.962 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9501e-05 2024-04-19T02:17:24.962 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:24.962 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:24.962 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:24.962 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.962 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.963 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:157448 5.7 5:ed833a19:::benchmark_data_smithi121_44835_object23413:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:24.963 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:06.870566+0000", 2024-04-19T02:17:24.963 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.057916871, 2024-04-19T02:17:24.963 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023031238999999998, 2024-04-19T02:17:24.963 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:24.963 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:24.963 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:24.963 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:24.963 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:24.963 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 157448 2024-04-19T02:17:24.963 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.963 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:24.963 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.963 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:24.963 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870566+0000", 2024-04-19T02:17:24.963 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:24.964 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.964 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.964 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:24.964 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870566+0000", 2024-04-19T02:17:24.964 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:24.964 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.964 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.964 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:24.964 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870566+0000", 2024-04-19T02:17:24.964 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:24.964 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.964 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.964 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:24.964 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870570+0000", 2024-04-19T02:17:24.964 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1620000000000001e-06 2024-04-19T02:17:24.965 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.965 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.965 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:24.965 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870577+0000", 2024-04-19T02:17:24.965 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2069999999999998e-06 2024-04-19T02:17:24.965 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.965 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.965 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:24.965 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870587+0000", 2024-04-19T02:17:24.965 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6919999999999997e-06 2024-04-19T02:17:24.965 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.965 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.965 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:24.965 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870615+0000", 2024-04-19T02:17:24.965 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8351999999999999e-05 2024-04-19T02:17:24.965 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.966 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.966 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:24.966 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870715+0000", 2024-04-19T02:17:24.966 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9624999999999996e-05 2024-04-19T02:17:24.966 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.966 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.966 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:24.966 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870805+0000", 2024-04-19T02:17:24.966 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0067000000000004e-05 2024-04-19T02:17:24.966 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.966 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.966 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:24.966 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.872773+0000", 2024-04-19T02:17:24.966 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001968605 2024-04-19T02:17:24.966 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.967 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.967 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:24.967 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.893514+0000", 2024-04-19T02:17:24.967 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020740082999999999 2024-04-19T02:17:24.967 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.967 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.967 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:24.967 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.893558+0000", 2024-04-19T02:17:24.967 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4110999999999998e-05 2024-04-19T02:17:24.967 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.967 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.967 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:24.967 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.893598+0000", 2024-04-19T02:17:24.967 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0077000000000003e-05 2024-04-19T02:17:24.967 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:24.968 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:24.968 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:24.968 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.968 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.968 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:157498 5.7 5:eb39b43d:::benchmark_data_smithi121_44835_object23463:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:24.968 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:06.911721+0000", 2024-04-19T02:17:24.968 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.016762226000001, 2024-04-19T02:17:24.968 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023313438999999998, 2024-04-19T02:17:24.968 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:24.968 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:24.968 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:24.968 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:24.968 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:24.968 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 157498 2024-04-19T02:17:24.968 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.969 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:24.969 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.969 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:24.969 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911721+0000", 2024-04-19T02:17:24.969 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:24.969 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.969 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.969 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:24.969 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911721+0000", 2024-04-19T02:17:24.969 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:24.969 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.969 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.969 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:24.969 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911720+0000", 2024-04-19T02:17:24.969 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:24.969 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.970 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.970 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:24.970 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911726+0000", 2024-04-19T02:17:24.970 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3179999999999997e-06 2024-04-19T02:17:24.970 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.970 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.970 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:24.970 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911746+0000", 2024-04-19T02:17:24.970 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0574e-05 2024-04-19T02:17:24.970 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.970 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.970 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:24.970 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911757+0000", 2024-04-19T02:17:24.970 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0959e-05 2024-04-19T02:17:24.970 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.971 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.971 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:24.971 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911795+0000", 2024-04-19T02:17:24.971 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7589999999999998e-05 2024-04-19T02:17:24.971 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.971 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.971 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:24.971 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911912+0000", 2024-04-19T02:17:24.971 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117625 2024-04-19T02:17:24.971 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.971 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.971 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:24.971 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.912250+0000", 2024-04-19T02:17:24.971 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00033710599999999999 2024-04-19T02:17:24.971 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.972 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.972 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:24.972 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.915540+0000", 2024-04-19T02:17:24.972 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032909559999999998 2024-04-19T02:17:24.972 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.972 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.972 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:24.972 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.934984+0000", 2024-04-19T02:17:24.972 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019443670999999999 2024-04-19T02:17:24.972 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.972 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.972 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:24.972 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.935013+0000", 2024-04-19T02:17:24.972 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8464999999999999e-05 2024-04-19T02:17:24.972 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.973 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.973 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:24.973 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.935035+0000", 2024-04-19T02:17:24.973 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1954e-05 2024-04-19T02:17:24.973 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:24.973 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:24.973 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:24.973 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.973 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.973 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168377 5.d 5:b1f3fb6d:::benchmark_data_smithi121_44835_object34342:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:24.973 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069470+0000", 2024-04-19T02:17:24.973 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 12.859013493999999, 2024-04-19T02:17:24.973 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050516473999999999, 2024-04-19T02:17:24.973 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:24.973 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:24.973 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:24.974 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:24.974 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:24.974 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168377 2024-04-19T02:17:24.974 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.974 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:24.974 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.974 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:24.974 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069470+0000", 2024-04-19T02:17:24.974 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:24.974 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.974 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.974 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:24.974 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069470+0000", 2024-04-19T02:17:24.974 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:24.975 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.975 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.975 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:24.975 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069469+0000", 2024-04-19T02:17:24.975 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:24.975 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.975 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.975 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:24.975 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069473+0000", 2024-04-19T02:17:24.975 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4580000000000002e-06 2024-04-19T02:17:24.975 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.975 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.975 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:24.975 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069482+0000", 2024-04-19T02:17:24.975 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2839999999999995e-06 2024-04-19T02:17:24.976 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.976 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.976 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:24.976 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069489+0000", 2024-04-19T02:17:24.976 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3579999999999997e-06 2024-04-19T02:17:24.976 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.976 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.976 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:24.976 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069559+0000", 2024-04-19T02:17:24.976 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9678000000000006e-05 2024-04-19T02:17:24.976 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.976 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.976 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:24.976 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069683+0000", 2024-04-19T02:17:24.976 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012359400000000001 2024-04-19T02:17:24.976 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.976 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.977 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:24.977 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069759+0000", 2024-04-19T02:17:24.977 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6834000000000003e-05 2024-04-19T02:17:24.977 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.977 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.977 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:24.977 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119871+0000", 2024-04-19T02:17:24.977 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050111392999999997 2024-04-19T02:17:24.977 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.977 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.977 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:24.977 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119932+0000", 2024-04-19T02:17:24.977 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1209000000000003e-05 2024-04-19T02:17:24.977 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.977 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.978 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:24.978 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119962+0000", 2024-04-19T02:17:24.978 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9717999999999999e-05 2024-04-19T02:17:24.978 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.978 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.978 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:24.978 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119986+0000", 2024-04-19T02:17:24.978 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4549000000000002e-05 2024-04-19T02:17:24.978 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:24.978 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:24.979 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:24.979 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.979 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.979 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168379 5.d 5:bcd492dd:::benchmark_data_smithi121_44835_object34344:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:24.979 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069502+0000", 2024-04-19T02:17:24.979 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 12.858981440999999, 2024-04-19T02:17:24.979 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050544645999999999, 2024-04-19T02:17:24.979 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:24.979 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:24.979 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:24.979 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:24.979 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:24.979 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168379 2024-04-19T02:17:24.979 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.979 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:24.979 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.980 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:24.980 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069502+0000", 2024-04-19T02:17:24.980 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:24.980 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.980 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.980 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:24.980 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069502+0000", 2024-04-19T02:17:24.980 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:24.980 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.980 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.980 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:24.980 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069501+0000", 2024-04-19T02:17:24.980 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:24.980 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.980 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.980 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:24.981 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069504+0000", 2024-04-19T02:17:24.981 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9289999999999998e-06 2024-04-19T02:17:24.981 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.981 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.981 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:24.981 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069511+0000", 2024-04-19T02:17:24.981 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1909999999999997e-06 2024-04-19T02:17:24.981 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.981 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.981 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:24.981 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069517+0000", 2024-04-19T02:17:24.981 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0789999999999997e-06 2024-04-19T02:17:24.981 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.981 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.981 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:24.982 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071081+0000", 2024-04-19T02:17:24.982 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0015646550000000001 2024-04-19T02:17:24.982 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.982 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.982 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:24.982 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071195+0000", 2024-04-19T02:17:24.982 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011399400000000001 2024-04-19T02:17:24.982 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.982 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.982 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:24.982 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071293+0000", 2024-04-19T02:17:24.982 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7938999999999999e-05 2024-04-19T02:17:24.982 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.982 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.982 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:24.983 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119898+0000", 2024-04-19T02:17:24.983 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.048604808999999999 2024-04-19T02:17:24.983 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.983 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.983 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:24.983 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119993+0000", 2024-04-19T02:17:24.983 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5224999999999997e-05 2024-04-19T02:17:24.983 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.983 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.983 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:24.983 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120024+0000", 2024-04-19T02:17:24.983 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0580999999999997e-05 2024-04-19T02:17:24.983 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.983 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.983 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:24.983 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120047+0000", 2024-04-19T02:17:24.984 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2725e-05 2024-04-19T02:17:24.984 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:24.984 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:24.984 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:24.984 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.984 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.984 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168381 5.d 5:bcbab0e3:::benchmark_data_smithi121_44835_object34346:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:24.984 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:24.984 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 12.858962023, 2024-04-19T02:17:24.984 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050574694000000003, 2024-04-19T02:17:24.984 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:24.984 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:24.984 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:24.984 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:24.984 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:24.984 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168381 2024-04-19T02:17:24.985 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.985 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:24.985 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.985 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:24.985 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:24.985 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:24.985 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.985 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.985 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:24.985 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:24.985 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:24.985 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.985 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.985 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:24.985 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:24.986 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:24.986 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.986 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.986 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:24.986 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069523+0000", 2024-04-19T02:17:24.986 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.244e-06 2024-04-19T02:17:24.986 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.986 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.986 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:24.986 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069528+0000", 2024-04-19T02:17:24.986 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0669999999999999e-06 2024-04-19T02:17:24.986 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.986 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.987 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:24.987 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069533+0000", 2024-04-19T02:17:24.987 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4680000000000003e-06 2024-04-19T02:17:24.987 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.987 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:24.987 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072637+0000", 2024-04-19T02:17:24.987 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031040429999999999 2024-04-19T02:17:24.987 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.987 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:24.987 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072710+0000", 2024-04-19T02:17:24.987 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3045000000000003e-05 2024-04-19T02:17:24.987 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.987 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:24.988 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072775+0000", 2024-04-19T02:17:24.988 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5034000000000001e-05 2024-04-19T02:17:24.988 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.988 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:24.988 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119925+0000", 2024-04-19T02:17:24.988 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.047150594999999997 2024-04-19T02:17:24.988 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.988 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:24.988 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120055+0000", 2024-04-19T02:17:24.988 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129288 2024-04-19T02:17:24.988 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.988 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:24.989 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120077+0000", 2024-04-19T02:17:24.989 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1759e-05 2024-04-19T02:17:24.989 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.989 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.989 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:24.989 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120096+0000", 2024-04-19T02:17:24.989 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9524000000000001e-05 2024-04-19T02:17:24.989 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:24.989 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:24.989 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:24.989 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.989 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.989 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168382 5.f 5:f2599a15:::benchmark_data_smithi121_44835_object34347:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:24.989 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069556+0000", 2024-04-19T02:17:24.989 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 12.858927616000001, 2024-04-19T02:17:24.990 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050009713999999997, 2024-04-19T02:17:24.990 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:24.990 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:24.990 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:24.990 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:24.990 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:24.990 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168382 2024-04-19T02:17:24.990 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.990 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:24.990 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.990 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:24.990 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069556+0000", 2024-04-19T02:17:24.990 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:24.990 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.990 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.991 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:24.991 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069556+0000", 2024-04-19T02:17:24.991 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:24.991 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.991 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.991 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:24.991 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069555+0000", 2024-04-19T02:17:24.991 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:24.991 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.991 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.991 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:24.991 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069558+0000", 2024-04-19T02:17:24.991 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7879999999999998e-06 2024-04-19T02:17:24.991 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.991 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.992 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:24.992 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069566+0000", 2024-04-19T02:17:24.992 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6149999999999999e-06 2024-04-19T02:17:24.992 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.992 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.992 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:24.992 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069571+0000", 2024-04-19T02:17:24.992 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5509999999999999e-06 2024-04-19T02:17:24.992 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.992 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.992 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:24.992 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069618+0000", 2024-04-19T02:17:24.992 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6964e-05 2024-04-19T02:17:24.992 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.992 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.993 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:24.993 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069744+0000", 2024-04-19T02:17:24.993 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012577199999999999 2024-04-19T02:17:24.993 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.993 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.993 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:24.993 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.070116+0000", 2024-04-19T02:17:24.993 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000372407 2024-04-19T02:17:24.993 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.993 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.993 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:24.993 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117511+0000", 2024-04-19T02:17:24.993 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.047394935999999999 2024-04-19T02:17:24.993 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.993 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.993 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:24.994 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119484+0000", 2024-04-19T02:17:24.994 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019722310000000001 2024-04-19T02:17:24.994 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.994 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.994 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:24.994 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119525+0000", 2024-04-19T02:17:24.994 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1035999999999998e-05 2024-04-19T02:17:24.994 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.994 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.994 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:24.994 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119565+0000", 2024-04-19T02:17:24.994 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0859000000000003e-05 2024-04-19T02:17:24.994 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:24.994 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:24.995 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:24.995 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.995 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168383 5.d 5:bbd9496c:::benchmark_data_smithi121_44835_object34348:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:24.995 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069581+0000", 2024-04-19T02:17:24.995 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 12.858902728, 2024-04-19T02:17:24.995 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050607278999999998, 2024-04-19T02:17:24.995 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:24.995 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:24.995 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:24.995 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:24.995 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:24.995 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168383 2024-04-19T02:17:24.995 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.995 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:24.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.996 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:24.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069581+0000", 2024-04-19T02:17:24.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:24.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.996 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:24.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069581+0000", 2024-04-19T02:17:24.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:24.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.996 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:24.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069580+0000", 2024-04-19T02:17:24.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:24.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:24.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069589+0000", 2024-04-19T02:17:24.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6750000000000008e-06 2024-04-19T02:17:24.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:24.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069596+0000", 2024-04-19T02:17:24.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7360000000000004e-06 2024-04-19T02:17:24.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:24.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069601+0000", 2024-04-19T02:17:24.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0479999999999998e-06 2024-04-19T02:17:24.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.998 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:24.998 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.073854+0000", 2024-04-19T02:17:24.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042531920000000003 2024-04-19T02:17:24.998 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.998 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:24.998 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.073952+0000", 2024-04-19T02:17:24.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7851999999999998e-05 2024-04-19T02:17:24.998 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.998 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:24.998 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074012+0000", 2024-04-19T02:17:24.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0225e-05 2024-04-19T02:17:24.998 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:24.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120102+0000", 2024-04-19T02:17:24.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.046090150000000003 2024-04-19T02:17:24.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:24.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120129+0000", 2024-04-19T02:17:24.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7228000000000001e-05 2024-04-19T02:17:24.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:24.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:24.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120157+0000", 2024-04-19T02:17:24.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7165000000000002e-05 2024-04-19T02:17:24.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:24.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:25.000 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120188+0000", 2024-04-19T02:17:25.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1418000000000003e-05 2024-04-19T02:17:25.000 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:25.000 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:25.000 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:25.000 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.000 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.000 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168384 5.7 5:ed638f84:::benchmark_data_smithi121_44835_object34349:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:25.000 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069612+0000", 2024-04-19T02:17:25.000 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 12.858871675, 2024-04-19T02:17:25.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049863376000000001, 2024-04-19T02:17:25.000 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:25.000 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:25.000 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:25.001 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:25.001 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:25.001 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168384 2024-04-19T02:17:25.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.001 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:25.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:25.001 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069612+0000", 2024-04-19T02:17:25.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:25.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:25.001 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069612+0000", 2024-04-19T02:17:25.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:25.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.002 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:25.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069611+0000", 2024-04-19T02:17:25.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:25.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.002 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:25.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069614+0000", 2024-04-19T02:17:25.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7819999999999998e-06 2024-04-19T02:17:25.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.002 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:25.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069623+0000", 2024-04-19T02:17:25.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6989999999999992e-06 2024-04-19T02:17:25.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:25.003 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069628+0000", 2024-04-19T02:17:25.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4999999999999999e-06 2024-04-19T02:17:25.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:25.003 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069662+0000", 2024-04-19T02:17:25.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3319999999999999e-05 2024-04-19T02:17:25.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:25.003 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069782+0000", 2024-04-19T02:17:25.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120547 2024-04-19T02:17:25.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.004 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:25.004 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119338+0000", 2024-04-19T02:17:25.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049556141999999997 2024-04-19T02:17:25.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.004 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:25.004 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119388+0000", 2024-04-19T02:17:25.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9866e-05 2024-04-19T02:17:25.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.004 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:25.004 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119475+0000", 2024-04-19T02:17:25.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6929999999999996e-05 2024-04-19T02:17:25.004 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:25.005 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:25.005 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:25.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.005 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168385 5.d 5:b22d7e69:::benchmark_data_smithi121_44835_object34350:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:25.005 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:25.005 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 12.858848236, 2024-04-19T02:17:25.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.055438508999999997, 2024-04-19T02:17:25.005 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:25.005 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:25.005 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:25.005 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:25.005 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:25.005 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168385 2024-04-19T02:17:25.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.006 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:25.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:25.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:25.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:25.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:25.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:25.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:25.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:25.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:25.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:25.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.007 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:25.007 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069637+0000", 2024-04-19T02:17:25.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.576e-06 2024-04-19T02:17:25.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.007 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:25.007 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069643+0000", 2024-04-19T02:17:25.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8030000000000002e-06 2024-04-19T02:17:25.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.007 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:25.007 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069648+0000", 2024-04-19T02:17:25.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0889999999999999e-06 2024-04-19T02:17:25.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:25.008 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117534+0000", 2024-04-19T02:17:25.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.047886390000000001 2024-04-19T02:17:25.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:25.008 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117670+0000", 2024-04-19T02:17:25.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000135969 2024-04-19T02:17:25.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:25.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117803+0000", 2024-04-19T02:17:25.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000132955 2024-04-19T02:17:25.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:25.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120501+0000", 2024-04-19T02:17:25.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026978050000000002 2024-04-19T02:17:25.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:25.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.125026+0000", 2024-04-19T02:17:25.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045244589999999998 2024-04-19T02:17:25.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:25.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.125049+0000", 2024-04-19T02:17:25.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3807000000000001e-05 2024-04-19T02:17:25.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.010 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:25.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.125074+0000", 2024-04-19T02:17:25.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4175000000000001e-05 2024-04-19T02:17:25.010 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:25.010 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:25.010 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:25.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.010 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168386 5.5 5:a2cda182:::benchmark_data_smithi121_44835_object34351:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:25.010 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069653+0000", 2024-04-19T02:17:25.010 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 12.858830769000001, 2024-04-19T02:17:25.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058748884000000001, 2024-04-19T02:17:25.011 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:25.011 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:25.011 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:25.011 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:25.011 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:25.011 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168386 2024-04-19T02:17:25.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.011 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:25.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.011 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:25.011 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069653+0000", 2024-04-19T02:17:25.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:25.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.011 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:25.012 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069653+0000", 2024-04-19T02:17:25.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:25.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.012 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:25.012 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069652+0000", 2024-04-19T02:17:25.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:25.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.012 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:25.012 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069654+0000", 2024-04-19T02:17:25.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1220000000000002e-06 2024-04-19T02:17:25.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.012 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:25.012 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069660+0000", 2024-04-19T02:17:25.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5890000000000002e-06 2024-04-19T02:17:25.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:25.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069665+0000", 2024-04-19T02:17:25.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.989e-06 2024-04-19T02:17:25.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:25.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120220+0000", 2024-04-19T02:17:25.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050555061999999998 2024-04-19T02:17:25.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:25.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120329+0000", 2024-04-19T02:17:25.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010922200000000001 2024-04-19T02:17:25.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:25.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.128293+0000", 2024-04-19T02:17:25.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079640279999999997 2024-04-19T02:17:25.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:25.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.128336+0000", 2024-04-19T02:17:25.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2245e-05 2024-04-19T02:17:25.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:25.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.128401+0000", 2024-04-19T02:17:25.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5975000000000004e-05 2024-04-19T02:17:25.015 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:25.015 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:25.015 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:25.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.015 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168387 5.f 5:ff36d1d9:::benchmark_data_smithi121_44835_object34352:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:25.015 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:25.015 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 12.858813935000001, 2024-04-19T02:17:25.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049975358999999997, 2024-04-19T02:17:25.015 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:25.015 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:25.015 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:25.015 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:25.015 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:25.015 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168387 2024-04-19T02:17:25.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.016 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:25.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:25.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:25.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:25.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:25.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:25.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:25.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:25.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:25.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:25.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.017 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:25.017 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069671+0000", 2024-04-19T02:17:25.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1739999999999999e-06 2024-04-19T02:17:25.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.017 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:25.017 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069677+0000", 2024-04-19T02:17:25.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4519999999999996e-06 2024-04-19T02:17:25.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.017 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:25.017 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069682+0000", 2024-04-19T02:17:25.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5400000000000003e-06 2024-04-19T02:17:25.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:25.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072634+0000", 2024-04-19T02:17:25.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0029521510000000001 2024-04-19T02:17:25.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:25.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072706+0000", 2024-04-19T02:17:25.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1996999999999995e-05 2024-04-19T02:17:25.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:25.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072772+0000", 2024-04-19T02:17:25.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5380000000000001e-05 2024-04-19T02:17:25.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:25.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117549+0000", 2024-04-19T02:17:25.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044777124000000001 2024-04-19T02:17:25.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:25.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119572+0000", 2024-04-19T02:17:25.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002022893 2024-04-19T02:17:25.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:25.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119613+0000", 2024-04-19T02:17:25.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0849999999999997e-05 2024-04-19T02:17:25.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.020 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:25.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119645+0000", 2024-04-19T02:17:25.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2113000000000002e-05 2024-04-19T02:17:25.020 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:25.020 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:25.020 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:25.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.020 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168389 5.2 5:4bcb87b1:::benchmark_data_smithi121_44835_object34354:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:25.020 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.071719+0000", 2024-04-19T02:17:25.020 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 12.856764839, 2024-04-19T02:17:25.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.048248604, 2024-04-19T02:17:25.020 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:25.020 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:25.021 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:25.021 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:25.021 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:25.021 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168389 2024-04-19T02:17:25.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.021 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:25.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:25.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071719+0000", 2024-04-19T02:17:25.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:25.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:25.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071719+0000", 2024-04-19T02:17:25.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:25.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.022 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:25.022 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071718+0000", 2024-04-19T02:17:25.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:25.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.022 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:25.022 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071722+0000", 2024-04-19T02:17:25.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8590000000000004e-06 2024-04-19T02:17:25.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.022 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:25.022 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071730+0000", 2024-04-19T02:17:25.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8569999999999995e-06 2024-04-19T02:17:25.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:25.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071736+0000", 2024-04-19T02:17:25.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.127e-06 2024-04-19T02:17:25.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:25.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071769+0000", 2024-04-19T02:17:25.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3052000000000001e-05 2024-04-19T02:17:25.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:25.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071843+0000", 2024-04-19T02:17:25.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3683000000000006e-05 2024-04-19T02:17:25.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:25.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119852+0000", 2024-04-19T02:17:25.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.048009353999999997 2024-04-19T02:17:25.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:25.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119896+0000", 2024-04-19T02:17:25.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3102000000000002e-05 2024-04-19T02:17:25.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:25.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119967+0000", 2024-04-19T02:17:25.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1589999999999997e-05 2024-04-19T02:17:25.025 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:25.025 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:25.025 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:25.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.025 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168391 5.3 5:c5d9b5e1:::benchmark_data_smithi121_44835_object34356:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:25.025 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.074402+0000", 2024-04-19T02:17:25.025 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 12.854081000000001, 2024-04-19T02:17:25.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.045426756999999998, 2024-04-19T02:17:25.025 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:25.025 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:25.025 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:25.025 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:25.026 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:25.026 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168391 2024-04-19T02:17:25.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.026 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:25.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.026 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:25.026 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074402+0000", 2024-04-19T02:17:25.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:25.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.026 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:25.026 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074402+0000", 2024-04-19T02:17:25.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:25.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:25.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074401+0000", 2024-04-19T02:17:25.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:25.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:25.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074406+0000", 2024-04-19T02:17:25.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5879999999999999e-06 2024-04-19T02:17:25.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:25.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074414+0000", 2024-04-19T02:17:25.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8599999999999993e-06 2024-04-19T02:17:25.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:25.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074420+0000", 2024-04-19T02:17:25.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6350000000000003e-06 2024-04-19T02:17:25.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:25.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074453+0000", 2024-04-19T02:17:25.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3874000000000001e-05 2024-04-19T02:17:25.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:25.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074531+0000", 2024-04-19T02:17:25.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7999999999999999e-05 2024-04-19T02:17:25.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:25.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119717+0000", 2024-04-19T02:17:25.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.045185395000000003 2024-04-19T02:17:25.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:25.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119756+0000", 2024-04-19T02:17:25.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9110000000000003e-05 2024-04-19T02:17:25.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:25.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119829+0000", 2024-04-19T02:17:25.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3238000000000006e-05 2024-04-19T02:17:25.029 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:25.029 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:25.029 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:25.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.030 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4549.0:168377 5.d e52/16 ondisk, result = 0)", 2024-04-19T02:17:25.030 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.077260+0000", 2024-04-19T02:17:25.030 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 12.851223258999999, 2024-04-19T02:17:25.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042613204000000002, 2024-04-19T02:17:25.030 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:25.030 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:25.030 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:25.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.030 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:25.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.077260+0000", 2024-04-19T02:17:25.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:25.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:25.031 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.077260+0000", 2024-04-19T02:17:25.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:25.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:25.031 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.077259+0000", 2024-04-19T02:17:25.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:25.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:25.031 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.077267+0000", 2024-04-19T02:17:25.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6799999999999993e-06 2024-04-19T02:17:25.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:25.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117372+0000", 2024-04-19T02:17:25.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040105342000000002 2024-04-19T02:17:25.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:25.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117389+0000", 2024-04-19T02:17:25.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6711e-05 2024-04-19T02:17:25.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:25.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119862+0000", 2024-04-19T02:17:25.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0024730580000000002 2024-04-19T02:17:25.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:25.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119867+0000", 2024-04-19T02:17:25.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1590000000000001e-06 2024-04-19T02:17:25.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:25.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:25.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:25.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119873+0000", 2024-04-19T02:17:25.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1410000000000002e-06 2024-04-19T02:17:25.033 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:25.033 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:25.033 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:25.033 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:25.033 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:25.033 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:25.035 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:17:25.035 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:25.035+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:25.135 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:25.136+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:25.207 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:17:25.207 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:17:25.207 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.207 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:205382 5.d e57/16 5:b46e58d1:::benchmark_data_smithi121_44835_object71347:head v 57'12828, mlcod=57'12825)", 2024-04-19T02:17:25.207 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:25.204978+0000", 2024-04-19T02:17:25.207 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0025704780000000002, 2024-04-19T02:17:25.207 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0025951469999999999, 2024-04-19T02:17:25.207 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:25.208 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:25.208 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:25.208 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.208 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:25.208 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.204978+0000", 2024-04-19T02:17:25.208 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:25.208 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.208 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.208 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:25.208 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.204978+0000", 2024-04-19T02:17:25.208 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:25.208 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.208 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.208 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:25.208 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.204978+0000", 2024-04-19T02:17:25.209 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:25.209 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.209 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.209 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:25.209 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.204984+0000", 2024-04-19T02:17:25.209 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.1569999999999997e-06 2024-04-19T02:17:25.209 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.209 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.209 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:25.209 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.204992+0000", 2024-04-19T02:17:25.209 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.8369999999999997e-06 2024-04-19T02:17:25.209 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.209 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.209 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:25.210 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.204997+0000", 2024-04-19T02:17:25.210 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.1499999999999998e-06 2024-04-19T02:17:25.210 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.210 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.210 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:25.210 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.205034+0000", 2024-04-19T02:17:25.210 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7722000000000002e-05 2024-04-19T02:17:25.210 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.210 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.210 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:25.210 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.205053+0000", 2024-04-19T02:17:25.210 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.893e-05 2024-04-19T02:17:25.210 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:25.210 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:25.210 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:25.211 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.211 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.211 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:205390 5.b 5:d7f397f0:::benchmark_data_smithi121_44835_object71355:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:17:25.211 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:25.206179+0000", 2024-04-19T02:17:25.211 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0013698149999999999, 2024-04-19T02:17:25.211 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001468196, 2024-04-19T02:17:25.211 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:25.211 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:25.211 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:25.211 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:25.211 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:25.211 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 205390 2024-04-19T02:17:25.211 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.211 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:25.212 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.212 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:25.212 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.206179+0000", 2024-04-19T02:17:25.212 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:25.212 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.212 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.212 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:25.212 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.206179+0000", 2024-04-19T02:17:25.212 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:25.212 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.212 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.212 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:25.212 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.206178+0000", 2024-04-19T02:17:25.212 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:25.212 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.212 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.213 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:25.213 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.206183+0000", 2024-04-19T02:17:25.213 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8790000000000002e-06 2024-04-19T02:17:25.213 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.213 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.213 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:25.213 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.206195+0000", 2024-04-19T02:17:25.213 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1642e-05 2024-04-19T02:17:25.213 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.213 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.213 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:25.213 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.206202+0000", 2024-04-19T02:17:25.213 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.7659999999999998e-06 2024-04-19T02:17:25.213 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.214 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.214 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:25.214 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.206278+0000", 2024-04-19T02:17:25.214 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.5563999999999997e-05 2024-04-19T02:17:25.214 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.214 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.214 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:25.214 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.206407+0000", 2024-04-19T02:17:25.214 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012953500000000001 2024-04-19T02:17:25.214 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:25.214 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:25.214 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:25.214 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.214 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.214 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:205391 5.e 5:719261af:::benchmark_data_smithi121_44835_object71356:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:17:25.215 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:25.206213+0000", 2024-04-19T02:17:25.215 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0013352349999999999, 2024-04-19T02:17:25.215 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001495244, 2024-04-19T02:17:25.215 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:25.215 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:25.215 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:25.215 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:25.215 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:25.215 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 205391 2024-04-19T02:17:25.215 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.215 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:25.215 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.215 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:25.215 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.206213+0000", 2024-04-19T02:17:25.216 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:25.216 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.216 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.216 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:25.216 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.206213+0000", 2024-04-19T02:17:25.216 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:25.216 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.216 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.216 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:25.216 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.206213+0000", 2024-04-19T02:17:25.216 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:25.216 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.216 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.216 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:25.217 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.206215+0000", 2024-04-19T02:17:25.217 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3939999999999999e-06 2024-04-19T02:17:25.217 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.217 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.217 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:25.217 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.206221+0000", 2024-04-19T02:17:25.217 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.8989999999999998e-06 2024-04-19T02:17:25.217 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.217 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.217 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:25.217 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.206230+0000", 2024-04-19T02:17:25.217 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.5620000000000004e-06 2024-04-19T02:17:25.217 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.217 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.217 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:25.218 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.206767+0000", 2024-04-19T02:17:25.218 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00053719599999999998 2024-04-19T02:17:25.218 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.218 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.218 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:25.218 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.206889+0000", 2024-04-19T02:17:25.218 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012229400000000001 2024-04-19T02:17:25.218 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:25.218 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:25.218 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:25.218 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.218 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.218 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:205392 5.8 5:1bfe6edc:::benchmark_data_smithi121_44835_object71357:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:17:25.218 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:25.206662+0000", 2024-04-19T02:17:25.219 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.00088676399999999996, 2024-04-19T02:17:25.219 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001097741, 2024-04-19T02:17:25.219 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:25.219 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:25.219 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:25.219 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:25.219 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:25.219 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 205392 2024-04-19T02:17:25.219 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.219 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:25.219 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.219 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:25.219 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.206662+0000", 2024-04-19T02:17:25.219 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:25.219 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.220 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.220 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:25.220 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.206662+0000", 2024-04-19T02:17:25.220 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:25.220 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.220 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.220 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:25.220 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.206661+0000", 2024-04-19T02:17:25.220 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:25.220 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.220 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.220 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:25.220 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.206665+0000", 2024-04-19T02:17:25.220 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6550000000000002e-06 2024-04-19T02:17:25.220 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.221 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.221 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:25.221 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.206673+0000", 2024-04-19T02:17:25.221 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.1880000000000002e-06 2024-04-19T02:17:25.221 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.221 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.221 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:25.221 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.206679+0000", 2024-04-19T02:17:25.221 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.0499999999999997e-06 2024-04-19T02:17:25.221 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.221 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.221 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:25.221 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.206797+0000", 2024-04-19T02:17:25.221 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000118066 2024-04-19T02:17:25.222 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.222 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.222 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:25.222 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.206902+0000", 2024-04-19T02:17:25.222 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000104499 2024-04-19T02:17:25.222 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:25.222 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:25.222 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:25.222 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.222 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.222 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:205393 5.8 5.a7195298 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:17:25.222 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:25.206770+0000", 2024-04-19T02:17:25.222 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.00077839100000000002, 2024-04-19T02:17:25.222 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0010413969999999999, 2024-04-19T02:17:25.223 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:25.223 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "queued for pg", 2024-04-19T02:17:25.223 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:25.223 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:25.223 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:25.223 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 205393 2024-04-19T02:17:25.223 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.223 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:25.223 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.223 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:25.223 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.206770+0000", 2024-04-19T02:17:25.223 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:25.223 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.223 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.223 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:25.223 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.206770+0000", 2024-04-19T02:17:25.224 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:25.224 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.224 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.224 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:25.224 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.206770+0000", 2024-04-19T02:17:25.224 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:25.224 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.224 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.224 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:25.224 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.206774+0000", 2024-04-19T02:17:25.224 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3499999999999999e-06 2024-04-19T02:17:25.224 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.224 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.224 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:25.224 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.206784+0000", 2024-04-19T02:17:25.225 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.8199999999999992e-06 2024-04-19T02:17:25.225 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.225 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.225 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:25.225 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.206791+0000", 2024-04-19T02:17:25.225 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1080000000000004e-06 2024-04-19T02:17:25.225 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:25.225 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:25.225 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:25.225 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.225 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.225 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:205394 5.8 5.aa55c08 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:17:25.225 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:25.206805+0000", 2024-04-19T02:17:25.225 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.00074409499999999996, 2024-04-19T02:17:25.225 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001048018, 2024-04-19T02:17:25.226 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:25.226 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "queued for pg", 2024-04-19T02:17:25.226 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:25.226 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:25.226 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:25.226 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 205394 2024-04-19T02:17:25.226 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.226 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:25.226 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.226 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:25.226 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.206805+0000", 2024-04-19T02:17:25.226 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:25.226 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.226 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.227 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:25.227 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.206805+0000", 2024-04-19T02:17:25.227 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:25.227 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.227 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.227 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:25.227 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.206804+0000", 2024-04-19T02:17:25.227 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:25.227 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.227 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.227 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:25.227 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.206807+0000", 2024-04-19T02:17:25.227 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.6970000000000002e-06 2024-04-19T02:17:25.227 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.227 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.227 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:25.228 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.206813+0000", 2024-04-19T02:17:25.228 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.9710000000000001e-06 2024-04-19T02:17:25.228 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.228 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.228 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:25.228 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.206818+0000", 2024-04-19T02:17:25.228 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.9849999999999997e-06 2024-04-19T02:17:25.228 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:25.228 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:25.228 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:25.228 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.228 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.228 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:205378 5.8 5:1d346a00:::benchmark_data_smithi121_44835_object71343:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:17:25.228 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:25.203058+0000", 2024-04-19T02:17:25.229 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0044909160000000002, 2024-04-19T02:17:25.229 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0048293499999999996, 2024-04-19T02:17:25.229 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:25.229 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:25.229 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:25.229 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:25.229 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:25.229 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 205378 2024-04-19T02:17:25.229 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.229 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:25.229 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.229 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:25.229 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.203058+0000", 2024-04-19T02:17:25.229 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:25.229 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.230 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.230 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:25.230 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.203058+0000", 2024-04-19T02:17:25.230 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:25.230 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.230 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.230 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:25.230 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.203057+0000", 2024-04-19T02:17:25.230 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:25.230 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.230 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.230 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:25.230 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.203059+0000", 2024-04-19T02:17:25.230 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.8139999999999999e-06 2024-04-19T02:17:25.230 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.231 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.231 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:25.231 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.203063+0000", 2024-04-19T02:17:25.231 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.349e-06 2024-04-19T02:17:25.231 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.231 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.231 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:25.231 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.203066+0000", 2024-04-19T02:17:25.231 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1049999999999999e-06 2024-04-19T02:17:25.231 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.231 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.231 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:25.231 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.204688+0000", 2024-04-19T02:17:25.231 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016221009999999999 2024-04-19T02:17:25.231 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.232 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.232 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:25.232 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.204820+0000", 2024-04-19T02:17:25.232 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013226000000000001 2024-04-19T02:17:25.232 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:25.232 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:25.232 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:25.232 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.232 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.232 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:205386 5.1 5:887d61f4:::benchmark_data_smithi121_44835_object71351:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:17:25.232 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:25.203837+0000", 2024-04-19T02:17:25.232 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0037120170000000002, 2024-04-19T02:17:25.232 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0040899220000000002, 2024-04-19T02:17:25.232 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:25.232 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:25.233 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:25.233 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:25.233 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:25.233 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 205386 2024-04-19T02:17:25.233 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.233 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:25.233 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.233 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:25.233 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.203837+0000", 2024-04-19T02:17:25.233 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:25.233 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.233 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.233 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:25.233 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.203837+0000", 2024-04-19T02:17:25.233 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:25.234 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.234 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.234 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:25.234 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.203836+0000", 2024-04-19T02:17:25.234 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:25.234 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.234 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.234 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:25.234 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.203839+0000", 2024-04-19T02:17:25.234 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.326e-06 2024-04-19T02:17:25.234 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.234 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.234 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:25.234 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.203855+0000", 2024-04-19T02:17:25.235 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.5290000000000001e-05 2024-04-19T02:17:25.235 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.235 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.235 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:25.235 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.203861+0000", 2024-04-19T02:17:25.235 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.2500000000000003e-06 2024-04-19T02:17:25.235 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.235 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.235 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:25.235 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.203944+0000", 2024-04-19T02:17:25.235 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2820999999999999e-05 2024-04-19T02:17:25.235 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.235 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.235 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:25.235 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.204101+0000", 2024-04-19T02:17:25.235 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00015737999999999999 2024-04-19T02:17:25.236 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:25.236 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:25.236 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:25.236 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.236 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.236 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:205388 5.e 5:7ecd225c:::benchmark_data_smithi121_44835_object71353:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:17:25.236 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:25.204778+0000", 2024-04-19T02:17:25.236 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0027711749999999999, 2024-04-19T02:17:25.236 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0031883810000000001, 2024-04-19T02:17:25.236 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:25.236 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:25.236 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:25.236 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:25.236 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:25.236 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 205388 2024-04-19T02:17:25.236 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.237 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:25.237 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.237 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:25.237 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.204778+0000", 2024-04-19T02:17:25.237 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:25.237 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.237 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.237 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:25.237 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.204778+0000", 2024-04-19T02:17:25.237 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:25.237 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.237 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.237 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:25.237 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.204777+0000", 2024-04-19T02:17:25.237 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:25.238 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.238 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.238 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:25.238 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.204782+0000", 2024-04-19T02:17:25.238 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.826e-06 2024-04-19T02:17:25.238 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.238 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.238 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:25.238 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.204791+0000", 2024-04-19T02:17:25.238 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7540000000000001e-06 2024-04-19T02:17:25.238 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.238 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.238 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:25.238 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.204798+0000", 2024-04-19T02:17:25.238 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.8390000000000001e-06 2024-04-19T02:17:25.239 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.239 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.239 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:25.239 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.204833+0000", 2024-04-19T02:17:25.239 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5258e-05 2024-04-19T02:17:25.239 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.239 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.239 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:25.239 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.204939+0000", 2024-04-19T02:17:25.239 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010547700000000001 2024-04-19T02:17:25.239 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:25.239 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:25.239 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:25.239 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.239 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.240 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:205389 5.1 5:85cc867b:::benchmark_data_smithi121_44835_object71354:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T02:17:25.240 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:25.204815+0000", 2024-04-19T02:17:25.240 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0027340519999999998, 2024-04-19T02:17:25.240 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.003187989, 2024-04-19T02:17:25.240 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:25.240 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:25.240 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:25.240 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:25.240 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:25.240 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 205389 2024-04-19T02:17:25.240 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.240 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:25.240 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.240 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:25.240 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.204815+0000", 2024-04-19T02:17:25.241 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:25.241 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.241 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.241 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:25.241 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.204815+0000", 2024-04-19T02:17:25.241 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:25.241 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.241 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.241 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:25.241 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.204814+0000", 2024-04-19T02:17:25.241 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:25.241 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.241 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.241 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:25.241 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.204817+0000", 2024-04-19T02:17:25.242 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0539999999999999e-06 2024-04-19T02:17:25.242 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.242 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.242 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:25.242 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.204823+0000", 2024-04-19T02:17:25.242 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.212e-06 2024-04-19T02:17:25.242 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.242 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.242 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:25.242 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.204828+0000", 2024-04-19T02:17:25.242 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.04e-06 2024-04-19T02:17:25.242 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.242 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.242 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:25.243 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.206172+0000", 2024-04-19T02:17:25.243 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0013434149999999999 2024-04-19T02:17:25.243 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:25.243 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:25.243 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:25.243 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:25.206301+0000", 2024-04-19T02:17:25.243 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012929599999999999 2024-04-19T02:17:25.243 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:25.243 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:25.243 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:25.243 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:25.243 INFO:teuthology.orchestra.run.smithi174.stdout: ], 2024-04-19T02:17:25.243 INFO:teuthology.orchestra.run.smithi174.stdout: "num_ops": 10 2024-04-19T02:17:25.243 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:17:25.244 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:17:25.245 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:25.246+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:25.246 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:17:25.321 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T02:17:25.329 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [2] live_osds: [0, 1] 2024-04-19T02:17:25.329 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T02:17:25.329 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2024-04-19T02:17:25.329 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-19T02:17:25.329 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-19T02:17:25.330 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2024-04-19T02:17:25.346 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:25.347+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:25.395 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:17:25.417 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:17:25.417 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:17:25.417 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:17:25.417 INFO:teuthology.orchestra.run.smithi121.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T02:17:25.420 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:17:25.420 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:17:25.447 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:25.448 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:25.448 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:25.448+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:25.452 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:17:25.509 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:17:25.510 INFO:teuthology.orchestra.run.smithi174.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-19T02:17:25.510 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:17:25.565 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:25.565+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:25.649 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:25.649+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:25.669 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:25.669 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:25.683 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:25.749 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:25.750+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:25.850 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:25.850+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:25.869 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:25.869 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:25.881 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:25.951 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:25.951+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:26.002 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~17s 2024-04-19T02:17:26.052 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:26.053+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:26.090 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:26.091 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:26.105 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:26.153 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:26.153+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:26.254 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:26.255+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:26.306 INFO:teuthology.orchestra.run.smithi121.stderr:nodeep-scrub is unset 2024-04-19T02:17:26.320 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:26.321 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:26.336 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:17:26.377 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:26.378+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:26.455 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:26.456+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:26.507 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:26.507 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:26.522 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:17:26.564 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:26.564+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:26.657 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:26.658+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:26.743 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:26.743 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:26.758 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:17:26.758 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:26.757+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:26.862 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:26.860+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:26.959 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:26.959+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:26.978 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:26.978 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:26.993 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:27.060 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:27.060+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:27.160 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:27.160+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:27.164 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:27.164 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:27.177 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:27.260 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:27.261+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:27.348 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:27.348 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:27.361 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:27.362 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:27.361+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:27.422 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:17:27.462 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:27.462+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:27.563 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:27.563+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:27.574 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:17:27.576 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:27.576 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-04-19T02:17:27.576 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-04-19T02:17:27.576 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:17:27.576 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.576 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:27.576 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:17:27.576 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 118.30433023400001, 2024-04-19T02:17:27.577 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022007204999999998, 2024-04-19T02:17:27.577 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:27.577 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:27.577 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:27.577 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.577 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:27.577 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:17:27.577 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:27.577 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.577 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.577 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:27.577 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:17:27.577 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:27.577 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.577 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.578 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:27.578 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269990+0000", 2024-04-19T02:17:27.578 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:27.578 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.578 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.578 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:27.578 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269999+0000", 2024-04-19T02:17:27.578 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9539999999999993e-06 2024-04-19T02:17:27.578 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.578 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.578 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:27.578 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270006+0000", 2024-04-19T02:17:27.578 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.216e-06 2024-04-19T02:17:27.578 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.578 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.578 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.579 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270012+0000", 2024-04-19T02:17:27.579 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5049999999999998e-06 2024-04-19T02:17:27.579 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.579 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.579 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:27.579 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270058+0000", 2024-04-19T02:17:27.579 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.634e-05 2024-04-19T02:17:27.579 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.579 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.579 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:27.579 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270064+0000", 2024-04-19T02:17:27.579 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0669999999999997e-06 2024-04-19T02:17:27.579 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.579 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.579 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:27.579 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287159+0000", 2024-04-19T02:17:27.580 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017095086999999998 2024-04-19T02:17:27.580 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.580 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.580 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:27.580 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287254+0000", 2024-04-19T02:17:27.580 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4716000000000006e-05 2024-04-19T02:17:27.580 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.580 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.580 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:27.580 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287389+0000", 2024-04-19T02:17:27.580 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013511900000000001 2024-04-19T02:17:27.580 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.580 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.580 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:27.580 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290481+0000", 2024-04-19T02:17:27.580 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030920169999999999 2024-04-19T02:17:27.581 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.581 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.581 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:27.581 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291931+0000", 2024-04-19T02:17:27.581 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001450118 2024-04-19T02:17:27.581 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.581 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.581 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:27.581 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291960+0000", 2024-04-19T02:17:27.581 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9096000000000001e-05 2024-04-19T02:17:27.581 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.581 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.581 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:27.581 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291998+0000", 2024-04-19T02:17:27.581 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7514e-05 2024-04-19T02:17:27.582 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:27.582 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:27.582 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:27.582 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.582 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.582 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:27.582 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:17:27.582 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 118.30421945800001, 2024-04-19T02:17:27.582 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020837887999999999, 2024-04-19T02:17:27.582 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:27.582 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:27.582 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:27.582 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.582 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:27.582 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:17:27.583 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:27.583 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.583 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.583 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:27.583 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:17:27.583 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:27.583 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.583 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.583 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:27.583 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:17:27.583 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:27.583 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.583 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.583 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:27.583 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270109+0000", 2024-04-19T02:17:27.584 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3110000000000006e-06 2024-04-19T02:17:27.584 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.584 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.584 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:27.584 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270117+0000", 2024-04-19T02:17:27.584 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0479999999999999e-06 2024-04-19T02:17:27.584 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.584 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.584 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.584 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270123+0000", 2024-04-19T02:17:27.584 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5500000000000002e-06 2024-04-19T02:17:27.584 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.584 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.584 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:27.585 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270150+0000", 2024-04-19T02:17:27.585 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7712000000000002e-05 2024-04-19T02:17:27.585 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.585 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.585 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:27.585 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270153+0000", 2024-04-19T02:17:27.585 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6089999999999999e-06 2024-04-19T02:17:27.585 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.585 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.585 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:27.585 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285958+0000", 2024-04-19T02:17:27.585 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015805274000000001 2024-04-19T02:17:27.585 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.585 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.585 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:27.585 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286126+0000", 2024-04-19T02:17:27.586 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016765700000000001 2024-04-19T02:17:27.586 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.586 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.586 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:27.586 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286296+0000", 2024-04-19T02:17:27.586 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017007 2024-04-19T02:17:27.586 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.586 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.586 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:27.586 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290426+0000", 2024-04-19T02:17:27.586 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041299839999999997 2024-04-19T02:17:27.586 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.586 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.586 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:27.586 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290867+0000", 2024-04-19T02:17:27.586 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00044083300000000001 2024-04-19T02:17:27.587 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.587 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.587 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:27.587 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290900+0000", 2024-04-19T02:17:27.587 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3380000000000002e-05 2024-04-19T02:17:27.587 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.587 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.587 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:27.587 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290939+0000", 2024-04-19T02:17:27.587 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8970000000000001e-05 2024-04-19T02:17:27.587 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:27.587 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:27.587 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:27.588 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.588 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.588 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:21 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:27.588 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:17:27.588 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 118.304130786, 2024-04-19T02:17:27.588 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020833187999999999, 2024-04-19T02:17:27.588 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:27.588 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:27.588 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:27.588 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.588 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:27.588 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:17:27.588 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:27.588 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.588 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.588 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:27.589 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:17:27.589 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:27.589 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.589 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.589 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:27.589 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270189+0000", 2024-04-19T02:17:27.589 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:27.589 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.589 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.589 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:27.589 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270192+0000", 2024-04-19T02:17:27.589 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7549999999999999e-06 2024-04-19T02:17:27.589 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.589 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.589 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:27.590 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270198+0000", 2024-04-19T02:17:27.590 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0859999999999998e-06 2024-04-19T02:17:27.590 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.590 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.590 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.590 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270204+0000", 2024-04-19T02:17:27.590 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1970000000000004e-06 2024-04-19T02:17:27.590 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.590 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.590 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:27.590 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270238+0000", 2024-04-19T02:17:27.590 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4282000000000001e-05 2024-04-19T02:17:27.590 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.590 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.590 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:27.590 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270240+0000", 2024-04-19T02:17:27.591 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3099999999999999e-06 2024-04-19T02:17:27.591 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.591 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.591 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:27.591 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287131+0000", 2024-04-19T02:17:27.591 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01689104 2024-04-19T02:17:27.591 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.591 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.591 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:27.591 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287262+0000", 2024-04-19T02:17:27.591 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130347 2024-04-19T02:17:27.591 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.591 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.591 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:27.591 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291023+0000", 2024-04-19T02:17:27.592 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037616350000000002 2024-04-19T02:17:27.592 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:27.592 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:27.592 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:27.592 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.592 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.592 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:94468 5.2 5:4f406431:::benchmark_data_smithi121_44835_object94467:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T02:17:27.592 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:17:27.592 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 52.462891603999999, 2024-04-19T02:17:27.592 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024835144999999999, 2024-04-19T02:17:27.592 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:27.592 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:27.592 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:27.592 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:27.592 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:27.592 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 94468 2024-04-19T02:17:27.593 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.593 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:27.593 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.593 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:27.593 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:17:27.593 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:27.593 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.593 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.593 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:27.593 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:17:27.593 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:27.593 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.593 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.593 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:27.593 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:17:27.593 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:27.594 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.594 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.594 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:27.594 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111498+0000", 2024-04-19T02:17:27.594 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9529000000000005e-05 2024-04-19T02:17:27.594 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.596 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.596 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:27.596 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111506+0000", 2024-04-19T02:17:27.596 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9030000000000004e-06 2024-04-19T02:17:27.596 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.596 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.596 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.596 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111513+0000", 2024-04-19T02:17:27.596 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8759999999999999e-06 2024-04-19T02:17:27.596 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.596 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.596 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:27.596 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112466+0000", 2024-04-19T02:17:27.597 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00095318499999999995 2024-04-19T02:17:27.597 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.597 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.597 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:27.597 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112590+0000", 2024-04-19T02:17:27.597 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012380900000000001 2024-04-19T02:17:27.597 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.597 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.597 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:27.597 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112728+0000", 2024-04-19T02:17:27.597 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013753800000000001 2024-04-19T02:17:27.597 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.597 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.597 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:27.598 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115064+0000", 2024-04-19T02:17:27.598 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002336819 2024-04-19T02:17:27.598 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.598 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.598 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:27.598 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136207+0000", 2024-04-19T02:17:27.598 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021142942000000001 2024-04-19T02:17:27.598 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.598 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.598 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:27.598 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136241+0000", 2024-04-19T02:17:27.598 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3577000000000001e-05 2024-04-19T02:17:27.598 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.599 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.599 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:27.599 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136264+0000", 2024-04-19T02:17:27.599 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3421000000000002e-05 2024-04-19T02:17:27.599 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:27.599 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:27.599 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:27.599 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.599 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.599 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:94472 5.2 5:45b7e9be:::benchmark_data_smithi121_44835_object94471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:27.599 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:17:27.599 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 52.459245072999998, 2024-04-19T02:17:27.599 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021273843000000001, 2024-04-19T02:17:27.599 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:27.599 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:27.599 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:27.600 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:27.600 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:27.600 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 94472 2024-04-19T02:17:27.600 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.600 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:27.600 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.600 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:27.600 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:17:27.600 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:27.600 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.600 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.600 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:27.600 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:17:27.600 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:27.601 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.601 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.601 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:27.601 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115075+0000", 2024-04-19T02:17:27.601 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:27.601 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.601 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.601 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:27.601 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115161+0000", 2024-04-19T02:17:27.601 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6632000000000007e-05 2024-04-19T02:17:27.601 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.601 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.601 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:27.601 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115171+0000", 2024-04-19T02:17:27.601 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2969999999999992e-06 2024-04-19T02:17:27.602 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.602 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.602 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.602 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115178+0000", 2024-04-19T02:17:27.602 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7610000000000007e-06 2024-04-19T02:17:27.602 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.602 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.602 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:27.602 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115213+0000", 2024-04-19T02:17:27.602 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5000999999999999e-05 2024-04-19T02:17:27.602 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.602 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.602 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:27.603 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115303+0000", 2024-04-19T02:17:27.603 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9791999999999997e-05 2024-04-19T02:17:27.603 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.603 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.603 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:27.603 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115391+0000", 2024-04-19T02:17:27.603 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7559000000000007e-05 2024-04-19T02:17:27.603 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.603 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.603 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:27.603 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.117894+0000", 2024-04-19T02:17:27.603 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002503496 2024-04-19T02:17:27.603 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.604 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.604 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:27.604 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136297+0000", 2024-04-19T02:17:27.604 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018402335999999998 2024-04-19T02:17:27.604 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.604 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.604 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:27.604 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136327+0000", 2024-04-19T02:17:27.604 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0534999999999998e-05 2024-04-19T02:17:27.604 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.604 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.604 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:27.604 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136350+0000", 2024-04-19T02:17:27.605 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2427999999999999e-05 2024-04-19T02:17:27.605 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:27.605 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:27.605 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:27.605 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.605 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.605 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:129219 5.2 5:45e7e1f4:::benchmark_data_smithi121_44835_object129218:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T02:17:27.605 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:52.629592+0000", 2024-04-19T02:17:27.605 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.944728820000002, 2024-04-19T02:17:27.605 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021099489999999999, 2024-04-19T02:17:27.605 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:27.605 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:27.605 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:27.605 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:27.606 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:27.606 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129219 2024-04-19T02:17:27.606 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.606 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:27.606 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.606 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:27.606 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629592+0000", 2024-04-19T02:17:27.606 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:27.606 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.606 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.606 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:27.606 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629592+0000", 2024-04-19T02:17:27.606 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:27.606 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.607 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.607 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:27.607 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629591+0000", 2024-04-19T02:17:27.607 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:27.607 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.607 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.607 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:27.607 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629618+0000", 2024-04-19T02:17:27.607 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6970000000000001e-05 2024-04-19T02:17:27.607 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.607 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.607 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:27.607 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629639+0000", 2024-04-19T02:17:27.607 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0701999999999999e-05 2024-04-19T02:17:27.608 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.608 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.608 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.608 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629645+0000", 2024-04-19T02:17:27.608 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2299999999999996e-06 2024-04-19T02:17:27.608 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.608 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.608 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:27.608 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.635658+0000", 2024-04-19T02:17:27.608 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0060127549999999998 2024-04-19T02:17:27.608 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.608 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.608 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:27.608 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.635811+0000", 2024-04-19T02:17:27.608 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015305700000000001 2024-04-19T02:17:27.609 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.609 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.609 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:27.609 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.635967+0000", 2024-04-19T02:17:27.609 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015578599999999999 2024-04-19T02:17:27.609 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.609 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.609 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:27.609 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.642488+0000", 2024-04-19T02:17:27.609 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0065215619999999998 2024-04-19T02:17:27.609 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.609 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.609 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:27.609 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650603+0000", 2024-04-19T02:17:27.609 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0081144900000000002 2024-04-19T02:17:27.610 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.610 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.610 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:27.610 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650652+0000", 2024-04-19T02:17:27.610 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9079999999999998e-05 2024-04-19T02:17:27.610 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.610 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.610 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:27.610 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650691+0000", 2024-04-19T02:17:27.610 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9501e-05 2024-04-19T02:17:27.610 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:27.610 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:27.610 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:27.610 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.611 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.611 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:157448 5.7 5:ed833a19:::benchmark_data_smithi121_44835_object23413:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:27.611 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:06.870566+0000", 2024-04-19T02:17:27.611 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 20.703754238999998, 2024-04-19T02:17:27.611 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023031238999999998, 2024-04-19T02:17:27.611 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:27.611 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:27.611 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:27.611 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:27.611 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:27.611 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 157448 2024-04-19T02:17:27.611 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.611 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:27.611 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.612 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:27.612 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870566+0000", 2024-04-19T02:17:27.612 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:27.612 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.612 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.612 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:27.612 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870566+0000", 2024-04-19T02:17:27.612 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:27.612 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.612 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.612 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:27.612 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870566+0000", 2024-04-19T02:17:27.612 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:27.612 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.613 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.613 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:27.613 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870570+0000", 2024-04-19T02:17:27.613 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1620000000000001e-06 2024-04-19T02:17:27.613 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.613 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.613 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:27.613 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870577+0000", 2024-04-19T02:17:27.613 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2069999999999998e-06 2024-04-19T02:17:27.613 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.613 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.613 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.613 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870587+0000", 2024-04-19T02:17:27.613 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6919999999999997e-06 2024-04-19T02:17:27.613 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.614 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.614 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:27.614 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870615+0000", 2024-04-19T02:17:27.614 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8351999999999999e-05 2024-04-19T02:17:27.614 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.614 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.614 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:27.614 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870715+0000", 2024-04-19T02:17:27.614 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9624999999999996e-05 2024-04-19T02:17:27.614 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.614 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.614 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:27.614 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870805+0000", 2024-04-19T02:17:27.614 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0067000000000004e-05 2024-04-19T02:17:27.614 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.615 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.615 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:27.615 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.872773+0000", 2024-04-19T02:17:27.615 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001968605 2024-04-19T02:17:27.615 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.615 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.615 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:27.615 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.893514+0000", 2024-04-19T02:17:27.615 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020740082999999999 2024-04-19T02:17:27.615 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.615 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.615 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:27.615 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.893558+0000", 2024-04-19T02:17:27.615 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4110999999999998e-05 2024-04-19T02:17:27.615 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.615 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.616 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:27.616 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.893598+0000", 2024-04-19T02:17:27.616 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0077000000000003e-05 2024-04-19T02:17:27.616 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:27.616 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:27.616 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:27.616 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.616 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.616 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:157498 5.7 5:eb39b43d:::benchmark_data_smithi121_44835_object23463:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:27.616 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:06.911721+0000", 2024-04-19T02:17:27.616 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 20.662599594, 2024-04-19T02:17:27.616 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023313438999999998, 2024-04-19T02:17:27.616 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:27.616 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:27.616 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:27.616 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:27.617 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:27.617 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 157498 2024-04-19T02:17:27.617 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.617 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:27.617 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.617 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:27.617 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911721+0000", 2024-04-19T02:17:27.617 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:27.617 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.617 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.617 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:27.617 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911721+0000", 2024-04-19T02:17:27.617 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:27.617 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.617 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.617 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:27.618 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911720+0000", 2024-04-19T02:17:27.618 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:27.618 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.618 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.618 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:27.618 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911726+0000", 2024-04-19T02:17:27.618 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3179999999999997e-06 2024-04-19T02:17:27.618 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.618 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.618 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:27.618 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911746+0000", 2024-04-19T02:17:27.618 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0574e-05 2024-04-19T02:17:27.618 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.618 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.619 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.619 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911757+0000", 2024-04-19T02:17:27.619 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0959e-05 2024-04-19T02:17:27.619 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.619 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.619 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:27.619 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911795+0000", 2024-04-19T02:17:27.619 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7589999999999998e-05 2024-04-19T02:17:27.619 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.619 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.619 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:27.620 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911912+0000", 2024-04-19T02:17:27.620 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117625 2024-04-19T02:17:27.620 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.620 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.620 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:27.620 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.912250+0000", 2024-04-19T02:17:27.620 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00033710599999999999 2024-04-19T02:17:27.620 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.620 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.620 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:27.620 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.915540+0000", 2024-04-19T02:17:27.620 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032909559999999998 2024-04-19T02:17:27.620 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.620 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.621 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:27.621 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.934984+0000", 2024-04-19T02:17:27.621 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019443670999999999 2024-04-19T02:17:27.621 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.621 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.621 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:27.621 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.935013+0000", 2024-04-19T02:17:27.621 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8464999999999999e-05 2024-04-19T02:17:27.621 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.621 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.621 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:27.621 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.935035+0000", 2024-04-19T02:17:27.621 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1954e-05 2024-04-19T02:17:27.622 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:27.622 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:27.622 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:27.622 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.622 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.622 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168377 5.d 5:b1f3fb6d:::benchmark_data_smithi121_44835_object34342:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:27.622 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069470+0000", 2024-04-19T02:17:27.622 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.504850862, 2024-04-19T02:17:27.622 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050516473999999999, 2024-04-19T02:17:27.622 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:27.622 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:27.622 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:27.622 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:27.623 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:27.623 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168377 2024-04-19T02:17:27.623 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.623 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:27.623 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.623 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:27.623 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069470+0000", 2024-04-19T02:17:27.623 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:27.623 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.623 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.623 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:27.623 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069470+0000", 2024-04-19T02:17:27.623 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:27.623 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.624 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.624 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:27.624 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069469+0000", 2024-04-19T02:17:27.624 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:27.624 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.624 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.624 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:27.624 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069473+0000", 2024-04-19T02:17:27.624 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4580000000000002e-06 2024-04-19T02:17:27.624 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.624 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.624 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:27.624 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069482+0000", 2024-04-19T02:17:27.624 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2839999999999995e-06 2024-04-19T02:17:27.625 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.625 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.625 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.625 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069489+0000", 2024-04-19T02:17:27.625 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3579999999999997e-06 2024-04-19T02:17:27.625 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.625 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.625 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:27.625 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069559+0000", 2024-04-19T02:17:27.625 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9678000000000006e-05 2024-04-19T02:17:27.625 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.625 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.625 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:27.625 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069683+0000", 2024-04-19T02:17:27.625 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012359400000000001 2024-04-19T02:17:27.626 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.626 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.626 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:27.626 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069759+0000", 2024-04-19T02:17:27.626 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6834000000000003e-05 2024-04-19T02:17:27.626 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.626 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.626 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:27.626 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119871+0000", 2024-04-19T02:17:27.626 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050111392999999997 2024-04-19T02:17:27.626 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.626 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.626 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:27.626 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119932+0000", 2024-04-19T02:17:27.627 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1209000000000003e-05 2024-04-19T02:17:27.627 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.627 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.627 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:27.627 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119962+0000", 2024-04-19T02:17:27.627 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9717999999999999e-05 2024-04-19T02:17:27.627 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.627 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.627 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:27.627 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119986+0000", 2024-04-19T02:17:27.627 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4549000000000002e-05 2024-04-19T02:17:27.627 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:27.627 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:27.627 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:27.628 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.628 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.628 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168379 5.d 5:bcd492dd:::benchmark_data_smithi121_44835_object34344:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:27.628 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069502+0000", 2024-04-19T02:17:27.628 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.504818809, 2024-04-19T02:17:27.628 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050544645999999999, 2024-04-19T02:17:27.628 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:27.628 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:27.628 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:27.628 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:27.628 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:27.628 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168379 2024-04-19T02:17:27.628 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.628 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:27.628 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.629 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:27.629 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069502+0000", 2024-04-19T02:17:27.629 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:27.629 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.629 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.629 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:27.629 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069502+0000", 2024-04-19T02:17:27.629 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:27.629 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.629 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.629 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:27.629 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069501+0000", 2024-04-19T02:17:27.629 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:27.629 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.630 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.630 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:27.630 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069504+0000", 2024-04-19T02:17:27.630 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9289999999999998e-06 2024-04-19T02:17:27.630 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.630 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.630 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:27.630 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069511+0000", 2024-04-19T02:17:27.630 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1909999999999997e-06 2024-04-19T02:17:27.630 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.630 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.630 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.630 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069517+0000", 2024-04-19T02:17:27.631 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0789999999999997e-06 2024-04-19T02:17:27.631 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.631 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.631 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:27.631 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071081+0000", 2024-04-19T02:17:27.631 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0015646550000000001 2024-04-19T02:17:27.631 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.631 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.631 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:27.631 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071195+0000", 2024-04-19T02:17:27.631 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011399400000000001 2024-04-19T02:17:27.631 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.631 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.631 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:27.631 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071293+0000", 2024-04-19T02:17:27.632 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7938999999999999e-05 2024-04-19T02:17:27.632 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.632 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.632 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:27.632 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119898+0000", 2024-04-19T02:17:27.632 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.048604808999999999 2024-04-19T02:17:27.632 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.632 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.632 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:27.632 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119993+0000", 2024-04-19T02:17:27.632 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5224999999999997e-05 2024-04-19T02:17:27.632 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.632 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.632 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:27.633 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120024+0000", 2024-04-19T02:17:27.633 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0580999999999997e-05 2024-04-19T02:17:27.633 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.633 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.633 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:27.633 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120047+0000", 2024-04-19T02:17:27.633 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2725e-05 2024-04-19T02:17:27.633 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:27.633 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:27.633 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:27.633 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.633 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.633 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168381 5.d 5:bcbab0e3:::benchmark_data_smithi121_44835_object34346:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:27.634 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:27.634 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.504799391000001, 2024-04-19T02:17:27.634 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050574694000000003, 2024-04-19T02:17:27.634 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:27.634 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:27.634 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:27.634 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:27.634 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:27.634 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168381 2024-04-19T02:17:27.634 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.634 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:27.634 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.634 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:27.634 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:27.634 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:27.635 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.635 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.635 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:27.635 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:27.635 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:27.635 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.635 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.635 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:27.635 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:27.635 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:27.635 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.635 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.635 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:27.636 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069523+0000", 2024-04-19T02:17:27.636 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.244e-06 2024-04-19T02:17:27.636 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.636 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.636 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:27.636 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069528+0000", 2024-04-19T02:17:27.636 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0669999999999999e-06 2024-04-19T02:17:27.636 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.636 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.636 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.636 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069533+0000", 2024-04-19T02:17:27.636 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4680000000000003e-06 2024-04-19T02:17:27.636 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.636 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.637 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:27.637 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072637+0000", 2024-04-19T02:17:27.637 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031040429999999999 2024-04-19T02:17:27.637 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.637 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.637 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:27.637 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072710+0000", 2024-04-19T02:17:27.637 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3045000000000003e-05 2024-04-19T02:17:27.637 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.637 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.637 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:27.637 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072775+0000", 2024-04-19T02:17:27.637 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5034000000000001e-05 2024-04-19T02:17:27.637 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.638 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.638 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:27.638 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119925+0000", 2024-04-19T02:17:27.638 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.047150594999999997 2024-04-19T02:17:27.638 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.638 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.638 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:27.638 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120055+0000", 2024-04-19T02:17:27.638 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129288 2024-04-19T02:17:27.638 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.638 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.638 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:27.638 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120077+0000", 2024-04-19T02:17:27.638 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1759e-05 2024-04-19T02:17:27.639 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.639 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.639 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:27.639 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120096+0000", 2024-04-19T02:17:27.639 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9524000000000001e-05 2024-04-19T02:17:27.639 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:27.639 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:27.639 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:27.639 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.639 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.639 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168382 5.f 5:f2599a15:::benchmark_data_smithi121_44835_object34347:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:27.639 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069556+0000", 2024-04-19T02:17:27.639 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.504764983999999, 2024-04-19T02:17:27.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050009713999999997, 2024-04-19T02:17:27.640 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:27.640 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:27.640 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:27.640 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:27.640 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:27.640 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168382 2024-04-19T02:17:27.640 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.640 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:27.640 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.640 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:27.640 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069556+0000", 2024-04-19T02:17:27.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:27.640 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.640 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.640 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:27.640 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069556+0000", 2024-04-19T02:17:27.641 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:27.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:27.641 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069555+0000", 2024-04-19T02:17:27.641 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:27.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:27.641 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069558+0000", 2024-04-19T02:17:27.641 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7879999999999998e-06 2024-04-19T02:17:27.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:27.641 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069566+0000", 2024-04-19T02:17:27.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6149999999999999e-06 2024-04-19T02:17:27.642 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.642 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.642 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069571+0000", 2024-04-19T02:17:27.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5509999999999999e-06 2024-04-19T02:17:27.642 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.642 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:27.642 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069618+0000", 2024-04-19T02:17:27.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6964e-05 2024-04-19T02:17:27.642 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.642 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:27.642 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069744+0000", 2024-04-19T02:17:27.643 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012577199999999999 2024-04-19T02:17:27.643 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.643 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.643 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:27.643 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.070116+0000", 2024-04-19T02:17:27.643 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000372407 2024-04-19T02:17:27.643 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.643 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.643 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:27.643 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117511+0000", 2024-04-19T02:17:27.643 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.047394935999999999 2024-04-19T02:17:27.643 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.643 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.643 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:27.644 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119484+0000", 2024-04-19T02:17:27.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019722310000000001 2024-04-19T02:17:27.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.644 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:27.644 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119525+0000", 2024-04-19T02:17:27.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1035999999999998e-05 2024-04-19T02:17:27.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.644 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:27.644 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119565+0000", 2024-04-19T02:17:27.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0859000000000003e-05 2024-04-19T02:17:27.644 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:27.644 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:27.645 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:27.645 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.645 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.645 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168383 5.d 5:bbd9496c:::benchmark_data_smithi121_44835_object34348:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:27.645 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069581+0000", 2024-04-19T02:17:27.645 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.504740096000001, 2024-04-19T02:17:27.645 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050607278999999998, 2024-04-19T02:17:27.645 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:27.645 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:27.645 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:27.645 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:27.645 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:27.645 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168383 2024-04-19T02:17:27.645 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.646 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:27.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.646 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:27.646 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069581+0000", 2024-04-19T02:17:27.646 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:27.646 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.646 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:27.646 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069581+0000", 2024-04-19T02:17:27.646 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:27.646 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.646 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:27.647 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069580+0000", 2024-04-19T02:17:27.647 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:27.647 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.647 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.647 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:27.647 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069589+0000", 2024-04-19T02:17:27.647 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6750000000000008e-06 2024-04-19T02:17:27.647 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.647 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.647 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:27.647 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069596+0000", 2024-04-19T02:17:27.647 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7360000000000004e-06 2024-04-19T02:17:27.647 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.647 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.648 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.648 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069601+0000", 2024-04-19T02:17:27.648 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0479999999999998e-06 2024-04-19T02:17:27.648 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.648 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.648 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:27.648 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.073854+0000", 2024-04-19T02:17:27.648 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042531920000000003 2024-04-19T02:17:27.648 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.648 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.648 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:27.648 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.073952+0000", 2024-04-19T02:17:27.648 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7851999999999998e-05 2024-04-19T02:17:27.648 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.649 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.649 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:27.649 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074012+0000", 2024-04-19T02:17:27.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0225e-05 2024-04-19T02:17:27.649 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.649 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.649 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:27.649 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120102+0000", 2024-04-19T02:17:27.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.046090150000000003 2024-04-19T02:17:27.649 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.649 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.649 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:27.649 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120129+0000", 2024-04-19T02:17:27.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7228000000000001e-05 2024-04-19T02:17:27.649 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.650 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.650 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:27.650 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120157+0000", 2024-04-19T02:17:27.650 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7165000000000002e-05 2024-04-19T02:17:27.650 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.650 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.650 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:27.650 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120188+0000", 2024-04-19T02:17:27.650 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1418000000000003e-05 2024-04-19T02:17:27.650 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:27.650 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:27.650 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:27.650 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.650 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.651 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168384 5.7 5:ed638f84:::benchmark_data_smithi121_44835_object34349:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:27.651 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069612+0000", 2024-04-19T02:17:27.651 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.504709043, 2024-04-19T02:17:27.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049863376000000001, 2024-04-19T02:17:27.651 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:27.651 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:27.651 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:27.651 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:27.651 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:27.651 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168384 2024-04-19T02:17:27.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.651 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:27.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:27.652 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069612+0000", 2024-04-19T02:17:27.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:27.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:27.652 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069612+0000", 2024-04-19T02:17:27.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:27.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:27.652 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069611+0000", 2024-04-19T02:17:27.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:27.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:27.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069614+0000", 2024-04-19T02:17:27.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7819999999999998e-06 2024-04-19T02:17:27.653 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.653 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:27.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069623+0000", 2024-04-19T02:17:27.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6989999999999992e-06 2024-04-19T02:17:27.653 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.653 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069628+0000", 2024-04-19T02:17:27.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4999999999999999e-06 2024-04-19T02:17:27.653 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.653 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:27.654 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069662+0000", 2024-04-19T02:17:27.654 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3319999999999999e-05 2024-04-19T02:17:27.654 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.654 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.654 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:27.654 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069782+0000", 2024-04-19T02:17:27.654 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120547 2024-04-19T02:17:27.654 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.654 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.654 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:27.655 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119338+0000", 2024-04-19T02:17:27.655 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049556141999999997 2024-04-19T02:17:27.655 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.655 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.655 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:27.655 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119388+0000", 2024-04-19T02:17:27.655 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9866e-05 2024-04-19T02:17:27.655 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.655 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.655 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:27.655 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119475+0000", 2024-04-19T02:17:27.655 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6929999999999996e-05 2024-04-19T02:17:27.655 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:27.655 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:27.655 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:27.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.656 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.656 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168385 5.d 5:b22d7e69:::benchmark_data_smithi121_44835_object34350:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:27.656 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:27.656 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.504685604000001, 2024-04-19T02:17:27.656 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.055438508999999997, 2024-04-19T02:17:27.656 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:27.656 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:27.656 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:27.656 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:27.656 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:27.656 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168385 2024-04-19T02:17:27.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.656 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:27.656 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.657 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:27.657 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:27.657 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:27.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.657 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.657 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:27.657 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:27.657 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:27.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.657 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.657 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:27.658 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:27.658 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:27.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.658 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.658 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:27.658 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069637+0000", 2024-04-19T02:17:27.658 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.576e-06 2024-04-19T02:17:27.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.658 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.658 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:27.658 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069643+0000", 2024-04-19T02:17:27.658 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8030000000000002e-06 2024-04-19T02:17:27.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.658 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.658 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.659 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069648+0000", 2024-04-19T02:17:27.659 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0889999999999999e-06 2024-04-19T02:17:27.659 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.659 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.659 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:27.659 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117534+0000", 2024-04-19T02:17:27.659 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.047886390000000001 2024-04-19T02:17:27.659 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.659 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.659 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:27.659 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117670+0000", 2024-04-19T02:17:27.659 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000135969 2024-04-19T02:17:27.659 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.659 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.659 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:27.660 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117803+0000", 2024-04-19T02:17:27.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000132955 2024-04-19T02:17:27.660 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.660 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:27.660 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120501+0000", 2024-04-19T02:17:27.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026978050000000002 2024-04-19T02:17:27.660 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.660 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:27.660 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.125026+0000", 2024-04-19T02:17:27.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045244589999999998 2024-04-19T02:17:27.660 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.660 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:27.661 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.125049+0000", 2024-04-19T02:17:27.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3807000000000001e-05 2024-04-19T02:17:27.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.661 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.661 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:27.661 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.125074+0000", 2024-04-19T02:17:27.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4175000000000001e-05 2024-04-19T02:17:27.661 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:27.661 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:27.661 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:27.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.661 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.661 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168386 5.5 5:a2cda182:::benchmark_data_smithi121_44835_object34351:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:27.661 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069653+0000", 2024-04-19T02:17:27.661 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.504668136999999, 2024-04-19T02:17:27.662 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058748884000000001, 2024-04-19T02:17:27.662 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:27.662 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:27.662 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:27.662 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:27.662 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:27.662 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168386 2024-04-19T02:17:27.662 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.662 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:27.662 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.662 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:27.662 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069653+0000", 2024-04-19T02:17:27.662 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:27.662 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.662 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:27.663 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069653+0000", 2024-04-19T02:17:27.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:27.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:27.663 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069652+0000", 2024-04-19T02:17:27.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:27.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:27.663 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069654+0000", 2024-04-19T02:17:27.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1220000000000002e-06 2024-04-19T02:17:27.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.664 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.664 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:27.664 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069660+0000", 2024-04-19T02:17:27.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5890000000000002e-06 2024-04-19T02:17:27.664 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.664 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.664 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.664 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069665+0000", 2024-04-19T02:17:27.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.989e-06 2024-04-19T02:17:27.664 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.664 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.664 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:27.664 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120220+0000", 2024-04-19T02:17:27.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050555061999999998 2024-04-19T02:17:27.664 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.665 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.665 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:27.665 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120329+0000", 2024-04-19T02:17:27.665 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010922200000000001 2024-04-19T02:17:27.665 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.665 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.665 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:27.665 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.128293+0000", 2024-04-19T02:17:27.665 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079640279999999997 2024-04-19T02:17:27.665 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.665 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.665 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:27.665 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.128336+0000", 2024-04-19T02:17:27.665 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2245e-05 2024-04-19T02:17:27.665 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.665 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.666 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:27.666 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.128401+0000", 2024-04-19T02:17:27.666 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5975000000000004e-05 2024-04-19T02:17:27.666 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:27.666 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:27.666 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:27.666 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.666 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.666 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168387 5.f 5:ff36d1d9:::benchmark_data_smithi121_44835_object34352:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:27.666 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:27.666 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.504651302999999, 2024-04-19T02:17:27.666 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049975358999999997, 2024-04-19T02:17:27.666 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:27.666 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:27.667 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:27.667 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:27.667 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:27.667 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168387 2024-04-19T02:17:27.667 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.667 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:27.667 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.667 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:27.667 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:27.667 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:27.667 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.667 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.667 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:27.667 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:27.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:27.668 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:27.668 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:27.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:27.668 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:27.668 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069671+0000", 2024-04-19T02:17:27.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1739999999999999e-06 2024-04-19T02:17:27.668 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:27.668 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069677+0000", 2024-04-19T02:17:27.669 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4519999999999996e-06 2024-04-19T02:17:27.669 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.669 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.669 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.669 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069682+0000", 2024-04-19T02:17:27.669 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5400000000000003e-06 2024-04-19T02:17:27.669 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.669 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.669 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:27.669 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072634+0000", 2024-04-19T02:17:27.669 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0029521510000000001 2024-04-19T02:17:27.669 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.669 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.669 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:27.669 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072706+0000", 2024-04-19T02:17:27.670 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1996999999999995e-05 2024-04-19T02:17:27.670 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.670 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.670 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:27.670 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072772+0000", 2024-04-19T02:17:27.670 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5380000000000001e-05 2024-04-19T02:17:27.670 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.670 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.670 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:27.670 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117549+0000", 2024-04-19T02:17:27.670 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044777124000000001 2024-04-19T02:17:27.670 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.670 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.670 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:27.671 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119572+0000", 2024-04-19T02:17:27.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002022893 2024-04-19T02:17:27.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.671 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:27.671 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119613+0000", 2024-04-19T02:17:27.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0849999999999997e-05 2024-04-19T02:17:27.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.671 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:27.671 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119645+0000", 2024-04-19T02:17:27.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2113000000000002e-05 2024-04-19T02:17:27.671 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:27.671 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:27.671 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:27.672 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.672 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.672 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168389 5.2 5:4bcb87b1:::benchmark_data_smithi121_44835_object34354:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:27.672 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.071719+0000", 2024-04-19T02:17:27.672 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.502602207000001, 2024-04-19T02:17:27.672 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.048248604, 2024-04-19T02:17:27.672 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:27.672 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:27.672 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:27.672 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:27.672 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:27.672 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168389 2024-04-19T02:17:27.672 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.672 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:27.672 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.673 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:27.673 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071719+0000", 2024-04-19T02:17:27.673 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:27.673 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.673 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.673 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:27.673 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071719+0000", 2024-04-19T02:17:27.673 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:27.673 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.673 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.673 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:27.673 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071718+0000", 2024-04-19T02:17:27.673 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:27.673 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.674 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.674 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:27.674 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071722+0000", 2024-04-19T02:17:27.674 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8590000000000004e-06 2024-04-19T02:17:27.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.674 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.674 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:27.674 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071730+0000", 2024-04-19T02:17:27.674 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8569999999999995e-06 2024-04-19T02:17:27.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.674 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.674 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.674 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071736+0000", 2024-04-19T02:17:27.674 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.127e-06 2024-04-19T02:17:27.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.675 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.675 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:27.675 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071769+0000", 2024-04-19T02:17:27.675 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3052000000000001e-05 2024-04-19T02:17:27.675 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.675 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.675 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:27.675 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071843+0000", 2024-04-19T02:17:27.675 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3683000000000006e-05 2024-04-19T02:17:27.675 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.675 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.675 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:27.675 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119852+0000", 2024-04-19T02:17:27.675 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.048009353999999997 2024-04-19T02:17:27.676 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.676 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.676 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:27.676 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119896+0000", 2024-04-19T02:17:27.676 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3102000000000002e-05 2024-04-19T02:17:27.676 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.676 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.676 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:27.676 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119967+0000", 2024-04-19T02:17:27.676 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1589999999999997e-05 2024-04-19T02:17:27.676 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:27.676 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:27.676 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:27.676 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.676 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.677 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168391 5.3 5:c5d9b5e1:::benchmark_data_smithi121_44835_object34356:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:27.677 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.074402+0000", 2024-04-19T02:17:27.677 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.499918367999999, 2024-04-19T02:17:27.677 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.045426756999999998, 2024-04-19T02:17:27.677 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:27.677 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:27.677 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:27.677 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:27.677 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:27.677 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168391 2024-04-19T02:17:27.677 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.677 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:27.677 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.677 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:27.678 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074402+0000", 2024-04-19T02:17:27.678 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:27.678 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.678 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.678 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:27.678 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074402+0000", 2024-04-19T02:17:27.678 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:27.678 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.678 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.678 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:27.678 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074401+0000", 2024-04-19T02:17:27.678 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:27.678 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.678 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.679 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:27.679 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074406+0000", 2024-04-19T02:17:27.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5879999999999999e-06 2024-04-19T02:17:27.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.679 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.679 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:27.679 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074414+0000", 2024-04-19T02:17:27.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8599999999999993e-06 2024-04-19T02:17:27.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.679 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.679 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.679 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074420+0000", 2024-04-19T02:17:27.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6350000000000003e-06 2024-04-19T02:17:27.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.679 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.680 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:27.680 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074453+0000", 2024-04-19T02:17:27.680 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3874000000000001e-05 2024-04-19T02:17:27.680 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.680 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:27.680 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074531+0000", 2024-04-19T02:17:27.680 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7999999999999999e-05 2024-04-19T02:17:27.680 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.680 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:27.680 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119717+0000", 2024-04-19T02:17:27.680 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.045185395000000003 2024-04-19T02:17:27.680 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.681 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:27.681 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119756+0000", 2024-04-19T02:17:27.681 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9110000000000003e-05 2024-04-19T02:17:27.681 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.681 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.681 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:27.681 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119829+0000", 2024-04-19T02:17:27.681 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3238000000000006e-05 2024-04-19T02:17:27.681 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:27.681 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:27.681 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:27.681 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.681 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.681 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4549.0:168377 5.d e52/16 ondisk, result = 0)", 2024-04-19T02:17:27.682 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.077260+0000", 2024-04-19T02:17:27.682 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.497060627, 2024-04-19T02:17:27.682 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042613204000000002, 2024-04-19T02:17:27.682 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:27.682 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:27.682 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:27.682 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.682 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:27.682 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.077260+0000", 2024-04-19T02:17:27.682 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:27.682 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.682 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.682 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:27.682 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.077260+0000", 2024-04-19T02:17:27.683 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:27.683 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.683 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.683 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:27.683 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.077259+0000", 2024-04-19T02:17:27.683 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:27.683 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.683 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.683 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:27.683 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.077267+0000", 2024-04-19T02:17:27.683 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6799999999999993e-06 2024-04-19T02:17:27.683 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.683 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.683 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:27.683 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117372+0000", 2024-04-19T02:17:27.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040105342000000002 2024-04-19T02:17:27.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.684 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.684 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117389+0000", 2024-04-19T02:17:27.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6711e-05 2024-04-19T02:17:27.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.684 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:27.684 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119862+0000", 2024-04-19T02:17:27.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0024730580000000002 2024-04-19T02:17:27.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.684 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:27.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119867+0000", 2024-04-19T02:17:27.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1590000000000001e-06 2024-04-19T02:17:27.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:27.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:27.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:27.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119873+0000", 2024-04-19T02:17:27.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1410000000000002e-06 2024-04-19T02:17:27.685 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:27.685 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:27.685 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:27.685 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:27.685 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:27.685 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:27.686 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:17:27.687 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:17:27.688 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:17:27.688 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:27.686+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:27.689 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:17:27.689 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:17:27.689 INFO:teuthology.orchestra.run.smithi121.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T02:17:27.689 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:17:27.787 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:27.787+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:27.870 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:17:27.870 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:17:27.870 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.870 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:212788 5.b 5:d5b9f24f:::benchmark_data_smithi121_44835_object78753:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T02:17:27.870 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:27.867483+0000", 2024-04-19T02:17:27.870 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0029947659999999998, 2024-04-19T02:17:27.870 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0030161239999999998, 2024-04-19T02:17:27.871 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:27.871 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:27.871 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:27.871 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:27.871 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:27.871 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 212788 2024-04-19T02:17:27.871 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.871 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:27.871 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.871 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:27.871 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.867483+0000", 2024-04-19T02:17:27.871 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:27.871 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.871 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.871 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:27.872 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.867483+0000", 2024-04-19T02:17:27.872 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:27.872 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.872 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.872 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:27.872 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.867483+0000", 2024-04-19T02:17:27.872 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:27.872 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.872 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.872 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:27.872 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.867488+0000", 2024-04-19T02:17:27.872 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8659999999999997e-06 2024-04-19T02:17:27.872 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.872 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.872 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:27.873 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.867494+0000", 2024-04-19T02:17:27.873 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.0220000000000001e-06 2024-04-19T02:17:27.873 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.873 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.873 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.873 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.867499+0000", 2024-04-19T02:17:27.873 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.3499999999999996e-06 2024-04-19T02:17:27.873 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.873 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.873 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:27.873 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.867889+0000", 2024-04-19T02:17:27.873 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00038976899999999999 2024-04-19T02:17:27.873 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.873 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.873 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:27.874 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.867965+0000", 2024-04-19T02:17:27.874 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.6769999999999999e-05 2024-04-19T02:17:27.874 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:27.874 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:27.874 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:27.874 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.874 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.874 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:212790 5.a 5:5a3b684c:::benchmark_data_smithi121_44835_object78755:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T02:17:27.874 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:27.867592+0000", 2024-04-19T02:17:27.874 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0028862639999999999, 2024-04-19T02:17:27.874 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.002955956, 2024-04-19T02:17:27.874 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:27.874 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:27.874 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:27.875 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:27.875 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:27.875 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 212790 2024-04-19T02:17:27.875 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.875 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:27.875 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.875 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:27.875 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.867592+0000", 2024-04-19T02:17:27.875 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:27.875 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.875 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.875 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:27.875 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.867592+0000", 2024-04-19T02:17:27.875 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:27.876 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.876 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.876 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:27.876 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.867591+0000", 2024-04-19T02:17:27.876 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:27.876 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.876 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.876 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:27.876 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.867595+0000", 2024-04-19T02:17:27.876 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0060000000000003e-06 2024-04-19T02:17:27.876 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.876 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.876 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:27.876 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.867604+0000", 2024-04-19T02:17:27.877 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.242e-06 2024-04-19T02:17:27.877 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.877 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.877 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.877 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.867609+0000", 2024-04-19T02:17:27.877 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.1610000000000002e-06 2024-04-19T02:17:27.877 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.877 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.877 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:27.877 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.867653+0000", 2024-04-19T02:17:27.877 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4118e-05 2024-04-19T02:17:27.877 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.877 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.877 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:27.878 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.867787+0000", 2024-04-19T02:17:27.878 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013374700000000001 2024-04-19T02:17:27.878 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:27.878 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:27.878 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:27.878 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.878 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.878 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:212791 5.a 5:5a2e85a7:::benchmark_data_smithi121_44835_object78756:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T02:17:27.878 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:27.867692+0000", 2024-04-19T02:17:27.878 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.002786256, 2024-04-19T02:17:27.878 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0029210830000000001, 2024-04-19T02:17:27.878 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:27.878 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:27.878 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:27.879 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:27.879 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:27.879 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 212791 2024-04-19T02:17:27.879 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.879 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:27.879 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.879 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:27.879 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.867692+0000", 2024-04-19T02:17:27.879 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:27.879 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.879 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.879 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:27.879 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.867692+0000", 2024-04-19T02:17:27.879 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:27.880 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.880 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.880 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:27.880 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.867691+0000", 2024-04-19T02:17:27.880 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:27.880 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.880 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.880 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:27.880 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.867694+0000", 2024-04-19T02:17:27.880 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0249999999999998e-06 2024-04-19T02:17:27.880 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.880 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.880 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:27.880 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.867700+0000", 2024-04-19T02:17:27.880 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7400000000000001e-06 2024-04-19T02:17:27.881 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.881 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.881 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.881 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.867704+0000", 2024-04-19T02:17:27.881 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9940000000000002e-06 2024-04-19T02:17:27.881 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.881 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.881 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:27.881 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.869896+0000", 2024-04-19T02:17:27.881 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0021920619999999998 2024-04-19T02:17:27.881 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.881 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.881 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:27.881 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.870032+0000", 2024-04-19T02:17:27.881 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000135351 2024-04-19T02:17:27.881 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:27.882 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:27.882 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:27.882 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.882 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.882 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:212793 5.b 5:df2d412d:::benchmark_data_smithi121_44835_object78758:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T02:17:27.882 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:27.867867+0000", 2024-04-19T02:17:27.882 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.002611169, 2024-04-19T02:17:27.882 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0028295949999999999, 2024-04-19T02:17:27.882 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:27.882 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:27.882 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:27.882 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:27.882 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:27.882 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 212793 2024-04-19T02:17:27.883 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.883 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:27.883 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.883 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:27.883 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.867867+0000", 2024-04-19T02:17:27.883 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:27.883 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.883 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.883 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:27.883 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.867867+0000", 2024-04-19T02:17:27.883 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:27.883 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.883 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.883 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:27.883 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.867866+0000", 2024-04-19T02:17:27.884 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:27.884 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.884 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.884 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:27.884 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.867870+0000", 2024-04-19T02:17:27.884 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1470000000000003e-06 2024-04-19T02:17:27.884 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.884 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.884 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:27.884 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.867878+0000", 2024-04-19T02:17:27.884 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.8499999999999994e-06 2024-04-19T02:17:27.884 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.884 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.884 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.884 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.867884+0000", 2024-04-19T02:17:27.885 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.8409999999999996e-06 2024-04-19T02:17:27.885 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.885 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.885 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:27.885 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.869981+0000", 2024-04-19T02:17:27.885 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0020972709999999999 2024-04-19T02:17:27.885 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.885 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.885 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:27.885 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.870109+0000", 2024-04-19T02:17:27.885 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012774499999999999 2024-04-19T02:17:27.885 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:27.885 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:27.885 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:27.886 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.886 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.886 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:212795 5.d e58/16 5:bfa15fa1:::benchmark_data_smithi121_44835_object78760:head v 58'13319, mlcod=58'13317)", 2024-04-19T02:17:27.886 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:27.868292+0000", 2024-04-19T02:17:27.886 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0021859940000000001, 2024-04-19T02:17:27.886 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0024708880000000001, 2024-04-19T02:17:27.886 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:27.886 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:27.886 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:27.886 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.886 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:27.886 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.868292+0000", 2024-04-19T02:17:27.886 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:27.886 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.887 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.887 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:27.887 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.868292+0000", 2024-04-19T02:17:27.887 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:27.887 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.887 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.887 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:27.887 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.868292+0000", 2024-04-19T02:17:27.887 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:27.887 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.887 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.887 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:27.887 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.868295+0000", 2024-04-19T02:17:27.887 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5240000000000001e-06 2024-04-19T02:17:27.887 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.888 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.888 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:27.888 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.868304+0000", 2024-04-19T02:17:27.888 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.1300000000000001e-06 2024-04-19T02:17:27.888 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.888 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.888 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.888 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.868308+0000", 2024-04-19T02:17:27.888 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.6129999999999997e-06 2024-04-19T02:17:27.888 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.888 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.888 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:27.888 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.868341+0000", 2024-04-19T02:17:27.888 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2499999999999997e-05 2024-04-19T02:17:27.888 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.889 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.889 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:27.889 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.868359+0000", 2024-04-19T02:17:27.889 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.8518000000000001e-05 2024-04-19T02:17:27.889 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:27.889 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:27.889 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:27.889 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.889 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.889 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:212798 5.e 5:722488d4:::benchmark_data_smithi121_44835_object78763:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T02:17:27.889 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:27.870137+0000", 2024-04-19T02:17:27.889 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.00034095099999999998, 2024-04-19T02:17:27.889 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00066258199999999999, 2024-04-19T02:17:27.889 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:27.889 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:27.889 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:27.890 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:27.890 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:27.890 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 212798 2024-04-19T02:17:27.890 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.890 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:27.890 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.890 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:27.890 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.870137+0000", 2024-04-19T02:17:27.890 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:27.890 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.890 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.890 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:27.890 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.870137+0000", 2024-04-19T02:17:27.890 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:27.891 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.891 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.891 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:27.891 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.870136+0000", 2024-04-19T02:17:27.891 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:27.891 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.891 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.891 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:27.891 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.870142+0000", 2024-04-19T02:17:27.891 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2580000000000003e-06 2024-04-19T02:17:27.891 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.891 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.891 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:27.891 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.870151+0000", 2024-04-19T02:17:27.891 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.5610000000000004e-06 2024-04-19T02:17:27.892 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.892 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.892 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.892 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.870158+0000", 2024-04-19T02:17:27.892 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6139999999999997e-06 2024-04-19T02:17:27.892 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.892 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.892 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:27.892 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.870192+0000", 2024-04-19T02:17:27.892 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4616999999999997e-05 2024-04-19T02:17:27.892 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.892 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.892 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:27.892 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.870276+0000", 2024-04-19T02:17:27.892 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.3765999999999997e-05 2024-04-19T02:17:27.893 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:27.893 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:27.893 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:27.893 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.893 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.893 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:212799 5.b 5.601f6f1b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T02:17:27.893 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:27.870166+0000", 2024-04-19T02:17:27.893 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.00031178299999999999, 2024-04-19T02:17:27.893 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00066919899999999999, 2024-04-19T02:17:27.893 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:27.893 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "queued for pg", 2024-04-19T02:17:27.893 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:27.893 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:27.893 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:27.893 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 212799 2024-04-19T02:17:27.893 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.894 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:27.894 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.894 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:27.894 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.870166+0000", 2024-04-19T02:17:27.894 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:27.894 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.894 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.894 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:27.894 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.870166+0000", 2024-04-19T02:17:27.894 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:27.894 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.894 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.894 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:27.894 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.870166+0000", 2024-04-19T02:17:27.895 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:27.895 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.895 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.895 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:27.895 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.870169+0000", 2024-04-19T02:17:27.895 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.548e-06 2024-04-19T02:17:27.895 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.895 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.895 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:27.895 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.870175+0000", 2024-04-19T02:17:27.895 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.9669999999999998e-06 2024-04-19T02:17:27.895 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.895 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.895 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.896 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.870181+0000", 2024-04-19T02:17:27.896 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6930000000000001e-06 2024-04-19T02:17:27.896 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:27.896 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:27.896 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:27.896 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.896 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.896 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:212800 5.d e58/16 5:b2828e02:::benchmark_data_smithi121_44835_object78765:head v 58'13320, mlcod=58'13317)", 2024-04-19T02:17:27.896 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:27.870566+0000", 2024-04-19T02:17:27.896 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 4294967295.9999123, 2024-04-19T02:17:27.896 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00030039900000000002, 2024-04-19T02:17:27.896 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:27.896 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:27.896 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:27.896 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.897 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:27.897 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.870566+0000", 2024-04-19T02:17:27.897 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:27.897 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.897 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.897 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:27.897 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.870566+0000", 2024-04-19T02:17:27.897 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:27.897 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.897 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.897 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:27.897 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.870565+0000", 2024-04-19T02:17:27.897 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:27.897 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.898 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.898 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:27.898 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.870572+0000", 2024-04-19T02:17:27.898 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.0790000000000003e-06 2024-04-19T02:17:27.898 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.898 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.898 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:27.898 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.870587+0000", 2024-04-19T02:17:27.898 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.4324e-05 2024-04-19T02:17:27.898 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.898 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.898 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.898 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.870594+0000", 2024-04-19T02:17:27.898 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.6690000000000006e-06 2024-04-19T02:17:27.898 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.899 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.899 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:27.899 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.870623+0000", 2024-04-19T02:17:27.899 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.8770999999999999e-05 2024-04-19T02:17:27.899 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.899 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.899 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:27.899 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.870641+0000", 2024-04-19T02:17:27.899 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.8099999999999999e-05 2024-04-19T02:17:27.899 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:27.899 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:27.899 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:27.899 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.899 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.900 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:212802 5.f e58/16 5:f304a986:::benchmark_data_smithi121_44835_object78767:head v 58'13356, mlcod=58'13353)", 2024-04-19T02:17:27.900 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:27.870656+0000", 2024-04-19T02:17:27.900 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 4294967295.9998221, 2024-04-19T02:17:27.900 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00024650900000000001, 2024-04-19T02:17:27.900 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:27.900 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:27.900 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:27.900 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.900 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:27.900 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.870656+0000", 2024-04-19T02:17:27.900 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:27.900 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.900 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.900 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:27.900 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.870656+0000", 2024-04-19T02:17:27.900 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:27.901 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.901 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.901 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:27.901 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.870656+0000", 2024-04-19T02:17:27.901 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:27.901 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.901 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.901 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:27.901 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.870660+0000", 2024-04-19T02:17:27.901 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7579999999999998e-06 2024-04-19T02:17:27.901 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.901 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.901 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:27.901 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.870665+0000", 2024-04-19T02:17:27.901 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2100000000000001e-06 2024-04-19T02:17:27.901 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.902 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.902 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:27.902 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.870669+0000", 2024-04-19T02:17:27.902 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0620000000000002e-06 2024-04-19T02:17:27.902 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.902 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.902 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:27.902 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.870696+0000", 2024-04-19T02:17:27.902 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7565000000000001e-05 2024-04-19T02:17:27.902 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:27.902 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:27.902 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:27.902 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:27.870714+0000", 2024-04-19T02:17:27.902 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.7280999999999999e-05 2024-04-19T02:17:27.902 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:27.903 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:27.903 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:27.903 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:27.903 INFO:teuthology.orchestra.run.smithi174.stdout: ], 2024-04-19T02:17:27.903 INFO:teuthology.orchestra.run.smithi174.stdout: "num_ops": 9 2024-04-19T02:17:27.903 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:17:27.904 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:17:27.905 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:27.904+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:28.005 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:28.005+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:28.106 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:28.107+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:28.124 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:17:28.124 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [], 2024-04-19T02:17:28.124 INFO:teuthology.orchestra.run.smithi174.stdout: "complaint_time": 30, 2024-04-19T02:17:28.124 INFO:teuthology.orchestra.run.smithi174.stdout: "num_blocked_ops": 0 2024-04-19T02:17:28.124 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:17:28.140 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:17:28.207 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:28.207+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:28.308 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:28.308+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:28.319 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T02:17:28.358 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:17:28.358 INFO:teuthology.orchestra.run.smithi174.stdout: "size": 20, 2024-04-19T02:17:28.358 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 600, 2024-04-19T02:17:28.358 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:17:28.358 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.358 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:19 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:28.359 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:17:28.359 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 119.087206577, 2024-04-19T02:17:28.359 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020818203, 2024-04-19T02:17:28.359 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:28.359 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:28.359 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:28.359 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.359 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:28.359 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:17:28.359 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:28.359 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.359 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.359 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:28.359 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:17:28.360 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:28.360 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.360 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.360 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:28.360 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:17:28.360 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:28.360 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.360 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.360 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:28.360 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270065+0000", 2024-04-19T02:17:28.360 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4310000000000001e-06 2024-04-19T02:17:28.360 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.360 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.360 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:28.360 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270070+0000", 2024-04-19T02:17:28.361 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2859999999999999e-06 2024-04-19T02:17:28.361 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.361 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.361 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:28.361 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270077+0000", 2024-04-19T02:17:28.361 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5270000000000004e-06 2024-04-19T02:17:28.361 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.361 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.361 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:28.361 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270107+0000", 2024-04-19T02:17:28.361 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0205999999999998e-05 2024-04-19T02:17:28.361 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.361 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.361 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:28.362 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270111+0000", 2024-04-19T02:17:28.362 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8650000000000003e-06 2024-04-19T02:17:28.362 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.362 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.362 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:28.362 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285936+0000", 2024-04-19T02:17:28.362 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015824677999999998 2024-04-19T02:17:28.362 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.362 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.362 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:28.362 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286007+0000", 2024-04-19T02:17:28.362 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1157999999999999e-05 2024-04-19T02:17:28.362 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.362 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.362 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:28.363 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286086+0000", 2024-04-19T02:17:28.363 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9084000000000004e-05 2024-04-19T02:17:28.363 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.363 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.363 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:28.363 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290740+0000", 2024-04-19T02:17:28.363 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0046543679999999999 2024-04-19T02:17:28.363 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.363 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.363 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:28.363 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290833+0000", 2024-04-19T02:17:28.363 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2551000000000002e-05 2024-04-19T02:17:28.363 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.363 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.363 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:28.364 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290859+0000", 2024-04-19T02:17:28.364 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.6696999999999999e-05 2024-04-19T02:17:28.364 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.364 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.364 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:28.364 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290881+0000", 2024-04-19T02:17:28.364 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1653000000000001e-05 2024-04-19T02:17:28.364 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:28.364 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:28.364 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:28.364 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.364 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.364 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:77622 5.8 5:166fbe77:::benchmark_data_smithi121_44835_object77621:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:28.364 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:17:28.364 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 61.551709639999999, 2024-04-19T02:17:28.365 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.021784694, 2024-04-19T02:17:28.365 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:28.365 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:28.365 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:28.365 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:28.365 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:28.365 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 77622 2024-04-19T02:17:28.365 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.365 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:28.365 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.365 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:28.365 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:17:28.365 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:28.365 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.365 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.366 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:28.366 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:17:28.366 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:28.366 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.366 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.366 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:28.366 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805559+0000", 2024-04-19T02:17:28.366 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:28.366 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.366 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.366 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:28.366 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805659+0000", 2024-04-19T02:17:28.366 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.9908000000000006e-05 2024-04-19T02:17:28.366 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.366 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.367 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:28.367 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805668+0000", 2024-04-19T02:17:28.367 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2129999999999997e-06 2024-04-19T02:17:28.367 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.367 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.367 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:28.367 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805673+0000", 2024-04-19T02:17:28.367 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0370000000000002e-06 2024-04-19T02:17:28.367 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.367 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.367 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:28.367 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812022+0000", 2024-04-19T02:17:28.367 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0063483239999999998 2024-04-19T02:17:28.367 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.367 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.367 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:28.368 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812129+0000", 2024-04-19T02:17:28.368 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010744200000000001 2024-04-19T02:17:28.368 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.368 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.368 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:28.368 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812252+0000", 2024-04-19T02:17:28.368 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000122519 2024-04-19T02:17:28.368 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.368 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.368 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:28.368 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.820979+0000", 2024-04-19T02:17:28.368 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0087272740000000001 2024-04-19T02:17:28.368 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.368 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.368 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:28.369 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827270+0000", 2024-04-19T02:17:28.369 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0062906239999999999 2024-04-19T02:17:28.369 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.369 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.369 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:28.369 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827309+0000", 2024-04-19T02:17:28.369 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9678999999999997e-05 2024-04-19T02:17:28.369 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.369 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.369 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:28.369 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827345+0000", 2024-04-19T02:17:28.369 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5308000000000001e-05 2024-04-19T02:17:28.369 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:28.369 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:28.369 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:28.369 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.370 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.370 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78224 5.4 5:26e797d5:::benchmark_data_smithi121_44835_object78223:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:28.370 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:17:28.370 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 61.250707441000003, 2024-04-19T02:17:28.370 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.021471998999999999, 2024-04-19T02:17:28.370 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:28.370 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:28.370 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:28.370 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:28.370 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:28.370 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78224 2024-04-19T02:17:28.370 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.370 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:28.370 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.370 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:28.371 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:17:28.371 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:28.371 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.371 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.371 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:28.371 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:17:28.371 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:28.371 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.371 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.371 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:28.371 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106561+0000", 2024-04-19T02:17:28.371 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:28.371 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.371 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.371 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:28.372 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106630+0000", 2024-04-19T02:17:28.372 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.8553999999999994e-05 2024-04-19T02:17:28.372 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.372 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.372 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:28.372 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106644+0000", 2024-04-19T02:17:28.372 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.4651000000000001e-05 2024-04-19T02:17:28.372 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.372 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.372 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:28.372 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106653+0000", 2024-04-19T02:17:28.372 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.6719999999999993e-06 2024-04-19T02:17:28.372 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.372 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.372 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:28.373 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106693+0000", 2024-04-19T02:17:28.373 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9978999999999998e-05 2024-04-19T02:17:28.373 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.373 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.373 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:28.373 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106840+0000", 2024-04-19T02:17:28.373 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0001473 2024-04-19T02:17:28.373 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.373 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.373 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:28.373 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106971+0000", 2024-04-19T02:17:28.373 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013051499999999999 2024-04-19T02:17:28.373 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.373 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.373 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:28.373 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.109047+0000", 2024-04-19T02:17:28.374 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.002076002 2024-04-19T02:17:28.374 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.374 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.374 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:28.374 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.127967+0000", 2024-04-19T02:17:28.374 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.018919780000000001 2024-04-19T02:17:28.374 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.374 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.374 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:28.374 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128004+0000", 2024-04-19T02:17:28.374 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7719000000000003e-05 2024-04-19T02:17:28.374 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.374 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.374 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:28.374 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128034+0000", 2024-04-19T02:17:28.375 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9651000000000001e-05 2024-04-19T02:17:28.375 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:28.375 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:28.375 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:28.375 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.375 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.375 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78259 5.4 5:2aa344b2:::benchmark_data_smithi121_44835_object78258:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:28.375 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:17:28.375 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 61.232012372, 2024-04-19T02:17:28.375 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022934350999999999, 2024-04-19T02:17:28.375 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:28.375 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:28.375 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:28.375 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:28.375 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:28.375 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78259 2024-04-19T02:17:28.376 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.376 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:28.376 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.376 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:28.376 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:17:28.376 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:28.376 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.376 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.376 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:28.376 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:17:28.376 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:28.376 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.376 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.376 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:28.377 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125256+0000", 2024-04-19T02:17:28.377 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:28.377 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.377 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.377 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:28.377 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125347+0000", 2024-04-19T02:17:28.377 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0470000000000006e-05 2024-04-19T02:17:28.377 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.377 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.377 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:28.377 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125358+0000", 2024-04-19T02:17:28.377 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1764e-05 2024-04-19T02:17:28.377 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.377 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.377 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:28.378 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125364+0000", 2024-04-19T02:17:28.378 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7189999999999998e-06 2024-04-19T02:17:28.378 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.378 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.378 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:28.378 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125391+0000", 2024-04-19T02:17:28.378 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7270000000000001e-05 2024-04-19T02:17:28.378 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.378 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.378 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:28.378 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125471+0000", 2024-04-19T02:17:28.378 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9209999999999995e-05 2024-04-19T02:17:28.378 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.378 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.378 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:28.379 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125559+0000", 2024-04-19T02:17:28.379 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.8689000000000004e-05 2024-04-19T02:17:28.379 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.379 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.379 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:28.379 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128164+0000", 2024-04-19T02:17:28.379 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0026050270000000002 2024-04-19T02:17:28.379 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.379 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.379 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:28.379 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148139+0000", 2024-04-19T02:17:28.379 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.019975050000000001 2024-04-19T02:17:28.379 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.379 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.380 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:28.380 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148169+0000", 2024-04-19T02:17:28.380 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0001e-05 2024-04-19T02:17:28.380 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.380 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.380 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:28.380 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148191+0000", 2024-04-19T02:17:28.380 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.2104999999999999e-05 2024-04-19T02:17:28.380 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:28.380 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:28.380 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:28.380 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.380 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.380 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78271 5.4 5:2982d7a6:::benchmark_data_smithi121_44835_object78270:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:28.380 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:17:28.381 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 61.225149141999999, 2024-04-19T02:17:28.381 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020841755999999999, 2024-04-19T02:17:28.381 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:28.381 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:28.381 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:28.381 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:28.381 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:28.381 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78271 2024-04-19T02:17:28.381 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.381 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:28.381 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.381 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:28.381 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:17:28.381 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:28.382 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.382 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.382 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:28.382 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:17:28.382 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:28.382 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.382 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.382 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:28.382 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132119+0000", 2024-04-19T02:17:28.382 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:28.382 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.382 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.382 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:28.382 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132185+0000", 2024-04-19T02:17:28.382 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5994000000000005e-05 2024-04-19T02:17:28.383 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.383 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.383 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:28.383 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132197+0000", 2024-04-19T02:17:28.383 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2091e-05 2024-04-19T02:17:28.383 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.383 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.383 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:28.383 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132206+0000", 2024-04-19T02:17:28.383 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.5099999999999998e-06 2024-04-19T02:17:28.383 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.383 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.383 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:28.383 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132242+0000", 2024-04-19T02:17:28.384 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5663000000000001e-05 2024-04-19T02:17:28.384 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.384 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.384 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:28.384 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132335+0000", 2024-04-19T02:17:28.384 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3275000000000004e-05 2024-04-19T02:17:28.384 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.384 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.384 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:28.384 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132432+0000", 2024-04-19T02:17:28.384 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7571000000000005e-05 2024-04-19T02:17:28.384 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.384 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.384 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:28.384 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.136706+0000", 2024-04-19T02:17:28.385 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0042738170000000001 2024-04-19T02:17:28.385 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.385 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.385 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:28.385 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152909+0000", 2024-04-19T02:17:28.385 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016202415000000001 2024-04-19T02:17:28.385 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.385 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.385 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:28.385 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152938+0000", 2024-04-19T02:17:28.385 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9740999999999999e-05 2024-04-19T02:17:28.385 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.385 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.385 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:28.385 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152962+0000", 2024-04-19T02:17:28.386 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3659000000000002e-05 2024-04-19T02:17:28.386 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:28.386 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:28.386 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:28.386 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.386 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.386 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78272 5.4 5:273e819a:::benchmark_data_smithi121_44835_object78271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:28.386 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:28.386 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 61.224660098999998, 2024-04-19T02:17:28.386 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022180163999999999, 2024-04-19T02:17:28.386 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:28.386 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:28.386 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:28.386 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:28.386 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:28.387 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78272 2024-04-19T02:17:28.387 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.387 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:28.387 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.387 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:28.387 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:28.387 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:28.387 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.387 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.387 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:28.387 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:28.387 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:28.387 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.387 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.388 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:28.388 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:28.388 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:28.388 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.388 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.388 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:28.388 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132690+0000", 2024-04-19T02:17:28.388 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0963000000000004e-05 2024-04-19T02:17:28.388 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.388 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.388 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:28.388 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132703+0000", 2024-04-19T02:17:28.388 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.3072e-05 2024-04-19T02:17:28.388 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.388 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.388 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:28.389 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132710+0000", 2024-04-19T02:17:28.389 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3100000000000003e-06 2024-04-19T02:17:28.389 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.389 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.389 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:28.389 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134005+0000", 2024-04-19T02:17:28.389 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001294513 2024-04-19T02:17:28.389 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.389 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.389 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:28.389 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134139+0000", 2024-04-19T02:17:28.389 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000134447 2024-04-19T02:17:28.389 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.389 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.389 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:28.389 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134284+0000", 2024-04-19T02:17:28.389 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014514399999999999 2024-04-19T02:17:28.390 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.390 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.390 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:28.390 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.139622+0000", 2024-04-19T02:17:28.390 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0053373830000000002 2024-04-19T02:17:28.390 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.390 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.390 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:28.390 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154737+0000", 2024-04-19T02:17:28.390 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015115195999999999 2024-04-19T02:17:28.390 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.390 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.390 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:28.391 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154768+0000", 2024-04-19T02:17:28.391 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0824999999999997e-05 2024-04-19T02:17:28.391 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.391 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.391 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:28.391 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154790+0000", 2024-04-19T02:17:28.391 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1999000000000001e-05 2024-04-19T02:17:28.391 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:28.391 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:28.391 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:28.391 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.391 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.391 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:94481 5.e 5:7b2fbebf:::benchmark_data_smithi121_44835_object94480:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:28.391 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:17:28.391 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 53.236023781999997, 2024-04-19T02:17:28.392 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020897846000000001, 2024-04-19T02:17:28.392 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:28.392 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:28.392 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:28.392 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:28.392 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:28.392 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 94481 2024-04-19T02:17:28.392 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.392 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:28.392 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.392 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:28.392 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:17:28.392 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:28.392 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.392 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.393 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:28.393 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:17:28.393 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:28.393 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.393 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.393 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:28.393 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121245+0000", 2024-04-19T02:17:28.393 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:28.393 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.393 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.393 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:28.393 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121273+0000", 2024-04-19T02:17:28.393 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7250000000000002e-05 2024-04-19T02:17:28.393 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.393 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.394 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:28.394 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121277+0000", 2024-04-19T02:17:28.394 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2860000000000001e-06 2024-04-19T02:17:28.394 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.394 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.394 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:28.394 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121280+0000", 2024-04-19T02:17:28.394 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2739999999999999e-06 2024-04-19T02:17:28.394 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.394 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.394 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:28.394 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121320+0000", 2024-04-19T02:17:28.394 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9879000000000002e-05 2024-04-19T02:17:28.394 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.395 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.395 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:28.395 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121448+0000", 2024-04-19T02:17:28.395 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012748800000000001 2024-04-19T02:17:28.395 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.395 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.395 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:28.395 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121595+0000", 2024-04-19T02:17:28.395 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014741299999999999 2024-04-19T02:17:28.395 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.395 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.395 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:28.395 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.127776+0000", 2024-04-19T02:17:28.395 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0061811360000000003 2024-04-19T02:17:28.395 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.395 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.396 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:28.396 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142073+0000", 2024-04-19T02:17:28.396 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014296959999999999 2024-04-19T02:17:28.396 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.396 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.396 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:28.396 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142106+0000", 2024-04-19T02:17:28.396 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3348e-05 2024-04-19T02:17:28.396 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.396 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.396 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:28.396 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142144+0000", 2024-04-19T02:17:28.396 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7153000000000002e-05 2024-04-19T02:17:28.396 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:28.396 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:28.396 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:28.397 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.397 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.397 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:94581 5.b 5:dc86d6e9:::benchmark_data_smithi121_44835_object94580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:28.397 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:28.397 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 53.177089209000002, 2024-04-19T02:17:28.397 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022099711000000001, 2024-04-19T02:17:28.397 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:28.397 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:28.397 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:28.397 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:28.397 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:28.397 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 94581 2024-04-19T02:17:28.397 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.397 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:28.397 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.397 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:28.397 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:28.398 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:28.398 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.398 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.398 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:28.398 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:28.398 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:28.398 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.398 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.398 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:28.398 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:28.398 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:28.398 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.398 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.398 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:28.398 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180253+0000", 2024-04-19T02:17:28.399 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3163000000000004e-05 2024-04-19T02:17:28.399 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.399 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.399 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:28.399 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180266+0000", 2024-04-19T02:17:28.399 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2886e-05 2024-04-19T02:17:28.399 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.399 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.399 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:28.399 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180273+0000", 2024-04-19T02:17:28.399 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.4059999999999999e-06 2024-04-19T02:17:28.399 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.399 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.399 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:28.399 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180646+0000", 2024-04-19T02:17:28.399 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00037283999999999999 2024-04-19T02:17:28.399 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.400 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.400 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:28.400 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180774+0000", 2024-04-19T02:17:28.400 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012793799999999999 2024-04-19T02:17:28.400 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.400 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.400 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:28.400 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180920+0000", 2024-04-19T02:17:28.400 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000146692 2024-04-19T02:17:28.400 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.400 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.400 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:28.400 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.183344+0000", 2024-04-19T02:17:28.400 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0024231669999999999 2024-04-19T02:17:28.400 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.400 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.400 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:28.401 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202196+0000", 2024-04-19T02:17:28.401 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.018852384 2024-04-19T02:17:28.401 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.401 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.401 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:28.401 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202241+0000", 2024-04-19T02:17:28.401 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4923999999999999e-05 2024-04-19T02:17:28.401 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.401 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.401 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:28.401 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202280+0000", 2024-04-19T02:17:28.401 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9096e-05 2024-04-19T02:17:28.401 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:28.401 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:28.401 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:28.402 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.402 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.402 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:96356 5.0 5:0a661b39:::benchmark_data_smithi121_44835_object96355:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:28.402 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:17:28.402 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 52.263876367000002, 2024-04-19T02:17:28.402 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020955516, 2024-04-19T02:17:28.402 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:28.402 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:28.402 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:28.402 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:28.402 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:28.402 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 96356 2024-04-19T02:17:28.402 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.402 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:28.402 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.403 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:28.403 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:17:28.403 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:28.403 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.403 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.403 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:28.403 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:17:28.403 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:28.403 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.403 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.403 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:28.403 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:17:28.403 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:28.403 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.403 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.404 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:28.404 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093455+0000", 2024-04-19T02:17:28.404 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.2205000000000005e-05 2024-04-19T02:17:28.404 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.404 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.404 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:28.404 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093464+0000", 2024-04-19T02:17:28.404 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3910000000000004e-06 2024-04-19T02:17:28.404 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.404 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.404 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:28.404 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093469+0000", 2024-04-19T02:17:28.404 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.7249999999999997e-06 2024-04-19T02:17:28.404 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.404 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.404 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:28.404 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099643+0000", 2024-04-19T02:17:28.404 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0061743359999999999 2024-04-19T02:17:28.405 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.405 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.405 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:28.405 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099774+0000", 2024-04-19T02:17:28.405 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013050599999999999 2024-04-19T02:17:28.405 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.405 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.405 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:28.405 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099917+0000", 2024-04-19T02:17:28.405 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000143187 2024-04-19T02:17:28.405 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.405 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.405 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:28.405 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.105432+0000", 2024-04-19T02:17:28.405 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.005514873 2024-04-19T02:17:28.405 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.405 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.406 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:28.406 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114264+0000", 2024-04-19T02:17:28.406 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.008831752 2024-04-19T02:17:28.406 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.406 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.406 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:28.406 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114300+0000", 2024-04-19T02:17:28.406 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6582000000000003e-05 2024-04-19T02:17:28.406 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.406 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.406 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:28.406 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114349+0000", 2024-04-19T02:17:28.406 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8579999999999999e-05 2024-04-19T02:17:28.406 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:28.407 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:28.407 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:28.407 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.407 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.407 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:96357 5.0 5:00efce8b:::benchmark_data_smithi121_44835_object96356:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:28.407 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:17:28.407 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 52.263796689000003, 2024-04-19T02:17:28.407 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020937471999999999, 2024-04-19T02:17:28.407 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:28.407 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:28.407 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:28.407 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:28.407 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:28.407 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 96357 2024-04-19T02:17:28.407 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.408 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:28.408 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.408 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:28.408 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:17:28.408 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:28.408 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.408 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.408 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:28.408 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:17:28.408 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:28.408 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.408 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.408 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:28.408 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093472+0000", 2024-04-19T02:17:28.408 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:28.408 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.409 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.409 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:28.409 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093513+0000", 2024-04-19T02:17:28.409 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0213000000000003e-05 2024-04-19T02:17:28.409 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.409 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.409 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:28.409 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093519+0000", 2024-04-19T02:17:28.409 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.066e-06 2024-04-19T02:17:28.409 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.409 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.409 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:28.409 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093525+0000", 2024-04-19T02:17:28.409 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.8170000000000004e-06 2024-04-19T02:17:28.410 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.410 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.410 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:28.410 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103412+0000", 2024-04-19T02:17:28.410 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0098872739999999997 2024-04-19T02:17:28.410 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.410 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.410 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:28.410 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103551+0000", 2024-04-19T02:17:28.410 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000139295 2024-04-19T02:17:28.410 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.410 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.410 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:28.411 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103701+0000", 2024-04-19T02:17:28.411 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014954599999999999 2024-04-19T02:17:28.411 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.411 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.411 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:28.411 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.108849+0000", 2024-04-19T02:17:28.411 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0051487199999999999 2024-04-19T02:17:28.411 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.411 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.411 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:28.411 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114355+0000", 2024-04-19T02:17:28.411 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0055052529999999999 2024-04-19T02:17:28.411 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.411 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.411 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:28.412 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114379+0000", 2024-04-19T02:17:28.412 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4275000000000001e-05 2024-04-19T02:17:28.412 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.412 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.412 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:28.412 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114410+0000", 2024-04-19T02:17:28.412 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1356999999999998e-05 2024-04-19T02:17:28.412 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:28.412 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:28.412 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:28.412 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.412 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.412 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:104431 5.8 5:14818e19:::benchmark_data_smithi121_44835_object104430:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T02:17:28.412 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:17:28.412 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 48.145884164000002, 2024-04-19T02:17:28.412 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022149528000000002, 2024-04-19T02:17:28.413 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:28.413 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:28.413 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:28.413 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:28.413 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:28.413 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 104431 2024-04-19T02:17:28.413 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.413 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:28.413 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.413 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:28.413 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:17:28.413 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:28.413 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.413 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.413 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:28.413 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:17:28.413 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:28.414 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.414 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.414 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:28.414 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211384+0000", 2024-04-19T02:17:28.414 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:28.414 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.414 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.414 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:28.414 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211458+0000", 2024-04-19T02:17:28.414 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3311000000000003e-05 2024-04-19T02:17:28.414 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.414 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.414 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:28.415 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211471+0000", 2024-04-19T02:17:28.415 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.3308e-05 2024-04-19T02:17:28.415 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.415 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.415 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:28.415 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211479+0000", 2024-04-19T02:17:28.415 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0909999999999993e-06 2024-04-19T02:17:28.415 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.415 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.415 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:28.415 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.221821+0000", 2024-04-19T02:17:28.415 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010341596999999999 2024-04-19T02:17:28.415 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.415 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.416 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:28.416 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.221966+0000", 2024-04-19T02:17:28.416 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000145167 2024-04-19T02:17:28.416 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.416 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.416 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:28.416 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.222077+0000", 2024-04-19T02:17:28.416 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011128000000000001 2024-04-19T02:17:28.416 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.416 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.416 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:28.416 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.228126+0000", 2024-04-19T02:17:28.416 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0060486710000000003 2024-04-19T02:17:28.416 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.416 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.416 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:28.417 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233449+0000", 2024-04-19T02:17:28.417 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0053231370000000004 2024-04-19T02:17:28.417 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.417 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.417 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:28.417 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233498+0000", 2024-04-19T02:17:28.417 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8798999999999998e-05 2024-04-19T02:17:28.417 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.417 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.417 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:28.417 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233535+0000", 2024-04-19T02:17:28.417 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7119000000000002e-05 2024-04-19T02:17:28.417 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:28.417 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:28.418 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:28.418 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.418 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.418 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157437 5.e 5:78833a3d:::benchmark_data_smithi121_44835_object23402:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:28.418 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.859854+0000", 2024-04-19T02:17:28.418 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 21.497415392000001, 2024-04-19T02:17:28.418 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.025859589999999998, 2024-04-19T02:17:28.418 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:28.418 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:28.418 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:28.418 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:28.418 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:28.418 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157437 2024-04-19T02:17:28.418 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.418 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:28.419 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.419 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:28.419 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859854+0000", 2024-04-19T02:17:28.419 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:28.419 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.419 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.419 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:28.419 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859854+0000", 2024-04-19T02:17:28.419 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:28.419 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.419 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.419 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:28.419 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859853+0000", 2024-04-19T02:17:28.419 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:28.419 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.420 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.420 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:28.420 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859857+0000", 2024-04-19T02:17:28.420 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8789999999999996e-06 2024-04-19T02:17:28.420 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.420 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.420 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:28.420 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859865+0000", 2024-04-19T02:17:28.420 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.1880000000000002e-06 2024-04-19T02:17:28.420 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.420 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.420 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:28.420 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859873+0000", 2024-04-19T02:17:28.420 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.2980000000000003e-06 2024-04-19T02:17:28.421 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.421 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.421 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:28.421 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859908+0000", 2024-04-19T02:17:28.421 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5682999999999997e-05 2024-04-19T02:17:28.421 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.421 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.421 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:28.421 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.860046+0000", 2024-04-19T02:17:28.421 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013714200000000001 2024-04-19T02:17:28.421 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.421 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.421 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:28.421 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.860153+0000", 2024-04-19T02:17:28.422 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010725700000000001 2024-04-19T02:17:28.422 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.422 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.422 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:28.422 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.862008+0000", 2024-04-19T02:17:28.422 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001855179 2024-04-19T02:17:28.422 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.422 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.422 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:28.422 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.885629+0000", 2024-04-19T02:17:28.422 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.023621428 2024-04-19T02:17:28.422 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.422 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.422 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:28.423 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.885676+0000", 2024-04-19T02:17:28.423 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.6371e-05 2024-04-19T02:17:28.423 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.423 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.423 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:28.423 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.885714+0000", 2024-04-19T02:17:28.423 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7907000000000001e-05 2024-04-19T02:17:28.423 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:28.423 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:28.423 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:28.423 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.423 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.423 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157438 5.0 5:01944e77:::benchmark_data_smithi121_44835_object23403:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:28.423 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.864095+0000", 2024-04-19T02:17:28.424 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 21.493174108000002, 2024-04-19T02:17:28.424 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.032015298999999997, 2024-04-19T02:17:28.424 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:28.424 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:28.424 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:28.424 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:28.424 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:28.424 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157438 2024-04-19T02:17:28.424 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.424 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:28.424 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.424 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:28.424 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864095+0000", 2024-04-19T02:17:28.424 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:28.425 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.425 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.425 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:28.425 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864095+0000", 2024-04-19T02:17:28.425 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:28.425 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.425 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.425 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:28.425 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864094+0000", 2024-04-19T02:17:28.425 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:28.425 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.425 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.425 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:28.425 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864102+0000", 2024-04-19T02:17:28.425 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.6629999999999993e-06 2024-04-19T02:17:28.425 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.425 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.425 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:28.426 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864113+0000", 2024-04-19T02:17:28.426 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1185999999999999e-05 2024-04-19T02:17:28.426 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.426 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.426 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:28.426 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864119+0000", 2024-04-19T02:17:28.426 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.224e-06 2024-04-19T02:17:28.426 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.426 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.426 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:28.426 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864151+0000", 2024-04-19T02:17:28.426 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1395e-05 2024-04-19T02:17:28.426 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.426 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.426 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:28.427 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864275+0000", 2024-04-19T02:17:28.427 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012431399999999999 2024-04-19T02:17:28.427 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.427 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.427 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:28.427 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864341+0000", 2024-04-19T02:17:28.427 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6146e-05 2024-04-19T02:17:28.427 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.427 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.427 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:28.427 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.866040+0000", 2024-04-19T02:17:28.427 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016991879999999999 2024-04-19T02:17:28.427 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.427 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.428 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:28.428 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896055+0000", 2024-04-19T02:17:28.428 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.030014886000000001 2024-04-19T02:17:28.428 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.428 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.428 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:28.428 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896087+0000", 2024-04-19T02:17:28.428 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1761000000000003e-05 2024-04-19T02:17:28.428 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.428 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.428 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:28.428 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896111+0000", 2024-04-19T02:17:28.428 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3623999999999999e-05 2024-04-19T02:17:28.428 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:28.428 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:28.428 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:28.429 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.429 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.429 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157439 5.e 5:79eb9d3c:::benchmark_data_smithi121_44835_object23404:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:28.429 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:28.429 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 21.493143032999999, 2024-04-19T02:17:28.429 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.027045244, 2024-04-19T02:17:28.429 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:28.429 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:28.429 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:28.429 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:28.429 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:28.429 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157439 2024-04-19T02:17:28.429 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.429 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:28.429 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.429 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:28.429 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:28.430 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:28.430 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.430 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.430 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:28.430 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:28.430 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:28.430 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.430 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.430 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:28.430 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:28.430 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:28.430 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.430 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.430 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:28.430 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864128+0000", 2024-04-19T02:17:28.431 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.911e-06 2024-04-19T02:17:28.431 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.431 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.431 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:28.431 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864136+0000", 2024-04-19T02:17:28.431 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2609999999999993e-06 2024-04-19T02:17:28.431 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.431 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.431 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:28.431 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864140+0000", 2024-04-19T02:17:28.431 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5530000000000001e-06 2024-04-19T02:17:28.431 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.431 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.431 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:28.431 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864169+0000", 2024-04-19T02:17:28.431 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.8932e-05 2024-04-19T02:17:28.432 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.432 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.432 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:28.432 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864267+0000", 2024-04-19T02:17:28.432 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7969999999999999e-05 2024-04-19T02:17:28.432 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.432 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.432 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:28.432 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864339+0000", 2024-04-19T02:17:28.432 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.2280999999999995e-05 2024-04-19T02:17:28.432 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.432 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.432 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:28.432 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.865763+0000", 2024-04-19T02:17:28.432 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0014236310000000001 2024-04-19T02:17:28.432 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.432 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.433 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:28.433 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.891093+0000", 2024-04-19T02:17:28.433 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.025330571 2024-04-19T02:17:28.433 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.433 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.433 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:28.433 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.891137+0000", 2024-04-19T02:17:28.433 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3980999999999998e-05 2024-04-19T02:17:28.433 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.433 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.433 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:28.433 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.891172+0000", 2024-04-19T02:17:28.433 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4465000000000003e-05 2024-04-19T02:17:28.433 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:28.434 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:28.434 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:28.434 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.434 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.434 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157442 5.0 5:0062b73f:::benchmark_data_smithi121_44835_object23407:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:28.434 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.867065+0000", 2024-04-19T02:17:28.434 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 21.490204382999998, 2024-04-19T02:17:28.434 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.029165542999999999, 2024-04-19T02:17:28.434 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:28.434 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:28.434 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:28.434 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:28.434 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:28.434 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157442 2024-04-19T02:17:28.435 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.435 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:28.435 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.435 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:28.435 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867065+0000", 2024-04-19T02:17:28.435 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:28.435 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.435 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.435 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:28.435 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867065+0000", 2024-04-19T02:17:28.435 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:28.435 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.435 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.435 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:28.435 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867064+0000", 2024-04-19T02:17:28.436 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:28.436 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.436 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.436 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:28.436 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867069+0000", 2024-04-19T02:17:28.436 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4549999999999997e-06 2024-04-19T02:17:28.436 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.436 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.436 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:28.436 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867080+0000", 2024-04-19T02:17:28.436 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0797e-05 2024-04-19T02:17:28.436 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.436 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.436 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:28.436 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867088+0000", 2024-04-19T02:17:28.436 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9729999999999997e-06 2024-04-19T02:17:28.437 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.437 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.437 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:28.437 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867121+0000", 2024-04-19T02:17:28.437 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2920000000000003e-05 2024-04-19T02:17:28.437 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.437 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.437 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:28.437 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867203+0000", 2024-04-19T02:17:28.437 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2578999999999997e-05 2024-04-19T02:17:28.437 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.437 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.437 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:28.437 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867386+0000", 2024-04-19T02:17:28.437 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00018237400000000001 2024-04-19T02:17:28.438 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.438 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.438 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:28.438 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.869338+0000", 2024-04-19T02:17:28.438 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0019521160000000001 2024-04-19T02:17:28.438 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.438 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.438 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:28.438 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896150+0000", 2024-04-19T02:17:28.438 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.026812074000000002 2024-04-19T02:17:28.438 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.438 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.438 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:28.438 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896191+0000", 2024-04-19T02:17:28.439 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1192000000000001e-05 2024-04-19T02:17:28.439 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.439 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.439 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:28.439 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896231+0000", 2024-04-19T02:17:28.439 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9764000000000001e-05 2024-04-19T02:17:28.439 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:28.439 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:28.439 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:28.439 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.439 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.439 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157499 5.8 5:1c3aa38a:::benchmark_data_smithi121_44835_object23464:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:28.439 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.913447+0000", 2024-04-19T02:17:28.439 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 21.443822811, 2024-04-19T02:17:28.440 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.024508188, 2024-04-19T02:17:28.440 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:28.440 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:28.440 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:28.440 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:28.440 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:28.440 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157499 2024-04-19T02:17:28.440 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.440 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:28.440 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.440 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:28.440 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913447+0000", 2024-04-19T02:17:28.440 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:28.440 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.440 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.441 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:28.441 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913447+0000", 2024-04-19T02:17:28.441 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:28.441 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.441 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.441 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:28.441 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913446+0000", 2024-04-19T02:17:28.441 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:28.441 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.441 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.441 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:28.441 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913451+0000", 2024-04-19T02:17:28.441 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.677e-06 2024-04-19T02:17:28.441 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.442 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.442 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:28.442 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913461+0000", 2024-04-19T02:17:28.442 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.8859999999999999e-06 2024-04-19T02:17:28.442 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.442 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.442 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:28.442 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913467+0000", 2024-04-19T02:17:28.442 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.0800000000000002e-06 2024-04-19T02:17:28.442 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.442 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.442 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:28.442 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913513+0000", 2024-04-19T02:17:28.442 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.5707000000000001e-05 2024-04-19T02:17:28.442 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.443 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.443 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:28.443 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913637+0000", 2024-04-19T02:17:28.443 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012379200000000001 2024-04-19T02:17:28.443 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.443 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.443 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:28.443 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913747+0000", 2024-04-19T02:17:28.443 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000110071 2024-04-19T02:17:28.443 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.443 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.443 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:28.443 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915674+0000", 2024-04-19T02:17:28.443 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0019270789999999999 2024-04-19T02:17:28.443 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.444 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.444 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:28.444 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937902+0000", 2024-04-19T02:17:28.444 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022228286 2024-04-19T02:17:28.444 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.444 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.444 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:28.444 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937931+0000", 2024-04-19T02:17:28.444 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9122e-05 2024-04-19T02:17:28.444 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.444 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.444 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:28.444 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937955+0000", 2024-04-19T02:17:28.444 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3591000000000002e-05 2024-04-19T02:17:28.444 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:28.445 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:28.445 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:28.445 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.445 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.445 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157500 5.0 5:0969ec74:::benchmark_data_smithi121_44835_object23465:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:28.445 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.913476+0000", 2024-04-19T02:17:28.445 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 21.443793944999999, 2024-04-19T02:17:28.445 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.024497596, 2024-04-19T02:17:28.445 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:28.445 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:28.445 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:28.445 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:28.445 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:28.445 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157500 2024-04-19T02:17:28.445 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.445 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:28.446 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.446 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:28.446 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913476+0000", 2024-04-19T02:17:28.446 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:28.446 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.446 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.446 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:28.446 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913476+0000", 2024-04-19T02:17:28.446 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:28.446 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.446 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.446 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:28.446 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913475+0000", 2024-04-19T02:17:28.446 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:28.446 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.447 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.447 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:28.447 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913478+0000", 2024-04-19T02:17:28.447 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.2670000000000001e-06 2024-04-19T02:17:28.447 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.447 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.447 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:28.447 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913481+0000", 2024-04-19T02:17:28.447 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6899999999999998e-06 2024-04-19T02:17:28.447 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.447 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.447 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:28.447 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913485+0000", 2024-04-19T02:17:28.447 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1230000000000002e-06 2024-04-19T02:17:28.447 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.447 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.448 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:28.448 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913526+0000", 2024-04-19T02:17:28.448 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.104e-05 2024-04-19T02:17:28.448 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.448 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.448 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:28.448 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913606+0000", 2024-04-19T02:17:28.448 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9510000000000003e-05 2024-04-19T02:17:28.448 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.448 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.448 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:28.448 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913671+0000", 2024-04-19T02:17:28.448 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.4838000000000005e-05 2024-04-19T02:17:28.448 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.448 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.449 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:28.449 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915348+0000", 2024-04-19T02:17:28.449 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016769860000000001 2024-04-19T02:17:28.449 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.449 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.449 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:28.449 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937897+0000", 2024-04-19T02:17:28.449 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022548902999999999 2024-04-19T02:17:28.449 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.449 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.449 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:28.449 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937938+0000", 2024-04-19T02:17:28.449 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1499999999999999e-05 2024-04-19T02:17:28.449 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.449 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.450 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:28.450 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937973+0000", 2024-04-19T02:17:28.450 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5057e-05 2024-04-19T02:17:28.450 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:28.450 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:28.450 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:28.450 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.450 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.450 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157501 5.4 5:26661819:::benchmark_data_smithi121_44835_object23466:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:28.450 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.914839+0000", 2024-04-19T02:17:28.450 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 21.442430650999999, 2024-04-19T02:17:28.450 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.028504224000000002, 2024-04-19T02:17:28.450 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:28.450 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:28.451 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:28.451 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:28.451 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:28.451 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157501 2024-04-19T02:17:28.451 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.451 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:28.451 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.451 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:28.451 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914839+0000", 2024-04-19T02:17:28.451 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:28.451 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.451 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.451 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:28.451 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914839+0000", 2024-04-19T02:17:28.451 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:28.452 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.452 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.452 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:28.452 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914838+0000", 2024-04-19T02:17:28.452 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:28.452 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.452 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.452 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:28.452 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914841+0000", 2024-04-19T02:17:28.452 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.706e-06 2024-04-19T02:17:28.452 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.452 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.452 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:28.452 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914848+0000", 2024-04-19T02:17:28.452 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.7429999999999996e-06 2024-04-19T02:17:28.453 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.453 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.453 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:28.453 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914852+0000", 2024-04-19T02:17:28.453 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0810000000000004e-06 2024-04-19T02:17:28.453 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.453 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.453 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:28.453 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914892+0000", 2024-04-19T02:17:28.453 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9957999999999999e-05 2024-04-19T02:17:28.453 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.453 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.453 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:28.453 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915008+0000", 2024-04-19T02:17:28.453 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000116401 2024-04-19T02:17:28.454 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.454 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.454 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:28.454 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915125+0000", 2024-04-19T02:17:28.454 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011622500000000001 2024-04-19T02:17:28.454 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.454 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.454 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:28.454 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916663+0000", 2024-04-19T02:17:28.454 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0015381310000000001 2024-04-19T02:17:28.454 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.454 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.454 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:28.454 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943114+0000", 2024-04-19T02:17:28.455 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.026451125999999998 2024-04-19T02:17:28.455 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.455 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.455 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:28.455 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943245+0000", 2024-04-19T02:17:28.455 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000131645 2024-04-19T02:17:28.455 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.455 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.455 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:28.455 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943343+0000", 2024-04-19T02:17:28.455 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7604999999999998e-05 2024-04-19T02:17:28.455 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:28.455 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:28.455 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:28.455 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.456 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.456 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157507 5.b 5:de8840a2:::benchmark_data_smithi121_44835_object23472:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:28.456 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:28.456 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 21.440866369999998, 2024-04-19T02:17:28.456 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022544518999999999, 2024-04-19T02:17:28.456 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:28.456 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:28.456 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:28.456 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:28.456 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:28.456 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157507 2024-04-19T02:17:28.456 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.456 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:28.456 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.456 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:28.456 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:28.457 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:28.457 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.457 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.457 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:28.457 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:28.457 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:28.457 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.457 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.457 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:28.457 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:28.457 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:28.457 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.457 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.457 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:28.457 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916406+0000", 2024-04-19T02:17:28.458 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4589999999999998e-06 2024-04-19T02:17:28.458 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.458 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.458 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:28.458 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916415+0000", 2024-04-19T02:17:28.458 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3910000000000004e-06 2024-04-19T02:17:28.458 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.458 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.458 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:28.458 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916421+0000", 2024-04-19T02:17:28.458 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.6130000000000003e-06 2024-04-19T02:17:28.458 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.458 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.458 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:28.458 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916448+0000", 2024-04-19T02:17:28.459 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7277999999999999e-05 2024-04-19T02:17:28.459 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.459 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.459 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:28.459 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916539+0000", 2024-04-19T02:17:28.459 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0855999999999999e-05 2024-04-19T02:17:28.459 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.459 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.459 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:28.459 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916605+0000", 2024-04-19T02:17:28.459 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6141000000000003e-05 2024-04-19T02:17:28.459 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.459 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.459 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:28.459 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918276+0000", 2024-04-19T02:17:28.460 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001670726 2024-04-19T02:17:28.460 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.460 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.460 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:28.460 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.938888+0000", 2024-04-19T02:17:28.460 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020612042000000001 2024-04-19T02:17:28.460 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.460 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.460 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:28.460 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.938924+0000", 2024-04-19T02:17:28.460 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5692999999999999e-05 2024-04-19T02:17:28.460 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.460 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.460 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:28.461 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.938948+0000", 2024-04-19T02:17:28.461 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3879e-05 2024-04-19T02:17:28.461 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:28.461 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:28.461 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:28.461 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.461 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.461 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157509 5.8 5:1dca85d0:::benchmark_data_smithi121_44835_object23474:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:28.461 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:28.461 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 21.438438124000001, 2024-04-19T02:17:28.461 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.024511807, 2024-04-19T02:17:28.461 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:28.461 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:28.461 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:28.461 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:28.462 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:28.462 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157509 2024-04-19T02:17:28.462 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.462 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:28.462 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.462 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:28.462 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:28.462 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:28.462 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.462 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.462 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:28.462 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:28.462 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:28.462 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.463 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.463 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:28.463 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:28.463 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:28.463 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.463 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.463 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:28.463 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918834+0000", 2024-04-19T02:17:28.463 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9409999999999999e-06 2024-04-19T02:17:28.463 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.463 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.463 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:28.463 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918859+0000", 2024-04-19T02:17:28.463 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.5245999999999999e-05 2024-04-19T02:17:28.463 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.464 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.464 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:28.464 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918864+0000", 2024-04-19T02:17:28.464 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.1819999999999997e-06 2024-04-19T02:17:28.464 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.464 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.464 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:28.464 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918900+0000", 2024-04-19T02:17:28.464 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5327000000000002e-05 2024-04-19T02:17:28.464 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.464 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.464 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:28.464 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.919024+0000", 2024-04-19T02:17:28.464 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012400900000000001 2024-04-19T02:17:28.464 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.464 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.465 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:28.465 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.919136+0000", 2024-04-19T02:17:28.465 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000111987 2024-04-19T02:17:28.465 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.465 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.465 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:28.465 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.922096+0000", 2024-04-19T02:17:28.465 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0029607079999999998 2024-04-19T02:17:28.465 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.465 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.465 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:28.465 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943120+0000", 2024-04-19T02:17:28.465 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.021023995 2024-04-19T02:17:28.465 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.465 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.466 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:28.466 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943255+0000", 2024-04-19T02:17:28.466 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013502100000000001 2024-04-19T02:17:28.466 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:28.466 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:28.466 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:28.466 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943343+0000", 2024-04-19T02:17:28.466 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.7931999999999998e-05 2024-04-19T02:17:28.466 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:28.466 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:28.466 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:28.466 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:28.466 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:28.466 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:17:28.468 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:28.468+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:28.468 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:28.568 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:28.568+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:28.638 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:28.638 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:17:28.638 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.638 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:214889 5.d 5:bab17ca7:::benchmark_data_smithi121_44835_object80854:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T02:17:28.638 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:28.631946+0000", 2024-04-19T02:17:28.638 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0068778229999999999, 2024-04-19T02:17:28.639 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0068964020000000003, 2024-04-19T02:17:28.639 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:28.639 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:28.639 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:28.639 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:28.639 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:28.639 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 214889 2024-04-19T02:17:28.639 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.639 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:28.639 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.639 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:28.639 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:28.631946+0000", 2024-04-19T02:17:28.639 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:28.639 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.639 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.640 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:28.640 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:28.631946+0000", 2024-04-19T02:17:28.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:28.640 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.640 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.640 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:28.640 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:28.631945+0000", 2024-04-19T02:17:28.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:28.640 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.640 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.640 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:28.640 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:28.631950+0000", 2024-04-19T02:17:28.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5430000000000004e-06 2024-04-19T02:17:28.640 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:28.641 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:28.631961+0000", 2024-04-19T02:17:28.641 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1371e-05 2024-04-19T02:17:28.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:28.641 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:28.631969+0000", 2024-04-19T02:17:28.641 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3250000000000008e-06 2024-04-19T02:17:28.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:28.641 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:28.632016+0000", 2024-04-19T02:17:28.641 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6538000000000001e-05 2024-04-19T02:17:28.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.642 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:28.642 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:28.632155+0000", 2024-04-19T02:17:28.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013942199999999999 2024-04-19T02:17:28.642 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.642 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:28.642 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:28.632297+0000", 2024-04-19T02:17:28.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000142058 2024-04-19T02:17:28.642 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.642 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:28.642 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:28.637234+0000", 2024-04-19T02:17:28.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.004936541 2024-04-19T02:17:28.642 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:28.643 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:28.643 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:28.643 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.643 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.643 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:214891 5.c 5:34367e61:::benchmark_data_smithi121_44835_object80856:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T02:17:28.643 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:28.634054+0000", 2024-04-19T02:17:28.643 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0047700030000000001, 2024-04-19T02:17:28.643 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0048548480000000001, 2024-04-19T02:17:28.643 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:28.643 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:28.643 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:28.643 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:28.643 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:28.643 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 214891 2024-04-19T02:17:28.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.644 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:28.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.644 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:28.644 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:28.634054+0000", 2024-04-19T02:17:28.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:28.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.644 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:28.644 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:28.634054+0000", 2024-04-19T02:17:28.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:28.645 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.645 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.645 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:28.645 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:28.634053+0000", 2024-04-19T02:17:28.645 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:28.645 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.645 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.645 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:28.645 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:28.634057+0000", 2024-04-19T02:17:28.645 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2119999999999997e-06 2024-04-19T02:17:28.645 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.646 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:28.646 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:28.634065+0000", 2024-04-19T02:17:28.646 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8509999999999999e-06 2024-04-19T02:17:28.646 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.646 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:28.646 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:28.634070+0000", 2024-04-19T02:17:28.646 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7339999999999999e-06 2024-04-19T02:17:28.646 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.646 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:28.647 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:28.634105+0000", 2024-04-19T02:17:28.647 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5151999999999998e-05 2024-04-19T02:17:28.647 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.647 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.647 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:28.647 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:28.634221+0000", 2024-04-19T02:17:28.647 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000115673 2024-04-19T02:17:28.647 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:28.647 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:28.647 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:28.647 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.647 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.647 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:214892 5.9 5:962b9e05:::benchmark_data_smithi121_44835_object80857:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T02:17:28.647 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:28.634077+0000", 2024-04-19T02:17:28.648 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0047466000000000001, 2024-04-19T02:17:28.648 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0048690299999999999, 2024-04-19T02:17:28.648 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:28.648 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:28.648 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:28.648 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:28.648 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:28.648 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 214892 2024-04-19T02:17:28.648 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.648 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:28.648 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.648 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:28.649 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:28.634077+0000", 2024-04-19T02:17:28.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:28.649 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.649 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.649 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:28.649 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:28.634077+0000", 2024-04-19T02:17:28.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:28.649 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.649 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.649 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:28.649 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:28.634077+0000", 2024-04-19T02:17:28.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:28.649 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.649 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.649 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:28.650 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:28.634079+0000", 2024-04-19T02:17:28.650 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3029999999999998e-06 2024-04-19T02:17:28.650 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.650 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.650 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:28.650 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:28.634085+0000", 2024-04-19T02:17:28.650 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7760000000000003e-06 2024-04-19T02:17:28.650 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.650 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.650 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:28.650 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:28.634092+0000", 2024-04-19T02:17:28.650 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6039999999999998e-06 2024-04-19T02:17:28.650 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.650 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:28.651 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:28.634125+0000", 2024-04-19T02:17:28.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3788999999999998e-05 2024-04-19T02:17:28.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:28.651 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:28.634243+0000", 2024-04-19T02:17:28.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117398 2024-04-19T02:17:28.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:28.651 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:28.634356+0000", 2024-04-19T02:17:28.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000113193 2024-04-19T02:17:28.651 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:28.651 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:28.652 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:28.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.652 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:214894 5.c 5:32489b79:::benchmark_data_smithi121_44835_object80859:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T02:17:28.652 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:28.634259+0000", 2024-04-19T02:17:28.652 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0045646200000000001, 2024-04-19T02:17:28.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047261350000000002, 2024-04-19T02:17:28.652 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:28.652 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:28.652 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:28.652 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:28.652 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:28.652 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 214894 2024-04-19T02:17:28.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.653 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:28.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.653 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:28.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:28.634259+0000", 2024-04-19T02:17:28.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:28.653 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.653 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:28.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:28.634259+0000", 2024-04-19T02:17:28.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:28.653 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.653 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:28.654 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:28.634258+0000", 2024-04-19T02:17:28.654 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:28.654 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.654 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.654 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:28.654 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:28.634264+0000", 2024-04-19T02:17:28.654 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6289999999999998e-06 2024-04-19T02:17:28.654 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.654 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.654 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:28.654 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:28.634274+0000", 2024-04-19T02:17:28.654 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0275000000000001e-05 2024-04-19T02:17:28.654 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.655 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.655 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:28.655 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:28.634283+0000", 2024-04-19T02:17:28.655 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4300000000000006e-06 2024-04-19T02:17:28.655 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.655 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.655 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:28.655 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:28.635729+0000", 2024-04-19T02:17:28.655 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001446342 2024-04-19T02:17:28.655 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.655 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.655 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:28.655 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:28.635800+0000", 2024-04-19T02:17:28.655 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1314000000000002e-05 2024-04-19T02:17:28.655 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:28.656 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:28.656 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:28.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.656 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.656 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:214898 5.f 5:fcdaabb6:::benchmark_data_smithi121_44835_object80863:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T02:17:28.656 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:28.635839+0000", 2024-04-19T02:17:28.656 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0029850829999999999, 2024-04-19T02:17:28.656 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031835269999999998, 2024-04-19T02:17:28.657 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:28.657 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:28.657 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:28.657 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:28.657 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:28.657 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 214898 2024-04-19T02:17:28.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.657 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:28.657 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.657 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:28.657 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:28.635839+0000", 2024-04-19T02:17:28.657 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:28.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.657 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.658 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:28.658 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:28.635839+0000", 2024-04-19T02:17:28.658 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:28.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.658 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.658 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:28.658 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:28.635838+0000", 2024-04-19T02:17:28.658 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:28.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.658 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.658 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:28.658 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:28.635843+0000", 2024-04-19T02:17:28.658 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8860000000000003e-06 2024-04-19T02:17:28.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.659 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.659 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:28.659 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:28.635854+0000", 2024-04-19T02:17:28.659 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0851e-05 2024-04-19T02:17:28.659 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.659 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.659 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:28.659 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:28.635862+0000", 2024-04-19T02:17:28.659 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1440000000000003e-06 2024-04-19T02:17:28.659 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.659 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.659 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:28.659 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:28.635902+0000", 2024-04-19T02:17:28.659 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0670999999999997e-05 2024-04-19T02:17:28.660 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.660 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:28.660 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:28.636020+0000", 2024-04-19T02:17:28.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117619 2024-04-19T02:17:28.660 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.660 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:28.660 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:28.636137+0000", 2024-04-19T02:17:28.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011720800000000001 2024-04-19T02:17:28.660 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:28.660 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:28.660 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:28.660 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.660 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:214900 5.9 5:9550adcb:::benchmark_data_smithi121_44835_object80865:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T02:17:28.661 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:28.636803+0000", 2024-04-19T02:17:28.661 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0020212239999999999, 2024-04-19T02:17:28.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022585959999999999, 2024-04-19T02:17:28.661 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:28.661 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:28.661 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:28.661 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:28.661 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:28.661 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 214900 2024-04-19T02:17:28.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.661 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:28.662 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.662 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:28.662 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:28.636803+0000", 2024-04-19T02:17:28.662 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:28.662 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.662 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.662 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:28.662 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:28.636803+0000", 2024-04-19T02:17:28.662 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:28.662 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.662 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.662 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:28.662 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:28.636802+0000", 2024-04-19T02:17:28.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:28.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:28.663 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:28.636807+0000", 2024-04-19T02:17:28.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7589999999999997e-06 2024-04-19T02:17:28.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:28.663 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:28.636819+0000", 2024-04-19T02:17:28.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2012e-05 2024-04-19T02:17:28.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:28.663 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:28.636829+0000", 2024-04-19T02:17:28.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9890000000000004e-06 2024-04-19T02:17:28.664 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.664 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.664 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:28.664 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:28.636872+0000", 2024-04-19T02:17:28.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3451000000000001e-05 2024-04-19T02:17:28.664 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.664 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.664 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:28.664 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:28.636976+0000", 2024-04-19T02:17:28.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000103546 2024-04-19T02:17:28.664 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:28.664 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:28.664 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:28.665 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:28.637043+0000", 2024-04-19T02:17:28.665 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7899999999999997e-05 2024-04-19T02:17:28.665 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:28.665 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:28.665 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:28.665 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:28.665 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-04-19T02:17:28.665 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 6 2024-04-19T02:17:28.665 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:28.666 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:28.707 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:28.707+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:28.770 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:28.771+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:28.871 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:28.871+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:28.880 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:28.880 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-04-19T02:17:28.880 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-04-19T02:17:28.881 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-04-19T02:17:28.881 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:28.896 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:28.972 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:28.972+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:29.066 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:29.067 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-04-19T02:17:29.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-04-19T02:17:29.067 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:17:29.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.067 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:29.067 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:17:29.067 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 119.795426822, 2024-04-19T02:17:29.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022007204999999998, 2024-04-19T02:17:29.067 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:29.067 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:29.067 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:29.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:29.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:17:29.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:29.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:29.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:17:29.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:29.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:29.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269990+0000", 2024-04-19T02:17:29.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:29.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:29.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269999+0000", 2024-04-19T02:17:29.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9539999999999993e-06 2024-04-19T02:17:29.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.070 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.070 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:29.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270006+0000", 2024-04-19T02:17:29.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.216e-06 2024-04-19T02:17:29.070 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.070 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.070 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:29.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270012+0000", 2024-04-19T02:17:29.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5049999999999998e-06 2024-04-19T02:17:29.070 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.070 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.071 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:29.071 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270058+0000", 2024-04-19T02:17:29.071 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.634e-05 2024-04-19T02:17:29.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.071 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:29.071 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270064+0000", 2024-04-19T02:17:29.071 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0669999999999997e-06 2024-04-19T02:17:29.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.071 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:29.071 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287159+0000", 2024-04-19T02:17:29.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017095086999999998 2024-04-19T02:17:29.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.072 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:29.072 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287254+0000", 2024-04-19T02:17:29.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4716000000000006e-05 2024-04-19T02:17:29.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.072 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:29.072 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287389+0000", 2024-04-19T02:17:29.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013511900000000001 2024-04-19T02:17:29.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:29.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290481+0000", 2024-04-19T02:17:29.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030920169999999999 2024-04-19T02:17:29.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:29.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291931+0000", 2024-04-19T02:17:29.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001450118 2024-04-19T02:17:29.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:29.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291960+0000", 2024-04-19T02:17:29.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9096000000000001e-05 2024-04-19T02:17:29.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:29.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291998+0000", 2024-04-19T02:17:29.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7514e-05 2024-04-19T02:17:29.074 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:29.074 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:29.074 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:29.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.075 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:29.075 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:17:29.075 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 119.795316046, 2024-04-19T02:17:29.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020837887999999999, 2024-04-19T02:17:29.075 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:29.075 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:29.075 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:29.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:29.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:17:29.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:29.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.076 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.076 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:29.076 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:17:29.076 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:29.076 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.076 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.076 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:29.076 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:17:29.076 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:29.076 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.076 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.076 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:29.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270109+0000", 2024-04-19T02:17:29.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3110000000000006e-06 2024-04-19T02:17:29.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.077 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.077 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:29.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270117+0000", 2024-04-19T02:17:29.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0479999999999999e-06 2024-04-19T02:17:29.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.077 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.077 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:29.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270123+0000", 2024-04-19T02:17:29.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5500000000000002e-06 2024-04-19T02:17:29.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:29.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270150+0000", 2024-04-19T02:17:29.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7712000000000002e-05 2024-04-19T02:17:29.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:29.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270153+0000", 2024-04-19T02:17:29.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6089999999999999e-06 2024-04-19T02:17:29.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.079 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:29.079 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285958+0000", 2024-04-19T02:17:29.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015805274000000001 2024-04-19T02:17:29.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.079 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:29.079 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286126+0000", 2024-04-19T02:17:29.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016765700000000001 2024-04-19T02:17:29.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.079 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:29.079 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286296+0000", 2024-04-19T02:17:29.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017007 2024-04-19T02:17:29.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.080 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.080 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:29.080 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290426+0000", 2024-04-19T02:17:29.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041299839999999997 2024-04-19T02:17:29.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.080 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.080 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:29.080 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290867+0000", 2024-04-19T02:17:29.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00044083300000000001 2024-04-19T02:17:29.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.080 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.080 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:29.080 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290900+0000", 2024-04-19T02:17:29.081 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3380000000000002e-05 2024-04-19T02:17:29.081 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.081 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:29.081 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290939+0000", 2024-04-19T02:17:29.081 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8970000000000001e-05 2024-04-19T02:17:29.081 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:29.081 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:29.081 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:29.081 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.081 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:21 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:29.081 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:17:29.082 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 119.79522737400001, 2024-04-19T02:17:29.082 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020833187999999999, 2024-04-19T02:17:29.082 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:29.082 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:29.082 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:29.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.082 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:29.082 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:17:29.082 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:29.082 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:29.083 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:17:29.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:29.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:29.083 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270189+0000", 2024-04-19T02:17:29.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:29.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:29.084 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270192+0000", 2024-04-19T02:17:29.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7549999999999999e-06 2024-04-19T02:17:29.084 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.084 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.084 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:29.084 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270198+0000", 2024-04-19T02:17:29.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0859999999999998e-06 2024-04-19T02:17:29.084 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.084 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.084 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:29.084 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270204+0000", 2024-04-19T02:17:29.085 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1970000000000004e-06 2024-04-19T02:17:29.085 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.085 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.085 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:29.085 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270238+0000", 2024-04-19T02:17:29.085 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4282000000000001e-05 2024-04-19T02:17:29.085 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.085 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.085 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:29.085 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270240+0000", 2024-04-19T02:17:29.085 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3099999999999999e-06 2024-04-19T02:17:29.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.086 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:29.086 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287131+0000", 2024-04-19T02:17:29.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01689104 2024-04-19T02:17:29.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.086 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:29.086 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287262+0000", 2024-04-19T02:17:29.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130347 2024-04-19T02:17:29.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.087 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:29.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291023+0000", 2024-04-19T02:17:29.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037616350000000002 2024-04-19T02:17:29.087 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:29.087 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:29.087 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:29.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.087 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:94468 5.2 5:4f406431:::benchmark_data_smithi121_44835_object94467:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T02:17:29.087 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:17:29.087 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 53.953988191999997, 2024-04-19T02:17:29.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024835144999999999, 2024-04-19T02:17:29.088 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:29.088 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:29.088 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:29.088 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:29.088 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:29.088 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 94468 2024-04-19T02:17:29.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.088 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:29.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:29.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:17:29.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:29.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:29.089 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:17:29.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:29.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:29.089 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:17:29.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:29.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:29.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111498+0000", 2024-04-19T02:17:29.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9529000000000005e-05 2024-04-19T02:17:29.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:29.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111506+0000", 2024-04-19T02:17:29.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9030000000000004e-06 2024-04-19T02:17:29.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:29.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111513+0000", 2024-04-19T02:17:29.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8759999999999999e-06 2024-04-19T02:17:29.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.091 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:29.091 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112466+0000", 2024-04-19T02:17:29.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00095318499999999995 2024-04-19T02:17:29.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.091 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:29.091 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112590+0000", 2024-04-19T02:17:29.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012380900000000001 2024-04-19T02:17:29.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.091 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:29.092 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112728+0000", 2024-04-19T02:17:29.092 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013753800000000001 2024-04-19T02:17:29.092 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.092 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.092 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:29.092 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115064+0000", 2024-04-19T02:17:29.092 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002336819 2024-04-19T02:17:29.092 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.092 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.092 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:29.092 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136207+0000", 2024-04-19T02:17:29.092 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021142942000000001 2024-04-19T02:17:29.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.093 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:29.093 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136241+0000", 2024-04-19T02:17:29.093 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3577000000000001e-05 2024-04-19T02:17:29.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.093 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:29.093 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136264+0000", 2024-04-19T02:17:29.093 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3421000000000002e-05 2024-04-19T02:17:29.094 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:29.094 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:29.094 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:29.094 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.094 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:94472 5.2 5:45b7e9be:::benchmark_data_smithi121_44835_object94471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:29.094 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:17:29.094 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 53.950341661000003, 2024-04-19T02:17:29.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021273843000000001, 2024-04-19T02:17:29.094 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:29.094 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:29.094 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:29.095 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:29.095 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:29.095 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 94472 2024-04-19T02:17:29.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.095 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:29.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:29.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:17:29.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:29.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.096 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:29.096 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:17:29.096 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:29.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.096 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:29.096 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115075+0000", 2024-04-19T02:17:29.096 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:29.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.096 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:29.096 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115161+0000", 2024-04-19T02:17:29.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6632000000000007e-05 2024-04-19T02:17:29.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:29.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115171+0000", 2024-04-19T02:17:29.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2969999999999992e-06 2024-04-19T02:17:29.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:29.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115178+0000", 2024-04-19T02:17:29.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7610000000000007e-06 2024-04-19T02:17:29.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.098 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:29.098 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115213+0000", 2024-04-19T02:17:29.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5000999999999999e-05 2024-04-19T02:17:29.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.098 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:29.098 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115303+0000", 2024-04-19T02:17:29.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9791999999999997e-05 2024-04-19T02:17:29.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.098 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:29.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115391+0000", 2024-04-19T02:17:29.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7559000000000007e-05 2024-04-19T02:17:29.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:29.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.117894+0000", 2024-04-19T02:17:29.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002503496 2024-04-19T02:17:29.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:29.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136297+0000", 2024-04-19T02:17:29.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018402335999999998 2024-04-19T02:17:29.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.100 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:29.100 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136327+0000", 2024-04-19T02:17:29.100 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0534999999999998e-05 2024-04-19T02:17:29.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.100 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.100 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:29.100 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136350+0000", 2024-04-19T02:17:29.100 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2427999999999999e-05 2024-04-19T02:17:29.100 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:29.100 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:29.100 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:29.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.100 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.100 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:129219 5.2 5:45e7e1f4:::benchmark_data_smithi121_44835_object129218:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T02:17:29.101 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:52.629592+0000", 2024-04-19T02:17:29.101 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 36.435825407999999, 2024-04-19T02:17:29.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021099489999999999, 2024-04-19T02:17:29.101 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:29.101 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:29.101 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:29.101 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:29.101 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:29.101 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129219 2024-04-19T02:17:29.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.101 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:29.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.101 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:29.101 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629592+0000", 2024-04-19T02:17:29.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:29.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:29.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629592+0000", 2024-04-19T02:17:29.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:29.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:29.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629591+0000", 2024-04-19T02:17:29.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:29.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:29.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629618+0000", 2024-04-19T02:17:29.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6970000000000001e-05 2024-04-19T02:17:29.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:29.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629639+0000", 2024-04-19T02:17:29.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0701999999999999e-05 2024-04-19T02:17:29.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:29.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629645+0000", 2024-04-19T02:17:29.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2299999999999996e-06 2024-04-19T02:17:29.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:29.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.635658+0000", 2024-04-19T02:17:29.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0060127549999999998 2024-04-19T02:17:29.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:29.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.635811+0000", 2024-04-19T02:17:29.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015305700000000001 2024-04-19T02:17:29.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:29.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.635967+0000", 2024-04-19T02:17:29.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015578599999999999 2024-04-19T02:17:29.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:29.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.642488+0000", 2024-04-19T02:17:29.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0065215619999999998 2024-04-19T02:17:29.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:29.106 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650603+0000", 2024-04-19T02:17:29.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0081144900000000002 2024-04-19T02:17:29.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.106 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:29.106 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650652+0000", 2024-04-19T02:17:29.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9079999999999998e-05 2024-04-19T02:17:29.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.106 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:29.106 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650691+0000", 2024-04-19T02:17:29.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9501e-05 2024-04-19T02:17:29.107 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:29.107 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:29.107 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:29.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.107 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:157448 5.7 5:ed833a19:::benchmark_data_smithi121_44835_object23413:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:29.107 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:06.870566+0000", 2024-04-19T02:17:29.107 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.194850827, 2024-04-19T02:17:29.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023031238999999998, 2024-04-19T02:17:29.107 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:29.107 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:29.108 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:29.108 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:29.108 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:29.108 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 157448 2024-04-19T02:17:29.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.108 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:29.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:29.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870566+0000", 2024-04-19T02:17:29.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:29.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:29.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870566+0000", 2024-04-19T02:17:29.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:29.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:29.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870566+0000", 2024-04-19T02:17:29.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:29.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:29.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870570+0000", 2024-04-19T02:17:29.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1620000000000001e-06 2024-04-19T02:17:29.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.110 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:29.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870577+0000", 2024-04-19T02:17:29.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2069999999999998e-06 2024-04-19T02:17:29.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.110 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:29.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870587+0000", 2024-04-19T02:17:29.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6919999999999997e-06 2024-04-19T02:17:29.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:29.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870615+0000", 2024-04-19T02:17:29.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8351999999999999e-05 2024-04-19T02:17:29.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:29.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870715+0000", 2024-04-19T02:17:29.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9624999999999996e-05 2024-04-19T02:17:29.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:29.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870805+0000", 2024-04-19T02:17:29.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0067000000000004e-05 2024-04-19T02:17:29.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:29.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.872773+0000", 2024-04-19T02:17:29.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001968605 2024-04-19T02:17:29.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:29.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.893514+0000", 2024-04-19T02:17:29.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020740082999999999 2024-04-19T02:17:29.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:29.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.893558+0000", 2024-04-19T02:17:29.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4110999999999998e-05 2024-04-19T02:17:29.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:29.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.893598+0000", 2024-04-19T02:17:29.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0077000000000003e-05 2024-04-19T02:17:29.113 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:29.113 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:29.113 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:29.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.114 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:157498 5.7 5:eb39b43d:::benchmark_data_smithi121_44835_object23463:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:29.114 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:06.911721+0000", 2024-04-19T02:17:29.114 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.153696182000001, 2024-04-19T02:17:29.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023313438999999998, 2024-04-19T02:17:29.114 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:29.114 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:29.114 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:29.114 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:29.114 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:29.114 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 157498 2024-04-19T02:17:29.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.115 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:29.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:29.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911721+0000", 2024-04-19T02:17:29.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:29.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.117 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:29.117 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911721+0000", 2024-04-19T02:17:29.117 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:29.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:29.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911720+0000", 2024-04-19T02:17:29.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:29.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:29.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911726+0000", 2024-04-19T02:17:29.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3179999999999997e-06 2024-04-19T02:17:29.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:29.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911746+0000", 2024-04-19T02:17:29.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0574e-05 2024-04-19T02:17:29.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:29.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911757+0000", 2024-04-19T02:17:29.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0959e-05 2024-04-19T02:17:29.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:29.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911795+0000", 2024-04-19T02:17:29.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7589999999999998e-05 2024-04-19T02:17:29.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:29.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911912+0000", 2024-04-19T02:17:29.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117625 2024-04-19T02:17:29.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:29.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.912250+0000", 2024-04-19T02:17:29.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00033710599999999999 2024-04-19T02:17:29.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:29.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.915540+0000", 2024-04-19T02:17:29.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032909559999999998 2024-04-19T02:17:29.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:29.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.934984+0000", 2024-04-19T02:17:29.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019443670999999999 2024-04-19T02:17:29.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:29.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.935013+0000", 2024-04-19T02:17:29.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8464999999999999e-05 2024-04-19T02:17:29.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:29.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.935035+0000", 2024-04-19T02:17:29.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1954e-05 2024-04-19T02:17:29.122 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:29.122 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:29.122 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:29.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.123 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168377 5.d 5:b1f3fb6d:::benchmark_data_smithi121_44835_object34342:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:29.123 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069470+0000", 2024-04-19T02:17:29.123 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 16.995947449999999, 2024-04-19T02:17:29.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050516473999999999, 2024-04-19T02:17:29.123 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:29.123 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:29.123 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:29.123 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:29.123 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:29.123 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168377 2024-04-19T02:17:29.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.123 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:29.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:29.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069470+0000", 2024-04-19T02:17:29.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:29.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:29.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069470+0000", 2024-04-19T02:17:29.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:29.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:29.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069469+0000", 2024-04-19T02:17:29.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:29.125 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.125 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.125 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:29.125 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069473+0000", 2024-04-19T02:17:29.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4580000000000002e-06 2024-04-19T02:17:29.125 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.125 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.125 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:29.125 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069482+0000", 2024-04-19T02:17:29.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2839999999999995e-06 2024-04-19T02:17:29.125 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.125 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.126 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:29.126 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069489+0000", 2024-04-19T02:17:29.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3579999999999997e-06 2024-04-19T02:17:29.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.126 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:29.126 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069559+0000", 2024-04-19T02:17:29.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9678000000000006e-05 2024-04-19T02:17:29.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.126 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:29.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069683+0000", 2024-04-19T02:17:29.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012359400000000001 2024-04-19T02:17:29.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:29.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069759+0000", 2024-04-19T02:17:29.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6834000000000003e-05 2024-04-19T02:17:29.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:29.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119871+0000", 2024-04-19T02:17:29.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050111392999999997 2024-04-19T02:17:29.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:29.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119932+0000", 2024-04-19T02:17:29.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1209000000000003e-05 2024-04-19T02:17:29.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:29.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119962+0000", 2024-04-19T02:17:29.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9717999999999999e-05 2024-04-19T02:17:29.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.129 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:29.129 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119986+0000", 2024-04-19T02:17:29.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4549000000000002e-05 2024-04-19T02:17:29.129 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:29.129 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:29.129 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:29.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.129 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168379 5.d 5:bcd492dd:::benchmark_data_smithi121_44835_object34344:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:29.130 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069502+0000", 2024-04-19T02:17:29.130 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 16.995915397000001, 2024-04-19T02:17:29.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050544645999999999, 2024-04-19T02:17:29.130 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:29.130 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:29.130 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:29.130 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:29.130 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:29.130 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168379 2024-04-19T02:17:29.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.131 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:29.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:29.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069502+0000", 2024-04-19T02:17:29.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:29.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:29.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069502+0000", 2024-04-19T02:17:29.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:29.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.132 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:29.132 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069501+0000", 2024-04-19T02:17:29.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:29.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.132 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:29.132 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069504+0000", 2024-04-19T02:17:29.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9289999999999998e-06 2024-04-19T02:17:29.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.133 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:29.133 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069511+0000", 2024-04-19T02:17:29.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1909999999999997e-06 2024-04-19T02:17:29.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.133 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:29.133 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069517+0000", 2024-04-19T02:17:29.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0789999999999997e-06 2024-04-19T02:17:29.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.133 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:29.133 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071081+0000", 2024-04-19T02:17:29.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0015646550000000001 2024-04-19T02:17:29.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:29.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071195+0000", 2024-04-19T02:17:29.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011399400000000001 2024-04-19T02:17:29.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:29.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071293+0000", 2024-04-19T02:17:29.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7938999999999999e-05 2024-04-19T02:17:29.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:29.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119898+0000", 2024-04-19T02:17:29.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.048604808999999999 2024-04-19T02:17:29.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:29.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119993+0000", 2024-04-19T02:17:29.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5224999999999997e-05 2024-04-19T02:17:29.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.136 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:29.136 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120024+0000", 2024-04-19T02:17:29.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0580999999999997e-05 2024-04-19T02:17:29.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.136 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:29.136 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120047+0000", 2024-04-19T02:17:29.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2725e-05 2024-04-19T02:17:29.136 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:29.136 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:29.137 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:29.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.137 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168381 5.d 5:bcbab0e3:::benchmark_data_smithi121_44835_object34346:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:29.137 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:29.137 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 16.995895979, 2024-04-19T02:17:29.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050574694000000003, 2024-04-19T02:17:29.137 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:29.137 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:29.137 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:29.137 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:29.137 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:29.137 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168381 2024-04-19T02:17:29.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.138 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:29.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.138 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:29.138 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:29.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:29.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.138 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:29.138 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:29.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:29.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:29.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:29.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:29.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:29.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069523+0000", 2024-04-19T02:17:29.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.244e-06 2024-04-19T02:17:29.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:29.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069528+0000", 2024-04-19T02:17:29.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0669999999999999e-06 2024-04-19T02:17:29.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:29.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069533+0000", 2024-04-19T02:17:29.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4680000000000003e-06 2024-04-19T02:17:29.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:29.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072637+0000", 2024-04-19T02:17:29.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031040429999999999 2024-04-19T02:17:29.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:29.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072710+0000", 2024-04-19T02:17:29.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3045000000000003e-05 2024-04-19T02:17:29.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:29.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072775+0000", 2024-04-19T02:17:29.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5034000000000001e-05 2024-04-19T02:17:29.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.142 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:29.142 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119925+0000", 2024-04-19T02:17:29.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.047150594999999997 2024-04-19T02:17:29.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.142 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:29.142 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120055+0000", 2024-04-19T02:17:29.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129288 2024-04-19T02:17:29.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.143 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:29.143 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120077+0000", 2024-04-19T02:17:29.143 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1759e-05 2024-04-19T02:17:29.143 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.143 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.143 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:29.143 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120096+0000", 2024-04-19T02:17:29.143 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9524000000000001e-05 2024-04-19T02:17:29.143 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:29.143 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:29.143 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:29.143 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.144 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168382 5.f 5:f2599a15:::benchmark_data_smithi121_44835_object34347:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:29.144 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069556+0000", 2024-04-19T02:17:29.144 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 16.995861571999999, 2024-04-19T02:17:29.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050009713999999997, 2024-04-19T02:17:29.144 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:29.144 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:29.144 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:29.144 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:29.144 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:29.144 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168382 2024-04-19T02:17:29.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.145 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:29.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:29.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069556+0000", 2024-04-19T02:17:29.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:29.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:29.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069556+0000", 2024-04-19T02:17:29.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:29.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:29.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069555+0000", 2024-04-19T02:17:29.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:29.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:29.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069558+0000", 2024-04-19T02:17:29.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7879999999999998e-06 2024-04-19T02:17:29.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:29.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069566+0000", 2024-04-19T02:17:29.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6149999999999999e-06 2024-04-19T02:17:29.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.147 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:29.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069571+0000", 2024-04-19T02:17:29.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5509999999999999e-06 2024-04-19T02:17:29.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.147 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:29.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069618+0000", 2024-04-19T02:17:29.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6964e-05 2024-04-19T02:17:29.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.147 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:29.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069744+0000", 2024-04-19T02:17:29.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012577199999999999 2024-04-19T02:17:29.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:29.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.070116+0000", 2024-04-19T02:17:29.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000372407 2024-04-19T02:17:29.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:29.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117511+0000", 2024-04-19T02:17:29.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.047394935999999999 2024-04-19T02:17:29.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:29.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119484+0000", 2024-04-19T02:17:29.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019722310000000001 2024-04-19T02:17:29.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:29.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119525+0000", 2024-04-19T02:17:29.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1035999999999998e-05 2024-04-19T02:17:29.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:29.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119565+0000", 2024-04-19T02:17:29.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0859000000000003e-05 2024-04-19T02:17:29.150 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:29.150 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:29.150 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:29.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.150 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168383 5.d 5:bbd9496c:::benchmark_data_smithi121_44835_object34348:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:29.150 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069581+0000", 2024-04-19T02:17:29.150 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 16.995836684, 2024-04-19T02:17:29.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050607278999999998, 2024-04-19T02:17:29.151 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:29.151 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:29.151 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:29.151 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:29.151 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:29.151 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168383 2024-04-19T02:17:29.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.151 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:29.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:29.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069581+0000", 2024-04-19T02:17:29.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:29.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:29.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069581+0000", 2024-04-19T02:17:29.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:29.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:29.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069580+0000", 2024-04-19T02:17:29.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:29.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:29.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069589+0000", 2024-04-19T02:17:29.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6750000000000008e-06 2024-04-19T02:17:29.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:29.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069596+0000", 2024-04-19T02:17:29.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7360000000000004e-06 2024-04-19T02:17:29.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:29.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069601+0000", 2024-04-19T02:17:29.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0479999999999998e-06 2024-04-19T02:17:29.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:29.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.073854+0000", 2024-04-19T02:17:29.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042531920000000003 2024-04-19T02:17:29.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:29.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.073952+0000", 2024-04-19T02:17:29.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7851999999999998e-05 2024-04-19T02:17:29.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:29.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074012+0000", 2024-04-19T02:17:29.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0225e-05 2024-04-19T02:17:29.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:29.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120102+0000", 2024-04-19T02:17:29.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.046090150000000003 2024-04-19T02:17:29.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:29.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120129+0000", 2024-04-19T02:17:29.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7228000000000001e-05 2024-04-19T02:17:29.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:29.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120157+0000", 2024-04-19T02:17:29.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7165000000000002e-05 2024-04-19T02:17:29.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:29.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120188+0000", 2024-04-19T02:17:29.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1418000000000003e-05 2024-04-19T02:17:29.157 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:29.157 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:29.157 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:29.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.157 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168384 5.7 5:ed638f84:::benchmark_data_smithi121_44835_object34349:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:29.157 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069612+0000", 2024-04-19T02:17:29.157 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 16.995805631, 2024-04-19T02:17:29.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049863376000000001, 2024-04-19T02:17:29.157 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:29.157 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:29.157 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:29.158 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:29.158 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:29.158 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168384 2024-04-19T02:17:29.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.158 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:29.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:29.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069612+0000", 2024-04-19T02:17:29.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:29.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:29.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069612+0000", 2024-04-19T02:17:29.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:29.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:29.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069611+0000", 2024-04-19T02:17:29.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:29.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:29.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069614+0000", 2024-04-19T02:17:29.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7819999999999998e-06 2024-04-19T02:17:29.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:29.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069623+0000", 2024-04-19T02:17:29.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6989999999999992e-06 2024-04-19T02:17:29.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:29.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069628+0000", 2024-04-19T02:17:29.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4999999999999999e-06 2024-04-19T02:17:29.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:29.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069662+0000", 2024-04-19T02:17:29.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3319999999999999e-05 2024-04-19T02:17:29.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:29.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069782+0000", 2024-04-19T02:17:29.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120547 2024-04-19T02:17:29.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:29.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119338+0000", 2024-04-19T02:17:29.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049556141999999997 2024-04-19T02:17:29.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:29.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119388+0000", 2024-04-19T02:17:29.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9866e-05 2024-04-19T02:17:29.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:29.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119475+0000", 2024-04-19T02:17:29.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6929999999999996e-05 2024-04-19T02:17:29.162 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:29.162 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:29.163 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:29.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.163 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168385 5.d 5:b22d7e69:::benchmark_data_smithi121_44835_object34350:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:29.163 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:29.163 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 16.995782192, 2024-04-19T02:17:29.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.055438508999999997, 2024-04-19T02:17:29.163 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:29.163 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:29.163 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:29.163 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:29.163 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:29.163 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168385 2024-04-19T02:17:29.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.164 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:29.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.164 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:29.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:29.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:29.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.164 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:29.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:29.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:29.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:29.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:29.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:29.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:29.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069637+0000", 2024-04-19T02:17:29.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.576e-06 2024-04-19T02:17:29.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:29.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069643+0000", 2024-04-19T02:17:29.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8030000000000002e-06 2024-04-19T02:17:29.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:29.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069648+0000", 2024-04-19T02:17:29.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0889999999999999e-06 2024-04-19T02:17:29.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:29.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117534+0000", 2024-04-19T02:17:29.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.047886390000000001 2024-04-19T02:17:29.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:29.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117670+0000", 2024-04-19T02:17:29.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000135969 2024-04-19T02:17:29.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:29.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117803+0000", 2024-04-19T02:17:29.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000132955 2024-04-19T02:17:29.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:29.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120501+0000", 2024-04-19T02:17:29.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026978050000000002 2024-04-19T02:17:29.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:29.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.125026+0000", 2024-04-19T02:17:29.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045244589999999998 2024-04-19T02:17:29.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:29.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.125049+0000", 2024-04-19T02:17:29.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3807000000000001e-05 2024-04-19T02:17:29.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:29.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.125074+0000", 2024-04-19T02:17:29.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4175000000000001e-05 2024-04-19T02:17:29.169 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:29.169 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:29.169 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:29.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.169 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168386 5.5 5:a2cda182:::benchmark_data_smithi121_44835_object34351:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:29.169 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069653+0000", 2024-04-19T02:17:29.170 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 16.995764725000001, 2024-04-19T02:17:29.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058748884000000001, 2024-04-19T02:17:29.170 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:29.170 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:29.170 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:29.170 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:29.170 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:29.170 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168386 2024-04-19T02:17:29.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.170 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:29.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:29.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069653+0000", 2024-04-19T02:17:29.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:29.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:29.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069653+0000", 2024-04-19T02:17:29.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:29.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:29.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069652+0000", 2024-04-19T02:17:29.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:29.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:29.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069654+0000", 2024-04-19T02:17:29.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1220000000000002e-06 2024-04-19T02:17:29.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:29.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069660+0000", 2024-04-19T02:17:29.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5890000000000002e-06 2024-04-19T02:17:29.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:29.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069665+0000", 2024-04-19T02:17:29.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.989e-06 2024-04-19T02:17:29.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:29.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120220+0000", 2024-04-19T02:17:29.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050555061999999998 2024-04-19T02:17:29.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:29.174 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120329+0000", 2024-04-19T02:17:29.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010922200000000001 2024-04-19T02:17:29.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.174 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:29.174 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.128293+0000", 2024-04-19T02:17:29.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079640279999999997 2024-04-19T02:17:29.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.174 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:29.174 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.128336+0000", 2024-04-19T02:17:29.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2245e-05 2024-04-19T02:17:29.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:29.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.128401+0000", 2024-04-19T02:17:29.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5975000000000004e-05 2024-04-19T02:17:29.175 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:29.175 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:29.175 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:29.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.175 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168387 5.f 5:ff36d1d9:::benchmark_data_smithi121_44835_object34352:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:29.175 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:29.175 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 16.995747891000001, 2024-04-19T02:17:29.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049975358999999997, 2024-04-19T02:17:29.176 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:29.176 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:29.176 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:29.176 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:29.176 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:29.176 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168387 2024-04-19T02:17:29.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.176 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:29.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:29.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:29.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:29.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:29.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:29.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:29.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:29.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:29.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:29.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:29.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069671+0000", 2024-04-19T02:17:29.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1739999999999999e-06 2024-04-19T02:17:29.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:29.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069677+0000", 2024-04-19T02:17:29.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4519999999999996e-06 2024-04-19T02:17:29.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:29.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069682+0000", 2024-04-19T02:17:29.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5400000000000003e-06 2024-04-19T02:17:29.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:29.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072634+0000", 2024-04-19T02:17:29.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0029521510000000001 2024-04-19T02:17:29.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:29.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072706+0000", 2024-04-19T02:17:29.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1996999999999995e-05 2024-04-19T02:17:29.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:29.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072772+0000", 2024-04-19T02:17:29.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5380000000000001e-05 2024-04-19T02:17:29.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:29.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117549+0000", 2024-04-19T02:17:29.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044777124000000001 2024-04-19T02:17:29.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:29.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119572+0000", 2024-04-19T02:17:29.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002022893 2024-04-19T02:17:29.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:29.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119613+0000", 2024-04-19T02:17:29.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0849999999999997e-05 2024-04-19T02:17:29.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:29.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119645+0000", 2024-04-19T02:17:29.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2113000000000002e-05 2024-04-19T02:17:29.182 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:29.182 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:29.182 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:29.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.182 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168389 5.2 5:4bcb87b1:::benchmark_data_smithi121_44835_object34354:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:29.182 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.071719+0000", 2024-04-19T02:17:29.182 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 16.993698795, 2024-04-19T02:17:29.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.048248604, 2024-04-19T02:17:29.182 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:29.183 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:29.183 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:29.183 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:29.183 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:29.183 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168389 2024-04-19T02:17:29.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.183 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:29.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:29.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071719+0000", 2024-04-19T02:17:29.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:29.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:29.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071719+0000", 2024-04-19T02:17:29.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:29.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:29.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071718+0000", 2024-04-19T02:17:29.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:29.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:29.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071722+0000", 2024-04-19T02:17:29.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8590000000000004e-06 2024-04-19T02:17:29.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:29.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071730+0000", 2024-04-19T02:17:29.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8569999999999995e-06 2024-04-19T02:17:29.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:29.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071736+0000", 2024-04-19T02:17:29.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.127e-06 2024-04-19T02:17:29.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:29.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071769+0000", 2024-04-19T02:17:29.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3052000000000001e-05 2024-04-19T02:17:29.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:29.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071843+0000", 2024-04-19T02:17:29.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3683000000000006e-05 2024-04-19T02:17:29.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:29.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119852+0000", 2024-04-19T02:17:29.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.048009353999999997 2024-04-19T02:17:29.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:29.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119896+0000", 2024-04-19T02:17:29.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3102000000000002e-05 2024-04-19T02:17:29.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:29.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119967+0000", 2024-04-19T02:17:29.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1589999999999997e-05 2024-04-19T02:17:29.188 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:29.188 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:29.188 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:29.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.188 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168391 5.3 5:c5d9b5e1:::benchmark_data_smithi121_44835_object34356:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:29.188 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.074402+0000", 2024-04-19T02:17:29.188 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 16.991014956000001, 2024-04-19T02:17:29.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.045426756999999998, 2024-04-19T02:17:29.188 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:29.188 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:29.188 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:29.189 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:29.189 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:29.189 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168391 2024-04-19T02:17:29.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.189 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:29.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:29.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074402+0000", 2024-04-19T02:17:29.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:29.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:29.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074402+0000", 2024-04-19T02:17:29.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:29.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:29.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074401+0000", 2024-04-19T02:17:29.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:29.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:29.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074406+0000", 2024-04-19T02:17:29.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5879999999999999e-06 2024-04-19T02:17:29.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:29.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074414+0000", 2024-04-19T02:17:29.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8599999999999993e-06 2024-04-19T02:17:29.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:29.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074420+0000", 2024-04-19T02:17:29.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6350000000000003e-06 2024-04-19T02:17:29.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:29.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074453+0000", 2024-04-19T02:17:29.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3874000000000001e-05 2024-04-19T02:17:29.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:29.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074531+0000", 2024-04-19T02:17:29.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7999999999999999e-05 2024-04-19T02:17:29.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:29.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119717+0000", 2024-04-19T02:17:29.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.045185395000000003 2024-04-19T02:17:29.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:29.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119756+0000", 2024-04-19T02:17:29.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9110000000000003e-05 2024-04-19T02:17:29.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:29.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119829+0000", 2024-04-19T02:17:29.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3238000000000006e-05 2024-04-19T02:17:29.193 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:29.193 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:29.194 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:29.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.194 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4549.0:168377 5.d e52/16 ondisk, result = 0)", 2024-04-19T02:17:29.194 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.077260+0000", 2024-04-19T02:17:29.194 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 16.988157215000001, 2024-04-19T02:17:29.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042613204000000002, 2024-04-19T02:17:29.194 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:29.194 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:29.194 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:29.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:29.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.077260+0000", 2024-04-19T02:17:29.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:29.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:29.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.077260+0000", 2024-04-19T02:17:29.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:29.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:29.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.077259+0000", 2024-04-19T02:17:29.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:29.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:29.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.077267+0000", 2024-04-19T02:17:29.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6799999999999993e-06 2024-04-19T02:17:29.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:29.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117372+0000", 2024-04-19T02:17:29.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040105342000000002 2024-04-19T02:17:29.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:29.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117389+0000", 2024-04-19T02:17:29.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6711e-05 2024-04-19T02:17:29.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:29.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119862+0000", 2024-04-19T02:17:29.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0024730580000000002 2024-04-19T02:17:29.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:29.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119867+0000", 2024-04-19T02:17:29.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1590000000000001e-06 2024-04-19T02:17:29.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:29.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:29.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:29.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119873+0000", 2024-04-19T02:17:29.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1410000000000002e-06 2024-04-19T02:17:29.198 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:29.198 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:29.198 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:29.198 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:29.198 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:29.199 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:29.200 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:17:29.201 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:29.200+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:29.301 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:29.301+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:29.318 INFO:teuthology.orchestra.run.smithi121.stderr:noscrub is set 2024-04-19T02:17:29.373 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:17:29.374 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:17:29.374 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.374 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:216913 5.0 5:06b220f0:::benchmark_data_smithi121_44835_object82878:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T02:17:29.374 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:29.363183+0000", 2024-04-19T02:17:29.374 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.010852074999999999, 2024-04-19T02:17:29.374 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010873226, 2024-04-19T02:17:29.374 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:29.374 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:29.374 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:29.374 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:29.374 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:29.375 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 216913 2024-04-19T02:17:29.375 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.375 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:29.375 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.375 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:29.375 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.363183+0000", 2024-04-19T02:17:29.375 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.375 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.375 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.375 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:29.375 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.363183+0000", 2024-04-19T02:17:29.375 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.375 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.375 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.375 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:29.376 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.363183+0000", 2024-04-19T02:17:29.376 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:29.376 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.376 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.376 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:29.376 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.363185+0000", 2024-04-19T02:17:29.376 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1639999999999999e-06 2024-04-19T02:17:29.376 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.376 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.376 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:29.376 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.363191+0000", 2024-04-19T02:17:29.376 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.1299999999999998e-06 2024-04-19T02:17:29.376 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.376 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.377 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:29.377 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.363197+0000", 2024-04-19T02:17:29.377 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.9349999999999999e-06 2024-04-19T02:17:29.377 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.377 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.377 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:29.377 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.368220+0000", 2024-04-19T02:17:29.377 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0050223849999999999 2024-04-19T02:17:29.377 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.377 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.377 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:29.377 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.368342+0000", 2024-04-19T02:17:29.377 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000122416 2024-04-19T02:17:29.377 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.377 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:29.378 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.378 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.378 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.378 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:216924 5.d e59/16 5:b0c986b3:::benchmark_data_smithi121_44835_object82889:head v 59'13583, mlcod=59'13579)", 2024-04-19T02:17:29.378 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:29.368668+0000", 2024-04-19T02:17:29.378 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0053677580000000003, 2024-04-19T02:17:29.378 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0054347759999999997, 2024-04-19T02:17:29.378 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:29.378 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:29.378 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:29.378 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.378 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:29.378 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.368668+0000", 2024-04-19T02:17:29.378 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.378 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.379 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.379 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:29.379 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.368668+0000", 2024-04-19T02:17:29.379 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.379 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.379 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.379 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:29.379 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.368667+0000", 2024-04-19T02:17:29.379 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:29.379 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.379 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.379 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:29.379 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.368675+0000", 2024-04-19T02:17:29.379 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9689999999999994e-06 2024-04-19T02:17:29.379 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.380 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.380 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:29.380 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.368691+0000", 2024-04-19T02:17:29.380 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.6082e-05 2024-04-19T02:17:29.380 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.380 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.380 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:29.380 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.368698+0000", 2024-04-19T02:17:29.380 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.9949999999999999e-06 2024-04-19T02:17:29.380 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.380 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.380 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:29.380 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.368835+0000", 2024-04-19T02:17:29.380 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000136988 2024-04-19T02:17:29.380 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.381 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.381 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:29.381 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.368851+0000", 2024-04-19T02:17:29.381 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.6007000000000001e-05 2024-04-19T02:17:29.381 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.381 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:29.381 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.381 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.381 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.381 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:216926 5.0 5:01d29bd1:::benchmark_data_smithi121_44835_object82891:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T02:17:29.381 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:29.368986+0000", 2024-04-19T02:17:29.381 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0050495339999999996, 2024-04-19T02:17:29.381 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0051529760000000001, 2024-04-19T02:17:29.382 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:29.382 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:29.382 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:29.382 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:29.382 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:29.382 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 216926 2024-04-19T02:17:29.382 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.382 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:29.382 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.382 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:29.382 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.368986+0000", 2024-04-19T02:17:29.382 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.382 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.382 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.382 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:29.383 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.368986+0000", 2024-04-19T02:17:29.383 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.383 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.383 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.383 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:29.383 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.368985+0000", 2024-04-19T02:17:29.383 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:29.383 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.383 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.383 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:29.383 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.368989+0000", 2024-04-19T02:17:29.383 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.6569999999999996e-06 2024-04-19T02:17:29.383 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.383 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.383 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:29.383 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.369000+0000", 2024-04-19T02:17:29.384 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0696000000000001e-05 2024-04-19T02:17:29.384 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.384 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.384 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:29.384 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.369007+0000", 2024-04-19T02:17:29.384 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1679999999999998e-06 2024-04-19T02:17:29.384 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.384 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.384 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:29.384 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.370217+0000", 2024-04-19T02:17:29.384 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0012093220000000001 2024-04-19T02:17:29.384 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.384 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.384 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:29.385 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.370298+0000", 2024-04-19T02:17:29.385 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.1631999999999994e-05 2024-04-19T02:17:29.385 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.385 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:29.385 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.385 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.385 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.385 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:216931 5.8 5:1e1e2d9e:::benchmark_data_smithi121_44835_object82896:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T02:17:29.385 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:29.370252+0000", 2024-04-19T02:17:29.385 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0037835719999999998, 2024-04-19T02:17:29.385 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0039251319999999996, 2024-04-19T02:17:29.385 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:29.385 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:29.385 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:29.386 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:29.386 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:29.386 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 216931 2024-04-19T02:17:29.386 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.386 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:29.386 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.386 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:29.386 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.370252+0000", 2024-04-19T02:17:29.386 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.386 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.386 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.386 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:29.386 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.370252+0000", 2024-04-19T02:17:29.386 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.386 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.387 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.387 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:29.387 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.370251+0000", 2024-04-19T02:17:29.387 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:29.387 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.387 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.387 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:29.387 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.370256+0000", 2024-04-19T02:17:29.387 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.9080000000000003e-06 2024-04-19T02:17:29.387 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.387 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.387 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:29.387 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.370264+0000", 2024-04-19T02:17:29.387 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.3650000000000004e-06 2024-04-19T02:17:29.387 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.388 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.388 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:29.388 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.370271+0000", 2024-04-19T02:17:29.388 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.9399999999999996e-06 2024-04-19T02:17:29.388 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.388 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.388 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:29.388 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.371371+0000", 2024-04-19T02:17:29.388 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0010995 2024-04-19T02:17:29.388 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.388 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.388 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:29.388 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.371442+0000", 2024-04-19T02:17:29.388 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1632999999999997e-05 2024-04-19T02:17:29.389 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.389 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:29.389 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.389 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.389 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.389 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:216932 5.9 e59/16 5:90296dc8:::benchmark_data_smithi121_44835_object82897:head v 59'13757, mlcod=59'13755)", 2024-04-19T02:17:29.389 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:29.370651+0000", 2024-04-19T02:17:29.389 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.003384298, 2024-04-19T02:17:29.389 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0035779029999999999, 2024-04-19T02:17:29.389 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:29.389 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:29.389 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:29.389 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.389 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:29.389 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.370651+0000", 2024-04-19T02:17:29.390 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.390 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.390 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.390 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:29.390 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.370651+0000", 2024-04-19T02:17:29.390 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.390 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.390 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.390 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:29.390 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.370650+0000", 2024-04-19T02:17:29.390 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:29.390 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.391 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.391 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:29.391 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.370659+0000", 2024-04-19T02:17:29.391 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.6230000000000003e-06 2024-04-19T02:17:29.391 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.391 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.391 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:29.391 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.370668+0000", 2024-04-19T02:17:29.391 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.5489999999999995e-06 2024-04-19T02:17:29.391 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.391 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.391 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:29.391 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.370674+0000", 2024-04-19T02:17:29.391 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.3569999999999997e-06 2024-04-19T02:17:29.392 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.392 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.392 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:29.392 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.370698+0000", 2024-04-19T02:17:29.392 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4349999999999999e-05 2024-04-19T02:17:29.392 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.392 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.392 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:29.392 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.370711+0000", 2024-04-19T02:17:29.392 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2724999999999999e-05 2024-04-19T02:17:29.392 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.392 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:29.392 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.392 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.393 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.393 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:216935 5.e 5:7fce0b1b:::benchmark_data_smithi121_44835_object82900:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T02:17:29.393 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:29.373102+0000", 2024-04-19T02:17:29.393 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.00093391999999999998, 2024-04-19T02:17:29.393 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0011950540000000001, 2024-04-19T02:17:29.393 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:29.393 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:29.393 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:29.393 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:29.393 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:29.393 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 216935 2024-04-19T02:17:29.393 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.393 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:29.393 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.394 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:29.394 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.373102+0000", 2024-04-19T02:17:29.394 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.394 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.394 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.394 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:29.394 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.373102+0000", 2024-04-19T02:17:29.394 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.394 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.394 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.394 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:29.394 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.373101+0000", 2024-04-19T02:17:29.394 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:29.395 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.395 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.395 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:29.395 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.373105+0000", 2024-04-19T02:17:29.395 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.7400000000000004e-06 2024-04-19T02:17:29.395 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.395 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.395 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:29.395 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.373116+0000", 2024-04-19T02:17:29.395 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0628000000000001e-05 2024-04-19T02:17:29.395 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.395 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.395 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:29.396 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.373122+0000", 2024-04-19T02:17:29.396 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.2210000000000002e-06 2024-04-19T02:17:29.396 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.396 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.396 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:29.396 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.373155+0000", 2024-04-19T02:17:29.396 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3167999999999998e-05 2024-04-19T02:17:29.396 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.396 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.396 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:29.396 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.373274+0000", 2024-04-19T02:17:29.396 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000118397 2024-04-19T02:17:29.396 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.396 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:29.396 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.396 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.397 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.397 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:216936 5.a 5:58850a58:::benchmark_data_smithi121_44835_object82901:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T02:17:29.397 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:29.373130+0000", 2024-04-19T02:17:29.397 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.00090531300000000004, 2024-04-19T02:17:29.397 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0012335580000000001, 2024-04-19T02:17:29.397 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:29.397 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:29.397 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:29.397 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:29.397 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:29.397 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 216936 2024-04-19T02:17:29.397 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.397 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:29.398 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.398 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:29.398 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.373130+0000", 2024-04-19T02:17:29.398 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.398 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.398 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.398 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:29.398 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.373130+0000", 2024-04-19T02:17:29.398 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.398 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.398 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.398 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:29.398 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.373130+0000", 2024-04-19T02:17:29.399 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:29.399 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.399 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.399 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:29.399 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.373132+0000", 2024-04-19T02:17:29.399 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.413e-06 2024-04-19T02:17:29.399 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.399 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.399 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:29.399 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.373137+0000", 2024-04-19T02:17:29.399 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.634e-06 2024-04-19T02:17:29.399 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.399 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.399 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:29.399 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.373146+0000", 2024-04-19T02:17:29.400 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.7800000000000006e-06 2024-04-19T02:17:29.400 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.400 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.400 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:29.400 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.373182+0000", 2024-04-19T02:17:29.400 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6572999999999997e-05 2024-04-19T02:17:29.400 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.400 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.400 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:29.400 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.373293+0000", 2024-04-19T02:17:29.400 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000110529 2024-04-19T02:17:29.400 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.400 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:29.400 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.401 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.401 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.401 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:216937 5.1 5:8ff8789d:::benchmark_data_smithi121_44835_object82902:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T02:17:29.401 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:29.373152+0000", 2024-04-19T02:17:29.401 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.00088316000000000002, 2024-04-19T02:17:29.401 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0012773120000000001, 2024-04-19T02:17:29.401 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:29.401 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:29.401 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:29.401 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:29.401 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:29.401 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 216937 2024-04-19T02:17:29.401 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.401 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:29.401 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.402 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:29.402 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.373152+0000", 2024-04-19T02:17:29.402 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.402 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.402 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.402 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:29.402 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.373152+0000", 2024-04-19T02:17:29.402 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.402 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.402 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.402 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:29.402 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.373152+0000", 2024-04-19T02:17:29.403 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:29.403 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.403 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.403 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:29.403 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.373154+0000", 2024-04-19T02:17:29.403 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.2520000000000002e-06 2024-04-19T02:17:29.403 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.403 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.403 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:29.403 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.373160+0000", 2024-04-19T02:17:29.403 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.6300000000000003e-06 2024-04-19T02:17:29.403 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.404 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.404 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:29.404 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.373164+0000", 2024-04-19T02:17:29.404 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2390000000000004e-06 2024-04-19T02:17:29.404 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.404 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.404 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:29.404 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.373202+0000", 2024-04-19T02:17:29.404 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7468000000000001e-05 2024-04-19T02:17:29.404 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.404 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.404 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:29.404 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.373312+0000", 2024-04-19T02:17:29.404 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000110367 2024-04-19T02:17:29.404 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.405 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:29.405 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.405 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.405 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.405 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:216938 5.4 5:2639256a:::benchmark_data_smithi121_44835_object82903:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T02:17:29.405 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:29.373172+0000", 2024-04-19T02:17:29.405 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.00086382899999999999, 2024-04-19T02:17:29.405 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0012994219999999999, 2024-04-19T02:17:29.405 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:29.405 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:29.405 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:29.405 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:29.405 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:29.405 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 216938 2024-04-19T02:17:29.406 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.406 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:29.406 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.406 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:29.406 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.373172+0000", 2024-04-19T02:17:29.406 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.406 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.406 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.406 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:29.406 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.373172+0000", 2024-04-19T02:17:29.406 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.406 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.406 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.406 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:29.407 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.373171+0000", 2024-04-19T02:17:29.407 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:29.407 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.407 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.407 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:29.407 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.373173+0000", 2024-04-19T02:17:29.407 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1569999999999998e-06 2024-04-19T02:17:29.407 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.407 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.407 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:29.407 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.373180+0000", 2024-04-19T02:17:29.407 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.489e-06 2024-04-19T02:17:29.408 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.408 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.408 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:29.408 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.373185+0000", 2024-04-19T02:17:29.408 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0130000000000001e-06 2024-04-19T02:17:29.408 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.408 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.408 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:29.408 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.373223+0000", 2024-04-19T02:17:29.408 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8525999999999997e-05 2024-04-19T02:17:29.408 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.408 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.409 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:29.409 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.373344+0000", 2024-04-19T02:17:29.409 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000120908 2024-04-19T02:17:29.409 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.409 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:29.409 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.409 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.409 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.409 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:216933 5.9 e59/16 5:92116d11:::benchmark_data_smithi121_44835_object82898:head v 59'13758, mlcod=59'13755)", 2024-04-19T02:17:29.409 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:29.373202+0000", 2024-04-19T02:17:29.409 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.00083357099999999996, 2024-04-19T02:17:29.409 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001305458, 2024-04-19T02:17:29.409 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:29.410 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:29.410 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:29.410 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.410 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:29.410 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.373202+0000", 2024-04-19T02:17:29.410 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.410 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.410 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.410 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:29.410 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.373202+0000", 2024-04-19T02:17:29.410 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.410 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.411 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.411 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:29.411 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.373201+0000", 2024-04-19T02:17:29.411 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:29.411 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.411 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.411 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:29.411 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.373209+0000", 2024-04-19T02:17:29.411 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.401e-06 2024-04-19T02:17:29.411 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.411 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.411 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:29.411 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.373215+0000", 2024-04-19T02:17:29.411 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5610000000000004e-06 2024-04-19T02:17:29.411 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.411 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.412 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:29.412 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.373221+0000", 2024-04-19T02:17:29.412 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2499999999999997e-06 2024-04-19T02:17:29.412 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.412 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.412 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:29.412 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.373301+0000", 2024-04-19T02:17:29.412 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0124999999999996e-05 2024-04-19T02:17:29.412 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.412 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.412 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:29.412 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:29.373311+0000", 2024-04-19T02:17:29.412 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0453e-05 2024-04-19T02:17:29.412 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.412 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:29.413 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.413 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.413 INFO:teuthology.orchestra.run.smithi174.stdout: ], 2024-04-19T02:17:29.413 INFO:teuthology.orchestra.run.smithi174.stdout: "num_ops": 10 2024-04-19T02:17:29.413 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:17:29.414 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:17:29.415 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:29.414+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:29.515 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:29.515+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:29.588 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:17:29.588 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [], 2024-04-19T02:17:29.589 INFO:teuthology.orchestra.run.smithi174.stdout: "complaint_time": 30, 2024-04-19T02:17:29.589 INFO:teuthology.orchestra.run.smithi174.stdout: "num_blocked_ops": 0 2024-04-19T02:17:29.589 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:17:29.603 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:17:29.616 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:29.616+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:29.690 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:17:29.717 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:29.717+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:29.818 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:29.818+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:29.821 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:17:29.821 INFO:teuthology.orchestra.run.smithi174.stdout: "size": 20, 2024-04-19T02:17:29.822 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 600, 2024-04-19T02:17:29.822 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:17:29.822 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.822 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:19 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:29.822 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:17:29.822 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 120.54977615599999, 2024-04-19T02:17:29.822 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020818203, 2024-04-19T02:17:29.822 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:29.822 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:29.822 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:29.822 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.822 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:29.822 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:17:29.823 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.823 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.823 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.823 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:29.823 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:17:29.823 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.823 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.823 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.823 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:29.823 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:17:29.823 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:29.823 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.823 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.823 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:29.823 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270065+0000", 2024-04-19T02:17:29.824 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4310000000000001e-06 2024-04-19T02:17:29.824 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.824 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.824 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:29.824 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270070+0000", 2024-04-19T02:17:29.824 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2859999999999999e-06 2024-04-19T02:17:29.824 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.824 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.824 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:29.824 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270077+0000", 2024-04-19T02:17:29.824 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5270000000000004e-06 2024-04-19T02:17:29.824 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.824 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.824 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:29.824 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270107+0000", 2024-04-19T02:17:29.825 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0205999999999998e-05 2024-04-19T02:17:29.825 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.825 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.825 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:29.825 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270111+0000", 2024-04-19T02:17:29.825 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8650000000000003e-06 2024-04-19T02:17:29.825 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.825 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.825 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:29.825 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285936+0000", 2024-04-19T02:17:29.825 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015824677999999998 2024-04-19T02:17:29.825 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.825 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.825 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:29.826 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286007+0000", 2024-04-19T02:17:29.826 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1157999999999999e-05 2024-04-19T02:17:29.826 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.826 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.826 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:29.826 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286086+0000", 2024-04-19T02:17:29.826 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9084000000000004e-05 2024-04-19T02:17:29.826 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.826 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.826 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:29.826 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290740+0000", 2024-04-19T02:17:29.826 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0046543679999999999 2024-04-19T02:17:29.826 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.827 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.827 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:29.827 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290833+0000", 2024-04-19T02:17:29.827 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2551000000000002e-05 2024-04-19T02:17:29.827 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.827 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.827 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:29.827 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290859+0000", 2024-04-19T02:17:29.827 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.6696999999999999e-05 2024-04-19T02:17:29.827 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.827 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.827 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:29.827 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290881+0000", 2024-04-19T02:17:29.827 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1653000000000001e-05 2024-04-19T02:17:29.827 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.828 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:29.828 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.828 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.828 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.828 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:77622 5.8 5:166fbe77:::benchmark_data_smithi121_44835_object77621:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:29.828 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:17:29.828 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 63.014279219000002, 2024-04-19T02:17:29.828 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.021784694, 2024-04-19T02:17:29.828 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:29.828 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:29.828 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:29.828 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:29.828 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:29.828 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 77622 2024-04-19T02:17:29.828 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.829 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:29.829 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.829 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:29.829 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:17:29.829 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.829 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.829 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.829 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:29.829 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:17:29.829 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.829 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.829 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.829 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:29.829 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805559+0000", 2024-04-19T02:17:29.829 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:29.830 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.830 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.830 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:29.830 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805659+0000", 2024-04-19T02:17:29.830 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.9908000000000006e-05 2024-04-19T02:17:29.830 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.830 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.830 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:29.830 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805668+0000", 2024-04-19T02:17:29.830 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2129999999999997e-06 2024-04-19T02:17:29.830 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.830 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.830 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:29.830 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805673+0000", 2024-04-19T02:17:29.830 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0370000000000002e-06 2024-04-19T02:17:29.831 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.831 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.831 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:29.831 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812022+0000", 2024-04-19T02:17:29.831 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0063483239999999998 2024-04-19T02:17:29.831 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.831 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.831 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:29.831 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812129+0000", 2024-04-19T02:17:29.831 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010744200000000001 2024-04-19T02:17:29.831 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.831 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.831 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:29.831 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812252+0000", 2024-04-19T02:17:29.831 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000122519 2024-04-19T02:17:29.831 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.832 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.832 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:29.832 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.820979+0000", 2024-04-19T02:17:29.832 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0087272740000000001 2024-04-19T02:17:29.832 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.832 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.832 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:29.832 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827270+0000", 2024-04-19T02:17:29.832 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0062906239999999999 2024-04-19T02:17:29.832 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.832 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.832 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:29.832 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827309+0000", 2024-04-19T02:17:29.832 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9678999999999997e-05 2024-04-19T02:17:29.832 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.833 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.833 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:29.833 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827345+0000", 2024-04-19T02:17:29.833 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5308000000000001e-05 2024-04-19T02:17:29.833 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.833 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:29.833 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.833 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.833 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.833 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78224 5.4 5:26e797d5:::benchmark_data_smithi121_44835_object78223:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:29.833 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:17:29.833 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 62.71327702, 2024-04-19T02:17:29.833 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.021471998999999999, 2024-04-19T02:17:29.833 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:29.834 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:29.834 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:29.834 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:29.834 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:29.834 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78224 2024-04-19T02:17:29.834 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.834 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:29.834 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.834 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:29.834 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:17:29.834 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.834 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.834 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.834 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:29.834 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:17:29.835 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.835 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.835 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.835 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:29.835 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106561+0000", 2024-04-19T02:17:29.835 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:29.835 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.835 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.835 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:29.835 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106630+0000", 2024-04-19T02:17:29.835 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.8553999999999994e-05 2024-04-19T02:17:29.835 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.835 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.835 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:29.835 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106644+0000", 2024-04-19T02:17:29.836 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.4651000000000001e-05 2024-04-19T02:17:29.836 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.836 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.836 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:29.836 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106653+0000", 2024-04-19T02:17:29.836 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.6719999999999993e-06 2024-04-19T02:17:29.836 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.836 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.836 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:29.836 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106693+0000", 2024-04-19T02:17:29.836 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9978999999999998e-05 2024-04-19T02:17:29.836 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.836 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.836 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:29.836 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106840+0000", 2024-04-19T02:17:29.836 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0001473 2024-04-19T02:17:29.837 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.837 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.837 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:29.837 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106971+0000", 2024-04-19T02:17:29.837 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013051499999999999 2024-04-19T02:17:29.837 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.837 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.837 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:29.837 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.109047+0000", 2024-04-19T02:17:29.837 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.002076002 2024-04-19T02:17:29.837 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.837 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.837 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:29.837 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.127967+0000", 2024-04-19T02:17:29.837 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.018919780000000001 2024-04-19T02:17:29.838 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.838 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.838 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:29.838 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128004+0000", 2024-04-19T02:17:29.838 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7719000000000003e-05 2024-04-19T02:17:29.838 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.838 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.838 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:29.838 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128034+0000", 2024-04-19T02:17:29.838 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9651000000000001e-05 2024-04-19T02:17:29.838 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.838 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:29.838 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.838 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.839 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.839 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78259 5.4 5:2aa344b2:::benchmark_data_smithi121_44835_object78258:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:29.839 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:17:29.839 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 62.694581951000004, 2024-04-19T02:17:29.839 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022934350999999999, 2024-04-19T02:17:29.839 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:29.839 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:29.839 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:29.839 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:29.839 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:29.839 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78259 2024-04-19T02:17:29.839 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.839 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:29.839 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.839 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:29.840 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:17:29.840 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.840 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.840 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.840 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:29.840 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:17:29.840 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.840 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.840 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.840 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:29.840 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125256+0000", 2024-04-19T02:17:29.840 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:29.840 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.840 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.840 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:29.840 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125347+0000", 2024-04-19T02:17:29.841 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0470000000000006e-05 2024-04-19T02:17:29.841 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.841 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.841 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:29.841 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125358+0000", 2024-04-19T02:17:29.841 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1764e-05 2024-04-19T02:17:29.841 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.841 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.841 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:29.841 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125364+0000", 2024-04-19T02:17:29.841 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7189999999999998e-06 2024-04-19T02:17:29.841 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.841 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.841 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:29.842 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125391+0000", 2024-04-19T02:17:29.842 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7270000000000001e-05 2024-04-19T02:17:29.842 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.842 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.842 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:29.842 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125471+0000", 2024-04-19T02:17:29.842 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9209999999999995e-05 2024-04-19T02:17:29.842 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.842 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.842 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:29.842 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125559+0000", 2024-04-19T02:17:29.842 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.8689000000000004e-05 2024-04-19T02:17:29.843 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.843 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.843 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:29.843 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128164+0000", 2024-04-19T02:17:29.843 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0026050270000000002 2024-04-19T02:17:29.843 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.843 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.843 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:29.843 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148139+0000", 2024-04-19T02:17:29.843 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.019975050000000001 2024-04-19T02:17:29.843 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.843 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.843 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:29.843 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148169+0000", 2024-04-19T02:17:29.843 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0001e-05 2024-04-19T02:17:29.844 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.844 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.844 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:29.844 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148191+0000", 2024-04-19T02:17:29.844 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.2104999999999999e-05 2024-04-19T02:17:29.844 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.844 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:29.844 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.844 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.844 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.844 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78271 5.4 5:2982d7a6:::benchmark_data_smithi121_44835_object78270:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:29.844 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:17:29.844 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 62.687718721000003, 2024-04-19T02:17:29.844 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020841755999999999, 2024-04-19T02:17:29.844 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:29.844 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:29.845 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:29.845 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:29.845 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:29.845 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78271 2024-04-19T02:17:29.845 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.845 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:29.845 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.845 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:29.845 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:17:29.845 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.845 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.845 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.845 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:29.845 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:17:29.845 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.845 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.846 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.846 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:29.846 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132119+0000", 2024-04-19T02:17:29.846 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:29.846 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.846 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.846 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:29.846 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132185+0000", 2024-04-19T02:17:29.846 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5994000000000005e-05 2024-04-19T02:17:29.846 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.846 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.846 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:29.846 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132197+0000", 2024-04-19T02:17:29.846 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2091e-05 2024-04-19T02:17:29.846 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.847 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.847 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:29.847 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132206+0000", 2024-04-19T02:17:29.847 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.5099999999999998e-06 2024-04-19T02:17:29.847 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.847 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.847 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:29.847 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132242+0000", 2024-04-19T02:17:29.847 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5663000000000001e-05 2024-04-19T02:17:29.847 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.847 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.847 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:29.847 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132335+0000", 2024-04-19T02:17:29.847 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3275000000000004e-05 2024-04-19T02:17:29.847 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.848 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.848 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:29.848 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132432+0000", 2024-04-19T02:17:29.848 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7571000000000005e-05 2024-04-19T02:17:29.848 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.848 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.848 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:29.848 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.136706+0000", 2024-04-19T02:17:29.848 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0042738170000000001 2024-04-19T02:17:29.848 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.848 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.848 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:29.848 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152909+0000", 2024-04-19T02:17:29.848 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016202415000000001 2024-04-19T02:17:29.848 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.849 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.849 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:29.849 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152938+0000", 2024-04-19T02:17:29.849 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9740999999999999e-05 2024-04-19T02:17:29.849 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.849 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.849 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:29.849 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152962+0000", 2024-04-19T02:17:29.849 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3659000000000002e-05 2024-04-19T02:17:29.849 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.849 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:29.849 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.849 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.849 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.849 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78272 5.4 5:273e819a:::benchmark_data_smithi121_44835_object78271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:29.850 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:29.850 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 62.687229678000001, 2024-04-19T02:17:29.850 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022180163999999999, 2024-04-19T02:17:29.850 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:29.850 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:29.850 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:29.850 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:29.850 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:29.850 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78272 2024-04-19T02:17:29.850 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.850 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:29.850 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.850 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:29.850 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:29.850 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.851 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.851 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.851 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:29.851 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:29.851 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.851 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.851 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.851 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:29.851 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:29.851 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:29.851 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.851 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.851 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:29.851 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132690+0000", 2024-04-19T02:17:29.851 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0963000000000004e-05 2024-04-19T02:17:29.852 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.852 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.852 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:29.852 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132703+0000", 2024-04-19T02:17:29.852 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.3072e-05 2024-04-19T02:17:29.852 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.852 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.852 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:29.852 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132710+0000", 2024-04-19T02:17:29.852 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3100000000000003e-06 2024-04-19T02:17:29.852 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.852 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.852 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:29.852 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134005+0000", 2024-04-19T02:17:29.852 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001294513 2024-04-19T02:17:29.852 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.853 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.853 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:29.853 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134139+0000", 2024-04-19T02:17:29.853 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000134447 2024-04-19T02:17:29.853 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.853 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.853 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:29.853 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134284+0000", 2024-04-19T02:17:29.853 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014514399999999999 2024-04-19T02:17:29.853 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.853 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.853 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:29.853 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.139622+0000", 2024-04-19T02:17:29.853 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0053373830000000002 2024-04-19T02:17:29.853 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.854 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.854 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:29.854 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154737+0000", 2024-04-19T02:17:29.854 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015115195999999999 2024-04-19T02:17:29.854 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.854 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.854 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:29.854 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154768+0000", 2024-04-19T02:17:29.854 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0824999999999997e-05 2024-04-19T02:17:29.854 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.854 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.854 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:29.854 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154790+0000", 2024-04-19T02:17:29.854 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1999000000000001e-05 2024-04-19T02:17:29.854 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.855 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:29.855 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.855 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.855 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.855 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:94481 5.e 5:7b2fbebf:::benchmark_data_smithi121_44835_object94480:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:29.855 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:17:29.855 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 54.698593361, 2024-04-19T02:17:29.855 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020897846000000001, 2024-04-19T02:17:29.855 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:29.855 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:29.855 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:29.855 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:29.855 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:29.855 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 94481 2024-04-19T02:17:29.855 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.856 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:29.856 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.856 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:29.856 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:17:29.856 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.856 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.856 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.856 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:29.856 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:17:29.856 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.856 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.856 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.856 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:29.856 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121245+0000", 2024-04-19T02:17:29.856 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:29.857 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.857 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.857 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:29.857 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121273+0000", 2024-04-19T02:17:29.857 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7250000000000002e-05 2024-04-19T02:17:29.857 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.857 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.857 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:29.857 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121277+0000", 2024-04-19T02:17:29.857 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2860000000000001e-06 2024-04-19T02:17:29.857 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.857 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.857 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:29.857 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121280+0000", 2024-04-19T02:17:29.857 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2739999999999999e-06 2024-04-19T02:17:29.857 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.858 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.858 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:29.858 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121320+0000", 2024-04-19T02:17:29.858 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9879000000000002e-05 2024-04-19T02:17:29.858 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.858 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.858 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:29.858 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121448+0000", 2024-04-19T02:17:29.858 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012748800000000001 2024-04-19T02:17:29.858 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.858 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.858 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:29.858 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121595+0000", 2024-04-19T02:17:29.858 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014741299999999999 2024-04-19T02:17:29.859 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.859 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.859 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:29.859 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.127776+0000", 2024-04-19T02:17:29.859 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0061811360000000003 2024-04-19T02:17:29.859 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.859 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.859 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:29.859 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142073+0000", 2024-04-19T02:17:29.859 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014296959999999999 2024-04-19T02:17:29.859 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.859 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.859 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:29.859 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142106+0000", 2024-04-19T02:17:29.860 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3348e-05 2024-04-19T02:17:29.860 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.860 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.860 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:29.860 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142144+0000", 2024-04-19T02:17:29.860 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7153000000000002e-05 2024-04-19T02:17:29.860 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.860 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:29.860 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.860 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.860 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.860 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:94581 5.b 5:dc86d6e9:::benchmark_data_smithi121_44835_object94580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:29.860 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:29.860 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 54.639658787999998, 2024-04-19T02:17:29.860 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022099711000000001, 2024-04-19T02:17:29.860 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:29.861 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:29.861 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:29.861 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:29.861 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:29.861 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 94581 2024-04-19T02:17:29.861 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.861 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:29.861 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.861 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:29.861 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:29.861 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.861 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.861 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.861 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:29.861 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:29.862 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.862 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.862 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.862 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:29.862 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:29.862 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:29.862 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.862 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.862 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:29.862 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180253+0000", 2024-04-19T02:17:29.862 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3163000000000004e-05 2024-04-19T02:17:29.862 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.862 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.862 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:29.862 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180266+0000", 2024-04-19T02:17:29.863 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2886e-05 2024-04-19T02:17:29.863 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.863 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.863 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:29.863 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180273+0000", 2024-04-19T02:17:29.863 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.4059999999999999e-06 2024-04-19T02:17:29.863 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.863 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.863 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:29.863 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180646+0000", 2024-04-19T02:17:29.863 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00037283999999999999 2024-04-19T02:17:29.863 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.863 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.863 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:29.863 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180774+0000", 2024-04-19T02:17:29.864 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012793799999999999 2024-04-19T02:17:29.864 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.864 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.864 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:29.864 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180920+0000", 2024-04-19T02:17:29.864 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000146692 2024-04-19T02:17:29.864 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.864 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.864 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:29.864 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.183344+0000", 2024-04-19T02:17:29.864 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0024231669999999999 2024-04-19T02:17:29.864 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.864 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.864 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:29.864 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202196+0000", 2024-04-19T02:17:29.865 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.018852384 2024-04-19T02:17:29.865 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.865 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.865 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:29.865 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202241+0000", 2024-04-19T02:17:29.865 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4923999999999999e-05 2024-04-19T02:17:29.865 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.865 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.865 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:29.865 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202280+0000", 2024-04-19T02:17:29.865 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9096e-05 2024-04-19T02:17:29.865 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.865 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:29.865 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.865 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.866 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.866 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:96356 5.0 5:0a661b39:::benchmark_data_smithi121_44835_object96355:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:29.866 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:17:29.866 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 53.726445945999998, 2024-04-19T02:17:29.866 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020955516, 2024-04-19T02:17:29.866 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:29.866 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:29.866 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:29.866 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:29.866 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:29.866 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 96356 2024-04-19T02:17:29.866 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.866 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:29.866 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.867 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:29.867 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:17:29.867 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.867 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.867 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.867 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:29.867 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:17:29.867 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.867 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.867 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.867 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:29.867 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:17:29.867 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:29.867 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.867 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.867 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:29.868 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093455+0000", 2024-04-19T02:17:29.868 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.2205000000000005e-05 2024-04-19T02:17:29.868 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.868 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.868 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:29.868 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093464+0000", 2024-04-19T02:17:29.868 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3910000000000004e-06 2024-04-19T02:17:29.868 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.868 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.868 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:29.868 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093469+0000", 2024-04-19T02:17:29.868 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.7249999999999997e-06 2024-04-19T02:17:29.868 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.868 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.868 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:29.869 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099643+0000", 2024-04-19T02:17:29.869 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0061743359999999999 2024-04-19T02:17:29.869 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.869 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.869 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:29.869 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099774+0000", 2024-04-19T02:17:29.869 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013050599999999999 2024-04-19T02:17:29.869 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.869 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.869 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:29.869 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099917+0000", 2024-04-19T02:17:29.869 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000143187 2024-04-19T02:17:29.869 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.869 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.869 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:29.870 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.105432+0000", 2024-04-19T02:17:29.870 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.005514873 2024-04-19T02:17:29.870 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.870 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.870 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:29.870 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114264+0000", 2024-04-19T02:17:29.870 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.008831752 2024-04-19T02:17:29.870 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.870 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.870 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:29.870 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114300+0000", 2024-04-19T02:17:29.870 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6582000000000003e-05 2024-04-19T02:17:29.870 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.870 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.870 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:29.871 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114349+0000", 2024-04-19T02:17:29.871 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8579999999999999e-05 2024-04-19T02:17:29.871 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.871 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:29.871 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.871 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.871 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.871 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:96357 5.0 5:00efce8b:::benchmark_data_smithi121_44835_object96356:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:29.871 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:17:29.871 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 53.726366268, 2024-04-19T02:17:29.871 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020937471999999999, 2024-04-19T02:17:29.871 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:29.871 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:29.871 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:29.871 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:29.872 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:29.872 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 96357 2024-04-19T02:17:29.872 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.872 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:29.872 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.872 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:29.872 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:17:29.872 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.872 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.872 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.872 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:29.872 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:17:29.872 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.872 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.873 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.873 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:29.873 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093472+0000", 2024-04-19T02:17:29.873 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:29.873 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.873 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.873 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:29.873 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093513+0000", 2024-04-19T02:17:29.873 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0213000000000003e-05 2024-04-19T02:17:29.873 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.873 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.873 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:29.873 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093519+0000", 2024-04-19T02:17:29.873 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.066e-06 2024-04-19T02:17:29.873 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.873 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.874 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:29.874 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093525+0000", 2024-04-19T02:17:29.874 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.8170000000000004e-06 2024-04-19T02:17:29.874 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.874 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.874 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:29.874 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103412+0000", 2024-04-19T02:17:29.874 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0098872739999999997 2024-04-19T02:17:29.874 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.874 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.874 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:29.874 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103551+0000", 2024-04-19T02:17:29.874 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000139295 2024-04-19T02:17:29.874 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.875 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.875 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:29.875 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103701+0000", 2024-04-19T02:17:29.875 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014954599999999999 2024-04-19T02:17:29.875 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.875 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.875 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:29.875 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.108849+0000", 2024-04-19T02:17:29.875 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0051487199999999999 2024-04-19T02:17:29.875 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.875 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.875 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:29.875 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114355+0000", 2024-04-19T02:17:29.875 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0055052529999999999 2024-04-19T02:17:29.876 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.876 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.876 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:29.876 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114379+0000", 2024-04-19T02:17:29.876 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4275000000000001e-05 2024-04-19T02:17:29.876 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.876 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.876 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:29.876 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114410+0000", 2024-04-19T02:17:29.876 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1356999999999998e-05 2024-04-19T02:17:29.876 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.876 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:29.876 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.876 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.876 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.876 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:104431 5.8 5:14818e19:::benchmark_data_smithi121_44835_object104430:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T02:17:29.877 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:17:29.877 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 49.608453742999998, 2024-04-19T02:17:29.877 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022149528000000002, 2024-04-19T02:17:29.877 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:29.877 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:29.877 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:29.877 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:29.877 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:29.877 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 104431 2024-04-19T02:17:29.877 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.877 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:29.877 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.877 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:29.877 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:17:29.877 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.878 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.878 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.878 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:29.878 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:17:29.878 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.878 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.878 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.878 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:29.878 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211384+0000", 2024-04-19T02:17:29.878 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:29.878 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.878 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.878 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:29.878 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211458+0000", 2024-04-19T02:17:29.878 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3311000000000003e-05 2024-04-19T02:17:29.879 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.879 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.879 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:29.879 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211471+0000", 2024-04-19T02:17:29.879 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.3308e-05 2024-04-19T02:17:29.879 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.879 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.879 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:29.879 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211479+0000", 2024-04-19T02:17:29.879 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0909999999999993e-06 2024-04-19T02:17:29.879 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.879 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.879 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:29.879 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.221821+0000", 2024-04-19T02:17:29.879 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010341596999999999 2024-04-19T02:17:29.880 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.880 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.880 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:29.880 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.221966+0000", 2024-04-19T02:17:29.880 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000145167 2024-04-19T02:17:29.880 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.880 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.880 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:29.880 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.222077+0000", 2024-04-19T02:17:29.880 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011128000000000001 2024-04-19T02:17:29.880 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.880 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.880 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:29.880 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.228126+0000", 2024-04-19T02:17:29.880 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0060486710000000003 2024-04-19T02:17:29.881 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.881 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.881 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:29.881 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233449+0000", 2024-04-19T02:17:29.881 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0053231370000000004 2024-04-19T02:17:29.881 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.881 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.881 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:29.881 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233498+0000", 2024-04-19T02:17:29.881 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8798999999999998e-05 2024-04-19T02:17:29.881 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.881 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.881 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:29.881 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233535+0000", 2024-04-19T02:17:29.881 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7119000000000002e-05 2024-04-19T02:17:29.881 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.882 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:29.882 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.882 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.882 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.882 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157437 5.e 5:78833a3d:::benchmark_data_smithi121_44835_object23402:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:29.882 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.859854+0000", 2024-04-19T02:17:29.882 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 22.959984971000001, 2024-04-19T02:17:29.882 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.025859589999999998, 2024-04-19T02:17:29.882 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:29.882 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:29.882 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:29.882 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:29.882 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:29.882 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157437 2024-04-19T02:17:29.883 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.883 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:29.883 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.883 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:29.883 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859854+0000", 2024-04-19T02:17:29.883 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.883 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.883 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.883 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:29.883 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859854+0000", 2024-04-19T02:17:29.883 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.883 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.883 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.883 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:29.883 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859853+0000", 2024-04-19T02:17:29.884 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:29.884 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.884 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.884 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:29.884 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859857+0000", 2024-04-19T02:17:29.884 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8789999999999996e-06 2024-04-19T02:17:29.884 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.884 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.884 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:29.884 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859865+0000", 2024-04-19T02:17:29.884 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.1880000000000002e-06 2024-04-19T02:17:29.884 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.884 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.884 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:29.884 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859873+0000", 2024-04-19T02:17:29.885 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.2980000000000003e-06 2024-04-19T02:17:29.885 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.885 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.885 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:29.885 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859908+0000", 2024-04-19T02:17:29.885 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5682999999999997e-05 2024-04-19T02:17:29.885 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.885 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.885 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:29.885 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.860046+0000", 2024-04-19T02:17:29.885 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013714200000000001 2024-04-19T02:17:29.885 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.885 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.885 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:29.885 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.860153+0000", 2024-04-19T02:17:29.886 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010725700000000001 2024-04-19T02:17:29.886 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.886 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.886 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:29.886 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.862008+0000", 2024-04-19T02:17:29.886 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001855179 2024-04-19T02:17:29.886 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.886 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.886 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:29.886 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.885629+0000", 2024-04-19T02:17:29.886 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.023621428 2024-04-19T02:17:29.886 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.886 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.886 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:29.887 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.885676+0000", 2024-04-19T02:17:29.887 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.6371e-05 2024-04-19T02:17:29.887 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.887 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.887 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:29.887 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.885714+0000", 2024-04-19T02:17:29.887 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7907000000000001e-05 2024-04-19T02:17:29.887 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.887 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:29.887 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.887 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.887 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.887 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157438 5.0 5:01944e77:::benchmark_data_smithi121_44835_object23403:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:29.887 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.864095+0000", 2024-04-19T02:17:29.887 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 22.955743687000002, 2024-04-19T02:17:29.888 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.032015298999999997, 2024-04-19T02:17:29.888 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:29.888 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:29.888 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:29.888 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:29.888 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:29.888 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157438 2024-04-19T02:17:29.888 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.888 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:29.888 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.888 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:29.888 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864095+0000", 2024-04-19T02:17:29.888 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.888 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.888 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.888 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:29.889 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864095+0000", 2024-04-19T02:17:29.889 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.889 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.889 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.889 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:29.889 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864094+0000", 2024-04-19T02:17:29.889 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:29.889 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.889 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.889 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:29.889 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864102+0000", 2024-04-19T02:17:29.889 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.6629999999999993e-06 2024-04-19T02:17:29.889 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.889 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.889 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:29.890 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864113+0000", 2024-04-19T02:17:29.890 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1185999999999999e-05 2024-04-19T02:17:29.890 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.890 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.890 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:29.890 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864119+0000", 2024-04-19T02:17:29.890 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.224e-06 2024-04-19T02:17:29.890 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.890 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.890 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:29.890 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864151+0000", 2024-04-19T02:17:29.890 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1395e-05 2024-04-19T02:17:29.890 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.890 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.891 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:29.891 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864275+0000", 2024-04-19T02:17:29.891 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012431399999999999 2024-04-19T02:17:29.891 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.891 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.891 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:29.891 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864341+0000", 2024-04-19T02:17:29.891 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6146e-05 2024-04-19T02:17:29.891 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.891 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.891 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:29.891 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.866040+0000", 2024-04-19T02:17:29.891 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016991879999999999 2024-04-19T02:17:29.891 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.891 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.892 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:29.892 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896055+0000", 2024-04-19T02:17:29.892 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.030014886000000001 2024-04-19T02:17:29.892 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.892 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.892 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:29.892 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896087+0000", 2024-04-19T02:17:29.892 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1761000000000003e-05 2024-04-19T02:17:29.892 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.892 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.892 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:29.892 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896111+0000", 2024-04-19T02:17:29.892 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3623999999999999e-05 2024-04-19T02:17:29.892 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.892 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:29.893 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.893 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.893 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.893 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157439 5.e 5:79eb9d3c:::benchmark_data_smithi121_44835_object23404:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:29.893 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:29.893 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 22.955712611999999, 2024-04-19T02:17:29.893 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.027045244, 2024-04-19T02:17:29.893 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:29.893 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:29.893 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:29.893 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:29.893 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:29.893 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157439 2024-04-19T02:17:29.893 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.893 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:29.894 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.894 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:29.894 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:29.894 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.894 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.894 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.894 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:29.894 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:29.894 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.894 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.894 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.894 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:29.894 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:29.894 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:29.895 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.895 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.895 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:29.895 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864128+0000", 2024-04-19T02:17:29.895 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.911e-06 2024-04-19T02:17:29.895 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.895 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.895 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:29.895 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864136+0000", 2024-04-19T02:17:29.895 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2609999999999993e-06 2024-04-19T02:17:29.895 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.895 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.895 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:29.895 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864140+0000", 2024-04-19T02:17:29.895 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5530000000000001e-06 2024-04-19T02:17:29.896 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.896 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.896 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:29.896 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864169+0000", 2024-04-19T02:17:29.896 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.8932e-05 2024-04-19T02:17:29.896 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.896 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.896 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:29.896 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864267+0000", 2024-04-19T02:17:29.896 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7969999999999999e-05 2024-04-19T02:17:29.896 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.896 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.896 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:29.896 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864339+0000", 2024-04-19T02:17:29.896 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.2280999999999995e-05 2024-04-19T02:17:29.897 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.897 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.897 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:29.897 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.865763+0000", 2024-04-19T02:17:29.897 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0014236310000000001 2024-04-19T02:17:29.897 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.897 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.897 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:29.897 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.891093+0000", 2024-04-19T02:17:29.897 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.025330571 2024-04-19T02:17:29.897 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.897 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.897 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:29.897 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.891137+0000", 2024-04-19T02:17:29.897 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3980999999999998e-05 2024-04-19T02:17:29.898 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.898 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.898 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:29.898 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.891172+0000", 2024-04-19T02:17:29.898 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4465000000000003e-05 2024-04-19T02:17:29.898 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.898 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:29.898 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.898 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.898 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.898 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157442 5.0 5:0062b73f:::benchmark_data_smithi121_44835_object23407:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:29.898 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.867065+0000", 2024-04-19T02:17:29.898 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 22.952773961999998, 2024-04-19T02:17:29.898 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.029165542999999999, 2024-04-19T02:17:29.898 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:29.899 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:29.899 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:29.899 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:29.899 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:29.899 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157442 2024-04-19T02:17:29.899 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.899 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:29.899 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.899 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:29.899 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867065+0000", 2024-04-19T02:17:29.899 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.899 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.899 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.899 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:29.899 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867065+0000", 2024-04-19T02:17:29.900 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.900 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.900 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.900 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:29.900 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867064+0000", 2024-04-19T02:17:29.900 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:29.900 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.900 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.900 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:29.900 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867069+0000", 2024-04-19T02:17:29.900 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4549999999999997e-06 2024-04-19T02:17:29.900 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.900 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.900 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:29.900 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867080+0000", 2024-04-19T02:17:29.900 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0797e-05 2024-04-19T02:17:29.901 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.901 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.901 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:29.901 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867088+0000", 2024-04-19T02:17:29.901 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9729999999999997e-06 2024-04-19T02:17:29.901 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.901 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.901 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:29.901 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867121+0000", 2024-04-19T02:17:29.901 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2920000000000003e-05 2024-04-19T02:17:29.901 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.901 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.901 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:29.901 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867203+0000", 2024-04-19T02:17:29.901 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2578999999999997e-05 2024-04-19T02:17:29.902 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.902 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.902 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:29.902 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867386+0000", 2024-04-19T02:17:29.902 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00018237400000000001 2024-04-19T02:17:29.902 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.902 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.902 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:29.902 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.869338+0000", 2024-04-19T02:17:29.902 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0019521160000000001 2024-04-19T02:17:29.902 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.902 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.902 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:29.902 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896150+0000", 2024-04-19T02:17:29.902 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.026812074000000002 2024-04-19T02:17:29.903 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.903 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.903 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:29.903 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896191+0000", 2024-04-19T02:17:29.903 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1192000000000001e-05 2024-04-19T02:17:29.903 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.903 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.903 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:29.903 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896231+0000", 2024-04-19T02:17:29.903 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9764000000000001e-05 2024-04-19T02:17:29.903 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.903 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:29.903 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.903 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.903 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.903 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157499 5.8 5:1c3aa38a:::benchmark_data_smithi121_44835_object23464:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:29.904 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.913447+0000", 2024-04-19T02:17:29.904 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 22.906392390000001, 2024-04-19T02:17:29.904 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.024508188, 2024-04-19T02:17:29.904 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:29.904 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:29.904 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:29.904 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:29.904 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:29.904 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157499 2024-04-19T02:17:29.904 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.904 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:29.904 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.904 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:29.904 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913447+0000", 2024-04-19T02:17:29.904 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.905 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.905 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.905 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:29.905 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913447+0000", 2024-04-19T02:17:29.905 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.905 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.905 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.905 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:29.905 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913446+0000", 2024-04-19T02:17:29.905 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:29.905 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.905 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.905 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:29.905 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913451+0000", 2024-04-19T02:17:29.905 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.677e-06 2024-04-19T02:17:29.906 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.906 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.906 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:29.906 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913461+0000", 2024-04-19T02:17:29.906 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.8859999999999999e-06 2024-04-19T02:17:29.906 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.906 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.906 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:29.906 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913467+0000", 2024-04-19T02:17:29.906 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.0800000000000002e-06 2024-04-19T02:17:29.906 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.906 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.906 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:29.906 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913513+0000", 2024-04-19T02:17:29.907 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.5707000000000001e-05 2024-04-19T02:17:29.907 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.907 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.907 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:29.907 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913637+0000", 2024-04-19T02:17:29.907 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012379200000000001 2024-04-19T02:17:29.907 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.907 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.907 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:29.907 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913747+0000", 2024-04-19T02:17:29.907 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000110071 2024-04-19T02:17:29.907 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.907 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.907 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:29.907 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915674+0000", 2024-04-19T02:17:29.907 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0019270789999999999 2024-04-19T02:17:29.908 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.908 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.908 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:29.908 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937902+0000", 2024-04-19T02:17:29.908 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022228286 2024-04-19T02:17:29.908 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.908 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.908 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:29.908 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937931+0000", 2024-04-19T02:17:29.908 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9122e-05 2024-04-19T02:17:29.908 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.908 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.908 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:29.908 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937955+0000", 2024-04-19T02:17:29.908 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3591000000000002e-05 2024-04-19T02:17:29.908 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.909 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:29.909 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.909 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.909 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.909 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157500 5.0 5:0969ec74:::benchmark_data_smithi121_44835_object23465:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:29.909 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.913476+0000", 2024-04-19T02:17:29.909 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 22.906363524, 2024-04-19T02:17:29.909 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.024497596, 2024-04-19T02:17:29.909 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:29.909 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:29.909 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:29.909 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:29.909 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:29.909 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157500 2024-04-19T02:17:29.909 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.910 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:29.910 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.910 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:29.910 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913476+0000", 2024-04-19T02:17:29.910 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.910 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.910 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.910 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:29.910 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913476+0000", 2024-04-19T02:17:29.910 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.910 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.910 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.910 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:29.910 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913475+0000", 2024-04-19T02:17:29.910 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:29.911 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.911 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.911 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:29.911 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913478+0000", 2024-04-19T02:17:29.911 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.2670000000000001e-06 2024-04-19T02:17:29.911 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.911 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.911 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:29.911 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913481+0000", 2024-04-19T02:17:29.911 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6899999999999998e-06 2024-04-19T02:17:29.911 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.911 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.911 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:29.911 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913485+0000", 2024-04-19T02:17:29.911 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1230000000000002e-06 2024-04-19T02:17:29.912 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.912 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.912 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:29.912 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913526+0000", 2024-04-19T02:17:29.912 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.104e-05 2024-04-19T02:17:29.912 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.912 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.912 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:29.912 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913606+0000", 2024-04-19T02:17:29.912 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9510000000000003e-05 2024-04-19T02:17:29.912 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.912 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.912 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:29.912 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913671+0000", 2024-04-19T02:17:29.912 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.4838000000000005e-05 2024-04-19T02:17:29.912 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.913 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.913 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:29.913 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915348+0000", 2024-04-19T02:17:29.913 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016769860000000001 2024-04-19T02:17:29.913 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.913 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.913 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:29.913 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937897+0000", 2024-04-19T02:17:29.913 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022548902999999999 2024-04-19T02:17:29.913 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.913 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.913 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:29.913 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937938+0000", 2024-04-19T02:17:29.913 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1499999999999999e-05 2024-04-19T02:17:29.913 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.914 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.914 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:29.914 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937973+0000", 2024-04-19T02:17:29.914 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5057e-05 2024-04-19T02:17:29.914 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.914 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:29.914 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.914 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.914 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.914 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157501 5.4 5:26661819:::benchmark_data_smithi121_44835_object23466:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:29.914 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.914839+0000", 2024-04-19T02:17:29.914 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 22.905000229999999, 2024-04-19T02:17:29.914 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.028504224000000002, 2024-04-19T02:17:29.914 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:29.914 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:29.915 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:29.915 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:29.915 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:29.915 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157501 2024-04-19T02:17:29.915 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.915 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:29.915 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.915 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:29.915 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914839+0000", 2024-04-19T02:17:29.915 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.915 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.915 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.915 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:29.915 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914839+0000", 2024-04-19T02:17:29.915 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.916 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.916 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.916 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:29.916 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914838+0000", 2024-04-19T02:17:29.916 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:29.916 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.916 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.916 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:29.916 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914841+0000", 2024-04-19T02:17:29.916 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.706e-06 2024-04-19T02:17:29.916 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.916 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.916 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:29.916 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914848+0000", 2024-04-19T02:17:29.916 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.7429999999999996e-06 2024-04-19T02:17:29.916 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.917 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.917 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:29.917 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914852+0000", 2024-04-19T02:17:29.917 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0810000000000004e-06 2024-04-19T02:17:29.917 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.917 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.917 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:29.917 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914892+0000", 2024-04-19T02:17:29.917 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9957999999999999e-05 2024-04-19T02:17:29.917 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.917 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.917 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:29.917 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915008+0000", 2024-04-19T02:17:29.917 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000116401 2024-04-19T02:17:29.917 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.918 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.918 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:29.918 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915125+0000", 2024-04-19T02:17:29.918 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011622500000000001 2024-04-19T02:17:29.918 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.918 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.918 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:29.918 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916663+0000", 2024-04-19T02:17:29.918 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0015381310000000001 2024-04-19T02:17:29.918 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.918 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.918 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:29.918 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943114+0000", 2024-04-19T02:17:29.918 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.026451125999999998 2024-04-19T02:17:29.918 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.919 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.919 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:29.919 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943245+0000", 2024-04-19T02:17:29.919 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000131645 2024-04-19T02:17:29.919 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.919 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.919 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:29.919 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943343+0000", 2024-04-19T02:17:29.919 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7604999999999998e-05 2024-04-19T02:17:29.919 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.919 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:29.919 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.919 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.919 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.919 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157507 5.b 5:de8840a2:::benchmark_data_smithi121_44835_object23472:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:29.920 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:29.920 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 22.903435948999999, 2024-04-19T02:17:29.920 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022544518999999999, 2024-04-19T02:17:29.920 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:29.920 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:29.920 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:29.920 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:29.920 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:29.920 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157507 2024-04-19T02:17:29.920 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.920 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:29.920 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.920 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:29.920 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:29.920 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.921 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.921 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.921 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:29.921 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:29.921 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.921 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.921 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.921 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:29.921 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:29.921 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:29.921 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.921 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.921 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:29.921 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916406+0000", 2024-04-19T02:17:29.921 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4589999999999998e-06 2024-04-19T02:17:29.921 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.922 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.922 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:29.922 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916415+0000", 2024-04-19T02:17:29.922 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3910000000000004e-06 2024-04-19T02:17:29.922 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.922 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.922 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:29.922 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916421+0000", 2024-04-19T02:17:29.922 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.6130000000000003e-06 2024-04-19T02:17:29.922 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.922 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.922 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:29.922 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916448+0000", 2024-04-19T02:17:29.922 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7277999999999999e-05 2024-04-19T02:17:29.923 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.923 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.923 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:29.923 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916539+0000", 2024-04-19T02:17:29.923 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0855999999999999e-05 2024-04-19T02:17:29.923 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.923 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.923 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:29.923 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916605+0000", 2024-04-19T02:17:29.923 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6141000000000003e-05 2024-04-19T02:17:29.923 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.923 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.923 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:29.923 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918276+0000", 2024-04-19T02:17:29.923 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001670726 2024-04-19T02:17:29.924 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.924 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.924 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:29.924 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.938888+0000", 2024-04-19T02:17:29.924 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020612042000000001 2024-04-19T02:17:29.924 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.924 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.924 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:29.924 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.938924+0000", 2024-04-19T02:17:29.924 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5692999999999999e-05 2024-04-19T02:17:29.924 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.924 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.924 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:29.924 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.938948+0000", 2024-04-19T02:17:29.924 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3879e-05 2024-04-19T02:17:29.925 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.925 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:29.925 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.925 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.925 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.925 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157509 5.8 5:1dca85d0:::benchmark_data_smithi121_44835_object23474:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:29.925 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:29.925 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 22.901007703000001, 2024-04-19T02:17:29.925 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.024511807, 2024-04-19T02:17:29.925 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:29.925 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:29.925 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:29.925 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:29.925 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:29.925 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157509 2024-04-19T02:17:29.926 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.926 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:29.926 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.926 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:29.926 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:29.926 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.926 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.926 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.926 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:29.926 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:29.926 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:29.926 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.926 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.926 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:29.926 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:29.927 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:29.927 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.927 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.927 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:29.927 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918834+0000", 2024-04-19T02:17:29.927 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9409999999999999e-06 2024-04-19T02:17:29.927 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.927 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.927 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:29.927 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918859+0000", 2024-04-19T02:17:29.927 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.5245999999999999e-05 2024-04-19T02:17:29.927 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.927 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.927 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:29.927 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918864+0000", 2024-04-19T02:17:29.928 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.1819999999999997e-06 2024-04-19T02:17:29.928 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.928 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.928 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:29.928 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918900+0000", 2024-04-19T02:17:29.928 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5327000000000002e-05 2024-04-19T02:17:29.928 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.928 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.928 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:29.928 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.919024+0000", 2024-04-19T02:17:29.928 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012400900000000001 2024-04-19T02:17:29.928 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.928 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.928 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:29.929 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.919136+0000", 2024-04-19T02:17:29.929 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000111987 2024-04-19T02:17:29.929 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.929 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.929 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:29.929 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.922096+0000", 2024-04-19T02:17:29.929 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0029607079999999998 2024-04-19T02:17:29.929 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.929 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.929 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:29.929 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943120+0000", 2024-04-19T02:17:29.929 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.021023995 2024-04-19T02:17:29.929 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.929 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.929 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:29.929 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943255+0000", 2024-04-19T02:17:29.930 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013502100000000001 2024-04-19T02:17:29.930 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:29.930 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:29.930 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:29.930 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943343+0000", 2024-04-19T02:17:29.930 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.7931999999999998e-05 2024-04-19T02:17:29.930 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.930 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:29.930 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.930 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:29.930 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:29.930 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:17:29.932 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:17:29.932 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:17:29.933 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:29.932+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:29.933 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:17:29.933 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:29.934 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:17:29.934 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:17:29.934 INFO:teuthology.orchestra.run.smithi121.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T02:17:29.934 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:17:30.032 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:30.032+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:30.103 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:30.103 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:30.116 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:30.133 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:30.133+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:30.233 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:30.233+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:30.294 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:30.294 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:30.308 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:30.354 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:30.349+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:30.436 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:30.436+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:30.520 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:30.520 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:30.524 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [2] live_osds: [0, 1] 2024-04-19T02:17:30.524 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T02:17:30.524 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-04-19T02:17:30.524 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-19T02:17:30.528 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:17:30.572 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:30.572+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:30.637 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:30.637+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:30.702 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:30.702 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:30.717 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:17:30.738 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:30.738+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:30.839 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:30.839+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:30.871 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:17:30.871 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-04-19T02:17:30.871 INFO:teuthology.orchestra.run.smithi121.stdout: "epoch": 59, 2024-04-19T02:17:30.871 INFO:teuthology.orchestra.run.smithi121.stdout: "fsid": "f6ab5dd0-bb9f-4b48-a9fc-4728c7955ca8", 2024-04-19T02:17:30.871 INFO:teuthology.orchestra.run.smithi121.stdout: "created": "2024-04-19T02:15:13.539846+0000", 2024-04-19T02:17:30.871 INFO:teuthology.orchestra.run.smithi121.stdout: "modified": "2024-04-19T02:17:29.309056+0000", 2024-04-19T02:17:30.871 INFO:teuthology.orchestra.run.smithi121.stdout: "last_up_change": "2024-04-19T02:17:07.231829+0000", 2024-04-19T02:17:30.871 INFO:teuthology.orchestra.run.smithi121.stdout: "last_in_change": "2024-04-19T02:15:15.482624+0000", 2024-04-19T02:17:30.871 INFO:teuthology.orchestra.run.smithi121.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-19T02:17:30.871 INFO:teuthology.orchestra.run.smithi121.stdout: "flags_num": 5801984, 2024-04-19T02:17:30.871 INFO:teuthology.orchestra.run.smithi121.stdout: "flags_set": [ 2024-04-19T02:17:30.871 INFO:teuthology.orchestra.run.smithi121.stdout: "noscrub", 2024-04-19T02:17:30.872 INFO:teuthology.orchestra.run.smithi121.stdout: "pglog_hardlimit", 2024-04-19T02:17:30.872 INFO:teuthology.orchestra.run.smithi121.stdout: "purged_snapdirs", 2024-04-19T02:17:30.872 INFO:teuthology.orchestra.run.smithi121.stdout: "recovery_deletes", 2024-04-19T02:17:30.872 INFO:teuthology.orchestra.run.smithi121.stdout: "sortbitwise" 2024-04-19T02:17:30.872 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-04-19T02:17:30.872 INFO:teuthology.orchestra.run.smithi121.stdout: "crush_version": 4, 2024-04-19T02:17:30.872 INFO:teuthology.orchestra.run.smithi121.stdout: "full_ratio": 0.94999998807907104, 2024-04-19T02:17:30.872 INFO:teuthology.orchestra.run.smithi121.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-19T02:17:30.872 INFO:teuthology.orchestra.run.smithi121.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-19T02:17:30.872 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_snapshot": "", 2024-04-19T02:17:30.872 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_max": 5, 2024-04-19T02:17:30.872 INFO:teuthology.orchestra.run.smithi121.stdout: "max_osd": 3, 2024-04-19T02:17:30.872 INFO:teuthology.orchestra.run.smithi121.stdout: "require_min_compat_client": "luminous", 2024-04-19T02:17:30.872 INFO:teuthology.orchestra.run.smithi121.stdout: "min_compat_client": "luminous", 2024-04-19T02:17:30.872 INFO:teuthology.orchestra.run.smithi121.stdout: "require_osd_release": "reef", 2024-04-19T02:17:30.873 INFO:teuthology.orchestra.run.smithi121.stdout: "allow_crimson": false, 2024-04-19T02:17:30.873 INFO:teuthology.orchestra.run.smithi121.stdout: "pools": [ 2024-04-19T02:17:30.873 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:17:30.873 INFO:teuthology.orchestra.run.smithi121.stdout: "pool": 1, 2024-04-19T02:17:30.873 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_name": ".mgr", 2024-04-19T02:17:30.873 INFO:teuthology.orchestra.run.smithi121.stdout: "create_time": "2024-04-19T02:15:22.776125+0000", 2024-04-19T02:17:30.873 INFO:teuthology.orchestra.run.smithi121.stdout: "flags": 1, 2024-04-19T02:17:30.873 INFO:teuthology.orchestra.run.smithi121.stdout: "flags_names": "hashpspool", 2024-04-19T02:17:30.873 INFO:teuthology.orchestra.run.smithi121.stdout: "type": 1, 2024-04-19T02:17:30.873 INFO:teuthology.orchestra.run.smithi121.stdout: "size": 2, 2024-04-19T02:17:30.873 INFO:teuthology.orchestra.run.smithi121.stdout: "min_size": 1, 2024-04-19T02:17:30.873 INFO:teuthology.orchestra.run.smithi121.stdout: "crush_rule": 0, 2024-04-19T02:17:30.873 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_count": 0, 2024-04-19T02:17:30.873 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_target": 0, 2024-04-19T02:17:30.873 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T02:17:30.874 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T02:17:30.874 INFO:teuthology.orchestra.run.smithi121.stdout: "object_hash": 2, 2024-04-19T02:17:30.874 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_autoscale_mode": "off", 2024-04-19T02:17:30.874 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num": 1, 2024-04-19T02:17:30.874 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_placement_num": 1, 2024-04-19T02:17:30.874 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_placement_num_target": 1, 2024-04-19T02:17:30.874 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_target": 1, 2024-04-19T02:17:30.874 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_pending": 1, 2024-04-19T02:17:30.874 INFO:teuthology.orchestra.run.smithi121.stdout: "last_pg_merge_meta": { 2024-04-19T02:17:30.874 INFO:teuthology.orchestra.run.smithi121.stdout: "source_pgid": "0.0", 2024-04-19T02:17:30.874 INFO:teuthology.orchestra.run.smithi121.stdout: "ready_epoch": 0, 2024-04-19T02:17:30.874 INFO:teuthology.orchestra.run.smithi121.stdout: "last_epoch_started": 0, 2024-04-19T02:17:30.874 INFO:teuthology.orchestra.run.smithi121.stdout: "last_epoch_clean": 0, 2024-04-19T02:17:30.874 INFO:teuthology.orchestra.run.smithi121.stdout: "source_version": "0'0", 2024-04-19T02:17:30.875 INFO:teuthology.orchestra.run.smithi121.stdout: "target_version": "0'0" 2024-04-19T02:17:30.875 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:17:30.875 INFO:teuthology.orchestra.run.smithi121.stdout: "last_change": "11", 2024-04-19T02:17:30.875 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend": "0", 2024-04-19T02:17:30.875 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T02:17:30.875 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T02:17:30.875 INFO:teuthology.orchestra.run.smithi121.stdout: "auid": 0, 2024-04-19T02:17:30.875 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_mode": "selfmanaged", 2024-04-19T02:17:30.875 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_seq": 0, 2024-04-19T02:17:30.875 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_epoch": 0, 2024-04-19T02:17:30.875 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_snaps": [], 2024-04-19T02:17:30.876 INFO:teuthology.orchestra.run.smithi121.stdout: "removed_snaps": "[]", 2024-04-19T02:17:30.876 INFO:teuthology.orchestra.run.smithi121.stdout: "quota_max_bytes": 0, 2024-04-19T02:17:30.876 INFO:teuthology.orchestra.run.smithi121.stdout: "quota_max_objects": 0, 2024-04-19T02:17:30.876 INFO:teuthology.orchestra.run.smithi121.stdout: "tiers": [], 2024-04-19T02:17:30.876 INFO:teuthology.orchestra.run.smithi121.stdout: "tier_of": -1, 2024-04-19T02:17:30.876 INFO:teuthology.orchestra.run.smithi121.stdout: "read_tier": -1, 2024-04-19T02:17:30.876 INFO:teuthology.orchestra.run.smithi121.stdout: "write_tier": -1, 2024-04-19T02:17:30.876 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_mode": "none", 2024-04-19T02:17:30.876 INFO:teuthology.orchestra.run.smithi121.stdout: "target_max_bytes": 0, 2024-04-19T02:17:30.876 INFO:teuthology.orchestra.run.smithi121.stdout: "target_max_objects": 0, 2024-04-19T02:17:30.877 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T02:17:30.877 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T02:17:30.877 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T02:17:30.877 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_min_flush_age": 0, 2024-04-19T02:17:30.877 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_min_evict_age": 0, 2024-04-19T02:17:30.877 INFO:teuthology.orchestra.run.smithi121.stdout: "erasure_code_profile": "", 2024-04-19T02:17:30.877 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_params": { 2024-04-19T02:17:30.877 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "none" 2024-04-19T02:17:30.877 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:17:30.877 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_period": 0, 2024-04-19T02:17:30.877 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_count": 0, 2024-04-19T02:17:30.877 INFO:teuthology.orchestra.run.smithi121.stdout: "use_gmt_hitset": true, 2024-04-19T02:17:30.877 INFO:teuthology.orchestra.run.smithi121.stdout: "min_read_recency_for_promote": 0, 2024-04-19T02:17:30.878 INFO:teuthology.orchestra.run.smithi121.stdout: "min_write_recency_for_promote": 0, 2024-04-19T02:17:30.878 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T02:17:30.878 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_search_last_n": 0, 2024-04-19T02:17:30.878 INFO:teuthology.orchestra.run.smithi121.stdout: "grade_table": [], 2024-04-19T02:17:30.878 INFO:teuthology.orchestra.run.smithi121.stdout: "stripe_width": 0, 2024-04-19T02:17:30.878 INFO:teuthology.orchestra.run.smithi121.stdout: "expected_num_objects": 0, 2024-04-19T02:17:30.878 INFO:teuthology.orchestra.run.smithi121.stdout: "fast_read": false, 2024-04-19T02:17:30.878 INFO:teuthology.orchestra.run.smithi121.stdout: "options": { 2024-04-19T02:17:30.878 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_max": 32, 2024-04-19T02:17:30.878 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_min": 1 2024-04-19T02:17:30.878 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:17:30.878 INFO:teuthology.orchestra.run.smithi121.stdout: "application_metadata": { 2024-04-19T02:17:30.878 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": {} 2024-04-19T02:17:30.878 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:17:30.879 INFO:teuthology.orchestra.run.smithi121.stdout: "read_balance": { 2024-04-19T02:17:30.879 INFO:teuthology.orchestra.run.smithi121.stdout: "score_acting": 2.9900000095367432, 2024-04-19T02:17:30.879 INFO:teuthology.orchestra.run.smithi121.stdout: "score_stable": 2.9900000095367432, 2024-04-19T02:17:30.879 INFO:teuthology.orchestra.run.smithi121.stdout: "optimal_score": 0.67000001668930054, 2024-04-19T02:17:30.879 INFO:teuthology.orchestra.run.smithi121.stdout: "raw_score_acting": 2, 2024-04-19T02:17:30.879 INFO:teuthology.orchestra.run.smithi121.stdout: "raw_score_stable": 2, 2024-04-19T02:17:30.879 INFO:teuthology.orchestra.run.smithi121.stdout: "primary_affinity_weighted": 0.90409350395202637, 2024-04-19T02:17:30.879 INFO:teuthology.orchestra.run.smithi121.stdout: "average_primary_affinity": 0.89999997615814209, 2024-04-19T02:17:30.879 INFO:teuthology.orchestra.run.smithi121.stdout: "average_primary_affinity_weighted": 0.89999997615814209 2024-04-19T02:17:30.879 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:17:30.879 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:17:30.879 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:17:30.879 INFO:teuthology.orchestra.run.smithi121.stdout: "pool": 2, 2024-04-19T02:17:30.879 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_name": "rbd", 2024-04-19T02:17:30.879 INFO:teuthology.orchestra.run.smithi121.stdout: "create_time": "2024-04-19T02:15:23.264005+0000", 2024-04-19T02:17:30.880 INFO:teuthology.orchestra.run.smithi121.stdout: "flags": 1, 2024-04-19T02:17:30.880 INFO:teuthology.orchestra.run.smithi121.stdout: "flags_names": "hashpspool", 2024-04-19T02:17:30.880 INFO:teuthology.orchestra.run.smithi121.stdout: "type": 1, 2024-04-19T02:17:30.880 INFO:teuthology.orchestra.run.smithi121.stdout: "size": 2, 2024-04-19T02:17:30.880 INFO:teuthology.orchestra.run.smithi121.stdout: "min_size": 1, 2024-04-19T02:17:30.880 INFO:teuthology.orchestra.run.smithi121.stdout: "crush_rule": 0, 2024-04-19T02:17:30.880 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_count": 0, 2024-04-19T02:17:30.880 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_target": 0, 2024-04-19T02:17:30.880 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T02:17:30.880 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T02:17:30.880 INFO:teuthology.orchestra.run.smithi121.stdout: "object_hash": 2, 2024-04-19T02:17:30.880 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_autoscale_mode": "off", 2024-04-19T02:17:30.880 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num": 8, 2024-04-19T02:17:30.880 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_placement_num": 8, 2024-04-19T02:17:30.880 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_placement_num_target": 8, 2024-04-19T02:17:30.881 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_target": 8, 2024-04-19T02:17:30.881 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_pending": 8, 2024-04-19T02:17:30.881 INFO:teuthology.orchestra.run.smithi121.stdout: "last_pg_merge_meta": { 2024-04-19T02:17:30.881 INFO:teuthology.orchestra.run.smithi121.stdout: "source_pgid": "0.0", 2024-04-19T02:17:30.881 INFO:teuthology.orchestra.run.smithi121.stdout: "ready_epoch": 0, 2024-04-19T02:17:30.881 INFO:teuthology.orchestra.run.smithi121.stdout: "last_epoch_started": 0, 2024-04-19T02:17:30.881 INFO:teuthology.orchestra.run.smithi121.stdout: "last_epoch_clean": 0, 2024-04-19T02:17:30.881 INFO:teuthology.orchestra.run.smithi121.stdout: "source_version": "0'0", 2024-04-19T02:17:30.881 INFO:teuthology.orchestra.run.smithi121.stdout: "target_version": "0'0" 2024-04-19T02:17:30.881 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:17:30.881 INFO:teuthology.orchestra.run.smithi121.stdout: "last_change": "11", 2024-04-19T02:17:30.881 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend": "0", 2024-04-19T02:17:30.881 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T02:17:30.881 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T02:17:30.881 INFO:teuthology.orchestra.run.smithi121.stdout: "auid": 0, 2024-04-19T02:17:30.882 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_mode": "selfmanaged", 2024-04-19T02:17:30.882 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_seq": 0, 2024-04-19T02:17:30.882 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_epoch": 0, 2024-04-19T02:17:30.882 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_snaps": [], 2024-04-19T02:17:30.882 INFO:teuthology.orchestra.run.smithi121.stdout: "removed_snaps": "[]", 2024-04-19T02:17:30.882 INFO:teuthology.orchestra.run.smithi121.stdout: "quota_max_bytes": 0, 2024-04-19T02:17:30.882 INFO:teuthology.orchestra.run.smithi121.stdout: "quota_max_objects": 0, 2024-04-19T02:17:30.882 INFO:teuthology.orchestra.run.smithi121.stdout: "tiers": [], 2024-04-19T02:17:30.882 INFO:teuthology.orchestra.run.smithi121.stdout: "tier_of": -1, 2024-04-19T02:17:30.882 INFO:teuthology.orchestra.run.smithi121.stdout: "read_tier": -1, 2024-04-19T02:17:30.882 INFO:teuthology.orchestra.run.smithi121.stdout: "write_tier": -1, 2024-04-19T02:17:30.882 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_mode": "none", 2024-04-19T02:17:30.882 INFO:teuthology.orchestra.run.smithi121.stdout: "target_max_bytes": 0, 2024-04-19T02:17:30.882 INFO:teuthology.orchestra.run.smithi121.stdout: "target_max_objects": 0, 2024-04-19T02:17:30.883 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T02:17:30.883 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T02:17:30.883 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T02:17:30.883 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_min_flush_age": 0, 2024-04-19T02:17:30.883 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_min_evict_age": 0, 2024-04-19T02:17:30.883 INFO:teuthology.orchestra.run.smithi121.stdout: "erasure_code_profile": "", 2024-04-19T02:17:30.883 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_params": { 2024-04-19T02:17:30.883 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "none" 2024-04-19T02:17:30.883 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:17:30.883 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_period": 0, 2024-04-19T02:17:30.883 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_count": 0, 2024-04-19T02:17:30.883 INFO:teuthology.orchestra.run.smithi121.stdout: "use_gmt_hitset": true, 2024-04-19T02:17:30.883 INFO:teuthology.orchestra.run.smithi121.stdout: "min_read_recency_for_promote": 0, 2024-04-19T02:17:30.883 INFO:teuthology.orchestra.run.smithi121.stdout: "min_write_recency_for_promote": 0, 2024-04-19T02:17:30.883 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T02:17:30.884 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_search_last_n": 0, 2024-04-19T02:17:30.884 INFO:teuthology.orchestra.run.smithi121.stdout: "grade_table": [], 2024-04-19T02:17:30.884 INFO:teuthology.orchestra.run.smithi121.stdout: "stripe_width": 0, 2024-04-19T02:17:30.884 INFO:teuthology.orchestra.run.smithi121.stdout: "expected_num_objects": 0, 2024-04-19T02:17:30.884 INFO:teuthology.orchestra.run.smithi121.stdout: "fast_read": false, 2024-04-19T02:17:30.884 INFO:teuthology.orchestra.run.smithi121.stdout: "options": {}, 2024-04-19T02:17:30.884 INFO:teuthology.orchestra.run.smithi121.stdout: "application_metadata": { 2024-04-19T02:17:30.884 INFO:teuthology.orchestra.run.smithi121.stdout: "rbd": {} 2024-04-19T02:17:30.884 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:17:30.884 INFO:teuthology.orchestra.run.smithi121.stdout: "read_balance": { 2024-04-19T02:17:30.884 INFO:teuthology.orchestra.run.smithi121.stdout: "score_acting": 1.4900000095367432, 2024-04-19T02:17:30.884 INFO:teuthology.orchestra.run.smithi121.stdout: "score_stable": 1.4900000095367432, 2024-04-19T02:17:30.884 INFO:teuthology.orchestra.run.smithi121.stdout: "optimal_score": 0.67000001668930054, 2024-04-19T02:17:30.884 INFO:teuthology.orchestra.run.smithi121.stdout: "raw_score_acting": 1, 2024-04-19T02:17:30.884 INFO:teuthology.orchestra.run.smithi121.stdout: "raw_score_stable": 1, 2024-04-19T02:17:30.885 INFO:teuthology.orchestra.run.smithi121.stdout: "primary_affinity_weighted": 0.90409350395202637, 2024-04-19T02:17:30.885 INFO:teuthology.orchestra.run.smithi121.stdout: "average_primary_affinity": 0.89999997615814209, 2024-04-19T02:17:30.885 INFO:teuthology.orchestra.run.smithi121.stdout: "average_primary_affinity_weighted": 0.89999997615814209 2024-04-19T02:17:30.885 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:17:30.885 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:17:30.885 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:17:30.885 INFO:teuthology.orchestra.run.smithi121.stdout: "pool": 3, 2024-04-19T02:17:30.885 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_name": "cephfs_metadata", 2024-04-19T02:17:30.885 INFO:teuthology.orchestra.run.smithi121.stdout: "create_time": "2024-04-19T02:15:27.675087+0000", 2024-04-19T02:17:30.885 INFO:teuthology.orchestra.run.smithi121.stdout: "flags": 1, 2024-04-19T02:17:30.885 INFO:teuthology.orchestra.run.smithi121.stdout: "flags_names": "hashpspool", 2024-04-19T02:17:30.885 INFO:teuthology.orchestra.run.smithi121.stdout: "type": 1, 2024-04-19T02:17:30.885 INFO:teuthology.orchestra.run.smithi121.stdout: "size": 2, 2024-04-19T02:17:30.885 INFO:teuthology.orchestra.run.smithi121.stdout: "min_size": 1, 2024-04-19T02:17:30.885 INFO:teuthology.orchestra.run.smithi121.stdout: "crush_rule": 0, 2024-04-19T02:17:30.885 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_count": 0, 2024-04-19T02:17:30.886 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_target": 0, 2024-04-19T02:17:30.886 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T02:17:30.886 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T02:17:30.886 INFO:teuthology.orchestra.run.smithi121.stdout: "object_hash": 2, 2024-04-19T02:17:30.886 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_autoscale_mode": "off", 2024-04-19T02:17:30.886 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num": 32, 2024-04-19T02:17:30.886 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_placement_num": 32, 2024-04-19T02:17:30.886 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_placement_num_target": 32, 2024-04-19T02:17:30.886 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_target": 32, 2024-04-19T02:17:30.886 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_pending": 32, 2024-04-19T02:17:30.886 INFO:teuthology.orchestra.run.smithi121.stdout: "last_pg_merge_meta": { 2024-04-19T02:17:30.886 INFO:teuthology.orchestra.run.smithi121.stdout: "source_pgid": "0.0", 2024-04-19T02:17:30.886 INFO:teuthology.orchestra.run.smithi121.stdout: "ready_epoch": 0, 2024-04-19T02:17:30.886 INFO:teuthology.orchestra.run.smithi121.stdout: "last_epoch_started": 0, 2024-04-19T02:17:30.887 INFO:teuthology.orchestra.run.smithi121.stdout: "last_epoch_clean": 0, 2024-04-19T02:17:30.887 INFO:teuthology.orchestra.run.smithi121.stdout: "source_version": "0'0", 2024-04-19T02:17:30.887 INFO:teuthology.orchestra.run.smithi121.stdout: "target_version": "0'0" 2024-04-19T02:17:30.887 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:17:30.887 INFO:teuthology.orchestra.run.smithi121.stdout: "last_change": "14", 2024-04-19T02:17:30.887 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend": "0", 2024-04-19T02:17:30.887 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T02:17:30.887 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T02:17:30.887 INFO:teuthology.orchestra.run.smithi121.stdout: "auid": 0, 2024-04-19T02:17:30.887 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_mode": "selfmanaged", 2024-04-19T02:17:30.887 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_seq": 0, 2024-04-19T02:17:30.887 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_epoch": 0, 2024-04-19T02:17:30.887 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_snaps": [], 2024-04-19T02:17:30.887 INFO:teuthology.orchestra.run.smithi121.stdout: "removed_snaps": "[]", 2024-04-19T02:17:30.887 INFO:teuthology.orchestra.run.smithi121.stdout: "quota_max_bytes": 0, 2024-04-19T02:17:30.888 INFO:teuthology.orchestra.run.smithi121.stdout: "quota_max_objects": 0, 2024-04-19T02:17:30.888 INFO:teuthology.orchestra.run.smithi121.stdout: "tiers": [], 2024-04-19T02:17:30.888 INFO:teuthology.orchestra.run.smithi121.stdout: "tier_of": -1, 2024-04-19T02:17:30.888 INFO:teuthology.orchestra.run.smithi121.stdout: "read_tier": -1, 2024-04-19T02:17:30.888 INFO:teuthology.orchestra.run.smithi121.stdout: "write_tier": -1, 2024-04-19T02:17:30.888 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_mode": "none", 2024-04-19T02:17:30.888 INFO:teuthology.orchestra.run.smithi121.stdout: "target_max_bytes": 0, 2024-04-19T02:17:30.888 INFO:teuthology.orchestra.run.smithi121.stdout: "target_max_objects": 0, 2024-04-19T02:17:30.888 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T02:17:30.888 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T02:17:30.888 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T02:17:30.888 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_min_flush_age": 0, 2024-04-19T02:17:30.888 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_min_evict_age": 0, 2024-04-19T02:17:30.888 INFO:teuthology.orchestra.run.smithi121.stdout: "erasure_code_profile": "", 2024-04-19T02:17:30.888 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_params": { 2024-04-19T02:17:30.889 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "none" 2024-04-19T02:17:30.889 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:17:30.889 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_period": 0, 2024-04-19T02:17:30.889 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_count": 0, 2024-04-19T02:17:30.889 INFO:teuthology.orchestra.run.smithi121.stdout: "use_gmt_hitset": true, 2024-04-19T02:17:30.889 INFO:teuthology.orchestra.run.smithi121.stdout: "min_read_recency_for_promote": 0, 2024-04-19T02:17:30.889 INFO:teuthology.orchestra.run.smithi121.stdout: "min_write_recency_for_promote": 0, 2024-04-19T02:17:30.889 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T02:17:30.889 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_search_last_n": 0, 2024-04-19T02:17:30.889 INFO:teuthology.orchestra.run.smithi121.stdout: "grade_table": [], 2024-04-19T02:17:30.889 INFO:teuthology.orchestra.run.smithi121.stdout: "stripe_width": 0, 2024-04-19T02:17:30.889 INFO:teuthology.orchestra.run.smithi121.stdout: "expected_num_objects": 0, 2024-04-19T02:17:30.889 INFO:teuthology.orchestra.run.smithi121.stdout: "fast_read": false, 2024-04-19T02:17:30.889 INFO:teuthology.orchestra.run.smithi121.stdout: "options": { 2024-04-19T02:17:30.889 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_autoscale_bias": 4, 2024-04-19T02:17:30.890 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_min": 16, 2024-04-19T02:17:30.890 INFO:teuthology.orchestra.run.smithi121.stdout: "recovery_priority": 5 2024-04-19T02:17:30.890 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:17:30.890 INFO:teuthology.orchestra.run.smithi121.stdout: "application_metadata": { 2024-04-19T02:17:30.890 INFO:teuthology.orchestra.run.smithi121.stdout: "cephfs": { 2024-04-19T02:17:30.890 INFO:teuthology.orchestra.run.smithi121.stdout: "metadata": "cephfs" 2024-04-19T02:17:30.890 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:17:30.890 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:17:30.890 INFO:teuthology.orchestra.run.smithi121.stdout: "read_balance": { 2024-04-19T02:17:30.890 INFO:teuthology.orchestra.run.smithi121.stdout: "score_acting": 1.8700000047683716, 2024-04-19T02:17:30.890 INFO:teuthology.orchestra.run.smithi121.stdout: "score_stable": 1.8700000047683716, 2024-04-19T02:17:30.890 INFO:teuthology.orchestra.run.smithi121.stdout: "optimal_score": 0.67000001668930054, 2024-04-19T02:17:30.890 INFO:teuthology.orchestra.run.smithi121.stdout: "raw_score_acting": 1.25, 2024-04-19T02:17:30.891 INFO:teuthology.orchestra.run.smithi121.stdout: "raw_score_stable": 1.25, 2024-04-19T02:17:30.891 INFO:teuthology.orchestra.run.smithi121.stdout: "primary_affinity_weighted": 0.90409350395202637, 2024-04-19T02:17:30.891 INFO:teuthology.orchestra.run.smithi121.stdout: "average_primary_affinity": 0.89999997615814209, 2024-04-19T02:17:30.891 INFO:teuthology.orchestra.run.smithi121.stdout: "average_primary_affinity_weighted": 0.89999997615814209 2024-04-19T02:17:30.891 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:17:30.891 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:17:30.891 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:17:30.891 INFO:teuthology.orchestra.run.smithi121.stdout: "pool": 4, 2024-04-19T02:17:30.891 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_name": "cephfs_data", 2024-04-19T02:17:30.891 INFO:teuthology.orchestra.run.smithi121.stdout: "create_time": "2024-04-19T02:15:28.232224+0000", 2024-04-19T02:17:30.891 INFO:teuthology.orchestra.run.smithi121.stdout: "flags": 1, 2024-04-19T02:17:30.891 INFO:teuthology.orchestra.run.smithi121.stdout: "flags_names": "hashpspool", 2024-04-19T02:17:30.891 INFO:teuthology.orchestra.run.smithi121.stdout: "type": 1, 2024-04-19T02:17:30.891 INFO:teuthology.orchestra.run.smithi121.stdout: "size": 2, 2024-04-19T02:17:30.891 INFO:teuthology.orchestra.run.smithi121.stdout: "min_size": 1, 2024-04-19T02:17:30.891 INFO:teuthology.orchestra.run.smithi121.stdout: "crush_rule": 0, 2024-04-19T02:17:30.892 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_count": 0, 2024-04-19T02:17:30.892 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_target": 0, 2024-04-19T02:17:30.892 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T02:17:30.892 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T02:17:30.892 INFO:teuthology.orchestra.run.smithi121.stdout: "object_hash": 2, 2024-04-19T02:17:30.892 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_autoscale_mode": "off", 2024-04-19T02:17:30.892 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num": 64, 2024-04-19T02:17:30.892 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_placement_num": 64, 2024-04-19T02:17:30.892 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_placement_num_target": 64, 2024-04-19T02:17:30.892 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_target": 64, 2024-04-19T02:17:30.892 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_pending": 64, 2024-04-19T02:17:30.892 INFO:teuthology.orchestra.run.smithi121.stdout: "last_pg_merge_meta": { 2024-04-19T02:17:30.892 INFO:teuthology.orchestra.run.smithi121.stdout: "source_pgid": "0.0", 2024-04-19T02:17:30.892 INFO:teuthology.orchestra.run.smithi121.stdout: "ready_epoch": 0, 2024-04-19T02:17:30.892 INFO:teuthology.orchestra.run.smithi121.stdout: "last_epoch_started": 0, 2024-04-19T02:17:30.893 INFO:teuthology.orchestra.run.smithi121.stdout: "last_epoch_clean": 0, 2024-04-19T02:17:30.893 INFO:teuthology.orchestra.run.smithi121.stdout: "source_version": "0'0", 2024-04-19T02:17:30.893 INFO:teuthology.orchestra.run.smithi121.stdout: "target_version": "0'0" 2024-04-19T02:17:30.893 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:17:30.893 INFO:teuthology.orchestra.run.smithi121.stdout: "last_change": "15", 2024-04-19T02:17:30.893 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend": "0", 2024-04-19T02:17:30.893 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T02:17:30.893 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T02:17:30.893 INFO:teuthology.orchestra.run.smithi121.stdout: "auid": 0, 2024-04-19T02:17:30.893 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_mode": "selfmanaged", 2024-04-19T02:17:30.893 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_seq": 0, 2024-04-19T02:17:30.893 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_epoch": 0, 2024-04-19T02:17:30.893 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_snaps": [], 2024-04-19T02:17:30.893 INFO:teuthology.orchestra.run.smithi121.stdout: "removed_snaps": "[]", 2024-04-19T02:17:30.893 INFO:teuthology.orchestra.run.smithi121.stdout: "quota_max_bytes": 0, 2024-04-19T02:17:30.893 INFO:teuthology.orchestra.run.smithi121.stdout: "quota_max_objects": 0, 2024-04-19T02:17:30.894 INFO:teuthology.orchestra.run.smithi121.stdout: "tiers": [], 2024-04-19T02:17:30.894 INFO:teuthology.orchestra.run.smithi121.stdout: "tier_of": -1, 2024-04-19T02:17:30.894 INFO:teuthology.orchestra.run.smithi121.stdout: "read_tier": -1, 2024-04-19T02:17:30.894 INFO:teuthology.orchestra.run.smithi121.stdout: "write_tier": -1, 2024-04-19T02:17:30.894 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_mode": "none", 2024-04-19T02:17:30.894 INFO:teuthology.orchestra.run.smithi121.stdout: "target_max_bytes": 0, 2024-04-19T02:17:30.894 INFO:teuthology.orchestra.run.smithi121.stdout: "target_max_objects": 0, 2024-04-19T02:17:30.894 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T02:17:30.894 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T02:17:30.894 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T02:17:30.894 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_min_flush_age": 0, 2024-04-19T02:17:30.894 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_min_evict_age": 0, 2024-04-19T02:17:30.894 INFO:teuthology.orchestra.run.smithi121.stdout: "erasure_code_profile": "", 2024-04-19T02:17:30.894 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_params": { 2024-04-19T02:17:30.895 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "none" 2024-04-19T02:17:30.895 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:17:30.895 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_period": 0, 2024-04-19T02:17:30.895 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_count": 0, 2024-04-19T02:17:30.895 INFO:teuthology.orchestra.run.smithi121.stdout: "use_gmt_hitset": true, 2024-04-19T02:17:30.895 INFO:teuthology.orchestra.run.smithi121.stdout: "min_read_recency_for_promote": 0, 2024-04-19T02:17:30.895 INFO:teuthology.orchestra.run.smithi121.stdout: "min_write_recency_for_promote": 0, 2024-04-19T02:17:30.895 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T02:17:30.895 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_search_last_n": 0, 2024-04-19T02:17:30.895 INFO:teuthology.orchestra.run.smithi121.stdout: "grade_table": [], 2024-04-19T02:17:30.895 INFO:teuthology.orchestra.run.smithi121.stdout: "stripe_width": 0, 2024-04-19T02:17:30.895 INFO:teuthology.orchestra.run.smithi121.stdout: "expected_num_objects": 0, 2024-04-19T02:17:30.895 INFO:teuthology.orchestra.run.smithi121.stdout: "fast_read": false, 2024-04-19T02:17:30.895 INFO:teuthology.orchestra.run.smithi121.stdout: "options": { 2024-04-19T02:17:30.896 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_min": 64, 2024-04-19T02:17:30.896 INFO:teuthology.orchestra.run.smithi121.stdout: "target_size_ratio": 0.89999997615814209 2024-04-19T02:17:30.896 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:17:30.896 INFO:teuthology.orchestra.run.smithi121.stdout: "application_metadata": { 2024-04-19T02:17:30.896 INFO:teuthology.orchestra.run.smithi121.stdout: "cephfs": { 2024-04-19T02:17:30.896 INFO:teuthology.orchestra.run.smithi121.stdout: "data": "cephfs" 2024-04-19T02:17:30.896 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:17:30.896 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:17:30.896 INFO:teuthology.orchestra.run.smithi121.stdout: "read_balance": { 2024-04-19T02:17:30.896 INFO:teuthology.orchestra.run.smithi121.stdout: "score_acting": 1.5800000429153442, 2024-04-19T02:17:30.896 INFO:teuthology.orchestra.run.smithi121.stdout: "score_stable": 1.5800000429153442, 2024-04-19T02:17:30.896 INFO:teuthology.orchestra.run.smithi121.stdout: "optimal_score": 0.67000001668930054, 2024-04-19T02:17:30.896 INFO:teuthology.orchestra.run.smithi121.stdout: "raw_score_acting": 1.059999942779541, 2024-04-19T02:17:30.896 INFO:teuthology.orchestra.run.smithi121.stdout: "raw_score_stable": 1.059999942779541, 2024-04-19T02:17:30.896 INFO:teuthology.orchestra.run.smithi121.stdout: "primary_affinity_weighted": 0.90409350395202637, 2024-04-19T02:17:30.897 INFO:teuthology.orchestra.run.smithi121.stdout: "average_primary_affinity": 0.89999997615814209, 2024-04-19T02:17:30.897 INFO:teuthology.orchestra.run.smithi121.stdout: "average_primary_affinity_weighted": 0.89999997615814209 2024-04-19T02:17:30.897 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:17:30.897 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:17:30.897 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:17:30.897 INFO:teuthology.orchestra.run.smithi121.stdout: "pool": 5, 2024-04-19T02:17:30.897 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_name": "unique_pool_0", 2024-04-19T02:17:30.897 INFO:teuthology.orchestra.run.smithi121.stdout: "create_time": "2024-04-19T02:15:52.929114+0000", 2024-04-19T02:17:30.897 INFO:teuthology.orchestra.run.smithi121.stdout: "flags": 1, 2024-04-19T02:17:30.897 INFO:teuthology.orchestra.run.smithi121.stdout: "flags_names": "hashpspool", 2024-04-19T02:17:30.897 INFO:teuthology.orchestra.run.smithi121.stdout: "type": 1, 2024-04-19T02:17:30.897 INFO:teuthology.orchestra.run.smithi121.stdout: "size": 2, 2024-04-19T02:17:30.897 INFO:teuthology.orchestra.run.smithi121.stdout: "min_size": 1, 2024-04-19T02:17:30.897 INFO:teuthology.orchestra.run.smithi121.stdout: "crush_rule": 0, 2024-04-19T02:17:30.897 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_count": 0, 2024-04-19T02:17:30.898 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_target": 0, 2024-04-19T02:17:30.898 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T02:17:30.898 INFO:teuthology.orchestra.run.smithi121.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T02:17:30.898 INFO:teuthology.orchestra.run.smithi121.stdout: "object_hash": 2, 2024-04-19T02:17:30.898 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_autoscale_mode": "off", 2024-04-19T02:17:30.898 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num": 16, 2024-04-19T02:17:30.898 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_placement_num": 16, 2024-04-19T02:17:30.898 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_placement_num_target": 16, 2024-04-19T02:17:30.898 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_target": 16, 2024-04-19T02:17:30.898 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_num_pending": 16, 2024-04-19T02:17:30.898 INFO:teuthology.orchestra.run.smithi121.stdout: "last_pg_merge_meta": { 2024-04-19T02:17:30.898 INFO:teuthology.orchestra.run.smithi121.stdout: "source_pgid": "0.0", 2024-04-19T02:17:30.898 INFO:teuthology.orchestra.run.smithi121.stdout: "ready_epoch": 0, 2024-04-19T02:17:30.898 INFO:teuthology.orchestra.run.smithi121.stdout: "last_epoch_started": 0, 2024-04-19T02:17:30.898 INFO:teuthology.orchestra.run.smithi121.stdout: "last_epoch_clean": 0, 2024-04-19T02:17:30.899 INFO:teuthology.orchestra.run.smithi121.stdout: "source_version": "0'0", 2024-04-19T02:17:30.899 INFO:teuthology.orchestra.run.smithi121.stdout: "target_version": "0'0" 2024-04-19T02:17:30.899 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:17:30.899 INFO:teuthology.orchestra.run.smithi121.stdout: "last_change": "18", 2024-04-19T02:17:30.899 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend": "0", 2024-04-19T02:17:30.899 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T02:17:30.899 INFO:teuthology.orchestra.run.smithi121.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T02:17:30.899 INFO:teuthology.orchestra.run.smithi121.stdout: "auid": 0, 2024-04-19T02:17:30.899 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_mode": "selfmanaged", 2024-04-19T02:17:30.899 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_seq": 0, 2024-04-19T02:17:30.899 INFO:teuthology.orchestra.run.smithi121.stdout: "snap_epoch": 0, 2024-04-19T02:17:30.899 INFO:teuthology.orchestra.run.smithi121.stdout: "pool_snaps": [], 2024-04-19T02:17:30.899 INFO:teuthology.orchestra.run.smithi121.stdout: "removed_snaps": "[]", 2024-04-19T02:17:30.899 INFO:teuthology.orchestra.run.smithi121.stdout: "quota_max_bytes": 0, 2024-04-19T02:17:30.899 INFO:teuthology.orchestra.run.smithi121.stdout: "quota_max_objects": 0, 2024-04-19T02:17:30.900 INFO:teuthology.orchestra.run.smithi121.stdout: "tiers": [], 2024-04-19T02:17:30.900 INFO:teuthology.orchestra.run.smithi121.stdout: "tier_of": -1, 2024-04-19T02:17:30.900 INFO:teuthology.orchestra.run.smithi121.stdout: "read_tier": -1, 2024-04-19T02:17:30.900 INFO:teuthology.orchestra.run.smithi121.stdout: "write_tier": -1, 2024-04-19T02:17:30.900 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_mode": "none", 2024-04-19T02:17:30.900 INFO:teuthology.orchestra.run.smithi121.stdout: "target_max_bytes": 0, 2024-04-19T02:17:30.900 INFO:teuthology.orchestra.run.smithi121.stdout: "target_max_objects": 0, 2024-04-19T02:17:30.900 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T02:17:30.900 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T02:17:30.900 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T02:17:30.900 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_min_flush_age": 0, 2024-04-19T02:17:30.900 INFO:teuthology.orchestra.run.smithi121.stdout: "cache_min_evict_age": 0, 2024-04-19T02:17:30.900 INFO:teuthology.orchestra.run.smithi121.stdout: "erasure_code_profile": "", 2024-04-19T02:17:30.900 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_params": { 2024-04-19T02:17:30.901 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "none" 2024-04-19T02:17:30.901 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:17:30.901 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_period": 0, 2024-04-19T02:17:30.901 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_count": 0, 2024-04-19T02:17:30.901 INFO:teuthology.orchestra.run.smithi121.stdout: "use_gmt_hitset": true, 2024-04-19T02:17:30.901 INFO:teuthology.orchestra.run.smithi121.stdout: "min_read_recency_for_promote": 0, 2024-04-19T02:17:30.901 INFO:teuthology.orchestra.run.smithi121.stdout: "min_write_recency_for_promote": 0, 2024-04-19T02:17:30.901 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T02:17:30.901 INFO:teuthology.orchestra.run.smithi121.stdout: "hit_set_search_last_n": 0, 2024-04-19T02:17:30.901 INFO:teuthology.orchestra.run.smithi121.stdout: "grade_table": [], 2024-04-19T02:17:30.901 INFO:teuthology.orchestra.run.smithi121.stdout: "stripe_width": 0, 2024-04-19T02:17:30.901 INFO:teuthology.orchestra.run.smithi121.stdout: "expected_num_objects": 0, 2024-04-19T02:17:30.901 INFO:teuthology.orchestra.run.smithi121.stdout: "fast_read": false, 2024-04-19T02:17:30.901 INFO:teuthology.orchestra.run.smithi121.stdout: "options": {}, 2024-04-19T02:17:30.902 INFO:teuthology.orchestra.run.smithi121.stdout: "application_metadata": { 2024-04-19T02:17:30.902 INFO:teuthology.orchestra.run.smithi121.stdout: "rados": {} 2024-04-19T02:17:30.902 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:17:30.902 INFO:teuthology.orchestra.run.smithi121.stdout: "read_balance": { 2024-04-19T02:17:30.902 INFO:teuthology.orchestra.run.smithi121.stdout: "score_acting": 1.690000057220459, 2024-04-19T02:17:30.902 INFO:teuthology.orchestra.run.smithi121.stdout: "score_stable": 1.690000057220459, 2024-04-19T02:17:30.902 INFO:teuthology.orchestra.run.smithi121.stdout: "optimal_score": 0.67000001668930054, 2024-04-19T02:17:30.902 INFO:teuthology.orchestra.run.smithi121.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-19T02:17:30.902 INFO:teuthology.orchestra.run.smithi121.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-19T02:17:30.902 INFO:teuthology.orchestra.run.smithi121.stdout: "primary_affinity_weighted": 0.90409350395202637, 2024-04-19T02:17:30.902 INFO:teuthology.orchestra.run.smithi121.stdout: "average_primary_affinity": 0.89999997615814209, 2024-04-19T02:17:30.902 INFO:teuthology.orchestra.run.smithi121.stdout: "average_primary_affinity_weighted": 0.89999997615814209 2024-04-19T02:17:30.903 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:17:30.903 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:17:30.903 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-04-19T02:17:30.903 INFO:teuthology.orchestra.run.smithi121.stdout: "osds": [ 2024-04-19T02:17:30.903 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:17:30.903 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": 0, 2024-04-19T02:17:30.903 INFO:teuthology.orchestra.run.smithi121.stdout: "uuid": "88cb15f3-271c-43d5-af51-1cd26b8ed13c", 2024-04-19T02:17:30.903 INFO:teuthology.orchestra.run.smithi121.stdout: "up": 1, 2024-04-19T02:17:30.903 INFO:teuthology.orchestra.run.smithi121.stdout: "in": 1, 2024-04-19T02:17:30.903 INFO:teuthology.orchestra.run.smithi121.stdout: "weight": 1, 2024-04-19T02:17:30.903 INFO:teuthology.orchestra.run.smithi121.stdout: "primary_affinity": 1, 2024-04-19T02:17:30.903 INFO:teuthology.orchestra.run.smithi121.stdout: "last_clean_begin": 0, 2024-04-19T02:17:30.903 INFO:teuthology.orchestra.run.smithi121.stdout: "last_clean_end": 0, 2024-04-19T02:17:30.903 INFO:teuthology.orchestra.run.smithi121.stdout: "up_from": 8, 2024-04-19T02:17:30.904 INFO:teuthology.orchestra.run.smithi121.stdout: "up_thru": 50, 2024-04-19T02:17:30.904 INFO:teuthology.orchestra.run.smithi121.stdout: "down_at": 0, 2024-04-19T02:17:30.904 INFO:teuthology.orchestra.run.smithi121.stdout: "lost_at": 0, 2024-04-19T02:17:30.904 INFO:teuthology.orchestra.run.smithi121.stdout: "public_addrs": { 2024-04-19T02:17:30.904 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:17:30.904 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:17:30.904 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:17:30.904 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.153:6800", 2024-04-19T02:17:30.904 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41347 2024-04-19T02:17:30.904 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:17:30.904 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:17:30.904 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:17:30.904 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.153:6801", 2024-04-19T02:17:30.904 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41347 2024-04-19T02:17:30.904 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:17:30.904 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:17:30.904 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:17:30.905 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_addrs": { 2024-04-19T02:17:30.905 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:17:30.905 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:17:30.905 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:17:30.905 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.153:6802", 2024-04-19T02:17:30.905 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41347 2024-04-19T02:17:30.905 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:17:30.905 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:17:30.905 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:17:30.905 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.153:6803", 2024-04-19T02:17:30.905 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41347 2024-04-19T02:17:30.905 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:17:30.905 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:17:30.905 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:17:30.905 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_back_addrs": { 2024-04-19T02:17:30.906 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:17:30.906 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:17:30.906 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:17:30.906 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.153:6806", 2024-04-19T02:17:30.906 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41347 2024-04-19T02:17:30.906 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:17:30.906 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:17:30.906 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:17:30.906 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.153:6807", 2024-04-19T02:17:30.906 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41347 2024-04-19T02:17:30.906 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:17:30.906 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:17:30.906 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:17:30.907 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_front_addrs": { 2024-04-19T02:17:30.907 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:17:30.907 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:17:30.907 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:17:30.907 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.153:6804", 2024-04-19T02:17:30.907 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41347 2024-04-19T02:17:30.907 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:17:30.907 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:17:30.907 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:17:30.907 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.153:6805", 2024-04-19T02:17:30.907 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41347 2024-04-19T02:17:30.907 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:17:30.907 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:17:30.907 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:17:30.907 INFO:teuthology.orchestra.run.smithi121.stdout: "public_addr": "172.21.15.153:6801/41347", 2024-04-19T02:17:30.908 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_addr": "172.21.15.153:6803/41347", 2024-04-19T02:17:30.908 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_back_addr": "172.21.15.153:6807/41347", 2024-04-19T02:17:30.908 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_front_addr": "172.21.15.153:6805/41347", 2024-04-19T02:17:30.908 INFO:teuthology.orchestra.run.smithi121.stdout: "state": [ 2024-04-19T02:17:30.908 INFO:teuthology.orchestra.run.smithi121.stdout: "exists", 2024-04-19T02:17:30.908 INFO:teuthology.orchestra.run.smithi121.stdout: "up" 2024-04-19T02:17:30.908 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:17:30.908 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:17:30.908 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:17:30.908 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": 1, 2024-04-19T02:17:30.908 INFO:teuthology.orchestra.run.smithi121.stdout: "uuid": "2674869a-db01-4d9f-a496-9fb3851b5b21", 2024-04-19T02:17:30.908 INFO:teuthology.orchestra.run.smithi121.stdout: "up": 1, 2024-04-19T02:17:30.908 INFO:teuthology.orchestra.run.smithi121.stdout: "in": 1, 2024-04-19T02:17:30.908 INFO:teuthology.orchestra.run.smithi121.stdout: "weight": 1, 2024-04-19T02:17:30.909 INFO:teuthology.orchestra.run.smithi121.stdout: "primary_affinity": 0.7122802734375, 2024-04-19T02:17:30.909 INFO:teuthology.orchestra.run.smithi121.stdout: "last_clean_begin": 0, 2024-04-19T02:17:30.909 INFO:teuthology.orchestra.run.smithi121.stdout: "last_clean_end": 0, 2024-04-19T02:17:30.909 INFO:teuthology.orchestra.run.smithi121.stdout: "up_from": 8, 2024-04-19T02:17:30.909 INFO:teuthology.orchestra.run.smithi121.stdout: "up_thru": 50, 2024-04-19T02:17:30.909 INFO:teuthology.orchestra.run.smithi121.stdout: "down_at": 0, 2024-04-19T02:17:30.909 INFO:teuthology.orchestra.run.smithi121.stdout: "lost_at": 0, 2024-04-19T02:17:30.909 INFO:teuthology.orchestra.run.smithi121.stdout: "public_addrs": { 2024-04-19T02:17:30.909 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:17:30.909 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:17:30.909 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:17:30.909 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.174:6800", 2024-04-19T02:17:30.909 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41380 2024-04-19T02:17:30.909 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:17:30.909 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:17:30.910 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:17:30.910 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.174:6801", 2024-04-19T02:17:30.910 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41380 2024-04-19T02:17:30.910 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:17:30.910 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:17:30.910 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:17:30.910 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_addrs": { 2024-04-19T02:17:30.910 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:17:30.910 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:17:30.910 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:17:30.910 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.174:6802", 2024-04-19T02:17:30.910 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41380 2024-04-19T02:17:30.910 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:17:30.910 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:17:30.911 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:17:30.911 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.174:6803", 2024-04-19T02:17:30.911 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41380 2024-04-19T02:17:30.911 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:17:30.911 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:17:30.911 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:17:30.911 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_back_addrs": { 2024-04-19T02:17:30.911 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:17:30.911 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:17:30.911 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:17:30.911 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.174:6806", 2024-04-19T02:17:30.911 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41380 2024-04-19T02:17:30.911 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:17:30.911 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:17:30.912 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:17:30.912 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.174:6807", 2024-04-19T02:17:30.912 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41380 2024-04-19T02:17:30.912 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:17:30.912 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:17:30.912 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:17:30.912 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_front_addrs": { 2024-04-19T02:17:30.912 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:17:30.912 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:17:30.912 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:17:30.912 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.174:6804", 2024-04-19T02:17:30.912 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41380 2024-04-19T02:17:30.912 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:17:30.912 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:17:30.912 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:17:30.912 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.174:6805", 2024-04-19T02:17:30.913 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41380 2024-04-19T02:17:30.913 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:17:30.913 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:17:30.913 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:17:30.913 INFO:teuthology.orchestra.run.smithi121.stdout: "public_addr": "172.21.15.174:6801/41380", 2024-04-19T02:17:30.913 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_addr": "172.21.15.174:6803/41380", 2024-04-19T02:17:30.913 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_back_addr": "172.21.15.174:6807/41380", 2024-04-19T02:17:30.913 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_front_addr": "172.21.15.174:6805/41380", 2024-04-19T02:17:30.913 INFO:teuthology.orchestra.run.smithi121.stdout: "state": [ 2024-04-19T02:17:30.913 INFO:teuthology.orchestra.run.smithi121.stdout: "exists", 2024-04-19T02:17:30.913 INFO:teuthology.orchestra.run.smithi121.stdout: "up" 2024-04-19T02:17:30.913 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:17:30.913 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:17:30.914 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:17:30.914 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": 2, 2024-04-19T02:17:30.914 INFO:teuthology.orchestra.run.smithi121.stdout: "uuid": "712ad943-2f98-49d9-aabe-f66b509be633", 2024-04-19T02:17:30.914 INFO:teuthology.orchestra.run.smithi121.stdout: "up": 0, 2024-04-19T02:17:30.914 INFO:teuthology.orchestra.run.smithi121.stdout: "in": 1, 2024-04-19T02:17:30.914 INFO:teuthology.orchestra.run.smithi121.stdout: "weight": 1, 2024-04-19T02:17:30.914 INFO:teuthology.orchestra.run.smithi121.stdout: "primary_affinity": 1, 2024-04-19T02:17:30.914 INFO:teuthology.orchestra.run.smithi121.stdout: "last_clean_begin": 0, 2024-04-19T02:17:30.914 INFO:teuthology.orchestra.run.smithi121.stdout: "last_clean_end": 0, 2024-04-19T02:17:30.914 INFO:teuthology.orchestra.run.smithi121.stdout: "up_from": 8, 2024-04-19T02:17:30.914 INFO:teuthology.orchestra.run.smithi121.stdout: "up_thru": 47, 2024-04-19T02:17:30.914 INFO:teuthology.orchestra.run.smithi121.stdout: "down_at": 50, 2024-04-19T02:17:30.914 INFO:teuthology.orchestra.run.smithi121.stdout: "lost_at": 0, 2024-04-19T02:17:30.914 INFO:teuthology.orchestra.run.smithi121.stdout: "public_addrs": { 2024-04-19T02:17:30.915 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:17:30.915 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:17:30.915 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:17:30.915 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.177:6800", 2024-04-19T02:17:30.915 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41508 2024-04-19T02:17:30.915 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:17:30.915 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:17:30.915 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:17:30.915 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.177:6801", 2024-04-19T02:17:30.915 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41508 2024-04-19T02:17:30.915 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:17:30.915 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:17:30.915 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:17:30.915 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_addrs": { 2024-04-19T02:17:30.916 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:17:30.916 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:17:30.916 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:17:30.916 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.177:6802", 2024-04-19T02:17:30.916 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41508 2024-04-19T02:17:30.916 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:17:30.916 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:17:30.916 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:17:30.916 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.177:6803", 2024-04-19T02:17:30.916 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41508 2024-04-19T02:17:30.916 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:17:30.916 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:17:30.916 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:17:30.916 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_back_addrs": { 2024-04-19T02:17:30.916 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:17:30.917 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:17:30.917 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:17:30.917 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.177:6806", 2024-04-19T02:17:30.917 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41508 2024-04-19T02:17:30.917 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:17:30.917 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:17:30.917 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:17:30.917 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.177:6807", 2024-04-19T02:17:30.917 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41508 2024-04-19T02:17:30.917 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:17:30.917 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:17:30.917 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:17:30.917 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_front_addrs": { 2024-04-19T02:17:30.917 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-04-19T02:17:30.917 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:17:30.918 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-04-19T02:17:30.918 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.177:6804", 2024-04-19T02:17:30.918 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41508 2024-04-19T02:17:30.918 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:17:30.918 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:17:30.918 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-04-19T02:17:30.918 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.177:6805", 2024-04-19T02:17:30.918 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 41508 2024-04-19T02:17:30.918 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:17:30.918 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:17:30.918 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:17:30.918 INFO:teuthology.orchestra.run.smithi121.stdout: "public_addr": "172.21.15.177:6801/41508", 2024-04-19T02:17:30.918 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_addr": "172.21.15.177:6803/41508", 2024-04-19T02:17:30.919 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_back_addr": "172.21.15.177:6807/41508", 2024-04-19T02:17:30.919 INFO:teuthology.orchestra.run.smithi121.stdout: "heartbeat_front_addr": "172.21.15.177:6805/41508", 2024-04-19T02:17:30.919 INFO:teuthology.orchestra.run.smithi121.stdout: "state": [ 2024-04-19T02:17:30.919 INFO:teuthology.orchestra.run.smithi121.stdout: "exists" 2024-04-19T02:17:30.919 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:17:30.919 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:17:30.919 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-04-19T02:17:30.919 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_xinfo": [ 2024-04-19T02:17:30.919 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:17:30.919 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": 0, 2024-04-19T02:17:30.919 INFO:teuthology.orchestra.run.smithi121.stdout: "down_stamp": "0.000000", 2024-04-19T02:17:30.919 INFO:teuthology.orchestra.run.smithi121.stdout: "laggy_probability": 0, 2024-04-19T02:17:30.919 INFO:teuthology.orchestra.run.smithi121.stdout: "laggy_interval": 0, 2024-04-19T02:17:30.919 INFO:teuthology.orchestra.run.smithi121.stdout: "features": 4540138322906710015, 2024-04-19T02:17:30.919 INFO:teuthology.orchestra.run.smithi121.stdout: "old_weight": 0, 2024-04-19T02:17:30.920 INFO:teuthology.orchestra.run.smithi121.stdout: "last_purged_snaps_scrub": "2024-04-19T02:15:20.495280+0000", 2024-04-19T02:17:30.920 INFO:teuthology.orchestra.run.smithi121.stdout: "dead_epoch": 0 2024-04-19T02:17:30.920 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:17:30.920 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:17:30.920 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": 1, 2024-04-19T02:17:30.920 INFO:teuthology.orchestra.run.smithi121.stdout: "down_stamp": "0.000000", 2024-04-19T02:17:30.920 INFO:teuthology.orchestra.run.smithi121.stdout: "laggy_probability": 0, 2024-04-19T02:17:30.920 INFO:teuthology.orchestra.run.smithi121.stdout: "laggy_interval": 0, 2024-04-19T02:17:30.920 INFO:teuthology.orchestra.run.smithi121.stdout: "features": 4540138322906710015, 2024-04-19T02:17:30.920 INFO:teuthology.orchestra.run.smithi121.stdout: "old_weight": 0, 2024-04-19T02:17:30.920 INFO:teuthology.orchestra.run.smithi121.stdout: "last_purged_snaps_scrub": "2024-04-19T02:15:20.594553+0000", 2024-04-19T02:17:30.920 INFO:teuthology.orchestra.run.smithi121.stdout: "dead_epoch": 0 2024-04-19T02:17:30.920 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:17:30.920 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:17:30.921 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": 2, 2024-04-19T02:17:30.921 INFO:teuthology.orchestra.run.smithi121.stdout: "down_stamp": "0.000000", 2024-04-19T02:17:30.921 INFO:teuthology.orchestra.run.smithi121.stdout: "laggy_probability": 0, 2024-04-19T02:17:30.921 INFO:teuthology.orchestra.run.smithi121.stdout: "laggy_interval": 0, 2024-04-19T02:17:30.921 INFO:teuthology.orchestra.run.smithi121.stdout: "features": 4540138322906710015, 2024-04-19T02:17:30.921 INFO:teuthology.orchestra.run.smithi121.stdout: "old_weight": 0, 2024-04-19T02:17:30.921 INFO:teuthology.orchestra.run.smithi121.stdout: "last_purged_snaps_scrub": "2024-04-19T02:15:20.524253+0000", 2024-04-19T02:17:30.921 INFO:teuthology.orchestra.run.smithi121.stdout: "dead_epoch": 49 2024-04-19T02:17:30.921 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:17:30.921 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-04-19T02:17:30.921 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_upmap": [ 2024-04-19T02:17:30.921 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:17:30.921 INFO:teuthology.orchestra.run.smithi121.stdout: "pgid": "4.36", 2024-04-19T02:17:30.921 INFO:teuthology.orchestra.run.smithi121.stdout: "osds": [ 2024-04-19T02:17:30.921 INFO:teuthology.orchestra.run.smithi121.stdout: 0, 2024-04-19T02:17:30.922 INFO:teuthology.orchestra.run.smithi121.stdout: 1 2024-04-19T02:17:30.922 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:17:30.922 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:17:30.922 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-04-19T02:17:30.922 INFO:teuthology.orchestra.run.smithi121.stdout: "pgid": "5.1", 2024-04-19T02:17:30.922 INFO:teuthology.orchestra.run.smithi121.stdout: "osds": [ 2024-04-19T02:17:30.922 INFO:teuthology.orchestra.run.smithi121.stdout: 1, 2024-04-19T02:17:30.922 INFO:teuthology.orchestra.run.smithi121.stdout: 2 2024-04-19T02:17:30.922 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-04-19T02:17:30.922 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:17:30.922 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-04-19T02:17:30.922 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_upmap_items": [], 2024-04-19T02:17:30.922 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_upmap_primaries": [], 2024-04-19T02:17:30.922 INFO:teuthology.orchestra.run.smithi121.stdout: "pg_temp": [], 2024-04-19T02:17:30.923 INFO:teuthology.orchestra.run.smithi121.stdout: "primary_temp": [], 2024-04-19T02:17:30.923 INFO:teuthology.orchestra.run.smithi121.stdout: "blocklist": {}, 2024-04-19T02:17:30.923 INFO:teuthology.orchestra.run.smithi121.stdout: "range_blocklist": {}, 2024-04-19T02:17:30.923 INFO:teuthology.orchestra.run.smithi121.stdout: "erasure_code_profiles": { 2024-04-19T02:17:30.923 INFO:teuthology.orchestra.run.smithi121.stdout: "default": { 2024-04-19T02:17:30.923 INFO:teuthology.orchestra.run.smithi121.stdout: "crush-failure-domain": "osd", 2024-04-19T02:17:30.923 INFO:teuthology.orchestra.run.smithi121.stdout: "k": "2", 2024-04-19T02:17:30.923 INFO:teuthology.orchestra.run.smithi121.stdout: "m": "1", 2024-04-19T02:17:30.923 INFO:teuthology.orchestra.run.smithi121.stdout: "plugin": "jerasure", 2024-04-19T02:17:30.923 INFO:teuthology.orchestra.run.smithi121.stdout: "technique": "reed_sol_van" 2024-04-19T02:17:30.923 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:17:30.923 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-04-19T02:17:30.923 INFO:teuthology.orchestra.run.smithi121.stdout: "removed_snaps_queue": [], 2024-04-19T02:17:30.923 INFO:teuthology.orchestra.run.smithi121.stdout: "new_removed_snaps": [], 2024-04-19T02:17:30.923 INFO:teuthology.orchestra.run.smithi121.stdout: "new_purged_snaps": [], 2024-04-19T02:17:30.924 INFO:teuthology.orchestra.run.smithi121.stdout: "crush_node_flags": {}, 2024-04-19T02:17:30.924 INFO:teuthology.orchestra.run.smithi121.stdout: "device_class_flags": {}, 2024-04-19T02:17:30.924 INFO:teuthology.orchestra.run.smithi121.stdout: "stretch_mode": { 2024-04-19T02:17:30.924 INFO:teuthology.orchestra.run.smithi121.stdout: "stretch_mode_enabled": false, 2024-04-19T02:17:30.924 INFO:teuthology.orchestra.run.smithi121.stdout: "stretch_bucket_count": 0, 2024-04-19T02:17:30.924 INFO:teuthology.orchestra.run.smithi121.stdout: "degraded_stretch_mode": 0, 2024-04-19T02:17:30.924 INFO:teuthology.orchestra.run.smithi121.stdout: "recovering_stretch_mode": 0, 2024-04-19T02:17:30.924 INFO:teuthology.orchestra.run.smithi121.stdout: "stretch_mode_bucket": 0 2024-04-19T02:17:30.924 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-04-19T02:17:30.924 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-04-19T02:17:30.926 INFO:tasks.thrashosds.thrasher:j is {'epoch': 59, 'fsid': 'f6ab5dd0-bb9f-4b48-a9fc-4728c7955ca8', 'created': '2024-04-19T02:15:13.539846+0000', 'modified': '2024-04-19T02:17:29.309056+0000', 'last_up_change': '2024-04-19T02:17:07.231829+0000', 'last_in_change': '2024-04-19T02:15:15.482624+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-19T02:15:22.776125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9040935039520264, 'average_primary_affinity': 0.8999999761581421, 'average_primary_affinity_weighted': 0.8999999761581421}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-19T02:15:23.264005+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.4900000095367432, 'score_stable': 1.4900000095367432, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 0.9040935039520264, 'average_primary_affinity': 0.8999999761581421, 'average_primary_affinity_weighted': 0.8999999761581421}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-19T02:15:27.675087+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8700000047683716, 'score_stable': 1.8700000047683716, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 0.9040935039520264, 'average_primary_affinity': 0.8999999761581421, 'average_primary_affinity_weighted': 0.8999999761581421}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-19T02:15:28.232224+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5800000429153442, 'score_stable': 1.5800000429153442, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.059999942779541, 'raw_score_stable': 1.059999942779541, 'primary_affinity_weighted': 0.9040935039520264, 'average_primary_affinity': 0.8999999761581421, 'average_primary_affinity_weighted': 0.8999999761581421}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2024-04-19T02:15:52.929114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 0.9040935039520264, 'average_primary_affinity': 0.8999999761581421, 'average_primary_affinity_weighted': 0.8999999761581421}}], 'osds': [{'osd': 0, 'uuid': '88cb15f3-271c-43d5-af51-1cd26b8ed13c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 50, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6800', 'nonce': 41347}, {'type': 'v1', 'addr': '172.21.15.153:6801', 'nonce': 41347}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6802', 'nonce': 41347}, {'type': 'v1', 'addr': '172.21.15.153:6803', 'nonce': 41347}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6806', 'nonce': 41347}, {'type': 'v1', 'addr': '172.21.15.153:6807', 'nonce': 41347}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6804', 'nonce': 41347}, {'type': 'v1', 'addr': '172.21.15.153:6805', 'nonce': 41347}]}, 'public_addr': '172.21.15.153:6801/41347', 'cluster_addr': '172.21.15.153:6803/41347', 'heartbeat_back_addr': '172.21.15.153:6807/41347', 'heartbeat_front_addr': '172.21.15.153:6805/41347', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '2674869a-db01-4d9f-a496-9fb3851b5b21', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.7122802734375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 50, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6800', 'nonce': 41380}, {'type': 'v1', 'addr': '172.21.15.174:6801', 'nonce': 41380}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6802', 'nonce': 41380}, {'type': 'v1', 'addr': '172.21.15.174:6803', 'nonce': 41380}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6806', 'nonce': 41380}, {'type': 'v1', 'addr': '172.21.15.174:6807', 'nonce': 41380}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6804', 'nonce': 41380}, {'type': 'v1', 'addr': '172.21.15.174:6805', 'nonce': 41380}]}, 'public_addr': '172.21.15.174:6801/41380', 'cluster_addr': '172.21.15.174:6803/41380', 'heartbeat_back_addr': '172.21.15.174:6807/41380', 'heartbeat_front_addr': '172.21.15.174:6805/41380', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '712ad943-2f98-49d9-aabe-f66b509be633', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 47, 'down_at': 50, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6800', 'nonce': 41508}, {'type': 'v1', 'addr': '172.21.15.177:6801', 'nonce': 41508}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6802', 'nonce': 41508}, {'type': 'v1', 'addr': '172.21.15.177:6803', 'nonce': 41508}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6806', 'nonce': 41508}, {'type': 'v1', 'addr': '172.21.15.177:6807', 'nonce': 41508}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6804', 'nonce': 41508}, {'type': 'v1', 'addr': '172.21.15.177:6805', 'nonce': 41508}]}, 'public_addr': '172.21.15.177:6801/41508', 'cluster_addr': '172.21.15.177:6803/41508', 'heartbeat_back_addr': '172.21.15.177:6807/41508', 'heartbeat_front_addr': '172.21.15.177:6805/41508', 'state': ['exists']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-19T02:15:20.495280+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-19T02:15:20.594553+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-19T02:15:20.524253+0000', 'dead_epoch': 49}], 'pg_upmap': [{'pgid': '4.36', 'osds': [0, 1]}, {'pgid': '5.1', 'osds': [1, 2]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-19T02:17:30.926 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-04-19T02:17:30.932 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:30.932 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:30.941 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:30.941+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:30.947 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:17:31.042 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:31.042+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:31.143 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:31.143+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:31.165 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:31.165 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:31.180 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:31.244 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:31.244+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:31.330 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T02:17:31.345 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:31.345+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:31.354 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:31.354 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:31.364 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:31.446 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:31.446+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:31.538 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:31.538 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:31.546 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:31.546+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:31.548 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:31.647 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:31.647+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:31.748 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:31.748+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:31.763 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:31.764 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:31.778 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:17:31.808 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~23s 2024-04-19T02:17:31.848 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:31.848+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:31.935 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:17:31.949 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:31.949+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:31.955 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:31.955 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:31.969 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:17:32.054 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:32.054+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:32.086 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:17:32.109 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:17:32.110 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:17:32.110 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:17:32.110 INFO:teuthology.orchestra.run.smithi121.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T02:17:32.112 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:17:32.113 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:17:32.150 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:32.150+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:32.189 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:17:32.189 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [], 2024-04-19T02:17:32.190 INFO:teuthology.orchestra.run.smithi174.stdout: "complaint_time": 30, 2024-04-19T02:17:32.190 INFO:teuthology.orchestra.run.smithi174.stdout: "num_blocked_ops": 0 2024-04-19T02:17:32.190 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:17:32.206 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:17:32.294 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:32.294+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:32.324 INFO:teuthology.orchestra.run.smithi121.stderr:nodeep-scrub is set 2024-04-19T02:17:32.351 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:32.351+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:32.423 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:17:32.423 INFO:teuthology.orchestra.run.smithi174.stdout: "size": 20, 2024-04-19T02:17:32.423 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 600, 2024-04-19T02:17:32.423 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:17:32.424 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.424 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:19 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:32.424 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:17:32.424 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 123.15024705800001, 2024-04-19T02:17:32.424 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020818203, 2024-04-19T02:17:32.424 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:32.424 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:32.424 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:32.424 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.424 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:32.424 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:17:32.424 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:32.424 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.424 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.425 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:32.425 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:17:32.425 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:32.425 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.425 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.425 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:32.425 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:17:32.425 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:32.425 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.425 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.425 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:32.425 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270065+0000", 2024-04-19T02:17:32.425 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4310000000000001e-06 2024-04-19T02:17:32.425 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.425 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.426 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:32.426 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270070+0000", 2024-04-19T02:17:32.426 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2859999999999999e-06 2024-04-19T02:17:32.426 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.426 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.426 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.426 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270077+0000", 2024-04-19T02:17:32.426 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5270000000000004e-06 2024-04-19T02:17:32.426 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.426 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.426 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:32.426 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270107+0000", 2024-04-19T02:17:32.426 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0205999999999998e-05 2024-04-19T02:17:32.426 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.427 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.427 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:32.427 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270111+0000", 2024-04-19T02:17:32.427 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8650000000000003e-06 2024-04-19T02:17:32.427 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.427 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.427 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:32.427 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285936+0000", 2024-04-19T02:17:32.427 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015824677999999998 2024-04-19T02:17:32.427 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.427 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.427 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:32.427 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286007+0000", 2024-04-19T02:17:32.427 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1157999999999999e-05 2024-04-19T02:17:32.427 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.428 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.428 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:32.428 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286086+0000", 2024-04-19T02:17:32.428 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9084000000000004e-05 2024-04-19T02:17:32.428 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.428 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.428 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:32.428 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290740+0000", 2024-04-19T02:17:32.428 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0046543679999999999 2024-04-19T02:17:32.428 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.428 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.428 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:32.428 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290833+0000", 2024-04-19T02:17:32.428 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2551000000000002e-05 2024-04-19T02:17:32.429 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.429 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.429 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:32.429 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290859+0000", 2024-04-19T02:17:32.429 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.6696999999999999e-05 2024-04-19T02:17:32.429 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.429 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.429 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:32.429 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290881+0000", 2024-04-19T02:17:32.429 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1653000000000001e-05 2024-04-19T02:17:32.429 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:32.429 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:32.429 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:32.429 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.429 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.430 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:77622 5.8 5:166fbe77:::benchmark_data_smithi121_44835_object77621:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:32.430 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:17:32.430 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 65.614750121, 2024-04-19T02:17:32.430 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.021784694, 2024-04-19T02:17:32.430 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:32.430 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:32.430 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:32.430 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:32.430 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:32.430 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 77622 2024-04-19T02:17:32.430 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.430 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:32.430 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.431 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:32.431 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:17:32.431 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:32.431 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.431 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.431 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:32.431 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:17:32.431 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:32.431 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.431 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.431 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:32.432 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805559+0000", 2024-04-19T02:17:32.432 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:32.432 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.432 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.432 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:32.432 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805659+0000", 2024-04-19T02:17:32.432 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.9908000000000006e-05 2024-04-19T02:17:32.432 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.432 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.432 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:32.432 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805668+0000", 2024-04-19T02:17:32.432 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2129999999999997e-06 2024-04-19T02:17:32.433 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.433 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.433 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.433 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805673+0000", 2024-04-19T02:17:32.433 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0370000000000002e-06 2024-04-19T02:17:32.433 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.433 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.433 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:32.434 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812022+0000", 2024-04-19T02:17:32.434 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0063483239999999998 2024-04-19T02:17:32.434 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.434 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.434 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:32.434 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812129+0000", 2024-04-19T02:17:32.434 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010744200000000001 2024-04-19T02:17:32.435 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.435 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.435 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:32.435 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812252+0000", 2024-04-19T02:17:32.435 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000122519 2024-04-19T02:17:32.435 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.436 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.436 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:32.436 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.820979+0000", 2024-04-19T02:17:32.436 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0087272740000000001 2024-04-19T02:17:32.436 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.436 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.436 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:32.437 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827270+0000", 2024-04-19T02:17:32.437 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0062906239999999999 2024-04-19T02:17:32.437 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.437 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.437 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:32.437 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827309+0000", 2024-04-19T02:17:32.438 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9678999999999997e-05 2024-04-19T02:17:32.438 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.438 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.438 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:32.438 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827345+0000", 2024-04-19T02:17:32.438 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5308000000000001e-05 2024-04-19T02:17:32.438 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:32.439 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:32.439 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:32.439 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.439 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.439 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78224 5.4 5:26e797d5:::benchmark_data_smithi121_44835_object78223:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:32.439 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:17:32.439 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 65.313747922000005, 2024-04-19T02:17:32.439 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.021471998999999999, 2024-04-19T02:17:32.440 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:32.440 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:32.440 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:32.440 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:32.440 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:32.440 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78224 2024-04-19T02:17:32.440 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.440 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:32.440 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.441 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:32.441 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:17:32.441 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:32.441 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.441 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.441 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:32.441 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:17:32.442 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:32.442 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.442 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.442 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:32.442 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106561+0000", 2024-04-19T02:17:32.442 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:32.443 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.443 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.443 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:32.443 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106630+0000", 2024-04-19T02:17:32.443 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.8553999999999994e-05 2024-04-19T02:17:32.443 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.443 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.443 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:32.443 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106644+0000", 2024-04-19T02:17:32.443 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.4651000000000001e-05 2024-04-19T02:17:32.443 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.444 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.444 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.444 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106653+0000", 2024-04-19T02:17:32.444 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.6719999999999993e-06 2024-04-19T02:17:32.444 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.444 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.444 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:32.444 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106693+0000", 2024-04-19T02:17:32.444 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9978999999999998e-05 2024-04-19T02:17:32.444 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.444 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.444 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:32.444 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106840+0000", 2024-04-19T02:17:32.444 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0001473 2024-04-19T02:17:32.445 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.445 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.445 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:32.445 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106971+0000", 2024-04-19T02:17:32.445 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013051499999999999 2024-04-19T02:17:32.445 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.445 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.445 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:32.445 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.109047+0000", 2024-04-19T02:17:32.445 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.002076002 2024-04-19T02:17:32.445 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.445 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.445 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:32.445 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.127967+0000", 2024-04-19T02:17:32.446 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.018919780000000001 2024-04-19T02:17:32.446 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.446 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.446 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:32.446 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128004+0000", 2024-04-19T02:17:32.446 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7719000000000003e-05 2024-04-19T02:17:32.446 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.446 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.446 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:32.446 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128034+0000", 2024-04-19T02:17:32.446 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9651000000000001e-05 2024-04-19T02:17:32.446 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:32.446 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:32.447 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:32.447 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.447 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.447 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78259 5.4 5:2aa344b2:::benchmark_data_smithi121_44835_object78258:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:32.447 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:17:32.447 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 65.295052853000001, 2024-04-19T02:17:32.447 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022934350999999999, 2024-04-19T02:17:32.447 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:32.447 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:32.447 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:32.447 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:32.447 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:32.447 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78259 2024-04-19T02:17:32.447 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.448 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:32.448 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.448 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:32.448 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:17:32.448 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:32.448 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.448 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.448 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:32.448 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:17:32.448 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:32.448 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.448 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.448 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:32.448 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125256+0000", 2024-04-19T02:17:32.449 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:32.449 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.449 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.449 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:32.449 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125347+0000", 2024-04-19T02:17:32.449 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0470000000000006e-05 2024-04-19T02:17:32.449 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.449 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.449 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:32.449 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125358+0000", 2024-04-19T02:17:32.449 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1764e-05 2024-04-19T02:17:32.449 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.449 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.449 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.449 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125364+0000", 2024-04-19T02:17:32.450 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7189999999999998e-06 2024-04-19T02:17:32.450 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.450 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.450 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:32.450 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125391+0000", 2024-04-19T02:17:32.450 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7270000000000001e-05 2024-04-19T02:17:32.450 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.450 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.450 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:32.450 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125471+0000", 2024-04-19T02:17:32.451 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9209999999999995e-05 2024-04-19T02:17:32.451 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.451 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.451 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:32.451 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125559+0000", 2024-04-19T02:17:32.451 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.8689000000000004e-05 2024-04-19T02:17:32.451 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.451 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.451 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:32.451 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128164+0000", 2024-04-19T02:17:32.451 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0026050270000000002 2024-04-19T02:17:32.451 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.451 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.451 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:32.451 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148139+0000", 2024-04-19T02:17:32.451 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.019975050000000001 2024-04-19T02:17:32.452 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.452 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.452 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:32.452 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148169+0000", 2024-04-19T02:17:32.452 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0001e-05 2024-04-19T02:17:32.452 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.452 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.452 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:32.452 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148191+0000", 2024-04-19T02:17:32.452 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.2104999999999999e-05 2024-04-19T02:17:32.452 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:32.453 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:32.453 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:32.453 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.453 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.453 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78271 5.4 5:2982d7a6:::benchmark_data_smithi121_44835_object78270:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:32.453 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:17:32.453 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 65.288189622999994, 2024-04-19T02:17:32.453 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020841755999999999, 2024-04-19T02:17:32.453 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:32.453 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:32.453 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:32.453 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:32.454 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:32.454 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78271 2024-04-19T02:17:32.454 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.454 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:32.454 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.454 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:32.454 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:17:32.454 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:32.454 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.454 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.454 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:32.454 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:17:32.454 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:32.455 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.455 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.455 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:32.455 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132119+0000", 2024-04-19T02:17:32.455 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:32.455 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.455 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.455 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:32.455 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132185+0000", 2024-04-19T02:17:32.455 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5994000000000005e-05 2024-04-19T02:17:32.455 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.455 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.455 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:32.455 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132197+0000", 2024-04-19T02:17:32.455 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2091e-05 2024-04-19T02:17:32.456 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.456 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.456 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.456 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132206+0000", 2024-04-19T02:17:32.456 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.5099999999999998e-06 2024-04-19T02:17:32.456 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.456 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.456 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:32.456 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132242+0000", 2024-04-19T02:17:32.456 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5663000000000001e-05 2024-04-19T02:17:32.456 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.456 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.456 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:32.456 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132335+0000", 2024-04-19T02:17:32.456 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3275000000000004e-05 2024-04-19T02:17:32.457 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.457 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.457 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:32.457 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132432+0000", 2024-04-19T02:17:32.457 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7571000000000005e-05 2024-04-19T02:17:32.457 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.457 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.457 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:32.457 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.136706+0000", 2024-04-19T02:17:32.457 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0042738170000000001 2024-04-19T02:17:32.457 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.457 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.457 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:32.457 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152909+0000", 2024-04-19T02:17:32.457 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016202415000000001 2024-04-19T02:17:32.458 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.458 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.458 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:32.458 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152938+0000", 2024-04-19T02:17:32.458 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9740999999999999e-05 2024-04-19T02:17:32.458 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.458 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.458 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:32.458 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152962+0000", 2024-04-19T02:17:32.458 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3659000000000002e-05 2024-04-19T02:17:32.458 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:32.458 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:32.458 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:32.459 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.459 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.459 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78272 5.4 5:273e819a:::benchmark_data_smithi121_44835_object78271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:32.459 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:32.459 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 65.287700580000006, 2024-04-19T02:17:32.459 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022180163999999999, 2024-04-19T02:17:32.459 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:32.459 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:32.459 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:32.459 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:32.459 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:32.459 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78272 2024-04-19T02:17:32.459 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.459 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:32.459 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.460 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:32.460 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:32.460 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:32.460 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.460 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.460 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:32.460 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:32.460 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:32.460 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.460 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.460 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:32.460 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:32.460 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:32.461 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.461 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.461 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:32.461 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132690+0000", 2024-04-19T02:17:32.461 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0963000000000004e-05 2024-04-19T02:17:32.461 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.461 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.461 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:32.461 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132703+0000", 2024-04-19T02:17:32.461 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.3072e-05 2024-04-19T02:17:32.461 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.461 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.461 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.461 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132710+0000", 2024-04-19T02:17:32.462 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3100000000000003e-06 2024-04-19T02:17:32.462 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.462 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.462 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:32.462 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134005+0000", 2024-04-19T02:17:32.462 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001294513 2024-04-19T02:17:32.462 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.462 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.462 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:32.462 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134139+0000", 2024-04-19T02:17:32.462 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000134447 2024-04-19T02:17:32.462 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.462 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.462 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:32.463 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134284+0000", 2024-04-19T02:17:32.463 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014514399999999999 2024-04-19T02:17:32.463 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.463 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.463 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:32.463 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.139622+0000", 2024-04-19T02:17:32.463 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0053373830000000002 2024-04-19T02:17:32.463 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.463 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.464 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:32.464 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154737+0000", 2024-04-19T02:17:32.464 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015115195999999999 2024-04-19T02:17:32.464 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.464 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.464 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:32.464 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154768+0000", 2024-04-19T02:17:32.464 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0824999999999997e-05 2024-04-19T02:17:32.464 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.464 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.464 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:32.464 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154790+0000", 2024-04-19T02:17:32.464 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1999000000000001e-05 2024-04-19T02:17:32.464 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:32.464 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:32.465 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:32.465 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.465 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.465 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:94481 5.e 5:7b2fbebf:::benchmark_data_smithi121_44835_object94480:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:32.465 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:17:32.465 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 57.299064262999998, 2024-04-19T02:17:32.465 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020897846000000001, 2024-04-19T02:17:32.465 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:32.465 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:32.465 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:32.465 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:32.465 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:32.465 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 94481 2024-04-19T02:17:32.465 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.465 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:32.465 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.466 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:32.466 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:17:32.466 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:32.466 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.466 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.466 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:32.466 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:17:32.466 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:32.466 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.466 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.466 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:32.466 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121245+0000", 2024-04-19T02:17:32.466 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:32.466 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.467 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.467 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:32.467 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121273+0000", 2024-04-19T02:17:32.467 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7250000000000002e-05 2024-04-19T02:17:32.467 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.467 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.467 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:32.467 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121277+0000", 2024-04-19T02:17:32.467 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2860000000000001e-06 2024-04-19T02:17:32.467 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.467 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.468 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.468 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121280+0000", 2024-04-19T02:17:32.468 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2739999999999999e-06 2024-04-19T02:17:32.468 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.468 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.468 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:32.468 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121320+0000", 2024-04-19T02:17:32.468 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9879000000000002e-05 2024-04-19T02:17:32.468 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.468 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.468 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:32.468 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121448+0000", 2024-04-19T02:17:32.468 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012748800000000001 2024-04-19T02:17:32.469 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.469 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.469 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:32.469 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121595+0000", 2024-04-19T02:17:32.469 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014741299999999999 2024-04-19T02:17:32.469 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.469 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.469 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:32.469 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.127776+0000", 2024-04-19T02:17:32.469 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0061811360000000003 2024-04-19T02:17:32.469 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.469 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.469 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:32.469 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142073+0000", 2024-04-19T02:17:32.469 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014296959999999999 2024-04-19T02:17:32.470 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.470 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.470 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:32.470 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142106+0000", 2024-04-19T02:17:32.470 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3348e-05 2024-04-19T02:17:32.470 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.470 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.470 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:32.470 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142144+0000", 2024-04-19T02:17:32.470 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7153000000000002e-05 2024-04-19T02:17:32.470 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:32.470 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:32.470 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:32.471 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.471 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.471 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:94581 5.b 5:dc86d6e9:::benchmark_data_smithi121_44835_object94580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:32.471 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:32.471 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 57.240129690000003, 2024-04-19T02:17:32.471 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022099711000000001, 2024-04-19T02:17:32.471 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:32.471 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:32.471 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:32.471 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:32.471 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:32.471 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 94581 2024-04-19T02:17:32.471 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.471 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:32.472 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.472 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:32.472 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:32.472 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:32.472 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.472 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.472 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:32.472 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:32.472 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:32.472 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.472 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.472 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:32.472 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:32.472 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:32.472 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.473 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.473 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:32.473 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180253+0000", 2024-04-19T02:17:32.473 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3163000000000004e-05 2024-04-19T02:17:32.473 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.473 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.473 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:32.473 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180266+0000", 2024-04-19T02:17:32.473 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2886e-05 2024-04-19T02:17:32.473 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.473 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.473 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.473 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180273+0000", 2024-04-19T02:17:32.474 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.4059999999999999e-06 2024-04-19T02:17:32.474 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.474 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.474 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:32.474 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180646+0000", 2024-04-19T02:17:32.474 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00037283999999999999 2024-04-19T02:17:32.474 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.474 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.475 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:32.475 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180774+0000", 2024-04-19T02:17:32.475 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012793799999999999 2024-04-19T02:17:32.475 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.475 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.475 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:32.475 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180920+0000", 2024-04-19T02:17:32.475 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000146692 2024-04-19T02:17:32.475 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.475 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.475 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:32.475 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.183344+0000", 2024-04-19T02:17:32.475 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0024231669999999999 2024-04-19T02:17:32.476 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.476 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.476 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:32.476 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202196+0000", 2024-04-19T02:17:32.476 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.018852384 2024-04-19T02:17:32.476 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.476 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.476 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:32.476 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202241+0000", 2024-04-19T02:17:32.476 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4923999999999999e-05 2024-04-19T02:17:32.476 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.476 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.476 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:32.476 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202280+0000", 2024-04-19T02:17:32.476 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9096e-05 2024-04-19T02:17:32.477 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:32.477 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:32.477 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:32.477 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.477 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.477 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:96356 5.0 5:0a661b39:::benchmark_data_smithi121_44835_object96355:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:32.477 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:17:32.477 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 56.326916848000003, 2024-04-19T02:17:32.477 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020955516, 2024-04-19T02:17:32.477 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:32.477 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:32.477 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:32.477 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:32.477 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:32.478 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 96356 2024-04-19T02:17:32.478 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.478 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:32.478 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.478 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:32.478 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:17:32.478 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:32.478 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.478 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.478 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:32.478 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:17:32.478 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:32.478 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.479 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.479 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:32.479 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:17:32.479 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:32.479 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.479 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.479 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:32.479 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093455+0000", 2024-04-19T02:17:32.479 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.2205000000000005e-05 2024-04-19T02:17:32.479 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.479 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.479 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:32.479 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093464+0000", 2024-04-19T02:17:32.479 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3910000000000004e-06 2024-04-19T02:17:32.480 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.480 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.480 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.480 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093469+0000", 2024-04-19T02:17:32.480 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.7249999999999997e-06 2024-04-19T02:17:32.480 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.480 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.480 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:32.480 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099643+0000", 2024-04-19T02:17:32.480 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0061743359999999999 2024-04-19T02:17:32.480 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.480 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.480 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:32.480 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099774+0000", 2024-04-19T02:17:32.480 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013050599999999999 2024-04-19T02:17:32.481 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.481 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.481 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:32.481 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099917+0000", 2024-04-19T02:17:32.481 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000143187 2024-04-19T02:17:32.481 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.481 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.481 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:32.481 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.105432+0000", 2024-04-19T02:17:32.481 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.005514873 2024-04-19T02:17:32.481 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.482 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.482 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:32.482 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114264+0000", 2024-04-19T02:17:32.482 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.008831752 2024-04-19T02:17:32.482 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.482 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.482 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:32.482 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114300+0000", 2024-04-19T02:17:32.482 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6582000000000003e-05 2024-04-19T02:17:32.482 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.482 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.482 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:32.482 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114349+0000", 2024-04-19T02:17:32.482 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8579999999999999e-05 2024-04-19T02:17:32.483 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:32.483 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:32.483 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:32.483 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.483 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.483 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:96357 5.0 5:00efce8b:::benchmark_data_smithi121_44835_object96356:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:32.483 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:17:32.483 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 56.326837169999997, 2024-04-19T02:17:32.483 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020937471999999999, 2024-04-19T02:17:32.483 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:32.483 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:32.484 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:32.484 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:32.484 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:32.484 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 96357 2024-04-19T02:17:32.484 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.484 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:32.484 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.484 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:32.485 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:17:32.485 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:32.485 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.485 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.485 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:32.485 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:17:32.485 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:32.485 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.485 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.486 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:32.486 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093472+0000", 2024-04-19T02:17:32.486 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:32.486 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.486 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.486 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:32.486 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093513+0000", 2024-04-19T02:17:32.486 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0213000000000003e-05 2024-04-19T02:17:32.486 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.486 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.486 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:32.486 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093519+0000", 2024-04-19T02:17:32.486 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.066e-06 2024-04-19T02:17:32.486 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.487 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.487 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.487 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093525+0000", 2024-04-19T02:17:32.487 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.8170000000000004e-06 2024-04-19T02:17:32.487 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.487 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.487 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:32.487 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103412+0000", 2024-04-19T02:17:32.487 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0098872739999999997 2024-04-19T02:17:32.487 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.487 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.487 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:32.487 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103551+0000", 2024-04-19T02:17:32.487 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000139295 2024-04-19T02:17:32.487 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.488 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.488 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:32.488 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103701+0000", 2024-04-19T02:17:32.488 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014954599999999999 2024-04-19T02:17:32.488 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.488 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.488 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:32.488 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.108849+0000", 2024-04-19T02:17:32.488 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0051487199999999999 2024-04-19T02:17:32.488 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.488 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.488 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:32.488 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114355+0000", 2024-04-19T02:17:32.488 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0055052529999999999 2024-04-19T02:17:32.489 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.489 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.489 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:32.489 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114379+0000", 2024-04-19T02:17:32.489 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4275000000000001e-05 2024-04-19T02:17:32.489 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.489 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.489 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:32.489 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114410+0000", 2024-04-19T02:17:32.489 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1356999999999998e-05 2024-04-19T02:17:32.489 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:32.489 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:32.489 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:32.489 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.490 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.490 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:104431 5.8 5:14818e19:::benchmark_data_smithi121_44835_object104430:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T02:17:32.490 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:17:32.490 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 52.208924645000003, 2024-04-19T02:17:32.490 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022149528000000002, 2024-04-19T02:17:32.490 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:32.490 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:32.490 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:32.490 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:32.490 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:32.490 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 104431 2024-04-19T02:17:32.490 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.490 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:32.490 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.491 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:32.491 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:17:32.491 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:32.491 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.491 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.491 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:32.491 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:17:32.491 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:32.491 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.491 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.491 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:32.491 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211384+0000", 2024-04-19T02:17:32.491 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:32.491 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.491 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.492 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:32.492 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211458+0000", 2024-04-19T02:17:32.492 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3311000000000003e-05 2024-04-19T02:17:32.492 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.492 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.492 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:32.492 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211471+0000", 2024-04-19T02:17:32.492 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.3308e-05 2024-04-19T02:17:32.492 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.492 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.492 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.492 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211479+0000", 2024-04-19T02:17:32.492 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0909999999999993e-06 2024-04-19T02:17:32.492 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.492 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.493 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:32.493 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.221821+0000", 2024-04-19T02:17:32.493 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010341596999999999 2024-04-19T02:17:32.493 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.493 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.493 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:32.493 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.221966+0000", 2024-04-19T02:17:32.493 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000145167 2024-04-19T02:17:32.493 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.493 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.493 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:32.493 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.222077+0000", 2024-04-19T02:17:32.493 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011128000000000001 2024-04-19T02:17:32.493 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.493 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.493 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:32.494 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.228126+0000", 2024-04-19T02:17:32.494 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0060486710000000003 2024-04-19T02:17:32.494 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.494 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.494 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:32.494 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233449+0000", 2024-04-19T02:17:32.494 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0053231370000000004 2024-04-19T02:17:32.494 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.494 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.494 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:32.494 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233498+0000", 2024-04-19T02:17:32.494 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8798999999999998e-05 2024-04-19T02:17:32.494 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.494 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.495 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:32.495 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233535+0000", 2024-04-19T02:17:32.495 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7119000000000002e-05 2024-04-19T02:17:32.495 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:32.495 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:32.495 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:32.495 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.495 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.495 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157437 5.e 5:78833a3d:::benchmark_data_smithi121_44835_object23402:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:32.495 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.859854+0000", 2024-04-19T02:17:32.495 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 25.560455872999999, 2024-04-19T02:17:32.496 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.025859589999999998, 2024-04-19T02:17:32.496 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:32.496 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:32.496 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:32.496 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:32.496 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:32.496 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157437 2024-04-19T02:17:32.496 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.496 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:32.496 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.496 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:32.496 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859854+0000", 2024-04-19T02:17:32.496 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:32.497 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.497 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.497 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:32.497 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859854+0000", 2024-04-19T02:17:32.497 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:32.497 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.497 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.497 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:32.497 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859853+0000", 2024-04-19T02:17:32.497 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:32.497 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.497 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.497 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:32.497 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859857+0000", 2024-04-19T02:17:32.498 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8789999999999996e-06 2024-04-19T02:17:32.498 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.498 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.498 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:32.498 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859865+0000", 2024-04-19T02:17:32.498 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.1880000000000002e-06 2024-04-19T02:17:32.498 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.498 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.498 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.498 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859873+0000", 2024-04-19T02:17:32.498 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.2980000000000003e-06 2024-04-19T02:17:32.498 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.498 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.498 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:32.499 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859908+0000", 2024-04-19T02:17:32.499 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5682999999999997e-05 2024-04-19T02:17:32.499 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.499 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.499 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:32.499 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.860046+0000", 2024-04-19T02:17:32.499 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013714200000000001 2024-04-19T02:17:32.499 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.499 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.499 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:32.499 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.860153+0000", 2024-04-19T02:17:32.499 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010725700000000001 2024-04-19T02:17:32.499 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.499 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.499 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:32.500 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.862008+0000", 2024-04-19T02:17:32.500 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001855179 2024-04-19T02:17:32.500 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.500 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.500 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:32.500 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.885629+0000", 2024-04-19T02:17:32.500 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.023621428 2024-04-19T02:17:32.500 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.500 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.500 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:32.500 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.885676+0000", 2024-04-19T02:17:32.500 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.6371e-05 2024-04-19T02:17:32.500 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.500 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.500 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:32.501 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.885714+0000", 2024-04-19T02:17:32.501 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7907000000000001e-05 2024-04-19T02:17:32.501 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:32.501 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:32.501 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:32.501 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.501 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.501 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157438 5.0 5:01944e77:::benchmark_data_smithi121_44835_object23403:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:32.501 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.864095+0000", 2024-04-19T02:17:32.501 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 25.556214589, 2024-04-19T02:17:32.501 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.032015298999999997, 2024-04-19T02:17:32.501 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:32.501 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:32.501 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:32.502 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:32.502 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:32.502 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157438 2024-04-19T02:17:32.502 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.502 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:32.502 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.502 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:32.502 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864095+0000", 2024-04-19T02:17:32.502 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:32.502 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.502 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.503 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:32.503 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864095+0000", 2024-04-19T02:17:32.503 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:32.503 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.503 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.503 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:32.503 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864094+0000", 2024-04-19T02:17:32.503 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:32.503 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.503 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.503 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:32.503 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864102+0000", 2024-04-19T02:17:32.503 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.6629999999999993e-06 2024-04-19T02:17:32.503 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.503 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.504 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:32.504 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864113+0000", 2024-04-19T02:17:32.504 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1185999999999999e-05 2024-04-19T02:17:32.504 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.504 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.504 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.504 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864119+0000", 2024-04-19T02:17:32.504 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.224e-06 2024-04-19T02:17:32.504 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.504 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.504 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:32.504 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864151+0000", 2024-04-19T02:17:32.504 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1395e-05 2024-04-19T02:17:32.504 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.505 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.505 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:32.505 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864275+0000", 2024-04-19T02:17:32.505 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012431399999999999 2024-04-19T02:17:32.505 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.505 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.505 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:32.505 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864341+0000", 2024-04-19T02:17:32.505 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6146e-05 2024-04-19T02:17:32.505 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.505 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.505 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:32.505 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.866040+0000", 2024-04-19T02:17:32.506 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016991879999999999 2024-04-19T02:17:32.506 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.506 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.506 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:32.506 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896055+0000", 2024-04-19T02:17:32.506 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.030014886000000001 2024-04-19T02:17:32.506 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.506 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.506 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:32.507 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896087+0000", 2024-04-19T02:17:32.507 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1761000000000003e-05 2024-04-19T02:17:32.507 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.507 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.507 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:32.507 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896111+0000", 2024-04-19T02:17:32.507 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3623999999999999e-05 2024-04-19T02:17:32.507 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:32.507 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:32.507 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:32.507 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.507 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.507 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157439 5.e 5:79eb9d3c:::benchmark_data_smithi121_44835_object23404:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:32.507 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:32.507 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 25.556183514000001, 2024-04-19T02:17:32.508 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.027045244, 2024-04-19T02:17:32.508 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:32.508 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:32.508 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:32.508 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:32.508 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:32.508 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157439 2024-04-19T02:17:32.508 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.508 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:32.508 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.508 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:32.508 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:32.508 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:32.508 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.509 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.509 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:32.509 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:32.509 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:32.509 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.509 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.509 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:32.509 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:32.509 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:32.509 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.509 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.509 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:32.509 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864128+0000", 2024-04-19T02:17:32.510 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.911e-06 2024-04-19T02:17:32.510 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.510 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.510 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:32.510 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864136+0000", 2024-04-19T02:17:32.510 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2609999999999993e-06 2024-04-19T02:17:32.510 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.510 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.510 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.510 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864140+0000", 2024-04-19T02:17:32.510 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5530000000000001e-06 2024-04-19T02:17:32.510 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.510 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.511 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:32.511 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864169+0000", 2024-04-19T02:17:32.511 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.8932e-05 2024-04-19T02:17:32.511 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.511 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.511 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:32.511 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864267+0000", 2024-04-19T02:17:32.511 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7969999999999999e-05 2024-04-19T02:17:32.511 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.511 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.511 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:32.511 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864339+0000", 2024-04-19T02:17:32.511 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.2280999999999995e-05 2024-04-19T02:17:32.511 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.511 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.512 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:32.512 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.865763+0000", 2024-04-19T02:17:32.512 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0014236310000000001 2024-04-19T02:17:32.512 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.512 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.512 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:32.512 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.891093+0000", 2024-04-19T02:17:32.512 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.025330571 2024-04-19T02:17:32.512 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.512 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.512 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:32.512 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.891137+0000", 2024-04-19T02:17:32.512 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3980999999999998e-05 2024-04-19T02:17:32.512 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.512 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.513 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:32.513 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.891172+0000", 2024-04-19T02:17:32.513 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4465000000000003e-05 2024-04-19T02:17:32.513 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:32.513 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:32.513 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:32.513 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.513 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.513 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157442 5.0 5:0062b73f:::benchmark_data_smithi121_44835_object23407:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:32.513 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.867065+0000", 2024-04-19T02:17:32.513 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 25.553244864, 2024-04-19T02:17:32.513 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.029165542999999999, 2024-04-19T02:17:32.513 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:32.513 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:32.514 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:32.514 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:32.514 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:32.514 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157442 2024-04-19T02:17:32.514 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.514 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:32.514 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.514 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:32.514 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867065+0000", 2024-04-19T02:17:32.514 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:32.514 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.514 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.514 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:32.514 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867065+0000", 2024-04-19T02:17:32.515 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:32.515 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.515 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.515 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:32.515 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867064+0000", 2024-04-19T02:17:32.515 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:32.515 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.515 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.515 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:32.515 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867069+0000", 2024-04-19T02:17:32.515 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4549999999999997e-06 2024-04-19T02:17:32.515 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.515 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.515 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:32.516 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867080+0000", 2024-04-19T02:17:32.516 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0797e-05 2024-04-19T02:17:32.516 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.516 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.516 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.516 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867088+0000", 2024-04-19T02:17:32.516 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9729999999999997e-06 2024-04-19T02:17:32.516 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.516 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.516 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:32.516 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867121+0000", 2024-04-19T02:17:32.516 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2920000000000003e-05 2024-04-19T02:17:32.516 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.516 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.517 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:32.517 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867203+0000", 2024-04-19T02:17:32.517 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2578999999999997e-05 2024-04-19T02:17:32.517 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.517 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.517 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:32.517 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867386+0000", 2024-04-19T02:17:32.517 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00018237400000000001 2024-04-19T02:17:32.517 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.517 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.517 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:32.517 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.869338+0000", 2024-04-19T02:17:32.518 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0019521160000000001 2024-04-19T02:17:32.518 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.518 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.518 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:32.518 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896150+0000", 2024-04-19T02:17:32.518 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.026812074000000002 2024-04-19T02:17:32.518 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.518 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.518 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:32.518 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896191+0000", 2024-04-19T02:17:32.518 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1192000000000001e-05 2024-04-19T02:17:32.518 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.518 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.518 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:32.519 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896231+0000", 2024-04-19T02:17:32.519 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9764000000000001e-05 2024-04-19T02:17:32.519 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:32.519 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:32.519 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:32.519 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.519 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.519 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157499 5.8 5:1c3aa38a:::benchmark_data_smithi121_44835_object23464:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:32.519 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.913447+0000", 2024-04-19T02:17:32.520 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 25.506863291999998, 2024-04-19T02:17:32.520 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.024508188, 2024-04-19T02:17:32.520 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:32.520 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:32.520 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:32.520 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:32.520 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:32.520 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157499 2024-04-19T02:17:32.520 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.520 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:32.520 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.521 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:32.521 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913447+0000", 2024-04-19T02:17:32.521 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:32.521 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.521 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.521 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:32.521 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913447+0000", 2024-04-19T02:17:32.521 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:32.521 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.521 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.521 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:32.521 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913446+0000", 2024-04-19T02:17:32.521 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:32.521 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.522 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.522 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:32.522 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913451+0000", 2024-04-19T02:17:32.522 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.677e-06 2024-04-19T02:17:32.522 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.522 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.522 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:32.522 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913461+0000", 2024-04-19T02:17:32.522 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.8859999999999999e-06 2024-04-19T02:17:32.522 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.522 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.522 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.522 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913467+0000", 2024-04-19T02:17:32.522 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.0800000000000002e-06 2024-04-19T02:17:32.523 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.523 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.523 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:32.523 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913513+0000", 2024-04-19T02:17:32.523 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.5707000000000001e-05 2024-04-19T02:17:32.523 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.523 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.523 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:32.523 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913637+0000", 2024-04-19T02:17:32.523 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012379200000000001 2024-04-19T02:17:32.523 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.523 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.523 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:32.523 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913747+0000", 2024-04-19T02:17:32.523 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000110071 2024-04-19T02:17:32.524 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.524 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.524 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:32.524 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915674+0000", 2024-04-19T02:17:32.524 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0019270789999999999 2024-04-19T02:17:32.524 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.524 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.524 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:32.524 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937902+0000", 2024-04-19T02:17:32.524 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022228286 2024-04-19T02:17:32.524 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.524 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.524 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:32.524 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937931+0000", 2024-04-19T02:17:32.524 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9122e-05 2024-04-19T02:17:32.525 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.525 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.525 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:32.525 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937955+0000", 2024-04-19T02:17:32.525 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3591000000000002e-05 2024-04-19T02:17:32.525 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:32.525 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:32.525 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:32.525 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.525 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.525 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157500 5.0 5:0969ec74:::benchmark_data_smithi121_44835_object23465:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:32.525 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.913476+0000", 2024-04-19T02:17:32.525 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 25.506834426000001, 2024-04-19T02:17:32.525 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.024497596, 2024-04-19T02:17:32.525 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:32.526 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:32.526 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:32.526 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:32.526 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:32.526 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157500 2024-04-19T02:17:32.526 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.526 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:32.526 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.526 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:32.526 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913476+0000", 2024-04-19T02:17:32.526 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:32.526 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.526 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.526 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:32.527 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913476+0000", 2024-04-19T02:17:32.527 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:32.527 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.527 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.527 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:32.527 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913475+0000", 2024-04-19T02:17:32.527 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:32.527 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.527 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.527 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:32.528 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913478+0000", 2024-04-19T02:17:32.528 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.2670000000000001e-06 2024-04-19T02:17:32.528 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.528 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.528 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:32.528 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913481+0000", 2024-04-19T02:17:32.528 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6899999999999998e-06 2024-04-19T02:17:32.528 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.528 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.528 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.528 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913485+0000", 2024-04-19T02:17:32.528 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1230000000000002e-06 2024-04-19T02:17:32.528 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.528 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.529 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:32.529 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913526+0000", 2024-04-19T02:17:32.529 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.104e-05 2024-04-19T02:17:32.529 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.529 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.529 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:32.529 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913606+0000", 2024-04-19T02:17:32.529 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9510000000000003e-05 2024-04-19T02:17:32.529 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.529 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.529 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:32.529 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913671+0000", 2024-04-19T02:17:32.529 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.4838000000000005e-05 2024-04-19T02:17:32.529 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.529 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.530 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:32.530 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915348+0000", 2024-04-19T02:17:32.530 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016769860000000001 2024-04-19T02:17:32.530 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.530 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.530 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:32.530 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937897+0000", 2024-04-19T02:17:32.530 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022548902999999999 2024-04-19T02:17:32.530 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.530 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.530 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:32.530 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937938+0000", 2024-04-19T02:17:32.530 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1499999999999999e-05 2024-04-19T02:17:32.530 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.531 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.531 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:32.531 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937973+0000", 2024-04-19T02:17:32.531 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5057e-05 2024-04-19T02:17:32.531 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:32.531 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:32.531 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:32.531 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.531 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.531 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157501 5.4 5:26661819:::benchmark_data_smithi121_44835_object23466:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:32.531 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.914839+0000", 2024-04-19T02:17:32.531 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 25.505471132, 2024-04-19T02:17:32.531 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.028504224000000002, 2024-04-19T02:17:32.531 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:32.531 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:32.532 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:32.532 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:32.532 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:32.532 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157501 2024-04-19T02:17:32.532 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.532 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:32.532 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.532 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:32.532 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914839+0000", 2024-04-19T02:17:32.532 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:32.532 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.532 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.532 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:32.532 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914839+0000", 2024-04-19T02:17:32.533 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:32.533 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.533 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.533 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:32.533 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914838+0000", 2024-04-19T02:17:32.533 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:32.533 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.533 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.533 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:32.533 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914841+0000", 2024-04-19T02:17:32.533 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.706e-06 2024-04-19T02:17:32.533 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.534 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.534 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:32.534 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914848+0000", 2024-04-19T02:17:32.534 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.7429999999999996e-06 2024-04-19T02:17:32.534 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.534 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.534 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.534 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914852+0000", 2024-04-19T02:17:32.534 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0810000000000004e-06 2024-04-19T02:17:32.534 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.534 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.534 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:32.534 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914892+0000", 2024-04-19T02:17:32.534 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9957999999999999e-05 2024-04-19T02:17:32.535 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.535 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.535 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:32.535 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915008+0000", 2024-04-19T02:17:32.535 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000116401 2024-04-19T02:17:32.535 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.535 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.535 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:32.535 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915125+0000", 2024-04-19T02:17:32.535 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011622500000000001 2024-04-19T02:17:32.535 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.535 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.535 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:32.535 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916663+0000", 2024-04-19T02:17:32.536 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0015381310000000001 2024-04-19T02:17:32.536 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.536 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.536 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:32.536 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943114+0000", 2024-04-19T02:17:32.536 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.026451125999999998 2024-04-19T02:17:32.536 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.536 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.536 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:32.536 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943245+0000", 2024-04-19T02:17:32.536 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000131645 2024-04-19T02:17:32.536 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.536 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.536 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:32.536 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943343+0000", 2024-04-19T02:17:32.536 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7604999999999998e-05 2024-04-19T02:17:32.537 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:32.537 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:32.537 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:32.537 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.537 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.537 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157507 5.b 5:de8840a2:::benchmark_data_smithi121_44835_object23472:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:32.537 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:32.537 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 25.503906851, 2024-04-19T02:17:32.537 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022544518999999999, 2024-04-19T02:17:32.537 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:32.537 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:32.537 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:32.537 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:32.537 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:32.538 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157507 2024-04-19T02:17:32.538 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.538 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:32.538 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.538 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:32.538 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:32.538 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:32.538 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.538 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.538 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:32.538 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:32.539 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:32.539 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.539 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.539 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:32.539 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:32.539 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:32.539 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.539 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.539 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:32.539 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916406+0000", 2024-04-19T02:17:32.539 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4589999999999998e-06 2024-04-19T02:17:32.539 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.539 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.539 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:32.540 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916415+0000", 2024-04-19T02:17:32.540 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3910000000000004e-06 2024-04-19T02:17:32.540 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.540 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.540 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.540 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916421+0000", 2024-04-19T02:17:32.540 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.6130000000000003e-06 2024-04-19T02:17:32.540 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.540 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.540 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:32.540 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916448+0000", 2024-04-19T02:17:32.540 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7277999999999999e-05 2024-04-19T02:17:32.540 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.540 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.540 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:32.541 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916539+0000", 2024-04-19T02:17:32.541 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0855999999999999e-05 2024-04-19T02:17:32.541 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.541 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.541 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:32.541 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916605+0000", 2024-04-19T02:17:32.541 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6141000000000003e-05 2024-04-19T02:17:32.541 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.541 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.541 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:32.541 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918276+0000", 2024-04-19T02:17:32.541 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001670726 2024-04-19T02:17:32.541 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.541 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.541 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:32.542 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.938888+0000", 2024-04-19T02:17:32.542 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020612042000000001 2024-04-19T02:17:32.542 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.542 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.542 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:32.542 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.938924+0000", 2024-04-19T02:17:32.542 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5692999999999999e-05 2024-04-19T02:17:32.542 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.542 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.542 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:32.542 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.938948+0000", 2024-04-19T02:17:32.542 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3879e-05 2024-04-19T02:17:32.542 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:32.542 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:32.543 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:32.543 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.543 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.543 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157509 5.8 5:1dca85d0:::benchmark_data_smithi121_44835_object23474:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:32.543 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:32.543 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 25.501478604999999, 2024-04-19T02:17:32.543 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.024511807, 2024-04-19T02:17:32.543 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:32.543 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:32.543 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:32.543 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:32.543 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:32.543 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157509 2024-04-19T02:17:32.544 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.544 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:32.544 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.544 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:32.544 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:32.544 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:32.544 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.544 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.544 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:32.544 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:32.544 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:32.544 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.544 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.544 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:32.544 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:32.545 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:32.545 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.545 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.545 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:32.545 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918834+0000", 2024-04-19T02:17:32.545 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9409999999999999e-06 2024-04-19T02:17:32.545 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.545 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.545 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:32.545 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918859+0000", 2024-04-19T02:17:32.545 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.5245999999999999e-05 2024-04-19T02:17:32.545 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.545 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.545 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.545 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918864+0000", 2024-04-19T02:17:32.546 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.1819999999999997e-06 2024-04-19T02:17:32.546 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.546 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.546 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:32.546 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918900+0000", 2024-04-19T02:17:32.546 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5327000000000002e-05 2024-04-19T02:17:32.546 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.546 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.546 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:32.546 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.919024+0000", 2024-04-19T02:17:32.546 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012400900000000001 2024-04-19T02:17:32.546 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.546 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.546 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:32.546 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.919136+0000", 2024-04-19T02:17:32.547 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000111987 2024-04-19T02:17:32.547 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.547 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.547 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:32.547 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.922096+0000", 2024-04-19T02:17:32.547 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0029607079999999998 2024-04-19T02:17:32.547 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.547 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.547 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:32.547 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943120+0000", 2024-04-19T02:17:32.547 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.021023995 2024-04-19T02:17:32.547 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.547 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.547 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:32.547 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943255+0000", 2024-04-19T02:17:32.548 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013502100000000001 2024-04-19T02:17:32.548 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:32.548 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:32.548 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:32.548 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943343+0000", 2024-04-19T02:17:32.548 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.7931999999999998e-05 2024-04-19T02:17:32.548 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:32.548 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:32.548 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:32.548 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:32.549 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:32.549 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:17:32.550 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:32.549+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:32.550 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:32.650 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:32.651+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:32.720 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:32.720 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:17:32.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.720 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:226024 5.9 5:9ed9783c:::benchmark_data_smithi121_44835_object91989:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T02:17:32.720 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:32.712601+0000", 2024-04-19T02:17:32.720 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.007145439, 2024-04-19T02:17:32.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0071645349999999997, 2024-04-19T02:17:32.720 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:32.720 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:32.721 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:32.721 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:32.721 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:32.721 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 226024 2024-04-19T02:17:32.721 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.721 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:32.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.721 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:32.721 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.712601+0000", 2024-04-19T02:17:32.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:32.721 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:32.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.712601+0000", 2024-04-19T02:17:32.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:32.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:32.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.712601+0000", 2024-04-19T02:17:32.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:32.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:32.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.712605+0000", 2024-04-19T02:17:32.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.98e-06 2024-04-19T02:17:32.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:32.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.712613+0000", 2024-04-19T02:17:32.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6670000000000002e-06 2024-04-19T02:17:32.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.712620+0000", 2024-04-19T02:17:32.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6959999999999999e-06 2024-04-19T02:17:32.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:32.724 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.712650+0000", 2024-04-19T02:17:32.724 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0286000000000001e-05 2024-04-19T02:17:32.724 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.724 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.724 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:32.724 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.712763+0000", 2024-04-19T02:17:32.724 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011295599999999999 2024-04-19T02:17:32.724 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.724 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.724 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:32.724 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.712870+0000", 2024-04-19T02:17:32.725 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010692 2024-04-19T02:17:32.725 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.725 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.725 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:32.725 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.717794+0000", 2024-04-19T02:17:32.725 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0049240439999999998 2024-04-19T02:17:32.725 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:32.725 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:32.725 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:32.725 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.725 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.725 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:226029 5.d 5:bc8b4639:::benchmark_data_smithi121_44835_object91994:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T02:17:32.726 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:32.715165+0000", 2024-04-19T02:17:32.726 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0045822049999999998, 2024-04-19T02:17:32.726 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0046807259999999996, 2024-04-19T02:17:32.726 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:32.726 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:32.726 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:32.726 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:32.726 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:32.726 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 226029 2024-04-19T02:17:32.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.726 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:32.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.727 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:32.727 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.715165+0000", 2024-04-19T02:17:32.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:32.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.727 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:32.727 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.715165+0000", 2024-04-19T02:17:32.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:32.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.727 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:32.727 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.715164+0000", 2024-04-19T02:17:32.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:32.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.728 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.728 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:32.728 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.715169+0000", 2024-04-19T02:17:32.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8380000000000001e-06 2024-04-19T02:17:32.728 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.728 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.728 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:32.728 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.715178+0000", 2024-04-19T02:17:32.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9490000000000002e-06 2024-04-19T02:17:32.728 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.728 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.728 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.728 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.715183+0000", 2024-04-19T02:17:32.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.446e-06 2024-04-19T02:17:32.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:32.729 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.715219+0000", 2024-04-19T02:17:32.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5871999999999998e-05 2024-04-19T02:17:32.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:32.729 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.715303+0000", 2024-04-19T02:17:32.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4332999999999994e-05 2024-04-19T02:17:32.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:32.729 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.715367+0000", 2024-04-19T02:17:32.730 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3733999999999997e-05 2024-04-19T02:17:32.730 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.730 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.730 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:32.730 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.718123+0000", 2024-04-19T02:17:32.730 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027558690000000002 2024-04-19T02:17:32.730 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:32.730 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:32.730 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:32.730 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.730 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.730 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:226030 5.5 5:a85bf3e5:::benchmark_data_smithi121_44835_object91995:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T02:17:32.730 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:32.715191+0000", 2024-04-19T02:17:32.730 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00455618, 2024-04-19T02:17:32.730 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.004742947, 2024-04-19T02:17:32.731 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:32.731 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:32.731 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:32.731 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:32.731 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:32.731 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 226030 2024-04-19T02:17:32.731 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.731 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:32.731 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.731 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:32.731 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.715191+0000", 2024-04-19T02:17:32.731 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:32.731 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.731 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.731 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:32.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.715191+0000", 2024-04-19T02:17:32.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:32.732 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.732 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.732 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:32.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.715190+0000", 2024-04-19T02:17:32.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:32.732 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.732 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.732 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:32.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.715193+0000", 2024-04-19T02:17:32.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5179999999999999e-06 2024-04-19T02:17:32.732 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.732 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.732 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:32.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.715199+0000", 2024-04-19T02:17:32.733 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9970000000000004e-06 2024-04-19T02:17:32.733 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.733 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.733 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.715204+0000", 2024-04-19T02:17:32.733 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0520000000000001e-06 2024-04-19T02:17:32.733 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.733 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:32.733 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.715235+0000", 2024-04-19T02:17:32.733 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0772999999999998e-05 2024-04-19T02:17:32.733 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.733 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:32.733 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.715354+0000", 2024-04-19T02:17:32.734 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011923599999999999 2024-04-19T02:17:32.734 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:32.734 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:32.734 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:32.734 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.734 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.734 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:226031 5.2 5:41cfdf8d:::benchmark_data_smithi121_44835_object91996:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T02:17:32.734 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:32.715217+0000", 2024-04-19T02:17:32.734 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0045296440000000002, 2024-04-19T02:17:32.734 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047670580000000002, 2024-04-19T02:17:32.734 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:32.734 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:32.734 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:32.735 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:32.735 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:32.735 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 226031 2024-04-19T02:17:32.735 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.735 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:32.735 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.735 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:32.735 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.715217+0000", 2024-04-19T02:17:32.736 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:32.736 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.736 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.736 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:32.736 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.715217+0000", 2024-04-19T02:17:32.736 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:32.736 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.736 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.736 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:32.736 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.715217+0000", 2024-04-19T02:17:32.736 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:32.736 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.736 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.737 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:32.737 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.715219+0000", 2024-04-19T02:17:32.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.491e-06 2024-04-19T02:17:32.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.737 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.737 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:32.737 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.715227+0000", 2024-04-19T02:17:32.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3900000000000004e-06 2024-04-19T02:17:32.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.737 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.737 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.737 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.715232+0000", 2024-04-19T02:17:32.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2410000000000003e-06 2024-04-19T02:17:32.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.738 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:32.738 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.715262+0000", 2024-04-19T02:17:32.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9810000000000001e-05 2024-04-19T02:17:32.738 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.738 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:32.738 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.715375+0000", 2024-04-19T02:17:32.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011298099999999999 2024-04-19T02:17:32.738 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:32.738 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:32.738 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:32.738 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.739 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:226034 5.c 5:3ef97ba9:::benchmark_data_smithi121_44835_object91999:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T02:17:32.739 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:32.717516+0000", 2024-04-19T02:17:32.739 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.002231163, 2024-04-19T02:17:32.739 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0025302269999999999, 2024-04-19T02:17:32.739 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:32.739 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:32.739 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:32.739 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:32.739 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:32.739 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 226034 2024-04-19T02:17:32.739 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.739 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:32.739 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.739 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:32.740 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.717516+0000", 2024-04-19T02:17:32.740 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:32.740 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.740 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.740 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:32.740 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.717516+0000", 2024-04-19T02:17:32.740 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:32.740 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.740 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.740 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:32.740 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.717515+0000", 2024-04-19T02:17:32.740 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:32.740 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.740 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.741 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:32.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.717519+0000", 2024-04-19T02:17:32.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9500000000000003e-06 2024-04-19T02:17:32.741 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.741 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:32.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.717527+0000", 2024-04-19T02:17:32.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7430000000000002e-06 2024-04-19T02:17:32.741 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.741 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.717531+0000", 2024-04-19T02:17:32.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4689999999999999e-06 2024-04-19T02:17:32.741 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.742 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:32.742 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.717562+0000", 2024-04-19T02:17:32.742 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0936999999999999e-05 2024-04-19T02:17:32.742 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.742 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.742 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:32.742 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.717685+0000", 2024-04-19T02:17:32.742 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000123161 2024-04-19T02:17:32.742 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:32.742 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:32.742 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:32.742 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.742 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.742 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:226035 5.2 5:435a14b4:::benchmark_data_smithi121_44835_object92000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T02:17:32.743 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:32.717539+0000", 2024-04-19T02:17:32.743 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0022082320000000001, 2024-04-19T02:17:32.743 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0025541769999999999, 2024-04-19T02:17:32.743 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:32.743 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:32.743 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:32.743 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:32.743 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:32.743 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 226035 2024-04-19T02:17:32.743 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.743 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:32.743 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.743 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:32.744 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.717539+0000", 2024-04-19T02:17:32.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:32.744 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:32.744 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.717539+0000", 2024-04-19T02:17:32.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:32.744 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:32.744 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.717538+0000", 2024-04-19T02:17:32.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:32.744 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:32.745 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.717540+0000", 2024-04-19T02:17:32.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.108e-06 2024-04-19T02:17:32.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.745 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:32.745 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.717546+0000", 2024-04-19T02:17:32.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9889999999999997e-06 2024-04-19T02:17:32.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.745 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.746 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.717550+0000", 2024-04-19T02:17:32.746 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6059999999999999e-06 2024-04-19T02:17:32.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.746 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:32.746 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.717586+0000", 2024-04-19T02:17:32.746 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6585999999999998e-05 2024-04-19T02:17:32.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.746 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:32.746 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.717693+0000", 2024-04-19T02:17:32.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010623799999999999 2024-04-19T02:17:32.747 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:32.747 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:32.747 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:32.747 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.747 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:226037 5.f 5:f8105fea:::benchmark_data_smithi121_44835_object92002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T02:17:32.747 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:32.717557+0000", 2024-04-19T02:17:32.747 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0021898460000000001, 2024-04-19T02:17:32.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0025776950000000001, 2024-04-19T02:17:32.747 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:32.747 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:32.747 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:32.747 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:32.748 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:32.748 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 226037 2024-04-19T02:17:32.748 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.748 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:32.748 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.748 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:32.748 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.717557+0000", 2024-04-19T02:17:32.748 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:32.748 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.748 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.748 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:32.748 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.717557+0000", 2024-04-19T02:17:32.748 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:32.748 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.748 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.749 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:32.749 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.717557+0000", 2024-04-19T02:17:32.749 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:32.749 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.749 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:32.749 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.717559+0000", 2024-04-19T02:17:32.749 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0470000000000001e-06 2024-04-19T02:17:32.749 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.749 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:32.749 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.717563+0000", 2024-04-19T02:17:32.749 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0439999999999997e-06 2024-04-19T02:17:32.749 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.750 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.750 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.717566+0000", 2024-04-19T02:17:32.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8710000000000001e-06 2024-04-19T02:17:32.750 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.750 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:32.750 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.717594+0000", 2024-04-19T02:17:32.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8546000000000001e-05 2024-04-19T02:17:32.750 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.750 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:32.750 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.717691+0000", 2024-04-19T02:17:32.751 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7099e-05 2024-04-19T02:17:32.751 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.751 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:32.751 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.717795+0000", 2024-04-19T02:17:32.751 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000103661 2024-04-19T02:17:32.751 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:32.751 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:32.751 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:32.751 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.751 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:226038 5.5 5:ae68acd2:::benchmark_data_smithi121_44835_object92003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T02:17:32.751 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:32.717660+0000", 2024-04-19T02:17:32.751 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.002086447, 2024-04-19T02:17:32.751 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002529758, 2024-04-19T02:17:32.752 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:32.752 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:32.752 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:32.752 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:32.752 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:32.752 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 226038 2024-04-19T02:17:32.752 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.752 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:32.752 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.752 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:32.752 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.717660+0000", 2024-04-19T02:17:32.752 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:32.752 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.752 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.753 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:32.753 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.717660+0000", 2024-04-19T02:17:32.753 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:32.753 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.753 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.753 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:32.753 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.717660+0000", 2024-04-19T02:17:32.753 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:32.753 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.753 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.753 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:32.753 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.717664+0000", 2024-04-19T02:17:32.753 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1470000000000003e-06 2024-04-19T02:17:32.753 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.753 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.754 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:32.754 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.717672+0000", 2024-04-19T02:17:32.754 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1550000000000007e-06 2024-04-19T02:17:32.754 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.754 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.754 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.754 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.717678+0000", 2024-04-19T02:17:32.754 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4479999999999999e-06 2024-04-19T02:17:32.754 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.754 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.754 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:32.754 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.717712+0000", 2024-04-19T02:17:32.754 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3899999999999997e-05 2024-04-19T02:17:32.755 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.755 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:32.755 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.717819+0000", 2024-04-19T02:17:32.755 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010696699999999999 2024-04-19T02:17:32.755 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:32.755 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:32.755 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:32.755 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.755 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:226039 5.6 5:66fb7f45:::benchmark_data_smithi121_44835_object92004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T02:17:32.755 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:32.717766+0000", 2024-04-19T02:17:32.755 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0019806889999999999, 2024-04-19T02:17:32.755 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0024640199999999999, 2024-04-19T02:17:32.755 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:32.756 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:32.756 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:32.756 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:32.756 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:32.756 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 226039 2024-04-19T02:17:32.756 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.756 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:32.756 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.756 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:32.756 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.717766+0000", 2024-04-19T02:17:32.756 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:32.757 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.757 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.757 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:32.757 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.717766+0000", 2024-04-19T02:17:32.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:32.757 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.757 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.757 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:32.757 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.717765+0000", 2024-04-19T02:17:32.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:32.757 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.757 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.757 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:32.757 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.717769+0000", 2024-04-19T02:17:32.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.382e-06 2024-04-19T02:17:32.758 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.758 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.758 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:32.758 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.717776+0000", 2024-04-19T02:17:32.758 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9949999999999999e-06 2024-04-19T02:17:32.758 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.758 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.758 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.758 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.717782+0000", 2024-04-19T02:17:32.758 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9839999999999998e-06 2024-04-19T02:17:32.758 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.758 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.758 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:32.759 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.717825+0000", 2024-04-19T02:17:32.759 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3339e-05 2024-04-19T02:17:32.759 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.759 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.759 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:32.759 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.717944+0000", 2024-04-19T02:17:32.759 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011854999999999999 2024-04-19T02:17:32.759 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:32.759 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:32.759 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:32.759 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.759 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.759 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:226041 5.9 5.46870719 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T02:17:32.759 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:32.719788+0000", 2024-04-19T02:17:32.760 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9999585, 2024-04-19T02:17:32.760 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00047944399999999999, 2024-04-19T02:17:32.760 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:32.760 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-04-19T02:17:32.760 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:32.760 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:32.760 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:32.760 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 226041 2024-04-19T02:17:32.760 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.760 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:32.760 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.760 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:32.760 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.719788+0000", 2024-04-19T02:17:32.760 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:32.760 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.761 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.761 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:32.761 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.719788+0000", 2024-04-19T02:17:32.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:32.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.761 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.761 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:32.761 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.719787+0000", 2024-04-19T02:17:32.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:32.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.761 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.761 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:32.761 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.719793+0000", 2024-04-19T02:17:32.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2750000000000003e-06 2024-04-19T02:17:32.762 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.762 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:32.762 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.719806+0000", 2024-04-19T02:17:32.762 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2914999999999999e-05 2024-04-19T02:17:32.762 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.762 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.762 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.719814+0000", 2024-04-19T02:17:32.762 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2379999999999997e-06 2024-04-19T02:17:32.762 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:32.762 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:32.762 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:32.762 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.763 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.763 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:226042 5.c 5:33c45d2c:::benchmark_data_smithi121_44835_object92007:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T02:17:32.763 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:32.719822+0000", 2024-04-19T02:17:32.763 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9999251, 2024-04-19T02:17:32.763 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00047912299999999997, 2024-04-19T02:17:32.763 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:32.763 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:32.763 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:32.763 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:32.763 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:32.763 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 226042 2024-04-19T02:17:32.763 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.763 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:32.764 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.764 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:32.764 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.719822+0000", 2024-04-19T02:17:32.764 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:32.764 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.764 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.764 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:32.764 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.719822+0000", 2024-04-19T02:17:32.764 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:32.764 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.764 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.764 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:32.764 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.719821+0000", 2024-04-19T02:17:32.764 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:32.765 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.765 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.765 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:32.765 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.719824+0000", 2024-04-19T02:17:32.765 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.137e-06 2024-04-19T02:17:32.765 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.765 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.765 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:32.765 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.719835+0000", 2024-04-19T02:17:32.765 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1385e-05 2024-04-19T02:17:32.765 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.765 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.765 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.766 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.719841+0000", 2024-04-19T02:17:32.766 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6799999999999998e-06 2024-04-19T02:17:32.766 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.766 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:32.766 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.719885+0000", 2024-04-19T02:17:32.766 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4579000000000001e-05 2024-04-19T02:17:32.766 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.766 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:32.766 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.720018+0000", 2024-04-19T02:17:32.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013283500000000001 2024-04-19T02:17:32.767 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:32.767 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:32.767 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:32.767 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.767 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:226044 5.f 5:fd1098d0:::benchmark_data_smithi121_44835_object92009:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T02:17:32.767 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:32.719850+0000", 2024-04-19T02:17:32.767 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.999897, 2024-04-19T02:17:32.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00048891600000000005, 2024-04-19T02:17:32.767 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:32.767 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:32.768 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:32.768 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:32.768 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:32.768 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 226044 2024-04-19T02:17:32.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.768 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:32.768 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.768 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:32.768 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.719850+0000", 2024-04-19T02:17:32.768 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:32.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.768 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.768 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:32.768 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.719850+0000", 2024-04-19T02:17:32.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:32.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.769 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:32.769 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.719849+0000", 2024-04-19T02:17:32.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:32.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.769 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:32.769 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.719852+0000", 2024-04-19T02:17:32.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.401e-06 2024-04-19T02:17:32.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.770 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:32.770 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.719859+0000", 2024-04-19T02:17:32.770 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6149999999999999e-06 2024-04-19T02:17:32.770 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.770 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.770 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.770 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.719866+0000", 2024-04-19T02:17:32.770 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2079999999999997e-06 2024-04-19T02:17:32.770 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.770 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.770 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:32.770 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.719948+0000", 2024-04-19T02:17:32.770 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2744999999999995e-05 2024-04-19T02:17:32.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.771 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.771 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:32.771 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.720047+0000", 2024-04-19T02:17:32.771 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8548999999999994e-05 2024-04-19T02:17:32.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.771 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.771 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:32.771 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.720114+0000", 2024-04-19T02:17:32.771 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7331999999999998e-05 2024-04-19T02:17:32.771 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:32.771 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:32.771 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:32.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.771 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.772 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:226045 5.2 5:49b5f84c:::benchmark_data_smithi121_44835_object92010:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T02:17:32.772 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:32.719881+0000", 2024-04-19T02:17:32.772 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.999866, 2024-04-19T02:17:32.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00049874999999999995, 2024-04-19T02:17:32.772 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:32.772 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:32.772 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:32.772 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:32.772 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:32.772 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 226045 2024-04-19T02:17:32.772 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.772 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:32.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.772 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:32.772 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.719881+0000", 2024-04-19T02:17:32.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:32.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:32.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.719881+0000", 2024-04-19T02:17:32.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:32.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:32.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.719880+0000", 2024-04-19T02:17:32.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:32.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:32.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.719884+0000", 2024-04-19T02:17:32.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2100000000000002e-06 2024-04-19T02:17:32.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:32.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.719890+0000", 2024-04-19T02:17:32.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7530000000000004e-06 2024-04-19T02:17:32.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.719896+0000", 2024-04-19T02:17:32.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.626e-06 2024-04-19T02:17:32.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:32.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.719930+0000", 2024-04-19T02:17:32.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3593000000000002e-05 2024-04-19T02:17:32.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:32.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.720047+0000", 2024-04-19T02:17:32.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117114 2024-04-19T02:17:32.776 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:32.776 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:32.776 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:32.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.776 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4549.0:226037 5.f e60/16)", 2024-04-19T02:17:32.776 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:32.719944+0000", 2024-04-19T02:17:32.776 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9998026, 2024-04-19T02:17:32.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00047036499999999999, 2024-04-19T02:17:32.776 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:32.776 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-04-19T02:17:32.776 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:32.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.776 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:32.777 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.719944+0000", 2024-04-19T02:17:32.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:32.777 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.777 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.777 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:32.777 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.719944+0000", 2024-04-19T02:17:32.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:32.777 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.777 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.777 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:32.777 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.719944+0000", 2024-04-19T02:17:32.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:32.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:32.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.719948+0000", 2024-04-19T02:17:32.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2239999999999997e-06 2024-04-19T02:17:32.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:32.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.719956+0000", 2024-04-19T02:17:32.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0509999999999997e-06 2024-04-19T02:17:32.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.779 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.719962+0000", 2024-04-19T02:17:32.779 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8000000000000004e-06 2024-04-19T02:17:32.779 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:32.779 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:32.779 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:32.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.779 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:226046 5.7 5.c84a567 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T02:17:32.779 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:32.719985+0000", 2024-04-19T02:17:32.779 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9997616, 2024-04-19T02:17:32.779 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00046018099999999999, 2024-04-19T02:17:32.780 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:32.780 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-04-19T02:17:32.780 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:32.780 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:32.780 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:32.780 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 226046 2024-04-19T02:17:32.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.780 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:32.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.780 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:32.780 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.719985+0000", 2024-04-19T02:17:32.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:32.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.781 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:32.781 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.719985+0000", 2024-04-19T02:17:32.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:32.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.781 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:32.781 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.719984+0000", 2024-04-19T02:17:32.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:32.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.781 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:32.781 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.719988+0000", 2024-04-19T02:17:32.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4869999999999998e-06 2024-04-19T02:17:32.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.782 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:32.782 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.719995+0000", 2024-04-19T02:17:32.782 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1010000000000003e-06 2024-04-19T02:17:32.782 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:32.782 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:32.782 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:32.782 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:32.720001+0000", 2024-04-19T02:17:32.782 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9329999999999998e-06 2024-04-19T02:17:32.782 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:32.782 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:32.782 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:32.783 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:32.783 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-04-19T02:17:32.783 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 15 2024-04-19T02:17:32.783 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:32.784 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:32.784+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:32.785 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:32.885 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:32.885+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:32.959 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:32.959 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-04-19T02:17:32.959 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-04-19T02:17:32.960 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-04-19T02:17:32.960 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:32.974 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:33.018 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:33.018+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:33.088 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:33.087+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:33.148 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:33.148 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-04-19T02:17:33.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-04-19T02:17:33.148 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:17:33.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.148 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:33.149 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:17:33.149 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 123.876404225, 2024-04-19T02:17:33.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022007204999999998, 2024-04-19T02:17:33.149 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:33.149 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:33.149 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:33.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:33.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:17:33.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:33.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:33.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:17:33.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:33.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:33.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269990+0000", 2024-04-19T02:17:33.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:33.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:33.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269999+0000", 2024-04-19T02:17:33.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9539999999999993e-06 2024-04-19T02:17:33.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:33.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270006+0000", 2024-04-19T02:17:33.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.216e-06 2024-04-19T02:17:33.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:33.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270012+0000", 2024-04-19T02:17:33.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5049999999999998e-06 2024-04-19T02:17:33.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:33.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270058+0000", 2024-04-19T02:17:33.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.634e-05 2024-04-19T02:17:33.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:33.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270064+0000", 2024-04-19T02:17:33.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0669999999999997e-06 2024-04-19T02:17:33.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:33.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287159+0000", 2024-04-19T02:17:33.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017095086999999998 2024-04-19T02:17:33.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:33.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287254+0000", 2024-04-19T02:17:33.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4716000000000006e-05 2024-04-19T02:17:33.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:33.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287389+0000", 2024-04-19T02:17:33.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013511900000000001 2024-04-19T02:17:33.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:33.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290481+0000", 2024-04-19T02:17:33.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030920169999999999 2024-04-19T02:17:33.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:33.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291931+0000", 2024-04-19T02:17:33.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001450118 2024-04-19T02:17:33.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:33.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291960+0000", 2024-04-19T02:17:33.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9096000000000001e-05 2024-04-19T02:17:33.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:33.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291998+0000", 2024-04-19T02:17:33.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7514e-05 2024-04-19T02:17:33.154 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:33.154 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:33.154 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:33.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.154 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:33.155 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:17:33.155 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 123.876293449, 2024-04-19T02:17:33.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020837887999999999, 2024-04-19T02:17:33.155 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:33.155 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:33.155 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:33.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:33.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:17:33.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:33.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:33.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:17:33.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:33.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:33.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:17:33.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:33.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:33.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270109+0000", 2024-04-19T02:17:33.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3110000000000006e-06 2024-04-19T02:17:33.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:33.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270117+0000", 2024-04-19T02:17:33.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0479999999999999e-06 2024-04-19T02:17:33.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:33.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270123+0000", 2024-04-19T02:17:33.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5500000000000002e-06 2024-04-19T02:17:33.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:33.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270150+0000", 2024-04-19T02:17:33.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7712000000000002e-05 2024-04-19T02:17:33.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:33.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270153+0000", 2024-04-19T02:17:33.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6089999999999999e-06 2024-04-19T02:17:33.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:33.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285958+0000", 2024-04-19T02:17:33.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015805274000000001 2024-04-19T02:17:33.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:33.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286126+0000", 2024-04-19T02:17:33.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016765700000000001 2024-04-19T02:17:33.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:33.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286296+0000", 2024-04-19T02:17:33.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017007 2024-04-19T02:17:33.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:33.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290426+0000", 2024-04-19T02:17:33.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041299839999999997 2024-04-19T02:17:33.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:33.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290867+0000", 2024-04-19T02:17:33.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00044083300000000001 2024-04-19T02:17:33.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:33.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290900+0000", 2024-04-19T02:17:33.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3380000000000002e-05 2024-04-19T02:17:33.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:33.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290939+0000", 2024-04-19T02:17:33.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8970000000000001e-05 2024-04-19T02:17:33.160 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:33.160 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:33.160 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:33.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.161 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:21 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:33.161 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:17:33.161 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 123.876204777, 2024-04-19T02:17:33.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020833187999999999, 2024-04-19T02:17:33.161 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:33.161 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:33.161 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:33.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:33.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:17:33.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:33.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:33.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:17:33.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:33.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:33.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270189+0000", 2024-04-19T02:17:33.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:33.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:33.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270192+0000", 2024-04-19T02:17:33.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7549999999999999e-06 2024-04-19T02:17:33.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:33.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270198+0000", 2024-04-19T02:17:33.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0859999999999998e-06 2024-04-19T02:17:33.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:33.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270204+0000", 2024-04-19T02:17:33.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1970000000000004e-06 2024-04-19T02:17:33.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:33.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270238+0000", 2024-04-19T02:17:33.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4282000000000001e-05 2024-04-19T02:17:33.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.164 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:33.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270240+0000", 2024-04-19T02:17:33.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3099999999999999e-06 2024-04-19T02:17:33.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.164 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:33.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287131+0000", 2024-04-19T02:17:33.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01689104 2024-04-19T02:17:33.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.164 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:33.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287262+0000", 2024-04-19T02:17:33.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130347 2024-04-19T02:17:33.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:33.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291023+0000", 2024-04-19T02:17:33.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037616350000000002 2024-04-19T02:17:33.165 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:33.165 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:33.165 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:33.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.165 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:94468 5.2 5:4f406431:::benchmark_data_smithi121_44835_object94467:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T02:17:33.165 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:17:33.165 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 58.034965595000003, 2024-04-19T02:17:33.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024835144999999999, 2024-04-19T02:17:33.165 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:33.165 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:33.165 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:33.166 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:33.166 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:33.166 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 94468 2024-04-19T02:17:33.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.166 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:33.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:33.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:17:33.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:33.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:33.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:17:33.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:33.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:33.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:17:33.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:33.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:33.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111498+0000", 2024-04-19T02:17:33.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9529000000000005e-05 2024-04-19T02:17:33.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:33.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111506+0000", 2024-04-19T02:17:33.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9030000000000004e-06 2024-04-19T02:17:33.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:33.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111513+0000", 2024-04-19T02:17:33.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8759999999999999e-06 2024-04-19T02:17:33.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:33.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112466+0000", 2024-04-19T02:17:33.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00095318499999999995 2024-04-19T02:17:33.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:33.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112590+0000", 2024-04-19T02:17:33.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012380900000000001 2024-04-19T02:17:33.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:33.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112728+0000", 2024-04-19T02:17:33.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013753800000000001 2024-04-19T02:17:33.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:33.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115064+0000", 2024-04-19T02:17:33.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002336819 2024-04-19T02:17:33.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:33.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136207+0000", 2024-04-19T02:17:33.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021142942000000001 2024-04-19T02:17:33.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:33.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136241+0000", 2024-04-19T02:17:33.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3577000000000001e-05 2024-04-19T02:17:33.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:33.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136264+0000", 2024-04-19T02:17:33.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3421000000000002e-05 2024-04-19T02:17:33.170 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:33.170 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:33.170 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:33.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.170 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:94472 5.2 5:45b7e9be:::benchmark_data_smithi121_44835_object94471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:33.171 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:17:33.171 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 58.031319064000002, 2024-04-19T02:17:33.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021273843000000001, 2024-04-19T02:17:33.171 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:33.171 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:33.171 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:33.171 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:33.171 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:33.171 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 94472 2024-04-19T02:17:33.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.171 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:33.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:33.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:17:33.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:33.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:33.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:17:33.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:33.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:33.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115075+0000", 2024-04-19T02:17:33.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:33.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:33.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115161+0000", 2024-04-19T02:17:33.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6632000000000007e-05 2024-04-19T02:17:33.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:33.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115171+0000", 2024-04-19T02:17:33.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2969999999999992e-06 2024-04-19T02:17:33.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:33.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115178+0000", 2024-04-19T02:17:33.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7610000000000007e-06 2024-04-19T02:17:33.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:33.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115213+0000", 2024-04-19T02:17:33.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5000999999999999e-05 2024-04-19T02:17:33.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.174 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:33.174 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115303+0000", 2024-04-19T02:17:33.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9791999999999997e-05 2024-04-19T02:17:33.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.174 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:33.174 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115391+0000", 2024-04-19T02:17:33.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7559000000000007e-05 2024-04-19T02:17:33.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.174 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:33.174 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.117894+0000", 2024-04-19T02:17:33.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002503496 2024-04-19T02:17:33.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:33.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136297+0000", 2024-04-19T02:17:33.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018402335999999998 2024-04-19T02:17:33.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:33.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136327+0000", 2024-04-19T02:17:33.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0534999999999998e-05 2024-04-19T02:17:33.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:33.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136350+0000", 2024-04-19T02:17:33.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2427999999999999e-05 2024-04-19T02:17:33.176 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:33.176 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:33.176 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:33.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.176 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:129219 5.2 5:45e7e1f4:::benchmark_data_smithi121_44835_object129218:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T02:17:33.176 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:52.629592+0000", 2024-04-19T02:17:33.176 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.516802810999998, 2024-04-19T02:17:33.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021099489999999999, 2024-04-19T02:17:33.176 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:33.176 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:33.176 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:33.176 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:33.176 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:33.176 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129219 2024-04-19T02:17:33.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.177 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:33.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:33.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629592+0000", 2024-04-19T02:17:33.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:33.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:33.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629592+0000", 2024-04-19T02:17:33.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:33.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:33.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629591+0000", 2024-04-19T02:17:33.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:33.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:33.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629618+0000", 2024-04-19T02:17:33.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6970000000000001e-05 2024-04-19T02:17:33.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:33.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629639+0000", 2024-04-19T02:17:33.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0701999999999999e-05 2024-04-19T02:17:33.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:33.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629645+0000", 2024-04-19T02:17:33.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2299999999999996e-06 2024-04-19T02:17:33.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:33.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.635658+0000", 2024-04-19T02:17:33.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0060127549999999998 2024-04-19T02:17:33.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:33.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.635811+0000", 2024-04-19T02:17:33.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015305700000000001 2024-04-19T02:17:33.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:33.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.635967+0000", 2024-04-19T02:17:33.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015578599999999999 2024-04-19T02:17:33.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:33.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.642488+0000", 2024-04-19T02:17:33.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0065215619999999998 2024-04-19T02:17:33.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:33.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650603+0000", 2024-04-19T02:17:33.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0081144900000000002 2024-04-19T02:17:33.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:33.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650652+0000", 2024-04-19T02:17:33.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9079999999999998e-05 2024-04-19T02:17:33.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:33.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650691+0000", 2024-04-19T02:17:33.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9501e-05 2024-04-19T02:17:33.181 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:33.182 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:33.182 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:33.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.182 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:157448 5.7 5:ed833a19:::benchmark_data_smithi121_44835_object23413:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:33.182 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:06.870566+0000", 2024-04-19T02:17:33.182 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.275828229999998, 2024-04-19T02:17:33.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023031238999999998, 2024-04-19T02:17:33.182 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:33.182 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:33.182 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:33.182 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:33.183 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:33.183 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 157448 2024-04-19T02:17:33.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.183 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:33.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:33.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870566+0000", 2024-04-19T02:17:33.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:33.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:33.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870566+0000", 2024-04-19T02:17:33.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:33.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:33.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870566+0000", 2024-04-19T02:17:33.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:33.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:33.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870570+0000", 2024-04-19T02:17:33.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1620000000000001e-06 2024-04-19T02:17:33.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:33.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870577+0000", 2024-04-19T02:17:33.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2069999999999998e-06 2024-04-19T02:17:33.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:33.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870587+0000", 2024-04-19T02:17:33.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6919999999999997e-06 2024-04-19T02:17:33.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:33.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870615+0000", 2024-04-19T02:17:33.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8351999999999999e-05 2024-04-19T02:17:33.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:33.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870715+0000", 2024-04-19T02:17:33.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9624999999999996e-05 2024-04-19T02:17:33.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:33.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870805+0000", 2024-04-19T02:17:33.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0067000000000004e-05 2024-04-19T02:17:33.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:33.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.872773+0000", 2024-04-19T02:17:33.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001968605 2024-04-19T02:17:33.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:33.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.893514+0000", 2024-04-19T02:17:33.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020740082999999999 2024-04-19T02:17:33.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:33.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.893558+0000", 2024-04-19T02:17:33.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4110999999999998e-05 2024-04-19T02:17:33.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:33.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.893598+0000", 2024-04-19T02:17:33.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0077000000000003e-05 2024-04-19T02:17:33.187 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:33.187 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:33.187 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:33.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.188 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:157498 5.7 5:eb39b43d:::benchmark_data_smithi121_44835_object23463:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:33.188 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:06.911721+0000", 2024-04-19T02:17:33.188 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.234673584999999, 2024-04-19T02:17:33.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023313438999999998, 2024-04-19T02:17:33.188 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:33.188 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:33.188 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:33.188 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:33.188 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:33.188 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 157498 2024-04-19T02:17:33.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.188 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:33.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:33.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911721+0000", 2024-04-19T02:17:33.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:33.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:33.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911721+0000", 2024-04-19T02:17:33.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:33.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:33.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911720+0000", 2024-04-19T02:17:33.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:33.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:33.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911726+0000", 2024-04-19T02:17:33.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3179999999999997e-06 2024-04-19T02:17:33.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:33.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911746+0000", 2024-04-19T02:17:33.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0574e-05 2024-04-19T02:17:33.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:33.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911757+0000", 2024-04-19T02:17:33.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0959e-05 2024-04-19T02:17:33.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:33.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911795+0000", 2024-04-19T02:17:33.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7589999999999998e-05 2024-04-19T02:17:33.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:33.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911912+0000", 2024-04-19T02:17:33.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117625 2024-04-19T02:17:33.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:33.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.912250+0000", 2024-04-19T02:17:33.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00033710599999999999 2024-04-19T02:17:33.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:33.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.915540+0000", 2024-04-19T02:17:33.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032909559999999998 2024-04-19T02:17:33.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:33.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.934984+0000", 2024-04-19T02:17:33.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019443670999999999 2024-04-19T02:17:33.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:33.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.935013+0000", 2024-04-19T02:17:33.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8464999999999999e-05 2024-04-19T02:17:33.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:33.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.935035+0000", 2024-04-19T02:17:33.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1954e-05 2024-04-19T02:17:33.193 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:33.193 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:33.193 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:33.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.193 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168377 5.d 5:b1f3fb6d:::benchmark_data_smithi121_44835_object34342:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:33.193 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069470+0000", 2024-04-19T02:17:33.193 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.076924853000001, 2024-04-19T02:17:33.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050516473999999999, 2024-04-19T02:17:33.193 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:33.193 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:33.194 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:33.194 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:33.194 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:33.194 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168377 2024-04-19T02:17:33.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.194 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:33.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:33.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069470+0000", 2024-04-19T02:17:33.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:33.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:33.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069470+0000", 2024-04-19T02:17:33.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:33.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:33.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069469+0000", 2024-04-19T02:17:33.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:33.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:33.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069473+0000", 2024-04-19T02:17:33.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4580000000000002e-06 2024-04-19T02:17:33.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:33.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069482+0000", 2024-04-19T02:17:33.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2839999999999995e-06 2024-04-19T02:17:33.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:33.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069489+0000", 2024-04-19T02:17:33.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3579999999999997e-06 2024-04-19T02:17:33.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:33.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069559+0000", 2024-04-19T02:17:33.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9678000000000006e-05 2024-04-19T02:17:33.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:33.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069683+0000", 2024-04-19T02:17:33.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012359400000000001 2024-04-19T02:17:33.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:33.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069759+0000", 2024-04-19T02:17:33.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6834000000000003e-05 2024-04-19T02:17:33.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:33.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119871+0000", 2024-04-19T02:17:33.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050111392999999997 2024-04-19T02:17:33.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:33.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119932+0000", 2024-04-19T02:17:33.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1209000000000003e-05 2024-04-19T02:17:33.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:33.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119962+0000", 2024-04-19T02:17:33.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9717999999999999e-05 2024-04-19T02:17:33.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:33.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119986+0000", 2024-04-19T02:17:33.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4549000000000002e-05 2024-04-19T02:17:33.198 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:33.199 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:33.199 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:33.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.199 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168379 5.d 5:bcd492dd:::benchmark_data_smithi121_44835_object34344:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:33.199 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069502+0000", 2024-04-19T02:17:33.199 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.0768928, 2024-04-19T02:17:33.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050544645999999999, 2024-04-19T02:17:33.199 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:33.199 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:33.199 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:33.199 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:33.199 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:33.199 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168379 2024-04-19T02:17:33.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.200 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:33.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:33.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069502+0000", 2024-04-19T02:17:33.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:33.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:33.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069502+0000", 2024-04-19T02:17:33.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:33.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:33.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069501+0000", 2024-04-19T02:17:33.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:33.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:33.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069504+0000", 2024-04-19T02:17:33.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9289999999999998e-06 2024-04-19T02:17:33.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:33.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069511+0000", 2024-04-19T02:17:33.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1909999999999997e-06 2024-04-19T02:17:33.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:33.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069517+0000", 2024-04-19T02:17:33.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0789999999999997e-06 2024-04-19T02:17:33.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:33.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071081+0000", 2024-04-19T02:17:33.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0015646550000000001 2024-04-19T02:17:33.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:33.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071195+0000", 2024-04-19T02:17:33.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011399400000000001 2024-04-19T02:17:33.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:33.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071293+0000", 2024-04-19T02:17:33.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7938999999999999e-05 2024-04-19T02:17:33.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:33.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119898+0000", 2024-04-19T02:17:33.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.048604808999999999 2024-04-19T02:17:33.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:33.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119993+0000", 2024-04-19T02:17:33.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5224999999999997e-05 2024-04-19T02:17:33.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:33.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120024+0000", 2024-04-19T02:17:33.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0580999999999997e-05 2024-04-19T02:17:33.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:33.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120047+0000", 2024-04-19T02:17:33.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2725e-05 2024-04-19T02:17:33.204 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:33.204 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:33.205 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:33.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.205 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168381 5.d 5:bcbab0e3:::benchmark_data_smithi121_44835_object34346:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:33.205 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:33.205 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.076873381999999, 2024-04-19T02:17:33.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050574694000000003, 2024-04-19T02:17:33.205 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:33.205 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:33.205 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:33.205 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:33.205 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:33.205 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168381 2024-04-19T02:17:33.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.205 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:33.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:33.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:33.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:33.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:33.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:33.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:33.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:33.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:33.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:33.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:33.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069523+0000", 2024-04-19T02:17:33.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.244e-06 2024-04-19T02:17:33.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:33.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069528+0000", 2024-04-19T02:17:33.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0669999999999999e-06 2024-04-19T02:17:33.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:33.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069533+0000", 2024-04-19T02:17:33.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4680000000000003e-06 2024-04-19T02:17:33.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:33.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072637+0000", 2024-04-19T02:17:33.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031040429999999999 2024-04-19T02:17:33.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:33.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072710+0000", 2024-04-19T02:17:33.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3045000000000003e-05 2024-04-19T02:17:33.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:33.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072775+0000", 2024-04-19T02:17:33.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5034000000000001e-05 2024-04-19T02:17:33.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:33.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119925+0000", 2024-04-19T02:17:33.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.047150594999999997 2024-04-19T02:17:33.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:33.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120055+0000", 2024-04-19T02:17:33.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129288 2024-04-19T02:17:33.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:33.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120077+0000", 2024-04-19T02:17:33.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1759e-05 2024-04-19T02:17:33.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:33.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120096+0000", 2024-04-19T02:17:33.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9524000000000001e-05 2024-04-19T02:17:33.210 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:33.210 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:33.210 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:33.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.210 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168382 5.f 5:f2599a15:::benchmark_data_smithi121_44835_object34347:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:33.210 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069556+0000", 2024-04-19T02:17:33.210 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.076838975000001, 2024-04-19T02:17:33.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050009713999999997, 2024-04-19T02:17:33.210 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:33.213 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:33.213 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:33.213 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:33.213 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:33.213 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168382 2024-04-19T02:17:33.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.213 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:33.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:33.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069556+0000", 2024-04-19T02:17:33.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:33.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:33.214 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069556+0000", 2024-04-19T02:17:33.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:33.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:33.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069555+0000", 2024-04-19T02:17:33.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:33.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:33.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069558+0000", 2024-04-19T02:17:33.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7879999999999998e-06 2024-04-19T02:17:33.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:33.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069566+0000", 2024-04-19T02:17:33.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6149999999999999e-06 2024-04-19T02:17:33.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:33.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069571+0000", 2024-04-19T02:17:33.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5509999999999999e-06 2024-04-19T02:17:33.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:33.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069618+0000", 2024-04-19T02:17:33.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6964e-05 2024-04-19T02:17:33.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:33.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069744+0000", 2024-04-19T02:17:33.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012577199999999999 2024-04-19T02:17:33.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:33.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.070116+0000", 2024-04-19T02:17:33.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000372407 2024-04-19T02:17:33.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:33.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117511+0000", 2024-04-19T02:17:33.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.047394935999999999 2024-04-19T02:17:33.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:33.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119484+0000", 2024-04-19T02:17:33.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019722310000000001 2024-04-19T02:17:33.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:33.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119525+0000", 2024-04-19T02:17:33.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1035999999999998e-05 2024-04-19T02:17:33.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:33.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119565+0000", 2024-04-19T02:17:33.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0859000000000003e-05 2024-04-19T02:17:33.218 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:33.218 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:33.218 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:33.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.218 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168383 5.d 5:bbd9496c:::benchmark_data_smithi121_44835_object34348:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:33.218 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069581+0000", 2024-04-19T02:17:33.219 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.076814086999999, 2024-04-19T02:17:33.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050607278999999998, 2024-04-19T02:17:33.219 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:33.219 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:33.219 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:33.219 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:33.219 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:33.219 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168383 2024-04-19T02:17:33.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.219 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:33.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:33.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069581+0000", 2024-04-19T02:17:33.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:33.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:33.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069581+0000", 2024-04-19T02:17:33.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:33.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:33.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069580+0000", 2024-04-19T02:17:33.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:33.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:33.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069589+0000", 2024-04-19T02:17:33.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6750000000000008e-06 2024-04-19T02:17:33.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:33.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069596+0000", 2024-04-19T02:17:33.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7360000000000004e-06 2024-04-19T02:17:33.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:33.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069601+0000", 2024-04-19T02:17:33.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0479999999999998e-06 2024-04-19T02:17:33.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:33.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.073854+0000", 2024-04-19T02:17:33.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042531920000000003 2024-04-19T02:17:33.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:33.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.073952+0000", 2024-04-19T02:17:33.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7851999999999998e-05 2024-04-19T02:17:33.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:33.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074012+0000", 2024-04-19T02:17:33.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0225e-05 2024-04-19T02:17:33.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.223 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:33.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120102+0000", 2024-04-19T02:17:33.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.046090150000000003 2024-04-19T02:17:33.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.223 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:33.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120129+0000", 2024-04-19T02:17:33.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7228000000000001e-05 2024-04-19T02:17:33.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.223 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:33.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120157+0000", 2024-04-19T02:17:33.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7165000000000002e-05 2024-04-19T02:17:33.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:33.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120188+0000", 2024-04-19T02:17:33.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1418000000000003e-05 2024-04-19T02:17:33.224 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:33.224 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:33.224 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:33.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.224 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168384 5.7 5:ed638f84:::benchmark_data_smithi121_44835_object34349:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:33.224 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069612+0000", 2024-04-19T02:17:33.224 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.076783034000002, 2024-04-19T02:17:33.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049863376000000001, 2024-04-19T02:17:33.224 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:33.224 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:33.224 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:33.225 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:33.225 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:33.225 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168384 2024-04-19T02:17:33.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.225 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:33.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:33.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069612+0000", 2024-04-19T02:17:33.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:33.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:33.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069612+0000", 2024-04-19T02:17:33.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:33.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:33.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069611+0000", 2024-04-19T02:17:33.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:33.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:33.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069614+0000", 2024-04-19T02:17:33.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7819999999999998e-06 2024-04-19T02:17:33.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:33.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069623+0000", 2024-04-19T02:17:33.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6989999999999992e-06 2024-04-19T02:17:33.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:33.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069628+0000", 2024-04-19T02:17:33.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4999999999999999e-06 2024-04-19T02:17:33.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:33.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069662+0000", 2024-04-19T02:17:33.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3319999999999999e-05 2024-04-19T02:17:33.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:33.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069782+0000", 2024-04-19T02:17:33.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120547 2024-04-19T02:17:33.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.228 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:33.228 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119338+0000", 2024-04-19T02:17:33.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049556141999999997 2024-04-19T02:17:33.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.228 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:33.228 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119388+0000", 2024-04-19T02:17:33.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9866e-05 2024-04-19T02:17:33.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.228 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:33.228 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119475+0000", 2024-04-19T02:17:33.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6929999999999996e-05 2024-04-19T02:17:33.228 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:33.229 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:33.229 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:33.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.229 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168385 5.d 5:b22d7e69:::benchmark_data_smithi121_44835_object34350:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:33.229 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:33.229 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.076759594999999, 2024-04-19T02:17:33.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.055438508999999997, 2024-04-19T02:17:33.229 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:33.229 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:33.229 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:33.229 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:33.229 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:33.229 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168385 2024-04-19T02:17:33.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.230 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:33.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:33.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:33.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:33.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:33.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:33.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:33.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:33.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:33.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:33.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:33.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069637+0000", 2024-04-19T02:17:33.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.576e-06 2024-04-19T02:17:33.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:33.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069643+0000", 2024-04-19T02:17:33.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8030000000000002e-06 2024-04-19T02:17:33.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:33.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069648+0000", 2024-04-19T02:17:33.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0889999999999999e-06 2024-04-19T02:17:33.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:33.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117534+0000", 2024-04-19T02:17:33.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.047886390000000001 2024-04-19T02:17:33.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:33.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117670+0000", 2024-04-19T02:17:33.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000135969 2024-04-19T02:17:33.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:33.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117803+0000", 2024-04-19T02:17:33.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000132955 2024-04-19T02:17:33.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:33.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120501+0000", 2024-04-19T02:17:33.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026978050000000002 2024-04-19T02:17:33.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:33.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.125026+0000", 2024-04-19T02:17:33.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045244589999999998 2024-04-19T02:17:33.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:33.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.125049+0000", 2024-04-19T02:17:33.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3807000000000001e-05 2024-04-19T02:17:33.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:33.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.125074+0000", 2024-04-19T02:17:33.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4175000000000001e-05 2024-04-19T02:17:33.235 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:33.235 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:33.235 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:33.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.235 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168386 5.5 5:a2cda182:::benchmark_data_smithi121_44835_object34351:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:33.235 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069653+0000", 2024-04-19T02:17:33.235 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.076742127999999, 2024-04-19T02:17:33.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058748884000000001, 2024-04-19T02:17:33.235 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:33.235 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:33.235 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:33.235 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:33.236 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:33.236 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168386 2024-04-19T02:17:33.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.236 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:33.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:33.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069653+0000", 2024-04-19T02:17:33.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:33.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:33.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069653+0000", 2024-04-19T02:17:33.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:33.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:33.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069652+0000", 2024-04-19T02:17:33.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:33.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:33.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069654+0000", 2024-04-19T02:17:33.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1220000000000002e-06 2024-04-19T02:17:33.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:33.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069660+0000", 2024-04-19T02:17:33.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5890000000000002e-06 2024-04-19T02:17:33.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:33.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069665+0000", 2024-04-19T02:17:33.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.989e-06 2024-04-19T02:17:33.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:33.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120220+0000", 2024-04-19T02:17:33.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050555061999999998 2024-04-19T02:17:33.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:33.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120329+0000", 2024-04-19T02:17:33.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010922200000000001 2024-04-19T02:17:33.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:33.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.128293+0000", 2024-04-19T02:17:33.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079640279999999997 2024-04-19T02:17:33.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:33.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.128336+0000", 2024-04-19T02:17:33.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2245e-05 2024-04-19T02:17:33.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:33.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.128401+0000", 2024-04-19T02:17:33.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5975000000000004e-05 2024-04-19T02:17:33.240 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:33.240 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:33.240 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:33.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.240 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168387 5.f 5:ff36d1d9:::benchmark_data_smithi121_44835_object34352:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:33.240 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:33.240 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.076725293999999, 2024-04-19T02:17:33.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049975358999999997, 2024-04-19T02:17:33.240 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:33.240 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:33.240 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:33.241 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:33.241 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:33.241 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168387 2024-04-19T02:17:33.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.241 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:33.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:33.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:33.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:33.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:33.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:33.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:33.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:33.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:33.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:33.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:33.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069671+0000", 2024-04-19T02:17:33.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1739999999999999e-06 2024-04-19T02:17:33.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:33.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069677+0000", 2024-04-19T02:17:33.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4519999999999996e-06 2024-04-19T02:17:33.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:33.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069682+0000", 2024-04-19T02:17:33.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5400000000000003e-06 2024-04-19T02:17:33.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:33.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072634+0000", 2024-04-19T02:17:33.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0029521510000000001 2024-04-19T02:17:33.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:33.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072706+0000", 2024-04-19T02:17:33.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1996999999999995e-05 2024-04-19T02:17:33.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:33.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072772+0000", 2024-04-19T02:17:33.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5380000000000001e-05 2024-04-19T02:17:33.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:33.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117549+0000", 2024-04-19T02:17:33.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044777124000000001 2024-04-19T02:17:33.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:33.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119572+0000", 2024-04-19T02:17:33.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002022893 2024-04-19T02:17:33.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:33.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119613+0000", 2024-04-19T02:17:33.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0849999999999997e-05 2024-04-19T02:17:33.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:33.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119645+0000", 2024-04-19T02:17:33.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2113000000000002e-05 2024-04-19T02:17:33.245 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:33.245 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:33.245 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:33.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.246 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168389 5.2 5:4bcb87b1:::benchmark_data_smithi121_44835_object34354:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:33.246 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.071719+0000", 2024-04-19T02:17:33.246 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.074676197999999, 2024-04-19T02:17:33.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.048248604, 2024-04-19T02:17:33.246 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:33.246 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:33.246 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:33.246 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:33.246 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:33.246 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168389 2024-04-19T02:17:33.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.246 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:33.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:33.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071719+0000", 2024-04-19T02:17:33.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:33.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:33.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071719+0000", 2024-04-19T02:17:33.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:33.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:33.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071718+0000", 2024-04-19T02:17:33.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:33.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:33.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071722+0000", 2024-04-19T02:17:33.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8590000000000004e-06 2024-04-19T02:17:33.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:33.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071730+0000", 2024-04-19T02:17:33.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8569999999999995e-06 2024-04-19T02:17:33.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:33.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071736+0000", 2024-04-19T02:17:33.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.127e-06 2024-04-19T02:17:33.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:33.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071769+0000", 2024-04-19T02:17:33.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3052000000000001e-05 2024-04-19T02:17:33.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:33.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071843+0000", 2024-04-19T02:17:33.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3683000000000006e-05 2024-04-19T02:17:33.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:33.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119852+0000", 2024-04-19T02:17:33.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.048009353999999997 2024-04-19T02:17:33.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:33.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119896+0000", 2024-04-19T02:17:33.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3102000000000002e-05 2024-04-19T02:17:33.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:33.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119967+0000", 2024-04-19T02:17:33.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1589999999999997e-05 2024-04-19T02:17:33.250 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:33.250 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:33.250 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:33.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.251 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168391 5.3 5:c5d9b5e1:::benchmark_data_smithi121_44835_object34356:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:33.251 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.074402+0000", 2024-04-19T02:17:33.251 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.071992358999999, 2024-04-19T02:17:33.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.045426756999999998, 2024-04-19T02:17:33.251 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:33.251 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:33.251 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:33.251 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:33.251 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:33.251 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168391 2024-04-19T02:17:33.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.251 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:33.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:33.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074402+0000", 2024-04-19T02:17:33.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:33.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:33.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074402+0000", 2024-04-19T02:17:33.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:33.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:33.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074401+0000", 2024-04-19T02:17:33.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:33.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:33.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074406+0000", 2024-04-19T02:17:33.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5879999999999999e-06 2024-04-19T02:17:33.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:33.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074414+0000", 2024-04-19T02:17:33.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8599999999999993e-06 2024-04-19T02:17:33.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:33.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074420+0000", 2024-04-19T02:17:33.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6350000000000003e-06 2024-04-19T02:17:33.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:33.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074453+0000", 2024-04-19T02:17:33.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3874000000000001e-05 2024-04-19T02:17:33.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:33.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074531+0000", 2024-04-19T02:17:33.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7999999999999999e-05 2024-04-19T02:17:33.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:33.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119717+0000", 2024-04-19T02:17:33.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.045185395000000003 2024-04-19T02:17:33.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.255 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:33.255 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119756+0000", 2024-04-19T02:17:33.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9110000000000003e-05 2024-04-19T02:17:33.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.255 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:33.255 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119829+0000", 2024-04-19T02:17:33.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3238000000000006e-05 2024-04-19T02:17:33.255 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:33.255 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:33.255 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:33.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.256 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4549.0:168377 5.d e52/16 ondisk, result = 0)", 2024-04-19T02:17:33.256 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.077260+0000", 2024-04-19T02:17:33.256 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.069134618, 2024-04-19T02:17:33.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042613204000000002, 2024-04-19T02:17:33.256 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:33.256 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:33.256 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:33.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:33.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.077260+0000", 2024-04-19T02:17:33.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:33.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:33.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.077260+0000", 2024-04-19T02:17:33.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:33.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:33.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.077259+0000", 2024-04-19T02:17:33.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:33.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:33.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.077267+0000", 2024-04-19T02:17:33.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6799999999999993e-06 2024-04-19T02:17:33.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:33.258 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117372+0000", 2024-04-19T02:17:33.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040105342000000002 2024-04-19T02:17:33.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:33.258 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117389+0000", 2024-04-19T02:17:33.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6711e-05 2024-04-19T02:17:33.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:33.258 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119862+0000", 2024-04-19T02:17:33.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0024730580000000002 2024-04-19T02:17:33.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:33.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119867+0000", 2024-04-19T02:17:33.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1590000000000001e-06 2024-04-19T02:17:33.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:33.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:33.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:33.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119873+0000", 2024-04-19T02:17:33.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1410000000000002e-06 2024-04-19T02:17:33.259 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:33.259 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:33.259 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:33.259 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:33.259 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:33.259 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:33.261 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:17:33.261 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:33.260+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:33.362 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:33.362+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:33.438 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:17:33.438 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:17:33.438 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.438 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:227984 5.a 5:55c083ad:::benchmark_data_smithi121_44835_object93949:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T02:17:33.438 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:33.432018+0000", 2024-04-19T02:17:33.438 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0058411299999999999, 2024-04-19T02:17:33.438 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0058695309999999999, 2024-04-19T02:17:33.438 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:33.438 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:33.438 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:33.438 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:33.439 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:33.439 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 227984 2024-04-19T02:17:33.439 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.439 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:33.439 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.439 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:33.439 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.432018+0000", 2024-04-19T02:17:33.439 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.439 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.439 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.439 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:33.439 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.432018+0000", 2024-04-19T02:17:33.439 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.439 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.440 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.440 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:33.440 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.432017+0000", 2024-04-19T02:17:33.440 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:33.440 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.440 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.440 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:33.440 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.432021+0000", 2024-04-19T02:17:33.440 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3390000000000003e-06 2024-04-19T02:17:33.440 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.440 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.440 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:33.440 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.432032+0000", 2024-04-19T02:17:33.440 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0672999999999999e-05 2024-04-19T02:17:33.440 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.441 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.441 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:33.441 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.432038+0000", 2024-04-19T02:17:33.441 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.7390000000000002e-06 2024-04-19T02:17:33.441 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.441 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.441 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:33.441 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.432075+0000", 2024-04-19T02:17:33.441 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6192000000000002e-05 2024-04-19T02:17:33.441 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.441 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.441 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:33.441 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.432391+0000", 2024-04-19T02:17:33.442 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00031645799999999998 2024-04-19T02:17:33.442 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.442 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:33.442 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.442 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.442 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.442 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:227985 5.a 5:5f763ce4:::benchmark_data_smithi121_44835_object93950:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T02:17:33.442 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:33.432565+0000", 2024-04-19T02:17:33.442 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0052939750000000002, 2024-04-19T02:17:33.442 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0054023550000000002, 2024-04-19T02:17:33.442 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:33.442 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:33.442 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:33.443 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:33.443 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:33.443 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 227985 2024-04-19T02:17:33.443 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.443 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:33.443 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.443 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:33.443 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.432565+0000", 2024-04-19T02:17:33.443 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.443 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.443 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.443 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:33.443 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.432565+0000", 2024-04-19T02:17:33.443 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.443 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.444 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.444 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:33.444 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.432564+0000", 2024-04-19T02:17:33.444 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:33.444 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.444 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.444 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:33.444 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.432568+0000", 2024-04-19T02:17:33.444 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6789999999999998e-06 2024-04-19T02:17:33.444 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.444 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.444 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:33.444 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.432577+0000", 2024-04-19T02:17:33.444 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3419999999999997e-06 2024-04-19T02:17:33.444 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.445 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.445 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:33.445 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.432582+0000", 2024-04-19T02:17:33.445 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.6879999999999998e-06 2024-04-19T02:17:33.445 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.445 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.445 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:33.445 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.434165+0000", 2024-04-19T02:17:33.445 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0015831040000000001 2024-04-19T02:17:33.445 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.445 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.445 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:33.446 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.434293+0000", 2024-04-19T02:17:33.446 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012756599999999999 2024-04-19T02:17:33.446 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.446 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:33.446 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.446 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.446 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.446 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:227988 5.e 5:72b547d4:::benchmark_data_smithi121_44835_object93953:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T02:17:33.446 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:33.434133+0000", 2024-04-19T02:17:33.446 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0037260769999999999, 2024-04-19T02:17:33.446 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.003910841, 2024-04-19T02:17:33.446 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:33.446 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:33.446 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:33.447 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:33.447 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:33.447 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 227988 2024-04-19T02:17:33.447 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.447 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:33.447 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.447 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:33.447 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.434133+0000", 2024-04-19T02:17:33.447 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.447 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.447 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.447 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:33.447 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.434133+0000", 2024-04-19T02:17:33.447 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.447 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.448 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.448 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:33.448 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.434132+0000", 2024-04-19T02:17:33.448 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:33.448 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.448 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.448 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:33.448 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.434136+0000", 2024-04-19T02:17:33.448 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7400000000000002e-06 2024-04-19T02:17:33.448 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.448 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.448 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:33.448 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.434143+0000", 2024-04-19T02:17:33.448 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.9580000000000001e-06 2024-04-19T02:17:33.448 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.449 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.449 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:33.449 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.434149+0000", 2024-04-19T02:17:33.449 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.0270000000000001e-06 2024-04-19T02:17:33.449 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.449 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.449 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:33.449 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.434184+0000", 2024-04-19T02:17:33.449 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4749000000000002e-05 2024-04-19T02:17:33.449 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.449 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.449 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:33.449 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.434318+0000", 2024-04-19T02:17:33.449 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013442 2024-04-19T02:17:33.450 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.450 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:33.450 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.450 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.450 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.450 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:227990 5.1 5:83d43805:::benchmark_data_smithi121_44835_object93955:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T02:17:33.450 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:33.434257+0000", 2024-04-19T02:17:33.450 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0036013400000000002, 2024-04-19T02:17:33.450 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0038586190000000002, 2024-04-19T02:17:33.450 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:33.450 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:33.450 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:33.450 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:33.450 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:33.451 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 227990 2024-04-19T02:17:33.451 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.451 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:33.451 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.451 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:33.451 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.434257+0000", 2024-04-19T02:17:33.451 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.451 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.451 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.451 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:33.451 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.434257+0000", 2024-04-19T02:17:33.451 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.451 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.451 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.452 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:33.452 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.434257+0000", 2024-04-19T02:17:33.452 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:33.452 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.452 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.452 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:33.452 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.434261+0000", 2024-04-19T02:17:33.452 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4410000000000003e-06 2024-04-19T02:17:33.452 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.452 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.452 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:33.452 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.434270+0000", 2024-04-19T02:17:33.452 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.5590000000000006e-06 2024-04-19T02:17:33.452 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.452 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.453 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:33.453 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.434275+0000", 2024-04-19T02:17:33.453 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.3639999999999998e-06 2024-04-19T02:17:33.453 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.453 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.453 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:33.453 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.434317+0000", 2024-04-19T02:17:33.453 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1579999999999998e-05 2024-04-19T02:17:33.453 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.453 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.453 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:33.453 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.434448+0000", 2024-04-19T02:17:33.453 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013111199999999999 2024-04-19T02:17:33.453 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.454 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:33.454 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.454 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.454 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.454 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:227992 5.a 5:5e702502:::benchmark_data_smithi121_44835_object93957:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T02:17:33.454 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:33.434291+0000", 2024-04-19T02:17:33.454 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.003567986, 2024-04-19T02:17:33.454 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0038967329999999999, 2024-04-19T02:17:33.454 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:33.454 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:33.454 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:33.454 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:33.454 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:33.454 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 227992 2024-04-19T02:17:33.455 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.455 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:33.455 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.455 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:33.455 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.434291+0000", 2024-04-19T02:17:33.455 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.455 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.455 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.455 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:33.455 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.434291+0000", 2024-04-19T02:17:33.455 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.455 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.455 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.455 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:33.455 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.434290+0000", 2024-04-19T02:17:33.456 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:33.456 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.456 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.456 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:33.456 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.434294+0000", 2024-04-19T02:17:33.456 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.326e-06 2024-04-19T02:17:33.456 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.456 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.456 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:33.456 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.434303+0000", 2024-04-19T02:17:33.456 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.8789999999999998e-06 2024-04-19T02:17:33.456 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.456 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.456 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:33.457 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.434310+0000", 2024-04-19T02:17:33.457 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.1809999999999998e-06 2024-04-19T02:17:33.457 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.457 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.457 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:33.457 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.436090+0000", 2024-04-19T02:17:33.457 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0017802429999999999 2024-04-19T02:17:33.457 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.457 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.457 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:33.457 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.436215+0000", 2024-04-19T02:17:33.457 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012495099999999999 2024-04-19T02:17:33.457 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.457 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:33.458 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.458 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.458 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.458 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:227995 5.8 5:1853068d:::benchmark_data_smithi121_44835_object93960:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T02:17:33.458 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:33.435556+0000", 2024-04-19T02:17:33.458 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0023026040000000002, 2024-04-19T02:17:33.458 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.002705547, 2024-04-19T02:17:33.458 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:33.458 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:33.458 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:33.458 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:33.458 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:33.459 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 227995 2024-04-19T02:17:33.459 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.459 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:33.459 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.459 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:33.459 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.435556+0000", 2024-04-19T02:17:33.459 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.459 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.459 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.459 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:33.459 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.435556+0000", 2024-04-19T02:17:33.459 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.459 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.459 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.460 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:33.460 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.435555+0000", 2024-04-19T02:17:33.460 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:33.460 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.460 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.460 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:33.460 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.435559+0000", 2024-04-19T02:17:33.460 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7799999999999998e-06 2024-04-19T02:17:33.460 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.460 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.460 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:33.460 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.435568+0000", 2024-04-19T02:17:33.460 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.4090000000000003e-06 2024-04-19T02:17:33.460 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.460 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.460 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:33.461 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.435573+0000", 2024-04-19T02:17:33.461 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.1000000000000003e-06 2024-04-19T02:17:33.461 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.461 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.461 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:33.461 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.435608+0000", 2024-04-19T02:17:33.461 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5017e-05 2024-04-19T02:17:33.461 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.461 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.461 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:33.461 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.435732+0000", 2024-04-19T02:17:33.461 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012452399999999999 2024-04-19T02:17:33.461 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.461 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:33.461 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.462 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.462 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.462 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:227996 5.0 5:0ce2f2b3:::benchmark_data_smithi121_44835_object93961:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T02:17:33.462 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:33.435776+0000", 2024-04-19T02:17:33.462 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.002083119, 2024-04-19T02:17:33.462 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.002556104, 2024-04-19T02:17:33.462 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:33.462 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:33.462 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:33.462 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:33.462 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:33.462 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 227996 2024-04-19T02:17:33.462 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.462 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:33.463 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.463 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:33.463 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.435776+0000", 2024-04-19T02:17:33.463 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.463 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.463 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.463 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:33.463 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.435776+0000", 2024-04-19T02:17:33.463 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.463 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.463 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.463 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:33.463 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.435775+0000", 2024-04-19T02:17:33.463 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:33.463 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.464 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.464 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:33.464 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.435778+0000", 2024-04-19T02:17:33.464 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9660000000000001e-06 2024-04-19T02:17:33.464 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.464 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.464 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:33.464 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.435785+0000", 2024-04-19T02:17:33.464 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3749999999999997e-06 2024-04-19T02:17:33.464 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.464 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.464 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:33.464 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.435789+0000", 2024-04-19T02:17:33.464 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.766e-06 2024-04-19T02:17:33.464 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.464 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.465 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:33.465 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.436212+0000", 2024-04-19T02:17:33.465 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000422915 2024-04-19T02:17:33.465 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.465 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.465 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:33.465 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.436327+0000", 2024-04-19T02:17:33.465 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000114901 2024-04-19T02:17:33.465 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.465 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:33.465 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.465 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.465 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.465 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:227998 5.8 5:1499b609:::benchmark_data_smithi121_44835_object93963:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T02:17:33.466 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:33.435968+0000", 2024-04-19T02:17:33.466 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.001890538, 2024-04-19T02:17:33.466 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0024332379999999999, 2024-04-19T02:17:33.466 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:33.466 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:33.466 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:33.466 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:33.466 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:33.466 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 227998 2024-04-19T02:17:33.466 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.466 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:33.466 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.466 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:33.466 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.435968+0000", 2024-04-19T02:17:33.466 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.467 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.467 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.467 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:33.467 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.435968+0000", 2024-04-19T02:17:33.467 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.467 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.467 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.467 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:33.467 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.435968+0000", 2024-04-19T02:17:33.467 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:33.467 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.467 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.467 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:33.467 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.435970+0000", 2024-04-19T02:17:33.467 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.6670000000000001e-06 2024-04-19T02:17:33.468 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.468 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.468 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:33.468 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.435974+0000", 2024-04-19T02:17:33.468 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.702e-06 2024-04-19T02:17:33.468 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.468 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.468 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:33.468 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.435978+0000", 2024-04-19T02:17:33.468 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5599999999999998e-06 2024-04-19T02:17:33.468 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.468 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.468 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:33.468 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.437832+0000", 2024-04-19T02:17:33.468 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0018544329999999999 2024-04-19T02:17:33.469 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.469 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.469 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:33.469 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.437955+0000", 2024-04-19T02:17:33.469 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000122595 2024-04-19T02:17:33.469 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.469 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:33.469 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.469 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.469 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.469 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:227999 5.d e60/16 5:b85a6b47:::benchmark_data_smithi121_44835_object93964:head v 60'14302, mlcod=60'14300)", 2024-04-19T02:17:33.469 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:33.436294+0000", 2024-04-19T02:17:33.469 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.001565051, 2024-04-19T02:17:33.469 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0021821990000000001, 2024-04-19T02:17:33.469 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:33.469 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:33.470 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:33.470 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.470 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:33.470 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.436294+0000", 2024-04-19T02:17:33.470 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.470 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.470 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.470 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:33.470 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.436294+0000", 2024-04-19T02:17:33.470 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.470 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.470 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.470 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:33.470 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.436293+0000", 2024-04-19T02:17:33.470 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:33.471 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.471 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.471 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:33.471 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.436303+0000", 2024-04-19T02:17:33.471 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0186999999999999e-05 2024-04-19T02:17:33.471 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.471 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.471 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:33.471 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.436312+0000", 2024-04-19T02:17:33.471 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.8990000000000007e-06 2024-04-19T02:17:33.471 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.471 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.471 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:33.471 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.436318+0000", 2024-04-19T02:17:33.471 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.1840000000000004e-06 2024-04-19T02:17:33.472 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.472 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.472 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:33.472 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.436439+0000", 2024-04-19T02:17:33.472 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000121187 2024-04-19T02:17:33.472 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.472 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.472 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:33.472 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.436459+0000", 2024-04-19T02:17:33.472 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.0214999999999999e-05 2024-04-19T02:17:33.472 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.472 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:33.472 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.472 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.472 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.473 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:228000 5.a 5:59fbc0af:::benchmark_data_smithi121_44835_object93965:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T02:17:33.473 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:33.437213+0000", 2024-04-19T02:17:33.473 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.00064614499999999999, 2024-04-19T02:17:33.473 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001325449, 2024-04-19T02:17:33.473 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:33.473 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:33.473 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:33.473 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:33.473 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:33.473 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 228000 2024-04-19T02:17:33.473 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.473 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:33.473 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.473 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:33.473 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.437213+0000", 2024-04-19T02:17:33.474 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.474 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.474 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.474 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:33.474 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.437213+0000", 2024-04-19T02:17:33.474 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.474 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.474 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.474 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:33.474 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.437212+0000", 2024-04-19T02:17:33.474 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:33.474 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.474 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.474 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:33.475 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.437219+0000", 2024-04-19T02:17:33.475 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.554e-06 2024-04-19T02:17:33.475 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.475 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.475 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:33.475 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.437235+0000", 2024-04-19T02:17:33.475 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.5517999999999999e-05 2024-04-19T02:17:33.475 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.475 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.475 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:33.475 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.437242+0000", 2024-04-19T02:17:33.475 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.0809999999999996e-06 2024-04-19T02:17:33.475 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.475 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.475 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:33.476 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.437514+0000", 2024-04-19T02:17:33.476 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00027248499999999999 2024-04-19T02:17:33.476 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.476 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.476 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:33.476 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:33.437591+0000", 2024-04-19T02:17:33.476 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.6261999999999996e-05 2024-04-19T02:17:33.476 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.476 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:33.476 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.476 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.476 INFO:teuthology.orchestra.run.smithi174.stdout: ], 2024-04-19T02:17:33.476 INFO:teuthology.orchestra.run.smithi174.stdout: "num_ops": 10 2024-04-19T02:17:33.476 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:17:33.478 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:17:33.478 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:33.478+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:33.579 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:33.578+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:33.656 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:17:33.656 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [], 2024-04-19T02:17:33.656 INFO:teuthology.orchestra.run.smithi174.stdout: "complaint_time": 30, 2024-04-19T02:17:33.656 INFO:teuthology.orchestra.run.smithi174.stdout: "num_blocked_ops": 0 2024-04-19T02:17:33.656 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:17:33.671 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:17:33.680 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:33.679+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:33.780 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:33.780+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:33.855 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:17:33.855 INFO:teuthology.orchestra.run.smithi174.stdout: "size": 20, 2024-04-19T02:17:33.855 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 600, 2024-04-19T02:17:33.855 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:17:33.856 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.856 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:19 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:33.856 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:17:33.856 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 124.58239620400001, 2024-04-19T02:17:33.856 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020818203, 2024-04-19T02:17:33.856 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:33.856 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:33.856 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:33.856 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.856 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:33.856 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:17:33.856 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.856 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.857 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.857 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:33.857 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:17:33.857 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.857 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.857 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.857 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:33.857 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:17:33.857 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:33.857 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.857 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.857 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:33.857 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270065+0000", 2024-04-19T02:17:33.857 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4310000000000001e-06 2024-04-19T02:17:33.858 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.858 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.858 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:33.858 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270070+0000", 2024-04-19T02:17:33.858 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2859999999999999e-06 2024-04-19T02:17:33.858 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.858 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.858 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:33.858 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270077+0000", 2024-04-19T02:17:33.858 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5270000000000004e-06 2024-04-19T02:17:33.858 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.858 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.858 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:33.859 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270107+0000", 2024-04-19T02:17:33.859 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0205999999999998e-05 2024-04-19T02:17:33.859 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.859 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.859 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:33.859 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270111+0000", 2024-04-19T02:17:33.859 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8650000000000003e-06 2024-04-19T02:17:33.859 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.859 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.859 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:33.859 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285936+0000", 2024-04-19T02:17:33.859 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015824677999999998 2024-04-19T02:17:33.859 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.859 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.860 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:33.860 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286007+0000", 2024-04-19T02:17:33.860 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1157999999999999e-05 2024-04-19T02:17:33.860 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.860 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.860 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:33.860 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286086+0000", 2024-04-19T02:17:33.860 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9084000000000004e-05 2024-04-19T02:17:33.860 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.860 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.860 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:33.860 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290740+0000", 2024-04-19T02:17:33.860 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0046543679999999999 2024-04-19T02:17:33.860 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.860 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.861 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:33.861 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290833+0000", 2024-04-19T02:17:33.861 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2551000000000002e-05 2024-04-19T02:17:33.861 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.861 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.861 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:33.861 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290859+0000", 2024-04-19T02:17:33.861 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.6696999999999999e-05 2024-04-19T02:17:33.861 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.861 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.861 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:33.861 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290881+0000", 2024-04-19T02:17:33.861 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1653000000000001e-05 2024-04-19T02:17:33.861 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.861 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:33.862 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.862 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.862 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.862 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:77622 5.8 5:166fbe77:::benchmark_data_smithi121_44835_object77621:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:33.862 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:17:33.862 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 67.046899267000001, 2024-04-19T02:17:33.862 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.021784694, 2024-04-19T02:17:33.862 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:33.862 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:33.862 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:33.862 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:33.862 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:33.862 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 77622 2024-04-19T02:17:33.862 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.863 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:33.863 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.863 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:33.863 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:17:33.863 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.863 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.863 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.863 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:33.863 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:17:33.863 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.863 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.863 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.863 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:33.863 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805559+0000", 2024-04-19T02:17:33.864 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:33.864 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.864 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.864 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:33.864 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805659+0000", 2024-04-19T02:17:33.864 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.9908000000000006e-05 2024-04-19T02:17:33.864 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.864 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.864 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:33.864 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805668+0000", 2024-04-19T02:17:33.864 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2129999999999997e-06 2024-04-19T02:17:33.864 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.864 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.864 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:33.865 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805673+0000", 2024-04-19T02:17:33.865 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0370000000000002e-06 2024-04-19T02:17:33.865 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.865 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.865 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:33.865 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812022+0000", 2024-04-19T02:17:33.865 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0063483239999999998 2024-04-19T02:17:33.865 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.865 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.865 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:33.865 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812129+0000", 2024-04-19T02:17:33.865 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010744200000000001 2024-04-19T02:17:33.865 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.865 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.865 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:33.866 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812252+0000", 2024-04-19T02:17:33.866 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000122519 2024-04-19T02:17:33.866 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.866 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.866 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:33.866 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.820979+0000", 2024-04-19T02:17:33.866 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0087272740000000001 2024-04-19T02:17:33.866 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.866 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.866 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:33.866 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827270+0000", 2024-04-19T02:17:33.866 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0062906239999999999 2024-04-19T02:17:33.867 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.867 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.867 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:33.867 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827309+0000", 2024-04-19T02:17:33.867 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9678999999999997e-05 2024-04-19T02:17:33.867 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.867 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.867 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:33.867 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827345+0000", 2024-04-19T02:17:33.867 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5308000000000001e-05 2024-04-19T02:17:33.867 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.867 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:33.867 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.867 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.867 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.867 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78224 5.4 5:26e797d5:::benchmark_data_smithi121_44835_object78223:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:33.868 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:17:33.868 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 66.745897068000005, 2024-04-19T02:17:33.868 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.021471998999999999, 2024-04-19T02:17:33.868 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:33.868 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:33.868 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:33.868 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:33.868 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:33.868 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78224 2024-04-19T02:17:33.868 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.868 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:33.868 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.868 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:33.868 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:17:33.868 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.869 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.869 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.869 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:33.869 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:17:33.869 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.869 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.869 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.869 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:33.869 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106561+0000", 2024-04-19T02:17:33.869 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:33.869 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.869 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.869 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:33.869 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106630+0000", 2024-04-19T02:17:33.869 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.8553999999999994e-05 2024-04-19T02:17:33.870 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.870 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.870 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:33.870 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106644+0000", 2024-04-19T02:17:33.870 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.4651000000000001e-05 2024-04-19T02:17:33.870 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.870 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.870 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:33.870 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106653+0000", 2024-04-19T02:17:33.870 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.6719999999999993e-06 2024-04-19T02:17:33.870 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.870 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.870 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:33.870 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106693+0000", 2024-04-19T02:17:33.870 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9978999999999998e-05 2024-04-19T02:17:33.871 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.871 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.871 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:33.871 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106840+0000", 2024-04-19T02:17:33.871 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0001473 2024-04-19T02:17:33.871 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.871 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.871 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:33.871 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106971+0000", 2024-04-19T02:17:33.871 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013051499999999999 2024-04-19T02:17:33.871 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.871 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.871 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:33.871 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.109047+0000", 2024-04-19T02:17:33.871 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.002076002 2024-04-19T02:17:33.872 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.872 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.872 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:33.872 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.127967+0000", 2024-04-19T02:17:33.872 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.018919780000000001 2024-04-19T02:17:33.872 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.872 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.872 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:33.872 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128004+0000", 2024-04-19T02:17:33.872 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7719000000000003e-05 2024-04-19T02:17:33.872 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.872 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.872 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:33.872 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128034+0000", 2024-04-19T02:17:33.872 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9651000000000001e-05 2024-04-19T02:17:33.872 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.873 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:33.873 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.873 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.873 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.873 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78259 5.4 5:2aa344b2:::benchmark_data_smithi121_44835_object78258:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:33.873 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:17:33.873 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 66.727201999000002, 2024-04-19T02:17:33.873 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022934350999999999, 2024-04-19T02:17:33.873 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:33.873 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:33.873 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:33.873 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:33.873 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:33.873 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78259 2024-04-19T02:17:33.873 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.874 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:33.874 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.874 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:33.874 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:17:33.874 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.874 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.874 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.874 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:33.874 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:17:33.874 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.874 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.874 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.874 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:33.874 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125256+0000", 2024-04-19T02:17:33.874 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:33.874 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.875 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.875 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:33.875 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125347+0000", 2024-04-19T02:17:33.875 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0470000000000006e-05 2024-04-19T02:17:33.875 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.875 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.875 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:33.875 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125358+0000", 2024-04-19T02:17:33.875 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1764e-05 2024-04-19T02:17:33.875 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.875 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.875 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:33.875 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125364+0000", 2024-04-19T02:17:33.875 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7189999999999998e-06 2024-04-19T02:17:33.875 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.876 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.876 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:33.876 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125391+0000", 2024-04-19T02:17:33.876 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7270000000000001e-05 2024-04-19T02:17:33.876 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.876 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.876 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:33.876 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125471+0000", 2024-04-19T02:17:33.876 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9209999999999995e-05 2024-04-19T02:17:33.876 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.876 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.876 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:33.876 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125559+0000", 2024-04-19T02:17:33.876 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.8689000000000004e-05 2024-04-19T02:17:33.876 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.876 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.877 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:33.877 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128164+0000", 2024-04-19T02:17:33.877 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0026050270000000002 2024-04-19T02:17:33.877 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.877 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.877 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:33.877 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148139+0000", 2024-04-19T02:17:33.877 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.019975050000000001 2024-04-19T02:17:33.877 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.877 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.877 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:33.877 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148169+0000", 2024-04-19T02:17:33.877 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0001e-05 2024-04-19T02:17:33.877 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.877 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.878 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:33.878 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148191+0000", 2024-04-19T02:17:33.878 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.2104999999999999e-05 2024-04-19T02:17:33.878 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.878 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:33.878 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.878 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.878 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.878 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78271 5.4 5:2982d7a6:::benchmark_data_smithi121_44835_object78270:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:33.878 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:17:33.878 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 66.720338768999994, 2024-04-19T02:17:33.878 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020841755999999999, 2024-04-19T02:17:33.878 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:33.878 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:33.878 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:33.879 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:33.879 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:33.879 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78271 2024-04-19T02:17:33.879 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.879 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:33.879 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.879 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:33.879 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:17:33.879 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.879 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.879 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.879 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:33.879 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:17:33.879 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.879 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.879 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.880 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:33.880 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132119+0000", 2024-04-19T02:17:33.880 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:33.880 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.880 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.880 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:33.880 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132185+0000", 2024-04-19T02:17:33.880 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5994000000000005e-05 2024-04-19T02:17:33.880 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.880 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.880 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:33.880 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132197+0000", 2024-04-19T02:17:33.880 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2091e-05 2024-04-19T02:17:33.880 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.880 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.880 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:33.881 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132206+0000", 2024-04-19T02:17:33.881 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.5099999999999998e-06 2024-04-19T02:17:33.881 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.881 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.881 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:33.881 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132242+0000", 2024-04-19T02:17:33.881 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5663000000000001e-05 2024-04-19T02:17:33.881 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.881 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.881 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:33.881 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132335+0000", 2024-04-19T02:17:33.881 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3275000000000004e-05 2024-04-19T02:17:33.881 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.881 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.881 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:33.882 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132432+0000", 2024-04-19T02:17:33.882 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7571000000000005e-05 2024-04-19T02:17:33.882 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.882 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.882 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:33.882 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.136706+0000", 2024-04-19T02:17:33.882 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0042738170000000001 2024-04-19T02:17:33.882 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.882 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.882 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:33.882 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152909+0000", 2024-04-19T02:17:33.882 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016202415000000001 2024-04-19T02:17:33.882 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.882 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.882 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:33.883 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152938+0000", 2024-04-19T02:17:33.883 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9740999999999999e-05 2024-04-19T02:17:33.883 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.883 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.883 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:33.883 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152962+0000", 2024-04-19T02:17:33.883 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3659000000000002e-05 2024-04-19T02:17:33.883 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.883 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:33.883 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.883 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.883 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.883 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78272 5.4 5:273e819a:::benchmark_data_smithi121_44835_object78271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:33.883 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:33.883 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 66.719849726000007, 2024-04-19T02:17:33.884 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022180163999999999, 2024-04-19T02:17:33.884 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:33.884 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:33.884 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:33.884 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:33.884 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:33.884 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78272 2024-04-19T02:17:33.884 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.884 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:33.884 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.884 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:33.884 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:33.884 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.884 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.884 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.884 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:33.885 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:33.885 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.885 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.885 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.885 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:33.885 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:33.885 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:33.885 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.885 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.885 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:33.885 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132690+0000", 2024-04-19T02:17:33.885 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0963000000000004e-05 2024-04-19T02:17:33.885 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.885 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.885 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:33.885 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132703+0000", 2024-04-19T02:17:33.886 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.3072e-05 2024-04-19T02:17:33.886 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.886 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.886 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:33.886 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132710+0000", 2024-04-19T02:17:33.886 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3100000000000003e-06 2024-04-19T02:17:33.886 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.886 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.886 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:33.886 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134005+0000", 2024-04-19T02:17:33.886 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001294513 2024-04-19T02:17:33.886 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.886 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.886 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:33.886 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134139+0000", 2024-04-19T02:17:33.887 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000134447 2024-04-19T02:17:33.887 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.887 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.888 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:33.888 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134284+0000", 2024-04-19T02:17:33.888 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014514399999999999 2024-04-19T02:17:33.888 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.888 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.889 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:33.889 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.139622+0000", 2024-04-19T02:17:33.889 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0053373830000000002 2024-04-19T02:17:33.889 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.889 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.889 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:33.889 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154737+0000", 2024-04-19T02:17:33.889 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015115195999999999 2024-04-19T02:17:33.889 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.889 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.889 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:33.889 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154768+0000", 2024-04-19T02:17:33.890 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0824999999999997e-05 2024-04-19T02:17:33.890 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.890 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.890 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:33.890 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154790+0000", 2024-04-19T02:17:33.890 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1999000000000001e-05 2024-04-19T02:17:33.890 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.891 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:33.891 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.891 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.891 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.891 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:94481 5.e 5:7b2fbebf:::benchmark_data_smithi121_44835_object94480:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:33.891 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:17:33.891 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 58.731213408999999, 2024-04-19T02:17:33.891 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020897846000000001, 2024-04-19T02:17:33.891 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:33.891 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:33.891 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:33.891 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:33.891 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:33.892 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 94481 2024-04-19T02:17:33.892 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.892 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:33.892 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.892 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:33.892 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:17:33.892 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.892 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.892 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.893 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:33.893 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:17:33.893 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.893 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.893 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.893 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:33.893 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121245+0000", 2024-04-19T02:17:33.893 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:33.893 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.893 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.893 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:33.893 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121273+0000", 2024-04-19T02:17:33.893 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7250000000000002e-05 2024-04-19T02:17:33.893 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.893 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.893 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:33.894 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121277+0000", 2024-04-19T02:17:33.894 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2860000000000001e-06 2024-04-19T02:17:33.894 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.894 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.894 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:33.894 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121280+0000", 2024-04-19T02:17:33.894 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2739999999999999e-06 2024-04-19T02:17:33.894 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.894 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.894 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:33.894 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121320+0000", 2024-04-19T02:17:33.894 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9879000000000002e-05 2024-04-19T02:17:33.894 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.894 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.895 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:33.895 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121448+0000", 2024-04-19T02:17:33.895 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012748800000000001 2024-04-19T02:17:33.895 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.895 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.895 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:33.895 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121595+0000", 2024-04-19T02:17:33.895 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014741299999999999 2024-04-19T02:17:33.895 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.895 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.895 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:33.895 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.127776+0000", 2024-04-19T02:17:33.895 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0061811360000000003 2024-04-19T02:17:33.895 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.896 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.896 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:33.896 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142073+0000", 2024-04-19T02:17:33.896 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014296959999999999 2024-04-19T02:17:33.896 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.896 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.896 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:33.896 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142106+0000", 2024-04-19T02:17:33.896 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3348e-05 2024-04-19T02:17:33.896 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.896 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.896 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:33.896 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142144+0000", 2024-04-19T02:17:33.897 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7153000000000002e-05 2024-04-19T02:17:33.897 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.897 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:33.897 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.897 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.897 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.897 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:94581 5.b 5:dc86d6e9:::benchmark_data_smithi121_44835_object94580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:33.897 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:33.897 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 58.672278835999997, 2024-04-19T02:17:33.897 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022099711000000001, 2024-04-19T02:17:33.897 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:33.897 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:33.897 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:33.897 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:33.898 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:33.898 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 94581 2024-04-19T02:17:33.898 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.898 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:33.898 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.898 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:33.898 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:33.898 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.898 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.898 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.898 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:33.898 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:33.898 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.898 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.899 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.899 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:33.899 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:33.899 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:33.899 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.899 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.899 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:33.899 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180253+0000", 2024-04-19T02:17:33.899 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3163000000000004e-05 2024-04-19T02:17:33.899 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.899 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.899 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:33.899 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180266+0000", 2024-04-19T02:17:33.899 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2886e-05 2024-04-19T02:17:33.899 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.900 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.900 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:33.900 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180273+0000", 2024-04-19T02:17:33.900 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.4059999999999999e-06 2024-04-19T02:17:33.900 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.900 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.900 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:33.900 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180646+0000", 2024-04-19T02:17:33.900 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00037283999999999999 2024-04-19T02:17:33.900 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.900 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.900 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:33.900 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180774+0000", 2024-04-19T02:17:33.900 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012793799999999999 2024-04-19T02:17:33.901 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.901 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.901 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:33.901 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180920+0000", 2024-04-19T02:17:33.901 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000146692 2024-04-19T02:17:33.901 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.901 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.901 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:33.901 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.183344+0000", 2024-04-19T02:17:33.901 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0024231669999999999 2024-04-19T02:17:33.901 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.901 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.902 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:33.902 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202196+0000", 2024-04-19T02:17:33.902 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.018852384 2024-04-19T02:17:33.902 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.902 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.902 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:33.902 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202241+0000", 2024-04-19T02:17:33.902 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4923999999999999e-05 2024-04-19T02:17:33.902 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.902 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.902 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:33.902 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202280+0000", 2024-04-19T02:17:33.902 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9096e-05 2024-04-19T02:17:33.902 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.903 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:33.903 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.903 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.903 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.903 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:96356 5.0 5:0a661b39:::benchmark_data_smithi121_44835_object96355:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:33.903 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:17:33.903 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 57.759065993999997, 2024-04-19T02:17:33.903 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020955516, 2024-04-19T02:17:33.903 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:33.903 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:33.903 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:33.903 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:33.903 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:33.904 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 96356 2024-04-19T02:17:33.904 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.904 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:33.904 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.904 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:33.904 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:17:33.904 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.904 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.904 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.904 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:33.904 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:17:33.904 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.904 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.904 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.905 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:33.905 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:17:33.905 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:33.905 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.905 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.905 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:33.905 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093455+0000", 2024-04-19T02:17:33.905 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.2205000000000005e-05 2024-04-19T02:17:33.905 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.905 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.905 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:33.905 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093464+0000", 2024-04-19T02:17:33.905 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3910000000000004e-06 2024-04-19T02:17:33.905 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.905 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.906 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:33.906 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093469+0000", 2024-04-19T02:17:33.906 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.7249999999999997e-06 2024-04-19T02:17:33.906 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.906 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.906 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:33.906 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099643+0000", 2024-04-19T02:17:33.906 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0061743359999999999 2024-04-19T02:17:33.906 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.906 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.906 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:33.906 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099774+0000", 2024-04-19T02:17:33.906 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013050599999999999 2024-04-19T02:17:33.906 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.906 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.907 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:33.907 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099917+0000", 2024-04-19T02:17:33.907 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000143187 2024-04-19T02:17:33.907 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.907 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.907 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:33.907 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.105432+0000", 2024-04-19T02:17:33.907 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.005514873 2024-04-19T02:17:33.907 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.907 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.907 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:33.907 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114264+0000", 2024-04-19T02:17:33.907 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.008831752 2024-04-19T02:17:33.908 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.908 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.908 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:33.908 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114300+0000", 2024-04-19T02:17:33.908 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6582000000000003e-05 2024-04-19T02:17:33.908 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.908 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.908 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:33.908 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114349+0000", 2024-04-19T02:17:33.908 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8579999999999999e-05 2024-04-19T02:17:33.908 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.908 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:33.908 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.908 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.909 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.909 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:96357 5.0 5:00efce8b:::benchmark_data_smithi121_44835_object96356:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:33.909 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:17:33.909 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 57.758986315999998, 2024-04-19T02:17:33.909 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020937471999999999, 2024-04-19T02:17:33.909 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:33.909 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:33.909 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:33.909 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:33.909 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:33.909 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 96357 2024-04-19T02:17:33.909 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.909 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:33.910 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.910 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:33.910 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:17:33.910 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.910 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.910 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.910 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:33.910 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:17:33.910 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.910 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.910 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.910 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:33.910 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093472+0000", 2024-04-19T02:17:33.910 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:33.911 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.911 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.911 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:33.911 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093513+0000", 2024-04-19T02:17:33.911 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0213000000000003e-05 2024-04-19T02:17:33.911 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.911 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.911 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:33.911 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093519+0000", 2024-04-19T02:17:33.911 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.066e-06 2024-04-19T02:17:33.911 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.911 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.911 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:33.911 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093525+0000", 2024-04-19T02:17:33.912 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.8170000000000004e-06 2024-04-19T02:17:33.912 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.912 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.912 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:33.912 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103412+0000", 2024-04-19T02:17:33.912 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0098872739999999997 2024-04-19T02:17:33.912 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.912 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.912 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:33.912 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103551+0000", 2024-04-19T02:17:33.912 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000139295 2024-04-19T02:17:33.912 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.912 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.913 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:33.913 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103701+0000", 2024-04-19T02:17:33.913 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014954599999999999 2024-04-19T02:17:33.913 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.913 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.913 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:33.913 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.108849+0000", 2024-04-19T02:17:33.913 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0051487199999999999 2024-04-19T02:17:33.913 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.913 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.913 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:33.913 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114355+0000", 2024-04-19T02:17:33.914 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0055052529999999999 2024-04-19T02:17:33.914 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.914 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.914 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:33.914 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114379+0000", 2024-04-19T02:17:33.914 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4275000000000001e-05 2024-04-19T02:17:33.914 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.914 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.914 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:33.914 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114410+0000", 2024-04-19T02:17:33.914 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1356999999999998e-05 2024-04-19T02:17:33.914 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.915 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:33.915 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.915 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.915 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.915 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:104431 5.8 5:14818e19:::benchmark_data_smithi121_44835_object104430:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T02:17:33.915 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:17:33.915 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 53.641073790999997, 2024-04-19T02:17:33.915 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022149528000000002, 2024-04-19T02:17:33.915 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:33.915 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:33.915 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:33.915 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:33.915 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:33.916 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 104431 2024-04-19T02:17:33.916 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.916 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:33.916 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.916 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:33.916 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:17:33.916 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.916 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.916 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.916 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:33.916 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:17:33.916 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.916 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.916 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.917 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:33.917 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211384+0000", 2024-04-19T02:17:33.917 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:33.917 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.917 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.917 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:33.917 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211458+0000", 2024-04-19T02:17:33.917 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3311000000000003e-05 2024-04-19T02:17:33.917 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.917 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.917 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:33.917 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211471+0000", 2024-04-19T02:17:33.917 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.3308e-05 2024-04-19T02:17:33.918 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.918 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.918 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:33.918 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211479+0000", 2024-04-19T02:17:33.918 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0909999999999993e-06 2024-04-19T02:17:33.918 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.918 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.918 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:33.918 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.221821+0000", 2024-04-19T02:17:33.918 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010341596999999999 2024-04-19T02:17:33.918 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.918 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.918 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:33.919 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.221966+0000", 2024-04-19T02:17:33.919 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000145167 2024-04-19T02:17:33.919 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.919 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.919 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:33.919 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.222077+0000", 2024-04-19T02:17:33.919 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011128000000000001 2024-04-19T02:17:33.919 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.919 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.919 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:33.919 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.228126+0000", 2024-04-19T02:17:33.919 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0060486710000000003 2024-04-19T02:17:33.919 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.919 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.919 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:33.920 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233449+0000", 2024-04-19T02:17:33.920 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0053231370000000004 2024-04-19T02:17:33.920 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.920 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.920 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:33.920 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233498+0000", 2024-04-19T02:17:33.920 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8798999999999998e-05 2024-04-19T02:17:33.921 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.921 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.921 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:33.922 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233535+0000", 2024-04-19T02:17:33.922 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7119000000000002e-05 2024-04-19T02:17:33.922 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.922 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:33.922 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.922 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.922 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.922 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157437 5.e 5:78833a3d:::benchmark_data_smithi121_44835_object23402:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:33.922 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.859854+0000", 2024-04-19T02:17:33.922 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 26.992605018999999, 2024-04-19T02:17:33.922 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.025859589999999998, 2024-04-19T02:17:33.923 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:33.923 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:33.923 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:33.923 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:33.923 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:33.923 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157437 2024-04-19T02:17:33.923 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.923 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:33.923 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.923 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:33.923 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859854+0000", 2024-04-19T02:17:33.923 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.923 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.924 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.924 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:33.924 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859854+0000", 2024-04-19T02:17:33.924 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.924 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.924 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.924 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:33.924 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859853+0000", 2024-04-19T02:17:33.924 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:33.924 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.924 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.924 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:33.924 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859857+0000", 2024-04-19T02:17:33.925 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8789999999999996e-06 2024-04-19T02:17:33.925 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.925 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.925 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:33.925 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859865+0000", 2024-04-19T02:17:33.925 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.1880000000000002e-06 2024-04-19T02:17:33.925 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.925 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.925 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:33.925 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859873+0000", 2024-04-19T02:17:33.925 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.2980000000000003e-06 2024-04-19T02:17:33.925 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.926 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.926 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:33.926 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859908+0000", 2024-04-19T02:17:33.926 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5682999999999997e-05 2024-04-19T02:17:33.926 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.926 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.926 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:33.926 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.860046+0000", 2024-04-19T02:17:33.926 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013714200000000001 2024-04-19T02:17:33.926 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.926 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.926 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:33.926 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.860153+0000", 2024-04-19T02:17:33.927 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010725700000000001 2024-04-19T02:17:33.927 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.927 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.927 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:33.927 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.862008+0000", 2024-04-19T02:17:33.927 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001855179 2024-04-19T02:17:33.927 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.927 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.927 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:33.927 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.885629+0000", 2024-04-19T02:17:33.927 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.023621428 2024-04-19T02:17:33.927 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.927 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.927 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:33.928 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.885676+0000", 2024-04-19T02:17:33.928 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.6371e-05 2024-04-19T02:17:33.928 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.928 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.928 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:33.928 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.885714+0000", 2024-04-19T02:17:33.928 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7907000000000001e-05 2024-04-19T02:17:33.928 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.928 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:33.928 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.928 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.928 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.928 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157438 5.0 5:01944e77:::benchmark_data_smithi121_44835_object23403:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:33.929 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.864095+0000", 2024-04-19T02:17:33.929 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 26.988363735, 2024-04-19T02:17:33.929 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.032015298999999997, 2024-04-19T02:17:33.929 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:33.929 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:33.929 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:33.929 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:33.929 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:33.929 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157438 2024-04-19T02:17:33.929 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.929 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:33.929 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.929 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:33.929 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864095+0000", 2024-04-19T02:17:33.929 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.930 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.930 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.930 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:33.930 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864095+0000", 2024-04-19T02:17:33.930 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.930 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.930 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.930 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:33.930 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864094+0000", 2024-04-19T02:17:33.930 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:33.930 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.930 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.930 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:33.930 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864102+0000", 2024-04-19T02:17:33.931 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.6629999999999993e-06 2024-04-19T02:17:33.931 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.931 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.931 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:33.931 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864113+0000", 2024-04-19T02:17:33.931 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1185999999999999e-05 2024-04-19T02:17:33.931 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.931 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.931 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:33.931 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864119+0000", 2024-04-19T02:17:33.931 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.224e-06 2024-04-19T02:17:33.931 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.931 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.931 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:33.932 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864151+0000", 2024-04-19T02:17:33.932 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1395e-05 2024-04-19T02:17:33.932 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.932 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.932 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:33.932 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864275+0000", 2024-04-19T02:17:33.932 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012431399999999999 2024-04-19T02:17:33.932 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.932 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.932 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:33.932 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864341+0000", 2024-04-19T02:17:33.932 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6146e-05 2024-04-19T02:17:33.932 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.932 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.932 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:33.932 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.866040+0000", 2024-04-19T02:17:33.933 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016991879999999999 2024-04-19T02:17:33.933 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.933 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.933 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:33.933 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896055+0000", 2024-04-19T02:17:33.933 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.030014886000000001 2024-04-19T02:17:33.933 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.933 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.933 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:33.933 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896087+0000", 2024-04-19T02:17:33.933 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1761000000000003e-05 2024-04-19T02:17:33.933 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.933 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.933 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:33.933 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896111+0000", 2024-04-19T02:17:33.933 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3623999999999999e-05 2024-04-19T02:17:33.933 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.934 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:33.934 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.934 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.934 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.934 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157439 5.e 5:79eb9d3c:::benchmark_data_smithi121_44835_object23404:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:33.934 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:33.934 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 26.988332660000001, 2024-04-19T02:17:33.934 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.027045244, 2024-04-19T02:17:33.934 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:33.934 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:33.934 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:33.934 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:33.934 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:33.934 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157439 2024-04-19T02:17:33.935 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.935 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:33.935 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.935 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:33.935 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:33.935 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.935 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.935 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.935 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:33.935 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:33.935 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.935 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.935 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.935 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:33.935 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:33.936 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:33.936 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.936 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.936 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:33.936 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864128+0000", 2024-04-19T02:17:33.936 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.911e-06 2024-04-19T02:17:33.936 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.936 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.936 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:33.936 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864136+0000", 2024-04-19T02:17:33.936 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2609999999999993e-06 2024-04-19T02:17:33.936 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.936 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.936 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:33.937 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864140+0000", 2024-04-19T02:17:33.937 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5530000000000001e-06 2024-04-19T02:17:33.937 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.937 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.937 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:33.937 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864169+0000", 2024-04-19T02:17:33.937 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.8932e-05 2024-04-19T02:17:33.937 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.937 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.937 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:33.937 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864267+0000", 2024-04-19T02:17:33.937 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7969999999999999e-05 2024-04-19T02:17:33.937 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.937 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.937 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:33.938 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864339+0000", 2024-04-19T02:17:33.938 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.2280999999999995e-05 2024-04-19T02:17:33.938 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.938 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.938 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:33.938 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.865763+0000", 2024-04-19T02:17:33.938 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0014236310000000001 2024-04-19T02:17:33.938 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.938 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.938 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:33.938 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.891093+0000", 2024-04-19T02:17:33.938 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.025330571 2024-04-19T02:17:33.938 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.938 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.939 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:33.939 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.891137+0000", 2024-04-19T02:17:33.939 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3980999999999998e-05 2024-04-19T02:17:33.939 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.939 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.939 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:33.939 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.891172+0000", 2024-04-19T02:17:33.939 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4465000000000003e-05 2024-04-19T02:17:33.939 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.939 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:33.939 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.939 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.939 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.939 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157442 5.0 5:0062b73f:::benchmark_data_smithi121_44835_object23407:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:33.939 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.867065+0000", 2024-04-19T02:17:33.940 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 26.98539401, 2024-04-19T02:17:33.940 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.029165542999999999, 2024-04-19T02:17:33.940 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:33.940 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:33.940 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:33.940 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:33.940 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:33.940 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157442 2024-04-19T02:17:33.940 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.940 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:33.940 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.940 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:33.940 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867065+0000", 2024-04-19T02:17:33.940 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.941 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.941 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.941 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:33.941 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867065+0000", 2024-04-19T02:17:33.941 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.941 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.941 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.941 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:33.941 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867064+0000", 2024-04-19T02:17:33.941 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:33.941 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.941 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.941 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:33.941 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867069+0000", 2024-04-19T02:17:33.941 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4549999999999997e-06 2024-04-19T02:17:33.942 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.942 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.942 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:33.942 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867080+0000", 2024-04-19T02:17:33.942 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0797e-05 2024-04-19T02:17:33.942 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.942 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.942 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:33.942 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867088+0000", 2024-04-19T02:17:33.942 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9729999999999997e-06 2024-04-19T02:17:33.942 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.942 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.942 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:33.943 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867121+0000", 2024-04-19T02:17:33.943 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2920000000000003e-05 2024-04-19T02:17:33.943 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.943 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.943 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:33.943 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867203+0000", 2024-04-19T02:17:33.943 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2578999999999997e-05 2024-04-19T02:17:33.943 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.943 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.943 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:33.943 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867386+0000", 2024-04-19T02:17:33.943 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00018237400000000001 2024-04-19T02:17:33.943 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.943 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.943 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:33.944 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.869338+0000", 2024-04-19T02:17:33.944 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0019521160000000001 2024-04-19T02:17:33.944 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.944 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.944 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:33.944 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896150+0000", 2024-04-19T02:17:33.944 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.026812074000000002 2024-04-19T02:17:33.944 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.944 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.944 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:33.944 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896191+0000", 2024-04-19T02:17:33.944 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1192000000000001e-05 2024-04-19T02:17:33.944 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.944 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.945 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:33.945 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896231+0000", 2024-04-19T02:17:33.945 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9764000000000001e-05 2024-04-19T02:17:33.945 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.945 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:33.945 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.945 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.945 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.945 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157499 5.8 5:1c3aa38a:::benchmark_data_smithi121_44835_object23464:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:33.945 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.913447+0000", 2024-04-19T02:17:33.945 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 26.939012437999999, 2024-04-19T02:17:33.945 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.024508188, 2024-04-19T02:17:33.945 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:33.946 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:33.946 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:33.946 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:33.946 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:33.946 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157499 2024-04-19T02:17:33.946 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.946 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:33.946 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.946 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:33.946 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913447+0000", 2024-04-19T02:17:33.946 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.946 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.946 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.946 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:33.946 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913447+0000", 2024-04-19T02:17:33.947 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.947 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.947 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.947 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:33.947 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913446+0000", 2024-04-19T02:17:33.947 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:33.947 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.947 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.947 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:33.947 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913451+0000", 2024-04-19T02:17:33.947 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.677e-06 2024-04-19T02:17:33.947 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.947 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.947 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:33.947 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913461+0000", 2024-04-19T02:17:33.948 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.8859999999999999e-06 2024-04-19T02:17:33.948 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.948 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.948 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:33.948 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913467+0000", 2024-04-19T02:17:33.948 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.0800000000000002e-06 2024-04-19T02:17:33.948 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.948 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.948 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:33.948 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913513+0000", 2024-04-19T02:17:33.948 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.5707000000000001e-05 2024-04-19T02:17:33.948 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.948 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.948 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:33.948 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913637+0000", 2024-04-19T02:17:33.949 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012379200000000001 2024-04-19T02:17:33.949 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.949 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.949 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:33.949 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913747+0000", 2024-04-19T02:17:33.949 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000110071 2024-04-19T02:17:33.949 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.949 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.949 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:33.949 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915674+0000", 2024-04-19T02:17:33.949 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0019270789999999999 2024-04-19T02:17:33.949 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.949 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.949 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:33.949 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937902+0000", 2024-04-19T02:17:33.950 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022228286 2024-04-19T02:17:33.950 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.950 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.950 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:33.950 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937931+0000", 2024-04-19T02:17:33.950 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9122e-05 2024-04-19T02:17:33.950 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.950 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.950 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:33.950 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937955+0000", 2024-04-19T02:17:33.950 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3591000000000002e-05 2024-04-19T02:17:33.950 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.950 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:33.950 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.950 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.951 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.951 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157500 5.0 5:0969ec74:::benchmark_data_smithi121_44835_object23465:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:33.951 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.913476+0000", 2024-04-19T02:17:33.951 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 26.938983572000001, 2024-04-19T02:17:33.951 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.024497596, 2024-04-19T02:17:33.951 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:33.951 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:33.951 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:33.951 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:33.951 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:33.951 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157500 2024-04-19T02:17:33.951 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.951 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:33.952 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.952 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:33.952 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913476+0000", 2024-04-19T02:17:33.952 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.952 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.952 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.952 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:33.952 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913476+0000", 2024-04-19T02:17:33.952 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.952 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.952 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.952 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:33.952 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913475+0000", 2024-04-19T02:17:33.953 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:33.953 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.953 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.953 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:33.953 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913478+0000", 2024-04-19T02:17:33.953 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.2670000000000001e-06 2024-04-19T02:17:33.953 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.953 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.953 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:33.953 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913481+0000", 2024-04-19T02:17:33.953 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6899999999999998e-06 2024-04-19T02:17:33.953 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.953 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.953 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:33.954 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913485+0000", 2024-04-19T02:17:33.954 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1230000000000002e-06 2024-04-19T02:17:33.954 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.954 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.954 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:33.954 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913526+0000", 2024-04-19T02:17:33.954 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.104e-05 2024-04-19T02:17:33.954 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.954 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.954 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:33.954 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913606+0000", 2024-04-19T02:17:33.954 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9510000000000003e-05 2024-04-19T02:17:33.954 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.955 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.955 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:33.955 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913671+0000", 2024-04-19T02:17:33.955 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.4838000000000005e-05 2024-04-19T02:17:33.955 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.955 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.955 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:33.955 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915348+0000", 2024-04-19T02:17:33.955 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016769860000000001 2024-04-19T02:17:33.955 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.955 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.955 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:33.955 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937897+0000", 2024-04-19T02:17:33.956 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022548902999999999 2024-04-19T02:17:33.956 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.956 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.956 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:33.956 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937938+0000", 2024-04-19T02:17:33.956 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1499999999999999e-05 2024-04-19T02:17:33.956 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.956 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.956 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:33.956 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937973+0000", 2024-04-19T02:17:33.956 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5057e-05 2024-04-19T02:17:33.956 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.956 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:33.957 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.957 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.957 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.957 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157501 5.4 5:26661819:::benchmark_data_smithi121_44835_object23466:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:33.957 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.914839+0000", 2024-04-19T02:17:33.957 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 26.937620278000001, 2024-04-19T02:17:33.957 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.028504224000000002, 2024-04-19T02:17:33.957 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:33.957 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:33.957 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:33.957 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:33.957 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:33.957 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157501 2024-04-19T02:17:33.957 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.958 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:33.958 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.958 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:33.958 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914839+0000", 2024-04-19T02:17:33.958 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.958 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.958 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.958 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:33.958 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914839+0000", 2024-04-19T02:17:33.958 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.958 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.958 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.958 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:33.958 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914838+0000", 2024-04-19T02:17:33.958 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:33.959 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.959 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.959 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:33.959 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914841+0000", 2024-04-19T02:17:33.959 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.706e-06 2024-04-19T02:17:33.959 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.959 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.959 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:33.959 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914848+0000", 2024-04-19T02:17:33.959 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.7429999999999996e-06 2024-04-19T02:17:33.959 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.959 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.959 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:33.960 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914852+0000", 2024-04-19T02:17:33.960 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0810000000000004e-06 2024-04-19T02:17:33.960 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.960 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.960 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:33.960 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914892+0000", 2024-04-19T02:17:33.960 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9957999999999999e-05 2024-04-19T02:17:33.960 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.960 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.960 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:33.960 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915008+0000", 2024-04-19T02:17:33.960 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000116401 2024-04-19T02:17:33.960 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.960 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.960 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:33.961 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915125+0000", 2024-04-19T02:17:33.961 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011622500000000001 2024-04-19T02:17:33.961 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.961 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.961 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:33.961 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916663+0000", 2024-04-19T02:17:33.961 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0015381310000000001 2024-04-19T02:17:33.961 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.961 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.961 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:33.961 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943114+0000", 2024-04-19T02:17:33.961 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.026451125999999998 2024-04-19T02:17:33.961 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.961 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.961 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:33.962 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943245+0000", 2024-04-19T02:17:33.962 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000131645 2024-04-19T02:17:33.962 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.962 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.962 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:33.962 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943343+0000", 2024-04-19T02:17:33.962 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7604999999999998e-05 2024-04-19T02:17:33.962 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.962 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:33.962 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.962 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.962 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.962 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157507 5.b 5:de8840a2:::benchmark_data_smithi121_44835_object23472:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:33.962 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:33.963 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 26.936055997, 2024-04-19T02:17:33.963 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022544518999999999, 2024-04-19T02:17:33.963 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:33.963 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:33.963 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:33.963 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:33.963 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:33.963 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157507 2024-04-19T02:17:33.963 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.963 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:33.963 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.963 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:33.963 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:33.964 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.964 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.964 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.964 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:33.964 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:33.964 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.964 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.964 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.964 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:33.964 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:33.964 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:33.964 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.964 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.965 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:33.965 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916406+0000", 2024-04-19T02:17:33.965 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4589999999999998e-06 2024-04-19T02:17:33.965 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.965 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.965 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:33.965 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916415+0000", 2024-04-19T02:17:33.965 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3910000000000004e-06 2024-04-19T02:17:33.965 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.965 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.965 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:33.965 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916421+0000", 2024-04-19T02:17:33.966 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.6130000000000003e-06 2024-04-19T02:17:33.966 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.966 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.966 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:33.966 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916448+0000", 2024-04-19T02:17:33.966 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7277999999999999e-05 2024-04-19T02:17:33.966 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.966 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.966 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:33.966 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916539+0000", 2024-04-19T02:17:33.966 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0855999999999999e-05 2024-04-19T02:17:33.966 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.966 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.967 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:33.967 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916605+0000", 2024-04-19T02:17:33.967 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6141000000000003e-05 2024-04-19T02:17:33.967 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.967 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.967 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:33.967 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918276+0000", 2024-04-19T02:17:33.967 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001670726 2024-04-19T02:17:33.967 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.967 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.967 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:33.967 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.938888+0000", 2024-04-19T02:17:33.967 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020612042000000001 2024-04-19T02:17:33.968 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.968 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.968 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:33.968 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.938924+0000", 2024-04-19T02:17:33.968 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5692999999999999e-05 2024-04-19T02:17:33.968 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.968 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.968 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:33.968 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.938948+0000", 2024-04-19T02:17:33.968 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3879e-05 2024-04-19T02:17:33.968 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.968 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:33.968 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.968 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.969 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.969 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157509 5.8 5:1dca85d0:::benchmark_data_smithi121_44835_object23474:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:33.969 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:33.969 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 26.933627751, 2024-04-19T02:17:33.969 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.024511807, 2024-04-19T02:17:33.969 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:33.969 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:33.969 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:33.969 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:33.969 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:33.969 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157509 2024-04-19T02:17:33.969 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.969 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:33.970 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.970 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:33.970 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:33.970 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.970 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.970 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.970 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:33.970 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:33.970 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:33.970 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.970 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.970 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:33.970 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:33.970 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:33.970 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.971 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.971 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:33.971 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918834+0000", 2024-04-19T02:17:33.971 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9409999999999999e-06 2024-04-19T02:17:33.971 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.971 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.971 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:33.971 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918859+0000", 2024-04-19T02:17:33.971 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.5245999999999999e-05 2024-04-19T02:17:33.971 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.971 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.971 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:33.971 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918864+0000", 2024-04-19T02:17:33.971 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.1819999999999997e-06 2024-04-19T02:17:33.971 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.971 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.971 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:33.972 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918900+0000", 2024-04-19T02:17:33.972 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5327000000000002e-05 2024-04-19T02:17:33.972 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.972 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.972 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:33.972 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.919024+0000", 2024-04-19T02:17:33.972 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012400900000000001 2024-04-19T02:17:33.972 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.972 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.972 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:33.972 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.919136+0000", 2024-04-19T02:17:33.972 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000111987 2024-04-19T02:17:33.972 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.972 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.972 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:33.972 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.922096+0000", 2024-04-19T02:17:33.973 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0029607079999999998 2024-04-19T02:17:33.973 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.973 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.973 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:33.973 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943120+0000", 2024-04-19T02:17:33.973 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.021023995 2024-04-19T02:17:33.973 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.973 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.973 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:33.973 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943255+0000", 2024-04-19T02:17:33.973 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013502100000000001 2024-04-19T02:17:33.973 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:33.973 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:33.973 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:33.973 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943343+0000", 2024-04-19T02:17:33.973 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.7931999999999998e-05 2024-04-19T02:17:33.973 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.973 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:33.974 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.974 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:33.974 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:33.974 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:17:33.975 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:33.975+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:33.976 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:34.076 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:34.076+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:34.114 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:17:34.147 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:34.147 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:17:34.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.147 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:230002 5.2 5:4f8ab550:::benchmark_data_smithi121_44835_object95967:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T02:17:34.147 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:34.144393+0000", 2024-04-19T02:17:34.147 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.003380863, 2024-04-19T02:17:34.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0034078260000000001, 2024-04-19T02:17:34.148 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:34.148 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:34.148 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:34.148 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:34.148 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:34.148 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 230002 2024-04-19T02:17:34.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.148 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:34.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:34.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.144393+0000", 2024-04-19T02:17:34.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:34.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:34.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.144393+0000", 2024-04-19T02:17:34.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:34.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:34.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.144393+0000", 2024-04-19T02:17:34.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:34.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:34.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.144395+0000", 2024-04-19T02:17:34.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1550000000000001e-06 2024-04-19T02:17:34.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:34.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.144401+0000", 2024-04-19T02:17:34.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4729999999999999e-06 2024-04-19T02:17:34.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:34.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.144405+0000", 2024-04-19T02:17:34.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3810000000000001e-06 2024-04-19T02:17:34.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:34.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.144437+0000", 2024-04-19T02:17:34.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1844999999999997e-05 2024-04-19T02:17:34.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:34.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.144546+0000", 2024-04-19T02:17:34.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000108565 2024-04-19T02:17:34.152 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:34.152 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:34.152 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:34.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.152 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:230003 5.c 5:350c6b06:::benchmark_data_smithi121_44835_object95968:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T02:17:34.152 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:34.144434+0000", 2024-04-19T02:17:34.152 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.003339963, 2024-04-19T02:17:34.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0034315510000000001, 2024-04-19T02:17:34.152 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:34.152 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:34.152 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:34.153 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:34.153 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:34.153 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 230003 2024-04-19T02:17:34.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.153 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:34.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:34.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.144434+0000", 2024-04-19T02:17:34.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:34.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:34.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.144434+0000", 2024-04-19T02:17:34.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:34.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:34.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.144434+0000", 2024-04-19T02:17:34.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:34.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:34.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.144437+0000", 2024-04-19T02:17:34.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5159999999999999e-06 2024-04-19T02:17:34.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:34.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.144444+0000", 2024-04-19T02:17:34.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2999999999999998e-06 2024-04-19T02:17:34.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:34.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.144450+0000", 2024-04-19T02:17:34.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.19e-06 2024-04-19T02:17:34.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:34.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.144482+0000", 2024-04-19T02:17:34.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2126999999999999e-05 2024-04-19T02:17:34.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:34.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.144597+0000", 2024-04-19T02:17:34.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000114745 2024-04-19T02:17:34.156 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:34.156 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:34.156 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:34.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.156 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:230005 5.9 5:9974a64b:::benchmark_data_smithi121_44835_object95970:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T02:17:34.156 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:34.146019+0000", 2024-04-19T02:17:34.156 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.001755483, 2024-04-19T02:17:34.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0018889149999999999, 2024-04-19T02:17:34.156 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:34.156 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:34.156 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:34.156 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:34.156 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:34.156 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 230005 2024-04-19T02:17:34.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.157 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:34.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:34.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.146019+0000", 2024-04-19T02:17:34.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:34.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:34.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.146019+0000", 2024-04-19T02:17:34.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:34.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:34.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.146018+0000", 2024-04-19T02:17:34.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:34.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:34.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.146023+0000", 2024-04-19T02:17:34.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6249999999999998e-06 2024-04-19T02:17:34.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:34.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.146032+0000", 2024-04-19T02:17:34.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5489999999999995e-06 2024-04-19T02:17:34.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:34.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.146039+0000", 2024-04-19T02:17:34.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.306e-06 2024-04-19T02:17:34.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:34.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.146076+0000", 2024-04-19T02:17:34.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6155999999999997e-05 2024-04-19T02:17:34.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:34.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.146190+0000", 2024-04-19T02:17:34.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011445799999999999 2024-04-19T02:17:34.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:34.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.146300+0000", 2024-04-19T02:17:34.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010948899999999999 2024-04-19T02:17:34.160 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:34.160 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:34.160 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:34.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.160 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:230009 5.9 5:955ee681:::benchmark_data_smithi121_44835_object95974:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T02:17:34.160 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:34.146252+0000", 2024-04-19T02:17:34.160 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0015219649999999999, 2024-04-19T02:17:34.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0016996159999999999, 2024-04-19T02:17:34.160 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:34.160 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:34.160 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:34.161 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:34.161 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:34.161 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 230009 2024-04-19T02:17:34.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.161 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:34.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:34.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.146252+0000", 2024-04-19T02:17:34.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:34.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:34.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.146252+0000", 2024-04-19T02:17:34.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:34.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:34.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.146252+0000", 2024-04-19T02:17:34.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:34.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:34.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.146255+0000", 2024-04-19T02:17:34.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2880000000000001e-06 2024-04-19T02:17:34.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:34.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.146261+0000", 2024-04-19T02:17:34.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5140000000000001e-06 2024-04-19T02:17:34.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:34.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.146264+0000", 2024-04-19T02:17:34.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9469999999999996e-06 2024-04-19T02:17:34.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:34.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.147861+0000", 2024-04-19T02:17:34.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0015960690000000001 2024-04-19T02:17:34.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:34.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.147944+0000", 2024-04-19T02:17:34.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3403000000000001e-05 2024-04-19T02:17:34.163 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:34.163 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:34.163 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:34.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.164 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:230010 5.2 5:47266f5b:::benchmark_data_smithi121_44835_object95975:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T02:17:34.164 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:34.146273+0000", 2024-04-19T02:17:34.164 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.001501147, 2024-04-19T02:17:34.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001722913, 2024-04-19T02:17:34.164 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:34.164 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:34.164 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:34.164 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:34.164 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:34.164 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 230010 2024-04-19T02:17:34.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.164 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:34.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:34.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.146273+0000", 2024-04-19T02:17:34.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:34.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:34.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.146273+0000", 2024-04-19T02:17:34.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:34.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:34.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.146273+0000", 2024-04-19T02:17:34.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:34.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:34.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.146275+0000", 2024-04-19T02:17:34.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.869e-06 2024-04-19T02:17:34.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:34.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.146281+0000", 2024-04-19T02:17:34.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7860000000000002e-06 2024-04-19T02:17:34.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:34.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.146284+0000", 2024-04-19T02:17:34.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9729999999999999e-06 2024-04-19T02:17:34.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:34.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.146445+0000", 2024-04-19T02:17:34.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016027500000000001 2024-04-19T02:17:34.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:34.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.146537+0000", 2024-04-19T02:17:34.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2015999999999994e-05 2024-04-19T02:17:34.167 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:34.167 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:34.167 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:34.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.167 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:230012 5.f 5:f22b34b0:::benchmark_data_smithi121_44835_object95977:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T02:17:34.167 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:34.146471+0000", 2024-04-19T02:17:34.168 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.001302955, 2024-04-19T02:17:34.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001565049, 2024-04-19T02:17:34.168 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:34.168 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:34.168 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:34.168 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:34.168 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:34.168 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 230012 2024-04-19T02:17:34.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.168 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:34.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:34.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.146471+0000", 2024-04-19T02:17:34.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:34.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:34.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.146471+0000", 2024-04-19T02:17:34.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:34.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:34.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.146471+0000", 2024-04-19T02:17:34.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:34.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:34.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.146475+0000", 2024-04-19T02:17:34.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8920000000000002e-06 2024-04-19T02:17:34.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:34.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.146482+0000", 2024-04-19T02:17:34.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4340000000000003e-06 2024-04-19T02:17:34.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:34.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.146488+0000", 2024-04-19T02:17:34.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0909999999999998e-06 2024-04-19T02:17:34.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:34.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.146521+0000", 2024-04-19T02:17:34.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3207999999999998e-05 2024-04-19T02:17:34.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:34.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.146597+0000", 2024-04-19T02:17:34.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5488999999999995e-05 2024-04-19T02:17:34.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:34.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.146660+0000", 2024-04-19T02:17:34.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3373999999999993e-05 2024-04-19T02:17:34.171 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:34.171 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:34.171 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:34.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.171 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:229996 5.f 5:ffa60367:::benchmark_data_smithi121_44835_object95961:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T02:17:34.171 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:34.142007+0000", 2024-04-19T02:17:34.171 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0057670350000000002, 2024-04-19T02:17:34.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00607684, 2024-04-19T02:17:34.172 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:34.172 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:34.172 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:34.172 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:34.172 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:34.172 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 229996 2024-04-19T02:17:34.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.172 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:34.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:34.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.142007+0000", 2024-04-19T02:17:34.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:34.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:34.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.142007+0000", 2024-04-19T02:17:34.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:34.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:34.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.142007+0000", 2024-04-19T02:17:34.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:34.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:34.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.142011+0000", 2024-04-19T02:17:34.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0419999999999996e-06 2024-04-19T02:17:34.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:34.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.142019+0000", 2024-04-19T02:17:34.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5259999999999993e-06 2024-04-19T02:17:34.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.174 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:34.174 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.142026+0000", 2024-04-19T02:17:34.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5220000000000004e-06 2024-04-19T02:17:34.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.174 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:34.174 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.142058+0000", 2024-04-19T02:17:34.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2103000000000001e-05 2024-04-19T02:17:34.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:34.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.142157+0000", 2024-04-19T02:17:34.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8933999999999998e-05 2024-04-19T02:17:34.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:34.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.142265+0000", 2024-04-19T02:17:34.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000108109 2024-04-19T02:17:34.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:34.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.146440+0000", 2024-04-19T02:17:34.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.004174952 2024-04-19T02:17:34.175 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:34.175 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:34.175 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:34.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.176 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:230000 5.3 5:cee43bd6:::benchmark_data_smithi121_44835_object95965:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T02:17:34.176 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:34.144352+0000", 2024-04-19T02:17:34.176 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.003422053, 2024-04-19T02:17:34.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037805809999999999, 2024-04-19T02:17:34.176 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:34.176 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:34.176 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:34.176 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:34.176 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:34.176 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 230000 2024-04-19T02:17:34.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.176 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:34.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:34.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.144352+0000", 2024-04-19T02:17:34.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:34.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:34.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.144352+0000", 2024-04-19T02:17:34.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:34.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:34.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.144351+0000", 2024-04-19T02:17:34.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:34.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:34.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.144355+0000", 2024-04-19T02:17:34.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.929e-06 2024-04-19T02:17:34.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:34.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.144363+0000", 2024-04-19T02:17:34.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6290000000000001e-06 2024-04-19T02:17:34.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:34.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.144367+0000", 2024-04-19T02:17:34.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0539999999999996e-06 2024-04-19T02:17:34.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:34.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.144405+0000", 2024-04-19T02:17:34.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7771000000000001e-05 2024-04-19T02:17:34.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:34.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.144506+0000", 2024-04-19T02:17:34.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101475 2024-04-19T02:17:34.179 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:34.179 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:34.179 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:34.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.179 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:230001 5.d 5:b70c835a:::benchmark_data_smithi121_44835_object95966:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T02:17:34.179 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:34.144375+0000", 2024-04-19T02:17:34.179 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0033995869999999999, 2024-04-19T02:17:34.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037957939999999999, 2024-04-19T02:17:34.180 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:34.180 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:34.180 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:34.180 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:34.180 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:34.180 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 230001 2024-04-19T02:17:34.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.180 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:34.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:34.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.144375+0000", 2024-04-19T02:17:34.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:34.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:34.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.144375+0000", 2024-04-19T02:17:34.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:34.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:34.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.144374+0000", 2024-04-19T02:17:34.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:34.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:34.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.144377+0000", 2024-04-19T02:17:34.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8219999999999998e-06 2024-04-19T02:17:34.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:34.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.144383+0000", 2024-04-19T02:17:34.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6579999999999999e-06 2024-04-19T02:17:34.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:34.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.144387+0000", 2024-04-19T02:17:34.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7570000000000004e-06 2024-04-19T02:17:34.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:34.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.144420+0000", 2024-04-19T02:17:34.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2768000000000002e-05 2024-04-19T02:17:34.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:34.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.144502+0000", 2024-04-19T02:17:34.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1562000000000003e-05 2024-04-19T02:17:34.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:34.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.144568+0000", 2024-04-19T02:17:34.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6241999999999994e-05 2024-04-19T02:17:34.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:34.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:34.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:34.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:34.146312+0000", 2024-04-19T02:17:34.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001743938 2024-04-19T02:17:34.183 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:34.183 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:34.183 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:34.183 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:34.184 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-04-19T02:17:34.184 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 9 2024-04-19T02:17:34.184 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:34.185 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:34.185 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:34.185+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:34.262 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:17:34.282 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:17:34.283 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:17:34.283 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:17:34.283 INFO:teuthology.orchestra.run.smithi121.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T02:17:34.285 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:17:34.286 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:17:34.286 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:34.285+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:34.336 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T02:17:34.386 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:34.386+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:34.397 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:34.397 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:34.411 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:34.487 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:34.488+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:34.589 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:34.588+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:34.624 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:34.624 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:34.638 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:17:34.689 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:34.689+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:34.790 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:34.790+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:34.817 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:34.817 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:34.831 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:17:34.890 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:34.890+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:34.991 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:34.991+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:35.056 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:35.056 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:35.068 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:17:35.091 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:35.091+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:35.192 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:35.192+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:35.248 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:35.248 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:35.258 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:35.299 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:35.299+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:35.343 INFO:teuthology.orchestra.run.smithi121.stderr:noscrub is unset 2024-04-19T02:17:35.394 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:35.394+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:35.434 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:35.434 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:35.447 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:35.494 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:35.494+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:35.596 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:35.596+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:35.665 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:35.665 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:35.678 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:35.722 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:35.721+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:35.797 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:35.797+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:35.851 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:35.851 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:35.865 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:17:35.906 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:35.906+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:35.927 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [2] live_osds: [0, 1] 2024-04-19T02:17:35.927 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T02:17:35.927 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-04-19T02:17:35.927 INFO:tasks.thrashosds.thrasher:Setting osd 2 primary_affinity to 0.625482 2024-04-19T02:17:35.927 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 0.6254817375594375 2024-04-19T02:17:35.999 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:35.999+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:36.040 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:36.040 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:36.052 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:17:36.100 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:36.100+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:36.201 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:36.201+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:36.231 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:36.231 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:36.245 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:17:36.286 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:17:36.330 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:36.330+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:36.344 INFO:teuthology.orchestra.run.smithi121.stderr:set osd.2 primary-affinity to 0.625482 (8409912) 2024-04-19T02:17:36.402 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:36.402+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:36.443 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:17:36.459 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:36.459 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:36.463 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:17:36.463 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:17:36.464 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:17:36.464 INFO:teuthology.orchestra.run.smithi121.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T02:17:36.466 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:17:36.467 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:17:36.472 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:36.516 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:36.516+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:36.604 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:36.604+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:36.648 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:36.649 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:17:36.649 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.649 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:237048 5.2 5:4c04b52d:::benchmark_data_smithi121_44835_object103013:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:36.649 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:36.637546+0000", 2024-04-19T02:17:36.649 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.010185961, 2024-04-19T02:17:36.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010215535, 2024-04-19T02:17:36.649 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:36.650 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:36.650 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:36.650 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:36.650 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:36.650 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 237048 2024-04-19T02:17:36.650 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.650 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:36.650 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.650 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:36.650 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.637546+0000", 2024-04-19T02:17:36.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:36.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:36.651 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.637546+0000", 2024-04-19T02:17:36.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:36.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:36.651 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.637545+0000", 2024-04-19T02:17:36.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:36.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:36.651 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.637549+0000", 2024-04-19T02:17:36.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5090000000000002e-06 2024-04-19T02:17:36.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:36.652 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.637557+0000", 2024-04-19T02:17:36.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4600000000000003e-06 2024-04-19T02:17:36.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.652 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.637566+0000", 2024-04-19T02:17:36.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8529999999999998e-06 2024-04-19T02:17:36.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:36.652 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.640795+0000", 2024-04-19T02:17:36.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032293460000000001 2024-04-19T02:17:36.653 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.653 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:36.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.640923+0000", 2024-04-19T02:17:36.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000128143 2024-04-19T02:17:36.653 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:36.653 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:36.653 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:36.653 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.653 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:237055 5.3 5:c2fa94db:::benchmark_data_smithi121_44835_object103020:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:36.653 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:36.640977+0000", 2024-04-19T02:17:36.653 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0067549359999999996, 2024-04-19T02:17:36.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0068657739999999998, 2024-04-19T02:17:36.654 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:36.654 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:36.654 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:36.654 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:36.654 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:36.654 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 237055 2024-04-19T02:17:36.654 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.654 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:36.654 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.654 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:36.654 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.640977+0000", 2024-04-19T02:17:36.654 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:36.654 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.654 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.655 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:36.655 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.640977+0000", 2024-04-19T02:17:36.655 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:36.655 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.655 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.655 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:36.655 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.640976+0000", 2024-04-19T02:17:36.655 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:36.655 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.655 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.655 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:36.656 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.640979+0000", 2024-04-19T02:17:36.656 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2959999999999999e-06 2024-04-19T02:17:36.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.656 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.656 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:36.656 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.640987+0000", 2024-04-19T02:17:36.656 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4599999999999997e-06 2024-04-19T02:17:36.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.656 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.656 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.656 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.640993+0000", 2024-04-19T02:17:36.656 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.404e-06 2024-04-19T02:17:36.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.656 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.656 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:36.657 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.641026+0000", 2024-04-19T02:17:36.657 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2515000000000003e-05 2024-04-19T02:17:36.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.657 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.657 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:36.657 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.641132+0000", 2024-04-19T02:17:36.657 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000106443 2024-04-19T02:17:36.657 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:36.657 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:36.657 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:36.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.657 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.657 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:237056 5.3 5:ca88da45:::benchmark_data_smithi121_44835_object103021:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:36.657 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:36.641003+0000", 2024-04-19T02:17:36.657 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0067285799999999996, 2024-04-19T02:17:36.658 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0069105369999999996, 2024-04-19T02:17:36.658 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:36.658 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:36.658 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:36.658 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:36.658 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:36.658 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 237056 2024-04-19T02:17:36.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.658 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:36.658 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.658 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:36.658 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.641003+0000", 2024-04-19T02:17:36.658 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:36.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.658 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.659 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:36.659 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.641003+0000", 2024-04-19T02:17:36.659 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:36.659 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.659 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.659 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:36.659 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.641002+0000", 2024-04-19T02:17:36.659 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:36.659 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.659 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.659 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:36.659 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.641005+0000", 2024-04-19T02:17:36.659 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8870000000000001e-06 2024-04-19T02:17:36.659 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.659 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.660 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:36.660 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.641013+0000", 2024-04-19T02:17:36.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1899999999999998e-06 2024-04-19T02:17:36.660 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.660 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.660 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.641018+0000", 2024-04-19T02:17:36.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5330000000000002e-06 2024-04-19T02:17:36.660 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.660 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:36.660 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.644361+0000", 2024-04-19T02:17:36.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033426010000000002 2024-04-19T02:17:36.660 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.660 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:36.661 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.644458+0000", 2024-04-19T02:17:36.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7471000000000002e-05 2024-04-19T02:17:36.661 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:36.661 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:36.661 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:36.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.661 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.661 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:237057 5.2 5:47e736a3:::benchmark_data_smithi121_44835_object103022:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:36.661 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:36.641030+0000", 2024-04-19T02:17:36.661 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0067016009999999997, 2024-04-19T02:17:36.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0069553530000000001, 2024-04-19T02:17:36.661 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:36.661 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:36.661 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:36.661 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:36.662 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:36.662 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 237057 2024-04-19T02:17:36.662 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.662 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:36.662 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.662 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:36.662 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.641030+0000", 2024-04-19T02:17:36.662 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:36.662 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.662 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.662 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:36.662 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.641030+0000", 2024-04-19T02:17:36.662 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:36.662 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:36.663 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.641030+0000", 2024-04-19T02:17:36.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:36.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:36.663 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.641032+0000", 2024-04-19T02:17:36.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.672e-06 2024-04-19T02:17:36.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:36.663 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.641039+0000", 2024-04-19T02:17:36.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5590000000000002e-06 2024-04-19T02:17:36.664 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.664 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.664 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.664 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.641044+0000", 2024-04-19T02:17:36.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3569999999999997e-06 2024-04-19T02:17:36.664 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.664 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.664 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:36.664 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.642126+0000", 2024-04-19T02:17:36.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001081577 2024-04-19T02:17:36.664 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.664 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.664 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:36.664 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.642229+0000", 2024-04-19T02:17:36.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000103414 2024-04-19T02:17:36.665 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:36.665 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:36.665 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:36.665 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.665 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.665 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:237063 5.3 5:c9bb4375:::benchmark_data_smithi121_44835_object103028:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:36.665 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:36.644227+0000", 2024-04-19T02:17:36.665 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.003504577, 2024-04-19T02:17:36.665 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038316930000000002, 2024-04-19T02:17:36.665 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:36.665 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:36.665 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:36.665 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:36.665 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:36.665 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 237063 2024-04-19T02:17:36.666 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.666 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:36.666 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.666 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:36.666 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.644227+0000", 2024-04-19T02:17:36.666 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:36.666 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.666 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.666 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:36.666 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.644227+0000", 2024-04-19T02:17:36.666 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:36.666 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.666 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.666 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:36.667 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.644226+0000", 2024-04-19T02:17:36.667 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:36.667 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.667 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.667 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:36.667 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.644231+0000", 2024-04-19T02:17:36.667 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7979999999999996e-06 2024-04-19T02:17:36.667 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.667 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.667 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:36.667 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.644243+0000", 2024-04-19T02:17:36.667 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2087e-05 2024-04-19T02:17:36.667 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.668 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.644251+0000", 2024-04-19T02:17:36.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3869999999999995e-06 2024-04-19T02:17:36.668 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:36.668 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.646005+0000", 2024-04-19T02:17:36.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001753997 2024-04-19T02:17:36.668 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:36.668 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.646079+0000", 2024-04-19T02:17:36.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3195999999999995e-05 2024-04-19T02:17:36.669 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:36.669 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:36.669 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:36.669 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.669 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.669 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:237064 5.9 5:9114bf42:::benchmark_data_smithi121_44835_object103029:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:36.669 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:36.644259+0000", 2024-04-19T02:17:36.669 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0034725279999999999, 2024-04-19T02:17:36.669 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038679209999999999, 2024-04-19T02:17:36.669 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:36.669 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:36.669 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:36.669 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:36.669 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:36.669 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 237064 2024-04-19T02:17:36.670 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.670 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:36.670 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.670 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:36.670 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.644259+0000", 2024-04-19T02:17:36.670 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:36.670 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.671 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:36.671 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.644259+0000", 2024-04-19T02:17:36.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:36.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.671 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:36.671 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.644259+0000", 2024-04-19T02:17:36.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:36.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.671 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:36.671 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.644261+0000", 2024-04-19T02:17:36.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7879999999999998e-06 2024-04-19T02:17:36.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.672 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.672 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:36.672 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.644269+0000", 2024-04-19T02:17:36.672 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4699999999999996e-06 2024-04-19T02:17:36.672 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.672 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.672 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.672 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.644274+0000", 2024-04-19T02:17:36.672 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4659999999999998e-06 2024-04-19T02:17:36.672 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.672 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.672 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:36.672 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.644326+0000", 2024-04-19T02:17:36.672 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2185000000000003e-05 2024-04-19T02:17:36.673 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.673 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.673 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:36.673 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.644451+0000", 2024-04-19T02:17:36.673 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012490799999999999 2024-04-19T02:17:36.673 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.673 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.673 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:36.673 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.644572+0000", 2024-04-19T02:17:36.673 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120627 2024-04-19T02:17:36.673 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.673 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.673 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:36.673 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.646622+0000", 2024-04-19T02:17:36.674 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002050142 2024-04-19T02:17:36.674 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:36.674 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:36.674 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:36.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.674 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.674 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:237065 5.d 5:b56abd82:::benchmark_data_smithi121_44835_object103030:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:36.674 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:36.644291+0000", 2024-04-19T02:17:36.674 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0034403229999999999, 2024-04-19T02:17:36.674 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039183849999999999, 2024-04-19T02:17:36.674 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:36.674 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:36.674 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:36.674 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:36.675 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:36.675 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 237065 2024-04-19T02:17:36.675 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.675 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:36.675 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.675 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:36.675 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.644291+0000", 2024-04-19T02:17:36.675 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:36.675 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.675 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.675 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:36.675 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.644291+0000", 2024-04-19T02:17:36.675 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:36.675 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.676 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.676 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:36.676 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.644291+0000", 2024-04-19T02:17:36.676 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:36.676 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.676 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.676 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:36.676 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.644294+0000", 2024-04-19T02:17:36.676 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3969999999999998e-06 2024-04-19T02:17:36.676 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.676 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.676 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:36.676 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.644302+0000", 2024-04-19T02:17:36.676 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6140000000000003e-06 2024-04-19T02:17:36.676 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.676 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.677 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.677 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.644307+0000", 2024-04-19T02:17:36.677 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6949999999999997e-06 2024-04-19T02:17:36.677 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.677 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.677 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:36.677 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.644410+0000", 2024-04-19T02:17:36.677 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010289 2024-04-19T02:17:36.677 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.677 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.678 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:36.678 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.644536+0000", 2024-04-19T02:17:36.678 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012534699999999999 2024-04-19T02:17:36.678 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.678 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.678 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:36.679 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.644647+0000", 2024-04-19T02:17:36.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011144199999999999 2024-04-19T02:17:36.679 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:36.679 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:36.679 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:36.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.679 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.679 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:237066 5.c 5:3aad6a84:::benchmark_data_smithi121_44835_object103031:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:36.679 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:36.644442+0000", 2024-04-19T02:17:36.679 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.003289831, 2024-04-19T02:17:36.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038471209999999998, 2024-04-19T02:17:36.679 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:36.679 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:36.679 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:36.680 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:36.680 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:36.680 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 237066 2024-04-19T02:17:36.680 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.680 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:36.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.680 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:36.680 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.644442+0000", 2024-04-19T02:17:36.680 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:36.680 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.680 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:36.680 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.644442+0000", 2024-04-19T02:17:36.681 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:36.681 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.681 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.681 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:36.681 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.644441+0000", 2024-04-19T02:17:36.681 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:36.681 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.681 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.681 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:36.681 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.644446+0000", 2024-04-19T02:17:36.681 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7430000000000002e-06 2024-04-19T02:17:36.682 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.682 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.682 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:36.682 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.644455+0000", 2024-04-19T02:17:36.682 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4069999999999999e-06 2024-04-19T02:17:36.682 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.682 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.682 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.682 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.644462+0000", 2024-04-19T02:17:36.682 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6069999999999996e-06 2024-04-19T02:17:36.682 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.682 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.682 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:36.682 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.644576+0000", 2024-04-19T02:17:36.683 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000114504 2024-04-19T02:17:36.683 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.683 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.683 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:36.683 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.644708+0000", 2024-04-19T02:17:36.683 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013183499999999999 2024-04-19T02:17:36.683 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:36.683 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:36.683 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:36.683 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.683 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.683 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:237068 5.d 5:b2295654:::benchmark_data_smithi121_44835_object103033:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:36.683 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:36.644556+0000", 2024-04-19T02:17:36.683 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0031757270000000002, 2024-04-19T02:17:36.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003800744, 2024-04-19T02:17:36.684 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:36.684 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:36.684 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:36.684 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:36.684 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:36.684 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 237068 2024-04-19T02:17:36.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.684 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:36.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.684 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:36.684 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.644556+0000", 2024-04-19T02:17:36.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:36.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:36.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.644556+0000", 2024-04-19T02:17:36.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:36.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:36.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.644555+0000", 2024-04-19T02:17:36.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:36.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:36.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.644561+0000", 2024-04-19T02:17:36.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7400000000000001e-06 2024-04-19T02:17:36.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:36.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.644570+0000", 2024-04-19T02:17:36.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8710000000000003e-06 2024-04-19T02:17:36.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.644577+0000", 2024-04-19T02:17:36.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.498e-06 2024-04-19T02:17:36.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:36.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.646517+0000", 2024-04-19T02:17:36.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001940111 2024-04-19T02:17:36.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.687 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.687 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:36.687 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.646631+0000", 2024-04-19T02:17:36.687 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011349 2024-04-19T02:17:36.687 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.687 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.687 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:36.687 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.646704+0000", 2024-04-19T02:17:36.687 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3668e-05 2024-04-19T02:17:36.687 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:36.687 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:36.687 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:36.687 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.688 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.688 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:237069 5.2 5:405f25ae:::benchmark_data_smithi121_44835_object103034:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:36.688 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:36.644670+0000", 2024-04-19T02:17:36.688 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0030619900000000001, 2024-04-19T02:17:36.688 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037725979999999998, 2024-04-19T02:17:36.688 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:36.688 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:36.688 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:36.688 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:36.688 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:36.688 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 237069 2024-04-19T02:17:36.689 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.689 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:36.689 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.689 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:36.689 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.644670+0000", 2024-04-19T02:17:36.689 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:36.689 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.689 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.689 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:36.689 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.644670+0000", 2024-04-19T02:17:36.689 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:36.689 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.689 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.689 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:36.690 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.644669+0000", 2024-04-19T02:17:36.690 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:36.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.690 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.690 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:36.690 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.644673+0000", 2024-04-19T02:17:36.690 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2950000000000004e-06 2024-04-19T02:17:36.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.690 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.690 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:36.690 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.644682+0000", 2024-04-19T02:17:36.690 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.49e-06 2024-04-19T02:17:36.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.690 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.691 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.644688+0000", 2024-04-19T02:17:36.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4790000000000001e-06 2024-04-19T02:17:36.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:36.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.646545+0000", 2024-04-19T02:17:36.694 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001856814 2024-04-19T02:17:36.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.695 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.695 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:36.695 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.646700+0000", 2024-04-19T02:17:36.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015527800000000001 2024-04-19T02:17:36.695 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:36.695 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:36.695 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:36.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.695 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.696 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:237071 5.3 5:cf9d4628:::benchmark_data_smithi121_44835_object103036:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:36.696 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:36.646831+0000", 2024-04-19T02:17:36.696 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00090071400000000005, 2024-04-19T02:17:36.696 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0016856169999999999, 2024-04-19T02:17:36.696 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:36.696 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:36.696 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:36.697 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:36.697 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:36.697 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 237071 2024-04-19T02:17:36.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.697 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:36.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.697 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:36.697 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.646831+0000", 2024-04-19T02:17:36.697 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:36.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.697 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:36.697 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.646831+0000", 2024-04-19T02:17:36.697 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:36.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.698 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:36.698 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.646830+0000", 2024-04-19T02:17:36.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:36.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.698 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:36.698 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.646834+0000", 2024-04-19T02:17:36.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.98e-06 2024-04-19T02:17:36.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.698 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:36.698 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.646843+0000", 2024-04-19T02:17:36.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1740000000000006e-06 2024-04-19T02:17:36.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.646851+0000", 2024-04-19T02:17:36.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3839999999999999e-06 2024-04-19T02:17:36.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:36.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.647275+0000", 2024-04-19T02:17:36.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00042413999999999999 2024-04-19T02:17:36.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:36.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.647353+0000", 2024-04-19T02:17:36.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8542999999999997e-05 2024-04-19T02:17:36.700 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:36.700 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:36.700 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:36.700 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.700 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:237074 5.d 5:be4fb503:::benchmark_data_smithi121_44835_object103039:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:36.700 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:36.647972+0000", 2024-04-19T02:17:36.700 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9997592, 2024-04-19T02:17:36.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00062392999999999997, 2024-04-19T02:17:36.700 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:36.700 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:36.700 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:36.700 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:36.700 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:36.700 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 237074 2024-04-19T02:17:36.701 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.701 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:36.701 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.701 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:36.701 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.647972+0000", 2024-04-19T02:17:36.701 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:36.701 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.701 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.701 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:36.701 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.647972+0000", 2024-04-19T02:17:36.701 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:36.701 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.701 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.701 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:36.701 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.647972+0000", 2024-04-19T02:17:36.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:36.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.702 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:36.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.647976+0000", 2024-04-19T02:17:36.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1679999999999997e-06 2024-04-19T02:17:36.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.702 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:36.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.647985+0000", 2024-04-19T02:17:36.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2099999999999999e-06 2024-04-19T02:17:36.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.703 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.703 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.647992+0000", 2024-04-19T02:17:36.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9929999999999998e-06 2024-04-19T02:17:36.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.703 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:36.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.648096+0000", 2024-04-19T02:17:36.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104461 2024-04-19T02:17:36.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:36.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.648217+0000", 2024-04-19T02:17:36.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012022400000000001 2024-04-19T02:17:36.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.705 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:36.705 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.648337+0000", 2024-04-19T02:17:36.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120801 2024-04-19T02:17:36.705 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:36.705 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:36.706 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:36.706 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.706 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:237075 5.d 5.cbbe8acd (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:36.706 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:36.648038+0000", 2024-04-19T02:17:36.706 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9996934, 2024-04-19T02:17:36.706 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000641787, 2024-04-19T02:17:36.706 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:36.706 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-04-19T02:17:36.706 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:36.706 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:36.706 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:36.706 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 237075 2024-04-19T02:17:36.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.707 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:36.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:36.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.648038+0000", 2024-04-19T02:17:36.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:36.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:36.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.648038+0000", 2024-04-19T02:17:36.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:36.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:36.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.648037+0000", 2024-04-19T02:17:36.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:36.708 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:36.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.648041+0000", 2024-04-19T02:17:36.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8319999999999999e-06 2024-04-19T02:17:36.708 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:36.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.648049+0000", 2024-04-19T02:17:36.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4939999999999997e-06 2024-04-19T02:17:36.708 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.648055+0000", 2024-04-19T02:17:36.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4359999999999999e-06 2024-04-19T02:17:36.709 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:36.709 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:36.709 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:36.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.709 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:237077 5.7 5:e4ee7fff:::benchmark_data_smithi121_44835_object103042:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:36.709 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:36.648597+0000", 2024-04-19T02:17:36.709 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9991345, 2024-04-19T02:17:36.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015005500000000001, 2024-04-19T02:17:36.709 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:36.709 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-04-19T02:17:36.709 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:36.709 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:36.709 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:36.709 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 237077 2024-04-19T02:17:36.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.710 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:36.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:36.710 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.648597+0000", 2024-04-19T02:17:36.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:36.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:36.710 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.648597+0000", 2024-04-19T02:17:36.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:36.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.711 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:36.711 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.648596+0000", 2024-04-19T02:17:36.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:36.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.711 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:36.711 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.648601+0000", 2024-04-19T02:17:36.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0629999999999996e-06 2024-04-19T02:17:36.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.711 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:36.711 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.648611+0000", 2024-04-19T02:17:36.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0045e-05 2024-04-19T02:17:36.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:36.712 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.648619+0000", 2024-04-19T02:17:36.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6890000000000004e-06 2024-04-19T02:17:36.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:36.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:36.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:36.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:36.648658+0000", 2024-04-19T02:17:36.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8679e-05 2024-04-19T02:17:36.713 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:36.713 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:36.713 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:36.713 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:36.714 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-04-19T02:17:36.714 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 14 2024-04-19T02:17:36.714 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:36.716 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:36.717 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:36.715+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:36.816 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:36.816+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:36.917 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:36.917+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:36.932 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:36.932 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-04-19T02:17:36.932 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-04-19T02:17:36.933 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-04-19T02:17:36.933 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:36.946 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:37.018 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:37.017+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:37.118 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:37.118+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:37.120 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:37.120 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-04-19T02:17:37.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-04-19T02:17:37.121 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:17:37.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.121 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:37.121 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:17:37.121 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 127.849998513, 2024-04-19T02:17:37.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022007204999999998, 2024-04-19T02:17:37.121 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:37.121 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:37.121 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:37.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:37.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:17:37.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:37.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:37.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269991+0000", 2024-04-19T02:17:37.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:37.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:37.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269990+0000", 2024-04-19T02:17:37.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:37.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:37.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.269999+0000", 2024-04-19T02:17:37.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9539999999999993e-06 2024-04-19T02:17:37.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.123 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:37.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270006+0000", 2024-04-19T02:17:37.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.216e-06 2024-04-19T02:17:37.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.123 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270012+0000", 2024-04-19T02:17:37.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5049999999999998e-06 2024-04-19T02:17:37.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.123 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:37.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270058+0000", 2024-04-19T02:17:37.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.634e-05 2024-04-19T02:17:37.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:37.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270064+0000", 2024-04-19T02:17:37.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0669999999999997e-06 2024-04-19T02:17:37.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:37.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287159+0000", 2024-04-19T02:17:37.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017095086999999998 2024-04-19T02:17:37.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:37.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287254+0000", 2024-04-19T02:17:37.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4716000000000006e-05 2024-04-19T02:17:37.125 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.125 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.125 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:37.125 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287389+0000", 2024-04-19T02:17:37.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013511900000000001 2024-04-19T02:17:37.125 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.125 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.125 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:37.125 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290481+0000", 2024-04-19T02:17:37.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030920169999999999 2024-04-19T02:17:37.125 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.125 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.125 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:37.125 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291931+0000", 2024-04-19T02:17:37.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001450118 2024-04-19T02:17:37.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.126 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:37.126 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291960+0000", 2024-04-19T02:17:37.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9096000000000001e-05 2024-04-19T02:17:37.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.126 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:37.126 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291998+0000", 2024-04-19T02:17:37.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7514e-05 2024-04-19T02:17:37.126 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:37.126 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:37.126 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:37.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.127 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:37.127 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:17:37.127 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 127.849887737, 2024-04-19T02:17:37.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020837887999999999, 2024-04-19T02:17:37.127 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:37.127 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:37.127 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:37.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:37.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:17:37.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:37.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:37.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:17:37.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:37.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:37.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270101+0000", 2024-04-19T02:17:37.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:37.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:37.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270109+0000", 2024-04-19T02:17:37.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3110000000000006e-06 2024-04-19T02:17:37.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.129 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:37.129 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270117+0000", 2024-04-19T02:17:37.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0479999999999999e-06 2024-04-19T02:17:37.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.129 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.129 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270123+0000", 2024-04-19T02:17:37.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5500000000000002e-06 2024-04-19T02:17:37.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.129 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:37.129 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270150+0000", 2024-04-19T02:17:37.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7712000000000002e-05 2024-04-19T02:17:37.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.130 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:37.130 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270153+0000", 2024-04-19T02:17:37.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6089999999999999e-06 2024-04-19T02:17:37.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.130 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:37.130 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.285958+0000", 2024-04-19T02:17:37.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015805274000000001 2024-04-19T02:17:37.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.130 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:37.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286126+0000", 2024-04-19T02:17:37.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016765700000000001 2024-04-19T02:17:37.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:37.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.286296+0000", 2024-04-19T02:17:37.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017007 2024-04-19T02:17:37.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:37.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290426+0000", 2024-04-19T02:17:37.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041299839999999997 2024-04-19T02:17:37.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.132 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:37.132 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290867+0000", 2024-04-19T02:17:37.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00044083300000000001 2024-04-19T02:17:37.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.132 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:37.132 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290900+0000", 2024-04-19T02:17:37.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3380000000000002e-05 2024-04-19T02:17:37.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.132 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:37.132 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.290939+0000", 2024-04-19T02:17:37.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8970000000000001e-05 2024-04-19T02:17:37.133 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:37.133 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:37.133 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:37.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.133 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:21 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:37.133 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:17:37.133 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 127.849799065, 2024-04-19T02:17:37.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020833187999999999, 2024-04-19T02:17:37.133 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:37.133 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:37.133 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:37.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.133 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:37.133 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:17:37.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:37.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:37.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270190+0000", 2024-04-19T02:17:37.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:37.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:37.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270189+0000", 2024-04-19T02:17:37.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:37.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:37.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270192+0000", 2024-04-19T02:17:37.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7549999999999999e-06 2024-04-19T02:17:37.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:37.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270198+0000", 2024-04-19T02:17:37.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0859999999999998e-06 2024-04-19T02:17:37.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270204+0000", 2024-04-19T02:17:37.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1970000000000004e-06 2024-04-19T02:17:37.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.136 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:37.136 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270238+0000", 2024-04-19T02:17:37.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4282000000000001e-05 2024-04-19T02:17:37.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.136 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:37.136 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.270240+0000", 2024-04-19T02:17:37.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3099999999999999e-06 2024-04-19T02:17:37.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.136 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:37.136 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287131+0000", 2024-04-19T02:17:37.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01689104 2024-04-19T02:17:37.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:37.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.287262+0000", 2024-04-19T02:17:37.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130347 2024-04-19T02:17:37.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:37.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:15:29.291023+0000", 2024-04-19T02:17:37.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037616350000000002 2024-04-19T02:17:37.137 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:37.137 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:37.137 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:37.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.137 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:94468 5.2 5:4f406431:::benchmark_data_smithi121_44835_object94467:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T02:17:37.137 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:17:37.138 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 62.008559882999997, 2024-04-19T02:17:37.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024835144999999999, 2024-04-19T02:17:37.138 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:37.138 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:37.138 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:37.138 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:37.138 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:37.138 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 94468 2024-04-19T02:17:37.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.138 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:37.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.138 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:37.138 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:17:37.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:37.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:37.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:17:37.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:37.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:37.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111429+0000", 2024-04-19T02:17:37.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:37.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:37.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111498+0000", 2024-04-19T02:17:37.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9529000000000005e-05 2024-04-19T02:17:37.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:37.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111506+0000", 2024-04-19T02:17:37.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9030000000000004e-06 2024-04-19T02:17:37.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.111513+0000", 2024-04-19T02:17:37.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8759999999999999e-06 2024-04-19T02:17:37.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:37.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112466+0000", 2024-04-19T02:17:37.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00095318499999999995 2024-04-19T02:17:37.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:37.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112590+0000", 2024-04-19T02:17:37.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012380900000000001 2024-04-19T02:17:37.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:37.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.112728+0000", 2024-04-19T02:17:37.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013753800000000001 2024-04-19T02:17:37.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:37.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115064+0000", 2024-04-19T02:17:37.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002336819 2024-04-19T02:17:37.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.142 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:37.142 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136207+0000", 2024-04-19T02:17:37.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021142942000000001 2024-04-19T02:17:37.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.142 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:37.142 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136241+0000", 2024-04-19T02:17:37.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3577000000000001e-05 2024-04-19T02:17:37.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.142 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:37.143 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136264+0000", 2024-04-19T02:17:37.143 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3421000000000002e-05 2024-04-19T02:17:37.143 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:37.143 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:37.143 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:37.143 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.143 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.143 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:94472 5.2 5:45b7e9be:::benchmark_data_smithi121_44835_object94471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:37.143 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:17:37.143 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 62.004913352000003, 2024-04-19T02:17:37.143 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021273843000000001, 2024-04-19T02:17:37.143 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:37.143 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:37.143 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:37.144 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:37.144 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:37.144 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 94472 2024-04-19T02:17:37.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.144 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:37.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.144 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:37.144 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:17:37.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:37.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.144 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:37.144 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115076+0000", 2024-04-19T02:17:37.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:37.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:37.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115075+0000", 2024-04-19T02:17:37.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:37.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:37.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115161+0000", 2024-04-19T02:17:37.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6632000000000007e-05 2024-04-19T02:17:37.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:37.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115171+0000", 2024-04-19T02:17:37.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2969999999999992e-06 2024-04-19T02:17:37.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115178+0000", 2024-04-19T02:17:37.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7610000000000007e-06 2024-04-19T02:17:37.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:37.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115213+0000", 2024-04-19T02:17:37.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5000999999999999e-05 2024-04-19T02:17:37.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:37.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115303+0000", 2024-04-19T02:17:37.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9791999999999997e-05 2024-04-19T02:17:37.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.147 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:37.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.115391+0000", 2024-04-19T02:17:37.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7559000000000007e-05 2024-04-19T02:17:37.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.147 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:37.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.117894+0000", 2024-04-19T02:17:37.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002503496 2024-04-19T02:17:37.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.147 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:37.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136297+0000", 2024-04-19T02:17:37.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018402335999999998 2024-04-19T02:17:37.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:37.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136327+0000", 2024-04-19T02:17:37.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0534999999999998e-05 2024-04-19T02:17:37.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:37.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:35.136350+0000", 2024-04-19T02:17:37.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2427999999999999e-05 2024-04-19T02:17:37.148 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:37.148 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:37.148 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:37.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.149 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:129219 5.2 5:45e7e1f4:::benchmark_data_smithi121_44835_object129218:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T02:17:37.149 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:16:52.629592+0000", 2024-04-19T02:17:37.149 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 44.490397098999999, 2024-04-19T02:17:37.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021099489999999999, 2024-04-19T02:17:37.149 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:37.149 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:37.149 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:37.149 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:37.149 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:37.149 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 129219 2024-04-19T02:17:37.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.149 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:37.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:37.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629592+0000", 2024-04-19T02:17:37.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:37.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:37.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629592+0000", 2024-04-19T02:17:37.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:37.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:37.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629591+0000", 2024-04-19T02:17:37.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:37.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:37.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629618+0000", 2024-04-19T02:17:37.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6970000000000001e-05 2024-04-19T02:17:37.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:37.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629639+0000", 2024-04-19T02:17:37.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0701999999999999e-05 2024-04-19T02:17:37.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.629645+0000", 2024-04-19T02:17:37.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2299999999999996e-06 2024-04-19T02:17:37.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:37.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.635658+0000", 2024-04-19T02:17:37.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0060127549999999998 2024-04-19T02:17:37.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:37.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.635811+0000", 2024-04-19T02:17:37.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015305700000000001 2024-04-19T02:17:37.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:37.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.635967+0000", 2024-04-19T02:17:37.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015578599999999999 2024-04-19T02:17:37.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:37.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.642488+0000", 2024-04-19T02:17:37.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0065215619999999998 2024-04-19T02:17:37.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:37.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650603+0000", 2024-04-19T02:17:37.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0081144900000000002 2024-04-19T02:17:37.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:37.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650652+0000", 2024-04-19T02:17:37.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9079999999999998e-05 2024-04-19T02:17:37.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:37.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:16:52.650691+0000", 2024-04-19T02:17:37.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9501e-05 2024-04-19T02:17:37.154 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:37.154 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:37.154 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:37.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.154 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:157448 5.7 5:ed833a19:::benchmark_data_smithi121_44835_object23413:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:37.154 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:06.870566+0000", 2024-04-19T02:17:37.154 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.249422517999999, 2024-04-19T02:17:37.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023031238999999998, 2024-04-19T02:17:37.154 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:37.154 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:37.155 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:37.155 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:37.155 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:37.155 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 157448 2024-04-19T02:17:37.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.155 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:37.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:37.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870566+0000", 2024-04-19T02:17:37.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:37.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:37.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870566+0000", 2024-04-19T02:17:37.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:37.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:37.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870566+0000", 2024-04-19T02:17:37.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:37.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:37.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870570+0000", 2024-04-19T02:17:37.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1620000000000001e-06 2024-04-19T02:17:37.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:37.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870577+0000", 2024-04-19T02:17:37.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2069999999999998e-06 2024-04-19T02:17:37.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870587+0000", 2024-04-19T02:17:37.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6919999999999997e-06 2024-04-19T02:17:37.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:37.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870615+0000", 2024-04-19T02:17:37.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8351999999999999e-05 2024-04-19T02:17:37.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:37.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870715+0000", 2024-04-19T02:17:37.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9624999999999996e-05 2024-04-19T02:17:37.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:37.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.870805+0000", 2024-04-19T02:17:37.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0067000000000004e-05 2024-04-19T02:17:37.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:37.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.872773+0000", 2024-04-19T02:17:37.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001968605 2024-04-19T02:17:37.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:37.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.893514+0000", 2024-04-19T02:17:37.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020740082999999999 2024-04-19T02:17:37.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:37.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.893558+0000", 2024-04-19T02:17:37.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4110999999999998e-05 2024-04-19T02:17:37.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:37.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.893598+0000", 2024-04-19T02:17:37.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0077000000000003e-05 2024-04-19T02:17:37.159 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:37.159 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:37.159 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:37.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.160 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:157498 5.7 5:eb39b43d:::benchmark_data_smithi121_44835_object23463:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:37.160 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:06.911721+0000", 2024-04-19T02:17:37.160 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.208267873, 2024-04-19T02:17:37.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023313438999999998, 2024-04-19T02:17:37.160 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:37.160 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:37.160 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:37.160 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:37.160 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:37.160 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 157498 2024-04-19T02:17:37.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.160 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:37.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:37.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911721+0000", 2024-04-19T02:17:37.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:37.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:37.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911721+0000", 2024-04-19T02:17:37.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:37.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:37.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911720+0000", 2024-04-19T02:17:37.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:37.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:37.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911726+0000", 2024-04-19T02:17:37.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3179999999999997e-06 2024-04-19T02:17:37.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:37.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911746+0000", 2024-04-19T02:17:37.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0574e-05 2024-04-19T02:17:37.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911757+0000", 2024-04-19T02:17:37.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0959e-05 2024-04-19T02:17:37.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:37.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911795+0000", 2024-04-19T02:17:37.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7589999999999998e-05 2024-04-19T02:17:37.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:37.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.911912+0000", 2024-04-19T02:17:37.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117625 2024-04-19T02:17:37.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:37.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.912250+0000", 2024-04-19T02:17:37.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00033710599999999999 2024-04-19T02:17:37.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.164 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:37.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.915540+0000", 2024-04-19T02:17:37.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032909559999999998 2024-04-19T02:17:37.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.164 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:37.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.934984+0000", 2024-04-19T02:17:37.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019443670999999999 2024-04-19T02:17:37.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.164 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:37.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.935013+0000", 2024-04-19T02:17:37.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8464999999999999e-05 2024-04-19T02:17:37.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:37.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:06.935035+0000", 2024-04-19T02:17:37.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1954e-05 2024-04-19T02:17:37.165 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:37.165 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:37.165 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:37.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.165 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168377 5.d 5:b1f3fb6d:::benchmark_data_smithi121_44835_object34342:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:37.165 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069470+0000", 2024-04-19T02:17:37.165 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.050519140999999, 2024-04-19T02:17:37.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050516473999999999, 2024-04-19T02:17:37.165 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:37.165 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:37.166 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:37.166 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:37.166 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:37.166 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168377 2024-04-19T02:17:37.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.166 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:37.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:37.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069470+0000", 2024-04-19T02:17:37.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:37.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:37.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069470+0000", 2024-04-19T02:17:37.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:37.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:37.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069469+0000", 2024-04-19T02:17:37.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:37.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:37.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069473+0000", 2024-04-19T02:17:37.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4580000000000002e-06 2024-04-19T02:17:37.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:37.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069482+0000", 2024-04-19T02:17:37.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2839999999999995e-06 2024-04-19T02:17:37.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069489+0000", 2024-04-19T02:17:37.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3579999999999997e-06 2024-04-19T02:17:37.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:37.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069559+0000", 2024-04-19T02:17:37.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9678000000000006e-05 2024-04-19T02:17:37.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:37.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069683+0000", 2024-04-19T02:17:37.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012359400000000001 2024-04-19T02:17:37.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:37.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069759+0000", 2024-04-19T02:17:37.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6834000000000003e-05 2024-04-19T02:17:37.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:37.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119871+0000", 2024-04-19T02:17:37.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050111392999999997 2024-04-19T02:17:37.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:37.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119932+0000", 2024-04-19T02:17:37.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1209000000000003e-05 2024-04-19T02:17:37.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:37.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119962+0000", 2024-04-19T02:17:37.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9717999999999999e-05 2024-04-19T02:17:37.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:37.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119986+0000", 2024-04-19T02:17:37.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4549000000000002e-05 2024-04-19T02:17:37.170 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:37.170 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:37.170 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:37.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.170 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168379 5.d 5:bcd492dd:::benchmark_data_smithi121_44835_object34344:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:37.171 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069502+0000", 2024-04-19T02:17:37.171 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.050487088000001, 2024-04-19T02:17:37.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050544645999999999, 2024-04-19T02:17:37.171 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:37.171 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:37.171 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:37.171 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:37.171 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:37.171 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168379 2024-04-19T02:17:37.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.171 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:37.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:37.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069502+0000", 2024-04-19T02:17:37.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:37.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:37.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069502+0000", 2024-04-19T02:17:37.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:37.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:37.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069501+0000", 2024-04-19T02:17:37.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:37.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:37.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069504+0000", 2024-04-19T02:17:37.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9289999999999998e-06 2024-04-19T02:17:37.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:37.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069511+0000", 2024-04-19T02:17:37.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1909999999999997e-06 2024-04-19T02:17:37.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069517+0000", 2024-04-19T02:17:37.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0789999999999997e-06 2024-04-19T02:17:37.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:37.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071081+0000", 2024-04-19T02:17:37.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0015646550000000001 2024-04-19T02:17:37.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.174 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:37.174 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071195+0000", 2024-04-19T02:17:37.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011399400000000001 2024-04-19T02:17:37.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.174 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:37.174 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071293+0000", 2024-04-19T02:17:37.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7938999999999999e-05 2024-04-19T02:17:37.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.174 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:37.174 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119898+0000", 2024-04-19T02:17:37.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.048604808999999999 2024-04-19T02:17:37.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:37.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119993+0000", 2024-04-19T02:17:37.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5224999999999997e-05 2024-04-19T02:17:37.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:37.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120024+0000", 2024-04-19T02:17:37.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0580999999999997e-05 2024-04-19T02:17:37.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:37.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120047+0000", 2024-04-19T02:17:37.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2725e-05 2024-04-19T02:17:37.176 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:37.176 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:37.176 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:37.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.176 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168381 5.d 5:bcbab0e3:::benchmark_data_smithi121_44835_object34346:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:37.176 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:37.176 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.05046767, 2024-04-19T02:17:37.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050574694000000003, 2024-04-19T02:17:37.176 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:37.176 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:37.176 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:37.176 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:37.176 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:37.177 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168381 2024-04-19T02:17:37.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.177 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:37.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:37.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:37.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:37.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:37.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:37.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:37.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:37.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:37.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:37.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:37.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069523+0000", 2024-04-19T02:17:37.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.244e-06 2024-04-19T02:17:37.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:37.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069528+0000", 2024-04-19T02:17:37.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0669999999999999e-06 2024-04-19T02:17:37.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069533+0000", 2024-04-19T02:17:37.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4680000000000003e-06 2024-04-19T02:17:37.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:37.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072637+0000", 2024-04-19T02:17:37.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031040429999999999 2024-04-19T02:17:37.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:37.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072710+0000", 2024-04-19T02:17:37.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3045000000000003e-05 2024-04-19T02:17:37.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:37.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072775+0000", 2024-04-19T02:17:37.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5034000000000001e-05 2024-04-19T02:17:37.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:37.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119925+0000", 2024-04-19T02:17:37.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.047150594999999997 2024-04-19T02:17:37.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:37.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120055+0000", 2024-04-19T02:17:37.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129288 2024-04-19T02:17:37.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:37.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120077+0000", 2024-04-19T02:17:37.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1759e-05 2024-04-19T02:17:37.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:37.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120096+0000", 2024-04-19T02:17:37.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9524000000000001e-05 2024-04-19T02:17:37.181 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:37.181 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:37.181 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:37.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.181 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168382 5.f 5:f2599a15:::benchmark_data_smithi121_44835_object34347:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:37.181 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069556+0000", 2024-04-19T02:17:37.181 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.050433262999999, 2024-04-19T02:17:37.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050009713999999997, 2024-04-19T02:17:37.182 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:37.182 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:37.182 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:37.182 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:37.182 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:37.182 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168382 2024-04-19T02:17:37.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.182 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:37.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:37.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069556+0000", 2024-04-19T02:17:37.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:37.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:37.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069556+0000", 2024-04-19T02:17:37.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:37.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:37.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069555+0000", 2024-04-19T02:17:37.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:37.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:37.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069558+0000", 2024-04-19T02:17:37.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7879999999999998e-06 2024-04-19T02:17:37.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:37.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069566+0000", 2024-04-19T02:17:37.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6149999999999999e-06 2024-04-19T02:17:37.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069571+0000", 2024-04-19T02:17:37.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5509999999999999e-06 2024-04-19T02:17:37.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:37.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069618+0000", 2024-04-19T02:17:37.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6964e-05 2024-04-19T02:17:37.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:37.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069744+0000", 2024-04-19T02:17:37.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012577199999999999 2024-04-19T02:17:37.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:37.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.070116+0000", 2024-04-19T02:17:37.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000372407 2024-04-19T02:17:37.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:37.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117511+0000", 2024-04-19T02:17:37.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.047394935999999999 2024-04-19T02:17:37.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:37.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119484+0000", 2024-04-19T02:17:37.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019722310000000001 2024-04-19T02:17:37.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:37.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119525+0000", 2024-04-19T02:17:37.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1035999999999998e-05 2024-04-19T02:17:37.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:37.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119565+0000", 2024-04-19T02:17:37.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0859000000000003e-05 2024-04-19T02:17:37.186 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:37.187 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:37.187 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:37.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.187 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168383 5.d 5:bbd9496c:::benchmark_data_smithi121_44835_object34348:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:37.187 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069581+0000", 2024-04-19T02:17:37.187 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.050408375, 2024-04-19T02:17:37.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050607278999999998, 2024-04-19T02:17:37.187 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:37.187 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:37.187 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:37.187 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:37.187 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:37.187 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168383 2024-04-19T02:17:37.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.188 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:37.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:37.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069581+0000", 2024-04-19T02:17:37.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:37.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:37.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069581+0000", 2024-04-19T02:17:37.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:37.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:37.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069580+0000", 2024-04-19T02:17:37.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:37.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:37.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069589+0000", 2024-04-19T02:17:37.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6750000000000008e-06 2024-04-19T02:17:37.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:37.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069596+0000", 2024-04-19T02:17:37.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7360000000000004e-06 2024-04-19T02:17:37.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069601+0000", 2024-04-19T02:17:37.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0479999999999998e-06 2024-04-19T02:17:37.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:37.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.073854+0000", 2024-04-19T02:17:37.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042531920000000003 2024-04-19T02:17:37.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:37.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.073952+0000", 2024-04-19T02:17:37.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7851999999999998e-05 2024-04-19T02:17:37.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:37.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074012+0000", 2024-04-19T02:17:37.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0225e-05 2024-04-19T02:17:37.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:37.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120102+0000", 2024-04-19T02:17:37.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.046090150000000003 2024-04-19T02:17:37.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:37.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120129+0000", 2024-04-19T02:17:37.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7228000000000001e-05 2024-04-19T02:17:37.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:37.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120157+0000", 2024-04-19T02:17:37.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7165000000000002e-05 2024-04-19T02:17:37.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:37.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120188+0000", 2024-04-19T02:17:37.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1418000000000003e-05 2024-04-19T02:17:37.193 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:37.193 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:37.193 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:37.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.193 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168384 5.7 5:ed638f84:::benchmark_data_smithi121_44835_object34349:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:37.193 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069612+0000", 2024-04-19T02:17:37.193 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.050377321999999, 2024-04-19T02:17:37.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049863376000000001, 2024-04-19T02:17:37.193 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:37.193 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:37.193 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:37.193 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:37.193 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:37.194 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168384 2024-04-19T02:17:37.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.194 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:37.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:37.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069612+0000", 2024-04-19T02:17:37.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:37.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:37.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069612+0000", 2024-04-19T02:17:37.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:37.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:37.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069611+0000", 2024-04-19T02:17:37.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:37.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:37.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069614+0000", 2024-04-19T02:17:37.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7819999999999998e-06 2024-04-19T02:17:37.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:37.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069623+0000", 2024-04-19T02:17:37.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6989999999999992e-06 2024-04-19T02:17:37.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069628+0000", 2024-04-19T02:17:37.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4999999999999999e-06 2024-04-19T02:17:37.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:37.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069662+0000", 2024-04-19T02:17:37.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3319999999999999e-05 2024-04-19T02:17:37.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:37.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069782+0000", 2024-04-19T02:17:37.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120547 2024-04-19T02:17:37.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:37.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119338+0000", 2024-04-19T02:17:37.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049556141999999997 2024-04-19T02:17:37.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:37.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119388+0000", 2024-04-19T02:17:37.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9866e-05 2024-04-19T02:17:37.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:37.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119475+0000", 2024-04-19T02:17:37.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6929999999999996e-05 2024-04-19T02:17:37.197 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:37.197 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:37.197 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:37.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.198 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168385 5.d 5:b22d7e69:::benchmark_data_smithi121_44835_object34350:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:37.198 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:37.198 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.050353883, 2024-04-19T02:17:37.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.055438508999999997, 2024-04-19T02:17:37.198 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:37.198 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:37.198 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:37.198 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:37.198 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:37.198 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168385 2024-04-19T02:17:37.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.199 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:37.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:37.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:37.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:37.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:37.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:37.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:37.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:37.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:37.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:37.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:37.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069637+0000", 2024-04-19T02:17:37.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.576e-06 2024-04-19T02:17:37.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:37.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069643+0000", 2024-04-19T02:17:37.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8030000000000002e-06 2024-04-19T02:17:37.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069648+0000", 2024-04-19T02:17:37.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0889999999999999e-06 2024-04-19T02:17:37.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:37.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117534+0000", 2024-04-19T02:17:37.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.047886390000000001 2024-04-19T02:17:37.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:37.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117670+0000", 2024-04-19T02:17:37.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000135969 2024-04-19T02:17:37.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:37.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117803+0000", 2024-04-19T02:17:37.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000132955 2024-04-19T02:17:37.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:37.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120501+0000", 2024-04-19T02:17:37.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026978050000000002 2024-04-19T02:17:37.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:37.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.125026+0000", 2024-04-19T02:17:37.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045244589999999998 2024-04-19T02:17:37.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:37.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.125049+0000", 2024-04-19T02:17:37.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3807000000000001e-05 2024-04-19T02:17:37.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:37.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.125074+0000", 2024-04-19T02:17:37.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4175000000000001e-05 2024-04-19T02:17:37.203 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:37.203 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:37.203 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:37.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.203 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168386 5.5 5:a2cda182:::benchmark_data_smithi121_44835_object34351:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:37.203 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069653+0000", 2024-04-19T02:17:37.203 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.050336416, 2024-04-19T02:17:37.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058748884000000001, 2024-04-19T02:17:37.204 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:37.204 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:37.204 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:37.204 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:37.204 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:37.204 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168386 2024-04-19T02:17:37.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.204 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:37.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:37.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069653+0000", 2024-04-19T02:17:37.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:37.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:37.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069653+0000", 2024-04-19T02:17:37.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:37.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:37.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069652+0000", 2024-04-19T02:17:37.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:37.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:37.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069654+0000", 2024-04-19T02:17:37.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1220000000000002e-06 2024-04-19T02:17:37.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:37.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069660+0000", 2024-04-19T02:17:37.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5890000000000002e-06 2024-04-19T02:17:37.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069665+0000", 2024-04-19T02:17:37.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.989e-06 2024-04-19T02:17:37.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:37.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120220+0000", 2024-04-19T02:17:37.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050555061999999998 2024-04-19T02:17:37.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:37.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120329+0000", 2024-04-19T02:17:37.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010922200000000001 2024-04-19T02:17:37.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:37.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.128293+0000", 2024-04-19T02:17:37.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079640279999999997 2024-04-19T02:17:37.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:37.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.128336+0000", 2024-04-19T02:17:37.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2245e-05 2024-04-19T02:17:37.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:37.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.128401+0000", 2024-04-19T02:17:37.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5975000000000004e-05 2024-04-19T02:17:37.208 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:37.208 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:37.208 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:37.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.208 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168387 5.f 5:ff36d1d9:::benchmark_data_smithi121_44835_object34352:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:37.208 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:37.208 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.050319582, 2024-04-19T02:17:37.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049975358999999997, 2024-04-19T02:17:37.208 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:37.208 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:37.208 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:37.208 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:37.209 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:37.209 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168387 2024-04-19T02:17:37.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.209 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:37.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:37.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:37.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:37.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:37.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:37.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:37.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:37.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:37.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:37.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:37.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069671+0000", 2024-04-19T02:17:37.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1739999999999999e-06 2024-04-19T02:17:37.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:37.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069677+0000", 2024-04-19T02:17:37.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4519999999999996e-06 2024-04-19T02:17:37.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069682+0000", 2024-04-19T02:17:37.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5400000000000003e-06 2024-04-19T02:17:37.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:37.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072634+0000", 2024-04-19T02:17:37.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0029521510000000001 2024-04-19T02:17:37.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:37.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072706+0000", 2024-04-19T02:17:37.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1996999999999995e-05 2024-04-19T02:17:37.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:37.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072772+0000", 2024-04-19T02:17:37.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5380000000000001e-05 2024-04-19T02:17:37.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:37.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117549+0000", 2024-04-19T02:17:37.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044777124000000001 2024-04-19T02:17:37.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:37.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119572+0000", 2024-04-19T02:17:37.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002022893 2024-04-19T02:17:37.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:37.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119613+0000", 2024-04-19T02:17:37.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0849999999999997e-05 2024-04-19T02:17:37.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:37.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119645+0000", 2024-04-19T02:17:37.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2113000000000002e-05 2024-04-19T02:17:37.213 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:37.213 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:37.213 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:37.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.214 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168389 5.2 5:4bcb87b1:::benchmark_data_smithi121_44835_object34354:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:37.214 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.071719+0000", 2024-04-19T02:17:37.214 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.048270486, 2024-04-19T02:17:37.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.048248604, 2024-04-19T02:17:37.214 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:37.214 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:37.214 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:37.214 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:37.214 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:37.214 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168389 2024-04-19T02:17:37.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.214 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:37.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:37.214 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071719+0000", 2024-04-19T02:17:37.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:37.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:37.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071719+0000", 2024-04-19T02:17:37.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:37.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:37.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071718+0000", 2024-04-19T02:17:37.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:37.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:37.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071722+0000", 2024-04-19T02:17:37.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8590000000000004e-06 2024-04-19T02:17:37.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:37.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071730+0000", 2024-04-19T02:17:37.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8569999999999995e-06 2024-04-19T02:17:37.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071736+0000", 2024-04-19T02:17:37.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.127e-06 2024-04-19T02:17:37.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:37.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071769+0000", 2024-04-19T02:17:37.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3052000000000001e-05 2024-04-19T02:17:37.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:37.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071843+0000", 2024-04-19T02:17:37.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3683000000000006e-05 2024-04-19T02:17:37.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:37.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119852+0000", 2024-04-19T02:17:37.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.048009353999999997 2024-04-19T02:17:37.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:37.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119896+0000", 2024-04-19T02:17:37.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3102000000000002e-05 2024-04-19T02:17:37.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:37.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119967+0000", 2024-04-19T02:17:37.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1589999999999997e-05 2024-04-19T02:17:37.218 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:37.218 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:37.218 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:37.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.218 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168391 5.3 5:c5d9b5e1:::benchmark_data_smithi121_44835_object34356:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:37.218 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.074402+0000", 2024-04-19T02:17:37.218 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.045586647, 2024-04-19T02:17:37.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.045426756999999998, 2024-04-19T02:17:37.219 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:37.219 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:37.219 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:37.219 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:37.219 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:37.219 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168391 2024-04-19T02:17:37.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.219 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:37.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:37.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074402+0000", 2024-04-19T02:17:37.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:37.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:37.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074402+0000", 2024-04-19T02:17:37.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:37.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:37.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074401+0000", 2024-04-19T02:17:37.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:37.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:37.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074406+0000", 2024-04-19T02:17:37.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5879999999999999e-06 2024-04-19T02:17:37.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:37.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074414+0000", 2024-04-19T02:17:37.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8599999999999993e-06 2024-04-19T02:17:37.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074420+0000", 2024-04-19T02:17:37.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6350000000000003e-06 2024-04-19T02:17:37.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:37.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074453+0000", 2024-04-19T02:17:37.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3874000000000001e-05 2024-04-19T02:17:37.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:37.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074531+0000", 2024-04-19T02:17:37.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7999999999999999e-05 2024-04-19T02:17:37.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:37.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119717+0000", 2024-04-19T02:17:37.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.045185395000000003 2024-04-19T02:17:37.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:37.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119756+0000", 2024-04-19T02:17:37.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9110000000000003e-05 2024-04-19T02:17:37.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:37.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119829+0000", 2024-04-19T02:17:37.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3238000000000006e-05 2024-04-19T02:17:37.223 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:37.223 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:37.223 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:37.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.223 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4549.0:168377 5.d e52/16 ondisk, result = 0)", 2024-04-19T02:17:37.223 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.077260+0000", 2024-04-19T02:17:37.223 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.042728906000001, 2024-04-19T02:17:37.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042613204000000002, 2024-04-19T02:17:37.223 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:37.223 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:37.223 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:37.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:37.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.077260+0000", 2024-04-19T02:17:37.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:37.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:37.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.077260+0000", 2024-04-19T02:17:37.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:37.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:37.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.077259+0000", 2024-04-19T02:17:37.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:37.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:37.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.077267+0000", 2024-04-19T02:17:37.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6799999999999993e-06 2024-04-19T02:17:37.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:37.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117372+0000", 2024-04-19T02:17:37.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040105342000000002 2024-04-19T02:17:37.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117389+0000", 2024-04-19T02:17:37.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6711e-05 2024-04-19T02:17:37.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:37.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119862+0000", 2024-04-19T02:17:37.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0024730580000000002 2024-04-19T02:17:37.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:37.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119867+0000", 2024-04-19T02:17:37.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1590000000000001e-06 2024-04-19T02:17:37.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:37.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:37.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:37.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119873+0000", 2024-04-19T02:17:37.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1410000000000002e-06 2024-04-19T02:17:37.226 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:37.226 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:37.227 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:37.227 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:37.227 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:37.227 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:37.228 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:17:37.229 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:37.228+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:37.329 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:37.329+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:37.356 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T02:17:37.406 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:17:37.407 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:17:37.407 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.407 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:239189 5.0 5.47044750 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:37.407 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:37.406950+0000", 2024-04-19T02:17:37.407 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.00050591000000000004, 2024-04-19T02:17:37.407 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00053209100000000005, 2024-04-19T02:17:37.407 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:37.407 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "queued for pg", 2024-04-19T02:17:37.407 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:37.407 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:37.407 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:37.407 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 239189 2024-04-19T02:17:37.407 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.408 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:37.408 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.408 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:37.408 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:37.406950+0000", 2024-04-19T02:17:37.408 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:37.408 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.408 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.408 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:37.408 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:37.406950+0000", 2024-04-19T02:17:37.408 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:37.408 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.408 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.408 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:37.408 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:37.406950+0000", 2024-04-19T02:17:37.409 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:37.409 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.409 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.409 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:37.409 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:37.406954+0000", 2024-04-19T02:17:37.409 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1559999999999997e-06 2024-04-19T02:17:37.409 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.409 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.409 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:37.409 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:37.406964+0000", 2024-04-19T02:17:37.409 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.8879999999999992e-06 2024-04-19T02:17:37.409 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.409 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.409 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.409 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:37.406970+0000", 2024-04-19T02:17:37.409 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.4570000000000002e-06 2024-04-19T02:17:37.410 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.410 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:37.410 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.410 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.410 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.410 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:239190 5.0 5.6e956cc0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:37.410 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:37.406981+0000", 2024-04-19T02:17:37.410 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.00047493699999999998, 2024-04-19T02:17:37.410 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00054236200000000001, 2024-04-19T02:17:37.410 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:37.410 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "queued for pg", 2024-04-19T02:17:37.410 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:37.410 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:37.410 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:37.411 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 239190 2024-04-19T02:17:37.411 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.411 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:37.411 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.411 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:37.411 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:37.406981+0000", 2024-04-19T02:17:37.411 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:37.411 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.411 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.411 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:37.411 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:37.406981+0000", 2024-04-19T02:17:37.411 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:37.411 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.411 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.411 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:37.412 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:37.406981+0000", 2024-04-19T02:17:37.412 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:37.412 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.412 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.412 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:37.412 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:37.406983+0000", 2024-04-19T02:17:37.412 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4839999999999998e-06 2024-04-19T02:17:37.412 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.412 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.412 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:37.412 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:37.406989+0000", 2024-04-19T02:17:37.412 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.1299999999999998e-06 2024-04-19T02:17:37.412 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.412 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.412 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.413 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:37.406994+0000", 2024-04-19T02:17:37.413 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.887e-06 2024-04-19T02:17:37.413 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.413 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:37.413 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.413 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.413 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.413 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:239177 5.b 5:d6ee029c:::benchmark_data_smithi121_44835_object105142:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:37.413 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:37.403991+0000", 2024-04-19T02:17:37.413 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0034653119999999999, 2024-04-19T02:17:37.413 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0035694910000000002, 2024-04-19T02:17:37.414 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:37.414 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:37.414 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:37.414 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:37.414 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:37.414 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 239177 2024-04-19T02:17:37.414 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.414 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:37.414 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.414 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:37.414 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:37.403991+0000", 2024-04-19T02:17:37.414 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:37.415 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.415 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.415 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:37.415 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:37.403991+0000", 2024-04-19T02:17:37.415 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:37.415 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.415 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.415 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:37.415 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:37.403990+0000", 2024-04-19T02:17:37.415 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:37.415 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.415 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.415 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:37.415 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:37.403994+0000", 2024-04-19T02:17:37.415 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.6120000000000001e-06 2024-04-19T02:17:37.416 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.416 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.416 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:37.416 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:37.404001+0000", 2024-04-19T02:17:37.416 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.046e-06 2024-04-19T02:17:37.416 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.416 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.416 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.416 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:37.404007+0000", 2024-04-19T02:17:37.416 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.6899999999999997e-06 2024-04-19T02:17:37.416 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.416 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.416 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:37.416 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:37.404065+0000", 2024-04-19T02:17:37.416 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7460999999999998e-05 2024-04-19T02:17:37.417 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.417 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.417 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:37.417 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:37.404164+0000", 2024-04-19T02:17:37.417 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.9806e-05 2024-04-19T02:17:37.417 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.417 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:37.417 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.417 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.417 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.417 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:239180 5.b 5:db8e74c3:::benchmark_data_smithi121_44835_object105145:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:37.417 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:37.404042+0000", 2024-04-19T02:17:37.417 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0034143730000000001, 2024-04-19T02:17:37.417 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0035569960000000002, 2024-04-19T02:17:37.417 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:37.418 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:37.418 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:37.418 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:37.418 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:37.418 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 239180 2024-04-19T02:17:37.418 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.418 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:37.418 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.418 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:37.418 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:37.404042+0000", 2024-04-19T02:17:37.418 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:37.418 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.418 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.418 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:37.419 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:37.404042+0000", 2024-04-19T02:17:37.419 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:37.419 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.419 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.419 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:37.419 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:37.404041+0000", 2024-04-19T02:17:37.419 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:37.419 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.419 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.419 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:37.419 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:37.404044+0000", 2024-04-19T02:17:37.419 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0249999999999998e-06 2024-04-19T02:17:37.419 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.419 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.420 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:37.420 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:37.404051+0000", 2024-04-19T02:17:37.420 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1219999999999997e-06 2024-04-19T02:17:37.420 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.420 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.420 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.420 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:37.404062+0000", 2024-04-19T02:17:37.420 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0428000000000001e-05 2024-04-19T02:17:37.420 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.420 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.420 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:37.420 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:37.406216+0000", 2024-04-19T02:17:37.420 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0021546460000000001 2024-04-19T02:17:37.420 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.421 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.421 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:37.421 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:37.406354+0000", 2024-04-19T02:17:37.421 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013703599999999999 2024-04-19T02:17:37.421 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.421 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:37.421 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.421 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.421 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.421 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:239178 5.9 e62/16 5:9acd09c8:::benchmark_data_smithi121_44835_object105143:head v 62'15185, mlcod=62'15180)", 2024-04-19T02:17:37.421 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:37.406324+0000", 2024-04-19T02:17:37.421 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.001132042, 2024-04-19T02:17:37.421 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001313013, 2024-04-19T02:17:37.421 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:37.421 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:37.422 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:37.422 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.422 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:37.422 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:37.406324+0000", 2024-04-19T02:17:37.422 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:37.422 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.422 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.422 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:37.422 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:37.406324+0000", 2024-04-19T02:17:37.422 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:37.422 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.422 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.422 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:37.422 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:37.406323+0000", 2024-04-19T02:17:37.422 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:37.423 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.423 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.423 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:37.423 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:37.406329+0000", 2024-04-19T02:17:37.423 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.0340000000000002e-06 2024-04-19T02:17:37.423 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.423 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.423 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:37.423 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:37.406338+0000", 2024-04-19T02:17:37.423 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.7360000000000007e-06 2024-04-19T02:17:37.423 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.423 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.423 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.423 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:37.406343+0000", 2024-04-19T02:17:37.423 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.7849999999999999e-06 2024-04-19T02:17:37.424 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.424 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.424 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:37.424 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:37.406399+0000", 2024-04-19T02:17:37.424 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.5742999999999998e-05 2024-04-19T02:17:37.424 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.424 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.424 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:37.424 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:37.406411+0000", 2024-04-19T02:17:37.424 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1839e-05 2024-04-19T02:17:37.424 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.424 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:37.424 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.424 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.424 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.425 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:239187 5.0 5:0e10d2e9:::benchmark_data_smithi121_44835_object105152:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:37.425 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:37.406559+0000", 2024-04-19T02:17:37.425 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.00089731399999999997, 2024-04-19T02:17:37.425 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0011124220000000001, 2024-04-19T02:17:37.425 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:37.425 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:37.425 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:37.425 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:37.425 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:37.425 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 239187 2024-04-19T02:17:37.425 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.425 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:37.425 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.425 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:37.425 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:37.406559+0000", 2024-04-19T02:17:37.425 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:37.426 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.426 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.426 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:37.426 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:37.406559+0000", 2024-04-19T02:17:37.426 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:37.426 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.426 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.426 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:37.426 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:37.406558+0000", 2024-04-19T02:17:37.426 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:37.426 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.426 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.426 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:37.426 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:37.406562+0000", 2024-04-19T02:17:37.426 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3409999999999996e-06 2024-04-19T02:17:37.427 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.427 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.427 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:37.427 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:37.406572+0000", 2024-04-19T02:17:37.427 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.8870000000000004e-06 2024-04-19T02:17:37.427 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.427 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.427 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.427 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:37.406579+0000", 2024-04-19T02:17:37.427 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.0929999999999997e-06 2024-04-19T02:17:37.427 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.427 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.427 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:37.427 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:37.406618+0000", 2024-04-19T02:17:37.427 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9249999999999999e-05 2024-04-19T02:17:37.427 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.427 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.428 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:37.428 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:37.406702+0000", 2024-04-19T02:17:37.428 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.3182000000000004e-05 2024-04-19T02:17:37.428 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.428 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:37.428 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.428 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.428 INFO:teuthology.orchestra.run.smithi174.stdout: ], 2024-04-19T02:17:37.428 INFO:teuthology.orchestra.run.smithi174.stdout: "num_ops": 6 2024-04-19T02:17:37.428 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:17:37.430 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:17:37.430 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:37.429+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:37.531 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:37.530+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:37.631 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~29s 2024-04-19T02:17:37.633 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:37.633+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:37.650 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:17:37.650 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [], 2024-04-19T02:17:37.650 INFO:teuthology.orchestra.run.smithi174.stdout: "complaint_time": 30, 2024-04-19T02:17:37.650 INFO:teuthology.orchestra.run.smithi174.stdout: "num_blocked_ops": 0 2024-04-19T02:17:37.650 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:17:37.665 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:17:37.733 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:37.733+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:37.834 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:37.834+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:37.847 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:17:37.847 INFO:teuthology.orchestra.run.smithi174.stdout: "size": 20, 2024-04-19T02:17:37.847 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 600, 2024-04-19T02:17:37.847 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:17:37.847 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.847 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(mds.0.3:19 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-19T02:17:37.847 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:17:37.847 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 128.57544767900001, 2024-04-19T02:17:37.847 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020818203, 2024-04-19T02:17:37.847 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:37.848 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:37.848 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:37.848 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.848 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:37.848 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:17:37.848 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:37.848 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.848 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.848 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:37.848 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:17:37.848 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:37.848 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.848 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.848 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:37.848 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270063+0000", 2024-04-19T02:17:37.849 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:37.849 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.849 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.849 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:37.849 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270065+0000", 2024-04-19T02:17:37.849 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4310000000000001e-06 2024-04-19T02:17:37.849 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.849 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.849 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:37.849 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270070+0000", 2024-04-19T02:17:37.849 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2859999999999999e-06 2024-04-19T02:17:37.849 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.849 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.849 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.850 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270077+0000", 2024-04-19T02:17:37.850 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5270000000000004e-06 2024-04-19T02:17:37.850 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.850 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.850 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:37.850 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270107+0000", 2024-04-19T02:17:37.850 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0205999999999998e-05 2024-04-19T02:17:37.850 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.850 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.850 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting_for_map not empty", 2024-04-19T02:17:37.850 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.270111+0000", 2024-04-19T02:17:37.850 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8650000000000003e-06 2024-04-19T02:17:37.850 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.850 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.851 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:37.851 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.285936+0000", 2024-04-19T02:17:37.851 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015824677999999998 2024-04-19T02:17:37.851 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.851 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.851 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:37.851 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286007+0000", 2024-04-19T02:17:37.851 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1157999999999999e-05 2024-04-19T02:17:37.851 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.851 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.851 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 0", 2024-04-19T02:17:37.851 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.286086+0000", 2024-04-19T02:17:37.851 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9084000000000004e-05 2024-04-19T02:17:37.851 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.851 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.851 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:37.852 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290740+0000", 2024-04-19T02:17:37.852 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0046543679999999999 2024-04-19T02:17:37.852 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.852 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.852 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:37.852 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290833+0000", 2024-04-19T02:17:37.852 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2551000000000002e-05 2024-04-19T02:17:37.852 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.852 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.852 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:37.852 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290859+0000", 2024-04-19T02:17:37.852 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.6696999999999999e-05 2024-04-19T02:17:37.852 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.852 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.852 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:37.853 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:15:29.290881+0000", 2024-04-19T02:17:37.853 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1653000000000001e-05 2024-04-19T02:17:37.853 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.853 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:37.853 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.853 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.853 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.853 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:77622 5.8 5:166fbe77:::benchmark_data_smithi121_44835_object77621:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:37.853 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:17:37.853 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 71.039950742000002, 2024-04-19T02:17:37.853 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.021784694, 2024-04-19T02:17:37.853 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:37.853 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:37.853 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:37.853 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:37.854 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:37.854 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 77622 2024-04-19T02:17:37.854 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.854 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:37.854 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.854 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:37.854 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:17:37.854 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:37.854 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.854 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.854 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:37.854 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805560+0000", 2024-04-19T02:17:37.854 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:37.854 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.854 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.855 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:37.855 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805559+0000", 2024-04-19T02:17:37.855 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:37.855 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.855 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.855 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:37.855 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805659+0000", 2024-04-19T02:17:37.855 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.9908000000000006e-05 2024-04-19T02:17:37.855 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.855 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.855 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:37.855 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805668+0000", 2024-04-19T02:17:37.855 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2129999999999997e-06 2024-04-19T02:17:37.855 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.855 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.855 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.856 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.805673+0000", 2024-04-19T02:17:37.856 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.0370000000000002e-06 2024-04-19T02:17:37.856 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.856 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.856 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:37.856 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812022+0000", 2024-04-19T02:17:37.856 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0063483239999999998 2024-04-19T02:17:37.856 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.856 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.856 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:37.856 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812129+0000", 2024-04-19T02:17:37.856 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010744200000000001 2024-04-19T02:17:37.856 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.856 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.856 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:37.857 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.812252+0000", 2024-04-19T02:17:37.857 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000122519 2024-04-19T02:17:37.857 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.857 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.857 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:37.857 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.820979+0000", 2024-04-19T02:17:37.857 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0087272740000000001 2024-04-19T02:17:37.857 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.857 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.857 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:37.857 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827270+0000", 2024-04-19T02:17:37.857 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0062906239999999999 2024-04-19T02:17:37.857 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.857 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.857 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:37.857 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827309+0000", 2024-04-19T02:17:37.858 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9678999999999997e-05 2024-04-19T02:17:37.858 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.858 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.858 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:37.858 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:26.827345+0000", 2024-04-19T02:17:37.858 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5308000000000001e-05 2024-04-19T02:17:37.858 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.858 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:37.858 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.858 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.858 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.858 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78224 5.4 5:26e797d5:::benchmark_data_smithi121_44835_object78223:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:37.858 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:17:37.858 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 70.738948543000006, 2024-04-19T02:17:37.858 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.021471998999999999, 2024-04-19T02:17:37.859 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:37.859 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:37.859 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:37.859 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:37.859 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:37.859 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78224 2024-04-19T02:17:37.859 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.859 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:37.859 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.859 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:37.859 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:17:37.859 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:37.859 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.859 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.859 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:37.860 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106562+0000", 2024-04-19T02:17:37.860 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:37.860 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.860 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.860 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:37.860 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106561+0000", 2024-04-19T02:17:37.860 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:37.860 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.860 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.860 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:37.860 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106630+0000", 2024-04-19T02:17:37.860 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.8553999999999994e-05 2024-04-19T02:17:37.860 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.860 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.860 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:37.861 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106644+0000", 2024-04-19T02:17:37.861 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.4651000000000001e-05 2024-04-19T02:17:37.861 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.861 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.861 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.861 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106653+0000", 2024-04-19T02:17:37.861 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.6719999999999993e-06 2024-04-19T02:17:37.861 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.861 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.861 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:37.861 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106693+0000", 2024-04-19T02:17:37.861 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9978999999999998e-05 2024-04-19T02:17:37.861 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.861 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.861 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:37.862 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106840+0000", 2024-04-19T02:17:37.862 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0001473 2024-04-19T02:17:37.862 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.862 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.862 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:37.862 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.106971+0000", 2024-04-19T02:17:37.862 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013051499999999999 2024-04-19T02:17:37.862 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.862 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.862 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:37.862 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.109047+0000", 2024-04-19T02:17:37.862 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.002076002 2024-04-19T02:17:37.862 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.862 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.862 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:37.863 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.127967+0000", 2024-04-19T02:17:37.863 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.018919780000000001 2024-04-19T02:17:37.863 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.863 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.863 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:37.863 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128004+0000", 2024-04-19T02:17:37.863 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7719000000000003e-05 2024-04-19T02:17:37.863 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.863 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.863 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:37.863 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128034+0000", 2024-04-19T02:17:37.863 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9651000000000001e-05 2024-04-19T02:17:37.863 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.863 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:37.863 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.863 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.864 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.864 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78259 5.4 5:2aa344b2:::benchmark_data_smithi121_44835_object78258:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:37.864 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:17:37.864 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 70.720253474000003, 2024-04-19T02:17:37.864 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022934350999999999, 2024-04-19T02:17:37.864 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:37.864 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:37.864 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:37.864 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:37.864 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:37.864 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78259 2024-04-19T02:17:37.864 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.864 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:37.864 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.864 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:37.865 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:17:37.865 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:37.865 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.865 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.865 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:37.865 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:17:37.865 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:37.865 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.865 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.865 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:37.865 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125256+0000", 2024-04-19T02:17:37.865 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:37.865 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.865 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.865 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:37.866 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125347+0000", 2024-04-19T02:17:37.866 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0470000000000006e-05 2024-04-19T02:17:37.866 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.866 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.866 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:37.866 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125358+0000", 2024-04-19T02:17:37.866 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1764e-05 2024-04-19T02:17:37.866 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.866 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.866 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.866 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125364+0000", 2024-04-19T02:17:37.866 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7189999999999998e-06 2024-04-19T02:17:37.866 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.866 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.866 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:37.867 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125391+0000", 2024-04-19T02:17:37.867 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7270000000000001e-05 2024-04-19T02:17:37.867 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.867 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.867 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:37.867 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125471+0000", 2024-04-19T02:17:37.867 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9209999999999995e-05 2024-04-19T02:17:37.867 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.867 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.867 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:37.867 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125559+0000", 2024-04-19T02:17:37.867 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.8689000000000004e-05 2024-04-19T02:17:37.867 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.867 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.867 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:37.867 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128164+0000", 2024-04-19T02:17:37.868 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0026050270000000002 2024-04-19T02:17:37.868 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.868 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.868 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:37.868 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148139+0000", 2024-04-19T02:17:37.868 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.019975050000000001 2024-04-19T02:17:37.868 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.868 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.868 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:37.868 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148169+0000", 2024-04-19T02:17:37.868 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0001e-05 2024-04-19T02:17:37.868 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.868 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.868 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:37.868 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148191+0000", 2024-04-19T02:17:37.869 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.2104999999999999e-05 2024-04-19T02:17:37.869 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.869 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:37.869 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.869 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.869 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.869 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78271 5.4 5:2982d7a6:::benchmark_data_smithi121_44835_object78270:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:37.869 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:17:37.869 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 70.713390243999996, 2024-04-19T02:17:37.869 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020841755999999999, 2024-04-19T02:17:37.869 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:37.869 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:37.869 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:37.869 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:37.869 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:37.869 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78271 2024-04-19T02:17:37.870 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.870 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:37.870 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.870 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:37.870 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:17:37.870 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:37.870 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.870 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.870 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:37.870 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132120+0000", 2024-04-19T02:17:37.870 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:37.870 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.870 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.870 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:37.870 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132119+0000", 2024-04-19T02:17:37.871 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:37.871 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.871 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.871 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:37.871 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132185+0000", 2024-04-19T02:17:37.871 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5994000000000005e-05 2024-04-19T02:17:37.871 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.871 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.871 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:37.871 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132197+0000", 2024-04-19T02:17:37.871 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2091e-05 2024-04-19T02:17:37.871 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.871 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.871 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.871 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132206+0000", 2024-04-19T02:17:37.871 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.5099999999999998e-06 2024-04-19T02:17:37.872 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.872 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.872 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:37.872 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132242+0000", 2024-04-19T02:17:37.872 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5663000000000001e-05 2024-04-19T02:17:37.872 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.872 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.872 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:37.872 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132335+0000", 2024-04-19T02:17:37.872 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3275000000000004e-05 2024-04-19T02:17:37.872 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.872 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.872 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:37.872 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132432+0000", 2024-04-19T02:17:37.873 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7571000000000005e-05 2024-04-19T02:17:37.873 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.873 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.873 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:37.873 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.136706+0000", 2024-04-19T02:17:37.873 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0042738170000000001 2024-04-19T02:17:37.873 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.873 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.873 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:37.873 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152909+0000", 2024-04-19T02:17:37.873 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.016202415000000001 2024-04-19T02:17:37.873 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.873 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.873 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:37.873 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152938+0000", 2024-04-19T02:17:37.873 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9740999999999999e-05 2024-04-19T02:17:37.874 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.874 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.874 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:37.874 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.152962+0000", 2024-04-19T02:17:37.874 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3659000000000002e-05 2024-04-19T02:17:37.874 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.874 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:37.874 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.874 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.874 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.874 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78272 5.4 5:273e819a:::benchmark_data_smithi121_44835_object78271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:37.874 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:37.874 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 70.712901200999994, 2024-04-19T02:17:37.874 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022180163999999999, 2024-04-19T02:17:37.875 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:37.875 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:37.875 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:37.875 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:37.875 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:37.875 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78272 2024-04-19T02:17:37.875 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.875 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:37.875 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.875 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:37.875 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:37.875 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:37.875 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.875 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.875 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:37.875 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:37.876 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:37.876 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.876 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.876 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:37.876 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:37.876 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:37.876 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.876 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.876 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:37.876 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132690+0000", 2024-04-19T02:17:37.876 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0963000000000004e-05 2024-04-19T02:17:37.876 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.876 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.876 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:37.876 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132703+0000", 2024-04-19T02:17:37.877 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.3072e-05 2024-04-19T02:17:37.877 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.877 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.877 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.877 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132710+0000", 2024-04-19T02:17:37.877 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3100000000000003e-06 2024-04-19T02:17:37.877 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.877 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.877 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:37.877 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134005+0000", 2024-04-19T02:17:37.877 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001294513 2024-04-19T02:17:37.877 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.877 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.877 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:37.877 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134139+0000", 2024-04-19T02:17:37.878 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000134447 2024-04-19T02:17:37.878 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.878 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.878 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:37.878 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134284+0000", 2024-04-19T02:17:37.878 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014514399999999999 2024-04-19T02:17:37.878 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.878 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.878 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:37.878 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.139622+0000", 2024-04-19T02:17:37.878 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0053373830000000002 2024-04-19T02:17:37.878 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.878 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.878 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:37.878 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154737+0000", 2024-04-19T02:17:37.879 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015115195999999999 2024-04-19T02:17:37.879 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.879 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.879 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:37.879 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154768+0000", 2024-04-19T02:17:37.879 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0824999999999997e-05 2024-04-19T02:17:37.879 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.879 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.879 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:37.879 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154790+0000", 2024-04-19T02:17:37.879 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1999000000000001e-05 2024-04-19T02:17:37.879 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.879 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:37.879 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.879 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.880 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.880 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:94481 5.e 5:7b2fbebf:::benchmark_data_smithi121_44835_object94480:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:37.880 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:17:37.880 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 62.724264884, 2024-04-19T02:17:37.880 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020897846000000001, 2024-04-19T02:17:37.880 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:37.880 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:37.880 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:37.880 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:37.880 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:37.880 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 94481 2024-04-19T02:17:37.880 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.880 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:37.880 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.880 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:37.880 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:17:37.881 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:37.881 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.881 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.881 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:37.881 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121246+0000", 2024-04-19T02:17:37.881 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:37.881 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.881 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.881 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:37.881 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121245+0000", 2024-04-19T02:17:37.881 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:37.881 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.881 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.881 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:37.881 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121273+0000", 2024-04-19T02:17:37.882 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7250000000000002e-05 2024-04-19T02:17:37.882 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.882 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.882 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:37.882 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121277+0000", 2024-04-19T02:17:37.882 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2860000000000001e-06 2024-04-19T02:17:37.882 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.882 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.882 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.882 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121280+0000", 2024-04-19T02:17:37.882 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2739999999999999e-06 2024-04-19T02:17:37.882 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.882 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.882 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:37.882 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121320+0000", 2024-04-19T02:17:37.883 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9879000000000002e-05 2024-04-19T02:17:37.883 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.883 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.883 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:37.883 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121448+0000", 2024-04-19T02:17:37.883 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012748800000000001 2024-04-19T02:17:37.883 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.883 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.883 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:37.883 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.121595+0000", 2024-04-19T02:17:37.883 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014741299999999999 2024-04-19T02:17:37.883 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.883 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.883 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:37.883 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.127776+0000", 2024-04-19T02:17:37.883 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0061811360000000003 2024-04-19T02:17:37.884 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.884 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.884 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:37.884 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142073+0000", 2024-04-19T02:17:37.884 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.014296959999999999 2024-04-19T02:17:37.884 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.884 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.884 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:37.884 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142106+0000", 2024-04-19T02:17:37.884 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3348e-05 2024-04-19T02:17:37.884 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.884 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.884 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:37.884 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.142144+0000", 2024-04-19T02:17:37.884 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7153000000000002e-05 2024-04-19T02:17:37.885 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.885 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:37.885 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.885 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.885 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.885 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:94581 5.b 5:dc86d6e9:::benchmark_data_smithi121_44835_object94580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:37.885 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:37.885 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 62.665330310999998, 2024-04-19T02:17:37.885 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022099711000000001, 2024-04-19T02:17:37.885 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:37.885 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:37.885 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:37.885 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:37.885 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:37.885 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 94581 2024-04-19T02:17:37.885 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.886 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:37.886 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.886 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:37.886 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:37.886 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:37.886 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.886 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.886 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:37.886 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:37.886 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:37.886 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.886 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.886 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:37.886 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:37.886 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:37.887 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.887 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.887 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:37.887 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180253+0000", 2024-04-19T02:17:37.887 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3163000000000004e-05 2024-04-19T02:17:37.887 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.887 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.887 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:37.887 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180266+0000", 2024-04-19T02:17:37.887 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2886e-05 2024-04-19T02:17:37.887 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.887 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.887 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.887 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180273+0000", 2024-04-19T02:17:37.887 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.4059999999999999e-06 2024-04-19T02:17:37.887 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.888 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.888 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:37.888 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180646+0000", 2024-04-19T02:17:37.888 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00037283999999999999 2024-04-19T02:17:37.888 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.888 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.888 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:37.888 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180774+0000", 2024-04-19T02:17:37.888 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012793799999999999 2024-04-19T02:17:37.888 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.888 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.888 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:37.888 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180920+0000", 2024-04-19T02:17:37.888 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000146692 2024-04-19T02:17:37.888 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.889 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.889 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:37.889 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.183344+0000", 2024-04-19T02:17:37.889 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0024231669999999999 2024-04-19T02:17:37.889 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.889 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.889 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:37.889 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202196+0000", 2024-04-19T02:17:37.889 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.018852384 2024-04-19T02:17:37.889 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.889 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.889 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:37.889 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202241+0000", 2024-04-19T02:17:37.889 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4923999999999999e-05 2024-04-19T02:17:37.889 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.890 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.890 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:37.890 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202280+0000", 2024-04-19T02:17:37.890 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9096e-05 2024-04-19T02:17:37.890 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.890 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:37.890 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.890 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.890 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.890 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:96356 5.0 5:0a661b39:::benchmark_data_smithi121_44835_object96355:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:37.890 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:17:37.890 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 61.752117468999998, 2024-04-19T02:17:37.890 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020955516, 2024-04-19T02:17:37.890 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:37.890 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:37.891 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:37.891 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:37.891 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:37.891 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 96356 2024-04-19T02:17:37.891 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.891 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:37.891 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.891 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:37.891 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:17:37.891 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:37.891 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.891 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.891 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:37.891 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:17:37.891 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:37.892 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.892 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.892 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:37.892 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093393+0000", 2024-04-19T02:17:37.892 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:37.892 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.892 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.892 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:37.892 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093455+0000", 2024-04-19T02:17:37.892 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.2205000000000005e-05 2024-04-19T02:17:37.892 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.892 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.892 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:37.892 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093464+0000", 2024-04-19T02:17:37.892 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3910000000000004e-06 2024-04-19T02:17:37.892 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.893 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.893 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.893 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093469+0000", 2024-04-19T02:17:37.893 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.7249999999999997e-06 2024-04-19T02:17:37.893 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.893 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.893 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:37.893 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099643+0000", 2024-04-19T02:17:37.893 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0061743359999999999 2024-04-19T02:17:37.893 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.893 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.893 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:37.893 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099774+0000", 2024-04-19T02:17:37.893 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013050599999999999 2024-04-19T02:17:37.893 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.893 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.894 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:37.894 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.099917+0000", 2024-04-19T02:17:37.894 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000143187 2024-04-19T02:17:37.894 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.894 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.894 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:37.894 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.105432+0000", 2024-04-19T02:17:37.894 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.005514873 2024-04-19T02:17:37.894 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.894 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.894 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:37.894 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114264+0000", 2024-04-19T02:17:37.894 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.008831752 2024-04-19T02:17:37.894 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.894 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.895 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:37.895 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114300+0000", 2024-04-19T02:17:37.895 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6582000000000003e-05 2024-04-19T02:17:37.895 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.895 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.895 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:37.895 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114349+0000", 2024-04-19T02:17:37.895 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8579999999999999e-05 2024-04-19T02:17:37.895 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.895 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:37.895 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.895 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.895 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.895 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:96357 5.0 5:00efce8b:::benchmark_data_smithi121_44835_object96356:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:37.895 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:17:37.895 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 61.752037790999999, 2024-04-19T02:17:37.896 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020937471999999999, 2024-04-19T02:17:37.896 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:37.896 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:37.896 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:37.896 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:37.896 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:37.896 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 96357 2024-04-19T02:17:37.896 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.896 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:37.896 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.896 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:37.896 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:17:37.896 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:37.896 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.896 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.897 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:37.897 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093473+0000", 2024-04-19T02:17:37.897 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:37.897 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.897 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.897 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:37.897 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093472+0000", 2024-04-19T02:17:37.897 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:37.897 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.897 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.897 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:37.897 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093513+0000", 2024-04-19T02:17:37.897 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0213000000000003e-05 2024-04-19T02:17:37.897 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.897 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.898 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:37.898 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093519+0000", 2024-04-19T02:17:37.898 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.066e-06 2024-04-19T02:17:37.898 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.898 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.898 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.898 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.093525+0000", 2024-04-19T02:17:37.898 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.8170000000000004e-06 2024-04-19T02:17:37.898 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.898 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.898 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:37.898 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103412+0000", 2024-04-19T02:17:37.898 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0098872739999999997 2024-04-19T02:17:37.898 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.898 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.899 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:37.899 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103551+0000", 2024-04-19T02:17:37.899 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000139295 2024-04-19T02:17:37.899 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.899 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.899 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:37.899 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.103701+0000", 2024-04-19T02:17:37.899 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014954599999999999 2024-04-19T02:17:37.899 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.899 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.899 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:37.899 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.108849+0000", 2024-04-19T02:17:37.899 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0051487199999999999 2024-04-19T02:17:37.899 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.899 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.899 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:37.900 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114355+0000", 2024-04-19T02:17:37.900 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0055052529999999999 2024-04-19T02:17:37.900 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.900 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.900 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:37.900 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114379+0000", 2024-04-19T02:17:37.900 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4275000000000001e-05 2024-04-19T02:17:37.900 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.900 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.900 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:37.900 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:36.114410+0000", 2024-04-19T02:17:37.900 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1356999999999998e-05 2024-04-19T02:17:37.900 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.900 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:37.900 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.900 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.901 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.901 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:104431 5.8 5:14818e19:::benchmark_data_smithi121_44835_object104430:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T02:17:37.901 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:17:37.901 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 57.634125265999998, 2024-04-19T02:17:37.901 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022149528000000002, 2024-04-19T02:17:37.901 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:37.901 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:37.901 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:37.901 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:37.901 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:37.901 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 104431 2024-04-19T02:17:37.901 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.901 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:37.901 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.902 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:37.902 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:17:37.902 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:37.902 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.902 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.902 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:37.902 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:17:37.902 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:37.902 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.902 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.902 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:37.902 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211384+0000", 2024-04-19T02:17:37.902 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:37.902 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.902 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.903 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:37.903 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211458+0000", 2024-04-19T02:17:37.903 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3311000000000003e-05 2024-04-19T02:17:37.903 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.903 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.903 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:37.903 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211471+0000", 2024-04-19T02:17:37.903 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.3308e-05 2024-04-19T02:17:37.903 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.903 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.903 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.903 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211479+0000", 2024-04-19T02:17:37.903 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0909999999999993e-06 2024-04-19T02:17:37.903 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.903 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.903 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:37.904 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.221821+0000", 2024-04-19T02:17:37.904 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010341596999999999 2024-04-19T02:17:37.904 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.904 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.904 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:37.904 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.221966+0000", 2024-04-19T02:17:37.904 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000145167 2024-04-19T02:17:37.904 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.904 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.904 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:37.904 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.222077+0000", 2024-04-19T02:17:37.904 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011128000000000001 2024-04-19T02:17:37.904 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.904 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.904 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:37.905 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.228126+0000", 2024-04-19T02:17:37.905 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0060486710000000003 2024-04-19T02:17:37.905 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.905 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.905 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:37.905 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233449+0000", 2024-04-19T02:17:37.905 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0053231370000000004 2024-04-19T02:17:37.905 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.905 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.905 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:37.905 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233498+0000", 2024-04-19T02:17:37.905 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8798999999999998e-05 2024-04-19T02:17:37.905 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.905 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.905 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:37.905 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233535+0000", 2024-04-19T02:17:37.906 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7119000000000002e-05 2024-04-19T02:17:37.906 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.906 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:37.906 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.906 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.906 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.906 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157437 5.e 5:78833a3d:::benchmark_data_smithi121_44835_object23402:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:37.906 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.859854+0000", 2024-04-19T02:17:37.906 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 30.985656494000001, 2024-04-19T02:17:37.906 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.025859589999999998, 2024-04-19T02:17:37.906 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:37.906 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:37.906 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:37.906 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:37.906 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:37.907 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157437 2024-04-19T02:17:37.907 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.907 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:37.907 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.907 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:37.907 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859854+0000", 2024-04-19T02:17:37.907 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:37.907 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.907 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.907 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:37.907 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859854+0000", 2024-04-19T02:17:37.907 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:37.907 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.907 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.907 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:37.908 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859853+0000", 2024-04-19T02:17:37.908 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:37.908 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.908 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.908 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:37.908 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859857+0000", 2024-04-19T02:17:37.908 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8789999999999996e-06 2024-04-19T02:17:37.908 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.908 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.908 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:37.908 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859865+0000", 2024-04-19T02:17:37.908 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.1880000000000002e-06 2024-04-19T02:17:37.908 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.908 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.908 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.908 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859873+0000", 2024-04-19T02:17:37.909 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.2980000000000003e-06 2024-04-19T02:17:37.909 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.909 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.909 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:37.909 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859908+0000", 2024-04-19T02:17:37.909 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5682999999999997e-05 2024-04-19T02:17:37.909 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.909 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.909 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:37.909 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.860046+0000", 2024-04-19T02:17:37.909 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013714200000000001 2024-04-19T02:17:37.909 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.909 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.909 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:37.909 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.860153+0000", 2024-04-19T02:17:37.910 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010725700000000001 2024-04-19T02:17:37.910 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.910 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.910 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:37.910 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.862008+0000", 2024-04-19T02:17:37.910 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001855179 2024-04-19T02:17:37.910 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.910 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.910 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:37.910 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.885629+0000", 2024-04-19T02:17:37.910 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.023621428 2024-04-19T02:17:37.910 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.910 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.910 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:37.911 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.885676+0000", 2024-04-19T02:17:37.911 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.6371e-05 2024-04-19T02:17:37.911 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.911 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.911 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:37.911 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.885714+0000", 2024-04-19T02:17:37.911 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7907000000000001e-05 2024-04-19T02:17:37.911 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.911 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:37.911 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.911 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.911 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.911 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157438 5.0 5:01944e77:::benchmark_data_smithi121_44835_object23403:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:37.911 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.864095+0000", 2024-04-19T02:17:37.911 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 30.981415210000002, 2024-04-19T02:17:37.912 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.032015298999999997, 2024-04-19T02:17:37.912 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:37.912 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:37.912 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:37.912 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:37.912 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:37.912 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157438 2024-04-19T02:17:37.912 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.912 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:37.912 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.912 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:37.912 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864095+0000", 2024-04-19T02:17:37.912 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:37.912 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.912 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.913 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:37.913 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864095+0000", 2024-04-19T02:17:37.913 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:37.913 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.913 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.913 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:37.913 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864094+0000", 2024-04-19T02:17:37.913 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:37.913 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.913 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.913 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:37.913 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864102+0000", 2024-04-19T02:17:37.913 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.6629999999999993e-06 2024-04-19T02:17:37.913 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.913 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.914 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:37.914 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864113+0000", 2024-04-19T02:17:37.914 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1185999999999999e-05 2024-04-19T02:17:37.914 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.914 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.914 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.914 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864119+0000", 2024-04-19T02:17:37.914 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.224e-06 2024-04-19T02:17:37.914 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.914 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.914 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:37.914 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864151+0000", 2024-04-19T02:17:37.914 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1395e-05 2024-04-19T02:17:37.914 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.914 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.915 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:37.915 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864275+0000", 2024-04-19T02:17:37.915 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012431399999999999 2024-04-19T02:17:37.915 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.915 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.915 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:37.915 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864341+0000", 2024-04-19T02:17:37.915 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6146e-05 2024-04-19T02:17:37.915 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.915 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.915 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:37.915 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.866040+0000", 2024-04-19T02:17:37.915 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016991879999999999 2024-04-19T02:17:37.915 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.915 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.916 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:37.916 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896055+0000", 2024-04-19T02:17:37.916 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.030014886000000001 2024-04-19T02:17:37.916 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.916 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.916 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:37.916 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896087+0000", 2024-04-19T02:17:37.916 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1761000000000003e-05 2024-04-19T02:17:37.916 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.916 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.916 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:37.916 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896111+0000", 2024-04-19T02:17:37.916 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3623999999999999e-05 2024-04-19T02:17:37.916 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.916 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:37.916 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.917 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.917 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.917 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157439 5.e 5:79eb9d3c:::benchmark_data_smithi121_44835_object23404:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:37.917 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:37.917 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 30.981384134999999, 2024-04-19T02:17:37.917 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.027045244, 2024-04-19T02:17:37.917 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:37.917 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:37.917 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:37.917 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:37.917 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:37.917 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157439 2024-04-19T02:17:37.917 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.917 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:37.917 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.918 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:37.918 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:37.918 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:37.918 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.918 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.918 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:37.918 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:37.918 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:37.918 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.918 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.918 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:37.918 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:37.918 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:37.918 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.918 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.919 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:37.919 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864128+0000", 2024-04-19T02:17:37.919 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.911e-06 2024-04-19T02:17:37.919 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.919 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.919 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:37.919 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864136+0000", 2024-04-19T02:17:37.919 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2609999999999993e-06 2024-04-19T02:17:37.919 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.919 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.919 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.919 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864140+0000", 2024-04-19T02:17:37.919 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5530000000000001e-06 2024-04-19T02:17:37.919 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.919 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.920 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:37.920 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864169+0000", 2024-04-19T02:17:37.920 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.8932e-05 2024-04-19T02:17:37.920 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.920 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.920 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:37.921 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864267+0000", 2024-04-19T02:17:37.921 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7969999999999999e-05 2024-04-19T02:17:37.922 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.922 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.922 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:37.922 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864339+0000", 2024-04-19T02:17:37.922 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.2280999999999995e-05 2024-04-19T02:17:37.922 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.922 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.922 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:37.922 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.865763+0000", 2024-04-19T02:17:37.922 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0014236310000000001 2024-04-19T02:17:37.922 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.922 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.922 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:37.922 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.891093+0000", 2024-04-19T02:17:37.922 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.025330571 2024-04-19T02:17:37.923 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.923 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.923 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:37.923 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.891137+0000", 2024-04-19T02:17:37.923 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3980999999999998e-05 2024-04-19T02:17:37.923 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.923 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.923 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:37.923 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.891172+0000", 2024-04-19T02:17:37.923 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4465000000000003e-05 2024-04-19T02:17:37.923 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.923 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:37.923 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.923 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.924 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.924 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157442 5.0 5:0062b73f:::benchmark_data_smithi121_44835_object23407:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:37.924 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.867065+0000", 2024-04-19T02:17:37.924 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 30.978445485000002, 2024-04-19T02:17:37.924 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.029165542999999999, 2024-04-19T02:17:37.924 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:37.924 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:37.924 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:37.924 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:37.924 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:37.924 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157442 2024-04-19T02:17:37.924 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.924 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:37.924 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.924 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:37.925 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867065+0000", 2024-04-19T02:17:37.925 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:37.925 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.925 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.925 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:37.925 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867065+0000", 2024-04-19T02:17:37.925 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:37.925 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.925 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.925 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:37.925 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867064+0000", 2024-04-19T02:17:37.925 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:37.925 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.925 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.925 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:37.926 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867069+0000", 2024-04-19T02:17:37.926 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4549999999999997e-06 2024-04-19T02:17:37.926 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.926 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.926 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:37.926 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867080+0000", 2024-04-19T02:17:37.926 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0797e-05 2024-04-19T02:17:37.926 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.926 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.926 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.926 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867088+0000", 2024-04-19T02:17:37.926 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9729999999999997e-06 2024-04-19T02:17:37.926 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.926 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.926 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:37.927 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867121+0000", 2024-04-19T02:17:37.927 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2920000000000003e-05 2024-04-19T02:17:37.927 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.927 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.927 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:37.927 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867203+0000", 2024-04-19T02:17:37.927 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2578999999999997e-05 2024-04-19T02:17:37.927 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.927 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.927 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:37.927 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867386+0000", 2024-04-19T02:17:37.927 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00018237400000000001 2024-04-19T02:17:37.927 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.927 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.927 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:37.928 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.869338+0000", 2024-04-19T02:17:37.928 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0019521160000000001 2024-04-19T02:17:37.928 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.928 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.928 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:37.928 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896150+0000", 2024-04-19T02:17:37.928 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.026812074000000002 2024-04-19T02:17:37.928 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.928 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.928 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:37.928 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896191+0000", 2024-04-19T02:17:37.928 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1192000000000001e-05 2024-04-19T02:17:37.928 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.928 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.928 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:37.928 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896231+0000", 2024-04-19T02:17:37.929 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9764000000000001e-05 2024-04-19T02:17:37.929 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.929 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:37.929 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.929 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.929 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.929 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157499 5.8 5:1c3aa38a:::benchmark_data_smithi121_44835_object23464:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:37.929 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.913447+0000", 2024-04-19T02:17:37.929 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 30.932063913, 2024-04-19T02:17:37.929 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.024508188, 2024-04-19T02:17:37.929 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:37.929 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:37.929 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:37.929 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:37.929 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:37.930 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157499 2024-04-19T02:17:37.930 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.930 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:37.930 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.930 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:37.930 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913447+0000", 2024-04-19T02:17:37.930 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:37.930 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.930 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.930 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:37.930 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913447+0000", 2024-04-19T02:17:37.930 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:37.930 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.930 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.930 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:37.931 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913446+0000", 2024-04-19T02:17:37.931 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:37.931 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.931 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.931 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:37.931 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913451+0000", 2024-04-19T02:17:37.931 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.677e-06 2024-04-19T02:17:37.931 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.931 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.931 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:37.931 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913461+0000", 2024-04-19T02:17:37.931 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.8859999999999999e-06 2024-04-19T02:17:37.931 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.931 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.931 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.932 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913467+0000", 2024-04-19T02:17:37.932 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.0800000000000002e-06 2024-04-19T02:17:37.932 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.932 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.932 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:37.932 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913513+0000", 2024-04-19T02:17:37.932 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.5707000000000001e-05 2024-04-19T02:17:37.932 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.932 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.932 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:37.932 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913637+0000", 2024-04-19T02:17:37.932 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012379200000000001 2024-04-19T02:17:37.932 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.932 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.932 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:37.932 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913747+0000", 2024-04-19T02:17:37.933 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000110071 2024-04-19T02:17:37.933 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.933 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.933 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:37.933 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915674+0000", 2024-04-19T02:17:37.933 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0019270789999999999 2024-04-19T02:17:37.933 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.933 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.933 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:37.933 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937902+0000", 2024-04-19T02:17:37.933 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022228286 2024-04-19T02:17:37.933 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.933 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.933 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:37.933 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937931+0000", 2024-04-19T02:17:37.934 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9122e-05 2024-04-19T02:17:37.934 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.934 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.934 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:37.934 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937955+0000", 2024-04-19T02:17:37.934 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3591000000000002e-05 2024-04-19T02:17:37.934 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.934 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:37.934 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.934 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.934 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.934 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157500 5.0 5:0969ec74:::benchmark_data_smithi121_44835_object23465:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:37.934 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.913476+0000", 2024-04-19T02:17:37.934 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 30.932035046999999, 2024-04-19T02:17:37.935 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.024497596, 2024-04-19T02:17:37.935 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:37.935 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:37.935 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:37.935 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:37.935 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:37.935 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157500 2024-04-19T02:17:37.935 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.935 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:37.935 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.935 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:37.935 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913476+0000", 2024-04-19T02:17:37.935 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:37.935 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.935 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.936 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:37.936 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913476+0000", 2024-04-19T02:17:37.936 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:37.936 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.936 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.936 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:37.936 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913475+0000", 2024-04-19T02:17:37.936 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:37.936 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.936 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.936 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:37.936 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913478+0000", 2024-04-19T02:17:37.936 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.2670000000000001e-06 2024-04-19T02:17:37.936 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.936 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.937 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:37.937 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913481+0000", 2024-04-19T02:17:37.937 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6899999999999998e-06 2024-04-19T02:17:37.937 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.937 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.937 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.937 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913485+0000", 2024-04-19T02:17:37.937 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1230000000000002e-06 2024-04-19T02:17:37.937 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.937 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.937 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:37.937 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913526+0000", 2024-04-19T02:17:37.937 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.104e-05 2024-04-19T02:17:37.937 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.938 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.938 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:37.938 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913606+0000", 2024-04-19T02:17:37.938 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9510000000000003e-05 2024-04-19T02:17:37.938 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.938 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.938 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:37.938 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913671+0000", 2024-04-19T02:17:37.938 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.4838000000000005e-05 2024-04-19T02:17:37.938 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.938 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.938 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:37.938 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915348+0000", 2024-04-19T02:17:37.938 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016769860000000001 2024-04-19T02:17:37.938 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.939 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.939 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:37.939 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937897+0000", 2024-04-19T02:17:37.939 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022548902999999999 2024-04-19T02:17:37.939 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.939 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.939 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:37.939 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937938+0000", 2024-04-19T02:17:37.939 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1499999999999999e-05 2024-04-19T02:17:37.939 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.939 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.939 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:37.939 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937973+0000", 2024-04-19T02:17:37.939 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5057e-05 2024-04-19T02:17:37.939 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.940 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:37.940 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.940 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.940 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.940 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157501 5.4 5:26661819:::benchmark_data_smithi121_44835_object23466:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:37.940 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.914839+0000", 2024-04-19T02:17:37.940 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 30.930671752999999, 2024-04-19T02:17:37.940 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.028504224000000002, 2024-04-19T02:17:37.940 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:37.940 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:37.940 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:37.940 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:37.940 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:37.940 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157501 2024-04-19T02:17:37.940 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.941 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:37.941 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.941 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:37.941 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914839+0000", 2024-04-19T02:17:37.941 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:37.941 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.941 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.941 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:37.941 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914839+0000", 2024-04-19T02:17:37.941 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:37.941 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.941 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.941 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:37.941 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914838+0000", 2024-04-19T02:17:37.941 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:37.941 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.942 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.942 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:37.942 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914841+0000", 2024-04-19T02:17:37.942 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.706e-06 2024-04-19T02:17:37.942 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.942 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.942 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:37.942 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914848+0000", 2024-04-19T02:17:37.942 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.7429999999999996e-06 2024-04-19T02:17:37.942 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.942 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.942 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.942 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914852+0000", 2024-04-19T02:17:37.942 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0810000000000004e-06 2024-04-19T02:17:37.943 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.943 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.943 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:37.943 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914892+0000", 2024-04-19T02:17:37.943 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9957999999999999e-05 2024-04-19T02:17:37.943 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.943 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.943 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:37.943 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915008+0000", 2024-04-19T02:17:37.943 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000116401 2024-04-19T02:17:37.943 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.943 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.943 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:37.943 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915125+0000", 2024-04-19T02:17:37.943 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011622500000000001 2024-04-19T02:17:37.944 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.944 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.944 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:37.944 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916663+0000", 2024-04-19T02:17:37.944 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0015381310000000001 2024-04-19T02:17:37.944 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.944 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.944 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:37.944 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943114+0000", 2024-04-19T02:17:37.944 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.026451125999999998 2024-04-19T02:17:37.944 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.944 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.944 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:37.944 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943245+0000", 2024-04-19T02:17:37.944 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000131645 2024-04-19T02:17:37.944 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.945 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.945 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:37.945 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943343+0000", 2024-04-19T02:17:37.945 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7604999999999998e-05 2024-04-19T02:17:37.945 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.945 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:37.945 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.945 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.945 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.945 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157507 5.b 5:de8840a2:::benchmark_data_smithi121_44835_object23472:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:37.945 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:37.945 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 30.929107471999998, 2024-04-19T02:17:37.945 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022544518999999999, 2024-04-19T02:17:37.945 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:37.945 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:37.946 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:37.946 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:37.946 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:37.946 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157507 2024-04-19T02:17:37.946 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.946 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:37.946 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.946 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:37.946 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:37.946 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:37.946 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.946 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.946 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:37.946 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:37.946 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:37.946 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.947 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.947 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:37.947 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:37.947 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:37.947 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.947 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.947 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:37.947 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916406+0000", 2024-04-19T02:17:37.947 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4589999999999998e-06 2024-04-19T02:17:37.947 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.947 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.947 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:37.947 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916415+0000", 2024-04-19T02:17:37.947 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3910000000000004e-06 2024-04-19T02:17:37.947 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.948 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.948 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.948 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916421+0000", 2024-04-19T02:17:37.948 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.6130000000000003e-06 2024-04-19T02:17:37.948 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.948 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.948 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:37.948 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916448+0000", 2024-04-19T02:17:37.948 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7277999999999999e-05 2024-04-19T02:17:37.948 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.948 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.948 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:37.948 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916539+0000", 2024-04-19T02:17:37.948 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0855999999999999e-05 2024-04-19T02:17:37.949 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.949 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.949 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:37.949 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916605+0000", 2024-04-19T02:17:37.949 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6141000000000003e-05 2024-04-19T02:17:37.949 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.949 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.949 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:37.949 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918276+0000", 2024-04-19T02:17:37.949 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001670726 2024-04-19T02:17:37.949 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.949 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.949 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:37.949 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.938888+0000", 2024-04-19T02:17:37.949 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020612042000000001 2024-04-19T02:17:37.950 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.950 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.950 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:37.950 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.938924+0000", 2024-04-19T02:17:37.950 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5692999999999999e-05 2024-04-19T02:17:37.950 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.950 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.950 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:37.950 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.938948+0000", 2024-04-19T02:17:37.950 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3879e-05 2024-04-19T02:17:37.950 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.950 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:37.950 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.950 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.950 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.951 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157509 5.8 5:1dca85d0:::benchmark_data_smithi121_44835_object23474:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:37.951 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:37.951 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 30.926679226000001, 2024-04-19T02:17:37.951 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.024511807, 2024-04-19T02:17:37.951 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:37.951 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:37.951 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:37.951 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:37.951 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:37.951 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157509 2024-04-19T02:17:37.951 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.951 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:37.951 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.951 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:37.951 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:37.952 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:37.952 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.952 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.952 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:37.952 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:37.952 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:37.952 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.952 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.952 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:37.952 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:37.952 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:37.952 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.952 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.952 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:37.952 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918834+0000", 2024-04-19T02:17:37.953 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9409999999999999e-06 2024-04-19T02:17:37.953 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.953 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.953 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:37.953 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918859+0000", 2024-04-19T02:17:37.953 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.5245999999999999e-05 2024-04-19T02:17:37.953 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.953 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.953 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:37.953 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918864+0000", 2024-04-19T02:17:37.953 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.1819999999999997e-06 2024-04-19T02:17:37.953 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.953 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.953 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:37.953 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918900+0000", 2024-04-19T02:17:37.954 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5327000000000002e-05 2024-04-19T02:17:37.954 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.954 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.954 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:37.954 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.919024+0000", 2024-04-19T02:17:37.954 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012400900000000001 2024-04-19T02:17:37.954 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.954 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.954 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:37.954 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.919136+0000", 2024-04-19T02:17:37.954 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000111987 2024-04-19T02:17:37.954 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.954 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.954 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:37.954 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.922096+0000", 2024-04-19T02:17:37.955 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0029607079999999998 2024-04-19T02:17:37.955 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.955 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.955 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:37.955 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943120+0000", 2024-04-19T02:17:37.955 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.021023995 2024-04-19T02:17:37.955 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.955 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.955 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:37.955 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943255+0000", 2024-04-19T02:17:37.955 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013502100000000001 2024-04-19T02:17:37.955 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:37.955 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:37.955 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:37.955 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943343+0000", 2024-04-19T02:17:37.956 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.7931999999999998e-05 2024-04-19T02:17:37.956 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.956 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:37.956 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.956 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:37.956 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:37.956 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:17:37.957 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:37.957+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:37.958 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:38.058 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:38.059+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:38.132 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:38.133 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:17:38.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.133 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241156 5.f 5:fe6521b2:::benchmark_data_smithi121_44835_object107121:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:38.133 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.127112+0000", 2024-04-19T02:17:38.133 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0046932379999999998, 2024-04-19T02:17:38.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.004730064, 2024-04-19T02:17:38.133 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:38.133 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:38.133 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:38.133 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:38.133 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:38.133 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241156 2024-04-19T02:17:38.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.134 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:38.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:38.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.127112+0000", 2024-04-19T02:17:38.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:38.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.127112+0000", 2024-04-19T02:17:38.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:38.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.127111+0000", 2024-04-19T02:17:38.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967296 2024-04-19T02:17:38.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:38.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.127113+0000", 2024-04-19T02:17:38.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.615e-06 2024-04-19T02:17:38.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:38.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.127116+0000", 2024-04-19T02:17:38.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1410000000000001e-06 2024-04-19T02:17:38.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.136 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:38.136 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.127119+0000", 2024-04-19T02:17:38.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.236e-06 2024-04-19T02:17:38.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.136 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:38.136 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.127156+0000", 2024-04-19T02:17:38.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6177000000000003e-05 2024-04-19T02:17:38.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.136 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:38.136 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.127248+0000", 2024-04-19T02:17:38.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2056000000000001e-05 2024-04-19T02:17:38.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:38.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.127332+0000", 2024-04-19T02:17:38.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4053000000000003e-05 2024-04-19T02:17:38.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:38.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.129978+0000", 2024-04-19T02:17:38.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026467639999999998 2024-04-19T02:17:38.137 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.137 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:38.137 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.137 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241159 5.f 5:f431a717:::benchmark_data_smithi121_44835_object107124:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:38.138 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.127125+0000", 2024-04-19T02:17:38.138 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0046797569999999997, 2024-04-19T02:17:38.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0048047649999999999, 2024-04-19T02:17:38.138 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:38.138 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:38.138 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:38.138 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:38.138 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:38.138 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241159 2024-04-19T02:17:38.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.139 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:38.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:38.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.127125+0000", 2024-04-19T02:17:38.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:38.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.127125+0000", 2024-04-19T02:17:38.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:38.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.127125+0000", 2024-04-19T02:17:38.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:38.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:38.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.127127+0000", 2024-04-19T02:17:38.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0379999999999998e-06 2024-04-19T02:17:38.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:38.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.127132+0000", 2024-04-19T02:17:38.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5219999999999998e-06 2024-04-19T02:17:38.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:38.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.127137+0000", 2024-04-19T02:17:38.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5759999999999999e-06 2024-04-19T02:17:38.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:38.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.128718+0000", 2024-04-19T02:17:38.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0015806679999999999 2024-04-19T02:17:38.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.142 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:38.142 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.128796+0000", 2024-04-19T02:17:38.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8639000000000004e-05 2024-04-19T02:17:38.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.142 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:38.142 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.128860+0000", 2024-04-19T02:17:38.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3887999999999995e-05 2024-04-19T02:17:38.142 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.143 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:38.143 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.143 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.143 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.143 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241165 5.6 5:6d4dc45a:::benchmark_data_smithi121_44835_object107130:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:38.143 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.129610+0000", 2024-04-19T02:17:38.144 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0021944450000000002, 2024-04-19T02:17:38.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0023940540000000001, 2024-04-19T02:17:38.144 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:38.144 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:38.144 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:38.144 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:38.145 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:38.145 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241165 2024-04-19T02:17:38.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.145 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:38.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:38.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.129610+0000", 2024-04-19T02:17:38.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:38.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.129610+0000", 2024-04-19T02:17:38.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:38.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.129610+0000", 2024-04-19T02:17:38.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:38.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:38.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.129614+0000", 2024-04-19T02:17:38.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2980000000000002e-06 2024-04-19T02:17:38.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:38.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.129624+0000", 2024-04-19T02:17:38.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6949999999999995e-06 2024-04-19T02:17:38.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:38.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.129631+0000", 2024-04-19T02:17:38.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0979999999999996e-06 2024-04-19T02:17:38.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:38.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.129675+0000", 2024-04-19T02:17:38.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4295999999999997e-05 2024-04-19T02:17:38.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:38.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.129761+0000", 2024-04-19T02:17:38.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6159e-05 2024-04-19T02:17:38.152 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.152 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:38.152 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.152 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241166 5.2 5:432d9211:::benchmark_data_smithi121_44835_object107131:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:38.152 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.129638+0000", 2024-04-19T02:17:38.152 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0021666060000000002, 2024-04-19T02:17:38.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0024390900000000001, 2024-04-19T02:17:38.152 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:38.152 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:38.152 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:38.152 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:38.153 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:38.153 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241166 2024-04-19T02:17:38.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.153 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:38.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:38.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.129638+0000", 2024-04-19T02:17:38.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:38.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.129638+0000", 2024-04-19T02:17:38.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:38.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.129638+0000", 2024-04-19T02:17:38.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:38.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:38.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.129640+0000", 2024-04-19T02:17:38.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.339e-06 2024-04-19T02:17:38.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:38.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.129650+0000", 2024-04-19T02:17:38.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7219999999999994e-06 2024-04-19T02:17:38.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:38.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.129657+0000", 2024-04-19T02:17:38.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9770000000000003e-06 2024-04-19T02:17:38.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:38.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.129700+0000", 2024-04-19T02:17:38.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2852999999999998e-05 2024-04-19T02:17:38.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:38.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.129828+0000", 2024-04-19T02:17:38.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012799600000000001 2024-04-19T02:17:38.156 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.156 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:38.156 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.156 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241167 5.5 5:a08fc2bb:::benchmark_data_smithi121_44835_object107132:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:38.156 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.129666+0000", 2024-04-19T02:17:38.156 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0021392949999999998, 2024-04-19T02:17:38.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0024816130000000001, 2024-04-19T02:17:38.156 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:38.156 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:38.156 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:38.156 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:38.156 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:38.156 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241167 2024-04-19T02:17:38.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.157 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:38.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:38.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.129666+0000", 2024-04-19T02:17:38.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:38.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.129666+0000", 2024-04-19T02:17:38.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:38.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.129665+0000", 2024-04-19T02:17:38.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:38.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:38.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.129668+0000", 2024-04-19T02:17:38.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1099999999999999e-06 2024-04-19T02:17:38.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:38.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.129674+0000", 2024-04-19T02:17:38.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0900000000000001e-06 2024-04-19T02:17:38.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:38.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.129679+0000", 2024-04-19T02:17:38.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7620000000000003e-06 2024-04-19T02:17:38.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:38.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.129717+0000", 2024-04-19T02:17:38.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7679999999999998e-05 2024-04-19T02:17:38.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:38.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.129835+0000", 2024-04-19T02:17:38.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000118403 2024-04-19T02:17:38.160 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.160 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:38.160 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.160 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241168 5.2 5:4863132a:::benchmark_data_smithi121_44835_object107133:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:38.160 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.130040+0000", 2024-04-19T02:17:38.160 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.001764432, 2024-04-19T02:17:38.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021718549999999999, 2024-04-19T02:17:38.161 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:38.161 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:38.161 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:38.161 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:38.161 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:38.161 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241168 2024-04-19T02:17:38.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.161 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:38.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:38.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.130040+0000", 2024-04-19T02:17:38.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:38.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.130040+0000", 2024-04-19T02:17:38.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:38.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.130040+0000", 2024-04-19T02:17:38.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:38.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:38.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.130044+0000", 2024-04-19T02:17:38.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7450000000000003e-06 2024-04-19T02:17:38.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:38.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.130054+0000", 2024-04-19T02:17:38.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1530000000000003e-06 2024-04-19T02:17:38.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:38.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.130062+0000", 2024-04-19T02:17:38.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6989999999999992e-06 2024-04-19T02:17:38.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:38.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.131858+0000", 2024-04-19T02:17:38.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017954010000000001 2024-04-19T02:17:38.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.164 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:38.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.131968+0000", 2024-04-19T02:17:38.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000110049 2024-04-19T02:17:38.164 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.164 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:38.164 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.164 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241169 5.3 5:cecb98d1:::benchmark_data_smithi121_44835_object107134:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:38.164 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.130112+0000", 2024-04-19T02:17:38.164 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0016933339999999999, 2024-04-19T02:17:38.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021767499999999999, 2024-04-19T02:17:38.164 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:38.164 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:38.164 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:38.165 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:38.165 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:38.165 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241169 2024-04-19T02:17:38.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.165 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:38.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:38.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.130112+0000", 2024-04-19T02:17:38.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:38.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.130112+0000", 2024-04-19T02:17:38.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:38.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.130111+0000", 2024-04-19T02:17:38.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:38.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:38.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.130114+0000", 2024-04-19T02:17:38.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0369999999999999e-06 2024-04-19T02:17:38.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:38.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.130121+0000", 2024-04-19T02:17:38.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2309999999999999e-06 2024-04-19T02:17:38.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:38.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.130126+0000", 2024-04-19T02:17:38.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2220000000000001e-06 2024-04-19T02:17:38.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:38.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.130169+0000", 2024-04-19T02:17:38.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2098999999999998e-05 2024-04-19T02:17:38.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:38.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.130307+0000", 2024-04-19T02:17:38.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013849899999999999 2024-04-19T02:17:38.168 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.168 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:38.168 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.168 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241170 5.9 5:9ca1bd5c:::benchmark_data_smithi121_44835_object107135:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:38.168 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.130135+0000", 2024-04-19T02:17:38.169 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0016698360000000001, 2024-04-19T02:17:38.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022277859999999998, 2024-04-19T02:17:38.169 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:38.169 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:38.169 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:38.169 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:38.169 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:38.169 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241170 2024-04-19T02:17:38.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.169 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:38.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:38.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.130135+0000", 2024-04-19T02:17:38.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:38.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.130135+0000", 2024-04-19T02:17:38.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:38.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.130135+0000", 2024-04-19T02:17:38.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:38.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:38.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.130137+0000", 2024-04-19T02:17:38.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2570000000000002e-06 2024-04-19T02:17:38.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:38.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.130142+0000", 2024-04-19T02:17:38.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2499999999999997e-06 2024-04-19T02:17:38.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:38.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.130147+0000", 2024-04-19T02:17:38.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4379999999999997e-06 2024-04-19T02:17:38.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:38.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.130223+0000", 2024-04-19T02:17:38.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6530000000000001e-05 2024-04-19T02:17:38.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:38.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.130335+0000", 2024-04-19T02:17:38.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011177500000000001 2024-04-19T02:17:38.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:38.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.130432+0000", 2024-04-19T02:17:38.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7170999999999995e-05 2024-04-19T02:17:38.173 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.173 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:38.173 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.173 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241171 5.7 5:ea113d18:::benchmark_data_smithi121_44835_object107136:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:38.173 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.130259+0000", 2024-04-19T02:17:38.173 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0015455029999999999, 2024-04-19T02:17:38.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002180904, 2024-04-19T02:17:38.173 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:38.174 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:38.174 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:38.174 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:38.174 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:38.174 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241171 2024-04-19T02:17:38.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.174 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:38.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.174 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:38.174 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.130259+0000", 2024-04-19T02:17:38.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:38.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.130259+0000", 2024-04-19T02:17:38.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:38.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.130259+0000", 2024-04-19T02:17:38.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:38.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:38.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.130262+0000", 2024-04-19T02:17:38.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.377e-06 2024-04-19T02:17:38.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:38.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.130269+0000", 2024-04-19T02:17:38.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2470000000000002e-06 2024-04-19T02:17:38.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:38.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.130275+0000", 2024-04-19T02:17:38.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5049999999999998e-06 2024-04-19T02:17:38.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:38.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.130313+0000", 2024-04-19T02:17:38.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8531000000000001e-05 2024-04-19T02:17:38.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:38.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.130425+0000", 2024-04-19T02:17:38.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000111326 2024-04-19T02:17:38.177 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.177 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:38.177 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.178 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4549.0:241145 5.d e62/16 ondisk, result = 0)", 2024-04-19T02:17:38.178 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.132415+0000", 2024-04-19T02:17:38.178 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9993901, 2024-04-19T02:17:38.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8466000000000003e-05, 2024-04-19T02:17:38.178 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:38.178 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:38.178 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:38.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:38.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132415+0000", 2024-04-19T02:17:38.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:38.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132415+0000", 2024-04-19T02:17:38.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:38.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132414+0000", 2024-04-19T02:17:38.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:38.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:38.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132420+0000", 2024-04-19T02:17:38.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7729999999999996e-06 2024-04-19T02:17:38.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:38.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132430+0000", 2024-04-19T02:17:38.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.004e-05 2024-04-19T02:17:38.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:38.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132437+0000", 2024-04-19T02:17:38.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8390000000000001e-06 2024-04-19T02:17:38.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:38.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132476+0000", 2024-04-19T02:17:38.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9215000000000003e-05 2024-04-19T02:17:38.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:38.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132483+0000", 2024-04-19T02:17:38.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1400000000000002e-06 2024-04-19T02:17:38.181 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.181 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:38.181 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.181 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4549.0:241146 5.d e62/16)", 2024-04-19T02:17:38.181 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.132446+0000", 2024-04-19T02:17:38.182 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9993587, 2024-04-19T02:17:38.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000116261, 2024-04-19T02:17:38.182 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:38.182 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-04-19T02:17:38.182 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:38.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:38.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132446+0000", 2024-04-19T02:17:38.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:38.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132446+0000", 2024-04-19T02:17:38.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:38.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132446+0000", 2024-04-19T02:17:38.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967296 2024-04-19T02:17:38.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:38.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132448+0000", 2024-04-19T02:17:38.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.001e-06 2024-04-19T02:17:38.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:38.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132458+0000", 2024-04-19T02:17:38.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0336999999999999e-05 2024-04-19T02:17:38.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:38.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132462+0000", 2024-04-19T02:17:38.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9790000000000004e-06 2024-04-19T02:17:38.184 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.184 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:38.184 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.184 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4549.0:241144 5.f e62/16 ondisk, result = 0)", 2024-04-19T02:17:38.184 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.132477+0000", 2024-04-19T02:17:38.184 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9993281, 2024-04-19T02:17:38.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000142943, 2024-04-19T02:17:38.185 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:38.185 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:38.185 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:38.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:38.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132477+0000", 2024-04-19T02:17:38.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:38.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132477+0000", 2024-04-19T02:17:38.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:38.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132477+0000", 2024-04-19T02:17:38.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967296 2024-04-19T02:17:38.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:38.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132479+0000", 2024-04-19T02:17:38.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8700000000000001e-06 2024-04-19T02:17:38.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:38.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132484+0000", 2024-04-19T02:17:38.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1290000000000004e-06 2024-04-19T02:17:38.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:38.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132488+0000", 2024-04-19T02:17:38.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6229999999999996e-06 2024-04-19T02:17:38.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:38.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132517+0000", 2024-04-19T02:17:38.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8713000000000001e-05 2024-04-19T02:17:38.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:38.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132525+0000", 2024-04-19T02:17:38.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8930000000000005e-06 2024-04-19T02:17:38.187 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.188 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:38.188 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.188 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4549.0:241156 5.f e62/16 ondisk, result = 0)", 2024-04-19T02:17:38.188 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.132494+0000", 2024-04-19T02:17:38.188 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.999311, 2024-04-19T02:17:38.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000223019, 2024-04-19T02:17:38.188 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:38.188 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:38.188 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:38.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:38.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132494+0000", 2024-04-19T02:17:38.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:38.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132494+0000", 2024-04-19T02:17:38.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:38.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132494+0000", 2024-04-19T02:17:38.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967296 2024-04-19T02:17:38.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:38.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132496+0000", 2024-04-19T02:17:38.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6869999999999999e-06 2024-04-19T02:17:38.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:38.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132501+0000", 2024-04-19T02:17:38.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2959999999999998e-06 2024-04-19T02:17:38.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:38.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132505+0000", 2024-04-19T02:17:38.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7629999999999998e-06 2024-04-19T02:17:38.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:38.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132646+0000", 2024-04-19T02:17:38.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014185200000000001 2024-04-19T02:17:38.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:38.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132653+0000", 2024-04-19T02:17:38.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.691e-06 2024-04-19T02:17:38.191 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.191 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:38.191 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.192 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4549.0:241159 5.f e62/16 ondisk, result = 0)", 2024-04-19T02:17:38.192 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.132508+0000", 2024-04-19T02:17:38.192 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9992971, 2024-04-19T02:17:38.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028296300000000001, 2024-04-19T02:17:38.192 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:38.192 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:38.192 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:38.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:38.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132508+0000", 2024-04-19T02:17:38.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:38.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132508+0000", 2024-04-19T02:17:38.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:38.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132508+0000", 2024-04-19T02:17:38.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967296 2024-04-19T02:17:38.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:38.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132509+0000", 2024-04-19T02:17:38.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5850000000000001e-06 2024-04-19T02:17:38.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:38.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132514+0000", 2024-04-19T02:17:38.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9089999999999999e-06 2024-04-19T02:17:38.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:38.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132518+0000", 2024-04-19T02:17:38.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7170000000000002e-06 2024-04-19T02:17:38.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:38.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132769+0000", 2024-04-19T02:17:38.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000251322 2024-04-19T02:17:38.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:38.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132776+0000", 2024-04-19T02:17:38.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4289999999999998e-06 2024-04-19T02:17:38.195 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.195 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:38.195 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.195 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241172 5.3 5:c9553f35:::benchmark_data_smithi121_44835_object107137:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:38.195 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.132532+0000", 2024-04-19T02:17:38.195 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9992733, 2024-04-19T02:17:38.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00033099300000000002, 2024-04-19T02:17:38.195 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:38.195 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:38.195 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:38.195 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:38.195 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:38.196 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241172 2024-04-19T02:17:38.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.196 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:38.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:38.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132532+0000", 2024-04-19T02:17:38.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:38.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132532+0000", 2024-04-19T02:17:38.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:38.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132531+0000", 2024-04-19T02:17:38.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:38.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:38.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132534+0000", 2024-04-19T02:17:38.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5279999999999999e-06 2024-04-19T02:17:38.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:38.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132542+0000", 2024-04-19T02:17:38.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2810000000000003e-06 2024-04-19T02:17:38.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:38.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132548+0000", 2024-04-19T02:17:38.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.993e-06 2024-04-19T02:17:38.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:38.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132589+0000", 2024-04-19T02:17:38.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1338999999999998e-05 2024-04-19T02:17:38.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:38.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132694+0000", 2024-04-19T02:17:38.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105324 2024-04-19T02:17:38.198 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.198 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:38.199 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.199 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241173 5.d 5:b26b66f9:::benchmark_data_smithi121_44835_object107138:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:38.199 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.132556+0000", 2024-04-19T02:17:38.199 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9992485, 2024-04-19T02:17:38.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00038925500000000003, 2024-04-19T02:17:38.199 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:38.199 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:38.199 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:38.199 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:38.199 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:38.199 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241173 2024-04-19T02:17:38.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.199 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:38.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:38.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132556+0000", 2024-04-19T02:17:38.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:38.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132556+0000", 2024-04-19T02:17:38.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:38.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132556+0000", 2024-04-19T02:17:38.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:38.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:38.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132558+0000", 2024-04-19T02:17:38.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3140000000000002e-06 2024-04-19T02:17:38.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:38.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132564+0000", 2024-04-19T02:17:38.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5380000000000002e-06 2024-04-19T02:17:38.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:38.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132575+0000", 2024-04-19T02:17:38.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1163e-05 2024-04-19T02:17:38.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:38.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132754+0000", 2024-04-19T02:17:38.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017934299999999999 2024-04-19T02:17:38.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:38.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132869+0000", 2024-04-19T02:17:38.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011524800000000001 2024-04-19T02:17:38.202 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.202 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:38.202 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.202 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241175 5.7 5:e2253f83:::benchmark_data_smithi121_44835_object107140:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:38.203 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.132589+0000", 2024-04-19T02:17:38.203 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9992156, 2024-04-19T02:17:38.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00043567399999999999, 2024-04-19T02:17:38.203 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:38.203 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:38.203 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:38.203 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:38.203 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:38.203 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241175 2024-04-19T02:17:38.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.203 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:38.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:38.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132589+0000", 2024-04-19T02:17:38.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:38.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132589+0000", 2024-04-19T02:17:38.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:38.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132588+0000", 2024-04-19T02:17:38.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:38.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:38.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132593+0000", 2024-04-19T02:17:38.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7870000000000001e-06 2024-04-19T02:17:38.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:38.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132601+0000", 2024-04-19T02:17:38.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4819999999999997e-06 2024-04-19T02:17:38.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:38.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132607+0000", 2024-04-19T02:17:38.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9009999999999997e-06 2024-04-19T02:17:38.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:38.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132805+0000", 2024-04-19T02:17:38.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000197355 2024-04-19T02:17:38.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:38.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.132917+0000", 2024-04-19T02:17:38.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011264000000000001 2024-04-19T02:17:38.206 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.206 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:38.206 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.206 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241176 5.c 5:3bef2fa5:::benchmark_data_smithi121_44835_object107141:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:38.206 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.133000+0000", 2024-04-19T02:17:38.206 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9988046, 2024-04-19T02:17:38.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010192999999999999, 2024-04-19T02:17:38.206 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:38.206 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-04-19T02:17:38.206 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:38.207 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:38.207 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:38.207 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241176 2024-04-19T02:17:38.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.207 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:38.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:38.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.133000+0000", 2024-04-19T02:17:38.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:38.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.133000+0000", 2024-04-19T02:17:38.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:38.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.133000+0000", 2024-04-19T02:17:38.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:38.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:38.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.133005+0000", 2024-04-19T02:17:38.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7899999999999999e-06 2024-04-19T02:17:38.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:38.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.133013+0000", 2024-04-19T02:17:38.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8829999999999995e-06 2024-04-19T02:17:38.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:38.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.133021+0000", 2024-04-19T02:17:38.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2200000000000003e-06 2024-04-19T02:17:38.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:38.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.133062+0000", 2024-04-19T02:17:38.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1149999999999997e-05 2024-04-19T02:17:38.209 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.209 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:38.209 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.209 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241178 5.7 5.7a865a87 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:38.210 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.133032+0000", 2024-04-19T02:17:38.210 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9987731, 2024-04-19T02:17:38.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109879, 2024-04-19T02:17:38.210 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:38.210 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-04-19T02:17:38.210 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:38.210 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:38.210 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:38.210 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241178 2024-04-19T02:17:38.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.210 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:38.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:38.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.133032+0000", 2024-04-19T02:17:38.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:38.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.133032+0000", 2024-04-19T02:17:38.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:38.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.133031+0000", 2024-04-19T02:17:38.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:38.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:38.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.133034+0000", 2024-04-19T02:17:38.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.469e-06 2024-04-19T02:17:38.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:38.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.133039+0000", 2024-04-19T02:17:38.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.626e-06 2024-04-19T02:17:38.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:38.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.133044+0000", 2024-04-19T02:17:38.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6689999999999997e-06 2024-04-19T02:17:38.212 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.212 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:38.212 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.212 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.212 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-04-19T02:17:38.213 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 19 2024-04-19T02:17:38.213 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:38.214 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:38.214+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:38.214 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:38.351 INFO:teuthology.orchestra.run.smithi121.stderr:nodeep-scrub is unset 2024-04-19T02:17:38.355 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:38.315+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:38.369 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:38.370 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-04-19T02:17:38.370 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-04-19T02:17:38.370 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-04-19T02:17:38.370 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:38.383 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:38.416 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:38.416+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:38.468 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:17:38.517 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:38.516+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:38.557 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:38.557 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-04-19T02:17:38.557 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-04-19T02:17:38.557 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:17:38.557 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.557 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168377 5.d 5:b1f3fb6d:::benchmark_data_smithi121_44835_object34342:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:38.557 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069470+0000", 2024-04-19T02:17:38.557 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.486348112000002, 2024-04-19T02:17:38.557 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050516473999999999, 2024-04-19T02:17:38.557 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:38.557 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:38.558 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:38.558 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:38.558 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:38.558 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168377 2024-04-19T02:17:38.558 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.558 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:38.558 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.558 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:38.558 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069470+0000", 2024-04-19T02:17:38.558 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.558 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.558 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.558 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:38.558 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069470+0000", 2024-04-19T02:17:38.559 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.559 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.559 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.559 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:38.559 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069469+0000", 2024-04-19T02:17:38.559 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:38.559 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.559 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.559 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:38.559 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069473+0000", 2024-04-19T02:17:38.559 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4580000000000002e-06 2024-04-19T02:17:38.559 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.559 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.559 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:38.560 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069482+0000", 2024-04-19T02:17:38.560 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2839999999999995e-06 2024-04-19T02:17:38.560 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.560 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.560 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:38.560 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069489+0000", 2024-04-19T02:17:38.560 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3579999999999997e-06 2024-04-19T02:17:38.560 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.560 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.560 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:38.560 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069559+0000", 2024-04-19T02:17:38.560 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9678000000000006e-05 2024-04-19T02:17:38.560 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.560 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.560 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:38.561 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069683+0000", 2024-04-19T02:17:38.561 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012359400000000001 2024-04-19T02:17:38.561 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.561 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.561 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:38.561 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069759+0000", 2024-04-19T02:17:38.561 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6834000000000003e-05 2024-04-19T02:17:38.561 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.561 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.561 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:38.561 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119871+0000", 2024-04-19T02:17:38.561 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050111392999999997 2024-04-19T02:17:38.561 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.561 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.561 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:38.562 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119932+0000", 2024-04-19T02:17:38.562 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1209000000000003e-05 2024-04-19T02:17:38.562 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.562 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.562 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:38.562 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119962+0000", 2024-04-19T02:17:38.562 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9717999999999999e-05 2024-04-19T02:17:38.562 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.562 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.562 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:38.562 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119986+0000", 2024-04-19T02:17:38.562 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4549000000000002e-05 2024-04-19T02:17:38.562 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.562 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:38.563 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.563 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.563 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.563 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168379 5.d 5:bcd492dd:::benchmark_data_smithi121_44835_object34344:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:38.563 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069502+0000", 2024-04-19T02:17:38.563 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.486316059, 2024-04-19T02:17:38.563 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050544645999999999, 2024-04-19T02:17:38.563 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:38.563 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:38.563 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:38.563 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:38.563 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:38.563 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168379 2024-04-19T02:17:38.563 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.563 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:38.563 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.564 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:38.564 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069502+0000", 2024-04-19T02:17:38.564 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.564 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.564 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.564 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:38.564 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069502+0000", 2024-04-19T02:17:38.564 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.564 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.564 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.564 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:38.564 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069501+0000", 2024-04-19T02:17:38.564 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:38.564 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.565 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.565 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:38.565 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069504+0000", 2024-04-19T02:17:38.565 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9289999999999998e-06 2024-04-19T02:17:38.565 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.565 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.565 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:38.565 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069511+0000", 2024-04-19T02:17:38.565 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1909999999999997e-06 2024-04-19T02:17:38.565 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.565 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.565 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:38.565 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069517+0000", 2024-04-19T02:17:38.565 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0789999999999997e-06 2024-04-19T02:17:38.565 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.566 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.566 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:38.566 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071081+0000", 2024-04-19T02:17:38.566 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0015646550000000001 2024-04-19T02:17:38.566 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.566 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.566 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:38.566 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071195+0000", 2024-04-19T02:17:38.566 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011399400000000001 2024-04-19T02:17:38.566 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.566 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.566 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:38.566 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071293+0000", 2024-04-19T02:17:38.566 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7938999999999999e-05 2024-04-19T02:17:38.567 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.567 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.567 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:38.567 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119898+0000", 2024-04-19T02:17:38.567 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.048604808999999999 2024-04-19T02:17:38.567 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.567 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.567 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:38.567 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119993+0000", 2024-04-19T02:17:38.567 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5224999999999997e-05 2024-04-19T02:17:38.567 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.567 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.567 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:38.567 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120024+0000", 2024-04-19T02:17:38.567 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0580999999999997e-05 2024-04-19T02:17:38.568 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.568 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.568 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:38.568 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120047+0000", 2024-04-19T02:17:38.568 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2725e-05 2024-04-19T02:17:38.568 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.568 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:38.568 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.568 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.568 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.568 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168381 5.d 5:bcbab0e3:::benchmark_data_smithi121_44835_object34346:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:38.568 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:38.568 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.486296640999999, 2024-04-19T02:17:38.568 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050574694000000003, 2024-04-19T02:17:38.569 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:38.569 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:38.569 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:38.569 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:38.569 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:38.569 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168381 2024-04-19T02:17:38.569 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.569 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:38.569 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.569 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:38.569 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:38.569 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.569 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.569 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.569 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:38.570 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:38.570 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.570 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.570 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.570 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:38.570 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:38.570 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:38.570 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.570 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.570 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:38.570 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069523+0000", 2024-04-19T02:17:38.570 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.244e-06 2024-04-19T02:17:38.570 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.571 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.571 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:38.571 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069528+0000", 2024-04-19T02:17:38.571 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0669999999999999e-06 2024-04-19T02:17:38.571 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.571 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.571 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:38.571 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069533+0000", 2024-04-19T02:17:38.571 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4680000000000003e-06 2024-04-19T02:17:38.571 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.571 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.571 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:38.571 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072637+0000", 2024-04-19T02:17:38.571 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031040429999999999 2024-04-19T02:17:38.572 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.572 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.572 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:38.572 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072710+0000", 2024-04-19T02:17:38.572 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3045000000000003e-05 2024-04-19T02:17:38.572 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.572 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.572 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:38.572 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072775+0000", 2024-04-19T02:17:38.572 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5034000000000001e-05 2024-04-19T02:17:38.572 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.572 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.572 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:38.572 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119925+0000", 2024-04-19T02:17:38.572 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.047150594999999997 2024-04-19T02:17:38.572 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.572 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.573 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:38.573 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120055+0000", 2024-04-19T02:17:38.573 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129288 2024-04-19T02:17:38.573 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.573 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.573 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:38.573 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120077+0000", 2024-04-19T02:17:38.573 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1759e-05 2024-04-19T02:17:38.573 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.573 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.573 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:38.573 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120096+0000", 2024-04-19T02:17:38.573 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9524000000000001e-05 2024-04-19T02:17:38.573 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.573 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:38.573 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.574 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.574 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.574 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168382 5.f 5:f2599a15:::benchmark_data_smithi121_44835_object34347:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:38.574 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069556+0000", 2024-04-19T02:17:38.574 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.486262234000002, 2024-04-19T02:17:38.574 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050009713999999997, 2024-04-19T02:17:38.574 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:38.574 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:38.574 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:38.574 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:38.574 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:38.574 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168382 2024-04-19T02:17:38.574 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.574 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:38.574 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.575 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:38.575 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069556+0000", 2024-04-19T02:17:38.575 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.575 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.575 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.575 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:38.575 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069556+0000", 2024-04-19T02:17:38.575 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.575 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.575 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.575 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:38.575 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069555+0000", 2024-04-19T02:17:38.575 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:38.575 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.575 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.575 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:38.576 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069558+0000", 2024-04-19T02:17:38.576 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7879999999999998e-06 2024-04-19T02:17:38.576 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.576 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.576 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:38.576 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069566+0000", 2024-04-19T02:17:38.576 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6149999999999999e-06 2024-04-19T02:17:38.576 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.576 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.576 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:38.576 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069571+0000", 2024-04-19T02:17:38.576 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5509999999999999e-06 2024-04-19T02:17:38.576 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.576 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.576 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:38.576 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069618+0000", 2024-04-19T02:17:38.576 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6964e-05 2024-04-19T02:17:38.577 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.577 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.577 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:38.577 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069744+0000", 2024-04-19T02:17:38.577 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012577199999999999 2024-04-19T02:17:38.577 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.577 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.577 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:38.577 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.070116+0000", 2024-04-19T02:17:38.577 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000372407 2024-04-19T02:17:38.577 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.577 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.577 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:38.577 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117511+0000", 2024-04-19T02:17:38.577 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.047394935999999999 2024-04-19T02:17:38.578 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.578 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.578 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:38.578 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119484+0000", 2024-04-19T02:17:38.578 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019722310000000001 2024-04-19T02:17:38.578 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.578 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.578 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:38.578 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119525+0000", 2024-04-19T02:17:38.578 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1035999999999998e-05 2024-04-19T02:17:38.578 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.578 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.578 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:38.578 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119565+0000", 2024-04-19T02:17:38.579 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0859000000000003e-05 2024-04-19T02:17:38.579 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.579 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:38.579 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.579 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.579 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.579 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168383 5.d 5:bbd9496c:::benchmark_data_smithi121_44835_object34348:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:38.579 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069581+0000", 2024-04-19T02:17:38.579 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.486237345999999, 2024-04-19T02:17:38.579 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050607278999999998, 2024-04-19T02:17:38.579 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:38.579 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:38.579 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:38.579 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:38.579 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:38.580 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168383 2024-04-19T02:17:38.580 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.580 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:38.580 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.580 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:38.580 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069581+0000", 2024-04-19T02:17:38.580 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.580 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.580 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.580 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:38.580 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069581+0000", 2024-04-19T02:17:38.580 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.580 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.580 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.580 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:38.581 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069580+0000", 2024-04-19T02:17:38.581 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:38.581 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.581 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.581 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:38.581 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069589+0000", 2024-04-19T02:17:38.581 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6750000000000008e-06 2024-04-19T02:17:38.581 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.581 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.581 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:38.581 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069596+0000", 2024-04-19T02:17:38.581 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7360000000000004e-06 2024-04-19T02:17:38.581 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.581 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.581 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:38.582 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069601+0000", 2024-04-19T02:17:38.582 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0479999999999998e-06 2024-04-19T02:17:38.582 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.582 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.582 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:38.582 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.073854+0000", 2024-04-19T02:17:38.582 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042531920000000003 2024-04-19T02:17:38.582 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.582 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.582 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:38.582 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.073952+0000", 2024-04-19T02:17:38.582 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7851999999999998e-05 2024-04-19T02:17:38.582 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.582 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.583 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:38.583 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074012+0000", 2024-04-19T02:17:38.583 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0225e-05 2024-04-19T02:17:38.583 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.583 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.583 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:38.583 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120102+0000", 2024-04-19T02:17:38.583 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.046090150000000003 2024-04-19T02:17:38.583 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.583 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.583 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:38.583 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120129+0000", 2024-04-19T02:17:38.583 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7228000000000001e-05 2024-04-19T02:17:38.583 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.584 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.584 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:38.584 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120157+0000", 2024-04-19T02:17:38.584 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7165000000000002e-05 2024-04-19T02:17:38.584 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.584 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.584 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:38.584 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120188+0000", 2024-04-19T02:17:38.584 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1418000000000003e-05 2024-04-19T02:17:38.584 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.584 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:38.584 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.584 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.584 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.584 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168384 5.7 5:ed638f84:::benchmark_data_smithi121_44835_object34349:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:38.585 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069612+0000", 2024-04-19T02:17:38.585 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.486206292999999, 2024-04-19T02:17:38.585 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049863376000000001, 2024-04-19T02:17:38.585 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:38.585 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:38.585 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:38.585 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:38.585 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:38.585 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168384 2024-04-19T02:17:38.585 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.585 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:38.585 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.585 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:38.585 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069612+0000", 2024-04-19T02:17:38.585 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.586 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.586 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.586 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:38.586 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069612+0000", 2024-04-19T02:17:38.586 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.586 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.586 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.586 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:38.586 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069611+0000", 2024-04-19T02:17:38.586 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:38.586 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.586 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.586 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:38.586 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069614+0000", 2024-04-19T02:17:38.586 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7819999999999998e-06 2024-04-19T02:17:38.587 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.587 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.587 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:38.587 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069623+0000", 2024-04-19T02:17:38.587 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6989999999999992e-06 2024-04-19T02:17:38.587 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.587 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.587 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:38.587 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069628+0000", 2024-04-19T02:17:38.587 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4999999999999999e-06 2024-04-19T02:17:38.587 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.587 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.587 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:38.587 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069662+0000", 2024-04-19T02:17:38.588 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3319999999999999e-05 2024-04-19T02:17:38.588 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.588 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.588 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:38.588 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069782+0000", 2024-04-19T02:17:38.588 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120547 2024-04-19T02:17:38.588 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.588 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.588 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:38.588 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119338+0000", 2024-04-19T02:17:38.588 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049556141999999997 2024-04-19T02:17:38.588 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.588 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.588 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:38.589 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119388+0000", 2024-04-19T02:17:38.589 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9866e-05 2024-04-19T02:17:38.589 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.589 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.589 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:38.589 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119475+0000", 2024-04-19T02:17:38.589 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6929999999999996e-05 2024-04-19T02:17:38.589 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.589 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:38.589 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.589 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.589 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.589 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168385 5.d 5:b22d7e69:::benchmark_data_smithi121_44835_object34350:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:38.589 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:38.589 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.486182853999999, 2024-04-19T02:17:38.590 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.055438508999999997, 2024-04-19T02:17:38.590 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:38.590 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:38.590 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:38.590 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:38.590 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:38.590 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168385 2024-04-19T02:17:38.590 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.590 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:38.590 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.590 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:38.590 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:38.590 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.590 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.591 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.591 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:38.591 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:38.591 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.591 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.591 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.591 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:38.591 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:38.591 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:38.591 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.591 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.591 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:38.591 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069637+0000", 2024-04-19T02:17:38.591 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.576e-06 2024-04-19T02:17:38.591 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.591 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.592 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:38.592 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069643+0000", 2024-04-19T02:17:38.592 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8030000000000002e-06 2024-04-19T02:17:38.592 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.592 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.592 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:38.592 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069648+0000", 2024-04-19T02:17:38.592 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0889999999999999e-06 2024-04-19T02:17:38.592 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.592 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.592 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:38.592 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117534+0000", 2024-04-19T02:17:38.592 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.047886390000000001 2024-04-19T02:17:38.592 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.592 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.592 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:38.592 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117670+0000", 2024-04-19T02:17:38.593 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000135969 2024-04-19T02:17:38.593 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.593 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.593 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:38.593 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117803+0000", 2024-04-19T02:17:38.593 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000132955 2024-04-19T02:17:38.593 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.593 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.593 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:38.593 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120501+0000", 2024-04-19T02:17:38.593 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026978050000000002 2024-04-19T02:17:38.593 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.593 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.593 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:38.593 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.125026+0000", 2024-04-19T02:17:38.593 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045244589999999998 2024-04-19T02:17:38.593 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.594 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.594 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:38.594 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.125049+0000", 2024-04-19T02:17:38.594 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3807000000000001e-05 2024-04-19T02:17:38.594 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.594 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.594 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:38.594 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.125074+0000", 2024-04-19T02:17:38.594 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4175000000000001e-05 2024-04-19T02:17:38.594 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.594 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:38.594 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.594 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.594 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.594 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168386 5.5 5:a2cda182:::benchmark_data_smithi121_44835_object34351:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:38.595 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069653+0000", 2024-04-19T02:17:38.595 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.486165387, 2024-04-19T02:17:38.595 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058748884000000001, 2024-04-19T02:17:38.595 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:38.595 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:38.595 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:38.595 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:38.595 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:38.595 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168386 2024-04-19T02:17:38.595 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.595 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:38.595 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.595 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:38.595 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069653+0000", 2024-04-19T02:17:38.596 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.596 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.596 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.596 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:38.596 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069653+0000", 2024-04-19T02:17:38.596 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.596 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.596 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.596 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:38.596 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069652+0000", 2024-04-19T02:17:38.596 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:38.596 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.596 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.596 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:38.596 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069654+0000", 2024-04-19T02:17:38.596 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1220000000000002e-06 2024-04-19T02:17:38.597 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.597 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.597 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:38.597 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069660+0000", 2024-04-19T02:17:38.597 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5890000000000002e-06 2024-04-19T02:17:38.597 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.597 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.597 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:38.597 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069665+0000", 2024-04-19T02:17:38.597 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.989e-06 2024-04-19T02:17:38.597 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.597 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.597 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:38.597 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120220+0000", 2024-04-19T02:17:38.597 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050555061999999998 2024-04-19T02:17:38.598 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.598 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.598 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:38.598 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120329+0000", 2024-04-19T02:17:38.598 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010922200000000001 2024-04-19T02:17:38.598 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.598 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.598 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:38.598 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.128293+0000", 2024-04-19T02:17:38.598 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079640279999999997 2024-04-19T02:17:38.598 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.598 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.598 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:38.598 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.128336+0000", 2024-04-19T02:17:38.598 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2245e-05 2024-04-19T02:17:38.599 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.599 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.599 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:38.599 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.128401+0000", 2024-04-19T02:17:38.599 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5975000000000004e-05 2024-04-19T02:17:38.599 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.599 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:38.599 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.599 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.599 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.599 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168387 5.f 5:ff36d1d9:::benchmark_data_smithi121_44835_object34352:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:38.599 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:38.599 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.486148553, 2024-04-19T02:17:38.599 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049975358999999997, 2024-04-19T02:17:38.599 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:38.599 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:38.600 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:38.600 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:38.600 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:38.600 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168387 2024-04-19T02:17:38.600 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.600 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:38.600 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.600 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:38.600 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:38.600 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.600 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.600 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.600 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:38.600 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:38.600 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.600 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.601 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.601 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:38.601 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:38.601 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:38.601 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.601 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.601 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:38.601 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069671+0000", 2024-04-19T02:17:38.601 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1739999999999999e-06 2024-04-19T02:17:38.601 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.601 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.601 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:38.601 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069677+0000", 2024-04-19T02:17:38.601 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4519999999999996e-06 2024-04-19T02:17:38.601 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.602 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.602 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:38.602 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069682+0000", 2024-04-19T02:17:38.602 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5400000000000003e-06 2024-04-19T02:17:38.602 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.602 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.602 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:38.602 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072634+0000", 2024-04-19T02:17:38.602 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0029521510000000001 2024-04-19T02:17:38.602 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.602 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.602 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:38.602 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072706+0000", 2024-04-19T02:17:38.602 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1996999999999995e-05 2024-04-19T02:17:38.602 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.603 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.603 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:38.603 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072772+0000", 2024-04-19T02:17:38.603 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5380000000000001e-05 2024-04-19T02:17:38.603 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.603 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.603 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:38.603 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117549+0000", 2024-04-19T02:17:38.603 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044777124000000001 2024-04-19T02:17:38.603 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.603 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.603 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:38.603 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119572+0000", 2024-04-19T02:17:38.603 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002022893 2024-04-19T02:17:38.603 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.603 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.604 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:38.604 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119613+0000", 2024-04-19T02:17:38.604 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0849999999999997e-05 2024-04-19T02:17:38.604 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.604 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.604 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:38.604 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119645+0000", 2024-04-19T02:17:38.604 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2113000000000002e-05 2024-04-19T02:17:38.604 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.604 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:38.604 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.604 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.604 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.604 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168389 5.2 5:4bcb87b1:::benchmark_data_smithi121_44835_object34354:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:38.604 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.071719+0000", 2024-04-19T02:17:38.604 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.484099456999999, 2024-04-19T02:17:38.604 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.048248604, 2024-04-19T02:17:38.605 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:38.605 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:38.605 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:38.605 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:38.605 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:38.605 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168389 2024-04-19T02:17:38.605 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.605 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:38.605 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.605 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:38.605 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071719+0000", 2024-04-19T02:17:38.605 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.605 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.605 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.606 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:38.606 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071719+0000", 2024-04-19T02:17:38.606 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.606 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.606 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.606 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:38.606 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071718+0000", 2024-04-19T02:17:38.606 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:38.606 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.606 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.606 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:38.606 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071722+0000", 2024-04-19T02:17:38.606 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8590000000000004e-06 2024-04-19T02:17:38.606 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.607 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.607 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:38.607 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071730+0000", 2024-04-19T02:17:38.607 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8569999999999995e-06 2024-04-19T02:17:38.607 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.607 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.607 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:38.607 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071736+0000", 2024-04-19T02:17:38.607 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.127e-06 2024-04-19T02:17:38.607 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.607 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.607 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:38.607 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071769+0000", 2024-04-19T02:17:38.607 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3052000000000001e-05 2024-04-19T02:17:38.607 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.607 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.607 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:38.608 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071843+0000", 2024-04-19T02:17:38.608 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3683000000000006e-05 2024-04-19T02:17:38.608 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.608 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.608 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:38.608 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119852+0000", 2024-04-19T02:17:38.608 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.048009353999999997 2024-04-19T02:17:38.608 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.608 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.608 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:38.608 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119896+0000", 2024-04-19T02:17:38.608 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3102000000000002e-05 2024-04-19T02:17:38.608 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.608 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.608 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:38.608 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119967+0000", 2024-04-19T02:17:38.608 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1589999999999997e-05 2024-04-19T02:17:38.609 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.609 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:38.609 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.609 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.609 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.609 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168391 5.3 5:c5d9b5e1:::benchmark_data_smithi121_44835_object34356:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:38.609 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.074402+0000", 2024-04-19T02:17:38.609 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.481415618, 2024-04-19T02:17:38.609 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.045426756999999998, 2024-04-19T02:17:38.609 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:38.609 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:38.609 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:38.609 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:38.609 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:38.609 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168391 2024-04-19T02:17:38.610 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.610 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:38.610 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.610 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:38.610 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074402+0000", 2024-04-19T02:17:38.610 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.610 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.610 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.610 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:38.610 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074402+0000", 2024-04-19T02:17:38.610 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.610 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.610 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.610 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:38.611 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074401+0000", 2024-04-19T02:17:38.611 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:38.611 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.611 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.611 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:38.611 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074406+0000", 2024-04-19T02:17:38.611 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5879999999999999e-06 2024-04-19T02:17:38.611 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.611 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.611 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:38.611 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074414+0000", 2024-04-19T02:17:38.611 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8599999999999993e-06 2024-04-19T02:17:38.611 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.611 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.611 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:38.611 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074420+0000", 2024-04-19T02:17:38.612 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6350000000000003e-06 2024-04-19T02:17:38.612 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.612 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.612 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:38.612 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074453+0000", 2024-04-19T02:17:38.612 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3874000000000001e-05 2024-04-19T02:17:38.612 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.612 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.612 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:38.612 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074531+0000", 2024-04-19T02:17:38.612 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7999999999999999e-05 2024-04-19T02:17:38.612 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.612 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.612 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:38.612 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119717+0000", 2024-04-19T02:17:38.613 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.045185395000000003 2024-04-19T02:17:38.613 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.613 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.613 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:38.613 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119756+0000", 2024-04-19T02:17:38.613 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9110000000000003e-05 2024-04-19T02:17:38.613 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.613 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.613 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:38.613 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119829+0000", 2024-04-19T02:17:38.613 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3238000000000006e-05 2024-04-19T02:17:38.613 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.613 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:38.613 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.613 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.613 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.614 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4549.0:168377 5.d e52/16 ondisk, result = 0)", 2024-04-19T02:17:38.614 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.077260+0000", 2024-04-19T02:17:38.614 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.478557877, 2024-04-19T02:17:38.614 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042613204000000002, 2024-04-19T02:17:38.614 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:38.614 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:38.614 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:38.614 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.614 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:38.614 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.077260+0000", 2024-04-19T02:17:38.614 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.614 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.614 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.614 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:38.614 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.077260+0000", 2024-04-19T02:17:38.615 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.615 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.615 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.615 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:38.615 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.077259+0000", 2024-04-19T02:17:38.615 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:38.615 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.615 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.615 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:38.615 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.077267+0000", 2024-04-19T02:17:38.615 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6799999999999993e-06 2024-04-19T02:17:38.615 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.615 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.615 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:38.615 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117372+0000", 2024-04-19T02:17:38.615 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040105342000000002 2024-04-19T02:17:38.615 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.616 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.616 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:38.616 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117389+0000", 2024-04-19T02:17:38.616 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6711e-05 2024-04-19T02:17:38.616 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.616 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.616 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:38.616 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119862+0000", 2024-04-19T02:17:38.616 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0024730580000000002 2024-04-19T02:17:38.616 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.616 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.616 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:38.616 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119867+0000", 2024-04-19T02:17:38.616 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1590000000000001e-06 2024-04-19T02:17:38.617 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.617 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.617 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:38.617 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119873+0000", 2024-04-19T02:17:38.617 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1410000000000002e-06 2024-04-19T02:17:38.617 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.617 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:38.617 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.617 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.617 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.617 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241615 5.d 5:bc2762a9:::benchmark_data_smithi121_44835_object107580:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:38.617 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.288268+0000", 2024-04-19T02:17:38.617 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.267550014, 2024-04-19T02:17:38.617 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.068304498000000005, 2024-04-19T02:17:38.617 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:38.617 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:38.617 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:38.618 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:38.618 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:38.618 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241615 2024-04-19T02:17:38.618 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.618 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:38.618 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.618 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:38.618 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.288268+0000", 2024-04-19T02:17:38.618 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.618 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.618 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.618 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:38.618 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.288268+0000", 2024-04-19T02:17:38.618 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.618 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.619 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.619 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:38.619 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.288267+0000", 2024-04-19T02:17:38.619 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:38.619 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.619 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.619 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:38.619 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.288273+0000", 2024-04-19T02:17:38.619 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.823e-06 2024-04-19T02:17:38.619 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.619 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.619 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:38.619 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.288288+0000", 2024-04-19T02:17:38.619 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5307000000000001e-05 2024-04-19T02:17:38.619 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.619 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.620 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:38.620 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.288296+0000", 2024-04-19T02:17:38.620 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5689999999999999e-06 2024-04-19T02:17:38.620 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.620 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.620 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:38.620 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290508+0000", 2024-04-19T02:17:38.620 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022125589999999998 2024-04-19T02:17:38.620 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.620 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.620 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:38.620 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290661+0000", 2024-04-19T02:17:38.620 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015289500000000001 2024-04-19T02:17:38.620 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.621 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.621 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:38.621 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290781+0000", 2024-04-19T02:17:38.621 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000119411 2024-04-19T02:17:38.621 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.621 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.621 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:38.621 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297532+0000", 2024-04-19T02:17:38.621 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0067517819999999996 2024-04-19T02:17:38.621 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.621 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.621 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:38.621 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.356516+0000", 2024-04-19T02:17:38.621 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058983233000000003 2024-04-19T02:17:38.621 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.621 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.621 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:38.622 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.356547+0000", 2024-04-19T02:17:38.622 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1063999999999999e-05 2024-04-19T02:17:38.622 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.622 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.622 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:38.622 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.356572+0000", 2024-04-19T02:17:38.622 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5795999999999998e-05 2024-04-19T02:17:38.622 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.622 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:38.622 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.622 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.622 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.622 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241622 5.d 5:ba16b775:::benchmark_data_smithi121_44835_object107587:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:38.622 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.290616+0000", 2024-04-19T02:17:38.622 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.26520154200000001, 2024-04-19T02:17:38.623 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.070971960000000001, 2024-04-19T02:17:38.623 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:38.623 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:38.623 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:38.623 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:38.623 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:38.623 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241622 2024-04-19T02:17:38.623 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.623 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:38.623 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.623 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:38.623 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290616+0000", 2024-04-19T02:17:38.623 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.623 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.623 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.623 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:38.624 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290616+0000", 2024-04-19T02:17:38.624 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.624 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.624 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.624 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:38.624 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290616+0000", 2024-04-19T02:17:38.624 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:38.624 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.624 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.624 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:38.624 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290619+0000", 2024-04-19T02:17:38.624 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8169999999999999e-06 2024-04-19T02:17:38.624 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.624 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.624 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:38.624 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290625+0000", 2024-04-19T02:17:38.624 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3759999999999996e-06 2024-04-19T02:17:38.625 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.625 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.625 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:38.625 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290630+0000", 2024-04-19T02:17:38.625 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2179999999999998e-06 2024-04-19T02:17:38.625 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.625 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.625 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:38.625 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.292551+0000", 2024-04-19T02:17:38.625 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001920185 2024-04-19T02:17:38.625 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.625 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.625 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:38.625 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.292680+0000", 2024-04-19T02:17:38.625 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012971700000000001 2024-04-19T02:17:38.625 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.626 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.626 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:38.626 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.292794+0000", 2024-04-19T02:17:38.626 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000114095 2024-04-19T02:17:38.626 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.626 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.626 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:38.626 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297538+0000", 2024-04-19T02:17:38.626 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00474341 2024-04-19T02:17:38.626 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.626 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.626 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:38.626 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361516+0000", 2024-04-19T02:17:38.626 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.063978249000000001 2024-04-19T02:17:38.626 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.627 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.627 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:38.627 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361550+0000", 2024-04-19T02:17:38.627 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4069999999999997e-05 2024-04-19T02:17:38.627 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.627 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.627 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:38.627 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361588+0000", 2024-04-19T02:17:38.627 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8349999999999997e-05 2024-04-19T02:17:38.627 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.627 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:38.627 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.627 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.627 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.628 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241636 5.d 5:bcce6ec3:::benchmark_data_smithi121_44835_object107601:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:38.628 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.295801+0000", 2024-04-19T02:17:38.628 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.26001681599999998, 2024-04-19T02:17:38.628 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.065904313000000006, 2024-04-19T02:17:38.628 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:38.628 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:38.628 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:38.628 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:38.628 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:38.628 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241636 2024-04-19T02:17:38.628 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.628 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:38.628 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.628 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:38.628 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295801+0000", 2024-04-19T02:17:38.629 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.629 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.629 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.629 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:38.629 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295801+0000", 2024-04-19T02:17:38.629 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.629 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.629 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.629 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:38.629 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295800+0000", 2024-04-19T02:17:38.629 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:38.629 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.629 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.629 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:38.630 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295806+0000", 2024-04-19T02:17:38.630 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5230000000000003e-06 2024-04-19T02:17:38.630 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.630 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.630 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:38.630 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295816+0000", 2024-04-19T02:17:38.630 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.079e-05 2024-04-19T02:17:38.630 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.630 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.630 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:38.630 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295825+0000", 2024-04-19T02:17:38.630 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4999999999999999e-06 2024-04-19T02:17:38.630 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.630 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.631 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:38.631 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.296001+0000", 2024-04-19T02:17:38.631 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017568600000000001 2024-04-19T02:17:38.631 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.631 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.631 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:38.631 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.296093+0000", 2024-04-19T02:17:38.631 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2237999999999993e-05 2024-04-19T02:17:38.631 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.631 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.631 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:38.631 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.296155+0000", 2024-04-19T02:17:38.631 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2281999999999998e-05 2024-04-19T02:17:38.631 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.632 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.632 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:38.632 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.299187+0000", 2024-04-19T02:17:38.632 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003031906 2024-04-19T02:17:38.632 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.632 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.632 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:38.632 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361624+0000", 2024-04-19T02:17:38.632 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.062437318999999998 2024-04-19T02:17:38.632 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.632 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.632 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:38.632 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361669+0000", 2024-04-19T02:17:38.632 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4197999999999999e-05 2024-04-19T02:17:38.632 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.633 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.633 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:38.633 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361705+0000", 2024-04-19T02:17:38.633 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6980999999999997e-05 2024-04-19T02:17:38.633 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.633 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:38.633 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.633 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.633 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.633 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241637 5.9 5:920672c8:::benchmark_data_smithi121_44835_object107602:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:38.633 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.295834+0000", 2024-04-19T02:17:38.633 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.25998368999999999, 2024-04-19T02:17:38.633 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.064579527999999997, 2024-04-19T02:17:38.633 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:38.633 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:38.634 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:38.634 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:38.634 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:38.634 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241637 2024-04-19T02:17:38.634 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.634 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:38.634 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.634 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:38.634 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295834+0000", 2024-04-19T02:17:38.634 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.634 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.634 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.634 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:38.635 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295834+0000", 2024-04-19T02:17:38.635 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.635 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.635 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.635 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:38.635 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295834+0000", 2024-04-19T02:17:38.635 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:38.635 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.635 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.635 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:38.635 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295836+0000", 2024-04-19T02:17:38.635 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4389999999999999e-06 2024-04-19T02:17:38.635 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.635 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.635 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:38.636 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295843+0000", 2024-04-19T02:17:38.636 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1759999999999998e-06 2024-04-19T02:17:38.636 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.636 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.636 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:38.636 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295847+0000", 2024-04-19T02:17:38.636 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7949999999999998e-06 2024-04-19T02:17:38.636 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.636 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.636 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:38.636 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295899+0000", 2024-04-19T02:17:38.636 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1579999999999997e-05 2024-04-19T02:17:38.636 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.636 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.636 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:38.637 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.296009+0000", 2024-04-19T02:17:38.637 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000110006 2024-04-19T02:17:38.637 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.637 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.637 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:38.637 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.296109+0000", 2024-04-19T02:17:38.637 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100035 2024-04-19T02:17:38.637 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.637 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.637 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:38.637 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.299700+0000", 2024-04-19T02:17:38.637 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035907999999999999 2024-04-19T02:17:38.637 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.637 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.637 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:38.638 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.360358+0000", 2024-04-19T02:17:38.638 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060657889 2024-04-19T02:17:38.638 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.638 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.638 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:38.638 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.360387+0000", 2024-04-19T02:17:38.638 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9492000000000002e-05 2024-04-19T02:17:38.638 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.638 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.638 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:38.638 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.360414+0000", 2024-04-19T02:17:38.638 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6631999999999998e-05 2024-04-19T02:17:38.638 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.638 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:38.638 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.639 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.639 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.639 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241638 5.d 5:b857cbeb:::benchmark_data_smithi121_44835_object107603:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:38.639 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.297779+0000", 2024-04-19T02:17:38.639 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.258038618, 2024-04-19T02:17:38.639 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.064037317999999996, 2024-04-19T02:17:38.639 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:38.639 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:38.639 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:38.639 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:38.639 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:38.639 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241638 2024-04-19T02:17:38.639 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.639 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:38.640 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.640 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:38.640 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297779+0000", 2024-04-19T02:17:38.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.640 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.640 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.640 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:38.640 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297779+0000", 2024-04-19T02:17:38.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.640 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.640 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.640 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:38.640 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297779+0000", 2024-04-19T02:17:38.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:38.640 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:38.641 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297784+0000", 2024-04-19T02:17:38.641 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3460000000000001e-06 2024-04-19T02:17:38.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:38.641 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297792+0000", 2024-04-19T02:17:38.641 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0949999999999996e-06 2024-04-19T02:17:38.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:38.641 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297799+0000", 2024-04-19T02:17:38.641 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0360000000000001e-06 2024-04-19T02:17:38.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.642 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:38.642 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297823+0000", 2024-04-19T02:17:38.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3595e-05 2024-04-19T02:17:38.642 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.642 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:38.642 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297893+0000", 2024-04-19T02:17:38.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0343000000000001e-05 2024-04-19T02:17:38.642 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.642 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:38.642 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297965+0000", 2024-04-19T02:17:38.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2253000000000001e-05 2024-04-19T02:17:38.643 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.643 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.643 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:38.643 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.300115+0000", 2024-04-19T02:17:38.643 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021493319999999999 2024-04-19T02:17:38.643 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.643 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.643 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:38.643 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361742+0000", 2024-04-19T02:17:38.643 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061627511000000003 2024-04-19T02:17:38.643 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.643 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.643 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:38.643 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361780+0000", 2024-04-19T02:17:38.643 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7759000000000002e-05 2024-04-19T02:17:38.643 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.644 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:38.644 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361817+0000", 2024-04-19T02:17:38.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6804999999999997e-05 2024-04-19T02:17:38.644 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.644 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:38.644 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.644 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241644 5.9 5:993dd037:::benchmark_data_smithi121_44835_object107609:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:38.644 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.298160+0000", 2024-04-19T02:17:38.644 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.25765760900000001, 2024-04-19T02:17:38.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.062615216000000001, 2024-04-19T02:17:38.644 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:38.644 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:38.645 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:38.645 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:38.645 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:38.645 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241644 2024-04-19T02:17:38.645 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.645 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:38.645 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.645 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:38.645 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298160+0000", 2024-04-19T02:17:38.645 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.645 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.645 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.645 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:38.645 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298160+0000", 2024-04-19T02:17:38.645 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.646 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.646 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:38.646 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298160+0000", 2024-04-19T02:17:38.646 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:38.646 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.646 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:38.646 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298162+0000", 2024-04-19T02:17:38.646 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8360000000000001e-06 2024-04-19T02:17:38.646 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.646 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:38.646 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298167+0000", 2024-04-19T02:17:38.647 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1710000000000001e-06 2024-04-19T02:17:38.647 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.647 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.647 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:38.647 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298170+0000", 2024-04-19T02:17:38.647 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0740000000000001e-06 2024-04-19T02:17:38.647 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.647 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.647 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:38.647 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298202+0000", 2024-04-19T02:17:38.647 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2163999999999999e-05 2024-04-19T02:17:38.647 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.647 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.647 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:38.647 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298281+0000", 2024-04-19T02:17:38.648 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8318000000000005e-05 2024-04-19T02:17:38.648 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.648 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.648 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:38.648 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298344+0000", 2024-04-19T02:17:38.648 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2909000000000004e-05 2024-04-19T02:17:38.648 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.648 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.648 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:38.648 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.301043+0000", 2024-04-19T02:17:38.648 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026998159999999998 2024-04-19T02:17:38.648 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.648 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.648 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:38.649 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.360725+0000", 2024-04-19T02:17:38.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059681627000000001 2024-04-19T02:17:38.649 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.649 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.649 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:38.649 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.360753+0000", 2024-04-19T02:17:38.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8198999999999999e-05 2024-04-19T02:17:38.649 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.649 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.649 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:38.649 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.360776+0000", 2024-04-19T02:17:38.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2388e-05 2024-04-19T02:17:38.649 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.649 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:38.649 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.650 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.650 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.650 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241645 5.9 5:935d75f3:::benchmark_data_smithi121_44835_object107610:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:38.650 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.298176+0000", 2024-04-19T02:17:38.650 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.25764244400000003, 2024-04-19T02:17:38.650 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.067784611999999994, 2024-04-19T02:17:38.650 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:38.650 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:38.650 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:38.650 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:38.650 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:38.650 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241645 2024-04-19T02:17:38.650 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.650 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:38.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:38.651 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298176+0000", 2024-04-19T02:17:38.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:38.651 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298176+0000", 2024-04-19T02:17:38.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:38.651 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298175+0000", 2024-04-19T02:17:38.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:38.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:38.652 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298177+0000", 2024-04-19T02:17:38.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9709999999999998e-06 2024-04-19T02:17:38.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:38.652 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298183+0000", 2024-04-19T02:17:38.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4700000000000001e-06 2024-04-19T02:17:38.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:38.652 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298187+0000", 2024-04-19T02:17:38.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7249999999999997e-06 2024-04-19T02:17:38.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.653 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:38.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.299715+0000", 2024-04-19T02:17:38.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001527657 2024-04-19T02:17:38.653 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.653 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:38.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.299790+0000", 2024-04-19T02:17:38.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4789999999999994e-05 2024-04-19T02:17:38.653 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.653 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:38.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.299853+0000", 2024-04-19T02:17:38.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2905999999999997e-05 2024-04-19T02:17:38.654 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.654 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.654 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:38.654 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.301553+0000", 2024-04-19T02:17:38.654 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017001609999999999 2024-04-19T02:17:38.654 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.654 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.654 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:38.654 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.365904+0000", 2024-04-19T02:17:38.654 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.064351028000000005 2024-04-19T02:17:38.654 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.654 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.654 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:38.654 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.365931+0000", 2024-04-19T02:17:38.654 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6809e-05 2024-04-19T02:17:38.655 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.655 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.655 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:38.655 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.365960+0000", 2024-04-19T02:17:38.655 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9391e-05 2024-04-19T02:17:38.655 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.655 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:38.655 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.655 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.655 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.655 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241652 5.d 5:bbf7ddbb:::benchmark_data_smithi121_44835_object107617:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:38.655 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.309592+0000", 2024-04-19T02:17:38.655 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.24622622599999999, 2024-04-19T02:17:38.655 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.054120610999999999, 2024-04-19T02:17:38.655 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:38.656 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:38.656 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:38.656 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:38.656 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:38.656 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241652 2024-04-19T02:17:38.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.656 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:38.656 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.656 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:38.656 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309592+0000", 2024-04-19T02:17:38.656 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.656 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.656 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:38.656 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309592+0000", 2024-04-19T02:17:38.657 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:38.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.657 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.657 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:38.657 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309591+0000", 2024-04-19T02:17:38.657 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:38.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.657 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.657 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:38.657 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309595+0000", 2024-04-19T02:17:38.657 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6009999999999999e-06 2024-04-19T02:17:38.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.657 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.657 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:38.657 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309603+0000", 2024-04-19T02:17:38.658 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9319999999999996e-06 2024-04-19T02:17:38.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.658 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.658 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:38.658 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309608+0000", 2024-04-19T02:17:38.658 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7809999999999996e-06 2024-04-19T02:17:38.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.658 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.658 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:38.658 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309635+0000", 2024-04-19T02:17:38.658 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7376e-05 2024-04-19T02:17:38.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.658 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.658 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:38.658 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309709+0000", 2024-04-19T02:17:38.659 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4318000000000002e-05 2024-04-19T02:17:38.659 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.659 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.659 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:38.659 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309774+0000", 2024-04-19T02:17:38.659 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5173999999999996e-05 2024-04-19T02:17:38.659 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.659 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.659 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:38.659 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.311459+0000", 2024-04-19T02:17:38.659 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001684269 2024-04-19T02:17:38.659 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.659 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.659 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:38.660 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.363665+0000", 2024-04-19T02:17:38.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.052205840000000003 2024-04-19T02:17:38.660 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.660 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:38.660 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.363694+0000", 2024-04-19T02:17:38.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9706999999999999e-05 2024-04-19T02:17:38.660 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:38.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:38.660 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:38.660 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.363712+0000", 2024-04-19T02:17:38.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8144000000000001e-05 2024-04-19T02:17:38.660 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.660 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:38.660 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.661 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:38.661 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:38.661 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:38.662 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:38.662+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:38.662 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:17:38.662 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:17:38.663 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:17:38.664 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:17:38.664 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:17:38.664 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:17:38.664 INFO:teuthology.orchestra.run.smithi121.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T02:17:38.665 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:17:38.763 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:38.762+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:38.843 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:38.843 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:38.858 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:17:38.901 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:38.901+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:38.964 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:38.964+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:39.037 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:39.038 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:39.051 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:17:39.093 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:39.093+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:39.165 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:39.165+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:39.266 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:39.266+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:39.268 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:39.268 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:39.283 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:39.367 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:39.367+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:39.457 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:39.458 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:39.468 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:39.468+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:39.471 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:39.569 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:39.570+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:39.647 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:39.647 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:39.662 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:39.706 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:39.706+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:39.771 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:39.772+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:39.832 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:39.832 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:39.847 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:17:39.891 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:39.891+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:39.973 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:39.973+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:40.021 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:40.021 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:40.036 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:17:40.074 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:40.074+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:40.176 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:40.176+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:40.251 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:40.251 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:40.264 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:17:40.308 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:40.308+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:40.363 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T02:17:40.379 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:40.379+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:40.437 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:40.492 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:40.494 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:40.493+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:40.495 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:40.594 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:40.594+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:40.666 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:17:40.669 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:40.669 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:40.684 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:40.695 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:40.695+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:40.796 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:40.796+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:40.813 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:17:40.833 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:17:40.834 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:17:40.834 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:17:40.834 INFO:teuthology.orchestra.run.smithi121.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T02:17:40.836 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:17:40.837 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:17:40.897 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:40.897+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:40.899 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:40.899 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-04-19T02:17:40.899 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-04-19T02:17:40.899 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-04-19T02:17:40.899 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:40.917 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:41.004 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:41.002+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:41.100 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:41.099+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:41.135 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:41.135 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-04-19T02:17:41.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-04-19T02:17:41.136 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:17:41.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.136 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168377 5.d 5:b1f3fb6d:::benchmark_data_smithi121_44835_object34342:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:41.136 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069470+0000", 2024-04-19T02:17:41.136 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 29.064362616, 2024-04-19T02:17:41.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050516473999999999, 2024-04-19T02:17:41.136 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:41.136 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.136 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:41.136 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:41.136 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:41.136 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168377 2024-04-19T02:17:41.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.136 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:41.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:41.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069470+0000", 2024-04-19T02:17:41.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:41.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:41.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069470+0000", 2024-04-19T02:17:41.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:41.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:41.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069469+0000", 2024-04-19T02:17:41.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:41.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.138 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:41.138 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069473+0000", 2024-04-19T02:17:41.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4580000000000002e-06 2024-04-19T02:17:41.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.138 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:41.138 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069482+0000", 2024-04-19T02:17:41.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2839999999999995e-06 2024-04-19T02:17:41.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.138 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.138 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069489+0000", 2024-04-19T02:17:41.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3579999999999997e-06 2024-04-19T02:17:41.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:41.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069559+0000", 2024-04-19T02:17:41.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9678000000000006e-05 2024-04-19T02:17:41.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:41.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069683+0000", 2024-04-19T02:17:41.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012359400000000001 2024-04-19T02:17:41.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:41.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069759+0000", 2024-04-19T02:17:41.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6834000000000003e-05 2024-04-19T02:17:41.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:41.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119871+0000", 2024-04-19T02:17:41.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050111392999999997 2024-04-19T02:17:41.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:41.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119932+0000", 2024-04-19T02:17:41.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1209000000000003e-05 2024-04-19T02:17:41.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:41.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119962+0000", 2024-04-19T02:17:41.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9717999999999999e-05 2024-04-19T02:17:41.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:41.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119986+0000", 2024-04-19T02:17:41.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4549000000000002e-05 2024-04-19T02:17:41.141 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:41.141 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:41.141 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:41.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.141 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168379 5.d 5:bcd492dd:::benchmark_data_smithi121_44835_object34344:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:41.141 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069502+0000", 2024-04-19T02:17:41.141 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 29.064330562999999, 2024-04-19T02:17:41.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050544645999999999, 2024-04-19T02:17:41.141 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:41.142 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.142 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:41.142 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:41.142 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:41.142 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168379 2024-04-19T02:17:41.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.142 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:41.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.142 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:41.142 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069502+0000", 2024-04-19T02:17:41.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:41.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.142 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:41.143 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069502+0000", 2024-04-19T02:17:41.143 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:41.143 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.143 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.143 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:41.143 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069501+0000", 2024-04-19T02:17:41.143 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:41.143 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.143 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.143 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:41.143 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069504+0000", 2024-04-19T02:17:41.143 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9289999999999998e-06 2024-04-19T02:17:41.143 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.143 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.143 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:41.143 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069511+0000", 2024-04-19T02:17:41.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1909999999999997e-06 2024-04-19T02:17:41.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.144 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.144 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069517+0000", 2024-04-19T02:17:41.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0789999999999997e-06 2024-04-19T02:17:41.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.144 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:41.144 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071081+0000", 2024-04-19T02:17:41.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0015646550000000001 2024-04-19T02:17:41.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.144 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:41.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071195+0000", 2024-04-19T02:17:41.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011399400000000001 2024-04-19T02:17:41.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:41.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071293+0000", 2024-04-19T02:17:41.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7938999999999999e-05 2024-04-19T02:17:41.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:41.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119898+0000", 2024-04-19T02:17:41.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.048604808999999999 2024-04-19T02:17:41.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:41.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119993+0000", 2024-04-19T02:17:41.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5224999999999997e-05 2024-04-19T02:17:41.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:41.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120024+0000", 2024-04-19T02:17:41.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0580999999999997e-05 2024-04-19T02:17:41.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:41.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120047+0000", 2024-04-19T02:17:41.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2725e-05 2024-04-19T02:17:41.146 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:41.146 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:41.147 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:41.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.147 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168381 5.d 5:bcbab0e3:::benchmark_data_smithi121_44835_object34346:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:41.147 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:41.147 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 29.064311145000001, 2024-04-19T02:17:41.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050574694000000003, 2024-04-19T02:17:41.147 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:41.147 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.147 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:41.147 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:41.147 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:41.147 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168381 2024-04-19T02:17:41.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.148 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:41.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:41.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:41.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:41.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:41.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:41.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:41.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:41.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:41.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:41.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:41.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069523+0000", 2024-04-19T02:17:41.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.244e-06 2024-04-19T02:17:41.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:41.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069528+0000", 2024-04-19T02:17:41.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0669999999999999e-06 2024-04-19T02:17:41.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069533+0000", 2024-04-19T02:17:41.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4680000000000003e-06 2024-04-19T02:17:41.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:41.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072637+0000", 2024-04-19T02:17:41.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031040429999999999 2024-04-19T02:17:41.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:41.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072710+0000", 2024-04-19T02:17:41.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3045000000000003e-05 2024-04-19T02:17:41.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:41.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072775+0000", 2024-04-19T02:17:41.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5034000000000001e-05 2024-04-19T02:17:41.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:41.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119925+0000", 2024-04-19T02:17:41.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.047150594999999997 2024-04-19T02:17:41.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:41.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120055+0000", 2024-04-19T02:17:41.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129288 2024-04-19T02:17:41.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:41.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120077+0000", 2024-04-19T02:17:41.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1759e-05 2024-04-19T02:17:41.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:41.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120096+0000", 2024-04-19T02:17:41.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9524000000000001e-05 2024-04-19T02:17:41.152 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:41.152 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:41.152 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:41.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.153 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168382 5.f 5:f2599a15:::benchmark_data_smithi121_44835_object34347:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:41.153 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069556+0000", 2024-04-19T02:17:41.153 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 29.064276738, 2024-04-19T02:17:41.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050009713999999997, 2024-04-19T02:17:41.153 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:41.153 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.153 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:41.153 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:41.153 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:41.153 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168382 2024-04-19T02:17:41.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.153 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:41.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:41.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069556+0000", 2024-04-19T02:17:41.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:41.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:41.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069556+0000", 2024-04-19T02:17:41.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:41.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:41.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069555+0000", 2024-04-19T02:17:41.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:41.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:41.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069558+0000", 2024-04-19T02:17:41.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7879999999999998e-06 2024-04-19T02:17:41.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:41.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069566+0000", 2024-04-19T02:17:41.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6149999999999999e-06 2024-04-19T02:17:41.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069571+0000", 2024-04-19T02:17:41.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5509999999999999e-06 2024-04-19T02:17:41.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:41.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069618+0000", 2024-04-19T02:17:41.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6964e-05 2024-04-19T02:17:41.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:41.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069744+0000", 2024-04-19T02:17:41.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012577199999999999 2024-04-19T02:17:41.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:41.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.070116+0000", 2024-04-19T02:17:41.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000372407 2024-04-19T02:17:41.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:41.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117511+0000", 2024-04-19T02:17:41.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.047394935999999999 2024-04-19T02:17:41.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:41.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119484+0000", 2024-04-19T02:17:41.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019722310000000001 2024-04-19T02:17:41.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:41.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119525+0000", 2024-04-19T02:17:41.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1035999999999998e-05 2024-04-19T02:17:41.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:41.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119565+0000", 2024-04-19T02:17:41.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0859000000000003e-05 2024-04-19T02:17:41.158 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:41.158 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:41.158 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:41.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.158 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168383 5.d 5:bbd9496c:::benchmark_data_smithi121_44835_object34348:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:41.158 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069581+0000", 2024-04-19T02:17:41.158 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 29.064251850000002, 2024-04-19T02:17:41.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050607278999999998, 2024-04-19T02:17:41.159 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:41.159 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.159 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:41.159 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:41.159 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:41.159 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168383 2024-04-19T02:17:41.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.159 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:41.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:41.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069581+0000", 2024-04-19T02:17:41.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:41.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:41.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069581+0000", 2024-04-19T02:17:41.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:41.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:41.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069580+0000", 2024-04-19T02:17:41.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:41.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:41.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069589+0000", 2024-04-19T02:17:41.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6750000000000008e-06 2024-04-19T02:17:41.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:41.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069596+0000", 2024-04-19T02:17:41.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7360000000000004e-06 2024-04-19T02:17:41.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069601+0000", 2024-04-19T02:17:41.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0479999999999998e-06 2024-04-19T02:17:41.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:41.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.073854+0000", 2024-04-19T02:17:41.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042531920000000003 2024-04-19T02:17:41.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:41.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.073952+0000", 2024-04-19T02:17:41.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7851999999999998e-05 2024-04-19T02:17:41.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:41.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074012+0000", 2024-04-19T02:17:41.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0225e-05 2024-04-19T02:17:41.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:41.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120102+0000", 2024-04-19T02:17:41.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.046090150000000003 2024-04-19T02:17:41.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:41.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120129+0000", 2024-04-19T02:17:41.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7228000000000001e-05 2024-04-19T02:17:41.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:41.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120157+0000", 2024-04-19T02:17:41.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7165000000000002e-05 2024-04-19T02:17:41.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:41.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120188+0000", 2024-04-19T02:17:41.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1418000000000003e-05 2024-04-19T02:17:41.163 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:41.163 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:41.163 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:41.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.164 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168384 5.7 5:ed638f84:::benchmark_data_smithi121_44835_object34349:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:41.164 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069612+0000", 2024-04-19T02:17:41.164 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 29.064220797000001, 2024-04-19T02:17:41.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049863376000000001, 2024-04-19T02:17:41.164 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:41.164 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.164 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:41.164 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:41.164 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:41.164 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168384 2024-04-19T02:17:41.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.164 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:41.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:41.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069612+0000", 2024-04-19T02:17:41.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:41.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:41.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069612+0000", 2024-04-19T02:17:41.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:41.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:41.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069611+0000", 2024-04-19T02:17:41.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:41.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:41.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069614+0000", 2024-04-19T02:17:41.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7819999999999998e-06 2024-04-19T02:17:41.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:41.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069623+0000", 2024-04-19T02:17:41.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6989999999999992e-06 2024-04-19T02:17:41.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069628+0000", 2024-04-19T02:17:41.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4999999999999999e-06 2024-04-19T02:17:41.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:41.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069662+0000", 2024-04-19T02:17:41.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3319999999999999e-05 2024-04-19T02:17:41.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:41.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069782+0000", 2024-04-19T02:17:41.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120547 2024-04-19T02:17:41.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:41.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119338+0000", 2024-04-19T02:17:41.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049556141999999997 2024-04-19T02:17:41.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:41.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119388+0000", 2024-04-19T02:17:41.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9866e-05 2024-04-19T02:17:41.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:41.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119475+0000", 2024-04-19T02:17:41.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6929999999999996e-05 2024-04-19T02:17:41.168 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:41.168 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:41.168 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:41.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.169 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168385 5.d 5:b22d7e69:::benchmark_data_smithi121_44835_object34350:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:41.169 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:41.169 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 29.064197358000001, 2024-04-19T02:17:41.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.055438508999999997, 2024-04-19T02:17:41.169 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:41.169 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.169 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:41.169 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:41.169 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:41.169 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168385 2024-04-19T02:17:41.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.169 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:41.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:41.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:41.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:41.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:41.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:41.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:41.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:41.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:41.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:41.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:41.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069637+0000", 2024-04-19T02:17:41.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.576e-06 2024-04-19T02:17:41.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:41.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069643+0000", 2024-04-19T02:17:41.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8030000000000002e-06 2024-04-19T02:17:41.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069648+0000", 2024-04-19T02:17:41.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0889999999999999e-06 2024-04-19T02:17:41.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:41.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117534+0000", 2024-04-19T02:17:41.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.047886390000000001 2024-04-19T02:17:41.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:41.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117670+0000", 2024-04-19T02:17:41.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000135969 2024-04-19T02:17:41.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:41.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117803+0000", 2024-04-19T02:17:41.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000132955 2024-04-19T02:17:41.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:41.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120501+0000", 2024-04-19T02:17:41.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026978050000000002 2024-04-19T02:17:41.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:41.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.125026+0000", 2024-04-19T02:17:41.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045244589999999998 2024-04-19T02:17:41.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:41.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.125049+0000", 2024-04-19T02:17:41.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3807000000000001e-05 2024-04-19T02:17:41.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:41.174 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.125074+0000", 2024-04-19T02:17:41.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4175000000000001e-05 2024-04-19T02:17:41.174 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:41.174 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:41.174 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:41.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.174 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168386 5.5 5:a2cda182:::benchmark_data_smithi121_44835_object34351:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:41.174 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069653+0000", 2024-04-19T02:17:41.174 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 29.064179890999998, 2024-04-19T02:17:41.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058748884000000001, 2024-04-19T02:17:41.174 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:41.174 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.175 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:41.175 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:41.175 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:41.175 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168386 2024-04-19T02:17:41.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.175 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:41.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:41.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069653+0000", 2024-04-19T02:17:41.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:41.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:41.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069653+0000", 2024-04-19T02:17:41.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:41.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:41.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069652+0000", 2024-04-19T02:17:41.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:41.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:41.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069654+0000", 2024-04-19T02:17:41.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1220000000000002e-06 2024-04-19T02:17:41.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:41.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069660+0000", 2024-04-19T02:17:41.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5890000000000002e-06 2024-04-19T02:17:41.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069665+0000", 2024-04-19T02:17:41.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.989e-06 2024-04-19T02:17:41.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:41.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120220+0000", 2024-04-19T02:17:41.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050555061999999998 2024-04-19T02:17:41.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:41.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120329+0000", 2024-04-19T02:17:41.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010922200000000001 2024-04-19T02:17:41.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:41.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.128293+0000", 2024-04-19T02:17:41.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079640279999999997 2024-04-19T02:17:41.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:41.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.128336+0000", 2024-04-19T02:17:41.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2245e-05 2024-04-19T02:17:41.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:41.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.128401+0000", 2024-04-19T02:17:41.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5975000000000004e-05 2024-04-19T02:17:41.179 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:41.179 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:41.179 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:41.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.179 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168387 5.f 5:ff36d1d9:::benchmark_data_smithi121_44835_object34352:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:41.179 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:41.179 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 29.064163056999998, 2024-04-19T02:17:41.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049975358999999997, 2024-04-19T02:17:41.179 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:41.179 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.179 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:41.179 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:41.180 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:41.180 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168387 2024-04-19T02:17:41.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.180 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:41.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:41.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:41.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:41.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:41.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:41.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:41.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:41.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:41.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:41.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:41.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069671+0000", 2024-04-19T02:17:41.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1739999999999999e-06 2024-04-19T02:17:41.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:41.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069677+0000", 2024-04-19T02:17:41.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4519999999999996e-06 2024-04-19T02:17:41.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069682+0000", 2024-04-19T02:17:41.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5400000000000003e-06 2024-04-19T02:17:41.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:41.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072634+0000", 2024-04-19T02:17:41.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0029521510000000001 2024-04-19T02:17:41.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:41.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072706+0000", 2024-04-19T02:17:41.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1996999999999995e-05 2024-04-19T02:17:41.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:41.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072772+0000", 2024-04-19T02:17:41.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5380000000000001e-05 2024-04-19T02:17:41.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:41.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117549+0000", 2024-04-19T02:17:41.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044777124000000001 2024-04-19T02:17:41.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:41.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119572+0000", 2024-04-19T02:17:41.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002022893 2024-04-19T02:17:41.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:41.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119613+0000", 2024-04-19T02:17:41.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0849999999999997e-05 2024-04-19T02:17:41.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:41.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119645+0000", 2024-04-19T02:17:41.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2113000000000002e-05 2024-04-19T02:17:41.184 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:41.184 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:41.184 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:41.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.184 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168389 5.2 5:4bcb87b1:::benchmark_data_smithi121_44835_object34354:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:41.184 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.071719+0000", 2024-04-19T02:17:41.184 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 29.062113961000001, 2024-04-19T02:17:41.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.048248604, 2024-04-19T02:17:41.185 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:41.185 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.185 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:41.185 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:41.185 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:41.185 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168389 2024-04-19T02:17:41.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.185 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:41.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:41.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071719+0000", 2024-04-19T02:17:41.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:41.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:41.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071719+0000", 2024-04-19T02:17:41.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:41.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:41.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071718+0000", 2024-04-19T02:17:41.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:41.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:41.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071722+0000", 2024-04-19T02:17:41.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8590000000000004e-06 2024-04-19T02:17:41.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:41.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071730+0000", 2024-04-19T02:17:41.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8569999999999995e-06 2024-04-19T02:17:41.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071736+0000", 2024-04-19T02:17:41.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.127e-06 2024-04-19T02:17:41.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:41.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071769+0000", 2024-04-19T02:17:41.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3052000000000001e-05 2024-04-19T02:17:41.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:41.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071843+0000", 2024-04-19T02:17:41.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3683000000000006e-05 2024-04-19T02:17:41.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:41.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119852+0000", 2024-04-19T02:17:41.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.048009353999999997 2024-04-19T02:17:41.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:41.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119896+0000", 2024-04-19T02:17:41.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3102000000000002e-05 2024-04-19T02:17:41.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:41.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119967+0000", 2024-04-19T02:17:41.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1589999999999997e-05 2024-04-19T02:17:41.189 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:41.189 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:41.189 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:41.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.189 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168391 5.3 5:c5d9b5e1:::benchmark_data_smithi121_44835_object34356:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:41.189 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.074402+0000", 2024-04-19T02:17:41.189 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 29.059430121999998, 2024-04-19T02:17:41.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.045426756999999998, 2024-04-19T02:17:41.189 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:41.189 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.189 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:41.190 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:41.190 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:41.190 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168391 2024-04-19T02:17:41.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.190 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:41.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:41.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074402+0000", 2024-04-19T02:17:41.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:41.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:41.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074402+0000", 2024-04-19T02:17:41.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:41.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:41.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074401+0000", 2024-04-19T02:17:41.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:41.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:41.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074406+0000", 2024-04-19T02:17:41.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5879999999999999e-06 2024-04-19T02:17:41.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:41.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074414+0000", 2024-04-19T02:17:41.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8599999999999993e-06 2024-04-19T02:17:41.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074420+0000", 2024-04-19T02:17:41.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6350000000000003e-06 2024-04-19T02:17:41.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:41.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074453+0000", 2024-04-19T02:17:41.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3874000000000001e-05 2024-04-19T02:17:41.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:41.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074531+0000", 2024-04-19T02:17:41.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7999999999999999e-05 2024-04-19T02:17:41.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:41.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119717+0000", 2024-04-19T02:17:41.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.045185395000000003 2024-04-19T02:17:41.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:41.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119756+0000", 2024-04-19T02:17:41.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9110000000000003e-05 2024-04-19T02:17:41.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:41.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119829+0000", 2024-04-19T02:17:41.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3238000000000006e-05 2024-04-19T02:17:41.193 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:41.194 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:41.194 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:41.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.194 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4549.0:168377 5.d e52/16 ondisk, result = 0)", 2024-04-19T02:17:41.194 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.077260+0000", 2024-04-19T02:17:41.194 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 29.056572380999999, 2024-04-19T02:17:41.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042613204000000002, 2024-04-19T02:17:41.194 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:41.194 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:41.194 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:41.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:41.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.077260+0000", 2024-04-19T02:17:41.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:41.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:41.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.077260+0000", 2024-04-19T02:17:41.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:41.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:41.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.077259+0000", 2024-04-19T02:17:41.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:41.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:41.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.077267+0000", 2024-04-19T02:17:41.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6799999999999993e-06 2024-04-19T02:17:41.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:41.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117372+0000", 2024-04-19T02:17:41.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040105342000000002 2024-04-19T02:17:41.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117389+0000", 2024-04-19T02:17:41.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6711e-05 2024-04-19T02:17:41.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:41.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119862+0000", 2024-04-19T02:17:41.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0024730580000000002 2024-04-19T02:17:41.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:41.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119867+0000", 2024-04-19T02:17:41.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1590000000000001e-06 2024-04-19T02:17:41.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:41.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119873+0000", 2024-04-19T02:17:41.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1410000000000002e-06 2024-04-19T02:17:41.197 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:41.197 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:41.198 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:41.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.198 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241615 5.d 5:bc2762a9:::benchmark_data_smithi121_44835_object107580:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:41.198 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.288268+0000", 2024-04-19T02:17:41.198 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 2.8455645179999998, 2024-04-19T02:17:41.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.068304498000000005, 2024-04-19T02:17:41.198 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:41.198 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.198 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:41.198 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:41.198 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:41.198 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241615 2024-04-19T02:17:41.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.198 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:41.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:41.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.288268+0000", 2024-04-19T02:17:41.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:41.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:41.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.288268+0000", 2024-04-19T02:17:41.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:41.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:41.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.288267+0000", 2024-04-19T02:17:41.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:41.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:41.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.288273+0000", 2024-04-19T02:17:41.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.823e-06 2024-04-19T02:17:41.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:41.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.288288+0000", 2024-04-19T02:17:41.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5307000000000001e-05 2024-04-19T02:17:41.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.288296+0000", 2024-04-19T02:17:41.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5689999999999999e-06 2024-04-19T02:17:41.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:41.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290508+0000", 2024-04-19T02:17:41.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022125589999999998 2024-04-19T02:17:41.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:41.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290661+0000", 2024-04-19T02:17:41.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015289500000000001 2024-04-19T02:17:41.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:41.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290781+0000", 2024-04-19T02:17:41.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000119411 2024-04-19T02:17:41.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:41.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297532+0000", 2024-04-19T02:17:41.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0067517819999999996 2024-04-19T02:17:41.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:41.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.356516+0000", 2024-04-19T02:17:41.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058983233000000003 2024-04-19T02:17:41.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:41.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.356547+0000", 2024-04-19T02:17:41.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1063999999999999e-05 2024-04-19T02:17:41.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:41.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.356572+0000", 2024-04-19T02:17:41.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5795999999999998e-05 2024-04-19T02:17:41.205 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:41.205 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:41.205 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:41.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.205 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241622 5.d 5:ba16b775:::benchmark_data_smithi121_44835_object107587:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:41.205 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.290616+0000", 2024-04-19T02:17:41.205 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 2.8432160460000002, 2024-04-19T02:17:41.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.070971960000000001, 2024-04-19T02:17:41.206 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:41.206 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.206 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:41.206 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:41.206 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:41.206 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241622 2024-04-19T02:17:41.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.206 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:41.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:41.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290616+0000", 2024-04-19T02:17:41.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:41.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:41.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290616+0000", 2024-04-19T02:17:41.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:41.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:41.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290616+0000", 2024-04-19T02:17:41.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:41.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:41.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290619+0000", 2024-04-19T02:17:41.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8169999999999999e-06 2024-04-19T02:17:41.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:41.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290625+0000", 2024-04-19T02:17:41.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3759999999999996e-06 2024-04-19T02:17:41.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290630+0000", 2024-04-19T02:17:41.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2179999999999998e-06 2024-04-19T02:17:41.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:41.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.292551+0000", 2024-04-19T02:17:41.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001920185 2024-04-19T02:17:41.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:41.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.292680+0000", 2024-04-19T02:17:41.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012971700000000001 2024-04-19T02:17:41.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:41.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.292794+0000", 2024-04-19T02:17:41.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000114095 2024-04-19T02:17:41.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:41.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297538+0000", 2024-04-19T02:17:41.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00474341 2024-04-19T02:17:41.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:41.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361516+0000", 2024-04-19T02:17:41.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.063978249000000001 2024-04-19T02:17:41.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:41.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361550+0000", 2024-04-19T02:17:41.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4069999999999997e-05 2024-04-19T02:17:41.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:41.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361588+0000", 2024-04-19T02:17:41.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8349999999999997e-05 2024-04-19T02:17:41.211 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:41.211 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:41.211 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:41.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.211 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241636 5.d 5:bcce6ec3:::benchmark_data_smithi121_44835_object107601:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:41.211 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.295801+0000", 2024-04-19T02:17:41.211 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 2.8380313199999998, 2024-04-19T02:17:41.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.065904313000000006, 2024-04-19T02:17:41.211 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:41.211 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.211 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:41.211 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:41.211 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:41.212 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241636 2024-04-19T02:17:41.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.212 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:41.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:41.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295801+0000", 2024-04-19T02:17:41.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:41.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:41.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295801+0000", 2024-04-19T02:17:41.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:41.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:41.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295800+0000", 2024-04-19T02:17:41.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:41.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:41.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295806+0000", 2024-04-19T02:17:41.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5230000000000003e-06 2024-04-19T02:17:41.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:41.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295816+0000", 2024-04-19T02:17:41.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.079e-05 2024-04-19T02:17:41.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295825+0000", 2024-04-19T02:17:41.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4999999999999999e-06 2024-04-19T02:17:41.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:41.214 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.296001+0000", 2024-04-19T02:17:41.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017568600000000001 2024-04-19T02:17:41.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:41.214 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.296093+0000", 2024-04-19T02:17:41.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2237999999999993e-05 2024-04-19T02:17:41.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:41.214 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.296155+0000", 2024-04-19T02:17:41.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2281999999999998e-05 2024-04-19T02:17:41.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:41.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.299187+0000", 2024-04-19T02:17:41.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003031906 2024-04-19T02:17:41.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:41.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361624+0000", 2024-04-19T02:17:41.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.062437318999999998 2024-04-19T02:17:41.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:41.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361669+0000", 2024-04-19T02:17:41.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4197999999999999e-05 2024-04-19T02:17:41.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:41.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361705+0000", 2024-04-19T02:17:41.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6980999999999997e-05 2024-04-19T02:17:41.216 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:41.216 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:41.216 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:41.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.216 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241637 5.9 5:920672c8:::benchmark_data_smithi121_44835_object107602:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:41.216 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.295834+0000", 2024-04-19T02:17:41.216 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 2.8379981939999999, 2024-04-19T02:17:41.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.064579527999999997, 2024-04-19T02:17:41.217 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:41.217 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.217 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:41.217 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:41.217 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:41.217 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241637 2024-04-19T02:17:41.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.217 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:41.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:41.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295834+0000", 2024-04-19T02:17:41.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:41.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:41.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295834+0000", 2024-04-19T02:17:41.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:41.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:41.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295834+0000", 2024-04-19T02:17:41.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:41.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:41.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295836+0000", 2024-04-19T02:17:41.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4389999999999999e-06 2024-04-19T02:17:41.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:41.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295843+0000", 2024-04-19T02:17:41.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1759999999999998e-06 2024-04-19T02:17:41.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295847+0000", 2024-04-19T02:17:41.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7949999999999998e-06 2024-04-19T02:17:41.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:41.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295899+0000", 2024-04-19T02:17:41.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1579999999999997e-05 2024-04-19T02:17:41.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:41.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.296009+0000", 2024-04-19T02:17:41.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000110006 2024-04-19T02:17:41.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:41.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.296109+0000", 2024-04-19T02:17:41.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100035 2024-04-19T02:17:41.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:41.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.299700+0000", 2024-04-19T02:17:41.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035907999999999999 2024-04-19T02:17:41.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:41.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.360358+0000", 2024-04-19T02:17:41.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060657889 2024-04-19T02:17:41.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:41.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.360387+0000", 2024-04-19T02:17:41.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9492000000000002e-05 2024-04-19T02:17:41.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:41.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.360414+0000", 2024-04-19T02:17:41.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6631999999999998e-05 2024-04-19T02:17:41.221 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:41.222 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:41.222 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:41.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.222 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241638 5.d 5:b857cbeb:::benchmark_data_smithi121_44835_object107603:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:41.222 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.297779+0000", 2024-04-19T02:17:41.222 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 2.836053122, 2024-04-19T02:17:41.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.064037317999999996, 2024-04-19T02:17:41.222 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:41.222 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.222 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:41.222 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:41.222 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:41.223 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241638 2024-04-19T02:17:41.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.223 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:41.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.223 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:41.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297779+0000", 2024-04-19T02:17:41.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:41.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.223 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:41.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297779+0000", 2024-04-19T02:17:41.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:41.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:41.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297779+0000", 2024-04-19T02:17:41.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:41.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:41.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297784+0000", 2024-04-19T02:17:41.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3460000000000001e-06 2024-04-19T02:17:41.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:41.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297792+0000", 2024-04-19T02:17:41.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0949999999999996e-06 2024-04-19T02:17:41.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297799+0000", 2024-04-19T02:17:41.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0360000000000001e-06 2024-04-19T02:17:41.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:41.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297823+0000", 2024-04-19T02:17:41.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3595e-05 2024-04-19T02:17:41.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:41.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297893+0000", 2024-04-19T02:17:41.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0343000000000001e-05 2024-04-19T02:17:41.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:41.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297965+0000", 2024-04-19T02:17:41.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2253000000000001e-05 2024-04-19T02:17:41.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:41.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.300115+0000", 2024-04-19T02:17:41.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021493319999999999 2024-04-19T02:17:41.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:41.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361742+0000", 2024-04-19T02:17:41.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061627511000000003 2024-04-19T02:17:41.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:41.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361780+0000", 2024-04-19T02:17:41.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7759000000000002e-05 2024-04-19T02:17:41.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:41.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361817+0000", 2024-04-19T02:17:41.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6804999999999997e-05 2024-04-19T02:17:41.227 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:41.227 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:41.227 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:41.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.227 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241644 5.9 5:993dd037:::benchmark_data_smithi121_44835_object107609:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:41.227 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.298160+0000", 2024-04-19T02:17:41.227 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 2.8356721130000002, 2024-04-19T02:17:41.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.062615216000000001, 2024-04-19T02:17:41.228 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:41.228 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.228 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:41.228 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:41.228 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:41.228 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241644 2024-04-19T02:17:41.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.228 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:41.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.228 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:41.228 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298160+0000", 2024-04-19T02:17:41.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:41.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:41.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298160+0000", 2024-04-19T02:17:41.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:41.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:41.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298160+0000", 2024-04-19T02:17:41.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:41.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:41.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298162+0000", 2024-04-19T02:17:41.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8360000000000001e-06 2024-04-19T02:17:41.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:41.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298167+0000", 2024-04-19T02:17:41.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1710000000000001e-06 2024-04-19T02:17:41.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298170+0000", 2024-04-19T02:17:41.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0740000000000001e-06 2024-04-19T02:17:41.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:41.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298202+0000", 2024-04-19T02:17:41.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2163999999999999e-05 2024-04-19T02:17:41.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:41.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298281+0000", 2024-04-19T02:17:41.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8318000000000005e-05 2024-04-19T02:17:41.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:41.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298344+0000", 2024-04-19T02:17:41.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2909000000000004e-05 2024-04-19T02:17:41.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:41.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.301043+0000", 2024-04-19T02:17:41.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026998159999999998 2024-04-19T02:17:41.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:41.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.360725+0000", 2024-04-19T02:17:41.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059681627000000001 2024-04-19T02:17:41.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:41.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.360753+0000", 2024-04-19T02:17:41.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8198999999999999e-05 2024-04-19T02:17:41.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:41.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.360776+0000", 2024-04-19T02:17:41.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2388e-05 2024-04-19T02:17:41.233 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:41.233 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:41.233 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:41.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.233 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241645 5.9 5:935d75f3:::benchmark_data_smithi121_44835_object107610:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:41.233 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.298176+0000", 2024-04-19T02:17:41.233 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 2.835656948, 2024-04-19T02:17:41.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.067784611999999994, 2024-04-19T02:17:41.233 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:41.233 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.233 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:41.234 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:41.234 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:41.234 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241645 2024-04-19T02:17:41.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.234 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:41.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:41.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298176+0000", 2024-04-19T02:17:41.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:41.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:41.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298176+0000", 2024-04-19T02:17:41.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:41.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:41.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298175+0000", 2024-04-19T02:17:41.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:41.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:41.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298177+0000", 2024-04-19T02:17:41.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9709999999999998e-06 2024-04-19T02:17:41.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:41.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298183+0000", 2024-04-19T02:17:41.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4700000000000001e-06 2024-04-19T02:17:41.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298187+0000", 2024-04-19T02:17:41.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7249999999999997e-06 2024-04-19T02:17:41.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:41.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.299715+0000", 2024-04-19T02:17:41.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001527657 2024-04-19T02:17:41.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:41.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.299790+0000", 2024-04-19T02:17:41.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4789999999999994e-05 2024-04-19T02:17:41.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:41.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.299853+0000", 2024-04-19T02:17:41.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2905999999999997e-05 2024-04-19T02:17:41.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:41.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.301553+0000", 2024-04-19T02:17:41.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017001609999999999 2024-04-19T02:17:41.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:41.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.365904+0000", 2024-04-19T02:17:41.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.064351028000000005 2024-04-19T02:17:41.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:41.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.365931+0000", 2024-04-19T02:17:41.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6809e-05 2024-04-19T02:17:41.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:41.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.365960+0000", 2024-04-19T02:17:41.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9391e-05 2024-04-19T02:17:41.238 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:41.238 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:41.238 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:41.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.238 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241652 5.d 5:bbf7ddbb:::benchmark_data_smithi121_44835_object107617:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:41.239 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.309592+0000", 2024-04-19T02:17:41.239 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 2.8242407300000001, 2024-04-19T02:17:41.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.054120610999999999, 2024-04-19T02:17:41.239 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:41.239 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.239 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:41.239 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:41.239 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:41.239 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241652 2024-04-19T02:17:41.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.239 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:41.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:41.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309592+0000", 2024-04-19T02:17:41.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:41.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:41.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309592+0000", 2024-04-19T02:17:41.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:41.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:41.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309591+0000", 2024-04-19T02:17:41.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:41.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:41.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309595+0000", 2024-04-19T02:17:41.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6009999999999999e-06 2024-04-19T02:17:41.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:41.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309603+0000", 2024-04-19T02:17:41.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9319999999999996e-06 2024-04-19T02:17:41.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309608+0000", 2024-04-19T02:17:41.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7809999999999996e-06 2024-04-19T02:17:41.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:41.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309635+0000", 2024-04-19T02:17:41.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7376e-05 2024-04-19T02:17:41.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:41.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309709+0000", 2024-04-19T02:17:41.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4318000000000002e-05 2024-04-19T02:17:41.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:41.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309774+0000", 2024-04-19T02:17:41.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5173999999999996e-05 2024-04-19T02:17:41.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:41.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.311459+0000", 2024-04-19T02:17:41.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001684269 2024-04-19T02:17:41.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:41.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.363665+0000", 2024-04-19T02:17:41.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.052205840000000003 2024-04-19T02:17:41.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:41.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.363694+0000", 2024-04-19T02:17:41.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9706999999999999e-05 2024-04-19T02:17:41.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:41.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:41.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:41.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.363712+0000", 2024-04-19T02:17:41.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8144000000000001e-05 2024-04-19T02:17:41.243 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:41.244 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:41.244 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:41.244 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:41.244 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:41.244 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:41.245 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:17:41.246 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:41.245+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:41.345 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:41.346+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:41.357 INFO:teuthology.orchestra.run.smithi121.stderr:noscrub is set 2024-04-19T02:17:41.361 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [2] live_osds: [0, 1] 2024-04-19T02:17:41.361 INFO:tasks.thrashosds.thrasher:Reviving osd 2 2024-04-19T02:17:41.361 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.2 doing powercycle of ubuntu@smithi177.front.sepia.ceph.com 2024-04-19T02:17:41.361 INFO:teuthology.orchestra.console.smithi177:Power on 2024-04-19T02:17:41.361 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-19T02:17:41.385 DEBUG:teuthology.orchestra.console.smithi177:power on output: Chassis Power Control: Up/On 2024-04-19T02:17:41.386 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T02:17:41.410 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off 2024-04-19T02:17:41.416 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:17:41.416 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [], 2024-04-19T02:17:41.416 INFO:teuthology.orchestra.run.smithi174.stdout: "num_ops": 0 2024-04-19T02:17:41.416 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:17:41.431 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:17:41.473 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:41.473+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:41.547 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:41.547+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:41.648 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:41.648+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:41.660 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:17:41.661 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [], 2024-04-19T02:17:41.661 INFO:teuthology.orchestra.run.smithi174.stdout: "complaint_time": 30, 2024-04-19T02:17:41.661 INFO:teuthology.orchestra.run.smithi174.stdout: "num_blocked_ops": 0 2024-04-19T02:17:41.661 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:17:41.673 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:17:41.748 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:41.748+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:41.849 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:41.849+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:41.894 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:17:41.894 INFO:teuthology.orchestra.run.smithi174.stdout: "size": 20, 2024-04-19T02:17:41.894 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 600, 2024-04-19T02:17:41.894 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:17:41.894 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.894 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78259 5.4 5:2aa344b2:::benchmark_data_smithi121_44835_object78258:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:41.895 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:17:41.895 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 74.763986658999997, 2024-04-19T02:17:41.895 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022934350999999999, 2024-04-19T02:17:41.895 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:41.895 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.895 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:41.895 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:41.895 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:41.895 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78259 2024-04-19T02:17:41.896 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.896 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:41.896 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.896 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:41.896 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:17:41.896 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:41.896 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.896 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.896 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:41.896 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:17:41.896 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:41.896 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.896 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.896 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:41.896 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125256+0000", 2024-04-19T02:17:41.897 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:41.897 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.897 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.897 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:41.897 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125347+0000", 2024-04-19T02:17:41.897 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0470000000000006e-05 2024-04-19T02:17:41.897 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.897 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.897 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:41.897 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125358+0000", 2024-04-19T02:17:41.897 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1764e-05 2024-04-19T02:17:41.897 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.897 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.897 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.897 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125364+0000", 2024-04-19T02:17:41.898 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7189999999999998e-06 2024-04-19T02:17:41.898 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.898 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.898 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:41.898 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125391+0000", 2024-04-19T02:17:41.898 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7270000000000001e-05 2024-04-19T02:17:41.898 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.898 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.898 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:41.898 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125471+0000", 2024-04-19T02:17:41.898 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9209999999999995e-05 2024-04-19T02:17:41.898 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.898 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.898 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:41.899 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125559+0000", 2024-04-19T02:17:41.899 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.8689000000000004e-05 2024-04-19T02:17:41.899 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.899 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.899 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:41.899 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128164+0000", 2024-04-19T02:17:41.899 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0026050270000000002 2024-04-19T02:17:41.899 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.899 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.899 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:41.899 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148139+0000", 2024-04-19T02:17:41.899 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.019975050000000001 2024-04-19T02:17:41.899 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.899 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.900 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:41.900 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148169+0000", 2024-04-19T02:17:41.900 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0001e-05 2024-04-19T02:17:41.900 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.900 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.900 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:41.900 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148191+0000", 2024-04-19T02:17:41.900 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.2104999999999999e-05 2024-04-19T02:17:41.900 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:41.900 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:41.900 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:41.900 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.900 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.900 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78272 5.4 5:273e819a:::benchmark_data_smithi121_44835_object78271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:41.900 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:41.901 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 74.756634386000002, 2024-04-19T02:17:41.901 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022180163999999999, 2024-04-19T02:17:41.901 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:41.901 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.901 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:41.901 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:41.901 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:41.901 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78272 2024-04-19T02:17:41.901 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.901 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:41.901 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.901 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:41.901 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:41.901 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:41.902 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.902 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.902 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:41.902 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:41.902 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:41.902 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.902 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.902 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:41.902 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:41.902 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:41.902 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.902 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.902 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:41.902 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132690+0000", 2024-04-19T02:17:41.902 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0963000000000004e-05 2024-04-19T02:17:41.903 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.903 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.903 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:41.903 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132703+0000", 2024-04-19T02:17:41.903 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.3072e-05 2024-04-19T02:17:41.903 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.903 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.903 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.903 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132710+0000", 2024-04-19T02:17:41.903 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3100000000000003e-06 2024-04-19T02:17:41.903 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.904 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.904 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:41.904 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134005+0000", 2024-04-19T02:17:41.904 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001294513 2024-04-19T02:17:41.904 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.904 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.904 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:41.904 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134139+0000", 2024-04-19T02:17:41.905 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000134447 2024-04-19T02:17:41.905 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.905 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.905 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:41.905 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134284+0000", 2024-04-19T02:17:41.905 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014514399999999999 2024-04-19T02:17:41.905 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.905 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.905 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:41.906 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.139622+0000", 2024-04-19T02:17:41.906 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0053373830000000002 2024-04-19T02:17:41.906 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.906 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.906 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:41.906 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154737+0000", 2024-04-19T02:17:41.906 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015115195999999999 2024-04-19T02:17:41.906 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.906 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.906 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:41.906 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154768+0000", 2024-04-19T02:17:41.907 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0824999999999997e-05 2024-04-19T02:17:41.907 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.907 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.907 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:41.907 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154790+0000", 2024-04-19T02:17:41.907 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1999000000000001e-05 2024-04-19T02:17:41.907 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:41.907 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:41.908 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:41.908 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.908 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.908 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:94581 5.b 5:dc86d6e9:::benchmark_data_smithi121_44835_object94580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:41.908 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:41.908 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 66.709063495999999, 2024-04-19T02:17:41.908 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022099711000000001, 2024-04-19T02:17:41.908 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:41.908 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.908 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:41.908 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:41.908 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:41.909 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 94581 2024-04-19T02:17:41.909 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.909 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:41.909 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.909 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:41.909 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:41.909 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:41.909 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.909 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.909 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:41.909 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:41.909 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:41.910 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.910 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.910 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:41.910 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:41.910 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:41.910 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.910 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.910 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:41.910 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180253+0000", 2024-04-19T02:17:41.910 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3163000000000004e-05 2024-04-19T02:17:41.910 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.910 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.910 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:41.911 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180266+0000", 2024-04-19T02:17:41.911 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2886e-05 2024-04-19T02:17:41.911 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.911 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.911 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.911 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180273+0000", 2024-04-19T02:17:41.911 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.4059999999999999e-06 2024-04-19T02:17:41.911 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.911 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.911 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:41.911 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180646+0000", 2024-04-19T02:17:41.911 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00037283999999999999 2024-04-19T02:17:41.912 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.912 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.912 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:41.912 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180774+0000", 2024-04-19T02:17:41.912 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012793799999999999 2024-04-19T02:17:41.912 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.912 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.912 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:41.912 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180920+0000", 2024-04-19T02:17:41.912 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000146692 2024-04-19T02:17:41.912 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.912 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.912 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:41.912 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.183344+0000", 2024-04-19T02:17:41.913 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0024231669999999999 2024-04-19T02:17:41.913 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.913 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.913 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:41.913 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202196+0000", 2024-04-19T02:17:41.913 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.018852384 2024-04-19T02:17:41.913 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.913 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.913 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:41.913 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202241+0000", 2024-04-19T02:17:41.913 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4923999999999999e-05 2024-04-19T02:17:41.913 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.913 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.913 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:41.914 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202280+0000", 2024-04-19T02:17:41.914 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9096e-05 2024-04-19T02:17:41.914 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:41.914 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:41.914 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:41.914 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.914 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.914 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:104431 5.8 5:14818e19:::benchmark_data_smithi121_44835_object104430:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T02:17:41.914 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:17:41.914 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 61.677858450999999, 2024-04-19T02:17:41.914 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022149528000000002, 2024-04-19T02:17:41.914 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:41.914 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.915 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:41.915 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:41.915 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:41.916 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 104431 2024-04-19T02:17:41.916 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.916 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:41.916 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.916 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:41.916 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:17:41.916 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:41.916 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.916 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.916 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:41.916 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:17:41.916 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:41.916 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.916 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.917 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:41.917 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211384+0000", 2024-04-19T02:17:41.917 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:41.917 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.917 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.917 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:41.917 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211458+0000", 2024-04-19T02:17:41.917 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3311000000000003e-05 2024-04-19T02:17:41.917 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.917 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.917 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:41.917 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211471+0000", 2024-04-19T02:17:41.917 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.3308e-05 2024-04-19T02:17:41.917 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.918 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.918 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.918 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211479+0000", 2024-04-19T02:17:41.918 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0909999999999993e-06 2024-04-19T02:17:41.918 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.918 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.918 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:41.918 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.221821+0000", 2024-04-19T02:17:41.918 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010341596999999999 2024-04-19T02:17:41.918 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.919 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.919 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:41.919 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.221966+0000", 2024-04-19T02:17:41.919 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000145167 2024-04-19T02:17:41.919 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.919 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.919 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:41.919 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.222077+0000", 2024-04-19T02:17:41.919 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011128000000000001 2024-04-19T02:17:41.919 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.919 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.919 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:41.919 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.228126+0000", 2024-04-19T02:17:41.919 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0060486710000000003 2024-04-19T02:17:41.920 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.920 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.920 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:41.920 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233449+0000", 2024-04-19T02:17:41.920 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0053231370000000004 2024-04-19T02:17:41.920 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.920 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.920 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:41.920 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233498+0000", 2024-04-19T02:17:41.920 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8798999999999998e-05 2024-04-19T02:17:41.920 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.920 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.920 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:41.920 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233535+0000", 2024-04-19T02:17:41.920 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7119000000000002e-05 2024-04-19T02:17:41.921 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:41.924 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:41.924 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:41.924 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.924 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.924 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157437 5.e 5:78833a3d:::benchmark_data_smithi121_44835_object23402:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:41.924 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.859854+0000", 2024-04-19T02:17:41.924 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 35.029389678999998, 2024-04-19T02:17:41.924 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.025859589999999998, 2024-04-19T02:17:41.924 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:41.924 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.924 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:41.925 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:41.925 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:41.925 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157437 2024-04-19T02:17:41.925 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.925 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:41.925 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.925 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:41.925 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859854+0000", 2024-04-19T02:17:41.925 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:41.925 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.925 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.925 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:41.925 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859854+0000", 2024-04-19T02:17:41.925 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:41.925 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.926 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.926 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:41.926 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859853+0000", 2024-04-19T02:17:41.926 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:41.926 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.926 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.926 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:41.926 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859857+0000", 2024-04-19T02:17:41.926 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8789999999999996e-06 2024-04-19T02:17:41.927 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.927 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.927 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:41.927 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859865+0000", 2024-04-19T02:17:41.927 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.1880000000000002e-06 2024-04-19T02:17:41.927 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.927 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.927 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.928 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859873+0000", 2024-04-19T02:17:41.928 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.2980000000000003e-06 2024-04-19T02:17:41.928 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.928 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.928 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:41.928 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859908+0000", 2024-04-19T02:17:41.928 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5682999999999997e-05 2024-04-19T02:17:41.928 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.928 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.928 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:41.928 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.860046+0000", 2024-04-19T02:17:41.928 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013714200000000001 2024-04-19T02:17:41.928 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.929 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.929 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:41.929 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.860153+0000", 2024-04-19T02:17:41.929 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010725700000000001 2024-04-19T02:17:41.929 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.929 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.929 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:41.929 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.862008+0000", 2024-04-19T02:17:41.929 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001855179 2024-04-19T02:17:41.929 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.929 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.929 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:41.929 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.885629+0000", 2024-04-19T02:17:41.929 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.023621428 2024-04-19T02:17:41.930 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.930 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.930 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:41.930 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.885676+0000", 2024-04-19T02:17:41.930 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.6371e-05 2024-04-19T02:17:41.930 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.930 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.930 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:41.930 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.885714+0000", 2024-04-19T02:17:41.930 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7907000000000001e-05 2024-04-19T02:17:41.930 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:41.930 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:41.930 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:41.930 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.931 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.931 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157438 5.0 5:01944e77:::benchmark_data_smithi121_44835_object23403:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:41.931 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.864095+0000", 2024-04-19T02:17:41.931 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 35.025148395000002, 2024-04-19T02:17:41.931 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.032015298999999997, 2024-04-19T02:17:41.931 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:41.931 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.931 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:41.931 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:41.931 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:41.931 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157438 2024-04-19T02:17:41.931 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.931 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:41.931 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.932 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:41.932 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864095+0000", 2024-04-19T02:17:41.932 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:41.932 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.932 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.932 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:41.932 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864095+0000", 2024-04-19T02:17:41.932 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:41.932 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.932 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.932 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:41.932 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864094+0000", 2024-04-19T02:17:41.932 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:41.932 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.932 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.933 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:41.933 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864102+0000", 2024-04-19T02:17:41.933 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.6629999999999993e-06 2024-04-19T02:17:41.933 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.933 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.933 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:41.933 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864113+0000", 2024-04-19T02:17:41.933 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1185999999999999e-05 2024-04-19T02:17:41.933 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.933 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.933 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.933 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864119+0000", 2024-04-19T02:17:41.933 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.224e-06 2024-04-19T02:17:41.933 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.934 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.934 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:41.934 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864151+0000", 2024-04-19T02:17:41.934 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1395e-05 2024-04-19T02:17:41.934 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.934 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.934 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:41.934 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864275+0000", 2024-04-19T02:17:41.934 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012431399999999999 2024-04-19T02:17:41.934 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.934 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.934 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:41.934 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864341+0000", 2024-04-19T02:17:41.934 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6146e-05 2024-04-19T02:17:41.935 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.935 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.935 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:41.935 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.866040+0000", 2024-04-19T02:17:41.935 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016991879999999999 2024-04-19T02:17:41.935 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.935 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.935 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:41.935 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896055+0000", 2024-04-19T02:17:41.935 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.030014886000000001 2024-04-19T02:17:41.935 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.935 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.935 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:41.935 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896087+0000", 2024-04-19T02:17:41.936 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1761000000000003e-05 2024-04-19T02:17:41.936 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.936 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.936 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:41.936 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896111+0000", 2024-04-19T02:17:41.936 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3623999999999999e-05 2024-04-19T02:17:41.936 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:41.936 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:41.936 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:41.936 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.936 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.936 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157439 5.e 5:79eb9d3c:::benchmark_data_smithi121_44835_object23404:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:41.936 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:41.936 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 35.02511732, 2024-04-19T02:17:41.936 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.027045244, 2024-04-19T02:17:41.937 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:41.937 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.937 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:41.937 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:41.937 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:41.937 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157439 2024-04-19T02:17:41.937 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.937 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:41.937 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.937 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:41.937 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:41.937 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:41.937 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.937 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.938 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:41.938 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:41.938 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:41.938 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.938 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.938 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:41.938 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:41.938 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:41.938 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.938 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.938 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:41.938 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864128+0000", 2024-04-19T02:17:41.938 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.911e-06 2024-04-19T02:17:41.938 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.939 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.939 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:41.939 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864136+0000", 2024-04-19T02:17:41.939 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2609999999999993e-06 2024-04-19T02:17:41.939 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.939 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.939 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.939 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864140+0000", 2024-04-19T02:17:41.939 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5530000000000001e-06 2024-04-19T02:17:41.939 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.939 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.939 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:41.939 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864169+0000", 2024-04-19T02:17:41.939 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.8932e-05 2024-04-19T02:17:41.939 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.940 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.940 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:41.940 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864267+0000", 2024-04-19T02:17:41.940 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7969999999999999e-05 2024-04-19T02:17:41.940 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.940 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.940 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:41.940 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864339+0000", 2024-04-19T02:17:41.940 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.2280999999999995e-05 2024-04-19T02:17:41.940 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.940 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.940 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:41.940 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.865763+0000", 2024-04-19T02:17:41.940 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0014236310000000001 2024-04-19T02:17:41.940 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.941 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.941 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:41.941 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.891093+0000", 2024-04-19T02:17:41.941 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.025330571 2024-04-19T02:17:41.941 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.941 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.941 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:41.941 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.891137+0000", 2024-04-19T02:17:41.941 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3980999999999998e-05 2024-04-19T02:17:41.941 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.941 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.941 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:41.941 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.891172+0000", 2024-04-19T02:17:41.941 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4465000000000003e-05 2024-04-19T02:17:41.942 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:41.942 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:41.942 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:41.942 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.942 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.942 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157442 5.0 5:0062b73f:::benchmark_data_smithi121_44835_object23407:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:41.942 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.867065+0000", 2024-04-19T02:17:41.942 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 35.022178670000002, 2024-04-19T02:17:41.942 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.029165542999999999, 2024-04-19T02:17:41.942 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:41.942 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.942 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:41.942 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:41.943 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:41.943 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157442 2024-04-19T02:17:41.943 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.943 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:41.943 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.943 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:41.943 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867065+0000", 2024-04-19T02:17:41.943 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:41.943 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.943 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.943 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:41.943 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867065+0000", 2024-04-19T02:17:41.943 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:41.943 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.943 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.944 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:41.944 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867064+0000", 2024-04-19T02:17:41.944 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:41.944 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.944 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.944 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:41.944 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867069+0000", 2024-04-19T02:17:41.944 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4549999999999997e-06 2024-04-19T02:17:41.944 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.944 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.944 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:41.944 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867080+0000", 2024-04-19T02:17:41.944 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0797e-05 2024-04-19T02:17:41.944 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.944 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.945 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.945 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867088+0000", 2024-04-19T02:17:41.945 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9729999999999997e-06 2024-04-19T02:17:41.945 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.945 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.945 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:41.945 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867121+0000", 2024-04-19T02:17:41.945 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2920000000000003e-05 2024-04-19T02:17:41.945 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.945 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.945 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:41.945 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867203+0000", 2024-04-19T02:17:41.945 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2578999999999997e-05 2024-04-19T02:17:41.945 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.945 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.946 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:41.946 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867386+0000", 2024-04-19T02:17:41.946 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00018237400000000001 2024-04-19T02:17:41.946 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.946 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.946 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:41.946 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.869338+0000", 2024-04-19T02:17:41.946 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0019521160000000001 2024-04-19T02:17:41.946 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.946 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.946 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:41.946 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896150+0000", 2024-04-19T02:17:41.946 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.026812074000000002 2024-04-19T02:17:41.946 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.947 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.947 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:41.947 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896191+0000", 2024-04-19T02:17:41.947 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1192000000000001e-05 2024-04-19T02:17:41.947 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.947 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.947 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:41.947 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896231+0000", 2024-04-19T02:17:41.947 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9764000000000001e-05 2024-04-19T02:17:41.947 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:41.947 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:41.947 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:41.947 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.947 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.947 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157499 5.8 5:1c3aa38a:::benchmark_data_smithi121_44835_object23464:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:41.948 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.913447+0000", 2024-04-19T02:17:41.948 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 34.975797098000001, 2024-04-19T02:17:41.948 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.024508188, 2024-04-19T02:17:41.948 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:41.948 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.948 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:41.948 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:41.948 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:41.948 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157499 2024-04-19T02:17:41.948 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.948 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:41.948 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.948 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:41.948 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913447+0000", 2024-04-19T02:17:41.949 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:41.949 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.949 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.949 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:41.949 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913447+0000", 2024-04-19T02:17:41.949 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:41.949 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.949 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.949 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:41.949 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913446+0000", 2024-04-19T02:17:41.949 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:41.949 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.949 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.949 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:41.949 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913451+0000", 2024-04-19T02:17:41.950 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.677e-06 2024-04-19T02:17:41.950 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.950 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.950 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:41.950 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913461+0000", 2024-04-19T02:17:41.950 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.8859999999999999e-06 2024-04-19T02:17:41.950 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.950 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.950 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.950 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913467+0000", 2024-04-19T02:17:41.950 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.0800000000000002e-06 2024-04-19T02:17:41.950 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.950 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.951 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:41.951 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913513+0000", 2024-04-19T02:17:41.951 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.5707000000000001e-05 2024-04-19T02:17:41.951 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.951 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.951 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:41.951 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913637+0000", 2024-04-19T02:17:41.951 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012379200000000001 2024-04-19T02:17:41.951 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.951 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.951 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:41.951 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913747+0000", 2024-04-19T02:17:41.951 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000110071 2024-04-19T02:17:41.951 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.952 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.952 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:41.952 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915674+0000", 2024-04-19T02:17:41.952 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0019270789999999999 2024-04-19T02:17:41.952 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.952 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.952 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:41.952 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937902+0000", 2024-04-19T02:17:41.952 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022228286 2024-04-19T02:17:41.952 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.952 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.952 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:41.952 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937931+0000", 2024-04-19T02:17:41.952 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9122e-05 2024-04-19T02:17:41.952 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.953 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.953 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:41.953 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937955+0000", 2024-04-19T02:17:41.953 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3591000000000002e-05 2024-04-19T02:17:41.953 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:41.953 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:41.953 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:41.953 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.953 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.953 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157500 5.0 5:0969ec74:::benchmark_data_smithi121_44835_object23465:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:41.953 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.913476+0000", 2024-04-19T02:17:41.953 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 34.975768232, 2024-04-19T02:17:41.953 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.024497596, 2024-04-19T02:17:41.953 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:41.953 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.954 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:41.954 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:41.954 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:41.954 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157500 2024-04-19T02:17:41.954 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.954 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:41.954 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.954 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:41.954 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913476+0000", 2024-04-19T02:17:41.954 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:41.954 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.954 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.954 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:41.955 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913476+0000", 2024-04-19T02:17:41.955 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:41.955 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.955 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.955 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:41.955 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913475+0000", 2024-04-19T02:17:41.955 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:41.955 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.955 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.955 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:41.955 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913478+0000", 2024-04-19T02:17:41.955 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.2670000000000001e-06 2024-04-19T02:17:41.955 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.955 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.956 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:41.956 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913481+0000", 2024-04-19T02:17:41.956 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6899999999999998e-06 2024-04-19T02:17:41.956 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.956 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.956 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.956 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913485+0000", 2024-04-19T02:17:41.956 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1230000000000002e-06 2024-04-19T02:17:41.956 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.956 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.956 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:41.956 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913526+0000", 2024-04-19T02:17:41.956 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.104e-05 2024-04-19T02:17:41.956 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.956 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.957 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:41.957 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913606+0000", 2024-04-19T02:17:41.957 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9510000000000003e-05 2024-04-19T02:17:41.957 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.957 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.957 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:41.957 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913671+0000", 2024-04-19T02:17:41.957 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.4838000000000005e-05 2024-04-19T02:17:41.957 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.957 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.957 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:41.957 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915348+0000", 2024-04-19T02:17:41.957 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016769860000000001 2024-04-19T02:17:41.957 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.957 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.958 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:41.958 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937897+0000", 2024-04-19T02:17:41.958 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022548902999999999 2024-04-19T02:17:41.958 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.958 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.958 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:41.958 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937938+0000", 2024-04-19T02:17:41.958 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1499999999999999e-05 2024-04-19T02:17:41.958 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.958 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.958 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:41.958 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937973+0000", 2024-04-19T02:17:41.958 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5057e-05 2024-04-19T02:17:41.958 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:41.959 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:41.959 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:41.959 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.959 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.959 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157501 5.4 5:26661819:::benchmark_data_smithi121_44835_object23466:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:41.959 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.914839+0000", 2024-04-19T02:17:41.959 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 34.974404937999999, 2024-04-19T02:17:41.959 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.028504224000000002, 2024-04-19T02:17:41.959 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:41.959 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.959 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:41.959 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:41.959 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:41.959 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157501 2024-04-19T02:17:41.959 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.960 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:41.960 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.960 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:41.960 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914839+0000", 2024-04-19T02:17:41.960 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:41.960 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.960 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.960 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:41.960 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914839+0000", 2024-04-19T02:17:41.960 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:41.960 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.960 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.960 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:41.960 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914838+0000", 2024-04-19T02:17:41.961 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:41.961 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.961 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.961 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:41.961 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914841+0000", 2024-04-19T02:17:41.961 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.706e-06 2024-04-19T02:17:41.961 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.961 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.961 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:41.961 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914848+0000", 2024-04-19T02:17:41.961 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.7429999999999996e-06 2024-04-19T02:17:41.961 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.961 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.961 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.961 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914852+0000", 2024-04-19T02:17:41.962 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0810000000000004e-06 2024-04-19T02:17:41.962 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.962 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.962 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:41.962 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914892+0000", 2024-04-19T02:17:41.962 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9957999999999999e-05 2024-04-19T02:17:41.962 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.962 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.962 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:41.962 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915008+0000", 2024-04-19T02:17:41.962 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000116401 2024-04-19T02:17:41.962 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.962 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.963 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:41.963 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915125+0000", 2024-04-19T02:17:41.963 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011622500000000001 2024-04-19T02:17:41.963 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.963 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.963 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:41.963 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916663+0000", 2024-04-19T02:17:41.963 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0015381310000000001 2024-04-19T02:17:41.963 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.963 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.963 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:41.963 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943114+0000", 2024-04-19T02:17:41.963 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.026451125999999998 2024-04-19T02:17:41.963 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.963 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.964 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:41.964 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943245+0000", 2024-04-19T02:17:41.964 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000131645 2024-04-19T02:17:41.964 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.964 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.964 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:41.964 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943343+0000", 2024-04-19T02:17:41.964 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7604999999999998e-05 2024-04-19T02:17:41.964 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:41.964 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:41.964 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:41.964 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.964 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.965 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157507 5.b 5:de8840a2:::benchmark_data_smithi121_44835_object23472:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:41.965 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:41.965 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 34.972840656999999, 2024-04-19T02:17:41.965 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022544518999999999, 2024-04-19T02:17:41.965 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:41.965 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.965 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:41.965 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:41.965 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:41.965 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157507 2024-04-19T02:17:41.965 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.966 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:41.966 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.966 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:41.966 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:41.966 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:41.966 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.966 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.966 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:41.966 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:41.966 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:41.966 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.966 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.966 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:41.966 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:41.967 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:41.967 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.967 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.967 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:41.967 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916406+0000", 2024-04-19T02:17:41.967 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4589999999999998e-06 2024-04-19T02:17:41.967 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.967 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.967 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:41.967 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916415+0000", 2024-04-19T02:17:41.967 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3910000000000004e-06 2024-04-19T02:17:41.967 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.967 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.968 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.968 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916421+0000", 2024-04-19T02:17:41.968 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.6130000000000003e-06 2024-04-19T02:17:41.968 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.968 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.968 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:41.968 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916448+0000", 2024-04-19T02:17:41.968 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7277999999999999e-05 2024-04-19T02:17:41.968 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.968 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.968 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:41.968 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916539+0000", 2024-04-19T02:17:41.968 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0855999999999999e-05 2024-04-19T02:17:41.968 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.968 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.969 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:41.969 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916605+0000", 2024-04-19T02:17:41.969 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6141000000000003e-05 2024-04-19T02:17:41.969 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.969 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.969 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:41.969 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918276+0000", 2024-04-19T02:17:41.969 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001670726 2024-04-19T02:17:41.969 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.969 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.969 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:41.969 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.938888+0000", 2024-04-19T02:17:41.969 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020612042000000001 2024-04-19T02:17:41.969 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.970 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.970 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:41.970 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.938924+0000", 2024-04-19T02:17:41.970 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5692999999999999e-05 2024-04-19T02:17:41.970 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.970 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.970 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:41.970 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.938948+0000", 2024-04-19T02:17:41.970 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3879e-05 2024-04-19T02:17:41.970 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:41.970 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:41.970 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:41.970 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.970 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.971 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157509 5.8 5:1dca85d0:::benchmark_data_smithi121_44835_object23474:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:41.971 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:41.971 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 34.970412410999998, 2024-04-19T02:17:41.971 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.024511807, 2024-04-19T02:17:41.971 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:41.971 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.971 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:41.971 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:41.971 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:41.971 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157509 2024-04-19T02:17:41.971 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.971 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:41.971 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.971 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:41.972 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:41.972 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:41.972 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.972 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.972 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:41.972 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:41.972 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:41.972 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.972 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.972 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:41.972 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:41.972 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:41.972 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.972 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.972 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:41.973 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918834+0000", 2024-04-19T02:17:41.973 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9409999999999999e-06 2024-04-19T02:17:41.973 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.973 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.973 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:41.973 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918859+0000", 2024-04-19T02:17:41.973 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.5245999999999999e-05 2024-04-19T02:17:41.973 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.973 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.973 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.973 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918864+0000", 2024-04-19T02:17:41.973 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.1819999999999997e-06 2024-04-19T02:17:41.973 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.973 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.974 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:41.974 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918900+0000", 2024-04-19T02:17:41.974 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5327000000000002e-05 2024-04-19T02:17:41.974 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.974 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.974 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:41.974 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.919024+0000", 2024-04-19T02:17:41.974 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012400900000000001 2024-04-19T02:17:41.974 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.974 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.974 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:41.974 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.919136+0000", 2024-04-19T02:17:41.974 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000111987 2024-04-19T02:17:41.974 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.975 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.975 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:41.975 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.922096+0000", 2024-04-19T02:17:41.975 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0029607079999999998 2024-04-19T02:17:41.975 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.975 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.975 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:41.975 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943120+0000", 2024-04-19T02:17:41.975 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.021023995 2024-04-19T02:17:41.975 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.975 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.975 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:41.975 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943255+0000", 2024-04-19T02:17:41.975 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013502100000000001 2024-04-19T02:17:41.975 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.976 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.976 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:41.976 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943343+0000", 2024-04-19T02:17:41.976 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.7931999999999998e-05 2024-04-19T02:17:41.976 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:41.976 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:41.976 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:41.976 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.976 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.976 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:241615 5.d e62/16 5:bc2762a9:::benchmark_data_smithi121_44835_object107580:head v 62'15112, mlcod=62'15108)", 2024-04-19T02:17:41.976 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:38.291278+0000", 2024-04-19T02:17:41.976 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 3.5979662489999997, 2024-04-19T02:17:41.976 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.064975456000000001, 2024-04-19T02:17:41.976 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:41.977 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.977 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:41.977 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.977 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:41.977 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.291278+0000", 2024-04-19T02:17:41.977 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:41.977 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.977 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.977 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:41.977 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.291278+0000", 2024-04-19T02:17:41.977 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:41.977 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.977 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.977 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:41.977 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.291277+0000", 2024-04-19T02:17:41.978 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:41.978 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.978 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.978 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:41.978 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.291281+0000", 2024-04-19T02:17:41.978 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8160000000000004e-06 2024-04-19T02:17:41.978 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.978 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.978 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:41.978 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.291291+0000", 2024-04-19T02:17:41.978 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0011e-05 2024-04-19T02:17:41.978 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.978 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.979 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.979 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.291296+0000", 2024-04-19T02:17:41.979 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.9559999999999996e-06 2024-04-19T02:17:41.979 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.979 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.979 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:41.979 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.292800+0000", 2024-04-19T02:17:41.979 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0015041060000000001 2024-04-19T02:17:41.979 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.979 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.979 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:41.979 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.292818+0000", 2024-04-19T02:17:41.979 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.8056000000000001e-05 2024-04-19T02:17:41.979 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.979 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.980 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:41.980 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.356217+0000", 2024-04-19T02:17:41.980 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.063399214999999995 2024-04-19T02:17:41.980 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.980 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.980 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:41.980 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.356253+0000", 2024-04-19T02:17:41.980 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5605999999999998e-05 2024-04-19T02:17:41.980 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:41.980 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:41.980 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:41.980 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.980 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.980 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:241622 5.d e62/16 5:ba16b775:::benchmark_data_smithi121_44835_object107587:head v 62'15113, mlcod=62'15108)", 2024-04-19T02:17:41.980 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:38.292906+0000", 2024-04-19T02:17:41.981 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 3.5963376949999999, 2024-04-19T02:17:41.981 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.068017509000000004, 2024-04-19T02:17:41.981 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:41.981 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.981 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:41.981 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.981 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:41.981 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.292906+0000", 2024-04-19T02:17:41.981 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:41.981 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.981 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.981 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:41.981 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.292906+0000", 2024-04-19T02:17:41.981 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:41.982 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.982 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.982 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:41.982 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.292906+0000", 2024-04-19T02:17:41.982 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:41.982 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.982 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.982 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:41.982 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.292913+0000", 2024-04-19T02:17:41.982 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1720000000000001e-06 2024-04-19T02:17:41.982 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.982 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.982 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:41.982 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.292918+0000", 2024-04-19T02:17:41.983 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2519999999999999e-06 2024-04-19T02:17:41.983 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.983 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.983 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.983 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.292923+0000", 2024-04-19T02:17:41.983 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4710000000000001e-06 2024-04-19T02:17:41.983 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.983 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.983 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:41.983 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.294510+0000", 2024-04-19T02:17:41.983 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001587822 2024-04-19T02:17:41.983 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.983 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.983 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:41.984 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.294528+0000", 2024-04-19T02:17:41.984 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.7234000000000001e-05 2024-04-19T02:17:41.984 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.984 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.984 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:41.984 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.360893+0000", 2024-04-19T02:17:41.984 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.066365882000000001 2024-04-19T02:17:41.984 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.984 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.984 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:41.984 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.360924+0000", 2024-04-19T02:17:41.984 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0139000000000001e-05 2024-04-19T02:17:41.984 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:41.984 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:41.984 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:41.985 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.985 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.985 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:241631 5.1 5:89a96e22:::benchmark_data_smithi121_44835_object107596:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:41.985 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:38.293316+0000", 2024-04-19T02:17:41.985 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 3.5959273700000001, 2024-04-19T02:17:41.985 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.066515056000000003, 2024-04-19T02:17:41.985 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:41.985 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.985 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:41.985 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:41.985 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:41.985 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 241631 2024-04-19T02:17:41.985 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.985 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:41.985 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.986 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:41.986 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293316+0000", 2024-04-19T02:17:41.986 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:41.986 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.986 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.986 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:41.986 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293316+0000", 2024-04-19T02:17:41.986 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:41.986 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.986 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.986 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:41.986 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293315+0000", 2024-04-19T02:17:41.986 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:41.986 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.987 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.987 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:41.987 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293321+0000", 2024-04-19T02:17:41.987 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.1390000000000003e-06 2024-04-19T02:17:41.987 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.987 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.987 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:41.987 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293331+0000", 2024-04-19T02:17:41.987 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.9690000000000006e-06 2024-04-19T02:17:41.987 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.987 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.987 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.987 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293338+0000", 2024-04-19T02:17:41.987 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.0559999999999999e-06 2024-04-19T02:17:41.987 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.987 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.988 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:41.988 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293365+0000", 2024-04-19T02:17:41.988 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7546e-05 2024-04-19T02:17:41.988 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.988 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.988 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:41.988 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293445+0000", 2024-04-19T02:17:41.988 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9387000000000004e-05 2024-04-19T02:17:41.988 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.988 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.988 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:41.988 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.359712+0000", 2024-04-19T02:17:41.988 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.066267197 2024-04-19T02:17:41.988 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.989 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.989 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:41.989 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.359757+0000", 2024-04-19T02:17:41.989 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4768000000000002e-05 2024-04-19T02:17:41.989 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.989 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.989 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:41.989 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.359831+0000", 2024-04-19T02:17:41.989 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.4935e-05 2024-04-19T02:17:41.989 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:41.989 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:41.989 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:41.989 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.989 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.989 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:241633 5.8 5:16311ac0:::benchmark_data_smithi121_44835_object107598:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:41.990 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:38.293861+0000", 2024-04-19T02:17:41.990 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 3.5953824189999999, 2024-04-19T02:17:41.990 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.066819026000000004, 2024-04-19T02:17:41.990 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:41.990 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.990 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:41.990 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:41.990 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:41.990 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 241633 2024-04-19T02:17:41.990 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.990 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:41.990 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.990 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:41.990 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293861+0000", 2024-04-19T02:17:41.991 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:41.991 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.991 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.991 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:41.991 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293861+0000", 2024-04-19T02:17:41.991 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:41.991 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.991 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.991 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:41.991 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293861+0000", 2024-04-19T02:17:41.991 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:41.991 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.991 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.991 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:41.992 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293863+0000", 2024-04-19T02:17:41.992 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.9690000000000001e-06 2024-04-19T02:17:41.992 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.992 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.992 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:41.992 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293867+0000", 2024-04-19T02:17:41.992 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5889999999999999e-06 2024-04-19T02:17:41.992 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.992 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.992 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.992 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293870+0000", 2024-04-19T02:17:41.992 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0110000000000001e-06 2024-04-19T02:17:41.992 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.992 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.992 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:41.993 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293905+0000", 2024-04-19T02:17:41.993 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5043000000000003e-05 2024-04-19T02:17:41.993 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.993 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.993 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:41.993 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.294020+0000", 2024-04-19T02:17:41.993 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011504400000000001 2024-04-19T02:17:41.993 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.993 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.993 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:41.993 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.360556+0000", 2024-04-19T02:17:41.993 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.066536559999999995 2024-04-19T02:17:41.993 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.993 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.994 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:41.994 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.360604+0000", 2024-04-19T02:17:41.994 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8152000000000002e-05 2024-04-19T02:17:41.994 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.994 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.994 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:41.994 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.360680+0000", 2024-04-19T02:17:41.994 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.5964999999999995e-05 2024-04-19T02:17:41.994 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:41.994 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:41.994 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:41.994 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.994 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.994 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:241634 5.1 5:8a07564d:::benchmark_data_smithi121_44835_object107599:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:41.994 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:38.293914+0000", 2024-04-19T02:17:41.995 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 3.5953296290000001, 2024-04-19T02:17:41.995 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.066174561000000007, 2024-04-19T02:17:41.995 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:41.995 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:41.995 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:41.995 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:41.995 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:41.995 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 241634 2024-04-19T02:17:41.995 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.995 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:41.995 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.995 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:41.995 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293914+0000", 2024-04-19T02:17:41.996 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:41.996 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.996 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.996 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:41.996 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293914+0000", 2024-04-19T02:17:41.996 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:41.996 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.996 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.996 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:41.996 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293914+0000", 2024-04-19T02:17:41.996 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:41.996 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.996 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.996 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:41.996 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293916+0000", 2024-04-19T02:17:41.997 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7240000000000001e-06 2024-04-19T02:17:41.997 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.997 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.997 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:41.997 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293921+0000", 2024-04-19T02:17:41.997 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2309999999999998e-06 2024-04-19T02:17:41.997 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.997 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.997 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:41.997 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293924+0000", 2024-04-19T02:17:41.997 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5810000000000001e-06 2024-04-19T02:17:41.997 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.997 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.997 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:41.997 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.295125+0000", 2024-04-19T02:17:41.998 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0012006759999999999 2024-04-19T02:17:41.998 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.998 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.998 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:41.998 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.295201+0000", 2024-04-19T02:17:41.998 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.5847999999999996e-05 2024-04-19T02:17:41.998 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.998 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.998 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:41.998 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.359977+0000", 2024-04-19T02:17:41.998 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.064775852999999994 2024-04-19T02:17:41.998 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.998 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.999 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:41.999 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.360019+0000", 2024-04-19T02:17:41.999 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2821999999999998e-05 2024-04-19T02:17:41.999 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.999 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.999 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:41.999 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.360089+0000", 2024-04-19T02:17:41.999 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.9356999999999993e-05 2024-04-19T02:17:41.999 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:41.999 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:41.999 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:41.999 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:41.999 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:41.999 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:241635 5.8 5:1c80e285:::benchmark_data_smithi121_44835_object107600:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:42.000 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:38.295774+0000", 2024-04-19T02:17:42.000 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 3.5934699170000002, 2024-04-19T02:17:42.000 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.065098854999999997, 2024-04-19T02:17:42.000 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:42.000 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:42.000 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:42.000 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:42.000 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:42.000 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 241635 2024-04-19T02:17:42.000 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:42.000 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:42.000 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:42.000 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:42.000 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.295774+0000", 2024-04-19T02:17:42.001 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:42.001 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:42.001 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:42.001 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:42.001 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.295774+0000", 2024-04-19T02:17:42.001 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:42.001 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:42.001 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:42.001 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:42.001 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.295773+0000", 2024-04-19T02:17:42.001 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:42.001 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:42.001 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:42.001 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:42.001 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.295779+0000", 2024-04-19T02:17:42.002 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.1e-06 2024-04-19T02:17:42.002 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:42.002 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:42.002 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:42.002 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.295789+0000", 2024-04-19T02:17:42.002 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.815e-06 2024-04-19T02:17:42.002 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:42.002 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:42.002 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:42.002 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.295796+0000", 2024-04-19T02:17:42.002 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3479999999999998e-06 2024-04-19T02:17:42.002 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:42.002 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:42.002 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:42.003 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.295823+0000", 2024-04-19T02:17:42.003 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.6400000000000001e-05 2024-04-19T02:17:42.003 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:42.003 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:42.003 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:42.003 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.356276+0000", 2024-04-19T02:17:42.003 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.060453042999999998 2024-04-19T02:17:42.003 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:42.003 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:42.003 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:42.003 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.360756+0000", 2024-04-19T02:17:42.003 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0044805879999999998 2024-04-19T02:17:42.003 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:42.003 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:42.004 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:42.004 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.360799+0000", 2024-04-19T02:17:42.004 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2407999999999998e-05 2024-04-19T02:17:42.004 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:42.004 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:42.004 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:42.004 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.360873+0000", 2024-04-19T02:17:42.004 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.4160999999999997e-05 2024-04-19T02:17:42.004 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:42.004 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:42.004 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:42.004 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:42.004 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:42.004 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:241637 5.9 e62/16 5:920672c8:::benchmark_data_smithi121_44835_object107602:head v 62'15373, mlcod=62'15371)", 2024-04-19T02:17:42.005 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:38.297900+0000", 2024-04-19T02:17:42.005 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 3.591344028, 2024-04-19T02:17:42.005 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.062258717999999998, 2024-04-19T02:17:42.005 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:42.005 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:42.005 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:42.005 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:42.005 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:42.005 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.297900+0000", 2024-04-19T02:17:42.005 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:42.005 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:42.005 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:42.005 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:42.005 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.297900+0000", 2024-04-19T02:17:42.005 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:42.005 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:42.006 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:42.006 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:42.006 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.297899+0000", 2024-04-19T02:17:42.006 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:42.006 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:42.006 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:42.006 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:42.006 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.297904+0000", 2024-04-19T02:17:42.006 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.9130000000000002e-06 2024-04-19T02:17:42.006 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:42.006 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:42.006 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:42.006 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.356177+0000", 2024-04-19T02:17:42.006 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.058273318999999997 2024-04-19T02:17:42.007 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:42.007 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:42.007 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:42.007 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.356187+0000", 2024-04-19T02:17:42.007 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7599999999999997e-06 2024-04-19T02:17:42.007 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:42.007 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:42.007 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:42.007 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.356220+0000", 2024-04-19T02:17:42.007 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2651999999999998e-05 2024-04-19T02:17:42.007 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:42.007 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:42.007 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:42.007 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.356251+0000", 2024-04-19T02:17:42.007 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1232999999999997e-05 2024-04-19T02:17:42.007 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:42.008 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:42.008 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:42.008 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.360091+0000", 2024-04-19T02:17:42.008 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0038395429999999999 2024-04-19T02:17:42.008 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:42.008 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:42.008 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:42.008 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.360158+0000", 2024-04-19T02:17:42.008 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.7916999999999994e-05 2024-04-19T02:17:42.008 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:42.008 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:42.008 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:42.008 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:42.008 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:42.009 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:17:42.010 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:42.010+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:42.010 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:42.111 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:42.111+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:42.185 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:42.185 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:17:42.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.185 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:252177 5.5 5:a1cebb6f:::benchmark_data_smithi121_44835_object118142:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T02:17:42.185 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:42.179782+0000", 2024-04-19T02:17:42.185 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0053270779999999998, 2024-04-19T02:17:42.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.005352201, 2024-04-19T02:17:42.185 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:42.185 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:42.185 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:42.186 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:42.186 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:42.186 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 252177 2024-04-19T02:17:42.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.186 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:42.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:42.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.179782+0000", 2024-04-19T02:17:42.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:42.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.179782+0000", 2024-04-19T02:17:42.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:42.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.179782+0000", 2024-04-19T02:17:42.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:42.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:42.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.179784+0000", 2024-04-19T02:17:42.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3860000000000001e-06 2024-04-19T02:17:42.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:42.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.179790+0000", 2024-04-19T02:17:42.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5690000000000004e-06 2024-04-19T02:17:42.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:42.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.179793+0000", 2024-04-19T02:17:42.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5140000000000002e-06 2024-04-19T02:17:42.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:42.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.181115+0000", 2024-04-19T02:17:42.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013222970000000001 2024-04-19T02:17:42.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:42.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.181200+0000", 2024-04-19T02:17:42.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4464999999999999e-05 2024-04-19T02:17:42.189 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.189 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:42.189 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.189 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:252179 5.d 5:bddaee6c:::benchmark_data_smithi121_44835_object118144:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T02:17:42.189 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:42.180162+0000", 2024-04-19T02:17:42.189 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0049475270000000002, 2024-04-19T02:17:42.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050607769999999998, 2024-04-19T02:17:42.189 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:42.189 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:42.189 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:42.189 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:42.190 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:42.190 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 252179 2024-04-19T02:17:42.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.190 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:42.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:42.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.180162+0000", 2024-04-19T02:17:42.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:42.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.180162+0000", 2024-04-19T02:17:42.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:42.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.180161+0000", 2024-04-19T02:17:42.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:42.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:42.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.180164+0000", 2024-04-19T02:17:42.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7420000000000002e-06 2024-04-19T02:17:42.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:42.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.180170+0000", 2024-04-19T02:17:42.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7259999999999999e-06 2024-04-19T02:17:42.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:42.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.180173+0000", 2024-04-19T02:17:42.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6500000000000002e-06 2024-04-19T02:17:42.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:42.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.181099+0000", 2024-04-19T02:17:42.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00092577399999999998 2024-04-19T02:17:42.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:42.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.181181+0000", 2024-04-19T02:17:42.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1522999999999999e-05 2024-04-19T02:17:42.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:42.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.181243+0000", 2024-04-19T02:17:42.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2391000000000006e-05 2024-04-19T02:17:42.193 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.193 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:42.193 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.193 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:252181 5.6 5:678aac77:::benchmark_data_smithi121_44835_object118146:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T02:17:42.193 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:42.182539+0000", 2024-04-19T02:17:42.193 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0025697960000000001, 2024-04-19T02:17:42.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027629040000000001, 2024-04-19T02:17:42.193 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:42.193 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:42.194 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:42.194 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:42.194 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:42.194 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 252181 2024-04-19T02:17:42.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.194 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:42.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:42.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.182539+0000", 2024-04-19T02:17:42.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:42.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.182539+0000", 2024-04-19T02:17:42.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:42.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.182539+0000", 2024-04-19T02:17:42.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:42.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:42.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.182542+0000", 2024-04-19T02:17:42.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.937e-06 2024-04-19T02:17:42.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:42.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.182548+0000", 2024-04-19T02:17:42.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2709999999999998e-06 2024-04-19T02:17:42.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:42.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.182552+0000", 2024-04-19T02:17:42.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7519999999999998e-06 2024-04-19T02:17:42.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:42.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.182590+0000", 2024-04-19T02:17:42.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8293000000000001e-05 2024-04-19T02:17:42.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:42.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.182677+0000", 2024-04-19T02:17:42.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6805000000000007e-05 2024-04-19T02:17:42.197 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.197 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:42.197 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.197 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:252182 5.f 5:fe92109f:::benchmark_data_smithi121_44835_object118147:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T02:17:42.197 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:42.182558+0000", 2024-04-19T02:17:42.197 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0025515339999999998, 2024-04-19T02:17:42.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002817412, 2024-04-19T02:17:42.197 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:42.197 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:42.197 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:42.197 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:42.197 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:42.197 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 252182 2024-04-19T02:17:42.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.198 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:42.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:42.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.182558+0000", 2024-04-19T02:17:42.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:42.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.182558+0000", 2024-04-19T02:17:42.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:42.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.182557+0000", 2024-04-19T02:17:42.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:42.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:42.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.182559+0000", 2024-04-19T02:17:42.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.385e-06 2024-04-19T02:17:42.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:42.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.182565+0000", 2024-04-19T02:17:42.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2310000000000004e-06 2024-04-19T02:17:42.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:42.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.182570+0000", 2024-04-19T02:17:42.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9570000000000001e-06 2024-04-19T02:17:42.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:42.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.182606+0000", 2024-04-19T02:17:42.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6609000000000001e-05 2024-04-19T02:17:42.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:42.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.182714+0000", 2024-04-19T02:17:42.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010742399999999999 2024-04-19T02:17:42.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:42.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.182825+0000", 2024-04-19T02:17:42.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000111035 2024-04-19T02:17:42.201 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.201 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:42.201 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.201 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:252186 5.c 5:3414c10d:::benchmark_data_smithi121_44835_object118151:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T02:17:42.201 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:42.182708+0000", 2024-04-19T02:17:42.201 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.002401126, 2024-04-19T02:17:42.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027448310000000001, 2024-04-19T02:17:42.201 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:42.201 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:42.201 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:42.201 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:42.202 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:42.202 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 252186 2024-04-19T02:17:42.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.202 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:42.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:42.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.182708+0000", 2024-04-19T02:17:42.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:42.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.182708+0000", 2024-04-19T02:17:42.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:42.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.182707+0000", 2024-04-19T02:17:42.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:42.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:42.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.182711+0000", 2024-04-19T02:17:42.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.194e-06 2024-04-19T02:17:42.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:42.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.182719+0000", 2024-04-19T02:17:42.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8129999999999996e-06 2024-04-19T02:17:42.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:42.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.182726+0000", 2024-04-19T02:17:42.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6409999999999996e-06 2024-04-19T02:17:42.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:42.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.182770+0000", 2024-04-19T02:17:42.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4001000000000001e-05 2024-04-19T02:17:42.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:42.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.182915+0000", 2024-04-19T02:17:42.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014557700000000001 2024-04-19T02:17:42.205 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.205 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:42.205 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.205 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:252187 5.5 5:aef48220:::benchmark_data_smithi121_44835_object118152:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T02:17:42.205 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:42.183147+0000", 2024-04-19T02:17:42.205 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0019619070000000001, 2024-04-19T02:17:42.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0023782740000000001, 2024-04-19T02:17:42.205 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:42.205 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:42.205 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:42.205 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:42.205 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:42.205 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 252187 2024-04-19T02:17:42.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.206 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:42.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:42.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.183147+0000", 2024-04-19T02:17:42.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:42.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.183147+0000", 2024-04-19T02:17:42.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:42.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.183147+0000", 2024-04-19T02:17:42.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:42.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:42.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.183150+0000", 2024-04-19T02:17:42.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8530000000000002e-06 2024-04-19T02:17:42.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:42.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.183161+0000", 2024-04-19T02:17:42.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0394000000000001e-05 2024-04-19T02:17:42.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:42.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.183169+0000", 2024-04-19T02:17:42.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0919999999999998e-06 2024-04-19T02:17:42.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:42.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.183211+0000", 2024-04-19T02:17:42.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1709999999999999e-05 2024-04-19T02:17:42.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:42.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.183338+0000", 2024-04-19T02:17:42.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012755000000000001 2024-04-19T02:17:42.208 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.208 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:42.208 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.209 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:252188 5.5 5:a6f3d361:::benchmark_data_smithi121_44835_object118153:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T02:17:42.209 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:42.184741+0000", 2024-04-19T02:17:42.209 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.000368568, 2024-04-19T02:17:42.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00086017199999999998, 2024-04-19T02:17:42.209 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:42.209 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:42.209 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:42.209 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:42.209 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:42.209 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 252188 2024-04-19T02:17:42.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.209 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:42.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:42.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.184741+0000", 2024-04-19T02:17:42.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:42.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.184741+0000", 2024-04-19T02:17:42.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:42.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.184740+0000", 2024-04-19T02:17:42.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:42.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:42.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.184745+0000", 2024-04-19T02:17:42.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9969999999999998e-06 2024-04-19T02:17:42.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:42.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.184754+0000", 2024-04-19T02:17:42.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4439999999999997e-06 2024-04-19T02:17:42.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:42.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.184762+0000", 2024-04-19T02:17:42.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4930000000000001e-06 2024-04-19T02:17:42.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:42.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.184793+0000", 2024-04-19T02:17:42.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1390999999999998e-05 2024-04-19T02:17:42.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:42.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.185014+0000", 2024-04-19T02:17:42.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000220774 2024-04-19T02:17:42.212 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.212 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:42.212 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.212 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:252163 5.9 5:925b4717:::benchmark_data_smithi121_44835_object118128:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T02:17:42.213 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:42.174061+0000", 2024-04-19T02:17:42.213 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.011047665999999999, 2024-04-19T02:17:42.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011614085999999999, 2024-04-19T02:17:42.213 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:42.213 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:42.213 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:42.213 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:42.213 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:42.213 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 252163 2024-04-19T02:17:42.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.213 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:42.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:42.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.174061+0000", 2024-04-19T02:17:42.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:42.214 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.174061+0000", 2024-04-19T02:17:42.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:42.214 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.174061+0000", 2024-04-19T02:17:42.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:42.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:42.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.174066+0000", 2024-04-19T02:17:42.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5999999999999997e-06 2024-04-19T02:17:42.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:42.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.174075+0000", 2024-04-19T02:17:42.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9789999999999999e-06 2024-04-19T02:17:42.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:42.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.174082+0000", 2024-04-19T02:17:42.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1520000000000003e-06 2024-04-19T02:17:42.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:42.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.178635+0000", 2024-04-19T02:17:42.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045526350000000002 2024-04-19T02:17:42.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:42.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.178759+0000", 2024-04-19T02:17:42.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012430000000000001 2024-04-19T02:17:42.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:42.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.178871+0000", 2024-04-19T02:17:42.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000111444 2024-04-19T02:17:42.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:42.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:42.184497+0000", 2024-04-19T02:17:42.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0056261100000000001 2024-04-19T02:17:42.217 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.217 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:42.217 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.217 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.217 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-04-19T02:17:42.217 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 8 2024-04-19T02:17:42.217 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:42.219 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:42.219 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:42.218+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:42.319 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:42.319+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:42.421 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:42.421+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:42.435 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:42.435 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-04-19T02:17:42.435 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-04-19T02:17:42.435 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-04-19T02:17:42.435 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:42.450 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:42.522 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:42.522+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:42.622 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:42.622+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:42.664 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:42.665 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-04-19T02:17:42.665 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-04-19T02:17:42.665 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:17:42.665 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.665 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168377 5.d 5:b1f3fb6d:::benchmark_data_smithi121_44835_object34342:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:42.665 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069470+0000", 2024-04-19T02:17:42.665 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.594381604999999, 2024-04-19T02:17:42.665 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050516473999999999, 2024-04-19T02:17:42.665 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:42.665 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:42.665 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:42.665 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:42.666 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:42.666 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168377 2024-04-19T02:17:42.666 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.666 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:42.666 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.666 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:42.666 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069470+0000", 2024-04-19T02:17:42.666 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.666 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.666 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.666 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:42.666 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069470+0000", 2024-04-19T02:17:42.666 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.666 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.667 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.667 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:42.667 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069469+0000", 2024-04-19T02:17:42.667 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:42.667 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.667 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.667 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:42.667 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069473+0000", 2024-04-19T02:17:42.667 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4580000000000002e-06 2024-04-19T02:17:42.667 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.667 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.667 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:42.667 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069482+0000", 2024-04-19T02:17:42.667 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2839999999999995e-06 2024-04-19T02:17:42.667 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:42.668 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069489+0000", 2024-04-19T02:17:42.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3579999999999997e-06 2024-04-19T02:17:42.668 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:42.668 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069559+0000", 2024-04-19T02:17:42.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9678000000000006e-05 2024-04-19T02:17:42.668 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:42.668 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069683+0000", 2024-04-19T02:17:42.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012359400000000001 2024-04-19T02:17:42.669 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.669 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.669 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:42.669 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069759+0000", 2024-04-19T02:17:42.669 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6834000000000003e-05 2024-04-19T02:17:42.669 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.669 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.669 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:42.669 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119871+0000", 2024-04-19T02:17:42.669 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050111392999999997 2024-04-19T02:17:42.669 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.669 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.669 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:42.670 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119932+0000", 2024-04-19T02:17:42.670 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1209000000000003e-05 2024-04-19T02:17:42.670 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.670 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.670 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:42.670 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119962+0000", 2024-04-19T02:17:42.670 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9717999999999999e-05 2024-04-19T02:17:42.670 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.670 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.670 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:42.670 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119986+0000", 2024-04-19T02:17:42.670 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4549000000000002e-05 2024-04-19T02:17:42.670 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.670 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:42.670 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.671 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168379 5.d 5:bcd492dd:::benchmark_data_smithi121_44835_object34344:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:42.671 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069502+0000", 2024-04-19T02:17:42.671 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.594349552000001, 2024-04-19T02:17:42.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050544645999999999, 2024-04-19T02:17:42.671 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:42.671 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:42.671 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:42.671 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:42.671 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:42.671 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168379 2024-04-19T02:17:42.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.671 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:42.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.672 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:42.672 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069502+0000", 2024-04-19T02:17:42.672 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.672 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.672 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.672 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:42.672 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069502+0000", 2024-04-19T02:17:42.672 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.672 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.672 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.672 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:42.672 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069501+0000", 2024-04-19T02:17:42.672 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:42.672 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.672 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.672 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:42.673 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069504+0000", 2024-04-19T02:17:42.673 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9289999999999998e-06 2024-04-19T02:17:42.673 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.673 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.673 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:42.673 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069511+0000", 2024-04-19T02:17:42.673 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1909999999999997e-06 2024-04-19T02:17:42.673 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.673 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.673 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:42.673 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069517+0000", 2024-04-19T02:17:42.673 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0789999999999997e-06 2024-04-19T02:17:42.673 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.673 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.674 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:42.674 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071081+0000", 2024-04-19T02:17:42.674 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0015646550000000001 2024-04-19T02:17:42.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.674 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.674 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:42.675 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071195+0000", 2024-04-19T02:17:42.675 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011399400000000001 2024-04-19T02:17:42.675 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.675 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.675 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:42.675 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071293+0000", 2024-04-19T02:17:42.676 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7938999999999999e-05 2024-04-19T02:17:42.676 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.676 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.676 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:42.676 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119898+0000", 2024-04-19T02:17:42.676 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.048604808999999999 2024-04-19T02:17:42.676 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.677 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.677 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:42.677 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119993+0000", 2024-04-19T02:17:42.677 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5224999999999997e-05 2024-04-19T02:17:42.677 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.677 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.678 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:42.678 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120024+0000", 2024-04-19T02:17:42.678 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0580999999999997e-05 2024-04-19T02:17:42.678 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.678 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.678 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:42.678 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120047+0000", 2024-04-19T02:17:42.678 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2725e-05 2024-04-19T02:17:42.678 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.678 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:42.679 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.679 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.679 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168381 5.d 5:bcbab0e3:::benchmark_data_smithi121_44835_object34346:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:42.679 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:42.679 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.594330134, 2024-04-19T02:17:42.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050574694000000003, 2024-04-19T02:17:42.680 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:42.680 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:42.680 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:42.680 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:42.680 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:42.680 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168381 2024-04-19T02:17:42.680 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.680 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:42.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.681 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:42.681 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:42.681 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.681 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.681 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.681 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:42.682 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:42.682 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.682 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.682 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.682 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:42.682 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:42.683 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:42.683 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.683 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.683 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:42.683 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069523+0000", 2024-04-19T02:17:42.683 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.244e-06 2024-04-19T02:17:42.683 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.683 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.683 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:42.683 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069528+0000", 2024-04-19T02:17:42.683 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0669999999999999e-06 2024-04-19T02:17:42.683 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.683 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.684 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:42.684 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069533+0000", 2024-04-19T02:17:42.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4680000000000003e-06 2024-04-19T02:17:42.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.684 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:42.684 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072637+0000", 2024-04-19T02:17:42.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031040429999999999 2024-04-19T02:17:42.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.684 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:42.684 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072710+0000", 2024-04-19T02:17:42.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3045000000000003e-05 2024-04-19T02:17:42.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:42.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072775+0000", 2024-04-19T02:17:42.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5034000000000001e-05 2024-04-19T02:17:42.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:42.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119925+0000", 2024-04-19T02:17:42.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.047150594999999997 2024-04-19T02:17:42.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:42.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120055+0000", 2024-04-19T02:17:42.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129288 2024-04-19T02:17:42.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:42.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120077+0000", 2024-04-19T02:17:42.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1759e-05 2024-04-19T02:17:42.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:42.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120096+0000", 2024-04-19T02:17:42.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9524000000000001e-05 2024-04-19T02:17:42.686 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.686 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:42.686 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.687 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.687 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.687 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168382 5.f 5:f2599a15:::benchmark_data_smithi121_44835_object34347:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:42.687 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069556+0000", 2024-04-19T02:17:42.687 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.594295726999999, 2024-04-19T02:17:42.687 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050009713999999997, 2024-04-19T02:17:42.687 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:42.687 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:42.687 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:42.687 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:42.687 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:42.687 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168382 2024-04-19T02:17:42.687 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.687 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:42.687 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.688 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:42.688 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069556+0000", 2024-04-19T02:17:42.688 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.688 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.688 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.688 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:42.688 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069556+0000", 2024-04-19T02:17:42.688 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.688 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.688 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.688 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:42.688 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069555+0000", 2024-04-19T02:17:42.688 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:42.688 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.688 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.689 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:42.689 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069558+0000", 2024-04-19T02:17:42.689 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7879999999999998e-06 2024-04-19T02:17:42.689 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.689 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.689 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:42.689 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069566+0000", 2024-04-19T02:17:42.689 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6149999999999999e-06 2024-04-19T02:17:42.689 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.689 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.689 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:42.689 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069571+0000", 2024-04-19T02:17:42.689 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5509999999999999e-06 2024-04-19T02:17:42.689 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.689 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.690 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:42.690 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069618+0000", 2024-04-19T02:17:42.690 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6964e-05 2024-04-19T02:17:42.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.690 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.690 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:42.690 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069744+0000", 2024-04-19T02:17:42.690 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012577199999999999 2024-04-19T02:17:42.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.690 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.690 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:42.690 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.070116+0000", 2024-04-19T02:17:42.690 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000372407 2024-04-19T02:17:42.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.691 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.691 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:42.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117511+0000", 2024-04-19T02:17:42.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.047394935999999999 2024-04-19T02:17:42.691 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.691 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.691 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:42.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119484+0000", 2024-04-19T02:17:42.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019722310000000001 2024-04-19T02:17:42.691 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.691 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.691 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:42.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119525+0000", 2024-04-19T02:17:42.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1035999999999998e-05 2024-04-19T02:17:42.691 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.691 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.692 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:42.692 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119565+0000", 2024-04-19T02:17:42.692 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0859000000000003e-05 2024-04-19T02:17:42.692 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.692 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:42.692 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.692 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.692 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.692 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168383 5.d 5:bbd9496c:::benchmark_data_smithi121_44835_object34348:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:42.692 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069581+0000", 2024-04-19T02:17:42.692 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.594270839, 2024-04-19T02:17:42.692 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050607278999999998, 2024-04-19T02:17:42.692 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:42.692 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:42.692 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:42.692 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:42.693 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:42.693 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168383 2024-04-19T02:17:42.693 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.693 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:42.693 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.693 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:42.693 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069581+0000", 2024-04-19T02:17:42.693 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.693 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.693 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.693 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:42.693 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069581+0000", 2024-04-19T02:17:42.693 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.693 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:42.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069580+0000", 2024-04-19T02:17:42.694 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:42.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:42.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069589+0000", 2024-04-19T02:17:42.694 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6750000000000008e-06 2024-04-19T02:17:42.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:42.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069596+0000", 2024-04-19T02:17:42.694 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7360000000000004e-06 2024-04-19T02:17:42.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.695 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.695 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:42.695 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069601+0000", 2024-04-19T02:17:42.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0479999999999998e-06 2024-04-19T02:17:42.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.695 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.695 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:42.695 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.073854+0000", 2024-04-19T02:17:42.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042531920000000003 2024-04-19T02:17:42.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.695 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.695 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:42.695 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.073952+0000", 2024-04-19T02:17:42.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7851999999999998e-05 2024-04-19T02:17:42.696 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.696 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.696 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:42.696 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074012+0000", 2024-04-19T02:17:42.696 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0225e-05 2024-04-19T02:17:42.696 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.696 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.696 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:42.696 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120102+0000", 2024-04-19T02:17:42.696 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.046090150000000003 2024-04-19T02:17:42.696 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.696 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.696 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:42.696 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120129+0000", 2024-04-19T02:17:42.697 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7228000000000001e-05 2024-04-19T02:17:42.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.697 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:42.697 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120157+0000", 2024-04-19T02:17:42.697 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7165000000000002e-05 2024-04-19T02:17:42.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.697 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:42.697 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120188+0000", 2024-04-19T02:17:42.697 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1418000000000003e-05 2024-04-19T02:17:42.697 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.697 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:42.697 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.698 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168384 5.7 5:ed638f84:::benchmark_data_smithi121_44835_object34349:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:42.698 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069612+0000", 2024-04-19T02:17:42.698 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.594239785999999, 2024-04-19T02:17:42.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049863376000000001, 2024-04-19T02:17:42.698 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:42.698 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:42.698 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:42.698 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:42.698 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:42.698 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168384 2024-04-19T02:17:42.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.698 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:42.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.698 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:42.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069612+0000", 2024-04-19T02:17:42.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:42.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069612+0000", 2024-04-19T02:17:42.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:42.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069611+0000", 2024-04-19T02:17:42.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:42.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.700 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:42.700 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069614+0000", 2024-04-19T02:17:42.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7819999999999998e-06 2024-04-19T02:17:42.700 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.700 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:42.700 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069623+0000", 2024-04-19T02:17:42.701 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6989999999999992e-06 2024-04-19T02:17:42.701 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.701 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.701 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:42.701 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069628+0000", 2024-04-19T02:17:42.701 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4999999999999999e-06 2024-04-19T02:17:42.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.702 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:42.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069662+0000", 2024-04-19T02:17:42.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3319999999999999e-05 2024-04-19T02:17:42.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.703 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:42.703 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069782+0000", 2024-04-19T02:17:42.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120547 2024-04-19T02:17:42.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.703 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:42.703 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119338+0000", 2024-04-19T02:17:42.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049556141999999997 2024-04-19T02:17:42.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:42.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119388+0000", 2024-04-19T02:17:42.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9866e-05 2024-04-19T02:17:42.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:42.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119475+0000", 2024-04-19T02:17:42.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6929999999999996e-05 2024-04-19T02:17:42.705 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.705 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:42.705 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.705 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168385 5.d 5:b22d7e69:::benchmark_data_smithi121_44835_object34350:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:42.705 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:42.705 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.594216347, 2024-04-19T02:17:42.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.055438508999999997, 2024-04-19T02:17:42.705 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:42.705 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:42.705 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:42.705 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:42.705 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:42.705 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168385 2024-04-19T02:17:42.706 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.706 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:42.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.706 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:42.706 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:42.706 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.706 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.706 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:42.706 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:42.706 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.706 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.706 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:42.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:42.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:42.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:42.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069637+0000", 2024-04-19T02:17:42.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.576e-06 2024-04-19T02:17:42.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:42.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069643+0000", 2024-04-19T02:17:42.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8030000000000002e-06 2024-04-19T02:17:42.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:42.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069648+0000", 2024-04-19T02:17:42.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0889999999999999e-06 2024-04-19T02:17:42.708 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:42.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117534+0000", 2024-04-19T02:17:42.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.047886390000000001 2024-04-19T02:17:42.708 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:42.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117670+0000", 2024-04-19T02:17:42.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000135969 2024-04-19T02:17:42.708 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:42.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117803+0000", 2024-04-19T02:17:42.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000132955 2024-04-19T02:17:42.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.709 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:42.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120501+0000", 2024-04-19T02:17:42.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026978050000000002 2024-04-19T02:17:42.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.709 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:42.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.125026+0000", 2024-04-19T02:17:42.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045244589999999998 2024-04-19T02:17:42.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.709 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:42.710 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.125049+0000", 2024-04-19T02:17:42.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3807000000000001e-05 2024-04-19T02:17:42.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:42.710 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.125074+0000", 2024-04-19T02:17:42.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4175000000000001e-05 2024-04-19T02:17:42.710 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.710 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:42.710 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.710 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168386 5.5 5:a2cda182:::benchmark_data_smithi121_44835_object34351:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:42.710 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069653+0000", 2024-04-19T02:17:42.710 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.59419888, 2024-04-19T02:17:42.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058748884000000001, 2024-04-19T02:17:42.711 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:42.711 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:42.711 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:42.711 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:42.711 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:42.711 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168386 2024-04-19T02:17:42.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.711 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:42.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.711 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:42.711 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069653+0000", 2024-04-19T02:17:42.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:42.712 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069653+0000", 2024-04-19T02:17:42.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:42.712 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069652+0000", 2024-04-19T02:17:42.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:42.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:42.712 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069654+0000", 2024-04-19T02:17:42.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1220000000000002e-06 2024-04-19T02:17:42.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:42.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069660+0000", 2024-04-19T02:17:42.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5890000000000002e-06 2024-04-19T02:17:42.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:42.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069665+0000", 2024-04-19T02:17:42.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.989e-06 2024-04-19T02:17:42.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:42.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120220+0000", 2024-04-19T02:17:42.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050555061999999998 2024-04-19T02:17:42.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.714 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:42.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120329+0000", 2024-04-19T02:17:42.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010922200000000001 2024-04-19T02:17:42.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.714 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:42.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.128293+0000", 2024-04-19T02:17:42.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079640279999999997 2024-04-19T02:17:42.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.714 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:42.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.128336+0000", 2024-04-19T02:17:42.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2245e-05 2024-04-19T02:17:42.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.715 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:42.715 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.128401+0000", 2024-04-19T02:17:42.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5975000000000004e-05 2024-04-19T02:17:42.715 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.715 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:42.715 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.715 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168387 5.f 5:ff36d1d9:::benchmark_data_smithi121_44835_object34352:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:42.715 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:42.715 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.594182046, 2024-04-19T02:17:42.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049975358999999997, 2024-04-19T02:17:42.715 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:42.715 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:42.715 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:42.715 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:42.716 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:42.716 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168387 2024-04-19T02:17:42.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.716 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:42.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.716 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:42.716 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:42.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.716 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:42.716 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:42.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.716 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:42.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:42.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:42.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:42.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069671+0000", 2024-04-19T02:17:42.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1739999999999999e-06 2024-04-19T02:17:42.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:42.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069677+0000", 2024-04-19T02:17:42.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4519999999999996e-06 2024-04-19T02:17:42.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:42.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069682+0000", 2024-04-19T02:17:42.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5400000000000003e-06 2024-04-19T02:17:42.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:42.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072634+0000", 2024-04-19T02:17:42.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0029521510000000001 2024-04-19T02:17:42.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:42.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072706+0000", 2024-04-19T02:17:42.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1996999999999995e-05 2024-04-19T02:17:42.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:42.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072772+0000", 2024-04-19T02:17:42.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5380000000000001e-05 2024-04-19T02:17:42.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:42.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117549+0000", 2024-04-19T02:17:42.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044777124000000001 2024-04-19T02:17:42.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:42.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119572+0000", 2024-04-19T02:17:42.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002022893 2024-04-19T02:17:42.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.720 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:42.720 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119613+0000", 2024-04-19T02:17:42.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0849999999999997e-05 2024-04-19T02:17:42.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.720 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:42.720 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119645+0000", 2024-04-19T02:17:42.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2113000000000002e-05 2024-04-19T02:17:42.720 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.720 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:42.720 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.721 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168389 5.2 5:4bcb87b1:::benchmark_data_smithi121_44835_object34354:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:42.721 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.071719+0000", 2024-04-19T02:17:42.721 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.59213295, 2024-04-19T02:17:42.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.048248604, 2024-04-19T02:17:42.721 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:42.721 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:42.721 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:42.721 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:42.721 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:42.721 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168389 2024-04-19T02:17:42.721 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.721 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:42.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.721 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:42.721 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071719+0000", 2024-04-19T02:17:42.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:42.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071719+0000", 2024-04-19T02:17:42.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:42.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071718+0000", 2024-04-19T02:17:42.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:42.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:42.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071722+0000", 2024-04-19T02:17:42.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8590000000000004e-06 2024-04-19T02:17:42.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:42.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071730+0000", 2024-04-19T02:17:42.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8569999999999995e-06 2024-04-19T02:17:42.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:42.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071736+0000", 2024-04-19T02:17:42.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.127e-06 2024-04-19T02:17:42.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:42.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071769+0000", 2024-04-19T02:17:42.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3052000000000001e-05 2024-04-19T02:17:42.724 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.724 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.724 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:42.724 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071843+0000", 2024-04-19T02:17:42.724 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3683000000000006e-05 2024-04-19T02:17:42.724 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.724 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.724 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:42.724 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119852+0000", 2024-04-19T02:17:42.724 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.048009353999999997 2024-04-19T02:17:42.724 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.724 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.724 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:42.724 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119896+0000", 2024-04-19T02:17:42.725 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3102000000000002e-05 2024-04-19T02:17:42.725 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.725 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.725 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:42.725 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119967+0000", 2024-04-19T02:17:42.725 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1589999999999997e-05 2024-04-19T02:17:42.725 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.725 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:42.725 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.725 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.725 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.725 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168391 5.3 5:c5d9b5e1:::benchmark_data_smithi121_44835_object34356:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:42.725 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.074402+0000", 2024-04-19T02:17:42.725 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.589449111, 2024-04-19T02:17:42.725 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.045426756999999998, 2024-04-19T02:17:42.725 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:42.726 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:42.726 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:42.726 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:42.726 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:42.726 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168391 2024-04-19T02:17:42.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.726 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:42.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.726 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:42.726 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074402+0000", 2024-04-19T02:17:42.726 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.727 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:42.727 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074402+0000", 2024-04-19T02:17:42.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.727 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:42.727 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074401+0000", 2024-04-19T02:17:42.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:42.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.728 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:42.728 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074406+0000", 2024-04-19T02:17:42.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5879999999999999e-06 2024-04-19T02:17:42.728 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.728 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.728 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:42.728 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074414+0000", 2024-04-19T02:17:42.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8599999999999993e-06 2024-04-19T02:17:42.728 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:42.729 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074420+0000", 2024-04-19T02:17:42.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6350000000000003e-06 2024-04-19T02:17:42.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:42.729 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074453+0000", 2024-04-19T02:17:42.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3874000000000001e-05 2024-04-19T02:17:42.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.730 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:42.730 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074531+0000", 2024-04-19T02:17:42.730 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7999999999999999e-05 2024-04-19T02:17:42.730 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.730 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.730 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:42.731 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119717+0000", 2024-04-19T02:17:42.731 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.045185395000000003 2024-04-19T02:17:42.731 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.731 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.731 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:42.731 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119756+0000", 2024-04-19T02:17:42.731 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9110000000000003e-05 2024-04-19T02:17:42.732 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.732 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.732 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:42.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119829+0000", 2024-04-19T02:17:42.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3238000000000006e-05 2024-04-19T02:17:42.732 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.733 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:42.733 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.733 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.733 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4549.0:168377 5.d e52/16 ondisk, result = 0)", 2024-04-19T02:17:42.734 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.077260+0000", 2024-04-19T02:17:42.734 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.586591370000001, 2024-04-19T02:17:42.734 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042613204000000002, 2024-04-19T02:17:42.734 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:42.734 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:42.734 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:42.735 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.735 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:42.735 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.077260+0000", 2024-04-19T02:17:42.735 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.735 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.735 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.735 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:42.736 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.077260+0000", 2024-04-19T02:17:42.736 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.736 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.736 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.736 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:42.736 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.077259+0000", 2024-04-19T02:17:42.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:42.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.737 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.737 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:42.737 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.077267+0000", 2024-04-19T02:17:42.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6799999999999993e-06 2024-04-19T02:17:42.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.738 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:42.738 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117372+0000", 2024-04-19T02:17:42.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040105342000000002 2024-04-19T02:17:42.738 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.739 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:42.739 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117389+0000", 2024-04-19T02:17:42.739 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6711e-05 2024-04-19T02:17:42.739 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.739 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.739 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:42.740 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119862+0000", 2024-04-19T02:17:42.740 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0024730580000000002 2024-04-19T02:17:42.740 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.740 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.740 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:42.740 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119867+0000", 2024-04-19T02:17:42.740 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1590000000000001e-06 2024-04-19T02:17:42.740 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.741 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:42.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119873+0000", 2024-04-19T02:17:42.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1410000000000002e-06 2024-04-19T02:17:42.741 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.741 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:42.741 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.742 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.742 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.742 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241615 5.d 5:bc2762a9:::benchmark_data_smithi121_44835_object107580:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:42.742 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.288268+0000", 2024-04-19T02:17:42.742 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.375583507, 2024-04-19T02:17:42.742 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.068304498000000005, 2024-04-19T02:17:42.743 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:42.743 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:42.743 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:42.743 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:42.743 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:42.743 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241615 2024-04-19T02:17:42.744 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.744 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:42.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:42.744 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.288268+0000", 2024-04-19T02:17:42.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.744 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.745 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:42.745 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.288268+0000", 2024-04-19T02:17:42.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.746 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:42.746 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.288267+0000", 2024-04-19T02:17:42.746 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:42.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.746 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:42.747 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.288273+0000", 2024-04-19T02:17:42.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.823e-06 2024-04-19T02:17:42.747 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.747 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:42.747 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.288288+0000", 2024-04-19T02:17:42.748 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5307000000000001e-05 2024-04-19T02:17:42.748 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.748 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.748 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:42.748 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.288296+0000", 2024-04-19T02:17:42.748 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5689999999999999e-06 2024-04-19T02:17:42.749 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.749 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:42.749 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290508+0000", 2024-04-19T02:17:42.749 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022125589999999998 2024-04-19T02:17:42.749 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.750 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:42.750 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290661+0000", 2024-04-19T02:17:42.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015289500000000001 2024-04-19T02:17:42.750 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.751 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:42.751 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290781+0000", 2024-04-19T02:17:42.751 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000119411 2024-04-19T02:17:42.751 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.752 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:42.752 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297532+0000", 2024-04-19T02:17:42.752 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0067517819999999996 2024-04-19T02:17:42.752 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.752 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.752 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:42.753 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.356516+0000", 2024-04-19T02:17:42.753 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058983233000000003 2024-04-19T02:17:42.753 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.753 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.753 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:42.753 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.356547+0000", 2024-04-19T02:17:42.754 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1063999999999999e-05 2024-04-19T02:17:42.754 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.754 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.754 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:42.754 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.356572+0000", 2024-04-19T02:17:42.754 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5795999999999998e-05 2024-04-19T02:17:42.755 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.755 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:42.755 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.755 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.755 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241622 5.d 5:ba16b775:::benchmark_data_smithi121_44835_object107587:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:42.756 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.290616+0000", 2024-04-19T02:17:42.756 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.3732350350000004, 2024-04-19T02:17:42.756 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.070971960000000001, 2024-04-19T02:17:42.756 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:42.756 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:42.756 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:42.757 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:42.757 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:42.757 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241622 2024-04-19T02:17:42.757 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.757 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:42.757 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.758 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:42.758 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290616+0000", 2024-04-19T02:17:42.758 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.758 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.758 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.758 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:42.759 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290616+0000", 2024-04-19T02:17:42.759 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.759 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.759 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.759 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:42.759 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290616+0000", 2024-04-19T02:17:42.760 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:42.760 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.760 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.760 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:42.760 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290619+0000", 2024-04-19T02:17:42.760 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8169999999999999e-06 2024-04-19T02:17:42.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.761 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.761 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:42.761 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290625+0000", 2024-04-19T02:17:42.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3759999999999996e-06 2024-04-19T02:17:42.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.762 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:42.762 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290630+0000", 2024-04-19T02:17:42.762 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2179999999999998e-06 2024-04-19T02:17:42.762 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.763 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.763 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:42.763 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.292551+0000", 2024-04-19T02:17:42.763 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001920185 2024-04-19T02:17:42.763 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.763 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.764 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:42.764 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.292680+0000", 2024-04-19T02:17:42.764 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012971700000000001 2024-04-19T02:17:42.764 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.764 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.764 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:42.765 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.292794+0000", 2024-04-19T02:17:42.765 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000114095 2024-04-19T02:17:42.765 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.765 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.765 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:42.765 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297538+0000", 2024-04-19T02:17:42.766 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00474341 2024-04-19T02:17:42.766 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.766 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:42.766 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361516+0000", 2024-04-19T02:17:42.766 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.063978249000000001 2024-04-19T02:17:42.767 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.767 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:42.767 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361550+0000", 2024-04-19T02:17:42.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4069999999999997e-05 2024-04-19T02:17:42.767 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.768 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.768 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:42.768 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361588+0000", 2024-04-19T02:17:42.768 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8349999999999997e-05 2024-04-19T02:17:42.768 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.768 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:42.769 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.769 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241636 5.d 5:bcce6ec3:::benchmark_data_smithi121_44835_object107601:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:42.769 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.295801+0000", 2024-04-19T02:17:42.769 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.368050309, 2024-04-19T02:17:42.770 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.065904313000000006, 2024-04-19T02:17:42.770 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:42.770 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:42.770 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:42.770 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:42.770 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:42.771 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241636 2024-04-19T02:17:42.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.771 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:42.771 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.771 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:42.771 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295801+0000", 2024-04-19T02:17:42.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.772 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.772 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:42.772 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295801+0000", 2024-04-19T02:17:42.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:42.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295800+0000", 2024-04-19T02:17:42.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:42.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:42.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295806+0000", 2024-04-19T02:17:42.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5230000000000003e-06 2024-04-19T02:17:42.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:42.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295816+0000", 2024-04-19T02:17:42.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.079e-05 2024-04-19T02:17:42.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:42.776 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295825+0000", 2024-04-19T02:17:42.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4999999999999999e-06 2024-04-19T02:17:42.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.776 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:42.776 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.296001+0000", 2024-04-19T02:17:42.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017568600000000001 2024-04-19T02:17:42.777 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.777 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.777 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:42.777 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.296093+0000", 2024-04-19T02:17:42.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2237999999999993e-05 2024-04-19T02:17:42.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:42.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.296155+0000", 2024-04-19T02:17:42.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2281999999999998e-05 2024-04-19T02:17:42.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:42.779 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.299187+0000", 2024-04-19T02:17:42.779 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003031906 2024-04-19T02:17:42.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.780 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:42.780 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361624+0000", 2024-04-19T02:17:42.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.062437318999999998 2024-04-19T02:17:42.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.780 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:42.781 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361669+0000", 2024-04-19T02:17:42.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4197999999999999e-05 2024-04-19T02:17:42.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.781 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:42.781 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361705+0000", 2024-04-19T02:17:42.782 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6980999999999997e-05 2024-04-19T02:17:42.782 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.782 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:42.782 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.782 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.783 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.783 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241637 5.9 5:920672c8:::benchmark_data_smithi121_44835_object107602:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:42.783 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.295834+0000", 2024-04-19T02:17:42.783 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.3680171830000001, 2024-04-19T02:17:42.783 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.064579527999999997, 2024-04-19T02:17:42.783 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:42.784 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:42.784 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:42.784 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:42.784 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:42.784 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241637 2024-04-19T02:17:42.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.785 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:42.785 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.785 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:42.785 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295834+0000", 2024-04-19T02:17:42.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.785 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.786 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:42.786 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295834+0000", 2024-04-19T02:17:42.786 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:42.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295834+0000", 2024-04-19T02:17:42.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:42.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:42.788 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295836+0000", 2024-04-19T02:17:42.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4389999999999999e-06 2024-04-19T02:17:42.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.788 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:42.788 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295843+0000", 2024-04-19T02:17:42.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1759999999999998e-06 2024-04-19T02:17:42.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:42.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295847+0000", 2024-04-19T02:17:42.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7949999999999998e-06 2024-04-19T02:17:42.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.790 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:42.790 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295899+0000", 2024-04-19T02:17:42.790 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1579999999999997e-05 2024-04-19T02:17:42.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.791 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.791 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:42.791 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.296009+0000", 2024-04-19T02:17:42.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000110006 2024-04-19T02:17:42.791 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.791 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.792 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:42.792 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.296109+0000", 2024-04-19T02:17:42.792 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100035 2024-04-19T02:17:42.792 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.792 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.792 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:42.793 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.299700+0000", 2024-04-19T02:17:42.793 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035907999999999999 2024-04-19T02:17:42.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.793 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.793 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:42.793 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.360358+0000", 2024-04-19T02:17:42.794 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060657889 2024-04-19T02:17:42.794 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.794 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.794 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:42.794 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.360387+0000", 2024-04-19T02:17:42.794 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9492000000000002e-05 2024-04-19T02:17:42.795 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.795 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.795 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:42.795 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.360414+0000", 2024-04-19T02:17:42.795 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6631999999999998e-05 2024-04-19T02:17:42.795 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.796 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:42.796 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.796 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.796 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.796 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241638 5.d 5:b857cbeb:::benchmark_data_smithi121_44835_object107603:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:42.796 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.297779+0000", 2024-04-19T02:17:42.796 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.3660721110000003, 2024-04-19T02:17:42.796 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.064037317999999996, 2024-04-19T02:17:42.797 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:42.797 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:42.797 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:42.797 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:42.797 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:42.797 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241638 2024-04-19T02:17:42.797 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.797 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:42.797 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.797 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:42.797 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297779+0000", 2024-04-19T02:17:42.797 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.797 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.797 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.797 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:42.798 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297779+0000", 2024-04-19T02:17:42.798 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.798 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.798 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.798 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:42.798 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297779+0000", 2024-04-19T02:17:42.798 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:42.798 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.798 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.798 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:42.798 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297784+0000", 2024-04-19T02:17:42.798 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3460000000000001e-06 2024-04-19T02:17:42.798 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.798 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.798 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:42.799 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297792+0000", 2024-04-19T02:17:42.799 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0949999999999996e-06 2024-04-19T02:17:42.799 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.799 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.799 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:42.799 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297799+0000", 2024-04-19T02:17:42.799 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0360000000000001e-06 2024-04-19T02:17:42.799 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.799 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.799 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:42.799 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297823+0000", 2024-04-19T02:17:42.799 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3595e-05 2024-04-19T02:17:42.799 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.799 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.799 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:42.800 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297893+0000", 2024-04-19T02:17:42.800 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0343000000000001e-05 2024-04-19T02:17:42.800 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.800 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.800 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:42.800 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297965+0000", 2024-04-19T02:17:42.800 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2253000000000001e-05 2024-04-19T02:17:42.800 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.800 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.800 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:42.800 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.300115+0000", 2024-04-19T02:17:42.800 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021493319999999999 2024-04-19T02:17:42.800 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.800 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.801 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:42.801 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361742+0000", 2024-04-19T02:17:42.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061627511000000003 2024-04-19T02:17:42.801 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.801 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:42.801 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361780+0000", 2024-04-19T02:17:42.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7759000000000002e-05 2024-04-19T02:17:42.801 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.801 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:42.801 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361817+0000", 2024-04-19T02:17:42.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6804999999999997e-05 2024-04-19T02:17:42.801 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.801 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:42.801 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.802 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.802 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.802 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241644 5.9 5:993dd037:::benchmark_data_smithi121_44835_object107609:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:42.802 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.298160+0000", 2024-04-19T02:17:42.802 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.3656911019999995, 2024-04-19T02:17:42.802 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.062615216000000001, 2024-04-19T02:17:42.802 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:42.802 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:42.802 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:42.802 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:42.802 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:42.802 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241644 2024-04-19T02:17:42.802 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.802 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:42.802 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.803 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:42.803 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298160+0000", 2024-04-19T02:17:42.803 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.803 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.803 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.803 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:42.803 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298160+0000", 2024-04-19T02:17:42.803 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.803 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.803 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.803 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:42.803 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298160+0000", 2024-04-19T02:17:42.803 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:42.803 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.804 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.804 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:42.804 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298162+0000", 2024-04-19T02:17:42.804 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8360000000000001e-06 2024-04-19T02:17:42.804 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.804 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.804 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:42.804 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298167+0000", 2024-04-19T02:17:42.804 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1710000000000001e-06 2024-04-19T02:17:42.804 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.805 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.805 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:42.805 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298170+0000", 2024-04-19T02:17:42.805 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0740000000000001e-06 2024-04-19T02:17:42.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.805 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.805 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:42.805 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298202+0000", 2024-04-19T02:17:42.805 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2163999999999999e-05 2024-04-19T02:17:42.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.805 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.805 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:42.805 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298281+0000", 2024-04-19T02:17:42.805 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8318000000000005e-05 2024-04-19T02:17:42.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.806 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:42.806 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298344+0000", 2024-04-19T02:17:42.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2909000000000004e-05 2024-04-19T02:17:42.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.806 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:42.806 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.301043+0000", 2024-04-19T02:17:42.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026998159999999998 2024-04-19T02:17:42.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.806 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:42.806 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.360725+0000", 2024-04-19T02:17:42.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059681627000000001 2024-04-19T02:17:42.807 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.807 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.807 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:42.807 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.360753+0000", 2024-04-19T02:17:42.807 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8198999999999999e-05 2024-04-19T02:17:42.807 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.807 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.807 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:42.807 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.360776+0000", 2024-04-19T02:17:42.807 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2388e-05 2024-04-19T02:17:42.807 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.807 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:42.807 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.807 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.807 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.807 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241645 5.9 5:935d75f3:::benchmark_data_smithi121_44835_object107610:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:42.808 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.298176+0000", 2024-04-19T02:17:42.808 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.3656759369999998, 2024-04-19T02:17:42.808 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.067784611999999994, 2024-04-19T02:17:42.808 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:42.808 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:42.808 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:42.808 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:42.808 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:42.808 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241645 2024-04-19T02:17:42.808 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.808 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:42.808 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.808 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:42.808 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298176+0000", 2024-04-19T02:17:42.809 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.809 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.809 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.809 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:42.809 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298176+0000", 2024-04-19T02:17:42.809 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.809 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.809 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.809 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:42.809 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298175+0000", 2024-04-19T02:17:42.809 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:42.809 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.809 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.809 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:42.809 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298177+0000", 2024-04-19T02:17:42.810 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9709999999999998e-06 2024-04-19T02:17:42.810 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.810 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.810 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:42.810 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298183+0000", 2024-04-19T02:17:42.810 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4700000000000001e-06 2024-04-19T02:17:42.810 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.810 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.810 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:42.811 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298187+0000", 2024-04-19T02:17:42.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7249999999999997e-06 2024-04-19T02:17:42.811 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.811 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:42.811 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.299715+0000", 2024-04-19T02:17:42.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001527657 2024-04-19T02:17:42.811 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.812 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.812 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:42.812 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.299790+0000", 2024-04-19T02:17:42.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4789999999999994e-05 2024-04-19T02:17:42.812 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.812 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.812 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:42.813 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.299853+0000", 2024-04-19T02:17:42.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2905999999999997e-05 2024-04-19T02:17:42.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:42.813 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.301553+0000", 2024-04-19T02:17:42.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017001609999999999 2024-04-19T02:17:42.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:42.813 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.365904+0000", 2024-04-19T02:17:42.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.064351028000000005 2024-04-19T02:17:42.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.814 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.814 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:42.814 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.365931+0000", 2024-04-19T02:17:42.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6809e-05 2024-04-19T02:17:42.814 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.814 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.814 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:42.814 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.365960+0000", 2024-04-19T02:17:42.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9391e-05 2024-04-19T02:17:42.814 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.814 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:42.814 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.814 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.814 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.815 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241652 5.d 5:bbf7ddbb:::benchmark_data_smithi121_44835_object107617:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:42.815 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.309592+0000", 2024-04-19T02:17:42.815 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.3542597189999999, 2024-04-19T02:17:42.815 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.054120610999999999, 2024-04-19T02:17:42.815 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:42.815 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:42.815 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:42.815 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:42.815 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:42.815 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241652 2024-04-19T02:17:42.815 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.815 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:42.815 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.815 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:42.815 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309592+0000", 2024-04-19T02:17:42.815 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:42.816 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309592+0000", 2024-04-19T02:17:42.816 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:42.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:42.816 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309591+0000", 2024-04-19T02:17:42.816 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:42.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:42.816 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309595+0000", 2024-04-19T02:17:42.816 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6009999999999999e-06 2024-04-19T02:17:42.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.817 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:42.817 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309603+0000", 2024-04-19T02:17:42.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9319999999999996e-06 2024-04-19T02:17:42.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.817 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:42.817 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309608+0000", 2024-04-19T02:17:42.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7809999999999996e-06 2024-04-19T02:17:42.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.817 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:42.817 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309635+0000", 2024-04-19T02:17:42.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7376e-05 2024-04-19T02:17:42.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:42.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309709+0000", 2024-04-19T02:17:42.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4318000000000002e-05 2024-04-19T02:17:42.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:42.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309774+0000", 2024-04-19T02:17:42.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5173999999999996e-05 2024-04-19T02:17:42.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:42.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.311459+0000", 2024-04-19T02:17:42.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001684269 2024-04-19T02:17:42.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:42.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.363665+0000", 2024-04-19T02:17:42.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.052205840000000003 2024-04-19T02:17:42.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:42.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.363694+0000", 2024-04-19T02:17:42.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9706999999999999e-05 2024-04-19T02:17:42.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:42.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:42.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:42.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.363712+0000", 2024-04-19T02:17:42.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8144000000000001e-05 2024-04-19T02:17:42.819 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.820 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:42.820 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.820 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:42.820 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:42.820 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:42.821 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:42.821+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:42.822 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:17:42.837 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:17:42.922 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:42.922+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:42.987 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:17:42.995 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:17:42.995 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:17:42.995 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:42.995 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:254441 5.0 5:0fa27e21:::benchmark_data_smithi121_44835_object120406:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T02:17:42.995 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:42.989932+0000", 2024-04-19T02:17:42.996 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0048390539999999998, 2024-04-19T02:17:42.996 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0048693620000000003, 2024-04-19T02:17:42.996 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:42.996 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:42.996 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:42.996 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:42.996 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:42.996 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 254441 2024-04-19T02:17:42.996 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:42.996 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:42.997 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:42.997 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:42.997 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.989932+0000", 2024-04-19T02:17:42.997 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:42.997 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:42.997 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:42.997 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:42.997 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.989932+0000", 2024-04-19T02:17:42.997 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:42.997 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:42.998 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:42.998 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:42.998 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.989932+0000", 2024-04-19T02:17:42.998 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:42.998 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:42.998 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:42.998 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:42.998 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.989934+0000", 2024-04-19T02:17:42.998 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.402e-06 2024-04-19T02:17:42.999 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:42.999 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:42.999 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:42.999 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.989941+0000", 2024-04-19T02:17:42.999 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.9110000000000004e-06 2024-04-19T02:17:42.999 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:42.999 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:42.999 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:42.999 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.989946+0000", 2024-04-19T02:17:42.999 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8060000000000002e-06 2024-04-19T02:17:42.999 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.000 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.000 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:43.000 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.992607+0000", 2024-04-19T02:17:43.000 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.002661503 2024-04-19T02:17:43.000 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.000 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.000 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:43.000 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.992696+0000", 2024-04-19T02:17:43.000 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.8289999999999997e-05 2024-04-19T02:17:43.000 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:43.000 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:43.000 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:43.000 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.000 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.000 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:254444 5.0 5:09120676:::benchmark_data_smithi121_44835_object120409:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T02:17:43.001 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:42.990367+0000", 2024-04-19T02:17:43.001 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0044038649999999999, 2024-04-19T02:17:43.001 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0045108980000000002, 2024-04-19T02:17:43.001 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:43.001 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:43.001 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:43.001 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:43.001 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:43.001 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 254444 2024-04-19T02:17:43.001 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.001 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:43.001 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.001 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:43.001 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.990367+0000", 2024-04-19T02:17:43.001 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:43.002 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.002 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.002 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:43.002 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.990367+0000", 2024-04-19T02:17:43.002 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:43.002 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.002 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.002 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:43.002 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.990367+0000", 2024-04-19T02:17:43.002 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:43.002 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.002 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.002 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:43.002 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.990369+0000", 2024-04-19T02:17:43.002 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1210000000000001e-06 2024-04-19T02:17:43.003 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.003 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.003 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:43.003 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.990375+0000", 2024-04-19T02:17:43.003 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.2079999999999997e-06 2024-04-19T02:17:43.003 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.003 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.003 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:43.003 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.990379+0000", 2024-04-19T02:17:43.003 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8249999999999998e-06 2024-04-19T02:17:43.003 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.003 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.003 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:43.003 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.993797+0000", 2024-04-19T02:17:43.004 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0034173770000000001 2024-04-19T02:17:43.004 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.004 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.004 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:43.004 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.993873+0000", 2024-04-19T02:17:43.004 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.6213999999999999e-05 2024-04-19T02:17:43.004 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:43.004 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:43.004 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:43.004 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.004 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.004 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:254446 5.0 5.421fa530 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T02:17:43.004 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:42.990641+0000", 2024-04-19T02:17:43.004 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0041303779999999997, 2024-04-19T02:17:43.005 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0043027480000000003, 2024-04-19T02:17:43.005 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:43.005 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "queued for pg", 2024-04-19T02:17:43.005 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:43.005 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:43.005 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:43.005 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 254446 2024-04-19T02:17:43.005 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.005 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:43.005 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.005 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:43.005 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.990641+0000", 2024-04-19T02:17:43.005 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:43.005 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.005 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.006 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:43.006 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.990641+0000", 2024-04-19T02:17:43.006 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:43.006 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.006 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.006 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:43.006 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.990640+0000", 2024-04-19T02:17:43.006 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:43.006 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.006 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.006 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:43.006 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.990644+0000", 2024-04-19T02:17:43.006 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.811e-06 2024-04-19T02:17:43.007 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.007 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.007 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:43.007 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.990654+0000", 2024-04-19T02:17:43.007 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.9850000000000001e-06 2024-04-19T02:17:43.007 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.007 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.007 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:43.007 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.990662+0000", 2024-04-19T02:17:43.007 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.5730000000000002e-06 2024-04-19T02:17:43.007 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:43.007 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:43.007 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:43.007 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.008 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.008 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:254451 5.a 5:57375a5e:::benchmark_data_smithi121_44835_object120416:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T02:17:43.008 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:42.992883+0000", 2024-04-19T02:17:43.008 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0018881379999999999, 2024-04-19T02:17:43.008 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0021163750000000002, 2024-04-19T02:17:43.008 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:43.008 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:43.008 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:43.008 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:43.008 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:43.008 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 254451 2024-04-19T02:17:43.008 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.008 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:43.009 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.009 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:43.009 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.992883+0000", 2024-04-19T02:17:43.009 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:43.009 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.009 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.009 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:43.009 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.992883+0000", 2024-04-19T02:17:43.009 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:43.009 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.009 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.009 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:43.009 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.992883+0000", 2024-04-19T02:17:43.009 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:43.010 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.010 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.010 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:43.010 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.992886+0000", 2024-04-19T02:17:43.010 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.777e-06 2024-04-19T02:17:43.010 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.010 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.010 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:43.010 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.992893+0000", 2024-04-19T02:17:43.010 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5100000000000004e-06 2024-04-19T02:17:43.010 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.010 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.010 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:43.011 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.992898+0000", 2024-04-19T02:17:43.011 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.977e-06 2024-04-19T02:17:43.011 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.011 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.011 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:43.011 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.992943+0000", 2024-04-19T02:17:43.011 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.5296999999999997e-05 2024-04-19T02:17:43.011 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.011 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.011 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:43.011 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.993080+0000", 2024-04-19T02:17:43.011 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000136608 2024-04-19T02:17:43.011 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:43.011 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:43.012 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:43.012 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.012 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.012 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:254452 5.1 5:88ce58a7:::benchmark_data_smithi121_44835_object120417:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T02:17:43.012 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:42.992966+0000", 2024-04-19T02:17:43.012 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0018053850000000001, 2024-04-19T02:17:43.012 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0021039219999999998, 2024-04-19T02:17:43.012 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:43.012 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:43.012 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:43.012 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:43.012 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:43.012 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 254452 2024-04-19T02:17:43.012 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.013 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:43.013 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.013 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:43.013 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.992966+0000", 2024-04-19T02:17:43.013 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:43.013 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.013 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.013 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:43.013 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.992966+0000", 2024-04-19T02:17:43.013 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:43.013 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.013 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.013 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:43.014 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.992965+0000", 2024-04-19T02:17:43.014 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:43.014 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.014 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.014 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:43.014 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.992968+0000", 2024-04-19T02:17:43.014 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7020000000000001e-06 2024-04-19T02:17:43.014 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.014 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.014 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:43.014 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.992973+0000", 2024-04-19T02:17:43.014 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4989999999999996e-06 2024-04-19T02:17:43.014 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.015 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.015 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:43.015 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.992976+0000", 2024-04-19T02:17:43.015 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.495e-06 2024-04-19T02:17:43.015 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.015 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.015 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:43.016 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.993003+0000", 2024-04-19T02:17:43.016 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7385e-05 2024-04-19T02:17:43.016 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.016 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.016 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:43.016 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.993091+0000", 2024-04-19T02:17:43.016 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.7770999999999997e-05 2024-04-19T02:17:43.016 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:43.017 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:43.017 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:43.017 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.017 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.017 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:254454 5.e 5:7080b942:::benchmark_data_smithi121_44835_object120419:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T02:17:43.017 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:42.993570+0000", 2024-04-19T02:17:43.017 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0012007910000000001, 2024-04-19T02:17:43.017 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001564981, 2024-04-19T02:17:43.017 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:43.018 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:43.018 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:43.018 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:43.018 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:43.018 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 254454 2024-04-19T02:17:43.018 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.018 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:43.018 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.018 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:43.019 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.993570+0000", 2024-04-19T02:17:43.019 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:43.019 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.019 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.019 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:43.019 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.993570+0000", 2024-04-19T02:17:43.019 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:43.019 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.019 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.019 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:43.019 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.993570+0000", 2024-04-19T02:17:43.019 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:43.019 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.019 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.020 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:43.020 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.993575+0000", 2024-04-19T02:17:43.020 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.6099999999999997e-06 2024-04-19T02:17:43.020 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.020 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.020 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:43.020 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.993587+0000", 2024-04-19T02:17:43.020 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2061e-05 2024-04-19T02:17:43.020 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.020 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.020 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:43.020 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.993595+0000", 2024-04-19T02:17:43.020 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.5630000000000003e-06 2024-04-19T02:17:43.020 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.020 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.021 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:43.021 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.993638+0000", 2024-04-19T02:17:43.021 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3531e-05 2024-04-19T02:17:43.021 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.021 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.021 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:43.021 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.993778+0000", 2024-04-19T02:17:43.021 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000139567 2024-04-19T02:17:43.021 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:43.021 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:43.021 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:43.021 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.021 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.021 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:254456 5.4 5:285ad91f:::benchmark_data_smithi121_44835_object120421:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T02:17:43.021 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:42.994351+0000", 2024-04-19T02:17:43.022 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.00041986600000000002, 2024-04-19T02:17:43.022 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00084974099999999999, 2024-04-19T02:17:43.022 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:43.022 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:43.022 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:43.022 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:43.022 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:43.022 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 254456 2024-04-19T02:17:43.022 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.022 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:43.022 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.022 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:43.022 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.994351+0000", 2024-04-19T02:17:43.022 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:43.023 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.023 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.023 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:43.023 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.994351+0000", 2024-04-19T02:17:43.023 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:43.023 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.023 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.023 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:43.023 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.994351+0000", 2024-04-19T02:17:43.023 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:43.023 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.023 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.023 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:43.023 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.994356+0000", 2024-04-19T02:17:43.023 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.023e-06 2024-04-19T02:17:43.024 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.024 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.024 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:43.024 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.994367+0000", 2024-04-19T02:17:43.024 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1865000000000001e-05 2024-04-19T02:17:43.024 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.024 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.024 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:43.024 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.994375+0000", 2024-04-19T02:17:43.024 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.5939999999999996e-06 2024-04-19T02:17:43.024 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.024 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.024 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:43.024 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.994418+0000", 2024-04-19T02:17:43.025 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2781000000000003e-05 2024-04-19T02:17:43.025 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.025 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.025 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:43.025 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.994545+0000", 2024-04-19T02:17:43.025 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012742600000000001 2024-04-19T02:17:43.025 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:43.025 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:43.025 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:43.025 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.025 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.025 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:254457 5.1 5.1003771 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T02:17:43.025 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:42.995153+0000", 2024-04-19T02:17:43.025 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 4294967295.9996185, 2024-04-19T02:17:43.026 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012018, 2024-04-19T02:17:43.026 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:43.026 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "queued for pg", 2024-04-19T02:17:43.026 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:43.026 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:43.026 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:43.026 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 254457 2024-04-19T02:17:43.026 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.027 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:43.027 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.027 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:43.027 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.995153+0000", 2024-04-19T02:17:43.027 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:43.027 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.027 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.027 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:43.028 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.995153+0000", 2024-04-19T02:17:43.028 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:43.028 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.028 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.028 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:43.028 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.995152+0000", 2024-04-19T02:17:43.028 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:43.028 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.029 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.029 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:43.029 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.995157+0000", 2024-04-19T02:17:43.029 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7139999999999998e-06 2024-04-19T02:17:43.029 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.029 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.029 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:43.029 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.995168+0000", 2024-04-19T02:17:43.029 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0879e-05 2024-04-19T02:17:43.030 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.030 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.030 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:43.030 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.995177+0000", 2024-04-19T02:17:43.030 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.4589999999999998e-06 2024-04-19T02:17:43.030 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:43.030 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:43.030 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:43.030 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.030 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.030 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:254423 5.0 5:00796929:::benchmark_data_smithi121_44835_object120388:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T02:17:43.031 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:42.984542+0000", 2024-04-19T02:17:43.031 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.010228886, 2024-04-19T02:17:43.031 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010791807, 2024-04-19T02:17:43.031 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:43.031 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:43.031 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:43.031 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:43.031 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:43.031 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 254423 2024-04-19T02:17:43.031 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.031 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:43.031 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.031 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:43.031 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.984542+0000", 2024-04-19T02:17:43.032 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:43.032 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.032 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.032 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:43.032 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.984542+0000", 2024-04-19T02:17:43.032 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:43.032 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.032 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.032 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:43.032 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.984541+0000", 2024-04-19T02:17:43.032 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:43.032 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.032 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.032 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:43.032 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.984547+0000", 2024-04-19T02:17:43.033 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.147e-06 2024-04-19T02:17:43.033 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.033 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.033 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:43.033 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.984556+0000", 2024-04-19T02:17:43.033 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.2450000000000004e-06 2024-04-19T02:17:43.033 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.033 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.033 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:43.033 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.984563+0000", 2024-04-19T02:17:43.033 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.9739999999999996e-06 2024-04-19T02:17:43.033 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.033 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.033 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:43.034 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.984604+0000", 2024-04-19T02:17:43.034 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1405000000000001e-05 2024-04-19T02:17:43.034 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.034 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.034 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:43.034 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.984728+0000", 2024-04-19T02:17:43.034 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012383699999999999 2024-04-19T02:17:43.034 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.034 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.035 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:43.035 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.995257+0000", 2024-04-19T02:17:43.035 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010528579999999999 2024-04-19T02:17:43.035 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.035 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.035 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:43.035 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.995314+0000", 2024-04-19T02:17:43.035 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7772999999999997e-05 2024-04-19T02:17:43.036 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:43.036 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:43.036 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:43.036 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.036 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.036 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:254428 5.0 5:05da4f4a:::benchmark_data_smithi121_44835_object120393:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T02:17:43.036 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:42.984908+0000", 2024-04-19T02:17:43.036 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0098633079999999995, 2024-04-19T02:17:43.037 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010522744000000001, 2024-04-19T02:17:43.037 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:43.037 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:43.037 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:43.037 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:43.037 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:43.037 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 254428 2024-04-19T02:17:43.037 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.037 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:43.037 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.037 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:43.037 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.984908+0000", 2024-04-19T02:17:43.037 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:43.038 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.038 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.038 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:43.038 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.984908+0000", 2024-04-19T02:17:43.038 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:43.038 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.038 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.038 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:43.038 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.984907+0000", 2024-04-19T02:17:43.038 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:43.038 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.038 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.038 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:43.038 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.984910+0000", 2024-04-19T02:17:43.038 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0580000000000002e-06 2024-04-19T02:17:43.039 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.039 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.039 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:43.039 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.984919+0000", 2024-04-19T02:17:43.039 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0770000000000008e-06 2024-04-19T02:17:43.039 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.039 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.039 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:43.039 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.984924+0000", 2024-04-19T02:17:43.039 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.8449999999999999e-06 2024-04-19T02:17:43.039 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.039 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.039 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:43.039 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.986855+0000", 2024-04-19T02:17:43.039 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001931056 2024-04-19T02:17:43.039 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.040 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.040 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:43.040 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.986945+0000", 2024-04-19T02:17:43.040 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.9300000000000002e-05 2024-04-19T02:17:43.040 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.040 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.040 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:43.040 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.995428+0000", 2024-04-19T02:17:43.040 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0084829160000000001 2024-04-19T02:17:43.040 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:43.040 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:43.040 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:43.040 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.041 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.041 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:254431 5.0 5:03b97280:::benchmark_data_smithi121_44835_object120396:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T02:17:43.041 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:42.986714+0000", 2024-04-19T02:17:43.041 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0080574700000000006, 2024-04-19T02:17:43.041 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0087959300000000004, 2024-04-19T02:17:43.041 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:43.041 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:43.041 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:43.041 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:43.041 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:43.041 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 254431 2024-04-19T02:17:43.041 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.041 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:43.041 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.041 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:43.041 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.986714+0000", 2024-04-19T02:17:43.042 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:43.042 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.042 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.042 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:43.042 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.986714+0000", 2024-04-19T02:17:43.042 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:43.042 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.042 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.042 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:43.042 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.986713+0000", 2024-04-19T02:17:43.042 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:43.042 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.042 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.042 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:43.042 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.986716+0000", 2024-04-19T02:17:43.043 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4889999999999998e-06 2024-04-19T02:17:43.043 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.043 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.043 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:43.043 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.986721+0000", 2024-04-19T02:17:43.043 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8790000000000002e-06 2024-04-19T02:17:43.043 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.043 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.043 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:43.043 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.986725+0000", 2024-04-19T02:17:43.043 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7409999999999998e-06 2024-04-19T02:17:43.043 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.043 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.043 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:43.044 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.988123+0000", 2024-04-19T02:17:43.044 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001398058 2024-04-19T02:17:43.044 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.044 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.044 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:43.044 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.988247+0000", 2024-04-19T02:17:43.044 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012447700000000001 2024-04-19T02:17:43.044 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:43.044 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:43.044 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:43.044 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.044 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.044 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:254435 5.0 5:0d9bdaba:::benchmark_data_smithi121_44835_object120400:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T02:17:43.044 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:42.987993+0000", 2024-04-19T02:17:43.044 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0067783549999999998, 2024-04-19T02:17:43.045 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.007589976, 2024-04-19T02:17:43.045 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:43.045 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:43.045 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:43.045 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:43.045 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:43.045 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 254435 2024-04-19T02:17:43.045 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.045 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:43.045 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.045 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:43.045 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.987993+0000", 2024-04-19T02:17:43.045 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:43.045 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.046 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.046 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:43.046 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.987993+0000", 2024-04-19T02:17:43.046 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:43.046 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.046 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.046 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:43.046 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.987992+0000", 2024-04-19T02:17:43.046 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:43.046 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.046 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.046 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:43.047 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.987996+0000", 2024-04-19T02:17:43.047 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9720000000000003e-06 2024-04-19T02:17:43.047 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.047 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.047 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:43.047 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.988004+0000", 2024-04-19T02:17:43.047 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0870000000000007e-06 2024-04-19T02:17:43.048 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.048 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.048 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:43.048 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.988009+0000", 2024-04-19T02:17:43.048 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.933e-06 2024-04-19T02:17:43.048 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.048 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.048 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:43.048 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.989427+0000", 2024-04-19T02:17:43.048 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001417859 2024-04-19T02:17:43.048 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.048 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.048 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:43.048 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.989543+0000", 2024-04-19T02:17:43.048 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011614 2024-04-19T02:17:43.049 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:43.049 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:43.049 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:43.049 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.049 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.049 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:254437 5.0 5:0a35c8b3:::benchmark_data_smithi121_44835_object120402:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T02:17:43.049 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:42.989511+0000", 2024-04-19T02:17:43.049 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.00526027, 2024-04-19T02:17:43.049 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0061447369999999999, 2024-04-19T02:17:43.049 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:43.049 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:43.050 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:43.050 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:43.050 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:43.050 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 254437 2024-04-19T02:17:43.050 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.050 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:43.050 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.050 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:43.051 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.989511+0000", 2024-04-19T02:17:43.051 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:43.051 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.051 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.051 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:43.052 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.989511+0000", 2024-04-19T02:17:43.052 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:43.052 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.052 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.053 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:43.053 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.989510+0000", 2024-04-19T02:17:43.053 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:43.053 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.053 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.054 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:43.054 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.989513+0000", 2024-04-19T02:17:43.054 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.6850000000000001e-06 2024-04-19T02:17:43.054 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.055 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.055 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:43.055 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.989519+0000", 2024-04-19T02:17:43.055 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.451e-06 2024-04-19T02:17:43.055 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.055 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.055 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:43.055 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.989523+0000", 2024-04-19T02:17:43.056 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.6779999999999999e-06 2024-04-19T02:17:43.056 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.056 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.056 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:43.056 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.991024+0000", 2024-04-19T02:17:43.056 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001501051 2024-04-19T02:17:43.056 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:43.057 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:43.057 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:43.057 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:42.991165+0000", 2024-04-19T02:17:43.057 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000141089 2024-04-19T02:17:43.057 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:43.057 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:43.057 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:43.057 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:43.058 INFO:teuthology.orchestra.run.smithi174.stdout: ], 2024-04-19T02:17:43.058 INFO:teuthology.orchestra.run.smithi174.stdout: "num_ops": 13 2024-04-19T02:17:43.058 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:17:43.060 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:17:43.060 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:43.059+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:43.061 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:17:43.061 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:17:43.062 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:17:43.062 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:17:43.062 INFO:teuthology.orchestra.run.smithi121.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T02:17:43.062 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:17:43.160 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:43.160+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:43.232 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:43.233 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:43.248 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:17:43.261 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:43.261+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:43.363 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:43.364+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:43.374 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T02:17:43.424 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:43.424 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:43.439 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:43.485 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:43.485+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:43.563 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~35s 2024-04-19T02:17:43.564 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:43.564+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:43.609 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:43.609 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:43.623 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:43.665 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:43.664+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:43.766 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:43.766+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:43.841 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:43.842 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:43.856 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:43.899 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:43.899+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:43.967 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:43.968+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:44.033 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:44.033 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:44.048 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:17:44.094 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:44.092+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:44.170 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:44.170+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:44.224 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:44.224 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:44.238 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:17:44.279 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:44.279+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:44.365 INFO:teuthology.orchestra.run.smithi121.stderr:nodeep-scrub is set 2024-04-19T02:17:44.372 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:44.372+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:44.465 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:44.466 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:44.473 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:44.473+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:44.481 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:17:44.574 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:44.573+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:44.676 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:44.676+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:44.698 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:44.698 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:44.710 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:44.775 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:44.775+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:44.876 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:44.876+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:44.890 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:44.891 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:44.906 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:44.977 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:44.977+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:45.064 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:17:45.080 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:45.078+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:45.080 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:45.081 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:45.094 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:45.178 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:45.178+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:45.212 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:17:45.234 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:17:45.234 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:17:45.234 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:17:45.234 INFO:teuthology.orchestra.run.smithi121.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T02:17:45.235 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:17:45.236 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:17:45.279 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:45.279+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:45.314 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:45.314 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-04-19T02:17:45.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-04-19T02:17:45.314 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:17:45.314 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.315 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168377 5.d 5:b1f3fb6d:::benchmark_data_smithi121_44835_object34342:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:45.315 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069470+0000", 2024-04-19T02:17:45.315 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 33.243584658000003, 2024-04-19T02:17:45.315 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050516473999999999, 2024-04-19T02:17:45.315 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:45.315 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:45.315 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:45.315 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:45.315 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:45.315 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168377 2024-04-19T02:17:45.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.315 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:45.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:45.316 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069470+0000", 2024-04-19T02:17:45.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:45.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.316 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:45.316 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069470+0000", 2024-04-19T02:17:45.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:45.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.316 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:45.316 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069469+0000", 2024-04-19T02:17:45.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:45.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.316 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:45.317 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069473+0000", 2024-04-19T02:17:45.317 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4580000000000002e-06 2024-04-19T02:17:45.317 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.317 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.317 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:45.317 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069482+0000", 2024-04-19T02:17:45.317 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2839999999999995e-06 2024-04-19T02:17:45.317 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.317 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.317 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.317 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069489+0000", 2024-04-19T02:17:45.317 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3579999999999997e-06 2024-04-19T02:17:45.317 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.317 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.318 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:45.318 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069559+0000", 2024-04-19T02:17:45.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9678000000000006e-05 2024-04-19T02:17:45.318 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.318 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.318 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:45.318 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069683+0000", 2024-04-19T02:17:45.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012359400000000001 2024-04-19T02:17:45.318 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.318 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.318 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:45.318 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069759+0000", 2024-04-19T02:17:45.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6834000000000003e-05 2024-04-19T02:17:45.318 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:45.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119871+0000", 2024-04-19T02:17:45.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050111392999999997 2024-04-19T02:17:45.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:45.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119932+0000", 2024-04-19T02:17:45.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1209000000000003e-05 2024-04-19T02:17:45.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:45.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119962+0000", 2024-04-19T02:17:45.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9717999999999999e-05 2024-04-19T02:17:45.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:45.320 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119986+0000", 2024-04-19T02:17:45.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4549000000000002e-05 2024-04-19T02:17:45.320 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:45.320 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:45.320 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:45.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.320 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168379 5.d 5:bcd492dd:::benchmark_data_smithi121_44835_object34344:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:45.320 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069502+0000", 2024-04-19T02:17:45.320 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 33.243552604999998, 2024-04-19T02:17:45.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050544645999999999, 2024-04-19T02:17:45.320 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:45.320 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:45.321 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:45.321 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:45.321 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:45.321 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168379 2024-04-19T02:17:45.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.321 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:45.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:45.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069502+0000", 2024-04-19T02:17:45.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:45.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:45.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069502+0000", 2024-04-19T02:17:45.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:45.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.322 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:45.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069501+0000", 2024-04-19T02:17:45.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:45.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.322 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:45.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069504+0000", 2024-04-19T02:17:45.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9289999999999998e-06 2024-04-19T02:17:45.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.322 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:45.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069511+0000", 2024-04-19T02:17:45.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1909999999999997e-06 2024-04-19T02:17:45.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.323 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069517+0000", 2024-04-19T02:17:45.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0789999999999997e-06 2024-04-19T02:17:45.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:45.323 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071081+0000", 2024-04-19T02:17:45.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0015646550000000001 2024-04-19T02:17:45.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:45.323 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071195+0000", 2024-04-19T02:17:45.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011399400000000001 2024-04-19T02:17:45.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:45.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071293+0000", 2024-04-19T02:17:45.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7938999999999999e-05 2024-04-19T02:17:45.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:45.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119898+0000", 2024-04-19T02:17:45.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.048604808999999999 2024-04-19T02:17:45.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:45.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119993+0000", 2024-04-19T02:17:45.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5224999999999997e-05 2024-04-19T02:17:45.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:45.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120024+0000", 2024-04-19T02:17:45.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0580999999999997e-05 2024-04-19T02:17:45.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:45.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120047+0000", 2024-04-19T02:17:45.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2725e-05 2024-04-19T02:17:45.325 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:45.325 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:45.325 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:45.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.326 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168381 5.d 5:bcbab0e3:::benchmark_data_smithi121_44835_object34346:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:45.326 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:45.326 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 33.243533186999997, 2024-04-19T02:17:45.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050574694000000003, 2024-04-19T02:17:45.326 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:45.326 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:45.326 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:45.326 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:45.326 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:45.326 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168381 2024-04-19T02:17:45.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.326 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:45.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.326 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:45.327 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:45.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:45.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.327 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:45.327 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:45.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:45.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.327 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:45.327 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:45.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:45.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:45.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069523+0000", 2024-04-19T02:17:45.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.244e-06 2024-04-19T02:17:45.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:45.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069528+0000", 2024-04-19T02:17:45.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0669999999999999e-06 2024-04-19T02:17:45.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069533+0000", 2024-04-19T02:17:45.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4680000000000003e-06 2024-04-19T02:17:45.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:45.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072637+0000", 2024-04-19T02:17:45.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031040429999999999 2024-04-19T02:17:45.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:45.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072710+0000", 2024-04-19T02:17:45.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3045000000000003e-05 2024-04-19T02:17:45.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:45.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072775+0000", 2024-04-19T02:17:45.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5034000000000001e-05 2024-04-19T02:17:45.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:45.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119925+0000", 2024-04-19T02:17:45.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.047150594999999997 2024-04-19T02:17:45.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:45.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120055+0000", 2024-04-19T02:17:45.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129288 2024-04-19T02:17:45.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:45.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120077+0000", 2024-04-19T02:17:45.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1759e-05 2024-04-19T02:17:45.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.331 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:45.331 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120096+0000", 2024-04-19T02:17:45.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9524000000000001e-05 2024-04-19T02:17:45.331 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:45.331 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:45.331 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:45.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.331 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168382 5.f 5:f2599a15:::benchmark_data_smithi121_44835_object34347:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:45.331 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069556+0000", 2024-04-19T02:17:45.331 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 33.243498780000003, 2024-04-19T02:17:45.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050009713999999997, 2024-04-19T02:17:45.331 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:45.332 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:45.332 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:45.332 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:45.332 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:45.332 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168382 2024-04-19T02:17:45.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.332 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:45.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.332 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:45.332 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069556+0000", 2024-04-19T02:17:45.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:45.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.332 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:45.332 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069556+0000", 2024-04-19T02:17:45.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:45.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:45.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069555+0000", 2024-04-19T02:17:45.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:45.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:45.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069558+0000", 2024-04-19T02:17:45.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7879999999999998e-06 2024-04-19T02:17:45.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:45.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069566+0000", 2024-04-19T02:17:45.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6149999999999999e-06 2024-04-19T02:17:45.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069571+0000", 2024-04-19T02:17:45.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5509999999999999e-06 2024-04-19T02:17:45.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:45.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069618+0000", 2024-04-19T02:17:45.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6964e-05 2024-04-19T02:17:45.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:45.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069744+0000", 2024-04-19T02:17:45.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012577199999999999 2024-04-19T02:17:45.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.335 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:45.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.070116+0000", 2024-04-19T02:17:45.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000372407 2024-04-19T02:17:45.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.335 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:45.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117511+0000", 2024-04-19T02:17:45.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.047394935999999999 2024-04-19T02:17:45.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.335 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:45.336 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119484+0000", 2024-04-19T02:17:45.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019722310000000001 2024-04-19T02:17:45.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.336 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.336 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:45.336 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119525+0000", 2024-04-19T02:17:45.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1035999999999998e-05 2024-04-19T02:17:45.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.336 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.336 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:45.336 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119565+0000", 2024-04-19T02:17:45.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0859000000000003e-05 2024-04-19T02:17:45.336 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:45.336 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:45.336 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:45.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.337 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.337 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168383 5.d 5:bbd9496c:::benchmark_data_smithi121_44835_object34348:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:45.337 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069581+0000", 2024-04-19T02:17:45.337 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 33.243473891999997, 2024-04-19T02:17:45.337 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050607278999999998, 2024-04-19T02:17:45.337 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:45.337 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:45.337 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:45.337 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:45.337 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:45.337 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168383 2024-04-19T02:17:45.337 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.337 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:45.337 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.337 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:45.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069581+0000", 2024-04-19T02:17:45.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:45.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:45.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069581+0000", 2024-04-19T02:17:45.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:45.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:45.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069580+0000", 2024-04-19T02:17:45.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:45.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:45.339 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069589+0000", 2024-04-19T02:17:45.339 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6750000000000008e-06 2024-04-19T02:17:45.339 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.339 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.339 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:45.339 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069596+0000", 2024-04-19T02:17:45.339 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7360000000000004e-06 2024-04-19T02:17:45.339 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.339 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.339 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.339 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069601+0000", 2024-04-19T02:17:45.339 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0479999999999998e-06 2024-04-19T02:17:45.339 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.339 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.339 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:45.340 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.073854+0000", 2024-04-19T02:17:45.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042531920000000003 2024-04-19T02:17:45.340 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.340 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:45.340 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.073952+0000", 2024-04-19T02:17:45.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7851999999999998e-05 2024-04-19T02:17:45.340 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.340 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:45.340 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074012+0000", 2024-04-19T02:17:45.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0225e-05 2024-04-19T02:17:45.340 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.340 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:45.341 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120102+0000", 2024-04-19T02:17:45.341 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.046090150000000003 2024-04-19T02:17:45.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.341 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.341 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:45.341 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120129+0000", 2024-04-19T02:17:45.341 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7228000000000001e-05 2024-04-19T02:17:45.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.341 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.341 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:45.341 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120157+0000", 2024-04-19T02:17:45.341 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7165000000000002e-05 2024-04-19T02:17:45.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.341 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.341 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:45.342 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120188+0000", 2024-04-19T02:17:45.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1418000000000003e-05 2024-04-19T02:17:45.342 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:45.342 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:45.342 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:45.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.342 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168384 5.7 5:ed638f84:::benchmark_data_smithi121_44835_object34349:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:45.342 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069612+0000", 2024-04-19T02:17:45.343 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 33.243442838999997, 2024-04-19T02:17:45.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049863376000000001, 2024-04-19T02:17:45.343 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:45.343 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:45.343 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:45.343 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:45.343 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:45.343 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168384 2024-04-19T02:17:45.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.343 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:45.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:45.343 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069612+0000", 2024-04-19T02:17:45.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:45.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:45.344 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069612+0000", 2024-04-19T02:17:45.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:45.344 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:45.344 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069611+0000", 2024-04-19T02:17:45.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:45.344 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:45.344 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069614+0000", 2024-04-19T02:17:45.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7819999999999998e-06 2024-04-19T02:17:45.344 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.345 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:45.345 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069623+0000", 2024-04-19T02:17:45.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6989999999999992e-06 2024-04-19T02:17:45.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.345 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.345 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069628+0000", 2024-04-19T02:17:45.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4999999999999999e-06 2024-04-19T02:17:45.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.345 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:45.345 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069662+0000", 2024-04-19T02:17:45.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3319999999999999e-05 2024-04-19T02:17:45.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.346 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:45.346 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069782+0000", 2024-04-19T02:17:45.346 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120547 2024-04-19T02:17:45.346 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.346 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:45.346 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119338+0000", 2024-04-19T02:17:45.346 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049556141999999997 2024-04-19T02:17:45.346 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.346 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:45.346 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119388+0000", 2024-04-19T02:17:45.346 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9866e-05 2024-04-19T02:17:45.346 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.347 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:45.347 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119475+0000", 2024-04-19T02:17:45.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6929999999999996e-05 2024-04-19T02:17:45.347 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:45.347 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:45.347 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:45.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.347 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168385 5.d 5:b22d7e69:::benchmark_data_smithi121_44835_object34350:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:45.347 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:45.347 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 33.243419400000001, 2024-04-19T02:17:45.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.055438508999999997, 2024-04-19T02:17:45.347 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:45.348 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:45.348 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:45.348 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:45.348 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:45.348 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168385 2024-04-19T02:17:45.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.348 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:45.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.348 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:45.348 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:45.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:45.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.348 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:45.348 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:45.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:45.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:45.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:45.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:45.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:45.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069637+0000", 2024-04-19T02:17:45.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.576e-06 2024-04-19T02:17:45.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:45.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069643+0000", 2024-04-19T02:17:45.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8030000000000002e-06 2024-04-19T02:17:45.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069648+0000", 2024-04-19T02:17:45.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0889999999999999e-06 2024-04-19T02:17:45.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:45.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117534+0000", 2024-04-19T02:17:45.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.047886390000000001 2024-04-19T02:17:45.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:45.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117670+0000", 2024-04-19T02:17:45.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000135969 2024-04-19T02:17:45.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:45.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117803+0000", 2024-04-19T02:17:45.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000132955 2024-04-19T02:17:45.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:45.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120501+0000", 2024-04-19T02:17:45.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026978050000000002 2024-04-19T02:17:45.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.352 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:45.352 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.125026+0000", 2024-04-19T02:17:45.352 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045244589999999998 2024-04-19T02:17:45.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.352 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:45.352 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.125049+0000", 2024-04-19T02:17:45.352 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3807000000000001e-05 2024-04-19T02:17:45.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.352 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:45.352 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.125074+0000", 2024-04-19T02:17:45.352 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4175000000000001e-05 2024-04-19T02:17:45.353 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:45.353 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:45.353 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:45.353 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.353 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.353 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168386 5.5 5:a2cda182:::benchmark_data_smithi121_44835_object34351:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:45.353 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069653+0000", 2024-04-19T02:17:45.353 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 33.243401933000001, 2024-04-19T02:17:45.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058748884000000001, 2024-04-19T02:17:45.353 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:45.353 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:45.353 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:45.353 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:45.353 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:45.353 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168386 2024-04-19T02:17:45.354 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.354 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:45.354 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.354 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:45.354 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069653+0000", 2024-04-19T02:17:45.354 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:45.354 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.354 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.354 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:45.354 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069653+0000", 2024-04-19T02:17:45.354 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:45.354 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:45.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069652+0000", 2024-04-19T02:17:45.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:45.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:45.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069654+0000", 2024-04-19T02:17:45.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1220000000000002e-06 2024-04-19T02:17:45.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:45.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069660+0000", 2024-04-19T02:17:45.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5890000000000002e-06 2024-04-19T02:17:45.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.356 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.356 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069665+0000", 2024-04-19T02:17:45.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.989e-06 2024-04-19T02:17:45.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.356 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:45.356 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120220+0000", 2024-04-19T02:17:45.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050555061999999998 2024-04-19T02:17:45.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.356 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:45.356 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120329+0000", 2024-04-19T02:17:45.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010922200000000001 2024-04-19T02:17:45.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:45.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.128293+0000", 2024-04-19T02:17:45.357 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079640279999999997 2024-04-19T02:17:45.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:45.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.128336+0000", 2024-04-19T02:17:45.357 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2245e-05 2024-04-19T02:17:45.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:45.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.128401+0000", 2024-04-19T02:17:45.357 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5975000000000004e-05 2024-04-19T02:17:45.357 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:45.357 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:45.358 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:45.358 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.358 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.358 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168387 5.f 5:ff36d1d9:::benchmark_data_smithi121_44835_object34352:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:45.358 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:45.358 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 33.243385099000001, 2024-04-19T02:17:45.358 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.049975358999999997, 2024-04-19T02:17:45.358 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:45.358 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:45.358 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:45.358 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:45.358 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:45.358 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168387 2024-04-19T02:17:45.358 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.358 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:45.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.359 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:45.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:45.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:45.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.359 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:45.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:45.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:45.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.359 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:45.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069669+0000", 2024-04-19T02:17:45.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:45.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.360 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:45.360 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069671+0000", 2024-04-19T02:17:45.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1739999999999999e-06 2024-04-19T02:17:45.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.360 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:45.360 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069677+0000", 2024-04-19T02:17:45.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4519999999999996e-06 2024-04-19T02:17:45.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.360 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.360 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069682+0000", 2024-04-19T02:17:45.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5400000000000003e-06 2024-04-19T02:17:45.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.361 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.361 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:45.361 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072634+0000", 2024-04-19T02:17:45.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0029521510000000001 2024-04-19T02:17:45.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.361 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.361 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:45.361 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072706+0000", 2024-04-19T02:17:45.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1996999999999995e-05 2024-04-19T02:17:45.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.361 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.361 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:45.361 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072772+0000", 2024-04-19T02:17:45.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5380000000000001e-05 2024-04-19T02:17:45.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.361 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:45.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117549+0000", 2024-04-19T02:17:45.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044777124000000001 2024-04-19T02:17:45.362 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:45.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119572+0000", 2024-04-19T02:17:45.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002022893 2024-04-19T02:17:45.362 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:45.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119613+0000", 2024-04-19T02:17:45.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0849999999999997e-05 2024-04-19T02:17:45.362 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.363 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.363 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:45.363 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119645+0000", 2024-04-19T02:17:45.363 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2113000000000002e-05 2024-04-19T02:17:45.363 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:45.363 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:45.363 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:45.363 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.363 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.363 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168389 5.2 5:4bcb87b1:::benchmark_data_smithi121_44835_object34354:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:45.363 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.071719+0000", 2024-04-19T02:17:45.363 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 33.241336003000001, 2024-04-19T02:17:45.363 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.048248604, 2024-04-19T02:17:45.363 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:45.364 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:45.364 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:45.364 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:45.364 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:45.364 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168389 2024-04-19T02:17:45.364 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.364 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:45.364 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.364 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:45.364 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071719+0000", 2024-04-19T02:17:45.364 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:45.364 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.364 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.364 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:45.365 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071719+0000", 2024-04-19T02:17:45.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:45.365 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.365 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.365 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:45.365 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071718+0000", 2024-04-19T02:17:45.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:45.365 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.365 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.365 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:45.365 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071722+0000", 2024-04-19T02:17:45.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8590000000000004e-06 2024-04-19T02:17:45.365 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.365 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.365 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:45.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071730+0000", 2024-04-19T02:17:45.366 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8569999999999995e-06 2024-04-19T02:17:45.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071736+0000", 2024-04-19T02:17:45.366 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.127e-06 2024-04-19T02:17:45.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:45.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071769+0000", 2024-04-19T02:17:45.366 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3052000000000001e-05 2024-04-19T02:17:45.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.367 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:45.367 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.071843+0000", 2024-04-19T02:17:45.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3683000000000006e-05 2024-04-19T02:17:45.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.367 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.367 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:45.367 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119852+0000", 2024-04-19T02:17:45.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.048009353999999997 2024-04-19T02:17:45.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.367 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.367 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:45.367 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119896+0000", 2024-04-19T02:17:45.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3102000000000002e-05 2024-04-19T02:17:45.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.367 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.368 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:45.368 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119967+0000", 2024-04-19T02:17:45.368 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1589999999999997e-05 2024-04-19T02:17:45.368 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:45.368 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:45.368 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:45.368 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.368 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.368 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168391 5.3 5:c5d9b5e1:::benchmark_data_smithi121_44835_object34356:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:45.368 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.074402+0000", 2024-04-19T02:17:45.368 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 33.238652164000001, 2024-04-19T02:17:45.368 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.045426756999999998, 2024-04-19T02:17:45.368 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:45.368 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:45.368 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:45.369 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:45.369 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:45.369 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168391 2024-04-19T02:17:45.369 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.369 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:45.369 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.369 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:45.369 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074402+0000", 2024-04-19T02:17:45.369 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:45.369 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.369 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.369 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:45.369 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074402+0000", 2024-04-19T02:17:45.369 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:45.369 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.370 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:45.370 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074401+0000", 2024-04-19T02:17:45.370 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:45.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.370 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:45.370 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074406+0000", 2024-04-19T02:17:45.370 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5879999999999999e-06 2024-04-19T02:17:45.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.370 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:45.370 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074414+0000", 2024-04-19T02:17:45.370 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8599999999999993e-06 2024-04-19T02:17:45.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.371 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.371 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074420+0000", 2024-04-19T02:17:45.371 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6350000000000003e-06 2024-04-19T02:17:45.371 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.371 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.371 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:45.371 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074453+0000", 2024-04-19T02:17:45.371 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3874000000000001e-05 2024-04-19T02:17:45.371 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.371 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.371 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:45.371 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074531+0000", 2024-04-19T02:17:45.371 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7999999999999999e-05 2024-04-19T02:17:45.371 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.371 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.372 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:45.372 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119717+0000", 2024-04-19T02:17:45.372 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.045185395000000003 2024-04-19T02:17:45.372 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.372 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.372 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:45.372 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119756+0000", 2024-04-19T02:17:45.372 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9110000000000003e-05 2024-04-19T02:17:45.372 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.372 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.372 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:45.372 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119829+0000", 2024-04-19T02:17:45.372 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3238000000000006e-05 2024-04-19T02:17:45.372 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:45.372 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:45.373 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:45.373 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.373 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.373 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4549.0:168377 5.d e52/16 ondisk, result = 0)", 2024-04-19T02:17:45.373 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.077260+0000", 2024-04-19T02:17:45.373 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 33.235794423000002, 2024-04-19T02:17:45.373 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042613204000000002, 2024-04-19T02:17:45.373 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:45.373 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:45.373 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:45.373 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.373 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:45.373 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.077260+0000", 2024-04-19T02:17:45.373 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:45.373 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.373 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.374 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:45.374 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.077260+0000", 2024-04-19T02:17:45.374 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:45.374 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.374 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.374 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:45.374 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.077259+0000", 2024-04-19T02:17:45.374 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:45.374 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.374 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.374 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:45.374 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.077267+0000", 2024-04-19T02:17:45.374 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6799999999999993e-06 2024-04-19T02:17:45.374 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.375 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:45.375 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117372+0000", 2024-04-19T02:17:45.375 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040105342000000002 2024-04-19T02:17:45.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.375 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.375 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117389+0000", 2024-04-19T02:17:45.375 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6711e-05 2024-04-19T02:17:45.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.375 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:45.375 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119862+0000", 2024-04-19T02:17:45.375 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0024730580000000002 2024-04-19T02:17:45.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.376 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:45.376 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119867+0000", 2024-04-19T02:17:45.376 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1590000000000001e-06 2024-04-19T02:17:45.376 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.376 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.376 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:45.376 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119873+0000", 2024-04-19T02:17:45.376 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1410000000000002e-06 2024-04-19T02:17:45.376 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:45.376 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:45.376 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:45.376 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.376 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.376 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241615 5.d 5:bc2762a9:::benchmark_data_smithi121_44835_object107580:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:45.376 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.288268+0000", 2024-04-19T02:17:45.377 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 7.0247865599999999, 2024-04-19T02:17:45.377 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.068304498000000005, 2024-04-19T02:17:45.377 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:45.377 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:45.377 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:45.377 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:45.377 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:45.377 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241615 2024-04-19T02:17:45.377 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.377 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:45.377 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.377 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:45.377 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.288268+0000", 2024-04-19T02:17:45.377 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:45.377 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.378 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:45.378 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.288268+0000", 2024-04-19T02:17:45.378 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:45.378 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.378 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:45.378 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.288267+0000", 2024-04-19T02:17:45.378 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:45.378 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.378 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:45.378 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.288273+0000", 2024-04-19T02:17:45.378 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.823e-06 2024-04-19T02:17:45.378 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.379 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.379 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:45.379 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.288288+0000", 2024-04-19T02:17:45.379 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5307000000000001e-05 2024-04-19T02:17:45.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.379 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.379 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.379 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.288296+0000", 2024-04-19T02:17:45.379 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5689999999999999e-06 2024-04-19T02:17:45.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.379 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.379 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:45.379 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290508+0000", 2024-04-19T02:17:45.379 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022125589999999998 2024-04-19T02:17:45.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.380 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.380 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:45.380 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290661+0000", 2024-04-19T02:17:45.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015289500000000001 2024-04-19T02:17:45.380 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.380 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.380 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:45.380 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290781+0000", 2024-04-19T02:17:45.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000119411 2024-04-19T02:17:45.380 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.380 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.380 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:45.380 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297532+0000", 2024-04-19T02:17:45.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0067517819999999996 2024-04-19T02:17:45.380 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.381 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.381 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:45.381 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.356516+0000", 2024-04-19T02:17:45.381 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058983233000000003 2024-04-19T02:17:45.381 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.381 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.381 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:45.381 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.356547+0000", 2024-04-19T02:17:45.381 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1063999999999999e-05 2024-04-19T02:17:45.381 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.381 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.381 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:45.381 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.356572+0000", 2024-04-19T02:17:45.381 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5795999999999998e-05 2024-04-19T02:17:45.381 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:45.382 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:45.382 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:45.382 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.382 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.382 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241622 5.d 5:ba16b775:::benchmark_data_smithi121_44835_object107587:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:45.382 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.290616+0000", 2024-04-19T02:17:45.382 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 7.0224380880000004, 2024-04-19T02:17:45.382 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.070971960000000001, 2024-04-19T02:17:45.382 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:45.382 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:45.382 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:45.382 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:45.382 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:45.382 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241622 2024-04-19T02:17:45.383 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.383 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:45.383 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.383 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:45.383 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290616+0000", 2024-04-19T02:17:45.383 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:45.383 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.383 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.383 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:45.383 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290616+0000", 2024-04-19T02:17:45.383 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:45.383 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.383 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.383 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:45.383 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290616+0000", 2024-04-19T02:17:45.384 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:45.384 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.384 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.384 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:45.384 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290619+0000", 2024-04-19T02:17:45.384 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8169999999999999e-06 2024-04-19T02:17:45.384 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.384 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.384 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:45.384 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290625+0000", 2024-04-19T02:17:45.384 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3759999999999996e-06 2024-04-19T02:17:45.384 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.384 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.384 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.385 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290630+0000", 2024-04-19T02:17:45.385 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2179999999999998e-06 2024-04-19T02:17:45.385 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.385 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.385 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:45.385 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.292551+0000", 2024-04-19T02:17:45.385 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001920185 2024-04-19T02:17:45.385 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.385 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.385 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:45.385 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.292680+0000", 2024-04-19T02:17:45.385 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012971700000000001 2024-04-19T02:17:45.385 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.385 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.385 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:45.386 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.292794+0000", 2024-04-19T02:17:45.386 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000114095 2024-04-19T02:17:45.386 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.386 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.386 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:45.386 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297538+0000", 2024-04-19T02:17:45.386 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00474341 2024-04-19T02:17:45.386 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.386 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.386 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:45.386 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361516+0000", 2024-04-19T02:17:45.386 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.063978249000000001 2024-04-19T02:17:45.386 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.387 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.387 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:45.387 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361550+0000", 2024-04-19T02:17:45.387 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4069999999999997e-05 2024-04-19T02:17:45.387 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.387 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.387 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:45.387 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361588+0000", 2024-04-19T02:17:45.387 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8349999999999997e-05 2024-04-19T02:17:45.387 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:45.387 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:45.387 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:45.387 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.387 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.387 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241636 5.d 5:bcce6ec3:::benchmark_data_smithi121_44835_object107601:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:45.388 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.295801+0000", 2024-04-19T02:17:45.388 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 7.0172533619999999, 2024-04-19T02:17:45.388 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.065904313000000006, 2024-04-19T02:17:45.388 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:45.388 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:45.388 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:45.388 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:45.388 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:45.388 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241636 2024-04-19T02:17:45.388 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.388 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:45.388 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.388 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:45.388 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295801+0000", 2024-04-19T02:17:45.388 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:45.389 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.389 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.389 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:45.389 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295801+0000", 2024-04-19T02:17:45.389 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:45.389 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.389 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.389 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:45.389 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295800+0000", 2024-04-19T02:17:45.389 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:45.389 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.389 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.389 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:45.389 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295806+0000", 2024-04-19T02:17:45.389 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5230000000000003e-06 2024-04-19T02:17:45.390 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.390 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.390 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:45.390 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295816+0000", 2024-04-19T02:17:45.390 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.079e-05 2024-04-19T02:17:45.390 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.390 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.390 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.390 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295825+0000", 2024-04-19T02:17:45.390 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4999999999999999e-06 2024-04-19T02:17:45.390 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.390 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.390 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:45.390 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.296001+0000", 2024-04-19T02:17:45.390 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017568600000000001 2024-04-19T02:17:45.391 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.391 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.391 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:45.391 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.296093+0000", 2024-04-19T02:17:45.391 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2237999999999993e-05 2024-04-19T02:17:45.391 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.391 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.391 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:45.391 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.296155+0000", 2024-04-19T02:17:45.391 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2281999999999998e-05 2024-04-19T02:17:45.391 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.391 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.391 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:45.392 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.299187+0000", 2024-04-19T02:17:45.392 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003031906 2024-04-19T02:17:45.392 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.392 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.392 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:45.392 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361624+0000", 2024-04-19T02:17:45.392 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.062437318999999998 2024-04-19T02:17:45.392 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.392 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.392 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:45.392 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361669+0000", 2024-04-19T02:17:45.392 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4197999999999999e-05 2024-04-19T02:17:45.392 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.392 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.392 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:45.393 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361705+0000", 2024-04-19T02:17:45.393 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6980999999999997e-05 2024-04-19T02:17:45.393 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:45.393 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:45.393 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:45.393 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.393 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.393 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241637 5.9 5:920672c8:::benchmark_data_smithi121_44835_object107602:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:45.393 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.295834+0000", 2024-04-19T02:17:45.393 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 7.017220236, 2024-04-19T02:17:45.393 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.064579527999999997, 2024-04-19T02:17:45.393 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:45.393 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:45.393 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:45.393 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:45.394 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:45.394 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241637 2024-04-19T02:17:45.394 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.394 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:45.394 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.394 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:45.394 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295834+0000", 2024-04-19T02:17:45.394 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:45.394 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.394 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.394 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:45.394 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295834+0000", 2024-04-19T02:17:45.394 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:45.394 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.394 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.395 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:45.395 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295834+0000", 2024-04-19T02:17:45.395 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:45.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.395 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:45.395 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295836+0000", 2024-04-19T02:17:45.395 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4389999999999999e-06 2024-04-19T02:17:45.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.395 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:45.395 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295843+0000", 2024-04-19T02:17:45.395 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1759999999999998e-06 2024-04-19T02:17:45.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.396 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.396 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295847+0000", 2024-04-19T02:17:45.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7949999999999998e-06 2024-04-19T02:17:45.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.396 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:45.396 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295899+0000", 2024-04-19T02:17:45.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1579999999999997e-05 2024-04-19T02:17:45.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.396 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:45.396 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.296009+0000", 2024-04-19T02:17:45.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000110006 2024-04-19T02:17:45.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.396 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:45.397 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.296109+0000", 2024-04-19T02:17:45.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100035 2024-04-19T02:17:45.397 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.397 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.397 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:45.397 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.299700+0000", 2024-04-19T02:17:45.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035907999999999999 2024-04-19T02:17:45.397 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.397 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.397 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:45.397 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.360358+0000", 2024-04-19T02:17:45.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060657889 2024-04-19T02:17:45.397 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.397 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.397 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:45.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.360387+0000", 2024-04-19T02:17:45.398 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9492000000000002e-05 2024-04-19T02:17:45.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:45.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.360414+0000", 2024-04-19T02:17:45.398 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6631999999999998e-05 2024-04-19T02:17:45.398 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:45.398 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:45.398 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:45.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.398 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241638 5.d 5:b857cbeb:::benchmark_data_smithi121_44835_object107603:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:45.398 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.297779+0000", 2024-04-19T02:17:45.399 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 7.0152751640000002, 2024-04-19T02:17:45.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.064037317999999996, 2024-04-19T02:17:45.399 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:45.399 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:45.399 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:45.399 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:45.399 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:45.399 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241638 2024-04-19T02:17:45.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.399 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:45.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.399 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:45.400 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297779+0000", 2024-04-19T02:17:45.400 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:45.400 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.400 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.400 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:45.400 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297779+0000", 2024-04-19T02:17:45.400 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:45.400 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.400 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.400 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:45.400 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297779+0000", 2024-04-19T02:17:45.400 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:45.400 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.400 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.401 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:45.401 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297784+0000", 2024-04-19T02:17:45.401 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3460000000000001e-06 2024-04-19T02:17:45.401 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.401 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.401 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:45.401 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297792+0000", 2024-04-19T02:17:45.401 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0949999999999996e-06 2024-04-19T02:17:45.401 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.401 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.401 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.401 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297799+0000", 2024-04-19T02:17:45.401 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0360000000000001e-06 2024-04-19T02:17:45.401 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.401 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.402 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:45.402 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297823+0000", 2024-04-19T02:17:45.402 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3595e-05 2024-04-19T02:17:45.402 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.402 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.402 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:45.402 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297893+0000", 2024-04-19T02:17:45.402 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0343000000000001e-05 2024-04-19T02:17:45.402 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.402 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.402 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:45.402 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297965+0000", 2024-04-19T02:17:45.402 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2253000000000001e-05 2024-04-19T02:17:45.402 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:45.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.300115+0000", 2024-04-19T02:17:45.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021493319999999999 2024-04-19T02:17:45.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:45.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361742+0000", 2024-04-19T02:17:45.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061627511000000003 2024-04-19T02:17:45.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:45.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361780+0000", 2024-04-19T02:17:45.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7759000000000002e-05 2024-04-19T02:17:45.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:45.404 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361817+0000", 2024-04-19T02:17:45.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6804999999999997e-05 2024-04-19T02:17:45.404 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:45.404 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:45.404 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:45.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.404 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241644 5.9 5:993dd037:::benchmark_data_smithi121_44835_object107609:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:45.404 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.298160+0000", 2024-04-19T02:17:45.404 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 7.0148941550000004, 2024-04-19T02:17:45.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.062615216000000001, 2024-04-19T02:17:45.404 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:45.404 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:45.405 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:45.405 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:45.405 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:45.405 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241644 2024-04-19T02:17:45.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.405 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:45.405 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.405 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:45.405 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298160+0000", 2024-04-19T02:17:45.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:45.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.405 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.405 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:45.405 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298160+0000", 2024-04-19T02:17:45.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:45.406 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.406 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:45.406 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298160+0000", 2024-04-19T02:17:45.406 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:45.406 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.406 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:45.406 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298162+0000", 2024-04-19T02:17:45.406 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8360000000000001e-06 2024-04-19T02:17:45.406 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.406 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:45.407 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298167+0000", 2024-04-19T02:17:45.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1710000000000001e-06 2024-04-19T02:17:45.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.407 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.407 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298170+0000", 2024-04-19T02:17:45.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0740000000000001e-06 2024-04-19T02:17:45.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.407 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:45.407 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298202+0000", 2024-04-19T02:17:45.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2163999999999999e-05 2024-04-19T02:17:45.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.407 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:45.407 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298281+0000", 2024-04-19T02:17:45.408 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8318000000000005e-05 2024-04-19T02:17:45.408 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.408 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.408 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:45.408 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298344+0000", 2024-04-19T02:17:45.408 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2909000000000004e-05 2024-04-19T02:17:45.408 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.408 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.408 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:45.408 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.301043+0000", 2024-04-19T02:17:45.408 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026998159999999998 2024-04-19T02:17:45.408 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.408 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.408 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:45.408 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.360725+0000", 2024-04-19T02:17:45.409 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059681627000000001 2024-04-19T02:17:45.409 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.409 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.409 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:45.409 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.360753+0000", 2024-04-19T02:17:45.409 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8198999999999999e-05 2024-04-19T02:17:45.409 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.409 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.409 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:45.409 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.360776+0000", 2024-04-19T02:17:45.409 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2388e-05 2024-04-19T02:17:45.409 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:45.409 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:45.409 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:45.410 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.410 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.410 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241645 5.9 5:935d75f3:::benchmark_data_smithi121_44835_object107610:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:45.410 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.298176+0000", 2024-04-19T02:17:45.410 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 7.0148789899999997, 2024-04-19T02:17:45.410 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.067784611999999994, 2024-04-19T02:17:45.410 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:45.410 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:45.410 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:45.410 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:45.410 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:45.411 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241645 2024-04-19T02:17:45.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.411 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:45.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.411 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:45.411 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298176+0000", 2024-04-19T02:17:45.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:45.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.411 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:45.411 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298176+0000", 2024-04-19T02:17:45.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:45.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.411 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:45.412 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298175+0000", 2024-04-19T02:17:45.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:45.412 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.412 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:45.412 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298177+0000", 2024-04-19T02:17:45.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9709999999999998e-06 2024-04-19T02:17:45.412 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.412 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:45.412 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298183+0000", 2024-04-19T02:17:45.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4700000000000001e-06 2024-04-19T02:17:45.412 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.412 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.413 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298187+0000", 2024-04-19T02:17:45.413 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7249999999999997e-06 2024-04-19T02:17:45.413 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.413 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.413 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:45.413 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.299715+0000", 2024-04-19T02:17:45.413 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001527657 2024-04-19T02:17:45.413 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.413 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.413 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:45.413 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.299790+0000", 2024-04-19T02:17:45.413 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4789999999999994e-05 2024-04-19T02:17:45.413 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.413 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.413 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:45.414 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.299853+0000", 2024-04-19T02:17:45.414 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2905999999999997e-05 2024-04-19T02:17:45.414 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.414 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.414 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:45.414 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.301553+0000", 2024-04-19T02:17:45.414 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017001609999999999 2024-04-19T02:17:45.414 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.414 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.414 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:45.414 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.365904+0000", 2024-04-19T02:17:45.414 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.064351028000000005 2024-04-19T02:17:45.414 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.414 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.414 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:45.415 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.365931+0000", 2024-04-19T02:17:45.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6809e-05 2024-04-19T02:17:45.415 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.415 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.415 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:45.415 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.365960+0000", 2024-04-19T02:17:45.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9391e-05 2024-04-19T02:17:45.415 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:45.415 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:45.415 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:45.415 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.415 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.415 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241652 5.d 5:bbf7ddbb:::benchmark_data_smithi121_44835_object107617:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:45.415 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.309592+0000", 2024-04-19T02:17:45.415 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 7.0034627719999998, 2024-04-19T02:17:45.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.054120610999999999, 2024-04-19T02:17:45.416 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:45.416 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:45.416 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:45.416 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:45.416 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:45.416 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241652 2024-04-19T02:17:45.416 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.416 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:45.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.416 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:45.416 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309592+0000", 2024-04-19T02:17:45.416 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:45.416 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.417 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:45.417 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309592+0000", 2024-04-19T02:17:45.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:45.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.417 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.417 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:45.417 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309591+0000", 2024-04-19T02:17:45.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:45.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.417 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.417 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:45.417 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309595+0000", 2024-04-19T02:17:45.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6009999999999999e-06 2024-04-19T02:17:45.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.417 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.418 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:45.418 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309603+0000", 2024-04-19T02:17:45.418 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9319999999999996e-06 2024-04-19T02:17:45.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.418 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.418 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309608+0000", 2024-04-19T02:17:45.418 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7809999999999996e-06 2024-04-19T02:17:45.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.418 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:45.418 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309635+0000", 2024-04-19T02:17:45.418 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7376e-05 2024-04-19T02:17:45.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:45.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309709+0000", 2024-04-19T02:17:45.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4318000000000002e-05 2024-04-19T02:17:45.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:45.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309774+0000", 2024-04-19T02:17:45.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5173999999999996e-05 2024-04-19T02:17:45.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:45.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.311459+0000", 2024-04-19T02:17:45.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001684269 2024-04-19T02:17:45.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.420 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:45.420 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.363665+0000", 2024-04-19T02:17:45.420 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.052205840000000003 2024-04-19T02:17:45.420 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.420 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.420 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:45.420 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.363694+0000", 2024-04-19T02:17:45.420 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9706999999999999e-05 2024-04-19T02:17:45.420 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:45.420 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:45.420 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:45.420 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.363712+0000", 2024-04-19T02:17:45.420 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8144000000000001e-05 2024-04-19T02:17:45.420 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:45.420 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:45.421 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:45.421 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:45.421 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:45.421 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:45.421 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T02:17:45.432 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:45.422+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:45.433 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:17:45.523 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:45.523+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:45.533 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on 2024-04-19T02:17:45.611 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:17:45.612 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:17:45.612 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:45.612 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:261682 5.a 5:51ba40f8:::benchmark_data_smithi121_44835_object127647:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T02:17:45.612 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:45.609971+0000", 2024-04-19T02:17:45.612 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0020210100000000002, 2024-04-19T02:17:45.612 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0020478969999999999, 2024-04-19T02:17:45.612 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:45.612 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:45.612 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:45.612 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:45.612 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:45.612 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 261682 2024-04-19T02:17:45.612 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:45.612 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:45.613 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:45.613 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:45.613 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:45.609971+0000", 2024-04-19T02:17:45.613 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:45.613 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:45.613 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:45.613 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:45.613 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:45.609971+0000", 2024-04-19T02:17:45.613 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:45.613 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:45.613 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:45.613 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:45.613 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:45.609970+0000", 2024-04-19T02:17:45.613 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:45.614 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:45.614 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:45.614 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:45.614 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:45.609974+0000", 2024-04-19T02:17:45.614 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1949999999999996e-06 2024-04-19T02:17:45.614 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:45.614 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:45.614 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:45.614 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:45.609983+0000", 2024-04-19T02:17:45.614 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.4940000000000003e-06 2024-04-19T02:17:45.614 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:45.614 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:45.614 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.614 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:45.609990+0000", 2024-04-19T02:17:45.614 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.5780000000000001e-06 2024-04-19T02:17:45.615 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:45.615 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:45.615 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:45.615 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:45.610035+0000", 2024-04-19T02:17:45.615 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4209000000000003e-05 2024-04-19T02:17:45.615 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:45.615 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:45.615 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:45.615 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:45.610170+0000", 2024-04-19T02:17:45.615 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013514899999999999 2024-04-19T02:17:45.615 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:45.615 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:45.615 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:45.615 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:45.615 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:45.616 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:261683 5.1 5:8020b5c3:::benchmark_data_smithi121_44835_object127648:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T02:17:45.616 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:45.610058+0000", 2024-04-19T02:17:45.616 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0019338720000000001, 2024-04-19T02:17:45.616 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0020476719999999999, 2024-04-19T02:17:45.616 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:45.616 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:45.616 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:45.616 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:45.616 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:45.616 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 261683 2024-04-19T02:17:45.616 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:45.616 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:45.616 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:45.616 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:45.616 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:45.610058+0000", 2024-04-19T02:17:45.617 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:45.617 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:45.617 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:45.617 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:45.617 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:45.610058+0000", 2024-04-19T02:17:45.617 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:45.617 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:45.617 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:45.617 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:45.617 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:45.610058+0000", 2024-04-19T02:17:45.617 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:45.617 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:45.617 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:45.617 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:45.618 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:45.610060+0000", 2024-04-19T02:17:45.618 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.6699999999999998e-06 2024-04-19T02:17:45.618 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:45.618 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:45.618 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:45.618 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:45.610068+0000", 2024-04-19T02:17:45.618 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.5599999999999996e-06 2024-04-19T02:17:45.618 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:45.618 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:45.618 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.618 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:45.610074+0000", 2024-04-19T02:17:45.618 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.0610000000000001e-06 2024-04-19T02:17:45.618 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:45.618 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:45.619 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:45.619 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:45.610106+0000", 2024-04-19T02:17:45.619 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1714999999999997e-05 2024-04-19T02:17:45.619 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:45.619 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:45.619 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:45.619 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:45.610188+0000", 2024-04-19T02:17:45.619 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2515999999999994e-05 2024-04-19T02:17:45.619 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:45.619 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:45.619 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:45.619 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:45.619 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:45.619 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:261680 5.d e65/16 5:b7474da2:::benchmark_data_smithi121_44835_object127645:head v 65'16387, mlcod=65'16385)", 2024-04-19T02:17:45.619 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:45.610256+0000", 2024-04-19T02:17:45.620 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0017361709999999999, 2024-04-19T02:17:45.620 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0019345090000000001, 2024-04-19T02:17:45.620 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:45.620 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:45.620 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:45.620 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:45.620 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:45.620 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:45.610256+0000", 2024-04-19T02:17:45.620 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:45.620 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:45.620 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:45.620 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:45.620 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:45.610256+0000", 2024-04-19T02:17:45.620 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:45.620 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:45.620 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:45.621 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:45.621 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:45.610255+0000", 2024-04-19T02:17:45.621 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:45.621 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:45.621 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:45.621 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:45.621 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:45.610260+0000", 2024-04-19T02:17:45.621 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.7090000000000001e-06 2024-04-19T02:17:45.621 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:45.621 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:45.621 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:45.621 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:45.610267+0000", 2024-04-19T02:17:45.621 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.4200000000000001e-06 2024-04-19T02:17:45.621 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:45.621 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:45.621 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.622 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:45.610273+0000", 2024-04-19T02:17:45.622 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.1919999999999996e-06 2024-04-19T02:17:45.622 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:45.622 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:45.622 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:45.622 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:45.610316+0000", 2024-04-19T02:17:45.622 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3226999999999998e-05 2024-04-19T02:17:45.622 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:45.622 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:45.622 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:45.622 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:45.610335+0000", 2024-04-19T02:17:45.622 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.9599e-05 2024-04-19T02:17:45.622 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:45.622 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:45.623 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:45.623 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:45.623 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:45.623 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:261686 5.a 5:5ea3c0d8:::benchmark_data_smithi121_44835_object127651:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T02:17:45.623 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:45.610982+0000", 2024-04-19T02:17:45.623 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.001010443, 2024-04-19T02:17:45.623 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001280141, 2024-04-19T02:17:45.623 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:45.623 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:45.623 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:45.623 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:45.623 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:45.623 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 261686 2024-04-19T02:17:45.624 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:45.624 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:45.624 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:45.624 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:45.624 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:45.610982+0000", 2024-04-19T02:17:45.624 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:45.624 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:45.624 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:45.624 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:45.624 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:45.610982+0000", 2024-04-19T02:17:45.624 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:45.624 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:45.624 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:45.624 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:45.625 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:45.610981+0000", 2024-04-19T02:17:45.625 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:45.625 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:45.625 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:45.625 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:45.625 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:45.610984+0000", 2024-04-19T02:17:45.625 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9689999999999999e-06 2024-04-19T02:17:45.625 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:45.625 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:45.625 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:45.625 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:45.610993+0000", 2024-04-19T02:17:45.625 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.5920000000000001e-06 2024-04-19T02:17:45.625 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:45.625 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:45.625 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.626 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:45.611000+0000", 2024-04-19T02:17:45.626 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.2579999999999998e-06 2024-04-19T02:17:45.626 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:45.626 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:45.626 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:45.626 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:45.611895+0000", 2024-04-19T02:17:45.626 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00089526099999999995 2024-04-19T02:17:45.626 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:45.626 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:45.627 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:45.627 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:45.612019+0000", 2024-04-19T02:17:45.627 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012422900000000001 2024-04-19T02:17:45.627 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:45.627 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:45.627 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:45.627 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:45.627 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:45.627 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:261685 5.f e65/16 5:fc48261b:::benchmark_data_smithi121_44835_object127650:head v 65'16466, mlcod=65'16463)", 2024-04-19T02:17:45.627 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:45.611294+0000", 2024-04-19T02:17:45.627 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.00069793399999999999, 2024-04-19T02:17:45.627 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0010343679999999999, 2024-04-19T02:17:45.627 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:45.627 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:45.627 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:45.628 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:45.628 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:45.628 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:45.611294+0000", 2024-04-19T02:17:45.628 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:45.628 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:45.628 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:45.628 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:45.628 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:45.611294+0000", 2024-04-19T02:17:45.628 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:45.628 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:45.628 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:45.628 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:45.628 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:45.611294+0000", 2024-04-19T02:17:45.628 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:45.628 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:45.629 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:45.629 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:45.629 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:45.611298+0000", 2024-04-19T02:17:45.629 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.5859999999999998e-06 2024-04-19T02:17:45.629 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:45.629 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:45.629 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:45.629 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:45.611304+0000", 2024-04-19T02:17:45.629 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.0009999999999998e-06 2024-04-19T02:17:45.629 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:45.629 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:45.629 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:45.629 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:45.611309+0000", 2024-04-19T02:17:45.629 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2599999999999996e-06 2024-04-19T02:17:45.629 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:45.629 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:45.630 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:45.630 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:45.611343+0000", 2024-04-19T02:17:45.630 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.3782999999999998e-05 2024-04-19T02:17:45.630 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:45.630 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:45.630 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:45.630 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:45.611363+0000", 2024-04-19T02:17:45.630 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.9718e-05 2024-04-19T02:17:45.630 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:45.630 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:45.630 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:45.630 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:45.630 INFO:teuthology.orchestra.run.smithi174.stdout: ], 2024-04-19T02:17:45.630 INFO:teuthology.orchestra.run.smithi174.stdout: "num_ops": 5 2024-04-19T02:17:45.630 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:17:45.632 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:17:45.632 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:45.632+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:45.634 INFO:teuthology.orchestra.console.smithi177:Power on completed 2024-04-19T02:17:45.733 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:45.732+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:45.736 DEBUG:teuthology.orchestra.console.smithi177:Waiting for login prompt 2024-04-19T02:17:45.736 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi177 2024-04-19T02:17:45.834 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:45.834+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:45.853 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:17:45.853 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [], 2024-04-19T02:17:45.853 INFO:teuthology.orchestra.run.smithi174.stdout: "complaint_time": 30, 2024-04-19T02:17:45.853 INFO:teuthology.orchestra.run.smithi174.stdout: "num_blocked_ops": 0 2024-04-19T02:17:45.853 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:17:45.866 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:17:45.935 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:45.935+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:46.025 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:17:46.025 INFO:teuthology.orchestra.run.smithi174.stdout: "size": 20, 2024-04-19T02:17:46.025 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 600, 2024-04-19T02:17:46.025 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:17:46.025 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.025 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78259 5.4 5:2aa344b2:::benchmark_data_smithi121_44835_object78258:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:46.025 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:17:46.025 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 78.897874798000004, 2024-04-19T02:17:46.025 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022934350999999999, 2024-04-19T02:17:46.025 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:46.025 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:46.025 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:46.026 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:46.026 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:46.026 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78259 2024-04-19T02:17:46.026 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.026 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:46.026 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.026 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:46.026 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:17:46.026 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:46.026 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.026 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.026 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:46.026 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:17:46.027 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:46.027 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.027 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.027 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:46.027 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125256+0000", 2024-04-19T02:17:46.027 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:46.027 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.027 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.027 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:46.027 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125347+0000", 2024-04-19T02:17:46.027 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0470000000000006e-05 2024-04-19T02:17:46.028 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.028 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.028 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:46.028 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125358+0000", 2024-04-19T02:17:46.028 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1764e-05 2024-04-19T02:17:46.028 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.028 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.028 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.028 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125364+0000", 2024-04-19T02:17:46.028 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7189999999999998e-06 2024-04-19T02:17:46.028 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.028 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.029 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:46.029 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125391+0000", 2024-04-19T02:17:46.029 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7270000000000001e-05 2024-04-19T02:17:46.029 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.029 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.029 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:46.029 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125471+0000", 2024-04-19T02:17:46.029 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9209999999999995e-05 2024-04-19T02:17:46.029 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.029 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.029 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:46.029 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125559+0000", 2024-04-19T02:17:46.029 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.8689000000000004e-05 2024-04-19T02:17:46.029 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.030 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.030 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:46.030 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128164+0000", 2024-04-19T02:17:46.030 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0026050270000000002 2024-04-19T02:17:46.030 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.030 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.030 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:46.030 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148139+0000", 2024-04-19T02:17:46.030 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.019975050000000001 2024-04-19T02:17:46.030 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.030 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.030 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:46.030 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148169+0000", 2024-04-19T02:17:46.031 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0001e-05 2024-04-19T02:17:46.031 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.031 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.031 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:46.031 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148191+0000", 2024-04-19T02:17:46.031 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.2104999999999999e-05 2024-04-19T02:17:46.031 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:46.031 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:46.031 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:46.031 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.031 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.031 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78272 5.4 5:273e819a:::benchmark_data_smithi121_44835_object78271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:46.031 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:46.031 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 78.890522524999994, 2024-04-19T02:17:46.031 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022180163999999999, 2024-04-19T02:17:46.032 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:46.032 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:46.032 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:46.032 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:46.032 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:46.032 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78272 2024-04-19T02:17:46.032 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.032 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:46.033 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.033 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:46.033 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:46.033 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:46.033 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.033 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.033 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:46.033 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:46.033 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:46.033 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.033 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.033 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:46.033 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:46.033 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:46.034 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.034 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.034 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:46.034 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132690+0000", 2024-04-19T02:17:46.034 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0963000000000004e-05 2024-04-19T02:17:46.034 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.034 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.034 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:46.034 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132703+0000", 2024-04-19T02:17:46.034 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.3072e-05 2024-04-19T02:17:46.034 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.034 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.034 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.034 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132710+0000", 2024-04-19T02:17:46.035 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3100000000000003e-06 2024-04-19T02:17:46.035 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.035 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.035 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:46.035 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134005+0000", 2024-04-19T02:17:46.035 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001294513 2024-04-19T02:17:46.035 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.035 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.035 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:46.035 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134139+0000", 2024-04-19T02:17:46.035 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000134447 2024-04-19T02:17:46.035 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.035 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.035 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:46.035 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134284+0000", 2024-04-19T02:17:46.036 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014514399999999999 2024-04-19T02:17:46.036 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.036 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.036 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:46.036 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.139622+0000", 2024-04-19T02:17:46.036 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0053373830000000002 2024-04-19T02:17:46.036 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.036 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.036 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:46.036 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154737+0000", 2024-04-19T02:17:46.036 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015115195999999999 2024-04-19T02:17:46.036 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.036 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.036 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:46.037 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154768+0000", 2024-04-19T02:17:46.037 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0824999999999997e-05 2024-04-19T02:17:46.037 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.037 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.037 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:46.037 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154790+0000", 2024-04-19T02:17:46.037 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1999000000000001e-05 2024-04-19T02:17:46.037 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:46.037 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:46.037 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:46.037 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.037 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.037 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:94581 5.b 5:dc86d6e9:::benchmark_data_smithi121_44835_object94580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:46.037 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:46.037 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 70.842951635000006, 2024-04-19T02:17:46.038 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022099711000000001, 2024-04-19T02:17:46.038 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:46.038 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:46.038 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:46.038 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:46.038 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:46.038 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 94581 2024-04-19T02:17:46.038 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.038 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:46.038 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.038 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:46.038 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:46.038 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:46.039 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.039 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.039 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:46.039 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:46.039 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:46.039 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.039 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.039 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:46.039 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:46.039 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:46.039 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.039 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.039 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:46.040 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180253+0000", 2024-04-19T02:17:46.040 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3163000000000004e-05 2024-04-19T02:17:46.040 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.040 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.040 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:46.040 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180266+0000", 2024-04-19T02:17:46.040 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2886e-05 2024-04-19T02:17:46.040 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.040 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.040 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.040 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180273+0000", 2024-04-19T02:17:46.040 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.4059999999999999e-06 2024-04-19T02:17:46.040 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.040 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.041 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:46.041 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180646+0000", 2024-04-19T02:17:46.041 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00037283999999999999 2024-04-19T02:17:46.041 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.041 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.041 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:46.041 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180774+0000", 2024-04-19T02:17:46.041 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012793799999999999 2024-04-19T02:17:46.041 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.041 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.041 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:46.041 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180920+0000", 2024-04-19T02:17:46.041 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000146692 2024-04-19T02:17:46.041 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.042 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.042 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:46.042 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.183344+0000", 2024-04-19T02:17:46.042 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0024231669999999999 2024-04-19T02:17:46.042 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.042 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.042 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:46.042 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202196+0000", 2024-04-19T02:17:46.042 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.018852384 2024-04-19T02:17:46.042 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.042 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.042 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:46.042 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202241+0000", 2024-04-19T02:17:46.043 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4923999999999999e-05 2024-04-19T02:17:46.043 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.043 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.043 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:46.043 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202280+0000", 2024-04-19T02:17:46.043 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9096e-05 2024-04-19T02:17:46.043 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:46.043 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:46.043 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:46.043 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.043 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.043 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:104431 5.8 5:14818e19:::benchmark_data_smithi121_44835_object104430:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T02:17:46.043 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:17:46.043 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 65.811746589999998, 2024-04-19T02:17:46.044 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022149528000000002, 2024-04-19T02:17:46.044 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:46.044 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:46.044 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:46.044 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:46.044 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:46.044 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 104431 2024-04-19T02:17:46.044 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.044 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:46.044 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.044 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:46.044 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:17:46.044 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:46.044 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.044 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.045 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:46.045 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:17:46.045 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:46.045 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.045 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.045 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:46.045 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211384+0000", 2024-04-19T02:17:46.045 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:46.045 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.045 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.045 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:46.045 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211458+0000", 2024-04-19T02:17:46.045 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3311000000000003e-05 2024-04-19T02:17:46.045 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.046 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.046 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:46.046 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211471+0000", 2024-04-19T02:17:46.046 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.3308e-05 2024-04-19T02:17:46.046 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.046 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.046 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.046 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211479+0000", 2024-04-19T02:17:46.046 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0909999999999993e-06 2024-04-19T02:17:46.046 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.046 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.046 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:46.046 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.221821+0000", 2024-04-19T02:17:46.046 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010341596999999999 2024-04-19T02:17:46.046 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.047 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.047 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:46.047 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.221966+0000", 2024-04-19T02:17:46.047 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000145167 2024-04-19T02:17:46.047 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.047 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.047 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:46.047 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.222077+0000", 2024-04-19T02:17:46.047 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011128000000000001 2024-04-19T02:17:46.047 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.047 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.047 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:46.047 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.228126+0000", 2024-04-19T02:17:46.047 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0060486710000000003 2024-04-19T02:17:46.047 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.048 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.048 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:46.048 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233449+0000", 2024-04-19T02:17:46.048 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0053231370000000004 2024-04-19T02:17:46.048 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.048 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.048 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:46.048 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233498+0000", 2024-04-19T02:17:46.048 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8798999999999998e-05 2024-04-19T02:17:46.048 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.048 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.048 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:46.048 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233535+0000", 2024-04-19T02:17:46.048 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7119000000000002e-05 2024-04-19T02:17:46.048 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:46.049 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:46.049 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:46.049 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.049 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.049 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157437 5.e 5:78833a3d:::benchmark_data_smithi121_44835_object23402:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:46.049 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.859854+0000", 2024-04-19T02:17:46.049 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 39.163277817999997, 2024-04-19T02:17:46.049 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.025859589999999998, 2024-04-19T02:17:46.049 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:46.049 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:46.049 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:46.049 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:46.049 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:46.049 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157437 2024-04-19T02:17:46.049 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.050 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:46.050 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.050 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:46.050 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859854+0000", 2024-04-19T02:17:46.050 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:46.050 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.050 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.050 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:46.050 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859854+0000", 2024-04-19T02:17:46.050 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:46.050 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.050 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.050 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:46.050 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859853+0000", 2024-04-19T02:17:46.051 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:46.051 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.051 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.051 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:46.051 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859857+0000", 2024-04-19T02:17:46.051 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8789999999999996e-06 2024-04-19T02:17:46.051 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.051 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.051 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:46.051 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859865+0000", 2024-04-19T02:17:46.051 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.1880000000000002e-06 2024-04-19T02:17:46.051 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.051 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.051 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.051 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859873+0000", 2024-04-19T02:17:46.052 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.2980000000000003e-06 2024-04-19T02:17:46.052 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.052 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.052 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:46.052 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859908+0000", 2024-04-19T02:17:46.052 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5682999999999997e-05 2024-04-19T02:17:46.052 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.052 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.052 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:46.052 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.860046+0000", 2024-04-19T02:17:46.052 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013714200000000001 2024-04-19T02:17:46.052 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.052 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.053 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:46.053 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.860153+0000", 2024-04-19T02:17:46.053 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010725700000000001 2024-04-19T02:17:46.053 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.053 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.053 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:46.053 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.862008+0000", 2024-04-19T02:17:46.053 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001855179 2024-04-19T02:17:46.053 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.053 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.053 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:46.053 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.885629+0000", 2024-04-19T02:17:46.053 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.023621428 2024-04-19T02:17:46.053 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.053 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.054 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:46.054 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.885676+0000", 2024-04-19T02:17:46.054 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.6371e-05 2024-04-19T02:17:46.054 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.054 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.054 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:46.054 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.885714+0000", 2024-04-19T02:17:46.054 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7907000000000001e-05 2024-04-19T02:17:46.054 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:46.054 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:46.054 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:46.054 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.054 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.054 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157438 5.0 5:01944e77:::benchmark_data_smithi121_44835_object23403:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:46.055 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.864095+0000", 2024-04-19T02:17:46.055 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 39.159036534000002, 2024-04-19T02:17:46.055 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.032015298999999997, 2024-04-19T02:17:46.055 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:46.055 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:46.055 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:46.055 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:46.055 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:46.055 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157438 2024-04-19T02:17:46.055 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.055 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:46.055 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.055 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:46.055 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864095+0000", 2024-04-19T02:17:46.056 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:46.056 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.056 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.056 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:46.056 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864095+0000", 2024-04-19T02:17:46.056 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:46.056 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.056 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.056 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:46.056 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864094+0000", 2024-04-19T02:17:46.056 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:46.056 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.056 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.056 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:46.056 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864102+0000", 2024-04-19T02:17:46.057 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.6629999999999993e-06 2024-04-19T02:17:46.057 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.057 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.057 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:46.057 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864113+0000", 2024-04-19T02:17:46.057 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1185999999999999e-05 2024-04-19T02:17:46.057 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.057 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.057 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.057 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864119+0000", 2024-04-19T02:17:46.057 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.224e-06 2024-04-19T02:17:46.057 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.057 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.057 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:46.058 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864151+0000", 2024-04-19T02:17:46.058 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1395e-05 2024-04-19T02:17:46.058 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.058 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.058 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:46.058 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864275+0000", 2024-04-19T02:17:46.058 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012431399999999999 2024-04-19T02:17:46.058 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.058 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.058 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:46.058 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864341+0000", 2024-04-19T02:17:46.058 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6146e-05 2024-04-19T02:17:46.058 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.058 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.059 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:46.059 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.866040+0000", 2024-04-19T02:17:46.059 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016991879999999999 2024-04-19T02:17:46.059 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.059 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.059 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:46.059 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896055+0000", 2024-04-19T02:17:46.059 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.030014886000000001 2024-04-19T02:17:46.059 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.059 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.059 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:46.059 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896087+0000", 2024-04-19T02:17:46.059 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1761000000000003e-05 2024-04-19T02:17:46.059 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.059 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.060 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:46.060 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896111+0000", 2024-04-19T02:17:46.060 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3623999999999999e-05 2024-04-19T02:17:46.060 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:46.060 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:46.060 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:46.060 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.060 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.060 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157439 5.e 5:79eb9d3c:::benchmark_data_smithi121_44835_object23404:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:46.060 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:46.060 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 39.159005458999999, 2024-04-19T02:17:46.060 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.027045244, 2024-04-19T02:17:46.060 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:46.060 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:46.061 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:46.061 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:46.061 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:46.061 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157439 2024-04-19T02:17:46.061 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.061 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:46.061 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.061 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:46.061 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:46.061 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:46.061 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.061 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.061 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:46.061 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:46.061 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:46.062 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.062 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.062 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:46.062 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:46.062 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:46.062 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.062 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.062 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:46.062 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864128+0000", 2024-04-19T02:17:46.062 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.911e-06 2024-04-19T02:17:46.062 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.062 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.062 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:46.062 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864136+0000", 2024-04-19T02:17:46.063 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2609999999999993e-06 2024-04-19T02:17:46.063 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.063 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.063 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.063 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864140+0000", 2024-04-19T02:17:46.063 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5530000000000001e-06 2024-04-19T02:17:46.063 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.063 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.063 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:46.063 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864169+0000", 2024-04-19T02:17:46.063 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.8932e-05 2024-04-19T02:17:46.063 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.063 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.063 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:46.063 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864267+0000", 2024-04-19T02:17:46.064 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7969999999999999e-05 2024-04-19T02:17:46.064 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.064 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.064 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:46.064 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864339+0000", 2024-04-19T02:17:46.064 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.2280999999999995e-05 2024-04-19T02:17:46.064 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.064 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.064 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:46.064 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.865763+0000", 2024-04-19T02:17:46.064 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0014236310000000001 2024-04-19T02:17:46.064 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.064 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.064 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:46.065 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.891093+0000", 2024-04-19T02:17:46.065 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.025330571 2024-04-19T02:17:46.065 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.065 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.065 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:46.065 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.891137+0000", 2024-04-19T02:17:46.065 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3980999999999998e-05 2024-04-19T02:17:46.065 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.065 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.065 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:46.065 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.891172+0000", 2024-04-19T02:17:46.065 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4465000000000003e-05 2024-04-19T02:17:46.065 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:46.065 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:46.066 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:46.066 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.066 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.066 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157442 5.0 5:0062b73f:::benchmark_data_smithi121_44835_object23407:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:46.066 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.867065+0000", 2024-04-19T02:17:46.066 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 39.156066809000002, 2024-04-19T02:17:46.066 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.029165542999999999, 2024-04-19T02:17:46.066 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:46.066 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:46.066 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:46.066 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:46.066 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:46.066 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157442 2024-04-19T02:17:46.066 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.067 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:46.067 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.067 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:46.067 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867065+0000", 2024-04-19T02:17:46.067 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:46.067 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.067 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.067 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:46.067 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867065+0000", 2024-04-19T02:17:46.067 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:46.067 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.067 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.067 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:46.067 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867064+0000", 2024-04-19T02:17:46.068 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:46.068 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.068 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.068 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:46.068 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867069+0000", 2024-04-19T02:17:46.068 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4549999999999997e-06 2024-04-19T02:17:46.068 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.068 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.068 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:46.068 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867080+0000", 2024-04-19T02:17:46.068 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0797e-05 2024-04-19T02:17:46.068 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.068 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.068 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.069 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867088+0000", 2024-04-19T02:17:46.069 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9729999999999997e-06 2024-04-19T02:17:46.069 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.069 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.069 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:46.069 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867121+0000", 2024-04-19T02:17:46.069 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2920000000000003e-05 2024-04-19T02:17:46.069 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.069 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.069 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:46.069 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867203+0000", 2024-04-19T02:17:46.069 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2578999999999997e-05 2024-04-19T02:17:46.069 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.069 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.070 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:46.070 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867386+0000", 2024-04-19T02:17:46.070 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00018237400000000001 2024-04-19T02:17:46.070 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.070 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.070 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:46.070 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.869338+0000", 2024-04-19T02:17:46.070 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0019521160000000001 2024-04-19T02:17:46.070 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.070 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.070 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:46.070 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896150+0000", 2024-04-19T02:17:46.070 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.026812074000000002 2024-04-19T02:17:46.070 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.071 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.071 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:46.071 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896191+0000", 2024-04-19T02:17:46.071 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1192000000000001e-05 2024-04-19T02:17:46.071 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.071 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.071 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:46.071 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896231+0000", 2024-04-19T02:17:46.071 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9764000000000001e-05 2024-04-19T02:17:46.071 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:46.071 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:46.071 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:46.071 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.071 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.072 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157499 5.8 5:1c3aa38a:::benchmark_data_smithi121_44835_object23464:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:46.072 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.913447+0000", 2024-04-19T02:17:46.072 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 39.109685237000001, 2024-04-19T02:17:46.072 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.024508188, 2024-04-19T02:17:46.072 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:46.072 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:46.072 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:46.072 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:46.072 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:46.072 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157499 2024-04-19T02:17:46.072 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.072 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:46.072 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.072 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:46.073 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913447+0000", 2024-04-19T02:17:46.073 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:46.073 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.073 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.073 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:46.073 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913447+0000", 2024-04-19T02:17:46.073 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:46.073 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.073 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.073 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:46.073 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913446+0000", 2024-04-19T02:17:46.073 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:46.073 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.073 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.073 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:46.074 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913451+0000", 2024-04-19T02:17:46.074 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.677e-06 2024-04-19T02:17:46.074 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.074 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.074 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:46.074 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913461+0000", 2024-04-19T02:17:46.074 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.8859999999999999e-06 2024-04-19T02:17:46.074 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.074 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.074 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.074 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913467+0000", 2024-04-19T02:17:46.074 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.0800000000000002e-06 2024-04-19T02:17:46.074 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.074 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.074 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:46.075 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913513+0000", 2024-04-19T02:17:46.075 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.5707000000000001e-05 2024-04-19T02:17:46.075 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.075 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.075 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:46.075 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913637+0000", 2024-04-19T02:17:46.075 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012379200000000001 2024-04-19T02:17:46.075 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.075 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.075 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:46.075 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913747+0000", 2024-04-19T02:17:46.075 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000110071 2024-04-19T02:17:46.075 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.075 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.076 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:46.076 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915674+0000", 2024-04-19T02:17:46.076 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0019270789999999999 2024-04-19T02:17:46.076 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.076 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.076 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:46.076 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937902+0000", 2024-04-19T02:17:46.076 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022228286 2024-04-19T02:17:46.076 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.076 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.076 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:46.076 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937931+0000", 2024-04-19T02:17:46.076 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9122e-05 2024-04-19T02:17:46.076 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.076 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.077 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:46.077 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937955+0000", 2024-04-19T02:17:46.077 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3591000000000002e-05 2024-04-19T02:17:46.077 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:46.077 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:46.077 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:46.077 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.077 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.077 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157500 5.0 5:0969ec74:::benchmark_data_smithi121_44835_object23465:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:46.077 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.913476+0000", 2024-04-19T02:17:46.077 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 39.109656371, 2024-04-19T02:17:46.077 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.024497596, 2024-04-19T02:17:46.077 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:46.077 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:46.077 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:46.078 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:46.078 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:46.078 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157500 2024-04-19T02:17:46.078 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.078 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:46.078 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.078 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:46.078 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913476+0000", 2024-04-19T02:17:46.078 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:46.078 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.078 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.078 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:46.078 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913476+0000", 2024-04-19T02:17:46.078 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:46.079 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.079 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.079 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:46.079 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913475+0000", 2024-04-19T02:17:46.079 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:46.079 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.079 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.079 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:46.079 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913478+0000", 2024-04-19T02:17:46.079 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.2670000000000001e-06 2024-04-19T02:17:46.079 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.079 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.079 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:46.079 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913481+0000", 2024-04-19T02:17:46.080 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6899999999999998e-06 2024-04-19T02:17:46.080 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.080 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.080 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.080 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913485+0000", 2024-04-19T02:17:46.080 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1230000000000002e-06 2024-04-19T02:17:46.080 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.080 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.080 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:46.080 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913526+0000", 2024-04-19T02:17:46.080 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.104e-05 2024-04-19T02:17:46.080 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.080 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.080 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:46.081 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913606+0000", 2024-04-19T02:17:46.081 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9510000000000003e-05 2024-04-19T02:17:46.081 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.081 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.081 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:46.081 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913671+0000", 2024-04-19T02:17:46.081 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.4838000000000005e-05 2024-04-19T02:17:46.081 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.081 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.081 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:46.081 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915348+0000", 2024-04-19T02:17:46.081 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016769860000000001 2024-04-19T02:17:46.081 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.081 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.081 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:46.082 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937897+0000", 2024-04-19T02:17:46.082 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022548902999999999 2024-04-19T02:17:46.082 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.082 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.082 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:46.082 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937938+0000", 2024-04-19T02:17:46.082 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1499999999999999e-05 2024-04-19T02:17:46.082 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.082 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.082 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:46.082 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937973+0000", 2024-04-19T02:17:46.082 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5057e-05 2024-04-19T02:17:46.082 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:46.083 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:46.083 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:46.083 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.083 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.083 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157501 5.4 5:26661819:::benchmark_data_smithi121_44835_object23466:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:46.083 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.914839+0000", 2024-04-19T02:17:46.083 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 39.108293076999999, 2024-04-19T02:17:46.083 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.028504224000000002, 2024-04-19T02:17:46.083 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:46.083 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:46.083 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:46.083 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:46.083 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:46.083 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157501 2024-04-19T02:17:46.083 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.084 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:46.084 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.084 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:46.084 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914839+0000", 2024-04-19T02:17:46.084 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:46.084 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.084 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.084 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:46.084 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914839+0000", 2024-04-19T02:17:46.084 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:46.084 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.084 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.084 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:46.084 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914838+0000", 2024-04-19T02:17:46.085 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:46.085 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.085 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.085 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:46.085 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914841+0000", 2024-04-19T02:17:46.085 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.706e-06 2024-04-19T02:17:46.085 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.085 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.085 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:46.085 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914848+0000", 2024-04-19T02:17:46.085 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.7429999999999996e-06 2024-04-19T02:17:46.085 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.085 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.085 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.085 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914852+0000", 2024-04-19T02:17:46.086 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0810000000000004e-06 2024-04-19T02:17:46.086 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.086 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.086 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:46.086 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914892+0000", 2024-04-19T02:17:46.086 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9957999999999999e-05 2024-04-19T02:17:46.086 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.086 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.086 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:46.086 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915008+0000", 2024-04-19T02:17:46.086 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000116401 2024-04-19T02:17:46.086 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.086 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.086 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:46.087 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915125+0000", 2024-04-19T02:17:46.087 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011622500000000001 2024-04-19T02:17:46.087 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.087 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.087 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:46.087 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916663+0000", 2024-04-19T02:17:46.087 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0015381310000000001 2024-04-19T02:17:46.087 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.087 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.087 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:46.087 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943114+0000", 2024-04-19T02:17:46.087 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.026451125999999998 2024-04-19T02:17:46.087 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.087 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.087 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:46.088 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943245+0000", 2024-04-19T02:17:46.088 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000131645 2024-04-19T02:17:46.088 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.088 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.088 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:46.088 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943343+0000", 2024-04-19T02:17:46.088 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7604999999999998e-05 2024-04-19T02:17:46.088 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:46.088 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:46.088 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:46.088 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.088 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.089 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157507 5.b 5:de8840a2:::benchmark_data_smithi121_44835_object23472:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:46.089 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:46.089 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 39.106728795999999, 2024-04-19T02:17:46.089 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022544518999999999, 2024-04-19T02:17:46.089 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:46.089 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:46.089 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:46.089 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:46.089 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:46.089 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157507 2024-04-19T02:17:46.089 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.089 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:46.089 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.089 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:46.090 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:46.090 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:46.090 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.090 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.090 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:46.090 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:46.090 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:46.090 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.090 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.090 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:46.090 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:46.090 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:46.090 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.090 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.091 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:46.091 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916406+0000", 2024-04-19T02:17:46.091 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4589999999999998e-06 2024-04-19T02:17:46.091 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.091 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.091 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:46.091 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916415+0000", 2024-04-19T02:17:46.091 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3910000000000004e-06 2024-04-19T02:17:46.091 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.091 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.091 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.091 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916421+0000", 2024-04-19T02:17:46.091 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.6130000000000003e-06 2024-04-19T02:17:46.091 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.092 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.092 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:46.092 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916448+0000", 2024-04-19T02:17:46.092 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7277999999999999e-05 2024-04-19T02:17:46.092 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.092 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.092 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:46.092 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916539+0000", 2024-04-19T02:17:46.092 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0855999999999999e-05 2024-04-19T02:17:46.092 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.092 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.092 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:46.092 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916605+0000", 2024-04-19T02:17:46.092 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6141000000000003e-05 2024-04-19T02:17:46.093 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.093 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.093 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:46.093 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918276+0000", 2024-04-19T02:17:46.093 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001670726 2024-04-19T02:17:46.093 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.093 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.093 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:46.093 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.938888+0000", 2024-04-19T02:17:46.093 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020612042000000001 2024-04-19T02:17:46.093 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.093 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.093 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:46.093 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.938924+0000", 2024-04-19T02:17:46.094 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5692999999999999e-05 2024-04-19T02:17:46.094 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.094 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.094 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:46.094 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.938948+0000", 2024-04-19T02:17:46.094 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3879e-05 2024-04-19T02:17:46.094 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:46.094 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:46.094 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:46.094 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.094 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.094 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157509 5.8 5:1dca85d0:::benchmark_data_smithi121_44835_object23474:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:46.094 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:46.094 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 39.104300549999998, 2024-04-19T02:17:46.095 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.024511807, 2024-04-19T02:17:46.095 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:46.095 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:46.095 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:46.095 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:46.095 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:46.095 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157509 2024-04-19T02:17:46.095 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.095 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:46.095 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.095 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:46.095 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:46.095 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:46.095 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.096 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.096 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:46.096 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:46.096 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:46.096 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.096 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.096 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:46.096 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:46.096 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:46.096 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.096 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.096 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:46.096 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918834+0000", 2024-04-19T02:17:46.096 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9409999999999999e-06 2024-04-19T02:17:46.097 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.097 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.097 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:46.097 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918859+0000", 2024-04-19T02:17:46.097 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.5245999999999999e-05 2024-04-19T02:17:46.097 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.097 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.097 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.097 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918864+0000", 2024-04-19T02:17:46.097 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.1819999999999997e-06 2024-04-19T02:17:46.097 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.097 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.097 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:46.098 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918900+0000", 2024-04-19T02:17:46.098 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5327000000000002e-05 2024-04-19T02:17:46.098 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.098 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.098 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:46.098 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.919024+0000", 2024-04-19T02:17:46.098 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012400900000000001 2024-04-19T02:17:46.098 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.098 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.098 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:46.098 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.919136+0000", 2024-04-19T02:17:46.098 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000111987 2024-04-19T02:17:46.098 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.098 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.099 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:46.099 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.922096+0000", 2024-04-19T02:17:46.099 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0029607079999999998 2024-04-19T02:17:46.099 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.099 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.099 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:46.099 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943120+0000", 2024-04-19T02:17:46.099 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.021023995 2024-04-19T02:17:46.099 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.099 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.099 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:46.099 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943255+0000", 2024-04-19T02:17:46.099 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013502100000000001 2024-04-19T02:17:46.100 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.100 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.100 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:46.100 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943343+0000", 2024-04-19T02:17:46.100 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.7931999999999998e-05 2024-04-19T02:17:46.100 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:46.100 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:46.100 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:46.100 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.100 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.100 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:241615 5.d e62/16 5:bc2762a9:::benchmark_data_smithi121_44835_object107580:head v 62'15112, mlcod=62'15108)", 2024-04-19T02:17:46.101 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:38.291278+0000", 2024-04-19T02:17:46.101 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 7.7318543880000004, 2024-04-19T02:17:46.101 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.064975456000000001, 2024-04-19T02:17:46.101 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:46.101 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:46.101 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:46.101 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.101 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:46.101 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.291278+0000", 2024-04-19T02:17:46.101 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:46.101 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.101 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.101 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:46.101 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.291278+0000", 2024-04-19T02:17:46.102 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:46.102 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.102 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.102 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:46.102 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.291277+0000", 2024-04-19T02:17:46.102 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:46.102 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.102 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.102 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:46.102 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.291281+0000", 2024-04-19T02:17:46.102 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8160000000000004e-06 2024-04-19T02:17:46.102 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.102 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.102 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:46.103 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.291291+0000", 2024-04-19T02:17:46.103 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0011e-05 2024-04-19T02:17:46.103 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.103 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.103 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.103 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.291296+0000", 2024-04-19T02:17:46.103 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.9559999999999996e-06 2024-04-19T02:17:46.103 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.103 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.103 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:46.103 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.292800+0000", 2024-04-19T02:17:46.103 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0015041060000000001 2024-04-19T02:17:46.103 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.103 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.104 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:46.104 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.292818+0000", 2024-04-19T02:17:46.104 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.8056000000000001e-05 2024-04-19T02:17:46.104 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.104 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.104 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:46.104 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.356217+0000", 2024-04-19T02:17:46.104 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.063399214999999995 2024-04-19T02:17:46.104 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.104 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.104 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:46.104 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.356253+0000", 2024-04-19T02:17:46.104 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5605999999999998e-05 2024-04-19T02:17:46.104 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:46.105 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:46.105 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:46.105 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.105 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.105 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:241622 5.d e62/16 5:ba16b775:::benchmark_data_smithi121_44835_object107587:head v 62'15113, mlcod=62'15108)", 2024-04-19T02:17:46.105 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:38.292906+0000", 2024-04-19T02:17:46.105 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 7.7302258339999996, 2024-04-19T02:17:46.105 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.068017509000000004, 2024-04-19T02:17:46.105 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:46.105 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:46.105 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:46.105 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.105 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:46.105 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.292906+0000", 2024-04-19T02:17:46.105 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:46.106 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.106 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.106 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:46.106 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.292906+0000", 2024-04-19T02:17:46.106 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:46.106 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.106 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.106 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:46.106 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.292906+0000", 2024-04-19T02:17:46.106 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:46.106 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.106 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.106 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:46.106 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.292913+0000", 2024-04-19T02:17:46.107 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1720000000000001e-06 2024-04-19T02:17:46.107 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.107 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.107 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:46.107 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.292918+0000", 2024-04-19T02:17:46.107 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2519999999999999e-06 2024-04-19T02:17:46.107 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.107 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.107 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.107 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.292923+0000", 2024-04-19T02:17:46.107 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4710000000000001e-06 2024-04-19T02:17:46.107 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.107 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.107 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:46.108 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.294510+0000", 2024-04-19T02:17:46.108 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001587822 2024-04-19T02:17:46.108 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.108 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.108 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:46.108 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.294528+0000", 2024-04-19T02:17:46.108 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.7234000000000001e-05 2024-04-19T02:17:46.108 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.108 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.108 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:46.108 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.360893+0000", 2024-04-19T02:17:46.108 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.066365882000000001 2024-04-19T02:17:46.108 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.108 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.109 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:46.109 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.360924+0000", 2024-04-19T02:17:46.109 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0139000000000001e-05 2024-04-19T02:17:46.109 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:46.109 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:46.109 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:46.109 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.109 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.109 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:241631 5.1 5:89a96e22:::benchmark_data_smithi121_44835_object107596:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:46.109 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:38.293316+0000", 2024-04-19T02:17:46.109 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 7.7298155089999998, 2024-04-19T02:17:46.109 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.066515056000000003, 2024-04-19T02:17:46.109 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:46.109 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:46.109 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:46.110 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:46.110 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:46.110 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 241631 2024-04-19T02:17:46.110 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.110 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:46.110 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.110 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:46.110 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293316+0000", 2024-04-19T02:17:46.110 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:46.110 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.110 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.110 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:46.110 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293316+0000", 2024-04-19T02:17:46.110 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:46.111 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.111 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.111 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:46.113 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293315+0000", 2024-04-19T02:17:46.113 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:46.114 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.114 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.114 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:46.114 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293321+0000", 2024-04-19T02:17:46.114 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.1390000000000003e-06 2024-04-19T02:17:46.114 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.114 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.114 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:46.114 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293331+0000", 2024-04-19T02:17:46.114 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.9690000000000006e-06 2024-04-19T02:17:46.114 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.114 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.114 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.115 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293338+0000", 2024-04-19T02:17:46.115 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.0559999999999999e-06 2024-04-19T02:17:46.115 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.115 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.115 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:46.115 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293365+0000", 2024-04-19T02:17:46.115 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7546e-05 2024-04-19T02:17:46.115 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.115 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.115 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:46.115 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293445+0000", 2024-04-19T02:17:46.115 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9387000000000004e-05 2024-04-19T02:17:46.115 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.115 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.115 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:46.116 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.359712+0000", 2024-04-19T02:17:46.116 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.066267197 2024-04-19T02:17:46.116 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.116 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.116 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:46.116 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.359757+0000", 2024-04-19T02:17:46.116 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4768000000000002e-05 2024-04-19T02:17:46.116 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.116 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.116 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:46.116 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.359831+0000", 2024-04-19T02:17:46.116 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.4935e-05 2024-04-19T02:17:46.116 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:46.116 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:46.117 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:46.117 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.117 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.117 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:241633 5.8 5:16311ac0:::benchmark_data_smithi121_44835_object107598:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:46.117 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:38.293861+0000", 2024-04-19T02:17:46.117 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 7.7292705579999996, 2024-04-19T02:17:46.117 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.066819026000000004, 2024-04-19T02:17:46.117 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:46.117 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:46.117 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:46.117 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:46.117 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:46.117 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 241633 2024-04-19T02:17:46.117 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.118 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:46.118 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.118 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:46.118 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293861+0000", 2024-04-19T02:17:46.118 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:46.118 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.118 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.118 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:46.118 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293861+0000", 2024-04-19T02:17:46.118 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:46.118 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.118 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.118 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:46.118 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293861+0000", 2024-04-19T02:17:46.119 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:46.119 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.119 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.119 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:46.119 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293863+0000", 2024-04-19T02:17:46.119 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.9690000000000001e-06 2024-04-19T02:17:46.119 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.119 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.119 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:46.119 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293867+0000", 2024-04-19T02:17:46.119 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5889999999999999e-06 2024-04-19T02:17:46.119 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.119 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.119 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.119 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293870+0000", 2024-04-19T02:17:46.120 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0110000000000001e-06 2024-04-19T02:17:46.120 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.120 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.120 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:46.120 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293905+0000", 2024-04-19T02:17:46.120 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5043000000000003e-05 2024-04-19T02:17:46.120 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.120 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.120 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:46.120 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.294020+0000", 2024-04-19T02:17:46.120 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011504400000000001 2024-04-19T02:17:46.120 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.120 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.120 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:46.120 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.360556+0000", 2024-04-19T02:17:46.121 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.066536559999999995 2024-04-19T02:17:46.121 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.121 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.121 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:46.121 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.360604+0000", 2024-04-19T02:17:46.121 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8152000000000002e-05 2024-04-19T02:17:46.121 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.121 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.121 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:46.121 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.360680+0000", 2024-04-19T02:17:46.121 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.5964999999999995e-05 2024-04-19T02:17:46.121 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:46.121 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:46.121 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:46.122 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.122 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.122 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:241634 5.1 5:8a07564d:::benchmark_data_smithi121_44835_object107599:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:46.122 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:38.293914+0000", 2024-04-19T02:17:46.122 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 7.7292177679999998, 2024-04-19T02:17:46.122 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.066174561000000007, 2024-04-19T02:17:46.122 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:46.122 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:46.122 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:46.122 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:46.122 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:46.122 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 241634 2024-04-19T02:17:46.122 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.122 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:46.123 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.123 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:46.123 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293914+0000", 2024-04-19T02:17:46.123 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:46.123 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.123 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.123 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:46.123 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293914+0000", 2024-04-19T02:17:46.123 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:46.123 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.123 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.123 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:46.123 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293914+0000", 2024-04-19T02:17:46.123 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:46.124 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.124 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.124 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:46.124 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293916+0000", 2024-04-19T02:17:46.124 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7240000000000001e-06 2024-04-19T02:17:46.124 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.124 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.124 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:46.124 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293921+0000", 2024-04-19T02:17:46.124 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2309999999999998e-06 2024-04-19T02:17:46.124 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.124 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.124 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.124 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293924+0000", 2024-04-19T02:17:46.125 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5810000000000001e-06 2024-04-19T02:17:46.125 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.125 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.125 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:46.125 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.295125+0000", 2024-04-19T02:17:46.125 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0012006759999999999 2024-04-19T02:17:46.125 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.125 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.125 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:46.125 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.295201+0000", 2024-04-19T02:17:46.125 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.5847999999999996e-05 2024-04-19T02:17:46.125 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.125 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.125 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:46.125 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.359977+0000", 2024-04-19T02:17:46.126 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.064775852999999994 2024-04-19T02:17:46.126 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.126 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.126 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:46.126 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.360019+0000", 2024-04-19T02:17:46.126 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2821999999999998e-05 2024-04-19T02:17:46.126 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.126 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.126 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:46.126 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.360089+0000", 2024-04-19T02:17:46.126 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.9356999999999993e-05 2024-04-19T02:17:46.126 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:46.126 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:46.126 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:46.127 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.127 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.127 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:241635 5.8 5:1c80e285:::benchmark_data_smithi121_44835_object107600:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:46.127 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:38.295774+0000", 2024-04-19T02:17:46.127 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 7.7273580559999999, 2024-04-19T02:17:46.127 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.065098854999999997, 2024-04-19T02:17:46.127 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:46.127 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:46.127 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:46.127 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:46.127 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:46.127 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 241635 2024-04-19T02:17:46.127 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.127 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:46.127 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.128 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:46.128 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.295774+0000", 2024-04-19T02:17:46.128 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:46.128 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.128 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.128 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:46.128 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.295774+0000", 2024-04-19T02:17:46.128 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:46.128 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.128 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.128 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:46.128 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.295773+0000", 2024-04-19T02:17:46.128 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:46.128 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.129 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.129 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:46.129 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.295779+0000", 2024-04-19T02:17:46.129 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.1e-06 2024-04-19T02:17:46.129 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.129 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.129 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:46.129 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.295789+0000", 2024-04-19T02:17:46.129 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.815e-06 2024-04-19T02:17:46.129 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.129 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.129 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.129 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.295796+0000", 2024-04-19T02:17:46.129 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3479999999999998e-06 2024-04-19T02:17:46.130 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.130 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.130 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:46.130 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.295823+0000", 2024-04-19T02:17:46.130 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.6400000000000001e-05 2024-04-19T02:17:46.130 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.130 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.130 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:46.130 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.356276+0000", 2024-04-19T02:17:46.130 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.060453042999999998 2024-04-19T02:17:46.130 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.130 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.130 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:46.130 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.360756+0000", 2024-04-19T02:17:46.131 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0044805879999999998 2024-04-19T02:17:46.131 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.131 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.131 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:46.131 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.360799+0000", 2024-04-19T02:17:46.131 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2407999999999998e-05 2024-04-19T02:17:46.131 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.131 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.131 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:46.131 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.360873+0000", 2024-04-19T02:17:46.131 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.4160999999999997e-05 2024-04-19T02:17:46.131 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:46.131 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:46.131 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:46.132 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.132 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.132 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:241637 5.9 e62/16 5:920672c8:::benchmark_data_smithi121_44835_object107602:head v 62'15373, mlcod=62'15371)", 2024-04-19T02:17:46.132 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:38.297900+0000", 2024-04-19T02:17:46.132 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 7.7252321669999997, 2024-04-19T02:17:46.132 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.062258717999999998, 2024-04-19T02:17:46.132 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:46.132 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:46.132 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:46.132 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.132 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:46.132 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.297900+0000", 2024-04-19T02:17:46.132 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:46.132 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.132 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.133 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:46.133 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.297900+0000", 2024-04-19T02:17:46.133 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:46.133 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.133 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.133 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:46.133 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.297899+0000", 2024-04-19T02:17:46.133 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:46.133 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.133 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.133 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:46.133 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.297904+0000", 2024-04-19T02:17:46.133 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.9130000000000002e-06 2024-04-19T02:17:46.133 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.134 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.134 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:46.134 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.356177+0000", 2024-04-19T02:17:46.134 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.058273318999999997 2024-04-19T02:17:46.134 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.134 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.134 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.134 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.356187+0000", 2024-04-19T02:17:46.134 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7599999999999997e-06 2024-04-19T02:17:46.134 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.134 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.134 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:46.134 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.356220+0000", 2024-04-19T02:17:46.134 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2651999999999998e-05 2024-04-19T02:17:46.134 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.135 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.135 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:46.135 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.356251+0000", 2024-04-19T02:17:46.135 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1232999999999997e-05 2024-04-19T02:17:46.135 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.135 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.135 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:46.135 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.360091+0000", 2024-04-19T02:17:46.135 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0038395429999999999 2024-04-19T02:17:46.135 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:46.135 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:46.135 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:46.135 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.360158+0000", 2024-04-19T02:17:46.135 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.7916999999999994e-05 2024-04-19T02:17:46.136 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:46.136 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:46.136 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:46.136 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:46.136 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:46.136 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:17:46.137 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:46.138 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:46.138+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:46.238 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:46.238+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:46.311 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:46.311 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:17:46.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.311 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:263465 5.c 5:329934db:::benchmark_data_smithi121_44835_object129430:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T02:17:46.311 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:46.308327+0000", 2024-04-19T02:17:46.311 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0034430939999999998, 2024-04-19T02:17:46.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0034619680000000002, 2024-04-19T02:17:46.311 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:46.311 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:46.312 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:46.312 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:46.312 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:46.312 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 263465 2024-04-19T02:17:46.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.312 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:46.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:46.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:46.308327+0000", 2024-04-19T02:17:46.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:46.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:46.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:46.308327+0000", 2024-04-19T02:17:46.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:46.313 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.313 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.313 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:46.313 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:46.308327+0000", 2024-04-19T02:17:46.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:46.313 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.313 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.313 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:46.313 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:46.308330+0000", 2024-04-19T02:17:46.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6219999999999998e-06 2024-04-19T02:17:46.313 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.313 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.313 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:46.313 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:46.308337+0000", 2024-04-19T02:17:46.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9519999999999997e-06 2024-04-19T02:17:46.314 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.314 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.314 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.314 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:46.308344+0000", 2024-04-19T02:17:46.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1920000000000002e-06 2024-04-19T02:17:46.314 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.314 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.314 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:46.314 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:46.308384+0000", 2024-04-19T02:17:46.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0714999999999999e-05 2024-04-19T02:17:46.314 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.314 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.314 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:46.314 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:46.308474+0000", 2024-04-19T02:17:46.315 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9680999999999997e-05 2024-04-19T02:17:46.315 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.315 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:46.315 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.315 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:263469 5.6 5:6c8c5125:::benchmark_data_smithi121_44835_object129434:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T02:17:46.315 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:46.308438+0000", 2024-04-19T02:17:46.315 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0033325939999999999, 2024-04-19T02:17:46.315 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033985899999999999, 2024-04-19T02:17:46.315 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:46.315 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:46.315 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:46.315 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:46.315 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:46.316 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 263469 2024-04-19T02:17:46.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.316 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:46.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.316 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:46.316 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:46.308438+0000", 2024-04-19T02:17:46.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:46.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.316 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:46.316 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:46.308438+0000", 2024-04-19T02:17:46.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:46.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.316 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:46.317 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:46.308437+0000", 2024-04-19T02:17:46.317 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:46.317 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.317 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.317 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:46.317 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:46.308441+0000", 2024-04-19T02:17:46.317 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2059999999999999e-06 2024-04-19T02:17:46.317 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.317 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.317 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:46.317 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:46.308446+0000", 2024-04-19T02:17:46.317 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5350000000000004e-06 2024-04-19T02:17:46.317 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.317 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.317 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.318 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:46.308450+0000", 2024-04-19T02:17:46.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.228e-06 2024-04-19T02:17:46.318 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.318 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.318 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:46.318 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:46.308475+0000", 2024-04-19T02:17:46.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4763999999999999e-05 2024-04-19T02:17:46.318 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.318 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.318 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:46.318 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:46.308546+0000", 2024-04-19T02:17:46.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1230999999999996e-05 2024-04-19T02:17:46.318 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.318 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:46.319 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.319 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:263471 5.2 5:42995432:::benchmark_data_smithi121_44835_object129436:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T02:17:46.319 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:46.310012+0000", 2024-04-19T02:17:46.319 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0017582889999999999, 2024-04-19T02:17:46.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001865317, 2024-04-19T02:17:46.319 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:46.319 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:46.319 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:46.319 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:46.319 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:46.319 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 263471 2024-04-19T02:17:46.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.319 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:46.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:46.320 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:46.310012+0000", 2024-04-19T02:17:46.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:46.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:46.320 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:46.310012+0000", 2024-04-19T02:17:46.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:46.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:46.320 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:46.310012+0000", 2024-04-19T02:17:46.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:46.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:46.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:46.310016+0000", 2024-04-19T02:17:46.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0589999999999996e-06 2024-04-19T02:17:46.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:46.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:46.310026+0000", 2024-04-19T02:17:46.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0458e-05 2024-04-19T02:17:46.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:46.310031+0000", 2024-04-19T02:17:46.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8539999999999996e-06 2024-04-19T02:17:46.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.322 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:46.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:46.310072+0000", 2024-04-19T02:17:46.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0658999999999998e-05 2024-04-19T02:17:46.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.322 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:46.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:46.310205+0000", 2024-04-19T02:17:46.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000133048 2024-04-19T02:17:46.322 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.322 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:46.322 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.322 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:263472 5.7 5:ef4e5584:::benchmark_data_smithi121_44835_object129437:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T02:17:46.323 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:46.310045+0000", 2024-04-19T02:17:46.323 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.001725383, 2024-04-19T02:17:46.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0018703979999999999, 2024-04-19T02:17:46.323 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:46.323 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:46.323 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:46.323 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:46.323 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:46.323 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 263472 2024-04-19T02:17:46.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.323 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:46.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:46.323 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:46.310045+0000", 2024-04-19T02:17:46.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:46.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:46.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:46.310045+0000", 2024-04-19T02:17:46.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:46.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:46.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:46.310045+0000", 2024-04-19T02:17:46.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:46.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:46.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:46.310048+0000", 2024-04-19T02:17:46.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0740000000000001e-06 2024-04-19T02:17:46.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:46.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:46.310054+0000", 2024-04-19T02:17:46.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1340000000000001e-06 2024-04-19T02:17:46.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:46.310060+0000", 2024-04-19T02:17:46.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2720000000000003e-06 2024-04-19T02:17:46.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:46.326 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:46.310096+0000", 2024-04-19T02:17:46.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5349999999999999e-05 2024-04-19T02:17:46.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.326 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:46.326 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:46.310203+0000", 2024-04-19T02:17:46.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107778 2024-04-19T02:17:46.326 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.326 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:46.326 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.326 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:263474 5.d 5:bfb7d1f4:::benchmark_data_smithi121_44835_object129439:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T02:17:46.327 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:46.310069+0000", 2024-04-19T02:17:46.327 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0017018949999999999, 2024-04-19T02:17:46.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001885666, 2024-04-19T02:17:46.327 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:46.327 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-04-19T02:17:46.327 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:46.327 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:46.327 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:46.327 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 263474 2024-04-19T02:17:46.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.327 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:46.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.327 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:46.327 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:46.310069+0000", 2024-04-19T02:17:46.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:46.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:46.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:46.310069+0000", 2024-04-19T02:17:46.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:46.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:46.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:46.310068+0000", 2024-04-19T02:17:46.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:46.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:46.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:46.310071+0000", 2024-04-19T02:17:46.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2089999999999999e-06 2024-04-19T02:17:46.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:46.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:46.310076+0000", 2024-04-19T02:17:46.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6119999999999998e-06 2024-04-19T02:17:46.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:46.310081+0000", 2024-04-19T02:17:46.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9069999999999998e-06 2024-04-19T02:17:46.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:46.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:46.310113+0000", 2024-04-19T02:17:46.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2118e-05 2024-04-19T02:17:46.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:46.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:46.310229+0000", 2024-04-19T02:17:46.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011564499999999999 2024-04-19T02:17:46.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:46.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:46.310294+0000", 2024-04-19T02:17:46.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5086000000000007e-05 2024-04-19T02:17:46.330 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.330 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:46.330 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.330 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:263477 5.5 5:a2a49cf7:::benchmark_data_smithi121_44835_object129442:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T02:17:46.331 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:46.310296+0000", 2024-04-19T02:17:46.331 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.001474092, 2024-04-19T02:17:46.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001699028, 2024-04-19T02:17:46.331 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:46.331 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-04-19T02:17:46.331 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:46.331 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:46.331 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:46.331 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 263477 2024-04-19T02:17:46.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.331 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:46.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.331 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:46.331 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:46.310296+0000", 2024-04-19T02:17:46.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:46.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.332 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:46.332 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:46.310296+0000", 2024-04-19T02:17:46.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:46.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.332 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:46.332 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:46.310296+0000", 2024-04-19T02:17:46.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:46.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.332 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:46.332 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:46.310300+0000", 2024-04-19T02:17:46.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8809999999999998e-06 2024-04-19T02:17:46.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:46.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:46.310306+0000", 2024-04-19T02:17:46.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5409999999999997e-06 2024-04-19T02:17:46.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:46.310311+0000", 2024-04-19T02:17:46.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5029999999999999e-06 2024-04-19T02:17:46.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:46.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:46.310349+0000", 2024-04-19T02:17:46.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7697999999999997e-05 2024-04-19T02:17:46.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:46.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:46.310459+0000", 2024-04-19T02:17:46.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000110111 2024-04-19T02:17:46.334 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.334 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:46.334 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.334 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.334 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-04-19T02:17:46.334 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 6 2024-04-19T02:17:46.334 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:46.335 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:46.377 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T02:17:46.379 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:46.379+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:46.441 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:46.441+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:46.501 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:46.501 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-04-19T02:17:46.501 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-04-19T02:17:46.502 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-04-19T02:17:46.502 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:46.514 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:46.555 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:46.555+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:46.642 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:46.642+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:46.733 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:46.733 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-04-19T02:17:46.733 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-04-19T02:17:46.733 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:17:46.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.733 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168381 5.d 5:bcbab0e3:::benchmark_data_smithi121_44835_object34346:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:46.733 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:46.733 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.661867891, 2024-04-19T02:17:46.734 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050574694000000003, 2024-04-19T02:17:46.734 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:46.734 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:46.734 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:46.734 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:46.734 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:46.734 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168381 2024-04-19T02:17:46.734 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.734 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:46.734 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.734 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:46.734 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:46.735 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:46.735 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.735 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.735 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:46.735 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:46.735 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:46.735 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.735 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.735 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:46.735 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:46.735 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:46.735 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.735 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.736 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:46.736 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069523+0000", 2024-04-19T02:17:46.736 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.244e-06 2024-04-19T02:17:46.736 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.736 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.736 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:46.736 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069528+0000", 2024-04-19T02:17:46.736 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0669999999999999e-06 2024-04-19T02:17:46.736 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.736 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.736 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.736 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069533+0000", 2024-04-19T02:17:46.736 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4680000000000003e-06 2024-04-19T02:17:46.736 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.736 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.737 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:46.737 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072637+0000", 2024-04-19T02:17:46.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031040429999999999 2024-04-19T02:17:46.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.737 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.737 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:46.737 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072710+0000", 2024-04-19T02:17:46.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3045000000000003e-05 2024-04-19T02:17:46.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.737 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.737 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:46.737 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072775+0000", 2024-04-19T02:17:46.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5034000000000001e-05 2024-04-19T02:17:46.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.738 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:46.738 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119925+0000", 2024-04-19T02:17:46.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.047150594999999997 2024-04-19T02:17:46.738 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.738 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:46.738 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120055+0000", 2024-04-19T02:17:46.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129288 2024-04-19T02:17:46.738 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.738 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:46.739 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120077+0000", 2024-04-19T02:17:46.739 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1759e-05 2024-04-19T02:17:46.739 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.739 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.739 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:46.739 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120096+0000", 2024-04-19T02:17:46.739 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9524000000000001e-05 2024-04-19T02:17:46.739 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.739 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:46.739 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.739 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.739 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.739 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168383 5.d 5:bbd9496c:::benchmark_data_smithi121_44835_object34348:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:46.739 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069581+0000", 2024-04-19T02:17:46.739 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.661808596, 2024-04-19T02:17:46.740 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050607278999999998, 2024-04-19T02:17:46.740 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:46.740 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:46.740 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:46.740 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:46.740 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:46.740 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168383 2024-04-19T02:17:46.740 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.740 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:46.740 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.740 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:46.740 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069581+0000", 2024-04-19T02:17:46.740 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:46.740 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.741 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:46.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069581+0000", 2024-04-19T02:17:46.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:46.741 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.741 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:46.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069580+0000", 2024-04-19T02:17:46.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:46.741 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.741 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:46.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069589+0000", 2024-04-19T02:17:46.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6750000000000008e-06 2024-04-19T02:17:46.741 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.742 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.742 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:46.742 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069596+0000", 2024-04-19T02:17:46.742 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7360000000000004e-06 2024-04-19T02:17:46.742 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.742 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.742 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.742 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069601+0000", 2024-04-19T02:17:46.742 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0479999999999998e-06 2024-04-19T02:17:46.742 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.743 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.743 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:46.743 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.073854+0000", 2024-04-19T02:17:46.743 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042531920000000003 2024-04-19T02:17:46.743 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.743 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.743 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:46.743 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.073952+0000", 2024-04-19T02:17:46.743 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7851999999999998e-05 2024-04-19T02:17:46.743 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.743 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.743 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:46.743 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074012+0000", 2024-04-19T02:17:46.743 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0225e-05 2024-04-19T02:17:46.744 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:46.744 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120102+0000", 2024-04-19T02:17:46.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.046090150000000003 2024-04-19T02:17:46.744 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:46.744 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120129+0000", 2024-04-19T02:17:46.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7228000000000001e-05 2024-04-19T02:17:46.744 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:46.744 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120157+0000", 2024-04-19T02:17:46.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7165000000000002e-05 2024-04-19T02:17:46.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.745 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:46.745 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120188+0000", 2024-04-19T02:17:46.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1418000000000003e-05 2024-04-19T02:17:46.745 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.745 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:46.745 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.745 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168385 5.d 5:b22d7e69:::benchmark_data_smithi121_44835_object34350:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:46.745 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:46.745 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.661754104000003, 2024-04-19T02:17:46.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.055438508999999997, 2024-04-19T02:17:46.745 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:46.746 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:46.746 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:46.746 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:46.746 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:46.746 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168385 2024-04-19T02:17:46.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.746 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:46.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.746 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:46.746 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:46.746 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:46.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.747 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:46.747 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:46.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:46.747 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.747 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:46.747 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:46.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:46.747 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.748 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:46.748 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069637+0000", 2024-04-19T02:17:46.748 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.576e-06 2024-04-19T02:17:46.748 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.748 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.748 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:46.749 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069643+0000", 2024-04-19T02:17:46.749 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8030000000000002e-06 2024-04-19T02:17:46.749 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.749 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.749 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069648+0000", 2024-04-19T02:17:46.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0889999999999999e-06 2024-04-19T02:17:46.750 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.750 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:46.750 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117534+0000", 2024-04-19T02:17:46.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.047886390000000001 2024-04-19T02:17:46.750 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.750 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:46.750 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117670+0000", 2024-04-19T02:17:46.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000135969 2024-04-19T02:17:46.751 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.751 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:46.751 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117803+0000", 2024-04-19T02:17:46.751 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000132955 2024-04-19T02:17:46.751 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.751 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:46.751 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120501+0000", 2024-04-19T02:17:46.751 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026978050000000002 2024-04-19T02:17:46.751 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.751 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:46.752 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.125026+0000", 2024-04-19T02:17:46.752 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045244589999999998 2024-04-19T02:17:46.752 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.752 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.752 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:46.752 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.125049+0000", 2024-04-19T02:17:46.752 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3807000000000001e-05 2024-04-19T02:17:46.752 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.752 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.752 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:46.753 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.125074+0000", 2024-04-19T02:17:46.753 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4175000000000001e-05 2024-04-19T02:17:46.753 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.753 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:46.753 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.753 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.753 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.753 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168386 5.5 5:a2cda182:::benchmark_data_smithi121_44835_object34351:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:46.753 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069653+0000", 2024-04-19T02:17:46.753 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.661736636999997, 2024-04-19T02:17:46.753 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058748884000000001, 2024-04-19T02:17:46.753 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:46.753 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:46.754 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:46.754 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:46.754 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:46.754 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168386 2024-04-19T02:17:46.754 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.754 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:46.754 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.754 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:46.754 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069653+0000", 2024-04-19T02:17:46.754 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:46.754 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.754 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.754 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:46.754 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069653+0000", 2024-04-19T02:17:46.755 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:46.755 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.755 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:46.755 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069652+0000", 2024-04-19T02:17:46.755 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:46.755 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.755 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:46.755 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069654+0000", 2024-04-19T02:17:46.755 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1220000000000002e-06 2024-04-19T02:17:46.755 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.755 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:46.755 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069660+0000", 2024-04-19T02:17:46.756 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5890000000000002e-06 2024-04-19T02:17:46.756 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.756 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.756 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.756 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069665+0000", 2024-04-19T02:17:46.756 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.989e-06 2024-04-19T02:17:46.756 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.756 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.756 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:46.756 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120220+0000", 2024-04-19T02:17:46.756 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050555061999999998 2024-04-19T02:17:46.756 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.756 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.756 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:46.757 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120329+0000", 2024-04-19T02:17:46.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010922200000000001 2024-04-19T02:17:46.757 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.757 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.757 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:46.757 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.128293+0000", 2024-04-19T02:17:46.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079640279999999997 2024-04-19T02:17:46.757 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.757 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.757 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:46.757 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.128336+0000", 2024-04-19T02:17:46.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2245e-05 2024-04-19T02:17:46.757 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.757 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.757 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:46.757 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.128401+0000", 2024-04-19T02:17:46.758 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5975000000000004e-05 2024-04-19T02:17:46.758 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.758 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:46.758 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.758 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.758 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.758 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241615 5.d 5:bc2762a9:::benchmark_data_smithi121_44835_object107580:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:46.758 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.288268+0000", 2024-04-19T02:17:46.758 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.4431212640000002, 2024-04-19T02:17:46.758 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.068304498000000005, 2024-04-19T02:17:46.758 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:46.758 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:46.758 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:46.758 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:46.759 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:46.759 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241615 2024-04-19T02:17:46.759 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.759 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:46.759 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.759 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:46.759 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.288268+0000", 2024-04-19T02:17:46.759 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:46.760 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.760 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.760 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:46.760 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.288268+0000", 2024-04-19T02:17:46.760 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:46.760 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.760 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.760 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:46.760 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.288267+0000", 2024-04-19T02:17:46.760 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:46.760 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.760 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.760 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:46.760 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.288273+0000", 2024-04-19T02:17:46.760 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.823e-06 2024-04-19T02:17:46.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.761 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.761 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:46.761 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.288288+0000", 2024-04-19T02:17:46.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5307000000000001e-05 2024-04-19T02:17:46.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.761 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.761 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.761 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.288296+0000", 2024-04-19T02:17:46.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5689999999999999e-06 2024-04-19T02:17:46.762 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.762 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:46.762 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290508+0000", 2024-04-19T02:17:46.762 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022125589999999998 2024-04-19T02:17:46.762 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.762 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:46.763 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290661+0000", 2024-04-19T02:17:46.763 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015289500000000001 2024-04-19T02:17:46.763 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.763 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.763 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:46.763 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290781+0000", 2024-04-19T02:17:46.763 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000119411 2024-04-19T02:17:46.763 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.763 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.763 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:46.763 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297532+0000", 2024-04-19T02:17:46.763 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0067517819999999996 2024-04-19T02:17:46.763 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.763 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.763 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:46.764 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.356516+0000", 2024-04-19T02:17:46.764 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058983233000000003 2024-04-19T02:17:46.764 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.764 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.764 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:46.764 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.356547+0000", 2024-04-19T02:17:46.764 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1063999999999999e-05 2024-04-19T02:17:46.764 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.764 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.764 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:46.764 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.356572+0000", 2024-04-19T02:17:46.764 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5795999999999998e-05 2024-04-19T02:17:46.764 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.764 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:46.765 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.765 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.765 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.765 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241622 5.d 5:ba16b775:::benchmark_data_smithi121_44835_object107587:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:46.765 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.290616+0000", 2024-04-19T02:17:46.765 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.4407727920000006, 2024-04-19T02:17:46.765 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.070971960000000001, 2024-04-19T02:17:46.765 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:46.765 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:46.765 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:46.765 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:46.765 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:46.765 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241622 2024-04-19T02:17:46.766 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.766 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:46.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.766 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:46.766 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290616+0000", 2024-04-19T02:17:46.766 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:46.766 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.766 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:46.766 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290616+0000", 2024-04-19T02:17:46.766 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:46.766 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.766 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:46.767 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290616+0000", 2024-04-19T02:17:46.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:46.767 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.767 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:46.767 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290619+0000", 2024-04-19T02:17:46.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8169999999999999e-06 2024-04-19T02:17:46.767 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.767 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:46.767 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290625+0000", 2024-04-19T02:17:46.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3759999999999996e-06 2024-04-19T02:17:46.767 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.767 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.768 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290630+0000", 2024-04-19T02:17:46.768 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2179999999999998e-06 2024-04-19T02:17:46.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.768 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.768 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:46.768 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.292551+0000", 2024-04-19T02:17:46.768 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001920185 2024-04-19T02:17:46.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.768 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.768 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:46.768 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.292680+0000", 2024-04-19T02:17:46.768 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012971700000000001 2024-04-19T02:17:46.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.769 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:46.769 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.292794+0000", 2024-04-19T02:17:46.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000114095 2024-04-19T02:17:46.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.769 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:46.769 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297538+0000", 2024-04-19T02:17:46.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00474341 2024-04-19T02:17:46.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.769 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:46.769 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361516+0000", 2024-04-19T02:17:46.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.063978249000000001 2024-04-19T02:17:46.770 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.770 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.770 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:46.770 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361550+0000", 2024-04-19T02:17:46.770 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4069999999999997e-05 2024-04-19T02:17:46.770 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.770 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.770 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:46.770 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361588+0000", 2024-04-19T02:17:46.771 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8349999999999997e-05 2024-04-19T02:17:46.771 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.771 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:46.771 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.771 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.771 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241636 5.d 5:bcce6ec3:::benchmark_data_smithi121_44835_object107601:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:46.771 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.295801+0000", 2024-04-19T02:17:46.771 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.4355880659999993, 2024-04-19T02:17:46.771 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.065904313000000006, 2024-04-19T02:17:46.771 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:46.771 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:46.771 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:46.771 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:46.772 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:46.772 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241636 2024-04-19T02:17:46.772 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.772 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:46.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.772 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:46.772 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295801+0000", 2024-04-19T02:17:46.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:46.772 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.772 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:46.772 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295801+0000", 2024-04-19T02:17:46.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:46.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:46.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295800+0000", 2024-04-19T02:17:46.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:46.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:46.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295806+0000", 2024-04-19T02:17:46.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5230000000000003e-06 2024-04-19T02:17:46.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:46.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295816+0000", 2024-04-19T02:17:46.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.079e-05 2024-04-19T02:17:46.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295825+0000", 2024-04-19T02:17:46.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4999999999999999e-06 2024-04-19T02:17:46.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:46.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.296001+0000", 2024-04-19T02:17:46.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017568600000000001 2024-04-19T02:17:46.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:46.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.296093+0000", 2024-04-19T02:17:46.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2237999999999993e-05 2024-04-19T02:17:46.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:46.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.296155+0000", 2024-04-19T02:17:46.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2281999999999998e-05 2024-04-19T02:17:46.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:46.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.299187+0000", 2024-04-19T02:17:46.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003031906 2024-04-19T02:17:46.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.776 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:46.776 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361624+0000", 2024-04-19T02:17:46.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.062437318999999998 2024-04-19T02:17:46.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.776 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:46.776 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361669+0000", 2024-04-19T02:17:46.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4197999999999999e-05 2024-04-19T02:17:46.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.776 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:46.777 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361705+0000", 2024-04-19T02:17:46.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6980999999999997e-05 2024-04-19T02:17:46.777 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.777 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:46.777 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.777 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.777 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.777 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241637 5.9 5:920672c8:::benchmark_data_smithi121_44835_object107602:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:46.777 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.295834+0000", 2024-04-19T02:17:46.777 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.4355549399999994, 2024-04-19T02:17:46.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.064579527999999997, 2024-04-19T02:17:46.777 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:46.777 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:46.777 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:46.777 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:46.778 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:46.778 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241637 2024-04-19T02:17:46.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.778 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:46.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:46.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295834+0000", 2024-04-19T02:17:46.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:46.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:46.779 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295834+0000", 2024-04-19T02:17:46.779 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:46.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:46.779 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295834+0000", 2024-04-19T02:17:46.779 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:46.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:46.779 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295836+0000", 2024-04-19T02:17:46.779 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4389999999999999e-06 2024-04-19T02:17:46.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:46.780 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295843+0000", 2024-04-19T02:17:46.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1759999999999998e-06 2024-04-19T02:17:46.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.780 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.780 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295847+0000", 2024-04-19T02:17:46.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7949999999999998e-06 2024-04-19T02:17:46.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.780 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:46.780 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295899+0000", 2024-04-19T02:17:46.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1579999999999997e-05 2024-04-19T02:17:46.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.781 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:46.781 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.296009+0000", 2024-04-19T02:17:46.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000110006 2024-04-19T02:17:46.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.781 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:46.781 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.296109+0000", 2024-04-19T02:17:46.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100035 2024-04-19T02:17:46.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.781 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:46.781 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.299700+0000", 2024-04-19T02:17:46.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035907999999999999 2024-04-19T02:17:46.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.782 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.782 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:46.782 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.360358+0000", 2024-04-19T02:17:46.782 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060657889 2024-04-19T02:17:46.782 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.782 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.782 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:46.782 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.360387+0000", 2024-04-19T02:17:46.782 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9492000000000002e-05 2024-04-19T02:17:46.782 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.782 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.782 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:46.782 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.360414+0000", 2024-04-19T02:17:46.783 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6631999999999998e-05 2024-04-19T02:17:46.783 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.783 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:46.783 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.783 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.783 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.783 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241638 5.d 5:b857cbeb:::benchmark_data_smithi121_44835_object107603:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:46.783 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.297779+0000", 2024-04-19T02:17:46.783 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.4336098679999996, 2024-04-19T02:17:46.783 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.064037317999999996, 2024-04-19T02:17:46.783 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:46.783 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:46.784 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:46.784 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:46.784 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:46.784 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241638 2024-04-19T02:17:46.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.784 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:46.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.784 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:46.784 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297779+0000", 2024-04-19T02:17:46.784 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:46.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.785 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:46.785 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297779+0000", 2024-04-19T02:17:46.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:46.785 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.785 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.785 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:46.785 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297779+0000", 2024-04-19T02:17:46.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:46.785 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.785 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.785 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:46.785 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297784+0000", 2024-04-19T02:17:46.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3460000000000001e-06 2024-04-19T02:17:46.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.786 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:46.786 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297792+0000", 2024-04-19T02:17:46.786 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0949999999999996e-06 2024-04-19T02:17:46.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.786 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.786 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297799+0000", 2024-04-19T02:17:46.786 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0360000000000001e-06 2024-04-19T02:17:46.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.786 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:46.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297823+0000", 2024-04-19T02:17:46.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3595e-05 2024-04-19T02:17:46.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:46.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297893+0000", 2024-04-19T02:17:46.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0343000000000001e-05 2024-04-19T02:17:46.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:46.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297965+0000", 2024-04-19T02:17:46.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2253000000000001e-05 2024-04-19T02:17:46.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.788 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:46.788 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.300115+0000", 2024-04-19T02:17:46.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021493319999999999 2024-04-19T02:17:46.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.788 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:46.788 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361742+0000", 2024-04-19T02:17:46.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061627511000000003 2024-04-19T02:17:46.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.788 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:46.788 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361780+0000", 2024-04-19T02:17:46.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7759000000000002e-05 2024-04-19T02:17:46.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:46.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361817+0000", 2024-04-19T02:17:46.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6804999999999997e-05 2024-04-19T02:17:46.789 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.789 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:46.789 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.789 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241644 5.9 5:993dd037:::benchmark_data_smithi121_44835_object107609:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:46.789 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.298160+0000", 2024-04-19T02:17:46.789 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.4332288589999997, 2024-04-19T02:17:46.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.062615216000000001, 2024-04-19T02:17:46.789 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:46.790 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:46.790 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:46.790 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:46.790 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:46.790 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241644 2024-04-19T02:17:46.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.790 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:46.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.790 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:46.790 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298160+0000", 2024-04-19T02:17:46.790 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:46.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.790 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:46.791 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298160+0000", 2024-04-19T02:17:46.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:46.791 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.791 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.791 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:46.791 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298160+0000", 2024-04-19T02:17:46.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:46.791 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.791 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.791 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:46.791 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298162+0000", 2024-04-19T02:17:46.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8360000000000001e-06 2024-04-19T02:17:46.791 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.792 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.792 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:46.792 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298167+0000", 2024-04-19T02:17:46.792 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1710000000000001e-06 2024-04-19T02:17:46.792 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.792 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.792 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.792 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298170+0000", 2024-04-19T02:17:46.792 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0740000000000001e-06 2024-04-19T02:17:46.792 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.793 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.793 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:46.793 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298202+0000", 2024-04-19T02:17:46.793 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2163999999999999e-05 2024-04-19T02:17:46.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.793 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.793 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:46.793 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298281+0000", 2024-04-19T02:17:46.794 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8318000000000005e-05 2024-04-19T02:17:46.794 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.794 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.794 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:46.794 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298344+0000", 2024-04-19T02:17:46.794 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2909000000000004e-05 2024-04-19T02:17:46.794 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.794 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.795 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:46.795 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.301043+0000", 2024-04-19T02:17:46.795 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026998159999999998 2024-04-19T02:17:46.795 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.795 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.795 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:46.795 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.360725+0000", 2024-04-19T02:17:46.795 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059681627000000001 2024-04-19T02:17:46.795 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.796 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.796 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:46.796 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.360753+0000", 2024-04-19T02:17:46.796 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8198999999999999e-05 2024-04-19T02:17:46.796 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.796 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.796 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:46.796 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.360776+0000", 2024-04-19T02:17:46.797 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2388e-05 2024-04-19T02:17:46.797 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.797 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:46.797 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.797 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.797 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.797 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241645 5.9 5:935d75f3:::benchmark_data_smithi121_44835_object107610:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:46.797 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.298176+0000", 2024-04-19T02:17:46.797 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.4332136939999991, 2024-04-19T02:17:46.797 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.067784611999999994, 2024-04-19T02:17:46.797 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:46.797 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:46.797 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:46.797 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:46.798 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:46.798 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241645 2024-04-19T02:17:46.798 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.798 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:46.798 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.798 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:46.798 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298176+0000", 2024-04-19T02:17:46.798 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:46.798 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.798 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.798 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:46.798 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298176+0000", 2024-04-19T02:17:46.798 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:46.798 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.798 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.799 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:46.799 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298175+0000", 2024-04-19T02:17:46.799 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:46.799 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.799 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.799 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:46.799 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298177+0000", 2024-04-19T02:17:46.799 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9709999999999998e-06 2024-04-19T02:17:46.799 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.799 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.799 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:46.799 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298183+0000", 2024-04-19T02:17:46.799 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4700000000000001e-06 2024-04-19T02:17:46.799 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.799 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.800 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.800 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298187+0000", 2024-04-19T02:17:46.800 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7249999999999997e-06 2024-04-19T02:17:46.800 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.800 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.800 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:46.800 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.299715+0000", 2024-04-19T02:17:46.800 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001527657 2024-04-19T02:17:46.800 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.800 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.800 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:46.800 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.299790+0000", 2024-04-19T02:17:46.800 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4789999999999994e-05 2024-04-19T02:17:46.800 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.800 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.801 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:46.801 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.299853+0000", 2024-04-19T02:17:46.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2905999999999997e-05 2024-04-19T02:17:46.801 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.801 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:46.801 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.301553+0000", 2024-04-19T02:17:46.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017001609999999999 2024-04-19T02:17:46.801 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.801 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:46.802 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.365904+0000", 2024-04-19T02:17:46.802 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.064351028000000005 2024-04-19T02:17:46.802 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.802 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.802 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:46.802 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.365931+0000", 2024-04-19T02:17:46.802 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6809e-05 2024-04-19T02:17:46.802 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.803 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.803 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:46.803 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.365960+0000", 2024-04-19T02:17:46.803 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9391e-05 2024-04-19T02:17:46.803 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.803 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:46.803 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.803 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.803 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.803 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241652 5.d 5:bbf7ddbb:::benchmark_data_smithi121_44835_object107617:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:46.803 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.309592+0000", 2024-04-19T02:17:46.803 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.4217974760000001, 2024-04-19T02:17:46.803 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.054120610999999999, 2024-04-19T02:17:46.804 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:46.804 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:46.804 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:46.804 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:46.804 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:46.804 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241652 2024-04-19T02:17:46.804 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.804 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:46.805 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.805 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:46.805 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309592+0000", 2024-04-19T02:17:46.805 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:46.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.805 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.805 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:46.805 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309592+0000", 2024-04-19T02:17:46.805 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:46.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.805 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.805 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:46.805 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309591+0000", 2024-04-19T02:17:46.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:46.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.806 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:46.806 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309595+0000", 2024-04-19T02:17:46.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6009999999999999e-06 2024-04-19T02:17:46.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.806 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:46.806 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309603+0000", 2024-04-19T02:17:46.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9319999999999996e-06 2024-04-19T02:17:46.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.807 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.807 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.807 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309608+0000", 2024-04-19T02:17:46.807 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7809999999999996e-06 2024-04-19T02:17:46.807 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.807 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.807 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:46.807 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309635+0000", 2024-04-19T02:17:46.807 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7376e-05 2024-04-19T02:17:46.807 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.807 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.807 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:46.807 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309709+0000", 2024-04-19T02:17:46.807 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4318000000000002e-05 2024-04-19T02:17:46.807 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.808 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.808 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:46.808 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309774+0000", 2024-04-19T02:17:46.808 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5173999999999996e-05 2024-04-19T02:17:46.808 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.808 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.808 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:46.808 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.311459+0000", 2024-04-19T02:17:46.808 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001684269 2024-04-19T02:17:46.808 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.808 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.808 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:46.808 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.363665+0000", 2024-04-19T02:17:46.808 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.052205840000000003 2024-04-19T02:17:46.808 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.808 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.809 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:46.809 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.363694+0000", 2024-04-19T02:17:46.809 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9706999999999999e-05 2024-04-19T02:17:46.809 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.809 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.809 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:46.809 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.363712+0000", 2024-04-19T02:17:46.809 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8144000000000001e-05 2024-04-19T02:17:46.809 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.809 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:46.809 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.810 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.810 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.810 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:262339 5.2 5:4f7a406e:::benchmark_data_smithi121_44835_object128304:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T02:17:46.810 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:45.851345+0000", 2024-04-19T02:17:46.810 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.88004413800000003, 2024-04-19T02:17:46.810 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.064477598999999997, 2024-04-19T02:17:46.810 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:46.810 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:46.810 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:46.810 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:46.811 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:46.811 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 262339 2024-04-19T02:17:46.811 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.811 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:46.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.811 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:46.811 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.851345+0000", 2024-04-19T02:17:46.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:46.811 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.811 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:46.811 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.851345+0000", 2024-04-19T02:17:46.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:46.812 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.812 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.812 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:46.812 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.851345+0000", 2024-04-19T02:17:46.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:46.812 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.812 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.812 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:46.812 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.851347+0000", 2024-04-19T02:17:46.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4619999999999999e-06 2024-04-19T02:17:46.812 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.812 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.812 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:46.812 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.851352+0000", 2024-04-19T02:17:46.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0540000000000002e-06 2024-04-19T02:17:46.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.813 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.851356+0000", 2024-04-19T02:17:46.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6990000000000001e-06 2024-04-19T02:17:46.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:46.813 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.853448+0000", 2024-04-19T02:17:46.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020915730000000002 2024-04-19T02:17:46.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:46.813 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.853593+0000", 2024-04-19T02:17:46.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014543800000000001 2024-04-19T02:17:46.814 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.814 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.814 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:46.814 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915708+0000", 2024-04-19T02:17:46.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.062114765000000002 2024-04-19T02:17:46.814 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.814 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.814 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:46.814 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915749+0000", 2024-04-19T02:17:46.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0926000000000001e-05 2024-04-19T02:17:46.814 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.814 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.815 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:46.815 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915823+0000", 2024-04-19T02:17:46.815 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4040000000000003e-05 2024-04-19T02:17:46.815 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.815 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:46.815 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.815 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.815 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.815 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:262342 5.5 5:af014019:::benchmark_data_smithi121_44835_object128307:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T02:17:46.815 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:45.852022+0000", 2024-04-19T02:17:46.815 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.87936693099999996, 2024-04-19T02:17:46.815 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.063803426999999996, 2024-04-19T02:17:46.815 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:46.815 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:46.815 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:46.816 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:46.816 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:46.816 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 262342 2024-04-19T02:17:46.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.816 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:46.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:46.816 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.852022+0000", 2024-04-19T02:17:46.816 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:46.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:46.816 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.852022+0000", 2024-04-19T02:17:46.816 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:46.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.817 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:46.817 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.852022+0000", 2024-04-19T02:17:46.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:46.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.817 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:46.817 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.852026+0000", 2024-04-19T02:17:46.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1670000000000001e-06 2024-04-19T02:17:46.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.817 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:46.817 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.852033+0000", 2024-04-19T02:17:46.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3730000000000004e-06 2024-04-19T02:17:46.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.852038+0000", 2024-04-19T02:17:46.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9559999999999996e-06 2024-04-19T02:17:46.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:46.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.852076+0000", 2024-04-19T02:17:46.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7429999999999999e-05 2024-04-19T02:17:46.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:46.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.852199+0000", 2024-04-19T02:17:46.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012372899999999999 2024-04-19T02:17:46.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:46.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915689+0000", 2024-04-19T02:17:46.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.063490115999999999 2024-04-19T02:17:46.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:46.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915743+0000", 2024-04-19T02:17:46.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3480000000000003e-05 2024-04-19T02:17:46.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:46.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915826+0000", 2024-04-19T02:17:46.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2830999999999993e-05 2024-04-19T02:17:46.820 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.820 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:46.820 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.820 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.820 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:262344 5.f 5:f913826c:::benchmark_data_smithi121_44835_object128309:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T02:17:46.820 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:45.854353+0000", 2024-04-19T02:17:46.820 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.87703667900000004, 2024-04-19T02:17:46.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061458894999999999, 2024-04-19T02:17:46.820 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:46.820 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:46.820 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:46.820 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:46.821 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:46.821 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 262344 2024-04-19T02:17:46.821 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.821 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:46.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.821 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:46.821 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854353+0000", 2024-04-19T02:17:46.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:46.821 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.821 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:46.821 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854353+0000", 2024-04-19T02:17:46.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:46.821 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.821 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:46.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854352+0000", 2024-04-19T02:17:46.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:46.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.822 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:46.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854356+0000", 2024-04-19T02:17:46.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3039999999999998e-06 2024-04-19T02:17:46.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.822 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:46.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854364+0000", 2024-04-19T02:17:46.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5100000000000001e-06 2024-04-19T02:17:46.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854369+0000", 2024-04-19T02:17:46.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2360000000000004e-06 2024-04-19T02:17:46.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:46.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854396+0000", 2024-04-19T02:17:46.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7487999999999998e-05 2024-04-19T02:17:46.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:46.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854468+0000", 2024-04-19T02:17:46.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1647e-05 2024-04-19T02:17:46.824 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.824 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.824 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:46.824 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854533+0000", 2024-04-19T02:17:46.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4709000000000007e-05 2024-04-19T02:17:46.824 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.824 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.824 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:46.824 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.856402+0000", 2024-04-19T02:17:46.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001868839 2024-04-19T02:17:46.824 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.824 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.824 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:46.824 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915731+0000", 2024-04-19T02:17:46.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059329036000000002 2024-04-19T02:17:46.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.825 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.825 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:46.825 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915774+0000", 2024-04-19T02:17:46.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3599e-05 2024-04-19T02:17:46.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.825 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.825 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:46.825 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915811+0000", 2024-04-19T02:17:46.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7171e-05 2024-04-19T02:17:46.825 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.825 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:46.825 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.826 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.826 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.826 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:262345 5.7 5:e3a7b870:::benchmark_data_smithi121_44835_object128310:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T02:17:46.826 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:45.854376+0000", 2024-04-19T02:17:46.826 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.87701357899999999, 2024-04-19T02:17:46.826 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061557471000000002, 2024-04-19T02:17:46.826 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:46.826 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:46.827 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:46.827 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:46.827 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:46.827 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 262345 2024-04-19T02:17:46.827 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.827 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:46.827 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.827 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:46.827 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854376+0000", 2024-04-19T02:17:46.827 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:46.827 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.827 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.827 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:46.827 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854376+0000", 2024-04-19T02:17:46.828 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:46.828 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.828 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.828 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:46.828 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854375+0000", 2024-04-19T02:17:46.828 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:46.828 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.828 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.828 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:46.828 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854377+0000", 2024-04-19T02:17:46.828 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6700000000000001e-06 2024-04-19T02:17:46.828 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.828 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.828 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:46.829 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854380+0000", 2024-04-19T02:17:46.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3790000000000002e-06 2024-04-19T02:17:46.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.829 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.829 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854383+0000", 2024-04-19T02:17:46.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7439999999999999e-06 2024-04-19T02:17:46.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.829 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:46.829 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854411+0000", 2024-04-19T02:17:46.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7430999999999999e-05 2024-04-19T02:17:46.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.829 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:46.830 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854483+0000", 2024-04-19T02:17:46.830 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2268999999999995e-05 2024-04-19T02:17:46.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.830 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:46.830 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915820+0000", 2024-04-19T02:17:46.830 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061336768 2024-04-19T02:17:46.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.830 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:46.830 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915858+0000", 2024-04-19T02:17:46.830 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7886000000000003e-05 2024-04-19T02:17:46.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.831 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:46.831 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915933+0000", 2024-04-19T02:17:46.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5593000000000006e-05 2024-04-19T02:17:46.831 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.831 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:46.831 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.831 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.831 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.831 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:262346 5.7 5:eee05b20:::benchmark_data_smithi121_44835_object128311:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T02:17:46.831 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:45.854386+0000", 2024-04-19T02:17:46.831 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.87700334700000004, 2024-04-19T02:17:46.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.065671691000000004, 2024-04-19T02:17:46.831 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:46.831 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:46.831 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:46.832 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:46.832 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:46.832 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 262346 2024-04-19T02:17:46.832 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.832 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:46.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.832 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:46.832 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854386+0000", 2024-04-19T02:17:46.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:46.832 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.832 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:46.832 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854386+0000", 2024-04-19T02:17:46.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:46.832 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.833 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:46.833 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854386+0000", 2024-04-19T02:17:46.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967296 2024-04-19T02:17:46.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.833 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:46.833 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854388+0000", 2024-04-19T02:17:46.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9290000000000001e-06 2024-04-19T02:17:46.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.833 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:46.833 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854391+0000", 2024-04-19T02:17:46.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.942e-06 2024-04-19T02:17:46.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854394+0000", 2024-04-19T02:17:46.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0740000000000001e-06 2024-04-19T02:17:46.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:46.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.855841+0000", 2024-04-19T02:17:46.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001447411 2024-04-19T02:17:46.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:46.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.855910+0000", 2024-04-19T02:17:46.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8609999999999995e-05 2024-04-19T02:17:46.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:46.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.919944+0000", 2024-04-19T02:17:46.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.064034663000000006 2024-04-19T02:17:46.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:46.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.919989+0000", 2024-04-19T02:17:46.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4533000000000002e-05 2024-04-19T02:17:46.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.836 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:46.836 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.920058+0000", 2024-04-19T02:17:46.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8756000000000004e-05 2024-04-19T02:17:46.836 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.836 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:46.836 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.836 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.836 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.836 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:262352 5.c 5:3c8d5871:::benchmark_data_smithi121_44835_object128317:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T02:17:46.836 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:45.855299+0000", 2024-04-19T02:17:46.836 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.87609073299999995, 2024-04-19T02:17:46.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060570657999999999, 2024-04-19T02:17:46.836 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:46.836 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:46.837 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:46.837 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:46.837 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:46.837 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 262352 2024-04-19T02:17:46.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.837 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:46.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.837 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:46.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.855299+0000", 2024-04-19T02:17:46.837 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:46.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.837 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:46.838 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.855299+0000", 2024-04-19T02:17:46.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:46.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.838 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:46.838 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.855298+0000", 2024-04-19T02:17:46.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:46.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.838 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:46.839 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.855301+0000", 2024-04-19T02:17:46.839 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.615e-06 2024-04-19T02:17:46.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.839 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.839 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:46.839 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.855305+0000", 2024-04-19T02:17:46.839 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7190000000000001e-06 2024-04-19T02:17:46.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.839 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.839 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.839 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.855309+0000", 2024-04-19T02:17:46.839 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.89e-06 2024-04-19T02:17:46.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.840 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:46.840 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.855340+0000", 2024-04-19T02:17:46.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1192000000000002e-05 2024-04-19T02:17:46.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.840 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:46.840 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.855412+0000", 2024-04-19T02:17:46.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1491999999999999e-05 2024-04-19T02:17:46.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.840 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:46.841 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915748+0000", 2024-04-19T02:17:46.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060335524000000001 2024-04-19T02:17:46.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.841 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:46.841 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915790+0000", 2024-04-19T02:17:46.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2178000000000002e-05 2024-04-19T02:17:46.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.841 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:46.841 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915869+0000", 2024-04-19T02:17:46.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9473000000000003e-05 2024-04-19T02:17:46.842 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.842 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:46.842 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.842 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:262357 5.3 5:c80391af:::benchmark_data_smithi121_44835_object128322:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T02:17:46.842 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:45.857454+0000", 2024-04-19T02:17:46.842 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.87393499600000002, 2024-04-19T02:17:46.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061276328999999997, 2024-04-19T02:17:46.842 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:46.842 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:46.842 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:46.842 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:46.842 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:46.843 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 262357 2024-04-19T02:17:46.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.843 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:46.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.843 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:46.843 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.857454+0000", 2024-04-19T02:17:46.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:46.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.843 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:46.843 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.857454+0000", 2024-04-19T02:17:46.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:46.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.843 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:46.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.857454+0000", 2024-04-19T02:17:46.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:46.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:46.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.857458+0000", 2024-04-19T02:17:46.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0579999999999999e-06 2024-04-19T02:17:46.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:46.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.857465+0000", 2024-04-19T02:17:46.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3379999999999999e-06 2024-04-19T02:17:46.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.845 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.857470+0000", 2024-04-19T02:17:46.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7840000000000003e-06 2024-04-19T02:17:46.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.845 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:46.845 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.857513+0000", 2024-04-19T02:17:46.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3537e-05 2024-04-19T02:17:46.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.845 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:46.845 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.857592+0000", 2024-04-19T02:17:46.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8286000000000002e-05 2024-04-19T02:17:46.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.845 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:46.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.918619+0000", 2024-04-19T02:17:46.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061027286 2024-04-19T02:17:46.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.846 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:46.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.918660+0000", 2024-04-19T02:17:46.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1152000000000002e-05 2024-04-19T02:17:46.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.846 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:46.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.918731+0000", 2024-04-19T02:17:46.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0456000000000004e-05 2024-04-19T02:17:46.846 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.846 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:46.846 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.847 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:262361 5.2 5:4dd4f1fe:::benchmark_data_smithi121_44835_object128326:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T02:17:46.847 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:45.861370+0000", 2024-04-19T02:17:46.847 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.87001902900000005, 2024-04-19T02:17:46.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061639977999999998, 2024-04-19T02:17:46.847 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:46.847 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:46.847 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:46.847 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:46.847 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:46.847 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 262361 2024-04-19T02:17:46.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.847 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:46.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:46.848 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.861370+0000", 2024-04-19T02:17:46.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:46.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:46.848 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.861370+0000", 2024-04-19T02:17:46.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:46.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:46.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.861368+0000", 2024-04-19T02:17:46.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:46.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.849 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:46.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.861382+0000", 2024-04-19T02:17:46.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3103e-05 2024-04-19T02:17:46.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.849 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:46.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915692+0000", 2024-04-19T02:17:46.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.054310768000000002 2024-04-19T02:17:46.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.849 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:46.850 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915703+0000", 2024-04-19T02:17:46.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0637e-05 2024-04-19T02:17:46.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.850 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:46.850 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915853+0000", 2024-04-19T02:17:46.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014972999999999999 2024-04-19T02:17:46.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.850 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:46.850 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915977+0000", 2024-04-19T02:17:46.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012470800000000001 2024-04-19T02:17:46.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:46.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.922943+0000", 2024-04-19T02:17:46.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0069653780000000004 2024-04-19T02:17:46.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:46.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.922969+0000", 2024-04-19T02:17:46.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6531000000000001e-05 2024-04-19T02:17:46.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:46.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:46.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:46.852 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.923010+0000", 2024-04-19T02:17:46.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0859000000000003e-05 2024-04-19T02:17:46.852 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.852 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:46.852 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.852 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:46.852 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:46.852 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:46.853 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:17:46.854 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:46.853+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:46.955 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:46.956+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:47.031 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:17:47.031 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:17:47.031 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:47.031 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:265475 5.0 5:0fca59f3:::benchmark_data_smithi121_44835_object131440:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T02:17:47.031 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:47.027384+0000", 2024-04-19T02:17:47.031 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0042498320000000003, 2024-04-19T02:17:47.031 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0042715449999999999, 2024-04-19T02:17:47.031 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:47.031 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:47.031 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:47.031 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:47.032 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:47.032 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 265475 2024-04-19T02:17:47.032 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:47.032 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:47.032 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:47.032 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:47.032 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:47.027384+0000", 2024-04-19T02:17:47.032 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:47.032 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:47.032 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:47.032 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:47.032 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:47.027384+0000", 2024-04-19T02:17:47.032 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:47.032 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:47.032 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:47.033 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:47.033 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:47.027383+0000", 2024-04-19T02:17:47.033 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:47.033 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:47.033 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:47.033 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:47.033 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:47.027387+0000", 2024-04-19T02:17:47.033 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8310000000000003e-06 2024-04-19T02:17:47.033 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:47.033 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:47.033 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:47.033 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:47.027395+0000", 2024-04-19T02:17:47.033 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.5140000000000004e-06 2024-04-19T02:17:47.033 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:47.034 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:47.034 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:47.034 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:47.027401+0000", 2024-04-19T02:17:47.034 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.105e-06 2024-04-19T02:17:47.034 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:47.034 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:47.034 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:47.034 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:47.027448+0000", 2024-04-19T02:17:47.034 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.6832000000000002e-05 2024-04-19T02:17:47.034 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:47.034 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:47.034 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:47.034 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:47.027559+0000", 2024-04-19T02:17:47.034 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011120600000000001 2024-04-19T02:17:47.035 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:47.035 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:47.035 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:47.035 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:47.035 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:47.035 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:265474 5.f e65/16 5:f45e2deb:::benchmark_data_smithi121_44835_object131439:head v 65'16682, mlcod=65'16680)", 2024-04-19T02:17:47.035 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:47.027593+0000", 2024-04-19T02:17:47.035 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0040408060000000001, 2024-04-19T02:17:47.035 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0041079289999999997, 2024-04-19T02:17:47.035 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:47.035 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:47.036 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:47.036 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:47.036 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:47.036 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:47.027593+0000", 2024-04-19T02:17:47.036 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:47.036 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:47.036 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:47.036 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:47.036 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:47.027593+0000", 2024-04-19T02:17:47.036 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:47.036 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:47.036 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:47.037 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:47.037 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:47.027593+0000", 2024-04-19T02:17:47.037 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:47.037 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:47.037 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:47.037 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:47.037 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:47.027603+0000", 2024-04-19T02:17:47.037 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0139999999999999e-05 2024-04-19T02:17:47.037 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:47.037 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:47.037 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:47.038 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:47.027613+0000", 2024-04-19T02:17:47.038 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0315e-05 2024-04-19T02:17:47.038 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:47.038 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:47.038 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:47.038 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:47.027620+0000", 2024-04-19T02:17:47.038 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.7510000000000002e-06 2024-04-19T02:17:47.038 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:47.038 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:47.038 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:47.038 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:47.029111+0000", 2024-04-19T02:17:47.038 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001490866 2024-04-19T02:17:47.038 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:47.038 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:47.039 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:47.039 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:47.029133+0000", 2024-04-19T02:17:47.039 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.2027000000000001e-05 2024-04-19T02:17:47.039 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:47.039 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:47.039 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:47.039 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:47.039 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:47.039 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:265476 5.f e65/16 5:feb501c3:::benchmark_data_smithi121_44835_object131441:head v 65'16683, mlcod=65'16680)", 2024-04-19T02:17:47.039 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:47.029375+0000", 2024-04-19T02:17:47.039 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0022594859999999998, 2024-04-19T02:17:47.039 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0023616140000000002, 2024-04-19T02:17:47.039 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:47.039 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:47.040 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:47.040 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:47.040 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:47.040 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:47.029375+0000", 2024-04-19T02:17:47.040 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:47.040 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:47.040 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:47.040 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:47.040 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:47.029375+0000", 2024-04-19T02:17:47.040 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:47.040 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:47.040 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:47.040 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:47.040 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:47.029374+0000", 2024-04-19T02:17:47.040 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:47.041 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:47.041 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:47.041 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:47.041 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:47.029384+0000", 2024-04-19T02:17:47.041 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.9259999999999995e-06 2024-04-19T02:17:47.041 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:47.041 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:47.041 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:47.041 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:47.029392+0000", 2024-04-19T02:17:47.041 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.4109999999999996e-06 2024-04-19T02:17:47.041 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:47.041 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:47.041 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:47.041 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:47.029399+0000", 2024-04-19T02:17:47.041 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.5880000000000003e-06 2024-04-19T02:17:47.042 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:47.042 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:47.042 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:47.042 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:47.030683+0000", 2024-04-19T02:17:47.042 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0012844760000000001 2024-04-19T02:17:47.042 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:47.042 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:47.042 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:47.042 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:47.030706+0000", 2024-04-19T02:17:47.042 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3201999999999999e-05 2024-04-19T02:17:47.043 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:47.043 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:47.043 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:47.043 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:47.043 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:47.043 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:265478 5.f e65/16)", 2024-04-19T02:17:47.043 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:47.030656+0000", 2024-04-19T02:17:47.043 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.00097773499999999998, 2024-04-19T02:17:47.043 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001111169, 2024-04-19T02:17:47.043 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:47.043 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "queued for pg", 2024-04-19T02:17:47.044 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:47.044 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:47.044 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:47.044 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:47.030656+0000", 2024-04-19T02:17:47.044 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:47.044 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:47.044 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:47.044 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:47.044 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:47.030656+0000", 2024-04-19T02:17:47.044 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:47.044 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:47.044 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:47.044 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:47.044 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:47.030656+0000", 2024-04-19T02:17:47.044 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:47.045 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:47.045 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:47.045 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:47.045 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:47.030664+0000", 2024-04-19T02:17:47.045 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9009999999999994e-06 2024-04-19T02:17:47.045 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:47.045 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:47.045 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:47.045 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:47.030672+0000", 2024-04-19T02:17:47.045 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0909999999999993e-06 2024-04-19T02:17:47.045 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:47.045 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:47.045 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:47.045 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:47.030678+0000", 2024-04-19T02:17:47.046 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.75e-06 2024-04-19T02:17:47.046 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:47.046 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:47.046 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:47.046 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:47.046 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:47.046 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:265471 5.e 5:70cad14e:::benchmark_data_smithi121_44835_object131436:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T02:17:47.046 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:47.027112+0000", 2024-04-19T02:17:47.046 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.004521901, 2024-04-19T02:17:47.046 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0046861749999999999, 2024-04-19T02:17:47.046 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:47.046 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:47.046 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:47.046 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:47.047 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:47.047 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 265471 2024-04-19T02:17:47.047 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:47.047 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:47.047 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:47.047 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:47.047 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:47.027112+0000", 2024-04-19T02:17:47.047 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:47.047 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:47.047 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:47.047 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:47.047 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:47.027112+0000", 2024-04-19T02:17:47.048 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:47.048 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:47.048 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:47.048 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:47.048 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:47.027112+0000", 2024-04-19T02:17:47.048 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:47.048 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:47.048 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:47.048 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:47.048 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:47.027114+0000", 2024-04-19T02:17:47.048 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.4030000000000001e-06 2024-04-19T02:17:47.048 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:47.048 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:47.049 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:47.049 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:47.027120+0000", 2024-04-19T02:17:47.049 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.2400000000000004e-06 2024-04-19T02:17:47.049 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:47.049 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:47.049 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:47.049 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:47.027126+0000", 2024-04-19T02:17:47.049 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.1599999999999997e-06 2024-04-19T02:17:47.049 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:47.049 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:47.049 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:47.049 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:47.027166+0000", 2024-04-19T02:17:47.049 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0303999999999999e-05 2024-04-19T02:17:47.049 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:47.049 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:47.050 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:47.050 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:47.027309+0000", 2024-04-19T02:17:47.050 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000143368 2024-04-19T02:17:47.050 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:47.050 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:47.050 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:47.050 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:47.050 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:47.050 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:265473 5.e 5:7f96aca0:::benchmark_data_smithi121_44835_object131438:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T02:17:47.050 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:47.027163+0000", 2024-04-19T02:17:47.050 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 0.0044710829999999998, 2024-04-19T02:17:47.050 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00467359, 2024-04-19T02:17:47.050 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:47.050 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "started", 2024-04-19T02:17:47.051 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:47.051 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:47.051 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:47.051 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 265473 2024-04-19T02:17:47.051 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:47.051 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:47.051 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:47.051 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:47.051 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:47.027163+0000", 2024-04-19T02:17:47.051 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:47.051 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:47.051 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:47.051 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:47.051 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:47.027163+0000", 2024-04-19T02:17:47.051 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:47.051 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:47.052 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:47.052 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:47.052 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:47.027162+0000", 2024-04-19T02:17:47.052 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:47.052 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:47.052 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:47.052 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:47.052 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:47.027165+0000", 2024-04-19T02:17:47.052 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.6970000000000002e-06 2024-04-19T02:17:47.052 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:47.052 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:47.052 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:47.052 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:47.027169+0000", 2024-04-19T02:17:47.052 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3499999999999999e-06 2024-04-19T02:17:47.053 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:47.053 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:47.053 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:47.053 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:47.027174+0000", 2024-04-19T02:17:47.053 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.194e-06 2024-04-19T02:17:47.053 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:47.053 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:47.053 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:47.053 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:47.030650+0000", 2024-04-19T02:17:47.053 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0034767579999999999 2024-04-19T02:17:47.053 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:47.053 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:47.053 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:47.053 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:47.030750+0000", 2024-04-19T02:17:47.053 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.9518999999999994e-05 2024-04-19T02:17:47.054 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:47.054 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:47.054 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:47.054 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:47.054 INFO:teuthology.orchestra.run.smithi174.stdout: ], 2024-04-19T02:17:47.054 INFO:teuthology.orchestra.run.smithi174.stdout: "num_ops": 6 2024-04-19T02:17:47.054 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:17:47.055 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:17:47.056 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:47.055+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:47.156 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:47.156+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:47.236 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:17:47.256 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:47.256+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:47.279 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:17:47.279 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [], 2024-04-19T02:17:47.279 INFO:teuthology.orchestra.run.smithi174.stdout: "complaint_time": 30, 2024-04-19T02:17:47.279 INFO:teuthology.orchestra.run.smithi174.stdout: "num_blocked_ops": 0 2024-04-19T02:17:47.279 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:17:47.292 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:17:47.358 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:47.357+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:47.375 INFO:teuthology.orchestra.run.smithi121.stderr:noscrub is unset 2024-04-19T02:17:47.385 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:17:47.407 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:17:47.408 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:17:47.408 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:17:47.408 INFO:teuthology.orchestra.run.smithi121.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T02:17:47.410 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:17:47.410 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:17:47.459 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:47.459+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:47.512 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:47.512 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:47.527 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:47.570 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:47.570+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:47.662 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:47.662+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:47.699 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:47.699 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:47.713 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:47.797 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:47.797+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:47.863 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:47.863+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:47.927 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:47.927 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:47.938 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:47.966 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:47.967+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:47.967 INFO:tasks.radosbench.radosbench.0.smithi121.stdout:Removed 134032 objects 2024-04-19T02:17:47.967 INFO:tasks.radosbench.radosbench.0.smithi121.stdout:Clean up completed and total clean up time :51.931 2024-04-19T02:17:48.068 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:48.068+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:48.105 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:48.105 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:48.116 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:17:48.170 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:48.171+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:48.243 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:48.243 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:48.253 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:17:48.297 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:48.297+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:48.372 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:48.372+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:48.379 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:48.379 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:48.389 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:17:48.474 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:48.474+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:48.555 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:48.556 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:48.565 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:48.607 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:48.607+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:48.675 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:48.675+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:48.699 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:48.699 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:48.709 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:48.776 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:48.775+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:48.836 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:48.836 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:48.845 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:48.877 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:48.877+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:48.978 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:48.978+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:49.012 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:49.012 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:49.022 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:17:49.079 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:49.079+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:49.154 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:49.154 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:49.165 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:17:49.206 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:49.206+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:49.280 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:49.281+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:49.331 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:49.331 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:49.342 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:17:49.369 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~41s 2024-04-19T02:17:49.386 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:49.386+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:49.387 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T02:17:49.412 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T02:17:49.468 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:49.468 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:49.478 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:49.520 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:49.520+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:49.582 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:49.583+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:49.583 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:17:49.602 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:17:49.603 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:17:49.603 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:17:49.603 INFO:teuthology.orchestra.run.smithi121.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T02:17:49.605 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:17:49.606 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:17:49.613 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:49.613 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-04-19T02:17:49.614 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-04-19T02:17:49.614 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:49.623 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:49.683 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:49.684+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:49.750 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:49.750 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-04-19T02:17:49.750 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-04-19T02:17:49.750 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-04-19T02:17:49.750 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:49.760 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:49.784 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:49.784+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:49.885 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:49.885+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:49.890 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:49.890 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-04-19T02:17:49.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-04-19T02:17:49.891 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:17:49.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.891 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168381 5.d 5:bcbab0e3:::benchmark_data_smithi121_44835_object34346:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:49.891 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:49.892 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.819269632999998, 2024-04-19T02:17:49.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050574694000000003, 2024-04-19T02:17:49.892 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:49.892 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:49.892 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:49.892 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:49.893 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:49.893 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168381 2024-04-19T02:17:49.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.893 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:49.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.894 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:49.894 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:49.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:49.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:49.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:49.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:49.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:49.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:49.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:49.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:49.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069523+0000", 2024-04-19T02:17:49.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.244e-06 2024-04-19T02:17:49.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:49.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069528+0000", 2024-04-19T02:17:49.898 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0669999999999999e-06 2024-04-19T02:17:49.898 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.898 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:49.898 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069533+0000", 2024-04-19T02:17:49.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4680000000000003e-06 2024-04-19T02:17:49.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.899 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:49.899 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072637+0000", 2024-04-19T02:17:49.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031040429999999999 2024-04-19T02:17:49.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:49.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072710+0000", 2024-04-19T02:17:49.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3045000000000003e-05 2024-04-19T02:17:49.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:49.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072775+0000", 2024-04-19T02:17:49.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5034000000000001e-05 2024-04-19T02:17:49.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:49.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119925+0000", 2024-04-19T02:17:49.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.047150594999999997 2024-04-19T02:17:49.903 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.903 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.903 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:49.903 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120055+0000", 2024-04-19T02:17:49.903 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129288 2024-04-19T02:17:49.903 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.904 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.904 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:49.904 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120077+0000", 2024-04-19T02:17:49.904 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1759e-05 2024-04-19T02:17:49.904 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.905 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.905 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:49.905 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120096+0000", 2024-04-19T02:17:49.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9524000000000001e-05 2024-04-19T02:17:49.905 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:49.906 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:49.906 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:49.906 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.906 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168383 5.d 5:bbd9496c:::benchmark_data_smithi121_44835_object34348:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:49.906 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069581+0000", 2024-04-19T02:17:49.907 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.819210337999998, 2024-04-19T02:17:49.907 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050607278999999998, 2024-04-19T02:17:49.907 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:49.908 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:49.908 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:49.908 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:49.908 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:49.908 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168383 2024-04-19T02:17:49.908 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.909 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:49.909 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.909 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:49.909 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069581+0000", 2024-04-19T02:17:49.909 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:49.910 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.910 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.910 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:49.910 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069581+0000", 2024-04-19T02:17:49.910 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:49.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.911 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:49.911 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069580+0000", 2024-04-19T02:17:49.911 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:49.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.912 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.912 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:49.912 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069589+0000", 2024-04-19T02:17:49.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6750000000000008e-06 2024-04-19T02:17:49.912 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.913 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.913 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:49.913 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069596+0000", 2024-04-19T02:17:49.913 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7360000000000004e-06 2024-04-19T02:17:49.913 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.913 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.914 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:49.914 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069601+0000", 2024-04-19T02:17:49.914 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0479999999999998e-06 2024-04-19T02:17:49.914 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.914 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.915 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:49.915 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.073854+0000", 2024-04-19T02:17:49.915 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042531920000000003 2024-04-19T02:17:49.915 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.915 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.915 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:49.916 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.073952+0000", 2024-04-19T02:17:49.916 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7851999999999998e-05 2024-04-19T02:17:49.916 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.916 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.916 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:49.917 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074012+0000", 2024-04-19T02:17:49.917 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0225e-05 2024-04-19T02:17:49.917 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.917 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.917 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:49.917 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120102+0000", 2024-04-19T02:17:49.918 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.046090150000000003 2024-04-19T02:17:49.918 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.918 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.918 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:49.918 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120129+0000", 2024-04-19T02:17:49.919 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7228000000000001e-05 2024-04-19T02:17:49.919 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.919 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.919 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:49.919 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120157+0000", 2024-04-19T02:17:49.920 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7165000000000002e-05 2024-04-19T02:17:49.920 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.920 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.920 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:49.920 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120188+0000", 2024-04-19T02:17:49.921 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1418000000000003e-05 2024-04-19T02:17:49.921 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:49.921 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:49.921 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:49.921 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.921 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.922 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168385 5.d 5:b22d7e69:::benchmark_data_smithi121_44835_object34350:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:49.922 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:49.922 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.819155846000001, 2024-04-19T02:17:49.922 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.055438508999999997, 2024-04-19T02:17:49.922 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:49.923 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:49.923 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:49.923 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:49.923 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:49.923 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168385 2024-04-19T02:17:49.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.924 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:49.924 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.924 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:49.924 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:49.924 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:49.925 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.925 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.925 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:49.925 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:49.925 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:49.925 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.926 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.926 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:49.926 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:49.926 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:49.926 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.927 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.927 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:49.927 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069637+0000", 2024-04-19T02:17:49.927 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.576e-06 2024-04-19T02:17:49.927 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.928 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.928 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:49.928 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069643+0000", 2024-04-19T02:17:49.928 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8030000000000002e-06 2024-04-19T02:17:49.928 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.928 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.929 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:49.929 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069648+0000", 2024-04-19T02:17:49.929 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0889999999999999e-06 2024-04-19T02:17:49.929 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.929 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.930 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:49.930 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117534+0000", 2024-04-19T02:17:49.930 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.047886390000000001 2024-04-19T02:17:49.930 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.930 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.930 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:49.931 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117670+0000", 2024-04-19T02:17:49.931 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000135969 2024-04-19T02:17:49.931 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.931 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.931 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:49.932 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117803+0000", 2024-04-19T02:17:49.932 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000132955 2024-04-19T02:17:49.932 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.932 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.932 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:49.932 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120501+0000", 2024-04-19T02:17:49.933 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026978050000000002 2024-04-19T02:17:49.933 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.933 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.933 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:49.933 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.125026+0000", 2024-04-19T02:17:49.933 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045244589999999998 2024-04-19T02:17:49.934 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.934 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.934 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:49.934 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.125049+0000", 2024-04-19T02:17:49.934 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3807000000000001e-05 2024-04-19T02:17:49.935 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.935 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.935 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:49.935 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.125074+0000", 2024-04-19T02:17:49.935 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4175000000000001e-05 2024-04-19T02:17:49.935 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:49.936 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:49.936 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:49.936 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.936 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.936 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168386 5.5 5:a2cda182:::benchmark_data_smithi121_44835_object34351:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:49.937 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069653+0000", 2024-04-19T02:17:49.937 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.819138379000002, 2024-04-19T02:17:49.937 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058748884000000001, 2024-04-19T02:17:49.937 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:49.937 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:49.937 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:49.938 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:49.938 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:49.938 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168386 2024-04-19T02:17:49.938 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.938 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:49.939 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.939 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:49.939 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069653+0000", 2024-04-19T02:17:49.939 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:49.939 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.939 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.940 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:49.940 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069653+0000", 2024-04-19T02:17:49.940 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:49.940 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.940 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.941 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:49.941 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069652+0000", 2024-04-19T02:17:49.941 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:49.941 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.941 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.941 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:49.942 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069654+0000", 2024-04-19T02:17:49.942 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1220000000000002e-06 2024-04-19T02:17:49.942 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.942 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.942 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:49.943 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069660+0000", 2024-04-19T02:17:49.943 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5890000000000002e-06 2024-04-19T02:17:49.943 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.943 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.943 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:49.943 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069665+0000", 2024-04-19T02:17:49.944 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.989e-06 2024-04-19T02:17:49.944 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.944 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.944 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:49.944 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120220+0000", 2024-04-19T02:17:49.945 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050555061999999998 2024-04-19T02:17:49.945 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.945 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.945 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:49.945 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120329+0000", 2024-04-19T02:17:49.945 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010922200000000001 2024-04-19T02:17:49.946 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.946 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.946 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:49.946 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.128293+0000", 2024-04-19T02:17:49.946 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079640279999999997 2024-04-19T02:17:49.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.947 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:49.947 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.128336+0000", 2024-04-19T02:17:49.947 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2245e-05 2024-04-19T02:17:49.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.948 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.948 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:49.948 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.128401+0000", 2024-04-19T02:17:49.948 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5975000000000004e-05 2024-04-19T02:17:49.948 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:49.949 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:49.949 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:49.949 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.949 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.949 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241615 5.d 5:bc2762a9:::benchmark_data_smithi121_44835_object107580:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:49.949 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.288268+0000", 2024-04-19T02:17:49.950 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 11.600523006, 2024-04-19T02:17:49.950 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.068304498000000005, 2024-04-19T02:17:49.950 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:49.950 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:49.950 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:49.951 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:49.951 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:49.951 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241615 2024-04-19T02:17:49.951 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.951 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:49.951 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.952 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:49.952 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.288268+0000", 2024-04-19T02:17:49.952 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:49.952 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.952 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.952 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:49.953 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.288268+0000", 2024-04-19T02:17:49.953 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:49.953 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.953 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.953 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:49.953 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.288267+0000", 2024-04-19T02:17:49.954 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:49.954 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.954 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.954 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:49.954 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.288273+0000", 2024-04-19T02:17:49.955 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.823e-06 2024-04-19T02:17:49.955 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.955 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.955 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:49.955 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.288288+0000", 2024-04-19T02:17:49.956 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5307000000000001e-05 2024-04-19T02:17:49.956 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.956 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.956 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:49.956 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.288296+0000", 2024-04-19T02:17:49.956 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5689999999999999e-06 2024-04-19T02:17:49.957 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.957 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.957 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:49.957 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290508+0000", 2024-04-19T02:17:49.957 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022125589999999998 2024-04-19T02:17:49.958 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.958 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.958 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:49.958 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290661+0000", 2024-04-19T02:17:49.958 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015289500000000001 2024-04-19T02:17:49.959 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.959 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.959 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:49.959 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290781+0000", 2024-04-19T02:17:49.959 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000119411 2024-04-19T02:17:49.959 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.959 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.959 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:49.959 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297532+0000", 2024-04-19T02:17:49.959 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0067517819999999996 2024-04-19T02:17:49.959 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.959 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.960 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:49.960 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.356516+0000", 2024-04-19T02:17:49.960 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058983233000000003 2024-04-19T02:17:49.960 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.960 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.960 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:49.960 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.356547+0000", 2024-04-19T02:17:49.960 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1063999999999999e-05 2024-04-19T02:17:49.960 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.960 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.960 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:49.960 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.356572+0000", 2024-04-19T02:17:49.960 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5795999999999998e-05 2024-04-19T02:17:49.960 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:49.961 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:49.961 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:49.961 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.961 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.961 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241622 5.d 5:ba16b775:::benchmark_data_smithi121_44835_object107587:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:49.961 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.290616+0000", 2024-04-19T02:17:49.961 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 11.598174534, 2024-04-19T02:17:49.961 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.070971960000000001, 2024-04-19T02:17:49.961 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:49.961 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:49.961 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:49.961 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:49.961 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:49.961 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241622 2024-04-19T02:17:49.961 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.962 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:49.962 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.962 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:49.962 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290616+0000", 2024-04-19T02:17:49.962 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:49.962 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.962 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.962 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:49.962 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290616+0000", 2024-04-19T02:17:49.962 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:49.962 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.962 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.962 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:49.962 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290616+0000", 2024-04-19T02:17:49.962 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:49.963 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.963 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.963 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:49.963 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290619+0000", 2024-04-19T02:17:49.963 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8169999999999999e-06 2024-04-19T02:17:49.963 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.963 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.963 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:49.963 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290625+0000", 2024-04-19T02:17:49.963 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3759999999999996e-06 2024-04-19T02:17:49.963 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.963 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.963 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:49.963 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290630+0000", 2024-04-19T02:17:49.963 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2179999999999998e-06 2024-04-19T02:17:49.964 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.964 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.964 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:49.964 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.292551+0000", 2024-04-19T02:17:49.964 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001920185 2024-04-19T02:17:49.964 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.964 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.964 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:49.964 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.292680+0000", 2024-04-19T02:17:49.964 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012971700000000001 2024-04-19T02:17:49.964 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.964 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.964 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:49.964 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.292794+0000", 2024-04-19T02:17:49.964 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000114095 2024-04-19T02:17:49.965 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.965 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.965 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:49.965 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297538+0000", 2024-04-19T02:17:49.965 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00474341 2024-04-19T02:17:49.965 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.965 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.965 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:49.965 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361516+0000", 2024-04-19T02:17:49.965 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.063978249000000001 2024-04-19T02:17:49.965 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.965 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.965 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:49.965 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361550+0000", 2024-04-19T02:17:49.965 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4069999999999997e-05 2024-04-19T02:17:49.966 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.966 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.966 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:49.966 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361588+0000", 2024-04-19T02:17:49.966 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8349999999999997e-05 2024-04-19T02:17:49.966 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:49.966 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:49.966 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:49.966 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.966 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.966 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241636 5.d 5:bcce6ec3:::benchmark_data_smithi121_44835_object107601:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:49.966 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.295801+0000", 2024-04-19T02:17:49.966 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 11.592989808, 2024-04-19T02:17:49.966 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.065904313000000006, 2024-04-19T02:17:49.966 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:49.967 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:49.967 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:49.967 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:49.967 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:49.967 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241636 2024-04-19T02:17:49.967 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.967 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:49.967 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.967 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:49.967 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295801+0000", 2024-04-19T02:17:49.967 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:49.967 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.967 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.967 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:49.968 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295801+0000", 2024-04-19T02:17:49.968 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:49.968 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.968 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.968 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:49.968 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295800+0000", 2024-04-19T02:17:49.968 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:49.968 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.968 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.968 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:49.968 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295806+0000", 2024-04-19T02:17:49.968 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5230000000000003e-06 2024-04-19T02:17:49.968 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.968 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.968 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:49.969 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295816+0000", 2024-04-19T02:17:49.969 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.079e-05 2024-04-19T02:17:49.969 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.969 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.969 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:49.969 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295825+0000", 2024-04-19T02:17:49.969 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4999999999999999e-06 2024-04-19T02:17:49.969 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.969 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.969 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:49.969 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.296001+0000", 2024-04-19T02:17:49.969 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017568600000000001 2024-04-19T02:17:49.969 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.969 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.970 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:49.970 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.296093+0000", 2024-04-19T02:17:49.970 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2237999999999993e-05 2024-04-19T02:17:49.970 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.970 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.970 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:49.970 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.296155+0000", 2024-04-19T02:17:49.970 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2281999999999998e-05 2024-04-19T02:17:49.970 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.970 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.970 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:49.970 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.299187+0000", 2024-04-19T02:17:49.970 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003031906 2024-04-19T02:17:49.970 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.971 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.971 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:49.971 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361624+0000", 2024-04-19T02:17:49.971 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.062437318999999998 2024-04-19T02:17:49.971 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.971 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.971 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:49.971 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361669+0000", 2024-04-19T02:17:49.971 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4197999999999999e-05 2024-04-19T02:17:49.971 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.971 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.971 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:49.971 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361705+0000", 2024-04-19T02:17:49.971 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6980999999999997e-05 2024-04-19T02:17:49.972 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:49.972 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:49.972 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:49.972 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.972 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.972 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241637 5.9 5:920672c8:::benchmark_data_smithi121_44835_object107602:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:49.972 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.295834+0000", 2024-04-19T02:17:49.972 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 11.592956682000001, 2024-04-19T02:17:49.972 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.064579527999999997, 2024-04-19T02:17:49.972 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:49.972 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:49.972 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:49.972 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:49.972 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:49.973 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241637 2024-04-19T02:17:49.973 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.973 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:49.973 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.973 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:49.973 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295834+0000", 2024-04-19T02:17:49.973 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:49.973 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.973 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.973 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:49.973 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295834+0000", 2024-04-19T02:17:49.973 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:49.973 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.974 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.974 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:49.974 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295834+0000", 2024-04-19T02:17:49.974 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:49.974 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.974 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.974 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:49.974 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295836+0000", 2024-04-19T02:17:49.974 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4389999999999999e-06 2024-04-19T02:17:49.974 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.974 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.974 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:49.974 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295843+0000", 2024-04-19T02:17:49.975 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1759999999999998e-06 2024-04-19T02:17:49.975 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.975 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.975 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:49.975 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295847+0000", 2024-04-19T02:17:49.975 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7949999999999998e-06 2024-04-19T02:17:49.975 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.975 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.975 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:49.975 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295899+0000", 2024-04-19T02:17:49.975 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1579999999999997e-05 2024-04-19T02:17:49.975 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.975 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.975 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:49.976 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.296009+0000", 2024-04-19T02:17:49.976 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000110006 2024-04-19T02:17:49.976 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.976 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.976 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:49.976 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.296109+0000", 2024-04-19T02:17:49.976 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100035 2024-04-19T02:17:49.976 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.976 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.976 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:49.976 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.299700+0000", 2024-04-19T02:17:49.976 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035907999999999999 2024-04-19T02:17:49.976 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.976 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.977 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:49.977 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.360358+0000", 2024-04-19T02:17:49.977 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060657889 2024-04-19T02:17:49.977 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.977 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.977 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:49.977 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.360387+0000", 2024-04-19T02:17:49.977 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9492000000000002e-05 2024-04-19T02:17:49.977 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.977 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.977 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:49.977 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.360414+0000", 2024-04-19T02:17:49.977 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6631999999999998e-05 2024-04-19T02:17:49.977 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:49.978 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:49.978 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:49.978 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.978 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.978 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241638 5.d 5:b857cbeb:::benchmark_data_smithi121_44835_object107603:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:49.978 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.297779+0000", 2024-04-19T02:17:49.978 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 11.591011610000001, 2024-04-19T02:17:49.978 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.064037317999999996, 2024-04-19T02:17:49.978 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:49.978 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:49.978 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:49.978 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:49.978 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:49.979 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241638 2024-04-19T02:17:49.979 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.979 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:49.979 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.979 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:49.979 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297779+0000", 2024-04-19T02:17:49.979 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:49.979 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.979 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.979 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:49.979 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297779+0000", 2024-04-19T02:17:49.979 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:49.979 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.979 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.979 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:49.980 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297779+0000", 2024-04-19T02:17:49.980 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:49.980 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.980 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.980 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:49.980 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297784+0000", 2024-04-19T02:17:49.980 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3460000000000001e-06 2024-04-19T02:17:49.980 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.980 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.980 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:49.980 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297792+0000", 2024-04-19T02:17:49.980 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0949999999999996e-06 2024-04-19T02:17:49.980 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.980 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.980 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:49.981 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297799+0000", 2024-04-19T02:17:49.981 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0360000000000001e-06 2024-04-19T02:17:49.981 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.981 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.981 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:49.981 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297823+0000", 2024-04-19T02:17:49.981 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3595e-05 2024-04-19T02:17:49.981 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.981 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.981 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:49.981 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297893+0000", 2024-04-19T02:17:49.981 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0343000000000001e-05 2024-04-19T02:17:49.981 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.981 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.981 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:49.982 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297965+0000", 2024-04-19T02:17:49.982 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2253000000000001e-05 2024-04-19T02:17:49.982 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.982 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.982 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:49.982 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.300115+0000", 2024-04-19T02:17:49.982 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021493319999999999 2024-04-19T02:17:49.982 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.982 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.982 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:49.982 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361742+0000", 2024-04-19T02:17:49.982 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061627511000000003 2024-04-19T02:17:49.982 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.982 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.982 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:49.983 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361780+0000", 2024-04-19T02:17:49.983 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7759000000000002e-05 2024-04-19T02:17:49.983 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.983 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.983 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:49.983 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361817+0000", 2024-04-19T02:17:49.983 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6804999999999997e-05 2024-04-19T02:17:49.983 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:49.983 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:49.983 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:49.983 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.983 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.983 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241644 5.9 5:993dd037:::benchmark_data_smithi121_44835_object107609:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:49.983 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.298160+0000", 2024-04-19T02:17:49.983 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 11.590630601000001, 2024-04-19T02:17:49.984 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.062615216000000001, 2024-04-19T02:17:49.984 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:49.984 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:49.984 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:49.984 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:49.984 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:49.984 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241644 2024-04-19T02:17:49.984 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.984 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:49.984 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.984 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:49.984 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298160+0000", 2024-04-19T02:17:49.984 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:49.984 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.984 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.985 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:49.985 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298160+0000", 2024-04-19T02:17:49.985 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:49.985 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.985 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.985 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:49.985 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298160+0000", 2024-04-19T02:17:49.985 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:49.985 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.985 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.985 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:49.985 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298162+0000", 2024-04-19T02:17:49.985 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8360000000000001e-06 2024-04-19T02:17:49.985 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.985 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.986 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:49.986 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298167+0000", 2024-04-19T02:17:49.986 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1710000000000001e-06 2024-04-19T02:17:49.986 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.986 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.986 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:49.986 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298170+0000", 2024-04-19T02:17:49.986 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0740000000000001e-06 2024-04-19T02:17:49.986 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.986 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.986 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:49.986 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298202+0000", 2024-04-19T02:17:49.986 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2163999999999999e-05 2024-04-19T02:17:49.987 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.987 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:49.987 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298281+0000", 2024-04-19T02:17:49.987 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8318000000000005e-05 2024-04-19T02:17:49.987 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.987 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:49.987 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298344+0000", 2024-04-19T02:17:49.987 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2909000000000004e-05 2024-04-19T02:17:49.987 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.987 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:49.987 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.301043+0000", 2024-04-19T02:17:49.987 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026998159999999998 2024-04-19T02:17:49.988 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.988 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:49.988 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.360725+0000", 2024-04-19T02:17:49.988 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059681627000000001 2024-04-19T02:17:49.988 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.988 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:49.988 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.360753+0000", 2024-04-19T02:17:49.988 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8198999999999999e-05 2024-04-19T02:17:49.988 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.988 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:49.988 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.360776+0000", 2024-04-19T02:17:49.988 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2388e-05 2024-04-19T02:17:49.988 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:49.988 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:49.989 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:49.989 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.989 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.989 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241645 5.9 5:935d75f3:::benchmark_data_smithi121_44835_object107610:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:49.989 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.298176+0000", 2024-04-19T02:17:49.989 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 11.590615436, 2024-04-19T02:17:49.989 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.067784611999999994, 2024-04-19T02:17:49.989 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:49.989 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:49.989 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:49.989 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:49.989 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:49.989 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241645 2024-04-19T02:17:49.989 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.989 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:49.990 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.990 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:49.990 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298176+0000", 2024-04-19T02:17:49.990 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:49.990 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.990 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.990 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:49.990 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298176+0000", 2024-04-19T02:17:49.990 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:49.990 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.990 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.990 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:49.990 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298175+0000", 2024-04-19T02:17:49.990 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:49.991 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.991 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.991 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:49.991 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298177+0000", 2024-04-19T02:17:49.991 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9709999999999998e-06 2024-04-19T02:17:49.991 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.991 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.991 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:49.991 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298183+0000", 2024-04-19T02:17:49.991 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4700000000000001e-06 2024-04-19T02:17:49.991 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.991 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.991 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:49.991 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298187+0000", 2024-04-19T02:17:49.991 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7249999999999997e-06 2024-04-19T02:17:49.992 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.992 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.992 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:49.992 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.299715+0000", 2024-04-19T02:17:49.992 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001527657 2024-04-19T02:17:49.992 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.992 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.992 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:49.992 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.299790+0000", 2024-04-19T02:17:49.992 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4789999999999994e-05 2024-04-19T02:17:49.992 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.992 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.992 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:49.992 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.299853+0000", 2024-04-19T02:17:49.993 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2905999999999997e-05 2024-04-19T02:17:49.993 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.993 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.993 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:49.993 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.301553+0000", 2024-04-19T02:17:49.993 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017001609999999999 2024-04-19T02:17:49.993 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.993 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.993 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:49.993 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.365904+0000", 2024-04-19T02:17:49.993 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.064351028000000005 2024-04-19T02:17:49.993 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.993 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.993 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:49.993 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.365931+0000", 2024-04-19T02:17:49.994 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6809e-05 2024-04-19T02:17:49.994 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.994 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.994 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:49.994 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.365960+0000", 2024-04-19T02:17:49.994 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9391e-05 2024-04-19T02:17:49.994 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:49.994 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:49.994 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:49.994 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.994 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.994 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241652 5.d 5:bbf7ddbb:::benchmark_data_smithi121_44835_object107617:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:49.994 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.309592+0000", 2024-04-19T02:17:49.994 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 11.579199217999999, 2024-04-19T02:17:49.994 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.054120610999999999, 2024-04-19T02:17:49.995 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:49.995 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:49.995 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:49.995 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:49.995 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:49.995 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241652 2024-04-19T02:17:49.995 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.995 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:49.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.995 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:49.995 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309592+0000", 2024-04-19T02:17:49.995 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:49.995 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.995 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:49.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309592+0000", 2024-04-19T02:17:49.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:49.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.996 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:49.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309591+0000", 2024-04-19T02:17:49.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:49.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.996 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:49.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309595+0000", 2024-04-19T02:17:49.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6009999999999999e-06 2024-04-19T02:17:49.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.996 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:49.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309603+0000", 2024-04-19T02:17:49.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9319999999999996e-06 2024-04-19T02:17:49.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:49.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309608+0000", 2024-04-19T02:17:49.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7809999999999996e-06 2024-04-19T02:17:49.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:49.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309635+0000", 2024-04-19T02:17:49.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7376e-05 2024-04-19T02:17:49.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:49.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309709+0000", 2024-04-19T02:17:49.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4318000000000002e-05 2024-04-19T02:17:49.998 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.998 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:49.998 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309774+0000", 2024-04-19T02:17:49.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5173999999999996e-05 2024-04-19T02:17:49.998 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.998 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:49.998 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.311459+0000", 2024-04-19T02:17:49.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001684269 2024-04-19T02:17:49.998 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.998 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:49.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.363665+0000", 2024-04-19T02:17:49.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.052205840000000003 2024-04-19T02:17:49.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:49.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.363694+0000", 2024-04-19T02:17:49.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9706999999999999e-05 2024-04-19T02:17:49.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:49.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:49.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:49.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.363712+0000", 2024-04-19T02:17:49.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8144000000000001e-05 2024-04-19T02:17:49.999 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:49.999 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:49.999 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:50.000 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.000 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.000 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:262339 5.2 5:4f7a406e:::benchmark_data_smithi121_44835_object128304:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T02:17:50.000 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:45.851345+0000", 2024-04-19T02:17:50.000 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.0374458799999999, 2024-04-19T02:17:50.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.064477598999999997, 2024-04-19T02:17:50.000 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:50.000 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:50.000 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:50.000 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:50.000 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:50.000 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 262339 2024-04-19T02:17:50.000 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.000 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:50.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:50.001 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.851345+0000", 2024-04-19T02:17:50.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:50.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:50.001 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.851345+0000", 2024-04-19T02:17:50.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:50.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:50.001 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.851345+0000", 2024-04-19T02:17:50.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:50.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.002 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:50.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.851347+0000", 2024-04-19T02:17:50.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4619999999999999e-06 2024-04-19T02:17:50.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.002 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:50.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.851352+0000", 2024-04-19T02:17:50.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0540000000000002e-06 2024-04-19T02:17:50.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.002 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.851356+0000", 2024-04-19T02:17:50.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6990000000000001e-06 2024-04-19T02:17:50.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:50.003 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.853448+0000", 2024-04-19T02:17:50.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020915730000000002 2024-04-19T02:17:50.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:50.003 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.853593+0000", 2024-04-19T02:17:50.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014543800000000001 2024-04-19T02:17:50.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:50.003 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915708+0000", 2024-04-19T02:17:50.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.062114765000000002 2024-04-19T02:17:50.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.004 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:50.004 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915749+0000", 2024-04-19T02:17:50.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0926000000000001e-05 2024-04-19T02:17:50.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.004 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:50.004 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915823+0000", 2024-04-19T02:17:50.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4040000000000003e-05 2024-04-19T02:17:50.004 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:50.004 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:50.004 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:50.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.005 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:262342 5.5 5:af014019:::benchmark_data_smithi121_44835_object128307:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T02:17:50.005 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:45.852022+0000", 2024-04-19T02:17:50.005 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.0367686730000001, 2024-04-19T02:17:50.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.063803426999999996, 2024-04-19T02:17:50.005 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:50.005 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:50.005 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:50.005 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:50.005 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:50.005 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 262342 2024-04-19T02:17:50.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.005 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:50.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.005 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:50.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.852022+0000", 2024-04-19T02:17:50.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:50.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:50.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.852022+0000", 2024-04-19T02:17:50.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:50.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:50.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.852022+0000", 2024-04-19T02:17:50.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:50.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:50.007 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.852026+0000", 2024-04-19T02:17:50.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1670000000000001e-06 2024-04-19T02:17:50.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.007 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:50.007 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.852033+0000", 2024-04-19T02:17:50.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3730000000000004e-06 2024-04-19T02:17:50.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.007 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.007 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.852038+0000", 2024-04-19T02:17:50.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9559999999999996e-06 2024-04-19T02:17:50.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.007 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:50.008 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.852076+0000", 2024-04-19T02:17:50.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7429999999999999e-05 2024-04-19T02:17:50.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:50.008 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.852199+0000", 2024-04-19T02:17:50.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012372899999999999 2024-04-19T02:17:50.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:50.008 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915689+0000", 2024-04-19T02:17:50.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.063490115999999999 2024-04-19T02:17:50.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:50.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915743+0000", 2024-04-19T02:17:50.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3480000000000003e-05 2024-04-19T02:17:50.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:50.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915826+0000", 2024-04-19T02:17:50.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2830999999999993e-05 2024-04-19T02:17:50.009 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:50.009 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:50.009 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:50.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.010 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:262344 5.f 5:f913826c:::benchmark_data_smithi121_44835_object128309:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T02:17:50.010 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:45.854353+0000", 2024-04-19T02:17:50.010 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.0344384209999999, 2024-04-19T02:17:50.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061458894999999999, 2024-04-19T02:17:50.010 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:50.010 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:50.010 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:50.010 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:50.010 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:50.010 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 262344 2024-04-19T02:17:50.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.010 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:50.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.011 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:50.011 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854353+0000", 2024-04-19T02:17:50.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:50.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.011 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:50.011 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854353+0000", 2024-04-19T02:17:50.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:50.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.011 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:50.011 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854352+0000", 2024-04-19T02:17:50.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:50.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.012 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:50.012 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854356+0000", 2024-04-19T02:17:50.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3039999999999998e-06 2024-04-19T02:17:50.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.012 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:50.012 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854364+0000", 2024-04-19T02:17:50.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5100000000000001e-06 2024-04-19T02:17:50.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.012 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.012 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854369+0000", 2024-04-19T02:17:50.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2360000000000004e-06 2024-04-19T02:17:50.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:50.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854396+0000", 2024-04-19T02:17:50.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7487999999999998e-05 2024-04-19T02:17:50.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:50.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854468+0000", 2024-04-19T02:17:50.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1647e-05 2024-04-19T02:17:50.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:50.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854533+0000", 2024-04-19T02:17:50.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4709000000000007e-05 2024-04-19T02:17:50.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:50.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.856402+0000", 2024-04-19T02:17:50.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001868839 2024-04-19T02:17:50.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:50.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915731+0000", 2024-04-19T02:17:50.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059329036000000002 2024-04-19T02:17:50.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:50.015 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915774+0000", 2024-04-19T02:17:50.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3599e-05 2024-04-19T02:17:50.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:50.015 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915811+0000", 2024-04-19T02:17:50.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7171e-05 2024-04-19T02:17:50.015 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:50.015 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:50.015 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:50.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.017 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:262345 5.7 5:e3a7b870:::benchmark_data_smithi121_44835_object128310:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T02:17:50.017 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:45.854376+0000", 2024-04-19T02:17:50.017 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.034415321, 2024-04-19T02:17:50.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061557471000000002, 2024-04-19T02:17:50.017 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:50.017 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:50.017 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:50.017 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:50.018 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:50.018 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 262345 2024-04-19T02:17:50.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.018 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:50.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:50.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854376+0000", 2024-04-19T02:17:50.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:50.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:50.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854376+0000", 2024-04-19T02:17:50.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:50.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:50.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854375+0000", 2024-04-19T02:17:50.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:50.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:50.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854377+0000", 2024-04-19T02:17:50.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6700000000000001e-06 2024-04-19T02:17:50.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:50.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854380+0000", 2024-04-19T02:17:50.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3790000000000002e-06 2024-04-19T02:17:50.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.020 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854383+0000", 2024-04-19T02:17:50.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7439999999999999e-06 2024-04-19T02:17:50.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.020 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:50.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854411+0000", 2024-04-19T02:17:50.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7430999999999999e-05 2024-04-19T02:17:50.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.020 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:50.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854483+0000", 2024-04-19T02:17:50.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2268999999999995e-05 2024-04-19T02:17:50.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:50.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915820+0000", 2024-04-19T02:17:50.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061336768 2024-04-19T02:17:50.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:50.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915858+0000", 2024-04-19T02:17:50.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7886000000000003e-05 2024-04-19T02:17:50.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:50.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915933+0000", 2024-04-19T02:17:50.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5593000000000006e-05 2024-04-19T02:17:50.022 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:50.022 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:50.022 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:50.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.022 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:262346 5.7 5:eee05b20:::benchmark_data_smithi121_44835_object128311:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T02:17:50.022 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:45.854386+0000", 2024-04-19T02:17:50.022 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.0344050889999998, 2024-04-19T02:17:50.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.065671691000000004, 2024-04-19T02:17:50.022 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:50.022 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:50.022 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:50.022 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:50.022 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:50.023 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 262346 2024-04-19T02:17:50.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.023 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:50.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:50.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854386+0000", 2024-04-19T02:17:50.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:50.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:50.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854386+0000", 2024-04-19T02:17:50.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:50.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:50.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854386+0000", 2024-04-19T02:17:50.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967296 2024-04-19T02:17:50.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:50.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854388+0000", 2024-04-19T02:17:50.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9290000000000001e-06 2024-04-19T02:17:50.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:50.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854391+0000", 2024-04-19T02:17:50.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.942e-06 2024-04-19T02:17:50.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854394+0000", 2024-04-19T02:17:50.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0740000000000001e-06 2024-04-19T02:17:50.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:50.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.855841+0000", 2024-04-19T02:17:50.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001447411 2024-04-19T02:17:50.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:50.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.855910+0000", 2024-04-19T02:17:50.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8609999999999995e-05 2024-04-19T02:17:50.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:50.026 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.919944+0000", 2024-04-19T02:17:50.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.064034663000000006 2024-04-19T02:17:50.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.026 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:50.026 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.919989+0000", 2024-04-19T02:17:50.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4533000000000002e-05 2024-04-19T02:17:50.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.026 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:50.026 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.920058+0000", 2024-04-19T02:17:50.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8756000000000004e-05 2024-04-19T02:17:50.026 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:50.026 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:50.026 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:50.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.027 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:262352 5.c 5:3c8d5871:::benchmark_data_smithi121_44835_object128317:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T02:17:50.027 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:45.855299+0000", 2024-04-19T02:17:50.027 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.0334924750000001, 2024-04-19T02:17:50.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060570657999999999, 2024-04-19T02:17:50.027 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:50.027 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:50.027 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:50.027 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:50.027 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:50.027 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 262352 2024-04-19T02:17:50.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.027 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:50.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:50.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.855299+0000", 2024-04-19T02:17:50.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:50.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:50.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.855299+0000", 2024-04-19T02:17:50.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:50.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:50.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.855298+0000", 2024-04-19T02:17:50.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:50.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:50.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.855301+0000", 2024-04-19T02:17:50.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.615e-06 2024-04-19T02:17:50.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:50.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.855305+0000", 2024-04-19T02:17:50.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7190000000000001e-06 2024-04-19T02:17:50.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.855309+0000", 2024-04-19T02:17:50.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.89e-06 2024-04-19T02:17:50.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.030 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:50.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.855340+0000", 2024-04-19T02:17:50.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1192000000000002e-05 2024-04-19T02:17:50.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.030 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:50.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.855412+0000", 2024-04-19T02:17:50.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1491999999999999e-05 2024-04-19T02:17:50.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.030 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:50.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915748+0000", 2024-04-19T02:17:50.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060335524000000001 2024-04-19T02:17:50.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:50.031 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915790+0000", 2024-04-19T02:17:50.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2178000000000002e-05 2024-04-19T02:17:50.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:50.031 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915869+0000", 2024-04-19T02:17:50.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9473000000000003e-05 2024-04-19T02:17:50.031 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:50.031 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:50.031 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:50.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.032 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:262357 5.3 5:c80391af:::benchmark_data_smithi121_44835_object128322:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T02:17:50.032 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:45.857454+0000", 2024-04-19T02:17:50.032 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.0313367380000003, 2024-04-19T02:17:50.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061276328999999997, 2024-04-19T02:17:50.032 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:50.032 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:50.032 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:50.032 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:50.032 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:50.032 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 262357 2024-04-19T02:17:50.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.032 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:50.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:50.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.857454+0000", 2024-04-19T02:17:50.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:50.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:50.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.857454+0000", 2024-04-19T02:17:50.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:50.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:50.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.857454+0000", 2024-04-19T02:17:50.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:50.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:50.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.857458+0000", 2024-04-19T02:17:50.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0579999999999999e-06 2024-04-19T02:17:50.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:50.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.857465+0000", 2024-04-19T02:17:50.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3379999999999999e-06 2024-04-19T02:17:50.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.857470+0000", 2024-04-19T02:17:50.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7840000000000003e-06 2024-04-19T02:17:50.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:50.035 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.857513+0000", 2024-04-19T02:17:50.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3537e-05 2024-04-19T02:17:50.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.035 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:50.035 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.857592+0000", 2024-04-19T02:17:50.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8286000000000002e-05 2024-04-19T02:17:50.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.035 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:50.035 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.918619+0000", 2024-04-19T02:17:50.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061027286 2024-04-19T02:17:50.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.036 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:50.036 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.918660+0000", 2024-04-19T02:17:50.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1152000000000002e-05 2024-04-19T02:17:50.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.036 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:50.036 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.918731+0000", 2024-04-19T02:17:50.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0456000000000004e-05 2024-04-19T02:17:50.036 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:50.036 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:50.036 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:50.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.036 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:262361 5.2 5:4dd4f1fe:::benchmark_data_smithi121_44835_object128326:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T02:17:50.036 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:45.861370+0000", 2024-04-19T02:17:50.037 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.0274207710000001, 2024-04-19T02:17:50.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061639977999999998, 2024-04-19T02:17:50.037 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:50.037 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:50.037 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:50.037 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:50.037 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:50.037 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 262361 2024-04-19T02:17:50.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.037 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:50.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:50.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.861370+0000", 2024-04-19T02:17:50.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:50.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:50.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.861370+0000", 2024-04-19T02:17:50.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:50.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:50.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.861368+0000", 2024-04-19T02:17:50.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:50.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:50.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.861382+0000", 2024-04-19T02:17:50.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3103e-05 2024-04-19T02:17:50.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:50.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915692+0000", 2024-04-19T02:17:50.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.054310768000000002 2024-04-19T02:17:50.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915703+0000", 2024-04-19T02:17:50.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0637e-05 2024-04-19T02:17:50.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:50.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915853+0000", 2024-04-19T02:17:50.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014972999999999999 2024-04-19T02:17:50.040 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.040 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:50.040 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915977+0000", 2024-04-19T02:17:50.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012470800000000001 2024-04-19T02:17:50.040 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.040 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:50.040 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.922943+0000", 2024-04-19T02:17:50.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0069653780000000004 2024-04-19T02:17:50.040 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.040 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:50.040 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.922969+0000", 2024-04-19T02:17:50.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6531000000000001e-05 2024-04-19T02:17:50.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:50.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:50.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:50.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.923010+0000", 2024-04-19T02:17:50.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0859000000000003e-05 2024-04-19T02:17:50.041 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:50.041 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:50.041 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:50.041 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:50.041 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:50.041 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:50.043 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:17:50.043 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:50.043+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:50.144 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:50.144+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:50.172 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:17:50.172 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [], 2024-04-19T02:17:50.172 INFO:teuthology.orchestra.run.smithi174.stdout: "num_ops": 0 2024-04-19T02:17:50.173 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:17:50.183 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:17:50.245 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:50.245+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:50.346 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:50.345+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:50.350 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:17:50.350 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [], 2024-04-19T02:17:50.350 INFO:teuthology.orchestra.run.smithi174.stdout: "complaint_time": 30, 2024-04-19T02:17:50.350 INFO:teuthology.orchestra.run.smithi174.stdout: "num_blocked_ops": 0 2024-04-19T02:17:50.350 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:17:50.360 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:17:50.385 INFO:teuthology.orchestra.run.smithi121.stderr:nodeep-scrub is unset 2024-04-19T02:17:50.446 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:50.447+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:50.528 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:17:50.528 INFO:teuthology.orchestra.run.smithi174.stdout: "size": 20, 2024-04-19T02:17:50.528 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 600, 2024-04-19T02:17:50.528 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:17:50.529 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.529 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78259 5.4 5:2aa344b2:::benchmark_data_smithi121_44835_object78258:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:50.529 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:17:50.529 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 83.402185176000003, 2024-04-19T02:17:50.529 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022934350999999999, 2024-04-19T02:17:50.529 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:50.529 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:50.529 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:50.529 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:50.529 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:50.529 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78259 2024-04-19T02:17:50.529 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.529 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:50.529 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.530 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:50.530 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:17:50.530 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:50.530 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.530 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.530 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:50.530 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:17:50.530 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:50.530 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.530 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.530 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:50.530 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125256+0000", 2024-04-19T02:17:50.530 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:50.530 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.531 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.531 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:50.531 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125347+0000", 2024-04-19T02:17:50.531 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0470000000000006e-05 2024-04-19T02:17:50.531 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.531 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.531 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:50.531 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125358+0000", 2024-04-19T02:17:50.531 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1764e-05 2024-04-19T02:17:50.531 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.531 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.531 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.531 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125364+0000", 2024-04-19T02:17:50.531 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7189999999999998e-06 2024-04-19T02:17:50.531 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.532 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.532 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:50.532 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125391+0000", 2024-04-19T02:17:50.532 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7270000000000001e-05 2024-04-19T02:17:50.532 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.532 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.532 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:50.532 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125471+0000", 2024-04-19T02:17:50.533 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9209999999999995e-05 2024-04-19T02:17:50.533 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.533 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.533 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:50.533 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125559+0000", 2024-04-19T02:17:50.533 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.8689000000000004e-05 2024-04-19T02:17:50.533 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.533 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.533 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:50.533 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128164+0000", 2024-04-19T02:17:50.533 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0026050270000000002 2024-04-19T02:17:50.533 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.533 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.533 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:50.533 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148139+0000", 2024-04-19T02:17:50.533 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.019975050000000001 2024-04-19T02:17:50.533 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.534 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.534 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:50.534 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148169+0000", 2024-04-19T02:17:50.534 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0001e-05 2024-04-19T02:17:50.534 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.534 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.534 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:50.534 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148191+0000", 2024-04-19T02:17:50.534 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.2104999999999999e-05 2024-04-19T02:17:50.534 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:50.535 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:50.535 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:50.535 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.535 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.535 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78272 5.4 5:273e819a:::benchmark_data_smithi121_44835_object78271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:50.535 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:50.535 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 83.394832902999994, 2024-04-19T02:17:50.535 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022180163999999999, 2024-04-19T02:17:50.535 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:50.535 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:50.535 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:50.535 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:50.535 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:50.535 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78272 2024-04-19T02:17:50.535 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.536 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:50.536 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.536 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:50.536 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:50.536 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:50.536 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.536 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.536 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:50.536 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:50.536 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:50.536 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.536 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.536 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:50.536 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:50.536 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:50.537 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.537 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.537 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:50.537 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132690+0000", 2024-04-19T02:17:50.537 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0963000000000004e-05 2024-04-19T02:17:50.537 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.537 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.537 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:50.537 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132703+0000", 2024-04-19T02:17:50.537 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.3072e-05 2024-04-19T02:17:50.537 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.537 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.537 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.537 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132710+0000", 2024-04-19T02:17:50.537 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3100000000000003e-06 2024-04-19T02:17:50.537 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.538 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.538 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:50.538 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134005+0000", 2024-04-19T02:17:50.538 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001294513 2024-04-19T02:17:50.538 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.538 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.538 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:50.538 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134139+0000", 2024-04-19T02:17:50.538 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000134447 2024-04-19T02:17:50.538 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.538 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.538 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:50.538 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134284+0000", 2024-04-19T02:17:50.538 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014514399999999999 2024-04-19T02:17:50.539 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.539 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.539 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:50.539 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.139622+0000", 2024-04-19T02:17:50.539 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0053373830000000002 2024-04-19T02:17:50.539 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.539 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.539 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:50.539 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154737+0000", 2024-04-19T02:17:50.539 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015115195999999999 2024-04-19T02:17:50.539 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.539 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.539 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:50.539 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154768+0000", 2024-04-19T02:17:50.539 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0824999999999997e-05 2024-04-19T02:17:50.539 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.540 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.540 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:50.540 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154790+0000", 2024-04-19T02:17:50.540 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1999000000000001e-05 2024-04-19T02:17:50.540 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:50.540 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:50.540 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:50.540 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.540 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.540 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:94581 5.b 5:dc86d6e9:::benchmark_data_smithi121_44835_object94580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:50.540 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:50.540 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 75.347262013000005, 2024-04-19T02:17:50.540 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022099711000000001, 2024-04-19T02:17:50.540 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:50.540 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:50.541 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:50.541 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:50.541 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:50.541 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 94581 2024-04-19T02:17:50.541 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.541 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:50.541 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.541 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:50.541 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:50.541 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:50.541 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.541 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.541 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:50.541 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:50.541 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:50.542 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.542 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.542 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:50.542 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:50.542 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:50.542 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.542 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.542 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:50.542 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180253+0000", 2024-04-19T02:17:50.542 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3163000000000004e-05 2024-04-19T02:17:50.542 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.542 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.542 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:50.542 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180266+0000", 2024-04-19T02:17:50.542 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2886e-05 2024-04-19T02:17:50.543 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.543 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.543 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.543 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180273+0000", 2024-04-19T02:17:50.543 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.4059999999999999e-06 2024-04-19T02:17:50.543 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.543 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.543 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:50.543 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180646+0000", 2024-04-19T02:17:50.543 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00037283999999999999 2024-04-19T02:17:50.543 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.543 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.543 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:50.543 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180774+0000", 2024-04-19T02:17:50.543 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012793799999999999 2024-04-19T02:17:50.544 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.544 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.544 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:50.544 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180920+0000", 2024-04-19T02:17:50.544 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000146692 2024-04-19T02:17:50.544 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.544 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.544 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:50.544 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.183344+0000", 2024-04-19T02:17:50.544 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0024231669999999999 2024-04-19T02:17:50.544 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.544 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.544 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:50.544 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202196+0000", 2024-04-19T02:17:50.544 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.018852384 2024-04-19T02:17:50.544 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.545 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.545 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:50.545 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202241+0000", 2024-04-19T02:17:50.545 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4923999999999999e-05 2024-04-19T02:17:50.545 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.545 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.545 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:50.545 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202280+0000", 2024-04-19T02:17:50.545 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9096e-05 2024-04-19T02:17:50.545 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:50.545 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:50.545 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:50.545 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.545 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.545 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:104431 5.8 5:14818e19:::benchmark_data_smithi121_44835_object104430:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T02:17:50.545 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:17:50.546 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 70.316056967999998, 2024-04-19T02:17:50.546 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022149528000000002, 2024-04-19T02:17:50.546 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:50.546 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:50.546 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:50.546 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:50.546 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:50.546 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 104431 2024-04-19T02:17:50.546 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.546 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:50.546 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.546 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:50.546 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:17:50.546 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:50.547 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.547 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.547 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:50.547 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:17:50.547 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:50.547 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.547 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.547 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:50.547 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211384+0000", 2024-04-19T02:17:50.547 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:50.547 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.547 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.547 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:50.547 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211458+0000", 2024-04-19T02:17:50.547 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3311000000000003e-05 2024-04-19T02:17:50.547 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.548 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.548 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:50.548 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211471+0000", 2024-04-19T02:17:50.548 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.3308e-05 2024-04-19T02:17:50.548 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.548 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.548 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.548 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211479+0000", 2024-04-19T02:17:50.548 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0909999999999993e-06 2024-04-19T02:17:50.548 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.548 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.548 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:50.548 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.221821+0000", 2024-04-19T02:17:50.548 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010341596999999999 2024-04-19T02:17:50.548 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.548 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.549 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:50.549 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.221966+0000", 2024-04-19T02:17:50.549 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000145167 2024-04-19T02:17:50.549 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.549 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.549 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:50.549 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.222077+0000", 2024-04-19T02:17:50.549 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011128000000000001 2024-04-19T02:17:50.549 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.549 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.549 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:50.549 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.228126+0000", 2024-04-19T02:17:50.549 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0060486710000000003 2024-04-19T02:17:50.549 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.549 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.550 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:50.550 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233449+0000", 2024-04-19T02:17:50.550 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0053231370000000004 2024-04-19T02:17:50.550 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.550 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.550 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:50.550 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233498+0000", 2024-04-19T02:17:50.550 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8798999999999998e-05 2024-04-19T02:17:50.550 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.550 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.550 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:50.550 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233535+0000", 2024-04-19T02:17:50.550 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7119000000000002e-05 2024-04-19T02:17:50.550 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:50.550 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:50.551 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:50.551 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.551 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.551 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157437 5.e 5:78833a3d:::benchmark_data_smithi121_44835_object23402:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:50.551 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.859854+0000", 2024-04-19T02:17:50.551 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 43.667588195999997, 2024-04-19T02:17:50.551 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.025859589999999998, 2024-04-19T02:17:50.551 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:50.551 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:50.551 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:50.551 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:50.551 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:50.551 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157437 2024-04-19T02:17:50.551 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.551 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:50.551 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.552 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:50.552 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859854+0000", 2024-04-19T02:17:50.552 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:50.552 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.552 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.552 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:50.552 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859854+0000", 2024-04-19T02:17:50.552 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:50.552 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.552 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.552 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:50.552 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859853+0000", 2024-04-19T02:17:50.552 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:50.552 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.552 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.553 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:50.553 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859857+0000", 2024-04-19T02:17:50.553 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8789999999999996e-06 2024-04-19T02:17:50.553 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.553 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.553 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:50.553 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859865+0000", 2024-04-19T02:17:50.553 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.1880000000000002e-06 2024-04-19T02:17:50.553 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.553 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.553 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.553 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859873+0000", 2024-04-19T02:17:50.553 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.2980000000000003e-06 2024-04-19T02:17:50.553 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.553 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.553 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:50.554 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859908+0000", 2024-04-19T02:17:50.554 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5682999999999997e-05 2024-04-19T02:17:50.554 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.554 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.554 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:50.554 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.860046+0000", 2024-04-19T02:17:50.554 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013714200000000001 2024-04-19T02:17:50.554 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.554 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.554 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:50.554 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.860153+0000", 2024-04-19T02:17:50.554 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010725700000000001 2024-04-19T02:17:50.554 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.554 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.555 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:50.555 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.862008+0000", 2024-04-19T02:17:50.555 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001855179 2024-04-19T02:17:50.555 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.555 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.555 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:50.555 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.885629+0000", 2024-04-19T02:17:50.555 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.023621428 2024-04-19T02:17:50.555 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.555 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.555 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:50.555 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.885676+0000", 2024-04-19T02:17:50.555 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.6371e-05 2024-04-19T02:17:50.555 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.556 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.556 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:50.556 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.885714+0000", 2024-04-19T02:17:50.556 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7907000000000001e-05 2024-04-19T02:17:50.556 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:50.556 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:50.556 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:50.556 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.556 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.556 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157438 5.0 5:01944e77:::benchmark_data_smithi121_44835_object23403:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:50.556 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.864095+0000", 2024-04-19T02:17:50.556 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 43.663346912000002, 2024-04-19T02:17:50.556 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.032015298999999997, 2024-04-19T02:17:50.556 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:50.556 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:50.557 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:50.557 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:50.557 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:50.557 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157438 2024-04-19T02:17:50.557 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.557 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:50.557 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.557 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:50.557 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864095+0000", 2024-04-19T02:17:50.557 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:50.557 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.557 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.557 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:50.557 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864095+0000", 2024-04-19T02:17:50.557 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:50.557 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.558 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.558 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:50.558 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864094+0000", 2024-04-19T02:17:50.558 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:50.558 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.558 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.558 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:50.558 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864102+0000", 2024-04-19T02:17:50.558 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.6629999999999993e-06 2024-04-19T02:17:50.558 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.558 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.558 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:50.558 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864113+0000", 2024-04-19T02:17:50.558 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1185999999999999e-05 2024-04-19T02:17:50.559 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.559 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.559 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.559 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864119+0000", 2024-04-19T02:17:50.559 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.224e-06 2024-04-19T02:17:50.559 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.559 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.559 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:50.559 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864151+0000", 2024-04-19T02:17:50.559 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1395e-05 2024-04-19T02:17:50.559 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.559 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.559 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:50.559 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864275+0000", 2024-04-19T02:17:50.559 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012431399999999999 2024-04-19T02:17:50.560 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.560 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.560 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:50.560 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864341+0000", 2024-04-19T02:17:50.560 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6146e-05 2024-04-19T02:17:50.560 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.560 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.560 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:50.560 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.866040+0000", 2024-04-19T02:17:50.560 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016991879999999999 2024-04-19T02:17:50.560 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.560 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.560 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:50.560 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896055+0000", 2024-04-19T02:17:50.561 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.030014886000000001 2024-04-19T02:17:50.561 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.561 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.561 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:50.561 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896087+0000", 2024-04-19T02:17:50.561 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1761000000000003e-05 2024-04-19T02:17:50.561 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.561 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.561 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:50.561 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896111+0000", 2024-04-19T02:17:50.561 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3623999999999999e-05 2024-04-19T02:17:50.561 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:50.561 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:50.561 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:50.561 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.561 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.562 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157439 5.e 5:79eb9d3c:::benchmark_data_smithi121_44835_object23404:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:50.562 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:50.562 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 43.663315836999999, 2024-04-19T02:17:50.562 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.027045244, 2024-04-19T02:17:50.562 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:50.562 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:50.562 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:50.562 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:50.562 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:50.562 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157439 2024-04-19T02:17:50.562 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.562 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:50.562 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.562 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:50.563 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:50.563 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:50.563 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.563 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.563 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:50.563 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:50.563 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:50.563 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.563 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.563 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:50.563 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:50.563 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:50.563 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.563 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.563 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:50.563 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864128+0000", 2024-04-19T02:17:50.564 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.911e-06 2024-04-19T02:17:50.564 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.564 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.564 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:50.564 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864136+0000", 2024-04-19T02:17:50.564 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2609999999999993e-06 2024-04-19T02:17:50.564 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.564 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.564 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.564 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864140+0000", 2024-04-19T02:17:50.564 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5530000000000001e-06 2024-04-19T02:17:50.564 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.564 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.564 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:50.564 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864169+0000", 2024-04-19T02:17:50.564 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.8932e-05 2024-04-19T02:17:50.565 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.565 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.565 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:50.565 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864267+0000", 2024-04-19T02:17:50.565 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7969999999999999e-05 2024-04-19T02:17:50.565 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.565 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.565 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:50.565 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864339+0000", 2024-04-19T02:17:50.565 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.2280999999999995e-05 2024-04-19T02:17:50.565 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.565 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.565 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:50.565 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.865763+0000", 2024-04-19T02:17:50.565 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0014236310000000001 2024-04-19T02:17:50.566 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.566 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.566 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:50.566 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.891093+0000", 2024-04-19T02:17:50.566 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.025330571 2024-04-19T02:17:50.566 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.566 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.566 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:50.566 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.891137+0000", 2024-04-19T02:17:50.566 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3980999999999998e-05 2024-04-19T02:17:50.566 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.566 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.566 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:50.566 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.891172+0000", 2024-04-19T02:17:50.566 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4465000000000003e-05 2024-04-19T02:17:50.567 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:50.567 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:50.567 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:50.567 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.567 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.567 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157442 5.0 5:0062b73f:::benchmark_data_smithi121_44835_object23407:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:50.567 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.867065+0000", 2024-04-19T02:17:50.567 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 43.660377187000002, 2024-04-19T02:17:50.567 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.029165542999999999, 2024-04-19T02:17:50.567 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:50.567 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:50.567 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:50.567 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:50.567 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:50.567 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157442 2024-04-19T02:17:50.568 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.568 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:50.568 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.568 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:50.568 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867065+0000", 2024-04-19T02:17:50.568 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:50.568 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.568 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.568 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:50.568 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867065+0000", 2024-04-19T02:17:50.568 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:50.568 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.568 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.568 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:50.568 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867064+0000", 2024-04-19T02:17:50.569 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:50.569 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.569 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.569 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:50.569 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867069+0000", 2024-04-19T02:17:50.569 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4549999999999997e-06 2024-04-19T02:17:50.569 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.569 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.569 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:50.569 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867080+0000", 2024-04-19T02:17:50.569 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0797e-05 2024-04-19T02:17:50.569 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.569 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.569 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.569 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867088+0000", 2024-04-19T02:17:50.570 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9729999999999997e-06 2024-04-19T02:17:50.570 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.570 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.570 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:50.570 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867121+0000", 2024-04-19T02:17:50.570 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2920000000000003e-05 2024-04-19T02:17:50.570 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.570 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.570 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:50.570 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867203+0000", 2024-04-19T02:17:50.570 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2578999999999997e-05 2024-04-19T02:17:50.570 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.570 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.570 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:50.570 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867386+0000", 2024-04-19T02:17:50.571 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00018237400000000001 2024-04-19T02:17:50.571 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.571 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.571 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:50.571 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.869338+0000", 2024-04-19T02:17:50.571 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0019521160000000001 2024-04-19T02:17:50.571 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.571 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.571 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:50.571 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896150+0000", 2024-04-19T02:17:50.571 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.026812074000000002 2024-04-19T02:17:50.571 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.571 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.571 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:50.571 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896191+0000", 2024-04-19T02:17:50.571 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1192000000000001e-05 2024-04-19T02:17:50.572 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.572 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.572 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:50.572 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896231+0000", 2024-04-19T02:17:50.572 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9764000000000001e-05 2024-04-19T02:17:50.572 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:50.572 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:50.572 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:50.572 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.572 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.572 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157499 5.8 5:1c3aa38a:::benchmark_data_smithi121_44835_object23464:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:50.572 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.913447+0000", 2024-04-19T02:17:50.572 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 43.613995615, 2024-04-19T02:17:50.572 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.024508188, 2024-04-19T02:17:50.572 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:50.573 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:50.573 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:50.573 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:50.573 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:50.573 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157499 2024-04-19T02:17:50.573 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.573 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:50.573 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.573 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:50.573 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913447+0000", 2024-04-19T02:17:50.573 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:50.573 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.573 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.573 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:50.573 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913447+0000", 2024-04-19T02:17:50.573 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:50.574 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.574 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.574 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:50.574 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913446+0000", 2024-04-19T02:17:50.574 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:50.574 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.574 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.574 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:50.574 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913451+0000", 2024-04-19T02:17:50.574 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.677e-06 2024-04-19T02:17:50.574 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.574 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.574 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:50.574 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913461+0000", 2024-04-19T02:17:50.574 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.8859999999999999e-06 2024-04-19T02:17:50.575 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.575 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.575 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.575 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913467+0000", 2024-04-19T02:17:50.575 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.0800000000000002e-06 2024-04-19T02:17:50.575 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.575 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.575 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:50.575 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913513+0000", 2024-04-19T02:17:50.575 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.5707000000000001e-05 2024-04-19T02:17:50.575 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.575 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.575 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:50.575 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913637+0000", 2024-04-19T02:17:50.575 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012379200000000001 2024-04-19T02:17:50.576 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.576 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.576 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:50.576 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913747+0000", 2024-04-19T02:17:50.576 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000110071 2024-04-19T02:17:50.576 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.576 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.576 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:50.576 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915674+0000", 2024-04-19T02:17:50.576 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0019270789999999999 2024-04-19T02:17:50.576 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.576 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.576 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:50.576 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937902+0000", 2024-04-19T02:17:50.576 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022228286 2024-04-19T02:17:50.576 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.577 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.577 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:50.577 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937931+0000", 2024-04-19T02:17:50.577 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9122e-05 2024-04-19T02:17:50.577 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.577 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.577 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:50.577 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937955+0000", 2024-04-19T02:17:50.577 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3591000000000002e-05 2024-04-19T02:17:50.577 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:50.577 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:50.577 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:50.577 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.577 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.577 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157500 5.0 5:0969ec74:::benchmark_data_smithi121_44835_object23465:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:50.578 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.913476+0000", 2024-04-19T02:17:50.578 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 43.613966748999999, 2024-04-19T02:17:50.578 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.024497596, 2024-04-19T02:17:50.578 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:50.578 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:50.578 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:50.578 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:50.578 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:50.578 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157500 2024-04-19T02:17:50.578 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.578 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:50.578 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.578 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:50.578 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913476+0000", 2024-04-19T02:17:50.578 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:50.579 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.579 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.579 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:50.579 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913476+0000", 2024-04-19T02:17:50.579 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:50.579 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.579 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.579 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:50.579 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913475+0000", 2024-04-19T02:17:50.579 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:50.579 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.579 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.579 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:50.579 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913478+0000", 2024-04-19T02:17:50.579 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.2670000000000001e-06 2024-04-19T02:17:50.580 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.580 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.580 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:50.580 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913481+0000", 2024-04-19T02:17:50.580 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6899999999999998e-06 2024-04-19T02:17:50.580 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.580 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.580 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.580 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913485+0000", 2024-04-19T02:17:50.580 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1230000000000002e-06 2024-04-19T02:17:50.580 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.580 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.580 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:50.580 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913526+0000", 2024-04-19T02:17:50.580 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.104e-05 2024-04-19T02:17:50.581 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.581 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.581 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:50.581 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913606+0000", 2024-04-19T02:17:50.581 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9510000000000003e-05 2024-04-19T02:17:50.581 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.581 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.581 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:50.581 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913671+0000", 2024-04-19T02:17:50.581 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.4838000000000005e-05 2024-04-19T02:17:50.581 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.581 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.581 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:50.581 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915348+0000", 2024-04-19T02:17:50.581 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016769860000000001 2024-04-19T02:17:50.582 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.582 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.582 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:50.582 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937897+0000", 2024-04-19T02:17:50.582 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022548902999999999 2024-04-19T02:17:50.582 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.582 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.582 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:50.582 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937938+0000", 2024-04-19T02:17:50.582 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1499999999999999e-05 2024-04-19T02:17:50.582 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.582 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.582 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:50.582 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937973+0000", 2024-04-19T02:17:50.582 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5057e-05 2024-04-19T02:17:50.583 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:50.583 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:50.583 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:50.583 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.583 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.583 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157501 5.4 5:26661819:::benchmark_data_smithi121_44835_object23466:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:50.583 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.914839+0000", 2024-04-19T02:17:50.583 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 43.612603454999999, 2024-04-19T02:17:50.583 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.028504224000000002, 2024-04-19T02:17:50.583 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:50.583 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:50.583 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:50.583 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:50.583 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:50.583 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157501 2024-04-19T02:17:50.584 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.584 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:50.584 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.584 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:50.584 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914839+0000", 2024-04-19T02:17:50.584 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:50.584 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.584 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.584 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:50.584 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914839+0000", 2024-04-19T02:17:50.584 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:50.584 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.584 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.584 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:50.584 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914838+0000", 2024-04-19T02:17:50.584 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:50.585 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.585 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.585 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:50.585 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914841+0000", 2024-04-19T02:17:50.585 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.706e-06 2024-04-19T02:17:50.585 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.585 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.585 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:50.585 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914848+0000", 2024-04-19T02:17:50.585 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.7429999999999996e-06 2024-04-19T02:17:50.585 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.585 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.585 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.585 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914852+0000", 2024-04-19T02:17:50.585 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0810000000000004e-06 2024-04-19T02:17:50.585 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.586 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.586 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:50.586 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914892+0000", 2024-04-19T02:17:50.586 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9957999999999999e-05 2024-04-19T02:17:50.586 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.586 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.586 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:50.586 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915008+0000", 2024-04-19T02:17:50.586 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000116401 2024-04-19T02:17:50.586 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.586 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.586 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:50.586 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915125+0000", 2024-04-19T02:17:50.586 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011622500000000001 2024-04-19T02:17:50.586 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.587 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.587 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:50.587 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916663+0000", 2024-04-19T02:17:50.587 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0015381310000000001 2024-04-19T02:17:50.587 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.587 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.587 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:50.587 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943114+0000", 2024-04-19T02:17:50.587 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.026451125999999998 2024-04-19T02:17:50.587 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.587 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.587 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:50.587 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943245+0000", 2024-04-19T02:17:50.587 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000131645 2024-04-19T02:17:50.587 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.588 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.588 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:50.588 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943343+0000", 2024-04-19T02:17:50.588 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7604999999999998e-05 2024-04-19T02:17:50.588 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:50.588 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:50.588 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:50.588 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.588 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.588 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157507 5.b 5:de8840a2:::benchmark_data_smithi121_44835_object23472:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:50.588 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:50.588 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 43.611039173999998, 2024-04-19T02:17:50.588 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022544518999999999, 2024-04-19T02:17:50.588 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:50.588 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:50.589 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:50.589 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:50.589 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:50.589 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157507 2024-04-19T02:17:50.589 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.589 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:50.589 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.589 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:50.589 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:50.589 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:50.589 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.589 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.589 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:50.589 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:50.589 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:50.589 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.590 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.590 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:50.590 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:50.590 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:50.590 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.590 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.590 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:50.590 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916406+0000", 2024-04-19T02:17:50.590 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4589999999999998e-06 2024-04-19T02:17:50.590 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.590 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.590 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:50.590 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916415+0000", 2024-04-19T02:17:50.590 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3910000000000004e-06 2024-04-19T02:17:50.591 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.591 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.591 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.591 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916421+0000", 2024-04-19T02:17:50.591 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.6130000000000003e-06 2024-04-19T02:17:50.591 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.591 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.591 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:50.591 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916448+0000", 2024-04-19T02:17:50.591 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7277999999999999e-05 2024-04-19T02:17:50.591 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.591 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.591 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:50.591 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916539+0000", 2024-04-19T02:17:50.592 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0855999999999999e-05 2024-04-19T02:17:50.592 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.592 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.592 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:50.592 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916605+0000", 2024-04-19T02:17:50.592 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6141000000000003e-05 2024-04-19T02:17:50.592 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.593 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.593 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:50.593 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918276+0000", 2024-04-19T02:17:50.593 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001670726 2024-04-19T02:17:50.593 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.593 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.593 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:50.593 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.938888+0000", 2024-04-19T02:17:50.593 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020612042000000001 2024-04-19T02:17:50.593 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.593 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.593 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:50.593 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.938924+0000", 2024-04-19T02:17:50.593 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5692999999999999e-05 2024-04-19T02:17:50.593 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.594 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.594 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:50.594 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.938948+0000", 2024-04-19T02:17:50.594 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3879e-05 2024-04-19T02:17:50.594 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:50.594 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:50.594 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:50.594 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.594 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.594 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157509 5.8 5:1dca85d0:::benchmark_data_smithi121_44835_object23474:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:50.594 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:50.594 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 43.608610927999997, 2024-04-19T02:17:50.594 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.024511807, 2024-04-19T02:17:50.594 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:50.595 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:50.595 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:50.595 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:50.595 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:50.595 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157509 2024-04-19T02:17:50.595 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.595 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:50.595 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.595 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:50.595 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:50.595 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:50.595 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.595 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.595 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:50.595 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:50.595 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:50.596 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.596 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.596 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:50.596 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:50.596 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:50.596 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.596 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.596 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:50.596 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918834+0000", 2024-04-19T02:17:50.596 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9409999999999999e-06 2024-04-19T02:17:50.596 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.596 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.596 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:50.596 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918859+0000", 2024-04-19T02:17:50.596 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.5245999999999999e-05 2024-04-19T02:17:50.597 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.597 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.597 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.597 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918864+0000", 2024-04-19T02:17:50.597 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.1819999999999997e-06 2024-04-19T02:17:50.597 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.597 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.597 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:50.597 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918900+0000", 2024-04-19T02:17:50.597 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5327000000000002e-05 2024-04-19T02:17:50.597 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.597 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.597 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:50.597 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.919024+0000", 2024-04-19T02:17:50.598 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012400900000000001 2024-04-19T02:17:50.598 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.598 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.598 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:50.598 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.919136+0000", 2024-04-19T02:17:50.598 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000111987 2024-04-19T02:17:50.598 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.598 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.598 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:50.598 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.922096+0000", 2024-04-19T02:17:50.598 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0029607079999999998 2024-04-19T02:17:50.598 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.598 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.598 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:50.599 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943120+0000", 2024-04-19T02:17:50.599 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.021023995 2024-04-19T02:17:50.599 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.599 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.599 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:50.599 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943255+0000", 2024-04-19T02:17:50.599 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013502100000000001 2024-04-19T02:17:50.599 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.599 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.599 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:50.599 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943343+0000", 2024-04-19T02:17:50.599 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.7931999999999998e-05 2024-04-19T02:17:50.599 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:50.599 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:50.599 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:50.600 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.600 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.600 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:241615 5.d e62/16 5:bc2762a9:::benchmark_data_smithi121_44835_object107580:head v 62'15112, mlcod=62'15108)", 2024-04-19T02:17:50.600 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:38.291278+0000", 2024-04-19T02:17:50.600 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 12.236164766, 2024-04-19T02:17:50.600 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.064975456000000001, 2024-04-19T02:17:50.600 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:50.600 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:50.600 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:50.600 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.600 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:50.600 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.291278+0000", 2024-04-19T02:17:50.600 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:50.600 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.600 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.600 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:50.601 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.291278+0000", 2024-04-19T02:17:50.601 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:50.601 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.601 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.601 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:50.601 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.291277+0000", 2024-04-19T02:17:50.601 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:50.601 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.601 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.601 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:50.601 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.291281+0000", 2024-04-19T02:17:50.601 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8160000000000004e-06 2024-04-19T02:17:50.601 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.601 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.601 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:50.602 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.291291+0000", 2024-04-19T02:17:50.602 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0011e-05 2024-04-19T02:17:50.602 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.602 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.602 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.602 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.291296+0000", 2024-04-19T02:17:50.602 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.9559999999999996e-06 2024-04-19T02:17:50.602 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.602 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.602 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:50.602 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.292800+0000", 2024-04-19T02:17:50.602 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0015041060000000001 2024-04-19T02:17:50.602 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.602 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.602 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:50.602 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.292818+0000", 2024-04-19T02:17:50.603 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.8056000000000001e-05 2024-04-19T02:17:50.603 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.603 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.603 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:50.603 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.356217+0000", 2024-04-19T02:17:50.603 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.063399214999999995 2024-04-19T02:17:50.603 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.603 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.603 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:50.603 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.356253+0000", 2024-04-19T02:17:50.603 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5605999999999998e-05 2024-04-19T02:17:50.603 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:50.603 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:50.603 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:50.603 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.604 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.604 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:241622 5.d e62/16 5:ba16b775:::benchmark_data_smithi121_44835_object107587:head v 62'15113, mlcod=62'15108)", 2024-04-19T02:17:50.604 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:38.292906+0000", 2024-04-19T02:17:50.604 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 12.234536212, 2024-04-19T02:17:50.604 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.068017509000000004, 2024-04-19T02:17:50.604 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:50.604 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:50.604 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:50.604 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.604 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:50.604 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.292906+0000", 2024-04-19T02:17:50.604 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:50.604 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.604 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.604 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:50.604 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.292906+0000", 2024-04-19T02:17:50.605 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:50.605 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.605 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.605 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:50.605 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.292906+0000", 2024-04-19T02:17:50.605 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:50.605 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.605 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.605 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:50.605 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.292913+0000", 2024-04-19T02:17:50.605 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1720000000000001e-06 2024-04-19T02:17:50.605 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.605 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.605 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:50.605 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.292918+0000", 2024-04-19T02:17:50.606 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2519999999999999e-06 2024-04-19T02:17:50.606 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.606 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.606 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.606 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.292923+0000", 2024-04-19T02:17:50.606 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4710000000000001e-06 2024-04-19T02:17:50.606 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.606 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.606 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:50.606 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.294510+0000", 2024-04-19T02:17:50.606 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001587822 2024-04-19T02:17:50.606 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.606 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.606 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:50.606 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.294528+0000", 2024-04-19T02:17:50.607 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.7234000000000001e-05 2024-04-19T02:17:50.607 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.607 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.607 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:50.607 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.360893+0000", 2024-04-19T02:17:50.607 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.066365882000000001 2024-04-19T02:17:50.607 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.607 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.607 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:50.607 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.360924+0000", 2024-04-19T02:17:50.607 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0139000000000001e-05 2024-04-19T02:17:50.607 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:50.607 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:50.607 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:50.607 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.608 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.608 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:241631 5.1 5:89a96e22:::benchmark_data_smithi121_44835_object107596:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:50.608 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:38.293316+0000", 2024-04-19T02:17:50.608 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 12.234125886999999, 2024-04-19T02:17:50.608 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.066515056000000003, 2024-04-19T02:17:50.608 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:50.608 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:50.608 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:50.608 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:50.608 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:50.608 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 241631 2024-04-19T02:17:50.608 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.608 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:50.608 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.608 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:50.608 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293316+0000", 2024-04-19T02:17:50.609 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:50.609 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.609 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.609 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:50.609 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293316+0000", 2024-04-19T02:17:50.609 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:50.609 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.609 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.609 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:50.609 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293315+0000", 2024-04-19T02:17:50.609 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:50.609 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.609 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.609 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:50.609 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293321+0000", 2024-04-19T02:17:50.609 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.1390000000000003e-06 2024-04-19T02:17:50.610 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.610 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.610 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:50.610 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293331+0000", 2024-04-19T02:17:50.610 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.9690000000000006e-06 2024-04-19T02:17:50.610 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.610 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.610 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.610 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293338+0000", 2024-04-19T02:17:50.610 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.0559999999999999e-06 2024-04-19T02:17:50.610 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.610 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.610 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:50.610 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293365+0000", 2024-04-19T02:17:50.610 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7546e-05 2024-04-19T02:17:50.611 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.611 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.611 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:50.611 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293445+0000", 2024-04-19T02:17:50.611 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9387000000000004e-05 2024-04-19T02:17:50.611 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.611 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.611 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:50.611 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.359712+0000", 2024-04-19T02:17:50.611 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.066267197 2024-04-19T02:17:50.611 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.611 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.611 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:50.611 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.359757+0000", 2024-04-19T02:17:50.611 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4768000000000002e-05 2024-04-19T02:17:50.611 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.612 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.612 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:50.612 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.359831+0000", 2024-04-19T02:17:50.612 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.4935e-05 2024-04-19T02:17:50.612 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:50.612 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:50.612 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:50.612 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.612 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.612 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:241633 5.8 5:16311ac0:::benchmark_data_smithi121_44835_object107598:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:50.612 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:38.293861+0000", 2024-04-19T02:17:50.612 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 12.233580935999999, 2024-04-19T02:17:50.612 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.066819026000000004, 2024-04-19T02:17:50.612 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:50.612 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:50.612 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:50.613 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:50.613 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:50.613 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 241633 2024-04-19T02:17:50.613 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.613 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:50.613 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.613 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:50.613 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293861+0000", 2024-04-19T02:17:50.613 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:50.613 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.613 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.613 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:50.613 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293861+0000", 2024-04-19T02:17:50.613 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:50.613 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.613 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.614 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:50.614 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293861+0000", 2024-04-19T02:17:50.614 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:50.614 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.614 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.614 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:50.614 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293863+0000", 2024-04-19T02:17:50.614 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.9690000000000001e-06 2024-04-19T02:17:50.614 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.614 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.614 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:50.614 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293867+0000", 2024-04-19T02:17:50.614 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5889999999999999e-06 2024-04-19T02:17:50.614 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.614 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.615 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.615 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293870+0000", 2024-04-19T02:17:50.615 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0110000000000001e-06 2024-04-19T02:17:50.615 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.615 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.615 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:50.615 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293905+0000", 2024-04-19T02:17:50.615 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5043000000000003e-05 2024-04-19T02:17:50.615 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.615 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.615 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:50.615 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.294020+0000", 2024-04-19T02:17:50.615 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011504400000000001 2024-04-19T02:17:50.615 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.615 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.616 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:50.616 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.360556+0000", 2024-04-19T02:17:50.616 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.066536559999999995 2024-04-19T02:17:50.616 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.616 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.616 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:50.616 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.360604+0000", 2024-04-19T02:17:50.616 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8152000000000002e-05 2024-04-19T02:17:50.616 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.616 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.616 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:50.616 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.360680+0000", 2024-04-19T02:17:50.616 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.5964999999999995e-05 2024-04-19T02:17:50.616 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:50.616 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:50.617 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:50.617 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.617 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.617 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:241634 5.1 5:8a07564d:::benchmark_data_smithi121_44835_object107599:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:50.617 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:38.293914+0000", 2024-04-19T02:17:50.617 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 12.233528145999999, 2024-04-19T02:17:50.617 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.066174561000000007, 2024-04-19T02:17:50.617 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:50.617 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:50.617 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:50.617 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:50.617 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:50.617 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 241634 2024-04-19T02:17:50.617 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.618 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:50.618 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.618 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:50.618 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293914+0000", 2024-04-19T02:17:50.618 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:50.618 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.618 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.618 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:50.618 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293914+0000", 2024-04-19T02:17:50.618 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:50.618 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.618 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.618 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:50.618 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293914+0000", 2024-04-19T02:17:50.618 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:50.619 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.619 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.619 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:50.619 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293916+0000", 2024-04-19T02:17:50.619 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7240000000000001e-06 2024-04-19T02:17:50.619 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.619 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.619 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:50.619 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293921+0000", 2024-04-19T02:17:50.619 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2309999999999998e-06 2024-04-19T02:17:50.619 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.619 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.619 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.619 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293924+0000", 2024-04-19T02:17:50.619 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5810000000000001e-06 2024-04-19T02:17:50.620 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.620 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.620 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:50.620 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.295125+0000", 2024-04-19T02:17:50.620 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0012006759999999999 2024-04-19T02:17:50.620 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.620 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.620 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:50.620 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.295201+0000", 2024-04-19T02:17:50.620 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.5847999999999996e-05 2024-04-19T02:17:50.620 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.620 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.620 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:50.620 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.359977+0000", 2024-04-19T02:17:50.620 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.064775852999999994 2024-04-19T02:17:50.621 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.621 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.621 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:50.621 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.360019+0000", 2024-04-19T02:17:50.621 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2821999999999998e-05 2024-04-19T02:17:50.621 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.621 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.621 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:50.621 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.360089+0000", 2024-04-19T02:17:50.621 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.9356999999999993e-05 2024-04-19T02:17:50.621 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:50.621 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:50.621 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:50.621 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.621 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.622 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:241635 5.8 5:1c80e285:::benchmark_data_smithi121_44835_object107600:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:50.622 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:38.295774+0000", 2024-04-19T02:17:50.622 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 12.231668433999999, 2024-04-19T02:17:50.622 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.065098854999999997, 2024-04-19T02:17:50.622 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:50.622 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:50.622 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:50.622 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:50.622 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:50.622 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 241635 2024-04-19T02:17:50.622 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.622 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:50.622 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.622 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:50.622 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.295774+0000", 2024-04-19T02:17:50.623 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:50.623 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.623 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.623 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:50.623 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.295774+0000", 2024-04-19T02:17:50.623 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:50.623 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.623 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.623 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:50.623 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.295773+0000", 2024-04-19T02:17:50.623 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:50.623 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.623 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.623 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:50.623 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.295779+0000", 2024-04-19T02:17:50.624 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.1e-06 2024-04-19T02:17:50.624 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.624 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.624 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:50.624 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.295789+0000", 2024-04-19T02:17:50.624 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.815e-06 2024-04-19T02:17:50.624 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.624 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.624 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.624 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.295796+0000", 2024-04-19T02:17:50.624 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3479999999999998e-06 2024-04-19T02:17:50.624 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.624 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.624 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:50.624 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.295823+0000", 2024-04-19T02:17:50.624 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.6400000000000001e-05 2024-04-19T02:17:50.625 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.625 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.625 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:50.625 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.356276+0000", 2024-04-19T02:17:50.625 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.060453042999999998 2024-04-19T02:17:50.625 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.625 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.625 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:50.625 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.360756+0000", 2024-04-19T02:17:50.625 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0044805879999999998 2024-04-19T02:17:50.625 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.625 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.625 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:50.625 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.360799+0000", 2024-04-19T02:17:50.625 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2407999999999998e-05 2024-04-19T02:17:50.626 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.626 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.626 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:50.626 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.360873+0000", 2024-04-19T02:17:50.626 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.4160999999999997e-05 2024-04-19T02:17:50.626 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:50.626 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:50.626 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:50.626 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.626 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.626 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:241637 5.9 e62/16 5:920672c8:::benchmark_data_smithi121_44835_object107602:head v 62'15373, mlcod=62'15371)", 2024-04-19T02:17:50.626 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:38.297900+0000", 2024-04-19T02:17:50.626 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 12.229542544999999, 2024-04-19T02:17:50.626 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.062258717999999998, 2024-04-19T02:17:50.626 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:50.626 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:50.627 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:50.627 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.627 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:50.627 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.297900+0000", 2024-04-19T02:17:50.627 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:50.627 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.627 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.627 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:50.627 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.297900+0000", 2024-04-19T02:17:50.627 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:50.627 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.627 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.627 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:50.627 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.297899+0000", 2024-04-19T02:17:50.627 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:50.628 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.628 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.628 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:50.628 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.297904+0000", 2024-04-19T02:17:50.628 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.9130000000000002e-06 2024-04-19T02:17:50.628 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.628 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.628 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:50.628 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.356177+0000", 2024-04-19T02:17:50.628 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.058273318999999997 2024-04-19T02:17:50.628 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.628 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.628 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:50.628 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.356187+0000", 2024-04-19T02:17:50.628 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7599999999999997e-06 2024-04-19T02:17:50.628 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.629 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.629 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:50.629 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.356220+0000", 2024-04-19T02:17:50.629 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2651999999999998e-05 2024-04-19T02:17:50.629 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.629 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.629 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:50.629 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.356251+0000", 2024-04-19T02:17:50.629 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1232999999999997e-05 2024-04-19T02:17:50.629 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.629 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.629 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:50.629 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.360091+0000", 2024-04-19T02:17:50.629 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0038395429999999999 2024-04-19T02:17:50.629 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:50.630 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:50.630 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:50.630 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.360158+0000", 2024-04-19T02:17:50.630 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.7916999999999994e-05 2024-04-19T02:17:50.630 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:50.630 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:50.630 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:50.630 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:50.630 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:50.630 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:17:50.635 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:50.635+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:50.635 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:50.735 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:50.735+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:50.775 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:50.776 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-04-19T02:17:50.776 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-04-19T02:17:50.776 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:50.786 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:50.836 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:50.836+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:50.936 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:50.937+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:50.953 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:50.954 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-04-19T02:17:50.954 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-04-19T02:17:50.954 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-04-19T02:17:50.954 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:50.963 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:51.037 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:51.037+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:51.092 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:17:51.092 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-04-19T02:17:51.092 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-04-19T02:17:51.092 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-04-19T02:17:51.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.093 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168381 5.d 5:bcbab0e3:::benchmark_data_smithi121_44835_object34346:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:51.093 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:51.093 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 39.021962709999997, 2024-04-19T02:17:51.093 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050574694000000003, 2024-04-19T02:17:51.093 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:51.093 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:51.093 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:51.093 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:51.093 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:51.093 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168381 2024-04-19T02:17:51.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.093 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:51.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.093 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:51.094 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:51.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:51.094 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.094 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:51.094 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:51.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:51.094 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.094 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:51.094 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069521+0000", 2024-04-19T02:17:51.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:51.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:51.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069523+0000", 2024-04-19T02:17:51.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.244e-06 2024-04-19T02:17:51.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:51.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069528+0000", 2024-04-19T02:17:51.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0669999999999999e-06 2024-04-19T02:17:51.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:51.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069533+0000", 2024-04-19T02:17:51.096 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4680000000000003e-06 2024-04-19T02:17:51.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.096 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:51.096 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072637+0000", 2024-04-19T02:17:51.096 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031040429999999999 2024-04-19T02:17:51.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:51.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072710+0000", 2024-04-19T02:17:51.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3045000000000003e-05 2024-04-19T02:17:51.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:51.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.072775+0000", 2024-04-19T02:17:51.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5034000000000001e-05 2024-04-19T02:17:51.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:51.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.119925+0000", 2024-04-19T02:17:51.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.047150594999999997 2024-04-19T02:17:51.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.101 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:51.101 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120055+0000", 2024-04-19T02:17:51.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129288 2024-04-19T02:17:51.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.101 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:51.101 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120077+0000", 2024-04-19T02:17:51.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1759e-05 2024-04-19T02:17:51.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:51.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120096+0000", 2024-04-19T02:17:51.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9524000000000001e-05 2024-04-19T02:17:51.102 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:51.102 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:51.102 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:51.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.102 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168383 5.d 5:bbd9496c:::benchmark_data_smithi121_44835_object34348:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:51.102 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069581+0000", 2024-04-19T02:17:51.102 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 39.021903414999997, 2024-04-19T02:17:51.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050607278999999998, 2024-04-19T02:17:51.102 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:51.102 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:51.103 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:51.103 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:51.103 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:51.103 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168383 2024-04-19T02:17:51.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.103 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:51.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:51.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069581+0000", 2024-04-19T02:17:51.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:51.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:51.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069581+0000", 2024-04-19T02:17:51.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:51.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:51.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069580+0000", 2024-04-19T02:17:51.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:51.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:51.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069589+0000", 2024-04-19T02:17:51.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6750000000000008e-06 2024-04-19T02:17:51.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:51.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069596+0000", 2024-04-19T02:17:51.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7360000000000004e-06 2024-04-19T02:17:51.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:51.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069601+0000", 2024-04-19T02:17:51.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0479999999999998e-06 2024-04-19T02:17:51.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:51.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.073854+0000", 2024-04-19T02:17:51.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042531920000000003 2024-04-19T02:17:51.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.106 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:51.106 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.073952+0000", 2024-04-19T02:17:51.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7851999999999998e-05 2024-04-19T02:17:51.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.106 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:51.106 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.074012+0000", 2024-04-19T02:17:51.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0225e-05 2024-04-19T02:17:51.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:51.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120102+0000", 2024-04-19T02:17:51.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.046090150000000003 2024-04-19T02:17:51.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:51.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120129+0000", 2024-04-19T02:17:51.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7228000000000001e-05 2024-04-19T02:17:51.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:51.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120157+0000", 2024-04-19T02:17:51.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7165000000000002e-05 2024-04-19T02:17:51.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:51.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120188+0000", 2024-04-19T02:17:51.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1418000000000003e-05 2024-04-19T02:17:51.108 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:51.108 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:51.108 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:51.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.108 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168385 5.d 5:b22d7e69:::benchmark_data_smithi121_44835_object34350:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:51.108 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:51.108 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 39.021848923, 2024-04-19T02:17:51.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.055438508999999997, 2024-04-19T02:17:51.108 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:51.109 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:51.109 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:51.109 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:51.109 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:51.109 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168385 2024-04-19T02:17:51.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.109 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:51.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:51.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:51.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:51.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:51.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:51.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:51.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.110 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:51.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069635+0000", 2024-04-19T02:17:51.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:51.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.110 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:51.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069637+0000", 2024-04-19T02:17:51.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.576e-06 2024-04-19T02:17:51.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:51.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069643+0000", 2024-04-19T02:17:51.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8030000000000002e-06 2024-04-19T02:17:51.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:51.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069648+0000", 2024-04-19T02:17:51.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0889999999999999e-06 2024-04-19T02:17:51.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:51.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117534+0000", 2024-04-19T02:17:51.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.047886390000000001 2024-04-19T02:17:51.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:51.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117670+0000", 2024-04-19T02:17:51.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000135969 2024-04-19T02:17:51.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:51.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.117803+0000", 2024-04-19T02:17:51.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000132955 2024-04-19T02:17:51.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:51.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120501+0000", 2024-04-19T02:17:51.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026978050000000002 2024-04-19T02:17:51.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:51.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.125026+0000", 2024-04-19T02:17:51.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045244589999999998 2024-04-19T02:17:51.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:51.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.125049+0000", 2024-04-19T02:17:51.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3807000000000001e-05 2024-04-19T02:17:51.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.114 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:51.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.125074+0000", 2024-04-19T02:17:51.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4175000000000001e-05 2024-04-19T02:17:51.114 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:51.114 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:51.114 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:51.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.114 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:168386 5.5 5:a2cda182:::benchmark_data_smithi121_44835_object34351:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T02:17:51.114 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:12.069653+0000", 2024-04-19T02:17:51.114 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 39.021831456000001, 2024-04-19T02:17:51.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058748884000000001, 2024-04-19T02:17:51.115 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:51.115 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:51.115 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:51.115 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:51.115 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:51.115 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 168386 2024-04-19T02:17:51.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.115 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:51.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:51.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069653+0000", 2024-04-19T02:17:51.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:51.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:51.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069653+0000", 2024-04-19T02:17:51.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:51.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:51.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069652+0000", 2024-04-19T02:17:51.117 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:51.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.117 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:51.117 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069654+0000", 2024-04-19T02:17:51.117 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1220000000000002e-06 2024-04-19T02:17:51.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.117 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:51.117 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069660+0000", 2024-04-19T02:17:51.117 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5890000000000002e-06 2024-04-19T02:17:51.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.117 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:51.117 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.069665+0000", 2024-04-19T02:17:51.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.989e-06 2024-04-19T02:17:51.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:51.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120220+0000", 2024-04-19T02:17:51.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050555061999999998 2024-04-19T02:17:51.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:51.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.120329+0000", 2024-04-19T02:17:51.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010922200000000001 2024-04-19T02:17:51.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:51.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.128293+0000", 2024-04-19T02:17:51.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079640279999999997 2024-04-19T02:17:51.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:51.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.128336+0000", 2024-04-19T02:17:51.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2245e-05 2024-04-19T02:17:51.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:51.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:12.128401+0000", 2024-04-19T02:17:51.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5975000000000004e-05 2024-04-19T02:17:51.119 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:51.119 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:51.119 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:51.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.120 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241615 5.d 5:bc2762a9:::benchmark_data_smithi121_44835_object107580:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:51.120 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.288268+0000", 2024-04-19T02:17:51.120 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 12.803216083000001, 2024-04-19T02:17:51.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.068304498000000005, 2024-04-19T02:17:51.120 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:51.120 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:51.120 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:51.120 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:51.120 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:51.120 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241615 2024-04-19T02:17:51.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.120 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:51.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:51.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.288268+0000", 2024-04-19T02:17:51.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:51.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:51.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.288268+0000", 2024-04-19T02:17:51.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:51.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:51.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.288267+0000", 2024-04-19T02:17:51.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:51.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:51.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.288273+0000", 2024-04-19T02:17:51.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.823e-06 2024-04-19T02:17:51.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:51.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.288288+0000", 2024-04-19T02:17:51.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5307000000000001e-05 2024-04-19T02:17:51.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:51.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.288296+0000", 2024-04-19T02:17:51.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5689999999999999e-06 2024-04-19T02:17:51.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:51.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290508+0000", 2024-04-19T02:17:51.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022125589999999998 2024-04-19T02:17:51.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.123 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:51.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290661+0000", 2024-04-19T02:17:51.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015289500000000001 2024-04-19T02:17:51.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.123 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:51.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290781+0000", 2024-04-19T02:17:51.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000119411 2024-04-19T02:17:51.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.123 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:51.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297532+0000", 2024-04-19T02:17:51.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0067517819999999996 2024-04-19T02:17:51.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:51.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.356516+0000", 2024-04-19T02:17:51.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058983233000000003 2024-04-19T02:17:51.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:51.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.356547+0000", 2024-04-19T02:17:51.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1063999999999999e-05 2024-04-19T02:17:51.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.125 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:51.125 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.356572+0000", 2024-04-19T02:17:51.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5795999999999998e-05 2024-04-19T02:17:51.125 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:51.125 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:51.125 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:51.125 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.125 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.125 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241622 5.d 5:ba16b775:::benchmark_data_smithi121_44835_object107587:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:51.125 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.290616+0000", 2024-04-19T02:17:51.125 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 12.800867610999999, 2024-04-19T02:17:51.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.070971960000000001, 2024-04-19T02:17:51.125 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:51.125 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:51.125 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:51.126 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:51.126 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:51.126 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241622 2024-04-19T02:17:51.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.126 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:51.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.126 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:51.126 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290616+0000", 2024-04-19T02:17:51.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:51.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.126 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:51.126 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290616+0000", 2024-04-19T02:17:51.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:51.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:51.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290616+0000", 2024-04-19T02:17:51.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:51.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:51.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290619+0000", 2024-04-19T02:17:51.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8169999999999999e-06 2024-04-19T02:17:51.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:51.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290625+0000", 2024-04-19T02:17:51.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3759999999999996e-06 2024-04-19T02:17:51.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:51.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.290630+0000", 2024-04-19T02:17:51.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2179999999999998e-06 2024-04-19T02:17:51.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:51.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.292551+0000", 2024-04-19T02:17:51.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001920185 2024-04-19T02:17:51.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:51.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.292680+0000", 2024-04-19T02:17:51.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012971700000000001 2024-04-19T02:17:51.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.129 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:51.129 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.292794+0000", 2024-04-19T02:17:51.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000114095 2024-04-19T02:17:51.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.129 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:51.129 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297538+0000", 2024-04-19T02:17:51.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00474341 2024-04-19T02:17:51.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.129 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:51.129 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361516+0000", 2024-04-19T02:17:51.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.063978249000000001 2024-04-19T02:17:51.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.130 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:51.130 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361550+0000", 2024-04-19T02:17:51.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4069999999999997e-05 2024-04-19T02:17:51.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.130 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:51.130 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361588+0000", 2024-04-19T02:17:51.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8349999999999997e-05 2024-04-19T02:17:51.130 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:51.130 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:51.130 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:51.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.131 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241636 5.d 5:bcce6ec3:::benchmark_data_smithi121_44835_object107601:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:51.131 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.295801+0000", 2024-04-19T02:17:51.131 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 12.795682885, 2024-04-19T02:17:51.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.065904313000000006, 2024-04-19T02:17:51.131 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:51.131 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:51.131 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:51.131 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:51.131 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:51.131 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241636 2024-04-19T02:17:51.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.131 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:51.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:51.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295801+0000", 2024-04-19T02:17:51.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:51.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.132 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:51.132 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295801+0000", 2024-04-19T02:17:51.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:51.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.132 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:51.132 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295800+0000", 2024-04-19T02:17:51.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:51.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.132 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:51.132 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295806+0000", 2024-04-19T02:17:51.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5230000000000003e-06 2024-04-19T02:17:51.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.133 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:51.133 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295816+0000", 2024-04-19T02:17:51.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.079e-05 2024-04-19T02:17:51.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.133 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:51.133 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295825+0000", 2024-04-19T02:17:51.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4999999999999999e-06 2024-04-19T02:17:51.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:51.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.296001+0000", 2024-04-19T02:17:51.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017568600000000001 2024-04-19T02:17:51.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:51.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.296093+0000", 2024-04-19T02:17:51.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2237999999999993e-05 2024-04-19T02:17:51.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:51.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.296155+0000", 2024-04-19T02:17:51.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2281999999999998e-05 2024-04-19T02:17:51.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:51.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.299187+0000", 2024-04-19T02:17:51.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003031906 2024-04-19T02:17:51.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:51.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361624+0000", 2024-04-19T02:17:51.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.062437318999999998 2024-04-19T02:17:51.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:51.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361669+0000", 2024-04-19T02:17:51.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4197999999999999e-05 2024-04-19T02:17:51.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.136 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:51.136 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361705+0000", 2024-04-19T02:17:51.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6980999999999997e-05 2024-04-19T02:17:51.136 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:51.136 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:51.136 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:51.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.136 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241637 5.9 5:920672c8:::benchmark_data_smithi121_44835_object107602:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:51.136 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.295834+0000", 2024-04-19T02:17:51.136 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 12.795649759, 2024-04-19T02:17:51.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.064579527999999997, 2024-04-19T02:17:51.136 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:51.136 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:51.136 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:51.136 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:51.137 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:51.137 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241637 2024-04-19T02:17:51.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.137 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:51.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:51.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295834+0000", 2024-04-19T02:17:51.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:51.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:51.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295834+0000", 2024-04-19T02:17:51.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:51.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.138 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:51.138 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295834+0000", 2024-04-19T02:17:51.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:51.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.138 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:51.138 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295836+0000", 2024-04-19T02:17:51.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4389999999999999e-06 2024-04-19T02:17:51.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.138 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:51.138 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295843+0000", 2024-04-19T02:17:51.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1759999999999998e-06 2024-04-19T02:17:51.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:51.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295847+0000", 2024-04-19T02:17:51.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7949999999999998e-06 2024-04-19T02:17:51.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:51.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.295899+0000", 2024-04-19T02:17:51.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1579999999999997e-05 2024-04-19T02:17:51.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:51.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.296009+0000", 2024-04-19T02:17:51.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000110006 2024-04-19T02:17:51.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:51.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.296109+0000", 2024-04-19T02:17:51.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100035 2024-04-19T02:17:51.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:51.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.299700+0000", 2024-04-19T02:17:51.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035907999999999999 2024-04-19T02:17:51.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:51.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.360358+0000", 2024-04-19T02:17:51.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060657889 2024-04-19T02:17:51.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:51.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.360387+0000", 2024-04-19T02:17:51.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9492000000000002e-05 2024-04-19T02:17:51.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:51.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.360414+0000", 2024-04-19T02:17:51.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6631999999999998e-05 2024-04-19T02:17:51.141 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:51.141 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:51.141 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:51.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.142 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241638 5.d 5:b857cbeb:::benchmark_data_smithi121_44835_object107603:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:51.142 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.297779+0000", 2024-04-19T02:17:51.142 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 12.793704687, 2024-04-19T02:17:51.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.064037317999999996, 2024-04-19T02:17:51.142 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:51.142 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:51.142 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:51.142 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:51.142 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:51.142 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241638 2024-04-19T02:17:51.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.142 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:51.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.142 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:51.143 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297779+0000", 2024-04-19T02:17:51.143 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:51.143 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.143 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.143 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:51.143 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297779+0000", 2024-04-19T02:17:51.143 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:51.143 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.143 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.143 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:51.143 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297779+0000", 2024-04-19T02:17:51.143 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.999999 2024-04-19T02:17:51.143 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.143 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.143 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:51.143 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297784+0000", 2024-04-19T02:17:51.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3460000000000001e-06 2024-04-19T02:17:51.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.144 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:51.144 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297792+0000", 2024-04-19T02:17:51.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0949999999999996e-06 2024-04-19T02:17:51.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.144 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:51.144 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297799+0000", 2024-04-19T02:17:51.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0360000000000001e-06 2024-04-19T02:17:51.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.144 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:51.144 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297823+0000", 2024-04-19T02:17:51.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3595e-05 2024-04-19T02:17:51.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:51.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297893+0000", 2024-04-19T02:17:51.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0343000000000001e-05 2024-04-19T02:17:51.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:51.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.297965+0000", 2024-04-19T02:17:51.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2253000000000001e-05 2024-04-19T02:17:51.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:51.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.300115+0000", 2024-04-19T02:17:51.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021493319999999999 2024-04-19T02:17:51.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:51.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361742+0000", 2024-04-19T02:17:51.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061627511000000003 2024-04-19T02:17:51.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:51.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361780+0000", 2024-04-19T02:17:51.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7759000000000002e-05 2024-04-19T02:17:51.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:51.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.361817+0000", 2024-04-19T02:17:51.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6804999999999997e-05 2024-04-19T02:17:51.147 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:51.147 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:51.147 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:51.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.147 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241644 5.9 5:993dd037:::benchmark_data_smithi121_44835_object107609:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:51.147 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.298160+0000", 2024-04-19T02:17:51.147 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 12.793323678, 2024-04-19T02:17:51.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.062615216000000001, 2024-04-19T02:17:51.147 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:51.147 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:51.147 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:51.147 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:51.148 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:51.148 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241644 2024-04-19T02:17:51.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.148 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:51.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:51.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298160+0000", 2024-04-19T02:17:51.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:51.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:51.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298160+0000", 2024-04-19T02:17:51.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:51.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:51.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298160+0000", 2024-04-19T02:17:51.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:51.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:51.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298162+0000", 2024-04-19T02:17:51.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8360000000000001e-06 2024-04-19T02:17:51.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:51.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298167+0000", 2024-04-19T02:17:51.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1710000000000001e-06 2024-04-19T02:17:51.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:51.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298170+0000", 2024-04-19T02:17:51.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0740000000000001e-06 2024-04-19T02:17:51.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:51.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298202+0000", 2024-04-19T02:17:51.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2163999999999999e-05 2024-04-19T02:17:51.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:51.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298281+0000", 2024-04-19T02:17:51.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8318000000000005e-05 2024-04-19T02:17:51.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:51.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298344+0000", 2024-04-19T02:17:51.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2909000000000004e-05 2024-04-19T02:17:51.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:51.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.301043+0000", 2024-04-19T02:17:51.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026998159999999998 2024-04-19T02:17:51.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:51.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.360725+0000", 2024-04-19T02:17:51.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059681627000000001 2024-04-19T02:17:51.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:51.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.360753+0000", 2024-04-19T02:17:51.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8198999999999999e-05 2024-04-19T02:17:51.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:51.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.360776+0000", 2024-04-19T02:17:51.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2388e-05 2024-04-19T02:17:51.152 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:51.152 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:51.152 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:51.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.153 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241645 5.9 5:935d75f3:::benchmark_data_smithi121_44835_object107610:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:51.153 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.298176+0000", 2024-04-19T02:17:51.153 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 12.793308512999999, 2024-04-19T02:17:51.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.067784611999999994, 2024-04-19T02:17:51.153 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:51.153 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:51.153 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:51.153 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:51.153 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:51.153 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241645 2024-04-19T02:17:51.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.153 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:51.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:51.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298176+0000", 2024-04-19T02:17:51.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:51.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:51.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298176+0000", 2024-04-19T02:17:51.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:51.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:51.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298175+0000", 2024-04-19T02:17:51.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:51.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:51.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298177+0000", 2024-04-19T02:17:51.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9709999999999998e-06 2024-04-19T02:17:51.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:51.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298183+0000", 2024-04-19T02:17:51.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4700000000000001e-06 2024-04-19T02:17:51.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:51.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.298187+0000", 2024-04-19T02:17:51.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7249999999999997e-06 2024-04-19T02:17:51.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:51.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.299715+0000", 2024-04-19T02:17:51.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001527657 2024-04-19T02:17:51.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:51.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.299790+0000", 2024-04-19T02:17:51.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4789999999999994e-05 2024-04-19T02:17:51.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:51.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.299853+0000", 2024-04-19T02:17:51.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2905999999999997e-05 2024-04-19T02:17:51.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:51.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.301553+0000", 2024-04-19T02:17:51.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017001609999999999 2024-04-19T02:17:51.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:51.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.365904+0000", 2024-04-19T02:17:51.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.064351028000000005 2024-04-19T02:17:51.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:51.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.365931+0000", 2024-04-19T02:17:51.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6809e-05 2024-04-19T02:17:51.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:51.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.365960+0000", 2024-04-19T02:17:51.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9391e-05 2024-04-19T02:17:51.158 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:51.158 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:51.158 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:51.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.158 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:241652 5.d 5:bbf7ddbb:::benchmark_data_smithi121_44835_object107617:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:51.158 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:38.309592+0000", 2024-04-19T02:17:51.158 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 12.781892295, 2024-04-19T02:17:51.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.054120610999999999, 2024-04-19T02:17:51.158 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:51.158 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:51.158 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:51.158 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:51.159 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:51.159 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 241652 2024-04-19T02:17:51.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.159 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:51.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:51.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309592+0000", 2024-04-19T02:17:51.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:51.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:51.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309592+0000", 2024-04-19T02:17:51.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:51.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:51.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309591+0000", 2024-04-19T02:17:51.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:51.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:51.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309595+0000", 2024-04-19T02:17:51.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6009999999999999e-06 2024-04-19T02:17:51.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:51.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309603+0000", 2024-04-19T02:17:51.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9319999999999996e-06 2024-04-19T02:17:51.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:51.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309608+0000", 2024-04-19T02:17:51.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7809999999999996e-06 2024-04-19T02:17:51.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:51.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309635+0000", 2024-04-19T02:17:51.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7376e-05 2024-04-19T02:17:51.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:51.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309709+0000", 2024-04-19T02:17:51.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4318000000000002e-05 2024-04-19T02:17:51.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:51.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.309774+0000", 2024-04-19T02:17:51.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5173999999999996e-05 2024-04-19T02:17:51.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:51.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.311459+0000", 2024-04-19T02:17:51.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001684269 2024-04-19T02:17:51.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:51.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.363665+0000", 2024-04-19T02:17:51.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.052205840000000003 2024-04-19T02:17:51.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:51.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.363694+0000", 2024-04-19T02:17:51.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9706999999999999e-05 2024-04-19T02:17:51.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:51.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:38.363712+0000", 2024-04-19T02:17:51.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8144000000000001e-05 2024-04-19T02:17:51.164 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:51.164 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:51.164 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:51.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.164 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:262339 5.2 5:4f7a406e:::benchmark_data_smithi121_44835_object128304:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T02:17:51.164 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:45.851345+0000", 2024-04-19T02:17:51.164 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.2401389570000001, 2024-04-19T02:17:51.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.064477598999999997, 2024-04-19T02:17:51.164 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:51.164 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:51.164 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:51.165 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:51.165 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:51.165 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 262339 2024-04-19T02:17:51.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.165 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:51.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:51.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.851345+0000", 2024-04-19T02:17:51.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:51.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:51.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.851345+0000", 2024-04-19T02:17:51.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:51.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:51.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.851345+0000", 2024-04-19T02:17:51.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:51.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:51.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.851347+0000", 2024-04-19T02:17:51.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4619999999999999e-06 2024-04-19T02:17:51.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:51.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.851352+0000", 2024-04-19T02:17:51.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0540000000000002e-06 2024-04-19T02:17:51.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:51.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.851356+0000", 2024-04-19T02:17:51.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6990000000000001e-06 2024-04-19T02:17:51.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:51.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.853448+0000", 2024-04-19T02:17:51.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020915730000000002 2024-04-19T02:17:51.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:51.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.853593+0000", 2024-04-19T02:17:51.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014543800000000001 2024-04-19T02:17:51.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:51.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915708+0000", 2024-04-19T02:17:51.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.062114765000000002 2024-04-19T02:17:51.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:51.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915749+0000", 2024-04-19T02:17:51.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0926000000000001e-05 2024-04-19T02:17:51.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:51.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915823+0000", 2024-04-19T02:17:51.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4040000000000003e-05 2024-04-19T02:17:51.169 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:51.169 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:51.169 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:51.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.169 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:262342 5.5 5:af014019:::benchmark_data_smithi121_44835_object128307:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T02:17:51.169 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:45.852022+0000", 2024-04-19T02:17:51.169 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.2394617500000003, 2024-04-19T02:17:51.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.063803426999999996, 2024-04-19T02:17:51.169 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:51.169 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:51.169 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:51.169 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:51.170 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:51.170 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 262342 2024-04-19T02:17:51.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.170 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:51.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:51.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.852022+0000", 2024-04-19T02:17:51.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:51.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:51.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.852022+0000", 2024-04-19T02:17:51.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:51.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:51.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.852022+0000", 2024-04-19T02:17:51.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:51.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:51.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.852026+0000", 2024-04-19T02:17:51.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1670000000000001e-06 2024-04-19T02:17:51.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:51.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.852033+0000", 2024-04-19T02:17:51.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3730000000000004e-06 2024-04-19T02:17:51.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:51.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.852038+0000", 2024-04-19T02:17:51.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9559999999999996e-06 2024-04-19T02:17:51.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:51.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.852076+0000", 2024-04-19T02:17:51.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7429999999999999e-05 2024-04-19T02:17:51.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:51.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.852199+0000", 2024-04-19T02:17:51.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012372899999999999 2024-04-19T02:17:51.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:51.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915689+0000", 2024-04-19T02:17:51.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.063490115999999999 2024-04-19T02:17:51.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:51.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915743+0000", 2024-04-19T02:17:51.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3480000000000003e-05 2024-04-19T02:17:51.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:51.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915826+0000", 2024-04-19T02:17:51.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2830999999999993e-05 2024-04-19T02:17:51.173 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:51.174 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:51.174 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:51.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.174 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:262344 5.f 5:f913826c:::benchmark_data_smithi121_44835_object128309:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T02:17:51.174 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:45.854353+0000", 2024-04-19T02:17:51.174 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.2371314980000001, 2024-04-19T02:17:51.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061458894999999999, 2024-04-19T02:17:51.174 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:51.174 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:51.174 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:51.174 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:51.174 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:51.174 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 262344 2024-04-19T02:17:51.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.175 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:51.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:51.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854353+0000", 2024-04-19T02:17:51.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:51.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:51.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854353+0000", 2024-04-19T02:17:51.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:51.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:51.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854352+0000", 2024-04-19T02:17:51.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:51.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:51.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854356+0000", 2024-04-19T02:17:51.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3039999999999998e-06 2024-04-19T02:17:51.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:51.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854364+0000", 2024-04-19T02:17:51.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5100000000000001e-06 2024-04-19T02:17:51.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:51.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854369+0000", 2024-04-19T02:17:51.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2360000000000004e-06 2024-04-19T02:17:51.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:51.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854396+0000", 2024-04-19T02:17:51.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7487999999999998e-05 2024-04-19T02:17:51.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:51.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854468+0000", 2024-04-19T02:17:51.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1647e-05 2024-04-19T02:17:51.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-04-19T02:17:51.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854533+0000", 2024-04-19T02:17:51.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4709000000000007e-05 2024-04-19T02:17:51.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:51.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.856402+0000", 2024-04-19T02:17:51.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001868839 2024-04-19T02:17:51.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:51.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915731+0000", 2024-04-19T02:17:51.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059329036000000002 2024-04-19T02:17:51.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:51.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915774+0000", 2024-04-19T02:17:51.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3599e-05 2024-04-19T02:17:51.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:51.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915811+0000", 2024-04-19T02:17:51.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7171e-05 2024-04-19T02:17:51.179 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:51.179 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:51.179 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:51.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.179 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:262345 5.7 5:e3a7b870:::benchmark_data_smithi121_44835_object128310:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T02:17:51.179 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:45.854376+0000", 2024-04-19T02:17:51.179 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.2371083980000002, 2024-04-19T02:17:51.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061557471000000002, 2024-04-19T02:17:51.179 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:51.180 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:51.180 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:51.180 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:51.180 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:51.180 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 262345 2024-04-19T02:17:51.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.180 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:51.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:51.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854376+0000", 2024-04-19T02:17:51.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:51.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:51.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854376+0000", 2024-04-19T02:17:51.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:51.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:51.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854375+0000", 2024-04-19T02:17:51.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:51.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:51.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854377+0000", 2024-04-19T02:17:51.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6700000000000001e-06 2024-04-19T02:17:51.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:51.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854380+0000", 2024-04-19T02:17:51.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3790000000000002e-06 2024-04-19T02:17:51.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:51.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854383+0000", 2024-04-19T02:17:51.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7439999999999999e-06 2024-04-19T02:17:51.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:51.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854411+0000", 2024-04-19T02:17:51.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7430999999999999e-05 2024-04-19T02:17:51.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:51.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854483+0000", 2024-04-19T02:17:51.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2268999999999995e-05 2024-04-19T02:17:51.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:51.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915820+0000", 2024-04-19T02:17:51.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061336768 2024-04-19T02:17:51.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:51.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915858+0000", 2024-04-19T02:17:51.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7886000000000003e-05 2024-04-19T02:17:51.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:51.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915933+0000", 2024-04-19T02:17:51.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5593000000000006e-05 2024-04-19T02:17:51.184 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:51.184 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:51.184 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:51.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.184 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:262346 5.7 5:eee05b20:::benchmark_data_smithi121_44835_object128311:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T02:17:51.184 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:45.854386+0000", 2024-04-19T02:17:51.184 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.237098166, 2024-04-19T02:17:51.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.065671691000000004, 2024-04-19T02:17:51.184 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:51.184 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:51.184 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:51.184 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:51.184 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:51.185 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 262346 2024-04-19T02:17:51.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.185 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:51.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:51.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854386+0000", 2024-04-19T02:17:51.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:51.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:51.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854386+0000", 2024-04-19T02:17:51.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:51.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:51.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854386+0000", 2024-04-19T02:17:51.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967296 2024-04-19T02:17:51.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:51.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854388+0000", 2024-04-19T02:17:51.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9290000000000001e-06 2024-04-19T02:17:51.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:51.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854391+0000", 2024-04-19T02:17:51.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.942e-06 2024-04-19T02:17:51.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:51.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.854394+0000", 2024-04-19T02:17:51.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0740000000000001e-06 2024-04-19T02:17:51.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:51.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.855841+0000", 2024-04-19T02:17:51.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001447411 2024-04-19T02:17:51.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:51.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.855910+0000", 2024-04-19T02:17:51.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8609999999999995e-05 2024-04-19T02:17:51.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:51.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.919944+0000", 2024-04-19T02:17:51.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.064034663000000006 2024-04-19T02:17:51.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:51.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.919989+0000", 2024-04-19T02:17:51.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4533000000000002e-05 2024-04-19T02:17:51.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:51.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.920058+0000", 2024-04-19T02:17:51.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8756000000000004e-05 2024-04-19T02:17:51.188 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:51.189 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:51.189 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:51.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.189 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:262352 5.c 5:3c8d5871:::benchmark_data_smithi121_44835_object128317:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T02:17:51.189 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:45.855299+0000", 2024-04-19T02:17:51.189 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.2361855520000002, 2024-04-19T02:17:51.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060570657999999999, 2024-04-19T02:17:51.189 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:51.189 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:51.189 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:51.189 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:51.189 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:51.189 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 262352 2024-04-19T02:17:51.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.190 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:51.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:51.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.855299+0000", 2024-04-19T02:17:51.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:51.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:51.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.855299+0000", 2024-04-19T02:17:51.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:51.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:51.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.855298+0000", 2024-04-19T02:17:51.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:51.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:51.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.855301+0000", 2024-04-19T02:17:51.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.615e-06 2024-04-19T02:17:51.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:51.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.855305+0000", 2024-04-19T02:17:51.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7190000000000001e-06 2024-04-19T02:17:51.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:51.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.855309+0000", 2024-04-19T02:17:51.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.89e-06 2024-04-19T02:17:51.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:51.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.855340+0000", 2024-04-19T02:17:51.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1192000000000002e-05 2024-04-19T02:17:51.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:51.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.855412+0000", 2024-04-19T02:17:51.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1491999999999999e-05 2024-04-19T02:17:51.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:51.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915748+0000", 2024-04-19T02:17:51.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060335524000000001 2024-04-19T02:17:51.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:51.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915790+0000", 2024-04-19T02:17:51.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2178000000000002e-05 2024-04-19T02:17:51.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:51.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915869+0000", 2024-04-19T02:17:51.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9473000000000003e-05 2024-04-19T02:17:51.193 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:51.193 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:51.193 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:51.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.194 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:262357 5.3 5:c80391af:::benchmark_data_smithi121_44835_object128322:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T02:17:51.194 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:45.857454+0000", 2024-04-19T02:17:51.194 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.2340298150000004, 2024-04-19T02:17:51.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061276328999999997, 2024-04-19T02:17:51.194 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:51.194 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:51.194 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:51.194 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:51.194 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:51.194 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 262357 2024-04-19T02:17:51.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.194 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:51.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:51.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.857454+0000", 2024-04-19T02:17:51.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:51.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:51.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.857454+0000", 2024-04-19T02:17:51.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:51.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:51.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.857454+0000", 2024-04-19T02:17:51.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:51.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:51.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.857458+0000", 2024-04-19T02:17:51.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0579999999999999e-06 2024-04-19T02:17:51.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:51.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.857465+0000", 2024-04-19T02:17:51.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3379999999999999e-06 2024-04-19T02:17:51.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:51.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.857470+0000", 2024-04-19T02:17:51.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7840000000000003e-06 2024-04-19T02:17:51.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:51.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.857513+0000", 2024-04-19T02:17:51.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3537e-05 2024-04-19T02:17:51.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:51.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.857592+0000", 2024-04-19T02:17:51.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8286000000000002e-05 2024-04-19T02:17:51.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:51.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.918619+0000", 2024-04-19T02:17:51.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061027286 2024-04-19T02:17:51.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:51.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.918660+0000", 2024-04-19T02:17:51.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1152000000000002e-05 2024-04-19T02:17:51.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:51.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.918731+0000", 2024-04-19T02:17:51.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0456000000000004e-05 2024-04-19T02:17:51.198 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:51.198 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:51.198 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:51.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.198 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4549.0:262361 5.2 5:4dd4f1fe:::benchmark_data_smithi121_44835_object128326:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T02:17:51.198 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-04-19T02:17:45.861370+0000", 2024-04-19T02:17:51.199 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.2301138480000002, 2024-04-19T02:17:51.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061639977999999998, 2024-04-19T02:17:51.199 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-04-19T02:17:51.199 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:51.199 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-04-19T02:17:51.199 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4549", 2024-04-19T02:17:51.199 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:51.199 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 262361 2024-04-19T02:17:51.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.199 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-04-19T02:17:51.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-04-19T02:17:51.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.861370+0000", 2024-04-19T02:17:51.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:51.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-04-19T02:17:51.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.861370+0000", 2024-04-19T02:17:51.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-04-19T02:17:51.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-04-19T02:17:51.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.861368+0000", 2024-04-19T02:17:51.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4294967295.9999981 2024-04-19T02:17:51.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-04-19T02:17:51.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.861382+0000", 2024-04-19T02:17:51.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3103e-05 2024-04-19T02:17:51.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-04-19T02:17:51.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915692+0000", 2024-04-19T02:17:51.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.054310768000000002 2024-04-19T02:17:51.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-04-19T02:17:51.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915703+0000", 2024-04-19T02:17:51.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0637e-05 2024-04-19T02:17:51.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-04-19T02:17:51.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915853+0000", 2024-04-19T02:17:51.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014972999999999999 2024-04-19T02:17:51.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-04-19T02:17:51.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.915977+0000", 2024-04-19T02:17:51.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012470800000000001 2024-04-19T02:17:51.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-04-19T02:17:51.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.922943+0000", 2024-04-19T02:17:51.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0069653780000000004 2024-04-19T02:17:51.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-04-19T02:17:51.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.922969+0000", 2024-04-19T02:17:51.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6531000000000001e-05 2024-04-19T02:17:51.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-19T02:17:51.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-04-19T02:17:51.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-04-19T02:17:51.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-04-19T02:17:45.923010+0000", 2024-04-19T02:17:51.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0859000000000003e-05 2024-04-19T02:17:51.203 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:51.203 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:51.203 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:51.203 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-19T02:17:51.203 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-19T02:17:51.203 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:17:51.205 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:17:51.205 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:51.204+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:51.305 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:51.306+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:51.335 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:17:51.336 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [], 2024-04-19T02:17:51.336 INFO:teuthology.orchestra.run.smithi174.stdout: "num_ops": 0 2024-04-19T02:17:51.336 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:17:51.346 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:17:51.407 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:51.407+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:51.472 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:17:51.472 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [], 2024-04-19T02:17:51.472 INFO:teuthology.orchestra.run.smithi174.stdout: "complaint_time": 30, 2024-04-19T02:17:51.472 INFO:teuthology.orchestra.run.smithi174.stdout: "num_blocked_ops": 0 2024-04-19T02:17:51.472 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:17:51.482 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:17:51.508 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:51.508+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:51.607 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T02:17:51.608 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:51.609+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:51.610 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-19T02:17:51.610 INFO:teuthology.orchestra.run.smithi174.stdout: "size": 20, 2024-04-19T02:17:51.610 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 600, 2024-04-19T02:17:51.610 INFO:teuthology.orchestra.run.smithi174.stdout: "ops": [ 2024-04-19T02:17:51.610 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.610 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78259 5.4 5:2aa344b2:::benchmark_data_smithi121_44835_object78258:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:51.610 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:17:51.610 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 84.484236804000005, 2024-04-19T02:17:51.610 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022934350999999999, 2024-04-19T02:17:51.611 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:51.611 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:51.611 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:51.611 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:51.611 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:51.611 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78259 2024-04-19T02:17:51.611 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.611 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:51.611 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.611 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:51.611 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:17:51.611 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:51.611 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.611 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.611 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:51.612 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125257+0000", 2024-04-19T02:17:51.612 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:51.612 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.612 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.612 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:51.612 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125256+0000", 2024-04-19T02:17:51.612 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:51.612 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.612 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.612 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:51.612 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125347+0000", 2024-04-19T02:17:51.612 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0470000000000006e-05 2024-04-19T02:17:51.612 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.612 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.613 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:51.613 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125358+0000", 2024-04-19T02:17:51.613 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1764e-05 2024-04-19T02:17:51.613 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.613 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.613 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:51.613 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125364+0000", 2024-04-19T02:17:51.613 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.7189999999999998e-06 2024-04-19T02:17:51.613 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.613 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.613 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:51.613 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125391+0000", 2024-04-19T02:17:51.613 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7270000000000001e-05 2024-04-19T02:17:51.613 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.613 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.614 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:51.614 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125471+0000", 2024-04-19T02:17:51.614 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9209999999999995e-05 2024-04-19T02:17:51.614 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.614 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.614 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:51.614 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.125559+0000", 2024-04-19T02:17:51.614 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.8689000000000004e-05 2024-04-19T02:17:51.614 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.614 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.614 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:51.614 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.128164+0000", 2024-04-19T02:17:51.614 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0026050270000000002 2024-04-19T02:17:51.614 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.615 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.615 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:51.615 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148139+0000", 2024-04-19T02:17:51.615 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.019975050000000001 2024-04-19T02:17:51.615 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.615 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.615 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:51.615 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148169+0000", 2024-04-19T02:17:51.615 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0001e-05 2024-04-19T02:17:51.615 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.615 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.615 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:51.615 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.148191+0000", 2024-04-19T02:17:51.615 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.2104999999999999e-05 2024-04-19T02:17:51.616 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:51.616 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:51.616 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:51.616 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.616 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.616 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:78272 5.4 5:273e819a:::benchmark_data_smithi121_44835_object78271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T02:17:51.616 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:51.616 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 84.476884530999996, 2024-04-19T02:17:51.616 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022180163999999999, 2024-04-19T02:17:51.616 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:51.616 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:51.616 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:51.616 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:51.616 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:51.617 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 78272 2024-04-19T02:17:51.617 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.617 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:51.617 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.617 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:51.617 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:51.617 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:51.617 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.617 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.617 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:51.617 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:51.617 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:51.617 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.617 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.618 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:51.618 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132609+0000", 2024-04-19T02:17:51.618 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:51.618 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.618 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.618 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:51.618 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132690+0000", 2024-04-19T02:17:51.618 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0963000000000004e-05 2024-04-19T02:17:51.618 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.618 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.618 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:51.618 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132703+0000", 2024-04-19T02:17:51.618 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.3072e-05 2024-04-19T02:17:51.619 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.619 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.619 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:51.619 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.132710+0000", 2024-04-19T02:17:51.619 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3100000000000003e-06 2024-04-19T02:17:51.619 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.619 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.619 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:51.619 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134005+0000", 2024-04-19T02:17:51.619 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001294513 2024-04-19T02:17:51.619 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.619 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.619 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:51.619 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134139+0000", 2024-04-19T02:17:51.619 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000134447 2024-04-19T02:17:51.620 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.620 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.620 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:51.620 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.134284+0000", 2024-04-19T02:17:51.620 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00014514399999999999 2024-04-19T02:17:51.620 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.620 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.620 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:51.620 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.139622+0000", 2024-04-19T02:17:51.620 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0053373830000000002 2024-04-19T02:17:51.620 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.620 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.620 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:51.620 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154737+0000", 2024-04-19T02:17:51.620 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.015115195999999999 2024-04-19T02:17:51.621 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.621 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.621 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:51.621 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154768+0000", 2024-04-19T02:17:51.621 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0824999999999997e-05 2024-04-19T02:17:51.621 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.621 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.621 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:51.621 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:27.154790+0000", 2024-04-19T02:17:51.621 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.1999000000000001e-05 2024-04-19T02:17:51.621 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:51.621 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:51.621 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:51.621 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.621 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.622 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:94581 5.b 5:dc86d6e9:::benchmark_data_smithi121_44835_object94580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T02:17:51.622 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:51.622 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 76.429313640999993, 2024-04-19T02:17:51.622 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022099711000000001, 2024-04-19T02:17:51.622 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:51.622 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:51.622 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:51.622 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:51.622 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:51.622 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 94581 2024-04-19T02:17:51.622 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.622 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:51.622 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.622 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:51.622 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:51.623 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:51.623 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.623 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.623 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:51.623 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:51.623 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:51.623 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.623 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.623 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:51.623 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180180+0000", 2024-04-19T02:17:51.623 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:51.623 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.623 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.624 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:51.624 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180253+0000", 2024-04-19T02:17:51.624 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3163000000000004e-05 2024-04-19T02:17:51.624 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.624 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.624 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:51.624 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180266+0000", 2024-04-19T02:17:51.624 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.2886e-05 2024-04-19T02:17:51.624 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.624 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.624 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:51.624 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180273+0000", 2024-04-19T02:17:51.624 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.4059999999999999e-06 2024-04-19T02:17:51.624 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.624 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.625 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:51.625 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180646+0000", 2024-04-19T02:17:51.625 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00037283999999999999 2024-04-19T02:17:51.625 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.625 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.625 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:51.625 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180774+0000", 2024-04-19T02:17:51.625 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012793799999999999 2024-04-19T02:17:51.625 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.625 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.625 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:51.625 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.180920+0000", 2024-04-19T02:17:51.625 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000146692 2024-04-19T02:17:51.625 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.625 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.626 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:51.626 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.183344+0000", 2024-04-19T02:17:51.626 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0024231669999999999 2024-04-19T02:17:51.626 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.626 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.626 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:51.626 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202196+0000", 2024-04-19T02:17:51.626 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.018852384 2024-04-19T02:17:51.626 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.626 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.626 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:51.626 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202241+0000", 2024-04-19T02:17:51.626 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4923999999999999e-05 2024-04-19T02:17:51.626 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.627 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.627 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:51.627 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:35.202280+0000", 2024-04-19T02:17:51.627 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9096e-05 2024-04-19T02:17:51.627 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:51.627 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:51.627 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:51.627 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.627 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.627 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:104431 5.8 5:14818e19:::benchmark_data_smithi121_44835_object104430:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T02:17:51.627 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:17:51.627 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 71.398108596, 2024-04-19T02:17:51.627 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022149528000000002, 2024-04-19T02:17:51.627 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:51.628 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:51.628 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:51.628 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:51.628 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:51.628 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 104431 2024-04-19T02:17:51.628 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.628 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:51.628 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.628 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:51.628 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:17:51.628 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:51.628 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.628 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.628 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:51.629 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211385+0000", 2024-04-19T02:17:51.629 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:51.629 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.629 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.629 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:51.629 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211384+0000", 2024-04-19T02:17:51.629 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:51.629 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.629 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.629 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:51.629 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211458+0000", 2024-04-19T02:17:51.629 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3311000000000003e-05 2024-04-19T02:17:51.629 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.629 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.629 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:51.630 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211471+0000", 2024-04-19T02:17:51.630 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.3308e-05 2024-04-19T02:17:51.630 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.630 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.630 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:51.630 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.211479+0000", 2024-04-19T02:17:51.630 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.0909999999999993e-06 2024-04-19T02:17:51.630 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.630 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.630 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:51.630 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.221821+0000", 2024-04-19T02:17:51.630 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.010341596999999999 2024-04-19T02:17:51.630 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.630 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.631 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:51.631 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.221966+0000", 2024-04-19T02:17:51.631 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000145167 2024-04-19T02:17:51.631 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.631 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.631 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:51.631 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.222077+0000", 2024-04-19T02:17:51.631 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011128000000000001 2024-04-19T02:17:51.631 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.631 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.631 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:51.631 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.228126+0000", 2024-04-19T02:17:51.631 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0060486710000000003 2024-04-19T02:17:51.631 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.632 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.632 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:51.632 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233449+0000", 2024-04-19T02:17:51.632 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0053231370000000004 2024-04-19T02:17:51.632 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.632 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.632 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:51.632 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233498+0000", 2024-04-19T02:17:51.632 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8798999999999998e-05 2024-04-19T02:17:51.632 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.632 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.632 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:51.632 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:16:40.233535+0000", 2024-04-19T02:17:51.632 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7119000000000002e-05 2024-04-19T02:17:51.633 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:51.633 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:51.633 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:51.633 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.633 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.633 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157437 5.e 5:78833a3d:::benchmark_data_smithi121_44835_object23402:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:51.633 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.859854+0000", 2024-04-19T02:17:51.633 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 44.749639823999999, 2024-04-19T02:17:51.633 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.025859589999999998, 2024-04-19T02:17:51.633 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:51.633 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:51.633 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:51.633 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:51.633 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:51.633 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157437 2024-04-19T02:17:51.634 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.634 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:51.634 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.634 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:51.634 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859854+0000", 2024-04-19T02:17:51.634 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:51.634 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.634 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.634 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:51.634 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859854+0000", 2024-04-19T02:17:51.634 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:51.634 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.634 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.635 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:51.635 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859853+0000", 2024-04-19T02:17:51.635 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:51.635 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.635 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.635 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:51.635 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859857+0000", 2024-04-19T02:17:51.635 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8789999999999996e-06 2024-04-19T02:17:51.635 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.635 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.635 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:51.635 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859865+0000", 2024-04-19T02:17:51.635 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.1880000000000002e-06 2024-04-19T02:17:51.635 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.636 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.636 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:51.636 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859873+0000", 2024-04-19T02:17:51.636 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.2980000000000003e-06 2024-04-19T02:17:51.636 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.636 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.636 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:51.636 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.859908+0000", 2024-04-19T02:17:51.636 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5682999999999997e-05 2024-04-19T02:17:51.636 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.636 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.636 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:51.636 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.860046+0000", 2024-04-19T02:17:51.637 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013714200000000001 2024-04-19T02:17:51.637 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.637 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.637 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:51.637 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.860153+0000", 2024-04-19T02:17:51.637 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00010725700000000001 2024-04-19T02:17:51.637 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.637 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.637 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:51.637 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.862008+0000", 2024-04-19T02:17:51.637 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001855179 2024-04-19T02:17:51.637 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.637 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.637 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:51.637 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.885629+0000", 2024-04-19T02:17:51.638 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.023621428 2024-04-19T02:17:51.638 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.638 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.638 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:51.638 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.885676+0000", 2024-04-19T02:17:51.638 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.6371e-05 2024-04-19T02:17:51.638 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.638 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.638 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:51.638 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.885714+0000", 2024-04-19T02:17:51.638 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.7907000000000001e-05 2024-04-19T02:17:51.638 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:51.638 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:51.638 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:51.639 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.639 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.639 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157438 5.0 5:01944e77:::benchmark_data_smithi121_44835_object23403:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:51.639 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.864095+0000", 2024-04-19T02:17:51.639 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 44.745398539999997, 2024-04-19T02:17:51.639 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.032015298999999997, 2024-04-19T02:17:51.639 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:51.639 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:51.639 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:51.639 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:51.639 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:51.639 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157438 2024-04-19T02:17:51.639 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.640 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:51.640 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.640 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:51.640 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864095+0000", 2024-04-19T02:17:51.640 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:51.640 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.640 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.640 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:51.640 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864095+0000", 2024-04-19T02:17:51.640 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:51.640 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.640 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.640 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:51.641 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864094+0000", 2024-04-19T02:17:51.641 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:51.641 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.641 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.641 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:51.641 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864102+0000", 2024-04-19T02:17:51.641 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.6629999999999993e-06 2024-04-19T02:17:51.641 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.641 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.641 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:51.641 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864113+0000", 2024-04-19T02:17:51.641 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.1185999999999999e-05 2024-04-19T02:17:51.641 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.641 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.642 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:51.642 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864119+0000", 2024-04-19T02:17:51.642 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.224e-06 2024-04-19T02:17:51.642 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.642 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.642 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:51.642 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864151+0000", 2024-04-19T02:17:51.642 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1395e-05 2024-04-19T02:17:51.642 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.642 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.642 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:51.642 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864275+0000", 2024-04-19T02:17:51.642 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012431399999999999 2024-04-19T02:17:51.642 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.643 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.643 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:51.643 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864341+0000", 2024-04-19T02:17:51.643 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6146e-05 2024-04-19T02:17:51.643 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.643 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.643 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:51.643 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.866040+0000", 2024-04-19T02:17:51.643 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016991879999999999 2024-04-19T02:17:51.643 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.643 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.643 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:51.643 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896055+0000", 2024-04-19T02:17:51.644 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.030014886000000001 2024-04-19T02:17:51.644 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.644 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.644 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:51.644 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896087+0000", 2024-04-19T02:17:51.644 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1761000000000003e-05 2024-04-19T02:17:51.644 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.644 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.644 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:51.644 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896111+0000", 2024-04-19T02:17:51.644 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3623999999999999e-05 2024-04-19T02:17:51.644 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:51.644 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:51.644 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:51.645 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.645 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.645 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157439 5.e 5:79eb9d3c:::benchmark_data_smithi121_44835_object23404:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:51.645 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:51.645 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 44.745367465000001, 2024-04-19T02:17:51.645 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.027045244, 2024-04-19T02:17:51.645 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:51.645 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:51.645 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:51.645 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:51.645 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:51.645 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157439 2024-04-19T02:17:51.645 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.645 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:51.645 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.646 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:51.646 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:51.646 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:51.646 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.646 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.646 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:51.646 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:51.646 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:51.646 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.646 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.649 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:51.649 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864126+0000", 2024-04-19T02:17:51.650 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:51.650 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.650 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.650 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:51.650 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864128+0000", 2024-04-19T02:17:51.650 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.911e-06 2024-04-19T02:17:51.650 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.650 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.650 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:51.650 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864136+0000", 2024-04-19T02:17:51.650 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2609999999999993e-06 2024-04-19T02:17:51.650 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.650 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.650 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:51.650 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864140+0000", 2024-04-19T02:17:51.651 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5530000000000001e-06 2024-04-19T02:17:51.651 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.651 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.651 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:51.651 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864169+0000", 2024-04-19T02:17:51.651 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.8932e-05 2024-04-19T02:17:51.651 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.651 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.651 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:51.651 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864267+0000", 2024-04-19T02:17:51.651 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7969999999999999e-05 2024-04-19T02:17:51.651 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.652 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.652 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:51.652 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.864339+0000", 2024-04-19T02:17:51.652 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.2280999999999995e-05 2024-04-19T02:17:51.652 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.652 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.652 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:51.652 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.865763+0000", 2024-04-19T02:17:51.652 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0014236310000000001 2024-04-19T02:17:51.652 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.652 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.652 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:51.652 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.891093+0000", 2024-04-19T02:17:51.652 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.025330571 2024-04-19T02:17:51.653 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.653 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.653 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:51.653 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.891137+0000", 2024-04-19T02:17:51.653 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.3980999999999998e-05 2024-04-19T02:17:51.653 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.653 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.653 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:51.653 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.891172+0000", 2024-04-19T02:17:51.653 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4465000000000003e-05 2024-04-19T02:17:51.653 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:51.653 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:51.654 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:51.654 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.654 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.654 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157442 5.0 5:0062b73f:::benchmark_data_smithi121_44835_object23407:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:51.654 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.867065+0000", 2024-04-19T02:17:51.654 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 44.742428814999997, 2024-04-19T02:17:51.654 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.029165542999999999, 2024-04-19T02:17:51.654 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:51.654 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:51.654 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:51.654 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:51.654 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:51.654 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157442 2024-04-19T02:17:51.654 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.655 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:51.655 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.655 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:51.655 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867065+0000", 2024-04-19T02:17:51.655 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:51.655 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.655 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.655 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:51.655 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867065+0000", 2024-04-19T02:17:51.655 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:51.655 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.655 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.655 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:51.655 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867064+0000", 2024-04-19T02:17:51.656 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:51.656 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.656 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.656 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:51.656 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867069+0000", 2024-04-19T02:17:51.656 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4549999999999997e-06 2024-04-19T02:17:51.656 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.656 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.656 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:51.656 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867080+0000", 2024-04-19T02:17:51.656 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0797e-05 2024-04-19T02:17:51.656 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.656 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.656 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:51.657 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867088+0000", 2024-04-19T02:17:51.657 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9729999999999997e-06 2024-04-19T02:17:51.657 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.657 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.657 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:51.657 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867121+0000", 2024-04-19T02:17:51.657 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2920000000000003e-05 2024-04-19T02:17:51.657 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.657 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.657 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:51.657 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867203+0000", 2024-04-19T02:17:51.657 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.2578999999999997e-05 2024-04-19T02:17:51.657 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.657 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.657 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:51.658 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.867386+0000", 2024-04-19T02:17:51.658 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00018237400000000001 2024-04-19T02:17:51.658 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.658 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.658 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:51.658 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.869338+0000", 2024-04-19T02:17:51.658 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0019521160000000001 2024-04-19T02:17:51.658 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.658 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.658 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:51.658 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896150+0000", 2024-04-19T02:17:51.658 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.026812074000000002 2024-04-19T02:17:51.658 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.659 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.659 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:51.659 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896191+0000", 2024-04-19T02:17:51.659 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1192000000000001e-05 2024-04-19T02:17:51.659 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.659 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.659 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:51.659 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.896231+0000", 2024-04-19T02:17:51.659 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9764000000000001e-05 2024-04-19T02:17:51.659 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:51.659 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:51.659 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:51.659 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.659 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.659 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157499 5.8 5:1c3aa38a:::benchmark_data_smithi121_44835_object23464:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:51.660 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.913447+0000", 2024-04-19T02:17:51.660 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 44.696047243000002, 2024-04-19T02:17:51.660 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.024508188, 2024-04-19T02:17:51.660 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:51.660 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:51.660 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:51.660 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:51.660 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:51.660 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157499 2024-04-19T02:17:51.660 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.660 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:51.660 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.660 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:51.660 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913447+0000", 2024-04-19T02:17:51.661 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:51.661 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.661 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.661 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:51.661 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913447+0000", 2024-04-19T02:17:51.661 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:51.661 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.661 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.661 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:51.661 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913446+0000", 2024-04-19T02:17:51.661 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:51.661 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.661 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.661 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:51.662 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913451+0000", 2024-04-19T02:17:51.662 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.677e-06 2024-04-19T02:17:51.662 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.662 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.662 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:51.662 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913461+0000", 2024-04-19T02:17:51.662 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.8859999999999999e-06 2024-04-19T02:17:51.662 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.662 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.662 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:51.662 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913467+0000", 2024-04-19T02:17:51.662 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.0800000000000002e-06 2024-04-19T02:17:51.662 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.663 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.663 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:51.663 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913513+0000", 2024-04-19T02:17:51.663 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.5707000000000001e-05 2024-04-19T02:17:51.663 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.663 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.663 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:51.663 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913637+0000", 2024-04-19T02:17:51.663 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012379200000000001 2024-04-19T02:17:51.663 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.663 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.663 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:51.663 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913747+0000", 2024-04-19T02:17:51.663 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000110071 2024-04-19T02:17:51.663 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.664 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.664 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:51.664 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915674+0000", 2024-04-19T02:17:51.664 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0019270789999999999 2024-04-19T02:17:51.664 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.664 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.664 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:51.664 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937902+0000", 2024-04-19T02:17:51.664 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022228286 2024-04-19T02:17:51.664 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.664 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.664 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:51.664 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937931+0000", 2024-04-19T02:17:51.664 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9122e-05 2024-04-19T02:17:51.665 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.665 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.665 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:51.665 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937955+0000", 2024-04-19T02:17:51.665 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3591000000000002e-05 2024-04-19T02:17:51.665 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:51.665 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:51.665 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:51.665 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.665 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.665 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157500 5.0 5:0969ec74:::benchmark_data_smithi121_44835_object23465:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:51.665 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.913476+0000", 2024-04-19T02:17:51.665 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 44.696018377000001, 2024-04-19T02:17:51.666 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.024497596, 2024-04-19T02:17:51.666 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:51.666 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:51.666 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:51.666 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:51.666 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:51.666 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157500 2024-04-19T02:17:51.666 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.666 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:51.666 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.666 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:51.666 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913476+0000", 2024-04-19T02:17:51.666 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:51.666 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.667 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.667 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:51.667 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913476+0000", 2024-04-19T02:17:51.667 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:51.667 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.667 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.667 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:51.667 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913475+0000", 2024-04-19T02:17:51.667 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:51.667 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.667 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.667 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:51.667 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913478+0000", 2024-04-19T02:17:51.667 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.2670000000000001e-06 2024-04-19T02:17:51.668 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.668 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.668 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:51.668 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913481+0000", 2024-04-19T02:17:51.668 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.6899999999999998e-06 2024-04-19T02:17:51.668 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.668 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.668 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:51.668 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913485+0000", 2024-04-19T02:17:51.668 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1230000000000002e-06 2024-04-19T02:17:51.668 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.668 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.668 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:51.669 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913526+0000", 2024-04-19T02:17:51.669 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.104e-05 2024-04-19T02:17:51.669 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.669 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.669 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:51.669 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913606+0000", 2024-04-19T02:17:51.669 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9510000000000003e-05 2024-04-19T02:17:51.669 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.669 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.669 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:51.669 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.913671+0000", 2024-04-19T02:17:51.669 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.4838000000000005e-05 2024-04-19T02:17:51.669 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.669 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.670 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:51.670 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915348+0000", 2024-04-19T02:17:51.670 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0016769860000000001 2024-04-19T02:17:51.670 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.670 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.670 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:51.670 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937897+0000", 2024-04-19T02:17:51.670 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022548902999999999 2024-04-19T02:17:51.670 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.670 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.670 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:51.670 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937938+0000", 2024-04-19T02:17:51.670 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.1499999999999999e-05 2024-04-19T02:17:51.670 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.671 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.671 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:51.671 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.937973+0000", 2024-04-19T02:17:51.671 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5057e-05 2024-04-19T02:17:51.671 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:51.671 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:51.671 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:51.671 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.671 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.671 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157501 5.4 5:26661819:::benchmark_data_smithi121_44835_object23466:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:51.671 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.914839+0000", 2024-04-19T02:17:51.671 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 44.694655083000001, 2024-04-19T02:17:51.671 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.028504224000000002, 2024-04-19T02:17:51.671 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:51.671 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:51.672 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:51.672 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:51.672 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:51.672 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157501 2024-04-19T02:17:51.672 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.672 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:51.672 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.672 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:51.672 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914839+0000", 2024-04-19T02:17:51.672 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:51.672 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.672 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.672 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:51.672 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914839+0000", 2024-04-19T02:17:51.673 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:51.673 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.673 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.673 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:51.673 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914838+0000", 2024-04-19T02:17:51.673 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:51.673 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.673 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.673 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:51.673 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914841+0000", 2024-04-19T02:17:51.674 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.706e-06 2024-04-19T02:17:51.674 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.674 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.674 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:51.674 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914848+0000", 2024-04-19T02:17:51.674 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.7429999999999996e-06 2024-04-19T02:17:51.674 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.674 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.674 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:51.674 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914852+0000", 2024-04-19T02:17:51.674 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.0810000000000004e-06 2024-04-19T02:17:51.674 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.674 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.675 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:51.675 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.914892+0000", 2024-04-19T02:17:51.675 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.9957999999999999e-05 2024-04-19T02:17:51.675 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.675 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.675 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:51.675 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915008+0000", 2024-04-19T02:17:51.675 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000116401 2024-04-19T02:17:51.675 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.675 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.675 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:51.675 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.915125+0000", 2024-04-19T02:17:51.675 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011622500000000001 2024-04-19T02:17:51.675 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.676 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.676 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:51.676 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916663+0000", 2024-04-19T02:17:51.676 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0015381310000000001 2024-04-19T02:17:51.676 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.676 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.676 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:51.676 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943114+0000", 2024-04-19T02:17:51.676 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.026451125999999998 2024-04-19T02:17:51.676 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.676 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.676 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:51.676 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943245+0000", 2024-04-19T02:17:51.676 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000131645 2024-04-19T02:17:51.677 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.677 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.677 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:51.677 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943343+0000", 2024-04-19T02:17:51.677 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7604999999999998e-05 2024-04-19T02:17:51.677 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:51.677 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:51.677 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:51.677 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.677 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.677 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157507 5.b 5:de8840a2:::benchmark_data_smithi121_44835_object23472:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:51.677 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:51.677 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 44.693090802, 2024-04-19T02:17:51.677 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.022544518999999999, 2024-04-19T02:17:51.677 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:51.678 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:51.678 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:51.678 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:51.678 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:51.678 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157507 2024-04-19T02:17:51.678 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.678 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:51.678 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.678 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:51.678 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:51.678 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:51.678 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.678 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.678 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:51.678 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:51.679 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:51.679 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.679 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.679 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:51.679 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916403+0000", 2024-04-19T02:17:51.679 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:51.679 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.679 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.679 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:51.679 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916406+0000", 2024-04-19T02:17:51.679 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.4589999999999998e-06 2024-04-19T02:17:51.679 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.679 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.679 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:51.679 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916415+0000", 2024-04-19T02:17:51.679 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.3910000000000004e-06 2024-04-19T02:17:51.680 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.680 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.680 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:51.680 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916421+0000", 2024-04-19T02:17:51.680 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.6130000000000003e-06 2024-04-19T02:17:51.680 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.680 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.680 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:51.680 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916448+0000", 2024-04-19T02:17:51.680 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7277999999999999e-05 2024-04-19T02:17:51.680 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.680 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.680 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:51.680 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916539+0000", 2024-04-19T02:17:51.680 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.0855999999999999e-05 2024-04-19T02:17:51.681 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.681 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.681 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:51.681 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.916605+0000", 2024-04-19T02:17:51.681 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.6141000000000003e-05 2024-04-19T02:17:51.681 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.681 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.681 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:51.681 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918276+0000", 2024-04-19T02:17:51.681 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001670726 2024-04-19T02:17:51.681 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.681 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.681 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:51.681 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.938888+0000", 2024-04-19T02:17:51.682 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.020612042000000001 2024-04-19T02:17:51.682 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.682 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.682 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:51.682 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.938924+0000", 2024-04-19T02:17:51.682 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5692999999999999e-05 2024-04-19T02:17:51.682 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.682 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.682 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:51.682 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.938948+0000", 2024-04-19T02:17:51.682 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.3879e-05 2024-04-19T02:17:51.682 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:51.682 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:51.682 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:51.683 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.683 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.683 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:157509 5.8 5:1dca85d0:::benchmark_data_smithi121_44835_object23474:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T02:17:51.683 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:51.683 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 44.690662555999999, 2024-04-19T02:17:51.683 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.024511807, 2024-04-19T02:17:51.683 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:51.683 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:51.683 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:51.683 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:51.683 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:51.683 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 157509 2024-04-19T02:17:51.683 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.683 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:51.683 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.683 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:51.684 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:51.684 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:51.684 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.684 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.684 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:51.684 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:51.684 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:51.684 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.684 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.684 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:51.684 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918831+0000", 2024-04-19T02:17:51.684 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:51.684 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.684 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.685 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:51.685 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918834+0000", 2024-04-19T02:17:51.685 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.9409999999999999e-06 2024-04-19T02:17:51.685 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.685 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.685 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:51.685 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918859+0000", 2024-04-19T02:17:51.685 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.5245999999999999e-05 2024-04-19T02:17:51.685 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.685 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.685 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:51.686 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918864+0000", 2024-04-19T02:17:51.686 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.1819999999999997e-06 2024-04-19T02:17:51.686 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.686 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.686 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:51.686 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.918900+0000", 2024-04-19T02:17:51.686 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5327000000000002e-05 2024-04-19T02:17:51.686 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.686 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.686 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:51.686 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.919024+0000", 2024-04-19T02:17:51.686 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00012400900000000001 2024-04-19T02:17:51.686 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.686 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.687 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "waiting for subops from 2", 2024-04-19T02:17:51.687 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.919136+0000", 2024-04-19T02:17:51.687 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.000111987 2024-04-19T02:17:51.687 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.687 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.687 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:51.687 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.922096+0000", 2024-04-19T02:17:51.687 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0029607079999999998 2024-04-19T02:17:51.687 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.687 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.687 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "sub_op_commit_rec", 2024-04-19T02:17:51.687 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943120+0000", 2024-04-19T02:17:51.687 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.021023995 2024-04-19T02:17:51.687 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.688 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.688 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:51.688 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943255+0000", 2024-04-19T02:17:51.688 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00013502100000000001 2024-04-19T02:17:51.688 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.688 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.688 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:51.688 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:06.943343+0000", 2024-04-19T02:17:51.688 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 8.7931999999999998e-05 2024-04-19T02:17:51.688 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:51.688 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:51.688 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:51.688 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.688 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.689 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:241615 5.d e62/16 5:bc2762a9:::benchmark_data_smithi121_44835_object107580:head v 62'15112, mlcod=62'15108)", 2024-04-19T02:17:51.689 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:38.291278+0000", 2024-04-19T02:17:51.689 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 13.318216394, 2024-04-19T02:17:51.689 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.064975456000000001, 2024-04-19T02:17:51.689 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:51.689 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:51.689 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:51.689 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.689 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:51.689 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.291278+0000", 2024-04-19T02:17:51.689 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:51.689 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.689 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.689 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:51.690 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.291278+0000", 2024-04-19T02:17:51.690 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:51.690 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.690 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.690 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:51.690 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.291277+0000", 2024-04-19T02:17:51.690 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:51.690 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.690 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.690 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:51.690 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.291281+0000", 2024-04-19T02:17:51.690 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.8160000000000004e-06 2024-04-19T02:17:51.690 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.690 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.691 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:51.691 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.291291+0000", 2024-04-19T02:17:51.691 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.0011e-05 2024-04-19T02:17:51.691 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.691 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.691 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:51.691 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.291296+0000", 2024-04-19T02:17:51.691 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.9559999999999996e-06 2024-04-19T02:17:51.691 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.691 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.691 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:51.691 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.292800+0000", 2024-04-19T02:17:51.691 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0015041060000000001 2024-04-19T02:17:51.691 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.692 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.692 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:51.692 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.292818+0000", 2024-04-19T02:17:51.692 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.8056000000000001e-05 2024-04-19T02:17:51.692 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.692 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.692 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:51.692 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.356217+0000", 2024-04-19T02:17:51.692 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.063399214999999995 2024-04-19T02:17:51.692 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.692 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.692 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:51.692 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.356253+0000", 2024-04-19T02:17:51.692 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5605999999999998e-05 2024-04-19T02:17:51.693 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:51.693 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:51.693 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:51.693 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.693 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.693 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:241622 5.d e62/16 5:ba16b775:::benchmark_data_smithi121_44835_object107587:head v 62'15113, mlcod=62'15108)", 2024-04-19T02:17:51.693 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:38.292906+0000", 2024-04-19T02:17:51.693 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 13.31658784, 2024-04-19T02:17:51.693 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.068017509000000004, 2024-04-19T02:17:51.693 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:51.693 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:51.693 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:51.693 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.693 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:51.694 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.292906+0000", 2024-04-19T02:17:51.694 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:51.694 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.694 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.694 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:51.694 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.292906+0000", 2024-04-19T02:17:51.694 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:51.694 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.694 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.694 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:51.694 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.292906+0000", 2024-04-19T02:17:51.694 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:51.694 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.694 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.695 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:51.695 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.292913+0000", 2024-04-19T02:17:51.695 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.1720000000000001e-06 2024-04-19T02:17:51.695 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.695 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.695 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:51.695 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.292918+0000", 2024-04-19T02:17:51.695 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.2519999999999999e-06 2024-04-19T02:17:51.695 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.695 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.695 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:51.695 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.292923+0000", 2024-04-19T02:17:51.695 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4710000000000001e-06 2024-04-19T02:17:51.695 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.696 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.696 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:51.696 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.294510+0000", 2024-04-19T02:17:51.696 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.001587822 2024-04-19T02:17:51.696 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.696 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.696 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:51.696 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.294528+0000", 2024-04-19T02:17:51.696 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.7234000000000001e-05 2024-04-19T02:17:51.696 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.696 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.696 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:51.696 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.360893+0000", 2024-04-19T02:17:51.696 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.066365882000000001 2024-04-19T02:17:51.697 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.697 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.697 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:51.697 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.360924+0000", 2024-04-19T02:17:51.697 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0139000000000001e-05 2024-04-19T02:17:51.697 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:51.697 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:51.697 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:51.697 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.697 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.697 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:241631 5.1 5:89a96e22:::benchmark_data_smithi121_44835_object107596:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:51.697 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:38.293316+0000", 2024-04-19T02:17:51.697 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 13.316177515, 2024-04-19T02:17:51.698 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.066515056000000003, 2024-04-19T02:17:51.698 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:51.698 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:51.698 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:51.698 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:51.698 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:51.698 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 241631 2024-04-19T02:17:51.698 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.698 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:51.698 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.698 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:51.698 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293316+0000", 2024-04-19T02:17:51.698 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:51.699 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.699 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.699 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:51.699 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293316+0000", 2024-04-19T02:17:51.699 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:51.699 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.699 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.699 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:51.699 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293315+0000", 2024-04-19T02:17:51.699 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:51.699 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.699 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.699 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:51.699 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293321+0000", 2024-04-19T02:17:51.700 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 5.1390000000000003e-06 2024-04-19T02:17:51.700 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.700 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.700 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:51.700 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293331+0000", 2024-04-19T02:17:51.700 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.9690000000000006e-06 2024-04-19T02:17:51.700 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.700 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.700 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:51.700 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293338+0000", 2024-04-19T02:17:51.700 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.0559999999999999e-06 2024-04-19T02:17:51.700 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.700 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.700 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:51.701 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293365+0000", 2024-04-19T02:17:51.701 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7546e-05 2024-04-19T02:17:51.701 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.701 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.701 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:51.701 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293445+0000", 2024-04-19T02:17:51.701 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.9387000000000004e-05 2024-04-19T02:17:51.701 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.701 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.701 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:51.701 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.359712+0000", 2024-04-19T02:17:51.701 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.066267197 2024-04-19T02:17:51.701 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.701 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.702 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:51.702 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.359757+0000", 2024-04-19T02:17:51.702 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.4768000000000002e-05 2024-04-19T02:17:51.702 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.702 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.702 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:51.702 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.359831+0000", 2024-04-19T02:17:51.702 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.4935e-05 2024-04-19T02:17:51.702 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:51.702 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:51.702 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:51.702 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.703 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.703 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:241633 5.8 5:16311ac0:::benchmark_data_smithi121_44835_object107598:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:51.703 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:38.293861+0000", 2024-04-19T02:17:51.703 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 13.315632564, 2024-04-19T02:17:51.703 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.066819026000000004, 2024-04-19T02:17:51.703 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:51.703 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:51.703 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:51.703 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:51.703 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:51.703 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 241633 2024-04-19T02:17:51.704 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.704 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:51.704 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.704 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:51.704 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293861+0000", 2024-04-19T02:17:51.704 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:51.704 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.704 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.704 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:51.704 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293861+0000", 2024-04-19T02:17:51.704 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:51.704 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.704 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.704 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:51.705 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293861+0000", 2024-04-19T02:17:51.705 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:51.705 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.705 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.705 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:51.705 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293863+0000", 2024-04-19T02:17:51.705 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 1.9690000000000001e-06 2024-04-19T02:17:51.705 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.705 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.705 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:51.705 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293867+0000", 2024-04-19T02:17:51.705 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5889999999999999e-06 2024-04-19T02:17:51.706 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.706 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.706 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:51.706 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293870+0000", 2024-04-19T02:17:51.706 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.0110000000000001e-06 2024-04-19T02:17:51.706 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.706 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.706 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:51.706 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293905+0000", 2024-04-19T02:17:51.706 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5043000000000003e-05 2024-04-19T02:17:51.706 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.706 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.706 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:51.706 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.294020+0000", 2024-04-19T02:17:51.707 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.00011504400000000001 2024-04-19T02:17:51.707 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.707 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.707 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:51.707 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.360556+0000", 2024-04-19T02:17:51.707 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.066536559999999995 2024-04-19T02:17:51.707 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.707 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.707 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:51.707 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.360604+0000", 2024-04-19T02:17:51.707 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.8152000000000002e-05 2024-04-19T02:17:51.707 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.707 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.707 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:51.708 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.360680+0000", 2024-04-19T02:17:51.708 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.5964999999999995e-05 2024-04-19T02:17:51.708 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:51.708 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:51.708 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:51.708 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.708 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.708 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:241634 5.1 5:8a07564d:::benchmark_data_smithi121_44835_object107599:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:51.708 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:38.293914+0000", 2024-04-19T02:17:51.708 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 13.315579774, 2024-04-19T02:17:51.708 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.066174561000000007, 2024-04-19T02:17:51.708 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:51.708 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:51.708 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:51.708 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:51.709 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:51.709 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 241634 2024-04-19T02:17:51.709 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.709 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:51.709 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.709 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:51.709 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293914+0000", 2024-04-19T02:17:51.709 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:51.709 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.709 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.709 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:51.709 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293914+0000", 2024-04-19T02:17:51.709 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:51.710 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.710 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.710 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:51.710 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293914+0000", 2024-04-19T02:17:51.710 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:51.710 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.710 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.710 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:51.710 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293916+0000", 2024-04-19T02:17:51.710 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.7240000000000001e-06 2024-04-19T02:17:51.710 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.710 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.710 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:51.710 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293921+0000", 2024-04-19T02:17:51.711 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2309999999999998e-06 2024-04-19T02:17:51.711 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.711 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.711 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:51.711 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.293924+0000", 2024-04-19T02:17:51.711 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.5810000000000001e-06 2024-04-19T02:17:51.711 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.711 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.711 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:51.711 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.295125+0000", 2024-04-19T02:17:51.711 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0012006759999999999 2024-04-19T02:17:51.711 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.711 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.712 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:51.712 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.295201+0000", 2024-04-19T02:17:51.712 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.5847999999999996e-05 2024-04-19T02:17:51.712 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.712 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.712 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:51.712 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.359977+0000", 2024-04-19T02:17:51.712 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.064775852999999994 2024-04-19T02:17:51.712 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.712 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.712 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:51.712 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.360019+0000", 2024-04-19T02:17:51.712 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2821999999999998e-05 2024-04-19T02:17:51.712 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.713 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.713 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:51.713 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.360089+0000", 2024-04-19T02:17:51.713 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.9356999999999993e-05 2024-04-19T02:17:51.713 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:51.713 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:51.713 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:51.713 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.713 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.713 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_op(client.4549.0:241635 5.8 5:1c80e285:::benchmark_data_smithi121_44835_object107600:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T02:17:51.713 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:38.295774+0000", 2024-04-19T02:17:51.713 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 13.313720062, 2024-04-19T02:17:51.713 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.065098854999999997, 2024-04-19T02:17:51.714 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:51.714 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:51.714 INFO:teuthology.orchestra.run.smithi174.stdout: "client_info": { 2024-04-19T02:17:51.714 INFO:teuthology.orchestra.run.smithi174.stdout: "client": "client.4549", 2024-04-19T02:17:51.714 INFO:teuthology.orchestra.run.smithi174.stdout: "client_addr": "172.21.15.121:0/27527325", 2024-04-19T02:17:51.714 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 241635 2024-04-19T02:17:51.714 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.714 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:51.714 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.714 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:51.714 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.295774+0000", 2024-04-19T02:17:51.714 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:51.714 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.715 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.715 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:51.715 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.295774+0000", 2024-04-19T02:17:51.715 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:51.715 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.715 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.715 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:51.715 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.295773+0000", 2024-04-19T02:17:51.715 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.999999 2024-04-19T02:17:51.715 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.715 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.715 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:51.715 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.295779+0000", 2024-04-19T02:17:51.715 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.1e-06 2024-04-19T02:17:51.715 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.716 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.716 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:51.716 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.295789+0000", 2024-04-19T02:17:51.716 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.815e-06 2024-04-19T02:17:51.716 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.716 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.716 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:51.716 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.295796+0000", 2024-04-19T02:17:51.716 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.3479999999999998e-06 2024-04-19T02:17:51.716 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.716 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.716 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:51.716 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.295823+0000", 2024-04-19T02:17:51.717 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 2.6400000000000001e-05 2024-04-19T02:17:51.717 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.717 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.717 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:51.717 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.356276+0000", 2024-04-19T02:17:51.717 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.060453042999999998 2024-04-19T02:17:51.717 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.717 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.717 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "op_commit", 2024-04-19T02:17:51.717 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.360756+0000", 2024-04-19T02:17:51.717 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0044805879999999998 2024-04-19T02:17:51.717 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.717 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.717 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:51.718 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.360799+0000", 2024-04-19T02:17:51.718 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.2407999999999998e-05 2024-04-19T02:17:51.718 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.718 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.718 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:51.718 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.360873+0000", 2024-04-19T02:17:51.718 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 7.4160999999999997e-05 2024-04-19T02:17:51.718 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:51.718 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:51.718 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:51.718 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.718 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.718 INFO:teuthology.orchestra.run.smithi174.stdout: "description": "osd_repop(client.4549.0:241637 5.9 e62/16 5:920672c8:::benchmark_data_smithi121_44835_object107602:head v 62'15373, mlcod=62'15371)", 2024-04-19T02:17:51.718 INFO:teuthology.orchestra.run.smithi174.stdout: "initiated_at": "2024-04-19T02:17:38.297900+0000", 2024-04-19T02:17:51.718 INFO:teuthology.orchestra.run.smithi174.stdout: "age": 13.311594173, 2024-04-19T02:17:51.719 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.062258717999999998, 2024-04-19T02:17:51.719 INFO:teuthology.orchestra.run.smithi174.stdout: "type_data": { 2024-04-19T02:17:51.719 INFO:teuthology.orchestra.run.smithi174.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T02:17:51.719 INFO:teuthology.orchestra.run.smithi174.stdout: "events": [ 2024-04-19T02:17:51.719 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.719 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "initiated", 2024-04-19T02:17:51.719 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.297900+0000", 2024-04-19T02:17:51.719 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:51.719 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.719 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.719 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "throttled", 2024-04-19T02:17:51.719 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.297900+0000", 2024-04-19T02:17:51.719 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0 2024-04-19T02:17:51.719 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.720 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.720 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "header_read", 2024-04-19T02:17:51.720 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.297899+0000", 2024-04-19T02:17:51.720 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4294967295.9999995 2024-04-19T02:17:51.720 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.720 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.720 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "all_read", 2024-04-19T02:17:51.720 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.297904+0000", 2024-04-19T02:17:51.720 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 4.9130000000000002e-06 2024-04-19T02:17:51.720 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.720 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.720 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "dispatched", 2024-04-19T02:17:51.720 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.356177+0000", 2024-04-19T02:17:51.720 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.058273318999999997 2024-04-19T02:17:51.721 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.721 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.721 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "queued_for_pg", 2024-04-19T02:17:51.721 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.356187+0000", 2024-04-19T02:17:51.721 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 9.7599999999999997e-06 2024-04-19T02:17:51.721 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.721 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.721 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "reached_pg", 2024-04-19T02:17:51.721 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.356220+0000", 2024-04-19T02:17:51.721 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.2651999999999998e-05 2024-04-19T02:17:51.722 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.722 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.722 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "started", 2024-04-19T02:17:51.722 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.356251+0000", 2024-04-19T02:17:51.722 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 3.1232999999999997e-05 2024-04-19T02:17:51.722 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.722 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.722 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "commit_sent", 2024-04-19T02:17:51.722 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.360091+0000", 2024-04-19T02:17:51.722 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 0.0038395429999999999 2024-04-19T02:17:51.722 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-19T02:17:51.722 INFO:teuthology.orchestra.run.smithi174.stdout: { 2024-04-19T02:17:51.722 INFO:teuthology.orchestra.run.smithi174.stdout: "event": "done", 2024-04-19T02:17:51.722 INFO:teuthology.orchestra.run.smithi174.stdout: "time": "2024-04-19T02:17:38.360158+0000", 2024-04-19T02:17:51.723 INFO:teuthology.orchestra.run.smithi174.stdout: "duration": 6.7916999999999994e-05 2024-04-19T02:17:51.723 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:51.723 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:51.723 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:51.723 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-19T02:17:51.723 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-19T02:17:51.723 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-19T02:17:51.725 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:51.725+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:51.725 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:51.762 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0: {} 2024-04-19T02:17:51.781 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1: {} 2024-04-19T02:17:51.781 INFO:teuthology.orchestra.run.smithi121.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T02:17:51.781 INFO:teuthology.orchestra.run.smithi121.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T02:17:51.782 INFO:teuthology.orchestra.run.smithi121.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T02:17:51.784 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T02:17:51.785 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T02:17:51.825 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:51.826+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:51.861 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:51.861 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:51.871 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:51.926 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:51.927+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:51.997 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:51.997 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:52.008 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:52.051 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:52.052+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:52.129 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:52.129+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:52.135 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:52.135 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:52.145 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:17:52.229 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:52.230+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:52.282 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_0 2024-04-19T02:17:52.283 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2024-04-19T02:17:52.284 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:52.285 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:52.296 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:17:52.339 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:52.339+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:52.399 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T02:17:52.422 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:52.422 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:52.430 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:52.431+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:52.432 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:17:52.532 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:52.533+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:52.598 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:52.598 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:52.608 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T02:17:52.633 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:52.633+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:52.734 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:52.735+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:52.739 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:52.739 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:52.749 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T02:17:52.835 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:52.836+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:52.916 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:52.916 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:52.927 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T02:17:52.936 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:52.937+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:53.037 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:53.038+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:53.094 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:53.095 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:53.105 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T02:17:53.149 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:53.149+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:53.236 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:53.236 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:53.238 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-04-19T02:17:53.239+0000 7f14d4381700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41345) UID: 0 2024-04-19T02:17:53.246 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T02:17:53.339 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-04-19T02:17:53.339+0000 7fde3301a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41378) UID: 0 2024-04-19T02:17:53.402 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'unique_pool_0' removed 2024-04-19T02:17:53.404 INFO:teuthology.orchestra.run.smithi121.stderr:noscrub is set 2024-04-19T02:17:53.415 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-04-19T02:17:53.426 INFO:tasks.thrashosds:joining thrashosds 2024-04-19T02:17:53.428 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:53.428 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:53.435 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T02:17:53.621 INFO:teuthology.orchestra.run.smithi174.stdout:ERROR: (22) Invalid argument 2024-04-19T02:17:53.621 INFO:teuthology.orchestra.run.smithi174.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T02:17:55.177 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~47s 2024-04-19T02:17:55.428 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T02:17:56.401 INFO:teuthology.orchestra.run.smithi121.stderr:noscrub is unset 2024-04-19T02:17:56.413 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T02:17:57.417 INFO:teuthology.orchestra.run.smithi121.stderr:nodeep-scrub is unset 2024-04-19T02:18:00.985 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~52s 2024-04-19T02:18:06.793 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~58s 2024-04-19T02:18:12.600 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~64s 2024-04-19T02:18:18.408 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~70s 2024-04-19T02:18:24.216 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~76s 2024-04-19T02:18:30.024 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~81s 2024-04-19T02:18:35.832 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~87s 2024-04-19T02:18:41.640 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~93s 2024-04-19T02:18:47.446 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~99s 2024-04-19T02:18:53.254 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~105s 2024-04-19T02:18:59.061 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~111s 2024-04-19T02:19:04.868 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~116s 2024-04-19T02:19:10.677 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~122s 2024-04-19T02:19:16.483 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~128s 2024-04-19T02:19:22.289 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~134s 2024-04-19T02:19:28.096 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~140s 2024-04-19T02:19:33.905 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~145s 2024-04-19T02:19:39.711 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~151s 2024-04-19T02:19:40.907 DEBUG:teuthology.orchestra.console.smithi177:expect before: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.13 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A EA B0 4B GUID: 00000000 0000 0000 0000 0CC47AD91940 DHCP.-                    DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- CLIENT IP: 172.21.15.177 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:ea:b0:4b)... Configuring (net0 0c:c4:7a:ea:b0:4b).... Configuring (net0 0c:c4:7a:ea:b0:4b)..... Configuring (net0 0c:c4:7a:ea:b0:4b)...... ok .   [?25lUse the ^ and v keys to change the selection. Press 'e' to edit the selected item, or 'c' for a command prompt.   CentOS Stream (4.18.0-552.el8.x86_64) 8  CentOS Stream (4.18.0-489.el8.x86_64) 8  CentOS Stream (4.18.0-348.el8.x86_64) 8  CentOS Stream (0-rescue-a1b29d6c289747bdb22930598d39874a) 8              CentOS Stream (4.18.0-489.el8.x86_64) 8  The selected entry will be started automatically in 5s.  CentOS Stream (4.18.0-348.el8.x86_64) 8  CentOS Stream (0-rescue-a1b29d6c289747bdb22930598d39874a) 8            Use the * and * keys to change the selection.  Press 'e' to edit the selected item, or 'c' for a command prompt.  The selected entry will be started automatically in 5s.   CentOS Stream (4.18.0-552.el8.x86_64) 8   The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 0s. [?25h       [ 0.000000] Linux version 4.18.0-552.el8.x86_64 (mockbuild@x86-05.stream.rdu2.redhat.com) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-21) (GCC)) #1 SMP Sun Apr 7 19:39:51 UTC 2024 [ 0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-4.18.0-552.el8.x86_64 root=UUID=c5236ddf-553d-41ea-8bce-5708f99a0430 ro crashkernel=auto console=ttyS1,115200 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008bbff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078e71fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f24000-0x00000000798adfff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798ae000-0x0000000079d4afff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d4b000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0 12/17/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.689 MHz processor [ 0.000000] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0x78e72 max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000fda20-0x000fda2f] [ 0.000000] Using GB pages for direct mapping [ 0.000000] RAMDISK: [mem 0x34b91000-0x365c0fff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F0580 000024 (v02 SUPERM) [ 0.000000] ACPI: XSDT 0x00000000798AE098 0000B4 (v01 01072009 AMI 00010013) [ 0.000000] ACPI: FACP 0x00000000798E15B0 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: DSDT 0x00000000798AE1E8 0333C4 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.000000] ACPI: FACS 0x0000000079D49F80 000040 [ 0.000000] ACPI: APIC 0x00000000798E16C0 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: FPDT 0x00000000798E1788 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: FIDT 0x00000000798E17D0 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: SPMI 0x00000000798E1870 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.000000] ACPI: MCFG 0x00000000798E18B0 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.000000] ACPI: UEFI 0x00000000798E18F0 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.000000] ACPI: HPET 0x00000000798E1938 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.000000] ACPI: WDDT 0x00000000798E1970 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.000000] ACPI: SSDT 0x00000000798E19B0 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.000000] ACPI: SSDT 0x00000000798F8B30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.000000] ACPI: SSDT 0x00000000798FB180 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.000000] ACPI: PRAD 0x00000000798FB1E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.000000] ACPI: DMAR 0x00000000798FB2F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.000000] ACPI: HEST 0x00000000798FB3B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: BERT 0x00000000798FB630 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: ERST 0x00000000798FB660 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: EINJ 0x00000000798FB890 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0x798e15b0-0x798e16bb] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0x798ae1e8-0x798e15ab] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0x79d49f80-0x79d49fbf] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0x798e16c0-0x798e1787] [ 0.000000] ACPI: Reserving FPDT table memory at [mem 0x798e1788-0x798e17cb] [ 0.000000] ACPI: Reserving FIDT table memory at [mem 0x798e17d0-0x798e186b] [ 0.000000] ACPI: Reserving SPMI table memory at [mem 0x798e1870-0x798e18af] [ 0.000000] ACPI: Reserving MCFG table memory at [mem 0x798e18b0-0x798e18eb] [ 0.000000] ACPI: Reserving UEFI table memory at [mem 0x798e18f0-0x798e1931] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0x798e1938-0x798e196f] [ 0.000000] ACPI: Reserving WDDT table memory at [mem 0x798e1970-0x798e19af] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798e19b0-0x798f8b2e] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798f8b30-0x798fb17b] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798fb180-0x798fb1e3] [ 0.000000] ACPI: Reserving PRAD table memory at [mem 0x798fb1e8-0x798fb2e9] [ 0.000000] ACPI: Reserving DMAR table memory at [mem 0x798fb2f0-0x798fb3ab] [ 0.000000] ACPI: Reserving HEST table memory at [mem 0x798fb3b0-0x798fb62b] [ 0.000000] ACPI: Reserving BERT table memory at [mem 0x798fb630-0x798fb65f] [ 0.000000] ACPI: Reserving ERST table memory at [mem 0x798fb660-0x798fb88f] [ 0.000000] ACPI: Reserving EINJ table memory at [mem 0x798fb890-0x798fb9bf] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.000000] Using crashkernel=auto, the size chosen is a best effort estimation. [ 0.000000] Reserving 256MB of memory at 1664MB for crashkernel (System RAM: 32653MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.000000] node 0: [mem 0x0000000000100000-0x0000000078e71fff] [ 0.000000] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.000000] Zeroed struct page in unavailable ranges: 29188 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x408 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.000000] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.000000] [Firmware Bug]: TSC_DEADLINE disabled due to Errata; please update microcode to version: 0xb000020 (or later) [ 0.000000] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0x78e72000-0x78f23fff] [ 0.000000] PM: Registered nosave memory: [mem 0x78f24000-0x798adfff] [ 0.000000] PM: Registered nosave memory: [mem 0x798ae000-0x79d4afff] [ 0.000000] PM: Registered nosave memory: [mem 0x79d4b000-0x8fffffff] [ 0.000000] PM: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.000000] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on bare hardware [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u262144 [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 8228664 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-4.18.0-552.el8.x86_64 root=UUID=c5236ddf-553d-41ea-8bce-5708f99a0430 ro crashkernel=auto console=ttyS1,115200 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] software IO TLB: area num 8. [ 0.000000] Memory: 1756424K/33437680K available (14339K kernel code, 5957K rwdata, 8568K rodata, 2820K init, 13792K bss, 935736K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.000000] Kernel/User page tables isolation: enabled [ 0.000000] ftrace: allocating 41053 entries in 161 pages [ 0.000000] ftrace: allocated 161 pages with 3 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.000000] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.000000] random: crng done (trusting CPU's manufacturer) [ 0.001000] Console: colour VGA+ 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 0.001000] APIC: Switch to symmetric I/O mode setup [ 0.001003] DMAR: Host address width 46 [ 0.002001] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 0.003005] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 0.004001] DMAR: RMRR base: 0x0000007ba75000 end: 0x0000007ba84fff [ 0.005002] DMAR: ATSR flags: 0x0 [ 0.006001] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 0.007002] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 0.008001] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 0.009001] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 0.010001] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 0.010002] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 0.013037] DMAR-IR: Enabled IRQ remapping in xapic mode [ 0.014000] x2apic: IRQ remapping doesn't support X2APIC mode [ 0.014479] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.019001] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x32722b94e2f, max_idle_ns: 440795343600 ns [ 0.020001] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.37 BogoMIPS (lpj=3499689) [ 0.021000] pid_max: default: 32768 minimum: 301 [ 0.022021] LSM: Security Framework initializing [ 0.023007] Yama: becoming mindful. [ 0.024004] SELinux: Initializing. [ 0.025020] LSM support for eBPF active [ 0.030528] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, vmalloc) [ 0.033909] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, vmalloc) [ 0.035077] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.036077] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.038094] CPU0: Thermal monitoring enabled (TM1) [ 0.039055] process: using mwait in idle threads [ 0.040002] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 0.041000] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 0.042003] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 0.043001] Spectre V2 : Mitigation: Retpolines [ 0.044000] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 0.045000] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 0.046000] Speculative Store Bypass: Vulnerable [ 0.047004] MDS: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.048000] TAA: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.049000] MMIO Stale Data: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.060161] Freeing SMP alternatives memory: 36K [ 0.061189] smpboot: Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 0.164906] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 0.166097] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 0.167001] ... version: 3 [ 0.168000] ... bit width: 48 [ 0.169000] ... generic registers: 4 [ 0.170000] ... value mask: 0000ffffffffffff [ 0.171000] ... max period: 00007fffffffffff [ 0.172000] ... fixed-purpose events: 3 [ 0.173000] ... event mask: 000000070000000f [ 0.174027] rcu: Hierarchical SRCU implementation. [ 0.176050] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 0.177014] smp: Bringing up secondary CPUs ... [ 0.178068] x86: Booting SMP configuration: [ 0.179001] .... node #0, CPUs: #1 #2 #3 #4 [ 0.182254] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 0.184001] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 0.185000] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 0.186090] #5 #6 #7 [ 0.187534] smp: Brought up 1 node, 8 CPUs [ 0.189000] smpboot: Max logical packages: 1 [ 0.190001] smpboot: Total of 8 processors activated (55995.02 BogoMIPS) [ 0.233022] node 0 deferred pages initialised in 41ms [ 0.239077] devtmpfs: initialized [ 0.240041] x86/mm: Memory block size: 128MB [ 0.243390] ACPI: PM: Registering ACPI NVS region [mem 0x798ae000-0x79d4afff] (4837376 bytes) [ 0.252068] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.261008] futex hash table entries: 2048 (order: 5, 131072 bytes, vmalloc) [ 0.269059] pinctrl core: initialized pinctrl subsystem [ 0.274117] NET: Registered protocol family 16 [ 0.278065] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 0.286010] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.293009] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.301015] audit: initializing netlink subsys (disabled) [ 0.307008] audit: type=2000 audit(1713493153.307:1): state=initialized audit_enabled=0 res=1 [ 0.315002] cpuidle: using governor menu [ 0.319030] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 0.327001] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.333052] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 0.343001] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 0.350014] PCI: Using configuration type 1 for base access [ 0.356474] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.357001] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.358023] cryptd: max_cpu_qlen set to 1000 [ 0.362053] ACPI: Added _OSI(Module Device) [ 0.366001] ACPI: Added _OSI(Processor Device) [ 0.371001] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.376000] ACPI: Added _OSI(Processor Aggregator Device) [ 0.406228] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 0.415097] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 0.424099] ACPI: Dynamic OEM Table Load: [ 0.441138] ACPI: Interpreter enabled [ 0.445010] ACPI: PM: (supports S0 S4 S5) [ 0.449000] ACPI: Using IOAPIC for interrupt routing [ 0.456040] HEST: Enabling Firmware First mode for corrected errors. [ 0.463071] HEST: Table parsing has been initialized. [ 0.468097] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 0.475002] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.485116] ACPI: Enabled 5 GPEs in block 00 to 3F [ 0.513232] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 0.519003] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 0.529929] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 0.538332] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 0.546001] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 0.555031] PCI host bridge to bus 0000:ff [ 0.559001] pci_bus 0000:ff: root bus resource [bus ff] [ 0.565010] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 [ 0.571043] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 [ 0.577032] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 [ 0.583031] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 [ 0.589031] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 [ 0.595030] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 [ 0.601031] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 [ 0.607030] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 [ 0.613033] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 [ 0.619030] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 [ 0.625031] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 [ 0.631030] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 [ 0.637030] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 [ 0.643031] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 [ 0.649023] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 [ 0.655034] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 [ 0.662047] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 [ 0.668031] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 [ 0.674032] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 [ 0.680022] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 [ 0.686039] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 [ 0.692062] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 [ 0.698042] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 [ 0.704024] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 [ 0.710042] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 [ 0.716042] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 [ 0.722041] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 [ 0.728025] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 [ 0.734035] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 [ 0.740042] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 [ 0.746042] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 [ 0.752042] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 [ 0.758041] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 [ 0.764032] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 [ 0.770025] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 [ 0.776033] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 [ 0.782034] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 [ 0.788044] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 [ 0.794040] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 [ 0.800042] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 [ 0.807044] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 [ 0.813036] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 [ 0.819033] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 [ 0.825032] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 [ 0.831036] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 [ 0.837023] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 [ 0.843034] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 [ 0.849033] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 [ 0.855036] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 [ 0.861031] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 [ 0.867031] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 [ 0.873025] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 [ 0.879024] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 [ 0.885034] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 [ 0.891031] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 [ 0.899604] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 0.906002] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 0.915137] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 0.923250] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 0.931000] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 0.939496] PCI host bridge to bus 0000:00 [ 0.944002] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.950001] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 0.957000] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.965000] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 0.972000] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 0.980001] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 0.987000] pci_bus 0000:00: root bus resource [bus 00-fe] [ 0.993024] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 [ 0.999096] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 [ 1.005041] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 1.011086] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 [ 1.017041] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 1.023084] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 [ 1.029041] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 1.035082] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 [ 1.041007] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 1.048079] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 [ 1.054007] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 1.061072] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 [ 1.067008] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 1.074080] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 [ 1.080007] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 1.087068] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 [ 1.093007] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 1.100076] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 [ 1.106007] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 1.113076] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 [ 1.119007] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 1.125050] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 [ 1.131007] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 1.138065] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 [ 1.144065] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 [ 1.150081] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 [ 1.156057] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 [ 1.163005] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 1.169070] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 1.175098] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 1.181012] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 1.187006] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 1.192006] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 1.198006] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 1.203006] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 1.209007] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 1.215030] pci 0000:00:11.4: PME# supported from D3hot [ 1.220085] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 1.227014] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 1.233050] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 1.239091] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 1.245014] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 1.252051] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 1.258060] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 1.264014] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 1.271051] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 1.277070] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 1.283014] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 1.290044] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 1.296080] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 1.302066] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 1.308076] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 1.314067] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 1.320077] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 1.326038] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 1.332087] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 1.339013] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 1.345057] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 1.351075] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 1.357156] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 1.363009] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 1.369005] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 1.374005] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 1.380005] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 1.385005] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 1.391006] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 1.397023] pci 0000:00:1f.2: PME# supported from D3hot [ 1.403063] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 1.409013] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 1.415016] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 1.421154] acpiphp: Slot [1] registered [ 1.425013] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.430112] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 [ 1.436008] pci 0000:02:00.0: reg 0x10: [mem 0xfb310000-0xfb313fff 64bit] [ 1.443015] pci 0000:02:00.0: reg 0x30: [mem 0xfb300000-0xfb30ffff pref] [ 1.450003] pci 0000:02:00.0: enabling Extended Tags [ 1.455094] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.460003] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.466121] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 [ 1.473010] pci 0000:03:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 1.480004] pci 0000:03:00.0: reg 0x18: [io 0xe020-0xe03f] [ 1.485009] pci 0000:03:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 1.493004] pci 0000:03:00.0: reg 0x30: [mem 0xfb280000-0xfb2fffff pref] [ 1.499037] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 1.505015] pci 0000:03:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.513001] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 1.523008] pci 0000:03:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.530000] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 1.541145] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 [ 1.547009] pci 0000:03:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 1.554004] pci 0000:03:00.1: reg 0x18: [io 0xe000-0xe01f] [ 1.559009] pci 0000:03:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 1.567005] pci 0000:03:00.1: reg 0x30: [mem 0xfb200000-0xfb27ffff pref] [ 1.573033] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 1.580014] pci 0000:03:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.587000] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 1.597008] pci 0000:03:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.604001] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 1.615080] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.620002] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.626001] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.633002] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.640029] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.645061] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 1.651065] pci 0000:05:00.0: enabling Extended Tags [ 1.656070] pci 0000:05:00.0: supports D1 D2 [ 1.661000] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.667089] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.673002] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.679002] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.686040] pci_bus 0000:06: extended config space not accessible [ 1.692029] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 1.698022] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 1.704012] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 1.710012] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 1.716096] pci 0000:06:00.0: supports D1 D2 [ 1.720000] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.727066] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.732007] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.738003] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.745083] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 1.751017] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 1.757017] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 1.763009] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 1.769076] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 1.775035] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.782000] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 1.793021] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.800001] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 1.810093] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 1.816017] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 1.823017] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 1.828009] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 1.834072] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 1.841035] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.848000] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 1.858021] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.865000] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 1.876154] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.881002] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.887002] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.894003] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 1.900459] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 1.907036] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 1.913031] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 1.919019] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 1.925030] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 1.931000] ACPI: PCI: Interrupt link LNKE disabled [ 1.936030] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 1.942001] ACPI: PCI: Interrupt link LNKF disabled [ 1.947047] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 1.952001] ACPI: PCI: Interrupt link LNKG disabled [ 1.957031] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 1.963000] ACPI: PCI: Interrupt link LNKH disabled [ 1.968203] iommu: Default domain type: Passthrough [ 1.973066] SCSI subsystem initialized [ 1.977015] ACPI: bus type USB registered [ 1.981012] usbcore: registered new interface driver usbfs [ 1.987005] usbcore: registered new interface driver hub [ 1.992005] usbcore: registered new device driver usb [ 1.997020] pps_core: LinuxPPS API ver. 1 registered [ 2.002000] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 2.011002] PTP clock support registered [ 2.015015] EDAC MC: Ver: 3.0.0 [ 2.018110] PCI: Using ACPI for IRQ routing [ 2.027491] NetLabel: Initializing [ 2.031000] NetLabel: domain hash size = 128 [ 2.036000] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 2.041010] NetLabel: unlabeled traffic allowed by default [ 2.047020] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 2.051001] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 2.061001] pci 0000:06:00.0: vgaarb: bridge control possible [ 2.067000] vgaarb: loaded [ 2.070033] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 2.076001] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 2.084029] clocksource: Switched to clocksource tsc-early [ 2.099690] VFS: Disk quotas dquot_6.6.0 [ 2.103623] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 2.110549] pnp: PnP ACPI init [ 2.113947] system 00:01: [io 0x0500-0x057f] has been reserved [ 2.119865] system 00:01: [io 0x0400-0x047f] has been reserved [ 2.125775] system 00:01: [io 0x0580-0x059f] has been reserved [ 2.131686] system 00:01: [io 0x0600-0x061f] has been reserved [ 2.137604] system 00:01: [io 0x0880-0x0883] has been reserved [ 2.143520] system 00:01: [io 0x0800-0x081f] has been reserved [ 2.149438] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 2.156042] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 2.162647] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 2.169251] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 2.175856] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 2.182462] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 2.189067] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 2.195840] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 2.201757] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 2.207667] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 2.213579] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 2.219490] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 2.226079] pnp: PnP ACPI: found 5 devices [ 2.235575] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 2.244468] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 2.255935] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 2.263755] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.268718] pci 0000:00:02.0: PCI bridge to [bus 02] [ 2.273680] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 2.280461] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.288025] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.295931] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.303573] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.311568] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.319124] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.327031] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.334673] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.342668] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.350224] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.358129] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.365775] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.373765] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.381323] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.389230] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.396873] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.404864] pci 0000:00:03.0: PCI bridge to [bus 03] [ 2.409823] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 2.415909] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 2.422687] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.430419] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 2.435383] pci 0000:05:00.0: PCI bridge to [bus 06] [ 2.440344] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 2.446432] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.453223] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 2.458441] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 2.464528] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.471318] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 2.479055] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 2.486882] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 2.494623] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 2.502450] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 2.507412] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 2.513498] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 2.520276] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 2.528010] pci_bus 0000:00: Some PCI device resources are unassigned, try booting with pci=realloc [ 2.537048] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 2.543217] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 2.549391] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 2.556255] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 2.563120] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 2.569983] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 2.576850] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 2.583108] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 2.588672] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 2.594931] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.602141] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 2.607707] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 2.613966] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 2.619529] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 2.625788] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 2.631352] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 2.637610] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 2.644922] NET: Registered protocol family 2 [ 2.649479] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc) [ 2.658754] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, vmalloc) [ 2.667661] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc) [ 2.676076] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, vmalloc) [ 2.683659] TCP: Hash tables configured (established 262144 bind 65536) [ 2.690377] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, vmalloc) [ 2.698120] UDP hash table entries: 16384 (order: 7, 524288 bytes, vmalloc) [ 2.705135] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, vmalloc) [ 2.712603] NET: Registered protocol family 1 [ 2.716956] NET: Registered protocol family 44 [ 2.721479] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 2.745128] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x627 took 16061 usecs [ 2.764090] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x627 took 11280 usecs [ 2.771492] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 2.777937] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 2.786313] Unpacking initramfs... [ 3.060166] Freeing initrd memory: 26816K [ 3.064257] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 3.070695] software IO TLB: mapped [mem 0x0000000064000000-0x0000000068000000] (64MB) [ 3.078612] ACPI: bus type thunderbolt registered [ 3.084935] Initialise system trusted keyrings [ 3.089391] Key type blacklist registered [ 3.093421] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 3.101417] zbud: loaded [ 3.104262] pstore: using deflate compression [ 3.108793] Platform Keyring initialized [ 3.150970] NET: Registered protocol family 38 [ 3.155409] Key type asymmetric registered [ 3.159503] Asymmetric key parser 'x509' registered [ 3.164384] Running certificate verification selftests [ 3.194700] Loaded X.509 cert 'Certificate verification self-testing key: f58703bb33ce1b73ee02eccdee5b8817518fe3db' [ 3.205578] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 3.212989] io scheduler mq-deadline registered [ 3.217515] io scheduler kyber registered [ 3.221547] io scheduler bfq registered [ 3.225445] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 3.232668] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 3.238570] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 3.244468] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 3.250335] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 3.256203] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 3.262069] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 3.267946] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.275264] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 3.283624] ACPI: Power Button [PWRB] [ 3.287310] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 3.294720] ACPI: Power Button [PWRF] [ 3.299455] ERST: Error Record Serialization Table (ERST) support is initialized. [ 3.306959] pstore: Registered erst as persistent store backend [ 3.312974] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 3.339824] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.367747] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.375416] Non-volatile memory driver v1.3 [ 3.379997] rdac: device handler registered [ 3.384204] hp_sw: device handler registered [ 3.388475] emc: device handler registered [ 3.392606] alua: device handler registered [ 3.396853] libphy: Fixed MDIO Bus: probed [ 3.401106] usbcore: registered new interface driver usbserial_generic [ 3.401256] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 3.407625] usbserial: USB Serial support registered for generic [ 3.412869] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 1 [ 3.418862] i8042: PNP: No PS/2 controller found. [ 3.426239] ehci-pci 0000:00:1d.0: debug port 2 [ 3.430943] mousedev: PS/2 mouse device common for all mice [ 3.439376] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 3.441162] rtc_cmos 00:00: RTC can wake from S4 [ 3.451445] rtc_cmos 00:00: registered as rtc0 [ 3.453034] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 3.455896] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram, hpet irqs [ 3.461654] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.477518] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.484730] usb usb1: Product: EHCI Host Controller [ 3.489601] usb usb1: Manufacturer: Linux 4.18.0-552.el8.x86_64 ehci_hcd [ 3.496292] usb usb1: SerialNumber: 0000:00:1d.0 [ 3.500997] intel_pstate: Intel P-state driver initializing [ 3.501029] hub 1-0:1.0: USB hub found [ 3.510328] hub 1-0:1.0: 2 ports detected [ 3.514497] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 3.519782] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2 [ 3.527476] hid: raw HID events driver (C) Jiri Kosina [ 3.528254] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 3.532660] usbcore: registered new interface driver usbhid [ 3.541961] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 3.541975] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 3.541999] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 3.542002] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 3.542044] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.542045] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.542046] usb usb2: Product: xHCI Host Controller [ 3.542047] usb usb2: Manufacturer: Linux 4.18.0-552.el8.x86_64 xhci-hcd [ 3.542048] usb usb2: SerialNumber: 0000:00:14.0 [ 3.542140] hub 2-0:1.0: USB hub found [ 3.542165] hub 2-0:1.0: 15 ports detected [ 3.544534] usb usb3: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 4.18 [ 3.544536] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.544537] usb usb3: Product: xHCI Host Controller [ 3.544537] usb usb3: Manufacturer: Linux 4.18.0-552.el8.x86_64 xhci-hcd [ 3.544538] usb usb3: SerialNumber: 0000:00:14.0 [ 3.544628] hub 3-0:1.0: USB hub found [ 3.544642] hub 3-0:1.0: 6 ports detected [ 3.547337] usbhid: USB HID core driver [ 3.547426] drop_monitor: Initializing network drop monitor service [ 3.552636] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 4 [ 3.557832] Initializing XFRM netlink socket [ 3.565190] ehci-pci 0000:00:1a.0: debug port 2 [ 3.571530] NET: Registered protocol family 10 [ 3.583673] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 3.587124] Segment Routing with IPv6 [ 3.598037] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 3.598519] NET: Registered protocol family 17 [ 3.603143] usb usb4: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.606940] mpls_gso: MPLS GSO support [ 3.610974] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.610976] usb usb4: Product: EHCI Host Controller [ 3.724675] usb usb4: Manufacturer: Linux 4.18.0-552.el8.x86_64 ehci_hcd [ 3.731368] usb usb4: SerialNumber: 0000:00:1a.0 [ 3.7355] hub 4-0:1.0: USB hub found [ 3.739933] hub 4-0:1.0: 2 ports detected [ 3.739936] microcode: Microcode Update Driver: v2.2. [ 3.744034] resctrl: L3 allocation detected [ 3.753031] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 3.753262] resctrl: L3 monitoring detected [ 3.763967] AVX2 version of gcm_enc/dec engaged. [ 3.768582] AES CTR mode by8 optimization enabled [ 3.783861] sched_clock: Marking stable (3783858473, 0)->(5666558561, -1882700088) [ 3.791536] registered taskstats version 1 [ 3.795793] Loading compiled-in X.509 certificates [ 3.800855] Loaded X.509 cert 'Red Hat Enterprise Linux kernel signing key: b8c8c7a1297a11ed2e36e7913cdfd6f59248d125' [ 3.811710] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 3.823532] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 3.834154] zswap: loaded using pool lzo/zbud [ 3.838623] page_owner is disabled [ 3.845513] Key type big_key registered [ 3.851008] usb 2-12: new high-speed USB device number 2 using xhci_hcd [ 3.851062] Key type encrypted registered [ 3.861644] ima: No TPM chip found, activating TPM-bypass! [ 3.867130] ima: Allocated hash algorithm: sha256 [ 3.871833] ima: No architecture policies found [ 3.876369] evm: Initialising EVM extended attributes: [ 3.881500] evm: security.selinux [ 3.884811] evm: security.ima [ 3.887776] evm: security.capability [ 3.888364] usb 1-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 3.891349] evm: HMAC attrs: 0x1 [ 3.891628] rtc_cmos 00:00: setting system clock to 2024-04-19 02:19:18 UTC (1713493158) [ 3.899531] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 3.899768] hub 1-1:1.0: USB hub found [ 3.921868] hub 1-1:1.0: 8 ports detected [ 3.926711] Freeing unused decrypted memory: 2028K [ 3.931849] Freeing unused kernel image (initmem) memory: 2820K [ 3.943043] Write protecting the kernel read-only data: 26624k [ 3.949235] Freeing unused kernel image (text/rodata gap) memory: 2016K [ 3.956101] Freeing unused kernel image (rodata/data gap) memory: 1672K [ 3.972309] systemd[1]: systemd 239 (239-75.el8) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 3.983236] usb 2-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 3.987037] usb 4-1: new high-speed USB device number 2 using ehci-pci [ 4.009472] usb 2-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.014063] systemd[1]: Detected architecture x86-64. [ 4.017248] hub 2-12:1.0: USB hub found [ 4.021743] systemd[1]: Running in initial RAM disk. [ 4.025665] hub 2-12:1.0: 4 ports detected Welcome to CentOS Stream 8 dracut-049-224.git20230330.el8 (Initramfs)! [ 4.056061] systemd[1]: Set hostname to . [ 4.092845] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 4.105157] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 4.115384] usb 4-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 4.123558] usb 4-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.127010] tsc: Refined TSC clocksource calibration: 3499.993 MHz [ 4.131111] hub 4-1:1.0: USB hub found [ 4.136863] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734a05315, max_idle_ns: 440795202126 ns [ 4.141198] systemd[1]: Starting Create list of required static device nodes for the current kernel... [ 4.159895] clocksource: Switched to clocksource tsc [ 4.159896] hub 4-1:1.0: 6 ports detected Starting Create list of required st…ce nodes for the current kernel... [ 4.178144] systemd[1]: Reached target Swap. [ OK ] Reached target Swap. [ 4.188115] systemd[1]: Reached target Local File Systems. [ OK ] Reached target Local File Systems. [ 4.200793] systemd[1]: Starting Create Volatile Files and Directories... Starting Create Volatile Files and Directories... [ OK ] Listening on Journal Socket (/dev/log). Starting Journal Service... [ OK ] Listening on udev Control Socket. Starting Setup Virtual Console... [ OK ] Reached target Timers. Starting Load Kernel Modules... [ OK ] Reached target Slices. [ OK ] Reached targ[ 4.264719] fuse: init (API version 7.34) et Sockets. [ OK ] Started Memstrack Anylazing Service. [ OK ] Started Journal Service. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Create Volatile File[ 4.324071] usb 2-12.1: new low-speed USB device number 3 using xhci_hcd s and Direc[ OK ual Console. [m OK ] Started Load Kernel Modules. Starting Apply Kernel Variables... Starting dracut cmdline hook... Starting Create Static Device Nodes in /dev... [ OK ] Started Apply Kernel Variables. [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ OK ] Started udev[ 4.437294] usb 2-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 4.446601] usb 2-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 Kernel Device Manager. [ 4.458994] i HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.0/0003:0557:2419.0001/input/input2 Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ 4.522164] hneric 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 4.534767] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.1/0003:0557:2419.0002/input/input3 [ 4.546487] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ OK ] Started udev Coldplug all Devices. Starting dracut initqueue hook... Starting Show Plymouth Boot Screen... [ 4.590709] dca service started, version 1.12.1 [ OK ] Reached target System Initialization. [ OK ] Started Show[ 4.602801] nvme nvme0: pci function 0000:02:00.0 Plymouth Boot Screen. [ OK ] Sta[ 4.610657] nvme nvme0: 8/0/0 default/read/poll queues rted Forward Pas[ 4.617498] igb: Intel(R) Gigabit Ethernet Network Driver [ 4.618318] nvme0n1: detected capacity change from 0 to 400088457216 sword Requests t[ 4.624033] igb: Copyright (c) 2007-2014 Intel Corporation. o Plymouth Directory Watch. [[ 4.639066] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [0;32m OK [ 4.646204] ixgbe: Copyright (c) 1999-2016 Intel Corporation. ] Reached target Paths. [ OK ] Reached target Basic System. [ 4.662113] ACPI: bus type drm_connector registered [ 4.669021] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 4.677153] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 4.693343] scsi host0: ahci [ 4.693735] igb 0000:07:00.0: added PHC on eth0 [ 4.696361] scsi host1: ahci [ 4.700777] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 4.703765] scsi host2: ahci [ 4.710503] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:19:40 [ 4.713482] scsi host3: ahci [ 4.720587] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 4.723449] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 53 [ 4.728524] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 4.743499] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 53 [ 4.743502] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 53 [ 4.743521] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 53 [ 4.743717] ast 0000:06:00.0: [drm] Using P2A bridge for configuration [ 4.743823] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 4.743826] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 4.759335] scsi host4: ahci [ 4.765691] ast 0000:06:00.0: [drm] AST 2400 detected [ 4.772324] scsi host5: ahci [ 4.780385] ast 0000:06:00.0: [drm] Using analog VGA [ 4.784425] igb 0000:07:00.1: added PHC on eth1 [ 4.784452] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 4.784453] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:19:41 [ 4.784528] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 4.784529] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 4.785649] igb 0000:07:00.1 eno2: renamed from eth1 [ 4.788074] scsi host6: ahci [ 4.790849] ast 0000:06:00.0: [drm] dram MCLK=408 Mhz type=1 bus_width=16 [ 4.796003] scsi host7: ahci [ 4.798948] [drm] Initialized ast 0.1.0 20120228 for 0000:06:00.0 on minor 0 [ 4.803861] scsi host8: ahci [ 4.862550] scsi host9: ahci [ 4.862582] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 63 [ 4.862585] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 63 [ 4.862588] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 63 [ 4.862590] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 63 [ 4.862592] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 63 [ 4.862593] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 63 [ 4.934778] fbcon: astdrmfb (fb0) is primary device [ 4.936120] igb 0000:07:00.0 eno1: renamed from eth0 [ 4.984067] Console: switching to colour frame buffer device 128x48 [ 5.036425] ast 0000:06:00.0: [drm] fb0: astdrmfb frame buffer device [ 5.052851] ata4: SATA link down (SStatus 0 SControl 300) [ 5.053045] ata3: SATA link down (SStatus 0 SControl 300) [ 5.053260] ata2: SATA link down (SStatus 0 SControl 300) [ 5.055643] ata1: SATA link down (SStatus 0 SControl 300) [ 5.172433] ata9: SATA link down (SStatus 0 SControl 300) [ 5.177844] ata8: SATA link down (SStatus 0 SControl 300) [ 5.183250] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 5.189436] ata7: SATA link down (SStatus 0 SControl 300) [ 5.194844] ata10: SATA link down (SStatus 0 SControl 300) [ 5.200339] ata6: SATA link down (SStatus 0 SControl 300) [ 5.206515] ata5.00: NCQ Send/Recv Log not supported [ 5.211474] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 5.217730] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 5.226141] ata5.00: NCQ Send/Recv Log not supported [ 5.231107] ata5.00: configured for UDMA/133 [ 5.235513] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 5.249112] scsi 4:0:0:0: Attached scsi generic sg0 type 0 [ 5.258081] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 5.265751] sd 4:0:0:0: [sda] Write Protect is off [ 5.270560] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 5.290549] sda: sda1 [ 5.293159] sd 4:0:0:0: [sda] Attached SCSI disk [ OK ] Found device ST1000NM0033-9ZM173 1. [ OK ] Reached target Initrd Root Device. [ 5.788292] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 5.798563] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 5.807068] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 5.813243] ixgbe 0000:03:00.0: 0c:c4:7a:ea:b0:4a [ 5.821260] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 5.827882] libphy: ixgbe-mdio: probed [ 5.988142] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 5.998410] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.006916] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 6.013951] ixgbe 0000:03:00.1: 0c:c4:7a:ea:b0:4b [ 6.021948] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 6.028530] libphy: ixgbe-mdio: probed [ 6.033221] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ 6.044149] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ OK ] Started dracut initqueue hook. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting File System Check on /dev/…ddf-553d-41ea-8bce-5708f99a0430... [ OK ] Started File System Check on /dev/d…36ddf-553d-41ea-8bce-5708f99a0430. Mounting /sysroot... [ 6.220832] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped target Timers. Starting Setup Virtual Console... [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped dracut initqueue hook. Starting Plymouth switch root service... [ OK ] Stopped target Basic System. [ OK ] Stopped target Slices. [ OK ] Stopped target Sockets. [ OK ] Stopped target Paths. [ OK ] Stopped target System Initialization. [ OK ] Stopped Create Volatile Files and Directories. Stopping udev Kernel Device Manager... [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped Load Kernel Modules. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Swap. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Started Setup Virtual Console. [ OK ] Reached target Switch Root. [ OK ] Started Plymouth switch root service. [ 6.642053] printk: systemd: 10 output lines suppressed due to ratelimiting Starting Switch Root... [ 7.282848] SELinux: policy capability network_peer_controls=1 [ 7.288764] SELinux: policy capability open_perms=1 [ 7.293727] SELinux: policy capability extended_socket_class=1 [ 7.299638] SELinux: policy capability always_check_network=0 [ 7.305464] SELinux: policy capability cgroup_seclabel=1 [ 7.310853] SELinux: policy capability nnp_nosuid_transition=1 [ 7.338127] audit: type=1403 audit(1713493161.946:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 7.339909] systemd[1]: Successfully loaded SELinux policy in 212.063ms. [ 7.417282] systemd[1]: Relabelled /dev, /run and /sys/fs/cgroup in 19.867ms. [ 7.433603] systemd[1]: systemd 239 (239-75.el8) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 7.468065] systemd[1]: Detected architecture x86-64. Welcome to CentOS Stream 8! [ 7.479784] systemd[1]: Set hostname to . [ 8.688124] systemd[1]: initrd-switch-root.service: Succeeded. [ 8.694195] systemd[1]: Stopped Switch Root. [ OK [[ 8.699252] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. 0m] Stopped Swit[ 8.710762] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. ch Root. [ 8.721058] systemd[1]: Stopped Journal Service. [ OK [[ 8.727127] systemd[1]: Starting Journal Service... 0m] Stopped Jour[ 8.733636] systemd[1]: Mounting Huge Pages File System... nal Service. Starting Journal Service... Mounting Huge Pages File System... [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Reached target ceph target allowing…mirror@.service instances at once. [ OK ] Listening on Process Core Dump Socket. [ OK ] Created slice system-getty.slice. Mounting Kernel Debug File System... [ OK ] Reached target Swap. Starting Remount Root and Kernel File Systems... [ OK ] Created slice User and Session Slice. [ OK ] Listening on udev Control Socket. [ OK ] Created slice system-serial\x2dgetty.slice. [ OK ] Set up automount Arbitrary Executab…rmats File System Automount Point. [ OK ] Listening on udev Kernel Socket. Starting udev Coldplug all Devices... [ OK ] Stopped target Switch Root. Starting Setup Virtual Console... [ OK ] Stopped Plymouth switch root service. [ OK ] Listening on Device-mapper event daemon FIFOs. Starting Load Kernel Modules... Starting Read and set NIS domainname from /etc/sysconfig/network... [ OK ] Stopped target Initrd File Systems. [ OK ] Stopped target Initrd Root File System. [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. [ OK [ 8.870861] EXT4-fs (sda1): re-mounted. Opts: (null) ] Listening on LVM2 poll daemon socket. Starting Create list of required st…ce nodes for the current kernel... [ OK ] Reached target ceph target allowing…ph-mon@.service instances at once. [ OK ] Reached target ceph target allowing…ph-osd@.service instances at once. [ OK ] Reached target ceph target allowing…ph-mds@.service instances at once. [ OK ] Reached target ceph target allowing…adosgw@.service instances at once. Starting Monitoring of LVM2 mirrors…ng dmeventd or progress polling... [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Reached target Paths. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Slices. Mounting POSIX Message Queue File System... [ OK ] Created slice system-sshd\x2dkeygen.slice. [ OK ] Reached target ceph target allowing…ph-mgr@.service instances at once. [ OK ] Started Journal Service. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Started Remount Root and Kernel File Systems. [ OK ] Started Read and set NIS domainname from /etc/sysconfig/network. [ OK ] Mounted POSIX Message Queue File System. Starting Load/Save Random Seed... Starting Flush Journal to Persistent Storage... [ OK ] Started Create list of required sta…vice nodes for the current kernel. Starting Create Static Device Nodes in /dev... [ OK ] Started Load/Save Random Seed. [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started udev Coldplug all Devices. [ OK ] Started Load Kernel Modules. Mounting FUSE Control File System... Starting Apply Kernel Variables... [ OK ] Mounted FUSE Control File System. [ 9.114031] device-mapper: uevent: version 1.0.3 [ 9.118740] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com [ OK ] Started Apply Kernel Variables. [ OK ] Started Monitoring of LVM2 mirrors,…sing dmeventd or progress polling. [ OK ] Started Setup Virtual Console. [ OK ] Started Create Static Device Nodes in /dev. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. [ OK ] Reached target Local File Systems (Pre). [ OK ] Reached target Local File Systems. Starting Import network configuration from initramfs... Starting Tell Plymouth To Write Out Runtime Data... [ OK ] Started Tell Plymouth To Write Out Runtime Data. [ 9.513435] ioatdma: Intel(R) QuickData Technology Driver 5.00 [ OK ] Started Import network configuration from initramfs. Starting Create Volatile Fil[ 9.528059] igb 0000:07:00.0: DCA enabled es and Directori[ 9.533174] igb 0000:07:00.1: DCA enabled es... [ 9.538974] mei_me 0000:00:16.0: Device doesn't have valid ME Interface [ 9.575270] IPMI message handler: version 39.2 [ 9.581828] ipmi device interface [ 9.589820] ipmi_si: IPMI System Interface driver [ 9.594555] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS [ 9.600936] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 9.608175] ipmi_si: Adding SMBIOS-specified kcs state machine [ 9.614098] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI [ 9.620045] ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2] regsize 1 spacing 1 irq 0 [ 9.631274] power_meter ACPI000D:00: Found ACPI power meter. [ 9.631808] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI [ 9.636964] power_meter ACPI000D:00: Ignoring unsafe software power cap! [ 9.645687] ipmi_si: Adding ACPI-specified kcs state machine [ 9.658143] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 [ 9.697242] input: PC Speaker as /devices/platform/pcspkr/input/input4 [ 9.697348] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ OK ] Created slice system-lvm2\x2dpvscan.slice. Starting LVM event activation on device 259:0... [ 9.750611] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer [ 9.753028] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. [ 9.758529] RAPL PMU: hw unit of domain package 2^-14 Joules [ 9.775739] RAPL PMU: hw unit of domain dram 2^-16 Joules [ 9.788886] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x0833, dev_id: 0x20) [ 9.832309] ipmi_si IPI0001:00: IPMI kcs interface initialized [ 9.840111] iTCO_vendor_support: vendor-support=0 [ 9.847550] ipmi_ssif: IPMI SSIF Interface driver [ 9.852441] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11 [[ 9.858334] iTCO_wdt: Found a Wellsburg TCO device (Version=2, TCOBASE=0x0460)  OK ] Started Create Volatile Files and Directories[ 9.870165] iTCO_wdt: initialized. heartbeat=30 sec (nowayout=0) . Mounting RPC Pipe File System... Starting Security Auditing Service... Starting RPC Bind... [ OK ] Found device /dev/vg_nvme/lv_5. Mounting /var/lib/ceph... [ OK ] Started LVM event activation on device 259:0. [ 10.033303] RPC: Registered named UNIX socket transport module. [ 10.039244] RPC: Registered udp transport module. [ 10.043983] RPC: Registered tcp transport module. [ 10.043985] RPC: Registered tcp NFSv4.1 backchannel transport module. [ OK ] Started RPC Bind. [ OK ] Mounted RPC Pipe Fil[ 10.060859] SGI XFS with ACLs, security attributes, quota, no debug enabled e System. [ OK ] Reached target rpc_pipefs.target[ 10.073586] XFS (dm-4): Mounting V4 Filesystem . [ 10.085591] XFS (dm-4): Ending clean mount [ OK ] Mounted /var/lib/ceph. [ 10.185707] EDAC MC0: Giving out device to module sb_edac controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT) [ 10.196657] EDAC sbridge: Ver: 1.1.2 [ 10.242019] intel_rapl_common: Found RAPL domain package [ 10.247336] intel_rapl_common: Found RAPL domain dram [ 10.252389] intel_rapl_common: DRAM domain energy unit 15300pj [ OK ] Started Security Auditing Service. Starting Update UTMP about System Boot/Shutdown... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Reached target System Initialization. [ OK ] Started Updates mlocate database every day. [ OK ] Started Generate summary of yesterday's process accounting. [ OK ] Started Run system activity accounting tool every 10 minutes. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Reached target Timers. [ OK ] Listening on SSSD Kerberos Cache Manager responder socket. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. [ OK ] Started irqbalance daemon. [ OK ] Started libstoragemgmt plug-in server daemon. [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target allowing… ceph*@.service instances at once. [ OK ] Started Machine Check Exception Logging Daemon. [ OK ] Reached target User and Group Name Lookups. Starting Kernel Samepage Merging... [ OK ] Reached target sshd-keygen.target. Starting VDO volume services... Starting Authorization Manager... [ OK ] Started D-Bus System Message Bus. Starting Network Manager... Starting Restore /run/initramfs on shutdown... Starting Self Monitoring and Reporting Technology (SMART) Daemon... Starting Resets System Activity Logs... Starting NTP client/server... Starting Login Service... [ OK ] Started Kernel Samepage Merging. [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Resets System Activity Logs. Starting Kernel Samepage Merging (KSM) Tuning Daemon... [ OK ] Started Self Monitoring and Reporting Technology (SMART) Daemon. [ OK ] Started Kernel Samepage Merging (KSM) Tuning Daemon. [ OK ] Started Login Service. [ OK ] Started NTP client/server. [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting Dynamic System Tuning Daemon... Starting GSSAPI Proxy Daemon... Starting OpenSSH server daemon... Starting Network Manager Wait Online... Starting Hostname Service... [ OK ] Started Hostname Service. [ OK ] Started Authorization Manager. [ OK ] Started OpenSSH server daemon. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Started Perm[ 12.265172] IPv6: ADDRCONF(NETDEV_UP): eno1: link is not ready it User Sessions. [ OK ] Started Command Scheduler. [ OK ] Started Job spooling tools. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ 12.324124] IPv6: ADDRCONF(NETDEV_UP): eno1: link is not ready [ 12.331750] IPv6: ADDRCONF(NETDEV_UP): eno2: link is not ready [ 12.387827] IPv6: ADDRCONF(NETDEV_UP): eno2: link is not ready [ 12.395105] IPv6: ADDRCONF(NETDEV_UP): enp3s0f0: link is not ready [ 12.437890] ixgbe 0000:03:00.0: registered PHC device on enp3s0f0 [ 12.551922] IPv6: ADDRCONF(NETDEV_UP): enp3s0f0: link is not ready [ 12.559607] IPv6: ADDRCONF(NETDEV_UP): enp3s0f1: link is not ready [ 12.602676] ixgbe 0000:03:00.1: registered PHC device on enp3s0f1 [ OK ] Started VDO volume services. [ 12.711953] IPv6: ADDRCONF(NETDEV_UP): enp3s0f1: link is not ready [ 12.835135] ixgbe 0000:03:00.1 enp3s0f1: detected SFP+: 4 [ 13.031157] ixgbe 0000:03:00.1 enp3s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX [ 13.039011] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f1: link becomes ready [ OK ] Started Dynamic System Tuning Daemon. [* ] A start job is running for Network Manager Wait Online (9s / no limit) [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting System Logging Service... Starting Notify NFS peers of a restart... Starting /etc/rc.d/rc.local Compatibility... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' [ OK ] Started Nagios Remote Plugin Executor. Starting Crash recovery kernel arming... [ OK ] Started Notify NFS peers of a restart. + myips=172.21.15.177 + attempts=1 + sleep 1 [ OK ] Started System Logging Service. + '[' 172.21.15.177 '!=' '' ']' + set -e + '[' -n 172.21.15.177 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.177 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.177 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' + newhostname=smithi177.front.sepia.ceph.com + '[' -n smithi177.front.sepia.ceph.com ']' + hostname smithi177.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi177 + echo smithi177 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.177 smithi177.front.sepia.ceph.com smithi177/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.d/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... Starting SETroubleshoot daemon for …cessing new SELinux denial logs... CentOS Stream 8 Kernel 4.18.0-552.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2024-04-19T02:19:40.908 DEBUG:teuthology.orchestra.console.smithi177:expect after: smithi177 login: 2024-04-19T02:19:40.961 DEBUG:teuthology.orchestra.console.smithi177:console disconnect output: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.13 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A EA B0 4B GUID: 00000000 0000 0000 0000 0CC47AD91940 DHCP.-                    DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- CLIENT IP: 172.21.15.177 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:ea:b0:4b)... Configuring (net0 0c:c4:7a:ea:b0:4b).... Configuring (net0 0c:c4:7a:ea:b0:4b)..... Configuring (net0 0c:c4:7a:ea:b0:4b)...... ok .   [?25lUse the ^ and v keys to change the selection. Press 'e' to edit the selected item, or 'c' for a command prompt.   CentOS Stream (4.18.0-552.el8.x86_64) 8  CentOS Stream (4.18.0-489.el8.x86_64) 8  CentOS Stream (4.18.0-348.el8.x86_64) 8  CentOS Stream (0-rescue-a1b29d6c289747bdb22930598d39874a) 8              CentOS Stream (4.18.0-489.el8.x86_64) 8  The selected entry will be started automatically in 5s.  CentOS Stream (4.18.0-348.el8.x86_64) 8  CentOS Stream (0-rescue-a1b29d6c289747bdb22930598d39874a) 8            Use the * and * keys to change the selection.  Press 'e' to edit the selected item, or 'c' for a command prompt.  The selected entry will be started automatically in 5s.   CentOS Stream (4.18.0-552.el8.x86_64) 8   The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 0s. [?25h       [ 0.000000] Linux version 4.18.0-552.el8.x86_64 (mockbuild@x86-05.stream.rdu2.redhat.com) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-21) (GCC)) #1 SMP Sun Apr 7 19:39:51 UTC 2024 [ 0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-4.18.0-552.el8.x86_64 root=UUID=c5236ddf-553d-41ea-8bce-5708f99a0430 ro crashkernel=auto console=ttyS1,115200 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008bbff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078e71fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f24000-0x00000000798adfff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798ae000-0x0000000079d4afff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d4b000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0 12/17/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.689 MHz processor [ 0.000000] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0x78e72 max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000fda20-0x000fda2f] [ 0.000000] Using GB pages for direct mapping [ 0.000000] RAMDISK: [mem 0x34b91000-0x365c0fff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F0580 000024 (v02 SUPERM) [ 0.000000] ACPI: XSDT 0x00000000798AE098 0000B4 (v01 01072009 AMI 00010013) [ 0.000000] ACPI: FACP 0x00000000798E15B0 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: DSDT 0x00000000798AE1E8 0333C4 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.000000] ACPI: FACS 0x0000000079D49F80 000040 [ 0.000000] ACPI: APIC 0x00000000798E16C0 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: FPDT 0x00000000798E1788 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: FIDT 0x00000000798E17D0 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: SPMI 0x00000000798E1870 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.000000] ACPI: MCFG 0x00000000798E18B0 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.000000] ACPI: UEFI 0x00000000798E18F0 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.000000] ACPI: HPET 0x00000000798E1938 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.000000] ACPI: WDDT 0x00000000798E1970 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.000000] ACPI: SSDT 0x00000000798E19B0 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.000000] ACPI: SSDT 0x00000000798F8B30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.000000] ACPI: SSDT 0x00000000798FB180 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.000000] ACPI: PRAD 0x00000000798FB1E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.000000] ACPI: DMAR 0x00000000798FB2F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.000000] ACPI: HEST 0x00000000798FB3B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: BERT 0x00000000798FB630 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: ERST 0x00000000798FB660 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: EINJ 0x00000000798FB890 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0x798e15b0-0x798e16bb] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0x798ae1e8-0x798e15ab] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0x79d49f80-0x79d49fbf] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0x798e16c0-0x798e1787] [ 0.000000] ACPI: Reserving FPDT table memory at [mem 0x798e1788-0x798e17cb] [ 0.000000] ACPI: Reserving FIDT table memory at [mem 0x798e17d0-0x798e186b] [ 0.000000] ACPI: Reserving SPMI table memory at [mem 0x798e1870-0x798e18af] [ 0.000000] ACPI: Reserving MCFG table memory at [mem 0x798e18b0-0x798e18eb] [ 0.000000] ACPI: Reserving UEFI table memory at [mem 0x798e18f0-0x798e1931] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0x798e1938-0x798e196f] [ 0.000000] ACPI: Reserving WDDT table memory at [mem 0x798e1970-0x798e19af] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798e19b0-0x798f8b2e] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798f8b30-0x798fb17b] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798fb180-0x798fb1e3] [ 0.000000] ACPI: Reserving PRAD table memory at [mem 0x798fb1e8-0x798fb2e9] [ 0.000000] ACPI: Reserving DMAR table memory at [mem 0x798fb2f0-0x798fb3ab] [ 0.000000] ACPI: Reserving HEST table memory at [mem 0x798fb3b0-0x798fb62b] [ 0.000000] ACPI: Reserving BERT table memory at [mem 0x798fb630-0x798fb65f] [ 0.000000] ACPI: Reserving ERST table memory at [mem 0x798fb660-0x798fb88f] [ 0.000000] ACPI: Reserving EINJ table memory at [mem 0x798fb890-0x798fb9bf] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.000000] Using crashkernel=auto, the size chosen is a best effort estimation. [ 0.000000] Reserving 256MB of memory at 1664MB for crashkernel (System RAM: 32653MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.000000] node 0: [mem 0x0000000000100000-0x0000000078e71fff] [ 0.000000] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.000000] Zeroed struct page in unavailable ranges: 29188 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x408 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.000000] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.000000] [Firmware Bug]: TSC_DEADLINE disabled due to Errata; please update microcode to version: 0xb000020 (or later) [ 0.000000] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0x78e72000-0x78f23fff] [ 0.000000] PM: Registered nosave memory: [mem 0x78f24000-0x798adfff] [ 0.000000] PM: Registered nosave memory: [mem 0x798ae000-0x79d4afff] [ 0.000000] PM: Registered nosave memory: [mem 0x79d4b000-0x8fffffff] [ 0.000000] PM: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.000000] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on bare hardware [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u262144 [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 8228664 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-4.18.0-552.el8.x86_64 root=UUID=c5236ddf-553d-41ea-8bce-5708f99a0430 ro crashkernel=auto console=ttyS1,115200 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] software IO TLB: area num 8. [ 0.000000] Memory: 1756424K/33437680K available (14339K kernel code, 5957K rwdata, 8568K rodata, 2820K init, 13792K bss, 935736K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.000000] Kernel/User page tables isolation: enabled [ 0.000000] ftrace: allocating 41053 entries in 161 pages [ 0.000000] ftrace: allocated 161 pages with 3 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.000000] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.000000] random: crng done (trusting CPU's manufacturer) [ 0.001000] Console: colour VGA+ 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 0.001000] APIC: Switch to symmetric I/O mode setup [ 0.001003] DMAR: Host address width 46 [ 0.002001] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 0.003005] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 0.004001] DMAR: RMRR base: 0x0000007ba75000 end: 0x0000007ba84fff [ 0.005002] DMAR: ATSR flags: 0x0 [ 0.006001] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 0.007002] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 0.008001] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 0.009001] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 0.010001] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 0.010002] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 0.013037] DMAR-IR: Enabled IRQ remapping in xapic mode [ 0.014000] x2apic: IRQ remapping doesn't support X2APIC mode [ 0.014479] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.019001] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x32722b94e2f, max_idle_ns: 440795343600 ns [ 0.020001] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.37 BogoMIPS (lpj=3499689) [ 0.021000] pid_max: default: 32768 minimum: 301 [ 0.022021] LSM: Security Framework initializing [ 0.023007] Yama: becoming mindful. [ 0.024004] SELinux: Initializing. [ 0.025020] LSM support for eBPF active [ 0.030528] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, vmalloc) [ 0.033909] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, vmalloc) [ 0.035077] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.036077] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.038094] CPU0: Thermal monitoring enabled (TM1) [ 0.039055] process: using mwait in idle threads [ 0.040002] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 0.041000] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 0.042003] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 0.043001] Spectre V2 : Mitigation: Retpolines [ 0.044000] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 0.045000] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 0.046000] Speculative Store Bypass: Vulnerable [ 0.047004] MDS: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.048000] TAA: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.049000] MMIO Stale Data: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.060161] Freeing SMP alternatives memory: 36K [ 0.061189] smpboot: Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 0.164906] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 0.166097] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 0.167001] ... version: 3 [ 0.168000] ... bit width: 48 [ 0.169000] ... generic registers: 4 [ 0.170000] ... value mask: 0000ffffffffffff [ 0.171000] ... max period: 00007fffffffffff [ 0.172000] ... fixed-purpose events: 3 [ 0.173000] ... event mask: 000000070000000f [ 0.174027] rcu: Hierarchical SRCU implementation. [ 0.176050] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 0.177014] smp: Bringing up secondary CPUs ... [ 0.178068] x86: Booting SMP configuration: [ 0.179001] .... node #0, CPUs: #1 #2 #3 #4 [ 0.182254] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 0.184001] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 0.185000] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 0.186090] #5 #6 #7 [ 0.187534] smp: Brought up 1 node, 8 CPUs [ 0.189000] smpboot: Max logical packages: 1 [ 0.190001] smpboot: Total of 8 processors activated (55995.02 BogoMIPS) [ 0.233022] node 0 deferred pages initialised in 41ms [ 0.239077] devtmpfs: initialized [ 0.240041] x86/mm: Memory block size: 128MB [ 0.243390] ACPI: PM: Registering ACPI NVS region [mem 0x798ae000-0x79d4afff] (4837376 bytes) [ 0.252068] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.261008] futex hash table entries: 2048 (order: 5, 131072 bytes, vmalloc) [ 0.269059] pinctrl core: initialized pinctrl subsystem [ 0.274117] NET: Registered protocol family 16 [ 0.278065] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 0.286010] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.293009] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.301015] audit: initializing netlink subsys (disabled) [ 0.307008] audit: type=2000 audit(1713493153.307:1): state=initialized audit_enabled=0 res=1 [ 0.315002] cpuidle: using governor menu [ 0.319030] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 0.327001] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.333052] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 0.343001] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 0.350014] PCI: Using configuration type 1 for base access [ 0.356474] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.357001] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.358023] cryptd: max_cpu_qlen set to 1000 [ 0.362053] ACPI: Added _OSI(Module Device) [ 0.366001] ACPI: Added _OSI(Processor Device) [ 0.371001] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.376000] ACPI: Added _OSI(Processor Aggregator Device) [ 0.406228] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 0.415097] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 0.424099] ACPI: Dynamic OEM Table Load: [ 0.441138] ACPI: Interpreter enabled [ 0.445010] ACPI: PM: (supports S0 S4 S5) [ 0.449000] ACPI: Using IOAPIC for interrupt routing [ 0.456040] HEST: Enabling Firmware First mode for corrected errors. [ 0.463071] HEST: Table parsing has been initialized. [ 0.468097] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 0.475002] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.485116] ACPI: Enabled 5 GPEs in block 00 to 3F [ 0.513232] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 0.519003] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 0.529929] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 0.538332] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 0.546001] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 0.555031] PCI host bridge to bus 0000:ff [ 0.559001] pci_bus 0000:ff: root bus resource [bus ff] [ 0.565010] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 [ 0.571043] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 [ 0.577032] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 [ 0.583031] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 [ 0.589031] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 [ 0.595030] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 [ 0.601031] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 [ 0.607030] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 [ 0.613033] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 [ 0.619030] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 [ 0.625031] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 [ 0.631030] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 [ 0.637030] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 [ 0.643031] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 [ 0.649023] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 [ 0.655034] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 [ 0.662047] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 [ 0.668031] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 [ 0.674032] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 [ 0.680022] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 [ 0.686039] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 [ 0.692062] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 [ 0.698042] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 [ 0.704024] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 [ 0.710042] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 [ 0.716042] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 [ 0.722041] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 [ 0.728025] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 [ 0.734035] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 [ 0.740042] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 [ 0.746042] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 [ 0.752042] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 [ 0.758041] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 [ 0.764032] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 [ 0.770025] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 [ 0.776033] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 [ 0.782034] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 [ 0.788044] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 [ 0.794040] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 [ 0.800042] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 [ 0.807044] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 [ 0.813036] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 [ 0.819033] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 [ 0.825032] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 [ 0.831036] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 [ 0.837023] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 [ 0.843034] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 [ 0.849033] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 [ 0.855036] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 [ 0.861031] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 [ 0.867031] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 [ 0.873025] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 [ 0.879024] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 [ 0.885034] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 [ 0.891031] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 [ 0.899604] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 0.906002] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 0.915137] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 0.923250] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 0.931000] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 0.939496] PCI host bridge to bus 0000:00 [ 0.944002] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.950001] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 0.957000] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.965000] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 0.972000] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 0.980001] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 0.987000] pci_bus 0000:00: root bus resource [bus 00-fe] [ 0.993024] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 [ 0.999096] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 [ 1.005041] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 1.011086] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 [ 1.017041] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 1.023084] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 [ 1.029041] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 1.035082] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 [ 1.041007] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 1.048079] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 [ 1.054007] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 1.061072] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 [ 1.067008] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 1.074080] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 [ 1.080007] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 1.087068] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 [ 1.093007] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 1.100076] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 [ 1.106007] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 1.113076] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 [ 1.119007] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 1.125050] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 [ 1.131007] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 1.138065] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 [ 1.144065] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 [ 1.150081] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 [ 1.156057] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 [ 1.163005] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 1.169070] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 1.175098] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 1.181012] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 1.187006] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 1.192006] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 1.198006] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 1.203006] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 1.209007] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 1.215030] pci 0000:00:11.4: PME# supported from D3hot [ 1.220085] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 1.227014] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 1.233050] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 1.239091] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 1.245014] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 1.252051] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 1.258060] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 1.264014] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 1.271051] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 1.277070] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 1.283014] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 1.290044] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 1.296080] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 1.302066] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 1.308076] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 1.314067] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 1.320077] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 1.326038] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 1.332087] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 1.339013] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 1.345057] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 1.351075] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 1.357156] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 1.363009] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 1.369005] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 1.374005] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 1.380005] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 1.385005] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 1.391006] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 1.397023] pci 0000:00:1f.2: PME# supported from D3hot [ 1.403063] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 1.409013] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 1.415016] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 1.421154] acpiphp: Slot [1] registered [ 1.425013] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.430112] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 [ 1.436008] pci 0000:02:00.0: reg 0x10: [mem 0xfb310000-0xfb313fff 64bit] [ 1.443015] pci 0000:02:00.0: reg 0x30: [mem 0xfb300000-0xfb30ffff pref] [ 1.450003] pci 0000:02:00.0: enabling Extended Tags [ 1.455094] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.460003] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.466121] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 [ 1.473010] pci 0000:03:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 1.480004] pci 0000:03:00.0: reg 0x18: [io 0xe020-0xe03f] [ 1.485009] pci 0000:03:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 1.493004] pci 0000:03:00.0: reg 0x30: [mem 0xfb280000-0xfb2fffff pref] [ 1.499037] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 1.505015] pci 0000:03:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.513001] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 1.523008] pci 0000:03:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.530000] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 1.541145] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 [ 1.547009] pci 0000:03:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 1.554004] pci 0000:03:00.1: reg 0x18: [io 0xe000-0xe01f] [ 1.559009] pci 0000:03:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 1.567005] pci 0000:03:00.1: reg 0x30: [mem 0xfb200000-0xfb27ffff pref] [ 1.573033] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 1.580014] pci 0000:03:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.587000] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 1.597008] pci 0000:03:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.604001] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 1.615080] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.620002] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.626001] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.633002] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.640029] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.645061] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 1.651065] pci 0000:05:00.0: enabling Extended Tags [ 1.656070] pci 0000:05:00.0: supports D1 D2 [ 1.661000] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.667089] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.673002] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.679002] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.686040] pci_bus 0000:06: extended config space not accessible [ 1.692029] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 1.698022] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 1.704012] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 1.710012] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 1.716096] pci 0000:06:00.0: supports D1 D2 [ 1.720000] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.727066] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.732007] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.738003] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.745083] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 1.751017] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 1.757017] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 1.763009] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 1.769076] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 1.775035] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.782000] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 1.793021] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.800001] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 1.810093] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 1.816017] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 1.823017] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 1.828009] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 1.834072] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 1.841035] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.848000] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 1.858021] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.865000] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 1.876154] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.881002] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.887002] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.894003] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 1.900459] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 1.907036] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 1.913031] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 1.919019] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 1.925030] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 1.931000] ACPI: PCI: Interrupt link LNKE disabled [ 1.936030] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 1.942001] ACPI: PCI: Interrupt link LNKF disabled [ 1.947047] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 1.952001] ACPI: PCI: Interrupt link LNKG disabled [ 1.957031] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 1.963000] ACPI: PCI: Interrupt link LNKH disabled [ 1.968203] iommu: Default domain type: Passthrough [ 1.973066] SCSI subsystem initialized [ 1.977015] ACPI: bus type USB registered [ 1.981012] usbcore: registered new interface driver usbfs [ 1.987005] usbcore: registered new interface driver hub [ 1.992005] usbcore: registered new device driver usb [ 1.997020] pps_core: LinuxPPS API ver. 1 registered [ 2.002000] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 2.011002] PTP clock support registered [ 2.015015] EDAC MC: Ver: 3.0.0 [ 2.018110] PCI: Using ACPI for IRQ routing [ 2.027491] NetLabel: Initializing [ 2.031000] NetLabel: domain hash size = 128 [ 2.036000] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 2.041010] NetLabel: unlabeled traffic allowed by default [ 2.047020] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 2.051001] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 2.061001] pci 0000:06:00.0: vgaarb: bridge control possible [ 2.067000] vgaarb: loaded [ 2.070033] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 2.076001] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 2.084029] clocksource: Switched to clocksource tsc-early [ 2.099690] VFS: Disk quotas dquot_6.6.0 [ 2.103623] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 2.110549] pnp: PnP ACPI init [ 2.113947] system 00:01: [io 0x0500-0x057f] has been reserved [ 2.119865] system 00:01: [io 0x0400-0x047f] has been reserved [ 2.125775] system 00:01: [io 0x0580-0x059f] has been reserved [ 2.131686] system 00:01: [io 0x0600-0x061f] has been reserved [ 2.137604] system 00:01: [io 0x0880-0x0883] has been reserved [ 2.143520] system 00:01: [io 0x0800-0x081f] has been reserved [ 2.149438] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 2.156042] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 2.162647] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 2.169251] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 2.175856] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 2.182462] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 2.189067] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 2.195840] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 2.201757] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 2.207667] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 2.213579] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 2.219490] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 2.226079] pnp: PnP ACPI: found 5 devices [ 2.235575] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 2.244468] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 2.255935] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 2.263755] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.268718] pci 0000:00:02.0: PCI bridge to [bus 02] [ 2.273680] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 2.280461] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.288025] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.295931] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.303573] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.311568] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.319124] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.327031] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.334673] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.342668] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.350224] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.358129] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.365775] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.373765] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.381323] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.389230] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.396873] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.404864] pci 0000:00:03.0: PCI bridge to [bus 03] [ 2.409823] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 2.415909] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 2.422687] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.430419] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 2.435383] pci 0000:05:00.0: PCI bridge to [bus 06] [ 2.440344] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 2.446432] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.453223] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 2.458441] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 2.464528] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.471318] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 2.479055] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 2.486882] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 2.494623] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 2.502450] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 2.507412] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 2.513498] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 2.520276] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 2.528010] pci_bus 0000:00: Some PCI device resources are unassigned, try booting with pci=realloc [ 2.537048] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 2.543217] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 2.549391] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 2.556255] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 2.563120] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 2.569983] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 2.576850] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 2.583108] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 2.588672] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 2.594931] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.602141] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 2.607707] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 2.613966] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 2.619529] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 2.625788] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 2.631352] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 2.637610] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 2.644922] NET: Registered protocol family 2 [ 2.649479] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc) [ 2.658754] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, vmalloc) [ 2.667661] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc) [ 2.676076] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, vmalloc) [ 2.683659] TCP: Hash tables configured (established 262144 bind 65536) [ 2.690377] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, vmalloc) [ 2.698120] UDP hash table entries: 16384 (order: 7, 524288 bytes, vmalloc) [ 2.705135] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, vmalloc) [ 2.712603] NET: Registered protocol family 1 [ 2.716956] NET: Registered protocol family 44 [ 2.721479] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 2.745128] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x627 took 16061 usecs [ 2.764090] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x627 took 11280 usecs [ 2.771492] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 2.777937] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 2.786313] Unpacking initramfs... [ 3.060166] Freeing initrd memory: 26816K [ 3.064257] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 3.070695] software IO TLB: mapped [mem 0x0000000064000000-0x0000000068000000] (64MB) [ 3.078612] ACPI: bus type thunderbolt registered [ 3.084935] Initialise system trusted keyrings [ 3.089391] Key type blacklist registered [ 3.093421] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 3.101417] zbud: loaded [ 3.104262] pstore: using deflate compression [ 3.108793] Platform Keyring initialized [ 3.150970] NET: Registered protocol family 38 [ 3.155409] Key type asymmetric registered [ 3.159503] Asymmetric key parser 'x509' registered [ 3.164384] Running certificate verification selftests [ 3.194700] Loaded X.509 cert 'Certificate verification self-testing key: f58703bb33ce1b73ee02eccdee5b8817518fe3db' [ 3.205578] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 3.212989] io scheduler mq-deadline registered [ 3.217515] io scheduler kyber registered [ 3.221547] io scheduler bfq registered [ 3.225445] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 3.232668] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 3.238570] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 3.244468] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 3.250335] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 3.256203] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 3.262069] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 3.267946] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.275264] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 3.283624] ACPI: Power Button [PWRB] [ 3.287310] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 3.294720] ACPI: Power Button [PWRF] [ 3.299455] ERST: Error Record Serialization Table (ERST) support is initialized. [ 3.306959] pstore: Registered erst as persistent store backend [ 3.312974] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 3.339824] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.367747] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.375416] Non-volatile memory driver v1.3 [ 3.379997] rdac: device handler registered [ 3.384204] hp_sw: device handler registered [ 3.388475] emc: device handler registered [ 3.392606] alua: device handler registered [ 3.396853] libphy: Fixed MDIO Bus: probed [ 3.401106] usbcore: registered new interface driver usbserial_generic [ 3.401256] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 3.407625] usbserial: USB Serial support registered for generic [ 3.412869] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 1 [ 3.418862] i8042: PNP: No PS/2 controller found. [ 3.426239] ehci-pci 0000:00:1d.0: debug port 2 [ 3.430943] mousedev: PS/2 mouse device common for all mice [ 3.439376] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 3.441162] rtc_cmos 00:00: RTC can wake from S4 [ 3.451445] rtc_cmos 00:00: registered as rtc0 [ 3.453034] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 3.455896] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram, hpet irqs [ 3.461654] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.477518] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.484730] usb usb1: Product: EHCI Host Controller [ 3.489601] usb usb1: Manufacturer: Linux 4.18.0-552.el8.x86_64 ehci_hcd [ 3.496292] usb usb1: SerialNumber: 0000:00:1d.0 [ 3.500997] intel_pstate: Intel P-state driver initializing [ 3.501029] hub 1-0:1.0: USB hub found [ 3.510328] hub 1-0:1.0: 2 ports detected [ 3.514497] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 3.519782] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2 [ 3.527476] hid: raw HID events driver (C) Jiri Kosina [ 3.528254] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 3.532660] usbcore: registered new interface driver usbhid [ 3.541961] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 3.541975] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 3.541999] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 3.542002] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 3.542044] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.542045] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.542046] usb usb2: Product: xHCI Host Controller [ 3.542047] usb usb2: Manufacturer: Linux 4.18.0-552.el8.x86_64 xhci-hcd [ 3.542048] usb usb2: SerialNumber: 0000:00:14.0 [ 3.542140] hub 2-0:1.0: USB hub found [ 3.542165] hub 2-0:1.0: 15 ports detected [ 3.544534] usb usb3: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 4.18 [ 3.544536] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.544537] usb usb3: Product: xHCI Host Controller [ 3.544537] usb usb3: Manufacturer: Linux 4.18.0-552.el8.x86_64 xhci-hcd [ 3.544538] usb usb3: SerialNumber: 0000:00:14.0 [ 3.544628] hub 3-0:1.0: USB hub found [ 3.544642] hub 3-0:1.0: 6 ports detected [ 3.547337] usbhid: USB HID core driver [ 3.547426] drop_monitor: Initializing network drop monitor service [ 3.552636] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 4 [ 3.557832] Initializing XFRM netlink socket [ 3.565190] ehci-pci 0000:00:1a.0: debug port 2 [ 3.571530] NET: Registered protocol family 10 [ 3.583673] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 3.587124] Segment Routing with IPv6 [ 3.598037] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 3.598519] NET: Registered protocol family 17 [ 3.603143] usb usb4: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.606940] mpls_gso: MPLS GSO support [ 3.610974] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.610976] usb usb4: Product: EHCI Host Controller [ 3.724675] usb usb4: Manufacturer: Linux 4.18.0-552.el8.x86_64 ehci_hcd [ 3.731368] usb usb4: SerialNumber: 0000:00:1a.0 [ 3.7355] hub 4-0:1.0: USB hub found [ 3.739933] hub 4-0:1.0: 2 ports detected [ 3.739936] microcode: Microcode Update Driver: v2.2. [ 3.744034] resctrl: L3 allocation detected [ 3.753031] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 3.753262] resctrl: L3 monitoring detected [ 3.763967] AVX2 version of gcm_enc/dec engaged. [ 3.768582] AES CTR mode by8 optimization enabled [ 3.783861] sched_clock: Marking stable (3783858473, 0)->(5666558561, -1882700088) [ 3.791536] registered taskstats version 1 [ 3.795793] Loading compiled-in X.509 certificates [ 3.800855] Loaded X.509 cert 'Red Hat Enterprise Linux kernel signing key: b8c8c7a1297a11ed2e36e7913cdfd6f59248d125' [ 3.811710] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 3.823532] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 3.834154] zswap: loaded using pool lzo/zbud [ 3.838623] page_owner is disabled [ 3.845513] Key type big_key registered [ 3.851008] usb 2-12: new high-speed USB device number 2 using xhci_hcd [ 3.851062] Key type encrypted registered [ 3.861644] ima: No TPM chip found, activating TPM-bypass! [ 3.867130] ima: Allocated hash algorithm: sha256 [ 3.871833] ima: No architecture policies found [ 3.876369] evm: Initialising EVM extended attributes: [ 3.881500] evm: security.selinux [ 3.884811] evm: security.ima [ 3.887776] evm: security.capability [ 3.888364] usb 1-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 3.891349] evm: HMAC attrs: 0x1 [ 3.891628] rtc_cmos 00:00: setting system clock to 2024-04-19 02:19:18 UTC (1713493158) [ 3.899531] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 3.899768] hub 1-1:1.0: USB hub found [ 3.921868] hub 1-1:1.0: 8 ports detected [ 3.926711] Freeing unused decrypted memory: 2028K [ 3.931849] Freeing unused kernel image (initmem) memory: 2820K [ 3.943043] Write protecting the kernel read-only data: 26624k [ 3.949235] Freeing unused kernel image (text/rodata gap) memory: 2016K [ 3.956101] Freeing unused kernel image (rodata/data gap) memory: 1672K [ 3.972309] systemd[1]: systemd 239 (239-75.el8) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 3.983236] usb 2-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 3.987037] usb 4-1: new high-speed USB device number 2 using ehci-pci [ 4.009472] usb 2-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.014063] systemd[1]: Detected architecture x86-64. [ 4.017248] hub 2-12:1.0: USB hub found [ 4.021743] systemd[1]: Running in initial RAM disk. [ 4.025665] hub 2-12:1.0: 4 ports detected Welcome to CentOS Stream 8 dracut-049-224.git20230330.el8 (Initramfs)! [ 4.056061] systemd[1]: Set hostname to . [ 4.092845] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 4.105157] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 4.115384] usb 4-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 4.123558] usb 4-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.127010] tsc: Refined TSC clocksource calibration: 3499.993 MHz [ 4.131111] hub 4-1:1.0: USB hub found [ 4.136863] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734a05315, max_idle_ns: 440795202126 ns [ 4.141198] systemd[1]: Starting Create list of required static device nodes for the current kernel... [ 4.159895] clocksource: Switched to clocksource tsc [ 4.159896] hub 4-1:1.0: 6 ports detected Starting Create list of required st…ce nodes for the current kernel... [ 4.178144] systemd[1]: Reached target Swap. [ OK ] Reached target Swap. [ 4.188115] systemd[1]: Reached target Local File Systems. [ OK ] Reached target Local File Systems. [ 4.200793] systemd[1]: Starting Create Volatile Files and Directories... Starting Create Volatile Files and Directories... [ OK ] Listening on Journal Socket (/dev/log). Starting Journal Service... [ OK ] Listening on udev Control Socket. Starting Setup Virtual Console... [ OK ] Reached target Timers. Starting Load Kernel Modules... [ OK ] Reached target Slices. [ OK ] Reached targ[ 4.264719] fuse: init (API version 7.34) et Sockets. [ OK ] Started Memstrack Anylazing Service. [ OK ] Started Journal Service. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Create Volatile File[ 4.324071] usb 2-12.1: new low-speed USB device number 3 using xhci_hcd s and Direc[ OK ual Console. [m OK ] Started Load Kernel Modules. Starting Apply Kernel Variables... Starting dracut cmdline hook... Starting Create Static Device Nodes in /dev... [ OK ] Started Apply Kernel Variables. [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ OK ] Started udev[ 4.437294] usb 2-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 4.446601] usb 2-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 Kernel Device Manager. [ 4.458994] i HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.0/0003:0557:2419.0001/input/input2 Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ 4.522164] hneric 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 4.534767] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.1/0003:0557:2419.0002/input/input3 [ 4.546487] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ OK ] Started udev Coldplug all Devices. Starting dracut initqueue hook... Starting Show Plymouth Boot Screen... [ 4.590709] dca service started, version 1.12.1 [ OK ] Reached target System Initialization. [ OK ] Started Show[ 4.602801] nvme nvme0: pci function 0000:02:00.0 Plymouth Boot Screen. [ OK ] Sta[ 4.610657] nvme nvme0: 8/0/0 default/read/poll queues rted Forward Pas[ 4.617498] igb: Intel(R) Gigabit Ethernet Network Driver [ 4.618318] nvme0n1: detected capacity change from 0 to 400088457216 sword Requests t[ 4.624033] igb: Copyright (c) 2007-2014 Intel Corporation. o Plymouth Directory Watch. [[ 4.639066] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [0;32m OK [ 4.646204] ixgbe: Copyright (c) 1999-2016 Intel Corporation. ] Reached target Paths. [ OK ] Reached target Basic System. [ 4.662113] ACPI: bus type drm_connector registered [ 4.669021] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 4.677153] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 4.693343] scsi host0: ahci [ 4.693735] igb 0000:07:00.0: added PHC on eth0 [ 4.696361] scsi host1: ahci [ 4.700777] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 4.703765] scsi host2: ahci [ 4.710503] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:19:40 [ 4.713482] scsi host3: ahci [ 4.720587] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 4.723449] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 53 [ 4.728524] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 4.743499] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 53 [ 4.743502] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 53 [ 4.743521] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 53 [ 4.743717] ast 0000:06:00.0: [drm] Using P2A bridge for configuration [ 4.743823] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 4.743826] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 4.759335] scsi host4: ahci [ 4.765691] ast 0000:06:00.0: [drm] AST 2400 detected [ 4.772324] scsi host5: ahci [ 4.780385] ast 0000:06:00.0: [drm] Using analog VGA [ 4.784425] igb 0000:07:00.1: added PHC on eth1 [ 4.784452] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 4.784453] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:19:41 [ 4.784528] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 4.784529] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 4.785649] igb 0000:07:00.1 eno2: renamed from eth1 [ 4.788074] scsi host6: ahci [ 4.790849] ast 0000:06:00.0: [drm] dram MCLK=408 Mhz type=1 bus_width=16 [ 4.796003] scsi host7: ahci [ 4.798948] [drm] Initialized ast 0.1.0 20120228 for 0000:06:00.0 on minor 0 [ 4.803861] scsi host8: ahci [ 4.862550] scsi host9: ahci [ 4.862582] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 63 [ 4.862585] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 63 [ 4.862588] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 63 [ 4.862590] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 63 [ 4.862592] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 63 [ 4.862593] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 63 [ 4.934778] fbcon: astdrmfb (fb0) is primary device [ 4.936120] igb 0000:07:00.0 eno1: renamed from eth0 [ 4.984067] Console: switching to colour frame buffer device 128x48 [ 5.036425] ast 0000:06:00.0: [drm] fb0: astdrmfb frame buffer device [ 5.052851] ata4: SATA link down (SStatus 0 SControl 300) [ 5.053045] ata3: SATA link down (SStatus 0 SControl 300) [ 5.053260] ata2: SATA link down (SStatus 0 SControl 300) [ 5.055643] ata1: SATA link down (SStatus 0 SControl 300) [ 5.172433] ata9: SATA link down (SStatus 0 SControl 300) [ 5.177844] ata8: SATA link down (SStatus 0 SControl 300) [ 5.183250] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 5.189436] ata7: SATA link down (SStatus 0 SControl 300) [ 5.194844] ata10: SATA link down (SStatus 0 SControl 300) [ 5.200339] ata6: SATA link down (SStatus 0 SControl 300) [ 5.206515] ata5.00: NCQ Send/Recv Log not supported [ 5.211474] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 5.217730] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 5.226141] ata5.00: NCQ Send/Recv Log not supported [ 5.231107] ata5.00: configured for UDMA/133 [ 5.235513] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 5.249112] scsi 4:0:0:0: Attached scsi generic sg0 type 0 [ 5.258081] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 5.265751] sd 4:0:0:0: [sda] Write Protect is off [ 5.270560] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 5.290549] sda: sda1 [ 5.293159] sd 4:0:0:0: [sda] Attached SCSI disk [ OK ] Found device ST1000NM0033-9ZM173 1. [ OK ] Reached target Initrd Root Device. [ 5.788292] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 5.798563] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 5.807068] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 5.813243] ixgbe 0000:03:00.0: 0c:c4:7a:ea:b0:4a [ 5.821260] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 5.827882] libphy: ixgbe-mdio: probed [ 5.988142] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 5.998410] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.006916] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 6.013951] ixgbe 0000:03:00.1: 0c:c4:7a:ea:b0:4b [ 6.021948] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 6.028530] libphy: ixgbe-mdio: probed [ 6.033221] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ 6.044149] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ OK ] Started dracut initqueue hook. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting File System Check on /dev/…ddf-553d-41ea-8bce-5708f99a0430... [ OK ] Started File System Check on /dev/d…36ddf-553d-41ea-8bce-5708f99a0430. Mounting /sysroot... [ 6.220832] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped target Timers. Starting Setup Virtual Console... [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped dracut initqueue hook. Starting Plymouth switch root service... [ OK ] Stopped target Basic System. [ OK ] Stopped target Slices. [ OK ] Stopped target Sockets. [ OK ] Stopped target Paths. [ OK ] Stopped target System Initialization. [ OK ] Stopped Create Volatile Files and Directories. Stopping udev Kernel Device Manager... [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped Load Kernel Modules. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Swap. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Started Setup Virtual Console. [ OK ] Reached target Switch Root. [ OK ] Started Plymouth switch root service. [ 6.642053] printk: systemd: 10 output lines suppressed due to ratelimiting Starting Switch Root... [ 7.282848] SELinux: policy capability network_peer_controls=1 [ 7.288764] SELinux: policy capability open_perms=1 [ 7.293727] SELinux: policy capability extended_socket_class=1 [ 7.299638] SELinux: policy capability always_check_network=0 [ 7.305464] SELinux: policy capability cgroup_seclabel=1 [ 7.310853] SELinux: policy capability nnp_nosuid_transition=1 [ 7.338127] audit: type=1403 audit(1713493161.946:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 7.339909] systemd[1]: Successfully loaded SELinux policy in 212.063ms. [ 7.417282] systemd[1]: Relabelled /dev, /run and /sys/fs/cgroup in 19.867ms. [ 7.433603] systemd[1]: systemd 239 (239-75.el8) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 7.468065] systemd[1]: Detected architecture x86-64. Welcome to CentOS Stream 8! [ 7.479784] systemd[1]: Set hostname to . [ 8.688124] systemd[1]: initrd-switch-root.service: Succeeded. [ 8.694195] systemd[1]: Stopped Switch Root. [ OK [[ 8.699252] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. 0m] Stopped Swit[ 8.710762] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. ch Root. [ 8.721058] systemd[1]: Stopped Journal Service. [ OK [[ 8.727127] systemd[1]: Starting Journal Service... 0m] Stopped Jour[ 8.733636] systemd[1]: Mounting Huge Pages File System... nal Service. Starting Journal Service... Mounting Huge Pages File System... [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Reached target ceph target allowing…mirror@.service instances at once. [ OK ] Listening on Process Core Dump Socket. [ OK ] Created slice system-getty.slice. Mounting Kernel Debug File System... [ OK ] Reached target Swap. Starting Remount Root and Kernel File Systems... [ OK ] Created slice User and Session Slice. [ OK ] Listening on udev Control Socket. [ OK ] Created slice system-serial\x2dgetty.slice. [ OK ] Set up automount Arbitrary Executab…rmats File System Automount Point. [ OK ] Listening on udev Kernel Socket. Starting udev Coldplug all Devices... [ OK ] Stopped target Switch Root. Starting Setup Virtual Console... [ OK ] Stopped Plymouth switch root service. [ OK ] Listening on Device-mapper event daemon FIFOs. Starting Load Kernel Modules... Starting Read and set NIS domainname from /etc/sysconfig/network... [ OK ] Stopped target Initrd File Systems. [ OK ] Stopped target Initrd Root File System. [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. [ OK [ 8.870861] EXT4-fs (sda1): re-mounted. Opts: (null) ] Listening on LVM2 poll daemon socket. Starting Create list of required st…ce nodes for the current kernel... [ OK ] Reached target ceph target allowing…ph-mon@.service instances at once. [ OK ] Reached target ceph target allowing…ph-osd@.service instances at once. [ OK ] Reached target ceph target allowing…ph-mds@.service instances at once. [ OK ] Reached target ceph target allowing…adosgw@.service instances at once. Starting Monitoring of LVM2 mirrors…ng dmeventd or progress polling... [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Reached target Paths. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Slices. Mounting POSIX Message Queue File System... [ OK ] Created slice system-sshd\x2dkeygen.slice. [ OK ] Reached target ceph target allowing…ph-mgr@.service instances at once. [ OK ] Started Journal Service. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Started Remount Root and Kernel File Systems. [ OK ] Started Read and set NIS domainname from /etc/sysconfig/network. [ OK ] Mounted POSIX Message Queue File System. Starting Load/Save Random Seed... Starting Flush Journal to Persistent Storage... [ OK ] Started Create list of required sta…vice nodes for the current kernel. Starting Create Static Device Nodes in /dev... [ OK ] Started Load/Save Random Seed. [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started udev Coldplug all Devices. [ OK ] Started Load Kernel Modules. Mounting FUSE Control File System... Starting Apply Kernel Variables... [ OK ] Mounted FUSE Control File System. [ 9.114031] device-mapper: uevent: version 1.0.3 [ 9.118740] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com [ OK ] Started Apply Kernel Variables. [ OK ] Started Monitoring of LVM2 mirrors,…sing dmeventd or progress polling. [ OK ] Started Setup Virtual Console. [ OK ] Started Create Static Device Nodes in /dev. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. [ OK ] Reached target Local File Systems (Pre). [ OK ] Reached target Local File Systems. Starting Import network configuration from initramfs... Starting Tell Plymouth To Write Out Runtime Data... [ OK ] Started Tell Plymouth To Write Out Runtime Data. [ 9.513435] ioatdma: Intel(R) QuickData Technology Driver 5.00 [ OK ] Started Import network configuration from initramfs. Starting Create Volatile Fil[ 9.528059] igb 0000:07:00.0: DCA enabled es and Directori[ 9.533174] igb 0000:07:00.1: DCA enabled es... [ 9.538974] mei_me 0000:00:16.0: Device doesn't have valid ME Interface [ 9.575270] IPMI message handler: version 39.2 [ 9.581828] ipmi device interface [ 9.589820] ipmi_si: IPMI System Interface driver [ 9.594555] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS [ 9.600936] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 9.608175] ipmi_si: Adding SMBIOS-specified kcs state machine [ 9.614098] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI [ 9.620045] ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2] regsize 1 spacing 1 irq 0 [ 9.631274] power_meter ACPI000D:00: Found ACPI power meter. [ 9.631808] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI [ 9.636964] power_meter ACPI000D:00: Ignoring unsafe software power cap! [ 9.645687] ipmi_si: Adding ACPI-specified kcs state machine [ 9.658143] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 [ 9.697242] input: PC Speaker as /devices/platform/pcspkr/input/input4 [ 9.697348] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ OK ] Created slice system-lvm2\x2dpvscan.slice. Starting LVM event activation on device 259:0... [ 9.750611] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer [ 9.753028] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. [ 9.758529] RAPL PMU: hw unit of domain package 2^-14 Joules [ 9.775739] RAPL PMU: hw unit of domain dram 2^-16 Joules [ 9.788886] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x0833, dev_id: 0x20) [ 9.832309] ipmi_si IPI0001:00: IPMI kcs interface initialized [ 9.840111] iTCO_vendor_support: vendor-support=0 [ 9.847550] ipmi_ssif: IPMI SSIF Interface driver [ 9.852441] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11 [[ 9.858334] iTCO_wdt: Found a Wellsburg TCO device (Version=2, TCOBASE=0x0460)  OK ] Started Create Volatile Files and Directories[ 9.870165] iTCO_wdt: initialized. heartbeat=30 sec (nowayout=0) . Mounting RPC Pipe File System... Starting Security Auditing Service... Starting RPC Bind... [ OK ] Found device /dev/vg_nvme/lv_5. Mounting /var/lib/ceph... [ OK ] Started LVM event activation on device 259:0. [ 10.033303] RPC: Registered named UNIX socket transport module. [ 10.039244] RPC: Registered udp transport module. [ 10.043983] RPC: Registered tcp transport module. [ 10.043985] RPC: Registered tcp NFSv4.1 backchannel transport module. [ OK ] Started RPC Bind. [ OK ] Mounted RPC Pipe Fil[ 10.060859] SGI XFS with ACLs, security attributes, quota, no debug enabled e System. [ OK ] Reached target rpc_pipefs.target[ 10.073586] XFS (dm-4): Mounting V4 Filesystem . [ 10.085591] XFS (dm-4): Ending clean mount [ OK ] Mounted /var/lib/ceph. [ 10.185707] EDAC MC0: Giving out device to module sb_edac controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT) [ 10.196657] EDAC sbridge: Ver: 1.1.2 [ 10.242019] intel_rapl_common: Found RAPL domain package [ 10.247336] intel_rapl_common: Found RAPL domain dram [ 10.252389] intel_rapl_common: DRAM domain energy unit 15300pj [ OK ] Started Security Auditing Service. Starting Update UTMP about System Boot/Shutdown... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Reached target System Initialization. [ OK ] Started Updates mlocate database every day. [ OK ] Started Generate summary of yesterday's process accounting. [ OK ] Started Run system activity accounting tool every 10 minutes. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Reached target Timers. [ OK ] Listening on SSSD Kerberos Cache Manager responder socket. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. [ OK ] Started irqbalance daemon. [ OK ] Started libstoragemgmt plug-in server daemon. [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target allowing… ceph*@.service instances at once. [ OK ] Started Machine Check Exception Logging Daemon. [ OK ] Reached target User and Group Name Lookups. Starting Kernel Samepage Merging... [ OK ] Reached target sshd-keygen.target. Starting VDO volume services... Starting Authorization Manager... [ OK ] Started D-Bus System Message Bus. Starting Network Manager... Starting Restore /run/initramfs on shutdown... Starting Self Monitoring and Reporting Technology (SMART) Daemon... Starting Resets System Activity Logs... Starting NTP client/server... Starting Login Service... [ OK ] Started Kernel Samepage Merging. [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Resets System Activity Logs. Starting Kernel Samepage Merging (KSM) Tuning Daemon... [ OK ] Started Self Monitoring and Reporting Technology (SMART) Daemon. [ OK ] Started Kernel Samepage Merging (KSM) Tuning Daemon. [ OK ] Started Login Service. [ OK ] Started NTP client/server. [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting Dynamic System Tuning Daemon... Starting GSSAPI Proxy Daemon... Starting OpenSSH server daemon... Starting Network Manager Wait Online... Starting Hostname Service... [ OK ] Started Hostname Service. [ OK ] Started Authorization Manager. [ OK ] Started OpenSSH server daemon. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Started Perm[ 12.265172] IPv6: ADDRCONF(NETDEV_UP): eno1: link is not ready it User Sessions. [ OK ] Started Command Scheduler. [ OK ] Started Job spooling tools. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ 12.324124] IPv6: ADDRCONF(NETDEV_UP): eno1: link is not ready [ 12.331750] IPv6: ADDRCONF(NETDEV_UP): eno2: link is not ready [ 12.387827] IPv6: ADDRCONF(NETDEV_UP): eno2: link is not ready [ 12.395105] IPv6: ADDRCONF(NETDEV_UP): enp3s0f0: link is not ready [ 12.437890] ixgbe 0000:03:00.0: registered PHC device on enp3s0f0 [ 12.551922] IPv6: ADDRCONF(NETDEV_UP): enp3s0f0: link is not ready [ 12.559607] IPv6: ADDRCONF(NETDEV_UP): enp3s0f1: link is not ready [ 12.602676] ixgbe 0000:03:00.1: registered PHC device on enp3s0f1 [ OK ] Started VDO volume services. [ 12.711953] IPv6: ADDRCONF(NETDEV_UP): enp3s0f1: link is not ready [ 12.835135] ixgbe 0000:03:00.1 enp3s0f1: detected SFP+: 4 [ 13.031157] ixgbe 0000:03:00.1 enp3s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX [ 13.039011] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f1: link becomes ready [ OK ] Started Dynamic System Tuning Daemon. [* ] A start job is running for Network Manager Wait Online (9s / no limit) [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting System Logging Service... Starting Notify NFS peers of a restart... Starting /etc/rc.d/rc.local Compatibility... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' [ OK ] Started Nagios Remote Plugin Executor. Starting Crash recovery kernel arming... [ OK ] Started Notify NFS peers of a restart. + myips=172.21.15.177 + attempts=1 + sleep 1 [ OK ] Started System Logging Service. + '[' 172.21.15.177 '!=' '' ']' + set -e + '[' -n 172.21.15.177 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.177 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.177 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' + newhostname=smithi177.front.sepia.ceph.com + '[' -n smithi177.front.sepia.ceph.com ']' + hostname smithi177.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi177 + echo smithi177 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.177 smithi177.front.sepia.ceph.com smithi177/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.d/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... Starting SETroubleshoot daemon for …cessing new SELinux denial logs... CentOS Stream 8 Kernel 4.18.0-552.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi177 login: [disconnect] 2024-04-19T02:19:41.063 INFO:teuthology.misc:Re-opening connections... 2024-04-19T02:19:41.063 INFO:teuthology.misc:trying to connect to ubuntu@smithi177.front.sepia.ceph.com 2024-04-19T02:19:41.064 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-04-19T02:19:41.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:19:42.168 DEBUG:teuthology.orchestra.run.smithi177:> true 2024-04-19T02:19:42.721 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-04-19T02:19:42.721 DEBUG:teuthology.misc:waited 1.6573076248168945 2024-04-19T02:19:43.721 DEBUG:tasks.ceph_manager:Mounting data for osd.2 on ubuntu@smithi177.front.sepia.ceph.com 2024-04-19T02:19:43.721 INFO:tasks.ceph_manager:Mounting osd.2: dev: ubuntu@smithi177.front.sepia.ceph.com, cluster: cephmountpoint: /var/lib/ceph/osd/ceph-2, type: xfs, options: ['noatime'] 2024-04-19T02:19:43.722 DEBUG:teuthology.orchestra.run.smithi177:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-04-19T02:19:43.821 DEBUG:teuthology.orchestra.run.smithi177:> sudo install -d -m0777 -- /var/run/ceph 2024-04-19T02:19:43.883 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-19T02:19:43.884 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-19T02:19:43.886 INFO:tasks.ceph.osd.2:Started 2024-04-19T02:19:43.886 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:19:44.022 INFO:teuthology.orchestra.run.smithi177.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2024-04-19T02:19:44.025 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-19T02:19:44.026 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2024-04-19T02:19:44.760 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:19:44.761+0000 7f0b0a9cf800 -1 Falling back to public interface 2024-04-19T02:19:45.618 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-04-19T02:19:49.027 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:19:49.164 INFO:teuthology.orchestra.run.smithi177.stderr:no valid command found; 10 closest matches: 2024-04-19T02:19:49.164 INFO:teuthology.orchestra.run.smithi177.stderr:0 2024-04-19T02:19:49.164 INFO:teuthology.orchestra.run.smithi177.stderr:1 2024-04-19T02:19:49.164 INFO:teuthology.orchestra.run.smithi177.stderr:2 2024-04-19T02:19:49.165 INFO:teuthology.orchestra.run.smithi177.stderr:abort 2024-04-19T02:19:49.165 INFO:teuthology.orchestra.run.smithi177.stderr:assert 2024-04-19T02:19:49.165 INFO:teuthology.orchestra.run.smithi177.stderr:bluefs debug_inject_read_zeros 2024-04-19T02:19:49.165 INFO:teuthology.orchestra.run.smithi177.stderr:bluefs files list 2024-04-19T02:19:49.165 INFO:teuthology.orchestra.run.smithi177.stderr:bluefs stats 2024-04-19T02:19:49.165 INFO:teuthology.orchestra.run.smithi177.stderr:bluestore allocator dump block 2024-04-19T02:19:49.165 INFO:teuthology.orchestra.run.smithi177.stderr:bluestore allocator fragmentation block 2024-04-19T02:19:49.165 INFO:teuthology.orchestra.run.smithi177.stderr:admin_socket: invalid command 2024-04-19T02:19:49.167 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-19T02:19:49.167 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2024-04-19T02:19:52.281 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:19:52.282+0000 7f0b0a9cf800 -1 osd.2 49 log_to_monitors true 2024-04-19T02:19:52.927 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-04-19T02:19:52.928+0000 7f0af694a700 -1 osd.2 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-19T02:19:54.168 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T02:19:54.387 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-04-19T02:19:54.387 INFO:teuthology.orchestra.run.smithi177.stdout: "ops": [], 2024-04-19T02:19:54.387 INFO:teuthology.orchestra.run.smithi177.stdout: "num_ops": 0 2024-04-19T02:19:54.387 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-04-19T02:19:54.393 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-19T02:19:54.913 INFO:teuthology.orchestra.run.smithi121.stderr:reweighted osd.0 to 1 (10000) 2024-04-19T02:19:54.924 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-19T02:19:55.916 INFO:teuthology.orchestra.run.smithi121.stderr:reweighted osd.1 to 1 (10000) 2024-04-19T02:19:55.929 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-19T02:19:56.922 INFO:teuthology.orchestra.run.smithi121.stderr:reweighted osd.2 to 1 (10000) 2024-04-19T02:19:56.936 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-19T02:19:56.936 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:19:57.268 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:19:57.271 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-04-19T02:19:57.278 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":208,"stamp":"2024-04-19T02:19:56.916211+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":8,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":139,"acting":139,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":223,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":6336352,"kb_used_data":5706744,"kb_used_omap":9,"kb_used_meta":629558,"kb_avail":276779168,"statfs":{"total":289910292480,"available":283421868032,"internally_reserved":0,"allocated":5843705856,"data_stored":5842303912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10036,"internal_metadata":644667596},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.022228"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":72,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.413697+0000","last_change":"2024-04-19T02:17:08.254203+0000","last_active":"2024-04-19T02:17:57.413697+0000","last_peered":"2024-04-19T02:17:57.413697+0000","last_clean":"2024-04-19T02:17:05.242795+0000","last_became_active":"2024-04-19T02:17:08.254203+0000","last_became_peered":"2024-04-19T02:17:08.254203+0000","last_unstale":"2024-04-19T02:17:57.413697+0000","last_undegraded":"2024-04-19T02:17:57.413697+0000","last_fullsized":"2024-04-19T02:17:08.248809+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:24:51.800321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":72,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.412527+0000","last_change":"2024-04-19T02:17:08.276229+0000","last_active":"2024-04-19T02:17:57.412527+0000","last_peered":"2024-04-19T02:17:57.412527+0000","last_clean":"2024-04-19T02:17:05.242326+0000","last_became_active":"2024-04-19T02:17:08.276229+0000","last_became_peered":"2024-04-19T02:17:08.276229+0000","last_unstale":"2024-04-19T02:17:57.412527+0000","last_undegraded":"2024-04-19T02:17:57.412527+0000","last_fullsized":"2024-04-19T02:17:08.246093+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:29:20.438000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":68,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:19:42.898771+0000","last_change":"2024-04-19T02:15:29.286709+0000","last_active":"2024-04-19T02:19:42.898771+0000","last_peered":"2024-04-19T02:19:42.898771+0000","last_clean":"2024-04-19T02:19:42.898771+0000","last_became_active":"2024-04-19T02:15:29.286169+0000","last_became_peered":"2024-04-19T02:15:29.286169+0000","last_unstale":"2024-04-19T02:19:42.898771+0000","last_undegraded":"2024-04-19T02:19:42.898771+0000","last_fullsized":"2024-04-19T02:19:42.898771+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:58.741466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":73,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:19:32.896739+0000","last_change":"2024-04-19T02:17:08.268240+0000","last_active":"2024-04-19T02:19:32.896739+0000","last_peered":"2024-04-19T02:19:32.896739+0000","last_clean":"2024-04-19T02:17:05.243491+0000","last_became_active":"2024-04-19T02:17:08.268240+0000","last_became_peered":"2024-04-19T02:17:08.268240+0000","last_unstale":"2024-04-19T02:19:32.896739+0000","last_undegraded":"2024-04-19T02:19:32.896739+0000","last_fullsized":"2024-04-19T02:17:08.245740+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:34.019094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":36,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.412046+0000","last_change":"2024-04-19T02:17:08.249154+0000","last_active":"2024-04-19T02:17:57.412046+0000","last_peered":"2024-04-19T02:17:57.412046+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"2024-04-19T02:17:08.249154+0000","last_became_peered":"2024-04-19T02:17:08.249154+0000","last_unstale":"2024-04-19T02:17:57.412046+0000","last_undegraded":"2024-04-19T02:17:57.412046+0000","last_fullsized":"2024-04-19T02:17:08.246028+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:33.199338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":72,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:18:02.880069+0000","last_change":"2024-04-19T02:17:08.271359+0000","last_active":"2024-04-19T02:18:02.880069+0000","last_peered":"2024-04-19T02:18:02.880069+0000","last_clean":"2024-04-19T02:17:05.242544+0000","last_became_active":"2024-04-19T02:17:08.271359+0000","last_became_peered":"2024-04-19T02:17:08.271359+0000","last_unstale":"2024-04-19T02:18:02.880069+0000","last_undegraded":"2024-04-19T02:18:02.880069+0000","last_fullsized":"2024-04-19T02:17:08.243605+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:40:34.647402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":72,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:18:02.879989+0000","last_change":"2024-04-19T02:17:08.246286+0000","last_active":"2024-04-19T02:18:02.879989+0000","last_peered":"2024-04-19T02:18:02.879989+0000","last_clean":"2024-04-19T02:17:05.242437+0000","last_became_active":"2024-04-19T02:17:08.246286+0000","last_became_peered":"2024-04-19T02:17:08.246286+0000","last_unstale":"2024-04-19T02:18:02.879989+0000","last_undegraded":"2024-04-19T02:18:02.879989+0000","last_fullsized":"2024-04-19T02:17:08.243188+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:29:03.356417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":72,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:18:02.879911+0000","last_change":"2024-04-19T02:17:08.246832+0000","last_active":"2024-04-19T02:18:02.879911+0000","last_peered":"2024-04-19T02:18:02.879911+0000","last_clean":"2024-04-19T02:17:05.242331+0000","last_became_active":"2024-04-19T02:17:08.246832+0000","last_became_peered":"2024-04-19T02:17:08.246832+0000","last_unstale":"2024-04-19T02:18:02.879911+0000","last_undegraded":"2024-04-19T02:18:02.879911+0000","last_fullsized":"2024-04-19T02:17:08.243064+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:55:18.433102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":28,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.413004+0000","last_change":"2024-04-19T02:17:08.250169+0000","last_active":"2024-04-19T02:17:57.413004+0000","last_peered":"2024-04-19T02:17:57.413004+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"2024-04-19T02:17:08.250169+0000","last_became_peered":"2024-04-19T02:17:08.250169+0000","last_unstale":"2024-04-19T02:17:57.413004+0000","last_undegraded":"2024-04-19T02:17:57.413004+0000","last_fullsized":"2024-04-19T02:17:08.246576+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:00:42.593407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":49,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:18:57.890025+0000","last_change":"2024-04-19T02:16:30.093524+0000","last_active":"2024-04-19T02:18:57.890025+0000","last_peered":"2024-04-19T02:18:57.890025+0000","last_clean":"2024-04-19T02:18:57.890025+0000","last_became_active":"2024-04-19T02:16:30.093344+0000","last_became_peered":"2024-04-19T02:16:30.093344+0000","last_unstale":"2024-04-19T02:18:57.890025+0000","last_undegraded":"2024-04-19T02:18:57.890025+0000","last_fullsized":"2024-04-19T02:18:57.890025+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:14:40.293159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":72,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:58.304904+0000","last_change":"2024-04-19T02:17:08.269760+0000","last_active":"2024-04-19T02:17:58.304904+0000","last_peered":"2024-04-19T02:17:58.304904+0000","last_clean":"2024-04-19T02:17:05.243076+0000","last_became_active":"2024-04-19T02:17:08.269760+0000","last_became_peered":"2024-04-19T02:17:08.269760+0000","last_unstale":"2024-04-19T02:17:58.304904+0000","last_undegraded":"2024-04-19T02:17:58.304904+0000","last_fullsized":"2024-04-19T02:17:08.244647+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:13:21.073708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:18:22.884167+0000","last_change":"2024-04-19T02:15:53.958876+0000","last_active":"2024-04-19T02:18:22.884167+0000","last_peered":"2024-04-19T02:18:22.884167+0000","last_clean":"2024-04-19T02:18:22.884167+0000","last_became_active":"2024-04-19T02:15:53.958626+0000","last_became_peered":"2024-04-19T02:15:53.958626+0000","last_unstale":"2024-04-19T02:18:22.884167+0000","last_undegraded":"2024-04-19T02:18:22.884167+0000","last_fullsized":"2024-04-19T02:18:22.884167+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:23:57.044018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":36,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.412316+0000","last_change":"2024-04-19T02:17:08.251031+0000","last_active":"2024-04-19T02:17:57.412316+0000","last_peered":"2024-04-19T02:17:57.412316+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"2024-04-19T02:17:08.251031+0000","last_became_peered":"2024-04-19T02:17:08.251031+0000","last_unstale":"2024-04-19T02:17:57.412316+0000","last_undegraded":"2024-04-19T02:17:57.412316+0000","last_fullsized":"2024-04-19T02:17:08.246599+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:05:08.818432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:17:58.305329+0000","last_change":"2024-04-19T02:15:29.284262+0000","last_active":"2024-04-19T02:17:58.305329+0000","last_peered":"2024-04-19T02:17:58.305329+0000","last_clean":"2024-04-19T02:17:58.305329+0000","last_became_active":"2024-04-19T02:15:29.283121+0000","last_became_peered":"2024-04-19T02:15:29.283121+0000","last_unstale":"2024-04-19T02:17:58.305329+0000","last_undegraded":"2024-04-19T02:17:58.305329+0000","last_fullsized":"2024-04-19T02:17:58.305329+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:17:58.304348+0000","last_change":"2024-04-19T02:15:29.285139+0000","last_active":"2024-04-19T02:17:58.304348+0000","last_peered":"2024-04-19T02:17:58.304348+0000","last_clean":"2024-04-19T02:17:58.304348+0000","last_became_active":"2024-04-19T02:15:29.284649+0000","last_became_peered":"2024-04-19T02:15:29.284649+0000","last_unstale":"2024-04-19T02:17:58.304348+0000","last_undegraded":"2024-04-19T02:17:58.304348+0000","last_fullsized":"2024-04-19T02:17:58.304348+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":72,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:58.304233+0000","last_change":"2024-04-19T02:17:08.247963+0000","last_active":"2024-04-19T02:17:58.304233+0000","last_peered":"2024-04-19T02:17:58.304233+0000","last_clean":"2024-04-19T02:17:05.242424+0000","last_became_active":"2024-04-19T02:17:08.247963+0000","last_became_peered":"2024-04-19T02:17:08.247963+0000","last_unstale":"2024-04-19T02:17:58.304233+0000","last_undegraded":"2024-04-19T02:17:58.304233+0000","last_fullsized":"2024-04-19T02:17:08.244117+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:23:12.317985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":28,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.413101+0000","last_change":"2024-04-19T02:17:08.252165+0000","last_active":"2024-04-19T02:17:57.413101+0000","last_peered":"2024-04-19T02:17:57.413101+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"2024-04-19T02:17:08.252165+0000","last_became_peered":"2024-04-19T02:17:08.252165+0000","last_unstale":"2024-04-19T02:17:57.413101+0000","last_undegraded":"2024-04-19T02:17:57.413101+0000","last_fullsized":"2024-04-19T02:17:08.246840+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:55:21.340657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":71,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T02:17:56.957404+0000","last_change":"2024-04-19T02:17:08.276897+0000","last_active":"2024-04-19T02:17:56.957404+0000","last_peered":"2024-04-19T02:17:56.957404+0000","last_clean":"2024-04-19T02:17:05.242534+0000","last_became_active":"2024-04-19T02:17:08.276897+0000","last_became_peered":"2024-04-19T02:17:08.276897+0000","last_unstale":"2024-04-19T02:17:56.957404+0000","last_undegraded":"2024-04-19T02:17:56.957404+0000","last_fullsized":"2024-04-19T02:17:08.247739+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:29:03.356417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":28,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.412583+0000","last_change":"2024-04-19T02:17:08.249381+0000","last_active":"2024-04-19T02:17:57.412583+0000","last_peered":"2024-04-19T02:17:57.412583+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"2024-04-19T02:17:08.249381+0000","last_became_peered":"2024-04-19T02:17:08.249381+0000","last_unstale":"2024-04-19T02:17:57.412583+0000","last_undegraded":"2024-04-19T02:17:57.412583+0000","last_fullsized":"2024-04-19T02:17:08.246108+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:47:28.015230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":72,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:58.305721+0000","last_change":"2024-04-19T02:17:08.268438+0000","last_active":"2024-04-19T02:17:58.305721+0000","last_peered":"2024-04-19T02:17:58.305721+0000","last_clean":"2024-04-19T02:17:05.243411+0000","last_became_active":"2024-04-19T02:17:08.268438+0000","last_became_peered":"2024-04-19T02:17:08.268438+0000","last_unstale":"2024-04-19T02:17:58.305721+0000","last_undegraded":"2024-04-19T02:17:58.305721+0000","last_fullsized":"2024-04-19T02:17:08.245009+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:04:47.722306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":72,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:58.304896+0000","last_change":"2024-04-19T02:17:08.247268+0000","last_active":"2024-04-19T02:17:58.304896+0000","last_peered":"2024-04-19T02:17:58.304896+0000","last_clean":"2024-04-19T02:17:05.242791+0000","last_became_active":"2024-04-19T02:17:08.247268+0000","last_became_peered":"2024-04-19T02:17:08.247268+0000","last_unstale":"2024-04-19T02:17:58.304896+0000","last_undegraded":"2024-04-19T02:17:58.304896+0000","last_fullsized":"2024-04-19T02:17:08.244056+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:29:38.153412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:18:12.882002+0000","last_change":"2024-04-19T02:15:53.955813+0000","last_active":"2024-04-19T02:18:12.882002+0000","last_peered":"2024-04-19T02:18:12.882002+0000","last_clean":"2024-04-19T02:18:12.882002+0000","last_became_active":"2024-04-19T02:15:53.955614+0000","last_became_peered":"2024-04-19T02:15:53.955614+0000","last_unstale":"2024-04-19T02:18:12.882002+0000","last_undegraded":"2024-04-19T02:18:12.882002+0000","last_fullsized":"2024-04-19T02:18:12.882002+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:58:03.192647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":29,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:19:22.894753+0000","last_change":"2024-04-19T02:17:08.250353+0000","last_active":"2024-04-19T02:19:22.894753+0000","last_peered":"2024-04-19T02:19:22.894753+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"2024-04-19T02:17:08.250353+0000","last_became_peered":"2024-04-19T02:17:08.250353+0000","last_unstale":"2024-04-19T02:19:22.894753+0000","last_undegraded":"2024-04-19T02:19:22.894753+0000","last_fullsized":"2024-04-19T02:17:08.244520+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:55:52.567911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":72,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.411802+0000","last_change":"2024-04-19T02:17:08.273062+0000","last_active":"2024-04-19T02:17:57.411802+0000","last_peered":"2024-04-19T02:17:57.411802+0000","last_clean":"2024-04-19T02:17:05.241057+0000","last_became_active":"2024-04-19T02:17:08.273062+0000","last_became_peered":"2024-04-19T02:17:08.273062+0000","last_unstale":"2024-04-19T02:17:57.411802+0000","last_undegraded":"2024-04-19T02:17:57.411802+0000","last_fullsized":"2024-04-19T02:17:08.246960+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:51:23.449528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:17:57.413590+0000","last_change":"2024-04-19T02:15:29.278084+0000","last_active":"2024-04-19T02:17:57.413590+0000","last_peered":"2024-04-19T02:17:57.413590+0000","last_clean":"2024-04-19T02:17:57.413590+0000","last_became_active":"2024-04-19T02:15:29.276952+0000","last_became_peered":"2024-04-19T02:15:29.276952+0000","last_unstale":"2024-04-19T02:17:57.413590+0000","last_undegraded":"2024-04-19T02:17:57.413590+0000","last_fullsized":"2024-04-19T02:17:57.413590+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":29,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:19:17.894154+0000","last_change":"2024-04-19T02:17:08.271656+0000","last_active":"2024-04-19T02:19:17.894154+0000","last_peered":"2024-04-19T02:19:17.894154+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"2024-04-19T02:17:08.271656+0000","last_became_peered":"2024-04-19T02:17:08.271656+0000","last_unstale":"2024-04-19T02:19:17.894154+0000","last_undegraded":"2024-04-19T02:19:17.894154+0000","last_fullsized":"2024-04-19T02:17:08.248162+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:12:53.493922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":68,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-19T02:19:52.900903+0000","last_change":"2024-04-19T02:15:29.287389+0000","last_active":"2024-04-19T02:19:52.900903+0000","last_peered":"2024-04-19T02:19:52.900903+0000","last_clean":"2024-04-19T02:19:52.900903+0000","last_became_active":"2024-04-19T02:15:29.286431+0000","last_became_peered":"2024-04-19T02:15:29.286431+0000","last_unstale":"2024-04-19T02:19:52.900903+0000","last_undegraded":"2024-04-19T02:19:52.900903+0000","last_fullsized":"2024-04-19T02:19:52.900903+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:58:30.117887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":38,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.412726+0000","last_change":"2024-04-19T02:17:08.273760+0000","last_active":"2024-04-19T02:17:57.412726+0000","last_peered":"2024-04-19T02:17:57.412726+0000","last_clean":"2024-04-19T02:15:32.744848+0000","last_became_active":"2024-04-19T02:17:08.273760+0000","last_became_peered":"2024-04-19T02:17:08.273760+0000","last_unstale":"2024-04-19T02:17:57.412726+0000","last_undegraded":"2024-04-19T02:17:57.412726+0000","last_fullsized":"2024-04-19T02:17:08.245550+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:55:05.703869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:17:57.412891+0000","last_change":"2024-04-19T02:15:29.281792+0000","last_active":"2024-04-19T02:17:57.412891+0000","last_peered":"2024-04-19T02:17:57.412891+0000","last_clean":"2024-04-19T02:17:57.412891+0000","last_became_active":"2024-04-19T02:15:29.280479+0000","last_became_peered":"2024-04-19T02:15:29.280479+0000","last_unstale":"2024-04-19T02:17:57.412891+0000","last_undegraded":"2024-04-19T02:17:57.412891+0000","last_fullsized":"2024-04-19T02:17:57.412891+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":29,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:19:32.896575+0000","last_change":"2024-04-19T02:17:08.246335+0000","last_active":"2024-04-19T02:19:32.896575+0000","last_peered":"2024-04-19T02:19:32.896575+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"2024-04-19T02:17:08.246335+0000","last_became_peered":"2024-04-19T02:17:08.246335+0000","last_unstale":"2024-04-19T02:19:32.896575+0000","last_undegraded":"2024-04-19T02:19:32.896575+0000","last_fullsized":"2024-04-19T02:17:08.243263+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:38:06.145320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:19:07.892176+0000","last_change":"2024-04-19T02:17:08.271424+0000","last_active":"2024-04-19T02:19:07.892176+0000","last_peered":"2024-04-19T02:19:07.892176+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"2024-04-19T02:17:08.271424+0000","last_became_peered":"2024-04-19T02:17:08.271424+0000","last_unstale":"2024-04-19T02:19:07.892176+0000","last_undegraded":"2024-04-19T02:19:07.892176+0000","last_fullsized":"2024-04-19T02:17:08.246990+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:07:26.618068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":28,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.411969+0000","last_change":"2024-04-19T02:17:08.273025+0000","last_active":"2024-04-19T02:17:57.411969+0000","last_peered":"2024-04-19T02:17:57.411969+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"2024-04-19T02:17:08.273025+0000","last_became_peered":"2024-04-19T02:17:08.273025+0000","last_unstale":"2024-04-19T02:17:57.411969+0000","last_undegraded":"2024-04-19T02:17:57.411969+0000","last_fullsized":"2024-04-19T02:17:08.246788+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:50:42.135073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:17:57.413322+0000","last_change":"2024-04-19T02:15:29.280879+0000","last_active":"2024-04-19T02:17:57.413322+0000","last_peered":"2024-04-19T02:17:57.413322+0000","last_clean":"2024-04-19T02:17:57.413322+0000","last_became_active":"2024-04-19T02:15:29.279314+0000","last_became_peered":"2024-04-19T02:15:29.279314+0000","last_unstale":"2024-04-19T02:17:57.413322+0000","last_undegraded":"2024-04-19T02:17:57.413322+0000","last_fullsized":"2024-04-19T02:17:57.413322+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:19:32.897011+0000","last_change":"2024-04-19T02:17:08.268616+0000","last_active":"2024-04-19T02:19:32.897011+0000","last_peered":"2024-04-19T02:19:32.897011+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"2024-04-19T02:17:08.268616+0000","last_became_peered":"2024-04-19T02:17:08.268616+0000","last_unstale":"2024-04-19T02:19:32.897011+0000","last_undegraded":"2024-04-19T02:19:32.897011+0000","last_fullsized":"2024-04-19T02:17:08.246088+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:05:20.777115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.411676+0000","last_change":"2024-04-19T02:17:08.272867+0000","last_active":"2024-04-19T02:17:57.411676+0000","last_peered":"2024-04-19T02:17:57.411676+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"2024-04-19T02:17:08.272867+0000","last_became_peered":"2024-04-19T02:17:08.272867+0000","last_unstale":"2024-04-19T02:17:57.411676+0000","last_undegraded":"2024-04-19T02:17:57.411676+0000","last_fullsized":"2024-04-19T02:17:08.245566+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:11:33.437440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":73,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:58.305005+0000","last_change":"2024-04-19T02:17:08.271157+0000","last_active":"2024-04-19T02:17:58.305005+0000","last_peered":"2024-04-19T02:17:58.305005+0000","last_clean":"2024-04-19T02:17:05.244228+0000","last_became_active":"2024-04-19T02:17:08.271157+0000","last_became_peered":"2024-04-19T02:17:08.271157+0000","last_unstale":"2024-04-19T02:17:58.305005+0000","last_undegraded":"2024-04-19T02:17:58.305005+0000","last_fullsized":"2024-04-19T02:17:08.244593+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:03:07.456211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:19:27.895700+0000","last_change":"2024-04-19T02:17:08.247975+0000","last_active":"2024-04-19T02:19:27.895700+0000","last_peered":"2024-04-19T02:19:27.895700+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"2024-04-19T02:17:08.247975+0000","last_became_peered":"2024-04-19T02:17:08.247975+0000","last_unstale":"2024-04-19T02:19:27.895700+0000","last_undegraded":"2024-04-19T02:19:27.895700+0000","last_fullsized":"2024-04-19T02:17:08.243666+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:33:09.476848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":70,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:17:57.412540+0000","last_change":"2024-04-19T02:15:28.892937+0000","last_active":"2024-04-19T02:17:57.412540+0000","last_peered":"2024-04-19T02:17:57.412540+0000","last_clean":"2024-04-19T02:17:57.412540+0000","last_became_active":"2024-04-19T02:15:28.891440+0000","last_became_peered":"2024-04-19T02:15:28.891440+0000","last_unstale":"2024-04-19T02:17:57.412540+0000","last_undegraded":"2024-04-19T02:17:57.412540+0000","last_fullsized":"2024-04-19T02:17:57.412540+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.411983+0000","last_change":"2024-04-19T02:17:08.248960+0000","last_active":"2024-04-19T02:17:57.411983+0000","last_peered":"2024-04-19T02:17:57.411983+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"2024-04-19T02:17:08.248960+0000","last_became_peered":"2024-04-19T02:17:08.248960+0000","last_unstale":"2024-04-19T02:17:57.411983+0000","last_undegraded":"2024-04-19T02:17:57.411983+0000","last_fullsized":"2024-04-19T02:17:08.245252+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:12:24.821888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":74,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:17:58.305631+0000","last_change":"2024-04-19T02:15:28.891097+0000","last_active":"2024-04-19T02:17:58.305631+0000","last_peered":"2024-04-19T02:17:58.305631+0000","last_clean":"2024-04-19T02:17:58.305631+0000","last_became_active":"2024-04-19T02:15:28.890795+0000","last_became_peered":"2024-04-19T02:15:28.890795+0000","last_unstale":"2024-04-19T02:17:58.305631+0000","last_undegraded":"2024-04-19T02:17:58.305631+0000","last_fullsized":"2024-04-19T02:17:58.305631+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:17:58.305355+0000","last_change":"2024-04-19T02:15:29.278546+0000","last_active":"2024-04-19T02:17:58.305355+0000","last_peered":"2024-04-19T02:17:58.305355+0000","last_clean":"2024-04-19T02:17:58.305355+0000","last_became_active":"2024-04-19T02:15:29.277547+0000","last_became_peered":"2024-04-19T02:15:29.277547+0000","last_unstale":"2024-04-19T02:17:58.305355+0000","last_undegraded":"2024-04-19T02:17:58.305355+0000","last_fullsized":"2024-04-19T02:17:58.305355+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":75,"reported_epoch":70,"state":"active+undersized+degraded","last_fresh":"2024-04-19T02:17:58.305600+0000","last_change":"2024-04-19T02:17:08.249098+0000","last_active":"2024-04-19T02:17:58.305600+0000","last_peered":"2024-04-19T02:17:58.305600+0000","last_clean":"2024-04-19T02:17:05.242975+0000","last_became_active":"2024-04-19T02:17:08.249098+0000","last_became_peered":"2024-04-19T02:17:08.249098+0000","last_unstale":"2024-04-19T02:17:58.305600+0000","last_undegraded":"2024-04-19T02:17:08.244999+0000","last_fullsized":"2024-04-19T02:17:08.244918+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:13:44.153719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":2}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":36,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T02:17:56.957017+0000","last_change":"2024-04-19T02:17:08.251935+0000","last_active":"2024-04-19T02:17:56.957017+0000","last_peered":"2024-04-19T02:17:56.957017+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"2024-04-19T02:17:08.251935+0000","last_became_peered":"2024-04-19T02:17:08.251935+0000","last_unstale":"2024-04-19T02:17:56.957017+0000","last_undegraded":"2024-04-19T02:17:56.957017+0000","last_fullsized":"2024-04-19T02:17:08.246752+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:24:02.223119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:19:27.895757+0000","last_change":"2024-04-19T02:17:08.271940+0000","last_active":"2024-04-19T02:19:27.895757+0000","last_peered":"2024-04-19T02:19:27.895757+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"2024-04-19T02:17:08.271940+0000","last_became_peered":"2024-04-19T02:17:08.271940+0000","last_unstale":"2024-04-19T02:19:27.895757+0000","last_undegraded":"2024-04-19T02:19:27.895757+0000","last_fullsized":"2024-04-19T02:17:08.244098+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:29:37.809349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":36,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.412850+0000","last_change":"2024-04-19T02:17:08.251192+0000","last_active":"2024-04-19T02:17:57.412850+0000","last_peered":"2024-04-19T02:17:57.412850+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"2024-04-19T02:17:08.251192+0000","last_became_peered":"2024-04-19T02:17:08.251192+0000","last_unstale":"2024-04-19T02:17:57.412850+0000","last_undegraded":"2024-04-19T02:17:57.412850+0000","last_fullsized":"2024-04-19T02:17:08.247120+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:31:35.674479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":67,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-19T02:17:56.956303+0000","last_change":"2024-04-19T02:15:28.892934+0000","last_active":"2024-04-19T02:17:56.956303+0000","last_peered":"2024-04-19T02:17:56.956303+0000","last_clean":"2024-04-19T02:17:56.956303+0000","last_became_active":"2024-04-19T02:15:28.891879+0000","last_became_peered":"2024-04-19T02:15:28.891879+0000","last_unstale":"2024-04-19T02:17:56.956303+0000","last_undegraded":"2024-04-19T02:17:56.956303+0000","last_fullsized":"2024-04-19T02:17:56.956303+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:10:12.514798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:19:32.896871+0000","last_change":"2024-04-19T02:17:08.271535+0000","last_active":"2024-04-19T02:19:32.896871+0000","last_peered":"2024-04-19T02:19:32.896871+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"2024-04-19T02:17:08.271535+0000","last_became_peered":"2024-04-19T02:17:08.271535+0000","last_unstale":"2024-04-19T02:19:32.896871+0000","last_undegraded":"2024-04-19T02:19:32.896871+0000","last_fullsized":"2024-04-19T02:17:08.247235+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:11:21.094945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":76,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:17:58.304689+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:17:58.304689+0000","last_peered":"2024-04-19T02:17:58.304689+0000","last_clean":"2024-04-19T02:17:58.304689+0000","last_became_active":"2024-04-19T02:15:28.890882+0000","last_became_peered":"2024-04-19T02:15:28.890882+0000","last_unstale":"2024-04-19T02:17:58.304689+0000","last_undegraded":"2024-04-19T02:17:58.304689+0000","last_fullsized":"2024-04-19T02:17:58.304689+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:31.673938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:19:32.896941+0000","last_change":"2024-04-19T02:17:08.268502+0000","last_active":"2024-04-19T02:19:32.896941+0000","last_peered":"2024-04-19T02:19:32.896941+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"2024-04-19T02:17:08.268502+0000","last_became_peered":"2024-04-19T02:17:08.268502+0000","last_unstale":"2024-04-19T02:19:32.896941+0000","last_undegraded":"2024-04-19T02:19:32.896941+0000","last_fullsized":"2024-04-19T02:17:08.244786+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:49:10.887498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":69,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:17:58.305552+0000","last_change":"2024-04-19T02:15:28.890265+0000","last_active":"2024-04-19T02:17:58.305552+0000","last_peered":"2024-04-19T02:17:58.305552+0000","last_clean":"2024-04-19T02:17:58.305552+0000","last_became_active":"2024-04-19T02:15:28.890004+0000","last_became_peered":"2024-04-19T02:15:28.890004+0000","last_unstale":"2024-04-19T02:17:58.305552+0000","last_undegraded":"2024-04-19T02:17:58.305552+0000","last_fullsized":"2024-04-19T02:17:58.305552+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:02.517101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:17:57.411586+0000","last_change":"2024-04-19T02:15:29.285529+0000","last_active":"2024-04-19T02:17:57.411586+0000","last_peered":"2024-04-19T02:17:57.411586+0000","last_clean":"2024-04-19T02:17:57.411586+0000","last_became_active":"2024-04-19T02:15:29.285197+0000","last_became_peered":"2024-04-19T02:15:29.285197+0000","last_unstale":"2024-04-19T02:17:57.411586+0000","last_undegraded":"2024-04-19T02:17:57.411586+0000","last_fullsized":"2024-04-19T02:17:57.411586+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":69,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-19T02:17:56.957061+0000","last_change":"2024-04-19T02:15:28.893902+0000","last_active":"2024-04-19T02:17:56.957061+0000","last_peered":"2024-04-19T02:17:56.957061+0000","last_clean":"2024-04-19T02:17:56.957061+0000","last_became_active":"2024-04-19T02:15:28.893231+0000","last_became_peered":"2024-04-19T02:15:28.893231+0000","last_unstale":"2024-04-19T02:17:56.957061+0000","last_undegraded":"2024-04-19T02:17:56.957061+0000","last_fullsized":"2024-04-19T02:17:56.957061+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:23.658442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":72,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.412005+0000","last_change":"2024-04-19T02:17:08.274053+0000","last_active":"2024-04-19T02:17:57.412005+0000","last_peered":"2024-04-19T02:17:57.412005+0000","last_clean":"2024-04-19T02:17:05.241098+0000","last_became_active":"2024-04-19T02:17:08.274053+0000","last_became_peered":"2024-04-19T02:17:08.274053+0000","last_unstale":"2024-04-19T02:17:57.412005+0000","last_undegraded":"2024-04-19T02:17:57.412005+0000","last_fullsized":"2024-04-19T02:17:08.245689+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:52:12.240640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":69,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:17:58.305089+0000","last_change":"2024-04-19T02:15:28.891234+0000","last_active":"2024-04-19T02:17:58.305089+0000","last_peered":"2024-04-19T02:17:58.305089+0000","last_clean":"2024-04-19T02:17:58.305089+0000","last_became_active":"2024-04-19T02:15:28.890881+0000","last_became_peered":"2024-04-19T02:15:28.890881+0000","last_unstale":"2024-04-19T02:17:58.305089+0000","last_undegraded":"2024-04-19T02:17:58.305089+0000","last_fullsized":"2024-04-19T02:17:58.305089+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":73,"reported_epoch":71,"state":"active+undersized","last_fresh":"2024-04-19T02:19:52.900539+0000","last_change":"2024-04-19T02:17:08.272125+0000","last_active":"2024-04-19T02:19:52.900539+0000","last_peered":"2024-04-19T02:19:52.900539+0000","last_clean":"2024-04-19T02:17:05.242643+0000","last_became_active":"2024-04-19T02:17:08.272125+0000","last_became_peered":"2024-04-19T02:17:08.272125+0000","last_unstale":"2024-04-19T02:19:52.900539+0000","last_undegraded":"2024-04-19T02:19:52.900539+0000","last_fullsized":"2024-04-19T02:17:08.244067+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:11:15.438599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":73,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:58.304889+0000","last_change":"2024-04-19T02:17:08.268003+0000","last_active":"2024-04-19T02:17:58.304889+0000","last_peered":"2024-04-19T02:17:58.304889+0000","last_clean":"2024-04-19T02:17:05.242977+0000","last_became_active":"2024-04-19T02:17:08.268003+0000","last_became_peered":"2024-04-19T02:17:08.268003+0000","last_unstale":"2024-04-19T02:17:58.304889+0000","last_undegraded":"2024-04-19T02:17:58.304889+0000","last_fullsized":"2024-04-19T02:17:08.243977+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:33:08.605872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:19:22.894820+0000","last_change":"2024-04-19T02:17:08.245918+0000","last_active":"2024-04-19T02:19:22.894820+0000","last_peered":"2024-04-19T02:19:22.894820+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"2024-04-19T02:17:08.245918+0000","last_became_peered":"2024-04-19T02:17:08.245918+0000","last_unstale":"2024-04-19T02:19:22.894820+0000","last_undegraded":"2024-04-19T02:19:22.894820+0000","last_fullsized":"2024-04-19T02:17:08.243179+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:55:47.759981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":37,"reported_epoch":70,"state":"active+undersized+degraded","last_fresh":"2024-04-19T02:19:22.894844+0000","last_change":"2024-04-19T02:17:08.247033+0000","last_active":"2024-04-19T02:19:22.894844+0000","last_peered":"2024-04-19T02:19:22.894844+0000","last_clean":"2024-04-19T02:15:29.268663+0000","last_became_active":"2024-04-19T02:17:08.247033+0000","last_became_peered":"2024-04-19T02:17:08.247033+0000","last_unstale":"2024-04-19T02:19:22.894844+0000","last_undegraded":"2024-04-19T02:17:08.243532+0000","last_fullsized":"2024-04-19T02:17:08.243359+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:05:19.095959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":72,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:58.305114+0000","last_change":"2024-04-19T02:17:08.267908+0000","last_active":"2024-04-19T02:17:58.305114+0000","last_peered":"2024-04-19T02:17:58.305114+0000","last_clean":"2024-04-19T02:17:05.243065+0000","last_became_active":"2024-04-19T02:17:08.267908+0000","last_became_peered":"2024-04-19T02:17:08.267908+0000","last_unstale":"2024-04-19T02:17:58.305114+0000","last_undegraded":"2024-04-19T02:17:58.305114+0000","last_fullsized":"2024-04-19T02:17:08.244138+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:45.577736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":74,"reported_epoch":71,"state":"active+undersized","last_fresh":"2024-04-19T02:19:52.900351+0000","last_change":"2024-04-19T02:17:08.271559+0000","last_active":"2024-04-19T02:19:52.900351+0000","last_peered":"2024-04-19T02:19:52.900351+0000","last_clean":"2024-04-19T02:17:05.242553+0000","last_became_active":"2024-04-19T02:17:08.271559+0000","last_became_peered":"2024-04-19T02:17:08.271559+0000","last_unstale":"2024-04-19T02:19:52.900351+0000","last_undegraded":"2024-04-19T02:19:52.900351+0000","last_fullsized":"2024-04-19T02:17:08.243664+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:20:16.355189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:17:58.305635+0000","last_change":"2024-04-19T02:15:29.285019+0000","last_active":"2024-04-19T02:17:58.305635+0000","last_peered":"2024-04-19T02:17:58.305635+0000","last_clean":"2024-04-19T02:17:58.305635+0000","last_became_active":"2024-04-19T02:15:29.284650+0000","last_became_peered":"2024-04-19T02:15:29.284650+0000","last_unstale":"2024-04-19T02:17:58.305635+0000","last_undegraded":"2024-04-19T02:17:58.305635+0000","last_fullsized":"2024-04-19T02:17:58.305635+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:18:07.881112+0000","last_change":"2024-04-19T02:15:53.956839+0000","last_active":"2024-04-19T02:18:07.881112+0000","last_peered":"2024-04-19T02:18:07.881112+0000","last_clean":"2024-04-19T02:18:07.881112+0000","last_became_active":"2024-04-19T02:15:53.956630+0000","last_became_peered":"2024-04-19T02:15:53.956630+0000","last_unstale":"2024-04-19T02:18:07.881112+0000","last_undegraded":"2024-04-19T02:18:07.881112+0000","last_fullsized":"2024-04-19T02:18:07.881112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:47.229730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:17:58.305255+0000","last_change":"2024-04-19T02:15:29.287190+0000","last_active":"2024-04-19T02:17:58.305255+0000","last_peered":"2024-04-19T02:17:58.305255+0000","last_clean":"2024-04-19T02:17:58.305255+0000","last_became_active":"2024-04-19T02:15:29.286606+0000","last_became_peered":"2024-04-19T02:15:29.286606+0000","last_unstale":"2024-04-19T02:17:58.305255+0000","last_undegraded":"2024-04-19T02:17:58.305255+0000","last_fullsized":"2024-04-19T02:17:58.305255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:28.387062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":73,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.411792+0000","last_change":"2024-04-19T02:17:08.272832+0000","last_active":"2024-04-19T02:17:57.411792+0000","last_peered":"2024-04-19T02:17:57.411792+0000","last_clean":"2024-04-19T02:17:05.241224+0000","last_became_active":"2024-04-19T02:17:08.272832+0000","last_became_peered":"2024-04-19T02:17:08.272832+0000","last_unstale":"2024-04-19T02:17:57.411792+0000","last_undegraded":"2024-04-19T02:17:57.411792+0000","last_fullsized":"2024-04-19T02:17:08.246247+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:01:49.734528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.412739+0000","last_change":"2024-04-19T02:17:08.251223+0000","last_active":"2024-04-19T02:17:57.412739+0000","last_peered":"2024-04-19T02:17:57.412739+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"2024-04-19T02:17:08.251223+0000","last_became_peered":"2024-04-19T02:17:08.251223+0000","last_unstale":"2024-04-19T02:17:57.412739+0000","last_undegraded":"2024-04-19T02:17:57.412739+0000","last_fullsized":"2024-04-19T02:17:08.246317+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:08:19.926904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.412630+0000","last_change":"2024-04-19T02:17:08.249349+0000","last_active":"2024-04-19T02:17:57.412630+0000","last_peered":"2024-04-19T02:17:57.412630+0000","last_clean":"2024-04-19T02:15:23.520722+0000","last_became_active":"2024-04-19T02:17:08.249349+0000","last_became_peered":"2024-04-19T02:17:08.249349+0000","last_unstale":"2024-04-19T02:17:57.412630+0000","last_undegraded":"2024-04-19T02:17:57.412630+0000","last_fullsized":"2024-04-19T02:17:08.245938+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:34:56.254808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":74,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:19:42.898780+0000","last_change":"2024-04-19T02:17:08.269956+0000","last_active":"2024-04-19T02:19:42.898780+0000","last_peered":"2024-04-19T02:19:42.898780+0000","last_clean":"2024-04-19T02:17:05.243236+0000","last_became_active":"2024-04-19T02:17:08.269956+0000","last_became_peered":"2024-04-19T02:17:08.269956+0000","last_unstale":"2024-04-19T02:19:42.898780+0000","last_undegraded":"2024-04-19T02:19:42.898780+0000","last_fullsized":"2024-04-19T02:17:08.246156+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:54:01.634624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:17:57.412374+0000","last_change":"2024-04-19T02:15:29.277922+0000","last_active":"2024-04-19T02:17:57.412374+0000","last_peered":"2024-04-19T02:17:57.412374+0000","last_clean":"2024-04-19T02:17:57.412374+0000","last_became_active":"2024-04-19T02:15:29.276968+0000","last_became_peered":"2024-04-19T02:15:29.276968+0000","last_unstale":"2024-04-19T02:17:57.412374+0000","last_undegraded":"2024-04-19T02:17:57.412374+0000","last_fullsized":"2024-04-19T02:17:57.412374+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":77,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:19:37.897750+0000","last_change":"2024-04-19T02:17:08.272310+0000","last_active":"2024-04-19T02:19:37.897750+0000","last_peered":"2024-04-19T02:19:37.897750+0000","last_clean":"2024-04-19T02:17:05.242730+0000","last_became_active":"2024-04-19T02:17:08.272310+0000","last_became_peered":"2024-04-19T02:17:08.272310+0000","last_unstale":"2024-04-19T02:19:37.897750+0000","last_undegraded":"2024-04-19T02:19:37.897750+0000","last_fullsized":"2024-04-19T02:17:08.245677+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:34:47.040883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":74,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:19:42.898685+0000","last_change":"2024-04-19T02:17:08.248208+0000","last_active":"2024-04-19T02:19:42.898685+0000","last_peered":"2024-04-19T02:19:42.898685+0000","last_clean":"2024-04-19T02:17:05.242882+0000","last_became_active":"2024-04-19T02:17:08.248208+0000","last_became_peered":"2024-04-19T02:17:08.248208+0000","last_unstale":"2024-04-19T02:19:42.898685+0000","last_undegraded":"2024-04-19T02:19:42.898685+0000","last_fullsized":"2024-04-19T02:17:08.244450+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:53:51.051776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.412218+0000","last_change":"2024-04-19T02:17:08.248118+0000","last_active":"2024-04-19T02:17:57.412218+0000","last_peered":"2024-04-19T02:17:57.412218+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"2024-04-19T02:17:08.248118+0000","last_became_peered":"2024-04-19T02:17:08.248118+0000","last_unstale":"2024-04-19T02:17:57.412218+0000","last_undegraded":"2024-04-19T02:17:57.412218+0000","last_fullsized":"2024-04-19T02:17:08.245404+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:55:18.433102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":28,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.411759+0000","last_change":"2024-04-19T02:17:08.273665+0000","last_active":"2024-04-19T02:17:57.411759+0000","last_peered":"2024-04-19T02:17:57.411759+0000","last_clean":"2024-04-19T02:15:23.520722+0000","last_became_active":"2024-04-19T02:17:08.273665+0000","last_became_peered":"2024-04-19T02:17:08.273665+0000","last_unstale":"2024-04-19T02:17:57.411759+0000","last_undegraded":"2024-04-19T02:17:57.411759+0000","last_fullsized":"2024-04-19T02:17:08.245393+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:38:59.543425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:17:58.304005+0000","last_change":"2024-04-19T02:15:53.956945+0000","last_active":"2024-04-19T02:17:58.304005+0000","last_peered":"2024-04-19T02:17:58.304005+0000","last_clean":"2024-04-19T02:17:58.304005+0000","last_became_active":"2024-04-19T02:15:53.956719+0000","last_became_peered":"2024-04-19T02:15:53.956719+0000","last_unstale":"2024-04-19T02:17:58.304005+0000","last_undegraded":"2024-04-19T02:17:58.304005+0000","last_fullsized":"2024-04-19T02:17:58.304005+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:00:37.754624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.412896+0000","last_change":"2024-04-19T02:17:08.249335+0000","last_active":"2024-04-19T02:17:57.412896+0000","last_peered":"2024-04-19T02:17:57.412896+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"2024-04-19T02:17:08.249335+0000","last_became_peered":"2024-04-19T02:17:08.249335+0000","last_unstale":"2024-04-19T02:17:57.412896+0000","last_undegraded":"2024-04-19T02:17:57.412896+0000","last_fullsized":"2024-04-19T02:17:08.246161+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:58:12.264389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":77,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:19:37.897804+0000","last_change":"2024-04-19T02:17:08.248900+0000","last_active":"2024-04-19T02:19:37.897804+0000","last_peered":"2024-04-19T02:19:37.897804+0000","last_clean":"2024-04-19T02:17:05.242935+0000","last_became_active":"2024-04-19T02:17:08.248900+0000","last_became_peered":"2024-04-19T02:17:08.248900+0000","last_unstale":"2024-04-19T02:19:37.897804+0000","last_undegraded":"2024-04-19T02:19:37.897804+0000","last_fullsized":"2024-04-19T02:17:08.244662+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:09:29.939894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":268,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:19:27.895638+0000","last_change":"2024-04-19T02:15:24.533634+0000","last_active":"2024-04-19T02:19:27.895638+0000","last_peered":"2024-04-19T02:19:27.895638+0000","last_clean":"2024-04-19T02:19:27.895638+0000","last_became_active":"2024-04-19T02:15:24.533420+0000","last_became_peered":"2024-04-19T02:15:24.533420+0000","last_unstale":"2024-04-19T02:19:27.895638+0000","last_undegraded":"2024-04-19T02:19:27.895638+0000","last_fullsized":"2024-04-19T02:19:27.895638+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":28,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.412022+0000","last_change":"2024-04-19T02:17:08.273853+0000","last_active":"2024-04-19T02:17:57.412022+0000","last_peered":"2024-04-19T02:17:57.412022+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"2024-04-19T02:17:08.273853+0000","last_became_peered":"2024-04-19T02:17:08.273853+0000","last_unstale":"2024-04-19T02:17:57.412022+0000","last_undegraded":"2024-04-19T02:17:57.412022+0000","last_fullsized":"2024-04-19T02:17:08.245505+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:40.956036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":68,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:19:42.898802+0000","last_change":"2024-04-19T02:15:29.285015+0000","last_active":"2024-04-19T02:19:42.898802+0000","last_peered":"2024-04-19T02:19:42.898802+0000","last_clean":"2024-04-19T02:19:42.898802+0000","last_became_active":"2024-04-19T02:15:29.284164+0000","last_became_peered":"2024-04-19T02:15:29.284164+0000","last_unstale":"2024-04-19T02:19:42.898802+0000","last_undegraded":"2024-04-19T02:19:42.898802+0000","last_fullsized":"2024-04-19T02:19:42.898802+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:36.987844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":72,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:19:27.895653+0000","last_change":"2024-04-19T02:15:24.533912+0000","last_active":"2024-04-19T02:19:27.895653+0000","last_peered":"2024-04-19T02:19:27.895653+0000","last_clean":"2024-04-19T02:19:27.895653+0000","last_became_active":"2024-04-19T02:15:24.533580+0000","last_became_peered":"2024-04-19T02:15:24.533580+0000","last_unstale":"2024-04-19T02:19:27.895653+0000","last_undegraded":"2024-04-19T02:19:27.895653+0000","last_fullsized":"2024-04-19T02:19:27.895653+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:45.045477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":29,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:19:12.892934+0000","last_change":"2024-04-19T02:17:08.250900+0000","last_active":"2024-04-19T02:19:12.892934+0000","last_peered":"2024-04-19T02:19:12.892934+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"2024-04-19T02:17:08.250900+0000","last_became_peered":"2024-04-19T02:17:08.250900+0000","last_unstale":"2024-04-19T02:19:12.892934+0000","last_undegraded":"2024-04-19T02:19:12.892934+0000","last_fullsized":"2024-04-19T02:17:08.243541+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:25:03.958757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":37,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.412969+0000","last_change":"2024-04-19T02:17:08.277110+0000","last_active":"2024-04-19T02:17:57.412969+0000","last_peered":"2024-04-19T02:17:57.412969+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"2024-04-19T02:17:08.277110+0000","last_became_peered":"2024-04-19T02:17:08.277110+0000","last_unstale":"2024-04-19T02:17:57.412969+0000","last_undegraded":"2024-04-19T02:17:57.412969+0000","last_fullsized":"2024-04-19T02:17:08.247082+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:53:04.153025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.412735+0000","last_change":"2024-04-19T02:17:08.250163+0000","last_active":"2024-04-19T02:17:57.412735+0000","last_peered":"2024-04-19T02:17:57.412735+0000","last_clean":"2024-04-19T02:15:23.520722+0000","last_became_active":"2024-04-19T02:17:08.250163+0000","last_became_peered":"2024-04-19T02:17:08.250163+0000","last_unstale":"2024-04-19T02:17:57.412735+0000","last_undegraded":"2024-04-19T02:17:57.412735+0000","last_fullsized":"2024-04-19T02:17:08.246805+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:01:19.061078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":28,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.413012+0000","last_change":"2024-04-19T02:17:08.250218+0000","last_active":"2024-04-19T02:17:57.413012+0000","last_peered":"2024-04-19T02:17:57.413012+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"2024-04-19T02:17:08.250218+0000","last_became_peered":"2024-04-19T02:17:08.250218+0000","last_unstale":"2024-04-19T02:17:57.413012+0000","last_undegraded":"2024-04-19T02:17:57.413012+0000","last_fullsized":"2024-04-19T02:17:08.246632+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:25:03.958757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:17:57.412094+0000","last_change":"2024-04-19T02:15:29.281694+0000","last_active":"2024-04-19T02:17:57.412094+0000","last_peered":"2024-04-19T02:17:57.412094+0000","last_clean":"2024-04-19T02:17:57.412094+0000","last_became_active":"2024-04-19T02:15:29.280519+0000","last_became_peered":"2024-04-19T02:15:29.280519+0000","last_unstale":"2024-04-19T02:17:57.412094+0000","last_undegraded":"2024-04-19T02:17:57.412094+0000","last_fullsized":"2024-04-19T02:17:57.412094+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:50.890545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":36,"reported_epoch":70,"state":"active+undersized+degraded","last_fresh":"2024-04-19T02:17:57.413158+0000","last_change":"2024-04-19T02:17:08.253036+0000","last_active":"2024-04-19T02:17:57.413158+0000","last_peered":"2024-04-19T02:17:57.413158+0000","last_clean":"2024-04-19T02:15:29.270101+0000","last_became_active":"2024-04-19T02:17:08.253036+0000","last_became_peered":"2024-04-19T02:17:08.253036+0000","last_unstale":"2024-04-19T02:17:57.413158+0000","last_undegraded":"2024-04-19T02:17:08.247826+0000","last_fullsized":"2024-04-19T02:17:08.247745+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:18:01.965629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":28,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.412620+0000","last_change":"2024-04-19T02:17:08.276428+0000","last_active":"2024-04-19T02:17:57.412620+0000","last_peered":"2024-04-19T02:17:57.412620+0000","last_clean":"2024-04-19T02:15:23.520722+0000","last_became_active":"2024-04-19T02:17:08.276428+0000","last_became_peered":"2024-04-19T02:17:08.276428+0000","last_unstale":"2024-04-19T02:17:57.412620+0000","last_undegraded":"2024-04-19T02:17:57.412620+0000","last_fullsized":"2024-04-19T02:17:08.246290+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:39:50.844751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:19:07.891712+0000","last_change":"2024-04-19T02:17:08.246759+0000","last_active":"2024-04-19T02:19:07.891712+0000","last_peered":"2024-04-19T02:19:07.891712+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"2024-04-19T02:17:08.246759+0000","last_became_peered":"2024-04-19T02:17:08.246759+0000","last_unstale":"2024-04-19T02:19:07.891712+0000","last_undegraded":"2024-04-19T02:19:07.891712+0000","last_fullsized":"2024-04-19T02:17:08.243046+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:39:14.603809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":72,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:19:47.899722+0000","last_change":"2024-04-19T02:15:24.533777+0000","last_active":"2024-04-19T02:19:47.899722+0000","last_peered":"2024-04-19T02:19:47.899722+0000","last_clean":"2024-04-19T02:19:47.899722+0000","last_became_active":"2024-04-19T02:15:24.533436+0000","last_became_peered":"2024-04-19T02:15:24.533436+0000","last_unstale":"2024-04-19T02:19:47.899722+0000","last_undegraded":"2024-04-19T02:19:47.899722+0000","last_fullsized":"2024-04-19T02:19:47.899722+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:53:25.922418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":39,"reported_epoch":70,"state":"active+undersized+degraded","last_fresh":"2024-04-19T02:19:17.894111+0000","last_change":"2024-04-19T02:17:08.271293+0000","last_active":"2024-04-19T02:19:17.894111+0000","last_peered":"2024-04-19T02:19:17.894111+0000","last_clean":"2024-04-19T02:15:32.743668+0000","last_became_active":"2024-04-19T02:17:08.271293+0000","last_became_peered":"2024-04-19T02:17:08.271293+0000","last_unstale":"2024-04-19T02:19:17.894111+0000","last_undegraded":"2024-04-19T02:17:08.246338+0000","last_fullsized":"2024-04-19T02:17:08.246271+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:05:07.808901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:17:57.411955+0000","last_change":"2024-04-19T02:15:29.282244+0000","last_active":"2024-04-19T02:17:57.411955+0000","last_peered":"2024-04-19T02:17:57.411955+0000","last_clean":"2024-04-19T02:17:57.411955+0000","last_became_active":"2024-04-19T02:15:29.280366+0000","last_became_peered":"2024-04-19T02:15:29.280366+0000","last_unstale":"2024-04-19T02:17:57.411955+0000","last_undegraded":"2024-04-19T02:17:57.411955+0000","last_fullsized":"2024-04-19T02:17:57.411955+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":68,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:17:57.412359+0000","last_change":"2024-04-19T02:15:28.893027+0000","last_active":"2024-04-19T02:17:57.412359+0000","last_peered":"2024-04-19T02:17:57.412359+0000","last_clean":"2024-04-19T02:17:57.412359+0000","last_became_active":"2024-04-19T02:15:28.892695+0000","last_became_peered":"2024-04-19T02:15:28.892695+0000","last_unstale":"2024-04-19T02:17:57.412359+0000","last_undegraded":"2024-04-19T02:17:57.412359+0000","last_fullsized":"2024-04-19T02:17:57.412359+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":71,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.413043+0000","last_change":"2024-04-19T02:17:08.252455+0000","last_active":"2024-04-19T02:17:57.413043+0000","last_peered":"2024-04-19T02:17:57.413043+0000","last_clean":"2024-04-19T02:17:05.241737+0000","last_became_active":"2024-04-19T02:17:08.252455+0000","last_became_peered":"2024-04-19T02:17:08.252455+0000","last_unstale":"2024-04-19T02:17:57.413043+0000","last_undegraded":"2024-04-19T02:17:57.413043+0000","last_fullsized":"2024-04-19T02:17:08.246906+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:45.577736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":75,"reported_epoch":70,"state":"active+undersized+degraded","last_fresh":"2024-04-19T02:18:02.880287+0000","last_change":"2024-04-19T02:17:08.268249+0000","last_active":"2024-04-19T02:18:02.880287+0000","last_peered":"2024-04-19T02:18:02.880287+0000","last_clean":"2024-04-19T02:17:05.243248+0000","last_became_active":"2024-04-19T02:17:08.268249+0000","last_became_peered":"2024-04-19T02:17:08.268249+0000","last_unstale":"2024-04-19T02:18:02.880287+0000","last_undegraded":"2024-04-19T02:17:08.244900+0000","last_fullsized":"2024-04-19T02:17:08.244818+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:36:22.626608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":72,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:18:02.880174+0000","last_change":"2024-04-19T02:17:08.250259+0000","last_active":"2024-04-19T02:18:02.880174+0000","last_peered":"2024-04-19T02:18:02.880174+0000","last_clean":"2024-04-19T02:17:05.242838+0000","last_became_active":"2024-04-19T02:17:08.250259+0000","last_became_peered":"2024-04-19T02:17:08.250259+0000","last_unstale":"2024-04-19T02:18:02.880174+0000","last_undegraded":"2024-04-19T02:18:02.880174+0000","last_fullsized":"2024-04-19T02:17:08.244139+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:45.234497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":69,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:17:57.412754+0000","last_change":"2024-04-19T02:15:28.893239+0000","last_active":"2024-04-19T02:17:57.412754+0000","last_peered":"2024-04-19T02:17:57.412754+0000","last_clean":"2024-04-19T02:17:57.412754+0000","last_became_active":"2024-04-19T02:15:28.892881+0000","last_became_peered":"2024-04-19T02:15:28.892881+0000","last_unstale":"2024-04-19T02:17:57.412754+0000","last_undegraded":"2024-04-19T02:17:57.412754+0000","last_fullsized":"2024-04-19T02:17:57.412754+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":72,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:18:02.880100+0000","last_change":"2024-04-19T02:17:08.271755+0000","last_active":"2024-04-19T02:18:02.880100+0000","last_peered":"2024-04-19T02:18:02.880100+0000","last_clean":"2024-04-19T02:17:05.242634+0000","last_became_active":"2024-04-19T02:17:08.271755+0000","last_became_peered":"2024-04-19T02:17:08.271755+0000","last_unstale":"2024-04-19T02:18:02.880100+0000","last_undegraded":"2024-04-19T02:18:02.880100+0000","last_fullsized":"2024-04-19T02:17:08.243858+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:41:25.978162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":28,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.412908+0000","last_change":"2024-04-19T02:17:08.276665+0000","last_active":"2024-04-19T02:17:57.412908+0000","last_peered":"2024-04-19T02:17:57.412908+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"2024-04-19T02:17:08.276665+0000","last_became_peered":"2024-04-19T02:17:08.276665+0000","last_unstale":"2024-04-19T02:17:57.412908+0000","last_undegraded":"2024-04-19T02:17:57.412908+0000","last_fullsized":"2024-04-19T02:17:08.246649+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:33:08.605872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":71,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.412100+0000","last_change":"2024-04-19T02:17:08.273888+0000","last_active":"2024-04-19T02:17:57.412100+0000","last_peered":"2024-04-19T02:17:57.412100+0000","last_clean":"2024-04-19T02:17:05.241177+0000","last_became_active":"2024-04-19T02:17:08.273888+0000","last_became_peered":"2024-04-19T02:17:08.273888+0000","last_unstale":"2024-04-19T02:17:57.412100+0000","last_undegraded":"2024-04-19T02:17:57.412100+0000","last_fullsized":"2024-04-19T02:17:08.245820+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:05:20.105489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":37,"reported_epoch":70,"state":"active+undersized+degraded","last_fresh":"2024-04-19T02:19:12.893254+0000","last_change":"2024-04-19T02:17:08.268361+0000","last_active":"2024-04-19T02:19:12.893254+0000","last_peered":"2024-04-19T02:19:12.893254+0000","last_clean":"2024-04-19T02:15:29.270373+0000","last_became_active":"2024-04-19T02:17:08.268361+0000","last_became_peered":"2024-04-19T02:17:08.268361+0000","last_unstale":"2024-04-19T02:19:12.893254+0000","last_undegraded":"2024-04-19T02:17:08.245942+0000","last_fullsized":"2024-04-19T02:17:08.245894+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:04:15.113717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":2}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":72,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:58.305083+0000","last_change":"2024-04-19T02:17:08.250320+0000","last_active":"2024-04-19T02:17:58.305083+0000","last_peered":"2024-04-19T02:17:58.305083+0000","last_clean":"2024-04-19T02:17:05.242683+0000","last_became_active":"2024-04-19T02:17:08.250320+0000","last_became_peered":"2024-04-19T02:17:08.250320+0000","last_unstale":"2024-04-19T02:17:58.305083+0000","last_undegraded":"2024-04-19T02:17:58.305083+0000","last_fullsized":"2024-04-19T02:17:08.244070+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:21:04.745747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":73,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:19:42.898548+0000","last_change":"2024-04-19T02:17:08.247018+0000","last_active":"2024-04-19T02:19:42.898548+0000","last_peered":"2024-04-19T02:19:42.898548+0000","last_clean":"2024-04-19T02:17:05.242628+0000","last_became_active":"2024-04-19T02:17:08.247018+0000","last_became_peered":"2024-04-19T02:17:08.247018+0000","last_unstale":"2024-04-19T02:19:42.898548+0000","last_undegraded":"2024-04-19T02:19:42.898548+0000","last_fullsized":"2024-04-19T02:17:08.243630+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:26:46.208581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":28,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.411786+0000","last_change":"2024-04-19T02:17:08.273452+0000","last_active":"2024-04-19T02:17:57.411786+0000","last_peered":"2024-04-19T02:17:57.411786+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"2024-04-19T02:17:08.273452+0000","last_became_peered":"2024-04-19T02:17:08.273452+0000","last_unstale":"2024-04-19T02:17:57.411786+0000","last_undegraded":"2024-04-19T02:17:57.411786+0000","last_fullsized":"2024-04-19T02:17:08.245252+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:11:21.094945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:18:02.880051+0000","last_change":"2024-04-19T02:15:53.955913+0000","last_active":"2024-04-19T02:18:02.880051+0000","last_peered":"2024-04-19T02:18:02.880051+0000","last_clean":"2024-04-19T02:18:02.880051+0000","last_became_active":"2024-04-19T02:15:53.955676+0000","last_became_peered":"2024-04-19T02:15:53.955676+0000","last_unstale":"2024-04-19T02:18:02.880051+0000","last_undegraded":"2024-04-19T02:18:02.880051+0000","last_fullsized":"2024-04-19T02:18:02.880051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:53:02.899902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":28,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.412542+0000","last_change":"2024-04-19T02:17:08.275752+0000","last_active":"2024-04-19T02:17:57.412542+0000","last_peered":"2024-04-19T02:17:57.412542+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"2024-04-19T02:17:08.275752+0000","last_became_peered":"2024-04-19T02:17:08.275752+0000","last_unstale":"2024-04-19T02:17:57.412542+0000","last_undegraded":"2024-04-19T02:17:57.412542+0000","last_fullsized":"2024-04-19T02:17:08.246701+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:21:04.745747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:17:57.413131+0000","last_change":"2024-04-19T02:15:29.277568+0000","last_active":"2024-04-19T02:17:57.413131+0000","last_peered":"2024-04-19T02:17:57.413131+0000","last_clean":"2024-04-19T02:17:57.413131+0000","last_became_active":"2024-04-19T02:15:29.276725+0000","last_became_peered":"2024-04-19T02:15:29.276725+0000","last_unstale":"2024-04-19T02:17:57.413131+0000","last_undegraded":"2024-04-19T02:17:57.413131+0000","last_fullsized":"2024-04-19T02:17:57.413131+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":84,"acting":84,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":8,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5254,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":43,"acting":43,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":10,"acting":10,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":0,"seq":1,"num_pgs":84,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5757800,"kb_used_data":5703968,"kb_used_omap":6,"kb_used_meta":53817,"kb_avail":88614040,"statfs":{"total":96636764160,"available":90740776960,"internally_reserved":0,"allocated":5840863232,"data_stored":5840511790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6848,"internal_metadata":55108928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},{"osd":0,"up_from":8,"seq":34359738425,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":275328,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":273918,"kb_avail":94096512,"statfs":{"total":96636764160,"available":96354828288,"internally_reserved":0,"allocated":1425408,"data_stored":896369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":280492486},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 02:19:26 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.371,"15min":0.316},"min":{"1min":0.29899999999999999,"5min":0.159,"15min":0.159},"max":{"1min":0.57499999999999996,"5min":4.4480000000000004,"15min":4.4480000000000004},"last":0.498},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.379,"15min":0.36599999999999999},"min":{"1min":0.29399999999999998,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.54800000000000004,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.47199999999999998}]},{"osd":2,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":2.1000000000000001,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":0.19500000000000001},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.25600000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738424,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303224,"kb_used_data":1384,"kb_used_omap":1,"kb_used_meta":301822,"kb_avail":94068616,"statfs":{"total":96636764160,"available":96326262784,"internally_reserved":0,"allocated":1417216,"data_stored":895753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":309066182},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:19:29 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.40600000000000003,"15min":0.376},"min":{"1min":0.32700000000000001,"5min":0.157,"15min":0.157},"max":{"1min":0.64900000000000002,"5min":1.794,"15min":1.794},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.38100000000000001,"15min":0.32400000000000001},"min":{"1min":0.37,"5min":0.16,"15min":0.16},"max":{"1min":0.63,"5min":2.411,"15min":2.411},"last":0.50900000000000001}]},{"osd":2,"last update":"Fri Apr 19 02:16:26 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.46899999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5254,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:19:57.284 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:19:57.647 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:19:57.649 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-04-19T02:19:57.658 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":208,"stamp":"2024-04-19T02:19:56.916211+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":8,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":139,"acting":139,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":223,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":6336352,"kb_used_data":5706744,"kb_used_omap":9,"kb_used_meta":629558,"kb_avail":276779168,"statfs":{"total":289910292480,"available":283421868032,"internally_reserved":0,"allocated":5843705856,"data_stored":5842303912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10036,"internal_metadata":644667596},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.022228"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":72,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.413697+0000","last_change":"2024-04-19T02:17:08.254203+0000","last_active":"2024-04-19T02:17:57.413697+0000","last_peered":"2024-04-19T02:17:57.413697+0000","last_clean":"2024-04-19T02:17:05.242795+0000","last_became_active":"2024-04-19T02:17:08.254203+0000","last_became_peered":"2024-04-19T02:17:08.254203+0000","last_unstale":"2024-04-19T02:17:57.413697+0000","last_undegraded":"2024-04-19T02:17:57.413697+0000","last_fullsized":"2024-04-19T02:17:08.248809+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:24:51.800321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":72,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.412527+0000","last_change":"2024-04-19T02:17:08.276229+0000","last_active":"2024-04-19T02:17:57.412527+0000","last_peered":"2024-04-19T02:17:57.412527+0000","last_clean":"2024-04-19T02:17:05.242326+0000","last_became_active":"2024-04-19T02:17:08.276229+0000","last_became_peered":"2024-04-19T02:17:08.276229+0000","last_unstale":"2024-04-19T02:17:57.412527+0000","last_undegraded":"2024-04-19T02:17:57.412527+0000","last_fullsized":"2024-04-19T02:17:08.246093+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:29:20.438000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":68,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:19:42.898771+0000","last_change":"2024-04-19T02:15:29.286709+0000","last_active":"2024-04-19T02:19:42.898771+0000","last_peered":"2024-04-19T02:19:42.898771+0000","last_clean":"2024-04-19T02:19:42.898771+0000","last_became_active":"2024-04-19T02:15:29.286169+0000","last_became_peered":"2024-04-19T02:15:29.286169+0000","last_unstale":"2024-04-19T02:19:42.898771+0000","last_undegraded":"2024-04-19T02:19:42.898771+0000","last_fullsized":"2024-04-19T02:19:42.898771+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:58.741466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":73,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:19:32.896739+0000","last_change":"2024-04-19T02:17:08.268240+0000","last_active":"2024-04-19T02:19:32.896739+0000","last_peered":"2024-04-19T02:19:32.896739+0000","last_clean":"2024-04-19T02:17:05.243491+0000","last_became_active":"2024-04-19T02:17:08.268240+0000","last_became_peered":"2024-04-19T02:17:08.268240+0000","last_unstale":"2024-04-19T02:19:32.896739+0000","last_undegraded":"2024-04-19T02:19:32.896739+0000","last_fullsized":"2024-04-19T02:17:08.245740+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:34.019094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":36,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.412046+0000","last_change":"2024-04-19T02:17:08.249154+0000","last_active":"2024-04-19T02:17:57.412046+0000","last_peered":"2024-04-19T02:17:57.412046+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"2024-04-19T02:17:08.249154+0000","last_became_peered":"2024-04-19T02:17:08.249154+0000","last_unstale":"2024-04-19T02:17:57.412046+0000","last_undegraded":"2024-04-19T02:17:57.412046+0000","last_fullsized":"2024-04-19T02:17:08.246028+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:14:33.199338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":72,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:18:02.880069+0000","last_change":"2024-04-19T02:17:08.271359+0000","last_active":"2024-04-19T02:18:02.880069+0000","last_peered":"2024-04-19T02:18:02.880069+0000","last_clean":"2024-04-19T02:17:05.242544+0000","last_became_active":"2024-04-19T02:17:08.271359+0000","last_became_peered":"2024-04-19T02:17:08.271359+0000","last_unstale":"2024-04-19T02:18:02.880069+0000","last_undegraded":"2024-04-19T02:18:02.880069+0000","last_fullsized":"2024-04-19T02:17:08.243605+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:40:34.647402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":72,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:18:02.879989+0000","last_change":"2024-04-19T02:17:08.246286+0000","last_active":"2024-04-19T02:18:02.879989+0000","last_peered":"2024-04-19T02:18:02.879989+0000","last_clean":"2024-04-19T02:17:05.242437+0000","last_became_active":"2024-04-19T02:17:08.246286+0000","last_became_peered":"2024-04-19T02:17:08.246286+0000","last_unstale":"2024-04-19T02:18:02.879989+0000","last_undegraded":"2024-04-19T02:18:02.879989+0000","last_fullsized":"2024-04-19T02:17:08.243188+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:29:03.356417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":72,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:18:02.879911+0000","last_change":"2024-04-19T02:17:08.246832+0000","last_active":"2024-04-19T02:18:02.879911+0000","last_peered":"2024-04-19T02:18:02.879911+0000","last_clean":"2024-04-19T02:17:05.242331+0000","last_became_active":"2024-04-19T02:17:08.246832+0000","last_became_peered":"2024-04-19T02:17:08.246832+0000","last_unstale":"2024-04-19T02:18:02.879911+0000","last_undegraded":"2024-04-19T02:18:02.879911+0000","last_fullsized":"2024-04-19T02:17:08.243064+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:55:18.433102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":28,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.413004+0000","last_change":"2024-04-19T02:17:08.250169+0000","last_active":"2024-04-19T02:17:57.413004+0000","last_peered":"2024-04-19T02:17:57.413004+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"2024-04-19T02:17:08.250169+0000","last_became_peered":"2024-04-19T02:17:08.250169+0000","last_unstale":"2024-04-19T02:17:57.413004+0000","last_undegraded":"2024-04-19T02:17:57.413004+0000","last_fullsized":"2024-04-19T02:17:08.246576+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:00:42.593407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":49,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:18:57.890025+0000","last_change":"2024-04-19T02:16:30.093524+0000","last_active":"2024-04-19T02:18:57.890025+0000","last_peered":"2024-04-19T02:18:57.890025+0000","last_clean":"2024-04-19T02:18:57.890025+0000","last_became_active":"2024-04-19T02:16:30.093344+0000","last_became_peered":"2024-04-19T02:16:30.093344+0000","last_unstale":"2024-04-19T02:18:57.890025+0000","last_undegraded":"2024-04-19T02:18:57.890025+0000","last_fullsized":"2024-04-19T02:18:57.890025+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:14:40.293159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":72,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:58.304904+0000","last_change":"2024-04-19T02:17:08.269760+0000","last_active":"2024-04-19T02:17:58.304904+0000","last_peered":"2024-04-19T02:17:58.304904+0000","last_clean":"2024-04-19T02:17:05.243076+0000","last_became_active":"2024-04-19T02:17:08.269760+0000","last_became_peered":"2024-04-19T02:17:08.269760+0000","last_unstale":"2024-04-19T02:17:58.304904+0000","last_undegraded":"2024-04-19T02:17:58.304904+0000","last_fullsized":"2024-04-19T02:17:08.244647+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:13:21.073708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:18:22.884167+0000","last_change":"2024-04-19T02:15:53.958876+0000","last_active":"2024-04-19T02:18:22.884167+0000","last_peered":"2024-04-19T02:18:22.884167+0000","last_clean":"2024-04-19T02:18:22.884167+0000","last_became_active":"2024-04-19T02:15:53.958626+0000","last_became_peered":"2024-04-19T02:15:53.958626+0000","last_unstale":"2024-04-19T02:18:22.884167+0000","last_undegraded":"2024-04-19T02:18:22.884167+0000","last_fullsized":"2024-04-19T02:18:22.884167+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:23:57.044018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":36,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.412316+0000","last_change":"2024-04-19T02:17:08.251031+0000","last_active":"2024-04-19T02:17:57.412316+0000","last_peered":"2024-04-19T02:17:57.412316+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"2024-04-19T02:17:08.251031+0000","last_became_peered":"2024-04-19T02:17:08.251031+0000","last_unstale":"2024-04-19T02:17:57.412316+0000","last_undegraded":"2024-04-19T02:17:57.412316+0000","last_fullsized":"2024-04-19T02:17:08.246599+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:05:08.818432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:17:58.305329+0000","last_change":"2024-04-19T02:15:29.284262+0000","last_active":"2024-04-19T02:17:58.305329+0000","last_peered":"2024-04-19T02:17:58.305329+0000","last_clean":"2024-04-19T02:17:58.305329+0000","last_became_active":"2024-04-19T02:15:29.283121+0000","last_became_peered":"2024-04-19T02:15:29.283121+0000","last_unstale":"2024-04-19T02:17:58.305329+0000","last_undegraded":"2024-04-19T02:17:58.305329+0000","last_fullsized":"2024-04-19T02:17:58.305329+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:17:58.304348+0000","last_change":"2024-04-19T02:15:29.285139+0000","last_active":"2024-04-19T02:17:58.304348+0000","last_peered":"2024-04-19T02:17:58.304348+0000","last_clean":"2024-04-19T02:17:58.304348+0000","last_became_active":"2024-04-19T02:15:29.284649+0000","last_became_peered":"2024-04-19T02:15:29.284649+0000","last_unstale":"2024-04-19T02:17:58.304348+0000","last_undegraded":"2024-04-19T02:17:58.304348+0000","last_fullsized":"2024-04-19T02:17:58.304348+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":72,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:58.304233+0000","last_change":"2024-04-19T02:17:08.247963+0000","last_active":"2024-04-19T02:17:58.304233+0000","last_peered":"2024-04-19T02:17:58.304233+0000","last_clean":"2024-04-19T02:17:05.242424+0000","last_became_active":"2024-04-19T02:17:08.247963+0000","last_became_peered":"2024-04-19T02:17:08.247963+0000","last_unstale":"2024-04-19T02:17:58.304233+0000","last_undegraded":"2024-04-19T02:17:58.304233+0000","last_fullsized":"2024-04-19T02:17:08.244117+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:23:12.317985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":28,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.413101+0000","last_change":"2024-04-19T02:17:08.252165+0000","last_active":"2024-04-19T02:17:57.413101+0000","last_peered":"2024-04-19T02:17:57.413101+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"2024-04-19T02:17:08.252165+0000","last_became_peered":"2024-04-19T02:17:08.252165+0000","last_unstale":"2024-04-19T02:17:57.413101+0000","last_undegraded":"2024-04-19T02:17:57.413101+0000","last_fullsized":"2024-04-19T02:17:08.246840+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:55:21.340657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":71,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T02:17:56.957404+0000","last_change":"2024-04-19T02:17:08.276897+0000","last_active":"2024-04-19T02:17:56.957404+0000","last_peered":"2024-04-19T02:17:56.957404+0000","last_clean":"2024-04-19T02:17:05.242534+0000","last_became_active":"2024-04-19T02:17:08.276897+0000","last_became_peered":"2024-04-19T02:17:08.276897+0000","last_unstale":"2024-04-19T02:17:56.957404+0000","last_undegraded":"2024-04-19T02:17:56.957404+0000","last_fullsized":"2024-04-19T02:17:08.247739+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:29:03.356417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":28,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.412583+0000","last_change":"2024-04-19T02:17:08.249381+0000","last_active":"2024-04-19T02:17:57.412583+0000","last_peered":"2024-04-19T02:17:57.412583+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"2024-04-19T02:17:08.249381+0000","last_became_peered":"2024-04-19T02:17:08.249381+0000","last_unstale":"2024-04-19T02:17:57.412583+0000","last_undegraded":"2024-04-19T02:17:57.412583+0000","last_fullsized":"2024-04-19T02:17:08.246108+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:47:28.015230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":72,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:58.305721+0000","last_change":"2024-04-19T02:17:08.268438+0000","last_active":"2024-04-19T02:17:58.305721+0000","last_peered":"2024-04-19T02:17:58.305721+0000","last_clean":"2024-04-19T02:17:05.243411+0000","last_became_active":"2024-04-19T02:17:08.268438+0000","last_became_peered":"2024-04-19T02:17:08.268438+0000","last_unstale":"2024-04-19T02:17:58.305721+0000","last_undegraded":"2024-04-19T02:17:58.305721+0000","last_fullsized":"2024-04-19T02:17:08.245009+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:04:47.722306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":72,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:58.304896+0000","last_change":"2024-04-19T02:17:08.247268+0000","last_active":"2024-04-19T02:17:58.304896+0000","last_peered":"2024-04-19T02:17:58.304896+0000","last_clean":"2024-04-19T02:17:05.242791+0000","last_became_active":"2024-04-19T02:17:08.247268+0000","last_became_peered":"2024-04-19T02:17:08.247268+0000","last_unstale":"2024-04-19T02:17:58.304896+0000","last_undegraded":"2024-04-19T02:17:58.304896+0000","last_fullsized":"2024-04-19T02:17:08.244056+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:29:38.153412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:18:12.882002+0000","last_change":"2024-04-19T02:15:53.955813+0000","last_active":"2024-04-19T02:18:12.882002+0000","last_peered":"2024-04-19T02:18:12.882002+0000","last_clean":"2024-04-19T02:18:12.882002+0000","last_became_active":"2024-04-19T02:15:53.955614+0000","last_became_peered":"2024-04-19T02:15:53.955614+0000","last_unstale":"2024-04-19T02:18:12.882002+0000","last_undegraded":"2024-04-19T02:18:12.882002+0000","last_fullsized":"2024-04-19T02:18:12.882002+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:58:03.192647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":29,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:19:22.894753+0000","last_change":"2024-04-19T02:17:08.250353+0000","last_active":"2024-04-19T02:19:22.894753+0000","last_peered":"2024-04-19T02:19:22.894753+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"2024-04-19T02:17:08.250353+0000","last_became_peered":"2024-04-19T02:17:08.250353+0000","last_unstale":"2024-04-19T02:19:22.894753+0000","last_undegraded":"2024-04-19T02:19:22.894753+0000","last_fullsized":"2024-04-19T02:17:08.244520+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:55:52.567911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":72,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.411802+0000","last_change":"2024-04-19T02:17:08.273062+0000","last_active":"2024-04-19T02:17:57.411802+0000","last_peered":"2024-04-19T02:17:57.411802+0000","last_clean":"2024-04-19T02:17:05.241057+0000","last_became_active":"2024-04-19T02:17:08.273062+0000","last_became_peered":"2024-04-19T02:17:08.273062+0000","last_unstale":"2024-04-19T02:17:57.411802+0000","last_undegraded":"2024-04-19T02:17:57.411802+0000","last_fullsized":"2024-04-19T02:17:08.246960+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:51:23.449528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:17:57.413590+0000","last_change":"2024-04-19T02:15:29.278084+0000","last_active":"2024-04-19T02:17:57.413590+0000","last_peered":"2024-04-19T02:17:57.413590+0000","last_clean":"2024-04-19T02:17:57.413590+0000","last_became_active":"2024-04-19T02:15:29.276952+0000","last_became_peered":"2024-04-19T02:15:29.276952+0000","last_unstale":"2024-04-19T02:17:57.413590+0000","last_undegraded":"2024-04-19T02:17:57.413590+0000","last_fullsized":"2024-04-19T02:17:57.413590+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":29,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:19:17.894154+0000","last_change":"2024-04-19T02:17:08.271656+0000","last_active":"2024-04-19T02:19:17.894154+0000","last_peered":"2024-04-19T02:19:17.894154+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"2024-04-19T02:17:08.271656+0000","last_became_peered":"2024-04-19T02:17:08.271656+0000","last_unstale":"2024-04-19T02:19:17.894154+0000","last_undegraded":"2024-04-19T02:19:17.894154+0000","last_fullsized":"2024-04-19T02:17:08.248162+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:12:53.493922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":68,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-19T02:19:52.900903+0000","last_change":"2024-04-19T02:15:29.287389+0000","last_active":"2024-04-19T02:19:52.900903+0000","last_peered":"2024-04-19T02:19:52.900903+0000","last_clean":"2024-04-19T02:19:52.900903+0000","last_became_active":"2024-04-19T02:15:29.286431+0000","last_became_peered":"2024-04-19T02:15:29.286431+0000","last_unstale":"2024-04-19T02:19:52.900903+0000","last_undegraded":"2024-04-19T02:19:52.900903+0000","last_fullsized":"2024-04-19T02:19:52.900903+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:58:30.117887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":38,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.412726+0000","last_change":"2024-04-19T02:17:08.273760+0000","last_active":"2024-04-19T02:17:57.412726+0000","last_peered":"2024-04-19T02:17:57.412726+0000","last_clean":"2024-04-19T02:15:32.744848+0000","last_became_active":"2024-04-19T02:17:08.273760+0000","last_became_peered":"2024-04-19T02:17:08.273760+0000","last_unstale":"2024-04-19T02:17:57.412726+0000","last_undegraded":"2024-04-19T02:17:57.412726+0000","last_fullsized":"2024-04-19T02:17:08.245550+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:55:05.703869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:17:57.412891+0000","last_change":"2024-04-19T02:15:29.281792+0000","last_active":"2024-04-19T02:17:57.412891+0000","last_peered":"2024-04-19T02:17:57.412891+0000","last_clean":"2024-04-19T02:17:57.412891+0000","last_became_active":"2024-04-19T02:15:29.280479+0000","last_became_peered":"2024-04-19T02:15:29.280479+0000","last_unstale":"2024-04-19T02:17:57.412891+0000","last_undegraded":"2024-04-19T02:17:57.412891+0000","last_fullsized":"2024-04-19T02:17:57.412891+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":29,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:19:32.896575+0000","last_change":"2024-04-19T02:17:08.246335+0000","last_active":"2024-04-19T02:19:32.896575+0000","last_peered":"2024-04-19T02:19:32.896575+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"2024-04-19T02:17:08.246335+0000","last_became_peered":"2024-04-19T02:17:08.246335+0000","last_unstale":"2024-04-19T02:19:32.896575+0000","last_undegraded":"2024-04-19T02:19:32.896575+0000","last_fullsized":"2024-04-19T02:17:08.243263+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:38:06.145320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:19:07.892176+0000","last_change":"2024-04-19T02:17:08.271424+0000","last_active":"2024-04-19T02:19:07.892176+0000","last_peered":"2024-04-19T02:19:07.892176+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"2024-04-19T02:17:08.271424+0000","last_became_peered":"2024-04-19T02:17:08.271424+0000","last_unstale":"2024-04-19T02:19:07.892176+0000","last_undegraded":"2024-04-19T02:19:07.892176+0000","last_fullsized":"2024-04-19T02:17:08.246990+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:07:26.618068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":28,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.411969+0000","last_change":"2024-04-19T02:17:08.273025+0000","last_active":"2024-04-19T02:17:57.411969+0000","last_peered":"2024-04-19T02:17:57.411969+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"2024-04-19T02:17:08.273025+0000","last_became_peered":"2024-04-19T02:17:08.273025+0000","last_unstale":"2024-04-19T02:17:57.411969+0000","last_undegraded":"2024-04-19T02:17:57.411969+0000","last_fullsized":"2024-04-19T02:17:08.246788+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:50:42.135073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:17:57.413322+0000","last_change":"2024-04-19T02:15:29.280879+0000","last_active":"2024-04-19T02:17:57.413322+0000","last_peered":"2024-04-19T02:17:57.413322+0000","last_clean":"2024-04-19T02:17:57.413322+0000","last_became_active":"2024-04-19T02:15:29.279314+0000","last_became_peered":"2024-04-19T02:15:29.279314+0000","last_unstale":"2024-04-19T02:17:57.413322+0000","last_undegraded":"2024-04-19T02:17:57.413322+0000","last_fullsized":"2024-04-19T02:17:57.413322+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:19:32.897011+0000","last_change":"2024-04-19T02:17:08.268616+0000","last_active":"2024-04-19T02:19:32.897011+0000","last_peered":"2024-04-19T02:19:32.897011+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"2024-04-19T02:17:08.268616+0000","last_became_peered":"2024-04-19T02:17:08.268616+0000","last_unstale":"2024-04-19T02:19:32.897011+0000","last_undegraded":"2024-04-19T02:19:32.897011+0000","last_fullsized":"2024-04-19T02:17:08.246088+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:05:20.777115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.411676+0000","last_change":"2024-04-19T02:17:08.272867+0000","last_active":"2024-04-19T02:17:57.411676+0000","last_peered":"2024-04-19T02:17:57.411676+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"2024-04-19T02:17:08.272867+0000","last_became_peered":"2024-04-19T02:17:08.272867+0000","last_unstale":"2024-04-19T02:17:57.411676+0000","last_undegraded":"2024-04-19T02:17:57.411676+0000","last_fullsized":"2024-04-19T02:17:08.245566+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:11:33.437440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":73,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:58.305005+0000","last_change":"2024-04-19T02:17:08.271157+0000","last_active":"2024-04-19T02:17:58.305005+0000","last_peered":"2024-04-19T02:17:58.305005+0000","last_clean":"2024-04-19T02:17:05.244228+0000","last_became_active":"2024-04-19T02:17:08.271157+0000","last_became_peered":"2024-04-19T02:17:08.271157+0000","last_unstale":"2024-04-19T02:17:58.305005+0000","last_undegraded":"2024-04-19T02:17:58.305005+0000","last_fullsized":"2024-04-19T02:17:08.244593+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:03:07.456211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:19:27.895700+0000","last_change":"2024-04-19T02:17:08.247975+0000","last_active":"2024-04-19T02:19:27.895700+0000","last_peered":"2024-04-19T02:19:27.895700+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"2024-04-19T02:17:08.247975+0000","last_became_peered":"2024-04-19T02:17:08.247975+0000","last_unstale":"2024-04-19T02:19:27.895700+0000","last_undegraded":"2024-04-19T02:19:27.895700+0000","last_fullsized":"2024-04-19T02:17:08.243666+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:33:09.476848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":70,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:17:57.412540+0000","last_change":"2024-04-19T02:15:28.892937+0000","last_active":"2024-04-19T02:17:57.412540+0000","last_peered":"2024-04-19T02:17:57.412540+0000","last_clean":"2024-04-19T02:17:57.412540+0000","last_became_active":"2024-04-19T02:15:28.891440+0000","last_became_peered":"2024-04-19T02:15:28.891440+0000","last_unstale":"2024-04-19T02:17:57.412540+0000","last_undegraded":"2024-04-19T02:17:57.412540+0000","last_fullsized":"2024-04-19T02:17:57.412540+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.411983+0000","last_change":"2024-04-19T02:17:08.248960+0000","last_active":"2024-04-19T02:17:57.411983+0000","last_peered":"2024-04-19T02:17:57.411983+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"2024-04-19T02:17:08.248960+0000","last_became_peered":"2024-04-19T02:17:08.248960+0000","last_unstale":"2024-04-19T02:17:57.411983+0000","last_undegraded":"2024-04-19T02:17:57.411983+0000","last_fullsized":"2024-04-19T02:17:08.245252+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:12:24.821888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":74,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:17:58.305631+0000","last_change":"2024-04-19T02:15:28.891097+0000","last_active":"2024-04-19T02:17:58.305631+0000","last_peered":"2024-04-19T02:17:58.305631+0000","last_clean":"2024-04-19T02:17:58.305631+0000","last_became_active":"2024-04-19T02:15:28.890795+0000","last_became_peered":"2024-04-19T02:15:28.890795+0000","last_unstale":"2024-04-19T02:17:58.305631+0000","last_undegraded":"2024-04-19T02:17:58.305631+0000","last_fullsized":"2024-04-19T02:17:58.305631+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:17:58.305355+0000","last_change":"2024-04-19T02:15:29.278546+0000","last_active":"2024-04-19T02:17:58.305355+0000","last_peered":"2024-04-19T02:17:58.305355+0000","last_clean":"2024-04-19T02:17:58.305355+0000","last_became_active":"2024-04-19T02:15:29.277547+0000","last_became_peered":"2024-04-19T02:15:29.277547+0000","last_unstale":"2024-04-19T02:17:58.305355+0000","last_undegraded":"2024-04-19T02:17:58.305355+0000","last_fullsized":"2024-04-19T02:17:58.305355+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":75,"reported_epoch":70,"state":"active+undersized+degraded","last_fresh":"2024-04-19T02:17:58.305600+0000","last_change":"2024-04-19T02:17:08.249098+0000","last_active":"2024-04-19T02:17:58.305600+0000","last_peered":"2024-04-19T02:17:58.305600+0000","last_clean":"2024-04-19T02:17:05.242975+0000","last_became_active":"2024-04-19T02:17:08.249098+0000","last_became_peered":"2024-04-19T02:17:08.249098+0000","last_unstale":"2024-04-19T02:17:58.305600+0000","last_undegraded":"2024-04-19T02:17:08.244999+0000","last_fullsized":"2024-04-19T02:17:08.244918+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:13:44.153719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":2}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":36,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T02:17:56.957017+0000","last_change":"2024-04-19T02:17:08.251935+0000","last_active":"2024-04-19T02:17:56.957017+0000","last_peered":"2024-04-19T02:17:56.957017+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"2024-04-19T02:17:08.251935+0000","last_became_peered":"2024-04-19T02:17:08.251935+0000","last_unstale":"2024-04-19T02:17:56.957017+0000","last_undegraded":"2024-04-19T02:17:56.957017+0000","last_fullsized":"2024-04-19T02:17:08.246752+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:24:02.223119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:19:27.895757+0000","last_change":"2024-04-19T02:17:08.271940+0000","last_active":"2024-04-19T02:19:27.895757+0000","last_peered":"2024-04-19T02:19:27.895757+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"2024-04-19T02:17:08.271940+0000","last_became_peered":"2024-04-19T02:17:08.271940+0000","last_unstale":"2024-04-19T02:19:27.895757+0000","last_undegraded":"2024-04-19T02:19:27.895757+0000","last_fullsized":"2024-04-19T02:17:08.244098+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:29:37.809349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":36,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.412850+0000","last_change":"2024-04-19T02:17:08.251192+0000","last_active":"2024-04-19T02:17:57.412850+0000","last_peered":"2024-04-19T02:17:57.412850+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"2024-04-19T02:17:08.251192+0000","last_became_peered":"2024-04-19T02:17:08.251192+0000","last_unstale":"2024-04-19T02:17:57.412850+0000","last_undegraded":"2024-04-19T02:17:57.412850+0000","last_fullsized":"2024-04-19T02:17:08.247120+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:31:35.674479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":67,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-19T02:17:56.956303+0000","last_change":"2024-04-19T02:15:28.892934+0000","last_active":"2024-04-19T02:17:56.956303+0000","last_peered":"2024-04-19T02:17:56.956303+0000","last_clean":"2024-04-19T02:17:56.956303+0000","last_became_active":"2024-04-19T02:15:28.891879+0000","last_became_peered":"2024-04-19T02:15:28.891879+0000","last_unstale":"2024-04-19T02:17:56.956303+0000","last_undegraded":"2024-04-19T02:17:56.956303+0000","last_fullsized":"2024-04-19T02:17:56.956303+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:10:12.514798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:19:32.896871+0000","last_change":"2024-04-19T02:17:08.271535+0000","last_active":"2024-04-19T02:19:32.896871+0000","last_peered":"2024-04-19T02:19:32.896871+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"2024-04-19T02:17:08.271535+0000","last_became_peered":"2024-04-19T02:17:08.271535+0000","last_unstale":"2024-04-19T02:19:32.896871+0000","last_undegraded":"2024-04-19T02:19:32.896871+0000","last_fullsized":"2024-04-19T02:17:08.247235+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:11:21.094945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":76,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:17:58.304689+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:17:58.304689+0000","last_peered":"2024-04-19T02:17:58.304689+0000","last_clean":"2024-04-19T02:17:58.304689+0000","last_became_active":"2024-04-19T02:15:28.890882+0000","last_became_peered":"2024-04-19T02:15:28.890882+0000","last_unstale":"2024-04-19T02:17:58.304689+0000","last_undegraded":"2024-04-19T02:17:58.304689+0000","last_fullsized":"2024-04-19T02:17:58.304689+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:31.673938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:19:32.896941+0000","last_change":"2024-04-19T02:17:08.268502+0000","last_active":"2024-04-19T02:19:32.896941+0000","last_peered":"2024-04-19T02:19:32.896941+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"2024-04-19T02:17:08.268502+0000","last_became_peered":"2024-04-19T02:17:08.268502+0000","last_unstale":"2024-04-19T02:19:32.896941+0000","last_undegraded":"2024-04-19T02:19:32.896941+0000","last_fullsized":"2024-04-19T02:17:08.244786+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:49:10.887498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":69,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:17:58.305552+0000","last_change":"2024-04-19T02:15:28.890265+0000","last_active":"2024-04-19T02:17:58.305552+0000","last_peered":"2024-04-19T02:17:58.305552+0000","last_clean":"2024-04-19T02:17:58.305552+0000","last_became_active":"2024-04-19T02:15:28.890004+0000","last_became_peered":"2024-04-19T02:15:28.890004+0000","last_unstale":"2024-04-19T02:17:58.305552+0000","last_undegraded":"2024-04-19T02:17:58.305552+0000","last_fullsized":"2024-04-19T02:17:58.305552+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:02.517101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:17:57.411586+0000","last_change":"2024-04-19T02:15:29.285529+0000","last_active":"2024-04-19T02:17:57.411586+0000","last_peered":"2024-04-19T02:17:57.411586+0000","last_clean":"2024-04-19T02:17:57.411586+0000","last_became_active":"2024-04-19T02:15:29.285197+0000","last_became_peered":"2024-04-19T02:15:29.285197+0000","last_unstale":"2024-04-19T02:17:57.411586+0000","last_undegraded":"2024-04-19T02:17:57.411586+0000","last_fullsized":"2024-04-19T02:17:57.411586+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":69,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-19T02:17:56.957061+0000","last_change":"2024-04-19T02:15:28.893902+0000","last_active":"2024-04-19T02:17:56.957061+0000","last_peered":"2024-04-19T02:17:56.957061+0000","last_clean":"2024-04-19T02:17:56.957061+0000","last_became_active":"2024-04-19T02:15:28.893231+0000","last_became_peered":"2024-04-19T02:15:28.893231+0000","last_unstale":"2024-04-19T02:17:56.957061+0000","last_undegraded":"2024-04-19T02:17:56.957061+0000","last_fullsized":"2024-04-19T02:17:56.957061+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:23.658442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":72,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.412005+0000","last_change":"2024-04-19T02:17:08.274053+0000","last_active":"2024-04-19T02:17:57.412005+0000","last_peered":"2024-04-19T02:17:57.412005+0000","last_clean":"2024-04-19T02:17:05.241098+0000","last_became_active":"2024-04-19T02:17:08.274053+0000","last_became_peered":"2024-04-19T02:17:08.274053+0000","last_unstale":"2024-04-19T02:17:57.412005+0000","last_undegraded":"2024-04-19T02:17:57.412005+0000","last_fullsized":"2024-04-19T02:17:08.245689+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:52:12.240640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":69,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:17:58.305089+0000","last_change":"2024-04-19T02:15:28.891234+0000","last_active":"2024-04-19T02:17:58.305089+0000","last_peered":"2024-04-19T02:17:58.305089+0000","last_clean":"2024-04-19T02:17:58.305089+0000","last_became_active":"2024-04-19T02:15:28.890881+0000","last_became_peered":"2024-04-19T02:15:28.890881+0000","last_unstale":"2024-04-19T02:17:58.305089+0000","last_undegraded":"2024-04-19T02:17:58.305089+0000","last_fullsized":"2024-04-19T02:17:58.305089+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":73,"reported_epoch":71,"state":"active+undersized","last_fresh":"2024-04-19T02:19:52.900539+0000","last_change":"2024-04-19T02:17:08.272125+0000","last_active":"2024-04-19T02:19:52.900539+0000","last_peered":"2024-04-19T02:19:52.900539+0000","last_clean":"2024-04-19T02:17:05.242643+0000","last_became_active":"2024-04-19T02:17:08.272125+0000","last_became_peered":"2024-04-19T02:17:08.272125+0000","last_unstale":"2024-04-19T02:19:52.900539+0000","last_undegraded":"2024-04-19T02:19:52.900539+0000","last_fullsized":"2024-04-19T02:17:08.244067+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:11:15.438599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":73,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:58.304889+0000","last_change":"2024-04-19T02:17:08.268003+0000","last_active":"2024-04-19T02:17:58.304889+0000","last_peered":"2024-04-19T02:17:58.304889+0000","last_clean":"2024-04-19T02:17:05.242977+0000","last_became_active":"2024-04-19T02:17:08.268003+0000","last_became_peered":"2024-04-19T02:17:08.268003+0000","last_unstale":"2024-04-19T02:17:58.304889+0000","last_undegraded":"2024-04-19T02:17:58.304889+0000","last_fullsized":"2024-04-19T02:17:08.243977+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:33:08.605872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:19:22.894820+0000","last_change":"2024-04-19T02:17:08.245918+0000","last_active":"2024-04-19T02:19:22.894820+0000","last_peered":"2024-04-19T02:19:22.894820+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"2024-04-19T02:17:08.245918+0000","last_became_peered":"2024-04-19T02:17:08.245918+0000","last_unstale":"2024-04-19T02:19:22.894820+0000","last_undegraded":"2024-04-19T02:19:22.894820+0000","last_fullsized":"2024-04-19T02:17:08.243179+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:55:47.759981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":37,"reported_epoch":70,"state":"active+undersized+degraded","last_fresh":"2024-04-19T02:19:22.894844+0000","last_change":"2024-04-19T02:17:08.247033+0000","last_active":"2024-04-19T02:19:22.894844+0000","last_peered":"2024-04-19T02:19:22.894844+0000","last_clean":"2024-04-19T02:15:29.268663+0000","last_became_active":"2024-04-19T02:17:08.247033+0000","last_became_peered":"2024-04-19T02:17:08.247033+0000","last_unstale":"2024-04-19T02:19:22.894844+0000","last_undegraded":"2024-04-19T02:17:08.243532+0000","last_fullsized":"2024-04-19T02:17:08.243359+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:05:19.095959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":72,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:58.305114+0000","last_change":"2024-04-19T02:17:08.267908+0000","last_active":"2024-04-19T02:17:58.305114+0000","last_peered":"2024-04-19T02:17:58.305114+0000","last_clean":"2024-04-19T02:17:05.243065+0000","last_became_active":"2024-04-19T02:17:08.267908+0000","last_became_peered":"2024-04-19T02:17:08.267908+0000","last_unstale":"2024-04-19T02:17:58.305114+0000","last_undegraded":"2024-04-19T02:17:58.305114+0000","last_fullsized":"2024-04-19T02:17:08.244138+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:45.577736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":74,"reported_epoch":71,"state":"active+undersized","last_fresh":"2024-04-19T02:19:52.900351+0000","last_change":"2024-04-19T02:17:08.271559+0000","last_active":"2024-04-19T02:19:52.900351+0000","last_peered":"2024-04-19T02:19:52.900351+0000","last_clean":"2024-04-19T02:17:05.242553+0000","last_became_active":"2024-04-19T02:17:08.271559+0000","last_became_peered":"2024-04-19T02:17:08.271559+0000","last_unstale":"2024-04-19T02:19:52.900351+0000","last_undegraded":"2024-04-19T02:19:52.900351+0000","last_fullsized":"2024-04-19T02:17:08.243664+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:20:16.355189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:17:58.305635+0000","last_change":"2024-04-19T02:15:29.285019+0000","last_active":"2024-04-19T02:17:58.305635+0000","last_peered":"2024-04-19T02:17:58.305635+0000","last_clean":"2024-04-19T02:17:58.305635+0000","last_became_active":"2024-04-19T02:15:29.284650+0000","last_became_peered":"2024-04-19T02:15:29.284650+0000","last_unstale":"2024-04-19T02:17:58.305635+0000","last_undegraded":"2024-04-19T02:17:58.305635+0000","last_fullsized":"2024-04-19T02:17:58.305635+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:18:07.881112+0000","last_change":"2024-04-19T02:15:53.956839+0000","last_active":"2024-04-19T02:18:07.881112+0000","last_peered":"2024-04-19T02:18:07.881112+0000","last_clean":"2024-04-19T02:18:07.881112+0000","last_became_active":"2024-04-19T02:15:53.956630+0000","last_became_peered":"2024-04-19T02:15:53.956630+0000","last_unstale":"2024-04-19T02:18:07.881112+0000","last_undegraded":"2024-04-19T02:18:07.881112+0000","last_fullsized":"2024-04-19T02:18:07.881112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:47.229730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:17:58.305255+0000","last_change":"2024-04-19T02:15:29.287190+0000","last_active":"2024-04-19T02:17:58.305255+0000","last_peered":"2024-04-19T02:17:58.305255+0000","last_clean":"2024-04-19T02:17:58.305255+0000","last_became_active":"2024-04-19T02:15:29.286606+0000","last_became_peered":"2024-04-19T02:15:29.286606+0000","last_unstale":"2024-04-19T02:17:58.305255+0000","last_undegraded":"2024-04-19T02:17:58.305255+0000","last_fullsized":"2024-04-19T02:17:58.305255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:28.387062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":73,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.411792+0000","last_change":"2024-04-19T02:17:08.272832+0000","last_active":"2024-04-19T02:17:57.411792+0000","last_peered":"2024-04-19T02:17:57.411792+0000","last_clean":"2024-04-19T02:17:05.241224+0000","last_became_active":"2024-04-19T02:17:08.272832+0000","last_became_peered":"2024-04-19T02:17:08.272832+0000","last_unstale":"2024-04-19T02:17:57.411792+0000","last_undegraded":"2024-04-19T02:17:57.411792+0000","last_fullsized":"2024-04-19T02:17:08.246247+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:01:49.734528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.412739+0000","last_change":"2024-04-19T02:17:08.251223+0000","last_active":"2024-04-19T02:17:57.412739+0000","last_peered":"2024-04-19T02:17:57.412739+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"2024-04-19T02:17:08.251223+0000","last_became_peered":"2024-04-19T02:17:08.251223+0000","last_unstale":"2024-04-19T02:17:57.412739+0000","last_undegraded":"2024-04-19T02:17:57.412739+0000","last_fullsized":"2024-04-19T02:17:08.246317+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:08:19.926904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.412630+0000","last_change":"2024-04-19T02:17:08.249349+0000","last_active":"2024-04-19T02:17:57.412630+0000","last_peered":"2024-04-19T02:17:57.412630+0000","last_clean":"2024-04-19T02:15:23.520722+0000","last_became_active":"2024-04-19T02:17:08.249349+0000","last_became_peered":"2024-04-19T02:17:08.249349+0000","last_unstale":"2024-04-19T02:17:57.412630+0000","last_undegraded":"2024-04-19T02:17:57.412630+0000","last_fullsized":"2024-04-19T02:17:08.245938+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:34:56.254808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":74,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:19:42.898780+0000","last_change":"2024-04-19T02:17:08.269956+0000","last_active":"2024-04-19T02:19:42.898780+0000","last_peered":"2024-04-19T02:19:42.898780+0000","last_clean":"2024-04-19T02:17:05.243236+0000","last_became_active":"2024-04-19T02:17:08.269956+0000","last_became_peered":"2024-04-19T02:17:08.269956+0000","last_unstale":"2024-04-19T02:19:42.898780+0000","last_undegraded":"2024-04-19T02:19:42.898780+0000","last_fullsized":"2024-04-19T02:17:08.246156+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:54:01.634624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:17:57.412374+0000","last_change":"2024-04-19T02:15:29.277922+0000","last_active":"2024-04-19T02:17:57.412374+0000","last_peered":"2024-04-19T02:17:57.412374+0000","last_clean":"2024-04-19T02:17:57.412374+0000","last_became_active":"2024-04-19T02:15:29.276968+0000","last_became_peered":"2024-04-19T02:15:29.276968+0000","last_unstale":"2024-04-19T02:17:57.412374+0000","last_undegraded":"2024-04-19T02:17:57.412374+0000","last_fullsized":"2024-04-19T02:17:57.412374+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":77,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:19:37.897750+0000","last_change":"2024-04-19T02:17:08.272310+0000","last_active":"2024-04-19T02:19:37.897750+0000","last_peered":"2024-04-19T02:19:37.897750+0000","last_clean":"2024-04-19T02:17:05.242730+0000","last_became_active":"2024-04-19T02:17:08.272310+0000","last_became_peered":"2024-04-19T02:17:08.272310+0000","last_unstale":"2024-04-19T02:19:37.897750+0000","last_undegraded":"2024-04-19T02:19:37.897750+0000","last_fullsized":"2024-04-19T02:17:08.245677+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:34:47.040883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":74,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:19:42.898685+0000","last_change":"2024-04-19T02:17:08.248208+0000","last_active":"2024-04-19T02:19:42.898685+0000","last_peered":"2024-04-19T02:19:42.898685+0000","last_clean":"2024-04-19T02:17:05.242882+0000","last_became_active":"2024-04-19T02:17:08.248208+0000","last_became_peered":"2024-04-19T02:17:08.248208+0000","last_unstale":"2024-04-19T02:19:42.898685+0000","last_undegraded":"2024-04-19T02:19:42.898685+0000","last_fullsized":"2024-04-19T02:17:08.244450+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:53:51.051776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.412218+0000","last_change":"2024-04-19T02:17:08.248118+0000","last_active":"2024-04-19T02:17:57.412218+0000","last_peered":"2024-04-19T02:17:57.412218+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"2024-04-19T02:17:08.248118+0000","last_became_peered":"2024-04-19T02:17:08.248118+0000","last_unstale":"2024-04-19T02:17:57.412218+0000","last_undegraded":"2024-04-19T02:17:57.412218+0000","last_fullsized":"2024-04-19T02:17:08.245404+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:55:18.433102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":28,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.411759+0000","last_change":"2024-04-19T02:17:08.273665+0000","last_active":"2024-04-19T02:17:57.411759+0000","last_peered":"2024-04-19T02:17:57.411759+0000","last_clean":"2024-04-19T02:15:23.520722+0000","last_became_active":"2024-04-19T02:17:08.273665+0000","last_became_peered":"2024-04-19T02:17:08.273665+0000","last_unstale":"2024-04-19T02:17:57.411759+0000","last_undegraded":"2024-04-19T02:17:57.411759+0000","last_fullsized":"2024-04-19T02:17:08.245393+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:38:59.543425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:17:58.304005+0000","last_change":"2024-04-19T02:15:53.956945+0000","last_active":"2024-04-19T02:17:58.304005+0000","last_peered":"2024-04-19T02:17:58.304005+0000","last_clean":"2024-04-19T02:17:58.304005+0000","last_became_active":"2024-04-19T02:15:53.956719+0000","last_became_peered":"2024-04-19T02:15:53.956719+0000","last_unstale":"2024-04-19T02:17:58.304005+0000","last_undegraded":"2024-04-19T02:17:58.304005+0000","last_fullsized":"2024-04-19T02:17:58.304005+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:00:37.754624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.412896+0000","last_change":"2024-04-19T02:17:08.249335+0000","last_active":"2024-04-19T02:17:57.412896+0000","last_peered":"2024-04-19T02:17:57.412896+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"2024-04-19T02:17:08.249335+0000","last_became_peered":"2024-04-19T02:17:08.249335+0000","last_unstale":"2024-04-19T02:17:57.412896+0000","last_undegraded":"2024-04-19T02:17:57.412896+0000","last_fullsized":"2024-04-19T02:17:08.246161+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:58:12.264389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":77,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:19:37.897804+0000","last_change":"2024-04-19T02:17:08.248900+0000","last_active":"2024-04-19T02:19:37.897804+0000","last_peered":"2024-04-19T02:19:37.897804+0000","last_clean":"2024-04-19T02:17:05.242935+0000","last_became_active":"2024-04-19T02:17:08.248900+0000","last_became_peered":"2024-04-19T02:17:08.248900+0000","last_unstale":"2024-04-19T02:19:37.897804+0000","last_undegraded":"2024-04-19T02:19:37.897804+0000","last_fullsized":"2024-04-19T02:17:08.244662+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:09:29.939894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":268,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:19:27.895638+0000","last_change":"2024-04-19T02:15:24.533634+0000","last_active":"2024-04-19T02:19:27.895638+0000","last_peered":"2024-04-19T02:19:27.895638+0000","last_clean":"2024-04-19T02:19:27.895638+0000","last_became_active":"2024-04-19T02:15:24.533420+0000","last_became_peered":"2024-04-19T02:15:24.533420+0000","last_unstale":"2024-04-19T02:19:27.895638+0000","last_undegraded":"2024-04-19T02:19:27.895638+0000","last_fullsized":"2024-04-19T02:19:27.895638+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":28,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.412022+0000","last_change":"2024-04-19T02:17:08.273853+0000","last_active":"2024-04-19T02:17:57.412022+0000","last_peered":"2024-04-19T02:17:57.412022+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"2024-04-19T02:17:08.273853+0000","last_became_peered":"2024-04-19T02:17:08.273853+0000","last_unstale":"2024-04-19T02:17:57.412022+0000","last_undegraded":"2024-04-19T02:17:57.412022+0000","last_fullsized":"2024-04-19T02:17:08.245505+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:40.956036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":68,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:19:42.898802+0000","last_change":"2024-04-19T02:15:29.285015+0000","last_active":"2024-04-19T02:19:42.898802+0000","last_peered":"2024-04-19T02:19:42.898802+0000","last_clean":"2024-04-19T02:19:42.898802+0000","last_became_active":"2024-04-19T02:15:29.284164+0000","last_became_peered":"2024-04-19T02:15:29.284164+0000","last_unstale":"2024-04-19T02:19:42.898802+0000","last_undegraded":"2024-04-19T02:19:42.898802+0000","last_fullsized":"2024-04-19T02:19:42.898802+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:36.987844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":72,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:19:27.895653+0000","last_change":"2024-04-19T02:15:24.533912+0000","last_active":"2024-04-19T02:19:27.895653+0000","last_peered":"2024-04-19T02:19:27.895653+0000","last_clean":"2024-04-19T02:19:27.895653+0000","last_became_active":"2024-04-19T02:15:24.533580+0000","last_became_peered":"2024-04-19T02:15:24.533580+0000","last_unstale":"2024-04-19T02:19:27.895653+0000","last_undegraded":"2024-04-19T02:19:27.895653+0000","last_fullsized":"2024-04-19T02:19:27.895653+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:45.045477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":29,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:19:12.892934+0000","last_change":"2024-04-19T02:17:08.250900+0000","last_active":"2024-04-19T02:19:12.892934+0000","last_peered":"2024-04-19T02:19:12.892934+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"2024-04-19T02:17:08.250900+0000","last_became_peered":"2024-04-19T02:17:08.250900+0000","last_unstale":"2024-04-19T02:19:12.892934+0000","last_undegraded":"2024-04-19T02:19:12.892934+0000","last_fullsized":"2024-04-19T02:17:08.243541+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:25:03.958757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":37,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.412969+0000","last_change":"2024-04-19T02:17:08.277110+0000","last_active":"2024-04-19T02:17:57.412969+0000","last_peered":"2024-04-19T02:17:57.412969+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"2024-04-19T02:17:08.277110+0000","last_became_peered":"2024-04-19T02:17:08.277110+0000","last_unstale":"2024-04-19T02:17:57.412969+0000","last_undegraded":"2024-04-19T02:17:57.412969+0000","last_fullsized":"2024-04-19T02:17:08.247082+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:53:04.153025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.412735+0000","last_change":"2024-04-19T02:17:08.250163+0000","last_active":"2024-04-19T02:17:57.412735+0000","last_peered":"2024-04-19T02:17:57.412735+0000","last_clean":"2024-04-19T02:15:23.520722+0000","last_became_active":"2024-04-19T02:17:08.250163+0000","last_became_peered":"2024-04-19T02:17:08.250163+0000","last_unstale":"2024-04-19T02:17:57.412735+0000","last_undegraded":"2024-04-19T02:17:57.412735+0000","last_fullsized":"2024-04-19T02:17:08.246805+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:01:19.061078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":28,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.413012+0000","last_change":"2024-04-19T02:17:08.250218+0000","last_active":"2024-04-19T02:17:57.413012+0000","last_peered":"2024-04-19T02:17:57.413012+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"2024-04-19T02:17:08.250218+0000","last_became_peered":"2024-04-19T02:17:08.250218+0000","last_unstale":"2024-04-19T02:17:57.413012+0000","last_undegraded":"2024-04-19T02:17:57.413012+0000","last_fullsized":"2024-04-19T02:17:08.246632+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:25:03.958757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:17:57.412094+0000","last_change":"2024-04-19T02:15:29.281694+0000","last_active":"2024-04-19T02:17:57.412094+0000","last_peered":"2024-04-19T02:17:57.412094+0000","last_clean":"2024-04-19T02:17:57.412094+0000","last_became_active":"2024-04-19T02:15:29.280519+0000","last_became_peered":"2024-04-19T02:15:29.280519+0000","last_unstale":"2024-04-19T02:17:57.412094+0000","last_undegraded":"2024-04-19T02:17:57.412094+0000","last_fullsized":"2024-04-19T02:17:57.412094+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:50.890545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":36,"reported_epoch":70,"state":"active+undersized+degraded","last_fresh":"2024-04-19T02:17:57.413158+0000","last_change":"2024-04-19T02:17:08.253036+0000","last_active":"2024-04-19T02:17:57.413158+0000","last_peered":"2024-04-19T02:17:57.413158+0000","last_clean":"2024-04-19T02:15:29.270101+0000","last_became_active":"2024-04-19T02:17:08.253036+0000","last_became_peered":"2024-04-19T02:17:08.253036+0000","last_unstale":"2024-04-19T02:17:57.413158+0000","last_undegraded":"2024-04-19T02:17:08.247826+0000","last_fullsized":"2024-04-19T02:17:08.247745+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:18:01.965629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":28,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.412620+0000","last_change":"2024-04-19T02:17:08.276428+0000","last_active":"2024-04-19T02:17:57.412620+0000","last_peered":"2024-04-19T02:17:57.412620+0000","last_clean":"2024-04-19T02:15:23.520722+0000","last_became_active":"2024-04-19T02:17:08.276428+0000","last_became_peered":"2024-04-19T02:17:08.276428+0000","last_unstale":"2024-04-19T02:17:57.412620+0000","last_undegraded":"2024-04-19T02:17:57.412620+0000","last_fullsized":"2024-04-19T02:17:08.246290+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:39:50.844751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:19:07.891712+0000","last_change":"2024-04-19T02:17:08.246759+0000","last_active":"2024-04-19T02:19:07.891712+0000","last_peered":"2024-04-19T02:19:07.891712+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"2024-04-19T02:17:08.246759+0000","last_became_peered":"2024-04-19T02:17:08.246759+0000","last_unstale":"2024-04-19T02:19:07.891712+0000","last_undegraded":"2024-04-19T02:19:07.891712+0000","last_fullsized":"2024-04-19T02:17:08.243046+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:39:14.603809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":72,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:19:47.899722+0000","last_change":"2024-04-19T02:15:24.533777+0000","last_active":"2024-04-19T02:19:47.899722+0000","last_peered":"2024-04-19T02:19:47.899722+0000","last_clean":"2024-04-19T02:19:47.899722+0000","last_became_active":"2024-04-19T02:15:24.533436+0000","last_became_peered":"2024-04-19T02:15:24.533436+0000","last_unstale":"2024-04-19T02:19:47.899722+0000","last_undegraded":"2024-04-19T02:19:47.899722+0000","last_fullsized":"2024-04-19T02:19:47.899722+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:53:25.922418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":39,"reported_epoch":70,"state":"active+undersized+degraded","last_fresh":"2024-04-19T02:19:17.894111+0000","last_change":"2024-04-19T02:17:08.271293+0000","last_active":"2024-04-19T02:19:17.894111+0000","last_peered":"2024-04-19T02:19:17.894111+0000","last_clean":"2024-04-19T02:15:32.743668+0000","last_became_active":"2024-04-19T02:17:08.271293+0000","last_became_peered":"2024-04-19T02:17:08.271293+0000","last_unstale":"2024-04-19T02:19:17.894111+0000","last_undegraded":"2024-04-19T02:17:08.246338+0000","last_fullsized":"2024-04-19T02:17:08.246271+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:05:07.808901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:17:57.411955+0000","last_change":"2024-04-19T02:15:29.282244+0000","last_active":"2024-04-19T02:17:57.411955+0000","last_peered":"2024-04-19T02:17:57.411955+0000","last_clean":"2024-04-19T02:17:57.411955+0000","last_became_active":"2024-04-19T02:15:29.280366+0000","last_became_peered":"2024-04-19T02:15:29.280366+0000","last_unstale":"2024-04-19T02:17:57.411955+0000","last_undegraded":"2024-04-19T02:17:57.411955+0000","last_fullsized":"2024-04-19T02:17:57.411955+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":68,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:17:57.412359+0000","last_change":"2024-04-19T02:15:28.893027+0000","last_active":"2024-04-19T02:17:57.412359+0000","last_peered":"2024-04-19T02:17:57.412359+0000","last_clean":"2024-04-19T02:17:57.412359+0000","last_became_active":"2024-04-19T02:15:28.892695+0000","last_became_peered":"2024-04-19T02:15:28.892695+0000","last_unstale":"2024-04-19T02:17:57.412359+0000","last_undegraded":"2024-04-19T02:17:57.412359+0000","last_fullsized":"2024-04-19T02:17:57.412359+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":71,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.413043+0000","last_change":"2024-04-19T02:17:08.252455+0000","last_active":"2024-04-19T02:17:57.413043+0000","last_peered":"2024-04-19T02:17:57.413043+0000","last_clean":"2024-04-19T02:17:05.241737+0000","last_became_active":"2024-04-19T02:17:08.252455+0000","last_became_peered":"2024-04-19T02:17:08.252455+0000","last_unstale":"2024-04-19T02:17:57.413043+0000","last_undegraded":"2024-04-19T02:17:57.413043+0000","last_fullsized":"2024-04-19T02:17:08.246906+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:45.577736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":75,"reported_epoch":70,"state":"active+undersized+degraded","last_fresh":"2024-04-19T02:18:02.880287+0000","last_change":"2024-04-19T02:17:08.268249+0000","last_active":"2024-04-19T02:18:02.880287+0000","last_peered":"2024-04-19T02:18:02.880287+0000","last_clean":"2024-04-19T02:17:05.243248+0000","last_became_active":"2024-04-19T02:17:08.268249+0000","last_became_peered":"2024-04-19T02:17:08.268249+0000","last_unstale":"2024-04-19T02:18:02.880287+0000","last_undegraded":"2024-04-19T02:17:08.244900+0000","last_fullsized":"2024-04-19T02:17:08.244818+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:36:22.626608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":72,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:18:02.880174+0000","last_change":"2024-04-19T02:17:08.250259+0000","last_active":"2024-04-19T02:18:02.880174+0000","last_peered":"2024-04-19T02:18:02.880174+0000","last_clean":"2024-04-19T02:17:05.242838+0000","last_became_active":"2024-04-19T02:17:08.250259+0000","last_became_peered":"2024-04-19T02:17:08.250259+0000","last_unstale":"2024-04-19T02:18:02.880174+0000","last_undegraded":"2024-04-19T02:18:02.880174+0000","last_fullsized":"2024-04-19T02:17:08.244139+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:23:45.234497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":69,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:17:57.412754+0000","last_change":"2024-04-19T02:15:28.893239+0000","last_active":"2024-04-19T02:17:57.412754+0000","last_peered":"2024-04-19T02:17:57.412754+0000","last_clean":"2024-04-19T02:17:57.412754+0000","last_became_active":"2024-04-19T02:15:28.892881+0000","last_became_peered":"2024-04-19T02:15:28.892881+0000","last_unstale":"2024-04-19T02:17:57.412754+0000","last_undegraded":"2024-04-19T02:17:57.412754+0000","last_fullsized":"2024-04-19T02:17:57.412754+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":72,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:18:02.880100+0000","last_change":"2024-04-19T02:17:08.271755+0000","last_active":"2024-04-19T02:18:02.880100+0000","last_peered":"2024-04-19T02:18:02.880100+0000","last_clean":"2024-04-19T02:17:05.242634+0000","last_became_active":"2024-04-19T02:17:08.271755+0000","last_became_peered":"2024-04-19T02:17:08.271755+0000","last_unstale":"2024-04-19T02:18:02.880100+0000","last_undegraded":"2024-04-19T02:18:02.880100+0000","last_fullsized":"2024-04-19T02:17:08.243858+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:41:25.978162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":28,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.412908+0000","last_change":"2024-04-19T02:17:08.276665+0000","last_active":"2024-04-19T02:17:57.412908+0000","last_peered":"2024-04-19T02:17:57.412908+0000","last_clean":"2024-04-19T02:15:27.862187+0000","last_became_active":"2024-04-19T02:17:08.276665+0000","last_became_peered":"2024-04-19T02:17:08.276665+0000","last_unstale":"2024-04-19T02:17:57.412908+0000","last_undegraded":"2024-04-19T02:17:57.412908+0000","last_fullsized":"2024-04-19T02:17:08.246649+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:33:08.605872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":71,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.412100+0000","last_change":"2024-04-19T02:17:08.273888+0000","last_active":"2024-04-19T02:17:57.412100+0000","last_peered":"2024-04-19T02:17:57.412100+0000","last_clean":"2024-04-19T02:17:05.241177+0000","last_became_active":"2024-04-19T02:17:08.273888+0000","last_became_peered":"2024-04-19T02:17:08.273888+0000","last_unstale":"2024-04-19T02:17:57.412100+0000","last_undegraded":"2024-04-19T02:17:57.412100+0000","last_fullsized":"2024-04-19T02:17:08.245820+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:05:20.105489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":37,"reported_epoch":70,"state":"active+undersized+degraded","last_fresh":"2024-04-19T02:19:12.893254+0000","last_change":"2024-04-19T02:17:08.268361+0000","last_active":"2024-04-19T02:19:12.893254+0000","last_peered":"2024-04-19T02:19:12.893254+0000","last_clean":"2024-04-19T02:15:29.270373+0000","last_became_active":"2024-04-19T02:17:08.268361+0000","last_became_peered":"2024-04-19T02:17:08.268361+0000","last_unstale":"2024-04-19T02:19:12.893254+0000","last_undegraded":"2024-04-19T02:17:08.245942+0000","last_fullsized":"2024-04-19T02:17:08.245894+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:04:15.113717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":2}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":72,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:58.305083+0000","last_change":"2024-04-19T02:17:08.250320+0000","last_active":"2024-04-19T02:17:58.305083+0000","last_peered":"2024-04-19T02:17:58.305083+0000","last_clean":"2024-04-19T02:17:05.242683+0000","last_became_active":"2024-04-19T02:17:08.250320+0000","last_became_peered":"2024-04-19T02:17:08.250320+0000","last_unstale":"2024-04-19T02:17:58.305083+0000","last_undegraded":"2024-04-19T02:17:58.305083+0000","last_fullsized":"2024-04-19T02:17:08.244070+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:21:04.745747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":73,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:19:42.898548+0000","last_change":"2024-04-19T02:17:08.247018+0000","last_active":"2024-04-19T02:19:42.898548+0000","last_peered":"2024-04-19T02:19:42.898548+0000","last_clean":"2024-04-19T02:17:05.242628+0000","last_became_active":"2024-04-19T02:17:08.247018+0000","last_became_peered":"2024-04-19T02:17:08.247018+0000","last_unstale":"2024-04-19T02:19:42.898548+0000","last_undegraded":"2024-04-19T02:19:42.898548+0000","last_fullsized":"2024-04-19T02:17:08.243630+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:26:46.208581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":28,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.411786+0000","last_change":"2024-04-19T02:17:08.273452+0000","last_active":"2024-04-19T02:17:57.411786+0000","last_peered":"2024-04-19T02:17:57.411786+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"2024-04-19T02:17:08.273452+0000","last_became_peered":"2024-04-19T02:17:08.273452+0000","last_unstale":"2024-04-19T02:17:57.411786+0000","last_undegraded":"2024-04-19T02:17:57.411786+0000","last_fullsized":"2024-04-19T02:17:08.245252+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:11:21.094945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:18:02.880051+0000","last_change":"2024-04-19T02:15:53.955913+0000","last_active":"2024-04-19T02:18:02.880051+0000","last_peered":"2024-04-19T02:18:02.880051+0000","last_clean":"2024-04-19T02:18:02.880051+0000","last_became_active":"2024-04-19T02:15:53.955676+0000","last_became_peered":"2024-04-19T02:15:53.955676+0000","last_unstale":"2024-04-19T02:18:02.880051+0000","last_undegraded":"2024-04-19T02:18:02.880051+0000","last_fullsized":"2024-04-19T02:18:02.880051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:53:02.899902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":28,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-04-19T02:17:57.412542+0000","last_change":"2024-04-19T02:17:08.275752+0000","last_active":"2024-04-19T02:17:57.412542+0000","last_peered":"2024-04-19T02:17:57.412542+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"2024-04-19T02:17:08.275752+0000","last_became_peered":"2024-04-19T02:17:08.275752+0000","last_unstale":"2024-04-19T02:17:57.412542+0000","last_undegraded":"2024-04-19T02:17:57.412542+0000","last_fullsized":"2024-04-19T02:17:08.246701+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:21:04.745747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T02:17:57.413131+0000","last_change":"2024-04-19T02:15:29.277568+0000","last_active":"2024-04-19T02:17:57.413131+0000","last_peered":"2024-04-19T02:17:57.413131+0000","last_clean":"2024-04-19T02:17:57.413131+0000","last_became_active":"2024-04-19T02:15:29.276725+0000","last_became_peered":"2024-04-19T02:15:29.276725+0000","last_unstale":"2024-04-19T02:17:57.413131+0000","last_undegraded":"2024-04-19T02:17:57.413131+0000","last_fullsized":"2024-04-19T02:17:57.413131+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":84,"acting":84,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":8,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5254,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":43,"acting":43,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":10,"acting":10,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":0,"seq":1,"num_pgs":84,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5757800,"kb_used_data":5703968,"kb_used_omap":6,"kb_used_meta":53817,"kb_avail":88614040,"statfs":{"total":96636764160,"available":90740776960,"internally_reserved":0,"allocated":5840863232,"data_stored":5840511790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6848,"internal_metadata":55108928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},{"osd":0,"up_from":8,"seq":34359738425,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":275328,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":273918,"kb_avail":94096512,"statfs":{"total":96636764160,"available":96354828288,"internally_reserved":0,"allocated":1425408,"data_stored":896369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":280492486},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 02:19:26 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.371,"15min":0.316},"min":{"1min":0.29899999999999999,"5min":0.159,"15min":0.159},"max":{"1min":0.57499999999999996,"5min":4.4480000000000004,"15min":4.4480000000000004},"last":0.498},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.379,"15min":0.36599999999999999},"min":{"1min":0.29399999999999998,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.54800000000000004,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.47199999999999998}]},{"osd":2,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":2.1000000000000001,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":0.19500000000000001},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.25600000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738424,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303224,"kb_used_data":1384,"kb_used_omap":1,"kb_used_meta":301822,"kb_avail":94068616,"statfs":{"total":96636764160,"available":96326262784,"internally_reserved":0,"allocated":1417216,"data_stored":895753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":309066182},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:19:29 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.40600000000000003,"15min":0.376},"min":{"1min":0.32700000000000001,"5min":0.157,"15min":0.157},"max":{"1min":0.64900000000000002,"5min":1.794,"15min":1.794},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.38100000000000001,"15min":0.32400000000000001},"min":{"1min":0.37,"5min":0.16,"15min":0.16},"max":{"1min":0.63,"5min":2.411,"15min":2.411},"last":0.50900000000000001}]},{"osd":2,"last update":"Fri Apr 19 02:16:26 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.46899999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5254,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:19:57.662 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-19T02:19:57.662 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T02:19:57.662 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-04-19T02:19:57.662 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-19T02:19:57.663 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-19T02:19:57.663 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-04-19T02:19:57.802 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-19T02:19:57.802 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "" 2024-04-19T02:19:57.802 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-19T02:20:02.814 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-04-19T02:20:02.963 INFO:teuthology.orchestra.run.smithi121.stdout:mon.a: {} 2024-04-19T02:20:02.972 INFO:teuthology.orchestra.run.smithi121.stdout:mon.b: {} 2024-04-19T02:20:02.982 INFO:teuthology.orchestra.run.smithi121.stdout:mon.c: {} 2024-04-19T02:20:02.983 INFO:teuthology.orchestra.run.smithi121.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-19T02:20:02.983 INFO:teuthology.orchestra.run.smithi121.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-19T02:20:02.983 INFO:teuthology.orchestra.run.smithi121.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-19T02:20:02.993 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-19T02:20:03.941 INFO:teuthology.orchestra.run.smithi121.stderr:reweighted osd.0 to 1 (10000) 2024-04-19T02:20:03.954 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-04-19T02:20:04.957 INFO:teuthology.orchestra.run.smithi121.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-04-19T02:20:04.969 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-19T02:20:05.967 INFO:teuthology.orchestra.run.smithi121.stderr:reweighted osd.1 to 1 (10000) 2024-04-19T02:20:05.981 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-04-19T02:20:06.977 INFO:teuthology.orchestra.run.smithi121.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-04-19T02:20:06.989 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-19T02:20:07.985 INFO:teuthology.orchestra.run.smithi121.stderr:reweighted osd.2 to 1 (10000) 2024-04-19T02:20:07.999 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-04-19T02:20:08.992 INFO:teuthology.orchestra.run.smithi121.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-04-19T02:20:09.008 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-04-19T02:20:09.008 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-04-19T02:20:09.008 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-04-19T02:20:09.008 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-04-19T02:20:09.008 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-19T02:20:09.008 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T02:20:09.335 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:20:09.335 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":81,"fsid":"f6ab5dd0-bb9f-4b48-a9fc-4728c7955ca8","created":"2024-04-19T02:15:13.539846+0000","modified":"2024-04-19T02:20:08.985640+0000","last_up_change":"2024-04-19T02:19:53.893059+0000","last_in_change":"2024-04-19T02:15:15.482624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T02:15:22.776125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T02:15:23.264005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T02:15:27.675087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T02:15:28.232224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88cb15f3-271c-43d5-af51-1cd26b8ed13c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":41347},{"type":"v1","addr":"172.21.15.153:6801","nonce":41347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":41347},{"type":"v1","addr":"172.21.15.153:6803","nonce":41347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":41347},{"type":"v1","addr":"172.21.15.153:6807","nonce":41347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":41347},{"type":"v1","addr":"172.21.15.153:6805","nonce":41347}]},"public_addr":"172.21.15.153:6801/41347","cluster_addr":"172.21.15.153:6803/41347","heartbeat_back_addr":"172.21.15.153:6807/41347","heartbeat_front_addr":"172.21.15.153:6805/41347","state":["exists","up"]},{"osd":1,"uuid":"2674869a-db01-4d9f-a496-9fb3851b5b21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":41380},{"type":"v1","addr":"172.21.15.174:6801","nonce":41380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":41380},{"type":"v1","addr":"172.21.15.174:6803","nonce":41380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":41380},{"type":"v1","addr":"172.21.15.174:6807","nonce":41380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":41380},{"type":"v1","addr":"172.21.15.174:6805","nonce":41380}]},"public_addr":"172.21.15.174:6801/41380","cluster_addr":"172.21.15.174:6803/41380","heartbeat_back_addr":"172.21.15.174:6807/41380","heartbeat_front_addr":"172.21.15.174:6805/41380","state":["exists","up"]},{"osd":2,"uuid":"712ad943-2f98-49d9-aabe-f66b509be633","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":49,"up_from":72,"up_thru":72,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":6186},{"type":"v1","addr":"172.21.15.177:6801","nonce":6186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":6186},{"type":"v1","addr":"172.21.15.177:6803","nonce":6186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":6186},{"type":"v1","addr":"172.21.15.177:6807","nonce":6186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":6186},{"type":"v1","addr":"172.21.15.177:6805","nonce":6186}]},"public_addr":"172.21.15.177:6801/6186","cluster_addr":"172.21.15.177:6803/6186","heartbeat_back_addr":"172.21.15.177:6807/6186","heartbeat_front_addr":"172.21.15.177:6805/6186","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:15:20.495280+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:15:20.594553+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:15:20.524253+0000","dead_epoch":49}],"pg_upmap":[{"pgid":"4.36","osds":[0,1]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T02:20:09.349 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-19T02:20:09.350 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T02:20:09.673 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:20:09.674 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":81,"fsid":"f6ab5dd0-bb9f-4b48-a9fc-4728c7955ca8","created":"2024-04-19T02:15:13.539846+0000","modified":"2024-04-19T02:20:08.985640+0000","last_up_change":"2024-04-19T02:19:53.893059+0000","last_in_change":"2024-04-19T02:15:15.482624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T02:15:22.776125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T02:15:23.264005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T02:15:27.675087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T02:15:28.232224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88cb15f3-271c-43d5-af51-1cd26b8ed13c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":41347},{"type":"v1","addr":"172.21.15.153:6801","nonce":41347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":41347},{"type":"v1","addr":"172.21.15.153:6803","nonce":41347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":41347},{"type":"v1","addr":"172.21.15.153:6807","nonce":41347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":41347},{"type":"v1","addr":"172.21.15.153:6805","nonce":41347}]},"public_addr":"172.21.15.153:6801/41347","cluster_addr":"172.21.15.153:6803/41347","heartbeat_back_addr":"172.21.15.153:6807/41347","heartbeat_front_addr":"172.21.15.153:6805/41347","state":["exists","up"]},{"osd":1,"uuid":"2674869a-db01-4d9f-a496-9fb3851b5b21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":41380},{"type":"v1","addr":"172.21.15.174:6801","nonce":41380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":41380},{"type":"v1","addr":"172.21.15.174:6803","nonce":41380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":41380},{"type":"v1","addr":"172.21.15.174:6807","nonce":41380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":41380},{"type":"v1","addr":"172.21.15.174:6805","nonce":41380}]},"public_addr":"172.21.15.174:6801/41380","cluster_addr":"172.21.15.174:6803/41380","heartbeat_back_addr":"172.21.15.174:6807/41380","heartbeat_front_addr":"172.21.15.174:6805/41380","state":["exists","up"]},{"osd":2,"uuid":"712ad943-2f98-49d9-aabe-f66b509be633","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":49,"up_from":72,"up_thru":72,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":6186},{"type":"v1","addr":"172.21.15.177:6801","nonce":6186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":6186},{"type":"v1","addr":"172.21.15.177:6803","nonce":6186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":6186},{"type":"v1","addr":"172.21.15.177:6807","nonce":6186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":6186},{"type":"v1","addr":"172.21.15.177:6805","nonce":6186}]},"public_addr":"172.21.15.177:6801/6186","cluster_addr":"172.21.15.177:6803/6186","heartbeat_back_addr":"172.21.15.177:6807/6186","heartbeat_front_addr":"172.21.15.177:6805/6186","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:15:20.495280+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:15:20.594553+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:15:20.524253+0000","dead_epoch":49}],"pg_upmap":[{"pgid":"4.36","osds":[0,1]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T02:20:09.688 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-19T02:20:09.689 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-19T02:20:09.689 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-19T02:20:09.854 INFO:teuthology.orchestra.run.smithi121.stdout:309237645317 2024-04-19T02:20:09.854 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-19T02:20:09.871 INFO:teuthology.orchestra.run.smithi121.stdout:34359738428 2024-04-19T02:20:09.872 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-19T02:20:09.873 INFO:teuthology.orchestra.run.smithi121.stdout:34359738429 2024-04-19T02:20:09.873 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-19T02:20:10.194 INFO:teuthology.orchestra.run.smithi121.stdout:309237645316 2024-04-19T02:20:10.208 INFO:tasks.ceph.ceph_manager.ceph:need seq 309237645317 got 309237645316 for osd.2 2024-04-19T02:20:10.255 INFO:teuthology.orchestra.run.smithi121.stdout:34359738428 2024-04-19T02:20:10.260 INFO:teuthology.orchestra.run.smithi121.stdout:34359738427 2024-04-19T02:20:10.270 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738429 got 34359738428 for osd.0 2024-04-19T02:20:10.274 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738428 got 34359738427 for osd.1 2024-04-19T02:20:11.210 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-19T02:20:11.272 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-19T02:20:11.275 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-19T02:20:11.579 INFO:teuthology.orchestra.run.smithi121.stdout:309237645317 2024-04-19T02:20:11.593 INFO:tasks.ceph.ceph_manager.ceph:need seq 309237645317 got 309237645317 for osd.2 2024-04-19T02:20:11.593 DEBUG:teuthology.parallel:result is None 2024-04-19T02:20:11.655 INFO:teuthology.orchestra.run.smithi121.stdout:34359738429 2024-04-19T02:20:11.669 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738429 got 34359738429 for osd.0 2024-04-19T02:20:11.669 DEBUG:teuthology.parallel:result is None 2024-04-19T02:20:11.684 INFO:teuthology.orchestra.run.smithi121.stdout:34359738428 2024-04-19T02:20:11.697 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738428 got 34359738428 for osd.1 2024-04-19T02:20:11.698 DEBUG:teuthology.parallel:result is None 2024-04-19T02:20:11.698 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-19T02:20:11.698 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:20:12.071 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:20:12.073 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-04-19T02:20:12.082 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":222,"stamp":"2024-04-19T02:20:10.811829+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":641632,"kb_used_data":3824,"kb_used_omap":9,"kb_used_meta":637750,"kb_avail":282473888,"statfs":{"total":289910292480,"available":289253261312,"internally_reserved":0,"allocated":3915776,"data_stored":2243121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10036,"internal_metadata":653056204},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000839"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.983092+0000","last_change":"2024-04-19T02:19:54.929643+0000","last_active":"2024-04-19T02:20:07.983092+0000","last_peered":"2024-04-19T02:20:07.983092+0000","last_clean":"2024-04-19T02:20:07.983092+0000","last_became_active":"2024-04-19T02:19:54.929435+0000","last_became_peered":"2024-04-19T02:19:54.929435+0000","last_unstale":"2024-04-19T02:20:07.983092+0000","last_undegraded":"2024-04-19T02:20:07.983092+0000","last_fullsized":"2024-04-19T02:20:07.983092+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:44:05.807254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.982541+0000","last_change":"2024-04-19T02:19:54.931532+0000","last_active":"2024-04-19T02:20:07.982541+0000","last_peered":"2024-04-19T02:20:07.982541+0000","last_clean":"2024-04-19T02:20:07.982541+0000","last_became_active":"2024-04-19T02:19:54.931278+0000","last_became_peered":"2024-04-19T02:19:54.931278+0000","last_unstale":"2024-04-19T02:20:07.982541+0000","last_undegraded":"2024-04-19T02:20:07.982541+0000","last_fullsized":"2024-04-19T02:20:07.982541+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:20:02.024046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661523+0000","last_change":"2024-04-19T02:15:29.286709+0000","last_active":"2024-04-19T02:20:08.661523+0000","last_peered":"2024-04-19T02:20:08.661523+0000","last_clean":"2024-04-19T02:20:08.661523+0000","last_became_active":"2024-04-19T02:15:29.286169+0000","last_became_peered":"2024-04-19T02:15:29.286169+0000","last_unstale":"2024-04-19T02:20:08.661523+0000","last_undegraded":"2024-04-19T02:20:08.661523+0000","last_fullsized":"2024-04-19T02:20:08.661523+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:58.741466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661124+0000","last_change":"2024-04-19T02:19:54.927063+0000","last_active":"2024-04-19T02:20:08.661124+0000","last_peered":"2024-04-19T02:20:08.661124+0000","last_clean":"2024-04-19T02:20:08.661124+0000","last_became_active":"2024-04-19T02:19:54.926046+0000","last_became_peered":"2024-04-19T02:19:54.926046+0000","last_unstale":"2024-04-19T02:20:08.661124+0000","last_undegraded":"2024-04-19T02:20:08.661124+0000","last_fullsized":"2024-04-19T02:20:08.661124+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:52:59.151542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":54,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981322+0000","last_change":"2024-04-19T02:19:54.931669+0000","last_active":"2024-04-19T02:20:07.981322+0000","last_peered":"2024-04-19T02:20:07.981322+0000","last_clean":"2024-04-19T02:20:07.981322+0000","last_became_active":"2024-04-19T02:19:54.931435+0000","last_became_peered":"2024-04-19T02:19:54.931435+0000","last_unstale":"2024-04-19T02:20:07.981322+0000","last_undegraded":"2024-04-19T02:20:07.981322+0000","last_fullsized":"2024-04-19T02:20:07.981322+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:42:58.222802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660547+0000","last_change":"2024-04-19T02:19:54.924250+0000","last_active":"2024-04-19T02:20:08.660547+0000","last_peered":"2024-04-19T02:20:08.660547+0000","last_clean":"2024-04-19T02:20:08.660547+0000","last_became_active":"2024-04-19T02:19:54.923984+0000","last_became_peered":"2024-04-19T02:19:54.923984+0000","last_unstale":"2024-04-19T02:20:08.660547+0000","last_undegraded":"2024-04-19T02:20:08.660547+0000","last_fullsized":"2024-04-19T02:20:08.660547+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:56:51.290239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660603+0000","last_change":"2024-04-19T02:19:54.926647+0000","last_active":"2024-04-19T02:20:08.660603+0000","last_peered":"2024-04-19T02:20:08.660603+0000","last_clean":"2024-04-19T02:20:08.660603+0000","last_became_active":"2024-04-19T02:19:54.925529+0000","last_became_peered":"2024-04-19T02:19:54.925529+0000","last_unstale":"2024-04-19T02:20:08.660603+0000","last_undegraded":"2024-04-19T02:20:08.660603+0000","last_fullsized":"2024-04-19T02:20:08.660603+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:49:06.911557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660492+0000","last_change":"2024-04-19T02:19:54.930828+0000","last_active":"2024-04-19T02:20:08.660492+0000","last_peered":"2024-04-19T02:20:08.660492+0000","last_clean":"2024-04-19T02:20:08.660492+0000","last_became_active":"2024-04-19T02:19:54.930075+0000","last_became_peered":"2024-04-19T02:19:54.930075+0000","last_unstale":"2024-04-19T02:20:08.660492+0000","last_undegraded":"2024-04-19T02:20:08.660492+0000","last_fullsized":"2024-04-19T02:20:08.660492+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:00.512431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.982135+0000","last_change":"2024-04-19T02:19:54.931617+0000","last_active":"2024-04-19T02:20:07.982135+0000","last_peered":"2024-04-19T02:20:07.982135+0000","last_clean":"2024-04-19T02:20:07.982135+0000","last_became_active":"2024-04-19T02:19:54.928496+0000","last_became_peered":"2024-04-19T02:19:54.928496+0000","last_unstale":"2024-04-19T02:20:07.982135+0000","last_undegraded":"2024-04-19T02:20:07.982135+0000","last_fullsized":"2024-04-19T02:20:07.982135+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:56:50.232031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":59,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661471+0000","last_change":"2024-04-19T02:16:30.093524+0000","last_active":"2024-04-19T02:20:08.661471+0000","last_peered":"2024-04-19T02:20:08.661471+0000","last_clean":"2024-04-19T02:20:08.661471+0000","last_became_active":"2024-04-19T02:16:30.093344+0000","last_became_peered":"2024-04-19T02:16:30.093344+0000","last_unstale":"2024-04-19T02:20:08.661471+0000","last_undegraded":"2024-04-19T02:20:08.661471+0000","last_fullsized":"2024-04-19T02:20:08.661471+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:14:40.293159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661398+0000","last_change":"2024-04-19T02:19:54.926754+0000","last_active":"2024-04-19T02:20:08.661398+0000","last_peered":"2024-04-19T02:20:08.661398+0000","last_clean":"2024-04-19T02:20:08.661398+0000","last_became_active":"2024-04-19T02:19:54.926040+0000","last_became_peered":"2024-04-19T02:19:54.926040+0000","last_unstale":"2024-04-19T02:20:08.661398+0000","last_undegraded":"2024-04-19T02:20:08.661398+0000","last_fullsized":"2024-04-19T02:20:08.661398+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:36:16.313500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.665922+0000","last_change":"2024-04-19T02:20:08.662601+0000","last_active":"2024-04-19T02:20:08.665922+0000","last_peered":"2024-04-19T02:20:08.665922+0000","last_clean":"2024-04-19T02:20:08.665922+0000","last_became_active":"2024-04-19T02:20:08.662234+0000","last_became_peered":"2024-04-19T02:20:08.662234+0000","last_unstale":"2024-04-19T02:20:08.665922+0000","last_undegraded":"2024-04-19T02:20:08.665922+0000","last_fullsized":"2024-04-19T02:20:08.665922+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:34:06.694985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":54,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981515+0000","last_change":"2024-04-19T02:19:54.932576+0000","last_active":"2024-04-19T02:20:07.981515+0000","last_peered":"2024-04-19T02:20:07.981515+0000","last_clean":"2024-04-19T02:20:07.981515+0000","last_became_active":"2024-04-19T02:19:54.932240+0000","last_became_peered":"2024-04-19T02:19:54.932240+0000","last_unstale":"2024-04-19T02:20:07.981515+0000","last_undegraded":"2024-04-19T02:20:07.981515+0000","last_fullsized":"2024-04-19T02:20:07.981515+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:10:10.453676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661084+0000","last_change":"2024-04-19T02:15:29.284262+0000","last_active":"2024-04-19T02:20:08.661084+0000","last_peered":"2024-04-19T02:20:08.661084+0000","last_clean":"2024-04-19T02:20:08.661084+0000","last_became_active":"2024-04-19T02:15:29.283121+0000","last_became_peered":"2024-04-19T02:15:29.283121+0000","last_unstale":"2024-04-19T02:20:08.661084+0000","last_undegraded":"2024-04-19T02:20:08.661084+0000","last_fullsized":"2024-04-19T02:20:08.661084+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660877+0000","last_change":"2024-04-19T02:15:29.285139+0000","last_active":"2024-04-19T02:20:08.660877+0000","last_peered":"2024-04-19T02:20:08.660877+0000","last_clean":"2024-04-19T02:20:08.660877+0000","last_became_active":"2024-04-19T02:15:29.284649+0000","last_became_peered":"2024-04-19T02:15:29.284649+0000","last_unstale":"2024-04-19T02:20:08.660877+0000","last_undegraded":"2024-04-19T02:20:08.660877+0000","last_fullsized":"2024-04-19T02:20:08.660877+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660809+0000","last_change":"2024-04-19T02:19:54.931033+0000","last_active":"2024-04-19T02:20:08.660809+0000","last_peered":"2024-04-19T02:20:08.660809+0000","last_clean":"2024-04-19T02:20:08.660809+0000","last_became_active":"2024-04-19T02:19:54.930437+0000","last_became_peered":"2024-04-19T02:19:54.930437+0000","last_unstale":"2024-04-19T02:20:08.660809+0000","last_undegraded":"2024-04-19T02:20:08.660809+0000","last_fullsized":"2024-04-19T02:20:08.660809+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:44:05.807254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":32,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-19T02:20:07.982061+0000","last_change":"2024-04-19T02:19:54.921061+0000","last_active":"2024-04-19T02:19:54.921061+0000","last_peered":"2024-04-19T02:19:53.557856+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"2024-04-19T02:17:08.252165+0000","last_became_peered":"2024-04-19T02:17:08.252165+0000","last_unstale":"2024-04-19T02:20:07.982061+0000","last_undegraded":"2024-04-19T02:20:07.982061+0000","last_fullsized":"2024-04-19T02:20:07.982061+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:55:24.944798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996199+0000","last_change":"2024-04-19T02:19:54.933452+0000","last_active":"2024-04-19T02:20:08.996199+0000","last_peered":"2024-04-19T02:20:08.996199+0000","last_clean":"2024-04-19T02:20:08.996199+0000","last_became_active":"2024-04-19T02:19:54.933233+0000","last_became_peered":"2024-04-19T02:19:54.933233+0000","last_unstale":"2024-04-19T02:20:08.996199+0000","last_undegraded":"2024-04-19T02:20:08.996199+0000","last_fullsized":"2024-04-19T02:20:08.996199+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:50.712874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981674+0000","last_change":"2024-04-19T02:19:54.925745+0000","last_active":"2024-04-19T02:20:07.981674+0000","last_peered":"2024-04-19T02:20:07.981674+0000","last_clean":"2024-04-19T02:20:07.981674+0000","last_became_active":"2024-04-19T02:19:54.925060+0000","last_became_peered":"2024-04-19T02:19:54.925060+0000","last_unstale":"2024-04-19T02:20:07.981674+0000","last_undegraded":"2024-04-19T02:20:07.981674+0000","last_fullsized":"2024-04-19T02:20:07.981674+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:12:43.617806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661041+0000","last_change":"2024-04-19T02:19:54.927206+0000","last_active":"2024-04-19T02:20:08.661041+0000","last_peered":"2024-04-19T02:20:08.661041+0000","last_clean":"2024-04-19T02:20:08.661041+0000","last_became_active":"2024-04-19T02:19:54.926442+0000","last_became_peered":"2024-04-19T02:19:54.926442+0000","last_unstale":"2024-04-19T02:20:08.661041+0000","last_undegraded":"2024-04-19T02:20:08.661041+0000","last_fullsized":"2024-04-19T02:20:08.661041+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:27:17.095030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660768+0000","last_change":"2024-04-19T02:19:54.932532+0000","last_active":"2024-04-19T02:20:08.660768+0000","last_peered":"2024-04-19T02:20:08.660768+0000","last_clean":"2024-04-19T02:20:08.660768+0000","last_became_active":"2024-04-19T02:19:54.931438+0000","last_became_peered":"2024-04-19T02:19:54.931438+0000","last_unstale":"2024-04-19T02:20:08.660768+0000","last_undegraded":"2024-04-19T02:20:08.660768+0000","last_fullsized":"2024-04-19T02:20:08.660768+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:12:54.241778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.665603+0000","last_change":"2024-04-19T02:20:08.662261+0000","last_active":"2024-04-19T02:20:08.665603+0000","last_peered":"2024-04-19T02:20:08.665603+0000","last_clean":"2024-04-19T02:20:08.665603+0000","last_became_active":"2024-04-19T02:20:08.661940+0000","last_became_peered":"2024-04-19T02:20:08.661940+0000","last_unstale":"2024-04-19T02:20:08.665603+0000","last_undegraded":"2024-04-19T02:20:08.665603+0000","last_fullsized":"2024-04-19T02:20:08.665603+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:49:34.835266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":45,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T02:20:06.743619+0000","last_change":"2024-04-19T02:19:54.926885+0000","last_active":"2024-04-19T02:20:06.743619+0000","last_peered":"2024-04-19T02:20:06.743619+0000","last_clean":"2024-04-19T02:20:06.743619+0000","last_became_active":"2024-04-19T02:19:54.925939+0000","last_became_peered":"2024-04-19T02:19:54.925939+0000","last_unstale":"2024-04-19T02:20:06.743619+0000","last_undegraded":"2024-04-19T02:20:06.743619+0000","last_fullsized":"2024-04-19T02:20:06.743619+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:46:16.763335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981244+0000","last_change":"2024-04-19T02:19:54.928467+0000","last_active":"2024-04-19T02:20:07.981244+0000","last_peered":"2024-04-19T02:20:07.981244+0000","last_clean":"2024-04-19T02:20:07.981244+0000","last_became_active":"2024-04-19T02:19:54.928261+0000","last_became_peered":"2024-04-19T02:19:54.928261+0000","last_unstale":"2024-04-19T02:20:07.981244+0000","last_undegraded":"2024-04-19T02:20:07.981244+0000","last_fullsized":"2024-04-19T02:20:07.981244+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:40:43.645134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.983032+0000","last_change":"2024-04-19T02:15:29.278084+0000","last_active":"2024-04-19T02:20:07.983032+0000","last_peered":"2024-04-19T02:20:07.983032+0000","last_clean":"2024-04-19T02:20:07.983032+0000","last_became_active":"2024-04-19T02:15:29.276952+0000","last_became_peered":"2024-04-19T02:15:29.276952+0000","last_unstale":"2024-04-19T02:20:07.983032+0000","last_undegraded":"2024-04-19T02:20:07.983032+0000","last_fullsized":"2024-04-19T02:20:07.983032+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.982065+0000","last_change":"2024-04-19T02:19:54.933154+0000","last_active":"2024-04-19T02:20:07.982065+0000","last_peered":"2024-04-19T02:20:07.982065+0000","last_clean":"2024-04-19T02:20:07.982065+0000","last_became_active":"2024-04-19T02:19:54.931124+0000","last_became_peered":"2024-04-19T02:19:54.931124+0000","last_unstale":"2024-04-19T02:20:07.982065+0000","last_undegraded":"2024-04-19T02:20:07.982065+0000","last_fullsized":"2024-04-19T02:20:07.982065+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:49.555501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661389+0000","last_change":"2024-04-19T02:15:29.287389+0000","last_active":"2024-04-19T02:20:08.661389+0000","last_peered":"2024-04-19T02:20:08.661389+0000","last_clean":"2024-04-19T02:20:08.661389+0000","last_became_active":"2024-04-19T02:15:29.286431+0000","last_became_peered":"2024-04-19T02:15:29.286431+0000","last_unstale":"2024-04-19T02:20:08.661389+0000","last_undegraded":"2024-04-19T02:20:08.661389+0000","last_fullsized":"2024-04-19T02:20:08.661389+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:58:30.117887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":56,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981516+0000","last_change":"2024-04-19T02:19:54.927108+0000","last_active":"2024-04-19T02:20:07.981516+0000","last_peered":"2024-04-19T02:20:07.981516+0000","last_clean":"2024-04-19T02:20:07.981516+0000","last_became_active":"2024-04-19T02:19:54.926838+0000","last_became_peered":"2024-04-19T02:19:54.926838+0000","last_unstale":"2024-04-19T02:20:07.981516+0000","last_undegraded":"2024-04-19T02:20:07.981516+0000","last_fullsized":"2024-04-19T02:20:07.981516+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:25:27.561607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":76,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.982866+0000","last_change":"2024-04-19T02:15:29.281792+0000","last_active":"2024-04-19T02:20:07.982866+0000","last_peered":"2024-04-19T02:20:07.982866+0000","last_clean":"2024-04-19T02:20:07.982866+0000","last_became_active":"2024-04-19T02:15:29.280479+0000","last_became_peered":"2024-04-19T02:15:29.280479+0000","last_unstale":"2024-04-19T02:20:07.982866+0000","last_undegraded":"2024-04-19T02:20:07.982866+0000","last_fullsized":"2024-04-19T02:20:07.982866+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.980982+0000","last_change":"2024-04-19T02:19:54.925277+0000","last_active":"2024-04-19T02:20:07.980982+0000","last_peered":"2024-04-19T02:20:07.980982+0000","last_clean":"2024-04-19T02:20:07.980982+0000","last_became_active":"2024-04-19T02:19:54.924484+0000","last_became_peered":"2024-04-19T02:19:54.924484+0000","last_unstale":"2024-04-19T02:20:07.980982+0000","last_undegraded":"2024-04-19T02:20:07.980982+0000","last_fullsized":"2024-04-19T02:20:07.980982+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:57:54.845371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":45,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T02:20:06.744283+0000","last_change":"2024-04-19T02:19:54.931673+0000","last_active":"2024-04-19T02:20:06.744283+0000","last_peered":"2024-04-19T02:20:06.744283+0000","last_clean":"2024-04-19T02:20:06.744283+0000","last_became_active":"2024-04-19T02:19:54.931162+0000","last_became_peered":"2024-04-19T02:19:54.931162+0000","last_unstale":"2024-04-19T02:20:06.744283+0000","last_undegraded":"2024-04-19T02:20:06.744283+0000","last_fullsized":"2024-04-19T02:20:06.744283+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:42:40.944146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.980970+0000","last_change":"2024-04-19T02:19:54.930346+0000","last_active":"2024-04-19T02:20:07.980970+0000","last_peered":"2024-04-19T02:20:07.980970+0000","last_clean":"2024-04-19T02:20:07.980970+0000","last_became_active":"2024-04-19T02:19:54.928398+0000","last_became_peered":"2024-04-19T02:19:54.928398+0000","last_unstale":"2024-04-19T02:20:07.980970+0000","last_undegraded":"2024-04-19T02:20:07.980970+0000","last_fullsized":"2024-04-19T02:20:07.980970+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:46.321275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.982989+0000","last_change":"2024-04-19T02:15:29.280879+0000","last_active":"2024-04-19T02:20:07.982989+0000","last_peered":"2024-04-19T02:20:07.982989+0000","last_clean":"2024-04-19T02:20:07.982989+0000","last_became_active":"2024-04-19T02:15:29.279314+0000","last_became_peered":"2024-04-19T02:15:29.279314+0000","last_unstale":"2024-04-19T02:20:07.982989+0000","last_undegraded":"2024-04-19T02:20:07.982989+0000","last_fullsized":"2024-04-19T02:20:07.982989+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.982154+0000","last_change":"2024-04-19T02:19:54.927744+0000","last_active":"2024-04-19T02:20:07.982154+0000","last_peered":"2024-04-19T02:20:07.982154+0000","last_clean":"2024-04-19T02:20:07.982154+0000","last_became_active":"2024-04-19T02:19:54.925729+0000","last_became_peered":"2024-04-19T02:19:54.925729+0000","last_unstale":"2024-04-19T02:20:07.982154+0000","last_undegraded":"2024-04-19T02:20:07.982154+0000","last_fullsized":"2024-04-19T02:20:07.982154+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:27:57.229684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.980870+0000","last_change":"2024-04-19T02:19:54.928435+0000","last_active":"2024-04-19T02:20:07.980870+0000","last_peered":"2024-04-19T02:20:07.980870+0000","last_clean":"2024-04-19T02:20:07.980870+0000","last_became_active":"2024-04-19T02:19:54.927666+0000","last_became_peered":"2024-04-19T02:19:54.927666+0000","last_unstale":"2024-04-19T02:20:07.980870+0000","last_undegraded":"2024-04-19T02:20:07.980870+0000","last_fullsized":"2024-04-19T02:20:07.980870+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:20:45.000808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661594+0000","last_change":"2024-04-19T02:19:54.932025+0000","last_active":"2024-04-19T02:20:08.661594+0000","last_peered":"2024-04-19T02:20:08.661594+0000","last_clean":"2024-04-19T02:20:08.661594+0000","last_became_active":"2024-04-19T02:19:54.931540+0000","last_became_peered":"2024-04-19T02:19:54.931540+0000","last_unstale":"2024-04-19T02:20:08.661594+0000","last_undegraded":"2024-04-19T02:20:08.661594+0000","last_fullsized":"2024-04-19T02:20:08.661594+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:03:31.479331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981285+0000","last_change":"2024-04-19T02:19:54.924493+0000","last_active":"2024-04-19T02:20:07.981285+0000","last_peered":"2024-04-19T02:20:07.981285+0000","last_clean":"2024-04-19T02:20:07.981285+0000","last_became_active":"2024-04-19T02:19:54.923784+0000","last_became_peered":"2024-04-19T02:19:54.923784+0000","last_unstale":"2024-04-19T02:20:07.981285+0000","last_undegraded":"2024-04-19T02:20:07.981285+0000","last_fullsized":"2024-04-19T02:20:07.981285+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:09:34.378788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":80,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.982511+0000","last_change":"2024-04-19T02:15:28.892937+0000","last_active":"2024-04-19T02:20:07.982511+0000","last_peered":"2024-04-19T02:20:07.982511+0000","last_clean":"2024-04-19T02:20:07.982511+0000","last_became_active":"2024-04-19T02:15:28.891440+0000","last_became_peered":"2024-04-19T02:15:28.891440+0000","last_unstale":"2024-04-19T02:20:07.982511+0000","last_undegraded":"2024-04-19T02:20:07.982511+0000","last_fullsized":"2024-04-19T02:20:07.982511+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981039+0000","last_change":"2024-04-19T02:19:54.923898+0000","last_active":"2024-04-19T02:20:07.981039+0000","last_peered":"2024-04-19T02:20:07.981039+0000","last_clean":"2024-04-19T02:20:07.981039+0000","last_became_active":"2024-04-19T02:19:54.923493+0000","last_became_peered":"2024-04-19T02:19:54.923493+0000","last_unstale":"2024-04-19T02:20:07.981039+0000","last_undegraded":"2024-04-19T02:20:07.981039+0000","last_fullsized":"2024-04-19T02:20:07.981039+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:33.123319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660931+0000","last_change":"2024-04-19T02:15:28.891097+0000","last_active":"2024-04-19T02:20:08.660931+0000","last_peered":"2024-04-19T02:20:08.660931+0000","last_clean":"2024-04-19T02:20:08.660931+0000","last_became_active":"2024-04-19T02:15:28.890795+0000","last_became_peered":"2024-04-19T02:15:28.890795+0000","last_unstale":"2024-04-19T02:20:08.660931+0000","last_undegraded":"2024-04-19T02:20:08.660931+0000","last_fullsized":"2024-04-19T02:20:08.660931+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661095+0000","last_change":"2024-04-19T02:15:29.278546+0000","last_active":"2024-04-19T02:20:08.661095+0000","last_peered":"2024-04-19T02:20:08.661095+0000","last_clean":"2024-04-19T02:20:08.661095+0000","last_became_active":"2024-04-19T02:15:29.277547+0000","last_became_peered":"2024-04-19T02:15:29.277547+0000","last_unstale":"2024-04-19T02:20:08.661095+0000","last_undegraded":"2024-04-19T02:20:08.661095+0000","last_fullsized":"2024-04-19T02:20:08.661095+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661075+0000","last_change":"2024-04-19T02:19:54.933035+0000","last_active":"2024-04-19T02:20:08.661075+0000","last_peered":"2024-04-19T02:20:08.661075+0000","last_clean":"2024-04-19T02:20:08.661075+0000","last_became_active":"2024-04-19T02:19:54.932829+0000","last_became_peered":"2024-04-19T02:19:54.932829+0000","last_unstale":"2024-04-19T02:20:08.661075+0000","last_undegraded":"2024-04-19T02:20:08.661075+0000","last_fullsized":"2024-04-19T02:20:08.661075+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:09:05.626623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.988868+0000","last_change":"2024-04-19T02:20:07.983368+0000","last_active":"2024-04-19T02:20:07.988868+0000","last_peered":"2024-04-19T02:20:07.988868+0000","last_clean":"2024-04-19T02:20:07.988868+0000","last_became_active":"2024-04-19T02:20:07.983080+0000","last_became_peered":"2024-04-19T02:20:07.983080+0000","last_unstale":"2024-04-19T02:20:07.988868+0000","last_undegraded":"2024-04-19T02:20:07.988868+0000","last_fullsized":"2024-04-19T02:20:07.988868+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:24.138269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981065+0000","last_change":"2024-04-19T02:19:54.927323+0000","last_active":"2024-04-19T02:20:07.981065+0000","last_peered":"2024-04-19T02:20:07.981065+0000","last_clean":"2024-04-19T02:20:07.981065+0000","last_became_active":"2024-04-19T02:19:54.925703+0000","last_became_peered":"2024-04-19T02:19:54.925703+0000","last_unstale":"2024-04-19T02:20:07.981065+0000","last_undegraded":"2024-04-19T02:20:07.981065+0000","last_fullsized":"2024-04-19T02:20:07.981065+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:46:59.533765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":54,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.982823+0000","last_change":"2024-04-19T02:19:54.925918+0000","last_active":"2024-04-19T02:20:07.982823+0000","last_peered":"2024-04-19T02:20:07.982823+0000","last_clean":"2024-04-19T02:20:07.982823+0000","last_became_active":"2024-04-19T02:19:54.925634+0000","last_became_peered":"2024-04-19T02:19:54.925634+0000","last_unstale":"2024-04-19T02:20:07.982823+0000","last_undegraded":"2024-04-19T02:20:07.982823+0000","last_fullsized":"2024-04-19T02:20:07.982823+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:14:13.074455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996285+0000","last_change":"2024-04-19T02:15:28.892934+0000","last_active":"2024-04-19T02:20:08.996285+0000","last_peered":"2024-04-19T02:20:08.996285+0000","last_clean":"2024-04-19T02:20:08.996285+0000","last_became_active":"2024-04-19T02:15:28.891879+0000","last_became_peered":"2024-04-19T02:15:28.891879+0000","last_unstale":"2024-04-19T02:20:08.996285+0000","last_undegraded":"2024-04-19T02:20:08.996285+0000","last_fullsized":"2024-04-19T02:20:08.996285+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:10:12.514798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":45,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T02:20:06.744343+0000","last_change":"2024-04-19T02:19:54.931909+0000","last_active":"2024-04-19T02:20:06.744343+0000","last_peered":"2024-04-19T02:20:06.744343+0000","last_clean":"2024-04-19T02:20:06.744343+0000","last_became_active":"2024-04-19T02:19:54.931301+0000","last_became_peered":"2024-04-19T02:19:54.931301+0000","last_unstale":"2024-04-19T02:20:06.744343+0000","last_undegraded":"2024-04-19T02:20:06.744343+0000","last_fullsized":"2024-04-19T02:20:06.744343+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:10:08.224575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993693+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:20:08.993693+0000","last_peered":"2024-04-19T02:20:08.993693+0000","last_clean":"2024-04-19T02:20:08.993693+0000","last_became_active":"2024-04-19T02:15:28.890882+0000","last_became_peered":"2024-04-19T02:15:28.890882+0000","last_unstale":"2024-04-19T02:20:08.993693+0000","last_undegraded":"2024-04-19T02:20:08.993693+0000","last_fullsized":"2024-04-19T02:20:08.993693+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:31.673938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.982282+0000","last_change":"2024-04-19T02:19:54.927209+0000","last_active":"2024-04-19T02:20:07.982282+0000","last_peered":"2024-04-19T02:20:07.982282+0000","last_clean":"2024-04-19T02:20:07.982282+0000","last_became_active":"2024-04-19T02:19:54.925121+0000","last_became_peered":"2024-04-19T02:19:54.925121+0000","last_unstale":"2024-04-19T02:20:07.982282+0000","last_undegraded":"2024-04-19T02:20:07.982282+0000","last_fullsized":"2024-04-19T02:20:07.982282+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:16:21.982909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":80,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661726+0000","last_change":"2024-04-19T02:15:28.890265+0000","last_active":"2024-04-19T02:20:08.661726+0000","last_peered":"2024-04-19T02:20:08.661726+0000","last_clean":"2024-04-19T02:20:08.661726+0000","last_became_active":"2024-04-19T02:15:28.890004+0000","last_became_peered":"2024-04-19T02:15:28.890004+0000","last_unstale":"2024-04-19T02:20:08.661726+0000","last_undegraded":"2024-04-19T02:20:08.661726+0000","last_fullsized":"2024-04-19T02:20:08.661726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:02.517101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.980972+0000","last_change":"2024-04-19T02:15:29.285529+0000","last_active":"2024-04-19T02:20:07.980972+0000","last_peered":"2024-04-19T02:20:07.980972+0000","last_clean":"2024-04-19T02:20:07.980972+0000","last_became_active":"2024-04-19T02:15:29.285197+0000","last_became_peered":"2024-04-19T02:15:29.285197+0000","last_unstale":"2024-04-19T02:20:07.980972+0000","last_undegraded":"2024-04-19T02:20:07.980972+0000","last_fullsized":"2024-04-19T02:20:07.980972+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":80,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.982535+0000","last_change":"2024-04-19T02:15:28.893902+0000","last_active":"2024-04-19T02:20:07.982535+0000","last_peered":"2024-04-19T02:20:07.982535+0000","last_clean":"2024-04-19T02:20:07.982535+0000","last_became_active":"2024-04-19T02:15:28.893231+0000","last_became_peered":"2024-04-19T02:15:28.893231+0000","last_unstale":"2024-04-19T02:20:07.982535+0000","last_undegraded":"2024-04-19T02:20:07.982535+0000","last_fullsized":"2024-04-19T02:20:07.982535+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:23.658442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981713+0000","last_change":"2024-04-19T02:19:54.925840+0000","last_active":"2024-04-19T02:20:07.981713+0000","last_peered":"2024-04-19T02:20:07.981713+0000","last_clean":"2024-04-19T02:20:07.981713+0000","last_became_active":"2024-04-19T02:19:54.925502+0000","last_became_peered":"2024-04-19T02:19:54.925502+0000","last_unstale":"2024-04-19T02:20:07.981713+0000","last_undegraded":"2024-04-19T02:20:07.981713+0000","last_fullsized":"2024-04-19T02:20:07.981713+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:57.667340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":80,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661502+0000","last_change":"2024-04-19T02:15:28.891234+0000","last_active":"2024-04-19T02:20:08.661502+0000","last_peered":"2024-04-19T02:20:08.661502+0000","last_clean":"2024-04-19T02:20:08.661502+0000","last_became_active":"2024-04-19T02:15:28.890881+0000","last_became_peered":"2024-04-19T02:15:28.890881+0000","last_unstale":"2024-04-19T02:20:08.661502+0000","last_undegraded":"2024-04-19T02:20:08.661502+0000","last_fullsized":"2024-04-19T02:20:08.661502+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661157+0000","last_change":"2024-04-19T02:19:54.926103+0000","last_active":"2024-04-19T02:20:08.661157+0000","last_peered":"2024-04-19T02:20:08.661157+0000","last_clean":"2024-04-19T02:20:08.661157+0000","last_became_active":"2024-04-19T02:19:54.925591+0000","last_became_peered":"2024-04-19T02:19:54.925591+0000","last_unstale":"2024-04-19T02:20:08.661157+0000","last_undegraded":"2024-04-19T02:20:08.661157+0000","last_fullsized":"2024-04-19T02:20:08.661157+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:44:40.560973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":92,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660748+0000","last_change":"2024-04-19T02:19:54.926813+0000","last_active":"2024-04-19T02:20:08.660748+0000","last_peered":"2024-04-19T02:20:08.660748+0000","last_clean":"2024-04-19T02:20:08.660748+0000","last_became_active":"2024-04-19T02:19:54.925523+0000","last_became_peered":"2024-04-19T02:19:54.925523+0000","last_unstale":"2024-04-19T02:20:08.660748+0000","last_undegraded":"2024-04-19T02:20:08.660748+0000","last_fullsized":"2024-04-19T02:20:08.660748+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:39:56.887385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981499+0000","last_change":"2024-04-19T02:19:54.932306+0000","last_active":"2024-04-19T02:20:07.981499+0000","last_peered":"2024-04-19T02:20:07.981499+0000","last_clean":"2024-04-19T02:20:07.981499+0000","last_became_active":"2024-04-19T02:19:54.930843+0000","last_became_peered":"2024-04-19T02:19:54.930843+0000","last_unstale":"2024-04-19T02:20:07.981499+0000","last_undegraded":"2024-04-19T02:20:07.981499+0000","last_fullsized":"2024-04-19T02:20:07.981499+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:24:51.884048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981355+0000","last_change":"2024-04-19T02:19:54.932708+0000","last_active":"2024-04-19T02:20:07.981355+0000","last_peered":"2024-04-19T02:20:07.981355+0000","last_clean":"2024-04-19T02:20:07.981355+0000","last_became_active":"2024-04-19T02:19:54.931553+0000","last_became_peered":"2024-04-19T02:19:54.931553+0000","last_unstale":"2024-04-19T02:20:07.981355+0000","last_undegraded":"2024-04-19T02:20:07.981355+0000","last_fullsized":"2024-04-19T02:20:07.981355+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:47:07.651618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660749+0000","last_change":"2024-04-19T02:19:54.927009+0000","last_active":"2024-04-19T02:20:08.660749+0000","last_peered":"2024-04-19T02:20:08.660749+0000","last_clean":"2024-04-19T02:20:08.660749+0000","last_became_active":"2024-04-19T02:19:54.925645+0000","last_became_peered":"2024-04-19T02:19:54.925645+0000","last_unstale":"2024-04-19T02:20:08.660749+0000","last_undegraded":"2024-04-19T02:20:08.660749+0000","last_fullsized":"2024-04-19T02:20:08.660749+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:33:45.685463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":92,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660643+0000","last_change":"2024-04-19T02:19:54.923689+0000","last_active":"2024-04-19T02:20:08.660643+0000","last_peered":"2024-04-19T02:20:08.660643+0000","last_clean":"2024-04-19T02:20:08.660643+0000","last_became_active":"2024-04-19T02:19:54.923321+0000","last_became_peered":"2024-04-19T02:19:54.923321+0000","last_unstale":"2024-04-19T02:20:08.660643+0000","last_undegraded":"2024-04-19T02:20:08.660643+0000","last_fullsized":"2024-04-19T02:20:08.660643+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:03:01.578244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661714+0000","last_change":"2024-04-19T02:15:29.285019+0000","last_active":"2024-04-19T02:20:08.661714+0000","last_peered":"2024-04-19T02:20:08.661714+0000","last_clean":"2024-04-19T02:20:08.661714+0000","last_became_active":"2024-04-19T02:15:29.284650+0000","last_became_peered":"2024-04-19T02:15:29.284650+0000","last_unstale":"2024-04-19T02:20:08.661714+0000","last_undegraded":"2024-04-19T02:20:08.661714+0000","last_fullsized":"2024-04-19T02:20:08.661714+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.665914+0000","last_change":"2024-04-19T02:20:08.662566+0000","last_active":"2024-04-19T02:20:08.665914+0000","last_peered":"2024-04-19T02:20:08.665914+0000","last_clean":"2024-04-19T02:20:08.665914+0000","last_became_active":"2024-04-19T02:20:08.662277+0000","last_became_peered":"2024-04-19T02:20:08.662277+0000","last_unstale":"2024-04-19T02:20:08.665914+0000","last_undegraded":"2024-04-19T02:20:08.665914+0000","last_fullsized":"2024-04-19T02:20:08.665914+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:36:27.307955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661617+0000","last_change":"2024-04-19T02:15:29.287190+0000","last_active":"2024-04-19T02:20:08.661617+0000","last_peered":"2024-04-19T02:20:08.661617+0000","last_clean":"2024-04-19T02:20:08.661617+0000","last_became_active":"2024-04-19T02:15:29.286606+0000","last_became_peered":"2024-04-19T02:15:29.286606+0000","last_unstale":"2024-04-19T02:20:08.661617+0000","last_undegraded":"2024-04-19T02:20:08.661617+0000","last_fullsized":"2024-04-19T02:20:08.661617+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:28.387062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981146+0000","last_change":"2024-04-19T02:19:54.928493+0000","last_active":"2024-04-19T02:20:07.981146+0000","last_peered":"2024-04-19T02:20:07.981146+0000","last_clean":"2024-04-19T02:20:07.981146+0000","last_became_active":"2024-04-19T02:19:54.928298+0000","last_became_peered":"2024-04-19T02:19:54.928298+0000","last_unstale":"2024-04-19T02:20:07.981146+0000","last_undegraded":"2024-04-19T02:20:07.981146+0000","last_fullsized":"2024-04-19T02:20:07.981146+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:11:54.564261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.982056+0000","last_change":"2024-04-19T02:19:54.930452+0000","last_active":"2024-04-19T02:20:07.982056+0000","last_peered":"2024-04-19T02:20:07.982056+0000","last_clean":"2024-04-19T02:20:07.982056+0000","last_became_active":"2024-04-19T02:19:54.927309+0000","last_became_peered":"2024-04-19T02:19:54.927309+0000","last_unstale":"2024-04-19T02:20:07.982056+0000","last_undegraded":"2024-04-19T02:20:07.982056+0000","last_fullsized":"2024-04-19T02:20:07.982056+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:56:20.174957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":32,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-19T02:20:07.982091+0000","last_change":"2024-04-19T02:19:54.916264+0000","last_active":"2024-04-19T02:19:54.916264+0000","last_peered":"2024-04-19T02:19:53.557205+0000","last_clean":"2024-04-19T02:15:23.520722+0000","last_became_active":"2024-04-19T02:17:08.249349+0000","last_became_peered":"2024-04-19T02:17:08.249349+0000","last_unstale":"2024-04-19T02:20:07.982091+0000","last_undegraded":"2024-04-19T02:20:07.982091+0000","last_fullsized":"2024-04-19T02:20:07.982091+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:40.613587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":92,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661604+0000","last_change":"2024-04-19T02:19:54.926207+0000","last_active":"2024-04-19T02:20:08.661604+0000","last_peered":"2024-04-19T02:20:08.661604+0000","last_clean":"2024-04-19T02:20:08.661604+0000","last_became_active":"2024-04-19T02:19:54.925872+0000","last_became_peered":"2024-04-19T02:19:54.925872+0000","last_unstale":"2024-04-19T02:20:08.661604+0000","last_undegraded":"2024-04-19T02:20:08.661604+0000","last_fullsized":"2024-04-19T02:20:08.661604+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:31:46.734042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981815+0000","last_change":"2024-04-19T02:15:29.277922+0000","last_active":"2024-04-19T02:20:07.981815+0000","last_peered":"2024-04-19T02:20:07.981815+0000","last_clean":"2024-04-19T02:20:07.981815+0000","last_became_active":"2024-04-19T02:15:29.276968+0000","last_became_peered":"2024-04-19T02:15:29.276968+0000","last_unstale":"2024-04-19T02:20:07.981815+0000","last_undegraded":"2024-04-19T02:20:07.981815+0000","last_fullsized":"2024-04-19T02:20:07.981815+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":95,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660974+0000","last_change":"2024-04-19T02:19:54.927361+0000","last_active":"2024-04-19T02:20:08.660974+0000","last_peered":"2024-04-19T02:20:08.660974+0000","last_clean":"2024-04-19T02:20:08.660974+0000","last_became_active":"2024-04-19T02:19:54.927033+0000","last_became_peered":"2024-04-19T02:19:54.927033+0000","last_unstale":"2024-04-19T02:20:08.660974+0000","last_undegraded":"2024-04-19T02:20:08.660974+0000","last_fullsized":"2024-04-19T02:20:08.660974+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:07.194915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":92,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660955+0000","last_change":"2024-04-19T02:19:54.932790+0000","last_active":"2024-04-19T02:20:08.660955+0000","last_peered":"2024-04-19T02:20:08.660955+0000","last_clean":"2024-04-19T02:20:08.660955+0000","last_became_active":"2024-04-19T02:19:54.931683+0000","last_became_peered":"2024-04-19T02:19:54.931683+0000","last_unstale":"2024-04-19T02:20:08.660955+0000","last_undegraded":"2024-04-19T02:20:08.660955+0000","last_fullsized":"2024-04-19T02:20:08.660955+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:23:00.124845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981515+0000","last_change":"2024-04-19T02:19:54.926109+0000","last_active":"2024-04-19T02:20:07.981515+0000","last_peered":"2024-04-19T02:20:07.981515+0000","last_clean":"2024-04-19T02:20:07.981515+0000","last_became_active":"2024-04-19T02:19:54.924686+0000","last_became_peered":"2024-04-19T02:19:54.924686+0000","last_unstale":"2024-04-19T02:20:07.981515+0000","last_undegraded":"2024-04-19T02:20:07.981515+0000","last_fullsized":"2024-04-19T02:20:07.981515+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:20:03.487999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981372+0000","last_change":"2024-04-19T02:19:54.923465+0000","last_active":"2024-04-19T02:20:07.981372+0000","last_peered":"2024-04-19T02:20:07.981372+0000","last_clean":"2024-04-19T02:20:07.981372+0000","last_became_active":"2024-04-19T02:19:54.923164+0000","last_became_peered":"2024-04-19T02:19:54.923164+0000","last_unstale":"2024-04-19T02:20:07.981372+0000","last_undegraded":"2024-04-19T02:20:07.981372+0000","last_fullsized":"2024-04-19T02:20:07.981372+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:53:29.520848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.665628+0000","last_change":"2024-04-19T02:20:08.662301+0000","last_active":"2024-04-19T02:20:08.665628+0000","last_peered":"2024-04-19T02:20:08.665628+0000","last_clean":"2024-04-19T02:20:08.665628+0000","last_became_active":"2024-04-19T02:20:08.661952+0000","last_became_peered":"2024-04-19T02:20:08.661952+0000","last_unstale":"2024-04-19T02:20:08.665628+0000","last_undegraded":"2024-04-19T02:20:08.665628+0000","last_fullsized":"2024-04-19T02:20:08.665628+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:41:21.658836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.982200+0000","last_change":"2024-04-19T02:19:54.930115+0000","last_active":"2024-04-19T02:20:07.982200+0000","last_peered":"2024-04-19T02:20:07.982200+0000","last_clean":"2024-04-19T02:20:07.982200+0000","last_became_active":"2024-04-19T02:19:54.926463+0000","last_became_peered":"2024-04-19T02:19:54.926463+0000","last_unstale":"2024-04-19T02:20:07.982200+0000","last_undegraded":"2024-04-19T02:20:07.982200+0000","last_fullsized":"2024-04-19T02:20:07.982200+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:00.191645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":95,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660877+0000","last_change":"2024-04-19T02:19:54.932929+0000","last_active":"2024-04-19T02:20:08.660877+0000","last_peered":"2024-04-19T02:20:08.660877+0000","last_clean":"2024-04-19T02:20:08.660877+0000","last_became_active":"2024-04-19T02:19:54.932571+0000","last_became_peered":"2024-04-19T02:19:54.932571+0000","last_unstale":"2024-04-19T02:20:08.660877+0000","last_undegraded":"2024-04-19T02:20:08.660877+0000","last_fullsized":"2024-04-19T02:20:08.660877+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:50:08.657036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":278,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660871+0000","last_change":"2024-04-19T02:15:24.533634+0000","last_active":"2024-04-19T02:20:08.660871+0000","last_peered":"2024-04-19T02:20:08.660871+0000","last_clean":"2024-04-19T02:20:08.660871+0000","last_became_active":"2024-04-19T02:15:24.533420+0000","last_became_peered":"2024-04-19T02:15:24.533420+0000","last_unstale":"2024-04-19T02:20:08.660871+0000","last_undegraded":"2024-04-19T02:20:08.660871+0000","last_fullsized":"2024-04-19T02:20:08.660871+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":44,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T02:20:05.964845+0000","last_change":"2024-04-19T02:19:54.924862+0000","last_active":"2024-04-19T02:20:05.964845+0000","last_peered":"2024-04-19T02:20:05.964845+0000","last_clean":"2024-04-19T02:20:05.964845+0000","last_became_active":"2024-04-19T02:19:54.924581+0000","last_became_peered":"2024-04-19T02:19:54.924581+0000","last_unstale":"2024-04-19T02:20:05.964845+0000","last_undegraded":"2024-04-19T02:20:05.964845+0000","last_fullsized":"2024-04-19T02:20:05.964845+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:34:53.681271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661658+0000","last_change":"2024-04-19T02:15:29.285015+0000","last_active":"2024-04-19T02:20:08.661658+0000","last_peered":"2024-04-19T02:20:08.661658+0000","last_clean":"2024-04-19T02:20:08.661658+0000","last_became_active":"2024-04-19T02:15:29.284164+0000","last_became_peered":"2024-04-19T02:15:29.284164+0000","last_unstale":"2024-04-19T02:20:08.661658+0000","last_undegraded":"2024-04-19T02:20:08.661658+0000","last_fullsized":"2024-04-19T02:20:08.661658+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:36.987844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660906+0000","last_change":"2024-04-19T02:15:24.533912+0000","last_active":"2024-04-19T02:20:08.660906+0000","last_peered":"2024-04-19T02:20:08.660906+0000","last_clean":"2024-04-19T02:20:08.660906+0000","last_became_active":"2024-04-19T02:15:24.533580+0000","last_became_peered":"2024-04-19T02:15:24.533580+0000","last_unstale":"2024-04-19T02:20:08.660906+0000","last_undegraded":"2024-04-19T02:20:08.660906+0000","last_fullsized":"2024-04-19T02:20:08.660906+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:45.045477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":45,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T02:20:06.743494+0000","last_change":"2024-04-19T02:19:54.926899+0000","last_active":"2024-04-19T02:20:06.743494+0000","last_peered":"2024-04-19T02:20:06.743494+0000","last_clean":"2024-04-19T02:20:06.743494+0000","last_became_active":"2024-04-19T02:19:54.926346+0000","last_became_peered":"2024-04-19T02:19:54.926346+0000","last_unstale":"2024-04-19T02:20:06.743494+0000","last_undegraded":"2024-04-19T02:20:06.743494+0000","last_fullsized":"2024-04-19T02:20:06.743494+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:35:11.172682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":48,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.991873+0000","last_change":"2024-04-19T02:20:07.986363+0000","last_active":"2024-04-19T02:20:07.991873+0000","last_peered":"2024-04-19T02:20:07.991873+0000","last_clean":"2024-04-19T02:20:07.991873+0000","last_became_active":"2024-04-19T02:20:07.986110+0000","last_became_peered":"2024-04-19T02:20:07.986110+0000","last_unstale":"2024-04-19T02:20:07.991873+0000","last_undegraded":"2024-04-19T02:20:07.991873+0000","last_fullsized":"2024-04-19T02:20:07.991873+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:12.545910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":59,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.982625+0000","last_change":"2024-04-19T02:19:54.925886+0000","last_active":"2024-04-19T02:20:07.982625+0000","last_peered":"2024-04-19T02:20:07.982625+0000","last_clean":"2024-04-19T02:20:07.982625+0000","last_became_active":"2024-04-19T02:19:54.925570+0000","last_became_peered":"2024-04-19T02:19:54.925570+0000","last_unstale":"2024-04-19T02:20:07.982625+0000","last_undegraded":"2024-04-19T02:20:07.982625+0000","last_fullsized":"2024-04-19T02:20:07.982625+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:33:34.594161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981348+0000","last_change":"2024-04-19T02:19:54.933960+0000","last_active":"2024-04-19T02:20:07.981348+0000","last_peered":"2024-04-19T02:20:07.981348+0000","last_clean":"2024-04-19T02:20:07.981348+0000","last_became_active":"2024-04-19T02:19:54.929918+0000","last_became_peered":"2024-04-19T02:19:54.929918+0000","last_unstale":"2024-04-19T02:20:07.981348+0000","last_undegraded":"2024-04-19T02:20:07.981348+0000","last_fullsized":"2024-04-19T02:20:07.981348+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:33:10.282684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981355+0000","last_change":"2024-04-19T02:15:29.281694+0000","last_active":"2024-04-19T02:20:07.981355+0000","last_peered":"2024-04-19T02:20:07.981355+0000","last_clean":"2024-04-19T02:20:07.981355+0000","last_became_active":"2024-04-19T02:15:29.280519+0000","last_became_peered":"2024-04-19T02:15:29.280519+0000","last_unstale":"2024-04-19T02:20:07.981355+0000","last_undegraded":"2024-04-19T02:20:07.981355+0000","last_fullsized":"2024-04-19T02:20:07.981355+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:50.890545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981945+0000","last_change":"2024-04-19T02:19:54.931726+0000","last_active":"2024-04-19T02:20:07.981945+0000","last_peered":"2024-04-19T02:20:07.981945+0000","last_clean":"2024-04-19T02:20:07.981945+0000","last_became_active":"2024-04-19T02:19:54.928460+0000","last_became_peered":"2024-04-19T02:19:54.928460+0000","last_unstale":"2024-04-19T02:20:07.981945+0000","last_undegraded":"2024-04-19T02:20:07.981945+0000","last_fullsized":"2024-04-19T02:20:07.981945+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:07:04.935620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":44,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T02:20:05.965726+0000","last_change":"2024-04-19T02:19:54.932487+0000","last_active":"2024-04-19T02:20:05.965726+0000","last_peered":"2024-04-19T02:20:05.965726+0000","last_clean":"2024-04-19T02:20:05.965726+0000","last_became_active":"2024-04-19T02:19:54.932147+0000","last_became_peered":"2024-04-19T02:19:54.932147+0000","last_unstale":"2024-04-19T02:20:05.965726+0000","last_undegraded":"2024-04-19T02:20:05.965726+0000","last_fullsized":"2024-04-19T02:20:05.965726+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:07:56.379190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":45,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T02:20:06.743095+0000","last_change":"2024-04-19T02:19:54.930868+0000","last_active":"2024-04-19T02:20:06.743095+0000","last_peered":"2024-04-19T02:20:06.743095+0000","last_clean":"2024-04-19T02:20:06.743095+0000","last_became_active":"2024-04-19T02:19:54.930134+0000","last_became_peered":"2024-04-19T02:19:54.930134+0000","last_unstale":"2024-04-19T02:20:06.743095+0000","last_undegraded":"2024-04-19T02:20:06.743095+0000","last_fullsized":"2024-04-19T02:20:06.743095+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:05:46.319702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661749+0000","last_change":"2024-04-19T02:15:24.533777+0000","last_active":"2024-04-19T02:20:08.661749+0000","last_peered":"2024-04-19T02:20:08.661749+0000","last_clean":"2024-04-19T02:20:08.661749+0000","last_became_active":"2024-04-19T02:15:24.533436+0000","last_became_peered":"2024-04-19T02:15:24.533436+0000","last_unstale":"2024-04-19T02:20:08.661749+0000","last_undegraded":"2024-04-19T02:20:08.661749+0000","last_fullsized":"2024-04-19T02:20:08.661749+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:53:25.922418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981874+0000","last_change":"2024-04-19T02:19:54.933278+0000","last_active":"2024-04-19T02:20:07.981874+0000","last_peered":"2024-04-19T02:20:07.981874+0000","last_clean":"2024-04-19T02:20:07.981874+0000","last_became_active":"2024-04-19T02:19:54.931328+0000","last_became_peered":"2024-04-19T02:19:54.931328+0000","last_unstale":"2024-04-19T02:20:07.981874+0000","last_undegraded":"2024-04-19T02:20:07.981874+0000","last_fullsized":"2024-04-19T02:20:07.981874+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:08:38.731741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981486+0000","last_change":"2024-04-19T02:15:29.282244+0000","last_active":"2024-04-19T02:20:07.981486+0000","last_peered":"2024-04-19T02:20:07.981486+0000","last_clean":"2024-04-19T02:20:07.981486+0000","last_became_active":"2024-04-19T02:15:29.280366+0000","last_became_peered":"2024-04-19T02:15:29.280366+0000","last_unstale":"2024-04-19T02:20:07.981486+0000","last_undegraded":"2024-04-19T02:20:07.981486+0000","last_fullsized":"2024-04-19T02:20:07.981486+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981438+0000","last_change":"2024-04-19T02:15:28.893027+0000","last_active":"2024-04-19T02:20:07.981438+0000","last_peered":"2024-04-19T02:20:07.981438+0000","last_clean":"2024-04-19T02:20:07.981438+0000","last_became_active":"2024-04-19T02:15:28.892695+0000","last_became_peered":"2024-04-19T02:15:28.892695+0000","last_unstale":"2024-04-19T02:20:07.981438+0000","last_undegraded":"2024-04-19T02:20:07.981438+0000","last_fullsized":"2024-04-19T02:20:07.981438+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":89,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.982670+0000","last_change":"2024-04-19T02:19:54.929648+0000","last_active":"2024-04-19T02:20:07.982670+0000","last_peered":"2024-04-19T02:20:07.982670+0000","last_clean":"2024-04-19T02:20:07.982670+0000","last_became_active":"2024-04-19T02:19:54.929412+0000","last_became_peered":"2024-04-19T02:19:54.929412+0000","last_unstale":"2024-04-19T02:20:07.982670+0000","last_undegraded":"2024-04-19T02:20:07.982670+0000","last_fullsized":"2024-04-19T02:20:07.982670+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:28:21.688550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660988+0000","last_change":"2024-04-19T02:19:54.927315+0000","last_active":"2024-04-19T02:20:08.660988+0000","last_peered":"2024-04-19T02:20:08.660988+0000","last_clean":"2024-04-19T02:20:08.660988+0000","last_became_active":"2024-04-19T02:19:54.926630+0000","last_became_peered":"2024-04-19T02:19:54.926630+0000","last_unstale":"2024-04-19T02:20:08.660988+0000","last_undegraded":"2024-04-19T02:20:08.660988+0000","last_fullsized":"2024-04-19T02:20:08.660988+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:39:00.822558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660746+0000","last_change":"2024-04-19T02:19:54.931920+0000","last_active":"2024-04-19T02:20:08.660746+0000","last_peered":"2024-04-19T02:20:08.660746+0000","last_clean":"2024-04-19T02:20:08.660746+0000","last_became_active":"2024-04-19T02:19:54.931328+0000","last_became_peered":"2024-04-19T02:19:54.931328+0000","last_unstale":"2024-04-19T02:20:08.660746+0000","last_undegraded":"2024-04-19T02:20:08.660746+0000","last_fullsized":"2024-04-19T02:20:08.660746+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:39.655376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":79,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.982759+0000","last_change":"2024-04-19T02:15:28.893239+0000","last_active":"2024-04-19T02:20:07.982759+0000","last_peered":"2024-04-19T02:20:07.982759+0000","last_clean":"2024-04-19T02:20:07.982759+0000","last_became_active":"2024-04-19T02:15:28.892881+0000","last_became_peered":"2024-04-19T02:15:28.892881+0000","last_unstale":"2024-04-19T02:20:07.982759+0000","last_undegraded":"2024-04-19T02:20:07.982759+0000","last_fullsized":"2024-04-19T02:20:07.982759+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660664+0000","last_change":"2024-04-19T02:19:54.924029+0000","last_active":"2024-04-19T02:20:08.660664+0000","last_peered":"2024-04-19T02:20:08.660664+0000","last_clean":"2024-04-19T02:20:08.660664+0000","last_became_active":"2024-04-19T02:19:54.923752+0000","last_became_peered":"2024-04-19T02:19:54.923752+0000","last_unstale":"2024-04-19T02:20:08.660664+0000","last_undegraded":"2024-04-19T02:20:08.660664+0000","last_fullsized":"2024-04-19T02:20:08.660664+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:26:41.825722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981835+0000","last_change":"2024-04-19T02:19:54.933652+0000","last_active":"2024-04-19T02:20:07.981835+0000","last_peered":"2024-04-19T02:20:07.981835+0000","last_clean":"2024-04-19T02:20:07.981835+0000","last_became_active":"2024-04-19T02:19:54.932103+0000","last_became_peered":"2024-04-19T02:19:54.932103+0000","last_unstale":"2024-04-19T02:20:07.981835+0000","last_undegraded":"2024-04-19T02:20:07.981835+0000","last_fullsized":"2024-04-19T02:20:07.981835+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:46:14.540427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":89,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981851+0000","last_change":"2024-04-19T02:19:54.925832+0000","last_active":"2024-04-19T02:20:07.981851+0000","last_peered":"2024-04-19T02:20:07.981851+0000","last_clean":"2024-04-19T02:20:07.981851+0000","last_became_active":"2024-04-19T02:19:54.925565+0000","last_became_peered":"2024-04-19T02:19:54.925565+0000","last_unstale":"2024-04-19T02:20:07.981851+0000","last_undegraded":"2024-04-19T02:20:07.981851+0000","last_fullsized":"2024-04-19T02:20:07.981851+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:28:13.380027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.982061+0000","last_change":"2024-04-19T02:19:54.929083+0000","last_active":"2024-04-19T02:20:07.982061+0000","last_peered":"2024-04-19T02:20:07.982061+0000","last_clean":"2024-04-19T02:20:07.982061+0000","last_became_active":"2024-04-19T02:19:54.926439+0000","last_became_peered":"2024-04-19T02:19:54.926439+0000","last_unstale":"2024-04-19T02:20:07.982061+0000","last_undegraded":"2024-04-19T02:20:07.982061+0000","last_fullsized":"2024-04-19T02:20:07.982061+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:15:04.675082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661283+0000","last_change":"2024-04-19T02:19:54.931258+0000","last_active":"2024-04-19T02:20:08.661283+0000","last_peered":"2024-04-19T02:20:08.661283+0000","last_clean":"2024-04-19T02:20:08.661283+0000","last_became_active":"2024-04-19T02:19:54.930665+0000","last_became_peered":"2024-04-19T02:19:54.930665+0000","last_unstale":"2024-04-19T02:20:08.661283+0000","last_undegraded":"2024-04-19T02:20:08.661283+0000","last_fullsized":"2024-04-19T02:20:08.661283+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:57:08.681822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661185+0000","last_change":"2024-04-19T02:19:54.931055+0000","last_active":"2024-04-19T02:20:08.661185+0000","last_peered":"2024-04-19T02:20:08.661185+0000","last_clean":"2024-04-19T02:20:08.661185+0000","last_became_active":"2024-04-19T02:19:54.930527+0000","last_became_peered":"2024-04-19T02:19:54.930527+0000","last_unstale":"2024-04-19T02:20:08.661185+0000","last_undegraded":"2024-04-19T02:20:08.661185+0000","last_fullsized":"2024-04-19T02:20:08.661185+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:05:38.717309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":44,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T02:20:05.964982+0000","last_change":"2024-04-19T02:19:54.921032+0000","last_active":"2024-04-19T02:20:05.964982+0000","last_peered":"2024-04-19T02:20:05.964982+0000","last_clean":"2024-04-19T02:20:05.964982+0000","last_became_active":"2024-04-19T02:19:54.920757+0000","last_became_peered":"2024-04-19T02:19:54.920757+0000","last_unstale":"2024-04-19T02:20:05.964982+0000","last_undegraded":"2024-04-19T02:20:05.964982+0000","last_fullsized":"2024-04-19T02:20:05.964982+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:21:08.049253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.665682+0000","last_change":"2024-04-19T02:20:08.662331+0000","last_active":"2024-04-19T02:20:08.665682+0000","last_peered":"2024-04-19T02:20:08.665682+0000","last_clean":"2024-04-19T02:20:08.665682+0000","last_became_active":"2024-04-19T02:20:08.661996+0000","last_became_peered":"2024-04-19T02:20:08.661996+0000","last_unstale":"2024-04-19T02:20:08.665682+0000","last_undegraded":"2024-04-19T02:20:08.665682+0000","last_fullsized":"2024-04-19T02:20:08.665682+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:25:03.894231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":44,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T02:20:05.965410+0000","last_change":"2024-04-19T02:19:54.932579+0000","last_active":"2024-04-19T02:20:05.965410+0000","last_peered":"2024-04-19T02:20:05.965410+0000","last_clean":"2024-04-19T02:20:05.965410+0000","last_became_active":"2024-04-19T02:19:54.932323+0000","last_became_peered":"2024-04-19T02:19:54.932323+0000","last_unstale":"2024-04-19T02:20:05.965410+0000","last_undegraded":"2024-04-19T02:20:05.965410+0000","last_fullsized":"2024-04-19T02:20:05.965410+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:02:30.316314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.982665+0000","last_change":"2024-04-19T02:15:29.277568+0000","last_active":"2024-04-19T02:20:07.982665+0000","last_peered":"2024-04-19T02:20:07.982665+0000","last_clean":"2024-04-19T02:20:07.982665+0000","last_became_active":"2024-04-19T02:15:29.276725+0000","last_became_peered":"2024-04-19T02:15:29.276725+0000","last_unstale":"2024-04-19T02:20:07.982665+0000","last_undegraded":"2024-04-19T02:20:07.982665+0000","last_fullsized":"2024-04-19T02:20:07.982665+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5254,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":72,"seq":309237645317,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58816,"kb_used_data":876,"kb_used_omap":6,"kb_used_meta":57913,"kb_avail":94313024,"statfs":{"total":96636764160,"available":96576536576,"internally_reserved":0,"allocated":897024,"data_stored":353874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6848,"internal_metadata":59303232},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]}]},{"osd":0,"up_from":8,"seq":34359738429,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":275412,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":273918,"kb_avail":94096428,"statfs":{"total":96636764160,"available":96354742272,"internally_reserved":0,"allocated":1511424,"data_stored":943875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":280492486},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 02:19:26 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.371,"15min":0.316},"min":{"1min":0.29899999999999999,"5min":0.159,"15min":0.159},"max":{"1min":0.57499999999999996,"5min":4.4480000000000004,"15min":4.4480000000000004},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.379,"15min":0.36599999999999999},"min":{"1min":0.29399999999999998,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.54800000000000004,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.55200000000000005}]},{"osd":2,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":2.1000000000000001,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.59499999999999997}]}]},{"osd":1,"up_from":8,"seq":34359738428,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307404,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":305918,"kb_avail":94064436,"statfs":{"total":96636764160,"available":96321982464,"internally_reserved":0,"allocated":1507328,"data_stored":945372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":313260486},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:19:29 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.40600000000000003,"15min":0.376},"min":{"1min":0.32700000000000001,"5min":0.157,"15min":0.157},"max":{"1min":0.64900000000000002,"5min":1.794,"15min":1.794},"last":0.499},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.38100000000000001,"15min":0.32400000000000001},"min":{"1min":0.37,"5min":0.16,"15min":0.16},"max":{"1min":0.63,"5min":2.411,"15min":2.411},"last":0.434}]},{"osd":2,"last update":"Fri Apr 19 02:16:26 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.41899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5254,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:20:12.091 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:20:12.449 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:20:12.451 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-04-19T02:20:12.461 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":222,"stamp":"2024-04-19T02:20:10.811829+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":641632,"kb_used_data":3824,"kb_used_omap":9,"kb_used_meta":637750,"kb_avail":282473888,"statfs":{"total":289910292480,"available":289253261312,"internally_reserved":0,"allocated":3915776,"data_stored":2243121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10036,"internal_metadata":653056204},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000839"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.983092+0000","last_change":"2024-04-19T02:19:54.929643+0000","last_active":"2024-04-19T02:20:07.983092+0000","last_peered":"2024-04-19T02:20:07.983092+0000","last_clean":"2024-04-19T02:20:07.983092+0000","last_became_active":"2024-04-19T02:19:54.929435+0000","last_became_peered":"2024-04-19T02:19:54.929435+0000","last_unstale":"2024-04-19T02:20:07.983092+0000","last_undegraded":"2024-04-19T02:20:07.983092+0000","last_fullsized":"2024-04-19T02:20:07.983092+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:44:05.807254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.982541+0000","last_change":"2024-04-19T02:19:54.931532+0000","last_active":"2024-04-19T02:20:07.982541+0000","last_peered":"2024-04-19T02:20:07.982541+0000","last_clean":"2024-04-19T02:20:07.982541+0000","last_became_active":"2024-04-19T02:19:54.931278+0000","last_became_peered":"2024-04-19T02:19:54.931278+0000","last_unstale":"2024-04-19T02:20:07.982541+0000","last_undegraded":"2024-04-19T02:20:07.982541+0000","last_fullsized":"2024-04-19T02:20:07.982541+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:20:02.024046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661523+0000","last_change":"2024-04-19T02:15:29.286709+0000","last_active":"2024-04-19T02:20:08.661523+0000","last_peered":"2024-04-19T02:20:08.661523+0000","last_clean":"2024-04-19T02:20:08.661523+0000","last_became_active":"2024-04-19T02:15:29.286169+0000","last_became_peered":"2024-04-19T02:15:29.286169+0000","last_unstale":"2024-04-19T02:20:08.661523+0000","last_undegraded":"2024-04-19T02:20:08.661523+0000","last_fullsized":"2024-04-19T02:20:08.661523+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:58.741466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661124+0000","last_change":"2024-04-19T02:19:54.927063+0000","last_active":"2024-04-19T02:20:08.661124+0000","last_peered":"2024-04-19T02:20:08.661124+0000","last_clean":"2024-04-19T02:20:08.661124+0000","last_became_active":"2024-04-19T02:19:54.926046+0000","last_became_peered":"2024-04-19T02:19:54.926046+0000","last_unstale":"2024-04-19T02:20:08.661124+0000","last_undegraded":"2024-04-19T02:20:08.661124+0000","last_fullsized":"2024-04-19T02:20:08.661124+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:52:59.151542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":54,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981322+0000","last_change":"2024-04-19T02:19:54.931669+0000","last_active":"2024-04-19T02:20:07.981322+0000","last_peered":"2024-04-19T02:20:07.981322+0000","last_clean":"2024-04-19T02:20:07.981322+0000","last_became_active":"2024-04-19T02:19:54.931435+0000","last_became_peered":"2024-04-19T02:19:54.931435+0000","last_unstale":"2024-04-19T02:20:07.981322+0000","last_undegraded":"2024-04-19T02:20:07.981322+0000","last_fullsized":"2024-04-19T02:20:07.981322+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:42:58.222802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660547+0000","last_change":"2024-04-19T02:19:54.924250+0000","last_active":"2024-04-19T02:20:08.660547+0000","last_peered":"2024-04-19T02:20:08.660547+0000","last_clean":"2024-04-19T02:20:08.660547+0000","last_became_active":"2024-04-19T02:19:54.923984+0000","last_became_peered":"2024-04-19T02:19:54.923984+0000","last_unstale":"2024-04-19T02:20:08.660547+0000","last_undegraded":"2024-04-19T02:20:08.660547+0000","last_fullsized":"2024-04-19T02:20:08.660547+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:56:51.290239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660603+0000","last_change":"2024-04-19T02:19:54.926647+0000","last_active":"2024-04-19T02:20:08.660603+0000","last_peered":"2024-04-19T02:20:08.660603+0000","last_clean":"2024-04-19T02:20:08.660603+0000","last_became_active":"2024-04-19T02:19:54.925529+0000","last_became_peered":"2024-04-19T02:19:54.925529+0000","last_unstale":"2024-04-19T02:20:08.660603+0000","last_undegraded":"2024-04-19T02:20:08.660603+0000","last_fullsized":"2024-04-19T02:20:08.660603+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:49:06.911557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660492+0000","last_change":"2024-04-19T02:19:54.930828+0000","last_active":"2024-04-19T02:20:08.660492+0000","last_peered":"2024-04-19T02:20:08.660492+0000","last_clean":"2024-04-19T02:20:08.660492+0000","last_became_active":"2024-04-19T02:19:54.930075+0000","last_became_peered":"2024-04-19T02:19:54.930075+0000","last_unstale":"2024-04-19T02:20:08.660492+0000","last_undegraded":"2024-04-19T02:20:08.660492+0000","last_fullsized":"2024-04-19T02:20:08.660492+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:00.512431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.982135+0000","last_change":"2024-04-19T02:19:54.931617+0000","last_active":"2024-04-19T02:20:07.982135+0000","last_peered":"2024-04-19T02:20:07.982135+0000","last_clean":"2024-04-19T02:20:07.982135+0000","last_became_active":"2024-04-19T02:19:54.928496+0000","last_became_peered":"2024-04-19T02:19:54.928496+0000","last_unstale":"2024-04-19T02:20:07.982135+0000","last_undegraded":"2024-04-19T02:20:07.982135+0000","last_fullsized":"2024-04-19T02:20:07.982135+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:56:50.232031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":59,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661471+0000","last_change":"2024-04-19T02:16:30.093524+0000","last_active":"2024-04-19T02:20:08.661471+0000","last_peered":"2024-04-19T02:20:08.661471+0000","last_clean":"2024-04-19T02:20:08.661471+0000","last_became_active":"2024-04-19T02:16:30.093344+0000","last_became_peered":"2024-04-19T02:16:30.093344+0000","last_unstale":"2024-04-19T02:20:08.661471+0000","last_undegraded":"2024-04-19T02:20:08.661471+0000","last_fullsized":"2024-04-19T02:20:08.661471+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:14:40.293159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661398+0000","last_change":"2024-04-19T02:19:54.926754+0000","last_active":"2024-04-19T02:20:08.661398+0000","last_peered":"2024-04-19T02:20:08.661398+0000","last_clean":"2024-04-19T02:20:08.661398+0000","last_became_active":"2024-04-19T02:19:54.926040+0000","last_became_peered":"2024-04-19T02:19:54.926040+0000","last_unstale":"2024-04-19T02:20:08.661398+0000","last_undegraded":"2024-04-19T02:20:08.661398+0000","last_fullsized":"2024-04-19T02:20:08.661398+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:36:16.313500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.665922+0000","last_change":"2024-04-19T02:20:08.662601+0000","last_active":"2024-04-19T02:20:08.665922+0000","last_peered":"2024-04-19T02:20:08.665922+0000","last_clean":"2024-04-19T02:20:08.665922+0000","last_became_active":"2024-04-19T02:20:08.662234+0000","last_became_peered":"2024-04-19T02:20:08.662234+0000","last_unstale":"2024-04-19T02:20:08.665922+0000","last_undegraded":"2024-04-19T02:20:08.665922+0000","last_fullsized":"2024-04-19T02:20:08.665922+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:34:06.694985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":54,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981515+0000","last_change":"2024-04-19T02:19:54.932576+0000","last_active":"2024-04-19T02:20:07.981515+0000","last_peered":"2024-04-19T02:20:07.981515+0000","last_clean":"2024-04-19T02:20:07.981515+0000","last_became_active":"2024-04-19T02:19:54.932240+0000","last_became_peered":"2024-04-19T02:19:54.932240+0000","last_unstale":"2024-04-19T02:20:07.981515+0000","last_undegraded":"2024-04-19T02:20:07.981515+0000","last_fullsized":"2024-04-19T02:20:07.981515+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:10:10.453676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661084+0000","last_change":"2024-04-19T02:15:29.284262+0000","last_active":"2024-04-19T02:20:08.661084+0000","last_peered":"2024-04-19T02:20:08.661084+0000","last_clean":"2024-04-19T02:20:08.661084+0000","last_became_active":"2024-04-19T02:15:29.283121+0000","last_became_peered":"2024-04-19T02:15:29.283121+0000","last_unstale":"2024-04-19T02:20:08.661084+0000","last_undegraded":"2024-04-19T02:20:08.661084+0000","last_fullsized":"2024-04-19T02:20:08.661084+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660877+0000","last_change":"2024-04-19T02:15:29.285139+0000","last_active":"2024-04-19T02:20:08.660877+0000","last_peered":"2024-04-19T02:20:08.660877+0000","last_clean":"2024-04-19T02:20:08.660877+0000","last_became_active":"2024-04-19T02:15:29.284649+0000","last_became_peered":"2024-04-19T02:15:29.284649+0000","last_unstale":"2024-04-19T02:20:08.660877+0000","last_undegraded":"2024-04-19T02:20:08.660877+0000","last_fullsized":"2024-04-19T02:20:08.660877+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660809+0000","last_change":"2024-04-19T02:19:54.931033+0000","last_active":"2024-04-19T02:20:08.660809+0000","last_peered":"2024-04-19T02:20:08.660809+0000","last_clean":"2024-04-19T02:20:08.660809+0000","last_became_active":"2024-04-19T02:19:54.930437+0000","last_became_peered":"2024-04-19T02:19:54.930437+0000","last_unstale":"2024-04-19T02:20:08.660809+0000","last_undegraded":"2024-04-19T02:20:08.660809+0000","last_fullsized":"2024-04-19T02:20:08.660809+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:44:05.807254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":32,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-19T02:20:07.982061+0000","last_change":"2024-04-19T02:19:54.921061+0000","last_active":"2024-04-19T02:19:54.921061+0000","last_peered":"2024-04-19T02:19:53.557856+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"2024-04-19T02:17:08.252165+0000","last_became_peered":"2024-04-19T02:17:08.252165+0000","last_unstale":"2024-04-19T02:20:07.982061+0000","last_undegraded":"2024-04-19T02:20:07.982061+0000","last_fullsized":"2024-04-19T02:20:07.982061+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:55:24.944798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996199+0000","last_change":"2024-04-19T02:19:54.933452+0000","last_active":"2024-04-19T02:20:08.996199+0000","last_peered":"2024-04-19T02:20:08.996199+0000","last_clean":"2024-04-19T02:20:08.996199+0000","last_became_active":"2024-04-19T02:19:54.933233+0000","last_became_peered":"2024-04-19T02:19:54.933233+0000","last_unstale":"2024-04-19T02:20:08.996199+0000","last_undegraded":"2024-04-19T02:20:08.996199+0000","last_fullsized":"2024-04-19T02:20:08.996199+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:50.712874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981674+0000","last_change":"2024-04-19T02:19:54.925745+0000","last_active":"2024-04-19T02:20:07.981674+0000","last_peered":"2024-04-19T02:20:07.981674+0000","last_clean":"2024-04-19T02:20:07.981674+0000","last_became_active":"2024-04-19T02:19:54.925060+0000","last_became_peered":"2024-04-19T02:19:54.925060+0000","last_unstale":"2024-04-19T02:20:07.981674+0000","last_undegraded":"2024-04-19T02:20:07.981674+0000","last_fullsized":"2024-04-19T02:20:07.981674+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:12:43.617806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661041+0000","last_change":"2024-04-19T02:19:54.927206+0000","last_active":"2024-04-19T02:20:08.661041+0000","last_peered":"2024-04-19T02:20:08.661041+0000","last_clean":"2024-04-19T02:20:08.661041+0000","last_became_active":"2024-04-19T02:19:54.926442+0000","last_became_peered":"2024-04-19T02:19:54.926442+0000","last_unstale":"2024-04-19T02:20:08.661041+0000","last_undegraded":"2024-04-19T02:20:08.661041+0000","last_fullsized":"2024-04-19T02:20:08.661041+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:27:17.095030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660768+0000","last_change":"2024-04-19T02:19:54.932532+0000","last_active":"2024-04-19T02:20:08.660768+0000","last_peered":"2024-04-19T02:20:08.660768+0000","last_clean":"2024-04-19T02:20:08.660768+0000","last_became_active":"2024-04-19T02:19:54.931438+0000","last_became_peered":"2024-04-19T02:19:54.931438+0000","last_unstale":"2024-04-19T02:20:08.660768+0000","last_undegraded":"2024-04-19T02:20:08.660768+0000","last_fullsized":"2024-04-19T02:20:08.660768+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:12:54.241778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.665603+0000","last_change":"2024-04-19T02:20:08.662261+0000","last_active":"2024-04-19T02:20:08.665603+0000","last_peered":"2024-04-19T02:20:08.665603+0000","last_clean":"2024-04-19T02:20:08.665603+0000","last_became_active":"2024-04-19T02:20:08.661940+0000","last_became_peered":"2024-04-19T02:20:08.661940+0000","last_unstale":"2024-04-19T02:20:08.665603+0000","last_undegraded":"2024-04-19T02:20:08.665603+0000","last_fullsized":"2024-04-19T02:20:08.665603+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:49:34.835266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":45,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T02:20:06.743619+0000","last_change":"2024-04-19T02:19:54.926885+0000","last_active":"2024-04-19T02:20:06.743619+0000","last_peered":"2024-04-19T02:20:06.743619+0000","last_clean":"2024-04-19T02:20:06.743619+0000","last_became_active":"2024-04-19T02:19:54.925939+0000","last_became_peered":"2024-04-19T02:19:54.925939+0000","last_unstale":"2024-04-19T02:20:06.743619+0000","last_undegraded":"2024-04-19T02:20:06.743619+0000","last_fullsized":"2024-04-19T02:20:06.743619+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:46:16.763335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981244+0000","last_change":"2024-04-19T02:19:54.928467+0000","last_active":"2024-04-19T02:20:07.981244+0000","last_peered":"2024-04-19T02:20:07.981244+0000","last_clean":"2024-04-19T02:20:07.981244+0000","last_became_active":"2024-04-19T02:19:54.928261+0000","last_became_peered":"2024-04-19T02:19:54.928261+0000","last_unstale":"2024-04-19T02:20:07.981244+0000","last_undegraded":"2024-04-19T02:20:07.981244+0000","last_fullsized":"2024-04-19T02:20:07.981244+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:40:43.645134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.983032+0000","last_change":"2024-04-19T02:15:29.278084+0000","last_active":"2024-04-19T02:20:07.983032+0000","last_peered":"2024-04-19T02:20:07.983032+0000","last_clean":"2024-04-19T02:20:07.983032+0000","last_became_active":"2024-04-19T02:15:29.276952+0000","last_became_peered":"2024-04-19T02:15:29.276952+0000","last_unstale":"2024-04-19T02:20:07.983032+0000","last_undegraded":"2024-04-19T02:20:07.983032+0000","last_fullsized":"2024-04-19T02:20:07.983032+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.982065+0000","last_change":"2024-04-19T02:19:54.933154+0000","last_active":"2024-04-19T02:20:07.982065+0000","last_peered":"2024-04-19T02:20:07.982065+0000","last_clean":"2024-04-19T02:20:07.982065+0000","last_became_active":"2024-04-19T02:19:54.931124+0000","last_became_peered":"2024-04-19T02:19:54.931124+0000","last_unstale":"2024-04-19T02:20:07.982065+0000","last_undegraded":"2024-04-19T02:20:07.982065+0000","last_fullsized":"2024-04-19T02:20:07.982065+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:49.555501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661389+0000","last_change":"2024-04-19T02:15:29.287389+0000","last_active":"2024-04-19T02:20:08.661389+0000","last_peered":"2024-04-19T02:20:08.661389+0000","last_clean":"2024-04-19T02:20:08.661389+0000","last_became_active":"2024-04-19T02:15:29.286431+0000","last_became_peered":"2024-04-19T02:15:29.286431+0000","last_unstale":"2024-04-19T02:20:08.661389+0000","last_undegraded":"2024-04-19T02:20:08.661389+0000","last_fullsized":"2024-04-19T02:20:08.661389+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:58:30.117887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":56,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981516+0000","last_change":"2024-04-19T02:19:54.927108+0000","last_active":"2024-04-19T02:20:07.981516+0000","last_peered":"2024-04-19T02:20:07.981516+0000","last_clean":"2024-04-19T02:20:07.981516+0000","last_became_active":"2024-04-19T02:19:54.926838+0000","last_became_peered":"2024-04-19T02:19:54.926838+0000","last_unstale":"2024-04-19T02:20:07.981516+0000","last_undegraded":"2024-04-19T02:20:07.981516+0000","last_fullsized":"2024-04-19T02:20:07.981516+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:25:27.561607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":76,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.982866+0000","last_change":"2024-04-19T02:15:29.281792+0000","last_active":"2024-04-19T02:20:07.982866+0000","last_peered":"2024-04-19T02:20:07.982866+0000","last_clean":"2024-04-19T02:20:07.982866+0000","last_became_active":"2024-04-19T02:15:29.280479+0000","last_became_peered":"2024-04-19T02:15:29.280479+0000","last_unstale":"2024-04-19T02:20:07.982866+0000","last_undegraded":"2024-04-19T02:20:07.982866+0000","last_fullsized":"2024-04-19T02:20:07.982866+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.980982+0000","last_change":"2024-04-19T02:19:54.925277+0000","last_active":"2024-04-19T02:20:07.980982+0000","last_peered":"2024-04-19T02:20:07.980982+0000","last_clean":"2024-04-19T02:20:07.980982+0000","last_became_active":"2024-04-19T02:19:54.924484+0000","last_became_peered":"2024-04-19T02:19:54.924484+0000","last_unstale":"2024-04-19T02:20:07.980982+0000","last_undegraded":"2024-04-19T02:20:07.980982+0000","last_fullsized":"2024-04-19T02:20:07.980982+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:57:54.845371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":45,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T02:20:06.744283+0000","last_change":"2024-04-19T02:19:54.931673+0000","last_active":"2024-04-19T02:20:06.744283+0000","last_peered":"2024-04-19T02:20:06.744283+0000","last_clean":"2024-04-19T02:20:06.744283+0000","last_became_active":"2024-04-19T02:19:54.931162+0000","last_became_peered":"2024-04-19T02:19:54.931162+0000","last_unstale":"2024-04-19T02:20:06.744283+0000","last_undegraded":"2024-04-19T02:20:06.744283+0000","last_fullsized":"2024-04-19T02:20:06.744283+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:42:40.944146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.980970+0000","last_change":"2024-04-19T02:19:54.930346+0000","last_active":"2024-04-19T02:20:07.980970+0000","last_peered":"2024-04-19T02:20:07.980970+0000","last_clean":"2024-04-19T02:20:07.980970+0000","last_became_active":"2024-04-19T02:19:54.928398+0000","last_became_peered":"2024-04-19T02:19:54.928398+0000","last_unstale":"2024-04-19T02:20:07.980970+0000","last_undegraded":"2024-04-19T02:20:07.980970+0000","last_fullsized":"2024-04-19T02:20:07.980970+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:46.321275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.982989+0000","last_change":"2024-04-19T02:15:29.280879+0000","last_active":"2024-04-19T02:20:07.982989+0000","last_peered":"2024-04-19T02:20:07.982989+0000","last_clean":"2024-04-19T02:20:07.982989+0000","last_became_active":"2024-04-19T02:15:29.279314+0000","last_became_peered":"2024-04-19T02:15:29.279314+0000","last_unstale":"2024-04-19T02:20:07.982989+0000","last_undegraded":"2024-04-19T02:20:07.982989+0000","last_fullsized":"2024-04-19T02:20:07.982989+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.982154+0000","last_change":"2024-04-19T02:19:54.927744+0000","last_active":"2024-04-19T02:20:07.982154+0000","last_peered":"2024-04-19T02:20:07.982154+0000","last_clean":"2024-04-19T02:20:07.982154+0000","last_became_active":"2024-04-19T02:19:54.925729+0000","last_became_peered":"2024-04-19T02:19:54.925729+0000","last_unstale":"2024-04-19T02:20:07.982154+0000","last_undegraded":"2024-04-19T02:20:07.982154+0000","last_fullsized":"2024-04-19T02:20:07.982154+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:27:57.229684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.980870+0000","last_change":"2024-04-19T02:19:54.928435+0000","last_active":"2024-04-19T02:20:07.980870+0000","last_peered":"2024-04-19T02:20:07.980870+0000","last_clean":"2024-04-19T02:20:07.980870+0000","last_became_active":"2024-04-19T02:19:54.927666+0000","last_became_peered":"2024-04-19T02:19:54.927666+0000","last_unstale":"2024-04-19T02:20:07.980870+0000","last_undegraded":"2024-04-19T02:20:07.980870+0000","last_fullsized":"2024-04-19T02:20:07.980870+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:20:45.000808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661594+0000","last_change":"2024-04-19T02:19:54.932025+0000","last_active":"2024-04-19T02:20:08.661594+0000","last_peered":"2024-04-19T02:20:08.661594+0000","last_clean":"2024-04-19T02:20:08.661594+0000","last_became_active":"2024-04-19T02:19:54.931540+0000","last_became_peered":"2024-04-19T02:19:54.931540+0000","last_unstale":"2024-04-19T02:20:08.661594+0000","last_undegraded":"2024-04-19T02:20:08.661594+0000","last_fullsized":"2024-04-19T02:20:08.661594+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:03:31.479331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981285+0000","last_change":"2024-04-19T02:19:54.924493+0000","last_active":"2024-04-19T02:20:07.981285+0000","last_peered":"2024-04-19T02:20:07.981285+0000","last_clean":"2024-04-19T02:20:07.981285+0000","last_became_active":"2024-04-19T02:19:54.923784+0000","last_became_peered":"2024-04-19T02:19:54.923784+0000","last_unstale":"2024-04-19T02:20:07.981285+0000","last_undegraded":"2024-04-19T02:20:07.981285+0000","last_fullsized":"2024-04-19T02:20:07.981285+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:09:34.378788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":80,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.982511+0000","last_change":"2024-04-19T02:15:28.892937+0000","last_active":"2024-04-19T02:20:07.982511+0000","last_peered":"2024-04-19T02:20:07.982511+0000","last_clean":"2024-04-19T02:20:07.982511+0000","last_became_active":"2024-04-19T02:15:28.891440+0000","last_became_peered":"2024-04-19T02:15:28.891440+0000","last_unstale":"2024-04-19T02:20:07.982511+0000","last_undegraded":"2024-04-19T02:20:07.982511+0000","last_fullsized":"2024-04-19T02:20:07.982511+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981039+0000","last_change":"2024-04-19T02:19:54.923898+0000","last_active":"2024-04-19T02:20:07.981039+0000","last_peered":"2024-04-19T02:20:07.981039+0000","last_clean":"2024-04-19T02:20:07.981039+0000","last_became_active":"2024-04-19T02:19:54.923493+0000","last_became_peered":"2024-04-19T02:19:54.923493+0000","last_unstale":"2024-04-19T02:20:07.981039+0000","last_undegraded":"2024-04-19T02:20:07.981039+0000","last_fullsized":"2024-04-19T02:20:07.981039+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:33.123319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660931+0000","last_change":"2024-04-19T02:15:28.891097+0000","last_active":"2024-04-19T02:20:08.660931+0000","last_peered":"2024-04-19T02:20:08.660931+0000","last_clean":"2024-04-19T02:20:08.660931+0000","last_became_active":"2024-04-19T02:15:28.890795+0000","last_became_peered":"2024-04-19T02:15:28.890795+0000","last_unstale":"2024-04-19T02:20:08.660931+0000","last_undegraded":"2024-04-19T02:20:08.660931+0000","last_fullsized":"2024-04-19T02:20:08.660931+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661095+0000","last_change":"2024-04-19T02:15:29.278546+0000","last_active":"2024-04-19T02:20:08.661095+0000","last_peered":"2024-04-19T02:20:08.661095+0000","last_clean":"2024-04-19T02:20:08.661095+0000","last_became_active":"2024-04-19T02:15:29.277547+0000","last_became_peered":"2024-04-19T02:15:29.277547+0000","last_unstale":"2024-04-19T02:20:08.661095+0000","last_undegraded":"2024-04-19T02:20:08.661095+0000","last_fullsized":"2024-04-19T02:20:08.661095+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661075+0000","last_change":"2024-04-19T02:19:54.933035+0000","last_active":"2024-04-19T02:20:08.661075+0000","last_peered":"2024-04-19T02:20:08.661075+0000","last_clean":"2024-04-19T02:20:08.661075+0000","last_became_active":"2024-04-19T02:19:54.932829+0000","last_became_peered":"2024-04-19T02:19:54.932829+0000","last_unstale":"2024-04-19T02:20:08.661075+0000","last_undegraded":"2024-04-19T02:20:08.661075+0000","last_fullsized":"2024-04-19T02:20:08.661075+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:09:05.626623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.988868+0000","last_change":"2024-04-19T02:20:07.983368+0000","last_active":"2024-04-19T02:20:07.988868+0000","last_peered":"2024-04-19T02:20:07.988868+0000","last_clean":"2024-04-19T02:20:07.988868+0000","last_became_active":"2024-04-19T02:20:07.983080+0000","last_became_peered":"2024-04-19T02:20:07.983080+0000","last_unstale":"2024-04-19T02:20:07.988868+0000","last_undegraded":"2024-04-19T02:20:07.988868+0000","last_fullsized":"2024-04-19T02:20:07.988868+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:24.138269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981065+0000","last_change":"2024-04-19T02:19:54.927323+0000","last_active":"2024-04-19T02:20:07.981065+0000","last_peered":"2024-04-19T02:20:07.981065+0000","last_clean":"2024-04-19T02:20:07.981065+0000","last_became_active":"2024-04-19T02:19:54.925703+0000","last_became_peered":"2024-04-19T02:19:54.925703+0000","last_unstale":"2024-04-19T02:20:07.981065+0000","last_undegraded":"2024-04-19T02:20:07.981065+0000","last_fullsized":"2024-04-19T02:20:07.981065+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:46:59.533765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":54,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.982823+0000","last_change":"2024-04-19T02:19:54.925918+0000","last_active":"2024-04-19T02:20:07.982823+0000","last_peered":"2024-04-19T02:20:07.982823+0000","last_clean":"2024-04-19T02:20:07.982823+0000","last_became_active":"2024-04-19T02:19:54.925634+0000","last_became_peered":"2024-04-19T02:19:54.925634+0000","last_unstale":"2024-04-19T02:20:07.982823+0000","last_undegraded":"2024-04-19T02:20:07.982823+0000","last_fullsized":"2024-04-19T02:20:07.982823+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:14:13.074455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996285+0000","last_change":"2024-04-19T02:15:28.892934+0000","last_active":"2024-04-19T02:20:08.996285+0000","last_peered":"2024-04-19T02:20:08.996285+0000","last_clean":"2024-04-19T02:20:08.996285+0000","last_became_active":"2024-04-19T02:15:28.891879+0000","last_became_peered":"2024-04-19T02:15:28.891879+0000","last_unstale":"2024-04-19T02:20:08.996285+0000","last_undegraded":"2024-04-19T02:20:08.996285+0000","last_fullsized":"2024-04-19T02:20:08.996285+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:10:12.514798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":45,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T02:20:06.744343+0000","last_change":"2024-04-19T02:19:54.931909+0000","last_active":"2024-04-19T02:20:06.744343+0000","last_peered":"2024-04-19T02:20:06.744343+0000","last_clean":"2024-04-19T02:20:06.744343+0000","last_became_active":"2024-04-19T02:19:54.931301+0000","last_became_peered":"2024-04-19T02:19:54.931301+0000","last_unstale":"2024-04-19T02:20:06.744343+0000","last_undegraded":"2024-04-19T02:20:06.744343+0000","last_fullsized":"2024-04-19T02:20:06.744343+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:10:08.224575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993693+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:20:08.993693+0000","last_peered":"2024-04-19T02:20:08.993693+0000","last_clean":"2024-04-19T02:20:08.993693+0000","last_became_active":"2024-04-19T02:15:28.890882+0000","last_became_peered":"2024-04-19T02:15:28.890882+0000","last_unstale":"2024-04-19T02:20:08.993693+0000","last_undegraded":"2024-04-19T02:20:08.993693+0000","last_fullsized":"2024-04-19T02:20:08.993693+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:31.673938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.982282+0000","last_change":"2024-04-19T02:19:54.927209+0000","last_active":"2024-04-19T02:20:07.982282+0000","last_peered":"2024-04-19T02:20:07.982282+0000","last_clean":"2024-04-19T02:20:07.982282+0000","last_became_active":"2024-04-19T02:19:54.925121+0000","last_became_peered":"2024-04-19T02:19:54.925121+0000","last_unstale":"2024-04-19T02:20:07.982282+0000","last_undegraded":"2024-04-19T02:20:07.982282+0000","last_fullsized":"2024-04-19T02:20:07.982282+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:16:21.982909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":80,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661726+0000","last_change":"2024-04-19T02:15:28.890265+0000","last_active":"2024-04-19T02:20:08.661726+0000","last_peered":"2024-04-19T02:20:08.661726+0000","last_clean":"2024-04-19T02:20:08.661726+0000","last_became_active":"2024-04-19T02:15:28.890004+0000","last_became_peered":"2024-04-19T02:15:28.890004+0000","last_unstale":"2024-04-19T02:20:08.661726+0000","last_undegraded":"2024-04-19T02:20:08.661726+0000","last_fullsized":"2024-04-19T02:20:08.661726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:02.517101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.980972+0000","last_change":"2024-04-19T02:15:29.285529+0000","last_active":"2024-04-19T02:20:07.980972+0000","last_peered":"2024-04-19T02:20:07.980972+0000","last_clean":"2024-04-19T02:20:07.980972+0000","last_became_active":"2024-04-19T02:15:29.285197+0000","last_became_peered":"2024-04-19T02:15:29.285197+0000","last_unstale":"2024-04-19T02:20:07.980972+0000","last_undegraded":"2024-04-19T02:20:07.980972+0000","last_fullsized":"2024-04-19T02:20:07.980972+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":80,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.982535+0000","last_change":"2024-04-19T02:15:28.893902+0000","last_active":"2024-04-19T02:20:07.982535+0000","last_peered":"2024-04-19T02:20:07.982535+0000","last_clean":"2024-04-19T02:20:07.982535+0000","last_became_active":"2024-04-19T02:15:28.893231+0000","last_became_peered":"2024-04-19T02:15:28.893231+0000","last_unstale":"2024-04-19T02:20:07.982535+0000","last_undegraded":"2024-04-19T02:20:07.982535+0000","last_fullsized":"2024-04-19T02:20:07.982535+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:23.658442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981713+0000","last_change":"2024-04-19T02:19:54.925840+0000","last_active":"2024-04-19T02:20:07.981713+0000","last_peered":"2024-04-19T02:20:07.981713+0000","last_clean":"2024-04-19T02:20:07.981713+0000","last_became_active":"2024-04-19T02:19:54.925502+0000","last_became_peered":"2024-04-19T02:19:54.925502+0000","last_unstale":"2024-04-19T02:20:07.981713+0000","last_undegraded":"2024-04-19T02:20:07.981713+0000","last_fullsized":"2024-04-19T02:20:07.981713+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:57.667340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":80,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661502+0000","last_change":"2024-04-19T02:15:28.891234+0000","last_active":"2024-04-19T02:20:08.661502+0000","last_peered":"2024-04-19T02:20:08.661502+0000","last_clean":"2024-04-19T02:20:08.661502+0000","last_became_active":"2024-04-19T02:15:28.890881+0000","last_became_peered":"2024-04-19T02:15:28.890881+0000","last_unstale":"2024-04-19T02:20:08.661502+0000","last_undegraded":"2024-04-19T02:20:08.661502+0000","last_fullsized":"2024-04-19T02:20:08.661502+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661157+0000","last_change":"2024-04-19T02:19:54.926103+0000","last_active":"2024-04-19T02:20:08.661157+0000","last_peered":"2024-04-19T02:20:08.661157+0000","last_clean":"2024-04-19T02:20:08.661157+0000","last_became_active":"2024-04-19T02:19:54.925591+0000","last_became_peered":"2024-04-19T02:19:54.925591+0000","last_unstale":"2024-04-19T02:20:08.661157+0000","last_undegraded":"2024-04-19T02:20:08.661157+0000","last_fullsized":"2024-04-19T02:20:08.661157+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:44:40.560973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":92,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660748+0000","last_change":"2024-04-19T02:19:54.926813+0000","last_active":"2024-04-19T02:20:08.660748+0000","last_peered":"2024-04-19T02:20:08.660748+0000","last_clean":"2024-04-19T02:20:08.660748+0000","last_became_active":"2024-04-19T02:19:54.925523+0000","last_became_peered":"2024-04-19T02:19:54.925523+0000","last_unstale":"2024-04-19T02:20:08.660748+0000","last_undegraded":"2024-04-19T02:20:08.660748+0000","last_fullsized":"2024-04-19T02:20:08.660748+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:39:56.887385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981499+0000","last_change":"2024-04-19T02:19:54.932306+0000","last_active":"2024-04-19T02:20:07.981499+0000","last_peered":"2024-04-19T02:20:07.981499+0000","last_clean":"2024-04-19T02:20:07.981499+0000","last_became_active":"2024-04-19T02:19:54.930843+0000","last_became_peered":"2024-04-19T02:19:54.930843+0000","last_unstale":"2024-04-19T02:20:07.981499+0000","last_undegraded":"2024-04-19T02:20:07.981499+0000","last_fullsized":"2024-04-19T02:20:07.981499+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:24:51.884048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981355+0000","last_change":"2024-04-19T02:19:54.932708+0000","last_active":"2024-04-19T02:20:07.981355+0000","last_peered":"2024-04-19T02:20:07.981355+0000","last_clean":"2024-04-19T02:20:07.981355+0000","last_became_active":"2024-04-19T02:19:54.931553+0000","last_became_peered":"2024-04-19T02:19:54.931553+0000","last_unstale":"2024-04-19T02:20:07.981355+0000","last_undegraded":"2024-04-19T02:20:07.981355+0000","last_fullsized":"2024-04-19T02:20:07.981355+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:47:07.651618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660749+0000","last_change":"2024-04-19T02:19:54.927009+0000","last_active":"2024-04-19T02:20:08.660749+0000","last_peered":"2024-04-19T02:20:08.660749+0000","last_clean":"2024-04-19T02:20:08.660749+0000","last_became_active":"2024-04-19T02:19:54.925645+0000","last_became_peered":"2024-04-19T02:19:54.925645+0000","last_unstale":"2024-04-19T02:20:08.660749+0000","last_undegraded":"2024-04-19T02:20:08.660749+0000","last_fullsized":"2024-04-19T02:20:08.660749+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:33:45.685463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":92,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660643+0000","last_change":"2024-04-19T02:19:54.923689+0000","last_active":"2024-04-19T02:20:08.660643+0000","last_peered":"2024-04-19T02:20:08.660643+0000","last_clean":"2024-04-19T02:20:08.660643+0000","last_became_active":"2024-04-19T02:19:54.923321+0000","last_became_peered":"2024-04-19T02:19:54.923321+0000","last_unstale":"2024-04-19T02:20:08.660643+0000","last_undegraded":"2024-04-19T02:20:08.660643+0000","last_fullsized":"2024-04-19T02:20:08.660643+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:03:01.578244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661714+0000","last_change":"2024-04-19T02:15:29.285019+0000","last_active":"2024-04-19T02:20:08.661714+0000","last_peered":"2024-04-19T02:20:08.661714+0000","last_clean":"2024-04-19T02:20:08.661714+0000","last_became_active":"2024-04-19T02:15:29.284650+0000","last_became_peered":"2024-04-19T02:15:29.284650+0000","last_unstale":"2024-04-19T02:20:08.661714+0000","last_undegraded":"2024-04-19T02:20:08.661714+0000","last_fullsized":"2024-04-19T02:20:08.661714+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.665914+0000","last_change":"2024-04-19T02:20:08.662566+0000","last_active":"2024-04-19T02:20:08.665914+0000","last_peered":"2024-04-19T02:20:08.665914+0000","last_clean":"2024-04-19T02:20:08.665914+0000","last_became_active":"2024-04-19T02:20:08.662277+0000","last_became_peered":"2024-04-19T02:20:08.662277+0000","last_unstale":"2024-04-19T02:20:08.665914+0000","last_undegraded":"2024-04-19T02:20:08.665914+0000","last_fullsized":"2024-04-19T02:20:08.665914+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:36:27.307955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661617+0000","last_change":"2024-04-19T02:15:29.287190+0000","last_active":"2024-04-19T02:20:08.661617+0000","last_peered":"2024-04-19T02:20:08.661617+0000","last_clean":"2024-04-19T02:20:08.661617+0000","last_became_active":"2024-04-19T02:15:29.286606+0000","last_became_peered":"2024-04-19T02:15:29.286606+0000","last_unstale":"2024-04-19T02:20:08.661617+0000","last_undegraded":"2024-04-19T02:20:08.661617+0000","last_fullsized":"2024-04-19T02:20:08.661617+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:28.387062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981146+0000","last_change":"2024-04-19T02:19:54.928493+0000","last_active":"2024-04-19T02:20:07.981146+0000","last_peered":"2024-04-19T02:20:07.981146+0000","last_clean":"2024-04-19T02:20:07.981146+0000","last_became_active":"2024-04-19T02:19:54.928298+0000","last_became_peered":"2024-04-19T02:19:54.928298+0000","last_unstale":"2024-04-19T02:20:07.981146+0000","last_undegraded":"2024-04-19T02:20:07.981146+0000","last_fullsized":"2024-04-19T02:20:07.981146+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:11:54.564261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.982056+0000","last_change":"2024-04-19T02:19:54.930452+0000","last_active":"2024-04-19T02:20:07.982056+0000","last_peered":"2024-04-19T02:20:07.982056+0000","last_clean":"2024-04-19T02:20:07.982056+0000","last_became_active":"2024-04-19T02:19:54.927309+0000","last_became_peered":"2024-04-19T02:19:54.927309+0000","last_unstale":"2024-04-19T02:20:07.982056+0000","last_undegraded":"2024-04-19T02:20:07.982056+0000","last_fullsized":"2024-04-19T02:20:07.982056+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:56:20.174957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":32,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-19T02:20:07.982091+0000","last_change":"2024-04-19T02:19:54.916264+0000","last_active":"2024-04-19T02:19:54.916264+0000","last_peered":"2024-04-19T02:19:53.557205+0000","last_clean":"2024-04-19T02:15:23.520722+0000","last_became_active":"2024-04-19T02:17:08.249349+0000","last_became_peered":"2024-04-19T02:17:08.249349+0000","last_unstale":"2024-04-19T02:20:07.982091+0000","last_undegraded":"2024-04-19T02:20:07.982091+0000","last_fullsized":"2024-04-19T02:20:07.982091+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:40.613587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":92,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661604+0000","last_change":"2024-04-19T02:19:54.926207+0000","last_active":"2024-04-19T02:20:08.661604+0000","last_peered":"2024-04-19T02:20:08.661604+0000","last_clean":"2024-04-19T02:20:08.661604+0000","last_became_active":"2024-04-19T02:19:54.925872+0000","last_became_peered":"2024-04-19T02:19:54.925872+0000","last_unstale":"2024-04-19T02:20:08.661604+0000","last_undegraded":"2024-04-19T02:20:08.661604+0000","last_fullsized":"2024-04-19T02:20:08.661604+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:31:46.734042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981815+0000","last_change":"2024-04-19T02:15:29.277922+0000","last_active":"2024-04-19T02:20:07.981815+0000","last_peered":"2024-04-19T02:20:07.981815+0000","last_clean":"2024-04-19T02:20:07.981815+0000","last_became_active":"2024-04-19T02:15:29.276968+0000","last_became_peered":"2024-04-19T02:15:29.276968+0000","last_unstale":"2024-04-19T02:20:07.981815+0000","last_undegraded":"2024-04-19T02:20:07.981815+0000","last_fullsized":"2024-04-19T02:20:07.981815+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":95,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660974+0000","last_change":"2024-04-19T02:19:54.927361+0000","last_active":"2024-04-19T02:20:08.660974+0000","last_peered":"2024-04-19T02:20:08.660974+0000","last_clean":"2024-04-19T02:20:08.660974+0000","last_became_active":"2024-04-19T02:19:54.927033+0000","last_became_peered":"2024-04-19T02:19:54.927033+0000","last_unstale":"2024-04-19T02:20:08.660974+0000","last_undegraded":"2024-04-19T02:20:08.660974+0000","last_fullsized":"2024-04-19T02:20:08.660974+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:07.194915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":92,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660955+0000","last_change":"2024-04-19T02:19:54.932790+0000","last_active":"2024-04-19T02:20:08.660955+0000","last_peered":"2024-04-19T02:20:08.660955+0000","last_clean":"2024-04-19T02:20:08.660955+0000","last_became_active":"2024-04-19T02:19:54.931683+0000","last_became_peered":"2024-04-19T02:19:54.931683+0000","last_unstale":"2024-04-19T02:20:08.660955+0000","last_undegraded":"2024-04-19T02:20:08.660955+0000","last_fullsized":"2024-04-19T02:20:08.660955+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:23:00.124845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981515+0000","last_change":"2024-04-19T02:19:54.926109+0000","last_active":"2024-04-19T02:20:07.981515+0000","last_peered":"2024-04-19T02:20:07.981515+0000","last_clean":"2024-04-19T02:20:07.981515+0000","last_became_active":"2024-04-19T02:19:54.924686+0000","last_became_peered":"2024-04-19T02:19:54.924686+0000","last_unstale":"2024-04-19T02:20:07.981515+0000","last_undegraded":"2024-04-19T02:20:07.981515+0000","last_fullsized":"2024-04-19T02:20:07.981515+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:20:03.487999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981372+0000","last_change":"2024-04-19T02:19:54.923465+0000","last_active":"2024-04-19T02:20:07.981372+0000","last_peered":"2024-04-19T02:20:07.981372+0000","last_clean":"2024-04-19T02:20:07.981372+0000","last_became_active":"2024-04-19T02:19:54.923164+0000","last_became_peered":"2024-04-19T02:19:54.923164+0000","last_unstale":"2024-04-19T02:20:07.981372+0000","last_undegraded":"2024-04-19T02:20:07.981372+0000","last_fullsized":"2024-04-19T02:20:07.981372+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:53:29.520848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.665628+0000","last_change":"2024-04-19T02:20:08.662301+0000","last_active":"2024-04-19T02:20:08.665628+0000","last_peered":"2024-04-19T02:20:08.665628+0000","last_clean":"2024-04-19T02:20:08.665628+0000","last_became_active":"2024-04-19T02:20:08.661952+0000","last_became_peered":"2024-04-19T02:20:08.661952+0000","last_unstale":"2024-04-19T02:20:08.665628+0000","last_undegraded":"2024-04-19T02:20:08.665628+0000","last_fullsized":"2024-04-19T02:20:08.665628+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:41:21.658836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.982200+0000","last_change":"2024-04-19T02:19:54.930115+0000","last_active":"2024-04-19T02:20:07.982200+0000","last_peered":"2024-04-19T02:20:07.982200+0000","last_clean":"2024-04-19T02:20:07.982200+0000","last_became_active":"2024-04-19T02:19:54.926463+0000","last_became_peered":"2024-04-19T02:19:54.926463+0000","last_unstale":"2024-04-19T02:20:07.982200+0000","last_undegraded":"2024-04-19T02:20:07.982200+0000","last_fullsized":"2024-04-19T02:20:07.982200+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:00.191645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":95,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660877+0000","last_change":"2024-04-19T02:19:54.932929+0000","last_active":"2024-04-19T02:20:08.660877+0000","last_peered":"2024-04-19T02:20:08.660877+0000","last_clean":"2024-04-19T02:20:08.660877+0000","last_became_active":"2024-04-19T02:19:54.932571+0000","last_became_peered":"2024-04-19T02:19:54.932571+0000","last_unstale":"2024-04-19T02:20:08.660877+0000","last_undegraded":"2024-04-19T02:20:08.660877+0000","last_fullsized":"2024-04-19T02:20:08.660877+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:50:08.657036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":278,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660871+0000","last_change":"2024-04-19T02:15:24.533634+0000","last_active":"2024-04-19T02:20:08.660871+0000","last_peered":"2024-04-19T02:20:08.660871+0000","last_clean":"2024-04-19T02:20:08.660871+0000","last_became_active":"2024-04-19T02:15:24.533420+0000","last_became_peered":"2024-04-19T02:15:24.533420+0000","last_unstale":"2024-04-19T02:20:08.660871+0000","last_undegraded":"2024-04-19T02:20:08.660871+0000","last_fullsized":"2024-04-19T02:20:08.660871+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":44,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T02:20:05.964845+0000","last_change":"2024-04-19T02:19:54.924862+0000","last_active":"2024-04-19T02:20:05.964845+0000","last_peered":"2024-04-19T02:20:05.964845+0000","last_clean":"2024-04-19T02:20:05.964845+0000","last_became_active":"2024-04-19T02:19:54.924581+0000","last_became_peered":"2024-04-19T02:19:54.924581+0000","last_unstale":"2024-04-19T02:20:05.964845+0000","last_undegraded":"2024-04-19T02:20:05.964845+0000","last_fullsized":"2024-04-19T02:20:05.964845+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:34:53.681271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661658+0000","last_change":"2024-04-19T02:15:29.285015+0000","last_active":"2024-04-19T02:20:08.661658+0000","last_peered":"2024-04-19T02:20:08.661658+0000","last_clean":"2024-04-19T02:20:08.661658+0000","last_became_active":"2024-04-19T02:15:29.284164+0000","last_became_peered":"2024-04-19T02:15:29.284164+0000","last_unstale":"2024-04-19T02:20:08.661658+0000","last_undegraded":"2024-04-19T02:20:08.661658+0000","last_fullsized":"2024-04-19T02:20:08.661658+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:36.987844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660906+0000","last_change":"2024-04-19T02:15:24.533912+0000","last_active":"2024-04-19T02:20:08.660906+0000","last_peered":"2024-04-19T02:20:08.660906+0000","last_clean":"2024-04-19T02:20:08.660906+0000","last_became_active":"2024-04-19T02:15:24.533580+0000","last_became_peered":"2024-04-19T02:15:24.533580+0000","last_unstale":"2024-04-19T02:20:08.660906+0000","last_undegraded":"2024-04-19T02:20:08.660906+0000","last_fullsized":"2024-04-19T02:20:08.660906+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:45.045477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":45,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T02:20:06.743494+0000","last_change":"2024-04-19T02:19:54.926899+0000","last_active":"2024-04-19T02:20:06.743494+0000","last_peered":"2024-04-19T02:20:06.743494+0000","last_clean":"2024-04-19T02:20:06.743494+0000","last_became_active":"2024-04-19T02:19:54.926346+0000","last_became_peered":"2024-04-19T02:19:54.926346+0000","last_unstale":"2024-04-19T02:20:06.743494+0000","last_undegraded":"2024-04-19T02:20:06.743494+0000","last_fullsized":"2024-04-19T02:20:06.743494+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:35:11.172682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":48,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.991873+0000","last_change":"2024-04-19T02:20:07.986363+0000","last_active":"2024-04-19T02:20:07.991873+0000","last_peered":"2024-04-19T02:20:07.991873+0000","last_clean":"2024-04-19T02:20:07.991873+0000","last_became_active":"2024-04-19T02:20:07.986110+0000","last_became_peered":"2024-04-19T02:20:07.986110+0000","last_unstale":"2024-04-19T02:20:07.991873+0000","last_undegraded":"2024-04-19T02:20:07.991873+0000","last_fullsized":"2024-04-19T02:20:07.991873+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:12.545910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":59,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.982625+0000","last_change":"2024-04-19T02:19:54.925886+0000","last_active":"2024-04-19T02:20:07.982625+0000","last_peered":"2024-04-19T02:20:07.982625+0000","last_clean":"2024-04-19T02:20:07.982625+0000","last_became_active":"2024-04-19T02:19:54.925570+0000","last_became_peered":"2024-04-19T02:19:54.925570+0000","last_unstale":"2024-04-19T02:20:07.982625+0000","last_undegraded":"2024-04-19T02:20:07.982625+0000","last_fullsized":"2024-04-19T02:20:07.982625+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:33:34.594161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981348+0000","last_change":"2024-04-19T02:19:54.933960+0000","last_active":"2024-04-19T02:20:07.981348+0000","last_peered":"2024-04-19T02:20:07.981348+0000","last_clean":"2024-04-19T02:20:07.981348+0000","last_became_active":"2024-04-19T02:19:54.929918+0000","last_became_peered":"2024-04-19T02:19:54.929918+0000","last_unstale":"2024-04-19T02:20:07.981348+0000","last_undegraded":"2024-04-19T02:20:07.981348+0000","last_fullsized":"2024-04-19T02:20:07.981348+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:33:10.282684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981355+0000","last_change":"2024-04-19T02:15:29.281694+0000","last_active":"2024-04-19T02:20:07.981355+0000","last_peered":"2024-04-19T02:20:07.981355+0000","last_clean":"2024-04-19T02:20:07.981355+0000","last_became_active":"2024-04-19T02:15:29.280519+0000","last_became_peered":"2024-04-19T02:15:29.280519+0000","last_unstale":"2024-04-19T02:20:07.981355+0000","last_undegraded":"2024-04-19T02:20:07.981355+0000","last_fullsized":"2024-04-19T02:20:07.981355+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:50.890545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981945+0000","last_change":"2024-04-19T02:19:54.931726+0000","last_active":"2024-04-19T02:20:07.981945+0000","last_peered":"2024-04-19T02:20:07.981945+0000","last_clean":"2024-04-19T02:20:07.981945+0000","last_became_active":"2024-04-19T02:19:54.928460+0000","last_became_peered":"2024-04-19T02:19:54.928460+0000","last_unstale":"2024-04-19T02:20:07.981945+0000","last_undegraded":"2024-04-19T02:20:07.981945+0000","last_fullsized":"2024-04-19T02:20:07.981945+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:07:04.935620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":44,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T02:20:05.965726+0000","last_change":"2024-04-19T02:19:54.932487+0000","last_active":"2024-04-19T02:20:05.965726+0000","last_peered":"2024-04-19T02:20:05.965726+0000","last_clean":"2024-04-19T02:20:05.965726+0000","last_became_active":"2024-04-19T02:19:54.932147+0000","last_became_peered":"2024-04-19T02:19:54.932147+0000","last_unstale":"2024-04-19T02:20:05.965726+0000","last_undegraded":"2024-04-19T02:20:05.965726+0000","last_fullsized":"2024-04-19T02:20:05.965726+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:07:56.379190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":45,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T02:20:06.743095+0000","last_change":"2024-04-19T02:19:54.930868+0000","last_active":"2024-04-19T02:20:06.743095+0000","last_peered":"2024-04-19T02:20:06.743095+0000","last_clean":"2024-04-19T02:20:06.743095+0000","last_became_active":"2024-04-19T02:19:54.930134+0000","last_became_peered":"2024-04-19T02:19:54.930134+0000","last_unstale":"2024-04-19T02:20:06.743095+0000","last_undegraded":"2024-04-19T02:20:06.743095+0000","last_fullsized":"2024-04-19T02:20:06.743095+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:05:46.319702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661749+0000","last_change":"2024-04-19T02:15:24.533777+0000","last_active":"2024-04-19T02:20:08.661749+0000","last_peered":"2024-04-19T02:20:08.661749+0000","last_clean":"2024-04-19T02:20:08.661749+0000","last_became_active":"2024-04-19T02:15:24.533436+0000","last_became_peered":"2024-04-19T02:15:24.533436+0000","last_unstale":"2024-04-19T02:20:08.661749+0000","last_undegraded":"2024-04-19T02:20:08.661749+0000","last_fullsized":"2024-04-19T02:20:08.661749+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:53:25.922418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981874+0000","last_change":"2024-04-19T02:19:54.933278+0000","last_active":"2024-04-19T02:20:07.981874+0000","last_peered":"2024-04-19T02:20:07.981874+0000","last_clean":"2024-04-19T02:20:07.981874+0000","last_became_active":"2024-04-19T02:19:54.931328+0000","last_became_peered":"2024-04-19T02:19:54.931328+0000","last_unstale":"2024-04-19T02:20:07.981874+0000","last_undegraded":"2024-04-19T02:20:07.981874+0000","last_fullsized":"2024-04-19T02:20:07.981874+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:08:38.731741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981486+0000","last_change":"2024-04-19T02:15:29.282244+0000","last_active":"2024-04-19T02:20:07.981486+0000","last_peered":"2024-04-19T02:20:07.981486+0000","last_clean":"2024-04-19T02:20:07.981486+0000","last_became_active":"2024-04-19T02:15:29.280366+0000","last_became_peered":"2024-04-19T02:15:29.280366+0000","last_unstale":"2024-04-19T02:20:07.981486+0000","last_undegraded":"2024-04-19T02:20:07.981486+0000","last_fullsized":"2024-04-19T02:20:07.981486+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981438+0000","last_change":"2024-04-19T02:15:28.893027+0000","last_active":"2024-04-19T02:20:07.981438+0000","last_peered":"2024-04-19T02:20:07.981438+0000","last_clean":"2024-04-19T02:20:07.981438+0000","last_became_active":"2024-04-19T02:15:28.892695+0000","last_became_peered":"2024-04-19T02:15:28.892695+0000","last_unstale":"2024-04-19T02:20:07.981438+0000","last_undegraded":"2024-04-19T02:20:07.981438+0000","last_fullsized":"2024-04-19T02:20:07.981438+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":89,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.982670+0000","last_change":"2024-04-19T02:19:54.929648+0000","last_active":"2024-04-19T02:20:07.982670+0000","last_peered":"2024-04-19T02:20:07.982670+0000","last_clean":"2024-04-19T02:20:07.982670+0000","last_became_active":"2024-04-19T02:19:54.929412+0000","last_became_peered":"2024-04-19T02:19:54.929412+0000","last_unstale":"2024-04-19T02:20:07.982670+0000","last_undegraded":"2024-04-19T02:20:07.982670+0000","last_fullsized":"2024-04-19T02:20:07.982670+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:28:21.688550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660988+0000","last_change":"2024-04-19T02:19:54.927315+0000","last_active":"2024-04-19T02:20:08.660988+0000","last_peered":"2024-04-19T02:20:08.660988+0000","last_clean":"2024-04-19T02:20:08.660988+0000","last_became_active":"2024-04-19T02:19:54.926630+0000","last_became_peered":"2024-04-19T02:19:54.926630+0000","last_unstale":"2024-04-19T02:20:08.660988+0000","last_undegraded":"2024-04-19T02:20:08.660988+0000","last_fullsized":"2024-04-19T02:20:08.660988+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:39:00.822558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660746+0000","last_change":"2024-04-19T02:19:54.931920+0000","last_active":"2024-04-19T02:20:08.660746+0000","last_peered":"2024-04-19T02:20:08.660746+0000","last_clean":"2024-04-19T02:20:08.660746+0000","last_became_active":"2024-04-19T02:19:54.931328+0000","last_became_peered":"2024-04-19T02:19:54.931328+0000","last_unstale":"2024-04-19T02:20:08.660746+0000","last_undegraded":"2024-04-19T02:20:08.660746+0000","last_fullsized":"2024-04-19T02:20:08.660746+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:39.655376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":79,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.982759+0000","last_change":"2024-04-19T02:15:28.893239+0000","last_active":"2024-04-19T02:20:07.982759+0000","last_peered":"2024-04-19T02:20:07.982759+0000","last_clean":"2024-04-19T02:20:07.982759+0000","last_became_active":"2024-04-19T02:15:28.892881+0000","last_became_peered":"2024-04-19T02:15:28.892881+0000","last_unstale":"2024-04-19T02:20:07.982759+0000","last_undegraded":"2024-04-19T02:20:07.982759+0000","last_fullsized":"2024-04-19T02:20:07.982759+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660664+0000","last_change":"2024-04-19T02:19:54.924029+0000","last_active":"2024-04-19T02:20:08.660664+0000","last_peered":"2024-04-19T02:20:08.660664+0000","last_clean":"2024-04-19T02:20:08.660664+0000","last_became_active":"2024-04-19T02:19:54.923752+0000","last_became_peered":"2024-04-19T02:19:54.923752+0000","last_unstale":"2024-04-19T02:20:08.660664+0000","last_undegraded":"2024-04-19T02:20:08.660664+0000","last_fullsized":"2024-04-19T02:20:08.660664+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:26:41.825722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981835+0000","last_change":"2024-04-19T02:19:54.933652+0000","last_active":"2024-04-19T02:20:07.981835+0000","last_peered":"2024-04-19T02:20:07.981835+0000","last_clean":"2024-04-19T02:20:07.981835+0000","last_became_active":"2024-04-19T02:19:54.932103+0000","last_became_peered":"2024-04-19T02:19:54.932103+0000","last_unstale":"2024-04-19T02:20:07.981835+0000","last_undegraded":"2024-04-19T02:20:07.981835+0000","last_fullsized":"2024-04-19T02:20:07.981835+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:46:14.540427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":89,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981851+0000","last_change":"2024-04-19T02:19:54.925832+0000","last_active":"2024-04-19T02:20:07.981851+0000","last_peered":"2024-04-19T02:20:07.981851+0000","last_clean":"2024-04-19T02:20:07.981851+0000","last_became_active":"2024-04-19T02:19:54.925565+0000","last_became_peered":"2024-04-19T02:19:54.925565+0000","last_unstale":"2024-04-19T02:20:07.981851+0000","last_undegraded":"2024-04-19T02:20:07.981851+0000","last_fullsized":"2024-04-19T02:20:07.981851+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:28:13.380027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.982061+0000","last_change":"2024-04-19T02:19:54.929083+0000","last_active":"2024-04-19T02:20:07.982061+0000","last_peered":"2024-04-19T02:20:07.982061+0000","last_clean":"2024-04-19T02:20:07.982061+0000","last_became_active":"2024-04-19T02:19:54.926439+0000","last_became_peered":"2024-04-19T02:19:54.926439+0000","last_unstale":"2024-04-19T02:20:07.982061+0000","last_undegraded":"2024-04-19T02:20:07.982061+0000","last_fullsized":"2024-04-19T02:20:07.982061+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:15:04.675082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661283+0000","last_change":"2024-04-19T02:19:54.931258+0000","last_active":"2024-04-19T02:20:08.661283+0000","last_peered":"2024-04-19T02:20:08.661283+0000","last_clean":"2024-04-19T02:20:08.661283+0000","last_became_active":"2024-04-19T02:19:54.930665+0000","last_became_peered":"2024-04-19T02:19:54.930665+0000","last_unstale":"2024-04-19T02:20:08.661283+0000","last_undegraded":"2024-04-19T02:20:08.661283+0000","last_fullsized":"2024-04-19T02:20:08.661283+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:57:08.681822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661185+0000","last_change":"2024-04-19T02:19:54.931055+0000","last_active":"2024-04-19T02:20:08.661185+0000","last_peered":"2024-04-19T02:20:08.661185+0000","last_clean":"2024-04-19T02:20:08.661185+0000","last_became_active":"2024-04-19T02:19:54.930527+0000","last_became_peered":"2024-04-19T02:19:54.930527+0000","last_unstale":"2024-04-19T02:20:08.661185+0000","last_undegraded":"2024-04-19T02:20:08.661185+0000","last_fullsized":"2024-04-19T02:20:08.661185+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:05:38.717309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":44,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T02:20:05.964982+0000","last_change":"2024-04-19T02:19:54.921032+0000","last_active":"2024-04-19T02:20:05.964982+0000","last_peered":"2024-04-19T02:20:05.964982+0000","last_clean":"2024-04-19T02:20:05.964982+0000","last_became_active":"2024-04-19T02:19:54.920757+0000","last_became_peered":"2024-04-19T02:19:54.920757+0000","last_unstale":"2024-04-19T02:20:05.964982+0000","last_undegraded":"2024-04-19T02:20:05.964982+0000","last_fullsized":"2024-04-19T02:20:05.964982+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:21:08.049253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.665682+0000","last_change":"2024-04-19T02:20:08.662331+0000","last_active":"2024-04-19T02:20:08.665682+0000","last_peered":"2024-04-19T02:20:08.665682+0000","last_clean":"2024-04-19T02:20:08.665682+0000","last_became_active":"2024-04-19T02:20:08.661996+0000","last_became_peered":"2024-04-19T02:20:08.661996+0000","last_unstale":"2024-04-19T02:20:08.665682+0000","last_undegraded":"2024-04-19T02:20:08.665682+0000","last_fullsized":"2024-04-19T02:20:08.665682+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:25:03.894231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":44,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T02:20:05.965410+0000","last_change":"2024-04-19T02:19:54.932579+0000","last_active":"2024-04-19T02:20:05.965410+0000","last_peered":"2024-04-19T02:20:05.965410+0000","last_clean":"2024-04-19T02:20:05.965410+0000","last_became_active":"2024-04-19T02:19:54.932323+0000","last_became_peered":"2024-04-19T02:19:54.932323+0000","last_unstale":"2024-04-19T02:20:05.965410+0000","last_undegraded":"2024-04-19T02:20:05.965410+0000","last_fullsized":"2024-04-19T02:20:05.965410+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:02:30.316314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.982665+0000","last_change":"2024-04-19T02:15:29.277568+0000","last_active":"2024-04-19T02:20:07.982665+0000","last_peered":"2024-04-19T02:20:07.982665+0000","last_clean":"2024-04-19T02:20:07.982665+0000","last_became_active":"2024-04-19T02:15:29.276725+0000","last_became_peered":"2024-04-19T02:15:29.276725+0000","last_unstale":"2024-04-19T02:20:07.982665+0000","last_undegraded":"2024-04-19T02:20:07.982665+0000","last_fullsized":"2024-04-19T02:20:07.982665+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5254,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":72,"seq":309237645317,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58816,"kb_used_data":876,"kb_used_omap":6,"kb_used_meta":57913,"kb_avail":94313024,"statfs":{"total":96636764160,"available":96576536576,"internally_reserved":0,"allocated":897024,"data_stored":353874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6848,"internal_metadata":59303232},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]}]},{"osd":0,"up_from":8,"seq":34359738429,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":275412,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":273918,"kb_avail":94096428,"statfs":{"total":96636764160,"available":96354742272,"internally_reserved":0,"allocated":1511424,"data_stored":943875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":280492486},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 02:19:26 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.371,"15min":0.316},"min":{"1min":0.29899999999999999,"5min":0.159,"15min":0.159},"max":{"1min":0.57499999999999996,"5min":4.4480000000000004,"15min":4.4480000000000004},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.379,"15min":0.36599999999999999},"min":{"1min":0.29399999999999998,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.54800000000000004,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.55200000000000005}]},{"osd":2,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":2.1000000000000001,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.59499999999999997}]}]},{"osd":1,"up_from":8,"seq":34359738428,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307404,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":305918,"kb_avail":94064436,"statfs":{"total":96636764160,"available":96321982464,"internally_reserved":0,"allocated":1507328,"data_stored":945372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":313260486},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:19:29 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.40600000000000003,"15min":0.376},"min":{"1min":0.32700000000000001,"5min":0.157,"15min":0.157},"max":{"1min":0.64900000000000002,"5min":1.794,"15min":1.794},"last":0.499},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.38100000000000001,"15min":0.32400000000000001},"min":{"1min":0.37,"5min":0.16,"15min":0.16},"max":{"1min":0.63,"5min":2.411,"15min":2.411},"last":0.434}]},{"osd":2,"last update":"Fri Apr 19 02:16:26 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.41899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5254,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:20:12.465 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-19T02:20:12.905 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:20:12.905 INFO:teuthology.orchestra.run.smithi121.stdout:{"fsid":"f6ab5dd0-bb9f-4b48-a9fc-4728c7955ca8","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":298,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":82,"num_osds":3,"num_up_osds":3,"osd_up_since":1713493193,"num_in_osds":3,"osd_in_since":1713492915,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":103},{"state_name":"peering","count":2}],"num_pgs":105,"num_pools":4,"num_objects":24,"data_bytes":592730,"bytes_used":657031168,"bytes_avail":289253261312,"bytes_total":289910292480,"inactive_pgs_ratio":0.01904761977493763},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4230}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-04-19T02:16:34.750409+0000","services":{}},"progress_events":{}} 2024-04-19T02:20:12.919 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-04-19T02:20:12.919 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:20:13.246 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:20:13.248 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-04-19T02:20:13.258 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":223,"stamp":"2024-04-19T02:20:12.812107+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":641632,"kb_used_data":3824,"kb_used_omap":9,"kb_used_meta":637750,"kb_avail":282473888,"statfs":{"total":289910292480,"available":289253261312,"internally_reserved":0,"allocated":3915776,"data_stored":2243121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10036,"internal_metadata":653056204},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.842742"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.983092+0000","last_change":"2024-04-19T02:19:54.929643+0000","last_active":"2024-04-19T02:20:07.983092+0000","last_peered":"2024-04-19T02:20:07.983092+0000","last_clean":"2024-04-19T02:20:07.983092+0000","last_became_active":"2024-04-19T02:19:54.929435+0000","last_became_peered":"2024-04-19T02:19:54.929435+0000","last_unstale":"2024-04-19T02:20:07.983092+0000","last_undegraded":"2024-04-19T02:20:07.983092+0000","last_fullsized":"2024-04-19T02:20:07.983092+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:44:05.807254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.982541+0000","last_change":"2024-04-19T02:19:54.931532+0000","last_active":"2024-04-19T02:20:07.982541+0000","last_peered":"2024-04-19T02:20:07.982541+0000","last_clean":"2024-04-19T02:20:07.982541+0000","last_became_active":"2024-04-19T02:19:54.931278+0000","last_became_peered":"2024-04-19T02:19:54.931278+0000","last_unstale":"2024-04-19T02:20:07.982541+0000","last_undegraded":"2024-04-19T02:20:07.982541+0000","last_fullsized":"2024-04-19T02:20:07.982541+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:20:02.024046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661523+0000","last_change":"2024-04-19T02:15:29.286709+0000","last_active":"2024-04-19T02:20:08.661523+0000","last_peered":"2024-04-19T02:20:08.661523+0000","last_clean":"2024-04-19T02:20:08.661523+0000","last_became_active":"2024-04-19T02:15:29.286169+0000","last_became_peered":"2024-04-19T02:15:29.286169+0000","last_unstale":"2024-04-19T02:20:08.661523+0000","last_undegraded":"2024-04-19T02:20:08.661523+0000","last_fullsized":"2024-04-19T02:20:08.661523+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:58.741466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661124+0000","last_change":"2024-04-19T02:19:54.927063+0000","last_active":"2024-04-19T02:20:08.661124+0000","last_peered":"2024-04-19T02:20:08.661124+0000","last_clean":"2024-04-19T02:20:08.661124+0000","last_became_active":"2024-04-19T02:19:54.926046+0000","last_became_peered":"2024-04-19T02:19:54.926046+0000","last_unstale":"2024-04-19T02:20:08.661124+0000","last_undegraded":"2024-04-19T02:20:08.661124+0000","last_fullsized":"2024-04-19T02:20:08.661124+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:52:59.151542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":54,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981322+0000","last_change":"2024-04-19T02:19:54.931669+0000","last_active":"2024-04-19T02:20:07.981322+0000","last_peered":"2024-04-19T02:20:07.981322+0000","last_clean":"2024-04-19T02:20:07.981322+0000","last_became_active":"2024-04-19T02:19:54.931435+0000","last_became_peered":"2024-04-19T02:19:54.931435+0000","last_unstale":"2024-04-19T02:20:07.981322+0000","last_undegraded":"2024-04-19T02:20:07.981322+0000","last_fullsized":"2024-04-19T02:20:07.981322+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:42:58.222802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660547+0000","last_change":"2024-04-19T02:19:54.924250+0000","last_active":"2024-04-19T02:20:08.660547+0000","last_peered":"2024-04-19T02:20:08.660547+0000","last_clean":"2024-04-19T02:20:08.660547+0000","last_became_active":"2024-04-19T02:19:54.923984+0000","last_became_peered":"2024-04-19T02:19:54.923984+0000","last_unstale":"2024-04-19T02:20:08.660547+0000","last_undegraded":"2024-04-19T02:20:08.660547+0000","last_fullsized":"2024-04-19T02:20:08.660547+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:56:51.290239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660603+0000","last_change":"2024-04-19T02:19:54.926647+0000","last_active":"2024-04-19T02:20:08.660603+0000","last_peered":"2024-04-19T02:20:08.660603+0000","last_clean":"2024-04-19T02:20:08.660603+0000","last_became_active":"2024-04-19T02:19:54.925529+0000","last_became_peered":"2024-04-19T02:19:54.925529+0000","last_unstale":"2024-04-19T02:20:08.660603+0000","last_undegraded":"2024-04-19T02:20:08.660603+0000","last_fullsized":"2024-04-19T02:20:08.660603+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:49:06.911557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660492+0000","last_change":"2024-04-19T02:19:54.930828+0000","last_active":"2024-04-19T02:20:08.660492+0000","last_peered":"2024-04-19T02:20:08.660492+0000","last_clean":"2024-04-19T02:20:08.660492+0000","last_became_active":"2024-04-19T02:19:54.930075+0000","last_became_peered":"2024-04-19T02:19:54.930075+0000","last_unstale":"2024-04-19T02:20:08.660492+0000","last_undegraded":"2024-04-19T02:20:08.660492+0000","last_fullsized":"2024-04-19T02:20:08.660492+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:00.512431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.982135+0000","last_change":"2024-04-19T02:19:54.931617+0000","last_active":"2024-04-19T02:20:07.982135+0000","last_peered":"2024-04-19T02:20:07.982135+0000","last_clean":"2024-04-19T02:20:07.982135+0000","last_became_active":"2024-04-19T02:19:54.928496+0000","last_became_peered":"2024-04-19T02:19:54.928496+0000","last_unstale":"2024-04-19T02:20:07.982135+0000","last_undegraded":"2024-04-19T02:20:07.982135+0000","last_fullsized":"2024-04-19T02:20:07.982135+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:56:50.232031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":59,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661471+0000","last_change":"2024-04-19T02:16:30.093524+0000","last_active":"2024-04-19T02:20:08.661471+0000","last_peered":"2024-04-19T02:20:08.661471+0000","last_clean":"2024-04-19T02:20:08.661471+0000","last_became_active":"2024-04-19T02:16:30.093344+0000","last_became_peered":"2024-04-19T02:16:30.093344+0000","last_unstale":"2024-04-19T02:20:08.661471+0000","last_undegraded":"2024-04-19T02:20:08.661471+0000","last_fullsized":"2024-04-19T02:20:08.661471+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:14:40.293159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661398+0000","last_change":"2024-04-19T02:19:54.926754+0000","last_active":"2024-04-19T02:20:08.661398+0000","last_peered":"2024-04-19T02:20:08.661398+0000","last_clean":"2024-04-19T02:20:08.661398+0000","last_became_active":"2024-04-19T02:19:54.926040+0000","last_became_peered":"2024-04-19T02:19:54.926040+0000","last_unstale":"2024-04-19T02:20:08.661398+0000","last_undegraded":"2024-04-19T02:20:08.661398+0000","last_fullsized":"2024-04-19T02:20:08.661398+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:36:16.313500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.665922+0000","last_change":"2024-04-19T02:20:08.662601+0000","last_active":"2024-04-19T02:20:08.665922+0000","last_peered":"2024-04-19T02:20:08.665922+0000","last_clean":"2024-04-19T02:20:08.665922+0000","last_became_active":"2024-04-19T02:20:08.662234+0000","last_became_peered":"2024-04-19T02:20:08.662234+0000","last_unstale":"2024-04-19T02:20:08.665922+0000","last_undegraded":"2024-04-19T02:20:08.665922+0000","last_fullsized":"2024-04-19T02:20:08.665922+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:34:06.694985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":54,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981515+0000","last_change":"2024-04-19T02:19:54.932576+0000","last_active":"2024-04-19T02:20:07.981515+0000","last_peered":"2024-04-19T02:20:07.981515+0000","last_clean":"2024-04-19T02:20:07.981515+0000","last_became_active":"2024-04-19T02:19:54.932240+0000","last_became_peered":"2024-04-19T02:19:54.932240+0000","last_unstale":"2024-04-19T02:20:07.981515+0000","last_undegraded":"2024-04-19T02:20:07.981515+0000","last_fullsized":"2024-04-19T02:20:07.981515+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:10:10.453676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661084+0000","last_change":"2024-04-19T02:15:29.284262+0000","last_active":"2024-04-19T02:20:08.661084+0000","last_peered":"2024-04-19T02:20:08.661084+0000","last_clean":"2024-04-19T02:20:08.661084+0000","last_became_active":"2024-04-19T02:15:29.283121+0000","last_became_peered":"2024-04-19T02:15:29.283121+0000","last_unstale":"2024-04-19T02:20:08.661084+0000","last_undegraded":"2024-04-19T02:20:08.661084+0000","last_fullsized":"2024-04-19T02:20:08.661084+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660877+0000","last_change":"2024-04-19T02:15:29.285139+0000","last_active":"2024-04-19T02:20:08.660877+0000","last_peered":"2024-04-19T02:20:08.660877+0000","last_clean":"2024-04-19T02:20:08.660877+0000","last_became_active":"2024-04-19T02:15:29.284649+0000","last_became_peered":"2024-04-19T02:15:29.284649+0000","last_unstale":"2024-04-19T02:20:08.660877+0000","last_undegraded":"2024-04-19T02:20:08.660877+0000","last_fullsized":"2024-04-19T02:20:08.660877+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660809+0000","last_change":"2024-04-19T02:19:54.931033+0000","last_active":"2024-04-19T02:20:08.660809+0000","last_peered":"2024-04-19T02:20:08.660809+0000","last_clean":"2024-04-19T02:20:08.660809+0000","last_became_active":"2024-04-19T02:19:54.930437+0000","last_became_peered":"2024-04-19T02:19:54.930437+0000","last_unstale":"2024-04-19T02:20:08.660809+0000","last_undegraded":"2024-04-19T02:20:08.660809+0000","last_fullsized":"2024-04-19T02:20:08.660809+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:44:05.807254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":32,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-19T02:20:07.982061+0000","last_change":"2024-04-19T02:19:54.921061+0000","last_active":"2024-04-19T02:19:54.921061+0000","last_peered":"2024-04-19T02:19:53.557856+0000","last_clean":"2024-04-19T02:15:28.871717+0000","last_became_active":"2024-04-19T02:17:08.252165+0000","last_became_peered":"2024-04-19T02:17:08.252165+0000","last_unstale":"2024-04-19T02:20:07.982061+0000","last_undegraded":"2024-04-19T02:20:07.982061+0000","last_fullsized":"2024-04-19T02:20:07.982061+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:55:24.944798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996199+0000","last_change":"2024-04-19T02:19:54.933452+0000","last_active":"2024-04-19T02:20:08.996199+0000","last_peered":"2024-04-19T02:20:08.996199+0000","last_clean":"2024-04-19T02:20:08.996199+0000","last_became_active":"2024-04-19T02:19:54.933233+0000","last_became_peered":"2024-04-19T02:19:54.933233+0000","last_unstale":"2024-04-19T02:20:08.996199+0000","last_undegraded":"2024-04-19T02:20:08.996199+0000","last_fullsized":"2024-04-19T02:20:08.996199+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:50.712874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981674+0000","last_change":"2024-04-19T02:19:54.925745+0000","last_active":"2024-04-19T02:20:07.981674+0000","last_peered":"2024-04-19T02:20:07.981674+0000","last_clean":"2024-04-19T02:20:07.981674+0000","last_became_active":"2024-04-19T02:19:54.925060+0000","last_became_peered":"2024-04-19T02:19:54.925060+0000","last_unstale":"2024-04-19T02:20:07.981674+0000","last_undegraded":"2024-04-19T02:20:07.981674+0000","last_fullsized":"2024-04-19T02:20:07.981674+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:12:43.617806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661041+0000","last_change":"2024-04-19T02:19:54.927206+0000","last_active":"2024-04-19T02:20:08.661041+0000","last_peered":"2024-04-19T02:20:08.661041+0000","last_clean":"2024-04-19T02:20:08.661041+0000","last_became_active":"2024-04-19T02:19:54.926442+0000","last_became_peered":"2024-04-19T02:19:54.926442+0000","last_unstale":"2024-04-19T02:20:08.661041+0000","last_undegraded":"2024-04-19T02:20:08.661041+0000","last_fullsized":"2024-04-19T02:20:08.661041+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:27:17.095030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660768+0000","last_change":"2024-04-19T02:19:54.932532+0000","last_active":"2024-04-19T02:20:08.660768+0000","last_peered":"2024-04-19T02:20:08.660768+0000","last_clean":"2024-04-19T02:20:08.660768+0000","last_became_active":"2024-04-19T02:19:54.931438+0000","last_became_peered":"2024-04-19T02:19:54.931438+0000","last_unstale":"2024-04-19T02:20:08.660768+0000","last_undegraded":"2024-04-19T02:20:08.660768+0000","last_fullsized":"2024-04-19T02:20:08.660768+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:12:54.241778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.665603+0000","last_change":"2024-04-19T02:20:08.662261+0000","last_active":"2024-04-19T02:20:08.665603+0000","last_peered":"2024-04-19T02:20:08.665603+0000","last_clean":"2024-04-19T02:20:08.665603+0000","last_became_active":"2024-04-19T02:20:08.661940+0000","last_became_peered":"2024-04-19T02:20:08.661940+0000","last_unstale":"2024-04-19T02:20:08.665603+0000","last_undegraded":"2024-04-19T02:20:08.665603+0000","last_fullsized":"2024-04-19T02:20:08.665603+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:49:34.835266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":45,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T02:20:06.743619+0000","last_change":"2024-04-19T02:19:54.926885+0000","last_active":"2024-04-19T02:20:06.743619+0000","last_peered":"2024-04-19T02:20:06.743619+0000","last_clean":"2024-04-19T02:20:06.743619+0000","last_became_active":"2024-04-19T02:19:54.925939+0000","last_became_peered":"2024-04-19T02:19:54.925939+0000","last_unstale":"2024-04-19T02:20:06.743619+0000","last_undegraded":"2024-04-19T02:20:06.743619+0000","last_fullsized":"2024-04-19T02:20:06.743619+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:46:16.763335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981244+0000","last_change":"2024-04-19T02:19:54.928467+0000","last_active":"2024-04-19T02:20:07.981244+0000","last_peered":"2024-04-19T02:20:07.981244+0000","last_clean":"2024-04-19T02:20:07.981244+0000","last_became_active":"2024-04-19T02:19:54.928261+0000","last_became_peered":"2024-04-19T02:19:54.928261+0000","last_unstale":"2024-04-19T02:20:07.981244+0000","last_undegraded":"2024-04-19T02:20:07.981244+0000","last_fullsized":"2024-04-19T02:20:07.981244+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:40:43.645134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.983032+0000","last_change":"2024-04-19T02:15:29.278084+0000","last_active":"2024-04-19T02:20:07.983032+0000","last_peered":"2024-04-19T02:20:07.983032+0000","last_clean":"2024-04-19T02:20:07.983032+0000","last_became_active":"2024-04-19T02:15:29.276952+0000","last_became_peered":"2024-04-19T02:15:29.276952+0000","last_unstale":"2024-04-19T02:20:07.983032+0000","last_undegraded":"2024-04-19T02:20:07.983032+0000","last_fullsized":"2024-04-19T02:20:07.983032+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.982065+0000","last_change":"2024-04-19T02:19:54.933154+0000","last_active":"2024-04-19T02:20:07.982065+0000","last_peered":"2024-04-19T02:20:07.982065+0000","last_clean":"2024-04-19T02:20:07.982065+0000","last_became_active":"2024-04-19T02:19:54.931124+0000","last_became_peered":"2024-04-19T02:19:54.931124+0000","last_unstale":"2024-04-19T02:20:07.982065+0000","last_undegraded":"2024-04-19T02:20:07.982065+0000","last_fullsized":"2024-04-19T02:20:07.982065+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:49.555501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661389+0000","last_change":"2024-04-19T02:15:29.287389+0000","last_active":"2024-04-19T02:20:08.661389+0000","last_peered":"2024-04-19T02:20:08.661389+0000","last_clean":"2024-04-19T02:20:08.661389+0000","last_became_active":"2024-04-19T02:15:29.286431+0000","last_became_peered":"2024-04-19T02:15:29.286431+0000","last_unstale":"2024-04-19T02:20:08.661389+0000","last_undegraded":"2024-04-19T02:20:08.661389+0000","last_fullsized":"2024-04-19T02:20:08.661389+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:58:30.117887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":56,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981516+0000","last_change":"2024-04-19T02:19:54.927108+0000","last_active":"2024-04-19T02:20:07.981516+0000","last_peered":"2024-04-19T02:20:07.981516+0000","last_clean":"2024-04-19T02:20:07.981516+0000","last_became_active":"2024-04-19T02:19:54.926838+0000","last_became_peered":"2024-04-19T02:19:54.926838+0000","last_unstale":"2024-04-19T02:20:07.981516+0000","last_undegraded":"2024-04-19T02:20:07.981516+0000","last_fullsized":"2024-04-19T02:20:07.981516+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:25:27.561607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":76,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.982866+0000","last_change":"2024-04-19T02:15:29.281792+0000","last_active":"2024-04-19T02:20:07.982866+0000","last_peered":"2024-04-19T02:20:07.982866+0000","last_clean":"2024-04-19T02:20:07.982866+0000","last_became_active":"2024-04-19T02:15:29.280479+0000","last_became_peered":"2024-04-19T02:15:29.280479+0000","last_unstale":"2024-04-19T02:20:07.982866+0000","last_undegraded":"2024-04-19T02:20:07.982866+0000","last_fullsized":"2024-04-19T02:20:07.982866+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.980982+0000","last_change":"2024-04-19T02:19:54.925277+0000","last_active":"2024-04-19T02:20:07.980982+0000","last_peered":"2024-04-19T02:20:07.980982+0000","last_clean":"2024-04-19T02:20:07.980982+0000","last_became_active":"2024-04-19T02:19:54.924484+0000","last_became_peered":"2024-04-19T02:19:54.924484+0000","last_unstale":"2024-04-19T02:20:07.980982+0000","last_undegraded":"2024-04-19T02:20:07.980982+0000","last_fullsized":"2024-04-19T02:20:07.980982+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:57:54.845371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":45,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T02:20:06.744283+0000","last_change":"2024-04-19T02:19:54.931673+0000","last_active":"2024-04-19T02:20:06.744283+0000","last_peered":"2024-04-19T02:20:06.744283+0000","last_clean":"2024-04-19T02:20:06.744283+0000","last_became_active":"2024-04-19T02:19:54.931162+0000","last_became_peered":"2024-04-19T02:19:54.931162+0000","last_unstale":"2024-04-19T02:20:06.744283+0000","last_undegraded":"2024-04-19T02:20:06.744283+0000","last_fullsized":"2024-04-19T02:20:06.744283+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:42:40.944146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.980970+0000","last_change":"2024-04-19T02:19:54.930346+0000","last_active":"2024-04-19T02:20:07.980970+0000","last_peered":"2024-04-19T02:20:07.980970+0000","last_clean":"2024-04-19T02:20:07.980970+0000","last_became_active":"2024-04-19T02:19:54.928398+0000","last_became_peered":"2024-04-19T02:19:54.928398+0000","last_unstale":"2024-04-19T02:20:07.980970+0000","last_undegraded":"2024-04-19T02:20:07.980970+0000","last_fullsized":"2024-04-19T02:20:07.980970+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:46.321275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.982989+0000","last_change":"2024-04-19T02:15:29.280879+0000","last_active":"2024-04-19T02:20:07.982989+0000","last_peered":"2024-04-19T02:20:07.982989+0000","last_clean":"2024-04-19T02:20:07.982989+0000","last_became_active":"2024-04-19T02:15:29.279314+0000","last_became_peered":"2024-04-19T02:15:29.279314+0000","last_unstale":"2024-04-19T02:20:07.982989+0000","last_undegraded":"2024-04-19T02:20:07.982989+0000","last_fullsized":"2024-04-19T02:20:07.982989+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.982154+0000","last_change":"2024-04-19T02:19:54.927744+0000","last_active":"2024-04-19T02:20:07.982154+0000","last_peered":"2024-04-19T02:20:07.982154+0000","last_clean":"2024-04-19T02:20:07.982154+0000","last_became_active":"2024-04-19T02:19:54.925729+0000","last_became_peered":"2024-04-19T02:19:54.925729+0000","last_unstale":"2024-04-19T02:20:07.982154+0000","last_undegraded":"2024-04-19T02:20:07.982154+0000","last_fullsized":"2024-04-19T02:20:07.982154+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:27:57.229684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.980870+0000","last_change":"2024-04-19T02:19:54.928435+0000","last_active":"2024-04-19T02:20:07.980870+0000","last_peered":"2024-04-19T02:20:07.980870+0000","last_clean":"2024-04-19T02:20:07.980870+0000","last_became_active":"2024-04-19T02:19:54.927666+0000","last_became_peered":"2024-04-19T02:19:54.927666+0000","last_unstale":"2024-04-19T02:20:07.980870+0000","last_undegraded":"2024-04-19T02:20:07.980870+0000","last_fullsized":"2024-04-19T02:20:07.980870+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:20:45.000808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661594+0000","last_change":"2024-04-19T02:19:54.932025+0000","last_active":"2024-04-19T02:20:08.661594+0000","last_peered":"2024-04-19T02:20:08.661594+0000","last_clean":"2024-04-19T02:20:08.661594+0000","last_became_active":"2024-04-19T02:19:54.931540+0000","last_became_peered":"2024-04-19T02:19:54.931540+0000","last_unstale":"2024-04-19T02:20:08.661594+0000","last_undegraded":"2024-04-19T02:20:08.661594+0000","last_fullsized":"2024-04-19T02:20:08.661594+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:03:31.479331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981285+0000","last_change":"2024-04-19T02:19:54.924493+0000","last_active":"2024-04-19T02:20:07.981285+0000","last_peered":"2024-04-19T02:20:07.981285+0000","last_clean":"2024-04-19T02:20:07.981285+0000","last_became_active":"2024-04-19T02:19:54.923784+0000","last_became_peered":"2024-04-19T02:19:54.923784+0000","last_unstale":"2024-04-19T02:20:07.981285+0000","last_undegraded":"2024-04-19T02:20:07.981285+0000","last_fullsized":"2024-04-19T02:20:07.981285+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:09:34.378788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":80,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.982511+0000","last_change":"2024-04-19T02:15:28.892937+0000","last_active":"2024-04-19T02:20:07.982511+0000","last_peered":"2024-04-19T02:20:07.982511+0000","last_clean":"2024-04-19T02:20:07.982511+0000","last_became_active":"2024-04-19T02:15:28.891440+0000","last_became_peered":"2024-04-19T02:15:28.891440+0000","last_unstale":"2024-04-19T02:20:07.982511+0000","last_undegraded":"2024-04-19T02:20:07.982511+0000","last_fullsized":"2024-04-19T02:20:07.982511+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981039+0000","last_change":"2024-04-19T02:19:54.923898+0000","last_active":"2024-04-19T02:20:07.981039+0000","last_peered":"2024-04-19T02:20:07.981039+0000","last_clean":"2024-04-19T02:20:07.981039+0000","last_became_active":"2024-04-19T02:19:54.923493+0000","last_became_peered":"2024-04-19T02:19:54.923493+0000","last_unstale":"2024-04-19T02:20:07.981039+0000","last_undegraded":"2024-04-19T02:20:07.981039+0000","last_fullsized":"2024-04-19T02:20:07.981039+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:33.123319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660931+0000","last_change":"2024-04-19T02:15:28.891097+0000","last_active":"2024-04-19T02:20:08.660931+0000","last_peered":"2024-04-19T02:20:08.660931+0000","last_clean":"2024-04-19T02:20:08.660931+0000","last_became_active":"2024-04-19T02:15:28.890795+0000","last_became_peered":"2024-04-19T02:15:28.890795+0000","last_unstale":"2024-04-19T02:20:08.660931+0000","last_undegraded":"2024-04-19T02:20:08.660931+0000","last_fullsized":"2024-04-19T02:20:08.660931+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661095+0000","last_change":"2024-04-19T02:15:29.278546+0000","last_active":"2024-04-19T02:20:08.661095+0000","last_peered":"2024-04-19T02:20:08.661095+0000","last_clean":"2024-04-19T02:20:08.661095+0000","last_became_active":"2024-04-19T02:15:29.277547+0000","last_became_peered":"2024-04-19T02:15:29.277547+0000","last_unstale":"2024-04-19T02:20:08.661095+0000","last_undegraded":"2024-04-19T02:20:08.661095+0000","last_fullsized":"2024-04-19T02:20:08.661095+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661075+0000","last_change":"2024-04-19T02:19:54.933035+0000","last_active":"2024-04-19T02:20:08.661075+0000","last_peered":"2024-04-19T02:20:08.661075+0000","last_clean":"2024-04-19T02:20:08.661075+0000","last_became_active":"2024-04-19T02:19:54.932829+0000","last_became_peered":"2024-04-19T02:19:54.932829+0000","last_unstale":"2024-04-19T02:20:08.661075+0000","last_undegraded":"2024-04-19T02:20:08.661075+0000","last_fullsized":"2024-04-19T02:20:08.661075+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:09:05.626623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.988868+0000","last_change":"2024-04-19T02:20:07.983368+0000","last_active":"2024-04-19T02:20:07.988868+0000","last_peered":"2024-04-19T02:20:07.988868+0000","last_clean":"2024-04-19T02:20:07.988868+0000","last_became_active":"2024-04-19T02:20:07.983080+0000","last_became_peered":"2024-04-19T02:20:07.983080+0000","last_unstale":"2024-04-19T02:20:07.988868+0000","last_undegraded":"2024-04-19T02:20:07.988868+0000","last_fullsized":"2024-04-19T02:20:07.988868+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:24.138269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981065+0000","last_change":"2024-04-19T02:19:54.927323+0000","last_active":"2024-04-19T02:20:07.981065+0000","last_peered":"2024-04-19T02:20:07.981065+0000","last_clean":"2024-04-19T02:20:07.981065+0000","last_became_active":"2024-04-19T02:19:54.925703+0000","last_became_peered":"2024-04-19T02:19:54.925703+0000","last_unstale":"2024-04-19T02:20:07.981065+0000","last_undegraded":"2024-04-19T02:20:07.981065+0000","last_fullsized":"2024-04-19T02:20:07.981065+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:46:59.533765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":54,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.982823+0000","last_change":"2024-04-19T02:19:54.925918+0000","last_active":"2024-04-19T02:20:07.982823+0000","last_peered":"2024-04-19T02:20:07.982823+0000","last_clean":"2024-04-19T02:20:07.982823+0000","last_became_active":"2024-04-19T02:19:54.925634+0000","last_became_peered":"2024-04-19T02:19:54.925634+0000","last_unstale":"2024-04-19T02:20:07.982823+0000","last_undegraded":"2024-04-19T02:20:07.982823+0000","last_fullsized":"2024-04-19T02:20:07.982823+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:14:13.074455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996285+0000","last_change":"2024-04-19T02:15:28.892934+0000","last_active":"2024-04-19T02:20:08.996285+0000","last_peered":"2024-04-19T02:20:08.996285+0000","last_clean":"2024-04-19T02:20:08.996285+0000","last_became_active":"2024-04-19T02:15:28.891879+0000","last_became_peered":"2024-04-19T02:15:28.891879+0000","last_unstale":"2024-04-19T02:20:08.996285+0000","last_undegraded":"2024-04-19T02:20:08.996285+0000","last_fullsized":"2024-04-19T02:20:08.996285+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:10:12.514798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":45,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T02:20:06.744343+0000","last_change":"2024-04-19T02:19:54.931909+0000","last_active":"2024-04-19T02:20:06.744343+0000","last_peered":"2024-04-19T02:20:06.744343+0000","last_clean":"2024-04-19T02:20:06.744343+0000","last_became_active":"2024-04-19T02:19:54.931301+0000","last_became_peered":"2024-04-19T02:19:54.931301+0000","last_unstale":"2024-04-19T02:20:06.744343+0000","last_undegraded":"2024-04-19T02:20:06.744343+0000","last_fullsized":"2024-04-19T02:20:06.744343+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:10:08.224575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993693+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:20:08.993693+0000","last_peered":"2024-04-19T02:20:08.993693+0000","last_clean":"2024-04-19T02:20:08.993693+0000","last_became_active":"2024-04-19T02:15:28.890882+0000","last_became_peered":"2024-04-19T02:15:28.890882+0000","last_unstale":"2024-04-19T02:20:08.993693+0000","last_undegraded":"2024-04-19T02:20:08.993693+0000","last_fullsized":"2024-04-19T02:20:08.993693+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:31.673938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.982282+0000","last_change":"2024-04-19T02:19:54.927209+0000","last_active":"2024-04-19T02:20:07.982282+0000","last_peered":"2024-04-19T02:20:07.982282+0000","last_clean":"2024-04-19T02:20:07.982282+0000","last_became_active":"2024-04-19T02:19:54.925121+0000","last_became_peered":"2024-04-19T02:19:54.925121+0000","last_unstale":"2024-04-19T02:20:07.982282+0000","last_undegraded":"2024-04-19T02:20:07.982282+0000","last_fullsized":"2024-04-19T02:20:07.982282+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:16:21.982909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":80,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661726+0000","last_change":"2024-04-19T02:15:28.890265+0000","last_active":"2024-04-19T02:20:08.661726+0000","last_peered":"2024-04-19T02:20:08.661726+0000","last_clean":"2024-04-19T02:20:08.661726+0000","last_became_active":"2024-04-19T02:15:28.890004+0000","last_became_peered":"2024-04-19T02:15:28.890004+0000","last_unstale":"2024-04-19T02:20:08.661726+0000","last_undegraded":"2024-04-19T02:20:08.661726+0000","last_fullsized":"2024-04-19T02:20:08.661726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:02.517101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.980972+0000","last_change":"2024-04-19T02:15:29.285529+0000","last_active":"2024-04-19T02:20:07.980972+0000","last_peered":"2024-04-19T02:20:07.980972+0000","last_clean":"2024-04-19T02:20:07.980972+0000","last_became_active":"2024-04-19T02:15:29.285197+0000","last_became_peered":"2024-04-19T02:15:29.285197+0000","last_unstale":"2024-04-19T02:20:07.980972+0000","last_undegraded":"2024-04-19T02:20:07.980972+0000","last_fullsized":"2024-04-19T02:20:07.980972+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":80,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.982535+0000","last_change":"2024-04-19T02:15:28.893902+0000","last_active":"2024-04-19T02:20:07.982535+0000","last_peered":"2024-04-19T02:20:07.982535+0000","last_clean":"2024-04-19T02:20:07.982535+0000","last_became_active":"2024-04-19T02:15:28.893231+0000","last_became_peered":"2024-04-19T02:15:28.893231+0000","last_unstale":"2024-04-19T02:20:07.982535+0000","last_undegraded":"2024-04-19T02:20:07.982535+0000","last_fullsized":"2024-04-19T02:20:07.982535+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:23.658442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981713+0000","last_change":"2024-04-19T02:19:54.925840+0000","last_active":"2024-04-19T02:20:07.981713+0000","last_peered":"2024-04-19T02:20:07.981713+0000","last_clean":"2024-04-19T02:20:07.981713+0000","last_became_active":"2024-04-19T02:19:54.925502+0000","last_became_peered":"2024-04-19T02:19:54.925502+0000","last_unstale":"2024-04-19T02:20:07.981713+0000","last_undegraded":"2024-04-19T02:20:07.981713+0000","last_fullsized":"2024-04-19T02:20:07.981713+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:57.667340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":80,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661502+0000","last_change":"2024-04-19T02:15:28.891234+0000","last_active":"2024-04-19T02:20:08.661502+0000","last_peered":"2024-04-19T02:20:08.661502+0000","last_clean":"2024-04-19T02:20:08.661502+0000","last_became_active":"2024-04-19T02:15:28.890881+0000","last_became_peered":"2024-04-19T02:15:28.890881+0000","last_unstale":"2024-04-19T02:20:08.661502+0000","last_undegraded":"2024-04-19T02:20:08.661502+0000","last_fullsized":"2024-04-19T02:20:08.661502+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661157+0000","last_change":"2024-04-19T02:19:54.926103+0000","last_active":"2024-04-19T02:20:08.661157+0000","last_peered":"2024-04-19T02:20:08.661157+0000","last_clean":"2024-04-19T02:20:08.661157+0000","last_became_active":"2024-04-19T02:19:54.925591+0000","last_became_peered":"2024-04-19T02:19:54.925591+0000","last_unstale":"2024-04-19T02:20:08.661157+0000","last_undegraded":"2024-04-19T02:20:08.661157+0000","last_fullsized":"2024-04-19T02:20:08.661157+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:44:40.560973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":92,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660748+0000","last_change":"2024-04-19T02:19:54.926813+0000","last_active":"2024-04-19T02:20:08.660748+0000","last_peered":"2024-04-19T02:20:08.660748+0000","last_clean":"2024-04-19T02:20:08.660748+0000","last_became_active":"2024-04-19T02:19:54.925523+0000","last_became_peered":"2024-04-19T02:19:54.925523+0000","last_unstale":"2024-04-19T02:20:08.660748+0000","last_undegraded":"2024-04-19T02:20:08.660748+0000","last_fullsized":"2024-04-19T02:20:08.660748+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:39:56.887385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981499+0000","last_change":"2024-04-19T02:19:54.932306+0000","last_active":"2024-04-19T02:20:07.981499+0000","last_peered":"2024-04-19T02:20:07.981499+0000","last_clean":"2024-04-19T02:20:07.981499+0000","last_became_active":"2024-04-19T02:19:54.930843+0000","last_became_peered":"2024-04-19T02:19:54.930843+0000","last_unstale":"2024-04-19T02:20:07.981499+0000","last_undegraded":"2024-04-19T02:20:07.981499+0000","last_fullsized":"2024-04-19T02:20:07.981499+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:24:51.884048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981355+0000","last_change":"2024-04-19T02:19:54.932708+0000","last_active":"2024-04-19T02:20:07.981355+0000","last_peered":"2024-04-19T02:20:07.981355+0000","last_clean":"2024-04-19T02:20:07.981355+0000","last_became_active":"2024-04-19T02:19:54.931553+0000","last_became_peered":"2024-04-19T02:19:54.931553+0000","last_unstale":"2024-04-19T02:20:07.981355+0000","last_undegraded":"2024-04-19T02:20:07.981355+0000","last_fullsized":"2024-04-19T02:20:07.981355+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:47:07.651618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660749+0000","last_change":"2024-04-19T02:19:54.927009+0000","last_active":"2024-04-19T02:20:08.660749+0000","last_peered":"2024-04-19T02:20:08.660749+0000","last_clean":"2024-04-19T02:20:08.660749+0000","last_became_active":"2024-04-19T02:19:54.925645+0000","last_became_peered":"2024-04-19T02:19:54.925645+0000","last_unstale":"2024-04-19T02:20:08.660749+0000","last_undegraded":"2024-04-19T02:20:08.660749+0000","last_fullsized":"2024-04-19T02:20:08.660749+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:33:45.685463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":92,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660643+0000","last_change":"2024-04-19T02:19:54.923689+0000","last_active":"2024-04-19T02:20:08.660643+0000","last_peered":"2024-04-19T02:20:08.660643+0000","last_clean":"2024-04-19T02:20:08.660643+0000","last_became_active":"2024-04-19T02:19:54.923321+0000","last_became_peered":"2024-04-19T02:19:54.923321+0000","last_unstale":"2024-04-19T02:20:08.660643+0000","last_undegraded":"2024-04-19T02:20:08.660643+0000","last_fullsized":"2024-04-19T02:20:08.660643+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:03:01.578244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661714+0000","last_change":"2024-04-19T02:15:29.285019+0000","last_active":"2024-04-19T02:20:08.661714+0000","last_peered":"2024-04-19T02:20:08.661714+0000","last_clean":"2024-04-19T02:20:08.661714+0000","last_became_active":"2024-04-19T02:15:29.284650+0000","last_became_peered":"2024-04-19T02:15:29.284650+0000","last_unstale":"2024-04-19T02:20:08.661714+0000","last_undegraded":"2024-04-19T02:20:08.661714+0000","last_fullsized":"2024-04-19T02:20:08.661714+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.665914+0000","last_change":"2024-04-19T02:20:08.662566+0000","last_active":"2024-04-19T02:20:08.665914+0000","last_peered":"2024-04-19T02:20:08.665914+0000","last_clean":"2024-04-19T02:20:08.665914+0000","last_became_active":"2024-04-19T02:20:08.662277+0000","last_became_peered":"2024-04-19T02:20:08.662277+0000","last_unstale":"2024-04-19T02:20:08.665914+0000","last_undegraded":"2024-04-19T02:20:08.665914+0000","last_fullsized":"2024-04-19T02:20:08.665914+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:36:27.307955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661617+0000","last_change":"2024-04-19T02:15:29.287190+0000","last_active":"2024-04-19T02:20:08.661617+0000","last_peered":"2024-04-19T02:20:08.661617+0000","last_clean":"2024-04-19T02:20:08.661617+0000","last_became_active":"2024-04-19T02:15:29.286606+0000","last_became_peered":"2024-04-19T02:15:29.286606+0000","last_unstale":"2024-04-19T02:20:08.661617+0000","last_undegraded":"2024-04-19T02:20:08.661617+0000","last_fullsized":"2024-04-19T02:20:08.661617+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:28.387062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981146+0000","last_change":"2024-04-19T02:19:54.928493+0000","last_active":"2024-04-19T02:20:07.981146+0000","last_peered":"2024-04-19T02:20:07.981146+0000","last_clean":"2024-04-19T02:20:07.981146+0000","last_became_active":"2024-04-19T02:19:54.928298+0000","last_became_peered":"2024-04-19T02:19:54.928298+0000","last_unstale":"2024-04-19T02:20:07.981146+0000","last_undegraded":"2024-04-19T02:20:07.981146+0000","last_fullsized":"2024-04-19T02:20:07.981146+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:11:54.564261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.982056+0000","last_change":"2024-04-19T02:19:54.930452+0000","last_active":"2024-04-19T02:20:07.982056+0000","last_peered":"2024-04-19T02:20:07.982056+0000","last_clean":"2024-04-19T02:20:07.982056+0000","last_became_active":"2024-04-19T02:19:54.927309+0000","last_became_peered":"2024-04-19T02:19:54.927309+0000","last_unstale":"2024-04-19T02:20:07.982056+0000","last_undegraded":"2024-04-19T02:20:07.982056+0000","last_fullsized":"2024-04-19T02:20:07.982056+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:56:20.174957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":32,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-19T02:20:07.982091+0000","last_change":"2024-04-19T02:19:54.916264+0000","last_active":"2024-04-19T02:19:54.916264+0000","last_peered":"2024-04-19T02:19:53.557205+0000","last_clean":"2024-04-19T02:15:23.520722+0000","last_became_active":"2024-04-19T02:17:08.249349+0000","last_became_peered":"2024-04-19T02:17:08.249349+0000","last_unstale":"2024-04-19T02:20:07.982091+0000","last_undegraded":"2024-04-19T02:20:07.982091+0000","last_fullsized":"2024-04-19T02:20:07.982091+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:40.613587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":92,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661604+0000","last_change":"2024-04-19T02:19:54.926207+0000","last_active":"2024-04-19T02:20:08.661604+0000","last_peered":"2024-04-19T02:20:08.661604+0000","last_clean":"2024-04-19T02:20:08.661604+0000","last_became_active":"2024-04-19T02:19:54.925872+0000","last_became_peered":"2024-04-19T02:19:54.925872+0000","last_unstale":"2024-04-19T02:20:08.661604+0000","last_undegraded":"2024-04-19T02:20:08.661604+0000","last_fullsized":"2024-04-19T02:20:08.661604+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:31:46.734042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981815+0000","last_change":"2024-04-19T02:15:29.277922+0000","last_active":"2024-04-19T02:20:07.981815+0000","last_peered":"2024-04-19T02:20:07.981815+0000","last_clean":"2024-04-19T02:20:07.981815+0000","last_became_active":"2024-04-19T02:15:29.276968+0000","last_became_peered":"2024-04-19T02:15:29.276968+0000","last_unstale":"2024-04-19T02:20:07.981815+0000","last_undegraded":"2024-04-19T02:20:07.981815+0000","last_fullsized":"2024-04-19T02:20:07.981815+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":95,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660974+0000","last_change":"2024-04-19T02:19:54.927361+0000","last_active":"2024-04-19T02:20:08.660974+0000","last_peered":"2024-04-19T02:20:08.660974+0000","last_clean":"2024-04-19T02:20:08.660974+0000","last_became_active":"2024-04-19T02:19:54.927033+0000","last_became_peered":"2024-04-19T02:19:54.927033+0000","last_unstale":"2024-04-19T02:20:08.660974+0000","last_undegraded":"2024-04-19T02:20:08.660974+0000","last_fullsized":"2024-04-19T02:20:08.660974+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:07.194915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":92,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660955+0000","last_change":"2024-04-19T02:19:54.932790+0000","last_active":"2024-04-19T02:20:08.660955+0000","last_peered":"2024-04-19T02:20:08.660955+0000","last_clean":"2024-04-19T02:20:08.660955+0000","last_became_active":"2024-04-19T02:19:54.931683+0000","last_became_peered":"2024-04-19T02:19:54.931683+0000","last_unstale":"2024-04-19T02:20:08.660955+0000","last_undegraded":"2024-04-19T02:20:08.660955+0000","last_fullsized":"2024-04-19T02:20:08.660955+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:23:00.124845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981515+0000","last_change":"2024-04-19T02:19:54.926109+0000","last_active":"2024-04-19T02:20:07.981515+0000","last_peered":"2024-04-19T02:20:07.981515+0000","last_clean":"2024-04-19T02:20:07.981515+0000","last_became_active":"2024-04-19T02:19:54.924686+0000","last_became_peered":"2024-04-19T02:19:54.924686+0000","last_unstale":"2024-04-19T02:20:07.981515+0000","last_undegraded":"2024-04-19T02:20:07.981515+0000","last_fullsized":"2024-04-19T02:20:07.981515+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:20:03.487999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981372+0000","last_change":"2024-04-19T02:19:54.923465+0000","last_active":"2024-04-19T02:20:07.981372+0000","last_peered":"2024-04-19T02:20:07.981372+0000","last_clean":"2024-04-19T02:20:07.981372+0000","last_became_active":"2024-04-19T02:19:54.923164+0000","last_became_peered":"2024-04-19T02:19:54.923164+0000","last_unstale":"2024-04-19T02:20:07.981372+0000","last_undegraded":"2024-04-19T02:20:07.981372+0000","last_fullsized":"2024-04-19T02:20:07.981372+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:53:29.520848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.665628+0000","last_change":"2024-04-19T02:20:08.662301+0000","last_active":"2024-04-19T02:20:08.665628+0000","last_peered":"2024-04-19T02:20:08.665628+0000","last_clean":"2024-04-19T02:20:08.665628+0000","last_became_active":"2024-04-19T02:20:08.661952+0000","last_became_peered":"2024-04-19T02:20:08.661952+0000","last_unstale":"2024-04-19T02:20:08.665628+0000","last_undegraded":"2024-04-19T02:20:08.665628+0000","last_fullsized":"2024-04-19T02:20:08.665628+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:41:21.658836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.982200+0000","last_change":"2024-04-19T02:19:54.930115+0000","last_active":"2024-04-19T02:20:07.982200+0000","last_peered":"2024-04-19T02:20:07.982200+0000","last_clean":"2024-04-19T02:20:07.982200+0000","last_became_active":"2024-04-19T02:19:54.926463+0000","last_became_peered":"2024-04-19T02:19:54.926463+0000","last_unstale":"2024-04-19T02:20:07.982200+0000","last_undegraded":"2024-04-19T02:20:07.982200+0000","last_fullsized":"2024-04-19T02:20:07.982200+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:00.191645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":95,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660877+0000","last_change":"2024-04-19T02:19:54.932929+0000","last_active":"2024-04-19T02:20:08.660877+0000","last_peered":"2024-04-19T02:20:08.660877+0000","last_clean":"2024-04-19T02:20:08.660877+0000","last_became_active":"2024-04-19T02:19:54.932571+0000","last_became_peered":"2024-04-19T02:19:54.932571+0000","last_unstale":"2024-04-19T02:20:08.660877+0000","last_undegraded":"2024-04-19T02:20:08.660877+0000","last_fullsized":"2024-04-19T02:20:08.660877+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:50:08.657036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":278,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660871+0000","last_change":"2024-04-19T02:15:24.533634+0000","last_active":"2024-04-19T02:20:08.660871+0000","last_peered":"2024-04-19T02:20:08.660871+0000","last_clean":"2024-04-19T02:20:08.660871+0000","last_became_active":"2024-04-19T02:15:24.533420+0000","last_became_peered":"2024-04-19T02:15:24.533420+0000","last_unstale":"2024-04-19T02:20:08.660871+0000","last_undegraded":"2024-04-19T02:20:08.660871+0000","last_fullsized":"2024-04-19T02:20:08.660871+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":44,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T02:20:05.964845+0000","last_change":"2024-04-19T02:19:54.924862+0000","last_active":"2024-04-19T02:20:05.964845+0000","last_peered":"2024-04-19T02:20:05.964845+0000","last_clean":"2024-04-19T02:20:05.964845+0000","last_became_active":"2024-04-19T02:19:54.924581+0000","last_became_peered":"2024-04-19T02:19:54.924581+0000","last_unstale":"2024-04-19T02:20:05.964845+0000","last_undegraded":"2024-04-19T02:20:05.964845+0000","last_fullsized":"2024-04-19T02:20:05.964845+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:34:53.681271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661658+0000","last_change":"2024-04-19T02:15:29.285015+0000","last_active":"2024-04-19T02:20:08.661658+0000","last_peered":"2024-04-19T02:20:08.661658+0000","last_clean":"2024-04-19T02:20:08.661658+0000","last_became_active":"2024-04-19T02:15:29.284164+0000","last_became_peered":"2024-04-19T02:15:29.284164+0000","last_unstale":"2024-04-19T02:20:08.661658+0000","last_undegraded":"2024-04-19T02:20:08.661658+0000","last_fullsized":"2024-04-19T02:20:08.661658+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:36.987844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660906+0000","last_change":"2024-04-19T02:15:24.533912+0000","last_active":"2024-04-19T02:20:08.660906+0000","last_peered":"2024-04-19T02:20:08.660906+0000","last_clean":"2024-04-19T02:20:08.660906+0000","last_became_active":"2024-04-19T02:15:24.533580+0000","last_became_peered":"2024-04-19T02:15:24.533580+0000","last_unstale":"2024-04-19T02:20:08.660906+0000","last_undegraded":"2024-04-19T02:20:08.660906+0000","last_fullsized":"2024-04-19T02:20:08.660906+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:45.045477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":45,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T02:20:06.743494+0000","last_change":"2024-04-19T02:19:54.926899+0000","last_active":"2024-04-19T02:20:06.743494+0000","last_peered":"2024-04-19T02:20:06.743494+0000","last_clean":"2024-04-19T02:20:06.743494+0000","last_became_active":"2024-04-19T02:19:54.926346+0000","last_became_peered":"2024-04-19T02:19:54.926346+0000","last_unstale":"2024-04-19T02:20:06.743494+0000","last_undegraded":"2024-04-19T02:20:06.743494+0000","last_fullsized":"2024-04-19T02:20:06.743494+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:35:11.172682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":48,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.991873+0000","last_change":"2024-04-19T02:20:07.986363+0000","last_active":"2024-04-19T02:20:07.991873+0000","last_peered":"2024-04-19T02:20:07.991873+0000","last_clean":"2024-04-19T02:20:07.991873+0000","last_became_active":"2024-04-19T02:20:07.986110+0000","last_became_peered":"2024-04-19T02:20:07.986110+0000","last_unstale":"2024-04-19T02:20:07.991873+0000","last_undegraded":"2024-04-19T02:20:07.991873+0000","last_fullsized":"2024-04-19T02:20:07.991873+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:12.545910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":59,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.982625+0000","last_change":"2024-04-19T02:19:54.925886+0000","last_active":"2024-04-19T02:20:07.982625+0000","last_peered":"2024-04-19T02:20:07.982625+0000","last_clean":"2024-04-19T02:20:07.982625+0000","last_became_active":"2024-04-19T02:19:54.925570+0000","last_became_peered":"2024-04-19T02:19:54.925570+0000","last_unstale":"2024-04-19T02:20:07.982625+0000","last_undegraded":"2024-04-19T02:20:07.982625+0000","last_fullsized":"2024-04-19T02:20:07.982625+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:33:34.594161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981348+0000","last_change":"2024-04-19T02:19:54.933960+0000","last_active":"2024-04-19T02:20:07.981348+0000","last_peered":"2024-04-19T02:20:07.981348+0000","last_clean":"2024-04-19T02:20:07.981348+0000","last_became_active":"2024-04-19T02:19:54.929918+0000","last_became_peered":"2024-04-19T02:19:54.929918+0000","last_unstale":"2024-04-19T02:20:07.981348+0000","last_undegraded":"2024-04-19T02:20:07.981348+0000","last_fullsized":"2024-04-19T02:20:07.981348+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:33:10.282684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981355+0000","last_change":"2024-04-19T02:15:29.281694+0000","last_active":"2024-04-19T02:20:07.981355+0000","last_peered":"2024-04-19T02:20:07.981355+0000","last_clean":"2024-04-19T02:20:07.981355+0000","last_became_active":"2024-04-19T02:15:29.280519+0000","last_became_peered":"2024-04-19T02:15:29.280519+0000","last_unstale":"2024-04-19T02:20:07.981355+0000","last_undegraded":"2024-04-19T02:20:07.981355+0000","last_fullsized":"2024-04-19T02:20:07.981355+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:50.890545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981945+0000","last_change":"2024-04-19T02:19:54.931726+0000","last_active":"2024-04-19T02:20:07.981945+0000","last_peered":"2024-04-19T02:20:07.981945+0000","last_clean":"2024-04-19T02:20:07.981945+0000","last_became_active":"2024-04-19T02:19:54.928460+0000","last_became_peered":"2024-04-19T02:19:54.928460+0000","last_unstale":"2024-04-19T02:20:07.981945+0000","last_undegraded":"2024-04-19T02:20:07.981945+0000","last_fullsized":"2024-04-19T02:20:07.981945+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:07:04.935620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":44,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T02:20:05.965726+0000","last_change":"2024-04-19T02:19:54.932487+0000","last_active":"2024-04-19T02:20:05.965726+0000","last_peered":"2024-04-19T02:20:05.965726+0000","last_clean":"2024-04-19T02:20:05.965726+0000","last_became_active":"2024-04-19T02:19:54.932147+0000","last_became_peered":"2024-04-19T02:19:54.932147+0000","last_unstale":"2024-04-19T02:20:05.965726+0000","last_undegraded":"2024-04-19T02:20:05.965726+0000","last_fullsized":"2024-04-19T02:20:05.965726+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:07:56.379190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":45,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T02:20:06.743095+0000","last_change":"2024-04-19T02:19:54.930868+0000","last_active":"2024-04-19T02:20:06.743095+0000","last_peered":"2024-04-19T02:20:06.743095+0000","last_clean":"2024-04-19T02:20:06.743095+0000","last_became_active":"2024-04-19T02:19:54.930134+0000","last_became_peered":"2024-04-19T02:19:54.930134+0000","last_unstale":"2024-04-19T02:20:06.743095+0000","last_undegraded":"2024-04-19T02:20:06.743095+0000","last_fullsized":"2024-04-19T02:20:06.743095+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:05:46.319702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661749+0000","last_change":"2024-04-19T02:15:24.533777+0000","last_active":"2024-04-19T02:20:08.661749+0000","last_peered":"2024-04-19T02:20:08.661749+0000","last_clean":"2024-04-19T02:20:08.661749+0000","last_became_active":"2024-04-19T02:15:24.533436+0000","last_became_peered":"2024-04-19T02:15:24.533436+0000","last_unstale":"2024-04-19T02:20:08.661749+0000","last_undegraded":"2024-04-19T02:20:08.661749+0000","last_fullsized":"2024-04-19T02:20:08.661749+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:53:25.922418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981874+0000","last_change":"2024-04-19T02:19:54.933278+0000","last_active":"2024-04-19T02:20:07.981874+0000","last_peered":"2024-04-19T02:20:07.981874+0000","last_clean":"2024-04-19T02:20:07.981874+0000","last_became_active":"2024-04-19T02:19:54.931328+0000","last_became_peered":"2024-04-19T02:19:54.931328+0000","last_unstale":"2024-04-19T02:20:07.981874+0000","last_undegraded":"2024-04-19T02:20:07.981874+0000","last_fullsized":"2024-04-19T02:20:07.981874+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:08:38.731741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981486+0000","last_change":"2024-04-19T02:15:29.282244+0000","last_active":"2024-04-19T02:20:07.981486+0000","last_peered":"2024-04-19T02:20:07.981486+0000","last_clean":"2024-04-19T02:20:07.981486+0000","last_became_active":"2024-04-19T02:15:29.280366+0000","last_became_peered":"2024-04-19T02:15:29.280366+0000","last_unstale":"2024-04-19T02:20:07.981486+0000","last_undegraded":"2024-04-19T02:20:07.981486+0000","last_fullsized":"2024-04-19T02:20:07.981486+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981438+0000","last_change":"2024-04-19T02:15:28.893027+0000","last_active":"2024-04-19T02:20:07.981438+0000","last_peered":"2024-04-19T02:20:07.981438+0000","last_clean":"2024-04-19T02:20:07.981438+0000","last_became_active":"2024-04-19T02:15:28.892695+0000","last_became_peered":"2024-04-19T02:15:28.892695+0000","last_unstale":"2024-04-19T02:20:07.981438+0000","last_undegraded":"2024-04-19T02:20:07.981438+0000","last_fullsized":"2024-04-19T02:20:07.981438+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":89,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.982670+0000","last_change":"2024-04-19T02:19:54.929648+0000","last_active":"2024-04-19T02:20:07.982670+0000","last_peered":"2024-04-19T02:20:07.982670+0000","last_clean":"2024-04-19T02:20:07.982670+0000","last_became_active":"2024-04-19T02:19:54.929412+0000","last_became_peered":"2024-04-19T02:19:54.929412+0000","last_unstale":"2024-04-19T02:20:07.982670+0000","last_undegraded":"2024-04-19T02:20:07.982670+0000","last_fullsized":"2024-04-19T02:20:07.982670+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:28:21.688550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660988+0000","last_change":"2024-04-19T02:19:54.927315+0000","last_active":"2024-04-19T02:20:08.660988+0000","last_peered":"2024-04-19T02:20:08.660988+0000","last_clean":"2024-04-19T02:20:08.660988+0000","last_became_active":"2024-04-19T02:19:54.926630+0000","last_became_peered":"2024-04-19T02:19:54.926630+0000","last_unstale":"2024-04-19T02:20:08.660988+0000","last_undegraded":"2024-04-19T02:20:08.660988+0000","last_fullsized":"2024-04-19T02:20:08.660988+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:39:00.822558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660746+0000","last_change":"2024-04-19T02:19:54.931920+0000","last_active":"2024-04-19T02:20:08.660746+0000","last_peered":"2024-04-19T02:20:08.660746+0000","last_clean":"2024-04-19T02:20:08.660746+0000","last_became_active":"2024-04-19T02:19:54.931328+0000","last_became_peered":"2024-04-19T02:19:54.931328+0000","last_unstale":"2024-04-19T02:20:08.660746+0000","last_undegraded":"2024-04-19T02:20:08.660746+0000","last_fullsized":"2024-04-19T02:20:08.660746+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:39.655376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":79,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.982759+0000","last_change":"2024-04-19T02:15:28.893239+0000","last_active":"2024-04-19T02:20:07.982759+0000","last_peered":"2024-04-19T02:20:07.982759+0000","last_clean":"2024-04-19T02:20:07.982759+0000","last_became_active":"2024-04-19T02:15:28.892881+0000","last_became_peered":"2024-04-19T02:15:28.892881+0000","last_unstale":"2024-04-19T02:20:07.982759+0000","last_undegraded":"2024-04-19T02:20:07.982759+0000","last_fullsized":"2024-04-19T02:20:07.982759+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.660664+0000","last_change":"2024-04-19T02:19:54.924029+0000","last_active":"2024-04-19T02:20:08.660664+0000","last_peered":"2024-04-19T02:20:08.660664+0000","last_clean":"2024-04-19T02:20:08.660664+0000","last_became_active":"2024-04-19T02:19:54.923752+0000","last_became_peered":"2024-04-19T02:19:54.923752+0000","last_unstale":"2024-04-19T02:20:08.660664+0000","last_undegraded":"2024-04-19T02:20:08.660664+0000","last_fullsized":"2024-04-19T02:20:08.660664+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:26:41.825722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981835+0000","last_change":"2024-04-19T02:19:54.933652+0000","last_active":"2024-04-19T02:20:07.981835+0000","last_peered":"2024-04-19T02:20:07.981835+0000","last_clean":"2024-04-19T02:20:07.981835+0000","last_became_active":"2024-04-19T02:19:54.932103+0000","last_became_peered":"2024-04-19T02:19:54.932103+0000","last_unstale":"2024-04-19T02:20:07.981835+0000","last_undegraded":"2024-04-19T02:20:07.981835+0000","last_fullsized":"2024-04-19T02:20:07.981835+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:46:14.540427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":89,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.981851+0000","last_change":"2024-04-19T02:19:54.925832+0000","last_active":"2024-04-19T02:20:07.981851+0000","last_peered":"2024-04-19T02:20:07.981851+0000","last_clean":"2024-04-19T02:20:07.981851+0000","last_became_active":"2024-04-19T02:19:54.925565+0000","last_became_peered":"2024-04-19T02:19:54.925565+0000","last_unstale":"2024-04-19T02:20:07.981851+0000","last_undegraded":"2024-04-19T02:20:07.981851+0000","last_fullsized":"2024-04-19T02:20:07.981851+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:28:13.380027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.982061+0000","last_change":"2024-04-19T02:19:54.929083+0000","last_active":"2024-04-19T02:20:07.982061+0000","last_peered":"2024-04-19T02:20:07.982061+0000","last_clean":"2024-04-19T02:20:07.982061+0000","last_became_active":"2024-04-19T02:19:54.926439+0000","last_became_peered":"2024-04-19T02:19:54.926439+0000","last_unstale":"2024-04-19T02:20:07.982061+0000","last_undegraded":"2024-04-19T02:20:07.982061+0000","last_fullsized":"2024-04-19T02:20:07.982061+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:15:04.675082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661283+0000","last_change":"2024-04-19T02:19:54.931258+0000","last_active":"2024-04-19T02:20:08.661283+0000","last_peered":"2024-04-19T02:20:08.661283+0000","last_clean":"2024-04-19T02:20:08.661283+0000","last_became_active":"2024-04-19T02:19:54.930665+0000","last_became_peered":"2024-04-19T02:19:54.930665+0000","last_unstale":"2024-04-19T02:20:08.661283+0000","last_undegraded":"2024-04-19T02:20:08.661283+0000","last_fullsized":"2024-04-19T02:20:08.661283+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:57:08.681822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.661185+0000","last_change":"2024-04-19T02:19:54.931055+0000","last_active":"2024-04-19T02:20:08.661185+0000","last_peered":"2024-04-19T02:20:08.661185+0000","last_clean":"2024-04-19T02:20:08.661185+0000","last_became_active":"2024-04-19T02:19:54.930527+0000","last_became_peered":"2024-04-19T02:19:54.930527+0000","last_unstale":"2024-04-19T02:20:08.661185+0000","last_undegraded":"2024-04-19T02:20:08.661185+0000","last_fullsized":"2024-04-19T02:20:08.661185+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:05:38.717309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":44,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T02:20:05.964982+0000","last_change":"2024-04-19T02:19:54.921032+0000","last_active":"2024-04-19T02:20:05.964982+0000","last_peered":"2024-04-19T02:20:05.964982+0000","last_clean":"2024-04-19T02:20:05.964982+0000","last_became_active":"2024-04-19T02:19:54.920757+0000","last_became_peered":"2024-04-19T02:19:54.920757+0000","last_unstale":"2024-04-19T02:20:05.964982+0000","last_undegraded":"2024-04-19T02:20:05.964982+0000","last_fullsized":"2024-04-19T02:20:05.964982+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:21:08.049253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.665682+0000","last_change":"2024-04-19T02:20:08.662331+0000","last_active":"2024-04-19T02:20:08.665682+0000","last_peered":"2024-04-19T02:20:08.665682+0000","last_clean":"2024-04-19T02:20:08.665682+0000","last_became_active":"2024-04-19T02:20:08.661996+0000","last_became_peered":"2024-04-19T02:20:08.661996+0000","last_unstale":"2024-04-19T02:20:08.665682+0000","last_undegraded":"2024-04-19T02:20:08.665682+0000","last_fullsized":"2024-04-19T02:20:08.665682+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:25:03.894231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":44,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-19T02:20:05.965410+0000","last_change":"2024-04-19T02:19:54.932579+0000","last_active":"2024-04-19T02:20:05.965410+0000","last_peered":"2024-04-19T02:20:05.965410+0000","last_clean":"2024-04-19T02:20:05.965410+0000","last_became_active":"2024-04-19T02:19:54.932323+0000","last_became_peered":"2024-04-19T02:19:54.932323+0000","last_unstale":"2024-04-19T02:20:05.965410+0000","last_undegraded":"2024-04-19T02:20:05.965410+0000","last_fullsized":"2024-04-19T02:20:05.965410+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:02:30.316314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T02:20:07.982665+0000","last_change":"2024-04-19T02:15:29.277568+0000","last_active":"2024-04-19T02:20:07.982665+0000","last_peered":"2024-04-19T02:20:07.982665+0000","last_clean":"2024-04-19T02:20:07.982665+0000","last_became_active":"2024-04-19T02:15:29.276725+0000","last_became_peered":"2024-04-19T02:15:29.276725+0000","last_unstale":"2024-04-19T02:20:07.982665+0000","last_undegraded":"2024-04-19T02:20:07.982665+0000","last_fullsized":"2024-04-19T02:20:07.982665+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5254,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":72,"seq":309237645317,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58816,"kb_used_data":876,"kb_used_omap":6,"kb_used_meta":57913,"kb_avail":94313024,"statfs":{"total":96636764160,"available":96576536576,"internally_reserved":0,"allocated":897024,"data_stored":353874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6848,"internal_metadata":59303232},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]}]},{"osd":0,"up_from":8,"seq":34359738429,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":275412,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":273918,"kb_avail":94096428,"statfs":{"total":96636764160,"available":96354742272,"internally_reserved":0,"allocated":1511424,"data_stored":943875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":280492486},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 02:19:26 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.371,"15min":0.316},"min":{"1min":0.29899999999999999,"5min":0.159,"15min":0.159},"max":{"1min":0.57499999999999996,"5min":4.4480000000000004,"15min":4.4480000000000004},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.379,"15min":0.36599999999999999},"min":{"1min":0.29399999999999998,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.54800000000000004,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.55200000000000005}]},{"osd":2,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":2.1000000000000001,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.59499999999999997}]}]},{"osd":1,"up_from":8,"seq":34359738428,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307404,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":305918,"kb_avail":94064436,"statfs":{"total":96636764160,"available":96321982464,"internally_reserved":0,"allocated":1507328,"data_stored":945372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":313260486},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:19:29 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.40600000000000003,"15min":0.376},"min":{"1min":0.32700000000000001,"5min":0.157,"15min":0.157},"max":{"1min":0.64900000000000002,"5min":1.794,"15min":1.794},"last":0.499},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.38100000000000001,"15min":0.32400000000000001},"min":{"1min":0.37,"5min":0.16,"15min":0.16},"max":{"1min":0.63,"5min":2.411,"15min":2.411},"last":0.434}]},{"osd":2,"last update":"Fri Apr 19 02:16:26 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.41899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5254,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:20:16.297 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:20:16.636 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:20:16.637 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-04-19T02:20:16.647 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":224,"stamp":"2024-04-19T02:20:14.812381+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":641656,"kb_used_data":3848,"kb_used_omap":9,"kb_used_meta":637750,"kb_avail":282473864,"statfs":{"total":289910292480,"available":289253236736,"internally_reserved":0,"allocated":3940352,"data_stored":2255904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10036,"internal_metadata":653056204},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.833424"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996815+0000","last_change":"2024-04-19T02:19:54.929643+0000","last_active":"2024-04-19T02:20:08.996815+0000","last_peered":"2024-04-19T02:20:08.996815+0000","last_clean":"2024-04-19T02:20:08.996815+0000","last_became_active":"2024-04-19T02:19:54.929435+0000","last_became_peered":"2024-04-19T02:19:54.929435+0000","last_unstale":"2024-04-19T02:20:08.996815+0000","last_undegraded":"2024-04-19T02:20:08.996815+0000","last_fullsized":"2024-04-19T02:20:08.996815+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:44:05.807254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995814+0000","last_change":"2024-04-19T02:19:54.931532+0000","last_active":"2024-04-19T02:20:08.995814+0000","last_peered":"2024-04-19T02:20:08.995814+0000","last_clean":"2024-04-19T02:20:08.995814+0000","last_became_active":"2024-04-19T02:19:54.931278+0000","last_became_peered":"2024-04-19T02:19:54.931278+0000","last_unstale":"2024-04-19T02:20:08.995814+0000","last_undegraded":"2024-04-19T02:20:08.995814+0000","last_fullsized":"2024-04-19T02:20:08.995814+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:20:02.024046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993263+0000","last_change":"2024-04-19T02:15:29.286709+0000","last_active":"2024-04-19T02:20:08.993263+0000","last_peered":"2024-04-19T02:20:08.993263+0000","last_clean":"2024-04-19T02:20:08.993263+0000","last_became_active":"2024-04-19T02:15:29.286169+0000","last_became_peered":"2024-04-19T02:15:29.286169+0000","last_unstale":"2024-04-19T02:20:08.993263+0000","last_undegraded":"2024-04-19T02:20:08.993263+0000","last_fullsized":"2024-04-19T02:20:08.993263+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:58.741466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993036+0000","last_change":"2024-04-19T02:19:54.927063+0000","last_active":"2024-04-19T02:20:08.993036+0000","last_peered":"2024-04-19T02:20:08.993036+0000","last_clean":"2024-04-19T02:20:08.993036+0000","last_became_active":"2024-04-19T02:19:54.926046+0000","last_became_peered":"2024-04-19T02:19:54.926046+0000","last_unstale":"2024-04-19T02:20:08.993036+0000","last_undegraded":"2024-04-19T02:20:08.993036+0000","last_fullsized":"2024-04-19T02:20:08.993036+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:52:59.151542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":55,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995211+0000","last_change":"2024-04-19T02:19:54.931669+0000","last_active":"2024-04-19T02:20:08.995211+0000","last_peered":"2024-04-19T02:20:08.995211+0000","last_clean":"2024-04-19T02:20:08.995211+0000","last_became_active":"2024-04-19T02:19:54.931435+0000","last_became_peered":"2024-04-19T02:19:54.931435+0000","last_unstale":"2024-04-19T02:20:08.995211+0000","last_undegraded":"2024-04-19T02:20:08.995211+0000","last_fullsized":"2024-04-19T02:20:08.995211+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:42:58.222802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992140+0000","last_change":"2024-04-19T02:19:54.924250+0000","last_active":"2024-04-19T02:20:08.992140+0000","last_peered":"2024-04-19T02:20:08.992140+0000","last_clean":"2024-04-19T02:20:08.992140+0000","last_became_active":"2024-04-19T02:19:54.923984+0000","last_became_peered":"2024-04-19T02:19:54.923984+0000","last_unstale":"2024-04-19T02:20:08.992140+0000","last_undegraded":"2024-04-19T02:20:08.992140+0000","last_fullsized":"2024-04-19T02:20:08.992140+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:56:51.290239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992724+0000","last_change":"2024-04-19T02:19:54.926647+0000","last_active":"2024-04-19T02:20:08.992724+0000","last_peered":"2024-04-19T02:20:08.992724+0000","last_clean":"2024-04-19T02:20:08.992724+0000","last_became_active":"2024-04-19T02:19:54.925529+0000","last_became_peered":"2024-04-19T02:19:54.925529+0000","last_unstale":"2024-04-19T02:20:08.992724+0000","last_undegraded":"2024-04-19T02:20:08.992724+0000","last_fullsized":"2024-04-19T02:20:08.992724+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:49:06.911557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993273+0000","last_change":"2024-04-19T02:19:54.930828+0000","last_active":"2024-04-19T02:20:08.993273+0000","last_peered":"2024-04-19T02:20:08.993273+0000","last_clean":"2024-04-19T02:20:08.993273+0000","last_became_active":"2024-04-19T02:19:54.930075+0000","last_became_peered":"2024-04-19T02:19:54.930075+0000","last_unstale":"2024-04-19T02:20:08.993273+0000","last_undegraded":"2024-04-19T02:20:08.993273+0000","last_fullsized":"2024-04-19T02:20:08.993273+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:00.512431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.991008+0000","last_change":"2024-04-19T02:19:54.931617+0000","last_active":"2024-04-19T02:20:08.991008+0000","last_peered":"2024-04-19T02:20:08.991008+0000","last_clean":"2024-04-19T02:20:08.991008+0000","last_became_active":"2024-04-19T02:19:54.928496+0000","last_became_peered":"2024-04-19T02:19:54.928496+0000","last_unstale":"2024-04-19T02:20:08.991008+0000","last_undegraded":"2024-04-19T02:20:08.991008+0000","last_fullsized":"2024-04-19T02:20:08.991008+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:56:50.232031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":60,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993489+0000","last_change":"2024-04-19T02:16:30.093524+0000","last_active":"2024-04-19T02:20:08.993489+0000","last_peered":"2024-04-19T02:20:08.993489+0000","last_clean":"2024-04-19T02:20:08.993489+0000","last_became_active":"2024-04-19T02:16:30.093344+0000","last_became_peered":"2024-04-19T02:16:30.093344+0000","last_unstale":"2024-04-19T02:20:08.993489+0000","last_undegraded":"2024-04-19T02:20:08.993489+0000","last_fullsized":"2024-04-19T02:20:08.993489+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:14:40.293159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993069+0000","last_change":"2024-04-19T02:19:54.926754+0000","last_active":"2024-04-19T02:20:08.993069+0000","last_peered":"2024-04-19T02:20:08.993069+0000","last_clean":"2024-04-19T02:20:08.993069+0000","last_became_active":"2024-04-19T02:19:54.926040+0000","last_became_peered":"2024-04-19T02:19:54.926040+0000","last_unstale":"2024-04-19T02:20:08.993069+0000","last_undegraded":"2024-04-19T02:20:08.993069+0000","last_fullsized":"2024-04-19T02:20:08.993069+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:36:16.313500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995212+0000","last_change":"2024-04-19T02:20:08.662601+0000","last_active":"2024-04-19T02:20:08.995212+0000","last_peered":"2024-04-19T02:20:08.995212+0000","last_clean":"2024-04-19T02:20:08.995212+0000","last_became_active":"2024-04-19T02:20:08.662234+0000","last_became_peered":"2024-04-19T02:20:08.662234+0000","last_unstale":"2024-04-19T02:20:08.995212+0000","last_undegraded":"2024-04-19T02:20:08.995212+0000","last_fullsized":"2024-04-19T02:20:08.995212+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:34:06.694985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":55,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995768+0000","last_change":"2024-04-19T02:19:54.932576+0000","last_active":"2024-04-19T02:20:08.995768+0000","last_peered":"2024-04-19T02:20:08.995768+0000","last_clean":"2024-04-19T02:20:08.995768+0000","last_became_active":"2024-04-19T02:19:54.932240+0000","last_became_peered":"2024-04-19T02:19:54.932240+0000","last_unstale":"2024-04-19T02:20:08.995768+0000","last_undegraded":"2024-04-19T02:20:08.995768+0000","last_fullsized":"2024-04-19T02:20:08.995768+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:10:10.453676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":79,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637354+0000","last_change":"2024-04-19T02:15:29.284262+0000","last_active":"2024-04-19T02:20:10.637354+0000","last_peered":"2024-04-19T02:20:10.637354+0000","last_clean":"2024-04-19T02:20:10.637354+0000","last_became_active":"2024-04-19T02:15:29.283121+0000","last_became_peered":"2024-04-19T02:15:29.283121+0000","last_unstale":"2024-04-19T02:20:10.637354+0000","last_undegraded":"2024-04-19T02:20:10.637354+0000","last_fullsized":"2024-04-19T02:20:10.637354+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":79,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637524+0000","last_change":"2024-04-19T02:15:29.285139+0000","last_active":"2024-04-19T02:20:10.637524+0000","last_peered":"2024-04-19T02:20:10.637524+0000","last_clean":"2024-04-19T02:20:10.637524+0000","last_became_active":"2024-04-19T02:15:29.284649+0000","last_became_peered":"2024-04-19T02:15:29.284649+0000","last_unstale":"2024-04-19T02:20:10.637524+0000","last_undegraded":"2024-04-19T02:20:10.637524+0000","last_fullsized":"2024-04-19T02:20:10.637524+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637088+0000","last_change":"2024-04-19T02:19:54.931033+0000","last_active":"2024-04-19T02:20:10.637088+0000","last_peered":"2024-04-19T02:20:10.637088+0000","last_clean":"2024-04-19T02:20:10.637088+0000","last_became_active":"2024-04-19T02:19:54.930437+0000","last_became_peered":"2024-04-19T02:19:54.930437+0000","last_unstale":"2024-04-19T02:20:10.637088+0000","last_undegraded":"2024-04-19T02:20:10.637088+0000","last_fullsized":"2024-04-19T02:20:10.637088+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:44:05.807254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.001650+0000","last_change":"2024-04-19T02:20:10.001650+0000","last_active":"2024-04-19T02:20:10.001650+0000","last_peered":"2024-04-19T02:20:10.001650+0000","last_clean":"2024-04-19T02:20:10.001650+0000","last_became_active":"2024-04-19T02:20:10.001343+0000","last_became_peered":"2024-04-19T02:20:10.001343+0000","last_unstale":"2024-04-19T02:20:10.001650+0000","last_undegraded":"2024-04-19T02:20:10.001650+0000","last_fullsized":"2024-04-19T02:20:10.001650+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:15:54.452503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.858101+0000","last_change":"2024-04-19T02:19:54.933452+0000","last_active":"2024-04-19T02:20:09.858101+0000","last_peered":"2024-04-19T02:20:09.858101+0000","last_clean":"2024-04-19T02:20:09.858101+0000","last_became_active":"2024-04-19T02:19:54.933233+0000","last_became_peered":"2024-04-19T02:19:54.933233+0000","last_unstale":"2024-04-19T02:20:09.858101+0000","last_undegraded":"2024-04-19T02:20:09.858101+0000","last_fullsized":"2024-04-19T02:20:09.858101+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:50.712874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.990125+0000","last_change":"2024-04-19T02:19:54.925745+0000","last_active":"2024-04-19T02:20:08.990125+0000","last_peered":"2024-04-19T02:20:08.990125+0000","last_clean":"2024-04-19T02:20:08.990125+0000","last_became_active":"2024-04-19T02:19:54.925060+0000","last_became_peered":"2024-04-19T02:19:54.925060+0000","last_unstale":"2024-04-19T02:20:08.990125+0000","last_undegraded":"2024-04-19T02:20:08.990125+0000","last_fullsized":"2024-04-19T02:20:08.990125+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:12:43.617806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992995+0000","last_change":"2024-04-19T02:19:54.927206+0000","last_active":"2024-04-19T02:20:08.992995+0000","last_peered":"2024-04-19T02:20:08.992995+0000","last_clean":"2024-04-19T02:20:08.992995+0000","last_became_active":"2024-04-19T02:19:54.926442+0000","last_became_peered":"2024-04-19T02:19:54.926442+0000","last_unstale":"2024-04-19T02:20:08.992995+0000","last_undegraded":"2024-04-19T02:20:08.992995+0000","last_fullsized":"2024-04-19T02:20:08.992995+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:27:17.095030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992632+0000","last_change":"2024-04-19T02:19:54.932532+0000","last_active":"2024-04-19T02:20:08.992632+0000","last_peered":"2024-04-19T02:20:08.992632+0000","last_clean":"2024-04-19T02:20:08.992632+0000","last_became_active":"2024-04-19T02:19:54.931438+0000","last_became_peered":"2024-04-19T02:19:54.931438+0000","last_unstale":"2024-04-19T02:20:08.992632+0000","last_undegraded":"2024-04-19T02:20:08.992632+0000","last_fullsized":"2024-04-19T02:20:08.992632+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:12:54.241778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995945+0000","last_change":"2024-04-19T02:20:08.662261+0000","last_active":"2024-04-19T02:20:08.995945+0000","last_peered":"2024-04-19T02:20:08.995945+0000","last_clean":"2024-04-19T02:20:08.995945+0000","last_became_active":"2024-04-19T02:20:08.661940+0000","last_became_peered":"2024-04-19T02:20:08.661940+0000","last_unstale":"2024-04-19T02:20:08.995945+0000","last_undegraded":"2024-04-19T02:20:08.995945+0000","last_fullsized":"2024-04-19T02:20:08.995945+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:49:34.835266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.639368+0000","last_change":"2024-04-19T02:20:10.639368+0000","last_active":"2024-04-19T02:20:10.639368+0000","last_peered":"2024-04-19T02:20:10.639368+0000","last_clean":"2024-04-19T02:20:10.639368+0000","last_became_active":"2024-04-19T02:20:10.639036+0000","last_became_peered":"2024-04-19T02:20:10.639036+0000","last_unstale":"2024-04-19T02:20:10.639368+0000","last_undegraded":"2024-04-19T02:20:10.639368+0000","last_fullsized":"2024-04-19T02:20:10.639368+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:36:45.316530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996035+0000","last_change":"2024-04-19T02:19:54.928467+0000","last_active":"2024-04-19T02:20:08.996035+0000","last_peered":"2024-04-19T02:20:08.996035+0000","last_clean":"2024-04-19T02:20:08.996035+0000","last_became_active":"2024-04-19T02:19:54.928261+0000","last_became_peered":"2024-04-19T02:19:54.928261+0000","last_unstale":"2024-04-19T02:20:08.996035+0000","last_undegraded":"2024-04-19T02:20:08.996035+0000","last_fullsized":"2024-04-19T02:20:08.996035+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:40:43.645134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996795+0000","last_change":"2024-04-19T02:15:29.278084+0000","last_active":"2024-04-19T02:20:08.996795+0000","last_peered":"2024-04-19T02:20:08.996795+0000","last_clean":"2024-04-19T02:20:08.996795+0000","last_became_active":"2024-04-19T02:15:29.276952+0000","last_became_peered":"2024-04-19T02:15:29.276952+0000","last_unstale":"2024-04-19T02:20:08.996795+0000","last_undegraded":"2024-04-19T02:20:08.996795+0000","last_fullsized":"2024-04-19T02:20:08.996795+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.991888+0000","last_change":"2024-04-19T02:19:54.933154+0000","last_active":"2024-04-19T02:20:08.991888+0000","last_peered":"2024-04-19T02:20:08.991888+0000","last_clean":"2024-04-19T02:20:08.991888+0000","last_became_active":"2024-04-19T02:19:54.931124+0000","last_became_peered":"2024-04-19T02:19:54.931124+0000","last_unstale":"2024-04-19T02:20:08.991888+0000","last_undegraded":"2024-04-19T02:20:08.991888+0000","last_fullsized":"2024-04-19T02:20:08.991888+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:49.555501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993130+0000","last_change":"2024-04-19T02:15:29.287389+0000","last_active":"2024-04-19T02:20:08.993130+0000","last_peered":"2024-04-19T02:20:08.993130+0000","last_clean":"2024-04-19T02:20:08.993130+0000","last_became_active":"2024-04-19T02:15:29.286431+0000","last_became_peered":"2024-04-19T02:15:29.286431+0000","last_unstale":"2024-04-19T02:20:08.993130+0000","last_undegraded":"2024-04-19T02:20:08.993130+0000","last_fullsized":"2024-04-19T02:20:08.993130+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:58:30.117887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":57,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995777+0000","last_change":"2024-04-19T02:19:54.927108+0000","last_active":"2024-04-19T02:20:08.995777+0000","last_peered":"2024-04-19T02:20:08.995777+0000","last_clean":"2024-04-19T02:20:08.995777+0000","last_became_active":"2024-04-19T02:19:54.926838+0000","last_became_peered":"2024-04-19T02:19:54.926838+0000","last_unstale":"2024-04-19T02:20:08.995777+0000","last_undegraded":"2024-04-19T02:20:08.995777+0000","last_fullsized":"2024-04-19T02:20:08.995777+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:25:27.561607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":77,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996790+0000","last_change":"2024-04-19T02:15:29.281792+0000","last_active":"2024-04-19T02:20:08.996790+0000","last_peered":"2024-04-19T02:20:08.996790+0000","last_clean":"2024-04-19T02:20:08.996790+0000","last_became_active":"2024-04-19T02:15:29.280479+0000","last_became_peered":"2024-04-19T02:15:29.280479+0000","last_unstale":"2024-04-19T02:20:08.996790+0000","last_undegraded":"2024-04-19T02:20:08.996790+0000","last_fullsized":"2024-04-19T02:20:08.996790+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.989269+0000","last_change":"2024-04-19T02:19:54.925277+0000","last_active":"2024-04-19T02:20:08.989269+0000","last_peered":"2024-04-19T02:20:08.989269+0000","last_clean":"2024-04-19T02:20:08.989269+0000","last_became_active":"2024-04-19T02:19:54.924484+0000","last_became_peered":"2024-04-19T02:19:54.924484+0000","last_unstale":"2024-04-19T02:20:08.989269+0000","last_undegraded":"2024-04-19T02:20:08.989269+0000","last_fullsized":"2024-04-19T02:20:08.989269+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:57:54.845371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.639077+0000","last_change":"2024-04-19T02:20:10.639077+0000","last_active":"2024-04-19T02:20:10.639077+0000","last_peered":"2024-04-19T02:20:10.639077+0000","last_clean":"2024-04-19T02:20:10.639077+0000","last_became_active":"2024-04-19T02:20:10.638737+0000","last_became_peered":"2024-04-19T02:20:10.638737+0000","last_unstale":"2024-04-19T02:20:10.639077+0000","last_undegraded":"2024-04-19T02:20:10.639077+0000","last_fullsized":"2024-04-19T02:20:10.639077+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:20:05.200768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.989517+0000","last_change":"2024-04-19T02:19:54.930346+0000","last_active":"2024-04-19T02:20:08.989517+0000","last_peered":"2024-04-19T02:20:08.989517+0000","last_clean":"2024-04-19T02:20:08.989517+0000","last_became_active":"2024-04-19T02:19:54.928398+0000","last_became_peered":"2024-04-19T02:19:54.928398+0000","last_unstale":"2024-04-19T02:20:08.989517+0000","last_undegraded":"2024-04-19T02:20:08.989517+0000","last_fullsized":"2024-04-19T02:20:08.989517+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:46.321275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996446+0000","last_change":"2024-04-19T02:15:29.280879+0000","last_active":"2024-04-19T02:20:08.996446+0000","last_peered":"2024-04-19T02:20:08.996446+0000","last_clean":"2024-04-19T02:20:08.996446+0000","last_became_active":"2024-04-19T02:15:29.279314+0000","last_became_peered":"2024-04-19T02:15:29.279314+0000","last_unstale":"2024-04-19T02:20:08.996446+0000","last_undegraded":"2024-04-19T02:20:08.996446+0000","last_fullsized":"2024-04-19T02:20:08.996446+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.991148+0000","last_change":"2024-04-19T02:19:54.927744+0000","last_active":"2024-04-19T02:20:08.991148+0000","last_peered":"2024-04-19T02:20:08.991148+0000","last_clean":"2024-04-19T02:20:08.991148+0000","last_became_active":"2024-04-19T02:19:54.925729+0000","last_became_peered":"2024-04-19T02:19:54.925729+0000","last_unstale":"2024-04-19T02:20:08.991148+0000","last_undegraded":"2024-04-19T02:20:08.991148+0000","last_fullsized":"2024-04-19T02:20:08.991148+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:27:57.229684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.989293+0000","last_change":"2024-04-19T02:19:54.928435+0000","last_active":"2024-04-19T02:20:08.989293+0000","last_peered":"2024-04-19T02:20:08.989293+0000","last_clean":"2024-04-19T02:20:08.989293+0000","last_became_active":"2024-04-19T02:19:54.927666+0000","last_became_peered":"2024-04-19T02:19:54.927666+0000","last_unstale":"2024-04-19T02:20:08.989293+0000","last_undegraded":"2024-04-19T02:20:08.989293+0000","last_fullsized":"2024-04-19T02:20:08.989293+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:20:45.000808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993622+0000","last_change":"2024-04-19T02:19:54.932025+0000","last_active":"2024-04-19T02:20:08.993622+0000","last_peered":"2024-04-19T02:20:08.993622+0000","last_clean":"2024-04-19T02:20:08.993622+0000","last_became_active":"2024-04-19T02:19:54.931540+0000","last_became_peered":"2024-04-19T02:19:54.931540+0000","last_unstale":"2024-04-19T02:20:08.993622+0000","last_undegraded":"2024-04-19T02:20:08.993622+0000","last_fullsized":"2024-04-19T02:20:08.993622+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:03:31.479331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.991173+0000","last_change":"2024-04-19T02:19:54.924493+0000","last_active":"2024-04-19T02:20:08.991173+0000","last_peered":"2024-04-19T02:20:08.991173+0000","last_clean":"2024-04-19T02:20:08.991173+0000","last_became_active":"2024-04-19T02:19:54.923784+0000","last_became_peered":"2024-04-19T02:19:54.923784+0000","last_unstale":"2024-04-19T02:20:08.991173+0000","last_undegraded":"2024-04-19T02:20:08.991173+0000","last_fullsized":"2024-04-19T02:20:08.991173+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:09:34.378788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":81,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996234+0000","last_change":"2024-04-19T02:15:28.892937+0000","last_active":"2024-04-19T02:20:08.996234+0000","last_peered":"2024-04-19T02:20:08.996234+0000","last_clean":"2024-04-19T02:20:08.996234+0000","last_became_active":"2024-04-19T02:15:28.891440+0000","last_became_peered":"2024-04-19T02:15:28.891440+0000","last_unstale":"2024-04-19T02:20:08.996234+0000","last_undegraded":"2024-04-19T02:20:08.996234+0000","last_fullsized":"2024-04-19T02:20:08.996234+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.989329+0000","last_change":"2024-04-19T02:19:54.923898+0000","last_active":"2024-04-19T02:20:08.989329+0000","last_peered":"2024-04-19T02:20:08.989329+0000","last_clean":"2024-04-19T02:20:08.989329+0000","last_became_active":"2024-04-19T02:19:54.923493+0000","last_became_peered":"2024-04-19T02:19:54.923493+0000","last_unstale":"2024-04-19T02:20:08.989329+0000","last_undegraded":"2024-04-19T02:20:08.989329+0000","last_fullsized":"2024-04-19T02:20:08.989329+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:33.123319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":86,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637637+0000","last_change":"2024-04-19T02:15:28.891097+0000","last_active":"2024-04-19T02:20:10.637637+0000","last_peered":"2024-04-19T02:20:10.637637+0000","last_clean":"2024-04-19T02:20:10.637637+0000","last_became_active":"2024-04-19T02:15:28.890795+0000","last_became_peered":"2024-04-19T02:15:28.890795+0000","last_unstale":"2024-04-19T02:20:10.637637+0000","last_undegraded":"2024-04-19T02:20:10.637637+0000","last_fullsized":"2024-04-19T02:20:10.637637+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":79,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637625+0000","last_change":"2024-04-19T02:15:29.278546+0000","last_active":"2024-04-19T02:20:10.637625+0000","last_peered":"2024-04-19T02:20:10.637625+0000","last_clean":"2024-04-19T02:20:10.637625+0000","last_became_active":"2024-04-19T02:15:29.277547+0000","last_became_peered":"2024-04-19T02:15:29.277547+0000","last_unstale":"2024-04-19T02:20:10.637625+0000","last_undegraded":"2024-04-19T02:20:10.637625+0000","last_fullsized":"2024-04-19T02:20:10.637625+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":95,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637628+0000","last_change":"2024-04-19T02:19:54.933035+0000","last_active":"2024-04-19T02:20:10.637628+0000","last_peered":"2024-04-19T02:20:10.637628+0000","last_clean":"2024-04-19T02:20:10.637628+0000","last_became_active":"2024-04-19T02:19:54.932829+0000","last_became_peered":"2024-04-19T02:19:54.932829+0000","last_unstale":"2024-04-19T02:20:10.637628+0000","last_undegraded":"2024-04-19T02:20:10.637628+0000","last_fullsized":"2024-04-19T02:20:10.637628+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:09:05.626623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":49,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.998175+0000","last_change":"2024-04-19T02:20:07.983368+0000","last_active":"2024-04-19T02:20:09.998175+0000","last_peered":"2024-04-19T02:20:09.998175+0000","last_clean":"2024-04-19T02:20:09.998175+0000","last_became_active":"2024-04-19T02:20:07.983080+0000","last_became_peered":"2024-04-19T02:20:07.983080+0000","last_unstale":"2024-04-19T02:20:09.998175+0000","last_undegraded":"2024-04-19T02:20:09.998175+0000","last_fullsized":"2024-04-19T02:20:09.998175+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:24.138269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.989479+0000","last_change":"2024-04-19T02:19:54.927323+0000","last_active":"2024-04-19T02:20:08.989479+0000","last_peered":"2024-04-19T02:20:08.989479+0000","last_clean":"2024-04-19T02:20:08.989479+0000","last_became_active":"2024-04-19T02:19:54.925703+0000","last_became_peered":"2024-04-19T02:19:54.925703+0000","last_unstale":"2024-04-19T02:20:08.989479+0000","last_undegraded":"2024-04-19T02:20:08.989479+0000","last_fullsized":"2024-04-19T02:20:08.989479+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:46:59.533765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":55,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996775+0000","last_change":"2024-04-19T02:19:54.925918+0000","last_active":"2024-04-19T02:20:08.996775+0000","last_peered":"2024-04-19T02:20:08.996775+0000","last_clean":"2024-04-19T02:20:08.996775+0000","last_became_active":"2024-04-19T02:19:54.925634+0000","last_became_peered":"2024-04-19T02:19:54.925634+0000","last_unstale":"2024-04-19T02:20:08.996775+0000","last_undegraded":"2024-04-19T02:20:08.996775+0000","last_fullsized":"2024-04-19T02:20:08.996775+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:14:13.074455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.857926+0000","last_change":"2024-04-19T02:15:28.892934+0000","last_active":"2024-04-19T02:20:09.857926+0000","last_peered":"2024-04-19T02:20:09.857926+0000","last_clean":"2024-04-19T02:20:09.857926+0000","last_became_active":"2024-04-19T02:15:28.891879+0000","last_became_peered":"2024-04-19T02:15:28.891879+0000","last_unstale":"2024-04-19T02:20:09.857926+0000","last_undegraded":"2024-04-19T02:20:09.857926+0000","last_fullsized":"2024-04-19T02:20:09.857926+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:10:12.514798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.639094+0000","last_change":"2024-04-19T02:20:10.639094+0000","last_active":"2024-04-19T02:20:10.639094+0000","last_peered":"2024-04-19T02:20:10.639094+0000","last_clean":"2024-04-19T02:20:10.639094+0000","last_became_active":"2024-04-19T02:20:10.638755+0000","last_became_peered":"2024-04-19T02:20:10.638755+0000","last_unstale":"2024-04-19T02:20:10.639094+0000","last_undegraded":"2024-04-19T02:20:10.639094+0000","last_fullsized":"2024-04-19T02:20:10.639094+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:37:46.274811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.858501+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:20:09.858501+0000","last_peered":"2024-04-19T02:20:09.858501+0000","last_clean":"2024-04-19T02:20:09.858501+0000","last_became_active":"2024-04-19T02:15:28.890882+0000","last_became_peered":"2024-04-19T02:15:28.890882+0000","last_unstale":"2024-04-19T02:20:09.858501+0000","last_undegraded":"2024-04-19T02:20:09.858501+0000","last_fullsized":"2024-04-19T02:20:09.858501+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:31.673938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.991948+0000","last_change":"2024-04-19T02:19:54.927209+0000","last_active":"2024-04-19T02:20:08.991948+0000","last_peered":"2024-04-19T02:20:08.991948+0000","last_clean":"2024-04-19T02:20:08.991948+0000","last_became_active":"2024-04-19T02:19:54.925121+0000","last_became_peered":"2024-04-19T02:19:54.925121+0000","last_unstale":"2024-04-19T02:20:08.991948+0000","last_undegraded":"2024-04-19T02:20:08.991948+0000","last_fullsized":"2024-04-19T02:20:08.991948+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:16:21.982909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":81,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993779+0000","last_change":"2024-04-19T02:15:28.890265+0000","last_active":"2024-04-19T02:20:08.993779+0000","last_peered":"2024-04-19T02:20:08.993779+0000","last_clean":"2024-04-19T02:20:08.993779+0000","last_became_active":"2024-04-19T02:15:28.890004+0000","last_became_peered":"2024-04-19T02:15:28.890004+0000","last_unstale":"2024-04-19T02:20:08.993779+0000","last_undegraded":"2024-04-19T02:20:08.993779+0000","last_fullsized":"2024-04-19T02:20:08.993779+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:02.517101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.994900+0000","last_change":"2024-04-19T02:15:29.285529+0000","last_active":"2024-04-19T02:20:08.994900+0000","last_peered":"2024-04-19T02:20:08.994900+0000","last_clean":"2024-04-19T02:20:08.994900+0000","last_became_active":"2024-04-19T02:15:29.285197+0000","last_became_peered":"2024-04-19T02:15:29.285197+0000","last_unstale":"2024-04-19T02:20:08.994900+0000","last_undegraded":"2024-04-19T02:20:08.994900+0000","last_fullsized":"2024-04-19T02:20:08.994900+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":81,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995996+0000","last_change":"2024-04-19T02:15:28.893902+0000","last_active":"2024-04-19T02:20:08.995996+0000","last_peered":"2024-04-19T02:20:08.995996+0000","last_clean":"2024-04-19T02:20:08.995996+0000","last_became_active":"2024-04-19T02:15:28.893231+0000","last_became_peered":"2024-04-19T02:15:28.893231+0000","last_unstale":"2024-04-19T02:20:08.995996+0000","last_undegraded":"2024-04-19T02:20:08.995996+0000","last_fullsized":"2024-04-19T02:20:08.995996+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:23.658442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996319+0000","last_change":"2024-04-19T02:19:54.925840+0000","last_active":"2024-04-19T02:20:08.996319+0000","last_peered":"2024-04-19T02:20:08.996319+0000","last_clean":"2024-04-19T02:20:08.996319+0000","last_became_active":"2024-04-19T02:19:54.925502+0000","last_became_peered":"2024-04-19T02:19:54.925502+0000","last_unstale":"2024-04-19T02:20:08.996319+0000","last_undegraded":"2024-04-19T02:20:08.996319+0000","last_fullsized":"2024-04-19T02:20:08.996319+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:57.667340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":81,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993204+0000","last_change":"2024-04-19T02:15:28.891234+0000","last_active":"2024-04-19T02:20:08.993204+0000","last_peered":"2024-04-19T02:20:08.993204+0000","last_clean":"2024-04-19T02:20:08.993204+0000","last_became_active":"2024-04-19T02:15:28.890881+0000","last_became_peered":"2024-04-19T02:15:28.890881+0000","last_unstale":"2024-04-19T02:20:08.993204+0000","last_undegraded":"2024-04-19T02:20:08.993204+0000","last_fullsized":"2024-04-19T02:20:08.993204+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992289+0000","last_change":"2024-04-19T02:19:54.926103+0000","last_active":"2024-04-19T02:20:08.992289+0000","last_peered":"2024-04-19T02:20:08.992289+0000","last_clean":"2024-04-19T02:20:08.992289+0000","last_became_active":"2024-04-19T02:19:54.925591+0000","last_became_peered":"2024-04-19T02:19:54.925591+0000","last_unstale":"2024-04-19T02:20:08.992289+0000","last_undegraded":"2024-04-19T02:20:08.992289+0000","last_fullsized":"2024-04-19T02:20:08.992289+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:44:40.560973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":93,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992481+0000","last_change":"2024-04-19T02:19:54.926813+0000","last_active":"2024-04-19T02:20:08.992481+0000","last_peered":"2024-04-19T02:20:08.992481+0000","last_clean":"2024-04-19T02:20:08.992481+0000","last_became_active":"2024-04-19T02:19:54.925523+0000","last_became_peered":"2024-04-19T02:19:54.925523+0000","last_unstale":"2024-04-19T02:20:08.992481+0000","last_undegraded":"2024-04-19T02:20:08.992481+0000","last_fullsized":"2024-04-19T02:20:08.992481+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:39:56.887385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.989835+0000","last_change":"2024-04-19T02:19:54.932306+0000","last_active":"2024-04-19T02:20:08.989835+0000","last_peered":"2024-04-19T02:20:08.989835+0000","last_clean":"2024-04-19T02:20:08.989835+0000","last_became_active":"2024-04-19T02:19:54.930843+0000","last_became_peered":"2024-04-19T02:19:54.930843+0000","last_unstale":"2024-04-19T02:20:08.989835+0000","last_undegraded":"2024-04-19T02:20:08.989835+0000","last_fullsized":"2024-04-19T02:20:08.989835+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:24:51.884048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.989655+0000","last_change":"2024-04-19T02:19:54.932708+0000","last_active":"2024-04-19T02:20:08.989655+0000","last_peered":"2024-04-19T02:20:08.989655+0000","last_clean":"2024-04-19T02:20:08.989655+0000","last_became_active":"2024-04-19T02:19:54.931553+0000","last_became_peered":"2024-04-19T02:19:54.931553+0000","last_unstale":"2024-04-19T02:20:08.989655+0000","last_undegraded":"2024-04-19T02:20:08.989655+0000","last_fullsized":"2024-04-19T02:20:08.989655+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:47:07.651618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992596+0000","last_change":"2024-04-19T02:19:54.927009+0000","last_active":"2024-04-19T02:20:08.992596+0000","last_peered":"2024-04-19T02:20:08.992596+0000","last_clean":"2024-04-19T02:20:08.992596+0000","last_became_active":"2024-04-19T02:19:54.925645+0000","last_became_peered":"2024-04-19T02:19:54.925645+0000","last_unstale":"2024-04-19T02:20:08.992596+0000","last_undegraded":"2024-04-19T02:20:08.992596+0000","last_fullsized":"2024-04-19T02:20:08.992596+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:33:45.685463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":93,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992170+0000","last_change":"2024-04-19T02:19:54.923689+0000","last_active":"2024-04-19T02:20:08.992170+0000","last_peered":"2024-04-19T02:20:08.992170+0000","last_clean":"2024-04-19T02:20:08.992170+0000","last_became_active":"2024-04-19T02:19:54.923321+0000","last_became_peered":"2024-04-19T02:19:54.923321+0000","last_unstale":"2024-04-19T02:20:08.992170+0000","last_undegraded":"2024-04-19T02:20:08.992170+0000","last_fullsized":"2024-04-19T02:20:08.992170+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:03:01.578244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993485+0000","last_change":"2024-04-19T02:15:29.285019+0000","last_active":"2024-04-19T02:20:08.993485+0000","last_peered":"2024-04-19T02:20:08.993485+0000","last_clean":"2024-04-19T02:20:08.993485+0000","last_became_active":"2024-04-19T02:15:29.284650+0000","last_became_peered":"2024-04-19T02:15:29.284650+0000","last_unstale":"2024-04-19T02:20:08.993485+0000","last_undegraded":"2024-04-19T02:20:08.993485+0000","last_fullsized":"2024-04-19T02:20:08.993485+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995102+0000","last_change":"2024-04-19T02:20:08.662566+0000","last_active":"2024-04-19T02:20:08.995102+0000","last_peered":"2024-04-19T02:20:08.995102+0000","last_clean":"2024-04-19T02:20:08.995102+0000","last_became_active":"2024-04-19T02:20:08.662277+0000","last_became_peered":"2024-04-19T02:20:08.662277+0000","last_unstale":"2024-04-19T02:20:08.995102+0000","last_undegraded":"2024-04-19T02:20:08.995102+0000","last_fullsized":"2024-04-19T02:20:08.995102+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:36:27.307955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993656+0000","last_change":"2024-04-19T02:15:29.287190+0000","last_active":"2024-04-19T02:20:08.993656+0000","last_peered":"2024-04-19T02:20:08.993656+0000","last_clean":"2024-04-19T02:20:08.993656+0000","last_became_active":"2024-04-19T02:15:29.286606+0000","last_became_peered":"2024-04-19T02:15:29.286606+0000","last_unstale":"2024-04-19T02:20:08.993656+0000","last_undegraded":"2024-04-19T02:20:08.993656+0000","last_fullsized":"2024-04-19T02:20:08.993656+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:28.387062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996306+0000","last_change":"2024-04-19T02:19:54.928493+0000","last_active":"2024-04-19T02:20:08.996306+0000","last_peered":"2024-04-19T02:20:08.996306+0000","last_clean":"2024-04-19T02:20:08.996306+0000","last_became_active":"2024-04-19T02:19:54.928298+0000","last_became_peered":"2024-04-19T02:19:54.928298+0000","last_unstale":"2024-04-19T02:20:08.996306+0000","last_undegraded":"2024-04-19T02:20:08.996306+0000","last_fullsized":"2024-04-19T02:20:08.996306+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:11:54.564261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.990650+0000","last_change":"2024-04-19T02:19:54.930452+0000","last_active":"2024-04-19T02:20:08.990650+0000","last_peered":"2024-04-19T02:20:08.990650+0000","last_clean":"2024-04-19T02:20:08.990650+0000","last_became_active":"2024-04-19T02:19:54.927309+0000","last_became_peered":"2024-04-19T02:19:54.927309+0000","last_unstale":"2024-04-19T02:20:08.990650+0000","last_undegraded":"2024-04-19T02:20:08.990650+0000","last_fullsized":"2024-04-19T02:20:08.990650+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:56:20.174957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.998998+0000","last_change":"2024-04-19T02:20:09.998998+0000","last_active":"2024-04-19T02:20:09.998998+0000","last_peered":"2024-04-19T02:20:09.998998+0000","last_clean":"2024-04-19T02:20:09.998998+0000","last_became_active":"2024-04-19T02:20:09.998776+0000","last_became_peered":"2024-04-19T02:20:09.998776+0000","last_unstale":"2024-04-19T02:20:09.998998+0000","last_undegraded":"2024-04-19T02:20:09.998998+0000","last_fullsized":"2024-04-19T02:20:09.998998+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:02:13.720846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":93,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993371+0000","last_change":"2024-04-19T02:19:54.926207+0000","last_active":"2024-04-19T02:20:08.993371+0000","last_peered":"2024-04-19T02:20:08.993371+0000","last_clean":"2024-04-19T02:20:08.993371+0000","last_became_active":"2024-04-19T02:19:54.925872+0000","last_became_peered":"2024-04-19T02:19:54.925872+0000","last_unstale":"2024-04-19T02:20:08.993371+0000","last_undegraded":"2024-04-19T02:20:08.993371+0000","last_fullsized":"2024-04-19T02:20:08.993371+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:31:46.734042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996171+0000","last_change":"2024-04-19T02:15:29.277922+0000","last_active":"2024-04-19T02:20:08.996171+0000","last_peered":"2024-04-19T02:20:08.996171+0000","last_clean":"2024-04-19T02:20:08.996171+0000","last_became_active":"2024-04-19T02:15:29.276968+0000","last_became_peered":"2024-04-19T02:15:29.276968+0000","last_unstale":"2024-04-19T02:20:08.996171+0000","last_undegraded":"2024-04-19T02:20:08.996171+0000","last_fullsized":"2024-04-19T02:20:08.996171+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":96,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992530+0000","last_change":"2024-04-19T02:19:54.927361+0000","last_active":"2024-04-19T02:20:08.992530+0000","last_peered":"2024-04-19T02:20:08.992530+0000","last_clean":"2024-04-19T02:20:08.992530+0000","last_became_active":"2024-04-19T02:19:54.927033+0000","last_became_peered":"2024-04-19T02:19:54.927033+0000","last_unstale":"2024-04-19T02:20:08.992530+0000","last_undegraded":"2024-04-19T02:20:08.992530+0000","last_fullsized":"2024-04-19T02:20:08.992530+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:07.194915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":93,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992757+0000","last_change":"2024-04-19T02:19:54.932790+0000","last_active":"2024-04-19T02:20:08.992757+0000","last_peered":"2024-04-19T02:20:08.992757+0000","last_clean":"2024-04-19T02:20:08.992757+0000","last_became_active":"2024-04-19T02:19:54.931683+0000","last_became_peered":"2024-04-19T02:19:54.931683+0000","last_unstale":"2024-04-19T02:20:08.992757+0000","last_undegraded":"2024-04-19T02:20:08.992757+0000","last_fullsized":"2024-04-19T02:20:08.992757+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:23:00.124845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.990653+0000","last_change":"2024-04-19T02:19:54.926109+0000","last_active":"2024-04-19T02:20:08.990653+0000","last_peered":"2024-04-19T02:20:08.990653+0000","last_clean":"2024-04-19T02:20:08.990653+0000","last_became_active":"2024-04-19T02:19:54.924686+0000","last_became_peered":"2024-04-19T02:19:54.924686+0000","last_unstale":"2024-04-19T02:20:08.990653+0000","last_undegraded":"2024-04-19T02:20:08.990653+0000","last_fullsized":"2024-04-19T02:20:08.990653+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:20:03.487999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.990873+0000","last_change":"2024-04-19T02:19:54.923465+0000","last_active":"2024-04-19T02:20:08.990873+0000","last_peered":"2024-04-19T02:20:08.990873+0000","last_clean":"2024-04-19T02:20:08.990873+0000","last_became_active":"2024-04-19T02:19:54.923164+0000","last_became_peered":"2024-04-19T02:19:54.923164+0000","last_unstale":"2024-04-19T02:20:08.990873+0000","last_undegraded":"2024-04-19T02:20:08.990873+0000","last_fullsized":"2024-04-19T02:20:08.990873+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:53:29.520848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995333+0000","last_change":"2024-04-19T02:20:08.662301+0000","last_active":"2024-04-19T02:20:08.995333+0000","last_peered":"2024-04-19T02:20:08.995333+0000","last_clean":"2024-04-19T02:20:08.995333+0000","last_became_active":"2024-04-19T02:20:08.661952+0000","last_became_peered":"2024-04-19T02:20:08.661952+0000","last_unstale":"2024-04-19T02:20:08.995333+0000","last_undegraded":"2024-04-19T02:20:08.995333+0000","last_fullsized":"2024-04-19T02:20:08.995333+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:41:21.658836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.991779+0000","last_change":"2024-04-19T02:19:54.930115+0000","last_active":"2024-04-19T02:20:08.991779+0000","last_peered":"2024-04-19T02:20:08.991779+0000","last_clean":"2024-04-19T02:20:08.991779+0000","last_became_active":"2024-04-19T02:19:54.926463+0000","last_became_peered":"2024-04-19T02:19:54.926463+0000","last_unstale":"2024-04-19T02:20:08.991779+0000","last_undegraded":"2024-04-19T02:20:08.991779+0000","last_fullsized":"2024-04-19T02:20:08.991779+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:00.191645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":96,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992852+0000","last_change":"2024-04-19T02:19:54.932929+0000","last_active":"2024-04-19T02:20:08.992852+0000","last_peered":"2024-04-19T02:20:08.992852+0000","last_clean":"2024-04-19T02:20:08.992852+0000","last_became_active":"2024-04-19T02:19:54.932571+0000","last_became_peered":"2024-04-19T02:19:54.932571+0000","last_unstale":"2024-04-19T02:20:08.992852+0000","last_undegraded":"2024-04-19T02:20:08.992852+0000","last_fullsized":"2024-04-19T02:20:08.992852+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:50:08.657036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":279,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993444+0000","last_change":"2024-04-19T02:15:24.533634+0000","last_active":"2024-04-19T02:20:08.993444+0000","last_peered":"2024-04-19T02:20:08.993444+0000","last_clean":"2024-04-19T02:20:08.993444+0000","last_became_active":"2024-04-19T02:15:24.533420+0000","last_became_peered":"2024-04-19T02:15:24.533420+0000","last_unstale":"2024-04-19T02:20:08.993444+0000","last_undegraded":"2024-04-19T02:20:08.993444+0000","last_fullsized":"2024-04-19T02:20:08.993444+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.001770+0000","last_change":"2024-04-19T02:20:10.001770+0000","last_active":"2024-04-19T02:20:10.001770+0000","last_peered":"2024-04-19T02:20:10.001770+0000","last_clean":"2024-04-19T02:20:10.001770+0000","last_became_active":"2024-04-19T02:20:10.001415+0000","last_became_peered":"2024-04-19T02:20:10.001415+0000","last_unstale":"2024-04-19T02:20:10.001770+0000","last_undegraded":"2024-04-19T02:20:10.001770+0000","last_fullsized":"2024-04-19T02:20:10.001770+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:00:30.084474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993420+0000","last_change":"2024-04-19T02:15:29.285015+0000","last_active":"2024-04-19T02:20:08.993420+0000","last_peered":"2024-04-19T02:20:08.993420+0000","last_clean":"2024-04-19T02:20:08.993420+0000","last_became_active":"2024-04-19T02:15:29.284164+0000","last_became_peered":"2024-04-19T02:15:29.284164+0000","last_unstale":"2024-04-19T02:20:08.993420+0000","last_undegraded":"2024-04-19T02:20:08.993420+0000","last_fullsized":"2024-04-19T02:20:08.993420+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:36.987844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":83,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993579+0000","last_change":"2024-04-19T02:15:24.533912+0000","last_active":"2024-04-19T02:20:08.993579+0000","last_peered":"2024-04-19T02:20:08.993579+0000","last_clean":"2024-04-19T02:20:08.993579+0000","last_became_active":"2024-04-19T02:15:24.533580+0000","last_became_peered":"2024-04-19T02:15:24.533580+0000","last_unstale":"2024-04-19T02:20:08.993579+0000","last_undegraded":"2024-04-19T02:20:08.993579+0000","last_fullsized":"2024-04-19T02:20:08.993579+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:45.045477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.639268+0000","last_change":"2024-04-19T02:20:10.639268+0000","last_active":"2024-04-19T02:20:10.639268+0000","last_peered":"2024-04-19T02:20:10.639268+0000","last_clean":"2024-04-19T02:20:10.639268+0000","last_became_active":"2024-04-19T02:20:10.638966+0000","last_became_peered":"2024-04-19T02:20:10.638966+0000","last_unstale":"2024-04-19T02:20:10.639268+0000","last_undegraded":"2024-04-19T02:20:10.639268+0000","last_fullsized":"2024-04-19T02:20:10.639268+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:38.164641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":49,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996215+0000","last_change":"2024-04-19T02:20:07.986363+0000","last_active":"2024-04-19T02:20:08.996215+0000","last_peered":"2024-04-19T02:20:08.996215+0000","last_clean":"2024-04-19T02:20:08.996215+0000","last_became_active":"2024-04-19T02:20:07.986110+0000","last_became_peered":"2024-04-19T02:20:07.986110+0000","last_unstale":"2024-04-19T02:20:08.996215+0000","last_undegraded":"2024-04-19T02:20:08.996215+0000","last_fullsized":"2024-04-19T02:20:08.996215+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:12.545910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":60,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996406+0000","last_change":"2024-04-19T02:19:54.925886+0000","last_active":"2024-04-19T02:20:08.996406+0000","last_peered":"2024-04-19T02:20:08.996406+0000","last_clean":"2024-04-19T02:20:08.996406+0000","last_became_active":"2024-04-19T02:19:54.925570+0000","last_became_peered":"2024-04-19T02:19:54.925570+0000","last_unstale":"2024-04-19T02:20:08.996406+0000","last_undegraded":"2024-04-19T02:20:08.996406+0000","last_fullsized":"2024-04-19T02:20:08.996406+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:33:34.594161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.990045+0000","last_change":"2024-04-19T02:19:54.933960+0000","last_active":"2024-04-19T02:20:08.990045+0000","last_peered":"2024-04-19T02:20:08.990045+0000","last_clean":"2024-04-19T02:20:08.990045+0000","last_became_active":"2024-04-19T02:19:54.929918+0000","last_became_peered":"2024-04-19T02:19:54.929918+0000","last_unstale":"2024-04-19T02:20:08.990045+0000","last_undegraded":"2024-04-19T02:20:08.990045+0000","last_fullsized":"2024-04-19T02:20:08.990045+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:33:10.282684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995346+0000","last_change":"2024-04-19T02:15:29.281694+0000","last_active":"2024-04-19T02:20:08.995346+0000","last_peered":"2024-04-19T02:20:08.995346+0000","last_clean":"2024-04-19T02:20:08.995346+0000","last_became_active":"2024-04-19T02:15:29.280519+0000","last_became_peered":"2024-04-19T02:15:29.280519+0000","last_unstale":"2024-04-19T02:20:08.995346+0000","last_undegraded":"2024-04-19T02:20:08.995346+0000","last_fullsized":"2024-04-19T02:20:08.995346+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:50.890545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.990434+0000","last_change":"2024-04-19T02:19:54.931726+0000","last_active":"2024-04-19T02:20:08.990434+0000","last_peered":"2024-04-19T02:20:08.990434+0000","last_clean":"2024-04-19T02:20:08.990434+0000","last_became_active":"2024-04-19T02:19:54.928460+0000","last_became_peered":"2024-04-19T02:19:54.928460+0000","last_unstale":"2024-04-19T02:20:08.990434+0000","last_undegraded":"2024-04-19T02:20:08.990434+0000","last_fullsized":"2024-04-19T02:20:08.990434+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:07:04.935620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.998879+0000","last_change":"2024-04-19T02:20:09.998879+0000","last_active":"2024-04-19T02:20:09.998879+0000","last_peered":"2024-04-19T02:20:09.998879+0000","last_clean":"2024-04-19T02:20:09.998879+0000","last_became_active":"2024-04-19T02:20:09.998629+0000","last_became_peered":"2024-04-19T02:20:09.998629+0000","last_unstale":"2024-04-19T02:20:09.998879+0000","last_undegraded":"2024-04-19T02:20:09.998879+0000","last_fullsized":"2024-04-19T02:20:09.998879+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:38:00.584717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.639272+0000","last_change":"2024-04-19T02:20:10.639272+0000","last_active":"2024-04-19T02:20:10.639272+0000","last_peered":"2024-04-19T02:20:10.639272+0000","last_clean":"2024-04-19T02:20:10.639272+0000","last_became_active":"2024-04-19T02:20:10.638912+0000","last_became_peered":"2024-04-19T02:20:10.638912+0000","last_unstale":"2024-04-19T02:20:10.639272+0000","last_undegraded":"2024-04-19T02:20:10.639272+0000","last_fullsized":"2024-04-19T02:20:10.639272+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:19.396777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":83,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993846+0000","last_change":"2024-04-19T02:15:24.533777+0000","last_active":"2024-04-19T02:20:08.993846+0000","last_peered":"2024-04-19T02:20:08.993846+0000","last_clean":"2024-04-19T02:20:08.993846+0000","last_became_active":"2024-04-19T02:15:24.533436+0000","last_became_peered":"2024-04-19T02:15:24.533436+0000","last_unstale":"2024-04-19T02:20:08.993846+0000","last_undegraded":"2024-04-19T02:20:08.993846+0000","last_fullsized":"2024-04-19T02:20:08.993846+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:53:25.922418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.990547+0000","last_change":"2024-04-19T02:19:54.933278+0000","last_active":"2024-04-19T02:20:08.990547+0000","last_peered":"2024-04-19T02:20:08.990547+0000","last_clean":"2024-04-19T02:20:08.990547+0000","last_became_active":"2024-04-19T02:19:54.931328+0000","last_became_peered":"2024-04-19T02:19:54.931328+0000","last_unstale":"2024-04-19T02:20:08.990547+0000","last_undegraded":"2024-04-19T02:20:08.990547+0000","last_fullsized":"2024-04-19T02:20:08.990547+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:08:38.731741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996195+0000","last_change":"2024-04-19T02:15:29.282244+0000","last_active":"2024-04-19T02:20:08.996195+0000","last_peered":"2024-04-19T02:20:08.996195+0000","last_clean":"2024-04-19T02:20:08.996195+0000","last_became_active":"2024-04-19T02:15:29.280366+0000","last_became_peered":"2024-04-19T02:15:29.280366+0000","last_unstale":"2024-04-19T02:20:08.996195+0000","last_undegraded":"2024-04-19T02:20:08.996195+0000","last_fullsized":"2024-04-19T02:20:08.996195+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995650+0000","last_change":"2024-04-19T02:15:28.893027+0000","last_active":"2024-04-19T02:20:08.995650+0000","last_peered":"2024-04-19T02:20:08.995650+0000","last_clean":"2024-04-19T02:20:08.995650+0000","last_became_active":"2024-04-19T02:15:28.892695+0000","last_became_peered":"2024-04-19T02:15:28.892695+0000","last_unstale":"2024-04-19T02:20:08.995650+0000","last_undegraded":"2024-04-19T02:20:08.995650+0000","last_fullsized":"2024-04-19T02:20:08.995650+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996179+0000","last_change":"2024-04-19T02:19:54.929648+0000","last_active":"2024-04-19T02:20:08.996179+0000","last_peered":"2024-04-19T02:20:08.996179+0000","last_clean":"2024-04-19T02:20:08.996179+0000","last_became_active":"2024-04-19T02:19:54.929412+0000","last_became_peered":"2024-04-19T02:19:54.929412+0000","last_unstale":"2024-04-19T02:20:08.996179+0000","last_undegraded":"2024-04-19T02:20:08.996179+0000","last_fullsized":"2024-04-19T02:20:08.996179+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:28:21.688550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":94,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992761+0000","last_change":"2024-04-19T02:19:54.927315+0000","last_active":"2024-04-19T02:20:08.992761+0000","last_peered":"2024-04-19T02:20:08.992761+0000","last_clean":"2024-04-19T02:20:08.992761+0000","last_became_active":"2024-04-19T02:19:54.926630+0000","last_became_peered":"2024-04-19T02:19:54.926630+0000","last_unstale":"2024-04-19T02:20:08.992761+0000","last_undegraded":"2024-04-19T02:20:08.992761+0000","last_fullsized":"2024-04-19T02:20:08.992761+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:39:00.822558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992698+0000","last_change":"2024-04-19T02:19:54.931920+0000","last_active":"2024-04-19T02:20:08.992698+0000","last_peered":"2024-04-19T02:20:08.992698+0000","last_clean":"2024-04-19T02:20:08.992698+0000","last_became_active":"2024-04-19T02:19:54.931328+0000","last_became_peered":"2024-04-19T02:19:54.931328+0000","last_unstale":"2024-04-19T02:20:08.992698+0000","last_undegraded":"2024-04-19T02:20:08.992698+0000","last_fullsized":"2024-04-19T02:20:08.992698+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:39.655376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":80,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996399+0000","last_change":"2024-04-19T02:15:28.893239+0000","last_active":"2024-04-19T02:20:08.996399+0000","last_peered":"2024-04-19T02:20:08.996399+0000","last_clean":"2024-04-19T02:20:08.996399+0000","last_became_active":"2024-04-19T02:15:28.892881+0000","last_became_peered":"2024-04-19T02:15:28.892881+0000","last_unstale":"2024-04-19T02:20:08.996399+0000","last_undegraded":"2024-04-19T02:20:08.996399+0000","last_fullsized":"2024-04-19T02:20:08.996399+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992227+0000","last_change":"2024-04-19T02:19:54.924029+0000","last_active":"2024-04-19T02:20:08.992227+0000","last_peered":"2024-04-19T02:20:08.992227+0000","last_clean":"2024-04-19T02:20:08.992227+0000","last_became_active":"2024-04-19T02:19:54.923752+0000","last_became_peered":"2024-04-19T02:19:54.923752+0000","last_unstale":"2024-04-19T02:20:08.992227+0000","last_undegraded":"2024-04-19T02:20:08.992227+0000","last_fullsized":"2024-04-19T02:20:08.992227+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:26:41.825722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.990448+0000","last_change":"2024-04-19T02:19:54.933652+0000","last_active":"2024-04-19T02:20:08.990448+0000","last_peered":"2024-04-19T02:20:08.990448+0000","last_clean":"2024-04-19T02:20:08.990448+0000","last_became_active":"2024-04-19T02:19:54.932103+0000","last_became_peered":"2024-04-19T02:19:54.932103+0000","last_unstale":"2024-04-19T02:20:08.990448+0000","last_undegraded":"2024-04-19T02:20:08.990448+0000","last_fullsized":"2024-04-19T02:20:08.990448+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:46:14.540427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996400+0000","last_change":"2024-04-19T02:19:54.925832+0000","last_active":"2024-04-19T02:20:08.996400+0000","last_peered":"2024-04-19T02:20:08.996400+0000","last_clean":"2024-04-19T02:20:08.996400+0000","last_became_active":"2024-04-19T02:19:54.925565+0000","last_became_peered":"2024-04-19T02:19:54.925565+0000","last_unstale":"2024-04-19T02:20:08.996400+0000","last_undegraded":"2024-04-19T02:20:08.996400+0000","last_fullsized":"2024-04-19T02:20:08.996400+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:28:13.380027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.990549+0000","last_change":"2024-04-19T02:19:54.929083+0000","last_active":"2024-04-19T02:20:08.990549+0000","last_peered":"2024-04-19T02:20:08.990549+0000","last_clean":"2024-04-19T02:20:08.990549+0000","last_became_active":"2024-04-19T02:19:54.926439+0000","last_became_peered":"2024-04-19T02:19:54.926439+0000","last_unstale":"2024-04-19T02:20:08.990549+0000","last_undegraded":"2024-04-19T02:20:08.990549+0000","last_fullsized":"2024-04-19T02:20:08.990549+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:15:04.675082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993698+0000","last_change":"2024-04-19T02:19:54.931258+0000","last_active":"2024-04-19T02:20:08.993698+0000","last_peered":"2024-04-19T02:20:08.993698+0000","last_clean":"2024-04-19T02:20:08.993698+0000","last_became_active":"2024-04-19T02:19:54.930665+0000","last_became_peered":"2024-04-19T02:19:54.930665+0000","last_unstale":"2024-04-19T02:20:08.993698+0000","last_undegraded":"2024-04-19T02:20:08.993698+0000","last_fullsized":"2024-04-19T02:20:08.993698+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:57:08.681822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993591+0000","last_change":"2024-04-19T02:19:54.931055+0000","last_active":"2024-04-19T02:20:08.993591+0000","last_peered":"2024-04-19T02:20:08.993591+0000","last_clean":"2024-04-19T02:20:08.993591+0000","last_became_active":"2024-04-19T02:19:54.930527+0000","last_became_peered":"2024-04-19T02:19:54.930527+0000","last_unstale":"2024-04-19T02:20:08.993591+0000","last_undegraded":"2024-04-19T02:20:08.993591+0000","last_fullsized":"2024-04-19T02:20:08.993591+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:05:38.717309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.001589+0000","last_change":"2024-04-19T02:20:10.001589+0000","last_active":"2024-04-19T02:20:10.001589+0000","last_peered":"2024-04-19T02:20:10.001589+0000","last_clean":"2024-04-19T02:20:10.001589+0000","last_became_active":"2024-04-19T02:20:10.001304+0000","last_became_peered":"2024-04-19T02:20:10.001304+0000","last_unstale":"2024-04-19T02:20:10.001589+0000","last_undegraded":"2024-04-19T02:20:10.001589+0000","last_fullsized":"2024-04-19T02:20:10.001589+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:36.432257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996078+0000","last_change":"2024-04-19T02:20:08.662331+0000","last_active":"2024-04-19T02:20:08.996078+0000","last_peered":"2024-04-19T02:20:08.996078+0000","last_clean":"2024-04-19T02:20:08.996078+0000","last_became_active":"2024-04-19T02:20:08.661996+0000","last_became_peered":"2024-04-19T02:20:08.661996+0000","last_unstale":"2024-04-19T02:20:08.996078+0000","last_undegraded":"2024-04-19T02:20:08.996078+0000","last_fullsized":"2024-04-19T02:20:08.996078+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:25:03.894231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.001706+0000","last_change":"2024-04-19T02:20:10.001706+0000","last_active":"2024-04-19T02:20:10.001706+0000","last_peered":"2024-04-19T02:20:10.001706+0000","last_clean":"2024-04-19T02:20:10.001706+0000","last_became_active":"2024-04-19T02:20:10.001372+0000","last_became_peered":"2024-04-19T02:20:10.001372+0000","last_unstale":"2024-04-19T02:20:10.001706+0000","last_undegraded":"2024-04-19T02:20:10.001706+0000","last_fullsized":"2024-04-19T02:20:10.001706+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:54:55.702629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996258+0000","last_change":"2024-04-19T02:15:29.277568+0000","last_active":"2024-04-19T02:20:08.996258+0000","last_peered":"2024-04-19T02:20:08.996258+0000","last_clean":"2024-04-19T02:20:08.996258+0000","last_became_active":"2024-04-19T02:15:29.276725+0000","last_became_peered":"2024-04-19T02:15:29.276725+0000","last_unstale":"2024-04-19T02:20:08.996258+0000","last_undegraded":"2024-04-19T02:20:08.996258+0000","last_fullsized":"2024-04-19T02:20:08.996258+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5254,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":72,"seq":309237645318,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58816,"kb_used_data":884,"kb_used_omap":6,"kb_used_meta":57913,"kb_avail":94313024,"statfs":{"total":96636764160,"available":96576536576,"internally_reserved":0,"allocated":905216,"data_stored":358135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6848,"internal_metadata":59303232},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738430,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":275424,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":273918,"kb_avail":94096416,"statfs":{"total":96636764160,"available":96354729984,"internally_reserved":0,"allocated":1519616,"data_stored":948136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":280492486},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 02:19:26 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.371,"15min":0.316},"min":{"1min":0.29899999999999999,"5min":0.159,"15min":0.159},"max":{"1min":0.57499999999999996,"5min":4.4480000000000004,"15min":4.4480000000000004},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.379,"15min":0.36599999999999999},"min":{"1min":0.29399999999999998,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.54800000000000004,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.40200000000000002}]},{"osd":2,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":2.1000000000000001,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.36099999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738429,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307416,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":305918,"kb_avail":94064424,"statfs":{"total":96636764160,"available":96321970176,"internally_reserved":0,"allocated":1515520,"data_stored":949633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":313260486},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:19:29 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.40600000000000003,"15min":0.376},"min":{"1min":0.32700000000000001,"5min":0.157,"15min":0.157},"max":{"1min":0.64900000000000002,"5min":1.794,"15min":1.794},"last":0.496},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.38100000000000001,"15min":0.32400000000000001},"min":{"1min":0.37,"5min":0.16,"15min":0.16},"max":{"1min":0.63,"5min":2.411,"15min":2.411},"last":0.53400000000000003}]},{"osd":2,"last update":"Fri Apr 19 02:16:26 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.60599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5254,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:20:16.652 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-19T02:20:16.652 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-04-19T02:20:17.031 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-19T02:20:17.041 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-19T02:20:17.041 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:20:17.365 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:20:17.367 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-04-19T02:20:17.377 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":225,"stamp":"2024-04-19T02:20:16.812850+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":641656,"kb_used_data":3848,"kb_used_omap":9,"kb_used_meta":637750,"kb_avail":282473864,"statfs":{"total":289910292480,"available":289253236736,"internally_reserved":0,"allocated":3940352,"data_stored":2255904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10036,"internal_metadata":653056204},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001507"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996815+0000","last_change":"2024-04-19T02:19:54.929643+0000","last_active":"2024-04-19T02:20:08.996815+0000","last_peered":"2024-04-19T02:20:08.996815+0000","last_clean":"2024-04-19T02:20:08.996815+0000","last_became_active":"2024-04-19T02:19:54.929435+0000","last_became_peered":"2024-04-19T02:19:54.929435+0000","last_unstale":"2024-04-19T02:20:08.996815+0000","last_undegraded":"2024-04-19T02:20:08.996815+0000","last_fullsized":"2024-04-19T02:20:08.996815+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:44:05.807254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995814+0000","last_change":"2024-04-19T02:19:54.931532+0000","last_active":"2024-04-19T02:20:08.995814+0000","last_peered":"2024-04-19T02:20:08.995814+0000","last_clean":"2024-04-19T02:20:08.995814+0000","last_became_active":"2024-04-19T02:19:54.931278+0000","last_became_peered":"2024-04-19T02:19:54.931278+0000","last_unstale":"2024-04-19T02:20:08.995814+0000","last_undegraded":"2024-04-19T02:20:08.995814+0000","last_fullsized":"2024-04-19T02:20:08.995814+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:20:02.024046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993263+0000","last_change":"2024-04-19T02:15:29.286709+0000","last_active":"2024-04-19T02:20:08.993263+0000","last_peered":"2024-04-19T02:20:08.993263+0000","last_clean":"2024-04-19T02:20:08.993263+0000","last_became_active":"2024-04-19T02:15:29.286169+0000","last_became_peered":"2024-04-19T02:15:29.286169+0000","last_unstale":"2024-04-19T02:20:08.993263+0000","last_undegraded":"2024-04-19T02:20:08.993263+0000","last_fullsized":"2024-04-19T02:20:08.993263+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:58.741466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993036+0000","last_change":"2024-04-19T02:19:54.927063+0000","last_active":"2024-04-19T02:20:08.993036+0000","last_peered":"2024-04-19T02:20:08.993036+0000","last_clean":"2024-04-19T02:20:08.993036+0000","last_became_active":"2024-04-19T02:19:54.926046+0000","last_became_peered":"2024-04-19T02:19:54.926046+0000","last_unstale":"2024-04-19T02:20:08.993036+0000","last_undegraded":"2024-04-19T02:20:08.993036+0000","last_fullsized":"2024-04-19T02:20:08.993036+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:52:59.151542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":55,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995211+0000","last_change":"2024-04-19T02:19:54.931669+0000","last_active":"2024-04-19T02:20:08.995211+0000","last_peered":"2024-04-19T02:20:08.995211+0000","last_clean":"2024-04-19T02:20:08.995211+0000","last_became_active":"2024-04-19T02:19:54.931435+0000","last_became_peered":"2024-04-19T02:19:54.931435+0000","last_unstale":"2024-04-19T02:20:08.995211+0000","last_undegraded":"2024-04-19T02:20:08.995211+0000","last_fullsized":"2024-04-19T02:20:08.995211+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:42:58.222802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992140+0000","last_change":"2024-04-19T02:19:54.924250+0000","last_active":"2024-04-19T02:20:08.992140+0000","last_peered":"2024-04-19T02:20:08.992140+0000","last_clean":"2024-04-19T02:20:08.992140+0000","last_became_active":"2024-04-19T02:19:54.923984+0000","last_became_peered":"2024-04-19T02:19:54.923984+0000","last_unstale":"2024-04-19T02:20:08.992140+0000","last_undegraded":"2024-04-19T02:20:08.992140+0000","last_fullsized":"2024-04-19T02:20:08.992140+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:56:51.290239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992724+0000","last_change":"2024-04-19T02:19:54.926647+0000","last_active":"2024-04-19T02:20:08.992724+0000","last_peered":"2024-04-19T02:20:08.992724+0000","last_clean":"2024-04-19T02:20:08.992724+0000","last_became_active":"2024-04-19T02:19:54.925529+0000","last_became_peered":"2024-04-19T02:19:54.925529+0000","last_unstale":"2024-04-19T02:20:08.992724+0000","last_undegraded":"2024-04-19T02:20:08.992724+0000","last_fullsized":"2024-04-19T02:20:08.992724+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:49:06.911557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993273+0000","last_change":"2024-04-19T02:19:54.930828+0000","last_active":"2024-04-19T02:20:08.993273+0000","last_peered":"2024-04-19T02:20:08.993273+0000","last_clean":"2024-04-19T02:20:08.993273+0000","last_became_active":"2024-04-19T02:19:54.930075+0000","last_became_peered":"2024-04-19T02:19:54.930075+0000","last_unstale":"2024-04-19T02:20:08.993273+0000","last_undegraded":"2024-04-19T02:20:08.993273+0000","last_fullsized":"2024-04-19T02:20:08.993273+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:00.512431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.991008+0000","last_change":"2024-04-19T02:19:54.931617+0000","last_active":"2024-04-19T02:20:08.991008+0000","last_peered":"2024-04-19T02:20:08.991008+0000","last_clean":"2024-04-19T02:20:08.991008+0000","last_became_active":"2024-04-19T02:19:54.928496+0000","last_became_peered":"2024-04-19T02:19:54.928496+0000","last_unstale":"2024-04-19T02:20:08.991008+0000","last_undegraded":"2024-04-19T02:20:08.991008+0000","last_fullsized":"2024-04-19T02:20:08.991008+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:56:50.232031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":60,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993489+0000","last_change":"2024-04-19T02:16:30.093524+0000","last_active":"2024-04-19T02:20:08.993489+0000","last_peered":"2024-04-19T02:20:08.993489+0000","last_clean":"2024-04-19T02:20:08.993489+0000","last_became_active":"2024-04-19T02:16:30.093344+0000","last_became_peered":"2024-04-19T02:16:30.093344+0000","last_unstale":"2024-04-19T02:20:08.993489+0000","last_undegraded":"2024-04-19T02:20:08.993489+0000","last_fullsized":"2024-04-19T02:20:08.993489+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:14:40.293159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993069+0000","last_change":"2024-04-19T02:19:54.926754+0000","last_active":"2024-04-19T02:20:08.993069+0000","last_peered":"2024-04-19T02:20:08.993069+0000","last_clean":"2024-04-19T02:20:08.993069+0000","last_became_active":"2024-04-19T02:19:54.926040+0000","last_became_peered":"2024-04-19T02:19:54.926040+0000","last_unstale":"2024-04-19T02:20:08.993069+0000","last_undegraded":"2024-04-19T02:20:08.993069+0000","last_fullsized":"2024-04-19T02:20:08.993069+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:36:16.313500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995212+0000","last_change":"2024-04-19T02:20:08.662601+0000","last_active":"2024-04-19T02:20:08.995212+0000","last_peered":"2024-04-19T02:20:08.995212+0000","last_clean":"2024-04-19T02:20:08.995212+0000","last_became_active":"2024-04-19T02:20:08.662234+0000","last_became_peered":"2024-04-19T02:20:08.662234+0000","last_unstale":"2024-04-19T02:20:08.995212+0000","last_undegraded":"2024-04-19T02:20:08.995212+0000","last_fullsized":"2024-04-19T02:20:08.995212+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:34:06.694985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":55,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995768+0000","last_change":"2024-04-19T02:19:54.932576+0000","last_active":"2024-04-19T02:20:08.995768+0000","last_peered":"2024-04-19T02:20:08.995768+0000","last_clean":"2024-04-19T02:20:08.995768+0000","last_became_active":"2024-04-19T02:19:54.932240+0000","last_became_peered":"2024-04-19T02:19:54.932240+0000","last_unstale":"2024-04-19T02:20:08.995768+0000","last_undegraded":"2024-04-19T02:20:08.995768+0000","last_fullsized":"2024-04-19T02:20:08.995768+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:10:10.453676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":79,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637354+0000","last_change":"2024-04-19T02:15:29.284262+0000","last_active":"2024-04-19T02:20:10.637354+0000","last_peered":"2024-04-19T02:20:10.637354+0000","last_clean":"2024-04-19T02:20:10.637354+0000","last_became_active":"2024-04-19T02:15:29.283121+0000","last_became_peered":"2024-04-19T02:15:29.283121+0000","last_unstale":"2024-04-19T02:20:10.637354+0000","last_undegraded":"2024-04-19T02:20:10.637354+0000","last_fullsized":"2024-04-19T02:20:10.637354+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":79,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637524+0000","last_change":"2024-04-19T02:15:29.285139+0000","last_active":"2024-04-19T02:20:10.637524+0000","last_peered":"2024-04-19T02:20:10.637524+0000","last_clean":"2024-04-19T02:20:10.637524+0000","last_became_active":"2024-04-19T02:15:29.284649+0000","last_became_peered":"2024-04-19T02:15:29.284649+0000","last_unstale":"2024-04-19T02:20:10.637524+0000","last_undegraded":"2024-04-19T02:20:10.637524+0000","last_fullsized":"2024-04-19T02:20:10.637524+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637088+0000","last_change":"2024-04-19T02:19:54.931033+0000","last_active":"2024-04-19T02:20:10.637088+0000","last_peered":"2024-04-19T02:20:10.637088+0000","last_clean":"2024-04-19T02:20:10.637088+0000","last_became_active":"2024-04-19T02:19:54.930437+0000","last_became_peered":"2024-04-19T02:19:54.930437+0000","last_unstale":"2024-04-19T02:20:10.637088+0000","last_undegraded":"2024-04-19T02:20:10.637088+0000","last_fullsized":"2024-04-19T02:20:10.637088+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:44:05.807254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.001650+0000","last_change":"2024-04-19T02:20:10.001650+0000","last_active":"2024-04-19T02:20:10.001650+0000","last_peered":"2024-04-19T02:20:10.001650+0000","last_clean":"2024-04-19T02:20:10.001650+0000","last_became_active":"2024-04-19T02:20:10.001343+0000","last_became_peered":"2024-04-19T02:20:10.001343+0000","last_unstale":"2024-04-19T02:20:10.001650+0000","last_undegraded":"2024-04-19T02:20:10.001650+0000","last_fullsized":"2024-04-19T02:20:10.001650+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:15:54.452503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.858101+0000","last_change":"2024-04-19T02:19:54.933452+0000","last_active":"2024-04-19T02:20:09.858101+0000","last_peered":"2024-04-19T02:20:09.858101+0000","last_clean":"2024-04-19T02:20:09.858101+0000","last_became_active":"2024-04-19T02:19:54.933233+0000","last_became_peered":"2024-04-19T02:19:54.933233+0000","last_unstale":"2024-04-19T02:20:09.858101+0000","last_undegraded":"2024-04-19T02:20:09.858101+0000","last_fullsized":"2024-04-19T02:20:09.858101+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:50.712874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.990125+0000","last_change":"2024-04-19T02:19:54.925745+0000","last_active":"2024-04-19T02:20:08.990125+0000","last_peered":"2024-04-19T02:20:08.990125+0000","last_clean":"2024-04-19T02:20:08.990125+0000","last_became_active":"2024-04-19T02:19:54.925060+0000","last_became_peered":"2024-04-19T02:19:54.925060+0000","last_unstale":"2024-04-19T02:20:08.990125+0000","last_undegraded":"2024-04-19T02:20:08.990125+0000","last_fullsized":"2024-04-19T02:20:08.990125+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:12:43.617806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992995+0000","last_change":"2024-04-19T02:19:54.927206+0000","last_active":"2024-04-19T02:20:08.992995+0000","last_peered":"2024-04-19T02:20:08.992995+0000","last_clean":"2024-04-19T02:20:08.992995+0000","last_became_active":"2024-04-19T02:19:54.926442+0000","last_became_peered":"2024-04-19T02:19:54.926442+0000","last_unstale":"2024-04-19T02:20:08.992995+0000","last_undegraded":"2024-04-19T02:20:08.992995+0000","last_fullsized":"2024-04-19T02:20:08.992995+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:27:17.095030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992632+0000","last_change":"2024-04-19T02:19:54.932532+0000","last_active":"2024-04-19T02:20:08.992632+0000","last_peered":"2024-04-19T02:20:08.992632+0000","last_clean":"2024-04-19T02:20:08.992632+0000","last_became_active":"2024-04-19T02:19:54.931438+0000","last_became_peered":"2024-04-19T02:19:54.931438+0000","last_unstale":"2024-04-19T02:20:08.992632+0000","last_undegraded":"2024-04-19T02:20:08.992632+0000","last_fullsized":"2024-04-19T02:20:08.992632+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:12:54.241778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995945+0000","last_change":"2024-04-19T02:20:08.662261+0000","last_active":"2024-04-19T02:20:08.995945+0000","last_peered":"2024-04-19T02:20:08.995945+0000","last_clean":"2024-04-19T02:20:08.995945+0000","last_became_active":"2024-04-19T02:20:08.661940+0000","last_became_peered":"2024-04-19T02:20:08.661940+0000","last_unstale":"2024-04-19T02:20:08.995945+0000","last_undegraded":"2024-04-19T02:20:08.995945+0000","last_fullsized":"2024-04-19T02:20:08.995945+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:49:34.835266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.639368+0000","last_change":"2024-04-19T02:20:10.639368+0000","last_active":"2024-04-19T02:20:10.639368+0000","last_peered":"2024-04-19T02:20:10.639368+0000","last_clean":"2024-04-19T02:20:10.639368+0000","last_became_active":"2024-04-19T02:20:10.639036+0000","last_became_peered":"2024-04-19T02:20:10.639036+0000","last_unstale":"2024-04-19T02:20:10.639368+0000","last_undegraded":"2024-04-19T02:20:10.639368+0000","last_fullsized":"2024-04-19T02:20:10.639368+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:36:45.316530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996035+0000","last_change":"2024-04-19T02:19:54.928467+0000","last_active":"2024-04-19T02:20:08.996035+0000","last_peered":"2024-04-19T02:20:08.996035+0000","last_clean":"2024-04-19T02:20:08.996035+0000","last_became_active":"2024-04-19T02:19:54.928261+0000","last_became_peered":"2024-04-19T02:19:54.928261+0000","last_unstale":"2024-04-19T02:20:08.996035+0000","last_undegraded":"2024-04-19T02:20:08.996035+0000","last_fullsized":"2024-04-19T02:20:08.996035+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:40:43.645134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996795+0000","last_change":"2024-04-19T02:15:29.278084+0000","last_active":"2024-04-19T02:20:08.996795+0000","last_peered":"2024-04-19T02:20:08.996795+0000","last_clean":"2024-04-19T02:20:08.996795+0000","last_became_active":"2024-04-19T02:15:29.276952+0000","last_became_peered":"2024-04-19T02:15:29.276952+0000","last_unstale":"2024-04-19T02:20:08.996795+0000","last_undegraded":"2024-04-19T02:20:08.996795+0000","last_fullsized":"2024-04-19T02:20:08.996795+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.991888+0000","last_change":"2024-04-19T02:19:54.933154+0000","last_active":"2024-04-19T02:20:08.991888+0000","last_peered":"2024-04-19T02:20:08.991888+0000","last_clean":"2024-04-19T02:20:08.991888+0000","last_became_active":"2024-04-19T02:19:54.931124+0000","last_became_peered":"2024-04-19T02:19:54.931124+0000","last_unstale":"2024-04-19T02:20:08.991888+0000","last_undegraded":"2024-04-19T02:20:08.991888+0000","last_fullsized":"2024-04-19T02:20:08.991888+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:49.555501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993130+0000","last_change":"2024-04-19T02:15:29.287389+0000","last_active":"2024-04-19T02:20:08.993130+0000","last_peered":"2024-04-19T02:20:08.993130+0000","last_clean":"2024-04-19T02:20:08.993130+0000","last_became_active":"2024-04-19T02:15:29.286431+0000","last_became_peered":"2024-04-19T02:15:29.286431+0000","last_unstale":"2024-04-19T02:20:08.993130+0000","last_undegraded":"2024-04-19T02:20:08.993130+0000","last_fullsized":"2024-04-19T02:20:08.993130+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:58:30.117887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":57,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995777+0000","last_change":"2024-04-19T02:19:54.927108+0000","last_active":"2024-04-19T02:20:08.995777+0000","last_peered":"2024-04-19T02:20:08.995777+0000","last_clean":"2024-04-19T02:20:08.995777+0000","last_became_active":"2024-04-19T02:19:54.926838+0000","last_became_peered":"2024-04-19T02:19:54.926838+0000","last_unstale":"2024-04-19T02:20:08.995777+0000","last_undegraded":"2024-04-19T02:20:08.995777+0000","last_fullsized":"2024-04-19T02:20:08.995777+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:25:27.561607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":77,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996790+0000","last_change":"2024-04-19T02:15:29.281792+0000","last_active":"2024-04-19T02:20:08.996790+0000","last_peered":"2024-04-19T02:20:08.996790+0000","last_clean":"2024-04-19T02:20:08.996790+0000","last_became_active":"2024-04-19T02:15:29.280479+0000","last_became_peered":"2024-04-19T02:15:29.280479+0000","last_unstale":"2024-04-19T02:20:08.996790+0000","last_undegraded":"2024-04-19T02:20:08.996790+0000","last_fullsized":"2024-04-19T02:20:08.996790+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.989269+0000","last_change":"2024-04-19T02:19:54.925277+0000","last_active":"2024-04-19T02:20:08.989269+0000","last_peered":"2024-04-19T02:20:08.989269+0000","last_clean":"2024-04-19T02:20:08.989269+0000","last_became_active":"2024-04-19T02:19:54.924484+0000","last_became_peered":"2024-04-19T02:19:54.924484+0000","last_unstale":"2024-04-19T02:20:08.989269+0000","last_undegraded":"2024-04-19T02:20:08.989269+0000","last_fullsized":"2024-04-19T02:20:08.989269+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:57:54.845371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.639077+0000","last_change":"2024-04-19T02:20:10.639077+0000","last_active":"2024-04-19T02:20:10.639077+0000","last_peered":"2024-04-19T02:20:10.639077+0000","last_clean":"2024-04-19T02:20:10.639077+0000","last_became_active":"2024-04-19T02:20:10.638737+0000","last_became_peered":"2024-04-19T02:20:10.638737+0000","last_unstale":"2024-04-19T02:20:10.639077+0000","last_undegraded":"2024-04-19T02:20:10.639077+0000","last_fullsized":"2024-04-19T02:20:10.639077+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:20:05.200768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.989517+0000","last_change":"2024-04-19T02:19:54.930346+0000","last_active":"2024-04-19T02:20:08.989517+0000","last_peered":"2024-04-19T02:20:08.989517+0000","last_clean":"2024-04-19T02:20:08.989517+0000","last_became_active":"2024-04-19T02:19:54.928398+0000","last_became_peered":"2024-04-19T02:19:54.928398+0000","last_unstale":"2024-04-19T02:20:08.989517+0000","last_undegraded":"2024-04-19T02:20:08.989517+0000","last_fullsized":"2024-04-19T02:20:08.989517+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:46.321275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996446+0000","last_change":"2024-04-19T02:15:29.280879+0000","last_active":"2024-04-19T02:20:08.996446+0000","last_peered":"2024-04-19T02:20:08.996446+0000","last_clean":"2024-04-19T02:20:08.996446+0000","last_became_active":"2024-04-19T02:15:29.279314+0000","last_became_peered":"2024-04-19T02:15:29.279314+0000","last_unstale":"2024-04-19T02:20:08.996446+0000","last_undegraded":"2024-04-19T02:20:08.996446+0000","last_fullsized":"2024-04-19T02:20:08.996446+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.991148+0000","last_change":"2024-04-19T02:19:54.927744+0000","last_active":"2024-04-19T02:20:08.991148+0000","last_peered":"2024-04-19T02:20:08.991148+0000","last_clean":"2024-04-19T02:20:08.991148+0000","last_became_active":"2024-04-19T02:19:54.925729+0000","last_became_peered":"2024-04-19T02:19:54.925729+0000","last_unstale":"2024-04-19T02:20:08.991148+0000","last_undegraded":"2024-04-19T02:20:08.991148+0000","last_fullsized":"2024-04-19T02:20:08.991148+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:27:57.229684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.989293+0000","last_change":"2024-04-19T02:19:54.928435+0000","last_active":"2024-04-19T02:20:08.989293+0000","last_peered":"2024-04-19T02:20:08.989293+0000","last_clean":"2024-04-19T02:20:08.989293+0000","last_became_active":"2024-04-19T02:19:54.927666+0000","last_became_peered":"2024-04-19T02:19:54.927666+0000","last_unstale":"2024-04-19T02:20:08.989293+0000","last_undegraded":"2024-04-19T02:20:08.989293+0000","last_fullsized":"2024-04-19T02:20:08.989293+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:20:45.000808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993622+0000","last_change":"2024-04-19T02:19:54.932025+0000","last_active":"2024-04-19T02:20:08.993622+0000","last_peered":"2024-04-19T02:20:08.993622+0000","last_clean":"2024-04-19T02:20:08.993622+0000","last_became_active":"2024-04-19T02:19:54.931540+0000","last_became_peered":"2024-04-19T02:19:54.931540+0000","last_unstale":"2024-04-19T02:20:08.993622+0000","last_undegraded":"2024-04-19T02:20:08.993622+0000","last_fullsized":"2024-04-19T02:20:08.993622+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:03:31.479331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.991173+0000","last_change":"2024-04-19T02:19:54.924493+0000","last_active":"2024-04-19T02:20:08.991173+0000","last_peered":"2024-04-19T02:20:08.991173+0000","last_clean":"2024-04-19T02:20:08.991173+0000","last_became_active":"2024-04-19T02:19:54.923784+0000","last_became_peered":"2024-04-19T02:19:54.923784+0000","last_unstale":"2024-04-19T02:20:08.991173+0000","last_undegraded":"2024-04-19T02:20:08.991173+0000","last_fullsized":"2024-04-19T02:20:08.991173+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:09:34.378788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":81,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996234+0000","last_change":"2024-04-19T02:15:28.892937+0000","last_active":"2024-04-19T02:20:08.996234+0000","last_peered":"2024-04-19T02:20:08.996234+0000","last_clean":"2024-04-19T02:20:08.996234+0000","last_became_active":"2024-04-19T02:15:28.891440+0000","last_became_peered":"2024-04-19T02:15:28.891440+0000","last_unstale":"2024-04-19T02:20:08.996234+0000","last_undegraded":"2024-04-19T02:20:08.996234+0000","last_fullsized":"2024-04-19T02:20:08.996234+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.989329+0000","last_change":"2024-04-19T02:19:54.923898+0000","last_active":"2024-04-19T02:20:08.989329+0000","last_peered":"2024-04-19T02:20:08.989329+0000","last_clean":"2024-04-19T02:20:08.989329+0000","last_became_active":"2024-04-19T02:19:54.923493+0000","last_became_peered":"2024-04-19T02:19:54.923493+0000","last_unstale":"2024-04-19T02:20:08.989329+0000","last_undegraded":"2024-04-19T02:20:08.989329+0000","last_fullsized":"2024-04-19T02:20:08.989329+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:33.123319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":86,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637637+0000","last_change":"2024-04-19T02:15:28.891097+0000","last_active":"2024-04-19T02:20:10.637637+0000","last_peered":"2024-04-19T02:20:10.637637+0000","last_clean":"2024-04-19T02:20:10.637637+0000","last_became_active":"2024-04-19T02:15:28.890795+0000","last_became_peered":"2024-04-19T02:15:28.890795+0000","last_unstale":"2024-04-19T02:20:10.637637+0000","last_undegraded":"2024-04-19T02:20:10.637637+0000","last_fullsized":"2024-04-19T02:20:10.637637+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":79,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637625+0000","last_change":"2024-04-19T02:15:29.278546+0000","last_active":"2024-04-19T02:20:10.637625+0000","last_peered":"2024-04-19T02:20:10.637625+0000","last_clean":"2024-04-19T02:20:10.637625+0000","last_became_active":"2024-04-19T02:15:29.277547+0000","last_became_peered":"2024-04-19T02:15:29.277547+0000","last_unstale":"2024-04-19T02:20:10.637625+0000","last_undegraded":"2024-04-19T02:20:10.637625+0000","last_fullsized":"2024-04-19T02:20:10.637625+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":95,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637628+0000","last_change":"2024-04-19T02:19:54.933035+0000","last_active":"2024-04-19T02:20:10.637628+0000","last_peered":"2024-04-19T02:20:10.637628+0000","last_clean":"2024-04-19T02:20:10.637628+0000","last_became_active":"2024-04-19T02:19:54.932829+0000","last_became_peered":"2024-04-19T02:19:54.932829+0000","last_unstale":"2024-04-19T02:20:10.637628+0000","last_undegraded":"2024-04-19T02:20:10.637628+0000","last_fullsized":"2024-04-19T02:20:10.637628+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:09:05.626623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":49,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.998175+0000","last_change":"2024-04-19T02:20:07.983368+0000","last_active":"2024-04-19T02:20:09.998175+0000","last_peered":"2024-04-19T02:20:09.998175+0000","last_clean":"2024-04-19T02:20:09.998175+0000","last_became_active":"2024-04-19T02:20:07.983080+0000","last_became_peered":"2024-04-19T02:20:07.983080+0000","last_unstale":"2024-04-19T02:20:09.998175+0000","last_undegraded":"2024-04-19T02:20:09.998175+0000","last_fullsized":"2024-04-19T02:20:09.998175+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:24.138269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.989479+0000","last_change":"2024-04-19T02:19:54.927323+0000","last_active":"2024-04-19T02:20:08.989479+0000","last_peered":"2024-04-19T02:20:08.989479+0000","last_clean":"2024-04-19T02:20:08.989479+0000","last_became_active":"2024-04-19T02:19:54.925703+0000","last_became_peered":"2024-04-19T02:19:54.925703+0000","last_unstale":"2024-04-19T02:20:08.989479+0000","last_undegraded":"2024-04-19T02:20:08.989479+0000","last_fullsized":"2024-04-19T02:20:08.989479+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:46:59.533765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":55,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996775+0000","last_change":"2024-04-19T02:19:54.925918+0000","last_active":"2024-04-19T02:20:08.996775+0000","last_peered":"2024-04-19T02:20:08.996775+0000","last_clean":"2024-04-19T02:20:08.996775+0000","last_became_active":"2024-04-19T02:19:54.925634+0000","last_became_peered":"2024-04-19T02:19:54.925634+0000","last_unstale":"2024-04-19T02:20:08.996775+0000","last_undegraded":"2024-04-19T02:20:08.996775+0000","last_fullsized":"2024-04-19T02:20:08.996775+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:14:13.074455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.857926+0000","last_change":"2024-04-19T02:15:28.892934+0000","last_active":"2024-04-19T02:20:09.857926+0000","last_peered":"2024-04-19T02:20:09.857926+0000","last_clean":"2024-04-19T02:20:09.857926+0000","last_became_active":"2024-04-19T02:15:28.891879+0000","last_became_peered":"2024-04-19T02:15:28.891879+0000","last_unstale":"2024-04-19T02:20:09.857926+0000","last_undegraded":"2024-04-19T02:20:09.857926+0000","last_fullsized":"2024-04-19T02:20:09.857926+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:10:12.514798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.639094+0000","last_change":"2024-04-19T02:20:10.639094+0000","last_active":"2024-04-19T02:20:10.639094+0000","last_peered":"2024-04-19T02:20:10.639094+0000","last_clean":"2024-04-19T02:20:10.639094+0000","last_became_active":"2024-04-19T02:20:10.638755+0000","last_became_peered":"2024-04-19T02:20:10.638755+0000","last_unstale":"2024-04-19T02:20:10.639094+0000","last_undegraded":"2024-04-19T02:20:10.639094+0000","last_fullsized":"2024-04-19T02:20:10.639094+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:37:46.274811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.858501+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:20:09.858501+0000","last_peered":"2024-04-19T02:20:09.858501+0000","last_clean":"2024-04-19T02:20:09.858501+0000","last_became_active":"2024-04-19T02:15:28.890882+0000","last_became_peered":"2024-04-19T02:15:28.890882+0000","last_unstale":"2024-04-19T02:20:09.858501+0000","last_undegraded":"2024-04-19T02:20:09.858501+0000","last_fullsized":"2024-04-19T02:20:09.858501+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:31.673938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.991948+0000","last_change":"2024-04-19T02:19:54.927209+0000","last_active":"2024-04-19T02:20:08.991948+0000","last_peered":"2024-04-19T02:20:08.991948+0000","last_clean":"2024-04-19T02:20:08.991948+0000","last_became_active":"2024-04-19T02:19:54.925121+0000","last_became_peered":"2024-04-19T02:19:54.925121+0000","last_unstale":"2024-04-19T02:20:08.991948+0000","last_undegraded":"2024-04-19T02:20:08.991948+0000","last_fullsized":"2024-04-19T02:20:08.991948+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:16:21.982909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":81,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993779+0000","last_change":"2024-04-19T02:15:28.890265+0000","last_active":"2024-04-19T02:20:08.993779+0000","last_peered":"2024-04-19T02:20:08.993779+0000","last_clean":"2024-04-19T02:20:08.993779+0000","last_became_active":"2024-04-19T02:15:28.890004+0000","last_became_peered":"2024-04-19T02:15:28.890004+0000","last_unstale":"2024-04-19T02:20:08.993779+0000","last_undegraded":"2024-04-19T02:20:08.993779+0000","last_fullsized":"2024-04-19T02:20:08.993779+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:02.517101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.994900+0000","last_change":"2024-04-19T02:15:29.285529+0000","last_active":"2024-04-19T02:20:08.994900+0000","last_peered":"2024-04-19T02:20:08.994900+0000","last_clean":"2024-04-19T02:20:08.994900+0000","last_became_active":"2024-04-19T02:15:29.285197+0000","last_became_peered":"2024-04-19T02:15:29.285197+0000","last_unstale":"2024-04-19T02:20:08.994900+0000","last_undegraded":"2024-04-19T02:20:08.994900+0000","last_fullsized":"2024-04-19T02:20:08.994900+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":81,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995996+0000","last_change":"2024-04-19T02:15:28.893902+0000","last_active":"2024-04-19T02:20:08.995996+0000","last_peered":"2024-04-19T02:20:08.995996+0000","last_clean":"2024-04-19T02:20:08.995996+0000","last_became_active":"2024-04-19T02:15:28.893231+0000","last_became_peered":"2024-04-19T02:15:28.893231+0000","last_unstale":"2024-04-19T02:20:08.995996+0000","last_undegraded":"2024-04-19T02:20:08.995996+0000","last_fullsized":"2024-04-19T02:20:08.995996+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:23.658442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996319+0000","last_change":"2024-04-19T02:19:54.925840+0000","last_active":"2024-04-19T02:20:08.996319+0000","last_peered":"2024-04-19T02:20:08.996319+0000","last_clean":"2024-04-19T02:20:08.996319+0000","last_became_active":"2024-04-19T02:19:54.925502+0000","last_became_peered":"2024-04-19T02:19:54.925502+0000","last_unstale":"2024-04-19T02:20:08.996319+0000","last_undegraded":"2024-04-19T02:20:08.996319+0000","last_fullsized":"2024-04-19T02:20:08.996319+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:57.667340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":81,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993204+0000","last_change":"2024-04-19T02:15:28.891234+0000","last_active":"2024-04-19T02:20:08.993204+0000","last_peered":"2024-04-19T02:20:08.993204+0000","last_clean":"2024-04-19T02:20:08.993204+0000","last_became_active":"2024-04-19T02:15:28.890881+0000","last_became_peered":"2024-04-19T02:15:28.890881+0000","last_unstale":"2024-04-19T02:20:08.993204+0000","last_undegraded":"2024-04-19T02:20:08.993204+0000","last_fullsized":"2024-04-19T02:20:08.993204+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992289+0000","last_change":"2024-04-19T02:19:54.926103+0000","last_active":"2024-04-19T02:20:08.992289+0000","last_peered":"2024-04-19T02:20:08.992289+0000","last_clean":"2024-04-19T02:20:08.992289+0000","last_became_active":"2024-04-19T02:19:54.925591+0000","last_became_peered":"2024-04-19T02:19:54.925591+0000","last_unstale":"2024-04-19T02:20:08.992289+0000","last_undegraded":"2024-04-19T02:20:08.992289+0000","last_fullsized":"2024-04-19T02:20:08.992289+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:44:40.560973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":93,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992481+0000","last_change":"2024-04-19T02:19:54.926813+0000","last_active":"2024-04-19T02:20:08.992481+0000","last_peered":"2024-04-19T02:20:08.992481+0000","last_clean":"2024-04-19T02:20:08.992481+0000","last_became_active":"2024-04-19T02:19:54.925523+0000","last_became_peered":"2024-04-19T02:19:54.925523+0000","last_unstale":"2024-04-19T02:20:08.992481+0000","last_undegraded":"2024-04-19T02:20:08.992481+0000","last_fullsized":"2024-04-19T02:20:08.992481+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:39:56.887385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.989835+0000","last_change":"2024-04-19T02:19:54.932306+0000","last_active":"2024-04-19T02:20:08.989835+0000","last_peered":"2024-04-19T02:20:08.989835+0000","last_clean":"2024-04-19T02:20:08.989835+0000","last_became_active":"2024-04-19T02:19:54.930843+0000","last_became_peered":"2024-04-19T02:19:54.930843+0000","last_unstale":"2024-04-19T02:20:08.989835+0000","last_undegraded":"2024-04-19T02:20:08.989835+0000","last_fullsized":"2024-04-19T02:20:08.989835+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:24:51.884048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.989655+0000","last_change":"2024-04-19T02:19:54.932708+0000","last_active":"2024-04-19T02:20:08.989655+0000","last_peered":"2024-04-19T02:20:08.989655+0000","last_clean":"2024-04-19T02:20:08.989655+0000","last_became_active":"2024-04-19T02:19:54.931553+0000","last_became_peered":"2024-04-19T02:19:54.931553+0000","last_unstale":"2024-04-19T02:20:08.989655+0000","last_undegraded":"2024-04-19T02:20:08.989655+0000","last_fullsized":"2024-04-19T02:20:08.989655+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:47:07.651618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992596+0000","last_change":"2024-04-19T02:19:54.927009+0000","last_active":"2024-04-19T02:20:08.992596+0000","last_peered":"2024-04-19T02:20:08.992596+0000","last_clean":"2024-04-19T02:20:08.992596+0000","last_became_active":"2024-04-19T02:19:54.925645+0000","last_became_peered":"2024-04-19T02:19:54.925645+0000","last_unstale":"2024-04-19T02:20:08.992596+0000","last_undegraded":"2024-04-19T02:20:08.992596+0000","last_fullsized":"2024-04-19T02:20:08.992596+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:33:45.685463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":93,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992170+0000","last_change":"2024-04-19T02:19:54.923689+0000","last_active":"2024-04-19T02:20:08.992170+0000","last_peered":"2024-04-19T02:20:08.992170+0000","last_clean":"2024-04-19T02:20:08.992170+0000","last_became_active":"2024-04-19T02:19:54.923321+0000","last_became_peered":"2024-04-19T02:19:54.923321+0000","last_unstale":"2024-04-19T02:20:08.992170+0000","last_undegraded":"2024-04-19T02:20:08.992170+0000","last_fullsized":"2024-04-19T02:20:08.992170+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:03:01.578244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993485+0000","last_change":"2024-04-19T02:15:29.285019+0000","last_active":"2024-04-19T02:20:08.993485+0000","last_peered":"2024-04-19T02:20:08.993485+0000","last_clean":"2024-04-19T02:20:08.993485+0000","last_became_active":"2024-04-19T02:15:29.284650+0000","last_became_peered":"2024-04-19T02:15:29.284650+0000","last_unstale":"2024-04-19T02:20:08.993485+0000","last_undegraded":"2024-04-19T02:20:08.993485+0000","last_fullsized":"2024-04-19T02:20:08.993485+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995102+0000","last_change":"2024-04-19T02:20:08.662566+0000","last_active":"2024-04-19T02:20:08.995102+0000","last_peered":"2024-04-19T02:20:08.995102+0000","last_clean":"2024-04-19T02:20:08.995102+0000","last_became_active":"2024-04-19T02:20:08.662277+0000","last_became_peered":"2024-04-19T02:20:08.662277+0000","last_unstale":"2024-04-19T02:20:08.995102+0000","last_undegraded":"2024-04-19T02:20:08.995102+0000","last_fullsized":"2024-04-19T02:20:08.995102+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:36:27.307955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993656+0000","last_change":"2024-04-19T02:15:29.287190+0000","last_active":"2024-04-19T02:20:08.993656+0000","last_peered":"2024-04-19T02:20:08.993656+0000","last_clean":"2024-04-19T02:20:08.993656+0000","last_became_active":"2024-04-19T02:15:29.286606+0000","last_became_peered":"2024-04-19T02:15:29.286606+0000","last_unstale":"2024-04-19T02:20:08.993656+0000","last_undegraded":"2024-04-19T02:20:08.993656+0000","last_fullsized":"2024-04-19T02:20:08.993656+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:28.387062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996306+0000","last_change":"2024-04-19T02:19:54.928493+0000","last_active":"2024-04-19T02:20:08.996306+0000","last_peered":"2024-04-19T02:20:08.996306+0000","last_clean":"2024-04-19T02:20:08.996306+0000","last_became_active":"2024-04-19T02:19:54.928298+0000","last_became_peered":"2024-04-19T02:19:54.928298+0000","last_unstale":"2024-04-19T02:20:08.996306+0000","last_undegraded":"2024-04-19T02:20:08.996306+0000","last_fullsized":"2024-04-19T02:20:08.996306+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:11:54.564261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.990650+0000","last_change":"2024-04-19T02:19:54.930452+0000","last_active":"2024-04-19T02:20:08.990650+0000","last_peered":"2024-04-19T02:20:08.990650+0000","last_clean":"2024-04-19T02:20:08.990650+0000","last_became_active":"2024-04-19T02:19:54.927309+0000","last_became_peered":"2024-04-19T02:19:54.927309+0000","last_unstale":"2024-04-19T02:20:08.990650+0000","last_undegraded":"2024-04-19T02:20:08.990650+0000","last_fullsized":"2024-04-19T02:20:08.990650+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:56:20.174957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.998998+0000","last_change":"2024-04-19T02:20:09.998998+0000","last_active":"2024-04-19T02:20:09.998998+0000","last_peered":"2024-04-19T02:20:09.998998+0000","last_clean":"2024-04-19T02:20:09.998998+0000","last_became_active":"2024-04-19T02:20:09.998776+0000","last_became_peered":"2024-04-19T02:20:09.998776+0000","last_unstale":"2024-04-19T02:20:09.998998+0000","last_undegraded":"2024-04-19T02:20:09.998998+0000","last_fullsized":"2024-04-19T02:20:09.998998+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:02:13.720846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":93,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993371+0000","last_change":"2024-04-19T02:19:54.926207+0000","last_active":"2024-04-19T02:20:08.993371+0000","last_peered":"2024-04-19T02:20:08.993371+0000","last_clean":"2024-04-19T02:20:08.993371+0000","last_became_active":"2024-04-19T02:19:54.925872+0000","last_became_peered":"2024-04-19T02:19:54.925872+0000","last_unstale":"2024-04-19T02:20:08.993371+0000","last_undegraded":"2024-04-19T02:20:08.993371+0000","last_fullsized":"2024-04-19T02:20:08.993371+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:31:46.734042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996171+0000","last_change":"2024-04-19T02:15:29.277922+0000","last_active":"2024-04-19T02:20:08.996171+0000","last_peered":"2024-04-19T02:20:08.996171+0000","last_clean":"2024-04-19T02:20:08.996171+0000","last_became_active":"2024-04-19T02:15:29.276968+0000","last_became_peered":"2024-04-19T02:15:29.276968+0000","last_unstale":"2024-04-19T02:20:08.996171+0000","last_undegraded":"2024-04-19T02:20:08.996171+0000","last_fullsized":"2024-04-19T02:20:08.996171+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":96,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992530+0000","last_change":"2024-04-19T02:19:54.927361+0000","last_active":"2024-04-19T02:20:08.992530+0000","last_peered":"2024-04-19T02:20:08.992530+0000","last_clean":"2024-04-19T02:20:08.992530+0000","last_became_active":"2024-04-19T02:19:54.927033+0000","last_became_peered":"2024-04-19T02:19:54.927033+0000","last_unstale":"2024-04-19T02:20:08.992530+0000","last_undegraded":"2024-04-19T02:20:08.992530+0000","last_fullsized":"2024-04-19T02:20:08.992530+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:07.194915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":93,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992757+0000","last_change":"2024-04-19T02:19:54.932790+0000","last_active":"2024-04-19T02:20:08.992757+0000","last_peered":"2024-04-19T02:20:08.992757+0000","last_clean":"2024-04-19T02:20:08.992757+0000","last_became_active":"2024-04-19T02:19:54.931683+0000","last_became_peered":"2024-04-19T02:19:54.931683+0000","last_unstale":"2024-04-19T02:20:08.992757+0000","last_undegraded":"2024-04-19T02:20:08.992757+0000","last_fullsized":"2024-04-19T02:20:08.992757+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:23:00.124845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.990653+0000","last_change":"2024-04-19T02:19:54.926109+0000","last_active":"2024-04-19T02:20:08.990653+0000","last_peered":"2024-04-19T02:20:08.990653+0000","last_clean":"2024-04-19T02:20:08.990653+0000","last_became_active":"2024-04-19T02:19:54.924686+0000","last_became_peered":"2024-04-19T02:19:54.924686+0000","last_unstale":"2024-04-19T02:20:08.990653+0000","last_undegraded":"2024-04-19T02:20:08.990653+0000","last_fullsized":"2024-04-19T02:20:08.990653+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:20:03.487999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.990873+0000","last_change":"2024-04-19T02:19:54.923465+0000","last_active":"2024-04-19T02:20:08.990873+0000","last_peered":"2024-04-19T02:20:08.990873+0000","last_clean":"2024-04-19T02:20:08.990873+0000","last_became_active":"2024-04-19T02:19:54.923164+0000","last_became_peered":"2024-04-19T02:19:54.923164+0000","last_unstale":"2024-04-19T02:20:08.990873+0000","last_undegraded":"2024-04-19T02:20:08.990873+0000","last_fullsized":"2024-04-19T02:20:08.990873+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:53:29.520848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995333+0000","last_change":"2024-04-19T02:20:08.662301+0000","last_active":"2024-04-19T02:20:08.995333+0000","last_peered":"2024-04-19T02:20:08.995333+0000","last_clean":"2024-04-19T02:20:08.995333+0000","last_became_active":"2024-04-19T02:20:08.661952+0000","last_became_peered":"2024-04-19T02:20:08.661952+0000","last_unstale":"2024-04-19T02:20:08.995333+0000","last_undegraded":"2024-04-19T02:20:08.995333+0000","last_fullsized":"2024-04-19T02:20:08.995333+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:41:21.658836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.991779+0000","last_change":"2024-04-19T02:19:54.930115+0000","last_active":"2024-04-19T02:20:08.991779+0000","last_peered":"2024-04-19T02:20:08.991779+0000","last_clean":"2024-04-19T02:20:08.991779+0000","last_became_active":"2024-04-19T02:19:54.926463+0000","last_became_peered":"2024-04-19T02:19:54.926463+0000","last_unstale":"2024-04-19T02:20:08.991779+0000","last_undegraded":"2024-04-19T02:20:08.991779+0000","last_fullsized":"2024-04-19T02:20:08.991779+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:00.191645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":96,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992852+0000","last_change":"2024-04-19T02:19:54.932929+0000","last_active":"2024-04-19T02:20:08.992852+0000","last_peered":"2024-04-19T02:20:08.992852+0000","last_clean":"2024-04-19T02:20:08.992852+0000","last_became_active":"2024-04-19T02:19:54.932571+0000","last_became_peered":"2024-04-19T02:19:54.932571+0000","last_unstale":"2024-04-19T02:20:08.992852+0000","last_undegraded":"2024-04-19T02:20:08.992852+0000","last_fullsized":"2024-04-19T02:20:08.992852+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:50:08.657036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":279,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993444+0000","last_change":"2024-04-19T02:15:24.533634+0000","last_active":"2024-04-19T02:20:08.993444+0000","last_peered":"2024-04-19T02:20:08.993444+0000","last_clean":"2024-04-19T02:20:08.993444+0000","last_became_active":"2024-04-19T02:15:24.533420+0000","last_became_peered":"2024-04-19T02:15:24.533420+0000","last_unstale":"2024-04-19T02:20:08.993444+0000","last_undegraded":"2024-04-19T02:20:08.993444+0000","last_fullsized":"2024-04-19T02:20:08.993444+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.001770+0000","last_change":"2024-04-19T02:20:10.001770+0000","last_active":"2024-04-19T02:20:10.001770+0000","last_peered":"2024-04-19T02:20:10.001770+0000","last_clean":"2024-04-19T02:20:10.001770+0000","last_became_active":"2024-04-19T02:20:10.001415+0000","last_became_peered":"2024-04-19T02:20:10.001415+0000","last_unstale":"2024-04-19T02:20:10.001770+0000","last_undegraded":"2024-04-19T02:20:10.001770+0000","last_fullsized":"2024-04-19T02:20:10.001770+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:00:30.084474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993420+0000","last_change":"2024-04-19T02:15:29.285015+0000","last_active":"2024-04-19T02:20:08.993420+0000","last_peered":"2024-04-19T02:20:08.993420+0000","last_clean":"2024-04-19T02:20:08.993420+0000","last_became_active":"2024-04-19T02:15:29.284164+0000","last_became_peered":"2024-04-19T02:15:29.284164+0000","last_unstale":"2024-04-19T02:20:08.993420+0000","last_undegraded":"2024-04-19T02:20:08.993420+0000","last_fullsized":"2024-04-19T02:20:08.993420+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:36.987844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":83,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993579+0000","last_change":"2024-04-19T02:15:24.533912+0000","last_active":"2024-04-19T02:20:08.993579+0000","last_peered":"2024-04-19T02:20:08.993579+0000","last_clean":"2024-04-19T02:20:08.993579+0000","last_became_active":"2024-04-19T02:15:24.533580+0000","last_became_peered":"2024-04-19T02:15:24.533580+0000","last_unstale":"2024-04-19T02:20:08.993579+0000","last_undegraded":"2024-04-19T02:20:08.993579+0000","last_fullsized":"2024-04-19T02:20:08.993579+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:45.045477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.639268+0000","last_change":"2024-04-19T02:20:10.639268+0000","last_active":"2024-04-19T02:20:10.639268+0000","last_peered":"2024-04-19T02:20:10.639268+0000","last_clean":"2024-04-19T02:20:10.639268+0000","last_became_active":"2024-04-19T02:20:10.638966+0000","last_became_peered":"2024-04-19T02:20:10.638966+0000","last_unstale":"2024-04-19T02:20:10.639268+0000","last_undegraded":"2024-04-19T02:20:10.639268+0000","last_fullsized":"2024-04-19T02:20:10.639268+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:38.164641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":49,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996215+0000","last_change":"2024-04-19T02:20:07.986363+0000","last_active":"2024-04-19T02:20:08.996215+0000","last_peered":"2024-04-19T02:20:08.996215+0000","last_clean":"2024-04-19T02:20:08.996215+0000","last_became_active":"2024-04-19T02:20:07.986110+0000","last_became_peered":"2024-04-19T02:20:07.986110+0000","last_unstale":"2024-04-19T02:20:08.996215+0000","last_undegraded":"2024-04-19T02:20:08.996215+0000","last_fullsized":"2024-04-19T02:20:08.996215+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:12.545910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":60,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996406+0000","last_change":"2024-04-19T02:19:54.925886+0000","last_active":"2024-04-19T02:20:08.996406+0000","last_peered":"2024-04-19T02:20:08.996406+0000","last_clean":"2024-04-19T02:20:08.996406+0000","last_became_active":"2024-04-19T02:19:54.925570+0000","last_became_peered":"2024-04-19T02:19:54.925570+0000","last_unstale":"2024-04-19T02:20:08.996406+0000","last_undegraded":"2024-04-19T02:20:08.996406+0000","last_fullsized":"2024-04-19T02:20:08.996406+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:33:34.594161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.990045+0000","last_change":"2024-04-19T02:19:54.933960+0000","last_active":"2024-04-19T02:20:08.990045+0000","last_peered":"2024-04-19T02:20:08.990045+0000","last_clean":"2024-04-19T02:20:08.990045+0000","last_became_active":"2024-04-19T02:19:54.929918+0000","last_became_peered":"2024-04-19T02:19:54.929918+0000","last_unstale":"2024-04-19T02:20:08.990045+0000","last_undegraded":"2024-04-19T02:20:08.990045+0000","last_fullsized":"2024-04-19T02:20:08.990045+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:33:10.282684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995346+0000","last_change":"2024-04-19T02:15:29.281694+0000","last_active":"2024-04-19T02:20:08.995346+0000","last_peered":"2024-04-19T02:20:08.995346+0000","last_clean":"2024-04-19T02:20:08.995346+0000","last_became_active":"2024-04-19T02:15:29.280519+0000","last_became_peered":"2024-04-19T02:15:29.280519+0000","last_unstale":"2024-04-19T02:20:08.995346+0000","last_undegraded":"2024-04-19T02:20:08.995346+0000","last_fullsized":"2024-04-19T02:20:08.995346+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:50.890545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.990434+0000","last_change":"2024-04-19T02:19:54.931726+0000","last_active":"2024-04-19T02:20:08.990434+0000","last_peered":"2024-04-19T02:20:08.990434+0000","last_clean":"2024-04-19T02:20:08.990434+0000","last_became_active":"2024-04-19T02:19:54.928460+0000","last_became_peered":"2024-04-19T02:19:54.928460+0000","last_unstale":"2024-04-19T02:20:08.990434+0000","last_undegraded":"2024-04-19T02:20:08.990434+0000","last_fullsized":"2024-04-19T02:20:08.990434+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:07:04.935620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.998879+0000","last_change":"2024-04-19T02:20:09.998879+0000","last_active":"2024-04-19T02:20:09.998879+0000","last_peered":"2024-04-19T02:20:09.998879+0000","last_clean":"2024-04-19T02:20:09.998879+0000","last_became_active":"2024-04-19T02:20:09.998629+0000","last_became_peered":"2024-04-19T02:20:09.998629+0000","last_unstale":"2024-04-19T02:20:09.998879+0000","last_undegraded":"2024-04-19T02:20:09.998879+0000","last_fullsized":"2024-04-19T02:20:09.998879+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:38:00.584717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.639272+0000","last_change":"2024-04-19T02:20:10.639272+0000","last_active":"2024-04-19T02:20:10.639272+0000","last_peered":"2024-04-19T02:20:10.639272+0000","last_clean":"2024-04-19T02:20:10.639272+0000","last_became_active":"2024-04-19T02:20:10.638912+0000","last_became_peered":"2024-04-19T02:20:10.638912+0000","last_unstale":"2024-04-19T02:20:10.639272+0000","last_undegraded":"2024-04-19T02:20:10.639272+0000","last_fullsized":"2024-04-19T02:20:10.639272+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:19.396777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":83,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993846+0000","last_change":"2024-04-19T02:15:24.533777+0000","last_active":"2024-04-19T02:20:08.993846+0000","last_peered":"2024-04-19T02:20:08.993846+0000","last_clean":"2024-04-19T02:20:08.993846+0000","last_became_active":"2024-04-19T02:15:24.533436+0000","last_became_peered":"2024-04-19T02:15:24.533436+0000","last_unstale":"2024-04-19T02:20:08.993846+0000","last_undegraded":"2024-04-19T02:20:08.993846+0000","last_fullsized":"2024-04-19T02:20:08.993846+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:53:25.922418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.990547+0000","last_change":"2024-04-19T02:19:54.933278+0000","last_active":"2024-04-19T02:20:08.990547+0000","last_peered":"2024-04-19T02:20:08.990547+0000","last_clean":"2024-04-19T02:20:08.990547+0000","last_became_active":"2024-04-19T02:19:54.931328+0000","last_became_peered":"2024-04-19T02:19:54.931328+0000","last_unstale":"2024-04-19T02:20:08.990547+0000","last_undegraded":"2024-04-19T02:20:08.990547+0000","last_fullsized":"2024-04-19T02:20:08.990547+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:08:38.731741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996195+0000","last_change":"2024-04-19T02:15:29.282244+0000","last_active":"2024-04-19T02:20:08.996195+0000","last_peered":"2024-04-19T02:20:08.996195+0000","last_clean":"2024-04-19T02:20:08.996195+0000","last_became_active":"2024-04-19T02:15:29.280366+0000","last_became_peered":"2024-04-19T02:15:29.280366+0000","last_unstale":"2024-04-19T02:20:08.996195+0000","last_undegraded":"2024-04-19T02:20:08.996195+0000","last_fullsized":"2024-04-19T02:20:08.996195+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995650+0000","last_change":"2024-04-19T02:15:28.893027+0000","last_active":"2024-04-19T02:20:08.995650+0000","last_peered":"2024-04-19T02:20:08.995650+0000","last_clean":"2024-04-19T02:20:08.995650+0000","last_became_active":"2024-04-19T02:15:28.892695+0000","last_became_peered":"2024-04-19T02:15:28.892695+0000","last_unstale":"2024-04-19T02:20:08.995650+0000","last_undegraded":"2024-04-19T02:20:08.995650+0000","last_fullsized":"2024-04-19T02:20:08.995650+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996179+0000","last_change":"2024-04-19T02:19:54.929648+0000","last_active":"2024-04-19T02:20:08.996179+0000","last_peered":"2024-04-19T02:20:08.996179+0000","last_clean":"2024-04-19T02:20:08.996179+0000","last_became_active":"2024-04-19T02:19:54.929412+0000","last_became_peered":"2024-04-19T02:19:54.929412+0000","last_unstale":"2024-04-19T02:20:08.996179+0000","last_undegraded":"2024-04-19T02:20:08.996179+0000","last_fullsized":"2024-04-19T02:20:08.996179+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:28:21.688550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":94,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992761+0000","last_change":"2024-04-19T02:19:54.927315+0000","last_active":"2024-04-19T02:20:08.992761+0000","last_peered":"2024-04-19T02:20:08.992761+0000","last_clean":"2024-04-19T02:20:08.992761+0000","last_became_active":"2024-04-19T02:19:54.926630+0000","last_became_peered":"2024-04-19T02:19:54.926630+0000","last_unstale":"2024-04-19T02:20:08.992761+0000","last_undegraded":"2024-04-19T02:20:08.992761+0000","last_fullsized":"2024-04-19T02:20:08.992761+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:39:00.822558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992698+0000","last_change":"2024-04-19T02:19:54.931920+0000","last_active":"2024-04-19T02:20:08.992698+0000","last_peered":"2024-04-19T02:20:08.992698+0000","last_clean":"2024-04-19T02:20:08.992698+0000","last_became_active":"2024-04-19T02:19:54.931328+0000","last_became_peered":"2024-04-19T02:19:54.931328+0000","last_unstale":"2024-04-19T02:20:08.992698+0000","last_undegraded":"2024-04-19T02:20:08.992698+0000","last_fullsized":"2024-04-19T02:20:08.992698+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:39.655376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":80,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996399+0000","last_change":"2024-04-19T02:15:28.893239+0000","last_active":"2024-04-19T02:20:08.996399+0000","last_peered":"2024-04-19T02:20:08.996399+0000","last_clean":"2024-04-19T02:20:08.996399+0000","last_became_active":"2024-04-19T02:15:28.892881+0000","last_became_peered":"2024-04-19T02:15:28.892881+0000","last_unstale":"2024-04-19T02:20:08.996399+0000","last_undegraded":"2024-04-19T02:20:08.996399+0000","last_fullsized":"2024-04-19T02:20:08.996399+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992227+0000","last_change":"2024-04-19T02:19:54.924029+0000","last_active":"2024-04-19T02:20:08.992227+0000","last_peered":"2024-04-19T02:20:08.992227+0000","last_clean":"2024-04-19T02:20:08.992227+0000","last_became_active":"2024-04-19T02:19:54.923752+0000","last_became_peered":"2024-04-19T02:19:54.923752+0000","last_unstale":"2024-04-19T02:20:08.992227+0000","last_undegraded":"2024-04-19T02:20:08.992227+0000","last_fullsized":"2024-04-19T02:20:08.992227+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:26:41.825722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.990448+0000","last_change":"2024-04-19T02:19:54.933652+0000","last_active":"2024-04-19T02:20:08.990448+0000","last_peered":"2024-04-19T02:20:08.990448+0000","last_clean":"2024-04-19T02:20:08.990448+0000","last_became_active":"2024-04-19T02:19:54.932103+0000","last_became_peered":"2024-04-19T02:19:54.932103+0000","last_unstale":"2024-04-19T02:20:08.990448+0000","last_undegraded":"2024-04-19T02:20:08.990448+0000","last_fullsized":"2024-04-19T02:20:08.990448+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:46:14.540427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996400+0000","last_change":"2024-04-19T02:19:54.925832+0000","last_active":"2024-04-19T02:20:08.996400+0000","last_peered":"2024-04-19T02:20:08.996400+0000","last_clean":"2024-04-19T02:20:08.996400+0000","last_became_active":"2024-04-19T02:19:54.925565+0000","last_became_peered":"2024-04-19T02:19:54.925565+0000","last_unstale":"2024-04-19T02:20:08.996400+0000","last_undegraded":"2024-04-19T02:20:08.996400+0000","last_fullsized":"2024-04-19T02:20:08.996400+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:28:13.380027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.990549+0000","last_change":"2024-04-19T02:19:54.929083+0000","last_active":"2024-04-19T02:20:08.990549+0000","last_peered":"2024-04-19T02:20:08.990549+0000","last_clean":"2024-04-19T02:20:08.990549+0000","last_became_active":"2024-04-19T02:19:54.926439+0000","last_became_peered":"2024-04-19T02:19:54.926439+0000","last_unstale":"2024-04-19T02:20:08.990549+0000","last_undegraded":"2024-04-19T02:20:08.990549+0000","last_fullsized":"2024-04-19T02:20:08.990549+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:15:04.675082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993698+0000","last_change":"2024-04-19T02:19:54.931258+0000","last_active":"2024-04-19T02:20:08.993698+0000","last_peered":"2024-04-19T02:20:08.993698+0000","last_clean":"2024-04-19T02:20:08.993698+0000","last_became_active":"2024-04-19T02:19:54.930665+0000","last_became_peered":"2024-04-19T02:19:54.930665+0000","last_unstale":"2024-04-19T02:20:08.993698+0000","last_undegraded":"2024-04-19T02:20:08.993698+0000","last_fullsized":"2024-04-19T02:20:08.993698+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:57:08.681822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993591+0000","last_change":"2024-04-19T02:19:54.931055+0000","last_active":"2024-04-19T02:20:08.993591+0000","last_peered":"2024-04-19T02:20:08.993591+0000","last_clean":"2024-04-19T02:20:08.993591+0000","last_became_active":"2024-04-19T02:19:54.930527+0000","last_became_peered":"2024-04-19T02:19:54.930527+0000","last_unstale":"2024-04-19T02:20:08.993591+0000","last_undegraded":"2024-04-19T02:20:08.993591+0000","last_fullsized":"2024-04-19T02:20:08.993591+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:05:38.717309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.001589+0000","last_change":"2024-04-19T02:20:10.001589+0000","last_active":"2024-04-19T02:20:10.001589+0000","last_peered":"2024-04-19T02:20:10.001589+0000","last_clean":"2024-04-19T02:20:10.001589+0000","last_became_active":"2024-04-19T02:20:10.001304+0000","last_became_peered":"2024-04-19T02:20:10.001304+0000","last_unstale":"2024-04-19T02:20:10.001589+0000","last_undegraded":"2024-04-19T02:20:10.001589+0000","last_fullsized":"2024-04-19T02:20:10.001589+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:36.432257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996078+0000","last_change":"2024-04-19T02:20:08.662331+0000","last_active":"2024-04-19T02:20:08.996078+0000","last_peered":"2024-04-19T02:20:08.996078+0000","last_clean":"2024-04-19T02:20:08.996078+0000","last_became_active":"2024-04-19T02:20:08.661996+0000","last_became_peered":"2024-04-19T02:20:08.661996+0000","last_unstale":"2024-04-19T02:20:08.996078+0000","last_undegraded":"2024-04-19T02:20:08.996078+0000","last_fullsized":"2024-04-19T02:20:08.996078+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:25:03.894231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.001706+0000","last_change":"2024-04-19T02:20:10.001706+0000","last_active":"2024-04-19T02:20:10.001706+0000","last_peered":"2024-04-19T02:20:10.001706+0000","last_clean":"2024-04-19T02:20:10.001706+0000","last_became_active":"2024-04-19T02:20:10.001372+0000","last_became_peered":"2024-04-19T02:20:10.001372+0000","last_unstale":"2024-04-19T02:20:10.001706+0000","last_undegraded":"2024-04-19T02:20:10.001706+0000","last_fullsized":"2024-04-19T02:20:10.001706+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:54:55.702629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996258+0000","last_change":"2024-04-19T02:15:29.277568+0000","last_active":"2024-04-19T02:20:08.996258+0000","last_peered":"2024-04-19T02:20:08.996258+0000","last_clean":"2024-04-19T02:20:08.996258+0000","last_became_active":"2024-04-19T02:15:29.276725+0000","last_became_peered":"2024-04-19T02:15:29.276725+0000","last_unstale":"2024-04-19T02:20:08.996258+0000","last_undegraded":"2024-04-19T02:20:08.996258+0000","last_fullsized":"2024-04-19T02:20:08.996258+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5254,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":72,"seq":309237645318,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58816,"kb_used_data":884,"kb_used_omap":6,"kb_used_meta":57913,"kb_avail":94313024,"statfs":{"total":96636764160,"available":96576536576,"internally_reserved":0,"allocated":905216,"data_stored":358135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6848,"internal_metadata":59303232},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738430,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":275424,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":273918,"kb_avail":94096416,"statfs":{"total":96636764160,"available":96354729984,"internally_reserved":0,"allocated":1519616,"data_stored":948136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":280492486},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 02:19:26 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.371,"15min":0.316},"min":{"1min":0.29899999999999999,"5min":0.159,"15min":0.159},"max":{"1min":0.57499999999999996,"5min":4.4480000000000004,"15min":4.4480000000000004},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.379,"15min":0.36599999999999999},"min":{"1min":0.29399999999999998,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.54800000000000004,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.40200000000000002}]},{"osd":2,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":2.1000000000000001,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.36099999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738429,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307416,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":305918,"kb_avail":94064424,"statfs":{"total":96636764160,"available":96321970176,"internally_reserved":0,"allocated":1515520,"data_stored":949633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":313260486},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:19:29 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.40600000000000003,"15min":0.376},"min":{"1min":0.32700000000000001,"5min":0.157,"15min":0.157},"max":{"1min":0.64900000000000002,"5min":1.794,"15min":1.794},"last":0.496},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.38100000000000001,"15min":0.32400000000000001},"min":{"1min":0.37,"5min":0.16,"15min":0.16},"max":{"1min":0.63,"5min":2.411,"15min":2.411},"last":0.53400000000000003}]},{"osd":2,"last update":"Fri Apr 19 02:16:26 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.60599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5254,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:20:17.382 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:20:17.741 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:20:17.743 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-04-19T02:20:17.753 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":225,"stamp":"2024-04-19T02:20:16.812850+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":641656,"kb_used_data":3848,"kb_used_omap":9,"kb_used_meta":637750,"kb_avail":282473864,"statfs":{"total":289910292480,"available":289253236736,"internally_reserved":0,"allocated":3940352,"data_stored":2255904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10036,"internal_metadata":653056204},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001507"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996815+0000","last_change":"2024-04-19T02:19:54.929643+0000","last_active":"2024-04-19T02:20:08.996815+0000","last_peered":"2024-04-19T02:20:08.996815+0000","last_clean":"2024-04-19T02:20:08.996815+0000","last_became_active":"2024-04-19T02:19:54.929435+0000","last_became_peered":"2024-04-19T02:19:54.929435+0000","last_unstale":"2024-04-19T02:20:08.996815+0000","last_undegraded":"2024-04-19T02:20:08.996815+0000","last_fullsized":"2024-04-19T02:20:08.996815+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:44:05.807254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995814+0000","last_change":"2024-04-19T02:19:54.931532+0000","last_active":"2024-04-19T02:20:08.995814+0000","last_peered":"2024-04-19T02:20:08.995814+0000","last_clean":"2024-04-19T02:20:08.995814+0000","last_became_active":"2024-04-19T02:19:54.931278+0000","last_became_peered":"2024-04-19T02:19:54.931278+0000","last_unstale":"2024-04-19T02:20:08.995814+0000","last_undegraded":"2024-04-19T02:20:08.995814+0000","last_fullsized":"2024-04-19T02:20:08.995814+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:20:02.024046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993263+0000","last_change":"2024-04-19T02:15:29.286709+0000","last_active":"2024-04-19T02:20:08.993263+0000","last_peered":"2024-04-19T02:20:08.993263+0000","last_clean":"2024-04-19T02:20:08.993263+0000","last_became_active":"2024-04-19T02:15:29.286169+0000","last_became_peered":"2024-04-19T02:15:29.286169+0000","last_unstale":"2024-04-19T02:20:08.993263+0000","last_undegraded":"2024-04-19T02:20:08.993263+0000","last_fullsized":"2024-04-19T02:20:08.993263+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:58.741466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993036+0000","last_change":"2024-04-19T02:19:54.927063+0000","last_active":"2024-04-19T02:20:08.993036+0000","last_peered":"2024-04-19T02:20:08.993036+0000","last_clean":"2024-04-19T02:20:08.993036+0000","last_became_active":"2024-04-19T02:19:54.926046+0000","last_became_peered":"2024-04-19T02:19:54.926046+0000","last_unstale":"2024-04-19T02:20:08.993036+0000","last_undegraded":"2024-04-19T02:20:08.993036+0000","last_fullsized":"2024-04-19T02:20:08.993036+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:52:59.151542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":55,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995211+0000","last_change":"2024-04-19T02:19:54.931669+0000","last_active":"2024-04-19T02:20:08.995211+0000","last_peered":"2024-04-19T02:20:08.995211+0000","last_clean":"2024-04-19T02:20:08.995211+0000","last_became_active":"2024-04-19T02:19:54.931435+0000","last_became_peered":"2024-04-19T02:19:54.931435+0000","last_unstale":"2024-04-19T02:20:08.995211+0000","last_undegraded":"2024-04-19T02:20:08.995211+0000","last_fullsized":"2024-04-19T02:20:08.995211+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:42:58.222802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992140+0000","last_change":"2024-04-19T02:19:54.924250+0000","last_active":"2024-04-19T02:20:08.992140+0000","last_peered":"2024-04-19T02:20:08.992140+0000","last_clean":"2024-04-19T02:20:08.992140+0000","last_became_active":"2024-04-19T02:19:54.923984+0000","last_became_peered":"2024-04-19T02:19:54.923984+0000","last_unstale":"2024-04-19T02:20:08.992140+0000","last_undegraded":"2024-04-19T02:20:08.992140+0000","last_fullsized":"2024-04-19T02:20:08.992140+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:56:51.290239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992724+0000","last_change":"2024-04-19T02:19:54.926647+0000","last_active":"2024-04-19T02:20:08.992724+0000","last_peered":"2024-04-19T02:20:08.992724+0000","last_clean":"2024-04-19T02:20:08.992724+0000","last_became_active":"2024-04-19T02:19:54.925529+0000","last_became_peered":"2024-04-19T02:19:54.925529+0000","last_unstale":"2024-04-19T02:20:08.992724+0000","last_undegraded":"2024-04-19T02:20:08.992724+0000","last_fullsized":"2024-04-19T02:20:08.992724+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:49:06.911557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993273+0000","last_change":"2024-04-19T02:19:54.930828+0000","last_active":"2024-04-19T02:20:08.993273+0000","last_peered":"2024-04-19T02:20:08.993273+0000","last_clean":"2024-04-19T02:20:08.993273+0000","last_became_active":"2024-04-19T02:19:54.930075+0000","last_became_peered":"2024-04-19T02:19:54.930075+0000","last_unstale":"2024-04-19T02:20:08.993273+0000","last_undegraded":"2024-04-19T02:20:08.993273+0000","last_fullsized":"2024-04-19T02:20:08.993273+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:00.512431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.991008+0000","last_change":"2024-04-19T02:19:54.931617+0000","last_active":"2024-04-19T02:20:08.991008+0000","last_peered":"2024-04-19T02:20:08.991008+0000","last_clean":"2024-04-19T02:20:08.991008+0000","last_became_active":"2024-04-19T02:19:54.928496+0000","last_became_peered":"2024-04-19T02:19:54.928496+0000","last_unstale":"2024-04-19T02:20:08.991008+0000","last_undegraded":"2024-04-19T02:20:08.991008+0000","last_fullsized":"2024-04-19T02:20:08.991008+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:56:50.232031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":60,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993489+0000","last_change":"2024-04-19T02:16:30.093524+0000","last_active":"2024-04-19T02:20:08.993489+0000","last_peered":"2024-04-19T02:20:08.993489+0000","last_clean":"2024-04-19T02:20:08.993489+0000","last_became_active":"2024-04-19T02:16:30.093344+0000","last_became_peered":"2024-04-19T02:16:30.093344+0000","last_unstale":"2024-04-19T02:20:08.993489+0000","last_undegraded":"2024-04-19T02:20:08.993489+0000","last_fullsized":"2024-04-19T02:20:08.993489+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:14:40.293159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993069+0000","last_change":"2024-04-19T02:19:54.926754+0000","last_active":"2024-04-19T02:20:08.993069+0000","last_peered":"2024-04-19T02:20:08.993069+0000","last_clean":"2024-04-19T02:20:08.993069+0000","last_became_active":"2024-04-19T02:19:54.926040+0000","last_became_peered":"2024-04-19T02:19:54.926040+0000","last_unstale":"2024-04-19T02:20:08.993069+0000","last_undegraded":"2024-04-19T02:20:08.993069+0000","last_fullsized":"2024-04-19T02:20:08.993069+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:36:16.313500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995212+0000","last_change":"2024-04-19T02:20:08.662601+0000","last_active":"2024-04-19T02:20:08.995212+0000","last_peered":"2024-04-19T02:20:08.995212+0000","last_clean":"2024-04-19T02:20:08.995212+0000","last_became_active":"2024-04-19T02:20:08.662234+0000","last_became_peered":"2024-04-19T02:20:08.662234+0000","last_unstale":"2024-04-19T02:20:08.995212+0000","last_undegraded":"2024-04-19T02:20:08.995212+0000","last_fullsized":"2024-04-19T02:20:08.995212+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:34:06.694985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":55,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995768+0000","last_change":"2024-04-19T02:19:54.932576+0000","last_active":"2024-04-19T02:20:08.995768+0000","last_peered":"2024-04-19T02:20:08.995768+0000","last_clean":"2024-04-19T02:20:08.995768+0000","last_became_active":"2024-04-19T02:19:54.932240+0000","last_became_peered":"2024-04-19T02:19:54.932240+0000","last_unstale":"2024-04-19T02:20:08.995768+0000","last_undegraded":"2024-04-19T02:20:08.995768+0000","last_fullsized":"2024-04-19T02:20:08.995768+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:10:10.453676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":79,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637354+0000","last_change":"2024-04-19T02:15:29.284262+0000","last_active":"2024-04-19T02:20:10.637354+0000","last_peered":"2024-04-19T02:20:10.637354+0000","last_clean":"2024-04-19T02:20:10.637354+0000","last_became_active":"2024-04-19T02:15:29.283121+0000","last_became_peered":"2024-04-19T02:15:29.283121+0000","last_unstale":"2024-04-19T02:20:10.637354+0000","last_undegraded":"2024-04-19T02:20:10.637354+0000","last_fullsized":"2024-04-19T02:20:10.637354+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":79,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637524+0000","last_change":"2024-04-19T02:15:29.285139+0000","last_active":"2024-04-19T02:20:10.637524+0000","last_peered":"2024-04-19T02:20:10.637524+0000","last_clean":"2024-04-19T02:20:10.637524+0000","last_became_active":"2024-04-19T02:15:29.284649+0000","last_became_peered":"2024-04-19T02:15:29.284649+0000","last_unstale":"2024-04-19T02:20:10.637524+0000","last_undegraded":"2024-04-19T02:20:10.637524+0000","last_fullsized":"2024-04-19T02:20:10.637524+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637088+0000","last_change":"2024-04-19T02:19:54.931033+0000","last_active":"2024-04-19T02:20:10.637088+0000","last_peered":"2024-04-19T02:20:10.637088+0000","last_clean":"2024-04-19T02:20:10.637088+0000","last_became_active":"2024-04-19T02:19:54.930437+0000","last_became_peered":"2024-04-19T02:19:54.930437+0000","last_unstale":"2024-04-19T02:20:10.637088+0000","last_undegraded":"2024-04-19T02:20:10.637088+0000","last_fullsized":"2024-04-19T02:20:10.637088+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:44:05.807254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.001650+0000","last_change":"2024-04-19T02:20:10.001650+0000","last_active":"2024-04-19T02:20:10.001650+0000","last_peered":"2024-04-19T02:20:10.001650+0000","last_clean":"2024-04-19T02:20:10.001650+0000","last_became_active":"2024-04-19T02:20:10.001343+0000","last_became_peered":"2024-04-19T02:20:10.001343+0000","last_unstale":"2024-04-19T02:20:10.001650+0000","last_undegraded":"2024-04-19T02:20:10.001650+0000","last_fullsized":"2024-04-19T02:20:10.001650+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:15:54.452503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.858101+0000","last_change":"2024-04-19T02:19:54.933452+0000","last_active":"2024-04-19T02:20:09.858101+0000","last_peered":"2024-04-19T02:20:09.858101+0000","last_clean":"2024-04-19T02:20:09.858101+0000","last_became_active":"2024-04-19T02:19:54.933233+0000","last_became_peered":"2024-04-19T02:19:54.933233+0000","last_unstale":"2024-04-19T02:20:09.858101+0000","last_undegraded":"2024-04-19T02:20:09.858101+0000","last_fullsized":"2024-04-19T02:20:09.858101+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:50.712874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.990125+0000","last_change":"2024-04-19T02:19:54.925745+0000","last_active":"2024-04-19T02:20:08.990125+0000","last_peered":"2024-04-19T02:20:08.990125+0000","last_clean":"2024-04-19T02:20:08.990125+0000","last_became_active":"2024-04-19T02:19:54.925060+0000","last_became_peered":"2024-04-19T02:19:54.925060+0000","last_unstale":"2024-04-19T02:20:08.990125+0000","last_undegraded":"2024-04-19T02:20:08.990125+0000","last_fullsized":"2024-04-19T02:20:08.990125+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:12:43.617806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992995+0000","last_change":"2024-04-19T02:19:54.927206+0000","last_active":"2024-04-19T02:20:08.992995+0000","last_peered":"2024-04-19T02:20:08.992995+0000","last_clean":"2024-04-19T02:20:08.992995+0000","last_became_active":"2024-04-19T02:19:54.926442+0000","last_became_peered":"2024-04-19T02:19:54.926442+0000","last_unstale":"2024-04-19T02:20:08.992995+0000","last_undegraded":"2024-04-19T02:20:08.992995+0000","last_fullsized":"2024-04-19T02:20:08.992995+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:27:17.095030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992632+0000","last_change":"2024-04-19T02:19:54.932532+0000","last_active":"2024-04-19T02:20:08.992632+0000","last_peered":"2024-04-19T02:20:08.992632+0000","last_clean":"2024-04-19T02:20:08.992632+0000","last_became_active":"2024-04-19T02:19:54.931438+0000","last_became_peered":"2024-04-19T02:19:54.931438+0000","last_unstale":"2024-04-19T02:20:08.992632+0000","last_undegraded":"2024-04-19T02:20:08.992632+0000","last_fullsized":"2024-04-19T02:20:08.992632+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:12:54.241778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995945+0000","last_change":"2024-04-19T02:20:08.662261+0000","last_active":"2024-04-19T02:20:08.995945+0000","last_peered":"2024-04-19T02:20:08.995945+0000","last_clean":"2024-04-19T02:20:08.995945+0000","last_became_active":"2024-04-19T02:20:08.661940+0000","last_became_peered":"2024-04-19T02:20:08.661940+0000","last_unstale":"2024-04-19T02:20:08.995945+0000","last_undegraded":"2024-04-19T02:20:08.995945+0000","last_fullsized":"2024-04-19T02:20:08.995945+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:49:34.835266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.639368+0000","last_change":"2024-04-19T02:20:10.639368+0000","last_active":"2024-04-19T02:20:10.639368+0000","last_peered":"2024-04-19T02:20:10.639368+0000","last_clean":"2024-04-19T02:20:10.639368+0000","last_became_active":"2024-04-19T02:20:10.639036+0000","last_became_peered":"2024-04-19T02:20:10.639036+0000","last_unstale":"2024-04-19T02:20:10.639368+0000","last_undegraded":"2024-04-19T02:20:10.639368+0000","last_fullsized":"2024-04-19T02:20:10.639368+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:36:45.316530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996035+0000","last_change":"2024-04-19T02:19:54.928467+0000","last_active":"2024-04-19T02:20:08.996035+0000","last_peered":"2024-04-19T02:20:08.996035+0000","last_clean":"2024-04-19T02:20:08.996035+0000","last_became_active":"2024-04-19T02:19:54.928261+0000","last_became_peered":"2024-04-19T02:19:54.928261+0000","last_unstale":"2024-04-19T02:20:08.996035+0000","last_undegraded":"2024-04-19T02:20:08.996035+0000","last_fullsized":"2024-04-19T02:20:08.996035+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:40:43.645134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996795+0000","last_change":"2024-04-19T02:15:29.278084+0000","last_active":"2024-04-19T02:20:08.996795+0000","last_peered":"2024-04-19T02:20:08.996795+0000","last_clean":"2024-04-19T02:20:08.996795+0000","last_became_active":"2024-04-19T02:15:29.276952+0000","last_became_peered":"2024-04-19T02:15:29.276952+0000","last_unstale":"2024-04-19T02:20:08.996795+0000","last_undegraded":"2024-04-19T02:20:08.996795+0000","last_fullsized":"2024-04-19T02:20:08.996795+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.991888+0000","last_change":"2024-04-19T02:19:54.933154+0000","last_active":"2024-04-19T02:20:08.991888+0000","last_peered":"2024-04-19T02:20:08.991888+0000","last_clean":"2024-04-19T02:20:08.991888+0000","last_became_active":"2024-04-19T02:19:54.931124+0000","last_became_peered":"2024-04-19T02:19:54.931124+0000","last_unstale":"2024-04-19T02:20:08.991888+0000","last_undegraded":"2024-04-19T02:20:08.991888+0000","last_fullsized":"2024-04-19T02:20:08.991888+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:49.555501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993130+0000","last_change":"2024-04-19T02:15:29.287389+0000","last_active":"2024-04-19T02:20:08.993130+0000","last_peered":"2024-04-19T02:20:08.993130+0000","last_clean":"2024-04-19T02:20:08.993130+0000","last_became_active":"2024-04-19T02:15:29.286431+0000","last_became_peered":"2024-04-19T02:15:29.286431+0000","last_unstale":"2024-04-19T02:20:08.993130+0000","last_undegraded":"2024-04-19T02:20:08.993130+0000","last_fullsized":"2024-04-19T02:20:08.993130+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:58:30.117887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":57,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995777+0000","last_change":"2024-04-19T02:19:54.927108+0000","last_active":"2024-04-19T02:20:08.995777+0000","last_peered":"2024-04-19T02:20:08.995777+0000","last_clean":"2024-04-19T02:20:08.995777+0000","last_became_active":"2024-04-19T02:19:54.926838+0000","last_became_peered":"2024-04-19T02:19:54.926838+0000","last_unstale":"2024-04-19T02:20:08.995777+0000","last_undegraded":"2024-04-19T02:20:08.995777+0000","last_fullsized":"2024-04-19T02:20:08.995777+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:25:27.561607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":77,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996790+0000","last_change":"2024-04-19T02:15:29.281792+0000","last_active":"2024-04-19T02:20:08.996790+0000","last_peered":"2024-04-19T02:20:08.996790+0000","last_clean":"2024-04-19T02:20:08.996790+0000","last_became_active":"2024-04-19T02:15:29.280479+0000","last_became_peered":"2024-04-19T02:15:29.280479+0000","last_unstale":"2024-04-19T02:20:08.996790+0000","last_undegraded":"2024-04-19T02:20:08.996790+0000","last_fullsized":"2024-04-19T02:20:08.996790+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.989269+0000","last_change":"2024-04-19T02:19:54.925277+0000","last_active":"2024-04-19T02:20:08.989269+0000","last_peered":"2024-04-19T02:20:08.989269+0000","last_clean":"2024-04-19T02:20:08.989269+0000","last_became_active":"2024-04-19T02:19:54.924484+0000","last_became_peered":"2024-04-19T02:19:54.924484+0000","last_unstale":"2024-04-19T02:20:08.989269+0000","last_undegraded":"2024-04-19T02:20:08.989269+0000","last_fullsized":"2024-04-19T02:20:08.989269+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:57:54.845371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.639077+0000","last_change":"2024-04-19T02:20:10.639077+0000","last_active":"2024-04-19T02:20:10.639077+0000","last_peered":"2024-04-19T02:20:10.639077+0000","last_clean":"2024-04-19T02:20:10.639077+0000","last_became_active":"2024-04-19T02:20:10.638737+0000","last_became_peered":"2024-04-19T02:20:10.638737+0000","last_unstale":"2024-04-19T02:20:10.639077+0000","last_undegraded":"2024-04-19T02:20:10.639077+0000","last_fullsized":"2024-04-19T02:20:10.639077+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:20:05.200768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.989517+0000","last_change":"2024-04-19T02:19:54.930346+0000","last_active":"2024-04-19T02:20:08.989517+0000","last_peered":"2024-04-19T02:20:08.989517+0000","last_clean":"2024-04-19T02:20:08.989517+0000","last_became_active":"2024-04-19T02:19:54.928398+0000","last_became_peered":"2024-04-19T02:19:54.928398+0000","last_unstale":"2024-04-19T02:20:08.989517+0000","last_undegraded":"2024-04-19T02:20:08.989517+0000","last_fullsized":"2024-04-19T02:20:08.989517+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:46.321275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996446+0000","last_change":"2024-04-19T02:15:29.280879+0000","last_active":"2024-04-19T02:20:08.996446+0000","last_peered":"2024-04-19T02:20:08.996446+0000","last_clean":"2024-04-19T02:20:08.996446+0000","last_became_active":"2024-04-19T02:15:29.279314+0000","last_became_peered":"2024-04-19T02:15:29.279314+0000","last_unstale":"2024-04-19T02:20:08.996446+0000","last_undegraded":"2024-04-19T02:20:08.996446+0000","last_fullsized":"2024-04-19T02:20:08.996446+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.991148+0000","last_change":"2024-04-19T02:19:54.927744+0000","last_active":"2024-04-19T02:20:08.991148+0000","last_peered":"2024-04-19T02:20:08.991148+0000","last_clean":"2024-04-19T02:20:08.991148+0000","last_became_active":"2024-04-19T02:19:54.925729+0000","last_became_peered":"2024-04-19T02:19:54.925729+0000","last_unstale":"2024-04-19T02:20:08.991148+0000","last_undegraded":"2024-04-19T02:20:08.991148+0000","last_fullsized":"2024-04-19T02:20:08.991148+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:27:57.229684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.989293+0000","last_change":"2024-04-19T02:19:54.928435+0000","last_active":"2024-04-19T02:20:08.989293+0000","last_peered":"2024-04-19T02:20:08.989293+0000","last_clean":"2024-04-19T02:20:08.989293+0000","last_became_active":"2024-04-19T02:19:54.927666+0000","last_became_peered":"2024-04-19T02:19:54.927666+0000","last_unstale":"2024-04-19T02:20:08.989293+0000","last_undegraded":"2024-04-19T02:20:08.989293+0000","last_fullsized":"2024-04-19T02:20:08.989293+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:20:45.000808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993622+0000","last_change":"2024-04-19T02:19:54.932025+0000","last_active":"2024-04-19T02:20:08.993622+0000","last_peered":"2024-04-19T02:20:08.993622+0000","last_clean":"2024-04-19T02:20:08.993622+0000","last_became_active":"2024-04-19T02:19:54.931540+0000","last_became_peered":"2024-04-19T02:19:54.931540+0000","last_unstale":"2024-04-19T02:20:08.993622+0000","last_undegraded":"2024-04-19T02:20:08.993622+0000","last_fullsized":"2024-04-19T02:20:08.993622+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:03:31.479331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.991173+0000","last_change":"2024-04-19T02:19:54.924493+0000","last_active":"2024-04-19T02:20:08.991173+0000","last_peered":"2024-04-19T02:20:08.991173+0000","last_clean":"2024-04-19T02:20:08.991173+0000","last_became_active":"2024-04-19T02:19:54.923784+0000","last_became_peered":"2024-04-19T02:19:54.923784+0000","last_unstale":"2024-04-19T02:20:08.991173+0000","last_undegraded":"2024-04-19T02:20:08.991173+0000","last_fullsized":"2024-04-19T02:20:08.991173+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:09:34.378788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":81,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996234+0000","last_change":"2024-04-19T02:15:28.892937+0000","last_active":"2024-04-19T02:20:08.996234+0000","last_peered":"2024-04-19T02:20:08.996234+0000","last_clean":"2024-04-19T02:20:08.996234+0000","last_became_active":"2024-04-19T02:15:28.891440+0000","last_became_peered":"2024-04-19T02:15:28.891440+0000","last_unstale":"2024-04-19T02:20:08.996234+0000","last_undegraded":"2024-04-19T02:20:08.996234+0000","last_fullsized":"2024-04-19T02:20:08.996234+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.989329+0000","last_change":"2024-04-19T02:19:54.923898+0000","last_active":"2024-04-19T02:20:08.989329+0000","last_peered":"2024-04-19T02:20:08.989329+0000","last_clean":"2024-04-19T02:20:08.989329+0000","last_became_active":"2024-04-19T02:19:54.923493+0000","last_became_peered":"2024-04-19T02:19:54.923493+0000","last_unstale":"2024-04-19T02:20:08.989329+0000","last_undegraded":"2024-04-19T02:20:08.989329+0000","last_fullsized":"2024-04-19T02:20:08.989329+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:33.123319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":86,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637637+0000","last_change":"2024-04-19T02:15:28.891097+0000","last_active":"2024-04-19T02:20:10.637637+0000","last_peered":"2024-04-19T02:20:10.637637+0000","last_clean":"2024-04-19T02:20:10.637637+0000","last_became_active":"2024-04-19T02:15:28.890795+0000","last_became_peered":"2024-04-19T02:15:28.890795+0000","last_unstale":"2024-04-19T02:20:10.637637+0000","last_undegraded":"2024-04-19T02:20:10.637637+0000","last_fullsized":"2024-04-19T02:20:10.637637+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":79,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637625+0000","last_change":"2024-04-19T02:15:29.278546+0000","last_active":"2024-04-19T02:20:10.637625+0000","last_peered":"2024-04-19T02:20:10.637625+0000","last_clean":"2024-04-19T02:20:10.637625+0000","last_became_active":"2024-04-19T02:15:29.277547+0000","last_became_peered":"2024-04-19T02:15:29.277547+0000","last_unstale":"2024-04-19T02:20:10.637625+0000","last_undegraded":"2024-04-19T02:20:10.637625+0000","last_fullsized":"2024-04-19T02:20:10.637625+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":95,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637628+0000","last_change":"2024-04-19T02:19:54.933035+0000","last_active":"2024-04-19T02:20:10.637628+0000","last_peered":"2024-04-19T02:20:10.637628+0000","last_clean":"2024-04-19T02:20:10.637628+0000","last_became_active":"2024-04-19T02:19:54.932829+0000","last_became_peered":"2024-04-19T02:19:54.932829+0000","last_unstale":"2024-04-19T02:20:10.637628+0000","last_undegraded":"2024-04-19T02:20:10.637628+0000","last_fullsized":"2024-04-19T02:20:10.637628+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:09:05.626623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":49,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.998175+0000","last_change":"2024-04-19T02:20:07.983368+0000","last_active":"2024-04-19T02:20:09.998175+0000","last_peered":"2024-04-19T02:20:09.998175+0000","last_clean":"2024-04-19T02:20:09.998175+0000","last_became_active":"2024-04-19T02:20:07.983080+0000","last_became_peered":"2024-04-19T02:20:07.983080+0000","last_unstale":"2024-04-19T02:20:09.998175+0000","last_undegraded":"2024-04-19T02:20:09.998175+0000","last_fullsized":"2024-04-19T02:20:09.998175+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:24.138269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.989479+0000","last_change":"2024-04-19T02:19:54.927323+0000","last_active":"2024-04-19T02:20:08.989479+0000","last_peered":"2024-04-19T02:20:08.989479+0000","last_clean":"2024-04-19T02:20:08.989479+0000","last_became_active":"2024-04-19T02:19:54.925703+0000","last_became_peered":"2024-04-19T02:19:54.925703+0000","last_unstale":"2024-04-19T02:20:08.989479+0000","last_undegraded":"2024-04-19T02:20:08.989479+0000","last_fullsized":"2024-04-19T02:20:08.989479+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:46:59.533765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":55,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996775+0000","last_change":"2024-04-19T02:19:54.925918+0000","last_active":"2024-04-19T02:20:08.996775+0000","last_peered":"2024-04-19T02:20:08.996775+0000","last_clean":"2024-04-19T02:20:08.996775+0000","last_became_active":"2024-04-19T02:19:54.925634+0000","last_became_peered":"2024-04-19T02:19:54.925634+0000","last_unstale":"2024-04-19T02:20:08.996775+0000","last_undegraded":"2024-04-19T02:20:08.996775+0000","last_fullsized":"2024-04-19T02:20:08.996775+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:14:13.074455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.857926+0000","last_change":"2024-04-19T02:15:28.892934+0000","last_active":"2024-04-19T02:20:09.857926+0000","last_peered":"2024-04-19T02:20:09.857926+0000","last_clean":"2024-04-19T02:20:09.857926+0000","last_became_active":"2024-04-19T02:15:28.891879+0000","last_became_peered":"2024-04-19T02:15:28.891879+0000","last_unstale":"2024-04-19T02:20:09.857926+0000","last_undegraded":"2024-04-19T02:20:09.857926+0000","last_fullsized":"2024-04-19T02:20:09.857926+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:10:12.514798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.639094+0000","last_change":"2024-04-19T02:20:10.639094+0000","last_active":"2024-04-19T02:20:10.639094+0000","last_peered":"2024-04-19T02:20:10.639094+0000","last_clean":"2024-04-19T02:20:10.639094+0000","last_became_active":"2024-04-19T02:20:10.638755+0000","last_became_peered":"2024-04-19T02:20:10.638755+0000","last_unstale":"2024-04-19T02:20:10.639094+0000","last_undegraded":"2024-04-19T02:20:10.639094+0000","last_fullsized":"2024-04-19T02:20:10.639094+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:37:46.274811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.858501+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:20:09.858501+0000","last_peered":"2024-04-19T02:20:09.858501+0000","last_clean":"2024-04-19T02:20:09.858501+0000","last_became_active":"2024-04-19T02:15:28.890882+0000","last_became_peered":"2024-04-19T02:15:28.890882+0000","last_unstale":"2024-04-19T02:20:09.858501+0000","last_undegraded":"2024-04-19T02:20:09.858501+0000","last_fullsized":"2024-04-19T02:20:09.858501+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:31.673938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.991948+0000","last_change":"2024-04-19T02:19:54.927209+0000","last_active":"2024-04-19T02:20:08.991948+0000","last_peered":"2024-04-19T02:20:08.991948+0000","last_clean":"2024-04-19T02:20:08.991948+0000","last_became_active":"2024-04-19T02:19:54.925121+0000","last_became_peered":"2024-04-19T02:19:54.925121+0000","last_unstale":"2024-04-19T02:20:08.991948+0000","last_undegraded":"2024-04-19T02:20:08.991948+0000","last_fullsized":"2024-04-19T02:20:08.991948+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:16:21.982909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":81,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993779+0000","last_change":"2024-04-19T02:15:28.890265+0000","last_active":"2024-04-19T02:20:08.993779+0000","last_peered":"2024-04-19T02:20:08.993779+0000","last_clean":"2024-04-19T02:20:08.993779+0000","last_became_active":"2024-04-19T02:15:28.890004+0000","last_became_peered":"2024-04-19T02:15:28.890004+0000","last_unstale":"2024-04-19T02:20:08.993779+0000","last_undegraded":"2024-04-19T02:20:08.993779+0000","last_fullsized":"2024-04-19T02:20:08.993779+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:02.517101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.994900+0000","last_change":"2024-04-19T02:15:29.285529+0000","last_active":"2024-04-19T02:20:08.994900+0000","last_peered":"2024-04-19T02:20:08.994900+0000","last_clean":"2024-04-19T02:20:08.994900+0000","last_became_active":"2024-04-19T02:15:29.285197+0000","last_became_peered":"2024-04-19T02:15:29.285197+0000","last_unstale":"2024-04-19T02:20:08.994900+0000","last_undegraded":"2024-04-19T02:20:08.994900+0000","last_fullsized":"2024-04-19T02:20:08.994900+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":81,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995996+0000","last_change":"2024-04-19T02:15:28.893902+0000","last_active":"2024-04-19T02:20:08.995996+0000","last_peered":"2024-04-19T02:20:08.995996+0000","last_clean":"2024-04-19T02:20:08.995996+0000","last_became_active":"2024-04-19T02:15:28.893231+0000","last_became_peered":"2024-04-19T02:15:28.893231+0000","last_unstale":"2024-04-19T02:20:08.995996+0000","last_undegraded":"2024-04-19T02:20:08.995996+0000","last_fullsized":"2024-04-19T02:20:08.995996+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:23.658442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996319+0000","last_change":"2024-04-19T02:19:54.925840+0000","last_active":"2024-04-19T02:20:08.996319+0000","last_peered":"2024-04-19T02:20:08.996319+0000","last_clean":"2024-04-19T02:20:08.996319+0000","last_became_active":"2024-04-19T02:19:54.925502+0000","last_became_peered":"2024-04-19T02:19:54.925502+0000","last_unstale":"2024-04-19T02:20:08.996319+0000","last_undegraded":"2024-04-19T02:20:08.996319+0000","last_fullsized":"2024-04-19T02:20:08.996319+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:57.667340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":81,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993204+0000","last_change":"2024-04-19T02:15:28.891234+0000","last_active":"2024-04-19T02:20:08.993204+0000","last_peered":"2024-04-19T02:20:08.993204+0000","last_clean":"2024-04-19T02:20:08.993204+0000","last_became_active":"2024-04-19T02:15:28.890881+0000","last_became_peered":"2024-04-19T02:15:28.890881+0000","last_unstale":"2024-04-19T02:20:08.993204+0000","last_undegraded":"2024-04-19T02:20:08.993204+0000","last_fullsized":"2024-04-19T02:20:08.993204+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992289+0000","last_change":"2024-04-19T02:19:54.926103+0000","last_active":"2024-04-19T02:20:08.992289+0000","last_peered":"2024-04-19T02:20:08.992289+0000","last_clean":"2024-04-19T02:20:08.992289+0000","last_became_active":"2024-04-19T02:19:54.925591+0000","last_became_peered":"2024-04-19T02:19:54.925591+0000","last_unstale":"2024-04-19T02:20:08.992289+0000","last_undegraded":"2024-04-19T02:20:08.992289+0000","last_fullsized":"2024-04-19T02:20:08.992289+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:44:40.560973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":93,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992481+0000","last_change":"2024-04-19T02:19:54.926813+0000","last_active":"2024-04-19T02:20:08.992481+0000","last_peered":"2024-04-19T02:20:08.992481+0000","last_clean":"2024-04-19T02:20:08.992481+0000","last_became_active":"2024-04-19T02:19:54.925523+0000","last_became_peered":"2024-04-19T02:19:54.925523+0000","last_unstale":"2024-04-19T02:20:08.992481+0000","last_undegraded":"2024-04-19T02:20:08.992481+0000","last_fullsized":"2024-04-19T02:20:08.992481+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:39:56.887385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.989835+0000","last_change":"2024-04-19T02:19:54.932306+0000","last_active":"2024-04-19T02:20:08.989835+0000","last_peered":"2024-04-19T02:20:08.989835+0000","last_clean":"2024-04-19T02:20:08.989835+0000","last_became_active":"2024-04-19T02:19:54.930843+0000","last_became_peered":"2024-04-19T02:19:54.930843+0000","last_unstale":"2024-04-19T02:20:08.989835+0000","last_undegraded":"2024-04-19T02:20:08.989835+0000","last_fullsized":"2024-04-19T02:20:08.989835+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:24:51.884048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.989655+0000","last_change":"2024-04-19T02:19:54.932708+0000","last_active":"2024-04-19T02:20:08.989655+0000","last_peered":"2024-04-19T02:20:08.989655+0000","last_clean":"2024-04-19T02:20:08.989655+0000","last_became_active":"2024-04-19T02:19:54.931553+0000","last_became_peered":"2024-04-19T02:19:54.931553+0000","last_unstale":"2024-04-19T02:20:08.989655+0000","last_undegraded":"2024-04-19T02:20:08.989655+0000","last_fullsized":"2024-04-19T02:20:08.989655+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:47:07.651618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992596+0000","last_change":"2024-04-19T02:19:54.927009+0000","last_active":"2024-04-19T02:20:08.992596+0000","last_peered":"2024-04-19T02:20:08.992596+0000","last_clean":"2024-04-19T02:20:08.992596+0000","last_became_active":"2024-04-19T02:19:54.925645+0000","last_became_peered":"2024-04-19T02:19:54.925645+0000","last_unstale":"2024-04-19T02:20:08.992596+0000","last_undegraded":"2024-04-19T02:20:08.992596+0000","last_fullsized":"2024-04-19T02:20:08.992596+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:33:45.685463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":93,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992170+0000","last_change":"2024-04-19T02:19:54.923689+0000","last_active":"2024-04-19T02:20:08.992170+0000","last_peered":"2024-04-19T02:20:08.992170+0000","last_clean":"2024-04-19T02:20:08.992170+0000","last_became_active":"2024-04-19T02:19:54.923321+0000","last_became_peered":"2024-04-19T02:19:54.923321+0000","last_unstale":"2024-04-19T02:20:08.992170+0000","last_undegraded":"2024-04-19T02:20:08.992170+0000","last_fullsized":"2024-04-19T02:20:08.992170+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:03:01.578244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993485+0000","last_change":"2024-04-19T02:15:29.285019+0000","last_active":"2024-04-19T02:20:08.993485+0000","last_peered":"2024-04-19T02:20:08.993485+0000","last_clean":"2024-04-19T02:20:08.993485+0000","last_became_active":"2024-04-19T02:15:29.284650+0000","last_became_peered":"2024-04-19T02:15:29.284650+0000","last_unstale":"2024-04-19T02:20:08.993485+0000","last_undegraded":"2024-04-19T02:20:08.993485+0000","last_fullsized":"2024-04-19T02:20:08.993485+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995102+0000","last_change":"2024-04-19T02:20:08.662566+0000","last_active":"2024-04-19T02:20:08.995102+0000","last_peered":"2024-04-19T02:20:08.995102+0000","last_clean":"2024-04-19T02:20:08.995102+0000","last_became_active":"2024-04-19T02:20:08.662277+0000","last_became_peered":"2024-04-19T02:20:08.662277+0000","last_unstale":"2024-04-19T02:20:08.995102+0000","last_undegraded":"2024-04-19T02:20:08.995102+0000","last_fullsized":"2024-04-19T02:20:08.995102+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:36:27.307955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993656+0000","last_change":"2024-04-19T02:15:29.287190+0000","last_active":"2024-04-19T02:20:08.993656+0000","last_peered":"2024-04-19T02:20:08.993656+0000","last_clean":"2024-04-19T02:20:08.993656+0000","last_became_active":"2024-04-19T02:15:29.286606+0000","last_became_peered":"2024-04-19T02:15:29.286606+0000","last_unstale":"2024-04-19T02:20:08.993656+0000","last_undegraded":"2024-04-19T02:20:08.993656+0000","last_fullsized":"2024-04-19T02:20:08.993656+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:28.387062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996306+0000","last_change":"2024-04-19T02:19:54.928493+0000","last_active":"2024-04-19T02:20:08.996306+0000","last_peered":"2024-04-19T02:20:08.996306+0000","last_clean":"2024-04-19T02:20:08.996306+0000","last_became_active":"2024-04-19T02:19:54.928298+0000","last_became_peered":"2024-04-19T02:19:54.928298+0000","last_unstale":"2024-04-19T02:20:08.996306+0000","last_undegraded":"2024-04-19T02:20:08.996306+0000","last_fullsized":"2024-04-19T02:20:08.996306+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:11:54.564261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.990650+0000","last_change":"2024-04-19T02:19:54.930452+0000","last_active":"2024-04-19T02:20:08.990650+0000","last_peered":"2024-04-19T02:20:08.990650+0000","last_clean":"2024-04-19T02:20:08.990650+0000","last_became_active":"2024-04-19T02:19:54.927309+0000","last_became_peered":"2024-04-19T02:19:54.927309+0000","last_unstale":"2024-04-19T02:20:08.990650+0000","last_undegraded":"2024-04-19T02:20:08.990650+0000","last_fullsized":"2024-04-19T02:20:08.990650+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:56:20.174957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.998998+0000","last_change":"2024-04-19T02:20:09.998998+0000","last_active":"2024-04-19T02:20:09.998998+0000","last_peered":"2024-04-19T02:20:09.998998+0000","last_clean":"2024-04-19T02:20:09.998998+0000","last_became_active":"2024-04-19T02:20:09.998776+0000","last_became_peered":"2024-04-19T02:20:09.998776+0000","last_unstale":"2024-04-19T02:20:09.998998+0000","last_undegraded":"2024-04-19T02:20:09.998998+0000","last_fullsized":"2024-04-19T02:20:09.998998+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:02:13.720846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":93,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993371+0000","last_change":"2024-04-19T02:19:54.926207+0000","last_active":"2024-04-19T02:20:08.993371+0000","last_peered":"2024-04-19T02:20:08.993371+0000","last_clean":"2024-04-19T02:20:08.993371+0000","last_became_active":"2024-04-19T02:19:54.925872+0000","last_became_peered":"2024-04-19T02:19:54.925872+0000","last_unstale":"2024-04-19T02:20:08.993371+0000","last_undegraded":"2024-04-19T02:20:08.993371+0000","last_fullsized":"2024-04-19T02:20:08.993371+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:31:46.734042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996171+0000","last_change":"2024-04-19T02:15:29.277922+0000","last_active":"2024-04-19T02:20:08.996171+0000","last_peered":"2024-04-19T02:20:08.996171+0000","last_clean":"2024-04-19T02:20:08.996171+0000","last_became_active":"2024-04-19T02:15:29.276968+0000","last_became_peered":"2024-04-19T02:15:29.276968+0000","last_unstale":"2024-04-19T02:20:08.996171+0000","last_undegraded":"2024-04-19T02:20:08.996171+0000","last_fullsized":"2024-04-19T02:20:08.996171+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":96,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992530+0000","last_change":"2024-04-19T02:19:54.927361+0000","last_active":"2024-04-19T02:20:08.992530+0000","last_peered":"2024-04-19T02:20:08.992530+0000","last_clean":"2024-04-19T02:20:08.992530+0000","last_became_active":"2024-04-19T02:19:54.927033+0000","last_became_peered":"2024-04-19T02:19:54.927033+0000","last_unstale":"2024-04-19T02:20:08.992530+0000","last_undegraded":"2024-04-19T02:20:08.992530+0000","last_fullsized":"2024-04-19T02:20:08.992530+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:07.194915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":93,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992757+0000","last_change":"2024-04-19T02:19:54.932790+0000","last_active":"2024-04-19T02:20:08.992757+0000","last_peered":"2024-04-19T02:20:08.992757+0000","last_clean":"2024-04-19T02:20:08.992757+0000","last_became_active":"2024-04-19T02:19:54.931683+0000","last_became_peered":"2024-04-19T02:19:54.931683+0000","last_unstale":"2024-04-19T02:20:08.992757+0000","last_undegraded":"2024-04-19T02:20:08.992757+0000","last_fullsized":"2024-04-19T02:20:08.992757+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:23:00.124845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.990653+0000","last_change":"2024-04-19T02:19:54.926109+0000","last_active":"2024-04-19T02:20:08.990653+0000","last_peered":"2024-04-19T02:20:08.990653+0000","last_clean":"2024-04-19T02:20:08.990653+0000","last_became_active":"2024-04-19T02:19:54.924686+0000","last_became_peered":"2024-04-19T02:19:54.924686+0000","last_unstale":"2024-04-19T02:20:08.990653+0000","last_undegraded":"2024-04-19T02:20:08.990653+0000","last_fullsized":"2024-04-19T02:20:08.990653+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:20:03.487999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.990873+0000","last_change":"2024-04-19T02:19:54.923465+0000","last_active":"2024-04-19T02:20:08.990873+0000","last_peered":"2024-04-19T02:20:08.990873+0000","last_clean":"2024-04-19T02:20:08.990873+0000","last_became_active":"2024-04-19T02:19:54.923164+0000","last_became_peered":"2024-04-19T02:19:54.923164+0000","last_unstale":"2024-04-19T02:20:08.990873+0000","last_undegraded":"2024-04-19T02:20:08.990873+0000","last_fullsized":"2024-04-19T02:20:08.990873+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:53:29.520848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995333+0000","last_change":"2024-04-19T02:20:08.662301+0000","last_active":"2024-04-19T02:20:08.995333+0000","last_peered":"2024-04-19T02:20:08.995333+0000","last_clean":"2024-04-19T02:20:08.995333+0000","last_became_active":"2024-04-19T02:20:08.661952+0000","last_became_peered":"2024-04-19T02:20:08.661952+0000","last_unstale":"2024-04-19T02:20:08.995333+0000","last_undegraded":"2024-04-19T02:20:08.995333+0000","last_fullsized":"2024-04-19T02:20:08.995333+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:41:21.658836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.991779+0000","last_change":"2024-04-19T02:19:54.930115+0000","last_active":"2024-04-19T02:20:08.991779+0000","last_peered":"2024-04-19T02:20:08.991779+0000","last_clean":"2024-04-19T02:20:08.991779+0000","last_became_active":"2024-04-19T02:19:54.926463+0000","last_became_peered":"2024-04-19T02:19:54.926463+0000","last_unstale":"2024-04-19T02:20:08.991779+0000","last_undegraded":"2024-04-19T02:20:08.991779+0000","last_fullsized":"2024-04-19T02:20:08.991779+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:00.191645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":96,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992852+0000","last_change":"2024-04-19T02:19:54.932929+0000","last_active":"2024-04-19T02:20:08.992852+0000","last_peered":"2024-04-19T02:20:08.992852+0000","last_clean":"2024-04-19T02:20:08.992852+0000","last_became_active":"2024-04-19T02:19:54.932571+0000","last_became_peered":"2024-04-19T02:19:54.932571+0000","last_unstale":"2024-04-19T02:20:08.992852+0000","last_undegraded":"2024-04-19T02:20:08.992852+0000","last_fullsized":"2024-04-19T02:20:08.992852+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:50:08.657036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":279,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993444+0000","last_change":"2024-04-19T02:15:24.533634+0000","last_active":"2024-04-19T02:20:08.993444+0000","last_peered":"2024-04-19T02:20:08.993444+0000","last_clean":"2024-04-19T02:20:08.993444+0000","last_became_active":"2024-04-19T02:15:24.533420+0000","last_became_peered":"2024-04-19T02:15:24.533420+0000","last_unstale":"2024-04-19T02:20:08.993444+0000","last_undegraded":"2024-04-19T02:20:08.993444+0000","last_fullsized":"2024-04-19T02:20:08.993444+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.001770+0000","last_change":"2024-04-19T02:20:10.001770+0000","last_active":"2024-04-19T02:20:10.001770+0000","last_peered":"2024-04-19T02:20:10.001770+0000","last_clean":"2024-04-19T02:20:10.001770+0000","last_became_active":"2024-04-19T02:20:10.001415+0000","last_became_peered":"2024-04-19T02:20:10.001415+0000","last_unstale":"2024-04-19T02:20:10.001770+0000","last_undegraded":"2024-04-19T02:20:10.001770+0000","last_fullsized":"2024-04-19T02:20:10.001770+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:00:30.084474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993420+0000","last_change":"2024-04-19T02:15:29.285015+0000","last_active":"2024-04-19T02:20:08.993420+0000","last_peered":"2024-04-19T02:20:08.993420+0000","last_clean":"2024-04-19T02:20:08.993420+0000","last_became_active":"2024-04-19T02:15:29.284164+0000","last_became_peered":"2024-04-19T02:15:29.284164+0000","last_unstale":"2024-04-19T02:20:08.993420+0000","last_undegraded":"2024-04-19T02:20:08.993420+0000","last_fullsized":"2024-04-19T02:20:08.993420+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:36.987844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":83,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993579+0000","last_change":"2024-04-19T02:15:24.533912+0000","last_active":"2024-04-19T02:20:08.993579+0000","last_peered":"2024-04-19T02:20:08.993579+0000","last_clean":"2024-04-19T02:20:08.993579+0000","last_became_active":"2024-04-19T02:15:24.533580+0000","last_became_peered":"2024-04-19T02:15:24.533580+0000","last_unstale":"2024-04-19T02:20:08.993579+0000","last_undegraded":"2024-04-19T02:20:08.993579+0000","last_fullsized":"2024-04-19T02:20:08.993579+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:45.045477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.639268+0000","last_change":"2024-04-19T02:20:10.639268+0000","last_active":"2024-04-19T02:20:10.639268+0000","last_peered":"2024-04-19T02:20:10.639268+0000","last_clean":"2024-04-19T02:20:10.639268+0000","last_became_active":"2024-04-19T02:20:10.638966+0000","last_became_peered":"2024-04-19T02:20:10.638966+0000","last_unstale":"2024-04-19T02:20:10.639268+0000","last_undegraded":"2024-04-19T02:20:10.639268+0000","last_fullsized":"2024-04-19T02:20:10.639268+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:38.164641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":49,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996215+0000","last_change":"2024-04-19T02:20:07.986363+0000","last_active":"2024-04-19T02:20:08.996215+0000","last_peered":"2024-04-19T02:20:08.996215+0000","last_clean":"2024-04-19T02:20:08.996215+0000","last_became_active":"2024-04-19T02:20:07.986110+0000","last_became_peered":"2024-04-19T02:20:07.986110+0000","last_unstale":"2024-04-19T02:20:08.996215+0000","last_undegraded":"2024-04-19T02:20:08.996215+0000","last_fullsized":"2024-04-19T02:20:08.996215+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:12.545910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":60,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996406+0000","last_change":"2024-04-19T02:19:54.925886+0000","last_active":"2024-04-19T02:20:08.996406+0000","last_peered":"2024-04-19T02:20:08.996406+0000","last_clean":"2024-04-19T02:20:08.996406+0000","last_became_active":"2024-04-19T02:19:54.925570+0000","last_became_peered":"2024-04-19T02:19:54.925570+0000","last_unstale":"2024-04-19T02:20:08.996406+0000","last_undegraded":"2024-04-19T02:20:08.996406+0000","last_fullsized":"2024-04-19T02:20:08.996406+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:33:34.594161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.990045+0000","last_change":"2024-04-19T02:19:54.933960+0000","last_active":"2024-04-19T02:20:08.990045+0000","last_peered":"2024-04-19T02:20:08.990045+0000","last_clean":"2024-04-19T02:20:08.990045+0000","last_became_active":"2024-04-19T02:19:54.929918+0000","last_became_peered":"2024-04-19T02:19:54.929918+0000","last_unstale":"2024-04-19T02:20:08.990045+0000","last_undegraded":"2024-04-19T02:20:08.990045+0000","last_fullsized":"2024-04-19T02:20:08.990045+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:33:10.282684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995346+0000","last_change":"2024-04-19T02:15:29.281694+0000","last_active":"2024-04-19T02:20:08.995346+0000","last_peered":"2024-04-19T02:20:08.995346+0000","last_clean":"2024-04-19T02:20:08.995346+0000","last_became_active":"2024-04-19T02:15:29.280519+0000","last_became_peered":"2024-04-19T02:15:29.280519+0000","last_unstale":"2024-04-19T02:20:08.995346+0000","last_undegraded":"2024-04-19T02:20:08.995346+0000","last_fullsized":"2024-04-19T02:20:08.995346+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:50.890545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.990434+0000","last_change":"2024-04-19T02:19:54.931726+0000","last_active":"2024-04-19T02:20:08.990434+0000","last_peered":"2024-04-19T02:20:08.990434+0000","last_clean":"2024-04-19T02:20:08.990434+0000","last_became_active":"2024-04-19T02:19:54.928460+0000","last_became_peered":"2024-04-19T02:19:54.928460+0000","last_unstale":"2024-04-19T02:20:08.990434+0000","last_undegraded":"2024-04-19T02:20:08.990434+0000","last_fullsized":"2024-04-19T02:20:08.990434+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:07:04.935620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.998879+0000","last_change":"2024-04-19T02:20:09.998879+0000","last_active":"2024-04-19T02:20:09.998879+0000","last_peered":"2024-04-19T02:20:09.998879+0000","last_clean":"2024-04-19T02:20:09.998879+0000","last_became_active":"2024-04-19T02:20:09.998629+0000","last_became_peered":"2024-04-19T02:20:09.998629+0000","last_unstale":"2024-04-19T02:20:09.998879+0000","last_undegraded":"2024-04-19T02:20:09.998879+0000","last_fullsized":"2024-04-19T02:20:09.998879+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:38:00.584717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.639272+0000","last_change":"2024-04-19T02:20:10.639272+0000","last_active":"2024-04-19T02:20:10.639272+0000","last_peered":"2024-04-19T02:20:10.639272+0000","last_clean":"2024-04-19T02:20:10.639272+0000","last_became_active":"2024-04-19T02:20:10.638912+0000","last_became_peered":"2024-04-19T02:20:10.638912+0000","last_unstale":"2024-04-19T02:20:10.639272+0000","last_undegraded":"2024-04-19T02:20:10.639272+0000","last_fullsized":"2024-04-19T02:20:10.639272+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:19.396777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":83,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993846+0000","last_change":"2024-04-19T02:15:24.533777+0000","last_active":"2024-04-19T02:20:08.993846+0000","last_peered":"2024-04-19T02:20:08.993846+0000","last_clean":"2024-04-19T02:20:08.993846+0000","last_became_active":"2024-04-19T02:15:24.533436+0000","last_became_peered":"2024-04-19T02:15:24.533436+0000","last_unstale":"2024-04-19T02:20:08.993846+0000","last_undegraded":"2024-04-19T02:20:08.993846+0000","last_fullsized":"2024-04-19T02:20:08.993846+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:53:25.922418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.990547+0000","last_change":"2024-04-19T02:19:54.933278+0000","last_active":"2024-04-19T02:20:08.990547+0000","last_peered":"2024-04-19T02:20:08.990547+0000","last_clean":"2024-04-19T02:20:08.990547+0000","last_became_active":"2024-04-19T02:19:54.931328+0000","last_became_peered":"2024-04-19T02:19:54.931328+0000","last_unstale":"2024-04-19T02:20:08.990547+0000","last_undegraded":"2024-04-19T02:20:08.990547+0000","last_fullsized":"2024-04-19T02:20:08.990547+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:08:38.731741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996195+0000","last_change":"2024-04-19T02:15:29.282244+0000","last_active":"2024-04-19T02:20:08.996195+0000","last_peered":"2024-04-19T02:20:08.996195+0000","last_clean":"2024-04-19T02:20:08.996195+0000","last_became_active":"2024-04-19T02:15:29.280366+0000","last_became_peered":"2024-04-19T02:15:29.280366+0000","last_unstale":"2024-04-19T02:20:08.996195+0000","last_undegraded":"2024-04-19T02:20:08.996195+0000","last_fullsized":"2024-04-19T02:20:08.996195+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995650+0000","last_change":"2024-04-19T02:15:28.893027+0000","last_active":"2024-04-19T02:20:08.995650+0000","last_peered":"2024-04-19T02:20:08.995650+0000","last_clean":"2024-04-19T02:20:08.995650+0000","last_became_active":"2024-04-19T02:15:28.892695+0000","last_became_peered":"2024-04-19T02:15:28.892695+0000","last_unstale":"2024-04-19T02:20:08.995650+0000","last_undegraded":"2024-04-19T02:20:08.995650+0000","last_fullsized":"2024-04-19T02:20:08.995650+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996179+0000","last_change":"2024-04-19T02:19:54.929648+0000","last_active":"2024-04-19T02:20:08.996179+0000","last_peered":"2024-04-19T02:20:08.996179+0000","last_clean":"2024-04-19T02:20:08.996179+0000","last_became_active":"2024-04-19T02:19:54.929412+0000","last_became_peered":"2024-04-19T02:19:54.929412+0000","last_unstale":"2024-04-19T02:20:08.996179+0000","last_undegraded":"2024-04-19T02:20:08.996179+0000","last_fullsized":"2024-04-19T02:20:08.996179+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:28:21.688550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":94,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992761+0000","last_change":"2024-04-19T02:19:54.927315+0000","last_active":"2024-04-19T02:20:08.992761+0000","last_peered":"2024-04-19T02:20:08.992761+0000","last_clean":"2024-04-19T02:20:08.992761+0000","last_became_active":"2024-04-19T02:19:54.926630+0000","last_became_peered":"2024-04-19T02:19:54.926630+0000","last_unstale":"2024-04-19T02:20:08.992761+0000","last_undegraded":"2024-04-19T02:20:08.992761+0000","last_fullsized":"2024-04-19T02:20:08.992761+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:39:00.822558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992698+0000","last_change":"2024-04-19T02:19:54.931920+0000","last_active":"2024-04-19T02:20:08.992698+0000","last_peered":"2024-04-19T02:20:08.992698+0000","last_clean":"2024-04-19T02:20:08.992698+0000","last_became_active":"2024-04-19T02:19:54.931328+0000","last_became_peered":"2024-04-19T02:19:54.931328+0000","last_unstale":"2024-04-19T02:20:08.992698+0000","last_undegraded":"2024-04-19T02:20:08.992698+0000","last_fullsized":"2024-04-19T02:20:08.992698+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:39.655376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":80,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996399+0000","last_change":"2024-04-19T02:15:28.893239+0000","last_active":"2024-04-19T02:20:08.996399+0000","last_peered":"2024-04-19T02:20:08.996399+0000","last_clean":"2024-04-19T02:20:08.996399+0000","last_became_active":"2024-04-19T02:15:28.892881+0000","last_became_peered":"2024-04-19T02:15:28.892881+0000","last_unstale":"2024-04-19T02:20:08.996399+0000","last_undegraded":"2024-04-19T02:20:08.996399+0000","last_fullsized":"2024-04-19T02:20:08.996399+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992227+0000","last_change":"2024-04-19T02:19:54.924029+0000","last_active":"2024-04-19T02:20:08.992227+0000","last_peered":"2024-04-19T02:20:08.992227+0000","last_clean":"2024-04-19T02:20:08.992227+0000","last_became_active":"2024-04-19T02:19:54.923752+0000","last_became_peered":"2024-04-19T02:19:54.923752+0000","last_unstale":"2024-04-19T02:20:08.992227+0000","last_undegraded":"2024-04-19T02:20:08.992227+0000","last_fullsized":"2024-04-19T02:20:08.992227+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:26:41.825722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.990448+0000","last_change":"2024-04-19T02:19:54.933652+0000","last_active":"2024-04-19T02:20:08.990448+0000","last_peered":"2024-04-19T02:20:08.990448+0000","last_clean":"2024-04-19T02:20:08.990448+0000","last_became_active":"2024-04-19T02:19:54.932103+0000","last_became_peered":"2024-04-19T02:19:54.932103+0000","last_unstale":"2024-04-19T02:20:08.990448+0000","last_undegraded":"2024-04-19T02:20:08.990448+0000","last_fullsized":"2024-04-19T02:20:08.990448+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:46:14.540427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996400+0000","last_change":"2024-04-19T02:19:54.925832+0000","last_active":"2024-04-19T02:20:08.996400+0000","last_peered":"2024-04-19T02:20:08.996400+0000","last_clean":"2024-04-19T02:20:08.996400+0000","last_became_active":"2024-04-19T02:19:54.925565+0000","last_became_peered":"2024-04-19T02:19:54.925565+0000","last_unstale":"2024-04-19T02:20:08.996400+0000","last_undegraded":"2024-04-19T02:20:08.996400+0000","last_fullsized":"2024-04-19T02:20:08.996400+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:28:13.380027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.990549+0000","last_change":"2024-04-19T02:19:54.929083+0000","last_active":"2024-04-19T02:20:08.990549+0000","last_peered":"2024-04-19T02:20:08.990549+0000","last_clean":"2024-04-19T02:20:08.990549+0000","last_became_active":"2024-04-19T02:19:54.926439+0000","last_became_peered":"2024-04-19T02:19:54.926439+0000","last_unstale":"2024-04-19T02:20:08.990549+0000","last_undegraded":"2024-04-19T02:20:08.990549+0000","last_fullsized":"2024-04-19T02:20:08.990549+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:15:04.675082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993698+0000","last_change":"2024-04-19T02:19:54.931258+0000","last_active":"2024-04-19T02:20:08.993698+0000","last_peered":"2024-04-19T02:20:08.993698+0000","last_clean":"2024-04-19T02:20:08.993698+0000","last_became_active":"2024-04-19T02:19:54.930665+0000","last_became_peered":"2024-04-19T02:19:54.930665+0000","last_unstale":"2024-04-19T02:20:08.993698+0000","last_undegraded":"2024-04-19T02:20:08.993698+0000","last_fullsized":"2024-04-19T02:20:08.993698+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:57:08.681822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993591+0000","last_change":"2024-04-19T02:19:54.931055+0000","last_active":"2024-04-19T02:20:08.993591+0000","last_peered":"2024-04-19T02:20:08.993591+0000","last_clean":"2024-04-19T02:20:08.993591+0000","last_became_active":"2024-04-19T02:19:54.930527+0000","last_became_peered":"2024-04-19T02:19:54.930527+0000","last_unstale":"2024-04-19T02:20:08.993591+0000","last_undegraded":"2024-04-19T02:20:08.993591+0000","last_fullsized":"2024-04-19T02:20:08.993591+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:05:38.717309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.001589+0000","last_change":"2024-04-19T02:20:10.001589+0000","last_active":"2024-04-19T02:20:10.001589+0000","last_peered":"2024-04-19T02:20:10.001589+0000","last_clean":"2024-04-19T02:20:10.001589+0000","last_became_active":"2024-04-19T02:20:10.001304+0000","last_became_peered":"2024-04-19T02:20:10.001304+0000","last_unstale":"2024-04-19T02:20:10.001589+0000","last_undegraded":"2024-04-19T02:20:10.001589+0000","last_fullsized":"2024-04-19T02:20:10.001589+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:36.432257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996078+0000","last_change":"2024-04-19T02:20:08.662331+0000","last_active":"2024-04-19T02:20:08.996078+0000","last_peered":"2024-04-19T02:20:08.996078+0000","last_clean":"2024-04-19T02:20:08.996078+0000","last_became_active":"2024-04-19T02:20:08.661996+0000","last_became_peered":"2024-04-19T02:20:08.661996+0000","last_unstale":"2024-04-19T02:20:08.996078+0000","last_undegraded":"2024-04-19T02:20:08.996078+0000","last_fullsized":"2024-04-19T02:20:08.996078+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:25:03.894231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.001706+0000","last_change":"2024-04-19T02:20:10.001706+0000","last_active":"2024-04-19T02:20:10.001706+0000","last_peered":"2024-04-19T02:20:10.001706+0000","last_clean":"2024-04-19T02:20:10.001706+0000","last_became_active":"2024-04-19T02:20:10.001372+0000","last_became_peered":"2024-04-19T02:20:10.001372+0000","last_unstale":"2024-04-19T02:20:10.001706+0000","last_undegraded":"2024-04-19T02:20:10.001706+0000","last_fullsized":"2024-04-19T02:20:10.001706+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:54:55.702629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996258+0000","last_change":"2024-04-19T02:15:29.277568+0000","last_active":"2024-04-19T02:20:08.996258+0000","last_peered":"2024-04-19T02:20:08.996258+0000","last_clean":"2024-04-19T02:20:08.996258+0000","last_became_active":"2024-04-19T02:15:29.276725+0000","last_became_peered":"2024-04-19T02:15:29.276725+0000","last_unstale":"2024-04-19T02:20:08.996258+0000","last_undegraded":"2024-04-19T02:20:08.996258+0000","last_fullsized":"2024-04-19T02:20:08.996258+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5254,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":72,"seq":309237645318,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58816,"kb_used_data":884,"kb_used_omap":6,"kb_used_meta":57913,"kb_avail":94313024,"statfs":{"total":96636764160,"available":96576536576,"internally_reserved":0,"allocated":905216,"data_stored":358135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6848,"internal_metadata":59303232},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738430,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":275424,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":273918,"kb_avail":94096416,"statfs":{"total":96636764160,"available":96354729984,"internally_reserved":0,"allocated":1519616,"data_stored":948136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":280492486},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 02:19:26 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.371,"15min":0.316},"min":{"1min":0.29899999999999999,"5min":0.159,"15min":0.159},"max":{"1min":0.57499999999999996,"5min":4.4480000000000004,"15min":4.4480000000000004},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.379,"15min":0.36599999999999999},"min":{"1min":0.29399999999999998,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.54800000000000004,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.40200000000000002}]},{"osd":2,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":2.1000000000000001,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.36099999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738429,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307416,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":305918,"kb_avail":94064424,"statfs":{"total":96636764160,"available":96321970176,"internally_reserved":0,"allocated":1515520,"data_stored":949633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":313260486},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:19:29 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.40600000000000003,"15min":0.376},"min":{"1min":0.32700000000000001,"5min":0.157,"15min":0.157},"max":{"1min":0.64900000000000002,"5min":1.794,"15min":1.794},"last":0.496},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.38100000000000001,"15min":0.32400000000000001},"min":{"1min":0.37,"5min":0.16,"15min":0.16},"max":{"1min":0.63,"5min":2.411,"15min":2.411},"last":0.53400000000000003}]},{"osd":2,"last update":"Fri Apr 19 02:16:26 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.60599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5254,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:20:17.757 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-19T02:20:17.758 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:20:18.122 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:20:18.124 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-04-19T02:20:18.134 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":225,"stamp":"2024-04-19T02:20:16.812850+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":641656,"kb_used_data":3848,"kb_used_omap":9,"kb_used_meta":637750,"kb_avail":282473864,"statfs":{"total":289910292480,"available":289253236736,"internally_reserved":0,"allocated":3940352,"data_stored":2255904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10036,"internal_metadata":653056204},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001507"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996815+0000","last_change":"2024-04-19T02:19:54.929643+0000","last_active":"2024-04-19T02:20:08.996815+0000","last_peered":"2024-04-19T02:20:08.996815+0000","last_clean":"2024-04-19T02:20:08.996815+0000","last_became_active":"2024-04-19T02:19:54.929435+0000","last_became_peered":"2024-04-19T02:19:54.929435+0000","last_unstale":"2024-04-19T02:20:08.996815+0000","last_undegraded":"2024-04-19T02:20:08.996815+0000","last_fullsized":"2024-04-19T02:20:08.996815+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:44:05.807254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995814+0000","last_change":"2024-04-19T02:19:54.931532+0000","last_active":"2024-04-19T02:20:08.995814+0000","last_peered":"2024-04-19T02:20:08.995814+0000","last_clean":"2024-04-19T02:20:08.995814+0000","last_became_active":"2024-04-19T02:19:54.931278+0000","last_became_peered":"2024-04-19T02:19:54.931278+0000","last_unstale":"2024-04-19T02:20:08.995814+0000","last_undegraded":"2024-04-19T02:20:08.995814+0000","last_fullsized":"2024-04-19T02:20:08.995814+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:20:02.024046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993263+0000","last_change":"2024-04-19T02:15:29.286709+0000","last_active":"2024-04-19T02:20:08.993263+0000","last_peered":"2024-04-19T02:20:08.993263+0000","last_clean":"2024-04-19T02:20:08.993263+0000","last_became_active":"2024-04-19T02:15:29.286169+0000","last_became_peered":"2024-04-19T02:15:29.286169+0000","last_unstale":"2024-04-19T02:20:08.993263+0000","last_undegraded":"2024-04-19T02:20:08.993263+0000","last_fullsized":"2024-04-19T02:20:08.993263+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:58.741466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993036+0000","last_change":"2024-04-19T02:19:54.927063+0000","last_active":"2024-04-19T02:20:08.993036+0000","last_peered":"2024-04-19T02:20:08.993036+0000","last_clean":"2024-04-19T02:20:08.993036+0000","last_became_active":"2024-04-19T02:19:54.926046+0000","last_became_peered":"2024-04-19T02:19:54.926046+0000","last_unstale":"2024-04-19T02:20:08.993036+0000","last_undegraded":"2024-04-19T02:20:08.993036+0000","last_fullsized":"2024-04-19T02:20:08.993036+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:52:59.151542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":55,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995211+0000","last_change":"2024-04-19T02:19:54.931669+0000","last_active":"2024-04-19T02:20:08.995211+0000","last_peered":"2024-04-19T02:20:08.995211+0000","last_clean":"2024-04-19T02:20:08.995211+0000","last_became_active":"2024-04-19T02:19:54.931435+0000","last_became_peered":"2024-04-19T02:19:54.931435+0000","last_unstale":"2024-04-19T02:20:08.995211+0000","last_undegraded":"2024-04-19T02:20:08.995211+0000","last_fullsized":"2024-04-19T02:20:08.995211+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:42:58.222802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992140+0000","last_change":"2024-04-19T02:19:54.924250+0000","last_active":"2024-04-19T02:20:08.992140+0000","last_peered":"2024-04-19T02:20:08.992140+0000","last_clean":"2024-04-19T02:20:08.992140+0000","last_became_active":"2024-04-19T02:19:54.923984+0000","last_became_peered":"2024-04-19T02:19:54.923984+0000","last_unstale":"2024-04-19T02:20:08.992140+0000","last_undegraded":"2024-04-19T02:20:08.992140+0000","last_fullsized":"2024-04-19T02:20:08.992140+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:56:51.290239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992724+0000","last_change":"2024-04-19T02:19:54.926647+0000","last_active":"2024-04-19T02:20:08.992724+0000","last_peered":"2024-04-19T02:20:08.992724+0000","last_clean":"2024-04-19T02:20:08.992724+0000","last_became_active":"2024-04-19T02:19:54.925529+0000","last_became_peered":"2024-04-19T02:19:54.925529+0000","last_unstale":"2024-04-19T02:20:08.992724+0000","last_undegraded":"2024-04-19T02:20:08.992724+0000","last_fullsized":"2024-04-19T02:20:08.992724+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:49:06.911557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993273+0000","last_change":"2024-04-19T02:19:54.930828+0000","last_active":"2024-04-19T02:20:08.993273+0000","last_peered":"2024-04-19T02:20:08.993273+0000","last_clean":"2024-04-19T02:20:08.993273+0000","last_became_active":"2024-04-19T02:19:54.930075+0000","last_became_peered":"2024-04-19T02:19:54.930075+0000","last_unstale":"2024-04-19T02:20:08.993273+0000","last_undegraded":"2024-04-19T02:20:08.993273+0000","last_fullsized":"2024-04-19T02:20:08.993273+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:00.512431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.991008+0000","last_change":"2024-04-19T02:19:54.931617+0000","last_active":"2024-04-19T02:20:08.991008+0000","last_peered":"2024-04-19T02:20:08.991008+0000","last_clean":"2024-04-19T02:20:08.991008+0000","last_became_active":"2024-04-19T02:19:54.928496+0000","last_became_peered":"2024-04-19T02:19:54.928496+0000","last_unstale":"2024-04-19T02:20:08.991008+0000","last_undegraded":"2024-04-19T02:20:08.991008+0000","last_fullsized":"2024-04-19T02:20:08.991008+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:56:50.232031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":60,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993489+0000","last_change":"2024-04-19T02:16:30.093524+0000","last_active":"2024-04-19T02:20:08.993489+0000","last_peered":"2024-04-19T02:20:08.993489+0000","last_clean":"2024-04-19T02:20:08.993489+0000","last_became_active":"2024-04-19T02:16:30.093344+0000","last_became_peered":"2024-04-19T02:16:30.093344+0000","last_unstale":"2024-04-19T02:20:08.993489+0000","last_undegraded":"2024-04-19T02:20:08.993489+0000","last_fullsized":"2024-04-19T02:20:08.993489+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:14:40.293159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993069+0000","last_change":"2024-04-19T02:19:54.926754+0000","last_active":"2024-04-19T02:20:08.993069+0000","last_peered":"2024-04-19T02:20:08.993069+0000","last_clean":"2024-04-19T02:20:08.993069+0000","last_became_active":"2024-04-19T02:19:54.926040+0000","last_became_peered":"2024-04-19T02:19:54.926040+0000","last_unstale":"2024-04-19T02:20:08.993069+0000","last_undegraded":"2024-04-19T02:20:08.993069+0000","last_fullsized":"2024-04-19T02:20:08.993069+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:36:16.313500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995212+0000","last_change":"2024-04-19T02:20:08.662601+0000","last_active":"2024-04-19T02:20:08.995212+0000","last_peered":"2024-04-19T02:20:08.995212+0000","last_clean":"2024-04-19T02:20:08.995212+0000","last_became_active":"2024-04-19T02:20:08.662234+0000","last_became_peered":"2024-04-19T02:20:08.662234+0000","last_unstale":"2024-04-19T02:20:08.995212+0000","last_undegraded":"2024-04-19T02:20:08.995212+0000","last_fullsized":"2024-04-19T02:20:08.995212+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:34:06.694985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":55,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995768+0000","last_change":"2024-04-19T02:19:54.932576+0000","last_active":"2024-04-19T02:20:08.995768+0000","last_peered":"2024-04-19T02:20:08.995768+0000","last_clean":"2024-04-19T02:20:08.995768+0000","last_became_active":"2024-04-19T02:19:54.932240+0000","last_became_peered":"2024-04-19T02:19:54.932240+0000","last_unstale":"2024-04-19T02:20:08.995768+0000","last_undegraded":"2024-04-19T02:20:08.995768+0000","last_fullsized":"2024-04-19T02:20:08.995768+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:10:10.453676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":79,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637354+0000","last_change":"2024-04-19T02:15:29.284262+0000","last_active":"2024-04-19T02:20:10.637354+0000","last_peered":"2024-04-19T02:20:10.637354+0000","last_clean":"2024-04-19T02:20:10.637354+0000","last_became_active":"2024-04-19T02:15:29.283121+0000","last_became_peered":"2024-04-19T02:15:29.283121+0000","last_unstale":"2024-04-19T02:20:10.637354+0000","last_undegraded":"2024-04-19T02:20:10.637354+0000","last_fullsized":"2024-04-19T02:20:10.637354+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":79,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637524+0000","last_change":"2024-04-19T02:15:29.285139+0000","last_active":"2024-04-19T02:20:10.637524+0000","last_peered":"2024-04-19T02:20:10.637524+0000","last_clean":"2024-04-19T02:20:10.637524+0000","last_became_active":"2024-04-19T02:15:29.284649+0000","last_became_peered":"2024-04-19T02:15:29.284649+0000","last_unstale":"2024-04-19T02:20:10.637524+0000","last_undegraded":"2024-04-19T02:20:10.637524+0000","last_fullsized":"2024-04-19T02:20:10.637524+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637088+0000","last_change":"2024-04-19T02:19:54.931033+0000","last_active":"2024-04-19T02:20:10.637088+0000","last_peered":"2024-04-19T02:20:10.637088+0000","last_clean":"2024-04-19T02:20:10.637088+0000","last_became_active":"2024-04-19T02:19:54.930437+0000","last_became_peered":"2024-04-19T02:19:54.930437+0000","last_unstale":"2024-04-19T02:20:10.637088+0000","last_undegraded":"2024-04-19T02:20:10.637088+0000","last_fullsized":"2024-04-19T02:20:10.637088+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:44:05.807254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.001650+0000","last_change":"2024-04-19T02:20:10.001650+0000","last_active":"2024-04-19T02:20:10.001650+0000","last_peered":"2024-04-19T02:20:10.001650+0000","last_clean":"2024-04-19T02:20:10.001650+0000","last_became_active":"2024-04-19T02:20:10.001343+0000","last_became_peered":"2024-04-19T02:20:10.001343+0000","last_unstale":"2024-04-19T02:20:10.001650+0000","last_undegraded":"2024-04-19T02:20:10.001650+0000","last_fullsized":"2024-04-19T02:20:10.001650+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:15:54.452503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.858101+0000","last_change":"2024-04-19T02:19:54.933452+0000","last_active":"2024-04-19T02:20:09.858101+0000","last_peered":"2024-04-19T02:20:09.858101+0000","last_clean":"2024-04-19T02:20:09.858101+0000","last_became_active":"2024-04-19T02:19:54.933233+0000","last_became_peered":"2024-04-19T02:19:54.933233+0000","last_unstale":"2024-04-19T02:20:09.858101+0000","last_undegraded":"2024-04-19T02:20:09.858101+0000","last_fullsized":"2024-04-19T02:20:09.858101+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:50.712874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.990125+0000","last_change":"2024-04-19T02:19:54.925745+0000","last_active":"2024-04-19T02:20:08.990125+0000","last_peered":"2024-04-19T02:20:08.990125+0000","last_clean":"2024-04-19T02:20:08.990125+0000","last_became_active":"2024-04-19T02:19:54.925060+0000","last_became_peered":"2024-04-19T02:19:54.925060+0000","last_unstale":"2024-04-19T02:20:08.990125+0000","last_undegraded":"2024-04-19T02:20:08.990125+0000","last_fullsized":"2024-04-19T02:20:08.990125+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:12:43.617806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992995+0000","last_change":"2024-04-19T02:19:54.927206+0000","last_active":"2024-04-19T02:20:08.992995+0000","last_peered":"2024-04-19T02:20:08.992995+0000","last_clean":"2024-04-19T02:20:08.992995+0000","last_became_active":"2024-04-19T02:19:54.926442+0000","last_became_peered":"2024-04-19T02:19:54.926442+0000","last_unstale":"2024-04-19T02:20:08.992995+0000","last_undegraded":"2024-04-19T02:20:08.992995+0000","last_fullsized":"2024-04-19T02:20:08.992995+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:27:17.095030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992632+0000","last_change":"2024-04-19T02:19:54.932532+0000","last_active":"2024-04-19T02:20:08.992632+0000","last_peered":"2024-04-19T02:20:08.992632+0000","last_clean":"2024-04-19T02:20:08.992632+0000","last_became_active":"2024-04-19T02:19:54.931438+0000","last_became_peered":"2024-04-19T02:19:54.931438+0000","last_unstale":"2024-04-19T02:20:08.992632+0000","last_undegraded":"2024-04-19T02:20:08.992632+0000","last_fullsized":"2024-04-19T02:20:08.992632+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:12:54.241778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995945+0000","last_change":"2024-04-19T02:20:08.662261+0000","last_active":"2024-04-19T02:20:08.995945+0000","last_peered":"2024-04-19T02:20:08.995945+0000","last_clean":"2024-04-19T02:20:08.995945+0000","last_became_active":"2024-04-19T02:20:08.661940+0000","last_became_peered":"2024-04-19T02:20:08.661940+0000","last_unstale":"2024-04-19T02:20:08.995945+0000","last_undegraded":"2024-04-19T02:20:08.995945+0000","last_fullsized":"2024-04-19T02:20:08.995945+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:49:34.835266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.639368+0000","last_change":"2024-04-19T02:20:10.639368+0000","last_active":"2024-04-19T02:20:10.639368+0000","last_peered":"2024-04-19T02:20:10.639368+0000","last_clean":"2024-04-19T02:20:10.639368+0000","last_became_active":"2024-04-19T02:20:10.639036+0000","last_became_peered":"2024-04-19T02:20:10.639036+0000","last_unstale":"2024-04-19T02:20:10.639368+0000","last_undegraded":"2024-04-19T02:20:10.639368+0000","last_fullsized":"2024-04-19T02:20:10.639368+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:36:45.316530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996035+0000","last_change":"2024-04-19T02:19:54.928467+0000","last_active":"2024-04-19T02:20:08.996035+0000","last_peered":"2024-04-19T02:20:08.996035+0000","last_clean":"2024-04-19T02:20:08.996035+0000","last_became_active":"2024-04-19T02:19:54.928261+0000","last_became_peered":"2024-04-19T02:19:54.928261+0000","last_unstale":"2024-04-19T02:20:08.996035+0000","last_undegraded":"2024-04-19T02:20:08.996035+0000","last_fullsized":"2024-04-19T02:20:08.996035+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:40:43.645134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996795+0000","last_change":"2024-04-19T02:15:29.278084+0000","last_active":"2024-04-19T02:20:08.996795+0000","last_peered":"2024-04-19T02:20:08.996795+0000","last_clean":"2024-04-19T02:20:08.996795+0000","last_became_active":"2024-04-19T02:15:29.276952+0000","last_became_peered":"2024-04-19T02:15:29.276952+0000","last_unstale":"2024-04-19T02:20:08.996795+0000","last_undegraded":"2024-04-19T02:20:08.996795+0000","last_fullsized":"2024-04-19T02:20:08.996795+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.991888+0000","last_change":"2024-04-19T02:19:54.933154+0000","last_active":"2024-04-19T02:20:08.991888+0000","last_peered":"2024-04-19T02:20:08.991888+0000","last_clean":"2024-04-19T02:20:08.991888+0000","last_became_active":"2024-04-19T02:19:54.931124+0000","last_became_peered":"2024-04-19T02:19:54.931124+0000","last_unstale":"2024-04-19T02:20:08.991888+0000","last_undegraded":"2024-04-19T02:20:08.991888+0000","last_fullsized":"2024-04-19T02:20:08.991888+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:49.555501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993130+0000","last_change":"2024-04-19T02:15:29.287389+0000","last_active":"2024-04-19T02:20:08.993130+0000","last_peered":"2024-04-19T02:20:08.993130+0000","last_clean":"2024-04-19T02:20:08.993130+0000","last_became_active":"2024-04-19T02:15:29.286431+0000","last_became_peered":"2024-04-19T02:15:29.286431+0000","last_unstale":"2024-04-19T02:20:08.993130+0000","last_undegraded":"2024-04-19T02:20:08.993130+0000","last_fullsized":"2024-04-19T02:20:08.993130+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:58:30.117887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":57,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995777+0000","last_change":"2024-04-19T02:19:54.927108+0000","last_active":"2024-04-19T02:20:08.995777+0000","last_peered":"2024-04-19T02:20:08.995777+0000","last_clean":"2024-04-19T02:20:08.995777+0000","last_became_active":"2024-04-19T02:19:54.926838+0000","last_became_peered":"2024-04-19T02:19:54.926838+0000","last_unstale":"2024-04-19T02:20:08.995777+0000","last_undegraded":"2024-04-19T02:20:08.995777+0000","last_fullsized":"2024-04-19T02:20:08.995777+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:25:27.561607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":77,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996790+0000","last_change":"2024-04-19T02:15:29.281792+0000","last_active":"2024-04-19T02:20:08.996790+0000","last_peered":"2024-04-19T02:20:08.996790+0000","last_clean":"2024-04-19T02:20:08.996790+0000","last_became_active":"2024-04-19T02:15:29.280479+0000","last_became_peered":"2024-04-19T02:15:29.280479+0000","last_unstale":"2024-04-19T02:20:08.996790+0000","last_undegraded":"2024-04-19T02:20:08.996790+0000","last_fullsized":"2024-04-19T02:20:08.996790+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.989269+0000","last_change":"2024-04-19T02:19:54.925277+0000","last_active":"2024-04-19T02:20:08.989269+0000","last_peered":"2024-04-19T02:20:08.989269+0000","last_clean":"2024-04-19T02:20:08.989269+0000","last_became_active":"2024-04-19T02:19:54.924484+0000","last_became_peered":"2024-04-19T02:19:54.924484+0000","last_unstale":"2024-04-19T02:20:08.989269+0000","last_undegraded":"2024-04-19T02:20:08.989269+0000","last_fullsized":"2024-04-19T02:20:08.989269+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:57:54.845371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.639077+0000","last_change":"2024-04-19T02:20:10.639077+0000","last_active":"2024-04-19T02:20:10.639077+0000","last_peered":"2024-04-19T02:20:10.639077+0000","last_clean":"2024-04-19T02:20:10.639077+0000","last_became_active":"2024-04-19T02:20:10.638737+0000","last_became_peered":"2024-04-19T02:20:10.638737+0000","last_unstale":"2024-04-19T02:20:10.639077+0000","last_undegraded":"2024-04-19T02:20:10.639077+0000","last_fullsized":"2024-04-19T02:20:10.639077+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:20:05.200768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.989517+0000","last_change":"2024-04-19T02:19:54.930346+0000","last_active":"2024-04-19T02:20:08.989517+0000","last_peered":"2024-04-19T02:20:08.989517+0000","last_clean":"2024-04-19T02:20:08.989517+0000","last_became_active":"2024-04-19T02:19:54.928398+0000","last_became_peered":"2024-04-19T02:19:54.928398+0000","last_unstale":"2024-04-19T02:20:08.989517+0000","last_undegraded":"2024-04-19T02:20:08.989517+0000","last_fullsized":"2024-04-19T02:20:08.989517+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:46.321275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996446+0000","last_change":"2024-04-19T02:15:29.280879+0000","last_active":"2024-04-19T02:20:08.996446+0000","last_peered":"2024-04-19T02:20:08.996446+0000","last_clean":"2024-04-19T02:20:08.996446+0000","last_became_active":"2024-04-19T02:15:29.279314+0000","last_became_peered":"2024-04-19T02:15:29.279314+0000","last_unstale":"2024-04-19T02:20:08.996446+0000","last_undegraded":"2024-04-19T02:20:08.996446+0000","last_fullsized":"2024-04-19T02:20:08.996446+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.991148+0000","last_change":"2024-04-19T02:19:54.927744+0000","last_active":"2024-04-19T02:20:08.991148+0000","last_peered":"2024-04-19T02:20:08.991148+0000","last_clean":"2024-04-19T02:20:08.991148+0000","last_became_active":"2024-04-19T02:19:54.925729+0000","last_became_peered":"2024-04-19T02:19:54.925729+0000","last_unstale":"2024-04-19T02:20:08.991148+0000","last_undegraded":"2024-04-19T02:20:08.991148+0000","last_fullsized":"2024-04-19T02:20:08.991148+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:27:57.229684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.989293+0000","last_change":"2024-04-19T02:19:54.928435+0000","last_active":"2024-04-19T02:20:08.989293+0000","last_peered":"2024-04-19T02:20:08.989293+0000","last_clean":"2024-04-19T02:20:08.989293+0000","last_became_active":"2024-04-19T02:19:54.927666+0000","last_became_peered":"2024-04-19T02:19:54.927666+0000","last_unstale":"2024-04-19T02:20:08.989293+0000","last_undegraded":"2024-04-19T02:20:08.989293+0000","last_fullsized":"2024-04-19T02:20:08.989293+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:20:45.000808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993622+0000","last_change":"2024-04-19T02:19:54.932025+0000","last_active":"2024-04-19T02:20:08.993622+0000","last_peered":"2024-04-19T02:20:08.993622+0000","last_clean":"2024-04-19T02:20:08.993622+0000","last_became_active":"2024-04-19T02:19:54.931540+0000","last_became_peered":"2024-04-19T02:19:54.931540+0000","last_unstale":"2024-04-19T02:20:08.993622+0000","last_undegraded":"2024-04-19T02:20:08.993622+0000","last_fullsized":"2024-04-19T02:20:08.993622+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:03:31.479331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.991173+0000","last_change":"2024-04-19T02:19:54.924493+0000","last_active":"2024-04-19T02:20:08.991173+0000","last_peered":"2024-04-19T02:20:08.991173+0000","last_clean":"2024-04-19T02:20:08.991173+0000","last_became_active":"2024-04-19T02:19:54.923784+0000","last_became_peered":"2024-04-19T02:19:54.923784+0000","last_unstale":"2024-04-19T02:20:08.991173+0000","last_undegraded":"2024-04-19T02:20:08.991173+0000","last_fullsized":"2024-04-19T02:20:08.991173+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:09:34.378788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":81,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996234+0000","last_change":"2024-04-19T02:15:28.892937+0000","last_active":"2024-04-19T02:20:08.996234+0000","last_peered":"2024-04-19T02:20:08.996234+0000","last_clean":"2024-04-19T02:20:08.996234+0000","last_became_active":"2024-04-19T02:15:28.891440+0000","last_became_peered":"2024-04-19T02:15:28.891440+0000","last_unstale":"2024-04-19T02:20:08.996234+0000","last_undegraded":"2024-04-19T02:20:08.996234+0000","last_fullsized":"2024-04-19T02:20:08.996234+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.989329+0000","last_change":"2024-04-19T02:19:54.923898+0000","last_active":"2024-04-19T02:20:08.989329+0000","last_peered":"2024-04-19T02:20:08.989329+0000","last_clean":"2024-04-19T02:20:08.989329+0000","last_became_active":"2024-04-19T02:19:54.923493+0000","last_became_peered":"2024-04-19T02:19:54.923493+0000","last_unstale":"2024-04-19T02:20:08.989329+0000","last_undegraded":"2024-04-19T02:20:08.989329+0000","last_fullsized":"2024-04-19T02:20:08.989329+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:33.123319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":86,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637637+0000","last_change":"2024-04-19T02:15:28.891097+0000","last_active":"2024-04-19T02:20:10.637637+0000","last_peered":"2024-04-19T02:20:10.637637+0000","last_clean":"2024-04-19T02:20:10.637637+0000","last_became_active":"2024-04-19T02:15:28.890795+0000","last_became_peered":"2024-04-19T02:15:28.890795+0000","last_unstale":"2024-04-19T02:20:10.637637+0000","last_undegraded":"2024-04-19T02:20:10.637637+0000","last_fullsized":"2024-04-19T02:20:10.637637+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":79,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637625+0000","last_change":"2024-04-19T02:15:29.278546+0000","last_active":"2024-04-19T02:20:10.637625+0000","last_peered":"2024-04-19T02:20:10.637625+0000","last_clean":"2024-04-19T02:20:10.637625+0000","last_became_active":"2024-04-19T02:15:29.277547+0000","last_became_peered":"2024-04-19T02:15:29.277547+0000","last_unstale":"2024-04-19T02:20:10.637625+0000","last_undegraded":"2024-04-19T02:20:10.637625+0000","last_fullsized":"2024-04-19T02:20:10.637625+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":95,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637628+0000","last_change":"2024-04-19T02:19:54.933035+0000","last_active":"2024-04-19T02:20:10.637628+0000","last_peered":"2024-04-19T02:20:10.637628+0000","last_clean":"2024-04-19T02:20:10.637628+0000","last_became_active":"2024-04-19T02:19:54.932829+0000","last_became_peered":"2024-04-19T02:19:54.932829+0000","last_unstale":"2024-04-19T02:20:10.637628+0000","last_undegraded":"2024-04-19T02:20:10.637628+0000","last_fullsized":"2024-04-19T02:20:10.637628+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:09:05.626623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":49,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.998175+0000","last_change":"2024-04-19T02:20:07.983368+0000","last_active":"2024-04-19T02:20:09.998175+0000","last_peered":"2024-04-19T02:20:09.998175+0000","last_clean":"2024-04-19T02:20:09.998175+0000","last_became_active":"2024-04-19T02:20:07.983080+0000","last_became_peered":"2024-04-19T02:20:07.983080+0000","last_unstale":"2024-04-19T02:20:09.998175+0000","last_undegraded":"2024-04-19T02:20:09.998175+0000","last_fullsized":"2024-04-19T02:20:09.998175+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:24.138269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.989479+0000","last_change":"2024-04-19T02:19:54.927323+0000","last_active":"2024-04-19T02:20:08.989479+0000","last_peered":"2024-04-19T02:20:08.989479+0000","last_clean":"2024-04-19T02:20:08.989479+0000","last_became_active":"2024-04-19T02:19:54.925703+0000","last_became_peered":"2024-04-19T02:19:54.925703+0000","last_unstale":"2024-04-19T02:20:08.989479+0000","last_undegraded":"2024-04-19T02:20:08.989479+0000","last_fullsized":"2024-04-19T02:20:08.989479+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:46:59.533765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":55,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996775+0000","last_change":"2024-04-19T02:19:54.925918+0000","last_active":"2024-04-19T02:20:08.996775+0000","last_peered":"2024-04-19T02:20:08.996775+0000","last_clean":"2024-04-19T02:20:08.996775+0000","last_became_active":"2024-04-19T02:19:54.925634+0000","last_became_peered":"2024-04-19T02:19:54.925634+0000","last_unstale":"2024-04-19T02:20:08.996775+0000","last_undegraded":"2024-04-19T02:20:08.996775+0000","last_fullsized":"2024-04-19T02:20:08.996775+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:14:13.074455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.857926+0000","last_change":"2024-04-19T02:15:28.892934+0000","last_active":"2024-04-19T02:20:09.857926+0000","last_peered":"2024-04-19T02:20:09.857926+0000","last_clean":"2024-04-19T02:20:09.857926+0000","last_became_active":"2024-04-19T02:15:28.891879+0000","last_became_peered":"2024-04-19T02:15:28.891879+0000","last_unstale":"2024-04-19T02:20:09.857926+0000","last_undegraded":"2024-04-19T02:20:09.857926+0000","last_fullsized":"2024-04-19T02:20:09.857926+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:10:12.514798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.639094+0000","last_change":"2024-04-19T02:20:10.639094+0000","last_active":"2024-04-19T02:20:10.639094+0000","last_peered":"2024-04-19T02:20:10.639094+0000","last_clean":"2024-04-19T02:20:10.639094+0000","last_became_active":"2024-04-19T02:20:10.638755+0000","last_became_peered":"2024-04-19T02:20:10.638755+0000","last_unstale":"2024-04-19T02:20:10.639094+0000","last_undegraded":"2024-04-19T02:20:10.639094+0000","last_fullsized":"2024-04-19T02:20:10.639094+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:37:46.274811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.858501+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:20:09.858501+0000","last_peered":"2024-04-19T02:20:09.858501+0000","last_clean":"2024-04-19T02:20:09.858501+0000","last_became_active":"2024-04-19T02:15:28.890882+0000","last_became_peered":"2024-04-19T02:15:28.890882+0000","last_unstale":"2024-04-19T02:20:09.858501+0000","last_undegraded":"2024-04-19T02:20:09.858501+0000","last_fullsized":"2024-04-19T02:20:09.858501+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:31.673938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.991948+0000","last_change":"2024-04-19T02:19:54.927209+0000","last_active":"2024-04-19T02:20:08.991948+0000","last_peered":"2024-04-19T02:20:08.991948+0000","last_clean":"2024-04-19T02:20:08.991948+0000","last_became_active":"2024-04-19T02:19:54.925121+0000","last_became_peered":"2024-04-19T02:19:54.925121+0000","last_unstale":"2024-04-19T02:20:08.991948+0000","last_undegraded":"2024-04-19T02:20:08.991948+0000","last_fullsized":"2024-04-19T02:20:08.991948+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:16:21.982909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":81,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993779+0000","last_change":"2024-04-19T02:15:28.890265+0000","last_active":"2024-04-19T02:20:08.993779+0000","last_peered":"2024-04-19T02:20:08.993779+0000","last_clean":"2024-04-19T02:20:08.993779+0000","last_became_active":"2024-04-19T02:15:28.890004+0000","last_became_peered":"2024-04-19T02:15:28.890004+0000","last_unstale":"2024-04-19T02:20:08.993779+0000","last_undegraded":"2024-04-19T02:20:08.993779+0000","last_fullsized":"2024-04-19T02:20:08.993779+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:02.517101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.994900+0000","last_change":"2024-04-19T02:15:29.285529+0000","last_active":"2024-04-19T02:20:08.994900+0000","last_peered":"2024-04-19T02:20:08.994900+0000","last_clean":"2024-04-19T02:20:08.994900+0000","last_became_active":"2024-04-19T02:15:29.285197+0000","last_became_peered":"2024-04-19T02:15:29.285197+0000","last_unstale":"2024-04-19T02:20:08.994900+0000","last_undegraded":"2024-04-19T02:20:08.994900+0000","last_fullsized":"2024-04-19T02:20:08.994900+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":81,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995996+0000","last_change":"2024-04-19T02:15:28.893902+0000","last_active":"2024-04-19T02:20:08.995996+0000","last_peered":"2024-04-19T02:20:08.995996+0000","last_clean":"2024-04-19T02:20:08.995996+0000","last_became_active":"2024-04-19T02:15:28.893231+0000","last_became_peered":"2024-04-19T02:15:28.893231+0000","last_unstale":"2024-04-19T02:20:08.995996+0000","last_undegraded":"2024-04-19T02:20:08.995996+0000","last_fullsized":"2024-04-19T02:20:08.995996+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:23.658442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996319+0000","last_change":"2024-04-19T02:19:54.925840+0000","last_active":"2024-04-19T02:20:08.996319+0000","last_peered":"2024-04-19T02:20:08.996319+0000","last_clean":"2024-04-19T02:20:08.996319+0000","last_became_active":"2024-04-19T02:19:54.925502+0000","last_became_peered":"2024-04-19T02:19:54.925502+0000","last_unstale":"2024-04-19T02:20:08.996319+0000","last_undegraded":"2024-04-19T02:20:08.996319+0000","last_fullsized":"2024-04-19T02:20:08.996319+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:57.667340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":81,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993204+0000","last_change":"2024-04-19T02:15:28.891234+0000","last_active":"2024-04-19T02:20:08.993204+0000","last_peered":"2024-04-19T02:20:08.993204+0000","last_clean":"2024-04-19T02:20:08.993204+0000","last_became_active":"2024-04-19T02:15:28.890881+0000","last_became_peered":"2024-04-19T02:15:28.890881+0000","last_unstale":"2024-04-19T02:20:08.993204+0000","last_undegraded":"2024-04-19T02:20:08.993204+0000","last_fullsized":"2024-04-19T02:20:08.993204+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992289+0000","last_change":"2024-04-19T02:19:54.926103+0000","last_active":"2024-04-19T02:20:08.992289+0000","last_peered":"2024-04-19T02:20:08.992289+0000","last_clean":"2024-04-19T02:20:08.992289+0000","last_became_active":"2024-04-19T02:19:54.925591+0000","last_became_peered":"2024-04-19T02:19:54.925591+0000","last_unstale":"2024-04-19T02:20:08.992289+0000","last_undegraded":"2024-04-19T02:20:08.992289+0000","last_fullsized":"2024-04-19T02:20:08.992289+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:44:40.560973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":93,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992481+0000","last_change":"2024-04-19T02:19:54.926813+0000","last_active":"2024-04-19T02:20:08.992481+0000","last_peered":"2024-04-19T02:20:08.992481+0000","last_clean":"2024-04-19T02:20:08.992481+0000","last_became_active":"2024-04-19T02:19:54.925523+0000","last_became_peered":"2024-04-19T02:19:54.925523+0000","last_unstale":"2024-04-19T02:20:08.992481+0000","last_undegraded":"2024-04-19T02:20:08.992481+0000","last_fullsized":"2024-04-19T02:20:08.992481+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:39:56.887385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.989835+0000","last_change":"2024-04-19T02:19:54.932306+0000","last_active":"2024-04-19T02:20:08.989835+0000","last_peered":"2024-04-19T02:20:08.989835+0000","last_clean":"2024-04-19T02:20:08.989835+0000","last_became_active":"2024-04-19T02:19:54.930843+0000","last_became_peered":"2024-04-19T02:19:54.930843+0000","last_unstale":"2024-04-19T02:20:08.989835+0000","last_undegraded":"2024-04-19T02:20:08.989835+0000","last_fullsized":"2024-04-19T02:20:08.989835+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:24:51.884048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.989655+0000","last_change":"2024-04-19T02:19:54.932708+0000","last_active":"2024-04-19T02:20:08.989655+0000","last_peered":"2024-04-19T02:20:08.989655+0000","last_clean":"2024-04-19T02:20:08.989655+0000","last_became_active":"2024-04-19T02:19:54.931553+0000","last_became_peered":"2024-04-19T02:19:54.931553+0000","last_unstale":"2024-04-19T02:20:08.989655+0000","last_undegraded":"2024-04-19T02:20:08.989655+0000","last_fullsized":"2024-04-19T02:20:08.989655+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:47:07.651618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992596+0000","last_change":"2024-04-19T02:19:54.927009+0000","last_active":"2024-04-19T02:20:08.992596+0000","last_peered":"2024-04-19T02:20:08.992596+0000","last_clean":"2024-04-19T02:20:08.992596+0000","last_became_active":"2024-04-19T02:19:54.925645+0000","last_became_peered":"2024-04-19T02:19:54.925645+0000","last_unstale":"2024-04-19T02:20:08.992596+0000","last_undegraded":"2024-04-19T02:20:08.992596+0000","last_fullsized":"2024-04-19T02:20:08.992596+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:33:45.685463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":93,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992170+0000","last_change":"2024-04-19T02:19:54.923689+0000","last_active":"2024-04-19T02:20:08.992170+0000","last_peered":"2024-04-19T02:20:08.992170+0000","last_clean":"2024-04-19T02:20:08.992170+0000","last_became_active":"2024-04-19T02:19:54.923321+0000","last_became_peered":"2024-04-19T02:19:54.923321+0000","last_unstale":"2024-04-19T02:20:08.992170+0000","last_undegraded":"2024-04-19T02:20:08.992170+0000","last_fullsized":"2024-04-19T02:20:08.992170+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:03:01.578244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993485+0000","last_change":"2024-04-19T02:15:29.285019+0000","last_active":"2024-04-19T02:20:08.993485+0000","last_peered":"2024-04-19T02:20:08.993485+0000","last_clean":"2024-04-19T02:20:08.993485+0000","last_became_active":"2024-04-19T02:15:29.284650+0000","last_became_peered":"2024-04-19T02:15:29.284650+0000","last_unstale":"2024-04-19T02:20:08.993485+0000","last_undegraded":"2024-04-19T02:20:08.993485+0000","last_fullsized":"2024-04-19T02:20:08.993485+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995102+0000","last_change":"2024-04-19T02:20:08.662566+0000","last_active":"2024-04-19T02:20:08.995102+0000","last_peered":"2024-04-19T02:20:08.995102+0000","last_clean":"2024-04-19T02:20:08.995102+0000","last_became_active":"2024-04-19T02:20:08.662277+0000","last_became_peered":"2024-04-19T02:20:08.662277+0000","last_unstale":"2024-04-19T02:20:08.995102+0000","last_undegraded":"2024-04-19T02:20:08.995102+0000","last_fullsized":"2024-04-19T02:20:08.995102+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:36:27.307955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993656+0000","last_change":"2024-04-19T02:15:29.287190+0000","last_active":"2024-04-19T02:20:08.993656+0000","last_peered":"2024-04-19T02:20:08.993656+0000","last_clean":"2024-04-19T02:20:08.993656+0000","last_became_active":"2024-04-19T02:15:29.286606+0000","last_became_peered":"2024-04-19T02:15:29.286606+0000","last_unstale":"2024-04-19T02:20:08.993656+0000","last_undegraded":"2024-04-19T02:20:08.993656+0000","last_fullsized":"2024-04-19T02:20:08.993656+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:28.387062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996306+0000","last_change":"2024-04-19T02:19:54.928493+0000","last_active":"2024-04-19T02:20:08.996306+0000","last_peered":"2024-04-19T02:20:08.996306+0000","last_clean":"2024-04-19T02:20:08.996306+0000","last_became_active":"2024-04-19T02:19:54.928298+0000","last_became_peered":"2024-04-19T02:19:54.928298+0000","last_unstale":"2024-04-19T02:20:08.996306+0000","last_undegraded":"2024-04-19T02:20:08.996306+0000","last_fullsized":"2024-04-19T02:20:08.996306+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:11:54.564261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.990650+0000","last_change":"2024-04-19T02:19:54.930452+0000","last_active":"2024-04-19T02:20:08.990650+0000","last_peered":"2024-04-19T02:20:08.990650+0000","last_clean":"2024-04-19T02:20:08.990650+0000","last_became_active":"2024-04-19T02:19:54.927309+0000","last_became_peered":"2024-04-19T02:19:54.927309+0000","last_unstale":"2024-04-19T02:20:08.990650+0000","last_undegraded":"2024-04-19T02:20:08.990650+0000","last_fullsized":"2024-04-19T02:20:08.990650+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:56:20.174957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.998998+0000","last_change":"2024-04-19T02:20:09.998998+0000","last_active":"2024-04-19T02:20:09.998998+0000","last_peered":"2024-04-19T02:20:09.998998+0000","last_clean":"2024-04-19T02:20:09.998998+0000","last_became_active":"2024-04-19T02:20:09.998776+0000","last_became_peered":"2024-04-19T02:20:09.998776+0000","last_unstale":"2024-04-19T02:20:09.998998+0000","last_undegraded":"2024-04-19T02:20:09.998998+0000","last_fullsized":"2024-04-19T02:20:09.998998+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:02:13.720846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":93,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993371+0000","last_change":"2024-04-19T02:19:54.926207+0000","last_active":"2024-04-19T02:20:08.993371+0000","last_peered":"2024-04-19T02:20:08.993371+0000","last_clean":"2024-04-19T02:20:08.993371+0000","last_became_active":"2024-04-19T02:19:54.925872+0000","last_became_peered":"2024-04-19T02:19:54.925872+0000","last_unstale":"2024-04-19T02:20:08.993371+0000","last_undegraded":"2024-04-19T02:20:08.993371+0000","last_fullsized":"2024-04-19T02:20:08.993371+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:31:46.734042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996171+0000","last_change":"2024-04-19T02:15:29.277922+0000","last_active":"2024-04-19T02:20:08.996171+0000","last_peered":"2024-04-19T02:20:08.996171+0000","last_clean":"2024-04-19T02:20:08.996171+0000","last_became_active":"2024-04-19T02:15:29.276968+0000","last_became_peered":"2024-04-19T02:15:29.276968+0000","last_unstale":"2024-04-19T02:20:08.996171+0000","last_undegraded":"2024-04-19T02:20:08.996171+0000","last_fullsized":"2024-04-19T02:20:08.996171+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":96,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992530+0000","last_change":"2024-04-19T02:19:54.927361+0000","last_active":"2024-04-19T02:20:08.992530+0000","last_peered":"2024-04-19T02:20:08.992530+0000","last_clean":"2024-04-19T02:20:08.992530+0000","last_became_active":"2024-04-19T02:19:54.927033+0000","last_became_peered":"2024-04-19T02:19:54.927033+0000","last_unstale":"2024-04-19T02:20:08.992530+0000","last_undegraded":"2024-04-19T02:20:08.992530+0000","last_fullsized":"2024-04-19T02:20:08.992530+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:07.194915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":93,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992757+0000","last_change":"2024-04-19T02:19:54.932790+0000","last_active":"2024-04-19T02:20:08.992757+0000","last_peered":"2024-04-19T02:20:08.992757+0000","last_clean":"2024-04-19T02:20:08.992757+0000","last_became_active":"2024-04-19T02:19:54.931683+0000","last_became_peered":"2024-04-19T02:19:54.931683+0000","last_unstale":"2024-04-19T02:20:08.992757+0000","last_undegraded":"2024-04-19T02:20:08.992757+0000","last_fullsized":"2024-04-19T02:20:08.992757+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:23:00.124845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.990653+0000","last_change":"2024-04-19T02:19:54.926109+0000","last_active":"2024-04-19T02:20:08.990653+0000","last_peered":"2024-04-19T02:20:08.990653+0000","last_clean":"2024-04-19T02:20:08.990653+0000","last_became_active":"2024-04-19T02:19:54.924686+0000","last_became_peered":"2024-04-19T02:19:54.924686+0000","last_unstale":"2024-04-19T02:20:08.990653+0000","last_undegraded":"2024-04-19T02:20:08.990653+0000","last_fullsized":"2024-04-19T02:20:08.990653+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:20:03.487999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.990873+0000","last_change":"2024-04-19T02:19:54.923465+0000","last_active":"2024-04-19T02:20:08.990873+0000","last_peered":"2024-04-19T02:20:08.990873+0000","last_clean":"2024-04-19T02:20:08.990873+0000","last_became_active":"2024-04-19T02:19:54.923164+0000","last_became_peered":"2024-04-19T02:19:54.923164+0000","last_unstale":"2024-04-19T02:20:08.990873+0000","last_undegraded":"2024-04-19T02:20:08.990873+0000","last_fullsized":"2024-04-19T02:20:08.990873+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:53:29.520848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995333+0000","last_change":"2024-04-19T02:20:08.662301+0000","last_active":"2024-04-19T02:20:08.995333+0000","last_peered":"2024-04-19T02:20:08.995333+0000","last_clean":"2024-04-19T02:20:08.995333+0000","last_became_active":"2024-04-19T02:20:08.661952+0000","last_became_peered":"2024-04-19T02:20:08.661952+0000","last_unstale":"2024-04-19T02:20:08.995333+0000","last_undegraded":"2024-04-19T02:20:08.995333+0000","last_fullsized":"2024-04-19T02:20:08.995333+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:41:21.658836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.991779+0000","last_change":"2024-04-19T02:19:54.930115+0000","last_active":"2024-04-19T02:20:08.991779+0000","last_peered":"2024-04-19T02:20:08.991779+0000","last_clean":"2024-04-19T02:20:08.991779+0000","last_became_active":"2024-04-19T02:19:54.926463+0000","last_became_peered":"2024-04-19T02:19:54.926463+0000","last_unstale":"2024-04-19T02:20:08.991779+0000","last_undegraded":"2024-04-19T02:20:08.991779+0000","last_fullsized":"2024-04-19T02:20:08.991779+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:00.191645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":96,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992852+0000","last_change":"2024-04-19T02:19:54.932929+0000","last_active":"2024-04-19T02:20:08.992852+0000","last_peered":"2024-04-19T02:20:08.992852+0000","last_clean":"2024-04-19T02:20:08.992852+0000","last_became_active":"2024-04-19T02:19:54.932571+0000","last_became_peered":"2024-04-19T02:19:54.932571+0000","last_unstale":"2024-04-19T02:20:08.992852+0000","last_undegraded":"2024-04-19T02:20:08.992852+0000","last_fullsized":"2024-04-19T02:20:08.992852+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:50:08.657036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":279,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993444+0000","last_change":"2024-04-19T02:15:24.533634+0000","last_active":"2024-04-19T02:20:08.993444+0000","last_peered":"2024-04-19T02:20:08.993444+0000","last_clean":"2024-04-19T02:20:08.993444+0000","last_became_active":"2024-04-19T02:15:24.533420+0000","last_became_peered":"2024-04-19T02:15:24.533420+0000","last_unstale":"2024-04-19T02:20:08.993444+0000","last_undegraded":"2024-04-19T02:20:08.993444+0000","last_fullsized":"2024-04-19T02:20:08.993444+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.001770+0000","last_change":"2024-04-19T02:20:10.001770+0000","last_active":"2024-04-19T02:20:10.001770+0000","last_peered":"2024-04-19T02:20:10.001770+0000","last_clean":"2024-04-19T02:20:10.001770+0000","last_became_active":"2024-04-19T02:20:10.001415+0000","last_became_peered":"2024-04-19T02:20:10.001415+0000","last_unstale":"2024-04-19T02:20:10.001770+0000","last_undegraded":"2024-04-19T02:20:10.001770+0000","last_fullsized":"2024-04-19T02:20:10.001770+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:00:30.084474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993420+0000","last_change":"2024-04-19T02:15:29.285015+0000","last_active":"2024-04-19T02:20:08.993420+0000","last_peered":"2024-04-19T02:20:08.993420+0000","last_clean":"2024-04-19T02:20:08.993420+0000","last_became_active":"2024-04-19T02:15:29.284164+0000","last_became_peered":"2024-04-19T02:15:29.284164+0000","last_unstale":"2024-04-19T02:20:08.993420+0000","last_undegraded":"2024-04-19T02:20:08.993420+0000","last_fullsized":"2024-04-19T02:20:08.993420+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:36.987844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":83,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993579+0000","last_change":"2024-04-19T02:15:24.533912+0000","last_active":"2024-04-19T02:20:08.993579+0000","last_peered":"2024-04-19T02:20:08.993579+0000","last_clean":"2024-04-19T02:20:08.993579+0000","last_became_active":"2024-04-19T02:15:24.533580+0000","last_became_peered":"2024-04-19T02:15:24.533580+0000","last_unstale":"2024-04-19T02:20:08.993579+0000","last_undegraded":"2024-04-19T02:20:08.993579+0000","last_fullsized":"2024-04-19T02:20:08.993579+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:45.045477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.639268+0000","last_change":"2024-04-19T02:20:10.639268+0000","last_active":"2024-04-19T02:20:10.639268+0000","last_peered":"2024-04-19T02:20:10.639268+0000","last_clean":"2024-04-19T02:20:10.639268+0000","last_became_active":"2024-04-19T02:20:10.638966+0000","last_became_peered":"2024-04-19T02:20:10.638966+0000","last_unstale":"2024-04-19T02:20:10.639268+0000","last_undegraded":"2024-04-19T02:20:10.639268+0000","last_fullsized":"2024-04-19T02:20:10.639268+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:38.164641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":49,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996215+0000","last_change":"2024-04-19T02:20:07.986363+0000","last_active":"2024-04-19T02:20:08.996215+0000","last_peered":"2024-04-19T02:20:08.996215+0000","last_clean":"2024-04-19T02:20:08.996215+0000","last_became_active":"2024-04-19T02:20:07.986110+0000","last_became_peered":"2024-04-19T02:20:07.986110+0000","last_unstale":"2024-04-19T02:20:08.996215+0000","last_undegraded":"2024-04-19T02:20:08.996215+0000","last_fullsized":"2024-04-19T02:20:08.996215+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:12.545910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":60,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996406+0000","last_change":"2024-04-19T02:19:54.925886+0000","last_active":"2024-04-19T02:20:08.996406+0000","last_peered":"2024-04-19T02:20:08.996406+0000","last_clean":"2024-04-19T02:20:08.996406+0000","last_became_active":"2024-04-19T02:19:54.925570+0000","last_became_peered":"2024-04-19T02:19:54.925570+0000","last_unstale":"2024-04-19T02:20:08.996406+0000","last_undegraded":"2024-04-19T02:20:08.996406+0000","last_fullsized":"2024-04-19T02:20:08.996406+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:33:34.594161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.990045+0000","last_change":"2024-04-19T02:19:54.933960+0000","last_active":"2024-04-19T02:20:08.990045+0000","last_peered":"2024-04-19T02:20:08.990045+0000","last_clean":"2024-04-19T02:20:08.990045+0000","last_became_active":"2024-04-19T02:19:54.929918+0000","last_became_peered":"2024-04-19T02:19:54.929918+0000","last_unstale":"2024-04-19T02:20:08.990045+0000","last_undegraded":"2024-04-19T02:20:08.990045+0000","last_fullsized":"2024-04-19T02:20:08.990045+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:33:10.282684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995346+0000","last_change":"2024-04-19T02:15:29.281694+0000","last_active":"2024-04-19T02:20:08.995346+0000","last_peered":"2024-04-19T02:20:08.995346+0000","last_clean":"2024-04-19T02:20:08.995346+0000","last_became_active":"2024-04-19T02:15:29.280519+0000","last_became_peered":"2024-04-19T02:15:29.280519+0000","last_unstale":"2024-04-19T02:20:08.995346+0000","last_undegraded":"2024-04-19T02:20:08.995346+0000","last_fullsized":"2024-04-19T02:20:08.995346+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:50.890545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.990434+0000","last_change":"2024-04-19T02:19:54.931726+0000","last_active":"2024-04-19T02:20:08.990434+0000","last_peered":"2024-04-19T02:20:08.990434+0000","last_clean":"2024-04-19T02:20:08.990434+0000","last_became_active":"2024-04-19T02:19:54.928460+0000","last_became_peered":"2024-04-19T02:19:54.928460+0000","last_unstale":"2024-04-19T02:20:08.990434+0000","last_undegraded":"2024-04-19T02:20:08.990434+0000","last_fullsized":"2024-04-19T02:20:08.990434+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:07:04.935620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.998879+0000","last_change":"2024-04-19T02:20:09.998879+0000","last_active":"2024-04-19T02:20:09.998879+0000","last_peered":"2024-04-19T02:20:09.998879+0000","last_clean":"2024-04-19T02:20:09.998879+0000","last_became_active":"2024-04-19T02:20:09.998629+0000","last_became_peered":"2024-04-19T02:20:09.998629+0000","last_unstale":"2024-04-19T02:20:09.998879+0000","last_undegraded":"2024-04-19T02:20:09.998879+0000","last_fullsized":"2024-04-19T02:20:09.998879+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:38:00.584717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.639272+0000","last_change":"2024-04-19T02:20:10.639272+0000","last_active":"2024-04-19T02:20:10.639272+0000","last_peered":"2024-04-19T02:20:10.639272+0000","last_clean":"2024-04-19T02:20:10.639272+0000","last_became_active":"2024-04-19T02:20:10.638912+0000","last_became_peered":"2024-04-19T02:20:10.638912+0000","last_unstale":"2024-04-19T02:20:10.639272+0000","last_undegraded":"2024-04-19T02:20:10.639272+0000","last_fullsized":"2024-04-19T02:20:10.639272+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:19.396777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":83,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993846+0000","last_change":"2024-04-19T02:15:24.533777+0000","last_active":"2024-04-19T02:20:08.993846+0000","last_peered":"2024-04-19T02:20:08.993846+0000","last_clean":"2024-04-19T02:20:08.993846+0000","last_became_active":"2024-04-19T02:15:24.533436+0000","last_became_peered":"2024-04-19T02:15:24.533436+0000","last_unstale":"2024-04-19T02:20:08.993846+0000","last_undegraded":"2024-04-19T02:20:08.993846+0000","last_fullsized":"2024-04-19T02:20:08.993846+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:53:25.922418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.990547+0000","last_change":"2024-04-19T02:19:54.933278+0000","last_active":"2024-04-19T02:20:08.990547+0000","last_peered":"2024-04-19T02:20:08.990547+0000","last_clean":"2024-04-19T02:20:08.990547+0000","last_became_active":"2024-04-19T02:19:54.931328+0000","last_became_peered":"2024-04-19T02:19:54.931328+0000","last_unstale":"2024-04-19T02:20:08.990547+0000","last_undegraded":"2024-04-19T02:20:08.990547+0000","last_fullsized":"2024-04-19T02:20:08.990547+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:08:38.731741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996195+0000","last_change":"2024-04-19T02:15:29.282244+0000","last_active":"2024-04-19T02:20:08.996195+0000","last_peered":"2024-04-19T02:20:08.996195+0000","last_clean":"2024-04-19T02:20:08.996195+0000","last_became_active":"2024-04-19T02:15:29.280366+0000","last_became_peered":"2024-04-19T02:15:29.280366+0000","last_unstale":"2024-04-19T02:20:08.996195+0000","last_undegraded":"2024-04-19T02:20:08.996195+0000","last_fullsized":"2024-04-19T02:20:08.996195+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995650+0000","last_change":"2024-04-19T02:15:28.893027+0000","last_active":"2024-04-19T02:20:08.995650+0000","last_peered":"2024-04-19T02:20:08.995650+0000","last_clean":"2024-04-19T02:20:08.995650+0000","last_became_active":"2024-04-19T02:15:28.892695+0000","last_became_peered":"2024-04-19T02:15:28.892695+0000","last_unstale":"2024-04-19T02:20:08.995650+0000","last_undegraded":"2024-04-19T02:20:08.995650+0000","last_fullsized":"2024-04-19T02:20:08.995650+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996179+0000","last_change":"2024-04-19T02:19:54.929648+0000","last_active":"2024-04-19T02:20:08.996179+0000","last_peered":"2024-04-19T02:20:08.996179+0000","last_clean":"2024-04-19T02:20:08.996179+0000","last_became_active":"2024-04-19T02:19:54.929412+0000","last_became_peered":"2024-04-19T02:19:54.929412+0000","last_unstale":"2024-04-19T02:20:08.996179+0000","last_undegraded":"2024-04-19T02:20:08.996179+0000","last_fullsized":"2024-04-19T02:20:08.996179+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:28:21.688550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":94,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992761+0000","last_change":"2024-04-19T02:19:54.927315+0000","last_active":"2024-04-19T02:20:08.992761+0000","last_peered":"2024-04-19T02:20:08.992761+0000","last_clean":"2024-04-19T02:20:08.992761+0000","last_became_active":"2024-04-19T02:19:54.926630+0000","last_became_peered":"2024-04-19T02:19:54.926630+0000","last_unstale":"2024-04-19T02:20:08.992761+0000","last_undegraded":"2024-04-19T02:20:08.992761+0000","last_fullsized":"2024-04-19T02:20:08.992761+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:39:00.822558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992698+0000","last_change":"2024-04-19T02:19:54.931920+0000","last_active":"2024-04-19T02:20:08.992698+0000","last_peered":"2024-04-19T02:20:08.992698+0000","last_clean":"2024-04-19T02:20:08.992698+0000","last_became_active":"2024-04-19T02:19:54.931328+0000","last_became_peered":"2024-04-19T02:19:54.931328+0000","last_unstale":"2024-04-19T02:20:08.992698+0000","last_undegraded":"2024-04-19T02:20:08.992698+0000","last_fullsized":"2024-04-19T02:20:08.992698+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:39.655376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":80,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996399+0000","last_change":"2024-04-19T02:15:28.893239+0000","last_active":"2024-04-19T02:20:08.996399+0000","last_peered":"2024-04-19T02:20:08.996399+0000","last_clean":"2024-04-19T02:20:08.996399+0000","last_became_active":"2024-04-19T02:15:28.892881+0000","last_became_peered":"2024-04-19T02:15:28.892881+0000","last_unstale":"2024-04-19T02:20:08.996399+0000","last_undegraded":"2024-04-19T02:20:08.996399+0000","last_fullsized":"2024-04-19T02:20:08.996399+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992227+0000","last_change":"2024-04-19T02:19:54.924029+0000","last_active":"2024-04-19T02:20:08.992227+0000","last_peered":"2024-04-19T02:20:08.992227+0000","last_clean":"2024-04-19T02:20:08.992227+0000","last_became_active":"2024-04-19T02:19:54.923752+0000","last_became_peered":"2024-04-19T02:19:54.923752+0000","last_unstale":"2024-04-19T02:20:08.992227+0000","last_undegraded":"2024-04-19T02:20:08.992227+0000","last_fullsized":"2024-04-19T02:20:08.992227+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:26:41.825722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.990448+0000","last_change":"2024-04-19T02:19:54.933652+0000","last_active":"2024-04-19T02:20:08.990448+0000","last_peered":"2024-04-19T02:20:08.990448+0000","last_clean":"2024-04-19T02:20:08.990448+0000","last_became_active":"2024-04-19T02:19:54.932103+0000","last_became_peered":"2024-04-19T02:19:54.932103+0000","last_unstale":"2024-04-19T02:20:08.990448+0000","last_undegraded":"2024-04-19T02:20:08.990448+0000","last_fullsized":"2024-04-19T02:20:08.990448+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:46:14.540427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996400+0000","last_change":"2024-04-19T02:19:54.925832+0000","last_active":"2024-04-19T02:20:08.996400+0000","last_peered":"2024-04-19T02:20:08.996400+0000","last_clean":"2024-04-19T02:20:08.996400+0000","last_became_active":"2024-04-19T02:19:54.925565+0000","last_became_peered":"2024-04-19T02:19:54.925565+0000","last_unstale":"2024-04-19T02:20:08.996400+0000","last_undegraded":"2024-04-19T02:20:08.996400+0000","last_fullsized":"2024-04-19T02:20:08.996400+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:28:13.380027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.990549+0000","last_change":"2024-04-19T02:19:54.929083+0000","last_active":"2024-04-19T02:20:08.990549+0000","last_peered":"2024-04-19T02:20:08.990549+0000","last_clean":"2024-04-19T02:20:08.990549+0000","last_became_active":"2024-04-19T02:19:54.926439+0000","last_became_peered":"2024-04-19T02:19:54.926439+0000","last_unstale":"2024-04-19T02:20:08.990549+0000","last_undegraded":"2024-04-19T02:20:08.990549+0000","last_fullsized":"2024-04-19T02:20:08.990549+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:15:04.675082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993698+0000","last_change":"2024-04-19T02:19:54.931258+0000","last_active":"2024-04-19T02:20:08.993698+0000","last_peered":"2024-04-19T02:20:08.993698+0000","last_clean":"2024-04-19T02:20:08.993698+0000","last_became_active":"2024-04-19T02:19:54.930665+0000","last_became_peered":"2024-04-19T02:19:54.930665+0000","last_unstale":"2024-04-19T02:20:08.993698+0000","last_undegraded":"2024-04-19T02:20:08.993698+0000","last_fullsized":"2024-04-19T02:20:08.993698+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:57:08.681822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993591+0000","last_change":"2024-04-19T02:19:54.931055+0000","last_active":"2024-04-19T02:20:08.993591+0000","last_peered":"2024-04-19T02:20:08.993591+0000","last_clean":"2024-04-19T02:20:08.993591+0000","last_became_active":"2024-04-19T02:19:54.930527+0000","last_became_peered":"2024-04-19T02:19:54.930527+0000","last_unstale":"2024-04-19T02:20:08.993591+0000","last_undegraded":"2024-04-19T02:20:08.993591+0000","last_fullsized":"2024-04-19T02:20:08.993591+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:05:38.717309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.001589+0000","last_change":"2024-04-19T02:20:10.001589+0000","last_active":"2024-04-19T02:20:10.001589+0000","last_peered":"2024-04-19T02:20:10.001589+0000","last_clean":"2024-04-19T02:20:10.001589+0000","last_became_active":"2024-04-19T02:20:10.001304+0000","last_became_peered":"2024-04-19T02:20:10.001304+0000","last_unstale":"2024-04-19T02:20:10.001589+0000","last_undegraded":"2024-04-19T02:20:10.001589+0000","last_fullsized":"2024-04-19T02:20:10.001589+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:36.432257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996078+0000","last_change":"2024-04-19T02:20:08.662331+0000","last_active":"2024-04-19T02:20:08.996078+0000","last_peered":"2024-04-19T02:20:08.996078+0000","last_clean":"2024-04-19T02:20:08.996078+0000","last_became_active":"2024-04-19T02:20:08.661996+0000","last_became_peered":"2024-04-19T02:20:08.661996+0000","last_unstale":"2024-04-19T02:20:08.996078+0000","last_undegraded":"2024-04-19T02:20:08.996078+0000","last_fullsized":"2024-04-19T02:20:08.996078+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:25:03.894231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.001706+0000","last_change":"2024-04-19T02:20:10.001706+0000","last_active":"2024-04-19T02:20:10.001706+0000","last_peered":"2024-04-19T02:20:10.001706+0000","last_clean":"2024-04-19T02:20:10.001706+0000","last_became_active":"2024-04-19T02:20:10.001372+0000","last_became_peered":"2024-04-19T02:20:10.001372+0000","last_unstale":"2024-04-19T02:20:10.001706+0000","last_undegraded":"2024-04-19T02:20:10.001706+0000","last_fullsized":"2024-04-19T02:20:10.001706+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:54:55.702629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996258+0000","last_change":"2024-04-19T02:15:29.277568+0000","last_active":"2024-04-19T02:20:08.996258+0000","last_peered":"2024-04-19T02:20:08.996258+0000","last_clean":"2024-04-19T02:20:08.996258+0000","last_became_active":"2024-04-19T02:15:29.276725+0000","last_became_peered":"2024-04-19T02:15:29.276725+0000","last_unstale":"2024-04-19T02:20:08.996258+0000","last_undegraded":"2024-04-19T02:20:08.996258+0000","last_fullsized":"2024-04-19T02:20:08.996258+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5254,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":72,"seq":309237645318,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58816,"kb_used_data":884,"kb_used_omap":6,"kb_used_meta":57913,"kb_avail":94313024,"statfs":{"total":96636764160,"available":96576536576,"internally_reserved":0,"allocated":905216,"data_stored":358135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6848,"internal_metadata":59303232},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738430,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":275424,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":273918,"kb_avail":94096416,"statfs":{"total":96636764160,"available":96354729984,"internally_reserved":0,"allocated":1519616,"data_stored":948136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":280492486},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 02:19:26 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.371,"15min":0.316},"min":{"1min":0.29899999999999999,"5min":0.159,"15min":0.159},"max":{"1min":0.57499999999999996,"5min":4.4480000000000004,"15min":4.4480000000000004},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.379,"15min":0.36599999999999999},"min":{"1min":0.29399999999999998,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.54800000000000004,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.40200000000000002}]},{"osd":2,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":2.1000000000000001,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.36099999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738429,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307416,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":305918,"kb_avail":94064424,"statfs":{"total":96636764160,"available":96321970176,"internally_reserved":0,"allocated":1515520,"data_stored":949633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":313260486},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:19:29 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.40600000000000003,"15min":0.376},"min":{"1min":0.32700000000000001,"5min":0.157,"15min":0.157},"max":{"1min":0.64900000000000002,"5min":1.794,"15min":1.794},"last":0.496},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.38100000000000001,"15min":0.32400000000000001},"min":{"1min":0.37,"5min":0.16,"15min":0.16},"max":{"1min":0.63,"5min":2.411,"15min":2.411},"last":0.53400000000000003}]},{"osd":2,"last update":"Fri Apr 19 02:16:26 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.60599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5254,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:20:18.138 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T02:20:18.497 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:20:18.497 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":82,"fsid":"f6ab5dd0-bb9f-4b48-a9fc-4728c7955ca8","created":"2024-04-19T02:15:13.539846+0000","modified":"2024-04-19T02:20:09.986791+0000","last_up_change":"2024-04-19T02:19:53.893059+0000","last_in_change":"2024-04-19T02:15:15.482624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T02:15:22.776125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T02:15:23.264005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T02:15:27.675087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T02:15:28.232224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88cb15f3-271c-43d5-af51-1cd26b8ed13c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":41347},{"type":"v1","addr":"172.21.15.153:6801","nonce":41347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":41347},{"type":"v1","addr":"172.21.15.153:6803","nonce":41347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":41347},{"type":"v1","addr":"172.21.15.153:6807","nonce":41347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":41347},{"type":"v1","addr":"172.21.15.153:6805","nonce":41347}]},"public_addr":"172.21.15.153:6801/41347","cluster_addr":"172.21.15.153:6803/41347","heartbeat_back_addr":"172.21.15.153:6807/41347","heartbeat_front_addr":"172.21.15.153:6805/41347","state":["exists","up"]},{"osd":1,"uuid":"2674869a-db01-4d9f-a496-9fb3851b5b21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":41380},{"type":"v1","addr":"172.21.15.174:6801","nonce":41380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":41380},{"type":"v1","addr":"172.21.15.174:6803","nonce":41380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":41380},{"type":"v1","addr":"172.21.15.174:6807","nonce":41380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":41380},{"type":"v1","addr":"172.21.15.174:6805","nonce":41380}]},"public_addr":"172.21.15.174:6801/41380","cluster_addr":"172.21.15.174:6803/41380","heartbeat_back_addr":"172.21.15.174:6807/41380","heartbeat_front_addr":"172.21.15.174:6805/41380","state":["exists","up"]},{"osd":2,"uuid":"712ad943-2f98-49d9-aabe-f66b509be633","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":49,"up_from":72,"up_thru":81,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":6186},{"type":"v1","addr":"172.21.15.177:6801","nonce":6186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":6186},{"type":"v1","addr":"172.21.15.177:6803","nonce":6186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":6186},{"type":"v1","addr":"172.21.15.177:6807","nonce":6186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":6186},{"type":"v1","addr":"172.21.15.177:6805","nonce":6186}]},"public_addr":"172.21.15.177:6801/6186","cluster_addr":"172.21.15.177:6803/6186","heartbeat_back_addr":"172.21.15.177:6807/6186","heartbeat_front_addr":"172.21.15.177:6805/6186","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:15:20.495280+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:15:20.594553+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:15:20.524253+0000","dead_epoch":49}],"pg_upmap":[{"pgid":"4.36","osds":[0,1]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T02:20:19.512 INFO:tasks.ceph:Scrubbing osd.0 2024-04-19T02:20:19.512 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-19T02:20:19.671 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-04-19T02:20:19.672 INFO:teuthology.orchestra.run.smithi121.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-19T02:20:19.672 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-04-19T02:20:19.683 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-19T02:20:20.007 INFO:teuthology.orchestra.run.smithi121.stderr:instructed osd(s) 0 to deep-scrub 2024-04-19T02:20:20.018 INFO:tasks.ceph:Scrubbing osd.1 2024-04-19T02:20:20.018 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-19T02:20:20.163 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-04-19T02:20:20.163 INFO:teuthology.orchestra.run.smithi121.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-19T02:20:20.163 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-04-19T02:20:20.175 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-19T02:20:20.500 INFO:teuthology.orchestra.run.smithi121.stderr:instructed osd(s) 1 to deep-scrub 2024-04-19T02:20:20.511 INFO:tasks.ceph:Scrubbing osd.2 2024-04-19T02:20:20.511 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-19T02:20:20.656 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-04-19T02:20:20.656 INFO:teuthology.orchestra.run.smithi121.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_pg_delete_cost = '' (not observed, change may require restart) osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-04-19T02:20:20.656 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-04-19T02:20:20.668 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-19T02:20:20.993 INFO:teuthology.orchestra.run.smithi121.stderr:instructed osd(s) 2 to deep-scrub 2024-04-19T02:20:21.004 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:20:21.330 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:20:21.332 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-04-19T02:20:21.341 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":227,"stamp":"2024-04-19T02:20:20.813651+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":641656,"kb_used_data":3848,"kb_used_omap":9,"kb_used_meta":637750,"kb_avail":282473864,"statfs":{"total":289910292480,"available":289253236736,"internally_reserved":0,"allocated":3940352,"data_stored":2255904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10036,"internal_metadata":653056204},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.818415"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996815+0000","last_change":"2024-04-19T02:19:54.929643+0000","last_active":"2024-04-19T02:20:08.996815+0000","last_peered":"2024-04-19T02:20:08.996815+0000","last_clean":"2024-04-19T02:20:08.996815+0000","last_became_active":"2024-04-19T02:19:54.929435+0000","last_became_peered":"2024-04-19T02:19:54.929435+0000","last_unstale":"2024-04-19T02:20:08.996815+0000","last_undegraded":"2024-04-19T02:20:08.996815+0000","last_fullsized":"2024-04-19T02:20:08.996815+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:44:05.807254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995814+0000","last_change":"2024-04-19T02:19:54.931532+0000","last_active":"2024-04-19T02:20:08.995814+0000","last_peered":"2024-04-19T02:20:08.995814+0000","last_clean":"2024-04-19T02:20:08.995814+0000","last_became_active":"2024-04-19T02:19:54.931278+0000","last_became_peered":"2024-04-19T02:19:54.931278+0000","last_unstale":"2024-04-19T02:20:08.995814+0000","last_undegraded":"2024-04-19T02:20:08.995814+0000","last_fullsized":"2024-04-19T02:20:08.995814+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:20:02.024046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993263+0000","last_change":"2024-04-19T02:15:29.286709+0000","last_active":"2024-04-19T02:20:08.993263+0000","last_peered":"2024-04-19T02:20:08.993263+0000","last_clean":"2024-04-19T02:20:08.993263+0000","last_became_active":"2024-04-19T02:15:29.286169+0000","last_became_peered":"2024-04-19T02:15:29.286169+0000","last_unstale":"2024-04-19T02:20:08.993263+0000","last_undegraded":"2024-04-19T02:20:08.993263+0000","last_fullsized":"2024-04-19T02:20:08.993263+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:59:58.741466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993036+0000","last_change":"2024-04-19T02:19:54.927063+0000","last_active":"2024-04-19T02:20:08.993036+0000","last_peered":"2024-04-19T02:20:08.993036+0000","last_clean":"2024-04-19T02:20:08.993036+0000","last_became_active":"2024-04-19T02:19:54.926046+0000","last_became_peered":"2024-04-19T02:19:54.926046+0000","last_unstale":"2024-04-19T02:20:08.993036+0000","last_undegraded":"2024-04-19T02:20:08.993036+0000","last_fullsized":"2024-04-19T02:20:08.993036+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:52:59.151542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":55,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995211+0000","last_change":"2024-04-19T02:19:54.931669+0000","last_active":"2024-04-19T02:20:08.995211+0000","last_peered":"2024-04-19T02:20:08.995211+0000","last_clean":"2024-04-19T02:20:08.995211+0000","last_became_active":"2024-04-19T02:19:54.931435+0000","last_became_peered":"2024-04-19T02:19:54.931435+0000","last_unstale":"2024-04-19T02:20:08.995211+0000","last_undegraded":"2024-04-19T02:20:08.995211+0000","last_fullsized":"2024-04-19T02:20:08.995211+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:42:58.222802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992140+0000","last_change":"2024-04-19T02:19:54.924250+0000","last_active":"2024-04-19T02:20:08.992140+0000","last_peered":"2024-04-19T02:20:08.992140+0000","last_clean":"2024-04-19T02:20:08.992140+0000","last_became_active":"2024-04-19T02:19:54.923984+0000","last_became_peered":"2024-04-19T02:19:54.923984+0000","last_unstale":"2024-04-19T02:20:08.992140+0000","last_undegraded":"2024-04-19T02:20:08.992140+0000","last_fullsized":"2024-04-19T02:20:08.992140+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:56:51.290239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992724+0000","last_change":"2024-04-19T02:19:54.926647+0000","last_active":"2024-04-19T02:20:08.992724+0000","last_peered":"2024-04-19T02:20:08.992724+0000","last_clean":"2024-04-19T02:20:08.992724+0000","last_became_active":"2024-04-19T02:19:54.925529+0000","last_became_peered":"2024-04-19T02:19:54.925529+0000","last_unstale":"2024-04-19T02:20:08.992724+0000","last_undegraded":"2024-04-19T02:20:08.992724+0000","last_fullsized":"2024-04-19T02:20:08.992724+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:49:06.911557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993273+0000","last_change":"2024-04-19T02:19:54.930828+0000","last_active":"2024-04-19T02:20:08.993273+0000","last_peered":"2024-04-19T02:20:08.993273+0000","last_clean":"2024-04-19T02:20:08.993273+0000","last_became_active":"2024-04-19T02:19:54.930075+0000","last_became_peered":"2024-04-19T02:19:54.930075+0000","last_unstale":"2024-04-19T02:20:08.993273+0000","last_undegraded":"2024-04-19T02:20:08.993273+0000","last_fullsized":"2024-04-19T02:20:08.993273+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:00.512431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.991008+0000","last_change":"2024-04-19T02:19:54.931617+0000","last_active":"2024-04-19T02:20:08.991008+0000","last_peered":"2024-04-19T02:20:08.991008+0000","last_clean":"2024-04-19T02:20:08.991008+0000","last_became_active":"2024-04-19T02:19:54.928496+0000","last_became_peered":"2024-04-19T02:19:54.928496+0000","last_unstale":"2024-04-19T02:20:08.991008+0000","last_undegraded":"2024-04-19T02:20:08.991008+0000","last_fullsized":"2024-04-19T02:20:08.991008+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:56:50.232031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":60,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993489+0000","last_change":"2024-04-19T02:16:30.093524+0000","last_active":"2024-04-19T02:20:08.993489+0000","last_peered":"2024-04-19T02:20:08.993489+0000","last_clean":"2024-04-19T02:20:08.993489+0000","last_became_active":"2024-04-19T02:16:30.093344+0000","last_became_peered":"2024-04-19T02:16:30.093344+0000","last_unstale":"2024-04-19T02:20:08.993489+0000","last_undegraded":"2024-04-19T02:20:08.993489+0000","last_fullsized":"2024-04-19T02:20:08.993489+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:14:40.293159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993069+0000","last_change":"2024-04-19T02:19:54.926754+0000","last_active":"2024-04-19T02:20:08.993069+0000","last_peered":"2024-04-19T02:20:08.993069+0000","last_clean":"2024-04-19T02:20:08.993069+0000","last_became_active":"2024-04-19T02:19:54.926040+0000","last_became_peered":"2024-04-19T02:19:54.926040+0000","last_unstale":"2024-04-19T02:20:08.993069+0000","last_undegraded":"2024-04-19T02:20:08.993069+0000","last_fullsized":"2024-04-19T02:20:08.993069+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:36:16.313500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995212+0000","last_change":"2024-04-19T02:20:08.662601+0000","last_active":"2024-04-19T02:20:08.995212+0000","last_peered":"2024-04-19T02:20:08.995212+0000","last_clean":"2024-04-19T02:20:08.995212+0000","last_became_active":"2024-04-19T02:20:08.662234+0000","last_became_peered":"2024-04-19T02:20:08.662234+0000","last_unstale":"2024-04-19T02:20:08.995212+0000","last_undegraded":"2024-04-19T02:20:08.995212+0000","last_fullsized":"2024-04-19T02:20:08.995212+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:34:06.694985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":55,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995768+0000","last_change":"2024-04-19T02:19:54.932576+0000","last_active":"2024-04-19T02:20:08.995768+0000","last_peered":"2024-04-19T02:20:08.995768+0000","last_clean":"2024-04-19T02:20:08.995768+0000","last_became_active":"2024-04-19T02:19:54.932240+0000","last_became_peered":"2024-04-19T02:19:54.932240+0000","last_unstale":"2024-04-19T02:20:08.995768+0000","last_undegraded":"2024-04-19T02:20:08.995768+0000","last_fullsized":"2024-04-19T02:20:08.995768+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:10:10.453676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":79,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637354+0000","last_change":"2024-04-19T02:15:29.284262+0000","last_active":"2024-04-19T02:20:10.637354+0000","last_peered":"2024-04-19T02:20:10.637354+0000","last_clean":"2024-04-19T02:20:10.637354+0000","last_became_active":"2024-04-19T02:15:29.283121+0000","last_became_peered":"2024-04-19T02:15:29.283121+0000","last_unstale":"2024-04-19T02:20:10.637354+0000","last_undegraded":"2024-04-19T02:20:10.637354+0000","last_fullsized":"2024-04-19T02:20:10.637354+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":79,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637524+0000","last_change":"2024-04-19T02:15:29.285139+0000","last_active":"2024-04-19T02:20:10.637524+0000","last_peered":"2024-04-19T02:20:10.637524+0000","last_clean":"2024-04-19T02:20:10.637524+0000","last_became_active":"2024-04-19T02:15:29.284649+0000","last_became_peered":"2024-04-19T02:15:29.284649+0000","last_unstale":"2024-04-19T02:20:10.637524+0000","last_undegraded":"2024-04-19T02:20:10.637524+0000","last_fullsized":"2024-04-19T02:20:10.637524+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:13.488756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637088+0000","last_change":"2024-04-19T02:19:54.931033+0000","last_active":"2024-04-19T02:20:10.637088+0000","last_peered":"2024-04-19T02:20:10.637088+0000","last_clean":"2024-04-19T02:20:10.637088+0000","last_became_active":"2024-04-19T02:19:54.930437+0000","last_became_peered":"2024-04-19T02:19:54.930437+0000","last_unstale":"2024-04-19T02:20:10.637088+0000","last_undegraded":"2024-04-19T02:20:10.637088+0000","last_fullsized":"2024-04-19T02:20:10.637088+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:44:05.807254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.001650+0000","last_change":"2024-04-19T02:20:10.001650+0000","last_active":"2024-04-19T02:20:10.001650+0000","last_peered":"2024-04-19T02:20:10.001650+0000","last_clean":"2024-04-19T02:20:10.001650+0000","last_became_active":"2024-04-19T02:20:10.001343+0000","last_became_peered":"2024-04-19T02:20:10.001343+0000","last_unstale":"2024-04-19T02:20:10.001650+0000","last_undegraded":"2024-04-19T02:20:10.001650+0000","last_fullsized":"2024-04-19T02:20:10.001650+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:15:54.452503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.858101+0000","last_change":"2024-04-19T02:19:54.933452+0000","last_active":"2024-04-19T02:20:09.858101+0000","last_peered":"2024-04-19T02:20:09.858101+0000","last_clean":"2024-04-19T02:20:09.858101+0000","last_became_active":"2024-04-19T02:19:54.933233+0000","last_became_peered":"2024-04-19T02:19:54.933233+0000","last_unstale":"2024-04-19T02:20:09.858101+0000","last_undegraded":"2024-04-19T02:20:09.858101+0000","last_fullsized":"2024-04-19T02:20:09.858101+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:50.712874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.990125+0000","last_change":"2024-04-19T02:19:54.925745+0000","last_active":"2024-04-19T02:20:08.990125+0000","last_peered":"2024-04-19T02:20:08.990125+0000","last_clean":"2024-04-19T02:20:08.990125+0000","last_became_active":"2024-04-19T02:19:54.925060+0000","last_became_peered":"2024-04-19T02:19:54.925060+0000","last_unstale":"2024-04-19T02:20:08.990125+0000","last_undegraded":"2024-04-19T02:20:08.990125+0000","last_fullsized":"2024-04-19T02:20:08.990125+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:12:43.617806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992995+0000","last_change":"2024-04-19T02:19:54.927206+0000","last_active":"2024-04-19T02:20:08.992995+0000","last_peered":"2024-04-19T02:20:08.992995+0000","last_clean":"2024-04-19T02:20:08.992995+0000","last_became_active":"2024-04-19T02:19:54.926442+0000","last_became_peered":"2024-04-19T02:19:54.926442+0000","last_unstale":"2024-04-19T02:20:08.992995+0000","last_undegraded":"2024-04-19T02:20:08.992995+0000","last_fullsized":"2024-04-19T02:20:08.992995+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:27:17.095030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992632+0000","last_change":"2024-04-19T02:19:54.932532+0000","last_active":"2024-04-19T02:20:08.992632+0000","last_peered":"2024-04-19T02:20:08.992632+0000","last_clean":"2024-04-19T02:20:08.992632+0000","last_became_active":"2024-04-19T02:19:54.931438+0000","last_became_peered":"2024-04-19T02:19:54.931438+0000","last_unstale":"2024-04-19T02:20:08.992632+0000","last_undegraded":"2024-04-19T02:20:08.992632+0000","last_fullsized":"2024-04-19T02:20:08.992632+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:12:54.241778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995945+0000","last_change":"2024-04-19T02:20:08.662261+0000","last_active":"2024-04-19T02:20:08.995945+0000","last_peered":"2024-04-19T02:20:08.995945+0000","last_clean":"2024-04-19T02:20:08.995945+0000","last_became_active":"2024-04-19T02:20:08.661940+0000","last_became_peered":"2024-04-19T02:20:08.661940+0000","last_unstale":"2024-04-19T02:20:08.995945+0000","last_undegraded":"2024-04-19T02:20:08.995945+0000","last_fullsized":"2024-04-19T02:20:08.995945+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:49:34.835266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.639368+0000","last_change":"2024-04-19T02:20:10.639368+0000","last_active":"2024-04-19T02:20:10.639368+0000","last_peered":"2024-04-19T02:20:10.639368+0000","last_clean":"2024-04-19T02:20:10.639368+0000","last_became_active":"2024-04-19T02:20:10.639036+0000","last_became_peered":"2024-04-19T02:20:10.639036+0000","last_unstale":"2024-04-19T02:20:10.639368+0000","last_undegraded":"2024-04-19T02:20:10.639368+0000","last_fullsized":"2024-04-19T02:20:10.639368+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:36:45.316530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996035+0000","last_change":"2024-04-19T02:19:54.928467+0000","last_active":"2024-04-19T02:20:08.996035+0000","last_peered":"2024-04-19T02:20:08.996035+0000","last_clean":"2024-04-19T02:20:08.996035+0000","last_became_active":"2024-04-19T02:19:54.928261+0000","last_became_peered":"2024-04-19T02:19:54.928261+0000","last_unstale":"2024-04-19T02:20:08.996035+0000","last_undegraded":"2024-04-19T02:20:08.996035+0000","last_fullsized":"2024-04-19T02:20:08.996035+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:40:43.645134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996795+0000","last_change":"2024-04-19T02:15:29.278084+0000","last_active":"2024-04-19T02:20:08.996795+0000","last_peered":"2024-04-19T02:20:08.996795+0000","last_clean":"2024-04-19T02:20:08.996795+0000","last_became_active":"2024-04-19T02:15:29.276952+0000","last_became_peered":"2024-04-19T02:15:29.276952+0000","last_unstale":"2024-04-19T02:20:08.996795+0000","last_undegraded":"2024-04-19T02:20:08.996795+0000","last_fullsized":"2024-04-19T02:20:08.996795+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:49.899552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.991888+0000","last_change":"2024-04-19T02:19:54.933154+0000","last_active":"2024-04-19T02:20:08.991888+0000","last_peered":"2024-04-19T02:20:08.991888+0000","last_clean":"2024-04-19T02:20:08.991888+0000","last_became_active":"2024-04-19T02:19:54.931124+0000","last_became_peered":"2024-04-19T02:19:54.931124+0000","last_unstale":"2024-04-19T02:20:08.991888+0000","last_undegraded":"2024-04-19T02:20:08.991888+0000","last_fullsized":"2024-04-19T02:20:08.991888+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:49.555501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993130+0000","last_change":"2024-04-19T02:15:29.287389+0000","last_active":"2024-04-19T02:20:08.993130+0000","last_peered":"2024-04-19T02:20:08.993130+0000","last_clean":"2024-04-19T02:20:08.993130+0000","last_became_active":"2024-04-19T02:15:29.286431+0000","last_became_peered":"2024-04-19T02:15:29.286431+0000","last_unstale":"2024-04-19T02:20:08.993130+0000","last_undegraded":"2024-04-19T02:20:08.993130+0000","last_fullsized":"2024-04-19T02:20:08.993130+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:58:30.117887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":57,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995777+0000","last_change":"2024-04-19T02:19:54.927108+0000","last_active":"2024-04-19T02:20:08.995777+0000","last_peered":"2024-04-19T02:20:08.995777+0000","last_clean":"2024-04-19T02:20:08.995777+0000","last_became_active":"2024-04-19T02:19:54.926838+0000","last_became_peered":"2024-04-19T02:19:54.926838+0000","last_unstale":"2024-04-19T02:20:08.995777+0000","last_undegraded":"2024-04-19T02:20:08.995777+0000","last_fullsized":"2024-04-19T02:20:08.995777+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:25:27.561607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":77,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996790+0000","last_change":"2024-04-19T02:15:29.281792+0000","last_active":"2024-04-19T02:20:08.996790+0000","last_peered":"2024-04-19T02:20:08.996790+0000","last_clean":"2024-04-19T02:20:08.996790+0000","last_became_active":"2024-04-19T02:15:29.280479+0000","last_became_peered":"2024-04-19T02:15:29.280479+0000","last_unstale":"2024-04-19T02:20:08.996790+0000","last_undegraded":"2024-04-19T02:20:08.996790+0000","last_fullsized":"2024-04-19T02:20:08.996790+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:43.491957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.989269+0000","last_change":"2024-04-19T02:19:54.925277+0000","last_active":"2024-04-19T02:20:08.989269+0000","last_peered":"2024-04-19T02:20:08.989269+0000","last_clean":"2024-04-19T02:20:08.989269+0000","last_became_active":"2024-04-19T02:19:54.924484+0000","last_became_peered":"2024-04-19T02:19:54.924484+0000","last_unstale":"2024-04-19T02:20:08.989269+0000","last_undegraded":"2024-04-19T02:20:08.989269+0000","last_fullsized":"2024-04-19T02:20:08.989269+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:57:54.845371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.639077+0000","last_change":"2024-04-19T02:20:10.639077+0000","last_active":"2024-04-19T02:20:10.639077+0000","last_peered":"2024-04-19T02:20:10.639077+0000","last_clean":"2024-04-19T02:20:10.639077+0000","last_became_active":"2024-04-19T02:20:10.638737+0000","last_became_peered":"2024-04-19T02:20:10.638737+0000","last_unstale":"2024-04-19T02:20:10.639077+0000","last_undegraded":"2024-04-19T02:20:10.639077+0000","last_fullsized":"2024-04-19T02:20:10.639077+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:20:05.200768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.989517+0000","last_change":"2024-04-19T02:19:54.930346+0000","last_active":"2024-04-19T02:20:08.989517+0000","last_peered":"2024-04-19T02:20:08.989517+0000","last_clean":"2024-04-19T02:20:08.989517+0000","last_became_active":"2024-04-19T02:19:54.928398+0000","last_became_peered":"2024-04-19T02:19:54.928398+0000","last_unstale":"2024-04-19T02:20:08.989517+0000","last_undegraded":"2024-04-19T02:20:08.989517+0000","last_fullsized":"2024-04-19T02:20:08.989517+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:46.321275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996446+0000","last_change":"2024-04-19T02:15:29.280879+0000","last_active":"2024-04-19T02:20:08.996446+0000","last_peered":"2024-04-19T02:20:08.996446+0000","last_clean":"2024-04-19T02:20:08.996446+0000","last_became_active":"2024-04-19T02:15:29.279314+0000","last_became_peered":"2024-04-19T02:15:29.279314+0000","last_unstale":"2024-04-19T02:20:08.996446+0000","last_undegraded":"2024-04-19T02:20:08.996446+0000","last_fullsized":"2024-04-19T02:20:08.996446+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:02.171576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.991148+0000","last_change":"2024-04-19T02:19:54.927744+0000","last_active":"2024-04-19T02:20:08.991148+0000","last_peered":"2024-04-19T02:20:08.991148+0000","last_clean":"2024-04-19T02:20:08.991148+0000","last_became_active":"2024-04-19T02:19:54.925729+0000","last_became_peered":"2024-04-19T02:19:54.925729+0000","last_unstale":"2024-04-19T02:20:08.991148+0000","last_undegraded":"2024-04-19T02:20:08.991148+0000","last_fullsized":"2024-04-19T02:20:08.991148+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:27:57.229684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.989293+0000","last_change":"2024-04-19T02:19:54.928435+0000","last_active":"2024-04-19T02:20:08.989293+0000","last_peered":"2024-04-19T02:20:08.989293+0000","last_clean":"2024-04-19T02:20:08.989293+0000","last_became_active":"2024-04-19T02:19:54.927666+0000","last_became_peered":"2024-04-19T02:19:54.927666+0000","last_unstale":"2024-04-19T02:20:08.989293+0000","last_undegraded":"2024-04-19T02:20:08.989293+0000","last_fullsized":"2024-04-19T02:20:08.989293+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:20:45.000808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993622+0000","last_change":"2024-04-19T02:19:54.932025+0000","last_active":"2024-04-19T02:20:08.993622+0000","last_peered":"2024-04-19T02:20:08.993622+0000","last_clean":"2024-04-19T02:20:08.993622+0000","last_became_active":"2024-04-19T02:19:54.931540+0000","last_became_peered":"2024-04-19T02:19:54.931540+0000","last_unstale":"2024-04-19T02:20:08.993622+0000","last_undegraded":"2024-04-19T02:20:08.993622+0000","last_fullsized":"2024-04-19T02:20:08.993622+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:03:31.479331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.991173+0000","last_change":"2024-04-19T02:19:54.924493+0000","last_active":"2024-04-19T02:20:08.991173+0000","last_peered":"2024-04-19T02:20:08.991173+0000","last_clean":"2024-04-19T02:20:08.991173+0000","last_became_active":"2024-04-19T02:19:54.923784+0000","last_became_peered":"2024-04-19T02:19:54.923784+0000","last_unstale":"2024-04-19T02:20:08.991173+0000","last_undegraded":"2024-04-19T02:20:08.991173+0000","last_fullsized":"2024-04-19T02:20:08.991173+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:09:34.378788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":81,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996234+0000","last_change":"2024-04-19T02:15:28.892937+0000","last_active":"2024-04-19T02:20:08.996234+0000","last_peered":"2024-04-19T02:20:08.996234+0000","last_clean":"2024-04-19T02:20:08.996234+0000","last_became_active":"2024-04-19T02:15:28.891440+0000","last_became_peered":"2024-04-19T02:15:28.891440+0000","last_unstale":"2024-04-19T02:20:08.996234+0000","last_undegraded":"2024-04-19T02:20:08.996234+0000","last_fullsized":"2024-04-19T02:20:08.996234+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:49:09.315097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.989329+0000","last_change":"2024-04-19T02:19:54.923898+0000","last_active":"2024-04-19T02:20:08.989329+0000","last_peered":"2024-04-19T02:20:08.989329+0000","last_clean":"2024-04-19T02:20:08.989329+0000","last_became_active":"2024-04-19T02:19:54.923493+0000","last_became_peered":"2024-04-19T02:19:54.923493+0000","last_unstale":"2024-04-19T02:20:08.989329+0000","last_undegraded":"2024-04-19T02:20:08.989329+0000","last_fullsized":"2024-04-19T02:20:08.989329+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:33.123319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":86,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637637+0000","last_change":"2024-04-19T02:15:28.891097+0000","last_active":"2024-04-19T02:20:10.637637+0000","last_peered":"2024-04-19T02:20:10.637637+0000","last_clean":"2024-04-19T02:20:10.637637+0000","last_became_active":"2024-04-19T02:15:28.890795+0000","last_became_peered":"2024-04-19T02:15:28.890795+0000","last_unstale":"2024-04-19T02:20:10.637637+0000","last_undegraded":"2024-04-19T02:20:10.637637+0000","last_fullsized":"2024-04-19T02:20:10.637637+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:57.858986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":79,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637625+0000","last_change":"2024-04-19T02:15:29.278546+0000","last_active":"2024-04-19T02:20:10.637625+0000","last_peered":"2024-04-19T02:20:10.637625+0000","last_clean":"2024-04-19T02:20:10.637625+0000","last_became_active":"2024-04-19T02:15:29.277547+0000","last_became_peered":"2024-04-19T02:15:29.277547+0000","last_unstale":"2024-04-19T02:20:10.637625+0000","last_undegraded":"2024-04-19T02:20:10.637625+0000","last_fullsized":"2024-04-19T02:20:10.637625+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:06.117220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":95,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637628+0000","last_change":"2024-04-19T02:19:54.933035+0000","last_active":"2024-04-19T02:20:10.637628+0000","last_peered":"2024-04-19T02:20:10.637628+0000","last_clean":"2024-04-19T02:20:10.637628+0000","last_became_active":"2024-04-19T02:19:54.932829+0000","last_became_peered":"2024-04-19T02:19:54.932829+0000","last_unstale":"2024-04-19T02:20:10.637628+0000","last_undegraded":"2024-04-19T02:20:10.637628+0000","last_fullsized":"2024-04-19T02:20:10.637628+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:09:05.626623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":49,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.998175+0000","last_change":"2024-04-19T02:20:07.983368+0000","last_active":"2024-04-19T02:20:09.998175+0000","last_peered":"2024-04-19T02:20:09.998175+0000","last_clean":"2024-04-19T02:20:09.998175+0000","last_became_active":"2024-04-19T02:20:07.983080+0000","last_became_peered":"2024-04-19T02:20:07.983080+0000","last_unstale":"2024-04-19T02:20:09.998175+0000","last_undegraded":"2024-04-19T02:20:09.998175+0000","last_fullsized":"2024-04-19T02:20:09.998175+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:24.138269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.989479+0000","last_change":"2024-04-19T02:19:54.927323+0000","last_active":"2024-04-19T02:20:08.989479+0000","last_peered":"2024-04-19T02:20:08.989479+0000","last_clean":"2024-04-19T02:20:08.989479+0000","last_became_active":"2024-04-19T02:19:54.925703+0000","last_became_peered":"2024-04-19T02:19:54.925703+0000","last_unstale":"2024-04-19T02:20:08.989479+0000","last_undegraded":"2024-04-19T02:20:08.989479+0000","last_fullsized":"2024-04-19T02:20:08.989479+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:46:59.533765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":55,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996775+0000","last_change":"2024-04-19T02:19:54.925918+0000","last_active":"2024-04-19T02:20:08.996775+0000","last_peered":"2024-04-19T02:20:08.996775+0000","last_clean":"2024-04-19T02:20:08.996775+0000","last_became_active":"2024-04-19T02:19:54.925634+0000","last_became_peered":"2024-04-19T02:19:54.925634+0000","last_unstale":"2024-04-19T02:20:08.996775+0000","last_undegraded":"2024-04-19T02:20:08.996775+0000","last_fullsized":"2024-04-19T02:20:08.996775+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:14:13.074455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.857926+0000","last_change":"2024-04-19T02:15:28.892934+0000","last_active":"2024-04-19T02:20:09.857926+0000","last_peered":"2024-04-19T02:20:09.857926+0000","last_clean":"2024-04-19T02:20:09.857926+0000","last_became_active":"2024-04-19T02:15:28.891879+0000","last_became_peered":"2024-04-19T02:15:28.891879+0000","last_unstale":"2024-04-19T02:20:09.857926+0000","last_undegraded":"2024-04-19T02:20:09.857926+0000","last_fullsized":"2024-04-19T02:20:09.857926+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:10:12.514798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.639094+0000","last_change":"2024-04-19T02:20:10.639094+0000","last_active":"2024-04-19T02:20:10.639094+0000","last_peered":"2024-04-19T02:20:10.639094+0000","last_clean":"2024-04-19T02:20:10.639094+0000","last_became_active":"2024-04-19T02:20:10.638755+0000","last_became_peered":"2024-04-19T02:20:10.638755+0000","last_unstale":"2024-04-19T02:20:10.639094+0000","last_undegraded":"2024-04-19T02:20:10.639094+0000","last_fullsized":"2024-04-19T02:20:10.639094+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:37:46.274811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.858501+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:20:09.858501+0000","last_peered":"2024-04-19T02:20:09.858501+0000","last_clean":"2024-04-19T02:20:09.858501+0000","last_became_active":"2024-04-19T02:15:28.890882+0000","last_became_peered":"2024-04-19T02:15:28.890882+0000","last_unstale":"2024-04-19T02:20:09.858501+0000","last_undegraded":"2024-04-19T02:20:09.858501+0000","last_fullsized":"2024-04-19T02:20:09.858501+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:31.673938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.991948+0000","last_change":"2024-04-19T02:19:54.927209+0000","last_active":"2024-04-19T02:20:08.991948+0000","last_peered":"2024-04-19T02:20:08.991948+0000","last_clean":"2024-04-19T02:20:08.991948+0000","last_became_active":"2024-04-19T02:19:54.925121+0000","last_became_peered":"2024-04-19T02:19:54.925121+0000","last_unstale":"2024-04-19T02:20:08.991948+0000","last_undegraded":"2024-04-19T02:20:08.991948+0000","last_fullsized":"2024-04-19T02:20:08.991948+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:16:21.982909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":81,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993779+0000","last_change":"2024-04-19T02:15:28.890265+0000","last_active":"2024-04-19T02:20:08.993779+0000","last_peered":"2024-04-19T02:20:08.993779+0000","last_clean":"2024-04-19T02:20:08.993779+0000","last_became_active":"2024-04-19T02:15:28.890004+0000","last_became_peered":"2024-04-19T02:15:28.890004+0000","last_unstale":"2024-04-19T02:20:08.993779+0000","last_undegraded":"2024-04-19T02:20:08.993779+0000","last_fullsized":"2024-04-19T02:20:08.993779+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:02.517101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.994900+0000","last_change":"2024-04-19T02:15:29.285529+0000","last_active":"2024-04-19T02:20:08.994900+0000","last_peered":"2024-04-19T02:20:08.994900+0000","last_clean":"2024-04-19T02:20:08.994900+0000","last_became_active":"2024-04-19T02:15:29.285197+0000","last_became_peered":"2024-04-19T02:15:29.285197+0000","last_unstale":"2024-04-19T02:20:08.994900+0000","last_undegraded":"2024-04-19T02:20:08.994900+0000","last_fullsized":"2024-04-19T02:20:08.994900+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:42.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":81,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995996+0000","last_change":"2024-04-19T02:15:28.893902+0000","last_active":"2024-04-19T02:20:08.995996+0000","last_peered":"2024-04-19T02:20:08.995996+0000","last_clean":"2024-04-19T02:20:08.995996+0000","last_became_active":"2024-04-19T02:15:28.893231+0000","last_became_peered":"2024-04-19T02:15:28.893231+0000","last_unstale":"2024-04-19T02:20:08.995996+0000","last_undegraded":"2024-04-19T02:20:08.995996+0000","last_fullsized":"2024-04-19T02:20:08.995996+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:23.658442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996319+0000","last_change":"2024-04-19T02:19:54.925840+0000","last_active":"2024-04-19T02:20:08.996319+0000","last_peered":"2024-04-19T02:20:08.996319+0000","last_clean":"2024-04-19T02:20:08.996319+0000","last_became_active":"2024-04-19T02:19:54.925502+0000","last_became_peered":"2024-04-19T02:19:54.925502+0000","last_unstale":"2024-04-19T02:20:08.996319+0000","last_undegraded":"2024-04-19T02:20:08.996319+0000","last_fullsized":"2024-04-19T02:20:08.996319+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:57.667340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":81,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993204+0000","last_change":"2024-04-19T02:15:28.891234+0000","last_active":"2024-04-19T02:20:08.993204+0000","last_peered":"2024-04-19T02:20:08.993204+0000","last_clean":"2024-04-19T02:20:08.993204+0000","last_became_active":"2024-04-19T02:15:28.890881+0000","last_became_peered":"2024-04-19T02:15:28.890881+0000","last_unstale":"2024-04-19T02:20:08.993204+0000","last_undegraded":"2024-04-19T02:20:08.993204+0000","last_fullsized":"2024-04-19T02:20:08.993204+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:23.916563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992289+0000","last_change":"2024-04-19T02:19:54.926103+0000","last_active":"2024-04-19T02:20:08.992289+0000","last_peered":"2024-04-19T02:20:08.992289+0000","last_clean":"2024-04-19T02:20:08.992289+0000","last_became_active":"2024-04-19T02:19:54.925591+0000","last_became_peered":"2024-04-19T02:19:54.925591+0000","last_unstale":"2024-04-19T02:20:08.992289+0000","last_undegraded":"2024-04-19T02:20:08.992289+0000","last_fullsized":"2024-04-19T02:20:08.992289+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:44:40.560973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":93,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992481+0000","last_change":"2024-04-19T02:19:54.926813+0000","last_active":"2024-04-19T02:20:08.992481+0000","last_peered":"2024-04-19T02:20:08.992481+0000","last_clean":"2024-04-19T02:20:08.992481+0000","last_became_active":"2024-04-19T02:19:54.925523+0000","last_became_peered":"2024-04-19T02:19:54.925523+0000","last_unstale":"2024-04-19T02:20:08.992481+0000","last_undegraded":"2024-04-19T02:20:08.992481+0000","last_fullsized":"2024-04-19T02:20:08.992481+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:39:56.887385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.989835+0000","last_change":"2024-04-19T02:19:54.932306+0000","last_active":"2024-04-19T02:20:08.989835+0000","last_peered":"2024-04-19T02:20:08.989835+0000","last_clean":"2024-04-19T02:20:08.989835+0000","last_became_active":"2024-04-19T02:19:54.930843+0000","last_became_peered":"2024-04-19T02:19:54.930843+0000","last_unstale":"2024-04-19T02:20:08.989835+0000","last_undegraded":"2024-04-19T02:20:08.989835+0000","last_fullsized":"2024-04-19T02:20:08.989835+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:24:51.884048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.989655+0000","last_change":"2024-04-19T02:19:54.932708+0000","last_active":"2024-04-19T02:20:08.989655+0000","last_peered":"2024-04-19T02:20:08.989655+0000","last_clean":"2024-04-19T02:20:08.989655+0000","last_became_active":"2024-04-19T02:19:54.931553+0000","last_became_peered":"2024-04-19T02:19:54.931553+0000","last_unstale":"2024-04-19T02:20:08.989655+0000","last_undegraded":"2024-04-19T02:20:08.989655+0000","last_fullsized":"2024-04-19T02:20:08.989655+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:47:07.651618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992596+0000","last_change":"2024-04-19T02:19:54.927009+0000","last_active":"2024-04-19T02:20:08.992596+0000","last_peered":"2024-04-19T02:20:08.992596+0000","last_clean":"2024-04-19T02:20:08.992596+0000","last_became_active":"2024-04-19T02:19:54.925645+0000","last_became_peered":"2024-04-19T02:19:54.925645+0000","last_unstale":"2024-04-19T02:20:08.992596+0000","last_undegraded":"2024-04-19T02:20:08.992596+0000","last_fullsized":"2024-04-19T02:20:08.992596+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:33:45.685463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":93,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992170+0000","last_change":"2024-04-19T02:19:54.923689+0000","last_active":"2024-04-19T02:20:08.992170+0000","last_peered":"2024-04-19T02:20:08.992170+0000","last_clean":"2024-04-19T02:20:08.992170+0000","last_became_active":"2024-04-19T02:19:54.923321+0000","last_became_peered":"2024-04-19T02:19:54.923321+0000","last_unstale":"2024-04-19T02:20:08.992170+0000","last_undegraded":"2024-04-19T02:20:08.992170+0000","last_fullsized":"2024-04-19T02:20:08.992170+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:03:01.578244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993485+0000","last_change":"2024-04-19T02:15:29.285019+0000","last_active":"2024-04-19T02:20:08.993485+0000","last_peered":"2024-04-19T02:20:08.993485+0000","last_clean":"2024-04-19T02:20:08.993485+0000","last_became_active":"2024-04-19T02:15:29.284650+0000","last_became_peered":"2024-04-19T02:15:29.284650+0000","last_unstale":"2024-04-19T02:20:08.993485+0000","last_undegraded":"2024-04-19T02:20:08.993485+0000","last_fullsized":"2024-04-19T02:20:08.993485+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995102+0000","last_change":"2024-04-19T02:20:08.662566+0000","last_active":"2024-04-19T02:20:08.995102+0000","last_peered":"2024-04-19T02:20:08.995102+0000","last_clean":"2024-04-19T02:20:08.995102+0000","last_became_active":"2024-04-19T02:20:08.662277+0000","last_became_peered":"2024-04-19T02:20:08.662277+0000","last_unstale":"2024-04-19T02:20:08.995102+0000","last_undegraded":"2024-04-19T02:20:08.995102+0000","last_fullsized":"2024-04-19T02:20:08.995102+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:36:27.307955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993656+0000","last_change":"2024-04-19T02:15:29.287190+0000","last_active":"2024-04-19T02:20:08.993656+0000","last_peered":"2024-04-19T02:20:08.993656+0000","last_clean":"2024-04-19T02:20:08.993656+0000","last_became_active":"2024-04-19T02:15:29.286606+0000","last_became_peered":"2024-04-19T02:15:29.286606+0000","last_unstale":"2024-04-19T02:20:08.993656+0000","last_undegraded":"2024-04-19T02:20:08.993656+0000","last_fullsized":"2024-04-19T02:20:08.993656+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:28.387062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996306+0000","last_change":"2024-04-19T02:19:54.928493+0000","last_active":"2024-04-19T02:20:08.996306+0000","last_peered":"2024-04-19T02:20:08.996306+0000","last_clean":"2024-04-19T02:20:08.996306+0000","last_became_active":"2024-04-19T02:19:54.928298+0000","last_became_peered":"2024-04-19T02:19:54.928298+0000","last_unstale":"2024-04-19T02:20:08.996306+0000","last_undegraded":"2024-04-19T02:20:08.996306+0000","last_fullsized":"2024-04-19T02:20:08.996306+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:11:54.564261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.990650+0000","last_change":"2024-04-19T02:19:54.930452+0000","last_active":"2024-04-19T02:20:08.990650+0000","last_peered":"2024-04-19T02:20:08.990650+0000","last_clean":"2024-04-19T02:20:08.990650+0000","last_became_active":"2024-04-19T02:19:54.927309+0000","last_became_peered":"2024-04-19T02:19:54.927309+0000","last_unstale":"2024-04-19T02:20:08.990650+0000","last_undegraded":"2024-04-19T02:20:08.990650+0000","last_fullsized":"2024-04-19T02:20:08.990650+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:56:20.174957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.998998+0000","last_change":"2024-04-19T02:20:09.998998+0000","last_active":"2024-04-19T02:20:09.998998+0000","last_peered":"2024-04-19T02:20:09.998998+0000","last_clean":"2024-04-19T02:20:09.998998+0000","last_became_active":"2024-04-19T02:20:09.998776+0000","last_became_peered":"2024-04-19T02:20:09.998776+0000","last_unstale":"2024-04-19T02:20:09.998998+0000","last_undegraded":"2024-04-19T02:20:09.998998+0000","last_fullsized":"2024-04-19T02:20:09.998998+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:02:13.720846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":93,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993371+0000","last_change":"2024-04-19T02:19:54.926207+0000","last_active":"2024-04-19T02:20:08.993371+0000","last_peered":"2024-04-19T02:20:08.993371+0000","last_clean":"2024-04-19T02:20:08.993371+0000","last_became_active":"2024-04-19T02:19:54.925872+0000","last_became_peered":"2024-04-19T02:19:54.925872+0000","last_unstale":"2024-04-19T02:20:08.993371+0000","last_undegraded":"2024-04-19T02:20:08.993371+0000","last_fullsized":"2024-04-19T02:20:08.993371+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:31:46.734042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996171+0000","last_change":"2024-04-19T02:15:29.277922+0000","last_active":"2024-04-19T02:20:08.996171+0000","last_peered":"2024-04-19T02:20:08.996171+0000","last_clean":"2024-04-19T02:20:08.996171+0000","last_became_active":"2024-04-19T02:15:29.276968+0000","last_became_peered":"2024-04-19T02:15:29.276968+0000","last_unstale":"2024-04-19T02:20:08.996171+0000","last_undegraded":"2024-04-19T02:20:08.996171+0000","last_fullsized":"2024-04-19T02:20:08.996171+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:15:08.164739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":96,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992530+0000","last_change":"2024-04-19T02:19:54.927361+0000","last_active":"2024-04-19T02:20:08.992530+0000","last_peered":"2024-04-19T02:20:08.992530+0000","last_clean":"2024-04-19T02:20:08.992530+0000","last_became_active":"2024-04-19T02:19:54.927033+0000","last_became_peered":"2024-04-19T02:19:54.927033+0000","last_unstale":"2024-04-19T02:20:08.992530+0000","last_undegraded":"2024-04-19T02:20:08.992530+0000","last_fullsized":"2024-04-19T02:20:08.992530+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:07.194915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":93,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992757+0000","last_change":"2024-04-19T02:19:54.932790+0000","last_active":"2024-04-19T02:20:08.992757+0000","last_peered":"2024-04-19T02:20:08.992757+0000","last_clean":"2024-04-19T02:20:08.992757+0000","last_became_active":"2024-04-19T02:19:54.931683+0000","last_became_peered":"2024-04-19T02:19:54.931683+0000","last_unstale":"2024-04-19T02:20:08.992757+0000","last_undegraded":"2024-04-19T02:20:08.992757+0000","last_fullsized":"2024-04-19T02:20:08.992757+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:23:00.124845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.990653+0000","last_change":"2024-04-19T02:19:54.926109+0000","last_active":"2024-04-19T02:20:08.990653+0000","last_peered":"2024-04-19T02:20:08.990653+0000","last_clean":"2024-04-19T02:20:08.990653+0000","last_became_active":"2024-04-19T02:19:54.924686+0000","last_became_peered":"2024-04-19T02:19:54.924686+0000","last_unstale":"2024-04-19T02:20:08.990653+0000","last_undegraded":"2024-04-19T02:20:08.990653+0000","last_fullsized":"2024-04-19T02:20:08.990653+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:20:03.487999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.990873+0000","last_change":"2024-04-19T02:19:54.923465+0000","last_active":"2024-04-19T02:20:08.990873+0000","last_peered":"2024-04-19T02:20:08.990873+0000","last_clean":"2024-04-19T02:20:08.990873+0000","last_became_active":"2024-04-19T02:19:54.923164+0000","last_became_peered":"2024-04-19T02:19:54.923164+0000","last_unstale":"2024-04-19T02:20:08.990873+0000","last_undegraded":"2024-04-19T02:20:08.990873+0000","last_fullsized":"2024-04-19T02:20:08.990873+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:53:29.520848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995333+0000","last_change":"2024-04-19T02:20:08.662301+0000","last_active":"2024-04-19T02:20:08.995333+0000","last_peered":"2024-04-19T02:20:08.995333+0000","last_clean":"2024-04-19T02:20:08.995333+0000","last_became_active":"2024-04-19T02:20:08.661952+0000","last_became_peered":"2024-04-19T02:20:08.661952+0000","last_unstale":"2024-04-19T02:20:08.995333+0000","last_undegraded":"2024-04-19T02:20:08.995333+0000","last_fullsized":"2024-04-19T02:20:08.995333+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:41:21.658836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.991779+0000","last_change":"2024-04-19T02:19:54.930115+0000","last_active":"2024-04-19T02:20:08.991779+0000","last_peered":"2024-04-19T02:20:08.991779+0000","last_clean":"2024-04-19T02:20:08.991779+0000","last_became_active":"2024-04-19T02:19:54.926463+0000","last_became_peered":"2024-04-19T02:19:54.926463+0000","last_unstale":"2024-04-19T02:20:08.991779+0000","last_undegraded":"2024-04-19T02:20:08.991779+0000","last_fullsized":"2024-04-19T02:20:08.991779+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:47:00.191645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":96,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992852+0000","last_change":"2024-04-19T02:19:54.932929+0000","last_active":"2024-04-19T02:20:08.992852+0000","last_peered":"2024-04-19T02:20:08.992852+0000","last_clean":"2024-04-19T02:20:08.992852+0000","last_became_active":"2024-04-19T02:19:54.932571+0000","last_became_peered":"2024-04-19T02:19:54.932571+0000","last_unstale":"2024-04-19T02:20:08.992852+0000","last_undegraded":"2024-04-19T02:20:08.992852+0000","last_fullsized":"2024-04-19T02:20:08.992852+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:50:08.657036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":279,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993444+0000","last_change":"2024-04-19T02:15:24.533634+0000","last_active":"2024-04-19T02:20:08.993444+0000","last_peered":"2024-04-19T02:20:08.993444+0000","last_clean":"2024-04-19T02:20:08.993444+0000","last_became_active":"2024-04-19T02:15:24.533420+0000","last_became_peered":"2024-04-19T02:15:24.533420+0000","last_unstale":"2024-04-19T02:20:08.993444+0000","last_undegraded":"2024-04-19T02:20:08.993444+0000","last_fullsized":"2024-04-19T02:20:08.993444+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:28.091242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.001770+0000","last_change":"2024-04-19T02:20:10.001770+0000","last_active":"2024-04-19T02:20:10.001770+0000","last_peered":"2024-04-19T02:20:10.001770+0000","last_clean":"2024-04-19T02:20:10.001770+0000","last_became_active":"2024-04-19T02:20:10.001415+0000","last_became_peered":"2024-04-19T02:20:10.001415+0000","last_unstale":"2024-04-19T02:20:10.001770+0000","last_undegraded":"2024-04-19T02:20:10.001770+0000","last_fullsized":"2024-04-19T02:20:10.001770+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:00:30.084474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993420+0000","last_change":"2024-04-19T02:15:29.285015+0000","last_active":"2024-04-19T02:20:08.993420+0000","last_peered":"2024-04-19T02:20:08.993420+0000","last_clean":"2024-04-19T02:20:08.993420+0000","last_became_active":"2024-04-19T02:15:29.284164+0000","last_became_peered":"2024-04-19T02:15:29.284164+0000","last_unstale":"2024-04-19T02:20:08.993420+0000","last_undegraded":"2024-04-19T02:20:08.993420+0000","last_fullsized":"2024-04-19T02:20:08.993420+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:36.987844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":83,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993579+0000","last_change":"2024-04-19T02:15:24.533912+0000","last_active":"2024-04-19T02:20:08.993579+0000","last_peered":"2024-04-19T02:20:08.993579+0000","last_clean":"2024-04-19T02:20:08.993579+0000","last_became_active":"2024-04-19T02:15:24.533580+0000","last_became_peered":"2024-04-19T02:15:24.533580+0000","last_unstale":"2024-04-19T02:20:08.993579+0000","last_undegraded":"2024-04-19T02:20:08.993579+0000","last_fullsized":"2024-04-19T02:20:08.993579+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:45.045477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.639268+0000","last_change":"2024-04-19T02:20:10.639268+0000","last_active":"2024-04-19T02:20:10.639268+0000","last_peered":"2024-04-19T02:20:10.639268+0000","last_clean":"2024-04-19T02:20:10.639268+0000","last_became_active":"2024-04-19T02:20:10.638966+0000","last_became_peered":"2024-04-19T02:20:10.638966+0000","last_unstale":"2024-04-19T02:20:10.639268+0000","last_undegraded":"2024-04-19T02:20:10.639268+0000","last_fullsized":"2024-04-19T02:20:10.639268+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:38.164641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":49,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996215+0000","last_change":"2024-04-19T02:20:07.986363+0000","last_active":"2024-04-19T02:20:08.996215+0000","last_peered":"2024-04-19T02:20:08.996215+0000","last_clean":"2024-04-19T02:20:08.996215+0000","last_became_active":"2024-04-19T02:20:07.986110+0000","last_became_peered":"2024-04-19T02:20:07.986110+0000","last_unstale":"2024-04-19T02:20:08.996215+0000","last_undegraded":"2024-04-19T02:20:08.996215+0000","last_fullsized":"2024-04-19T02:20:08.996215+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:12.545910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":60,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996406+0000","last_change":"2024-04-19T02:19:54.925886+0000","last_active":"2024-04-19T02:20:08.996406+0000","last_peered":"2024-04-19T02:20:08.996406+0000","last_clean":"2024-04-19T02:20:08.996406+0000","last_became_active":"2024-04-19T02:19:54.925570+0000","last_became_peered":"2024-04-19T02:19:54.925570+0000","last_unstale":"2024-04-19T02:20:08.996406+0000","last_undegraded":"2024-04-19T02:20:08.996406+0000","last_fullsized":"2024-04-19T02:20:08.996406+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:33:34.594161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.990045+0000","last_change":"2024-04-19T02:19:54.933960+0000","last_active":"2024-04-19T02:20:08.990045+0000","last_peered":"2024-04-19T02:20:08.990045+0000","last_clean":"2024-04-19T02:20:08.990045+0000","last_became_active":"2024-04-19T02:19:54.929918+0000","last_became_peered":"2024-04-19T02:19:54.929918+0000","last_unstale":"2024-04-19T02:20:08.990045+0000","last_undegraded":"2024-04-19T02:20:08.990045+0000","last_fullsized":"2024-04-19T02:20:08.990045+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:33:10.282684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995346+0000","last_change":"2024-04-19T02:15:29.281694+0000","last_active":"2024-04-19T02:20:08.995346+0000","last_peered":"2024-04-19T02:20:08.995346+0000","last_clean":"2024-04-19T02:20:08.995346+0000","last_became_active":"2024-04-19T02:15:29.280519+0000","last_became_peered":"2024-04-19T02:15:29.280519+0000","last_unstale":"2024-04-19T02:20:08.995346+0000","last_undegraded":"2024-04-19T02:20:08.995346+0000","last_fullsized":"2024-04-19T02:20:08.995346+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:50.890545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.990434+0000","last_change":"2024-04-19T02:19:54.931726+0000","last_active":"2024-04-19T02:20:08.990434+0000","last_peered":"2024-04-19T02:20:08.990434+0000","last_clean":"2024-04-19T02:20:08.990434+0000","last_became_active":"2024-04-19T02:19:54.928460+0000","last_became_peered":"2024-04-19T02:19:54.928460+0000","last_unstale":"2024-04-19T02:20:08.990434+0000","last_undegraded":"2024-04-19T02:20:08.990434+0000","last_fullsized":"2024-04-19T02:20:08.990434+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:07:04.935620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.998879+0000","last_change":"2024-04-19T02:20:09.998879+0000","last_active":"2024-04-19T02:20:09.998879+0000","last_peered":"2024-04-19T02:20:09.998879+0000","last_clean":"2024-04-19T02:20:09.998879+0000","last_became_active":"2024-04-19T02:20:09.998629+0000","last_became_peered":"2024-04-19T02:20:09.998629+0000","last_unstale":"2024-04-19T02:20:09.998879+0000","last_undegraded":"2024-04-19T02:20:09.998879+0000","last_fullsized":"2024-04-19T02:20:09.998879+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:38:00.584717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.639272+0000","last_change":"2024-04-19T02:20:10.639272+0000","last_active":"2024-04-19T02:20:10.639272+0000","last_peered":"2024-04-19T02:20:10.639272+0000","last_clean":"2024-04-19T02:20:10.639272+0000","last_became_active":"2024-04-19T02:20:10.638912+0000","last_became_peered":"2024-04-19T02:20:10.638912+0000","last_unstale":"2024-04-19T02:20:10.639272+0000","last_undegraded":"2024-04-19T02:20:10.639272+0000","last_fullsized":"2024-04-19T02:20:10.639272+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:19.396777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":83,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993846+0000","last_change":"2024-04-19T02:15:24.533777+0000","last_active":"2024-04-19T02:20:08.993846+0000","last_peered":"2024-04-19T02:20:08.993846+0000","last_clean":"2024-04-19T02:20:08.993846+0000","last_became_active":"2024-04-19T02:15:24.533436+0000","last_became_peered":"2024-04-19T02:15:24.533436+0000","last_unstale":"2024-04-19T02:20:08.993846+0000","last_undegraded":"2024-04-19T02:20:08.993846+0000","last_fullsized":"2024-04-19T02:20:08.993846+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:53:25.922418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.990547+0000","last_change":"2024-04-19T02:19:54.933278+0000","last_active":"2024-04-19T02:20:08.990547+0000","last_peered":"2024-04-19T02:20:08.990547+0000","last_clean":"2024-04-19T02:20:08.990547+0000","last_became_active":"2024-04-19T02:19:54.931328+0000","last_became_peered":"2024-04-19T02:19:54.931328+0000","last_unstale":"2024-04-19T02:20:08.990547+0000","last_undegraded":"2024-04-19T02:20:08.990547+0000","last_fullsized":"2024-04-19T02:20:08.990547+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:08:38.731741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996195+0000","last_change":"2024-04-19T02:15:29.282244+0000","last_active":"2024-04-19T02:20:08.996195+0000","last_peered":"2024-04-19T02:20:08.996195+0000","last_clean":"2024-04-19T02:20:08.996195+0000","last_became_active":"2024-04-19T02:15:29.280366+0000","last_became_peered":"2024-04-19T02:15:29.280366+0000","last_unstale":"2024-04-19T02:20:08.996195+0000","last_undegraded":"2024-04-19T02:20:08.996195+0000","last_fullsized":"2024-04-19T02:20:08.996195+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:38.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.995650+0000","last_change":"2024-04-19T02:15:28.893027+0000","last_active":"2024-04-19T02:20:08.995650+0000","last_peered":"2024-04-19T02:20:08.995650+0000","last_clean":"2024-04-19T02:20:08.995650+0000","last_became_active":"2024-04-19T02:15:28.892695+0000","last_became_peered":"2024-04-19T02:15:28.892695+0000","last_unstale":"2024-04-19T02:20:08.995650+0000","last_undegraded":"2024-04-19T02:20:08.995650+0000","last_fullsized":"2024-04-19T02:20:08.995650+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:54:39.720829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996179+0000","last_change":"2024-04-19T02:19:54.929648+0000","last_active":"2024-04-19T02:20:08.996179+0000","last_peered":"2024-04-19T02:20:08.996179+0000","last_clean":"2024-04-19T02:20:08.996179+0000","last_became_active":"2024-04-19T02:19:54.929412+0000","last_became_peered":"2024-04-19T02:19:54.929412+0000","last_unstale":"2024-04-19T02:20:08.996179+0000","last_undegraded":"2024-04-19T02:20:08.996179+0000","last_fullsized":"2024-04-19T02:20:08.996179+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:28:21.688550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":94,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992761+0000","last_change":"2024-04-19T02:19:54.927315+0000","last_active":"2024-04-19T02:20:08.992761+0000","last_peered":"2024-04-19T02:20:08.992761+0000","last_clean":"2024-04-19T02:20:08.992761+0000","last_became_active":"2024-04-19T02:19:54.926630+0000","last_became_peered":"2024-04-19T02:19:54.926630+0000","last_unstale":"2024-04-19T02:20:08.992761+0000","last_undegraded":"2024-04-19T02:20:08.992761+0000","last_fullsized":"2024-04-19T02:20:08.992761+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:39:00.822558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992698+0000","last_change":"2024-04-19T02:19:54.931920+0000","last_active":"2024-04-19T02:20:08.992698+0000","last_peered":"2024-04-19T02:20:08.992698+0000","last_clean":"2024-04-19T02:20:08.992698+0000","last_became_active":"2024-04-19T02:19:54.931328+0000","last_became_peered":"2024-04-19T02:19:54.931328+0000","last_unstale":"2024-04-19T02:20:08.992698+0000","last_undegraded":"2024-04-19T02:20:08.992698+0000","last_fullsized":"2024-04-19T02:20:08.992698+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:57:39.655376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":80,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996399+0000","last_change":"2024-04-19T02:15:28.893239+0000","last_active":"2024-04-19T02:20:08.996399+0000","last_peered":"2024-04-19T02:20:08.996399+0000","last_clean":"2024-04-19T02:20:08.996399+0000","last_became_active":"2024-04-19T02:15:28.892881+0000","last_became_peered":"2024-04-19T02:15:28.892881+0000","last_unstale":"2024-04-19T02:20:08.996399+0000","last_undegraded":"2024-04-19T02:20:08.996399+0000","last_fullsized":"2024-04-19T02:20:08.996399+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:11.854849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.992227+0000","last_change":"2024-04-19T02:19:54.924029+0000","last_active":"2024-04-19T02:20:08.992227+0000","last_peered":"2024-04-19T02:20:08.992227+0000","last_clean":"2024-04-19T02:20:08.992227+0000","last_became_active":"2024-04-19T02:19:54.923752+0000","last_became_peered":"2024-04-19T02:19:54.923752+0000","last_unstale":"2024-04-19T02:20:08.992227+0000","last_undegraded":"2024-04-19T02:20:08.992227+0000","last_fullsized":"2024-04-19T02:20:08.992227+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:26:41.825722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.990448+0000","last_change":"2024-04-19T02:19:54.933652+0000","last_active":"2024-04-19T02:20:08.990448+0000","last_peered":"2024-04-19T02:20:08.990448+0000","last_clean":"2024-04-19T02:20:08.990448+0000","last_became_active":"2024-04-19T02:19:54.932103+0000","last_became_peered":"2024-04-19T02:19:54.932103+0000","last_unstale":"2024-04-19T02:20:08.990448+0000","last_undegraded":"2024-04-19T02:20:08.990448+0000","last_fullsized":"2024-04-19T02:20:08.990448+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:46:14.540427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996400+0000","last_change":"2024-04-19T02:19:54.925832+0000","last_active":"2024-04-19T02:20:08.996400+0000","last_peered":"2024-04-19T02:20:08.996400+0000","last_clean":"2024-04-19T02:20:08.996400+0000","last_became_active":"2024-04-19T02:19:54.925565+0000","last_became_peered":"2024-04-19T02:19:54.925565+0000","last_unstale":"2024-04-19T02:20:08.996400+0000","last_undegraded":"2024-04-19T02:20:08.996400+0000","last_fullsized":"2024-04-19T02:20:08.996400+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:28:13.380027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.990549+0000","last_change":"2024-04-19T02:19:54.929083+0000","last_active":"2024-04-19T02:20:08.990549+0000","last_peered":"2024-04-19T02:20:08.990549+0000","last_clean":"2024-04-19T02:20:08.990549+0000","last_became_active":"2024-04-19T02:19:54.926439+0000","last_became_peered":"2024-04-19T02:19:54.926439+0000","last_unstale":"2024-04-19T02:20:08.990549+0000","last_undegraded":"2024-04-19T02:20:08.990549+0000","last_fullsized":"2024-04-19T02:20:08.990549+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:15:04.675082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993698+0000","last_change":"2024-04-19T02:19:54.931258+0000","last_active":"2024-04-19T02:20:08.993698+0000","last_peered":"2024-04-19T02:20:08.993698+0000","last_clean":"2024-04-19T02:20:08.993698+0000","last_became_active":"2024-04-19T02:19:54.930665+0000","last_became_peered":"2024-04-19T02:19:54.930665+0000","last_unstale":"2024-04-19T02:20:08.993698+0000","last_undegraded":"2024-04-19T02:20:08.993698+0000","last_fullsized":"2024-04-19T02:20:08.993698+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:57:08.681822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.993591+0000","last_change":"2024-04-19T02:19:54.931055+0000","last_active":"2024-04-19T02:20:08.993591+0000","last_peered":"2024-04-19T02:20:08.993591+0000","last_clean":"2024-04-19T02:20:08.993591+0000","last_became_active":"2024-04-19T02:19:54.930527+0000","last_became_peered":"2024-04-19T02:19:54.930527+0000","last_unstale":"2024-04-19T02:20:08.993591+0000","last_undegraded":"2024-04-19T02:20:08.993591+0000","last_fullsized":"2024-04-19T02:20:08.993591+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:05:38.717309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.001589+0000","last_change":"2024-04-19T02:20:10.001589+0000","last_active":"2024-04-19T02:20:10.001589+0000","last_peered":"2024-04-19T02:20:10.001589+0000","last_clean":"2024-04-19T02:20:10.001589+0000","last_became_active":"2024-04-19T02:20:10.001304+0000","last_became_peered":"2024-04-19T02:20:10.001304+0000","last_unstale":"2024-04-19T02:20:10.001589+0000","last_undegraded":"2024-04-19T02:20:10.001589+0000","last_fullsized":"2024-04-19T02:20:10.001589+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:36.432257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996078+0000","last_change":"2024-04-19T02:20:08.662331+0000","last_active":"2024-04-19T02:20:08.996078+0000","last_peered":"2024-04-19T02:20:08.996078+0000","last_clean":"2024-04-19T02:20:08.996078+0000","last_became_active":"2024-04-19T02:20:08.661996+0000","last_became_peered":"2024-04-19T02:20:08.661996+0000","last_unstale":"2024-04-19T02:20:08.996078+0000","last_undegraded":"2024-04-19T02:20:08.996078+0000","last_fullsized":"2024-04-19T02:20:08.996078+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:25:03.894231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.001706+0000","last_change":"2024-04-19T02:20:10.001706+0000","last_active":"2024-04-19T02:20:10.001706+0000","last_peered":"2024-04-19T02:20:10.001706+0000","last_clean":"2024-04-19T02:20:10.001706+0000","last_became_active":"2024-04-19T02:20:10.001372+0000","last_became_peered":"2024-04-19T02:20:10.001372+0000","last_unstale":"2024-04-19T02:20:10.001706+0000","last_undegraded":"2024-04-19T02:20:10.001706+0000","last_fullsized":"2024-04-19T02:20:10.001706+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:54:55.702629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T02:20:08.996258+0000","last_change":"2024-04-19T02:15:29.277568+0000","last_active":"2024-04-19T02:20:08.996258+0000","last_peered":"2024-04-19T02:20:08.996258+0000","last_clean":"2024-04-19T02:20:08.996258+0000","last_became_active":"2024-04-19T02:15:29.276725+0000","last_became_peered":"2024-04-19T02:15:29.276725+0000","last_unstale":"2024-04-19T02:20:08.996258+0000","last_undegraded":"2024-04-19T02:20:08.996258+0000","last_fullsized":"2024-04-19T02:20:08.996258+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:28.251797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5254,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":72,"seq":309237645319,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58816,"kb_used_data":884,"kb_used_omap":6,"kb_used_meta":57913,"kb_avail":94313024,"statfs":{"total":96636764160,"available":96576536576,"internally_reserved":0,"allocated":905216,"data_stored":358135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6848,"internal_metadata":59303232},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]}]},{"osd":0,"up_from":8,"seq":34359738431,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":275424,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":273918,"kb_avail":94096416,"statfs":{"total":96636764160,"available":96354729984,"internally_reserved":0,"allocated":1519616,"data_stored":948136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":280492486},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 02:19:26 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.371,"15min":0.316},"min":{"1min":0.29899999999999999,"5min":0.159,"15min":0.159},"max":{"1min":0.57499999999999996,"5min":4.4480000000000004,"15min":4.4480000000000004},"last":0.443},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.379,"15min":0.36599999999999999},"min":{"1min":0.29399999999999998,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.54800000000000004,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.46600000000000003}]},{"osd":2,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":2.1000000000000001,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.42899999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738430,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307416,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":305918,"kb_avail":94064424,"statfs":{"total":96636764160,"available":96321970176,"internally_reserved":0,"allocated":1515520,"data_stored":949633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":313260486},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:19:29 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.40600000000000003,"15min":0.376},"min":{"1min":0.32700000000000001,"5min":0.157,"15min":0.157},"max":{"1min":0.64900000000000002,"5min":1.794,"15min":1.794},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.38100000000000001,"15min":0.32400000000000001},"min":{"1min":0.37,"5min":0.16,"15min":0.16},"max":{"1min":0.63,"5min":2.411,"15min":2.411},"last":0.60399999999999998}]},{"osd":2,"last update":"Fri Apr 19 02:16:26 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.57599999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5254,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:20:21.348 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.348 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.349 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.349 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.349 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.349 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.349 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.349 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.350 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.350 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.350 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.350 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.350 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.350 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.350 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.350 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.350 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.350 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.351 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.351 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.351 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.351 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.352 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.352 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.352 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.352 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.352 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.352 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.352 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.352 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.352 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.352 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.353 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.353 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.353 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.353 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.353 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.353 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.353 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.353 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.353 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.353 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.354 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.354 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.354 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.354 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.354 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.354 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.354 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.354 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.354 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.355 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.355 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.355 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.355 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.356 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.356 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.356 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.356 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.357 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.357 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.357 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.357 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.357 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.357 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.357 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-19T02:15:23.520722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.358 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.358 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.358 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-19T02:15:23.520722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.358 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.358 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.358 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-19T02:15:23.520722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.358 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.359 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.359 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-19T02:15:23.520722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.359 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-19T02:15:23.520722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.359 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.359 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.359 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-19T02:15:23.520722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.359 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.359 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.359 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-19T02:15:23.520722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.360 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.360 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.360 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.360 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-19T02:15:23.520722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.360 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.360 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-19T02:15:23.520722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.360 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.360 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.360 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.361 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.361 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.361 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.361 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.361 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.361 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.361 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.361 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.361 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.361 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.362 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.362 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.362 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.362 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:21.362 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-19T02:20:41.364 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:20:41.709 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:20:41.711 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-04-19T02:20:41.721 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":237,"stamp":"2024-04-19T02:20:40.818888+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":641632,"kb_used_data":3848,"kb_used_omap":9,"kb_used_meta":637750,"kb_avail":282473888,"statfs":{"total":289910292480,"available":289253261312,"internally_reserved":0,"allocated":3940352,"data_stored":2255904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10036,"internal_metadata":653056204},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003218"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.998832+0000","last_change":"2024-04-19T02:19:54.929643+0000","last_active":"2024-04-19T02:20:09.998832+0000","last_peered":"2024-04-19T02:20:09.998832+0000","last_clean":"2024-04-19T02:20:09.998832+0000","last_became_active":"2024-04-19T02:19:54.929435+0000","last_became_peered":"2024-04-19T02:19:54.929435+0000","last_unstale":"2024-04-19T02:20:09.998832+0000","last_undegraded":"2024-04-19T02:20:09.998832+0000","last_fullsized":"2024-04-19T02:20:09.998832+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.998305+0000","last_change":"2024-04-19T02:19:54.931532+0000","last_active":"2024-04-19T02:20:09.998305+0000","last_peered":"2024-04-19T02:20:09.998305+0000","last_clean":"2024-04-19T02:20:09.998305+0000","last_became_active":"2024-04-19T02:19:54.931278+0000","last_became_peered":"2024-04-19T02:19:54.931278+0000","last_unstale":"2024-04-19T02:20:09.998305+0000","last_undegraded":"2024-04-19T02:20:09.998305+0000","last_fullsized":"2024-04-19T02:20:09.998305+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:35.678810+0000","last_change":"2024-04-19T02:20:35.678916+0000","last_active":"2024-04-19T02:20:35.678810+0000","last_peered":"2024-04-19T02:20:35.678810+0000","last_clean":"2024-04-19T02:20:35.678810+0000","last_became_active":"2024-04-19T02:15:29.286169+0000","last_became_peered":"2024-04-19T02:15:29.286169+0000","last_unstale":"2024-04-19T02:20:35.678810+0000","last_undegraded":"2024-04-19T02:20:35.678810+0000","last_fullsized":"2024-04-19T02:20:35.678810+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:35.678786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:35.678786+0000","last_clean_scrub_stamp":"2024-04-19T02:20:35.678786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:39:46.619486+0000","scrub_duration":0.0021837459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637860+0000","last_change":"2024-04-19T02:19:54.927063+0000","last_active":"2024-04-19T02:20:10.637860+0000","last_peered":"2024-04-19T02:20:10.637860+0000","last_clean":"2024-04-19T02:20:10.637860+0000","last_became_active":"2024-04-19T02:19:54.926046+0000","last_became_peered":"2024-04-19T02:19:54.926046+0000","last_unstale":"2024-04-19T02:20:10.637860+0000","last_undegraded":"2024-04-19T02:20:10.637860+0000","last_fullsized":"2024-04-19T02:20:10.637860+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":57,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:20.499482+0000","last_change":"2024-04-19T02:19:54.931669+0000","last_active":"2024-04-19T02:20:20.499482+0000","last_peered":"2024-04-19T02:20:20.499482+0000","last_clean":"2024-04-19T02:20:20.499482+0000","last_became_active":"2024-04-19T02:19:54.931435+0000","last_became_peered":"2024-04-19T02:19:54.931435+0000","last_unstale":"2024-04-19T02:20:20.499482+0000","last_undegraded":"2024-04-19T02:20:20.499482+0000","last_fullsized":"2024-04-19T02:20:20.499482+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:20.006277+0000","last_change":"2024-04-19T02:19:54.924250+0000","last_active":"2024-04-19T02:20:20.006277+0000","last_peered":"2024-04-19T02:20:20.006277+0000","last_clean":"2024-04-19T02:20:20.006277+0000","last_became_active":"2024-04-19T02:19:54.923984+0000","last_became_peered":"2024-04-19T02:19:54.923984+0000","last_unstale":"2024-04-19T02:20:20.006277+0000","last_undegraded":"2024-04-19T02:20:20.006277+0000","last_fullsized":"2024-04-19T02:20:20.006277+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:20.006245+0000","last_change":"2024-04-19T02:19:54.926647+0000","last_active":"2024-04-19T02:20:20.006245+0000","last_peered":"2024-04-19T02:20:20.006245+0000","last_clean":"2024-04-19T02:20:20.006245+0000","last_became_active":"2024-04-19T02:19:54.925529+0000","last_became_peered":"2024-04-19T02:19:54.925529+0000","last_unstale":"2024-04-19T02:20:20.006245+0000","last_undegraded":"2024-04-19T02:20:20.006245+0000","last_fullsized":"2024-04-19T02:20:20.006245+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:20.006244+0000","last_change":"2024-04-19T02:19:54.930828+0000","last_active":"2024-04-19T02:20:20.006244+0000","last_peered":"2024-04-19T02:20:20.006244+0000","last_clean":"2024-04-19T02:20:20.006244+0000","last_became_active":"2024-04-19T02:19:54.930075+0000","last_became_peered":"2024-04-19T02:19:54.930075+0000","last_unstale":"2024-04-19T02:20:20.006244+0000","last_undegraded":"2024-04-19T02:20:20.006244+0000","last_fullsized":"2024-04-19T02:20:20.006244+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.996771+0000","last_change":"2024-04-19T02:19:54.931617+0000","last_active":"2024-04-19T02:20:09.996771+0000","last_peered":"2024-04-19T02:20:09.996771+0000","last_clean":"2024-04-19T02:20:09.996771+0000","last_became_active":"2024-04-19T02:19:54.928496+0000","last_became_peered":"2024-04-19T02:19:54.928496+0000","last_unstale":"2024-04-19T02:20:09.996771+0000","last_undegraded":"2024-04-19T02:20:09.996771+0000","last_fullsized":"2024-04-19T02:20:09.996771+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":61,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637830+0000","last_change":"2024-04-19T02:16:30.093524+0000","last_active":"2024-04-19T02:20:10.637830+0000","last_peered":"2024-04-19T02:20:10.637830+0000","last_clean":"2024-04-19T02:20:10.637830+0000","last_became_active":"2024-04-19T02:16:30.093344+0000","last_became_peered":"2024-04-19T02:16:30.093344+0000","last_unstale":"2024-04-19T02:20:10.637830+0000","last_undegraded":"2024-04-19T02:20:10.637830+0000","last_fullsized":"2024-04-19T02:20:10.637830+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:20.006224+0000","last_change":"2024-04-19T02:19:54.926754+0000","last_active":"2024-04-19T02:20:20.006224+0000","last_peered":"2024-04-19T02:20:20.006224+0000","last_clean":"2024-04-19T02:20:20.006224+0000","last_became_active":"2024-04-19T02:19:54.926040+0000","last_became_peered":"2024-04-19T02:19:54.926040+0000","last_unstale":"2024-04-19T02:20:20.006224+0000","last_undegraded":"2024-04-19T02:20:20.006224+0000","last_fullsized":"2024-04-19T02:20:20.006224+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.998087+0000","last_change":"2024-04-19T02:20:08.662601+0000","last_active":"2024-04-19T02:20:09.998087+0000","last_peered":"2024-04-19T02:20:09.998087+0000","last_clean":"2024-04-19T02:20:09.998087+0000","last_became_active":"2024-04-19T02:20:08.662234+0000","last_became_peered":"2024-04-19T02:20:08.662234+0000","last_unstale":"2024-04-19T02:20:09.998087+0000","last_undegraded":"2024-04-19T02:20:09.998087+0000","last_fullsized":"2024-04-19T02:20:09.998087+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":68,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:24.574781+0000","last_change":"2024-04-19T02:20:24.574893+0000","last_active":"2024-04-19T02:20:24.574781+0000","last_peered":"2024-04-19T02:20:24.574781+0000","last_clean":"2024-04-19T02:20:24.574781+0000","last_became_active":"2024-04-19T02:19:54.932240+0000","last_became_peered":"2024-04-19T02:19:54.932240+0000","last_unstale":"2024-04-19T02:20:24.574781+0000","last_undegraded":"2024-04-19T02:20:24.574781+0000","last_fullsized":"2024-04-19T02:20:24.574781+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:24.574756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:24.574756+0000","last_clean_scrub_stamp":"2024-04-19T02:20:24.574756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:05:16.137888+0000","scrub_duration":0.02235088,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":80,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:12.907075+0000","last_change":"2024-04-19T02:15:29.284262+0000","last_active":"2024-04-19T02:20:12.907075+0000","last_peered":"2024-04-19T02:20:12.907075+0000","last_clean":"2024-04-19T02:20:12.907075+0000","last_became_active":"2024-04-19T02:15:29.283121+0000","last_became_peered":"2024-04-19T02:15:29.283121+0000","last_unstale":"2024-04-19T02:20:12.907075+0000","last_undegraded":"2024-04-19T02:20:12.907075+0000","last_fullsized":"2024-04-19T02:20:12.907075+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":80,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:12.907043+0000","last_change":"2024-04-19T02:15:29.285139+0000","last_active":"2024-04-19T02:20:12.907043+0000","last_peered":"2024-04-19T02:20:12.907043+0000","last_clean":"2024-04-19T02:20:12.907043+0000","last_became_active":"2024-04-19T02:15:29.284649+0000","last_became_peered":"2024-04-19T02:15:29.284649+0000","last_unstale":"2024-04-19T02:20:12.907043+0000","last_undegraded":"2024-04-19T02:20:12.907043+0000","last_fullsized":"2024-04-19T02:20:12.907043+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:20.567013+0000","last_change":"2024-04-19T02:20:20.567149+0000","last_active":"2024-04-19T02:20:20.567013+0000","last_peered":"2024-04-19T02:20:20.567013+0000","last_clean":"2024-04-19T02:20:20.567013+0000","last_became_active":"2024-04-19T02:19:54.930437+0000","last_became_peered":"2024-04-19T02:19:54.930437+0000","last_unstale":"2024-04-19T02:20:20.567013+0000","last_undegraded":"2024-04-19T02:20:20.567013+0000","last_fullsized":"2024-04-19T02:20:20.567013+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:20.566972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:20.566972+0000","last_clean_scrub_stamp":"2024-04-19T02:20:20.566972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:59:10.317082+0000","scrub_duration":0.00187685,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.002393+0000","last_change":"2024-04-19T02:20:10.001650+0000","last_active":"2024-04-19T02:20:10.002393+0000","last_peered":"2024-04-19T02:20:10.002393+0000","last_clean":"2024-04-19T02:20:10.002393+0000","last_became_active":"2024-04-19T02:20:10.001343+0000","last_became_peered":"2024-04-19T02:20:10.001343+0000","last_unstale":"2024-04-19T02:20:10.002393+0000","last_undegraded":"2024-04-19T02:20:10.002393+0000","last_fullsized":"2024-04-19T02:20:10.002393+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.998600+0000","last_change":"2024-04-19T02:19:54.933452+0000","last_active":"2024-04-19T02:20:09.998600+0000","last_peered":"2024-04-19T02:20:09.998600+0000","last_clean":"2024-04-19T02:20:09.998600+0000","last_became_active":"2024-04-19T02:19:54.933233+0000","last_became_peered":"2024-04-19T02:19:54.933233+0000","last_unstale":"2024-04-19T02:20:09.998600+0000","last_undegraded":"2024-04-19T02:20:09.998600+0000","last_fullsized":"2024-04-19T02:20:09.998600+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.996169+0000","last_change":"2024-04-19T02:19:54.925745+0000","last_active":"2024-04-19T02:20:09.996169+0000","last_peered":"2024-04-19T02:20:09.996169+0000","last_clean":"2024-04-19T02:20:09.996169+0000","last_became_active":"2024-04-19T02:19:54.925060+0000","last_became_peered":"2024-04-19T02:19:54.925060+0000","last_unstale":"2024-04-19T02:20:09.996169+0000","last_undegraded":"2024-04-19T02:20:09.996169+0000","last_fullsized":"2024-04-19T02:20:09.996169+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:32.721522+0000","last_change":"2024-04-19T02:20:32.721654+0000","last_active":"2024-04-19T02:20:32.721522+0000","last_peered":"2024-04-19T02:20:32.721522+0000","last_clean":"2024-04-19T02:20:32.721522+0000","last_became_active":"2024-04-19T02:19:54.926442+0000","last_became_peered":"2024-04-19T02:19:54.926442+0000","last_unstale":"2024-04-19T02:20:32.721522+0000","last_undegraded":"2024-04-19T02:20:32.721522+0000","last_fullsized":"2024-04-19T02:20:32.721522+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:32.721479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:32.721479+0000","last_clean_scrub_stamp":"2024-04-19T02:20:32.721479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:23:51.052141+0000","scrub_duration":0.0020564210000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637206+0000","last_change":"2024-04-19T02:19:54.932532+0000","last_active":"2024-04-19T02:20:10.637206+0000","last_peered":"2024-04-19T02:20:10.637206+0000","last_clean":"2024-04-19T02:20:10.637206+0000","last_became_active":"2024-04-19T02:19:54.931438+0000","last_became_peered":"2024-04-19T02:19:54.931438+0000","last_unstale":"2024-04-19T02:20:10.637206+0000","last_undegraded":"2024-04-19T02:20:10.637206+0000","last_fullsized":"2024-04-19T02:20:10.637206+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.997884+0000","last_change":"2024-04-19T02:20:08.662261+0000","last_active":"2024-04-19T02:20:09.997884+0000","last_peered":"2024-04-19T02:20:09.997884+0000","last_clean":"2024-04-19T02:20:09.997884+0000","last_became_active":"2024-04-19T02:20:08.661940+0000","last_became_peered":"2024-04-19T02:20:08.661940+0000","last_unstale":"2024-04-19T02:20:09.997884+0000","last_undegraded":"2024-04-19T02:20:09.997884+0000","last_fullsized":"2024-04-19T02:20:09.997884+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.640152+0000","last_change":"2024-04-19T02:20:10.639368+0000","last_active":"2024-04-19T02:20:10.640152+0000","last_peered":"2024-04-19T02:20:10.640152+0000","last_clean":"2024-04-19T02:20:10.640152+0000","last_became_active":"2024-04-19T02:20:10.639036+0000","last_became_peered":"2024-04-19T02:20:10.639036+0000","last_unstale":"2024-04-19T02:20:10.640152+0000","last_undegraded":"2024-04-19T02:20:10.640152+0000","last_fullsized":"2024-04-19T02:20:10.640152+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.997574+0000","last_change":"2024-04-19T02:19:54.928467+0000","last_active":"2024-04-19T02:20:09.997574+0000","last_peered":"2024-04-19T02:20:09.997574+0000","last_clean":"2024-04-19T02:20:09.997574+0000","last_became_active":"2024-04-19T02:19:54.928261+0000","last_became_peered":"2024-04-19T02:19:54.928261+0000","last_unstale":"2024-04-19T02:20:09.997574+0000","last_undegraded":"2024-04-19T02:20:09.997574+0000","last_fullsized":"2024-04-19T02:20:09.997574+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":79,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.998822+0000","last_change":"2024-04-19T02:15:29.278084+0000","last_active":"2024-04-19T02:20:09.998822+0000","last_peered":"2024-04-19T02:20:09.998822+0000","last_clean":"2024-04-19T02:20:09.998822+0000","last_became_active":"2024-04-19T02:15:29.276952+0000","last_became_peered":"2024-04-19T02:15:29.276952+0000","last_unstale":"2024-04-19T02:20:09.998822+0000","last_undegraded":"2024-04-19T02:20:09.998822+0000","last_fullsized":"2024-04-19T02:20:09.998822+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:36.825318+0000","last_change":"2024-04-19T02:20:36.825423+0000","last_active":"2024-04-19T02:20:36.825318+0000","last_peered":"2024-04-19T02:20:36.825318+0000","last_clean":"2024-04-19T02:20:36.825318+0000","last_became_active":"2024-04-19T02:19:54.931124+0000","last_became_peered":"2024-04-19T02:19:54.931124+0000","last_unstale":"2024-04-19T02:20:36.825318+0000","last_undegraded":"2024-04-19T02:20:36.825318+0000","last_fullsized":"2024-04-19T02:20:36.825318+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:36.825293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:36.825293+0000","last_clean_scrub_stamp":"2024-04-19T02:20:36.825293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:26:48.954624+0000","scrub_duration":0.0020341249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":80,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637710+0000","last_change":"2024-04-19T02:15:29.287389+0000","last_active":"2024-04-19T02:20:10.637710+0000","last_peered":"2024-04-19T02:20:10.637710+0000","last_clean":"2024-04-19T02:20:10.637710+0000","last_became_active":"2024-04-19T02:15:29.286431+0000","last_became_peered":"2024-04-19T02:15:29.286431+0000","last_unstale":"2024-04-19T02:20:10.637710+0000","last_undegraded":"2024-04-19T02:20:10.637710+0000","last_fullsized":"2024-04-19T02:20:10.637710+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":59,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:20.499104+0000","last_change":"2024-04-19T02:19:54.927108+0000","last_active":"2024-04-19T02:20:20.499104+0000","last_peered":"2024-04-19T02:20:20.499104+0000","last_clean":"2024-04-19T02:20:20.499104+0000","last_became_active":"2024-04-19T02:19:54.926838+0000","last_became_peered":"2024-04-19T02:19:54.926838+0000","last_unstale":"2024-04-19T02:20:20.499104+0000","last_undegraded":"2024-04-19T02:20:20.499104+0000","last_fullsized":"2024-04-19T02:20:20.499104+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":79,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:20.499310+0000","last_change":"2024-04-19T02:15:29.281792+0000","last_active":"2024-04-19T02:20:20.499310+0000","last_peered":"2024-04-19T02:20:20.499310+0000","last_clean":"2024-04-19T02:20:20.499310+0000","last_became_active":"2024-04-19T02:15:29.280479+0000","last_became_peered":"2024-04-19T02:15:29.280479+0000","last_unstale":"2024-04-19T02:20:20.499310+0000","last_undegraded":"2024-04-19T02:20:20.499310+0000","last_fullsized":"2024-04-19T02:20:20.499310+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.995053+0000","last_change":"2024-04-19T02:19:54.925277+0000","last_active":"2024-04-19T02:20:09.995053+0000","last_peered":"2024-04-19T02:20:09.995053+0000","last_clean":"2024-04-19T02:20:09.995053+0000","last_became_active":"2024-04-19T02:19:54.924484+0000","last_became_peered":"2024-04-19T02:19:54.924484+0000","last_unstale":"2024-04-19T02:20:09.995053+0000","last_undegraded":"2024-04-19T02:20:09.995053+0000","last_fullsized":"2024-04-19T02:20:09.995053+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.639795+0000","last_change":"2024-04-19T02:20:10.639077+0000","last_active":"2024-04-19T02:20:10.639795+0000","last_peered":"2024-04-19T02:20:10.639795+0000","last_clean":"2024-04-19T02:20:10.639795+0000","last_became_active":"2024-04-19T02:20:10.638737+0000","last_became_peered":"2024-04-19T02:20:10.638737+0000","last_unstale":"2024-04-19T02:20:10.639795+0000","last_undegraded":"2024-04-19T02:20:10.639795+0000","last_fullsized":"2024-04-19T02:20:10.639795+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.995156+0000","last_change":"2024-04-19T02:19:54.930346+0000","last_active":"2024-04-19T02:20:09.995156+0000","last_peered":"2024-04-19T02:20:09.995156+0000","last_clean":"2024-04-19T02:20:09.995156+0000","last_became_active":"2024-04-19T02:19:54.928398+0000","last_became_peered":"2024-04-19T02:19:54.928398+0000","last_unstale":"2024-04-19T02:20:09.995156+0000","last_undegraded":"2024-04-19T02:20:09.995156+0000","last_fullsized":"2024-04-19T02:20:09.995156+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:34.630146+0000","last_change":"2024-04-19T02:20:34.630281+0000","last_active":"2024-04-19T02:20:34.630146+0000","last_peered":"2024-04-19T02:20:34.630146+0000","last_clean":"2024-04-19T02:20:34.630146+0000","last_became_active":"2024-04-19T02:15:29.279314+0000","last_became_peered":"2024-04-19T02:15:29.279314+0000","last_unstale":"2024-04-19T02:20:34.630146+0000","last_undegraded":"2024-04-19T02:20:34.630146+0000","last_fullsized":"2024-04-19T02:20:34.630146+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:34.630122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:34.630122+0000","last_clean_scrub_stamp":"2024-04-19T02:20:34.630122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:19:42.256810+0000","scrub_duration":0.066969174000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.996869+0000","last_change":"2024-04-19T02:19:54.927744+0000","last_active":"2024-04-19T02:20:09.996869+0000","last_peered":"2024-04-19T02:20:09.996869+0000","last_clean":"2024-04-19T02:20:09.996869+0000","last_became_active":"2024-04-19T02:19:54.925729+0000","last_became_peered":"2024-04-19T02:19:54.925729+0000","last_unstale":"2024-04-19T02:20:09.996869+0000","last_undegraded":"2024-04-19T02:20:09.996869+0000","last_fullsized":"2024-04-19T02:20:09.996869+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.994967+0000","last_change":"2024-04-19T02:19:54.928435+0000","last_active":"2024-04-19T02:20:09.994967+0000","last_peered":"2024-04-19T02:20:09.994967+0000","last_clean":"2024-04-19T02:20:09.994967+0000","last_became_active":"2024-04-19T02:19:54.927666+0000","last_became_peered":"2024-04-19T02:19:54.927666+0000","last_unstale":"2024-04-19T02:20:09.994967+0000","last_undegraded":"2024-04-19T02:20:09.994967+0000","last_fullsized":"2024-04-19T02:20:09.994967+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:20.005850+0000","last_change":"2024-04-19T02:19:54.932025+0000","last_active":"2024-04-19T02:20:20.005850+0000","last_peered":"2024-04-19T02:20:20.005850+0000","last_clean":"2024-04-19T02:20:20.005850+0000","last_became_active":"2024-04-19T02:19:54.931540+0000","last_became_peered":"2024-04-19T02:19:54.931540+0000","last_unstale":"2024-04-19T02:20:20.005850+0000","last_undegraded":"2024-04-19T02:20:20.005850+0000","last_fullsized":"2024-04-19T02:20:20.005850+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:24.906406+0000","last_change":"2024-04-19T02:20:24.906512+0000","last_active":"2024-04-19T02:20:24.906406+0000","last_peered":"2024-04-19T02:20:24.906406+0000","last_clean":"2024-04-19T02:20:24.906406+0000","last_became_active":"2024-04-19T02:19:54.923784+0000","last_became_peered":"2024-04-19T02:19:54.923784+0000","last_unstale":"2024-04-19T02:20:24.906406+0000","last_undegraded":"2024-04-19T02:20:24.906406+0000","last_fullsized":"2024-04-19T02:20:24.906406+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:24.906368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:24.906368+0000","last_clean_scrub_stamp":"2024-04-19T02:20:24.906368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:16:17.186228+0000","scrub_duration":0.0016771609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":83,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:20.499067+0000","last_change":"2024-04-19T02:15:28.892937+0000","last_active":"2024-04-19T02:20:20.499067+0000","last_peered":"2024-04-19T02:20:20.499067+0000","last_clean":"2024-04-19T02:20:20.499067+0000","last_became_active":"2024-04-19T02:15:28.891440+0000","last_became_peered":"2024-04-19T02:15:28.891440+0000","last_unstale":"2024-04-19T02:20:20.499067+0000","last_undegraded":"2024-04-19T02:20:20.499067+0000","last_fullsized":"2024-04-19T02:20:20.499067+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.995091+0000","last_change":"2024-04-19T02:19:54.923898+0000","last_active":"2024-04-19T02:20:09.995091+0000","last_peered":"2024-04-19T02:20:09.995091+0000","last_clean":"2024-04-19T02:20:09.995091+0000","last_became_active":"2024-04-19T02:19:54.923493+0000","last_became_peered":"2024-04-19T02:19:54.923493+0000","last_unstale":"2024-04-19T02:20:09.995091+0000","last_undegraded":"2024-04-19T02:20:09.995091+0000","last_fullsized":"2024-04-19T02:20:09.995091+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":87,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:12.907134+0000","last_change":"2024-04-19T02:15:28.891097+0000","last_active":"2024-04-19T02:20:12.907134+0000","last_peered":"2024-04-19T02:20:12.907134+0000","last_clean":"2024-04-19T02:20:12.907134+0000","last_became_active":"2024-04-19T02:15:28.890795+0000","last_became_peered":"2024-04-19T02:15:28.890795+0000","last_unstale":"2024-04-19T02:20:12.907134+0000","last_undegraded":"2024-04-19T02:20:12.907134+0000","last_fullsized":"2024-04-19T02:20:12.907134+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":80,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:12.907112+0000","last_change":"2024-04-19T02:15:29.278546+0000","last_active":"2024-04-19T02:20:12.907112+0000","last_peered":"2024-04-19T02:20:12.907112+0000","last_clean":"2024-04-19T02:20:12.907112+0000","last_became_active":"2024-04-19T02:15:29.277547+0000","last_became_peered":"2024-04-19T02:15:29.277547+0000","last_unstale":"2024-04-19T02:20:12.907112+0000","last_undegraded":"2024-04-19T02:20:12.907112+0000","last_fullsized":"2024-04-19T02:20:12.907112+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":96,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:12.907102+0000","last_change":"2024-04-19T02:19:54.933035+0000","last_active":"2024-04-19T02:20:12.907102+0000","last_peered":"2024-04-19T02:20:12.907102+0000","last_clean":"2024-04-19T02:20:12.907102+0000","last_became_active":"2024-04-19T02:19:54.932829+0000","last_became_peered":"2024-04-19T02:19:54.932829+0000","last_unstale":"2024-04-19T02:20:12.907102+0000","last_undegraded":"2024-04-19T02:20:12.907102+0000","last_fullsized":"2024-04-19T02:20:12.907102+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:12.873826+0000","last_change":"2024-04-19T02:20:07.983368+0000","last_active":"2024-04-19T02:20:12.873826+0000","last_peered":"2024-04-19T02:20:12.873826+0000","last_clean":"2024-04-19T02:20:12.873826+0000","last_became_active":"2024-04-19T02:20:07.983080+0000","last_became_peered":"2024-04-19T02:20:07.983080+0000","last_unstale":"2024-04-19T02:20:12.873826+0000","last_undegraded":"2024-04-19T02:20:12.873826+0000","last_fullsized":"2024-04-19T02:20:12.873826+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.995252+0000","last_change":"2024-04-19T02:19:54.927323+0000","last_active":"2024-04-19T02:20:09.995252+0000","last_peered":"2024-04-19T02:20:09.995252+0000","last_clean":"2024-04-19T02:20:09.995252+0000","last_became_active":"2024-04-19T02:19:54.925703+0000","last_became_peered":"2024-04-19T02:19:54.925703+0000","last_unstale":"2024-04-19T02:20:09.995252+0000","last_undegraded":"2024-04-19T02:20:09.995252+0000","last_fullsized":"2024-04-19T02:20:09.995252+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":57,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:20.499286+0000","last_change":"2024-04-19T02:19:54.925918+0000","last_active":"2024-04-19T02:20:20.499286+0000","last_peered":"2024-04-19T02:20:20.499286+0000","last_clean":"2024-04-19T02:20:20.499286+0000","last_became_active":"2024-04-19T02:19:54.925634+0000","last_became_peered":"2024-04-19T02:19:54.925634+0000","last_unstale":"2024-04-19T02:20:20.499286+0000","last_undegraded":"2024-04-19T02:20:20.499286+0000","last_fullsized":"2024-04-19T02:20:20.499286+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":80,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.997791+0000","last_change":"2024-04-19T02:15:28.892934+0000","last_active":"2024-04-19T02:20:09.997791+0000","last_peered":"2024-04-19T02:20:09.997791+0000","last_clean":"2024-04-19T02:20:09.997791+0000","last_became_active":"2024-04-19T02:15:28.891879+0000","last_became_peered":"2024-04-19T02:15:28.891879+0000","last_unstale":"2024-04-19T02:20:09.997791+0000","last_undegraded":"2024-04-19T02:20:09.997791+0000","last_fullsized":"2024-04-19T02:20:09.997791+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.639813+0000","last_change":"2024-04-19T02:20:10.639094+0000","last_active":"2024-04-19T02:20:10.639813+0000","last_peered":"2024-04-19T02:20:10.639813+0000","last_clean":"2024-04-19T02:20:10.639813+0000","last_became_active":"2024-04-19T02:20:10.638755+0000","last_became_peered":"2024-04-19T02:20:10.638755+0000","last_unstale":"2024-04-19T02:20:10.639813+0000","last_undegraded":"2024-04-19T02:20:10.639813+0000","last_fullsized":"2024-04-19T02:20:10.639813+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":89,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637328+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:20:10.637328+0000","last_peered":"2024-04-19T02:20:10.637328+0000","last_clean":"2024-04-19T02:20:10.637328+0000","last_became_active":"2024-04-19T02:15:28.890882+0000","last_became_peered":"2024-04-19T02:15:28.890882+0000","last_unstale":"2024-04-19T02:20:10.637328+0000","last_undegraded":"2024-04-19T02:20:10.637328+0000","last_fullsized":"2024-04-19T02:20:10.637328+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.997074+0000","last_change":"2024-04-19T02:19:54.927209+0000","last_active":"2024-04-19T02:20:09.997074+0000","last_peered":"2024-04-19T02:20:09.997074+0000","last_clean":"2024-04-19T02:20:09.997074+0000","last_became_active":"2024-04-19T02:19:54.925121+0000","last_became_peered":"2024-04-19T02:19:54.925121+0000","last_unstale":"2024-04-19T02:20:09.997074+0000","last_undegraded":"2024-04-19T02:20:09.997074+0000","last_fullsized":"2024-04-19T02:20:09.997074+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":82,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.638107+0000","last_change":"2024-04-19T02:15:28.890265+0000","last_active":"2024-04-19T02:20:10.638107+0000","last_peered":"2024-04-19T02:20:10.638107+0000","last_clean":"2024-04-19T02:20:10.638107+0000","last_became_active":"2024-04-19T02:15:28.890004+0000","last_became_peered":"2024-04-19T02:15:28.890004+0000","last_unstale":"2024-04-19T02:20:10.638107+0000","last_undegraded":"2024-04-19T02:20:10.638107+0000","last_fullsized":"2024-04-19T02:20:10.638107+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:37.549179+0000","last_change":"2024-04-19T02:20:37.549289+0000","last_active":"2024-04-19T02:20:37.549179+0000","last_peered":"2024-04-19T02:20:37.549179+0000","last_clean":"2024-04-19T02:20:37.549179+0000","last_became_active":"2024-04-19T02:15:29.285197+0000","last_became_peered":"2024-04-19T02:15:29.285197+0000","last_unstale":"2024-04-19T02:20:37.549179+0000","last_undegraded":"2024-04-19T02:20:37.549179+0000","last_fullsized":"2024-04-19T02:20:37.549179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:37.549154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:37.549154+0000","last_clean_scrub_stamp":"2024-04-19T02:20:37.549154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:18:16.168949+0000","scrub_duration":0.0014928389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":82,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.998356+0000","last_change":"2024-04-19T02:15:28.893902+0000","last_active":"2024-04-19T02:20:09.998356+0000","last_peered":"2024-04-19T02:20:09.998356+0000","last_clean":"2024-04-19T02:20:09.998356+0000","last_became_active":"2024-04-19T02:15:28.893231+0000","last_became_peered":"2024-04-19T02:15:28.893231+0000","last_unstale":"2024-04-19T02:20:09.998356+0000","last_undegraded":"2024-04-19T02:20:09.998356+0000","last_fullsized":"2024-04-19T02:20:09.998356+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.997904+0000","last_change":"2024-04-19T02:19:54.925840+0000","last_active":"2024-04-19T02:20:09.997904+0000","last_peered":"2024-04-19T02:20:09.997904+0000","last_clean":"2024-04-19T02:20:09.997904+0000","last_became_active":"2024-04-19T02:19:54.925502+0000","last_became_peered":"2024-04-19T02:19:54.925502+0000","last_unstale":"2024-04-19T02:20:09.997904+0000","last_undegraded":"2024-04-19T02:20:09.997904+0000","last_fullsized":"2024-04-19T02:20:09.997904+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":82,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637789+0000","last_change":"2024-04-19T02:15:28.891234+0000","last_active":"2024-04-19T02:20:10.637789+0000","last_peered":"2024-04-19T02:20:10.637789+0000","last_clean":"2024-04-19T02:20:10.637789+0000","last_became_active":"2024-04-19T02:15:28.890881+0000","last_became_peered":"2024-04-19T02:15:28.890881+0000","last_unstale":"2024-04-19T02:20:10.637789+0000","last_undegraded":"2024-04-19T02:20:10.637789+0000","last_fullsized":"2024-04-19T02:20:10.637789+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637139+0000","last_change":"2024-04-19T02:19:54.926103+0000","last_active":"2024-04-19T02:20:10.637139+0000","last_peered":"2024-04-19T02:20:10.637139+0000","last_clean":"2024-04-19T02:20:10.637139+0000","last_became_active":"2024-04-19T02:19:54.925591+0000","last_became_peered":"2024-04-19T02:19:54.925591+0000","last_unstale":"2024-04-19T02:20:10.637139+0000","last_undegraded":"2024-04-19T02:20:10.637139+0000","last_fullsized":"2024-04-19T02:20:10.637139+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637415+0000","last_change":"2024-04-19T02:19:54.926813+0000","last_active":"2024-04-19T02:20:10.637415+0000","last_peered":"2024-04-19T02:20:10.637415+0000","last_clean":"2024-04-19T02:20:10.637415+0000","last_became_active":"2024-04-19T02:19:54.925523+0000","last_became_peered":"2024-04-19T02:19:54.925523+0000","last_unstale":"2024-04-19T02:20:10.637415+0000","last_undegraded":"2024-04-19T02:20:10.637415+0000","last_fullsized":"2024-04-19T02:20:10.637415+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:31.927807+0000","last_change":"2024-04-19T02:20:31.927940+0000","last_active":"2024-04-19T02:20:31.927807+0000","last_peered":"2024-04-19T02:20:31.927807+0000","last_clean":"2024-04-19T02:20:31.927807+0000","last_became_active":"2024-04-19T02:19:54.930843+0000","last_became_peered":"2024-04-19T02:19:54.930843+0000","last_unstale":"2024-04-19T02:20:31.927807+0000","last_undegraded":"2024-04-19T02:20:31.927807+0000","last_fullsized":"2024-04-19T02:20:31.927807+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:31.927783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:31.927783+0000","last_clean_scrub_stamp":"2024-04-19T02:20:31.927783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:16.149096+0000","scrub_duration":0.037287204999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.995805+0000","last_change":"2024-04-19T02:19:54.932708+0000","last_active":"2024-04-19T02:20:09.995805+0000","last_peered":"2024-04-19T02:20:09.995805+0000","last_clean":"2024-04-19T02:20:09.995805+0000","last_became_active":"2024-04-19T02:19:54.931553+0000","last_became_peered":"2024-04-19T02:19:54.931553+0000","last_unstale":"2024-04-19T02:20:09.995805+0000","last_undegraded":"2024-04-19T02:20:09.995805+0000","last_fullsized":"2024-04-19T02:20:09.995805+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637457+0000","last_change":"2024-04-19T02:19:54.927009+0000","last_active":"2024-04-19T02:20:10.637457+0000","last_peered":"2024-04-19T02:20:10.637457+0000","last_clean":"2024-04-19T02:20:10.637457+0000","last_became_active":"2024-04-19T02:19:54.925645+0000","last_became_peered":"2024-04-19T02:19:54.925645+0000","last_unstale":"2024-04-19T02:20:10.637457+0000","last_undegraded":"2024-04-19T02:20:10.637457+0000","last_fullsized":"2024-04-19T02:20:10.637457+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637005+0000","last_change":"2024-04-19T02:19:54.923689+0000","last_active":"2024-04-19T02:20:10.637005+0000","last_peered":"2024-04-19T02:20:10.637005+0000","last_clean":"2024-04-19T02:20:10.637005+0000","last_became_active":"2024-04-19T02:19:54.923321+0000","last_became_peered":"2024-04-19T02:19:54.923321+0000","last_unstale":"2024-04-19T02:20:10.637005+0000","last_undegraded":"2024-04-19T02:20:10.637005+0000","last_fullsized":"2024-04-19T02:20:10.637005+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":80,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.638016+0000","last_change":"2024-04-19T02:15:29.285019+0000","last_active":"2024-04-19T02:20:10.638016+0000","last_peered":"2024-04-19T02:20:10.638016+0000","last_clean":"2024-04-19T02:20:10.638016+0000","last_became_active":"2024-04-19T02:15:29.284650+0000","last_became_peered":"2024-04-19T02:15:29.284650+0000","last_unstale":"2024-04-19T02:20:10.638016+0000","last_undegraded":"2024-04-19T02:20:10.638016+0000","last_fullsized":"2024-04-19T02:20:10.638016+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.997742+0000","last_change":"2024-04-19T02:20:08.662566+0000","last_active":"2024-04-19T02:20:09.997742+0000","last_peered":"2024-04-19T02:20:09.997742+0000","last_clean":"2024-04-19T02:20:09.997742+0000","last_became_active":"2024-04-19T02:20:08.662277+0000","last_became_peered":"2024-04-19T02:20:08.662277+0000","last_unstale":"2024-04-19T02:20:09.997742+0000","last_undegraded":"2024-04-19T02:20:09.997742+0000","last_fullsized":"2024-04-19T02:20:09.997742+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":80,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637939+0000","last_change":"2024-04-19T02:15:29.287190+0000","last_active":"2024-04-19T02:20:10.637939+0000","last_peered":"2024-04-19T02:20:10.637939+0000","last_clean":"2024-04-19T02:20:10.637939+0000","last_became_active":"2024-04-19T02:15:29.286606+0000","last_became_peered":"2024-04-19T02:15:29.286606+0000","last_unstale":"2024-04-19T02:20:10.637939+0000","last_undegraded":"2024-04-19T02:20:10.637939+0000","last_fullsized":"2024-04-19T02:20:10.637939+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.997446+0000","last_change":"2024-04-19T02:19:54.928493+0000","last_active":"2024-04-19T02:20:09.997446+0000","last_peered":"2024-04-19T02:20:09.997446+0000","last_clean":"2024-04-19T02:20:09.997446+0000","last_became_active":"2024-04-19T02:19:54.928298+0000","last_became_peered":"2024-04-19T02:19:54.928298+0000","last_unstale":"2024-04-19T02:20:09.997446+0000","last_undegraded":"2024-04-19T02:20:09.997446+0000","last_fullsized":"2024-04-19T02:20:09.997446+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:27.963130+0000","last_change":"2024-04-19T02:20:27.963259+0000","last_active":"2024-04-19T02:20:27.963130+0000","last_peered":"2024-04-19T02:20:27.963130+0000","last_clean":"2024-04-19T02:20:27.963130+0000","last_became_active":"2024-04-19T02:19:54.927309+0000","last_became_peered":"2024-04-19T02:19:54.927309+0000","last_unstale":"2024-04-19T02:20:27.963130+0000","last_undegraded":"2024-04-19T02:20:27.963130+0000","last_fullsized":"2024-04-19T02:20:27.963130+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:27.963106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:27.963106+0000","last_clean_scrub_stamp":"2024-04-19T02:20:27.963106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:35:23.138484+0000","scrub_duration":0.070564934999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.999545+0000","last_change":"2024-04-19T02:20:09.998998+0000","last_active":"2024-04-19T02:20:09.999545+0000","last_peered":"2024-04-19T02:20:09.999545+0000","last_clean":"2024-04-19T02:20:09.999545+0000","last_became_active":"2024-04-19T02:20:09.998776+0000","last_became_peered":"2024-04-19T02:20:09.998776+0000","last_unstale":"2024-04-19T02:20:09.999545+0000","last_undegraded":"2024-04-19T02:20:09.999545+0000","last_fullsized":"2024-04-19T02:20:09.999545+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637917+0000","last_change":"2024-04-19T02:19:54.926207+0000","last_active":"2024-04-19T02:20:10.637917+0000","last_peered":"2024-04-19T02:20:10.637917+0000","last_clean":"2024-04-19T02:20:10.637917+0000","last_became_active":"2024-04-19T02:19:54.925872+0000","last_became_peered":"2024-04-19T02:19:54.925872+0000","last_unstale":"2024-04-19T02:20:10.637917+0000","last_undegraded":"2024-04-19T02:20:10.637917+0000","last_fullsized":"2024-04-19T02:20:10.637917+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.514809+0000","last_change":"2024-04-19T02:20:33.514910+0000","last_active":"2024-04-19T02:20:33.514809+0000","last_peered":"2024-04-19T02:20:33.514809+0000","last_clean":"2024-04-19T02:20:33.514809+0000","last_became_active":"2024-04-19T02:15:29.276968+0000","last_became_peered":"2024-04-19T02:15:29.276968+0000","last_unstale":"2024-04-19T02:20:33.514809+0000","last_undegraded":"2024-04-19T02:20:33.514809+0000","last_fullsized":"2024-04-19T02:20:33.514809+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:33.514784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:33.514784+0000","last_clean_scrub_stamp":"2024-04-19T02:20:33.514784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:01:55.933306+0000","scrub_duration":0.0019782179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":97,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637320+0000","last_change":"2024-04-19T02:19:54.927361+0000","last_active":"2024-04-19T02:20:10.637320+0000","last_peered":"2024-04-19T02:20:10.637320+0000","last_clean":"2024-04-19T02:20:10.637320+0000","last_became_active":"2024-04-19T02:19:54.927033+0000","last_became_peered":"2024-04-19T02:19:54.927033+0000","last_unstale":"2024-04-19T02:20:10.637320+0000","last_undegraded":"2024-04-19T02:20:10.637320+0000","last_fullsized":"2024-04-19T02:20:10.637320+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637470+0000","last_change":"2024-04-19T02:19:54.932790+0000","last_active":"2024-04-19T02:20:10.637470+0000","last_peered":"2024-04-19T02:20:10.637470+0000","last_clean":"2024-04-19T02:20:10.637470+0000","last_became_active":"2024-04-19T02:19:54.931683+0000","last_became_peered":"2024-04-19T02:19:54.931683+0000","last_unstale":"2024-04-19T02:20:10.637470+0000","last_undegraded":"2024-04-19T02:20:10.637470+0000","last_fullsized":"2024-04-19T02:20:10.637470+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:37.784585+0000","last_change":"2024-04-19T02:20:37.784722+0000","last_active":"2024-04-19T02:20:37.784585+0000","last_peered":"2024-04-19T02:20:37.784585+0000","last_clean":"2024-04-19T02:20:37.784585+0000","last_became_active":"2024-04-19T02:19:54.924686+0000","last_became_peered":"2024-04-19T02:19:54.924686+0000","last_unstale":"2024-04-19T02:20:37.784585+0000","last_undegraded":"2024-04-19T02:20:37.784585+0000","last_fullsized":"2024-04-19T02:20:37.784585+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:37.784561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:37.784561+0000","last_clean_scrub_stamp":"2024-04-19T02:20:37.784561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:26:44.108152+0000","scrub_duration":0.0013845000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.995480+0000","last_change":"2024-04-19T02:19:54.923465+0000","last_active":"2024-04-19T02:20:09.995480+0000","last_peered":"2024-04-19T02:20:09.995480+0000","last_clean":"2024-04-19T02:20:09.995480+0000","last_became_active":"2024-04-19T02:19:54.923164+0000","last_became_peered":"2024-04-19T02:19:54.923164+0000","last_unstale":"2024-04-19T02:20:09.995480+0000","last_undegraded":"2024-04-19T02:20:09.995480+0000","last_fullsized":"2024-04-19T02:20:09.995480+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.997425+0000","last_change":"2024-04-19T02:20:08.662301+0000","last_active":"2024-04-19T02:20:09.997425+0000","last_peered":"2024-04-19T02:20:09.997425+0000","last_clean":"2024-04-19T02:20:09.997425+0000","last_became_active":"2024-04-19T02:20:08.661952+0000","last_became_peered":"2024-04-19T02:20:08.661952+0000","last_unstale":"2024-04-19T02:20:09.997425+0000","last_undegraded":"2024-04-19T02:20:09.997425+0000","last_fullsized":"2024-04-19T02:20:09.997425+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:28.899614+0000","last_change":"2024-04-19T02:20:28.899746+0000","last_active":"2024-04-19T02:20:28.899614+0000","last_peered":"2024-04-19T02:20:28.899614+0000","last_clean":"2024-04-19T02:20:28.899614+0000","last_became_active":"2024-04-19T02:19:54.926463+0000","last_became_peered":"2024-04-19T02:19:54.926463+0000","last_unstale":"2024-04-19T02:20:28.899614+0000","last_undegraded":"2024-04-19T02:20:28.899614+0000","last_fullsized":"2024-04-19T02:20:28.899614+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:28.899588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:28.899588+0000","last_clean_scrub_stamp":"2024-04-19T02:20:28.899588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:34:50.323413+0000","scrub_duration":0.038469191,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":97,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637446+0000","last_change":"2024-04-19T02:19:54.932929+0000","last_active":"2024-04-19T02:20:10.637446+0000","last_peered":"2024-04-19T02:20:10.637446+0000","last_clean":"2024-04-19T02:20:10.637446+0000","last_became_active":"2024-04-19T02:19:54.932571+0000","last_became_peered":"2024-04-19T02:19:54.932571+0000","last_unstale":"2024-04-19T02:20:10.637446+0000","last_undegraded":"2024-04-19T02:20:10.637446+0000","last_fullsized":"2024-04-19T02:20:10.637446+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":280,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637133+0000","last_change":"2024-04-19T02:15:24.533634+0000","last_active":"2024-04-19T02:20:10.637133+0000","last_peered":"2024-04-19T02:20:10.637133+0000","last_clean":"2024-04-19T02:20:10.637133+0000","last_became_active":"2024-04-19T02:15:24.533420+0000","last_became_peered":"2024-04-19T02:15:24.533420+0000","last_unstale":"2024-04-19T02:20:10.637133+0000","last_undegraded":"2024-04-19T02:20:10.637133+0000","last_fullsized":"2024-04-19T02:20:10.637133+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":53,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:22.938802+0000","last_change":"2024-04-19T02:20:22.938906+0000","last_active":"2024-04-19T02:20:22.938802+0000","last_peered":"2024-04-19T02:20:22.938802+0000","last_clean":"2024-04-19T02:20:22.938802+0000","last_became_active":"2024-04-19T02:20:10.001415+0000","last_became_peered":"2024-04-19T02:20:10.001415+0000","last_unstale":"2024-04-19T02:20:22.938802+0000","last_undegraded":"2024-04-19T02:20:22.938802+0000","last_fullsized":"2024-04-19T02:20:22.938802+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:22.938775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:22.938775+0000","last_clean_scrub_stamp":"2024-04-19T02:20:22.938775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:30:51.144263+0000","scrub_duration":0.001921898,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:27.601296+0000","last_change":"2024-04-19T02:20:27.601464+0000","last_active":"2024-04-19T02:20:27.601296+0000","last_peered":"2024-04-19T02:20:27.601296+0000","last_clean":"2024-04-19T02:20:27.601296+0000","last_became_active":"2024-04-19T02:15:29.284164+0000","last_became_peered":"2024-04-19T02:15:29.284164+0000","last_unstale":"2024-04-19T02:20:27.601296+0000","last_undegraded":"2024-04-19T02:20:27.601296+0000","last_fullsized":"2024-04-19T02:20:27.601296+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:27.601255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:27.601255+0000","last_clean_scrub_stamp":"2024-04-19T02:20:27.601255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:45:08.158116+0000","scrub_duration":0.0020462050000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":84,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637203+0000","last_change":"2024-04-19T02:15:24.533912+0000","last_active":"2024-04-19T02:20:10.637203+0000","last_peered":"2024-04-19T02:20:10.637203+0000","last_clean":"2024-04-19T02:20:10.637203+0000","last_became_active":"2024-04-19T02:15:24.533580+0000","last_became_peered":"2024-04-19T02:15:24.533580+0000","last_unstale":"2024-04-19T02:20:10.637203+0000","last_undegraded":"2024-04-19T02:20:10.637203+0000","last_fullsized":"2024-04-19T02:20:10.637203+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.640131+0000","last_change":"2024-04-19T02:20:10.639268+0000","last_active":"2024-04-19T02:20:10.640131+0000","last_peered":"2024-04-19T02:20:10.640131+0000","last_clean":"2024-04-19T02:20:10.640131+0000","last_became_active":"2024-04-19T02:20:10.638966+0000","last_became_peered":"2024-04-19T02:20:10.638966+0000","last_unstale":"2024-04-19T02:20:10.640131+0000","last_undegraded":"2024-04-19T02:20:10.640131+0000","last_fullsized":"2024-04-19T02:20:10.640131+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.998577+0000","last_change":"2024-04-19T02:20:07.986363+0000","last_active":"2024-04-19T02:20:09.998577+0000","last_peered":"2024-04-19T02:20:09.998577+0000","last_clean":"2024-04-19T02:20:09.998577+0000","last_became_active":"2024-04-19T02:20:07.986110+0000","last_became_peered":"2024-04-19T02:20:07.986110+0000","last_unstale":"2024-04-19T02:20:09.998577+0000","last_undegraded":"2024-04-19T02:20:09.998577+0000","last_fullsized":"2024-04-19T02:20:09.998577+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":61,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.998413+0000","last_change":"2024-04-19T02:19:54.925886+0000","last_active":"2024-04-19T02:20:09.998413+0000","last_peered":"2024-04-19T02:20:09.998413+0000","last_clean":"2024-04-19T02:20:09.998413+0000","last_became_active":"2024-04-19T02:19:54.925570+0000","last_became_peered":"2024-04-19T02:19:54.925570+0000","last_unstale":"2024-04-19T02:20:09.998413+0000","last_undegraded":"2024-04-19T02:20:09.998413+0000","last_fullsized":"2024-04-19T02:20:09.998413+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.996111+0000","last_change":"2024-04-19T02:19:54.933960+0000","last_active":"2024-04-19T02:20:09.996111+0000","last_peered":"2024-04-19T02:20:09.996111+0000","last_clean":"2024-04-19T02:20:09.996111+0000","last_became_active":"2024-04-19T02:19:54.929918+0000","last_became_peered":"2024-04-19T02:19:54.929918+0000","last_unstale":"2024-04-19T02:20:09.996111+0000","last_undegraded":"2024-04-19T02:20:09.996111+0000","last_fullsized":"2024-04-19T02:20:09.996111+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":79,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.997668+0000","last_change":"2024-04-19T02:15:29.281694+0000","last_active":"2024-04-19T02:20:09.997668+0000","last_peered":"2024-04-19T02:20:09.997668+0000","last_clean":"2024-04-19T02:20:09.997668+0000","last_became_active":"2024-04-19T02:15:29.280519+0000","last_became_peered":"2024-04-19T02:15:29.280519+0000","last_unstale":"2024-04-19T02:20:09.997668+0000","last_undegraded":"2024-04-19T02:20:09.997668+0000","last_fullsized":"2024-04-19T02:20:09.997668+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.996465+0000","last_change":"2024-04-19T02:19:54.931726+0000","last_active":"2024-04-19T02:20:09.996465+0000","last_peered":"2024-04-19T02:20:09.996465+0000","last_clean":"2024-04-19T02:20:09.996465+0000","last_became_active":"2024-04-19T02:19:54.928460+0000","last_became_peered":"2024-04-19T02:19:54.928460+0000","last_unstale":"2024-04-19T02:20:09.996465+0000","last_undegraded":"2024-04-19T02:20:09.996465+0000","last_fullsized":"2024-04-19T02:20:09.996465+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.999540+0000","last_change":"2024-04-19T02:20:09.998879+0000","last_active":"2024-04-19T02:20:09.999540+0000","last_peered":"2024-04-19T02:20:09.999540+0000","last_clean":"2024-04-19T02:20:09.999540+0000","last_became_active":"2024-04-19T02:20:09.998629+0000","last_became_peered":"2024-04-19T02:20:09.998629+0000","last_unstale":"2024-04-19T02:20:09.999540+0000","last_undegraded":"2024-04-19T02:20:09.999540+0000","last_fullsized":"2024-04-19T02:20:09.999540+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.640140+0000","last_change":"2024-04-19T02:20:10.639272+0000","last_active":"2024-04-19T02:20:10.640140+0000","last_peered":"2024-04-19T02:20:10.640140+0000","last_clean":"2024-04-19T02:20:10.640140+0000","last_became_active":"2024-04-19T02:20:10.638912+0000","last_became_peered":"2024-04-19T02:20:10.638912+0000","last_unstale":"2024-04-19T02:20:10.640140+0000","last_undegraded":"2024-04-19T02:20:10.640140+0000","last_fullsized":"2024-04-19T02:20:10.640140+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":84,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.638122+0000","last_change":"2024-04-19T02:15:24.533777+0000","last_active":"2024-04-19T02:20:10.638122+0000","last_peered":"2024-04-19T02:20:10.638122+0000","last_clean":"2024-04-19T02:20:10.638122+0000","last_became_active":"2024-04-19T02:15:24.533436+0000","last_became_peered":"2024-04-19T02:15:24.533436+0000","last_unstale":"2024-04-19T02:20:10.638122+0000","last_undegraded":"2024-04-19T02:20:10.638122+0000","last_fullsized":"2024-04-19T02:20:10.638122+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.996544+0000","last_change":"2024-04-19T02:19:54.933278+0000","last_active":"2024-04-19T02:20:09.996544+0000","last_peered":"2024-04-19T02:20:09.996544+0000","last_clean":"2024-04-19T02:20:09.996544+0000","last_became_active":"2024-04-19T02:19:54.931328+0000","last_became_peered":"2024-04-19T02:19:54.931328+0000","last_unstale":"2024-04-19T02:20:09.996544+0000","last_undegraded":"2024-04-19T02:20:09.996544+0000","last_fullsized":"2024-04-19T02:20:09.996544+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":79,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.997840+0000","last_change":"2024-04-19T02:15:29.282244+0000","last_active":"2024-04-19T02:20:09.997840+0000","last_peered":"2024-04-19T02:20:09.997840+0000","last_clean":"2024-04-19T02:20:09.997840+0000","last_became_active":"2024-04-19T02:15:29.280366+0000","last_became_peered":"2024-04-19T02:15:29.280366+0000","last_unstale":"2024-04-19T02:20:09.997840+0000","last_undegraded":"2024-04-19T02:20:09.997840+0000","last_fullsized":"2024-04-19T02:20:09.997840+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:20.499156+0000","last_change":"2024-04-19T02:15:28.893027+0000","last_active":"2024-04-19T02:20:20.499156+0000","last_peered":"2024-04-19T02:20:20.499156+0000","last_clean":"2024-04-19T02:20:20.499156+0000","last_became_active":"2024-04-19T02:15:28.892695+0000","last_became_peered":"2024-04-19T02:15:28.892695+0000","last_unstale":"2024-04-19T02:20:20.499156+0000","last_undegraded":"2024-04-19T02:20:20.499156+0000","last_fullsized":"2024-04-19T02:20:20.499156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:20.499265+0000","last_change":"2024-04-19T02:19:54.929648+0000","last_active":"2024-04-19T02:20:20.499265+0000","last_peered":"2024-04-19T02:20:20.499265+0000","last_clean":"2024-04-19T02:20:20.499265+0000","last_became_active":"2024-04-19T02:19:54.929412+0000","last_became_peered":"2024-04-19T02:19:54.929412+0000","last_unstale":"2024-04-19T02:20:20.499265+0000","last_undegraded":"2024-04-19T02:20:20.499265+0000","last_fullsized":"2024-04-19T02:20:20.499265+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":96,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:20.005896+0000","last_change":"2024-04-19T02:19:54.927315+0000","last_active":"2024-04-19T02:20:20.005896+0000","last_peered":"2024-04-19T02:20:20.005896+0000","last_clean":"2024-04-19T02:20:20.005896+0000","last_became_active":"2024-04-19T02:19:54.926630+0000","last_became_peered":"2024-04-19T02:19:54.926630+0000","last_unstale":"2024-04-19T02:20:20.005896+0000","last_undegraded":"2024-04-19T02:20:20.005896+0000","last_fullsized":"2024-04-19T02:20:20.005896+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:23.628340+0000","last_change":"2024-04-19T02:20:23.628340+0000","last_active":"2024-04-19T02:20:23.628340+0000","last_peered":"2024-04-19T02:20:23.628340+0000","last_clean":"2024-04-19T02:20:23.628340+0000","last_became_active":"2024-04-19T02:19:54.931328+0000","last_became_peered":"2024-04-19T02:19:54.931328+0000","last_unstale":"2024-04-19T02:20:23.628340+0000","last_undegraded":"2024-04-19T02:20:23.628340+0000","last_fullsized":"2024-04-19T02:20:23.628340+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:23.628182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:23.628182+0000","last_clean_scrub_stamp":"2024-04-19T02:20:23.628182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:41:07.461430+0000","scrub_duration":0.042718649999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":82,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:20.499132+0000","last_change":"2024-04-19T02:15:28.893239+0000","last_active":"2024-04-19T02:20:20.499132+0000","last_peered":"2024-04-19T02:20:20.499132+0000","last_clean":"2024-04-19T02:20:20.499132+0000","last_became_active":"2024-04-19T02:15:28.892881+0000","last_became_peered":"2024-04-19T02:15:28.892881+0000","last_unstale":"2024-04-19T02:20:20.499132+0000","last_undegraded":"2024-04-19T02:20:20.499132+0000","last_fullsized":"2024-04-19T02:20:20.499132+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:21.614064+0000","last_change":"2024-04-19T02:20:21.614064+0000","last_active":"2024-04-19T02:20:21.614064+0000","last_peered":"2024-04-19T02:20:21.614064+0000","last_clean":"2024-04-19T02:20:21.614064+0000","last_became_active":"2024-04-19T02:19:54.923752+0000","last_became_peered":"2024-04-19T02:19:54.923752+0000","last_unstale":"2024-04-19T02:20:21.614064+0000","last_undegraded":"2024-04-19T02:20:21.614064+0000","last_fullsized":"2024-04-19T02:20:21.614064+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:21.613938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:21.613938+0000","last_clean_scrub_stamp":"2024-04-19T02:20:21.613938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:28:11.041024+0000","scrub_duration":0.0017798099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.996428+0000","last_change":"2024-04-19T02:19:54.933652+0000","last_active":"2024-04-19T02:20:09.996428+0000","last_peered":"2024-04-19T02:20:09.996428+0000","last_clean":"2024-04-19T02:20:09.996428+0000","last_became_active":"2024-04-19T02:19:54.932103+0000","last_became_peered":"2024-04-19T02:19:54.932103+0000","last_unstale":"2024-04-19T02:20:09.996428+0000","last_undegraded":"2024-04-19T02:20:09.996428+0000","last_fullsized":"2024-04-19T02:20:09.996428+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:20.499288+0000","last_change":"2024-04-19T02:19:54.925832+0000","last_active":"2024-04-19T02:20:20.499288+0000","last_peered":"2024-04-19T02:20:20.499288+0000","last_clean":"2024-04-19T02:20:20.499288+0000","last_became_active":"2024-04-19T02:19:54.925565+0000","last_became_peered":"2024-04-19T02:19:54.925565+0000","last_unstale":"2024-04-19T02:20:20.499288+0000","last_undegraded":"2024-04-19T02:20:20.499288+0000","last_fullsized":"2024-04-19T02:20:20.499288+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.996567+0000","last_change":"2024-04-19T02:19:54.929083+0000","last_active":"2024-04-19T02:20:09.996567+0000","last_peered":"2024-04-19T02:20:09.996567+0000","last_clean":"2024-04-19T02:20:09.996567+0000","last_became_active":"2024-04-19T02:19:54.926439+0000","last_became_peered":"2024-04-19T02:19:54.926439+0000","last_unstale":"2024-04-19T02:20:09.996567+0000","last_undegraded":"2024-04-19T02:20:09.996567+0000","last_fullsized":"2024-04-19T02:20:09.996567+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:20.006023+0000","last_change":"2024-04-19T02:19:54.931258+0000","last_active":"2024-04-19T02:20:20.006023+0000","last_peered":"2024-04-19T02:20:20.006023+0000","last_clean":"2024-04-19T02:20:20.006023+0000","last_became_active":"2024-04-19T02:19:54.930665+0000","last_became_peered":"2024-04-19T02:19:54.930665+0000","last_unstale":"2024-04-19T02:20:20.006023+0000","last_undegraded":"2024-04-19T02:20:20.006023+0000","last_fullsized":"2024-04-19T02:20:20.006023+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637261+0000","last_change":"2024-04-19T02:19:54.931055+0000","last_active":"2024-04-19T02:20:10.637261+0000","last_peered":"2024-04-19T02:20:10.637261+0000","last_clean":"2024-04-19T02:20:10.637261+0000","last_became_active":"2024-04-19T02:19:54.930527+0000","last_became_peered":"2024-04-19T02:19:54.930527+0000","last_unstale":"2024-04-19T02:20:10.637261+0000","last_undegraded":"2024-04-19T02:20:10.637261+0000","last_fullsized":"2024-04-19T02:20:10.637261+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.002363+0000","last_change":"2024-04-19T02:20:10.001589+0000","last_active":"2024-04-19T02:20:10.002363+0000","last_peered":"2024-04-19T02:20:10.002363+0000","last_clean":"2024-04-19T02:20:10.002363+0000","last_became_active":"2024-04-19T02:20:10.001304+0000","last_became_peered":"2024-04-19T02:20:10.001304+0000","last_unstale":"2024-04-19T02:20:10.002363+0000","last_undegraded":"2024-04-19T02:20:10.002363+0000","last_fullsized":"2024-04-19T02:20:10.002363+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.998017+0000","last_change":"2024-04-19T02:20:08.662331+0000","last_active":"2024-04-19T02:20:09.998017+0000","last_peered":"2024-04-19T02:20:09.998017+0000","last_clean":"2024-04-19T02:20:09.998017+0000","last_became_active":"2024-04-19T02:20:08.661996+0000","last_became_peered":"2024-04-19T02:20:08.661996+0000","last_unstale":"2024-04-19T02:20:09.998017+0000","last_undegraded":"2024-04-19T02:20:09.998017+0000","last_fullsized":"2024-04-19T02:20:09.998017+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.002397+0000","last_change":"2024-04-19T02:20:10.001706+0000","last_active":"2024-04-19T02:20:10.002397+0000","last_peered":"2024-04-19T02:20:10.002397+0000","last_clean":"2024-04-19T02:20:10.002397+0000","last_became_active":"2024-04-19T02:20:10.001372+0000","last_became_peered":"2024-04-19T02:20:10.001372+0000","last_unstale":"2024-04-19T02:20:10.002397+0000","last_undegraded":"2024-04-19T02:20:10.002397+0000","last_fullsized":"2024-04-19T02:20:10.002397+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":79,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.998319+0000","last_change":"2024-04-19T02:15:29.277568+0000","last_active":"2024-04-19T02:20:09.998319+0000","last_peered":"2024-04-19T02:20:09.998319+0000","last_clean":"2024-04-19T02:20:09.998319+0000","last_became_active":"2024-04-19T02:15:29.276725+0000","last_became_peered":"2024-04-19T02:15:29.276725+0000","last_unstale":"2024-04-19T02:20:09.998319+0000","last_undegraded":"2024-04-19T02:20:09.998319+0000","last_fullsized":"2024-04-19T02:20:09.998319+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5254,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":72,"seq":309237645323,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58812,"kb_used_data":884,"kb_used_omap":6,"kb_used_meta":57913,"kb_avail":94313028,"statfs":{"total":96636764160,"available":96576540672,"internally_reserved":0,"allocated":905216,"data_stored":358135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6848,"internal_metadata":59303232},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738435,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":275412,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":273918,"kb_avail":94096428,"statfs":{"total":96636764160,"available":96354742272,"internally_reserved":0,"allocated":1519616,"data_stored":948136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":280492486},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 02:20:28 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.40500000000000003,"15min":0.32700000000000001},"min":{"1min":0.30599999999999999,"5min":0.159,"15min":0.159},"max":{"1min":0.57599999999999996,"5min":4.4480000000000004,"15min":4.4480000000000004},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.39700000000000002,"15min":0.372},"min":{"1min":0.32600000000000001,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.59699999999999998,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.44800000000000001}]},{"osd":2,"last update":"Fri Apr 19 02:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":2.1000000000000001,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":0.309},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.35399999999999998}]}]},{"osd":1,"up_from":8,"seq":34359738434,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307408,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":305918,"kb_avail":94064432,"statfs":{"total":96636764160,"available":96321978368,"internally_reserved":0,"allocated":1515520,"data_stored":949633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":313260486},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:20:31 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.432,"15min":0.38400000000000001},"min":{"1min":0.38700000000000001,"5min":0.157,"15min":0.157},"max":{"1min":0.65200000000000002,"5min":1.794,"15min":1.794},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.41999999999999998,"15min":0.33700000000000002},"min":{"1min":0.41399999999999998,"5min":0.16,"15min":0.16},"max":{"1min":0.60399999999999998,"5min":2.411,"15min":2.411},"last":0.433}]},{"osd":2,"last update":"Fri Apr 19 02:16:26 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.45500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5254,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:20:41.726 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.726 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.727 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.727 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.727 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.727 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.727 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.727 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.727 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.727 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.727 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.728 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.728 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.728 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.728 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.728 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.728 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.728 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.728 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.728 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.729 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.729 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.729 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.729 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.729 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.729 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.729 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.729 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.729 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.729 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.730 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.730 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.730 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.730 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.730 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.730 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.730 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.730 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.730 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.731 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.731 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.731 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.731 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.731 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.731 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.731 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.731 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.731 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.732 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.732 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.732 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.732 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.732 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.732 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.732 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.732 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-19T02:15:23.520722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.732 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.732 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-19T02:15:23.520722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.733 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.733 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-19T02:15:23.520722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.734 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.734 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-19T02:15:23.520722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.734 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-19T02:15:23.520722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.734 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-19T02:15:23.520722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.734 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.734 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.735 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-19T02:15:23.520722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.735 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.735 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.735 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.735 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-19T02:15:23.520722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.735 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.735 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-19T02:15:23.520722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.735 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.735 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.735 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.736 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.736 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.736 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.737 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.737 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.737 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.737 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.737 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.738 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.738 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.738 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.738 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:20:41.738 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-19T02:21:01.740 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:21:02.080 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:21:02.082 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-04-19T02:21:02.091 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":247,"stamp":"2024-04-19T02:21:00.823853+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200,"ondisk_log_size":200,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":641632,"kb_used_data":3848,"kb_used_omap":9,"kb_used_meta":637750,"kb_avail":282473888,"statfs":{"total":289910292480,"available":289253261312,"internally_reserved":0,"allocated":3940352,"data_stored":2255904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10036,"internal_metadata":653056204},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003212"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":103,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:44.754058+0000","last_change":"2024-04-19T02:20:44.754184+0000","last_active":"2024-04-19T02:20:44.754058+0000","last_peered":"2024-04-19T02:20:44.754058+0000","last_clean":"2024-04-19T02:20:44.754058+0000","last_became_active":"2024-04-19T02:19:54.929435+0000","last_became_peered":"2024-04-19T02:19:54.929435+0000","last_unstale":"2024-04-19T02:20:44.754058+0000","last_undegraded":"2024-04-19T02:20:44.754058+0000","last_fullsized":"2024-04-19T02:20:44.754058+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:44.754035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:44.754035+0000","last_clean_scrub_stamp":"2024-04-19T02:20:44.754035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:46:01.301053+0000","scrub_duration":0.089914654999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":103,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:52.728883+0000","last_change":"2024-04-19T02:20:52.728989+0000","last_active":"2024-04-19T02:20:52.728883+0000","last_peered":"2024-04-19T02:20:52.728883+0000","last_clean":"2024-04-19T02:20:52.728883+0000","last_became_active":"2024-04-19T02:19:54.931278+0000","last_became_peered":"2024-04-19T02:19:54.931278+0000","last_unstale":"2024-04-19T02:20:52.728883+0000","last_undegraded":"2024-04-19T02:20:52.728883+0000","last_fullsized":"2024-04-19T02:20:52.728883+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:52.728860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:52.728860+0000","last_clean_scrub_stamp":"2024-04-19T02:20:52.728860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:55:28.628918+0000","scrub_duration":0.0016468570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:35.678810+0000","last_change":"2024-04-19T02:20:35.678916+0000","last_active":"2024-04-19T02:20:35.678810+0000","last_peered":"2024-04-19T02:20:35.678810+0000","last_clean":"2024-04-19T02:20:35.678810+0000","last_became_active":"2024-04-19T02:15:29.286169+0000","last_became_peered":"2024-04-19T02:15:29.286169+0000","last_unstale":"2024-04-19T02:20:35.678810+0000","last_undegraded":"2024-04-19T02:20:35.678810+0000","last_fullsized":"2024-04-19T02:20:35.678810+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:35.678786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:35.678786+0000","last_clean_scrub_stamp":"2024-04-19T02:20:35.678786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:39:46.619486+0000","scrub_duration":0.0021837459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637860+0000","last_change":"2024-04-19T02:19:54.927063+0000","last_active":"2024-04-19T02:20:10.637860+0000","last_peered":"2024-04-19T02:20:10.637860+0000","last_clean":"2024-04-19T02:20:10.637860+0000","last_became_active":"2024-04-19T02:19:54.926046+0000","last_became_peered":"2024-04-19T02:19:54.926046+0000","last_unstale":"2024-04-19T02:20:10.637860+0000","last_undegraded":"2024-04-19T02:20:10.637860+0000","last_fullsized":"2024-04-19T02:20:10.637860+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":57,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:20.499482+0000","last_change":"2024-04-19T02:19:54.931669+0000","last_active":"2024-04-19T02:20:20.499482+0000","last_peered":"2024-04-19T02:20:20.499482+0000","last_clean":"2024-04-19T02:20:20.499482+0000","last_became_active":"2024-04-19T02:19:54.931435+0000","last_became_peered":"2024-04-19T02:19:54.931435+0000","last_unstale":"2024-04-19T02:20:20.499482+0000","last_undegraded":"2024-04-19T02:20:20.499482+0000","last_fullsized":"2024-04-19T02:20:20.499482+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:20.006277+0000","last_change":"2024-04-19T02:19:54.924250+0000","last_active":"2024-04-19T02:20:20.006277+0000","last_peered":"2024-04-19T02:20:20.006277+0000","last_clean":"2024-04-19T02:20:20.006277+0000","last_became_active":"2024-04-19T02:19:54.923984+0000","last_became_peered":"2024-04-19T02:19:54.923984+0000","last_unstale":"2024-04-19T02:20:20.006277+0000","last_undegraded":"2024-04-19T02:20:20.006277+0000","last_fullsized":"2024-04-19T02:20:20.006277+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:45.640394+0000","last_change":"2024-04-19T02:20:45.640499+0000","last_active":"2024-04-19T02:20:45.640394+0000","last_peered":"2024-04-19T02:20:45.640394+0000","last_clean":"2024-04-19T02:20:45.640394+0000","last_became_active":"2024-04-19T02:19:54.925529+0000","last_became_peered":"2024-04-19T02:19:54.925529+0000","last_unstale":"2024-04-19T02:20:45.640394+0000","last_undegraded":"2024-04-19T02:20:45.640394+0000","last_fullsized":"2024-04-19T02:20:45.640394+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:45.640369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:45.640369+0000","last_clean_scrub_stamp":"2024-04-19T02:20:45.640369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:09:00.709082+0000","scrub_duration":0.022321161999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:20.006244+0000","last_change":"2024-04-19T02:19:54.930828+0000","last_active":"2024-04-19T02:20:20.006244+0000","last_peered":"2024-04-19T02:20:20.006244+0000","last_clean":"2024-04-19T02:20:20.006244+0000","last_became_active":"2024-04-19T02:19:54.930075+0000","last_became_peered":"2024-04-19T02:19:54.930075+0000","last_unstale":"2024-04-19T02:20:20.006244+0000","last_undegraded":"2024-04-19T02:20:20.006244+0000","last_fullsized":"2024-04-19T02:20:20.006244+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:39.837203+0000","last_change":"2024-04-19T02:20:39.837337+0000","last_active":"2024-04-19T02:20:39.837203+0000","last_peered":"2024-04-19T02:20:39.837203+0000","last_clean":"2024-04-19T02:20:39.837203+0000","last_became_active":"2024-04-19T02:19:54.928496+0000","last_became_peered":"2024-04-19T02:19:54.928496+0000","last_unstale":"2024-04-19T02:20:39.837203+0000","last_undegraded":"2024-04-19T02:20:39.837203+0000","last_fullsized":"2024-04-19T02:20:39.837203+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:39.837177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:39.837177+0000","last_clean_scrub_stamp":"2024-04-19T02:20:39.837177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:32:07.735631+0000","scrub_duration":0.037239790000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":61,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637830+0000","last_change":"2024-04-19T02:16:30.093524+0000","last_active":"2024-04-19T02:20:10.637830+0000","last_peered":"2024-04-19T02:20:10.637830+0000","last_clean":"2024-04-19T02:20:10.637830+0000","last_became_active":"2024-04-19T02:16:30.093344+0000","last_became_peered":"2024-04-19T02:16:30.093344+0000","last_unstale":"2024-04-19T02:20:10.637830+0000","last_undegraded":"2024-04-19T02:20:10.637830+0000","last_fullsized":"2024-04-19T02:20:10.637830+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:20.006224+0000","last_change":"2024-04-19T02:19:54.926754+0000","last_active":"2024-04-19T02:20:20.006224+0000","last_peered":"2024-04-19T02:20:20.006224+0000","last_clean":"2024-04-19T02:20:20.006224+0000","last_became_active":"2024-04-19T02:19:54.926040+0000","last_became_peered":"2024-04-19T02:19:54.926040+0000","last_unstale":"2024-04-19T02:20:20.006224+0000","last_undegraded":"2024-04-19T02:20:20.006224+0000","last_fullsized":"2024-04-19T02:20:20.006224+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.998087+0000","last_change":"2024-04-19T02:20:08.662601+0000","last_active":"2024-04-19T02:20:09.998087+0000","last_peered":"2024-04-19T02:20:09.998087+0000","last_clean":"2024-04-19T02:20:09.998087+0000","last_became_active":"2024-04-19T02:20:08.662234+0000","last_became_peered":"2024-04-19T02:20:08.662234+0000","last_unstale":"2024-04-19T02:20:09.998087+0000","last_undegraded":"2024-04-19T02:20:09.998087+0000","last_fullsized":"2024-04-19T02:20:09.998087+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":68,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:24.574781+0000","last_change":"2024-04-19T02:20:24.574893+0000","last_active":"2024-04-19T02:20:24.574781+0000","last_peered":"2024-04-19T02:20:24.574781+0000","last_clean":"2024-04-19T02:20:24.574781+0000","last_became_active":"2024-04-19T02:19:54.932240+0000","last_became_peered":"2024-04-19T02:19:54.932240+0000","last_unstale":"2024-04-19T02:20:24.574781+0000","last_undegraded":"2024-04-19T02:20:24.574781+0000","last_fullsized":"2024-04-19T02:20:24.574781+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:24.574756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:24.574756+0000","last_clean_scrub_stamp":"2024-04-19T02:20:24.574756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:05:16.137888+0000","scrub_duration":0.02235088,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:52.533209+0000","last_change":"2024-04-19T02:20:52.533329+0000","last_active":"2024-04-19T02:20:52.533209+0000","last_peered":"2024-04-19T02:20:52.533209+0000","last_clean":"2024-04-19T02:20:52.533209+0000","last_became_active":"2024-04-19T02:15:29.283121+0000","last_became_peered":"2024-04-19T02:15:29.283121+0000","last_unstale":"2024-04-19T02:20:52.533209+0000","last_undegraded":"2024-04-19T02:20:52.533209+0000","last_fullsized":"2024-04-19T02:20:52.533209+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:52.533183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:52.533183+0000","last_clean_scrub_stamp":"2024-04-19T02:20:52.533183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:46:09.200215+0000","scrub_duration":0.0015891010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":80,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:12.907043+0000","last_change":"2024-04-19T02:15:29.285139+0000","last_active":"2024-04-19T02:20:12.907043+0000","last_peered":"2024-04-19T02:20:12.907043+0000","last_clean":"2024-04-19T02:20:12.907043+0000","last_became_active":"2024-04-19T02:15:29.284649+0000","last_became_peered":"2024-04-19T02:15:29.284649+0000","last_unstale":"2024-04-19T02:20:12.907043+0000","last_undegraded":"2024-04-19T02:20:12.907043+0000","last_fullsized":"2024-04-19T02:20:12.907043+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:20.567013+0000","last_change":"2024-04-19T02:20:20.567149+0000","last_active":"2024-04-19T02:20:20.567013+0000","last_peered":"2024-04-19T02:20:20.567013+0000","last_clean":"2024-04-19T02:20:20.567013+0000","last_became_active":"2024-04-19T02:19:54.930437+0000","last_became_peered":"2024-04-19T02:19:54.930437+0000","last_unstale":"2024-04-19T02:20:20.567013+0000","last_undegraded":"2024-04-19T02:20:20.567013+0000","last_fullsized":"2024-04-19T02:20:20.567013+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:20.566972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:20.566972+0000","last_clean_scrub_stamp":"2024-04-19T02:20:20.566972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:59:10.317082+0000","scrub_duration":0.00187685,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.002393+0000","last_change":"2024-04-19T02:20:10.001650+0000","last_active":"2024-04-19T02:20:10.002393+0000","last_peered":"2024-04-19T02:20:10.002393+0000","last_clean":"2024-04-19T02:20:10.002393+0000","last_became_active":"2024-04-19T02:20:10.001343+0000","last_became_peered":"2024-04-19T02:20:10.001343+0000","last_unstale":"2024-04-19T02:20:10.002393+0000","last_undegraded":"2024-04-19T02:20:10.002393+0000","last_fullsized":"2024-04-19T02:20:10.002393+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.998600+0000","last_change":"2024-04-19T02:19:54.933452+0000","last_active":"2024-04-19T02:20:09.998600+0000","last_peered":"2024-04-19T02:20:09.998600+0000","last_clean":"2024-04-19T02:20:09.998600+0000","last_became_active":"2024-04-19T02:19:54.933233+0000","last_became_peered":"2024-04-19T02:19:54.933233+0000","last_unstale":"2024-04-19T02:20:09.998600+0000","last_undegraded":"2024-04-19T02:20:09.998600+0000","last_fullsized":"2024-04-19T02:20:09.998600+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.996169+0000","last_change":"2024-04-19T02:19:54.925745+0000","last_active":"2024-04-19T02:20:09.996169+0000","last_peered":"2024-04-19T02:20:09.996169+0000","last_clean":"2024-04-19T02:20:09.996169+0000","last_became_active":"2024-04-19T02:19:54.925060+0000","last_became_peered":"2024-04-19T02:19:54.925060+0000","last_unstale":"2024-04-19T02:20:09.996169+0000","last_undegraded":"2024-04-19T02:20:09.996169+0000","last_fullsized":"2024-04-19T02:20:09.996169+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:32.721522+0000","last_change":"2024-04-19T02:20:32.721654+0000","last_active":"2024-04-19T02:20:32.721522+0000","last_peered":"2024-04-19T02:20:32.721522+0000","last_clean":"2024-04-19T02:20:32.721522+0000","last_became_active":"2024-04-19T02:19:54.926442+0000","last_became_peered":"2024-04-19T02:19:54.926442+0000","last_unstale":"2024-04-19T02:20:32.721522+0000","last_undegraded":"2024-04-19T02:20:32.721522+0000","last_fullsized":"2024-04-19T02:20:32.721522+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:32.721479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:32.721479+0000","last_clean_scrub_stamp":"2024-04-19T02:20:32.721479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:23:51.052141+0000","scrub_duration":0.0020564210000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637206+0000","last_change":"2024-04-19T02:19:54.932532+0000","last_active":"2024-04-19T02:20:10.637206+0000","last_peered":"2024-04-19T02:20:10.637206+0000","last_clean":"2024-04-19T02:20:10.637206+0000","last_became_active":"2024-04-19T02:19:54.931438+0000","last_became_peered":"2024-04-19T02:19:54.931438+0000","last_unstale":"2024-04-19T02:20:10.637206+0000","last_undegraded":"2024-04-19T02:20:10.637206+0000","last_fullsized":"2024-04-19T02:20:10.637206+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.997884+0000","last_change":"2024-04-19T02:20:08.662261+0000","last_active":"2024-04-19T02:20:09.997884+0000","last_peered":"2024-04-19T02:20:09.997884+0000","last_clean":"2024-04-19T02:20:09.997884+0000","last_became_active":"2024-04-19T02:20:08.661940+0000","last_became_peered":"2024-04-19T02:20:08.661940+0000","last_unstale":"2024-04-19T02:20:09.997884+0000","last_undegraded":"2024-04-19T02:20:09.997884+0000","last_fullsized":"2024-04-19T02:20:09.997884+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.640152+0000","last_change":"2024-04-19T02:20:10.639368+0000","last_active":"2024-04-19T02:20:10.640152+0000","last_peered":"2024-04-19T02:20:10.640152+0000","last_clean":"2024-04-19T02:20:10.640152+0000","last_became_active":"2024-04-19T02:20:10.639036+0000","last_became_peered":"2024-04-19T02:20:10.639036+0000","last_unstale":"2024-04-19T02:20:10.640152+0000","last_undegraded":"2024-04-19T02:20:10.640152+0000","last_fullsized":"2024-04-19T02:20:10.640152+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":103,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:54.722505+0000","last_change":"2024-04-19T02:20:54.722628+0000","last_active":"2024-04-19T02:20:54.722505+0000","last_peered":"2024-04-19T02:20:54.722505+0000","last_clean":"2024-04-19T02:20:54.722505+0000","last_became_active":"2024-04-19T02:19:54.928261+0000","last_became_peered":"2024-04-19T02:19:54.928261+0000","last_unstale":"2024-04-19T02:20:54.722505+0000","last_undegraded":"2024-04-19T02:20:54.722505+0000","last_fullsized":"2024-04-19T02:20:54.722505+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:54.722476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:54.722476+0000","last_clean_scrub_stamp":"2024-04-19T02:20:54.722476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:41:38.555723+0000","scrub_duration":0.0018882219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:41.635924+0000","last_change":"2024-04-19T02:20:41.636049+0000","last_active":"2024-04-19T02:20:41.635924+0000","last_peered":"2024-04-19T02:20:41.635924+0000","last_clean":"2024-04-19T02:20:41.635924+0000","last_became_active":"2024-04-19T02:15:29.276952+0000","last_became_peered":"2024-04-19T02:15:29.276952+0000","last_unstale":"2024-04-19T02:20:41.635924+0000","last_undegraded":"2024-04-19T02:20:41.635924+0000","last_fullsized":"2024-04-19T02:20:41.635924+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:41.635899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:41.635899+0000","last_clean_scrub_stamp":"2024-04-19T02:20:41.635899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:02:03.442021+0000","scrub_duration":0.035233386999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:36.825318+0000","last_change":"2024-04-19T02:20:36.825423+0000","last_active":"2024-04-19T02:20:36.825318+0000","last_peered":"2024-04-19T02:20:36.825318+0000","last_clean":"2024-04-19T02:20:36.825318+0000","last_became_active":"2024-04-19T02:19:54.931124+0000","last_became_peered":"2024-04-19T02:19:54.931124+0000","last_unstale":"2024-04-19T02:20:36.825318+0000","last_undegraded":"2024-04-19T02:20:36.825318+0000","last_fullsized":"2024-04-19T02:20:36.825318+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:36.825293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:36.825293+0000","last_clean_scrub_stamp":"2024-04-19T02:20:36.825293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:26:48.954624+0000","scrub_duration":0.0020341249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":80,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637710+0000","last_change":"2024-04-19T02:15:29.287389+0000","last_active":"2024-04-19T02:20:10.637710+0000","last_peered":"2024-04-19T02:20:10.637710+0000","last_clean":"2024-04-19T02:20:10.637710+0000","last_became_active":"2024-04-19T02:15:29.286431+0000","last_became_peered":"2024-04-19T02:15:29.286431+0000","last_unstale":"2024-04-19T02:20:10.637710+0000","last_undegraded":"2024-04-19T02:20:10.637710+0000","last_fullsized":"2024-04-19T02:20:10.637710+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":59,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:20.499104+0000","last_change":"2024-04-19T02:19:54.927108+0000","last_active":"2024-04-19T02:20:20.499104+0000","last_peered":"2024-04-19T02:20:20.499104+0000","last_clean":"2024-04-19T02:20:20.499104+0000","last_became_active":"2024-04-19T02:19:54.926838+0000","last_became_peered":"2024-04-19T02:19:54.926838+0000","last_unstale":"2024-04-19T02:20:20.499104+0000","last_undegraded":"2024-04-19T02:20:20.499104+0000","last_fullsized":"2024-04-19T02:20:20.499104+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":79,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:20.499310+0000","last_change":"2024-04-19T02:15:29.281792+0000","last_active":"2024-04-19T02:20:20.499310+0000","last_peered":"2024-04-19T02:20:20.499310+0000","last_clean":"2024-04-19T02:20:20.499310+0000","last_became_active":"2024-04-19T02:15:29.280479+0000","last_became_peered":"2024-04-19T02:15:29.280479+0000","last_unstale":"2024-04-19T02:20:20.499310+0000","last_undegraded":"2024-04-19T02:20:20.499310+0000","last_fullsized":"2024-04-19T02:20:20.499310+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.995053+0000","last_change":"2024-04-19T02:19:54.925277+0000","last_active":"2024-04-19T02:20:09.995053+0000","last_peered":"2024-04-19T02:20:09.995053+0000","last_clean":"2024-04-19T02:20:09.995053+0000","last_became_active":"2024-04-19T02:19:54.924484+0000","last_became_peered":"2024-04-19T02:19:54.924484+0000","last_unstale":"2024-04-19T02:20:09.995053+0000","last_undegraded":"2024-04-19T02:20:09.995053+0000","last_fullsized":"2024-04-19T02:20:09.995053+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.639795+0000","last_change":"2024-04-19T02:20:10.639077+0000","last_active":"2024-04-19T02:20:10.639795+0000","last_peered":"2024-04-19T02:20:10.639795+0000","last_clean":"2024-04-19T02:20:10.639795+0000","last_became_active":"2024-04-19T02:20:10.638737+0000","last_became_peered":"2024-04-19T02:20:10.638737+0000","last_unstale":"2024-04-19T02:20:10.639795+0000","last_undegraded":"2024-04-19T02:20:10.639795+0000","last_fullsized":"2024-04-19T02:20:10.639795+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.995156+0000","last_change":"2024-04-19T02:19:54.930346+0000","last_active":"2024-04-19T02:20:09.995156+0000","last_peered":"2024-04-19T02:20:09.995156+0000","last_clean":"2024-04-19T02:20:09.995156+0000","last_became_active":"2024-04-19T02:19:54.928398+0000","last_became_peered":"2024-04-19T02:19:54.928398+0000","last_unstale":"2024-04-19T02:20:09.995156+0000","last_undegraded":"2024-04-19T02:20:09.995156+0000","last_fullsized":"2024-04-19T02:20:09.995156+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:34.630146+0000","last_change":"2024-04-19T02:20:34.630281+0000","last_active":"2024-04-19T02:20:34.630146+0000","last_peered":"2024-04-19T02:20:34.630146+0000","last_clean":"2024-04-19T02:20:34.630146+0000","last_became_active":"2024-04-19T02:15:29.279314+0000","last_became_peered":"2024-04-19T02:15:29.279314+0000","last_unstale":"2024-04-19T02:20:34.630146+0000","last_undegraded":"2024-04-19T02:20:34.630146+0000","last_fullsized":"2024-04-19T02:20:34.630146+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:34.630122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:34.630122+0000","last_clean_scrub_stamp":"2024-04-19T02:20:34.630122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:19:42.256810+0000","scrub_duration":0.066969174000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:47.942738+0000","last_change":"2024-04-19T02:20:47.942846+0000","last_active":"2024-04-19T02:20:47.942738+0000","last_peered":"2024-04-19T02:20:47.942738+0000","last_clean":"2024-04-19T02:20:47.942738+0000","last_became_active":"2024-04-19T02:19:54.925729+0000","last_became_peered":"2024-04-19T02:19:54.925729+0000","last_unstale":"2024-04-19T02:20:47.942738+0000","last_undegraded":"2024-04-19T02:20:47.942738+0000","last_fullsized":"2024-04-19T02:20:47.942738+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:47.942715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:47.942715+0000","last_clean_scrub_stamp":"2024-04-19T02:20:47.942715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:53:52.743256+0000","scrub_duration":0.001689886,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.994967+0000","last_change":"2024-04-19T02:19:54.928435+0000","last_active":"2024-04-19T02:20:09.994967+0000","last_peered":"2024-04-19T02:20:09.994967+0000","last_clean":"2024-04-19T02:20:09.994967+0000","last_became_active":"2024-04-19T02:19:54.927666+0000","last_became_peered":"2024-04-19T02:19:54.927666+0000","last_unstale":"2024-04-19T02:20:09.994967+0000","last_undegraded":"2024-04-19T02:20:09.994967+0000","last_fullsized":"2024-04-19T02:20:09.994967+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:20.005850+0000","last_change":"2024-04-19T02:19:54.932025+0000","last_active":"2024-04-19T02:20:20.005850+0000","last_peered":"2024-04-19T02:20:20.005850+0000","last_clean":"2024-04-19T02:20:20.005850+0000","last_became_active":"2024-04-19T02:19:54.931540+0000","last_became_peered":"2024-04-19T02:19:54.931540+0000","last_unstale":"2024-04-19T02:20:20.005850+0000","last_undegraded":"2024-04-19T02:20:20.005850+0000","last_fullsized":"2024-04-19T02:20:20.005850+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:24.906406+0000","last_change":"2024-04-19T02:20:24.906512+0000","last_active":"2024-04-19T02:20:24.906406+0000","last_peered":"2024-04-19T02:20:24.906406+0000","last_clean":"2024-04-19T02:20:24.906406+0000","last_became_active":"2024-04-19T02:19:54.923784+0000","last_became_peered":"2024-04-19T02:19:54.923784+0000","last_unstale":"2024-04-19T02:20:24.906406+0000","last_undegraded":"2024-04-19T02:20:24.906406+0000","last_fullsized":"2024-04-19T02:20:24.906406+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:24.906368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:24.906368+0000","last_clean_scrub_stamp":"2024-04-19T02:20:24.906368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:16:17.186228+0000","scrub_duration":0.0016771609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":83,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:20.499067+0000","last_change":"2024-04-19T02:15:28.892937+0000","last_active":"2024-04-19T02:20:20.499067+0000","last_peered":"2024-04-19T02:20:20.499067+0000","last_clean":"2024-04-19T02:20:20.499067+0000","last_became_active":"2024-04-19T02:15:28.891440+0000","last_became_peered":"2024-04-19T02:15:28.891440+0000","last_unstale":"2024-04-19T02:20:20.499067+0000","last_undegraded":"2024-04-19T02:20:20.499067+0000","last_fullsized":"2024-04-19T02:20:20.499067+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.995091+0000","last_change":"2024-04-19T02:19:54.923898+0000","last_active":"2024-04-19T02:20:09.995091+0000","last_peered":"2024-04-19T02:20:09.995091+0000","last_clean":"2024-04-19T02:20:09.995091+0000","last_became_active":"2024-04-19T02:19:54.923493+0000","last_became_peered":"2024-04-19T02:19:54.923493+0000","last_unstale":"2024-04-19T02:20:09.995091+0000","last_undegraded":"2024-04-19T02:20:09.995091+0000","last_fullsized":"2024-04-19T02:20:09.995091+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":87,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:12.907134+0000","last_change":"2024-04-19T02:15:28.891097+0000","last_active":"2024-04-19T02:20:12.907134+0000","last_peered":"2024-04-19T02:20:12.907134+0000","last_clean":"2024-04-19T02:20:12.907134+0000","last_became_active":"2024-04-19T02:15:28.890795+0000","last_became_peered":"2024-04-19T02:15:28.890795+0000","last_unstale":"2024-04-19T02:20:12.907134+0000","last_undegraded":"2024-04-19T02:20:12.907134+0000","last_fullsized":"2024-04-19T02:20:12.907134+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":80,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:12.907112+0000","last_change":"2024-04-19T02:15:29.278546+0000","last_active":"2024-04-19T02:20:12.907112+0000","last_peered":"2024-04-19T02:20:12.907112+0000","last_clean":"2024-04-19T02:20:12.907112+0000","last_became_active":"2024-04-19T02:15:29.277547+0000","last_became_peered":"2024-04-19T02:15:29.277547+0000","last_unstale":"2024-04-19T02:20:12.907112+0000","last_undegraded":"2024-04-19T02:20:12.907112+0000","last_fullsized":"2024-04-19T02:20:12.907112+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"82'4","reported_seq":109,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:54.609805+0000","last_change":"2024-04-19T02:20:54.609979+0000","last_active":"2024-04-19T02:20:54.609805+0000","last_peered":"2024-04-19T02:20:54.609805+0000","last_clean":"2024-04-19T02:20:54.609805+0000","last_became_active":"2024-04-19T02:19:54.932829+0000","last_became_peered":"2024-04-19T02:19:54.932829+0000","last_unstale":"2024-04-19T02:20:54.609805+0000","last_undegraded":"2024-04-19T02:20:54.609805+0000","last_fullsized":"2024-04-19T02:20:54.609805+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'4","last_scrub_stamp":"2024-04-19T02:20:54.609763+0000","last_deep_scrub":"82'4","last_deep_scrub_stamp":"2024-04-19T02:20:54.609763+0000","last_clean_scrub_stamp":"2024-04-19T02:20:54.609763+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:53:50.278165+0000","scrub_duration":0.0044989499999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:12.873826+0000","last_change":"2024-04-19T02:20:07.983368+0000","last_active":"2024-04-19T02:20:12.873826+0000","last_peered":"2024-04-19T02:20:12.873826+0000","last_clean":"2024-04-19T02:20:12.873826+0000","last_became_active":"2024-04-19T02:20:07.983080+0000","last_became_peered":"2024-04-19T02:20:07.983080+0000","last_unstale":"2024-04-19T02:20:12.873826+0000","last_undegraded":"2024-04-19T02:20:12.873826+0000","last_fullsized":"2024-04-19T02:20:12.873826+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.995252+0000","last_change":"2024-04-19T02:19:54.927323+0000","last_active":"2024-04-19T02:20:09.995252+0000","last_peered":"2024-04-19T02:20:09.995252+0000","last_clean":"2024-04-19T02:20:09.995252+0000","last_became_active":"2024-04-19T02:19:54.925703+0000","last_became_peered":"2024-04-19T02:19:54.925703+0000","last_unstale":"2024-04-19T02:20:09.995252+0000","last_undegraded":"2024-04-19T02:20:09.995252+0000","last_fullsized":"2024-04-19T02:20:09.995252+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":57,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:20.499286+0000","last_change":"2024-04-19T02:19:54.925918+0000","last_active":"2024-04-19T02:20:20.499286+0000","last_peered":"2024-04-19T02:20:20.499286+0000","last_clean":"2024-04-19T02:20:20.499286+0000","last_became_active":"2024-04-19T02:19:54.925634+0000","last_became_peered":"2024-04-19T02:19:54.925634+0000","last_unstale":"2024-04-19T02:20:20.499286+0000","last_undegraded":"2024-04-19T02:20:20.499286+0000","last_fullsized":"2024-04-19T02:20:20.499286+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":80,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.997791+0000","last_change":"2024-04-19T02:15:28.892934+0000","last_active":"2024-04-19T02:20:09.997791+0000","last_peered":"2024-04-19T02:20:09.997791+0000","last_clean":"2024-04-19T02:20:09.997791+0000","last_became_active":"2024-04-19T02:15:28.891879+0000","last_became_peered":"2024-04-19T02:15:28.891879+0000","last_unstale":"2024-04-19T02:20:09.997791+0000","last_undegraded":"2024-04-19T02:20:09.997791+0000","last_fullsized":"2024-04-19T02:20:09.997791+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.639813+0000","last_change":"2024-04-19T02:20:10.639094+0000","last_active":"2024-04-19T02:20:10.639813+0000","last_peered":"2024-04-19T02:20:10.639813+0000","last_clean":"2024-04-19T02:20:10.639813+0000","last_became_active":"2024-04-19T02:20:10.638755+0000","last_became_peered":"2024-04-19T02:20:10.638755+0000","last_unstale":"2024-04-19T02:20:10.639813+0000","last_undegraded":"2024-04-19T02:20:10.639813+0000","last_fullsized":"2024-04-19T02:20:10.639813+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":89,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637328+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:20:10.637328+0000","last_peered":"2024-04-19T02:20:10.637328+0000","last_clean":"2024-04-19T02:20:10.637328+0000","last_became_active":"2024-04-19T02:15:28.890882+0000","last_became_peered":"2024-04-19T02:15:28.890882+0000","last_unstale":"2024-04-19T02:20:10.637328+0000","last_undegraded":"2024-04-19T02:20:10.637328+0000","last_fullsized":"2024-04-19T02:20:10.637328+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:54.023457+0000","last_change":"2024-04-19T02:20:54.023600+0000","last_active":"2024-04-19T02:20:54.023457+0000","last_peered":"2024-04-19T02:20:54.023457+0000","last_clean":"2024-04-19T02:20:54.023457+0000","last_became_active":"2024-04-19T02:19:54.925121+0000","last_became_peered":"2024-04-19T02:19:54.925121+0000","last_unstale":"2024-04-19T02:20:54.023457+0000","last_undegraded":"2024-04-19T02:20:54.023457+0000","last_fullsized":"2024-04-19T02:20:54.023457+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:54.023433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:54.023433+0000","last_clean_scrub_stamp":"2024-04-19T02:20:54.023433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:02:43.764667+0000","scrub_duration":0.053810324999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":82,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.638107+0000","last_change":"2024-04-19T02:15:28.890265+0000","last_active":"2024-04-19T02:20:10.638107+0000","last_peered":"2024-04-19T02:20:10.638107+0000","last_clean":"2024-04-19T02:20:10.638107+0000","last_became_active":"2024-04-19T02:15:28.890004+0000","last_became_peered":"2024-04-19T02:15:28.890004+0000","last_unstale":"2024-04-19T02:20:10.638107+0000","last_undegraded":"2024-04-19T02:20:10.638107+0000","last_fullsized":"2024-04-19T02:20:10.638107+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:37.549179+0000","last_change":"2024-04-19T02:20:37.549289+0000","last_active":"2024-04-19T02:20:37.549179+0000","last_peered":"2024-04-19T02:20:37.549179+0000","last_clean":"2024-04-19T02:20:37.549179+0000","last_became_active":"2024-04-19T02:15:29.285197+0000","last_became_peered":"2024-04-19T02:15:29.285197+0000","last_unstale":"2024-04-19T02:20:37.549179+0000","last_undegraded":"2024-04-19T02:20:37.549179+0000","last_fullsized":"2024-04-19T02:20:37.549179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:37.549154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:37.549154+0000","last_clean_scrub_stamp":"2024-04-19T02:20:37.549154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:18:16.168949+0000","scrub_duration":0.0014928389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":82,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.998356+0000","last_change":"2024-04-19T02:15:28.893902+0000","last_active":"2024-04-19T02:20:09.998356+0000","last_peered":"2024-04-19T02:20:09.998356+0000","last_clean":"2024-04-19T02:20:09.998356+0000","last_became_active":"2024-04-19T02:15:28.893231+0000","last_became_peered":"2024-04-19T02:15:28.893231+0000","last_unstale":"2024-04-19T02:20:09.998356+0000","last_undegraded":"2024-04-19T02:20:09.998356+0000","last_fullsized":"2024-04-19T02:20:09.998356+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":103,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:49.727333+0000","last_change":"2024-04-19T02:20:49.727441+0000","last_active":"2024-04-19T02:20:49.727333+0000","last_peered":"2024-04-19T02:20:49.727333+0000","last_clean":"2024-04-19T02:20:49.727333+0000","last_became_active":"2024-04-19T02:19:54.925502+0000","last_became_peered":"2024-04-19T02:19:54.925502+0000","last_unstale":"2024-04-19T02:20:49.727333+0000","last_undegraded":"2024-04-19T02:20:49.727333+0000","last_fullsized":"2024-04-19T02:20:49.727333+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:49.727309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:49.727309+0000","last_clean_scrub_stamp":"2024-04-19T02:20:49.727309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:34:41.219108+0000","scrub_duration":0.002043497,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":82,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637789+0000","last_change":"2024-04-19T02:15:28.891234+0000","last_active":"2024-04-19T02:20:10.637789+0000","last_peered":"2024-04-19T02:20:10.637789+0000","last_clean":"2024-04-19T02:20:10.637789+0000","last_became_active":"2024-04-19T02:15:28.890881+0000","last_became_peered":"2024-04-19T02:15:28.890881+0000","last_unstale":"2024-04-19T02:20:10.637789+0000","last_undegraded":"2024-04-19T02:20:10.637789+0000","last_fullsized":"2024-04-19T02:20:10.637789+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637139+0000","last_change":"2024-04-19T02:19:54.926103+0000","last_active":"2024-04-19T02:20:10.637139+0000","last_peered":"2024-04-19T02:20:10.637139+0000","last_clean":"2024-04-19T02:20:10.637139+0000","last_became_active":"2024-04-19T02:19:54.925591+0000","last_became_peered":"2024-04-19T02:19:54.925591+0000","last_unstale":"2024-04-19T02:20:10.637139+0000","last_undegraded":"2024-04-19T02:20:10.637139+0000","last_fullsized":"2024-04-19T02:20:10.637139+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637415+0000","last_change":"2024-04-19T02:19:54.926813+0000","last_active":"2024-04-19T02:20:10.637415+0000","last_peered":"2024-04-19T02:20:10.637415+0000","last_clean":"2024-04-19T02:20:10.637415+0000","last_became_active":"2024-04-19T02:19:54.925523+0000","last_became_peered":"2024-04-19T02:19:54.925523+0000","last_unstale":"2024-04-19T02:20:10.637415+0000","last_undegraded":"2024-04-19T02:20:10.637415+0000","last_fullsized":"2024-04-19T02:20:10.637415+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:31.927807+0000","last_change":"2024-04-19T02:20:31.927940+0000","last_active":"2024-04-19T02:20:31.927807+0000","last_peered":"2024-04-19T02:20:31.927807+0000","last_clean":"2024-04-19T02:20:31.927807+0000","last_became_active":"2024-04-19T02:19:54.930843+0000","last_became_peered":"2024-04-19T02:19:54.930843+0000","last_unstale":"2024-04-19T02:20:31.927807+0000","last_undegraded":"2024-04-19T02:20:31.927807+0000","last_fullsized":"2024-04-19T02:20:31.927807+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:31.927783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:31.927783+0000","last_clean_scrub_stamp":"2024-04-19T02:20:31.927783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:16.149096+0000","scrub_duration":0.037287204999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.995805+0000","last_change":"2024-04-19T02:19:54.932708+0000","last_active":"2024-04-19T02:20:09.995805+0000","last_peered":"2024-04-19T02:20:09.995805+0000","last_clean":"2024-04-19T02:20:09.995805+0000","last_became_active":"2024-04-19T02:19:54.931553+0000","last_became_peered":"2024-04-19T02:19:54.931553+0000","last_unstale":"2024-04-19T02:20:09.995805+0000","last_undegraded":"2024-04-19T02:20:09.995805+0000","last_fullsized":"2024-04-19T02:20:09.995805+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637457+0000","last_change":"2024-04-19T02:19:54.927009+0000","last_active":"2024-04-19T02:20:10.637457+0000","last_peered":"2024-04-19T02:20:10.637457+0000","last_clean":"2024-04-19T02:20:10.637457+0000","last_became_active":"2024-04-19T02:19:54.925645+0000","last_became_peered":"2024-04-19T02:19:54.925645+0000","last_unstale":"2024-04-19T02:20:10.637457+0000","last_undegraded":"2024-04-19T02:20:10.637457+0000","last_fullsized":"2024-04-19T02:20:10.637457+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637005+0000","last_change":"2024-04-19T02:19:54.923689+0000","last_active":"2024-04-19T02:20:10.637005+0000","last_peered":"2024-04-19T02:20:10.637005+0000","last_clean":"2024-04-19T02:20:10.637005+0000","last_became_active":"2024-04-19T02:19:54.923321+0000","last_became_peered":"2024-04-19T02:19:54.923321+0000","last_unstale":"2024-04-19T02:20:10.637005+0000","last_undegraded":"2024-04-19T02:20:10.637005+0000","last_fullsized":"2024-04-19T02:20:10.637005+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":80,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.638016+0000","last_change":"2024-04-19T02:15:29.285019+0000","last_active":"2024-04-19T02:20:10.638016+0000","last_peered":"2024-04-19T02:20:10.638016+0000","last_clean":"2024-04-19T02:20:10.638016+0000","last_became_active":"2024-04-19T02:15:29.284650+0000","last_became_peered":"2024-04-19T02:15:29.284650+0000","last_unstale":"2024-04-19T02:20:10.638016+0000","last_undegraded":"2024-04-19T02:20:10.638016+0000","last_fullsized":"2024-04-19T02:20:10.638016+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.997742+0000","last_change":"2024-04-19T02:20:08.662566+0000","last_active":"2024-04-19T02:20:09.997742+0000","last_peered":"2024-04-19T02:20:09.997742+0000","last_clean":"2024-04-19T02:20:09.997742+0000","last_became_active":"2024-04-19T02:20:08.662277+0000","last_became_peered":"2024-04-19T02:20:08.662277+0000","last_unstale":"2024-04-19T02:20:09.997742+0000","last_undegraded":"2024-04-19T02:20:09.997742+0000","last_fullsized":"2024-04-19T02:20:09.997742+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":80,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637939+0000","last_change":"2024-04-19T02:15:29.287190+0000","last_active":"2024-04-19T02:20:10.637939+0000","last_peered":"2024-04-19T02:20:10.637939+0000","last_clean":"2024-04-19T02:20:10.637939+0000","last_became_active":"2024-04-19T02:15:29.286606+0000","last_became_peered":"2024-04-19T02:15:29.286606+0000","last_unstale":"2024-04-19T02:20:10.637939+0000","last_undegraded":"2024-04-19T02:20:10.637939+0000","last_fullsized":"2024-04-19T02:20:10.637939+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.997446+0000","last_change":"2024-04-19T02:19:54.928493+0000","last_active":"2024-04-19T02:20:09.997446+0000","last_peered":"2024-04-19T02:20:09.997446+0000","last_clean":"2024-04-19T02:20:09.997446+0000","last_became_active":"2024-04-19T02:19:54.928298+0000","last_became_peered":"2024-04-19T02:19:54.928298+0000","last_unstale":"2024-04-19T02:20:09.997446+0000","last_undegraded":"2024-04-19T02:20:09.997446+0000","last_fullsized":"2024-04-19T02:20:09.997446+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:27.963130+0000","last_change":"2024-04-19T02:20:27.963259+0000","last_active":"2024-04-19T02:20:27.963130+0000","last_peered":"2024-04-19T02:20:27.963130+0000","last_clean":"2024-04-19T02:20:27.963130+0000","last_became_active":"2024-04-19T02:19:54.927309+0000","last_became_peered":"2024-04-19T02:19:54.927309+0000","last_unstale":"2024-04-19T02:20:27.963130+0000","last_undegraded":"2024-04-19T02:20:27.963130+0000","last_fullsized":"2024-04-19T02:20:27.963130+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:27.963106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:27.963106+0000","last_clean_scrub_stamp":"2024-04-19T02:20:27.963106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:35:23.138484+0000","scrub_duration":0.070564934999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.999545+0000","last_change":"2024-04-19T02:20:09.998998+0000","last_active":"2024-04-19T02:20:09.999545+0000","last_peered":"2024-04-19T02:20:09.999545+0000","last_clean":"2024-04-19T02:20:09.999545+0000","last_became_active":"2024-04-19T02:20:09.998776+0000","last_became_peered":"2024-04-19T02:20:09.998776+0000","last_unstale":"2024-04-19T02:20:09.999545+0000","last_undegraded":"2024-04-19T02:20:09.999545+0000","last_fullsized":"2024-04-19T02:20:09.999545+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637917+0000","last_change":"2024-04-19T02:19:54.926207+0000","last_active":"2024-04-19T02:20:10.637917+0000","last_peered":"2024-04-19T02:20:10.637917+0000","last_clean":"2024-04-19T02:20:10.637917+0000","last_became_active":"2024-04-19T02:19:54.925872+0000","last_became_peered":"2024-04-19T02:19:54.925872+0000","last_unstale":"2024-04-19T02:20:10.637917+0000","last_undegraded":"2024-04-19T02:20:10.637917+0000","last_fullsized":"2024-04-19T02:20:10.637917+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.514809+0000","last_change":"2024-04-19T02:20:33.514910+0000","last_active":"2024-04-19T02:20:33.514809+0000","last_peered":"2024-04-19T02:20:33.514809+0000","last_clean":"2024-04-19T02:20:33.514809+0000","last_became_active":"2024-04-19T02:15:29.276968+0000","last_became_peered":"2024-04-19T02:15:29.276968+0000","last_unstale":"2024-04-19T02:20:33.514809+0000","last_undegraded":"2024-04-19T02:20:33.514809+0000","last_fullsized":"2024-04-19T02:20:33.514809+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:33.514784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:33.514784+0000","last_clean_scrub_stamp":"2024-04-19T02:20:33.514784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:01:55.933306+0000","scrub_duration":0.0019782179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":97,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637320+0000","last_change":"2024-04-19T02:19:54.927361+0000","last_active":"2024-04-19T02:20:10.637320+0000","last_peered":"2024-04-19T02:20:10.637320+0000","last_clean":"2024-04-19T02:20:10.637320+0000","last_became_active":"2024-04-19T02:19:54.927033+0000","last_became_peered":"2024-04-19T02:19:54.927033+0000","last_unstale":"2024-04-19T02:20:10.637320+0000","last_undegraded":"2024-04-19T02:20:10.637320+0000","last_fullsized":"2024-04-19T02:20:10.637320+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637470+0000","last_change":"2024-04-19T02:19:54.932790+0000","last_active":"2024-04-19T02:20:10.637470+0000","last_peered":"2024-04-19T02:20:10.637470+0000","last_clean":"2024-04-19T02:20:10.637470+0000","last_became_active":"2024-04-19T02:19:54.931683+0000","last_became_peered":"2024-04-19T02:19:54.931683+0000","last_unstale":"2024-04-19T02:20:10.637470+0000","last_undegraded":"2024-04-19T02:20:10.637470+0000","last_fullsized":"2024-04-19T02:20:10.637470+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:37.784585+0000","last_change":"2024-04-19T02:20:37.784722+0000","last_active":"2024-04-19T02:20:37.784585+0000","last_peered":"2024-04-19T02:20:37.784585+0000","last_clean":"2024-04-19T02:20:37.784585+0000","last_became_active":"2024-04-19T02:19:54.924686+0000","last_became_peered":"2024-04-19T02:19:54.924686+0000","last_unstale":"2024-04-19T02:20:37.784585+0000","last_undegraded":"2024-04-19T02:20:37.784585+0000","last_fullsized":"2024-04-19T02:20:37.784585+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:37.784561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:37.784561+0000","last_clean_scrub_stamp":"2024-04-19T02:20:37.784561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:26:44.108152+0000","scrub_duration":0.0013845000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:51.933270+0000","last_change":"2024-04-19T02:20:51.933365+0000","last_active":"2024-04-19T02:20:51.933270+0000","last_peered":"2024-04-19T02:20:51.933270+0000","last_clean":"2024-04-19T02:20:51.933270+0000","last_became_active":"2024-04-19T02:19:54.923164+0000","last_became_peered":"2024-04-19T02:19:54.923164+0000","last_unstale":"2024-04-19T02:20:51.933270+0000","last_undegraded":"2024-04-19T02:20:51.933270+0000","last_fullsized":"2024-04-19T02:20:51.933270+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:51.933246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:51.933246+0000","last_clean_scrub_stamp":"2024-04-19T02:20:51.933246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:39:21.609447+0000","scrub_duration":0.0015936590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.997425+0000","last_change":"2024-04-19T02:20:08.662301+0000","last_active":"2024-04-19T02:20:09.997425+0000","last_peered":"2024-04-19T02:20:09.997425+0000","last_clean":"2024-04-19T02:20:09.997425+0000","last_became_active":"2024-04-19T02:20:08.661952+0000","last_became_peered":"2024-04-19T02:20:08.661952+0000","last_unstale":"2024-04-19T02:20:09.997425+0000","last_undegraded":"2024-04-19T02:20:09.997425+0000","last_fullsized":"2024-04-19T02:20:09.997425+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:28.899614+0000","last_change":"2024-04-19T02:20:28.899746+0000","last_active":"2024-04-19T02:20:28.899614+0000","last_peered":"2024-04-19T02:20:28.899614+0000","last_clean":"2024-04-19T02:20:28.899614+0000","last_became_active":"2024-04-19T02:19:54.926463+0000","last_became_peered":"2024-04-19T02:19:54.926463+0000","last_unstale":"2024-04-19T02:20:28.899614+0000","last_undegraded":"2024-04-19T02:20:28.899614+0000","last_fullsized":"2024-04-19T02:20:28.899614+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:28.899588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:28.899588+0000","last_clean_scrub_stamp":"2024-04-19T02:20:28.899588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:34:50.323413+0000","scrub_duration":0.038469191,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":97,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637446+0000","last_change":"2024-04-19T02:19:54.932929+0000","last_active":"2024-04-19T02:20:10.637446+0000","last_peered":"2024-04-19T02:20:10.637446+0000","last_clean":"2024-04-19T02:20:10.637446+0000","last_became_active":"2024-04-19T02:19:54.932571+0000","last_became_peered":"2024-04-19T02:19:54.932571+0000","last_unstale":"2024-04-19T02:20:10.637446+0000","last_undegraded":"2024-04-19T02:20:10.637446+0000","last_fullsized":"2024-04-19T02:20:10.637446+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":280,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637133+0000","last_change":"2024-04-19T02:15:24.533634+0000","last_active":"2024-04-19T02:20:10.637133+0000","last_peered":"2024-04-19T02:20:10.637133+0000","last_clean":"2024-04-19T02:20:10.637133+0000","last_became_active":"2024-04-19T02:15:24.533420+0000","last_became_peered":"2024-04-19T02:15:24.533420+0000","last_unstale":"2024-04-19T02:20:10.637133+0000","last_undegraded":"2024-04-19T02:20:10.637133+0000","last_fullsized":"2024-04-19T02:20:10.637133+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":53,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:22.938802+0000","last_change":"2024-04-19T02:20:22.938906+0000","last_active":"2024-04-19T02:20:22.938802+0000","last_peered":"2024-04-19T02:20:22.938802+0000","last_clean":"2024-04-19T02:20:22.938802+0000","last_became_active":"2024-04-19T02:20:10.001415+0000","last_became_peered":"2024-04-19T02:20:10.001415+0000","last_unstale":"2024-04-19T02:20:22.938802+0000","last_undegraded":"2024-04-19T02:20:22.938802+0000","last_fullsized":"2024-04-19T02:20:22.938802+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:22.938775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:22.938775+0000","last_clean_scrub_stamp":"2024-04-19T02:20:22.938775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:30:51.144263+0000","scrub_duration":0.001921898,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:27.601296+0000","last_change":"2024-04-19T02:20:27.601464+0000","last_active":"2024-04-19T02:20:27.601296+0000","last_peered":"2024-04-19T02:20:27.601296+0000","last_clean":"2024-04-19T02:20:27.601296+0000","last_became_active":"2024-04-19T02:15:29.284164+0000","last_became_peered":"2024-04-19T02:15:29.284164+0000","last_unstale":"2024-04-19T02:20:27.601296+0000","last_undegraded":"2024-04-19T02:20:27.601296+0000","last_fullsized":"2024-04-19T02:20:27.601296+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:27.601255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:27.601255+0000","last_clean_scrub_stamp":"2024-04-19T02:20:27.601255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:45:08.158116+0000","scrub_duration":0.0020462050000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":84,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637203+0000","last_change":"2024-04-19T02:15:24.533912+0000","last_active":"2024-04-19T02:20:10.637203+0000","last_peered":"2024-04-19T02:20:10.637203+0000","last_clean":"2024-04-19T02:20:10.637203+0000","last_became_active":"2024-04-19T02:15:24.533580+0000","last_became_peered":"2024-04-19T02:15:24.533580+0000","last_unstale":"2024-04-19T02:20:10.637203+0000","last_undegraded":"2024-04-19T02:20:10.637203+0000","last_fullsized":"2024-04-19T02:20:10.637203+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.640131+0000","last_change":"2024-04-19T02:20:10.639268+0000","last_active":"2024-04-19T02:20:10.640131+0000","last_peered":"2024-04-19T02:20:10.640131+0000","last_clean":"2024-04-19T02:20:10.640131+0000","last_became_active":"2024-04-19T02:20:10.638966+0000","last_became_peered":"2024-04-19T02:20:10.638966+0000","last_unstale":"2024-04-19T02:20:10.640131+0000","last_undegraded":"2024-04-19T02:20:10.640131+0000","last_fullsized":"2024-04-19T02:20:10.640131+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.998577+0000","last_change":"2024-04-19T02:20:07.986363+0000","last_active":"2024-04-19T02:20:09.998577+0000","last_peered":"2024-04-19T02:20:09.998577+0000","last_clean":"2024-04-19T02:20:09.998577+0000","last_became_active":"2024-04-19T02:20:07.986110+0000","last_became_peered":"2024-04-19T02:20:07.986110+0000","last_unstale":"2024-04-19T02:20:09.998577+0000","last_undegraded":"2024-04-19T02:20:09.998577+0000","last_fullsized":"2024-04-19T02:20:09.998577+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":61,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.998413+0000","last_change":"2024-04-19T02:19:54.925886+0000","last_active":"2024-04-19T02:20:09.998413+0000","last_peered":"2024-04-19T02:20:09.998413+0000","last_clean":"2024-04-19T02:20:09.998413+0000","last_became_active":"2024-04-19T02:19:54.925570+0000","last_became_peered":"2024-04-19T02:19:54.925570+0000","last_unstale":"2024-04-19T02:20:09.998413+0000","last_undegraded":"2024-04-19T02:20:09.998413+0000","last_fullsized":"2024-04-19T02:20:09.998413+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.996111+0000","last_change":"2024-04-19T02:19:54.933960+0000","last_active":"2024-04-19T02:20:09.996111+0000","last_peered":"2024-04-19T02:20:09.996111+0000","last_clean":"2024-04-19T02:20:09.996111+0000","last_became_active":"2024-04-19T02:19:54.929918+0000","last_became_peered":"2024-04-19T02:19:54.929918+0000","last_unstale":"2024-04-19T02:20:09.996111+0000","last_undegraded":"2024-04-19T02:20:09.996111+0000","last_fullsized":"2024-04-19T02:20:09.996111+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":79,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.997668+0000","last_change":"2024-04-19T02:15:29.281694+0000","last_active":"2024-04-19T02:20:09.997668+0000","last_peered":"2024-04-19T02:20:09.997668+0000","last_clean":"2024-04-19T02:20:09.997668+0000","last_became_active":"2024-04-19T02:15:29.280519+0000","last_became_peered":"2024-04-19T02:15:29.280519+0000","last_unstale":"2024-04-19T02:20:09.997668+0000","last_undegraded":"2024-04-19T02:20:09.997668+0000","last_fullsized":"2024-04-19T02:20:09.997668+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.996465+0000","last_change":"2024-04-19T02:19:54.931726+0000","last_active":"2024-04-19T02:20:09.996465+0000","last_peered":"2024-04-19T02:20:09.996465+0000","last_clean":"2024-04-19T02:20:09.996465+0000","last_became_active":"2024-04-19T02:19:54.928460+0000","last_became_peered":"2024-04-19T02:19:54.928460+0000","last_unstale":"2024-04-19T02:20:09.996465+0000","last_undegraded":"2024-04-19T02:20:09.996465+0000","last_fullsized":"2024-04-19T02:20:09.996465+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.999540+0000","last_change":"2024-04-19T02:20:09.998879+0000","last_active":"2024-04-19T02:20:09.999540+0000","last_peered":"2024-04-19T02:20:09.999540+0000","last_clean":"2024-04-19T02:20:09.999540+0000","last_became_active":"2024-04-19T02:20:09.998629+0000","last_became_peered":"2024-04-19T02:20:09.998629+0000","last_unstale":"2024-04-19T02:20:09.999540+0000","last_undegraded":"2024-04-19T02:20:09.999540+0000","last_fullsized":"2024-04-19T02:20:09.999540+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.640140+0000","last_change":"2024-04-19T02:20:10.639272+0000","last_active":"2024-04-19T02:20:10.640140+0000","last_peered":"2024-04-19T02:20:10.640140+0000","last_clean":"2024-04-19T02:20:10.640140+0000","last_became_active":"2024-04-19T02:20:10.638912+0000","last_became_peered":"2024-04-19T02:20:10.638912+0000","last_unstale":"2024-04-19T02:20:10.640140+0000","last_undegraded":"2024-04-19T02:20:10.640140+0000","last_fullsized":"2024-04-19T02:20:10.640140+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":84,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.638122+0000","last_change":"2024-04-19T02:15:24.533777+0000","last_active":"2024-04-19T02:20:10.638122+0000","last_peered":"2024-04-19T02:20:10.638122+0000","last_clean":"2024-04-19T02:20:10.638122+0000","last_became_active":"2024-04-19T02:15:24.533436+0000","last_became_peered":"2024-04-19T02:15:24.533436+0000","last_unstale":"2024-04-19T02:20:10.638122+0000","last_undegraded":"2024-04-19T02:20:10.638122+0000","last_fullsized":"2024-04-19T02:20:10.638122+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"82'2","reported_seq":46,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:44.865916+0000","last_change":"2024-04-19T02:20:44.866016+0000","last_active":"2024-04-19T02:20:44.865916+0000","last_peered":"2024-04-19T02:20:44.865916+0000","last_clean":"2024-04-19T02:20:44.865916+0000","last_became_active":"2024-04-19T02:19:54.931328+0000","last_became_peered":"2024-04-19T02:19:54.931328+0000","last_unstale":"2024-04-19T02:20:44.865916+0000","last_undegraded":"2024-04-19T02:20:44.865916+0000","last_fullsized":"2024-04-19T02:20:44.865916+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-19T02:20:44.865892+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-19T02:20:44.865892+0000","last_clean_scrub_stamp":"2024-04-19T02:20:44.865892+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:06:18.693677+0000","scrub_duration":0.00333659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:40.611417+0000","last_change":"2024-04-19T02:20:40.611536+0000","last_active":"2024-04-19T02:20:40.611417+0000","last_peered":"2024-04-19T02:20:40.611417+0000","last_clean":"2024-04-19T02:20:40.611417+0000","last_became_active":"2024-04-19T02:15:29.280366+0000","last_became_peered":"2024-04-19T02:15:29.280366+0000","last_unstale":"2024-04-19T02:20:40.611417+0000","last_undegraded":"2024-04-19T02:20:40.611417+0000","last_fullsized":"2024-04-19T02:20:40.611417+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:40.611392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:40.611392+0000","last_clean_scrub_stamp":"2024-04-19T02:20:40.611392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:35.395252+0000","scrub_duration":0.0015883539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:20.499156+0000","last_change":"2024-04-19T02:15:28.893027+0000","last_active":"2024-04-19T02:20:20.499156+0000","last_peered":"2024-04-19T02:20:20.499156+0000","last_clean":"2024-04-19T02:20:20.499156+0000","last_became_active":"2024-04-19T02:15:28.892695+0000","last_became_peered":"2024-04-19T02:15:28.892695+0000","last_unstale":"2024-04-19T02:20:20.499156+0000","last_undegraded":"2024-04-19T02:20:20.499156+0000","last_fullsized":"2024-04-19T02:20:20.499156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":103,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:42.629277+0000","last_change":"2024-04-19T02:20:42.629383+0000","last_active":"2024-04-19T02:20:42.629277+0000","last_peered":"2024-04-19T02:20:42.629277+0000","last_clean":"2024-04-19T02:20:42.629277+0000","last_became_active":"2024-04-19T02:19:54.929412+0000","last_became_peered":"2024-04-19T02:19:54.929412+0000","last_unstale":"2024-04-19T02:20:42.629277+0000","last_undegraded":"2024-04-19T02:20:42.629277+0000","last_fullsized":"2024-04-19T02:20:42.629277+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:42.629252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:42.629252+0000","last_clean_scrub_stamp":"2024-04-19T02:20:42.629252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:14.280965+0000","scrub_duration":0.0020287679999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"82'3","reported_seq":108,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.601787+0000","last_change":"2024-04-19T02:20:48.601893+0000","last_active":"2024-04-19T02:20:48.601787+0000","last_peered":"2024-04-19T02:20:48.601787+0000","last_clean":"2024-04-19T02:20:48.601787+0000","last_became_active":"2024-04-19T02:19:54.926630+0000","last_became_peered":"2024-04-19T02:19:54.926630+0000","last_unstale":"2024-04-19T02:20:48.601787+0000","last_undegraded":"2024-04-19T02:20:48.601787+0000","last_fullsized":"2024-04-19T02:20:48.601787+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-19T02:20:48.601762+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-19T02:20:48.601762+0000","last_clean_scrub_stamp":"2024-04-19T02:20:48.601762+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:28:54.715316+0000","scrub_duration":0.0034412739999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:23.628340+0000","last_change":"2024-04-19T02:20:23.628340+0000","last_active":"2024-04-19T02:20:23.628340+0000","last_peered":"2024-04-19T02:20:23.628340+0000","last_clean":"2024-04-19T02:20:23.628340+0000","last_became_active":"2024-04-19T02:19:54.931328+0000","last_became_peered":"2024-04-19T02:19:54.931328+0000","last_unstale":"2024-04-19T02:20:23.628340+0000","last_undegraded":"2024-04-19T02:20:23.628340+0000","last_fullsized":"2024-04-19T02:20:23.628340+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:23.628182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:23.628182+0000","last_clean_scrub_stamp":"2024-04-19T02:20:23.628182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:41:07.461430+0000","scrub_duration":0.042718649999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":82,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:20.499132+0000","last_change":"2024-04-19T02:15:28.893239+0000","last_active":"2024-04-19T02:20:20.499132+0000","last_peered":"2024-04-19T02:20:20.499132+0000","last_clean":"2024-04-19T02:20:20.499132+0000","last_became_active":"2024-04-19T02:15:28.892881+0000","last_became_peered":"2024-04-19T02:15:28.892881+0000","last_unstale":"2024-04-19T02:20:20.499132+0000","last_undegraded":"2024-04-19T02:20:20.499132+0000","last_fullsized":"2024-04-19T02:20:20.499132+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:21.614064+0000","last_change":"2024-04-19T02:20:21.614064+0000","last_active":"2024-04-19T02:20:21.614064+0000","last_peered":"2024-04-19T02:20:21.614064+0000","last_clean":"2024-04-19T02:20:21.614064+0000","last_became_active":"2024-04-19T02:19:54.923752+0000","last_became_peered":"2024-04-19T02:19:54.923752+0000","last_unstale":"2024-04-19T02:20:21.614064+0000","last_undegraded":"2024-04-19T02:20:21.614064+0000","last_fullsized":"2024-04-19T02:20:21.614064+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:21.613938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:21.613938+0000","last_clean_scrub_stamp":"2024-04-19T02:20:21.613938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:28:11.041024+0000","scrub_duration":0.0017798099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.996428+0000","last_change":"2024-04-19T02:19:54.933652+0000","last_active":"2024-04-19T02:20:09.996428+0000","last_peered":"2024-04-19T02:20:09.996428+0000","last_clean":"2024-04-19T02:20:09.996428+0000","last_became_active":"2024-04-19T02:19:54.932103+0000","last_became_peered":"2024-04-19T02:19:54.932103+0000","last_unstale":"2024-04-19T02:20:09.996428+0000","last_undegraded":"2024-04-19T02:20:09.996428+0000","last_fullsized":"2024-04-19T02:20:09.996428+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:20.499288+0000","last_change":"2024-04-19T02:19:54.925832+0000","last_active":"2024-04-19T02:20:20.499288+0000","last_peered":"2024-04-19T02:20:20.499288+0000","last_clean":"2024-04-19T02:20:20.499288+0000","last_became_active":"2024-04-19T02:19:54.925565+0000","last_became_peered":"2024-04-19T02:19:54.925565+0000","last_unstale":"2024-04-19T02:20:20.499288+0000","last_undegraded":"2024-04-19T02:20:20.499288+0000","last_fullsized":"2024-04-19T02:20:20.499288+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.996567+0000","last_change":"2024-04-19T02:19:54.929083+0000","last_active":"2024-04-19T02:20:09.996567+0000","last_peered":"2024-04-19T02:20:09.996567+0000","last_clean":"2024-04-19T02:20:09.996567+0000","last_became_active":"2024-04-19T02:19:54.926439+0000","last_became_peered":"2024-04-19T02:19:54.926439+0000","last_unstale":"2024-04-19T02:20:09.996567+0000","last_undegraded":"2024-04-19T02:20:09.996567+0000","last_fullsized":"2024-04-19T02:20:09.996567+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:46.634857+0000","last_change":"2024-04-19T02:20:46.634995+0000","last_active":"2024-04-19T02:20:46.634857+0000","last_peered":"2024-04-19T02:20:46.634857+0000","last_clean":"2024-04-19T02:20:46.634857+0000","last_became_active":"2024-04-19T02:19:54.930665+0000","last_became_peered":"2024-04-19T02:19:54.930665+0000","last_unstale":"2024-04-19T02:20:46.634857+0000","last_undegraded":"2024-04-19T02:20:46.634857+0000","last_fullsized":"2024-04-19T02:20:46.634857+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:46.634833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:46.634833+0000","last_clean_scrub_stamp":"2024-04-19T02:20:46.634833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:58:28.047698+0000","scrub_duration":0.001963645,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637261+0000","last_change":"2024-04-19T02:19:54.931055+0000","last_active":"2024-04-19T02:20:10.637261+0000","last_peered":"2024-04-19T02:20:10.637261+0000","last_clean":"2024-04-19T02:20:10.637261+0000","last_became_active":"2024-04-19T02:19:54.930527+0000","last_became_peered":"2024-04-19T02:19:54.930527+0000","last_unstale":"2024-04-19T02:20:10.637261+0000","last_undegraded":"2024-04-19T02:20:10.637261+0000","last_fullsized":"2024-04-19T02:20:10.637261+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.002363+0000","last_change":"2024-04-19T02:20:10.001589+0000","last_active":"2024-04-19T02:20:10.002363+0000","last_peered":"2024-04-19T02:20:10.002363+0000","last_clean":"2024-04-19T02:20:10.002363+0000","last_became_active":"2024-04-19T02:20:10.001304+0000","last_became_peered":"2024-04-19T02:20:10.001304+0000","last_unstale":"2024-04-19T02:20:10.002363+0000","last_undegraded":"2024-04-19T02:20:10.002363+0000","last_fullsized":"2024-04-19T02:20:10.002363+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.998017+0000","last_change":"2024-04-19T02:20:08.662331+0000","last_active":"2024-04-19T02:20:09.998017+0000","last_peered":"2024-04-19T02:20:09.998017+0000","last_clean":"2024-04-19T02:20:09.998017+0000","last_became_active":"2024-04-19T02:20:08.661996+0000","last_became_peered":"2024-04-19T02:20:08.661996+0000","last_unstale":"2024-04-19T02:20:09.998017+0000","last_undegraded":"2024-04-19T02:20:09.998017+0000","last_fullsized":"2024-04-19T02:20:09.998017+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.002397+0000","last_change":"2024-04-19T02:20:10.001706+0000","last_active":"2024-04-19T02:20:10.002397+0000","last_peered":"2024-04-19T02:20:10.002397+0000","last_clean":"2024-04-19T02:20:10.002397+0000","last_became_active":"2024-04-19T02:20:10.001372+0000","last_became_peered":"2024-04-19T02:20:10.001372+0000","last_unstale":"2024-04-19T02:20:10.002397+0000","last_undegraded":"2024-04-19T02:20:10.002397+0000","last_fullsized":"2024-04-19T02:20:10.002397+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":79,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.998319+0000","last_change":"2024-04-19T02:15:29.277568+0000","last_active":"2024-04-19T02:20:09.998319+0000","last_peered":"2024-04-19T02:20:09.998319+0000","last_clean":"2024-04-19T02:20:09.998319+0000","last_became_active":"2024-04-19T02:15:29.276725+0000","last_became_peered":"2024-04-19T02:15:29.276725+0000","last_unstale":"2024-04-19T02:20:09.998319+0000","last_undegraded":"2024-04-19T02:20:09.998319+0000","last_fullsized":"2024-04-19T02:20:09.998319+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5254,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":72,"seq":309237645327,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58812,"kb_used_data":884,"kb_used_omap":6,"kb_used_meta":57913,"kb_avail":94313028,"statfs":{"total":96636764160,"available":96576540672,"internally_reserved":0,"allocated":905216,"data_stored":358135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6848,"internal_metadata":59303232},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:20:54 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.57199999999999995}]},{"osd":1,"last update":"Fri Apr 19 02:20:54 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.54600000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738439,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":275412,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":273918,"kb_avail":94096428,"statfs":{"total":96636764160,"available":96354742272,"internally_reserved":0,"allocated":1519616,"data_stored":948136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":280492486},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 02:20:28 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.40500000000000003,"15min":0.32700000000000001},"min":{"1min":0.30599999999999999,"5min":0.159,"15min":0.159},"max":{"1min":0.57599999999999996,"5min":4.4480000000000004,"15min":4.4480000000000004},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.39700000000000002,"15min":0.372},"min":{"1min":0.32600000000000001,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.59699999999999998,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.502}]},{"osd":2,"last update":"Fri Apr 19 02:20:56 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.54900000000000004}]}]},{"osd":1,"up_from":8,"seq":34359738438,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307408,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":305918,"kb_avail":94064432,"statfs":{"total":96636764160,"available":96321978368,"internally_reserved":0,"allocated":1515520,"data_stored":949633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":313260486},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:20:31 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.432,"15min":0.38400000000000001},"min":{"1min":0.38700000000000001,"5min":0.157,"15min":0.157},"max":{"1min":0.65200000000000002,"5min":1.794,"15min":1.794},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.41999999999999998,"15min":0.33700000000000002},"min":{"1min":0.41399999999999998,"5min":0.16,"15min":0.16},"max":{"1min":0.60399999999999998,"5min":2.411,"15min":2.411},"last":0.39300000000000002}]},{"osd":2,"last update":"Fri Apr 19 02:20:54 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.441}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5254,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:21:02.098 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.098 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.098 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.098 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.098 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.098 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.099 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.099 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.099 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.099 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.099 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.099 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.099 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.099 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.100 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.100 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.100 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.100 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.100 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.100 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.100 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.100 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.100 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.100 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.101 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.101 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.101 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.101 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.101 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.101 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.101 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.101 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.101 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.102 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.102 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.102 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.102 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.102 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.102 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.102 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.102 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.103 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.103 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.103 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.103 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-19T02:15:23.520722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.103 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.103 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-19T02:15:23.520722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.103 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.103 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.103 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-19T02:15:23.520722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.104 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-19T02:15:23.520722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.104 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-19T02:15:23.520722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.104 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.104 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.104 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-19T02:15:23.520722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.104 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.104 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.104 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.104 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-19T02:15:23.520722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.105 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.105 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-19T02:15:23.520722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.105 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.105 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.105 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.105 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.105 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.105 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.106 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.106 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.106 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.106 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:02.106 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-19T02:21:22.107 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:21:22.447 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:21:22.449 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-04-19T02:21:22.459 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":257,"stamp":"2024-04-19T02:21:20.829345+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":204,"ondisk_log_size":204,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":641632,"kb_used_data":3848,"kb_used_omap":9,"kb_used_meta":637750,"kb_avail":282473888,"statfs":{"total":289910292480,"available":289253261312,"internally_reserved":0,"allocated":3940352,"data_stored":2255904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10036,"internal_metadata":653056204},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003230"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":103,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:44.754058+0000","last_change":"2024-04-19T02:20:44.754184+0000","last_active":"2024-04-19T02:20:44.754058+0000","last_peered":"2024-04-19T02:20:44.754058+0000","last_clean":"2024-04-19T02:20:44.754058+0000","last_became_active":"2024-04-19T02:19:54.929435+0000","last_became_peered":"2024-04-19T02:19:54.929435+0000","last_unstale":"2024-04-19T02:20:44.754058+0000","last_undegraded":"2024-04-19T02:20:44.754058+0000","last_fullsized":"2024-04-19T02:20:44.754058+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:44.754035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:44.754035+0000","last_clean_scrub_stamp":"2024-04-19T02:20:44.754035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:46:01.301053+0000","scrub_duration":0.089914654999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":103,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:52.728883+0000","last_change":"2024-04-19T02:20:52.728989+0000","last_active":"2024-04-19T02:20:52.728883+0000","last_peered":"2024-04-19T02:20:52.728883+0000","last_clean":"2024-04-19T02:20:52.728883+0000","last_became_active":"2024-04-19T02:19:54.931278+0000","last_became_peered":"2024-04-19T02:19:54.931278+0000","last_unstale":"2024-04-19T02:20:52.728883+0000","last_undegraded":"2024-04-19T02:20:52.728883+0000","last_fullsized":"2024-04-19T02:20:52.728883+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:52.728860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:52.728860+0000","last_clean_scrub_stamp":"2024-04-19T02:20:52.728860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:55:28.628918+0000","scrub_duration":0.0016468570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:35.678810+0000","last_change":"2024-04-19T02:20:35.678916+0000","last_active":"2024-04-19T02:20:35.678810+0000","last_peered":"2024-04-19T02:20:35.678810+0000","last_clean":"2024-04-19T02:20:35.678810+0000","last_became_active":"2024-04-19T02:15:29.286169+0000","last_became_peered":"2024-04-19T02:15:29.286169+0000","last_unstale":"2024-04-19T02:20:35.678810+0000","last_undegraded":"2024-04-19T02:20:35.678810+0000","last_fullsized":"2024-04-19T02:20:35.678810+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:35.678786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:35.678786+0000","last_clean_scrub_stamp":"2024-04-19T02:20:35.678786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:39:46.619486+0000","scrub_duration":0.0021837459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637860+0000","last_change":"2024-04-19T02:19:54.927063+0000","last_active":"2024-04-19T02:20:10.637860+0000","last_peered":"2024-04-19T02:20:10.637860+0000","last_clean":"2024-04-19T02:20:10.637860+0000","last_became_active":"2024-04-19T02:19:54.926046+0000","last_became_peered":"2024-04-19T02:19:54.926046+0000","last_unstale":"2024-04-19T02:20:10.637860+0000","last_undegraded":"2024-04-19T02:20:10.637860+0000","last_fullsized":"2024-04-19T02:20:10.637860+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":68,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:59.656793+0000","last_change":"2024-04-19T02:20:59.656898+0000","last_active":"2024-04-19T02:20:59.656793+0000","last_peered":"2024-04-19T02:20:59.656793+0000","last_clean":"2024-04-19T02:20:59.656793+0000","last_became_active":"2024-04-19T02:19:54.931435+0000","last_became_peered":"2024-04-19T02:19:54.931435+0000","last_unstale":"2024-04-19T02:20:59.656793+0000","last_undegraded":"2024-04-19T02:20:59.656793+0000","last_fullsized":"2024-04-19T02:20:59.656793+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:59.656767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:59.656767+0000","last_clean_scrub_stamp":"2024-04-19T02:20:59.656767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:45:40.213629+0000","scrub_duration":0.021141032000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:20.006277+0000","last_change":"2024-04-19T02:19:54.924250+0000","last_active":"2024-04-19T02:20:20.006277+0000","last_peered":"2024-04-19T02:20:20.006277+0000","last_clean":"2024-04-19T02:20:20.006277+0000","last_became_active":"2024-04-19T02:19:54.923984+0000","last_became_peered":"2024-04-19T02:19:54.923984+0000","last_unstale":"2024-04-19T02:20:20.006277+0000","last_undegraded":"2024-04-19T02:20:20.006277+0000","last_fullsized":"2024-04-19T02:20:20.006277+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:45.640394+0000","last_change":"2024-04-19T02:20:45.640499+0000","last_active":"2024-04-19T02:20:45.640394+0000","last_peered":"2024-04-19T02:20:45.640394+0000","last_clean":"2024-04-19T02:20:45.640394+0000","last_became_active":"2024-04-19T02:19:54.925529+0000","last_became_peered":"2024-04-19T02:19:54.925529+0000","last_unstale":"2024-04-19T02:20:45.640394+0000","last_undegraded":"2024-04-19T02:20:45.640394+0000","last_fullsized":"2024-04-19T02:20:45.640394+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:45.640369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:45.640369+0000","last_clean_scrub_stamp":"2024-04-19T02:20:45.640369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:09:00.709082+0000","scrub_duration":0.022321161999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:20.006244+0000","last_change":"2024-04-19T02:19:54.930828+0000","last_active":"2024-04-19T02:20:20.006244+0000","last_peered":"2024-04-19T02:20:20.006244+0000","last_clean":"2024-04-19T02:20:20.006244+0000","last_became_active":"2024-04-19T02:19:54.930075+0000","last_became_peered":"2024-04-19T02:19:54.930075+0000","last_unstale":"2024-04-19T02:20:20.006244+0000","last_undegraded":"2024-04-19T02:20:20.006244+0000","last_fullsized":"2024-04-19T02:20:20.006244+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:39.837203+0000","last_change":"2024-04-19T02:20:39.837337+0000","last_active":"2024-04-19T02:20:39.837203+0000","last_peered":"2024-04-19T02:20:39.837203+0000","last_clean":"2024-04-19T02:20:39.837203+0000","last_became_active":"2024-04-19T02:19:54.928496+0000","last_became_peered":"2024-04-19T02:19:54.928496+0000","last_unstale":"2024-04-19T02:20:39.837203+0000","last_undegraded":"2024-04-19T02:20:39.837203+0000","last_fullsized":"2024-04-19T02:20:39.837203+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:39.837177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:39.837177+0000","last_clean_scrub_stamp":"2024-04-19T02:20:39.837177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:32:07.735631+0000","scrub_duration":0.037239790000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":61,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637830+0000","last_change":"2024-04-19T02:16:30.093524+0000","last_active":"2024-04-19T02:20:10.637830+0000","last_peered":"2024-04-19T02:20:10.637830+0000","last_clean":"2024-04-19T02:20:10.637830+0000","last_became_active":"2024-04-19T02:16:30.093344+0000","last_became_peered":"2024-04-19T02:16:30.093344+0000","last_unstale":"2024-04-19T02:20:10.637830+0000","last_undegraded":"2024-04-19T02:20:10.637830+0000","last_fullsized":"2024-04-19T02:20:10.637830+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:20.006224+0000","last_change":"2024-04-19T02:19:54.926754+0000","last_active":"2024-04-19T02:20:20.006224+0000","last_peered":"2024-04-19T02:20:20.006224+0000","last_clean":"2024-04-19T02:20:20.006224+0000","last_became_active":"2024-04-19T02:19:54.926040+0000","last_became_peered":"2024-04-19T02:19:54.926040+0000","last_unstale":"2024-04-19T02:20:20.006224+0000","last_undegraded":"2024-04-19T02:20:20.006224+0000","last_fullsized":"2024-04-19T02:20:20.006224+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.998087+0000","last_change":"2024-04-19T02:20:08.662601+0000","last_active":"2024-04-19T02:20:09.998087+0000","last_peered":"2024-04-19T02:20:09.998087+0000","last_clean":"2024-04-19T02:20:09.998087+0000","last_became_active":"2024-04-19T02:20:08.662234+0000","last_became_peered":"2024-04-19T02:20:08.662234+0000","last_unstale":"2024-04-19T02:20:09.998087+0000","last_undegraded":"2024-04-19T02:20:09.998087+0000","last_fullsized":"2024-04-19T02:20:09.998087+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":68,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:24.574781+0000","last_change":"2024-04-19T02:20:24.574893+0000","last_active":"2024-04-19T02:20:24.574781+0000","last_peered":"2024-04-19T02:20:24.574781+0000","last_clean":"2024-04-19T02:20:24.574781+0000","last_became_active":"2024-04-19T02:19:54.932240+0000","last_became_peered":"2024-04-19T02:19:54.932240+0000","last_unstale":"2024-04-19T02:20:24.574781+0000","last_undegraded":"2024-04-19T02:20:24.574781+0000","last_fullsized":"2024-04-19T02:20:24.574781+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:24.574756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:24.574756+0000","last_clean_scrub_stamp":"2024-04-19T02:20:24.574756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:05:16.137888+0000","scrub_duration":0.02235088,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:52.533209+0000","last_change":"2024-04-19T02:20:52.533329+0000","last_active":"2024-04-19T02:20:52.533209+0000","last_peered":"2024-04-19T02:20:52.533209+0000","last_clean":"2024-04-19T02:20:52.533209+0000","last_became_active":"2024-04-19T02:15:29.283121+0000","last_became_peered":"2024-04-19T02:15:29.283121+0000","last_unstale":"2024-04-19T02:20:52.533209+0000","last_undegraded":"2024-04-19T02:20:52.533209+0000","last_fullsized":"2024-04-19T02:20:52.533209+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:52.533183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:52.533183+0000","last_clean_scrub_stamp":"2024-04-19T02:20:52.533183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:46:09.200215+0000","scrub_duration":0.0015891010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:01.631997+0000","last_change":"2024-04-19T02:21:01.632133+0000","last_active":"2024-04-19T02:21:01.631997+0000","last_peered":"2024-04-19T02:21:01.631997+0000","last_clean":"2024-04-19T02:21:01.631997+0000","last_became_active":"2024-04-19T02:15:29.284649+0000","last_became_peered":"2024-04-19T02:15:29.284649+0000","last_unstale":"2024-04-19T02:21:01.631997+0000","last_undegraded":"2024-04-19T02:21:01.631997+0000","last_fullsized":"2024-04-19T02:21:01.631997+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:01.631972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:01.631972+0000","last_clean_scrub_stamp":"2024-04-19T02:21:01.631972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:49:22.367870+0000","scrub_duration":0.001884562,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:20.567013+0000","last_change":"2024-04-19T02:20:20.567149+0000","last_active":"2024-04-19T02:20:20.567013+0000","last_peered":"2024-04-19T02:20:20.567013+0000","last_clean":"2024-04-19T02:20:20.567013+0000","last_became_active":"2024-04-19T02:19:54.930437+0000","last_became_peered":"2024-04-19T02:19:54.930437+0000","last_unstale":"2024-04-19T02:20:20.567013+0000","last_undegraded":"2024-04-19T02:20:20.567013+0000","last_fullsized":"2024-04-19T02:20:20.567013+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:20.566972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:20.566972+0000","last_clean_scrub_stamp":"2024-04-19T02:20:20.566972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:59:10.317082+0000","scrub_duration":0.00187685,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.002393+0000","last_change":"2024-04-19T02:20:10.001650+0000","last_active":"2024-04-19T02:20:10.002393+0000","last_peered":"2024-04-19T02:20:10.002393+0000","last_clean":"2024-04-19T02:20:10.002393+0000","last_became_active":"2024-04-19T02:20:10.001343+0000","last_became_peered":"2024-04-19T02:20:10.001343+0000","last_unstale":"2024-04-19T02:20:10.002393+0000","last_undegraded":"2024-04-19T02:20:10.002393+0000","last_fullsized":"2024-04-19T02:20:10.002393+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":103,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:04.663105+0000","last_change":"2024-04-19T02:21:04.663219+0000","last_active":"2024-04-19T02:21:04.663105+0000","last_peered":"2024-04-19T02:21:04.663105+0000","last_clean":"2024-04-19T02:21:04.663105+0000","last_became_active":"2024-04-19T02:19:54.933233+0000","last_became_peered":"2024-04-19T02:19:54.933233+0000","last_unstale":"2024-04-19T02:21:04.663105+0000","last_undegraded":"2024-04-19T02:21:04.663105+0000","last_fullsized":"2024-04-19T02:21:04.663105+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:04.663080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:04.663080+0000","last_clean_scrub_stamp":"2024-04-19T02:21:04.663080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:24:22.993742+0000","scrub_duration":0.0015971410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.996169+0000","last_change":"2024-04-19T02:19:54.925745+0000","last_active":"2024-04-19T02:20:09.996169+0000","last_peered":"2024-04-19T02:20:09.996169+0000","last_clean":"2024-04-19T02:20:09.996169+0000","last_became_active":"2024-04-19T02:19:54.925060+0000","last_became_peered":"2024-04-19T02:19:54.925060+0000","last_unstale":"2024-04-19T02:20:09.996169+0000","last_undegraded":"2024-04-19T02:20:09.996169+0000","last_fullsized":"2024-04-19T02:20:09.996169+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:32.721522+0000","last_change":"2024-04-19T02:20:32.721654+0000","last_active":"2024-04-19T02:20:32.721522+0000","last_peered":"2024-04-19T02:20:32.721522+0000","last_clean":"2024-04-19T02:20:32.721522+0000","last_became_active":"2024-04-19T02:19:54.926442+0000","last_became_peered":"2024-04-19T02:19:54.926442+0000","last_unstale":"2024-04-19T02:20:32.721522+0000","last_undegraded":"2024-04-19T02:20:32.721522+0000","last_fullsized":"2024-04-19T02:20:32.721522+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:32.721479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:32.721479+0000","last_clean_scrub_stamp":"2024-04-19T02:20:32.721479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:23:51.052141+0000","scrub_duration":0.0020564210000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637206+0000","last_change":"2024-04-19T02:19:54.932532+0000","last_active":"2024-04-19T02:20:10.637206+0000","last_peered":"2024-04-19T02:20:10.637206+0000","last_clean":"2024-04-19T02:20:10.637206+0000","last_became_active":"2024-04-19T02:19:54.931438+0000","last_became_peered":"2024-04-19T02:19:54.931438+0000","last_unstale":"2024-04-19T02:20:10.637206+0000","last_undegraded":"2024-04-19T02:20:10.637206+0000","last_fullsized":"2024-04-19T02:20:10.637206+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.997884+0000","last_change":"2024-04-19T02:20:08.662261+0000","last_active":"2024-04-19T02:20:09.997884+0000","last_peered":"2024-04-19T02:20:09.997884+0000","last_clean":"2024-04-19T02:20:09.997884+0000","last_became_active":"2024-04-19T02:20:08.661940+0000","last_became_peered":"2024-04-19T02:20:08.661940+0000","last_unstale":"2024-04-19T02:20:09.997884+0000","last_undegraded":"2024-04-19T02:20:09.997884+0000","last_fullsized":"2024-04-19T02:20:09.997884+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.640152+0000","last_change":"2024-04-19T02:20:10.639368+0000","last_active":"2024-04-19T02:20:10.640152+0000","last_peered":"2024-04-19T02:20:10.640152+0000","last_clean":"2024-04-19T02:20:10.640152+0000","last_became_active":"2024-04-19T02:20:10.639036+0000","last_became_peered":"2024-04-19T02:20:10.639036+0000","last_unstale":"2024-04-19T02:20:10.640152+0000","last_undegraded":"2024-04-19T02:20:10.640152+0000","last_fullsized":"2024-04-19T02:20:10.640152+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":103,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:54.722505+0000","last_change":"2024-04-19T02:20:54.722628+0000","last_active":"2024-04-19T02:20:54.722505+0000","last_peered":"2024-04-19T02:20:54.722505+0000","last_clean":"2024-04-19T02:20:54.722505+0000","last_became_active":"2024-04-19T02:19:54.928261+0000","last_became_peered":"2024-04-19T02:19:54.928261+0000","last_unstale":"2024-04-19T02:20:54.722505+0000","last_undegraded":"2024-04-19T02:20:54.722505+0000","last_fullsized":"2024-04-19T02:20:54.722505+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:54.722476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:54.722476+0000","last_clean_scrub_stamp":"2024-04-19T02:20:54.722476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:41:38.555723+0000","scrub_duration":0.0018882219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:41.635924+0000","last_change":"2024-04-19T02:20:41.636049+0000","last_active":"2024-04-19T02:20:41.635924+0000","last_peered":"2024-04-19T02:20:41.635924+0000","last_clean":"2024-04-19T02:20:41.635924+0000","last_became_active":"2024-04-19T02:15:29.276952+0000","last_became_peered":"2024-04-19T02:15:29.276952+0000","last_unstale":"2024-04-19T02:20:41.635924+0000","last_undegraded":"2024-04-19T02:20:41.635924+0000","last_fullsized":"2024-04-19T02:20:41.635924+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:41.635899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:41.635899+0000","last_clean_scrub_stamp":"2024-04-19T02:20:41.635899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:02:03.442021+0000","scrub_duration":0.035233386999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:36.825318+0000","last_change":"2024-04-19T02:20:36.825423+0000","last_active":"2024-04-19T02:20:36.825318+0000","last_peered":"2024-04-19T02:20:36.825318+0000","last_clean":"2024-04-19T02:20:36.825318+0000","last_became_active":"2024-04-19T02:19:54.931124+0000","last_became_peered":"2024-04-19T02:19:54.931124+0000","last_unstale":"2024-04-19T02:20:36.825318+0000","last_undegraded":"2024-04-19T02:20:36.825318+0000","last_fullsized":"2024-04-19T02:20:36.825318+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:36.825293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:36.825293+0000","last_clean_scrub_stamp":"2024-04-19T02:20:36.825293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:26:48.954624+0000","scrub_duration":0.0020341249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":80,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637710+0000","last_change":"2024-04-19T02:15:29.287389+0000","last_active":"2024-04-19T02:20:10.637710+0000","last_peered":"2024-04-19T02:20:10.637710+0000","last_clean":"2024-04-19T02:20:10.637710+0000","last_became_active":"2024-04-19T02:15:29.286431+0000","last_became_peered":"2024-04-19T02:15:29.286431+0000","last_unstale":"2024-04-19T02:20:10.637710+0000","last_undegraded":"2024-04-19T02:20:10.637710+0000","last_fullsized":"2024-04-19T02:20:10.637710+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:07.561762+0000","last_change":"2024-04-19T02:21:07.561888+0000","last_active":"2024-04-19T02:21:07.561762+0000","last_peered":"2024-04-19T02:21:07.561762+0000","last_clean":"2024-04-19T02:21:07.561762+0000","last_became_active":"2024-04-19T02:19:54.926838+0000","last_became_peered":"2024-04-19T02:19:54.926838+0000","last_unstale":"2024-04-19T02:21:07.561762+0000","last_undegraded":"2024-04-19T02:21:07.561762+0000","last_fullsized":"2024-04-19T02:21:07.561762+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-19T02:21:07.561735+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-19T02:21:07.561735+0000","last_clean_scrub_stamp":"2024-04-19T02:21:07.561735+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:40:18.502435+0000","scrub_duration":0.001800028,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:17.504243+0000","last_change":"2024-04-19T02:21:17.504338+0000","last_active":"2024-04-19T02:21:17.504243+0000","last_peered":"2024-04-19T02:21:17.504243+0000","last_clean":"2024-04-19T02:21:17.504243+0000","last_became_active":"2024-04-19T02:15:29.280479+0000","last_became_peered":"2024-04-19T02:15:29.280479+0000","last_unstale":"2024-04-19T02:21:17.504243+0000","last_undegraded":"2024-04-19T02:21:17.504243+0000","last_fullsized":"2024-04-19T02:21:17.504243+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:17.504211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:17.504211+0000","last_clean_scrub_stamp":"2024-04-19T02:21:17.504211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:09:32.572924+0000","scrub_duration":0.001817379,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.995053+0000","last_change":"2024-04-19T02:19:54.925277+0000","last_active":"2024-04-19T02:20:09.995053+0000","last_peered":"2024-04-19T02:20:09.995053+0000","last_clean":"2024-04-19T02:20:09.995053+0000","last_became_active":"2024-04-19T02:19:54.924484+0000","last_became_peered":"2024-04-19T02:19:54.924484+0000","last_unstale":"2024-04-19T02:20:09.995053+0000","last_undegraded":"2024-04-19T02:20:09.995053+0000","last_fullsized":"2024-04-19T02:20:09.995053+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.639795+0000","last_change":"2024-04-19T02:20:10.639077+0000","last_active":"2024-04-19T02:20:10.639795+0000","last_peered":"2024-04-19T02:20:10.639795+0000","last_clean":"2024-04-19T02:20:10.639795+0000","last_became_active":"2024-04-19T02:20:10.638737+0000","last_became_peered":"2024-04-19T02:20:10.638737+0000","last_unstale":"2024-04-19T02:20:10.639795+0000","last_undegraded":"2024-04-19T02:20:10.639795+0000","last_fullsized":"2024-04-19T02:20:10.639795+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:08.944585+0000","last_change":"2024-04-19T02:21:08.944722+0000","last_active":"2024-04-19T02:21:08.944585+0000","last_peered":"2024-04-19T02:21:08.944585+0000","last_clean":"2024-04-19T02:21:08.944585+0000","last_became_active":"2024-04-19T02:19:54.928398+0000","last_became_peered":"2024-04-19T02:19:54.928398+0000","last_unstale":"2024-04-19T02:21:08.944585+0000","last_undegraded":"2024-04-19T02:21:08.944585+0000","last_fullsized":"2024-04-19T02:21:08.944585+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:08.944563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:08.944563+0000","last_clean_scrub_stamp":"2024-04-19T02:21:08.944563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:16:16.242584+0000","scrub_duration":0.0016415690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:34.630146+0000","last_change":"2024-04-19T02:20:34.630281+0000","last_active":"2024-04-19T02:20:34.630146+0000","last_peered":"2024-04-19T02:20:34.630146+0000","last_clean":"2024-04-19T02:20:34.630146+0000","last_became_active":"2024-04-19T02:15:29.279314+0000","last_became_peered":"2024-04-19T02:15:29.279314+0000","last_unstale":"2024-04-19T02:20:34.630146+0000","last_undegraded":"2024-04-19T02:20:34.630146+0000","last_fullsized":"2024-04-19T02:20:34.630146+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:34.630122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:34.630122+0000","last_clean_scrub_stamp":"2024-04-19T02:20:34.630122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:19:42.256810+0000","scrub_duration":0.066969174000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:47.942738+0000","last_change":"2024-04-19T02:20:47.942846+0000","last_active":"2024-04-19T02:20:47.942738+0000","last_peered":"2024-04-19T02:20:47.942738+0000","last_clean":"2024-04-19T02:20:47.942738+0000","last_became_active":"2024-04-19T02:19:54.925729+0000","last_became_peered":"2024-04-19T02:19:54.925729+0000","last_unstale":"2024-04-19T02:20:47.942738+0000","last_undegraded":"2024-04-19T02:20:47.942738+0000","last_fullsized":"2024-04-19T02:20:47.942738+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:47.942715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:47.942715+0000","last_clean_scrub_stamp":"2024-04-19T02:20:47.942715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:53:52.743256+0000","scrub_duration":0.001689886,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:15.993647+0000","last_change":"2024-04-19T02:21:15.993771+0000","last_active":"2024-04-19T02:21:15.993647+0000","last_peered":"2024-04-19T02:21:15.993647+0000","last_clean":"2024-04-19T02:21:15.993647+0000","last_became_active":"2024-04-19T02:19:54.927666+0000","last_became_peered":"2024-04-19T02:19:54.927666+0000","last_unstale":"2024-04-19T02:21:15.993647+0000","last_undegraded":"2024-04-19T02:21:15.993647+0000","last_fullsized":"2024-04-19T02:21:15.993647+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:15.993623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:15.993623+0000","last_clean_scrub_stamp":"2024-04-19T02:21:15.993623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:45.212212+0000","scrub_duration":0.0019736129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":105,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:05.779304+0000","last_change":"2024-04-19T02:21:05.779445+0000","last_active":"2024-04-19T02:21:05.779304+0000","last_peered":"2024-04-19T02:21:05.779304+0000","last_clean":"2024-04-19T02:21:05.779304+0000","last_became_active":"2024-04-19T02:19:54.931540+0000","last_became_peered":"2024-04-19T02:19:54.931540+0000","last_unstale":"2024-04-19T02:21:05.779304+0000","last_undegraded":"2024-04-19T02:21:05.779304+0000","last_fullsized":"2024-04-19T02:21:05.779304+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:05.779268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:05.779268+0000","last_clean_scrub_stamp":"2024-04-19T02:21:05.779268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:40:53.826444+0000","scrub_duration":0.0018519179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:24.906406+0000","last_change":"2024-04-19T02:20:24.906512+0000","last_active":"2024-04-19T02:20:24.906406+0000","last_peered":"2024-04-19T02:20:24.906406+0000","last_clean":"2024-04-19T02:20:24.906406+0000","last_became_active":"2024-04-19T02:19:54.923784+0000","last_became_peered":"2024-04-19T02:19:54.923784+0000","last_unstale":"2024-04-19T02:20:24.906406+0000","last_undegraded":"2024-04-19T02:20:24.906406+0000","last_fullsized":"2024-04-19T02:20:24.906406+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:24.906368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:24.906368+0000","last_clean_scrub_stamp":"2024-04-19T02:20:24.906368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:16:17.186228+0000","scrub_duration":0.0016771609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":83,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:20.499067+0000","last_change":"2024-04-19T02:15:28.892937+0000","last_active":"2024-04-19T02:20:20.499067+0000","last_peered":"2024-04-19T02:20:20.499067+0000","last_clean":"2024-04-19T02:20:20.499067+0000","last_became_active":"2024-04-19T02:15:28.891440+0000","last_became_peered":"2024-04-19T02:15:28.891440+0000","last_unstale":"2024-04-19T02:20:20.499067+0000","last_undegraded":"2024-04-19T02:20:20.499067+0000","last_fullsized":"2024-04-19T02:20:20.499067+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:10.974515+0000","last_change":"2024-04-19T02:21:10.974630+0000","last_active":"2024-04-19T02:21:10.974515+0000","last_peered":"2024-04-19T02:21:10.974515+0000","last_clean":"2024-04-19T02:21:10.974515+0000","last_became_active":"2024-04-19T02:19:54.923493+0000","last_became_peered":"2024-04-19T02:19:54.923493+0000","last_unstale":"2024-04-19T02:21:10.974515+0000","last_undegraded":"2024-04-19T02:21:10.974515+0000","last_fullsized":"2024-04-19T02:21:10.974515+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:10.974492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:10.974492+0000","last_clean_scrub_stamp":"2024-04-19T02:21:10.974492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:17:16.098605+0000","scrub_duration":0.0017195929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":87,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:12.907134+0000","last_change":"2024-04-19T02:15:28.891097+0000","last_active":"2024-04-19T02:20:12.907134+0000","last_peered":"2024-04-19T02:20:12.907134+0000","last_clean":"2024-04-19T02:20:12.907134+0000","last_became_active":"2024-04-19T02:15:28.890795+0000","last_became_peered":"2024-04-19T02:15:28.890795+0000","last_unstale":"2024-04-19T02:20:12.907134+0000","last_undegraded":"2024-04-19T02:20:12.907134+0000","last_fullsized":"2024-04-19T02:20:12.907134+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:59.594482+0000","last_change":"2024-04-19T02:20:59.594635+0000","last_active":"2024-04-19T02:20:59.594482+0000","last_peered":"2024-04-19T02:20:59.594482+0000","last_clean":"2024-04-19T02:20:59.594482+0000","last_became_active":"2024-04-19T02:15:29.277547+0000","last_became_peered":"2024-04-19T02:15:29.277547+0000","last_unstale":"2024-04-19T02:20:59.594482+0000","last_undegraded":"2024-04-19T02:20:59.594482+0000","last_fullsized":"2024-04-19T02:20:59.594482+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:59.594458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:59.594458+0000","last_clean_scrub_stamp":"2024-04-19T02:20:59.594458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:20:46.257524+0000","scrub_duration":0.001831102,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"82'4","reported_seq":109,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:54.609805+0000","last_change":"2024-04-19T02:20:54.609979+0000","last_active":"2024-04-19T02:20:54.609805+0000","last_peered":"2024-04-19T02:20:54.609805+0000","last_clean":"2024-04-19T02:20:54.609805+0000","last_became_active":"2024-04-19T02:19:54.932829+0000","last_became_peered":"2024-04-19T02:19:54.932829+0000","last_unstale":"2024-04-19T02:20:54.609805+0000","last_undegraded":"2024-04-19T02:20:54.609805+0000","last_fullsized":"2024-04-19T02:20:54.609805+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'4","last_scrub_stamp":"2024-04-19T02:20:54.609763+0000","last_deep_scrub":"82'4","last_deep_scrub_stamp":"2024-04-19T02:20:54.609763+0000","last_clean_scrub_stamp":"2024-04-19T02:20:54.609763+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:53:50.278165+0000","scrub_duration":0.0044989499999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:12.873826+0000","last_change":"2024-04-19T02:20:07.983368+0000","last_active":"2024-04-19T02:20:12.873826+0000","last_peered":"2024-04-19T02:20:12.873826+0000","last_clean":"2024-04-19T02:20:12.873826+0000","last_became_active":"2024-04-19T02:20:07.983080+0000","last_became_peered":"2024-04-19T02:20:07.983080+0000","last_unstale":"2024-04-19T02:20:12.873826+0000","last_undegraded":"2024-04-19T02:20:12.873826+0000","last_fullsized":"2024-04-19T02:20:12.873826+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.995252+0000","last_change":"2024-04-19T02:19:54.927323+0000","last_active":"2024-04-19T02:20:09.995252+0000","last_peered":"2024-04-19T02:20:09.995252+0000","last_clean":"2024-04-19T02:20:09.995252+0000","last_became_active":"2024-04-19T02:19:54.925703+0000","last_became_peered":"2024-04-19T02:19:54.925703+0000","last_unstale":"2024-04-19T02:20:09.995252+0000","last_undegraded":"2024-04-19T02:20:09.995252+0000","last_fullsized":"2024-04-19T02:20:09.995252+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":57,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:20.499286+0000","last_change":"2024-04-19T02:19:54.925918+0000","last_active":"2024-04-19T02:20:20.499286+0000","last_peered":"2024-04-19T02:20:20.499286+0000","last_clean":"2024-04-19T02:20:20.499286+0000","last_became_active":"2024-04-19T02:19:54.925634+0000","last_became_peered":"2024-04-19T02:19:54.925634+0000","last_unstale":"2024-04-19T02:20:20.499286+0000","last_undegraded":"2024-04-19T02:20:20.499286+0000","last_fullsized":"2024-04-19T02:20:20.499286+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":80,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.997791+0000","last_change":"2024-04-19T02:15:28.892934+0000","last_active":"2024-04-19T02:20:09.997791+0000","last_peered":"2024-04-19T02:20:09.997791+0000","last_clean":"2024-04-19T02:20:09.997791+0000","last_became_active":"2024-04-19T02:15:28.891879+0000","last_became_peered":"2024-04-19T02:15:28.891879+0000","last_unstale":"2024-04-19T02:20:09.997791+0000","last_undegraded":"2024-04-19T02:20:09.997791+0000","last_fullsized":"2024-04-19T02:20:09.997791+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.639813+0000","last_change":"2024-04-19T02:20:10.639094+0000","last_active":"2024-04-19T02:20:10.639813+0000","last_peered":"2024-04-19T02:20:10.639813+0000","last_clean":"2024-04-19T02:20:10.639813+0000","last_became_active":"2024-04-19T02:20:10.638755+0000","last_became_peered":"2024-04-19T02:20:10.638755+0000","last_unstale":"2024-04-19T02:20:10.639813+0000","last_undegraded":"2024-04-19T02:20:10.639813+0000","last_fullsized":"2024-04-19T02:20:10.639813+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":89,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637328+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:20:10.637328+0000","last_peered":"2024-04-19T02:20:10.637328+0000","last_clean":"2024-04-19T02:20:10.637328+0000","last_became_active":"2024-04-19T02:15:28.890882+0000","last_became_peered":"2024-04-19T02:15:28.890882+0000","last_unstale":"2024-04-19T02:20:10.637328+0000","last_undegraded":"2024-04-19T02:20:10.637328+0000","last_fullsized":"2024-04-19T02:20:10.637328+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:54.023457+0000","last_change":"2024-04-19T02:20:54.023600+0000","last_active":"2024-04-19T02:20:54.023457+0000","last_peered":"2024-04-19T02:20:54.023457+0000","last_clean":"2024-04-19T02:20:54.023457+0000","last_became_active":"2024-04-19T02:19:54.925121+0000","last_became_peered":"2024-04-19T02:19:54.925121+0000","last_unstale":"2024-04-19T02:20:54.023457+0000","last_undegraded":"2024-04-19T02:20:54.023457+0000","last_fullsized":"2024-04-19T02:20:54.023457+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:54.023433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:54.023433+0000","last_clean_scrub_stamp":"2024-04-19T02:20:54.023433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:02:43.764667+0000","scrub_duration":0.053810324999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"82'2","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:08.799687+0000","last_change":"2024-04-19T02:21:08.799794+0000","last_active":"2024-04-19T02:21:08.799687+0000","last_peered":"2024-04-19T02:21:08.799687+0000","last_clean":"2024-04-19T02:21:08.799687+0000","last_became_active":"2024-04-19T02:15:28.890004+0000","last_became_peered":"2024-04-19T02:15:28.890004+0000","last_unstale":"2024-04-19T02:21:08.799687+0000","last_undegraded":"2024-04-19T02:21:08.799687+0000","last_fullsized":"2024-04-19T02:21:08.799687+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-19T02:21:08.799663+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-19T02:21:08.799663+0000","last_clean_scrub_stamp":"2024-04-19T02:21:08.799663+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:23:57.962043+0000","scrub_duration":0.0033993159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:37.549179+0000","last_change":"2024-04-19T02:20:37.549289+0000","last_active":"2024-04-19T02:20:37.549179+0000","last_peered":"2024-04-19T02:20:37.549179+0000","last_clean":"2024-04-19T02:20:37.549179+0000","last_became_active":"2024-04-19T02:15:29.285197+0000","last_became_peered":"2024-04-19T02:15:29.285197+0000","last_unstale":"2024-04-19T02:20:37.549179+0000","last_undegraded":"2024-04-19T02:20:37.549179+0000","last_fullsized":"2024-04-19T02:20:37.549179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:37.549154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:37.549154+0000","last_clean_scrub_stamp":"2024-04-19T02:20:37.549154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:18:16.168949+0000","scrub_duration":0.0014928389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":82,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.998356+0000","last_change":"2024-04-19T02:15:28.893902+0000","last_active":"2024-04-19T02:20:09.998356+0000","last_peered":"2024-04-19T02:20:09.998356+0000","last_clean":"2024-04-19T02:20:09.998356+0000","last_became_active":"2024-04-19T02:15:28.893231+0000","last_became_peered":"2024-04-19T02:15:28.893231+0000","last_unstale":"2024-04-19T02:20:09.998356+0000","last_undegraded":"2024-04-19T02:20:09.998356+0000","last_fullsized":"2024-04-19T02:20:09.998356+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":103,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:49.727333+0000","last_change":"2024-04-19T02:20:49.727441+0000","last_active":"2024-04-19T02:20:49.727333+0000","last_peered":"2024-04-19T02:20:49.727333+0000","last_clean":"2024-04-19T02:20:49.727333+0000","last_became_active":"2024-04-19T02:19:54.925502+0000","last_became_peered":"2024-04-19T02:19:54.925502+0000","last_unstale":"2024-04-19T02:20:49.727333+0000","last_undegraded":"2024-04-19T02:20:49.727333+0000","last_fullsized":"2024-04-19T02:20:49.727333+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:49.727309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:49.727309+0000","last_clean_scrub_stamp":"2024-04-19T02:20:49.727309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:34:41.219108+0000","scrub_duration":0.002043497,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"82'2","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:12.770179+0000","last_change":"2024-04-19T02:21:12.770278+0000","last_active":"2024-04-19T02:21:12.770179+0000","last_peered":"2024-04-19T02:21:12.770179+0000","last_clean":"2024-04-19T02:21:12.770179+0000","last_became_active":"2024-04-19T02:15:28.890881+0000","last_became_peered":"2024-04-19T02:15:28.890881+0000","last_unstale":"2024-04-19T02:21:12.770179+0000","last_undegraded":"2024-04-19T02:21:12.770179+0000","last_fullsized":"2024-04-19T02:21:12.770179+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-19T02:21:12.770155+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-19T02:21:12.770155+0000","last_clean_scrub_stamp":"2024-04-19T02:21:12.770155+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:56:59.212815+0000","scrub_duration":0.00314285,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637139+0000","last_change":"2024-04-19T02:19:54.926103+0000","last_active":"2024-04-19T02:20:10.637139+0000","last_peered":"2024-04-19T02:20:10.637139+0000","last_clean":"2024-04-19T02:20:10.637139+0000","last_became_active":"2024-04-19T02:19:54.925591+0000","last_became_peered":"2024-04-19T02:19:54.925591+0000","last_unstale":"2024-04-19T02:20:10.637139+0000","last_undegraded":"2024-04-19T02:20:10.637139+0000","last_fullsized":"2024-04-19T02:20:10.637139+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":105,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.627379+0000","last_change":"2024-04-19T02:21:00.627484+0000","last_active":"2024-04-19T02:21:00.627379+0000","last_peered":"2024-04-19T02:21:00.627379+0000","last_clean":"2024-04-19T02:21:00.627379+0000","last_became_active":"2024-04-19T02:19:54.925523+0000","last_became_peered":"2024-04-19T02:19:54.925523+0000","last_unstale":"2024-04-19T02:21:00.627379+0000","last_undegraded":"2024-04-19T02:21:00.627379+0000","last_fullsized":"2024-04-19T02:21:00.627379+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:00.627355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:00.627355+0000","last_clean_scrub_stamp":"2024-04-19T02:21:00.627355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:39.950387+0000","scrub_duration":0.0016425540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:31.927807+0000","last_change":"2024-04-19T02:20:31.927940+0000","last_active":"2024-04-19T02:20:31.927807+0000","last_peered":"2024-04-19T02:20:31.927807+0000","last_clean":"2024-04-19T02:20:31.927807+0000","last_became_active":"2024-04-19T02:19:54.930843+0000","last_became_peered":"2024-04-19T02:19:54.930843+0000","last_unstale":"2024-04-19T02:20:31.927807+0000","last_undegraded":"2024-04-19T02:20:31.927807+0000","last_fullsized":"2024-04-19T02:20:31.927807+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:31.927783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:31.927783+0000","last_clean_scrub_stamp":"2024-04-19T02:20:31.927783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:16.149096+0000","scrub_duration":0.037287204999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.995805+0000","last_change":"2024-04-19T02:19:54.932708+0000","last_active":"2024-04-19T02:20:09.995805+0000","last_peered":"2024-04-19T02:20:09.995805+0000","last_clean":"2024-04-19T02:20:09.995805+0000","last_became_active":"2024-04-19T02:19:54.931553+0000","last_became_peered":"2024-04-19T02:19:54.931553+0000","last_unstale":"2024-04-19T02:20:09.995805+0000","last_undegraded":"2024-04-19T02:20:09.995805+0000","last_fullsized":"2024-04-19T02:20:09.995805+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:07.840808+0000","last_change":"2024-04-19T02:21:07.840904+0000","last_active":"2024-04-19T02:21:07.840808+0000","last_peered":"2024-04-19T02:21:07.840808+0000","last_clean":"2024-04-19T02:21:07.840808+0000","last_became_active":"2024-04-19T02:19:54.925645+0000","last_became_peered":"2024-04-19T02:19:54.925645+0000","last_unstale":"2024-04-19T02:21:07.840808+0000","last_undegraded":"2024-04-19T02:21:07.840808+0000","last_fullsized":"2024-04-19T02:21:07.840808+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:07.840784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:07.840784+0000","last_clean_scrub_stamp":"2024-04-19T02:21:07.840784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:56:35.438495+0000","scrub_duration":0.0018420279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637005+0000","last_change":"2024-04-19T02:19:54.923689+0000","last_active":"2024-04-19T02:20:10.637005+0000","last_peered":"2024-04-19T02:20:10.637005+0000","last_clean":"2024-04-19T02:20:10.637005+0000","last_became_active":"2024-04-19T02:19:54.923321+0000","last_became_peered":"2024-04-19T02:19:54.923321+0000","last_unstale":"2024-04-19T02:20:10.637005+0000","last_undegraded":"2024-04-19T02:20:10.637005+0000","last_fullsized":"2024-04-19T02:20:10.637005+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:04.743415+0000","last_change":"2024-04-19T02:21:04.743533+0000","last_active":"2024-04-19T02:21:04.743415+0000","last_peered":"2024-04-19T02:21:04.743415+0000","last_clean":"2024-04-19T02:21:04.743415+0000","last_became_active":"2024-04-19T02:15:29.284650+0000","last_became_peered":"2024-04-19T02:15:29.284650+0000","last_unstale":"2024-04-19T02:21:04.743415+0000","last_undegraded":"2024-04-19T02:21:04.743415+0000","last_fullsized":"2024-04-19T02:21:04.743415+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:04.743381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:04.743381+0000","last_clean_scrub_stamp":"2024-04-19T02:21:04.743381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:15:36.123544+0000","scrub_duration":0.0019252679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.997742+0000","last_change":"2024-04-19T02:20:08.662566+0000","last_active":"2024-04-19T02:20:09.997742+0000","last_peered":"2024-04-19T02:20:09.997742+0000","last_clean":"2024-04-19T02:20:09.997742+0000","last_became_active":"2024-04-19T02:20:08.662277+0000","last_became_peered":"2024-04-19T02:20:08.662277+0000","last_unstale":"2024-04-19T02:20:09.997742+0000","last_undegraded":"2024-04-19T02:20:09.997742+0000","last_fullsized":"2024-04-19T02:20:09.997742+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:11.802147+0000","last_change":"2024-04-19T02:21:11.802259+0000","last_active":"2024-04-19T02:21:11.802147+0000","last_peered":"2024-04-19T02:21:11.802147+0000","last_clean":"2024-04-19T02:21:11.802147+0000","last_became_active":"2024-04-19T02:15:29.286606+0000","last_became_peered":"2024-04-19T02:15:29.286606+0000","last_unstale":"2024-04-19T02:21:11.802147+0000","last_undegraded":"2024-04-19T02:21:11.802147+0000","last_fullsized":"2024-04-19T02:21:11.802147+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:11.802122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:11.802122+0000","last_clean_scrub_stamp":"2024-04-19T02:21:11.802122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:42.177826+0000","scrub_duration":0.001592062,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.997446+0000","last_change":"2024-04-19T02:19:54.928493+0000","last_active":"2024-04-19T02:20:09.997446+0000","last_peered":"2024-04-19T02:20:09.997446+0000","last_clean":"2024-04-19T02:20:09.997446+0000","last_became_active":"2024-04-19T02:19:54.928298+0000","last_became_peered":"2024-04-19T02:19:54.928298+0000","last_unstale":"2024-04-19T02:20:09.997446+0000","last_undegraded":"2024-04-19T02:20:09.997446+0000","last_fullsized":"2024-04-19T02:20:09.997446+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:27.963130+0000","last_change":"2024-04-19T02:20:27.963259+0000","last_active":"2024-04-19T02:20:27.963130+0000","last_peered":"2024-04-19T02:20:27.963130+0000","last_clean":"2024-04-19T02:20:27.963130+0000","last_became_active":"2024-04-19T02:19:54.927309+0000","last_became_peered":"2024-04-19T02:19:54.927309+0000","last_unstale":"2024-04-19T02:20:27.963130+0000","last_undegraded":"2024-04-19T02:20:27.963130+0000","last_fullsized":"2024-04-19T02:20:27.963130+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:27.963106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:27.963106+0000","last_clean_scrub_stamp":"2024-04-19T02:20:27.963106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:35:23.138484+0000","scrub_duration":0.070564934999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.999545+0000","last_change":"2024-04-19T02:20:09.998998+0000","last_active":"2024-04-19T02:20:09.999545+0000","last_peered":"2024-04-19T02:20:09.999545+0000","last_clean":"2024-04-19T02:20:09.999545+0000","last_became_active":"2024-04-19T02:20:09.998776+0000","last_became_peered":"2024-04-19T02:20:09.998776+0000","last_unstale":"2024-04-19T02:20:09.999545+0000","last_undegraded":"2024-04-19T02:20:09.999545+0000","last_fullsized":"2024-04-19T02:20:09.999545+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":105,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:02.676393+0000","last_change":"2024-04-19T02:21:02.676488+0000","last_active":"2024-04-19T02:21:02.676393+0000","last_peered":"2024-04-19T02:21:02.676393+0000","last_clean":"2024-04-19T02:21:02.676393+0000","last_became_active":"2024-04-19T02:19:54.925872+0000","last_became_peered":"2024-04-19T02:19:54.925872+0000","last_unstale":"2024-04-19T02:21:02.676393+0000","last_undegraded":"2024-04-19T02:21:02.676393+0000","last_fullsized":"2024-04-19T02:21:02.676393+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:02.676368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:02.676368+0000","last_clean_scrub_stamp":"2024-04-19T02:21:02.676368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:30:23.676866+0000","scrub_duration":0.001635245,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.514809+0000","last_change":"2024-04-19T02:20:33.514910+0000","last_active":"2024-04-19T02:20:33.514809+0000","last_peered":"2024-04-19T02:20:33.514809+0000","last_clean":"2024-04-19T02:20:33.514809+0000","last_became_active":"2024-04-19T02:15:29.276968+0000","last_became_peered":"2024-04-19T02:15:29.276968+0000","last_unstale":"2024-04-19T02:20:33.514809+0000","last_undegraded":"2024-04-19T02:20:33.514809+0000","last_fullsized":"2024-04-19T02:20:33.514809+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:33.514784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:33.514784+0000","last_clean_scrub_stamp":"2024-04-19T02:20:33.514784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:01:55.933306+0000","scrub_duration":0.0019782179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":97,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637320+0000","last_change":"2024-04-19T02:19:54.927361+0000","last_active":"2024-04-19T02:20:10.637320+0000","last_peered":"2024-04-19T02:20:10.637320+0000","last_clean":"2024-04-19T02:20:10.637320+0000","last_became_active":"2024-04-19T02:19:54.927033+0000","last_became_peered":"2024-04-19T02:19:54.927033+0000","last_unstale":"2024-04-19T02:20:10.637320+0000","last_undegraded":"2024-04-19T02:20:10.637320+0000","last_fullsized":"2024-04-19T02:20:10.637320+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637470+0000","last_change":"2024-04-19T02:19:54.932790+0000","last_active":"2024-04-19T02:20:10.637470+0000","last_peered":"2024-04-19T02:20:10.637470+0000","last_clean":"2024-04-19T02:20:10.637470+0000","last_became_active":"2024-04-19T02:19:54.931683+0000","last_became_peered":"2024-04-19T02:19:54.931683+0000","last_unstale":"2024-04-19T02:20:10.637470+0000","last_undegraded":"2024-04-19T02:20:10.637470+0000","last_fullsized":"2024-04-19T02:20:10.637470+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:37.784585+0000","last_change":"2024-04-19T02:20:37.784722+0000","last_active":"2024-04-19T02:20:37.784585+0000","last_peered":"2024-04-19T02:20:37.784585+0000","last_clean":"2024-04-19T02:20:37.784585+0000","last_became_active":"2024-04-19T02:19:54.924686+0000","last_became_peered":"2024-04-19T02:19:54.924686+0000","last_unstale":"2024-04-19T02:20:37.784585+0000","last_undegraded":"2024-04-19T02:20:37.784585+0000","last_fullsized":"2024-04-19T02:20:37.784585+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:37.784561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:37.784561+0000","last_clean_scrub_stamp":"2024-04-19T02:20:37.784561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:26:44.108152+0000","scrub_duration":0.0013845000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:51.933270+0000","last_change":"2024-04-19T02:20:51.933365+0000","last_active":"2024-04-19T02:20:51.933270+0000","last_peered":"2024-04-19T02:20:51.933270+0000","last_clean":"2024-04-19T02:20:51.933270+0000","last_became_active":"2024-04-19T02:19:54.923164+0000","last_became_peered":"2024-04-19T02:19:54.923164+0000","last_unstale":"2024-04-19T02:20:51.933270+0000","last_undegraded":"2024-04-19T02:20:51.933270+0000","last_fullsized":"2024-04-19T02:20:51.933270+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:51.933246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:51.933246+0000","last_clean_scrub_stamp":"2024-04-19T02:20:51.933246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:39:21.609447+0000","scrub_duration":0.0015936590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.997425+0000","last_change":"2024-04-19T02:20:08.662301+0000","last_active":"2024-04-19T02:20:09.997425+0000","last_peered":"2024-04-19T02:20:09.997425+0000","last_clean":"2024-04-19T02:20:09.997425+0000","last_became_active":"2024-04-19T02:20:08.661952+0000","last_became_peered":"2024-04-19T02:20:08.661952+0000","last_unstale":"2024-04-19T02:20:09.997425+0000","last_undegraded":"2024-04-19T02:20:09.997425+0000","last_fullsized":"2024-04-19T02:20:09.997425+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:28.899614+0000","last_change":"2024-04-19T02:20:28.899746+0000","last_active":"2024-04-19T02:20:28.899614+0000","last_peered":"2024-04-19T02:20:28.899614+0000","last_clean":"2024-04-19T02:20:28.899614+0000","last_became_active":"2024-04-19T02:19:54.926463+0000","last_became_peered":"2024-04-19T02:19:54.926463+0000","last_unstale":"2024-04-19T02:20:28.899614+0000","last_undegraded":"2024-04-19T02:20:28.899614+0000","last_fullsized":"2024-04-19T02:20:28.899614+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:28.899588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:28.899588+0000","last_clean_scrub_stamp":"2024-04-19T02:20:28.899588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:34:50.323413+0000","scrub_duration":0.038469191,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":97,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637446+0000","last_change":"2024-04-19T02:19:54.932929+0000","last_active":"2024-04-19T02:20:10.637446+0000","last_peered":"2024-04-19T02:20:10.637446+0000","last_clean":"2024-04-19T02:20:10.637446+0000","last_became_active":"2024-04-19T02:19:54.932571+0000","last_became_peered":"2024-04-19T02:19:54.932571+0000","last_unstale":"2024-04-19T02:20:10.637446+0000","last_undegraded":"2024-04-19T02:20:10.637446+0000","last_fullsized":"2024-04-19T02:20:10.637446+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":280,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637133+0000","last_change":"2024-04-19T02:15:24.533634+0000","last_active":"2024-04-19T02:20:10.637133+0000","last_peered":"2024-04-19T02:20:10.637133+0000","last_clean":"2024-04-19T02:20:10.637133+0000","last_became_active":"2024-04-19T02:15:24.533420+0000","last_became_peered":"2024-04-19T02:15:24.533420+0000","last_unstale":"2024-04-19T02:20:10.637133+0000","last_undegraded":"2024-04-19T02:20:10.637133+0000","last_fullsized":"2024-04-19T02:20:10.637133+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":53,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:22.938802+0000","last_change":"2024-04-19T02:20:22.938906+0000","last_active":"2024-04-19T02:20:22.938802+0000","last_peered":"2024-04-19T02:20:22.938802+0000","last_clean":"2024-04-19T02:20:22.938802+0000","last_became_active":"2024-04-19T02:20:10.001415+0000","last_became_peered":"2024-04-19T02:20:10.001415+0000","last_unstale":"2024-04-19T02:20:22.938802+0000","last_undegraded":"2024-04-19T02:20:22.938802+0000","last_fullsized":"2024-04-19T02:20:22.938802+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:22.938775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:22.938775+0000","last_clean_scrub_stamp":"2024-04-19T02:20:22.938775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:30:51.144263+0000","scrub_duration":0.001921898,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:27.601296+0000","last_change":"2024-04-19T02:20:27.601464+0000","last_active":"2024-04-19T02:20:27.601296+0000","last_peered":"2024-04-19T02:20:27.601296+0000","last_clean":"2024-04-19T02:20:27.601296+0000","last_became_active":"2024-04-19T02:15:29.284164+0000","last_became_peered":"2024-04-19T02:15:29.284164+0000","last_unstale":"2024-04-19T02:20:27.601296+0000","last_undegraded":"2024-04-19T02:20:27.601296+0000","last_fullsized":"2024-04-19T02:20:27.601296+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:27.601255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:27.601255+0000","last_clean_scrub_stamp":"2024-04-19T02:20:27.601255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:45:08.158116+0000","scrub_duration":0.0020462050000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":84,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637203+0000","last_change":"2024-04-19T02:15:24.533912+0000","last_active":"2024-04-19T02:20:10.637203+0000","last_peered":"2024-04-19T02:20:10.637203+0000","last_clean":"2024-04-19T02:20:10.637203+0000","last_became_active":"2024-04-19T02:15:24.533580+0000","last_became_peered":"2024-04-19T02:15:24.533580+0000","last_unstale":"2024-04-19T02:20:10.637203+0000","last_undegraded":"2024-04-19T02:20:10.637203+0000","last_fullsized":"2024-04-19T02:20:10.637203+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":53,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:07.946347+0000","last_change":"2024-04-19T02:21:07.946484+0000","last_active":"2024-04-19T02:21:07.946347+0000","last_peered":"2024-04-19T02:21:07.946347+0000","last_clean":"2024-04-19T02:21:07.946347+0000","last_became_active":"2024-04-19T02:20:10.638966+0000","last_became_peered":"2024-04-19T02:20:10.638966+0000","last_unstale":"2024-04-19T02:21:07.946347+0000","last_undegraded":"2024-04-19T02:21:07.946347+0000","last_fullsized":"2024-04-19T02:21:07.946347+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:07.946312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:07.946312+0000","last_clean_scrub_stamp":"2024-04-19T02:21:07.946312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:34:25.503097+0000","scrub_duration":0.001569176,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.998577+0000","last_change":"2024-04-19T02:20:07.986363+0000","last_active":"2024-04-19T02:20:09.998577+0000","last_peered":"2024-04-19T02:20:09.998577+0000","last_clean":"2024-04-19T02:20:09.998577+0000","last_became_active":"2024-04-19T02:20:07.986110+0000","last_became_peered":"2024-04-19T02:20:07.986110+0000","last_unstale":"2024-04-19T02:20:09.998577+0000","last_undegraded":"2024-04-19T02:20:09.998577+0000","last_fullsized":"2024-04-19T02:20:09.998577+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":61,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.998413+0000","last_change":"2024-04-19T02:19:54.925886+0000","last_active":"2024-04-19T02:20:09.998413+0000","last_peered":"2024-04-19T02:20:09.998413+0000","last_clean":"2024-04-19T02:20:09.998413+0000","last_became_active":"2024-04-19T02:19:54.925570+0000","last_became_peered":"2024-04-19T02:19:54.925570+0000","last_unstale":"2024-04-19T02:20:09.998413+0000","last_undegraded":"2024-04-19T02:20:09.998413+0000","last_fullsized":"2024-04-19T02:20:09.998413+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.996111+0000","last_change":"2024-04-19T02:19:54.933960+0000","last_active":"2024-04-19T02:20:09.996111+0000","last_peered":"2024-04-19T02:20:09.996111+0000","last_clean":"2024-04-19T02:20:09.996111+0000","last_became_active":"2024-04-19T02:19:54.929918+0000","last_became_peered":"2024-04-19T02:19:54.929918+0000","last_unstale":"2024-04-19T02:20:09.996111+0000","last_undegraded":"2024-04-19T02:20:09.996111+0000","last_fullsized":"2024-04-19T02:20:09.996111+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":79,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.997668+0000","last_change":"2024-04-19T02:15:29.281694+0000","last_active":"2024-04-19T02:20:09.997668+0000","last_peered":"2024-04-19T02:20:09.997668+0000","last_clean":"2024-04-19T02:20:09.997668+0000","last_became_active":"2024-04-19T02:15:29.280519+0000","last_became_peered":"2024-04-19T02:15:29.280519+0000","last_unstale":"2024-04-19T02:20:09.997668+0000","last_undegraded":"2024-04-19T02:20:09.997668+0000","last_fullsized":"2024-04-19T02:20:09.997668+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.996465+0000","last_change":"2024-04-19T02:19:54.931726+0000","last_active":"2024-04-19T02:20:09.996465+0000","last_peered":"2024-04-19T02:20:09.996465+0000","last_clean":"2024-04-19T02:20:09.996465+0000","last_became_active":"2024-04-19T02:19:54.928460+0000","last_became_peered":"2024-04-19T02:19:54.928460+0000","last_unstale":"2024-04-19T02:20:09.996465+0000","last_undegraded":"2024-04-19T02:20:09.996465+0000","last_fullsized":"2024-04-19T02:20:09.996465+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.999540+0000","last_change":"2024-04-19T02:20:09.998879+0000","last_active":"2024-04-19T02:20:09.999540+0000","last_peered":"2024-04-19T02:20:09.999540+0000","last_clean":"2024-04-19T02:20:09.999540+0000","last_became_active":"2024-04-19T02:20:09.998629+0000","last_became_peered":"2024-04-19T02:20:09.998629+0000","last_unstale":"2024-04-19T02:20:09.999540+0000","last_undegraded":"2024-04-19T02:20:09.999540+0000","last_fullsized":"2024-04-19T02:20:09.999540+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":53,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:04.937677+0000","last_change":"2024-04-19T02:21:04.937772+0000","last_active":"2024-04-19T02:21:04.937677+0000","last_peered":"2024-04-19T02:21:04.937677+0000","last_clean":"2024-04-19T02:21:04.937677+0000","last_became_active":"2024-04-19T02:20:10.638912+0000","last_became_peered":"2024-04-19T02:20:10.638912+0000","last_unstale":"2024-04-19T02:21:04.937677+0000","last_undegraded":"2024-04-19T02:21:04.937677+0000","last_fullsized":"2024-04-19T02:21:04.937677+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:04.937654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:04.937654+0000","last_clean_scrub_stamp":"2024-04-19T02:21:04.937654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:50:59.907567+0000","scrub_duration":0.001663454,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":84,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.638122+0000","last_change":"2024-04-19T02:15:24.533777+0000","last_active":"2024-04-19T02:20:10.638122+0000","last_peered":"2024-04-19T02:20:10.638122+0000","last_clean":"2024-04-19T02:20:10.638122+0000","last_became_active":"2024-04-19T02:15:24.533436+0000","last_became_peered":"2024-04-19T02:15:24.533436+0000","last_unstale":"2024-04-19T02:20:10.638122+0000","last_undegraded":"2024-04-19T02:20:10.638122+0000","last_fullsized":"2024-04-19T02:20:10.638122+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"82'2","reported_seq":46,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:44.865916+0000","last_change":"2024-04-19T02:20:44.866016+0000","last_active":"2024-04-19T02:20:44.865916+0000","last_peered":"2024-04-19T02:20:44.865916+0000","last_clean":"2024-04-19T02:20:44.865916+0000","last_became_active":"2024-04-19T02:19:54.931328+0000","last_became_peered":"2024-04-19T02:19:54.931328+0000","last_unstale":"2024-04-19T02:20:44.865916+0000","last_undegraded":"2024-04-19T02:20:44.865916+0000","last_fullsized":"2024-04-19T02:20:44.865916+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-19T02:20:44.865892+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-19T02:20:44.865892+0000","last_clean_scrub_stamp":"2024-04-19T02:20:44.865892+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:06:18.693677+0000","scrub_duration":0.00333659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:40.611417+0000","last_change":"2024-04-19T02:20:40.611536+0000","last_active":"2024-04-19T02:20:40.611417+0000","last_peered":"2024-04-19T02:20:40.611417+0000","last_clean":"2024-04-19T02:20:40.611417+0000","last_became_active":"2024-04-19T02:15:29.280366+0000","last_became_peered":"2024-04-19T02:15:29.280366+0000","last_unstale":"2024-04-19T02:20:40.611417+0000","last_undegraded":"2024-04-19T02:20:40.611417+0000","last_fullsized":"2024-04-19T02:20:40.611417+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:40.611392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:40.611392+0000","last_clean_scrub_stamp":"2024-04-19T02:20:40.611392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:35.395252+0000","scrub_duration":0.0015883539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:20.499156+0000","last_change":"2024-04-19T02:15:28.893027+0000","last_active":"2024-04-19T02:20:20.499156+0000","last_peered":"2024-04-19T02:20:20.499156+0000","last_clean":"2024-04-19T02:20:20.499156+0000","last_became_active":"2024-04-19T02:15:28.892695+0000","last_became_peered":"2024-04-19T02:15:28.892695+0000","last_unstale":"2024-04-19T02:20:20.499156+0000","last_undegraded":"2024-04-19T02:20:20.499156+0000","last_fullsized":"2024-04-19T02:20:20.499156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":103,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:42.629277+0000","last_change":"2024-04-19T02:20:42.629383+0000","last_active":"2024-04-19T02:20:42.629277+0000","last_peered":"2024-04-19T02:20:42.629277+0000","last_clean":"2024-04-19T02:20:42.629277+0000","last_became_active":"2024-04-19T02:19:54.929412+0000","last_became_peered":"2024-04-19T02:19:54.929412+0000","last_unstale":"2024-04-19T02:20:42.629277+0000","last_undegraded":"2024-04-19T02:20:42.629277+0000","last_fullsized":"2024-04-19T02:20:42.629277+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:42.629252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:42.629252+0000","last_clean_scrub_stamp":"2024-04-19T02:20:42.629252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:14.280965+0000","scrub_duration":0.0020287679999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"82'3","reported_seq":108,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.601787+0000","last_change":"2024-04-19T02:20:48.601893+0000","last_active":"2024-04-19T02:20:48.601787+0000","last_peered":"2024-04-19T02:20:48.601787+0000","last_clean":"2024-04-19T02:20:48.601787+0000","last_became_active":"2024-04-19T02:19:54.926630+0000","last_became_peered":"2024-04-19T02:19:54.926630+0000","last_unstale":"2024-04-19T02:20:48.601787+0000","last_undegraded":"2024-04-19T02:20:48.601787+0000","last_fullsized":"2024-04-19T02:20:48.601787+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-19T02:20:48.601762+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-19T02:20:48.601762+0000","last_clean_scrub_stamp":"2024-04-19T02:20:48.601762+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:28:54.715316+0000","scrub_duration":0.0034412739999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:23.628340+0000","last_change":"2024-04-19T02:20:23.628340+0000","last_active":"2024-04-19T02:20:23.628340+0000","last_peered":"2024-04-19T02:20:23.628340+0000","last_clean":"2024-04-19T02:20:23.628340+0000","last_became_active":"2024-04-19T02:19:54.931328+0000","last_became_peered":"2024-04-19T02:19:54.931328+0000","last_unstale":"2024-04-19T02:20:23.628340+0000","last_undegraded":"2024-04-19T02:20:23.628340+0000","last_fullsized":"2024-04-19T02:20:23.628340+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:23.628182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:23.628182+0000","last_clean_scrub_stamp":"2024-04-19T02:20:23.628182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:41:07.461430+0000","scrub_duration":0.042718649999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":82,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:20.499132+0000","last_change":"2024-04-19T02:15:28.893239+0000","last_active":"2024-04-19T02:20:20.499132+0000","last_peered":"2024-04-19T02:20:20.499132+0000","last_clean":"2024-04-19T02:20:20.499132+0000","last_became_active":"2024-04-19T02:15:28.892881+0000","last_became_peered":"2024-04-19T02:15:28.892881+0000","last_unstale":"2024-04-19T02:20:20.499132+0000","last_undegraded":"2024-04-19T02:20:20.499132+0000","last_fullsized":"2024-04-19T02:20:20.499132+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:21.614064+0000","last_change":"2024-04-19T02:20:21.614064+0000","last_active":"2024-04-19T02:20:21.614064+0000","last_peered":"2024-04-19T02:20:21.614064+0000","last_clean":"2024-04-19T02:20:21.614064+0000","last_became_active":"2024-04-19T02:19:54.923752+0000","last_became_peered":"2024-04-19T02:19:54.923752+0000","last_unstale":"2024-04-19T02:20:21.614064+0000","last_undegraded":"2024-04-19T02:20:21.614064+0000","last_fullsized":"2024-04-19T02:20:21.614064+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:21.613938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:21.613938+0000","last_clean_scrub_stamp":"2024-04-19T02:20:21.613938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:28:11.041024+0000","scrub_duration":0.0017798099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":43,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:06.947305+0000","last_change":"2024-04-19T02:21:06.947478+0000","last_active":"2024-04-19T02:21:06.947305+0000","last_peered":"2024-04-19T02:21:06.947305+0000","last_clean":"2024-04-19T02:21:06.947305+0000","last_became_active":"2024-04-19T02:19:54.932103+0000","last_became_peered":"2024-04-19T02:19:54.932103+0000","last_unstale":"2024-04-19T02:21:06.947305+0000","last_undegraded":"2024-04-19T02:21:06.947305+0000","last_fullsized":"2024-04-19T02:21:06.947305+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-19T02:21:06.947264+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-19T02:21:06.947264+0000","last_clean_scrub_stamp":"2024-04-19T02:21:06.947264+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:25:28.987258+0000","scrub_duration":0.001632035,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:20.499288+0000","last_change":"2024-04-19T02:19:54.925832+0000","last_active":"2024-04-19T02:20:20.499288+0000","last_peered":"2024-04-19T02:20:20.499288+0000","last_clean":"2024-04-19T02:20:20.499288+0000","last_became_active":"2024-04-19T02:19:54.925565+0000","last_became_peered":"2024-04-19T02:19:54.925565+0000","last_unstale":"2024-04-19T02:20:20.499288+0000","last_undegraded":"2024-04-19T02:20:20.499288+0000","last_fullsized":"2024-04-19T02:20:20.499288+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":45,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.977574+0000","last_change":"2024-04-19T02:21:00.977681+0000","last_active":"2024-04-19T02:21:00.977574+0000","last_peered":"2024-04-19T02:21:00.977574+0000","last_clean":"2024-04-19T02:21:00.977574+0000","last_became_active":"2024-04-19T02:19:54.926439+0000","last_became_peered":"2024-04-19T02:19:54.926439+0000","last_unstale":"2024-04-19T02:21:00.977574+0000","last_undegraded":"2024-04-19T02:21:00.977574+0000","last_fullsized":"2024-04-19T02:21:00.977574+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'6","last_scrub_stamp":"2024-04-19T02:21:00.977547+0000","last_deep_scrub":"82'6","last_deep_scrub_stamp":"2024-04-19T02:21:00.977547+0000","last_clean_scrub_stamp":"2024-04-19T02:21:00.977547+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:36:06.474124+0000","scrub_duration":0.0050912479999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:46.634857+0000","last_change":"2024-04-19T02:20:46.634995+0000","last_active":"2024-04-19T02:20:46.634857+0000","last_peered":"2024-04-19T02:20:46.634857+0000","last_clean":"2024-04-19T02:20:46.634857+0000","last_became_active":"2024-04-19T02:19:54.930665+0000","last_became_peered":"2024-04-19T02:19:54.930665+0000","last_unstale":"2024-04-19T02:20:46.634857+0000","last_undegraded":"2024-04-19T02:20:46.634857+0000","last_fullsized":"2024-04-19T02:20:46.634857+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:46.634833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:46.634833+0000","last_clean_scrub_stamp":"2024-04-19T02:20:46.634833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:58:28.047698+0000","scrub_duration":0.001963645,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:14.819754+0000","last_change":"2024-04-19T02:21:14.819858+0000","last_active":"2024-04-19T02:21:14.819754+0000","last_peered":"2024-04-19T02:21:14.819754+0000","last_clean":"2024-04-19T02:21:14.819754+0000","last_became_active":"2024-04-19T02:19:54.930527+0000","last_became_peered":"2024-04-19T02:19:54.930527+0000","last_unstale":"2024-04-19T02:21:14.819754+0000","last_undegraded":"2024-04-19T02:21:14.819754+0000","last_fullsized":"2024-04-19T02:21:14.819754+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:14.819731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:14.819731+0000","last_clean_scrub_stamp":"2024-04-19T02:21:14.819731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:24:42.325450+0000","scrub_duration":0.001789131,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.002363+0000","last_change":"2024-04-19T02:20:10.001589+0000","last_active":"2024-04-19T02:20:10.002363+0000","last_peered":"2024-04-19T02:20:10.002363+0000","last_clean":"2024-04-19T02:20:10.002363+0000","last_became_active":"2024-04-19T02:20:10.001304+0000","last_became_peered":"2024-04-19T02:20:10.001304+0000","last_unstale":"2024-04-19T02:20:10.002363+0000","last_undegraded":"2024-04-19T02:20:10.002363+0000","last_fullsized":"2024-04-19T02:20:10.002363+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.998017+0000","last_change":"2024-04-19T02:20:08.662331+0000","last_active":"2024-04-19T02:20:09.998017+0000","last_peered":"2024-04-19T02:20:09.998017+0000","last_clean":"2024-04-19T02:20:09.998017+0000","last_became_active":"2024-04-19T02:20:08.661996+0000","last_became_peered":"2024-04-19T02:20:08.661996+0000","last_unstale":"2024-04-19T02:20:09.998017+0000","last_undegraded":"2024-04-19T02:20:09.998017+0000","last_fullsized":"2024-04-19T02:20:09.998017+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.002397+0000","last_change":"2024-04-19T02:20:10.001706+0000","last_active":"2024-04-19T02:20:10.002397+0000","last_peered":"2024-04-19T02:20:10.002397+0000","last_clean":"2024-04-19T02:20:10.002397+0000","last_became_active":"2024-04-19T02:20:10.001372+0000","last_became_peered":"2024-04-19T02:20:10.001372+0000","last_unstale":"2024-04-19T02:20:10.002397+0000","last_undegraded":"2024-04-19T02:20:10.002397+0000","last_fullsized":"2024-04-19T02:20:10.002397+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":79,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.998319+0000","last_change":"2024-04-19T02:15:29.277568+0000","last_active":"2024-04-19T02:20:09.998319+0000","last_peered":"2024-04-19T02:20:09.998319+0000","last_clean":"2024-04-19T02:20:09.998319+0000","last_became_active":"2024-04-19T02:15:29.276725+0000","last_became_peered":"2024-04-19T02:15:29.276725+0000","last_unstale":"2024-04-19T02:20:09.998319+0000","last_undegraded":"2024-04-19T02:20:09.998319+0000","last_fullsized":"2024-04-19T02:20:09.998319+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5254,"internal_metadata":0},"log_size":47,"ondisk_log_size":47,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":72,"seq":309237645331,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58812,"kb_used_data":884,"kb_used_omap":6,"kb_used_meta":57913,"kb_avail":94313028,"statfs":{"total":96636764160,"available":96576540672,"internally_reserved":0,"allocated":905216,"data_stored":358135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6848,"internal_metadata":59303232},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:20:54 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.34799999999999998}]},{"osd":1,"last update":"Fri Apr 19 02:20:54 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.377}]}]},{"osd":0,"up_from":8,"seq":34359738443,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":275412,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":273918,"kb_avail":94096428,"statfs":{"total":96636764160,"available":96354742272,"internally_reserved":0,"allocated":1519616,"data_stored":948136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":280492486},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 02:20:28 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.40500000000000003,"15min":0.32700000000000001},"min":{"1min":0.30599999999999999,"5min":0.159,"15min":0.159},"max":{"1min":0.57599999999999996,"5min":4.4480000000000004,"15min":4.4480000000000004},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.39700000000000002,"15min":0.372},"min":{"1min":0.32600000000000001,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.59699999999999998,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.51400000000000001}]},{"osd":2,"last update":"Fri Apr 19 02:20:56 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.48199999999999998}]}]},{"osd":1,"up_from":8,"seq":34359738442,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307408,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":305918,"kb_avail":94064432,"statfs":{"total":96636764160,"available":96321978368,"internally_reserved":0,"allocated":1515520,"data_stored":949633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":313260486},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:20:31 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.432,"15min":0.38400000000000001},"min":{"1min":0.38700000000000001,"5min":0.157,"15min":0.157},"max":{"1min":0.65200000000000002,"5min":1.794,"15min":1.794},"last":0.499},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.41999999999999998,"15min":0.33700000000000002},"min":{"1min":0.41399999999999998,"5min":0.16,"15min":0.16},"max":{"1min":0.60399999999999998,"5min":2.411,"15min":2.411},"last":0.443}]},{"osd":2,"last update":"Fri Apr 19 02:20:54 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.46600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5254,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:21:22.464 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:22.465 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:22.465 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:22.465 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:22.465 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:22.465 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:22.465 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:22.465 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:22.466 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:22.466 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:22.466 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:22.466 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:22.466 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:22.466 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:22.466 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:22.466 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:22.467 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:22.467 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:22.467 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:22.467 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:22.467 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:22.467 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:22.467 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:22.467 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:22.467 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:22.468 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:22.468 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:22.469 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:22.471 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-19T02:15:23.520722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:22.471 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-19T02:15:23.520722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:22.471 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:22.471 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:22.471 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-19T02:15:23.520722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:22.471 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-19T02:15:23.520722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:22.471 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-19T02:15:23.520722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:22.471 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:22.472 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-19T02:15:23.520722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:22.472 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:22.472 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:22.472 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:22.472 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-19T02:15:23.520722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:22.472 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-19T02:15:23.520722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:22.472 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:22.473 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:22.473 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:22.473 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:22.474 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:22.474 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:22.474 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:22.474 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-19T02:21:42.475 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:21:42.817 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:21:42.819 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-04-19T02:21:42.828 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":267,"stamp":"2024-04-19T02:21:40.834818+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":212,"ondisk_log_size":212,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":641632,"kb_used_data":3848,"kb_used_omap":9,"kb_used_meta":637750,"kb_avail":282473888,"statfs":{"total":289910292480,"available":289253261312,"internally_reserved":0,"allocated":3940352,"data_stored":2255904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10036,"internal_metadata":653056204},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003523"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":103,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:44.754058+0000","last_change":"2024-04-19T02:20:44.754184+0000","last_active":"2024-04-19T02:20:44.754058+0000","last_peered":"2024-04-19T02:20:44.754058+0000","last_clean":"2024-04-19T02:20:44.754058+0000","last_became_active":"2024-04-19T02:19:54.929435+0000","last_became_peered":"2024-04-19T02:19:54.929435+0000","last_unstale":"2024-04-19T02:20:44.754058+0000","last_undegraded":"2024-04-19T02:20:44.754058+0000","last_fullsized":"2024-04-19T02:20:44.754058+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:44.754035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:44.754035+0000","last_clean_scrub_stamp":"2024-04-19T02:20:44.754035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:46:01.301053+0000","scrub_duration":0.089914654999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":103,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:52.728883+0000","last_change":"2024-04-19T02:20:52.728989+0000","last_active":"2024-04-19T02:20:52.728883+0000","last_peered":"2024-04-19T02:20:52.728883+0000","last_clean":"2024-04-19T02:20:52.728883+0000","last_became_active":"2024-04-19T02:19:54.931278+0000","last_became_peered":"2024-04-19T02:19:54.931278+0000","last_unstale":"2024-04-19T02:20:52.728883+0000","last_undegraded":"2024-04-19T02:20:52.728883+0000","last_fullsized":"2024-04-19T02:20:52.728883+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:52.728860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:52.728860+0000","last_clean_scrub_stamp":"2024-04-19T02:20:52.728860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:55:28.628918+0000","scrub_duration":0.0016468570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:35.678810+0000","last_change":"2024-04-19T02:20:35.678916+0000","last_active":"2024-04-19T02:20:35.678810+0000","last_peered":"2024-04-19T02:20:35.678810+0000","last_clean":"2024-04-19T02:20:35.678810+0000","last_became_active":"2024-04-19T02:15:29.286169+0000","last_became_peered":"2024-04-19T02:15:29.286169+0000","last_unstale":"2024-04-19T02:20:35.678810+0000","last_undegraded":"2024-04-19T02:20:35.678810+0000","last_fullsized":"2024-04-19T02:20:35.678810+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:35.678786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:35.678786+0000","last_clean_scrub_stamp":"2024-04-19T02:20:35.678786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:39:46.619486+0000","scrub_duration":0.0021837459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:20.006255+0000","last_change":"2024-04-19T02:19:54.927063+0000","last_active":"2024-04-19T02:20:20.006255+0000","last_peered":"2024-04-19T02:20:20.006255+0000","last_clean":"2024-04-19T02:20:20.006255+0000","last_became_active":"2024-04-19T02:19:54.926046+0000","last_became_peered":"2024-04-19T02:19:54.926046+0000","last_unstale":"2024-04-19T02:20:20.006255+0000","last_undegraded":"2024-04-19T02:20:20.006255+0000","last_fullsized":"2024-04-19T02:20:20.006255+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":68,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:59.656793+0000","last_change":"2024-04-19T02:20:59.656898+0000","last_active":"2024-04-19T02:20:59.656793+0000","last_peered":"2024-04-19T02:20:59.656793+0000","last_clean":"2024-04-19T02:20:59.656793+0000","last_became_active":"2024-04-19T02:19:54.931435+0000","last_became_peered":"2024-04-19T02:19:54.931435+0000","last_unstale":"2024-04-19T02:20:59.656793+0000","last_undegraded":"2024-04-19T02:20:59.656793+0000","last_fullsized":"2024-04-19T02:20:59.656793+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:59.656767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:59.656767+0000","last_clean_scrub_stamp":"2024-04-19T02:20:59.656767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:45:40.213629+0000","scrub_duration":0.021141032000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:20.006277+0000","last_change":"2024-04-19T02:19:54.924250+0000","last_active":"2024-04-19T02:20:20.006277+0000","last_peered":"2024-04-19T02:20:20.006277+0000","last_clean":"2024-04-19T02:20:20.006277+0000","last_became_active":"2024-04-19T02:19:54.923984+0000","last_became_peered":"2024-04-19T02:19:54.923984+0000","last_unstale":"2024-04-19T02:20:20.006277+0000","last_undegraded":"2024-04-19T02:20:20.006277+0000","last_fullsized":"2024-04-19T02:20:20.006277+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:45.640394+0000","last_change":"2024-04-19T02:20:45.640499+0000","last_active":"2024-04-19T02:20:45.640394+0000","last_peered":"2024-04-19T02:20:45.640394+0000","last_clean":"2024-04-19T02:20:45.640394+0000","last_became_active":"2024-04-19T02:19:54.925529+0000","last_became_peered":"2024-04-19T02:19:54.925529+0000","last_unstale":"2024-04-19T02:20:45.640394+0000","last_undegraded":"2024-04-19T02:20:45.640394+0000","last_fullsized":"2024-04-19T02:20:45.640394+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:45.640369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:45.640369+0000","last_clean_scrub_stamp":"2024-04-19T02:20:45.640369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:09:00.709082+0000","scrub_duration":0.022321161999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:20.006244+0000","last_change":"2024-04-19T02:19:54.930828+0000","last_active":"2024-04-19T02:20:20.006244+0000","last_peered":"2024-04-19T02:20:20.006244+0000","last_clean":"2024-04-19T02:20:20.006244+0000","last_became_active":"2024-04-19T02:19:54.930075+0000","last_became_peered":"2024-04-19T02:19:54.930075+0000","last_unstale":"2024-04-19T02:20:20.006244+0000","last_undegraded":"2024-04-19T02:20:20.006244+0000","last_fullsized":"2024-04-19T02:20:20.006244+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:39.837203+0000","last_change":"2024-04-19T02:20:39.837337+0000","last_active":"2024-04-19T02:20:39.837203+0000","last_peered":"2024-04-19T02:20:39.837203+0000","last_clean":"2024-04-19T02:20:39.837203+0000","last_became_active":"2024-04-19T02:19:54.928496+0000","last_became_peered":"2024-04-19T02:19:54.928496+0000","last_unstale":"2024-04-19T02:20:39.837203+0000","last_undegraded":"2024-04-19T02:20:39.837203+0000","last_fullsized":"2024-04-19T02:20:39.837203+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:39.837177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:39.837177+0000","last_clean_scrub_stamp":"2024-04-19T02:20:39.837177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:32:07.735631+0000","scrub_duration":0.037239790000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":62,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:20.006226+0000","last_change":"2024-04-19T02:16:30.093524+0000","last_active":"2024-04-19T02:20:20.006226+0000","last_peered":"2024-04-19T02:20:20.006226+0000","last_clean":"2024-04-19T02:20:20.006226+0000","last_became_active":"2024-04-19T02:16:30.093344+0000","last_became_peered":"2024-04-19T02:16:30.093344+0000","last_unstale":"2024-04-19T02:20:20.006226+0000","last_undegraded":"2024-04-19T02:20:20.006226+0000","last_fullsized":"2024-04-19T02:20:20.006226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:20.006224+0000","last_change":"2024-04-19T02:19:54.926754+0000","last_active":"2024-04-19T02:20:20.006224+0000","last_peered":"2024-04-19T02:20:20.006224+0000","last_clean":"2024-04-19T02:20:20.006224+0000","last_became_active":"2024-04-19T02:19:54.926040+0000","last_became_peered":"2024-04-19T02:19:54.926040+0000","last_unstale":"2024-04-19T02:20:20.006224+0000","last_undegraded":"2024-04-19T02:20:20.006224+0000","last_fullsized":"2024-04-19T02:20:20.006224+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.998087+0000","last_change":"2024-04-19T02:20:08.662601+0000","last_active":"2024-04-19T02:20:09.998087+0000","last_peered":"2024-04-19T02:20:09.998087+0000","last_clean":"2024-04-19T02:20:09.998087+0000","last_became_active":"2024-04-19T02:20:08.662234+0000","last_became_peered":"2024-04-19T02:20:08.662234+0000","last_unstale":"2024-04-19T02:20:09.998087+0000","last_undegraded":"2024-04-19T02:20:09.998087+0000","last_fullsized":"2024-04-19T02:20:09.998087+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":68,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:24.574781+0000","last_change":"2024-04-19T02:20:24.574893+0000","last_active":"2024-04-19T02:20:24.574781+0000","last_peered":"2024-04-19T02:20:24.574781+0000","last_clean":"2024-04-19T02:20:24.574781+0000","last_became_active":"2024-04-19T02:19:54.932240+0000","last_became_peered":"2024-04-19T02:19:54.932240+0000","last_unstale":"2024-04-19T02:20:24.574781+0000","last_undegraded":"2024-04-19T02:20:24.574781+0000","last_fullsized":"2024-04-19T02:20:24.574781+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:24.574756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:24.574756+0000","last_clean_scrub_stamp":"2024-04-19T02:20:24.574756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:05:16.137888+0000","scrub_duration":0.02235088,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:52.533209+0000","last_change":"2024-04-19T02:20:52.533329+0000","last_active":"2024-04-19T02:20:52.533209+0000","last_peered":"2024-04-19T02:20:52.533209+0000","last_clean":"2024-04-19T02:20:52.533209+0000","last_became_active":"2024-04-19T02:15:29.283121+0000","last_became_peered":"2024-04-19T02:15:29.283121+0000","last_unstale":"2024-04-19T02:20:52.533209+0000","last_undegraded":"2024-04-19T02:20:52.533209+0000","last_fullsized":"2024-04-19T02:20:52.533209+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:52.533183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:52.533183+0000","last_clean_scrub_stamp":"2024-04-19T02:20:52.533183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:46:09.200215+0000","scrub_duration":0.0015891010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:01.631997+0000","last_change":"2024-04-19T02:21:01.632133+0000","last_active":"2024-04-19T02:21:01.631997+0000","last_peered":"2024-04-19T02:21:01.631997+0000","last_clean":"2024-04-19T02:21:01.631997+0000","last_became_active":"2024-04-19T02:15:29.284649+0000","last_became_peered":"2024-04-19T02:15:29.284649+0000","last_unstale":"2024-04-19T02:21:01.631997+0000","last_undegraded":"2024-04-19T02:21:01.631997+0000","last_fullsized":"2024-04-19T02:21:01.631997+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:01.631972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:01.631972+0000","last_clean_scrub_stamp":"2024-04-19T02:21:01.631972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:49:22.367870+0000","scrub_duration":0.001884562,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:20.567013+0000","last_change":"2024-04-19T02:20:20.567149+0000","last_active":"2024-04-19T02:20:20.567013+0000","last_peered":"2024-04-19T02:20:20.567013+0000","last_clean":"2024-04-19T02:20:20.567013+0000","last_became_active":"2024-04-19T02:19:54.930437+0000","last_became_peered":"2024-04-19T02:19:54.930437+0000","last_unstale":"2024-04-19T02:20:20.567013+0000","last_undegraded":"2024-04-19T02:20:20.567013+0000","last_fullsized":"2024-04-19T02:20:20.567013+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:20.566972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:20.566972+0000","last_clean_scrub_stamp":"2024-04-19T02:20:20.566972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:59:10.317082+0000","scrub_duration":0.00187685,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.002393+0000","last_change":"2024-04-19T02:20:10.001650+0000","last_active":"2024-04-19T02:20:10.002393+0000","last_peered":"2024-04-19T02:20:10.002393+0000","last_clean":"2024-04-19T02:20:10.002393+0000","last_became_active":"2024-04-19T02:20:10.001343+0000","last_became_peered":"2024-04-19T02:20:10.001343+0000","last_unstale":"2024-04-19T02:20:10.002393+0000","last_undegraded":"2024-04-19T02:20:10.002393+0000","last_fullsized":"2024-04-19T02:20:10.002393+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":103,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:04.663105+0000","last_change":"2024-04-19T02:21:04.663219+0000","last_active":"2024-04-19T02:21:04.663105+0000","last_peered":"2024-04-19T02:21:04.663105+0000","last_clean":"2024-04-19T02:21:04.663105+0000","last_became_active":"2024-04-19T02:19:54.933233+0000","last_became_peered":"2024-04-19T02:19:54.933233+0000","last_unstale":"2024-04-19T02:21:04.663105+0000","last_undegraded":"2024-04-19T02:21:04.663105+0000","last_fullsized":"2024-04-19T02:21:04.663105+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:04.663080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:04.663080+0000","last_clean_scrub_stamp":"2024-04-19T02:21:04.663080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:24:22.993742+0000","scrub_duration":0.0015971410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:29.030999+0000","last_change":"2024-04-19T02:21:29.031138+0000","last_active":"2024-04-19T02:21:29.030999+0000","last_peered":"2024-04-19T02:21:29.030999+0000","last_clean":"2024-04-19T02:21:29.030999+0000","last_became_active":"2024-04-19T02:19:54.925060+0000","last_became_peered":"2024-04-19T02:19:54.925060+0000","last_unstale":"2024-04-19T02:21:29.030999+0000","last_undegraded":"2024-04-19T02:21:29.030999+0000","last_fullsized":"2024-04-19T02:21:29.030999+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:29.030973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:29.030973+0000","last_clean_scrub_stamp":"2024-04-19T02:21:29.030973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:34.156200+0000","scrub_duration":0.036993951999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:32.721522+0000","last_change":"2024-04-19T02:20:32.721654+0000","last_active":"2024-04-19T02:20:32.721522+0000","last_peered":"2024-04-19T02:20:32.721522+0000","last_clean":"2024-04-19T02:20:32.721522+0000","last_became_active":"2024-04-19T02:19:54.926442+0000","last_became_peered":"2024-04-19T02:19:54.926442+0000","last_unstale":"2024-04-19T02:20:32.721522+0000","last_undegraded":"2024-04-19T02:20:32.721522+0000","last_fullsized":"2024-04-19T02:20:32.721522+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:32.721479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:32.721479+0000","last_clean_scrub_stamp":"2024-04-19T02:20:32.721479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:23:51.052141+0000","scrub_duration":0.0020564210000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637206+0000","last_change":"2024-04-19T02:19:54.932532+0000","last_active":"2024-04-19T02:20:10.637206+0000","last_peered":"2024-04-19T02:20:10.637206+0000","last_clean":"2024-04-19T02:20:10.637206+0000","last_became_active":"2024-04-19T02:19:54.931438+0000","last_became_peered":"2024-04-19T02:19:54.931438+0000","last_unstale":"2024-04-19T02:20:10.637206+0000","last_undegraded":"2024-04-19T02:20:10.637206+0000","last_fullsized":"2024-04-19T02:20:10.637206+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.997884+0000","last_change":"2024-04-19T02:20:08.662261+0000","last_active":"2024-04-19T02:20:09.997884+0000","last_peered":"2024-04-19T02:20:09.997884+0000","last_clean":"2024-04-19T02:20:09.997884+0000","last_became_active":"2024-04-19T02:20:08.661940+0000","last_became_peered":"2024-04-19T02:20:08.661940+0000","last_unstale":"2024-04-19T02:20:09.997884+0000","last_undegraded":"2024-04-19T02:20:09.997884+0000","last_fullsized":"2024-04-19T02:20:09.997884+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.640152+0000","last_change":"2024-04-19T02:20:10.639368+0000","last_active":"2024-04-19T02:20:10.640152+0000","last_peered":"2024-04-19T02:20:10.640152+0000","last_clean":"2024-04-19T02:20:10.640152+0000","last_became_active":"2024-04-19T02:20:10.639036+0000","last_became_peered":"2024-04-19T02:20:10.639036+0000","last_unstale":"2024-04-19T02:20:10.640152+0000","last_undegraded":"2024-04-19T02:20:10.640152+0000","last_fullsized":"2024-04-19T02:20:10.640152+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":103,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:54.722505+0000","last_change":"2024-04-19T02:20:54.722628+0000","last_active":"2024-04-19T02:20:54.722505+0000","last_peered":"2024-04-19T02:20:54.722505+0000","last_clean":"2024-04-19T02:20:54.722505+0000","last_became_active":"2024-04-19T02:19:54.928261+0000","last_became_peered":"2024-04-19T02:19:54.928261+0000","last_unstale":"2024-04-19T02:20:54.722505+0000","last_undegraded":"2024-04-19T02:20:54.722505+0000","last_fullsized":"2024-04-19T02:20:54.722505+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:54.722476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:54.722476+0000","last_clean_scrub_stamp":"2024-04-19T02:20:54.722476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:41:38.555723+0000","scrub_duration":0.0018882219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:41.635924+0000","last_change":"2024-04-19T02:20:41.636049+0000","last_active":"2024-04-19T02:20:41.635924+0000","last_peered":"2024-04-19T02:20:41.635924+0000","last_clean":"2024-04-19T02:20:41.635924+0000","last_became_active":"2024-04-19T02:15:29.276952+0000","last_became_peered":"2024-04-19T02:15:29.276952+0000","last_unstale":"2024-04-19T02:20:41.635924+0000","last_undegraded":"2024-04-19T02:20:41.635924+0000","last_fullsized":"2024-04-19T02:20:41.635924+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:41.635899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:41.635899+0000","last_clean_scrub_stamp":"2024-04-19T02:20:41.635899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:02:03.442021+0000","scrub_duration":0.035233386999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:36.825318+0000","last_change":"2024-04-19T02:20:36.825423+0000","last_active":"2024-04-19T02:20:36.825318+0000","last_peered":"2024-04-19T02:20:36.825318+0000","last_clean":"2024-04-19T02:20:36.825318+0000","last_became_active":"2024-04-19T02:19:54.931124+0000","last_became_peered":"2024-04-19T02:19:54.931124+0000","last_unstale":"2024-04-19T02:20:36.825318+0000","last_undegraded":"2024-04-19T02:20:36.825318+0000","last_fullsized":"2024-04-19T02:20:36.825318+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:36.825293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:36.825293+0000","last_clean_scrub_stamp":"2024-04-19T02:20:36.825293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:26:48.954624+0000","scrub_duration":0.0020341249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":80,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637710+0000","last_change":"2024-04-19T02:15:29.287389+0000","last_active":"2024-04-19T02:20:10.637710+0000","last_peered":"2024-04-19T02:20:10.637710+0000","last_clean":"2024-04-19T02:20:10.637710+0000","last_became_active":"2024-04-19T02:15:29.286431+0000","last_became_peered":"2024-04-19T02:15:29.286431+0000","last_unstale":"2024-04-19T02:20:10.637710+0000","last_undegraded":"2024-04-19T02:20:10.637710+0000","last_fullsized":"2024-04-19T02:20:10.637710+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:07.561762+0000","last_change":"2024-04-19T02:21:07.561888+0000","last_active":"2024-04-19T02:21:07.561762+0000","last_peered":"2024-04-19T02:21:07.561762+0000","last_clean":"2024-04-19T02:21:07.561762+0000","last_became_active":"2024-04-19T02:19:54.926838+0000","last_became_peered":"2024-04-19T02:19:54.926838+0000","last_unstale":"2024-04-19T02:21:07.561762+0000","last_undegraded":"2024-04-19T02:21:07.561762+0000","last_fullsized":"2024-04-19T02:21:07.561762+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-19T02:21:07.561735+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-19T02:21:07.561735+0000","last_clean_scrub_stamp":"2024-04-19T02:21:07.561735+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:40:18.502435+0000","scrub_duration":0.001800028,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:17.504243+0000","last_change":"2024-04-19T02:21:17.504338+0000","last_active":"2024-04-19T02:21:17.504243+0000","last_peered":"2024-04-19T02:21:17.504243+0000","last_clean":"2024-04-19T02:21:17.504243+0000","last_became_active":"2024-04-19T02:15:29.280479+0000","last_became_peered":"2024-04-19T02:15:29.280479+0000","last_unstale":"2024-04-19T02:21:17.504243+0000","last_undegraded":"2024-04-19T02:21:17.504243+0000","last_fullsized":"2024-04-19T02:21:17.504243+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:17.504211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:17.504211+0000","last_clean_scrub_stamp":"2024-04-19T02:21:17.504211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:09:32.572924+0000","scrub_duration":0.001817379,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.012839+0000","last_change":"2024-04-19T02:21:18.012939+0000","last_active":"2024-04-19T02:21:18.012839+0000","last_peered":"2024-04-19T02:21:18.012839+0000","last_clean":"2024-04-19T02:21:18.012839+0000","last_became_active":"2024-04-19T02:19:54.924484+0000","last_became_peered":"2024-04-19T02:19:54.924484+0000","last_unstale":"2024-04-19T02:21:18.012839+0000","last_undegraded":"2024-04-19T02:21:18.012839+0000","last_fullsized":"2024-04-19T02:21:18.012839+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:18.012814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:18.012814+0000","last_clean_scrub_stamp":"2024-04-19T02:21:18.012814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:22:58.977653+0000","scrub_duration":0.0018265969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.639795+0000","last_change":"2024-04-19T02:20:10.639077+0000","last_active":"2024-04-19T02:20:10.639795+0000","last_peered":"2024-04-19T02:20:10.639795+0000","last_clean":"2024-04-19T02:20:10.639795+0000","last_became_active":"2024-04-19T02:20:10.638737+0000","last_became_peered":"2024-04-19T02:20:10.638737+0000","last_unstale":"2024-04-19T02:20:10.639795+0000","last_undegraded":"2024-04-19T02:20:10.639795+0000","last_fullsized":"2024-04-19T02:20:10.639795+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:08.944585+0000","last_change":"2024-04-19T02:21:08.944722+0000","last_active":"2024-04-19T02:21:08.944585+0000","last_peered":"2024-04-19T02:21:08.944585+0000","last_clean":"2024-04-19T02:21:08.944585+0000","last_became_active":"2024-04-19T02:19:54.928398+0000","last_became_peered":"2024-04-19T02:19:54.928398+0000","last_unstale":"2024-04-19T02:21:08.944585+0000","last_undegraded":"2024-04-19T02:21:08.944585+0000","last_fullsized":"2024-04-19T02:21:08.944585+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:08.944563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:08.944563+0000","last_clean_scrub_stamp":"2024-04-19T02:21:08.944563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:16:16.242584+0000","scrub_duration":0.0016415690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:34.630146+0000","last_change":"2024-04-19T02:20:34.630281+0000","last_active":"2024-04-19T02:20:34.630146+0000","last_peered":"2024-04-19T02:20:34.630146+0000","last_clean":"2024-04-19T02:20:34.630146+0000","last_became_active":"2024-04-19T02:15:29.279314+0000","last_became_peered":"2024-04-19T02:15:29.279314+0000","last_unstale":"2024-04-19T02:20:34.630146+0000","last_undegraded":"2024-04-19T02:20:34.630146+0000","last_fullsized":"2024-04-19T02:20:34.630146+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:34.630122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:34.630122+0000","last_clean_scrub_stamp":"2024-04-19T02:20:34.630122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:19:42.256810+0000","scrub_duration":0.066969174000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:47.942738+0000","last_change":"2024-04-19T02:20:47.942846+0000","last_active":"2024-04-19T02:20:47.942738+0000","last_peered":"2024-04-19T02:20:47.942738+0000","last_clean":"2024-04-19T02:20:47.942738+0000","last_became_active":"2024-04-19T02:19:54.925729+0000","last_became_peered":"2024-04-19T02:19:54.925729+0000","last_unstale":"2024-04-19T02:20:47.942738+0000","last_undegraded":"2024-04-19T02:20:47.942738+0000","last_fullsized":"2024-04-19T02:20:47.942738+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:47.942715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:47.942715+0000","last_clean_scrub_stamp":"2024-04-19T02:20:47.942715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:53:52.743256+0000","scrub_duration":0.001689886,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:15.993647+0000","last_change":"2024-04-19T02:21:15.993771+0000","last_active":"2024-04-19T02:21:15.993647+0000","last_peered":"2024-04-19T02:21:15.993647+0000","last_clean":"2024-04-19T02:21:15.993647+0000","last_became_active":"2024-04-19T02:19:54.927666+0000","last_became_peered":"2024-04-19T02:19:54.927666+0000","last_unstale":"2024-04-19T02:21:15.993647+0000","last_undegraded":"2024-04-19T02:21:15.993647+0000","last_fullsized":"2024-04-19T02:21:15.993647+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:15.993623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:15.993623+0000","last_clean_scrub_stamp":"2024-04-19T02:21:15.993623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:45.212212+0000","scrub_duration":0.0019736129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":105,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:05.779304+0000","last_change":"2024-04-19T02:21:05.779445+0000","last_active":"2024-04-19T02:21:05.779304+0000","last_peered":"2024-04-19T02:21:05.779304+0000","last_clean":"2024-04-19T02:21:05.779304+0000","last_became_active":"2024-04-19T02:19:54.931540+0000","last_became_peered":"2024-04-19T02:19:54.931540+0000","last_unstale":"2024-04-19T02:21:05.779304+0000","last_undegraded":"2024-04-19T02:21:05.779304+0000","last_fullsized":"2024-04-19T02:21:05.779304+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:05.779268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:05.779268+0000","last_clean_scrub_stamp":"2024-04-19T02:21:05.779268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:40:53.826444+0000","scrub_duration":0.0018519179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:24.906406+0000","last_change":"2024-04-19T02:20:24.906512+0000","last_active":"2024-04-19T02:20:24.906406+0000","last_peered":"2024-04-19T02:20:24.906406+0000","last_clean":"2024-04-19T02:20:24.906406+0000","last_became_active":"2024-04-19T02:19:54.923784+0000","last_became_peered":"2024-04-19T02:19:54.923784+0000","last_unstale":"2024-04-19T02:20:24.906406+0000","last_undegraded":"2024-04-19T02:20:24.906406+0000","last_fullsized":"2024-04-19T02:20:24.906406+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:24.906368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:24.906368+0000","last_clean_scrub_stamp":"2024-04-19T02:20:24.906368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:16:17.186228+0000","scrub_duration":0.0016771609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"82'5","reported_seq":96,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:31.607416+0000","last_change":"2024-04-19T02:21:31.607527+0000","last_active":"2024-04-19T02:21:31.607416+0000","last_peered":"2024-04-19T02:21:31.607416+0000","last_clean":"2024-04-19T02:21:31.607416+0000","last_became_active":"2024-04-19T02:15:28.891440+0000","last_became_peered":"2024-04-19T02:15:28.891440+0000","last_unstale":"2024-04-19T02:21:31.607416+0000","last_undegraded":"2024-04-19T02:21:31.607416+0000","last_fullsized":"2024-04-19T02:21:31.607416+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'5","last_scrub_stamp":"2024-04-19T02:21:31.607389+0000","last_deep_scrub":"82'5","last_deep_scrub_stamp":"2024-04-19T02:21:31.607389+0000","last_clean_scrub_stamp":"2024-04-19T02:21:31.607389+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:21:18.270455+0000","scrub_duration":0.0041207539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:10.974515+0000","last_change":"2024-04-19T02:21:10.974630+0000","last_active":"2024-04-19T02:21:10.974515+0000","last_peered":"2024-04-19T02:21:10.974515+0000","last_clean":"2024-04-19T02:21:10.974515+0000","last_became_active":"2024-04-19T02:19:54.923493+0000","last_became_peered":"2024-04-19T02:19:54.923493+0000","last_unstale":"2024-04-19T02:21:10.974515+0000","last_undegraded":"2024-04-19T02:21:10.974515+0000","last_fullsized":"2024-04-19T02:21:10.974515+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:10.974492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:10.974492+0000","last_clean_scrub_stamp":"2024-04-19T02:21:10.974492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:17:16.098605+0000","scrub_duration":0.0017195929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":87,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:12.907134+0000","last_change":"2024-04-19T02:15:28.891097+0000","last_active":"2024-04-19T02:20:12.907134+0000","last_peered":"2024-04-19T02:20:12.907134+0000","last_clean":"2024-04-19T02:20:12.907134+0000","last_became_active":"2024-04-19T02:15:28.890795+0000","last_became_peered":"2024-04-19T02:15:28.890795+0000","last_unstale":"2024-04-19T02:20:12.907134+0000","last_undegraded":"2024-04-19T02:20:12.907134+0000","last_fullsized":"2024-04-19T02:20:12.907134+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:59.594482+0000","last_change":"2024-04-19T02:20:59.594635+0000","last_active":"2024-04-19T02:20:59.594482+0000","last_peered":"2024-04-19T02:20:59.594482+0000","last_clean":"2024-04-19T02:20:59.594482+0000","last_became_active":"2024-04-19T02:15:29.277547+0000","last_became_peered":"2024-04-19T02:15:29.277547+0000","last_unstale":"2024-04-19T02:20:59.594482+0000","last_undegraded":"2024-04-19T02:20:59.594482+0000","last_fullsized":"2024-04-19T02:20:59.594482+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:59.594458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:59.594458+0000","last_clean_scrub_stamp":"2024-04-19T02:20:59.594458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:20:46.257524+0000","scrub_duration":0.001831102,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"82'4","reported_seq":109,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:54.609805+0000","last_change":"2024-04-19T02:20:54.609979+0000","last_active":"2024-04-19T02:20:54.609805+0000","last_peered":"2024-04-19T02:20:54.609805+0000","last_clean":"2024-04-19T02:20:54.609805+0000","last_became_active":"2024-04-19T02:19:54.932829+0000","last_became_peered":"2024-04-19T02:19:54.932829+0000","last_unstale":"2024-04-19T02:20:54.609805+0000","last_undegraded":"2024-04-19T02:20:54.609805+0000","last_fullsized":"2024-04-19T02:20:54.609805+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'4","last_scrub_stamp":"2024-04-19T02:20:54.609763+0000","last_deep_scrub":"82'4","last_deep_scrub_stamp":"2024-04-19T02:20:54.609763+0000","last_clean_scrub_stamp":"2024-04-19T02:20:54.609763+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:53:50.278165+0000","scrub_duration":0.0044989499999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:12.873826+0000","last_change":"2024-04-19T02:20:07.983368+0000","last_active":"2024-04-19T02:20:12.873826+0000","last_peered":"2024-04-19T02:20:12.873826+0000","last_clean":"2024-04-19T02:20:12.873826+0000","last_became_active":"2024-04-19T02:20:07.983080+0000","last_became_peered":"2024-04-19T02:20:07.983080+0000","last_unstale":"2024-04-19T02:20:12.873826+0000","last_undegraded":"2024-04-19T02:20:12.873826+0000","last_fullsized":"2024-04-19T02:20:12.873826+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:31.028435+0000","last_change":"2024-04-19T02:21:31.028561+0000","last_active":"2024-04-19T02:21:31.028435+0000","last_peered":"2024-04-19T02:21:31.028435+0000","last_clean":"2024-04-19T02:21:31.028435+0000","last_became_active":"2024-04-19T02:19:54.925703+0000","last_became_peered":"2024-04-19T02:19:54.925703+0000","last_unstale":"2024-04-19T02:21:31.028435+0000","last_undegraded":"2024-04-19T02:21:31.028435+0000","last_fullsized":"2024-04-19T02:21:31.028435+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:31.028410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:31.028410+0000","last_clean_scrub_stamp":"2024-04-19T02:21:31.028410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:46:36.306863+0000","scrub_duration":0.00173,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":57,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:20.499286+0000","last_change":"2024-04-19T02:19:54.925918+0000","last_active":"2024-04-19T02:20:20.499286+0000","last_peered":"2024-04-19T02:20:20.499286+0000","last_clean":"2024-04-19T02:20:20.499286+0000","last_became_active":"2024-04-19T02:19:54.925634+0000","last_became_peered":"2024-04-19T02:19:54.925634+0000","last_unstale":"2024-04-19T02:20:20.499286+0000","last_undegraded":"2024-04-19T02:20:20.499286+0000","last_fullsized":"2024-04-19T02:20:20.499286+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:34.594648+0000","last_change":"2024-04-19T02:21:34.594758+0000","last_active":"2024-04-19T02:21:34.594648+0000","last_peered":"2024-04-19T02:21:34.594648+0000","last_clean":"2024-04-19T02:21:34.594648+0000","last_became_active":"2024-04-19T02:15:28.891879+0000","last_became_peered":"2024-04-19T02:15:28.891879+0000","last_unstale":"2024-04-19T02:21:34.594648+0000","last_undegraded":"2024-04-19T02:21:34.594648+0000","last_fullsized":"2024-04-19T02:21:34.594648+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:34.594623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:34.594623+0000","last_clean_scrub_stamp":"2024-04-19T02:21:34.594623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:30:55.595121+0000","scrub_duration":0.0019129990000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.639813+0000","last_change":"2024-04-19T02:20:10.639094+0000","last_active":"2024-04-19T02:20:10.639813+0000","last_peered":"2024-04-19T02:20:10.639813+0000","last_clean":"2024-04-19T02:20:10.639813+0000","last_became_active":"2024-04-19T02:20:10.638755+0000","last_became_peered":"2024-04-19T02:20:10.638755+0000","last_unstale":"2024-04-19T02:20:10.639813+0000","last_undegraded":"2024-04-19T02:20:10.639813+0000","last_fullsized":"2024-04-19T02:20:10.639813+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":89,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637328+0000","last_change":"2024-04-19T02:15:28.891131+0000","last_active":"2024-04-19T02:20:10.637328+0000","last_peered":"2024-04-19T02:20:10.637328+0000","last_clean":"2024-04-19T02:20:10.637328+0000","last_became_active":"2024-04-19T02:15:28.890882+0000","last_became_peered":"2024-04-19T02:15:28.890882+0000","last_unstale":"2024-04-19T02:20:10.637328+0000","last_undegraded":"2024-04-19T02:20:10.637328+0000","last_fullsized":"2024-04-19T02:20:10.637328+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:54.023457+0000","last_change":"2024-04-19T02:20:54.023600+0000","last_active":"2024-04-19T02:20:54.023457+0000","last_peered":"2024-04-19T02:20:54.023457+0000","last_clean":"2024-04-19T02:20:54.023457+0000","last_became_active":"2024-04-19T02:19:54.925121+0000","last_became_peered":"2024-04-19T02:19:54.925121+0000","last_unstale":"2024-04-19T02:20:54.023457+0000","last_undegraded":"2024-04-19T02:20:54.023457+0000","last_fullsized":"2024-04-19T02:20:54.023457+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:54.023433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:54.023433+0000","last_clean_scrub_stamp":"2024-04-19T02:20:54.023433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:02:43.764667+0000","scrub_duration":0.053810324999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"82'2","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:08.799687+0000","last_change":"2024-04-19T02:21:08.799794+0000","last_active":"2024-04-19T02:21:08.799687+0000","last_peered":"2024-04-19T02:21:08.799687+0000","last_clean":"2024-04-19T02:21:08.799687+0000","last_became_active":"2024-04-19T02:15:28.890004+0000","last_became_peered":"2024-04-19T02:15:28.890004+0000","last_unstale":"2024-04-19T02:21:08.799687+0000","last_undegraded":"2024-04-19T02:21:08.799687+0000","last_fullsized":"2024-04-19T02:21:08.799687+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-19T02:21:08.799663+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-19T02:21:08.799663+0000","last_clean_scrub_stamp":"2024-04-19T02:21:08.799663+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:23:57.962043+0000","scrub_duration":0.0033993159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:37.549179+0000","last_change":"2024-04-19T02:20:37.549289+0000","last_active":"2024-04-19T02:20:37.549179+0000","last_peered":"2024-04-19T02:20:37.549179+0000","last_clean":"2024-04-19T02:20:37.549179+0000","last_became_active":"2024-04-19T02:15:29.285197+0000","last_became_peered":"2024-04-19T02:15:29.285197+0000","last_unstale":"2024-04-19T02:20:37.549179+0000","last_undegraded":"2024-04-19T02:20:37.549179+0000","last_fullsized":"2024-04-19T02:20:37.549179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:37.549154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:37.549154+0000","last_clean_scrub_stamp":"2024-04-19T02:20:37.549154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:18:16.168949+0000","scrub_duration":0.0014928389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"82'3","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:24.538286+0000","last_change":"2024-04-19T02:21:24.538404+0000","last_active":"2024-04-19T02:21:24.538286+0000","last_peered":"2024-04-19T02:21:24.538286+0000","last_clean":"2024-04-19T02:21:24.538286+0000","last_became_active":"2024-04-19T02:15:28.893231+0000","last_became_peered":"2024-04-19T02:15:28.893231+0000","last_unstale":"2024-04-19T02:21:24.538286+0000","last_undegraded":"2024-04-19T02:21:24.538286+0000","last_fullsized":"2024-04-19T02:21:24.538286+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-19T02:21:24.538258+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-19T02:21:24.538258+0000","last_clean_scrub_stamp":"2024-04-19T02:21:24.538258+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:46:41.205290+0000","scrub_duration":0.0060652270000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":103,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:49.727333+0000","last_change":"2024-04-19T02:20:49.727441+0000","last_active":"2024-04-19T02:20:49.727333+0000","last_peered":"2024-04-19T02:20:49.727333+0000","last_clean":"2024-04-19T02:20:49.727333+0000","last_became_active":"2024-04-19T02:19:54.925502+0000","last_became_peered":"2024-04-19T02:19:54.925502+0000","last_unstale":"2024-04-19T02:20:49.727333+0000","last_undegraded":"2024-04-19T02:20:49.727333+0000","last_fullsized":"2024-04-19T02:20:49.727333+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:49.727309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:49.727309+0000","last_clean_scrub_stamp":"2024-04-19T02:20:49.727309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:34:41.219108+0000","scrub_duration":0.002043497,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"82'2","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:12.770179+0000","last_change":"2024-04-19T02:21:12.770278+0000","last_active":"2024-04-19T02:21:12.770179+0000","last_peered":"2024-04-19T02:21:12.770179+0000","last_clean":"2024-04-19T02:21:12.770179+0000","last_became_active":"2024-04-19T02:15:28.890881+0000","last_became_peered":"2024-04-19T02:15:28.890881+0000","last_unstale":"2024-04-19T02:21:12.770179+0000","last_undegraded":"2024-04-19T02:21:12.770179+0000","last_fullsized":"2024-04-19T02:21:12.770179+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-19T02:21:12.770155+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-19T02:21:12.770155+0000","last_clean_scrub_stamp":"2024-04-19T02:21:12.770155+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:56:59.212815+0000","scrub_duration":0.00314285,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637139+0000","last_change":"2024-04-19T02:19:54.926103+0000","last_active":"2024-04-19T02:20:10.637139+0000","last_peered":"2024-04-19T02:20:10.637139+0000","last_clean":"2024-04-19T02:20:10.637139+0000","last_became_active":"2024-04-19T02:19:54.925591+0000","last_became_peered":"2024-04-19T02:19:54.925591+0000","last_unstale":"2024-04-19T02:20:10.637139+0000","last_undegraded":"2024-04-19T02:20:10.637139+0000","last_fullsized":"2024-04-19T02:20:10.637139+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":105,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.627379+0000","last_change":"2024-04-19T02:21:00.627484+0000","last_active":"2024-04-19T02:21:00.627379+0000","last_peered":"2024-04-19T02:21:00.627379+0000","last_clean":"2024-04-19T02:21:00.627379+0000","last_became_active":"2024-04-19T02:19:54.925523+0000","last_became_peered":"2024-04-19T02:19:54.925523+0000","last_unstale":"2024-04-19T02:21:00.627379+0000","last_undegraded":"2024-04-19T02:21:00.627379+0000","last_fullsized":"2024-04-19T02:21:00.627379+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:00.627355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:00.627355+0000","last_clean_scrub_stamp":"2024-04-19T02:21:00.627355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:39.950387+0000","scrub_duration":0.0016425540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:31.927807+0000","last_change":"2024-04-19T02:20:31.927940+0000","last_active":"2024-04-19T02:20:31.927807+0000","last_peered":"2024-04-19T02:20:31.927807+0000","last_clean":"2024-04-19T02:20:31.927807+0000","last_became_active":"2024-04-19T02:19:54.930843+0000","last_became_peered":"2024-04-19T02:19:54.930843+0000","last_unstale":"2024-04-19T02:20:31.927807+0000","last_undegraded":"2024-04-19T02:20:31.927807+0000","last_fullsized":"2024-04-19T02:20:31.927807+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:31.927783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:31.927783+0000","last_clean_scrub_stamp":"2024-04-19T02:20:31.927783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:16.149096+0000","scrub_duration":0.037287204999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'3","reported_seq":44,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:36.961730+0000","last_change":"2024-04-19T02:21:36.961895+0000","last_active":"2024-04-19T02:21:36.961730+0000","last_peered":"2024-04-19T02:21:36.961730+0000","last_clean":"2024-04-19T02:21:36.961730+0000","last_became_active":"2024-04-19T02:19:54.931553+0000","last_became_peered":"2024-04-19T02:19:54.931553+0000","last_unstale":"2024-04-19T02:21:36.961730+0000","last_undegraded":"2024-04-19T02:21:36.961730+0000","last_fullsized":"2024-04-19T02:21:36.961730+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-19T02:21:36.961704+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-19T02:21:36.961704+0000","last_clean_scrub_stamp":"2024-04-19T02:21:36.961704+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:06:19.021234+0000","scrub_duration":0.0035191599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:07.840808+0000","last_change":"2024-04-19T02:21:07.840904+0000","last_active":"2024-04-19T02:21:07.840808+0000","last_peered":"2024-04-19T02:21:07.840808+0000","last_clean":"2024-04-19T02:21:07.840808+0000","last_became_active":"2024-04-19T02:19:54.925645+0000","last_became_peered":"2024-04-19T02:19:54.925645+0000","last_unstale":"2024-04-19T02:21:07.840808+0000","last_undegraded":"2024-04-19T02:21:07.840808+0000","last_fullsized":"2024-04-19T02:21:07.840808+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:07.840784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:07.840784+0000","last_clean_scrub_stamp":"2024-04-19T02:21:07.840784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:56:35.438495+0000","scrub_duration":0.0018420279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":105,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.798683+0000","last_change":"2024-04-19T02:21:18.798790+0000","last_active":"2024-04-19T02:21:18.798683+0000","last_peered":"2024-04-19T02:21:18.798683+0000","last_clean":"2024-04-19T02:21:18.798683+0000","last_became_active":"2024-04-19T02:19:54.923321+0000","last_became_peered":"2024-04-19T02:19:54.923321+0000","last_unstale":"2024-04-19T02:21:18.798683+0000","last_undegraded":"2024-04-19T02:21:18.798683+0000","last_fullsized":"2024-04-19T02:21:18.798683+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:18.798658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:18.798658+0000","last_clean_scrub_stamp":"2024-04-19T02:21:18.798658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:35.622159+0000","scrub_duration":0.001875989,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:04.743415+0000","last_change":"2024-04-19T02:21:04.743533+0000","last_active":"2024-04-19T02:21:04.743415+0000","last_peered":"2024-04-19T02:21:04.743415+0000","last_clean":"2024-04-19T02:21:04.743415+0000","last_became_active":"2024-04-19T02:15:29.284650+0000","last_became_peered":"2024-04-19T02:15:29.284650+0000","last_unstale":"2024-04-19T02:21:04.743415+0000","last_undegraded":"2024-04-19T02:21:04.743415+0000","last_fullsized":"2024-04-19T02:21:04.743415+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:04.743381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:04.743381+0000","last_clean_scrub_stamp":"2024-04-19T02:21:04.743381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:15:36.123544+0000","scrub_duration":0.0019252679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.997742+0000","last_change":"2024-04-19T02:20:08.662566+0000","last_active":"2024-04-19T02:20:09.997742+0000","last_peered":"2024-04-19T02:20:09.997742+0000","last_clean":"2024-04-19T02:20:09.997742+0000","last_became_active":"2024-04-19T02:20:08.662277+0000","last_became_peered":"2024-04-19T02:20:08.662277+0000","last_unstale":"2024-04-19T02:20:09.997742+0000","last_undegraded":"2024-04-19T02:20:09.997742+0000","last_fullsized":"2024-04-19T02:20:09.997742+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:11.802147+0000","last_change":"2024-04-19T02:21:11.802259+0000","last_active":"2024-04-19T02:21:11.802147+0000","last_peered":"2024-04-19T02:21:11.802147+0000","last_clean":"2024-04-19T02:21:11.802147+0000","last_became_active":"2024-04-19T02:15:29.286606+0000","last_became_peered":"2024-04-19T02:15:29.286606+0000","last_unstale":"2024-04-19T02:21:11.802147+0000","last_undegraded":"2024-04-19T02:21:11.802147+0000","last_fullsized":"2024-04-19T02:21:11.802147+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:11.802122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:11.802122+0000","last_clean_scrub_stamp":"2024-04-19T02:21:11.802122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:42.177826+0000","scrub_duration":0.001592062,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:32.588969+0000","last_change":"2024-04-19T02:21:32.589083+0000","last_active":"2024-04-19T02:21:32.588969+0000","last_peered":"2024-04-19T02:21:32.588969+0000","last_clean":"2024-04-19T02:21:32.588969+0000","last_became_active":"2024-04-19T02:19:54.928298+0000","last_became_peered":"2024-04-19T02:19:54.928298+0000","last_unstale":"2024-04-19T02:21:32.588969+0000","last_undegraded":"2024-04-19T02:21:32.588969+0000","last_fullsized":"2024-04-19T02:21:32.588969+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:32.588945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:32.588945+0000","last_clean_scrub_stamp":"2024-04-19T02:21:32.588945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:12:11.911976+0000","scrub_duration":0.001689189,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:27.963130+0000","last_change":"2024-04-19T02:20:27.963259+0000","last_active":"2024-04-19T02:20:27.963130+0000","last_peered":"2024-04-19T02:20:27.963130+0000","last_clean":"2024-04-19T02:20:27.963130+0000","last_became_active":"2024-04-19T02:19:54.927309+0000","last_became_peered":"2024-04-19T02:19:54.927309+0000","last_unstale":"2024-04-19T02:20:27.963130+0000","last_undegraded":"2024-04-19T02:20:27.963130+0000","last_fullsized":"2024-04-19T02:20:27.963130+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:27.963106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:27.963106+0000","last_clean_scrub_stamp":"2024-04-19T02:20:27.963106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:35:23.138484+0000","scrub_duration":0.070564934999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.999545+0000","last_change":"2024-04-19T02:20:09.998998+0000","last_active":"2024-04-19T02:20:09.999545+0000","last_peered":"2024-04-19T02:20:09.999545+0000","last_clean":"2024-04-19T02:20:09.999545+0000","last_became_active":"2024-04-19T02:20:09.998776+0000","last_became_peered":"2024-04-19T02:20:09.998776+0000","last_unstale":"2024-04-19T02:20:09.999545+0000","last_undegraded":"2024-04-19T02:20:09.999545+0000","last_fullsized":"2024-04-19T02:20:09.999545+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":105,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:02.676393+0000","last_change":"2024-04-19T02:21:02.676488+0000","last_active":"2024-04-19T02:21:02.676393+0000","last_peered":"2024-04-19T02:21:02.676393+0000","last_clean":"2024-04-19T02:21:02.676393+0000","last_became_active":"2024-04-19T02:19:54.925872+0000","last_became_peered":"2024-04-19T02:19:54.925872+0000","last_unstale":"2024-04-19T02:21:02.676393+0000","last_undegraded":"2024-04-19T02:21:02.676393+0000","last_fullsized":"2024-04-19T02:21:02.676393+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:02.676368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:02.676368+0000","last_clean_scrub_stamp":"2024-04-19T02:21:02.676368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:30:23.676866+0000","scrub_duration":0.001635245,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.514809+0000","last_change":"2024-04-19T02:20:33.514910+0000","last_active":"2024-04-19T02:20:33.514809+0000","last_peered":"2024-04-19T02:20:33.514809+0000","last_clean":"2024-04-19T02:20:33.514809+0000","last_became_active":"2024-04-19T02:15:29.276968+0000","last_became_peered":"2024-04-19T02:15:29.276968+0000","last_unstale":"2024-04-19T02:20:33.514809+0000","last_undegraded":"2024-04-19T02:20:33.514809+0000","last_fullsized":"2024-04-19T02:20:33.514809+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:33.514784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:33.514784+0000","last_clean_scrub_stamp":"2024-04-19T02:20:33.514784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:01:55.933306+0000","scrub_duration":0.0019782179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":108,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:27.774411+0000","last_change":"2024-04-19T02:21:27.774512+0000","last_active":"2024-04-19T02:21:27.774411+0000","last_peered":"2024-04-19T02:21:27.774411+0000","last_clean":"2024-04-19T02:21:27.774411+0000","last_became_active":"2024-04-19T02:19:54.927033+0000","last_became_peered":"2024-04-19T02:19:54.927033+0000","last_unstale":"2024-04-19T02:21:27.774411+0000","last_undegraded":"2024-04-19T02:21:27.774411+0000","last_fullsized":"2024-04-19T02:21:27.774411+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:27.774381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:27.774381+0000","last_clean_scrub_stamp":"2024-04-19T02:21:27.774381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:18.998948+0000","scrub_duration":0.0019217139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.637470+0000","last_change":"2024-04-19T02:19:54.932790+0000","last_active":"2024-04-19T02:20:10.637470+0000","last_peered":"2024-04-19T02:20:10.637470+0000","last_clean":"2024-04-19T02:20:10.637470+0000","last_became_active":"2024-04-19T02:19:54.931683+0000","last_became_peered":"2024-04-19T02:19:54.931683+0000","last_unstale":"2024-04-19T02:20:10.637470+0000","last_undegraded":"2024-04-19T02:20:10.637470+0000","last_fullsized":"2024-04-19T02:20:10.637470+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:37.784585+0000","last_change":"2024-04-19T02:20:37.784722+0000","last_active":"2024-04-19T02:20:37.784585+0000","last_peered":"2024-04-19T02:20:37.784585+0000","last_clean":"2024-04-19T02:20:37.784585+0000","last_became_active":"2024-04-19T02:19:54.924686+0000","last_became_peered":"2024-04-19T02:19:54.924686+0000","last_unstale":"2024-04-19T02:20:37.784585+0000","last_undegraded":"2024-04-19T02:20:37.784585+0000","last_fullsized":"2024-04-19T02:20:37.784585+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:37.784561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:37.784561+0000","last_clean_scrub_stamp":"2024-04-19T02:20:37.784561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:26:44.108152+0000","scrub_duration":0.0013845000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:51.933270+0000","last_change":"2024-04-19T02:20:51.933365+0000","last_active":"2024-04-19T02:20:51.933270+0000","last_peered":"2024-04-19T02:20:51.933270+0000","last_clean":"2024-04-19T02:20:51.933270+0000","last_became_active":"2024-04-19T02:19:54.923164+0000","last_became_peered":"2024-04-19T02:19:54.923164+0000","last_unstale":"2024-04-19T02:20:51.933270+0000","last_undegraded":"2024-04-19T02:20:51.933270+0000","last_fullsized":"2024-04-19T02:20:51.933270+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:51.933246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:51.933246+0000","last_clean_scrub_stamp":"2024-04-19T02:20:51.933246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:39:21.609447+0000","scrub_duration":0.0015936590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.997425+0000","last_change":"2024-04-19T02:20:08.662301+0000","last_active":"2024-04-19T02:20:09.997425+0000","last_peered":"2024-04-19T02:20:09.997425+0000","last_clean":"2024-04-19T02:20:09.997425+0000","last_became_active":"2024-04-19T02:20:08.661952+0000","last_became_peered":"2024-04-19T02:20:08.661952+0000","last_unstale":"2024-04-19T02:20:09.997425+0000","last_undegraded":"2024-04-19T02:20:09.997425+0000","last_fullsized":"2024-04-19T02:20:09.997425+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:27.862187+0000","last_clean_scrub_stamp":"2024-04-19T02:15:27.862187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:28.899614+0000","last_change":"2024-04-19T02:20:28.899746+0000","last_active":"2024-04-19T02:20:28.899614+0000","last_peered":"2024-04-19T02:20:28.899614+0000","last_clean":"2024-04-19T02:20:28.899614+0000","last_became_active":"2024-04-19T02:19:54.926463+0000","last_became_peered":"2024-04-19T02:19:54.926463+0000","last_unstale":"2024-04-19T02:20:28.899614+0000","last_undegraded":"2024-04-19T02:20:28.899614+0000","last_fullsized":"2024-04-19T02:20:28.899614+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:28.899588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:28.899588+0000","last_clean_scrub_stamp":"2024-04-19T02:20:28.899588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:34:50.323413+0000","scrub_duration":0.038469191,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":108,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:28.736981+0000","last_change":"2024-04-19T02:21:28.737103+0000","last_active":"2024-04-19T02:21:28.736981+0000","last_peered":"2024-04-19T02:21:28.736981+0000","last_clean":"2024-04-19T02:21:28.736981+0000","last_became_active":"2024-04-19T02:19:54.932571+0000","last_became_peered":"2024-04-19T02:19:54.932571+0000","last_unstale":"2024-04-19T02:21:28.736981+0000","last_undegraded":"2024-04-19T02:21:28.736981+0000","last_fullsized":"2024-04-19T02:21:28.736981+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:28.736948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:28.736948+0000","last_clean_scrub_stamp":"2024-04-19T02:21:28.736948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:47:06.404175+0000","scrub_duration":0.0019713970000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"82'159","reported_seq":294,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.786721+0000","last_change":"2024-04-19T02:21:21.786721+0000","last_active":"2024-04-19T02:21:21.786721+0000","last_peered":"2024-04-19T02:21:21.786721+0000","last_clean":"2024-04-19T02:21:21.786721+0000","last_became_active":"2024-04-19T02:15:24.533420+0000","last_became_peered":"2024-04-19T02:15:24.533420+0000","last_unstale":"2024-04-19T02:21:21.786721+0000","last_undegraded":"2024-04-19T02:21:21.786721+0000","last_fullsized":"2024-04-19T02:21:21.786721+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'159","last_scrub_stamp":"2024-04-19T02:21:21.786526+0000","last_deep_scrub":"82'159","last_deep_scrub_stamp":"2024-04-19T02:21:21.786526+0000","last_clean_scrub_stamp":"2024-04-19T02:21:21.786526+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:56:17.050234+0000","scrub_duration":0.0051918429999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":53,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:22.938802+0000","last_change":"2024-04-19T02:20:22.938906+0000","last_active":"2024-04-19T02:20:22.938802+0000","last_peered":"2024-04-19T02:20:22.938802+0000","last_clean":"2024-04-19T02:20:22.938802+0000","last_became_active":"2024-04-19T02:20:10.001415+0000","last_became_peered":"2024-04-19T02:20:10.001415+0000","last_unstale":"2024-04-19T02:20:22.938802+0000","last_undegraded":"2024-04-19T02:20:22.938802+0000","last_fullsized":"2024-04-19T02:20:22.938802+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:22.938775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:22.938775+0000","last_clean_scrub_stamp":"2024-04-19T02:20:22.938775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:30:51.144263+0000","scrub_duration":0.001921898,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:27.601296+0000","last_change":"2024-04-19T02:20:27.601464+0000","last_active":"2024-04-19T02:20:27.601296+0000","last_peered":"2024-04-19T02:20:27.601296+0000","last_clean":"2024-04-19T02:20:27.601296+0000","last_became_active":"2024-04-19T02:15:29.284164+0000","last_became_peered":"2024-04-19T02:15:29.284164+0000","last_unstale":"2024-04-19T02:20:27.601296+0000","last_undegraded":"2024-04-19T02:20:27.601296+0000","last_fullsized":"2024-04-19T02:20:27.601296+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:27.601255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:27.601255+0000","last_clean_scrub_stamp":"2024-04-19T02:20:27.601255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:45:08.158116+0000","scrub_duration":0.0020462050000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:20.005757+0000","last_change":"2024-04-19T02:15:24.533912+0000","last_active":"2024-04-19T02:20:20.005757+0000","last_peered":"2024-04-19T02:20:20.005757+0000","last_clean":"2024-04-19T02:20:20.005757+0000","last_became_active":"2024-04-19T02:15:24.533580+0000","last_became_peered":"2024-04-19T02:15:24.533580+0000","last_unstale":"2024-04-19T02:20:20.005757+0000","last_undegraded":"2024-04-19T02:20:20.005757+0000","last_fullsized":"2024-04-19T02:20:20.005757+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":53,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:07.946347+0000","last_change":"2024-04-19T02:21:07.946484+0000","last_active":"2024-04-19T02:21:07.946347+0000","last_peered":"2024-04-19T02:21:07.946347+0000","last_clean":"2024-04-19T02:21:07.946347+0000","last_became_active":"2024-04-19T02:20:10.638966+0000","last_became_peered":"2024-04-19T02:20:10.638966+0000","last_unstale":"2024-04-19T02:21:07.946347+0000","last_undegraded":"2024-04-19T02:21:07.946347+0000","last_fullsized":"2024-04-19T02:21:07.946347+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:07.946312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:07.946312+0000","last_clean_scrub_stamp":"2024-04-19T02:21:07.946312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:34:25.503097+0000","scrub_duration":0.001569176,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.998577+0000","last_change":"2024-04-19T02:20:07.986363+0000","last_active":"2024-04-19T02:20:09.998577+0000","last_peered":"2024-04-19T02:20:09.998577+0000","last_clean":"2024-04-19T02:20:09.998577+0000","last_became_active":"2024-04-19T02:20:07.986110+0000","last_became_peered":"2024-04-19T02:20:07.986110+0000","last_unstale":"2024-04-19T02:20:09.998577+0000","last_undegraded":"2024-04-19T02:20:09.998577+0000","last_fullsized":"2024-04-19T02:20:09.998577+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":72,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.531462+0000","last_change":"2024-04-19T02:21:18.531610+0000","last_active":"2024-04-19T02:21:18.531462+0000","last_peered":"2024-04-19T02:21:18.531462+0000","last_clean":"2024-04-19T02:21:18.531462+0000","last_became_active":"2024-04-19T02:19:54.925570+0000","last_became_peered":"2024-04-19T02:19:54.925570+0000","last_unstale":"2024-04-19T02:21:18.531462+0000","last_undegraded":"2024-04-19T02:21:18.531462+0000","last_fullsized":"2024-04-19T02:21:18.531462+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:18.531437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:18.531437+0000","last_clean_scrub_stamp":"2024-04-19T02:21:18.531437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:58:59.944303+0000","scrub_duration":0.0019733250000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:35.000699+0000","last_change":"2024-04-19T02:21:35.000806+0000","last_active":"2024-04-19T02:21:35.000699+0000","last_peered":"2024-04-19T02:21:35.000699+0000","last_clean":"2024-04-19T02:21:35.000699+0000","last_became_active":"2024-04-19T02:19:54.929918+0000","last_became_peered":"2024-04-19T02:19:54.929918+0000","last_unstale":"2024-04-19T02:21:35.000699+0000","last_undegraded":"2024-04-19T02:21:35.000699+0000","last_fullsized":"2024-04-19T02:21:35.000699+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:35.000676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:35.000676+0000","last_clean_scrub_stamp":"2024-04-19T02:21:35.000676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:07:53.651573+0000","scrub_duration":0.001736706,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:37.609468+0000","last_change":"2024-04-19T02:21:37.609560+0000","last_active":"2024-04-19T02:21:37.609468+0000","last_peered":"2024-04-19T02:21:37.609468+0000","last_clean":"2024-04-19T02:21:37.609468+0000","last_became_active":"2024-04-19T02:15:29.280519+0000","last_became_peered":"2024-04-19T02:15:29.280519+0000","last_unstale":"2024-04-19T02:21:37.609468+0000","last_undegraded":"2024-04-19T02:21:37.609468+0000","last_fullsized":"2024-04-19T02:21:37.609468+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:37.609443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:37.609443+0000","last_clean_scrub_stamp":"2024-04-19T02:21:37.609443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:25.656619+0000","scrub_duration":0.0017652360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"82'3","reported_seq":44,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:33.975478+0000","last_change":"2024-04-19T02:21:33.975581+0000","last_active":"2024-04-19T02:21:33.975478+0000","last_peered":"2024-04-19T02:21:33.975478+0000","last_clean":"2024-04-19T02:21:33.975478+0000","last_became_active":"2024-04-19T02:19:54.928460+0000","last_became_peered":"2024-04-19T02:19:54.928460+0000","last_unstale":"2024-04-19T02:21:33.975478+0000","last_undegraded":"2024-04-19T02:21:33.975478+0000","last_fullsized":"2024-04-19T02:21:33.975478+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-19T02:21:33.975451+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-19T02:21:33.975451+0000","last_clean_scrub_stamp":"2024-04-19T02:21:33.975451+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:55:25.006115+0000","scrub_duration":0.0033633489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.999540+0000","last_change":"2024-04-19T02:20:09.998879+0000","last_active":"2024-04-19T02:20:09.999540+0000","last_peered":"2024-04-19T02:20:09.999540+0000","last_clean":"2024-04-19T02:20:09.999540+0000","last_became_active":"2024-04-19T02:20:09.998629+0000","last_became_peered":"2024-04-19T02:20:09.998629+0000","last_unstale":"2024-04-19T02:20:09.999540+0000","last_undegraded":"2024-04-19T02:20:09.999540+0000","last_fullsized":"2024-04-19T02:20:09.999540+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:23.520722+0000","last_clean_scrub_stamp":"2024-04-19T02:15:23.520722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":53,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:04.937677+0000","last_change":"2024-04-19T02:21:04.937772+0000","last_active":"2024-04-19T02:21:04.937677+0000","last_peered":"2024-04-19T02:21:04.937677+0000","last_clean":"2024-04-19T02:21:04.937677+0000","last_became_active":"2024-04-19T02:20:10.638912+0000","last_became_peered":"2024-04-19T02:20:10.638912+0000","last_unstale":"2024-04-19T02:21:04.937677+0000","last_undegraded":"2024-04-19T02:21:04.937677+0000","last_fullsized":"2024-04-19T02:21:04.937677+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:04.937654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:04.937654+0000","last_clean_scrub_stamp":"2024-04-19T02:21:04.937654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:50:59.907567+0000","scrub_duration":0.001663454,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":95,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:30.725279+0000","last_change":"2024-04-19T02:21:30.725386+0000","last_active":"2024-04-19T02:21:30.725279+0000","last_peered":"2024-04-19T02:21:30.725279+0000","last_clean":"2024-04-19T02:21:30.725279+0000","last_became_active":"2024-04-19T02:15:24.533436+0000","last_became_peered":"2024-04-19T02:15:24.533436+0000","last_unstale":"2024-04-19T02:21:30.725279+0000","last_undegraded":"2024-04-19T02:21:30.725279+0000","last_fullsized":"2024-04-19T02:21:30.725279+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:30.725253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:30.725253+0000","last_clean_scrub_stamp":"2024-04-19T02:21:30.725253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:19:28.238566+0000","scrub_duration":0.0018953679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"82'2","reported_seq":46,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:44.865916+0000","last_change":"2024-04-19T02:20:44.866016+0000","last_active":"2024-04-19T02:20:44.865916+0000","last_peered":"2024-04-19T02:20:44.865916+0000","last_clean":"2024-04-19T02:20:44.865916+0000","last_became_active":"2024-04-19T02:19:54.931328+0000","last_became_peered":"2024-04-19T02:19:54.931328+0000","last_unstale":"2024-04-19T02:20:44.865916+0000","last_undegraded":"2024-04-19T02:20:44.865916+0000","last_fullsized":"2024-04-19T02:20:44.865916+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-19T02:20:44.865892+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-19T02:20:44.865892+0000","last_clean_scrub_stamp":"2024-04-19T02:20:44.865892+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:06:18.693677+0000","scrub_duration":0.00333659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:40.611417+0000","last_change":"2024-04-19T02:20:40.611536+0000","last_active":"2024-04-19T02:20:40.611417+0000","last_peered":"2024-04-19T02:20:40.611417+0000","last_clean":"2024-04-19T02:20:40.611417+0000","last_became_active":"2024-04-19T02:15:29.280366+0000","last_became_peered":"2024-04-19T02:15:29.280366+0000","last_unstale":"2024-04-19T02:20:40.611417+0000","last_undegraded":"2024-04-19T02:20:40.611417+0000","last_fullsized":"2024-04-19T02:20:40.611417+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:40.611392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:40.611392+0000","last_clean_scrub_stamp":"2024-04-19T02:20:40.611392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:35.395252+0000","scrub_duration":0.0015883539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:26.555858+0000","last_change":"2024-04-19T02:21:26.555973+0000","last_active":"2024-04-19T02:21:26.555858+0000","last_peered":"2024-04-19T02:21:26.555858+0000","last_clean":"2024-04-19T02:21:26.555858+0000","last_became_active":"2024-04-19T02:15:28.892695+0000","last_became_peered":"2024-04-19T02:15:28.892695+0000","last_unstale":"2024-04-19T02:21:26.555858+0000","last_undegraded":"2024-04-19T02:21:26.555858+0000","last_fullsized":"2024-04-19T02:21:26.555858+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-19T02:21:26.555832+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-19T02:21:26.555832+0000","last_clean_scrub_stamp":"2024-04-19T02:21:26.555832+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:54:22.224234+0000","scrub_duration":0.001825763,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":103,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:42.629277+0000","last_change":"2024-04-19T02:20:42.629383+0000","last_active":"2024-04-19T02:20:42.629277+0000","last_peered":"2024-04-19T02:20:42.629277+0000","last_clean":"2024-04-19T02:20:42.629277+0000","last_became_active":"2024-04-19T02:19:54.929412+0000","last_became_peered":"2024-04-19T02:19:54.929412+0000","last_unstale":"2024-04-19T02:20:42.629277+0000","last_undegraded":"2024-04-19T02:20:42.629277+0000","last_fullsized":"2024-04-19T02:20:42.629277+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:42.629252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:42.629252+0000","last_clean_scrub_stamp":"2024-04-19T02:20:42.629252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:14.280965+0000","scrub_duration":0.0020287679999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"82'3","reported_seq":108,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.601787+0000","last_change":"2024-04-19T02:20:48.601893+0000","last_active":"2024-04-19T02:20:48.601787+0000","last_peered":"2024-04-19T02:20:48.601787+0000","last_clean":"2024-04-19T02:20:48.601787+0000","last_became_active":"2024-04-19T02:19:54.926630+0000","last_became_peered":"2024-04-19T02:19:54.926630+0000","last_unstale":"2024-04-19T02:20:48.601787+0000","last_undegraded":"2024-04-19T02:20:48.601787+0000","last_fullsized":"2024-04-19T02:20:48.601787+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-19T02:20:48.601762+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-19T02:20:48.601762+0000","last_clean_scrub_stamp":"2024-04-19T02:20:48.601762+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:28:54.715316+0000","scrub_duration":0.0034412739999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:23.628340+0000","last_change":"2024-04-19T02:20:23.628340+0000","last_active":"2024-04-19T02:20:23.628340+0000","last_peered":"2024-04-19T02:20:23.628340+0000","last_clean":"2024-04-19T02:20:23.628340+0000","last_became_active":"2024-04-19T02:19:54.931328+0000","last_became_peered":"2024-04-19T02:19:54.931328+0000","last_unstale":"2024-04-19T02:20:23.628340+0000","last_undegraded":"2024-04-19T02:20:23.628340+0000","last_fullsized":"2024-04-19T02:20:23.628340+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:23.628182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:23.628182+0000","last_clean_scrub_stamp":"2024-04-19T02:20:23.628182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:41:07.461430+0000","scrub_duration":0.042718649999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"82'3","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:33.586083+0000","last_change":"2024-04-19T02:21:33.586193+0000","last_active":"2024-04-19T02:21:33.586083+0000","last_peered":"2024-04-19T02:21:33.586083+0000","last_clean":"2024-04-19T02:21:33.586083+0000","last_became_active":"2024-04-19T02:15:28.892881+0000","last_became_peered":"2024-04-19T02:15:28.892881+0000","last_unstale":"2024-04-19T02:21:33.586083+0000","last_undegraded":"2024-04-19T02:21:33.586083+0000","last_fullsized":"2024-04-19T02:21:33.586083+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-19T02:21:33.586060+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-19T02:21:33.586060+0000","last_clean_scrub_stamp":"2024-04-19T02:21:33.586060+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:49:54.321957+0000","scrub_duration":0.0029867259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:21.614064+0000","last_change":"2024-04-19T02:20:21.614064+0000","last_active":"2024-04-19T02:20:21.614064+0000","last_peered":"2024-04-19T02:20:21.614064+0000","last_clean":"2024-04-19T02:20:21.614064+0000","last_became_active":"2024-04-19T02:19:54.923752+0000","last_became_peered":"2024-04-19T02:19:54.923752+0000","last_unstale":"2024-04-19T02:20:21.614064+0000","last_undegraded":"2024-04-19T02:20:21.614064+0000","last_fullsized":"2024-04-19T02:20:21.614064+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:21.613938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:21.613938+0000","last_clean_scrub_stamp":"2024-04-19T02:20:21.613938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:28:11.041024+0000","scrub_duration":0.0017798099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":43,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:06.947305+0000","last_change":"2024-04-19T02:21:06.947478+0000","last_active":"2024-04-19T02:21:06.947305+0000","last_peered":"2024-04-19T02:21:06.947305+0000","last_clean":"2024-04-19T02:21:06.947305+0000","last_became_active":"2024-04-19T02:19:54.932103+0000","last_became_peered":"2024-04-19T02:19:54.932103+0000","last_unstale":"2024-04-19T02:21:06.947305+0000","last_undegraded":"2024-04-19T02:21:06.947305+0000","last_fullsized":"2024-04-19T02:21:06.947305+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-19T02:21:06.947264+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-19T02:21:06.947264+0000","last_clean_scrub_stamp":"2024-04-19T02:21:06.947264+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:25:28.987258+0000","scrub_duration":0.001632035,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":103,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:36.664629+0000","last_change":"2024-04-19T02:21:36.664716+0000","last_active":"2024-04-19T02:21:36.664629+0000","last_peered":"2024-04-19T02:21:36.664629+0000","last_clean":"2024-04-19T02:21:36.664629+0000","last_became_active":"2024-04-19T02:19:54.925565+0000","last_became_peered":"2024-04-19T02:19:54.925565+0000","last_unstale":"2024-04-19T02:21:36.664629+0000","last_undegraded":"2024-04-19T02:21:36.664629+0000","last_fullsized":"2024-04-19T02:21:36.664629+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:36.664595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:36.664595+0000","last_clean_scrub_stamp":"2024-04-19T02:21:36.664595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:16:08.044759+0000","scrub_duration":0.020876051999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":45,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.977574+0000","last_change":"2024-04-19T02:21:00.977681+0000","last_active":"2024-04-19T02:21:00.977574+0000","last_peered":"2024-04-19T02:21:00.977574+0000","last_clean":"2024-04-19T02:21:00.977574+0000","last_became_active":"2024-04-19T02:19:54.926439+0000","last_became_peered":"2024-04-19T02:19:54.926439+0000","last_unstale":"2024-04-19T02:21:00.977574+0000","last_undegraded":"2024-04-19T02:21:00.977574+0000","last_fullsized":"2024-04-19T02:21:00.977574+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'6","last_scrub_stamp":"2024-04-19T02:21:00.977547+0000","last_deep_scrub":"82'6","last_deep_scrub_stamp":"2024-04-19T02:21:00.977547+0000","last_clean_scrub_stamp":"2024-04-19T02:21:00.977547+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:36:06.474124+0000","scrub_duration":0.0050912479999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:46.634857+0000","last_change":"2024-04-19T02:20:46.634995+0000","last_active":"2024-04-19T02:20:46.634857+0000","last_peered":"2024-04-19T02:20:46.634857+0000","last_clean":"2024-04-19T02:20:46.634857+0000","last_became_active":"2024-04-19T02:19:54.930665+0000","last_became_peered":"2024-04-19T02:19:54.930665+0000","last_unstale":"2024-04-19T02:20:46.634857+0000","last_undegraded":"2024-04-19T02:20:46.634857+0000","last_fullsized":"2024-04-19T02:20:46.634857+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:46.634833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:46.634833+0000","last_clean_scrub_stamp":"2024-04-19T02:20:46.634833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:58:28.047698+0000","scrub_duration":0.001963645,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:14.819754+0000","last_change":"2024-04-19T02:21:14.819858+0000","last_active":"2024-04-19T02:21:14.819754+0000","last_peered":"2024-04-19T02:21:14.819754+0000","last_clean":"2024-04-19T02:21:14.819754+0000","last_became_active":"2024-04-19T02:19:54.930527+0000","last_became_peered":"2024-04-19T02:19:54.930527+0000","last_unstale":"2024-04-19T02:21:14.819754+0000","last_undegraded":"2024-04-19T02:21:14.819754+0000","last_fullsized":"2024-04-19T02:21:14.819754+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:14.819731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:14.819731+0000","last_clean_scrub_stamp":"2024-04-19T02:21:14.819731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:24:42.325450+0000","scrub_duration":0.001789131,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.002363+0000","last_change":"2024-04-19T02:20:10.001589+0000","last_active":"2024-04-19T02:20:10.002363+0000","last_peered":"2024-04-19T02:20:10.002363+0000","last_clean":"2024-04-19T02:20:10.002363+0000","last_became_active":"2024-04-19T02:20:10.001304+0000","last_became_peered":"2024-04-19T02:20:10.001304+0000","last_unstale":"2024-04-19T02:20:10.002363+0000","last_undegraded":"2024-04-19T02:20:10.002363+0000","last_fullsized":"2024-04-19T02:20:10.002363+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.998017+0000","last_change":"2024-04-19T02:20:08.662331+0000","last_active":"2024-04-19T02:20:09.998017+0000","last_peered":"2024-04-19T02:20:09.998017+0000","last_clean":"2024-04-19T02:20:09.998017+0000","last_became_active":"2024-04-19T02:20:08.661996+0000","last_became_peered":"2024-04-19T02:20:08.661996+0000","last_unstale":"2024-04-19T02:20:09.998017+0000","last_undegraded":"2024-04-19T02:20:09.998017+0000","last_fullsized":"2024-04-19T02:20:09.998017+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:10.002397+0000","last_change":"2024-04-19T02:20:10.001706+0000","last_active":"2024-04-19T02:20:10.002397+0000","last_peered":"2024-04-19T02:20:10.002397+0000","last_clean":"2024-04-19T02:20:10.002397+0000","last_became_active":"2024-04-19T02:20:10.001372+0000","last_became_peered":"2024-04-19T02:20:10.001372+0000","last_unstale":"2024-04-19T02:20:10.002397+0000","last_undegraded":"2024-04-19T02:20:10.002397+0000","last_fullsized":"2024-04-19T02:20:10.002397+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.500038+0000","last_change":"2024-04-19T02:21:20.500137+0000","last_active":"2024-04-19T02:21:20.500038+0000","last_peered":"2024-04-19T02:21:20.500038+0000","last_clean":"2024-04-19T02:21:20.500038+0000","last_became_active":"2024-04-19T02:15:29.276725+0000","last_became_peered":"2024-04-19T02:15:29.276725+0000","last_unstale":"2024-04-19T02:21:20.500038+0000","last_undegraded":"2024-04-19T02:21:20.500038+0000","last_fullsized":"2024-04-19T02:21:20.500038+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:20.500012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:20.500012+0000","last_clean_scrub_stamp":"2024-04-19T02:21:20.500012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:29:26.613566+0000","scrub_duration":0.001700163,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5254,"internal_metadata":0},"log_size":53,"ondisk_log_size":53,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":72,"seq":309237645335,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58812,"kb_used_data":884,"kb_used_omap":6,"kb_used_meta":57913,"kb_avail":94313028,"statfs":{"total":96636764160,"available":96576540672,"internally_reserved":0,"allocated":905216,"data_stored":358135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6848,"internal_metadata":59303232},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:20:54 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.50800000000000001}]},{"osd":1,"last update":"Fri Apr 19 02:20:54 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.53400000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738447,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":275412,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":273918,"kb_avail":94096428,"statfs":{"total":96636764160,"available":96354742272,"internally_reserved":0,"allocated":1519616,"data_stored":948136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":280492486},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 02:21:29 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.441,"15min":0.33900000000000002},"min":{"1min":0.35299999999999998,"5min":0.17599999999999999,"15min":0.159},"max":{"1min":0.56399999999999995,"5min":4.4480000000000004,"15min":4.4480000000000004},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.41399999999999998,"15min":0.378},"min":{"1min":0.33300000000000002,"5min":0.19,"15min":0.17199999999999999},"max":{"1min":0.56299999999999994,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.47299999999999998}]},{"osd":2,"last update":"Fri Apr 19 02:20:56 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.57199999999999995}]}]},{"osd":1,"up_from":8,"seq":34359738446,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307408,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":305918,"kb_avail":94064432,"statfs":{"total":96636764160,"available":96321978368,"internally_reserved":0,"allocated":1515520,"data_stored":949633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":313260486},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:21:31 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.45400000000000001,"15min":0.39200000000000002},"min":{"1min":0.36399999999999999,"5min":0.157,"15min":0.157},"max":{"1min":0.60599999999999998,"5min":1.794,"15min":1.794},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.45300000000000001,"15min":0.34799999999999998},"min":{"1min":0.35499999999999998,"5min":0.17100000000000001,"15min":0.16},"max":{"1min":0.64500000000000002,"5min":2.411,"15min":2.411},"last":0.53500000000000003}]},{"osd":2,"last update":"Fri Apr 19 02:20:54 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.58999999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5254,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:21:42.833 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:42.833 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:42.833 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:42.833 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:42.834 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:42.834 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:42.834 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:42.834 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:42.834 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:42.834 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:42.834 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:42.835 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:42.835 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:42.835 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:42.835 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:42.835 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:42.835 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:42.836 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:42.836 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:42.836 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-19T02:15:23.520722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:42.836 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:42.836 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-19T02:15:27.862187+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=27, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:42.836 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-19T02:15:23.520722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:42.837 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:42.837 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-19T02:15:23.520722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=23, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:42.837 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:42.837 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:42.837 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:21:42.837 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-19T02:22:02.838 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:22:03.179 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:22:03.181 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-04-19T02:22:03.189 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":278,"stamp":"2024-04-19T02:22:02.840665+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":220,"ondisk_log_size":220,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":641632,"kb_used_data":3848,"kb_used_omap":9,"kb_used_meta":637750,"kb_avail":282473888,"statfs":{"total":289910292480,"available":289253261312,"internally_reserved":0,"allocated":3940352,"data_stored":2255904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10036,"internal_metadata":653056204},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003106"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:44.754184+0000","last_change":"2024-04-19T02:20:44.754184+0000","last_active":"2024-04-19T02:20:44.754184+0000","last_peered":"2024-04-19T02:20:44.754184+0000","last_clean":"2024-04-19T02:20:44.754184+0000","last_became_active":"2024-04-19T02:19:54.929435+0000","last_became_peered":"2024-04-19T02:19:54.929435+0000","last_unstale":"2024-04-19T02:20:44.754184+0000","last_undegraded":"2024-04-19T02:20:44.754184+0000","last_fullsized":"2024-04-19T02:20:44.754184+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:44.754035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:44.754035+0000","last_clean_scrub_stamp":"2024-04-19T02:20:44.754035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:46:01.301053+0000","scrub_duration":0.089914654999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:52.728989+0000","last_change":"2024-04-19T02:20:52.728989+0000","last_active":"2024-04-19T02:20:52.728989+0000","last_peered":"2024-04-19T02:20:52.728989+0000","last_clean":"2024-04-19T02:20:52.728989+0000","last_became_active":"2024-04-19T02:19:54.931278+0000","last_became_peered":"2024-04-19T02:19:54.931278+0000","last_unstale":"2024-04-19T02:20:52.728989+0000","last_undegraded":"2024-04-19T02:20:52.728989+0000","last_fullsized":"2024-04-19T02:20:52.728989+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:52.728860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:52.728860+0000","last_clean_scrub_stamp":"2024-04-19T02:20:52.728860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:55:28.628918+0000","scrub_duration":0.0016468570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:35.678916+0000","last_change":"2024-04-19T02:20:35.678916+0000","last_active":"2024-04-19T02:20:35.678916+0000","last_peered":"2024-04-19T02:20:35.678916+0000","last_clean":"2024-04-19T02:20:35.678916+0000","last_became_active":"2024-04-19T02:15:29.286169+0000","last_became_peered":"2024-04-19T02:15:29.286169+0000","last_unstale":"2024-04-19T02:20:35.678916+0000","last_undegraded":"2024-04-19T02:20:35.678916+0000","last_fullsized":"2024-04-19T02:20:35.678916+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:35.678786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:35.678786+0000","last_clean_scrub_stamp":"2024-04-19T02:20:35.678786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:39:46.619486+0000","scrub_duration":0.0021837459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":105,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:48.579011+0000","last_change":"2024-04-19T02:21:48.579106+0000","last_active":"2024-04-19T02:21:48.579011+0000","last_peered":"2024-04-19T02:21:48.579011+0000","last_clean":"2024-04-19T02:21:48.579011+0000","last_became_active":"2024-04-19T02:19:54.926046+0000","last_became_peered":"2024-04-19T02:19:54.926046+0000","last_unstale":"2024-04-19T02:21:48.579011+0000","last_undegraded":"2024-04-19T02:21:48.579011+0000","last_fullsized":"2024-04-19T02:21:48.579011+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:48.578974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:48.578974+0000","last_clean_scrub_stamp":"2024-04-19T02:21:48.578974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:46:01.755309+0000","scrub_duration":0.001818987,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":68,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:59.656793+0000","last_change":"2024-04-19T02:20:59.656898+0000","last_active":"2024-04-19T02:20:59.656793+0000","last_peered":"2024-04-19T02:20:59.656793+0000","last_clean":"2024-04-19T02:20:59.656793+0000","last_became_active":"2024-04-19T02:19:54.931435+0000","last_became_peered":"2024-04-19T02:19:54.931435+0000","last_unstale":"2024-04-19T02:20:59.656793+0000","last_undegraded":"2024-04-19T02:20:59.656793+0000","last_fullsized":"2024-04-19T02:20:59.656793+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:59.656767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:59.656767+0000","last_clean_scrub_stamp":"2024-04-19T02:20:59.656767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:45:40.213629+0000","scrub_duration":0.021141032000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:54.564261+0000","last_change":"2024-04-19T02:21:54.564397+0000","last_active":"2024-04-19T02:21:54.564261+0000","last_peered":"2024-04-19T02:21:54.564261+0000","last_clean":"2024-04-19T02:21:54.564261+0000","last_became_active":"2024-04-19T02:19:54.923984+0000","last_became_peered":"2024-04-19T02:19:54.923984+0000","last_unstale":"2024-04-19T02:21:54.564261+0000","last_undegraded":"2024-04-19T02:21:54.564261+0000","last_fullsized":"2024-04-19T02:21:54.564261+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:54.564237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:54.564237+0000","last_clean_scrub_stamp":"2024-04-19T02:21:54.564237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:09:26.947673+0000","scrub_duration":0.0018582099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:45.640394+0000","last_change":"2024-04-19T02:20:45.640499+0000","last_active":"2024-04-19T02:20:45.640394+0000","last_peered":"2024-04-19T02:20:45.640394+0000","last_clean":"2024-04-19T02:20:45.640394+0000","last_became_active":"2024-04-19T02:19:54.925529+0000","last_became_peered":"2024-04-19T02:19:54.925529+0000","last_unstale":"2024-04-19T02:20:45.640394+0000","last_undegraded":"2024-04-19T02:20:45.640394+0000","last_fullsized":"2024-04-19T02:20:45.640394+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:45.640369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:45.640369+0000","last_clean_scrub_stamp":"2024-04-19T02:20:45.640369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:09:00.709082+0000","scrub_duration":0.022321161999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:52.504735+0000","last_change":"2024-04-19T02:21:52.504839+0000","last_active":"2024-04-19T02:21:52.504735+0000","last_peered":"2024-04-19T02:21:52.504735+0000","last_clean":"2024-04-19T02:21:52.504735+0000","last_became_active":"2024-04-19T02:19:54.930075+0000","last_became_peered":"2024-04-19T02:19:54.930075+0000","last_unstale":"2024-04-19T02:21:52.504735+0000","last_undegraded":"2024-04-19T02:21:52.504735+0000","last_fullsized":"2024-04-19T02:21:52.504735+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:52.504710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:52.504710+0000","last_clean_scrub_stamp":"2024-04-19T02:21:52.504710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:26:23.927242+0000","scrub_duration":0.0017157870000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:39.837203+0000","last_change":"2024-04-19T02:20:39.837337+0000","last_active":"2024-04-19T02:20:39.837203+0000","last_peered":"2024-04-19T02:20:39.837203+0000","last_clean":"2024-04-19T02:20:39.837203+0000","last_became_active":"2024-04-19T02:19:54.928496+0000","last_became_peered":"2024-04-19T02:19:54.928496+0000","last_unstale":"2024-04-19T02:20:39.837203+0000","last_undegraded":"2024-04-19T02:20:39.837203+0000","last_fullsized":"2024-04-19T02:20:39.837203+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:39.837177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:39.837177+0000","last_clean_scrub_stamp":"2024-04-19T02:20:39.837177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:32:07.735631+0000","scrub_duration":0.037239790000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":62,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:20.006226+0000","last_change":"2024-04-19T02:16:30.093524+0000","last_active":"2024-04-19T02:20:20.006226+0000","last_peered":"2024-04-19T02:20:20.006226+0000","last_clean":"2024-04-19T02:20:20.006226+0000","last_became_active":"2024-04-19T02:16:30.093344+0000","last_became_peered":"2024-04-19T02:16:30.093344+0000","last_unstale":"2024-04-19T02:20:20.006226+0000","last_undegraded":"2024-04-19T02:20:20.006226+0000","last_fullsized":"2024-04-19T02:20:20.006226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:20.006224+0000","last_change":"2024-04-19T02:19:54.926754+0000","last_active":"2024-04-19T02:20:20.006224+0000","last_peered":"2024-04-19T02:20:20.006224+0000","last_clean":"2024-04-19T02:20:20.006224+0000","last_became_active":"2024-04-19T02:19:54.926040+0000","last_became_peered":"2024-04-19T02:19:54.926040+0000","last_unstale":"2024-04-19T02:20:20.006224+0000","last_undegraded":"2024-04-19T02:20:20.006224+0000","last_fullsized":"2024-04-19T02:20:20.006224+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:09.998087+0000","last_change":"2024-04-19T02:20:08.662601+0000","last_active":"2024-04-19T02:20:09.998087+0000","last_peered":"2024-04-19T02:20:09.998087+0000","last_clean":"2024-04-19T02:20:09.998087+0000","last_became_active":"2024-04-19T02:20:08.662234+0000","last_became_peered":"2024-04-19T02:20:08.662234+0000","last_unstale":"2024-04-19T02:20:09.998087+0000","last_undegraded":"2024-04-19T02:20:09.998087+0000","last_fullsized":"2024-04-19T02:20:09.998087+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:15:28.871717+0000","last_clean_scrub_stamp":"2024-04-19T02:15:28.871717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":68,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:24.574781+0000","last_change":"2024-04-19T02:20:24.574893+0000","last_active":"2024-04-19T02:20:24.574781+0000","last_peered":"2024-04-19T02:20:24.574781+0000","last_clean":"2024-04-19T02:20:24.574781+0000","last_became_active":"2024-04-19T02:19:54.932240+0000","last_became_peered":"2024-04-19T02:19:54.932240+0000","last_unstale":"2024-04-19T02:20:24.574781+0000","last_undegraded":"2024-04-19T02:20:24.574781+0000","last_fullsized":"2024-04-19T02:20:24.574781+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:24.574756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:24.574756+0000","last_clean_scrub_stamp":"2024-04-19T02:20:24.574756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:05:16.137888+0000","scrub_duration":0.02235088,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:52.533209+0000","last_change":"2024-04-19T02:20:52.533329+0000","last_active":"2024-04-19T02:20:52.533209+0000","last_peered":"2024-04-19T02:20:52.533209+0000","last_clean":"2024-04-19T02:20:52.533209+0000","last_became_active":"2024-04-19T02:15:29.283121+0000","last_became_peered":"2024-04-19T02:15:29.283121+0000","last_unstale":"2024-04-19T02:20:52.533209+0000","last_undegraded":"2024-04-19T02:20:52.533209+0000","last_fullsized":"2024-04-19T02:20:52.533209+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:52.533183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:52.533183+0000","last_clean_scrub_stamp":"2024-04-19T02:20:52.533183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:46:09.200215+0000","scrub_duration":0.0015891010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:01.631997+0000","last_change":"2024-04-19T02:21:01.632133+0000","last_active":"2024-04-19T02:21:01.631997+0000","last_peered":"2024-04-19T02:21:01.631997+0000","last_clean":"2024-04-19T02:21:01.631997+0000","last_became_active":"2024-04-19T02:15:29.284649+0000","last_became_peered":"2024-04-19T02:15:29.284649+0000","last_unstale":"2024-04-19T02:21:01.631997+0000","last_undegraded":"2024-04-19T02:21:01.631997+0000","last_fullsized":"2024-04-19T02:21:01.631997+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:01.631972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:01.631972+0000","last_clean_scrub_stamp":"2024-04-19T02:21:01.631972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:49:22.367870+0000","scrub_duration":0.001884562,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:20.567013+0000","last_change":"2024-04-19T02:20:20.567149+0000","last_active":"2024-04-19T02:20:20.567013+0000","last_peered":"2024-04-19T02:20:20.567013+0000","last_clean":"2024-04-19T02:20:20.567013+0000","last_became_active":"2024-04-19T02:19:54.930437+0000","last_became_peered":"2024-04-19T02:19:54.930437+0000","last_unstale":"2024-04-19T02:20:20.567013+0000","last_undegraded":"2024-04-19T02:20:20.567013+0000","last_fullsized":"2024-04-19T02:20:20.567013+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:20.566972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:20.566972+0000","last_clean_scrub_stamp":"2024-04-19T02:20:20.566972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:59:10.317082+0000","scrub_duration":0.00187685,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":52,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:47.983183+0000","last_change":"2024-04-19T02:21:47.983289+0000","last_active":"2024-04-19T02:21:47.983183+0000","last_peered":"2024-04-19T02:21:47.983183+0000","last_clean":"2024-04-19T02:21:47.983183+0000","last_became_active":"2024-04-19T02:20:10.001343+0000","last_became_peered":"2024-04-19T02:20:10.001343+0000","last_unstale":"2024-04-19T02:21:47.983183+0000","last_undegraded":"2024-04-19T02:21:47.983183+0000","last_fullsized":"2024-04-19T02:21:47.983183+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:47.983159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:47.983159+0000","last_clean_scrub_stamp":"2024-04-19T02:21:47.983159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:20:39.994026+0000","scrub_duration":0.100474256,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":103,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:04.663105+0000","last_change":"2024-04-19T02:21:04.663219+0000","last_active":"2024-04-19T02:21:04.663105+0000","last_peered":"2024-04-19T02:21:04.663105+0000","last_clean":"2024-04-19T02:21:04.663105+0000","last_became_active":"2024-04-19T02:19:54.933233+0000","last_became_peered":"2024-04-19T02:19:54.933233+0000","last_unstale":"2024-04-19T02:21:04.663105+0000","last_undegraded":"2024-04-19T02:21:04.663105+0000","last_fullsized":"2024-04-19T02:21:04.663105+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:04.663080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:04.663080+0000","last_clean_scrub_stamp":"2024-04-19T02:21:04.663080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:24:22.993742+0000","scrub_duration":0.0015971410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:29.030999+0000","last_change":"2024-04-19T02:21:29.031138+0000","last_active":"2024-04-19T02:21:29.030999+0000","last_peered":"2024-04-19T02:21:29.030999+0000","last_clean":"2024-04-19T02:21:29.030999+0000","last_became_active":"2024-04-19T02:19:54.925060+0000","last_became_peered":"2024-04-19T02:19:54.925060+0000","last_unstale":"2024-04-19T02:21:29.030999+0000","last_undegraded":"2024-04-19T02:21:29.030999+0000","last_fullsized":"2024-04-19T02:21:29.030999+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:29.030973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:29.030973+0000","last_clean_scrub_stamp":"2024-04-19T02:21:29.030973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:34.156200+0000","scrub_duration":0.036993951999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:32.721522+0000","last_change":"2024-04-19T02:20:32.721654+0000","last_active":"2024-04-19T02:20:32.721522+0000","last_peered":"2024-04-19T02:20:32.721522+0000","last_clean":"2024-04-19T02:20:32.721522+0000","last_became_active":"2024-04-19T02:19:54.926442+0000","last_became_peered":"2024-04-19T02:19:54.926442+0000","last_unstale":"2024-04-19T02:20:32.721522+0000","last_undegraded":"2024-04-19T02:20:32.721522+0000","last_fullsized":"2024-04-19T02:20:32.721522+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:32.721479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:32.721479+0000","last_clean_scrub_stamp":"2024-04-19T02:20:32.721479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:23:51.052141+0000","scrub_duration":0.0020564210000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:53.574438+0000","last_change":"2024-04-19T02:21:53.574568+0000","last_active":"2024-04-19T02:21:53.574438+0000","last_peered":"2024-04-19T02:21:53.574438+0000","last_clean":"2024-04-19T02:21:53.574438+0000","last_became_active":"2024-04-19T02:19:54.931438+0000","last_became_peered":"2024-04-19T02:19:54.931438+0000","last_unstale":"2024-04-19T02:21:53.574438+0000","last_undegraded":"2024-04-19T02:21:53.574438+0000","last_fullsized":"2024-04-19T02:21:53.574438+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:53.574412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:53.574412+0000","last_clean_scrub_stamp":"2024-04-19T02:21:53.574412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:06:16.951422+0000","scrub_duration":0.031250192000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:56.579508+0000","last_change":"2024-04-19T02:21:56.579617+0000","last_active":"2024-04-19T02:21:56.579508+0000","last_peered":"2024-04-19T02:21:56.579508+0000","last_clean":"2024-04-19T02:21:56.579508+0000","last_became_active":"2024-04-19T02:20:08.661940+0000","last_became_peered":"2024-04-19T02:20:08.661940+0000","last_unstale":"2024-04-19T02:21:56.579508+0000","last_undegraded":"2024-04-19T02:21:56.579508+0000","last_fullsized":"2024-04-19T02:21:56.579508+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:56.579482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:56.579482+0000","last_clean_scrub_stamp":"2024-04-19T02:21:56.579482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:41:20.227858+0000","scrub_duration":0.001865947,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":53,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:38.921664+0000","last_change":"2024-04-19T02:21:38.921808+0000","last_active":"2024-04-19T02:21:38.921664+0000","last_peered":"2024-04-19T02:21:38.921664+0000","last_clean":"2024-04-19T02:21:38.921664+0000","last_became_active":"2024-04-19T02:20:10.639036+0000","last_became_peered":"2024-04-19T02:20:10.639036+0000","last_unstale":"2024-04-19T02:21:38.921664+0000","last_undegraded":"2024-04-19T02:21:38.921664+0000","last_fullsized":"2024-04-19T02:21:38.921664+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:38.921639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:38.921639+0000","last_clean_scrub_stamp":"2024-04-19T02:21:38.921639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:29:01.933583+0000","scrub_duration":0.0017929129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":103,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:54.722505+0000","last_change":"2024-04-19T02:20:54.722628+0000","last_active":"2024-04-19T02:20:54.722505+0000","last_peered":"2024-04-19T02:20:54.722505+0000","last_clean":"2024-04-19T02:20:54.722505+0000","last_became_active":"2024-04-19T02:19:54.928261+0000","last_became_peered":"2024-04-19T02:19:54.928261+0000","last_unstale":"2024-04-19T02:20:54.722505+0000","last_undegraded":"2024-04-19T02:20:54.722505+0000","last_fullsized":"2024-04-19T02:20:54.722505+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:54.722476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:54.722476+0000","last_clean_scrub_stamp":"2024-04-19T02:20:54.722476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:41:38.555723+0000","scrub_duration":0.0018882219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:41.635924+0000","last_change":"2024-04-19T02:20:41.636049+0000","last_active":"2024-04-19T02:20:41.635924+0000","last_peered":"2024-04-19T02:20:41.635924+0000","last_clean":"2024-04-19T02:20:41.635924+0000","last_became_active":"2024-04-19T02:15:29.276952+0000","last_became_peered":"2024-04-19T02:15:29.276952+0000","last_unstale":"2024-04-19T02:20:41.635924+0000","last_undegraded":"2024-04-19T02:20:41.635924+0000","last_fullsized":"2024-04-19T02:20:41.635924+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:41.635899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:41.635899+0000","last_clean_scrub_stamp":"2024-04-19T02:20:41.635899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:02:03.442021+0000","scrub_duration":0.035233386999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:36.825318+0000","last_change":"2024-04-19T02:20:36.825423+0000","last_active":"2024-04-19T02:20:36.825318+0000","last_peered":"2024-04-19T02:20:36.825318+0000","last_clean":"2024-04-19T02:20:36.825318+0000","last_became_active":"2024-04-19T02:19:54.931124+0000","last_became_peered":"2024-04-19T02:19:54.931124+0000","last_unstale":"2024-04-19T02:20:36.825318+0000","last_undegraded":"2024-04-19T02:20:36.825318+0000","last_fullsized":"2024-04-19T02:20:36.825318+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:36.825293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:36.825293+0000","last_clean_scrub_stamp":"2024-04-19T02:20:36.825293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:26:48.954624+0000","scrub_duration":0.0020341249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:55.558345+0000","last_change":"2024-04-19T02:21:55.558483+0000","last_active":"2024-04-19T02:21:55.558345+0000","last_peered":"2024-04-19T02:21:55.558345+0000","last_clean":"2024-04-19T02:21:55.558345+0000","last_became_active":"2024-04-19T02:15:29.286431+0000","last_became_peered":"2024-04-19T02:15:29.286431+0000","last_unstale":"2024-04-19T02:21:55.558345+0000","last_undegraded":"2024-04-19T02:21:55.558345+0000","last_fullsized":"2024-04-19T02:21:55.558345+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:55.558322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:55.558322+0000","last_clean_scrub_stamp":"2024-04-19T02:21:55.558322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:01:47.471071+0000","scrub_duration":0.0018107189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:07.561762+0000","last_change":"2024-04-19T02:21:07.561888+0000","last_active":"2024-04-19T02:21:07.561762+0000","last_peered":"2024-04-19T02:21:07.561762+0000","last_clean":"2024-04-19T02:21:07.561762+0000","last_became_active":"2024-04-19T02:19:54.926838+0000","last_became_peered":"2024-04-19T02:19:54.926838+0000","last_unstale":"2024-04-19T02:21:07.561762+0000","last_undegraded":"2024-04-19T02:21:07.561762+0000","last_fullsized":"2024-04-19T02:21:07.561762+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-19T02:21:07.561735+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-19T02:21:07.561735+0000","last_clean_scrub_stamp":"2024-04-19T02:21:07.561735+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:40:18.502435+0000","scrub_duration":0.001800028,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:17.504243+0000","last_change":"2024-04-19T02:21:17.504338+0000","last_active":"2024-04-19T02:21:17.504243+0000","last_peered":"2024-04-19T02:21:17.504243+0000","last_clean":"2024-04-19T02:21:17.504243+0000","last_became_active":"2024-04-19T02:15:29.280479+0000","last_became_peered":"2024-04-19T02:15:29.280479+0000","last_unstale":"2024-04-19T02:21:17.504243+0000","last_undegraded":"2024-04-19T02:21:17.504243+0000","last_fullsized":"2024-04-19T02:21:17.504243+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:17.504211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:17.504211+0000","last_clean_scrub_stamp":"2024-04-19T02:21:17.504211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:09:32.572924+0000","scrub_duration":0.001817379,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.012839+0000","last_change":"2024-04-19T02:21:18.012939+0000","last_active":"2024-04-19T02:21:18.012839+0000","last_peered":"2024-04-19T02:21:18.012839+0000","last_clean":"2024-04-19T02:21:18.012839+0000","last_became_active":"2024-04-19T02:19:54.924484+0000","last_became_peered":"2024-04-19T02:19:54.924484+0000","last_unstale":"2024-04-19T02:21:18.012839+0000","last_undegraded":"2024-04-19T02:21:18.012839+0000","last_fullsized":"2024-04-19T02:21:18.012839+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:18.012814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:18.012814+0000","last_clean_scrub_stamp":"2024-04-19T02:21:18.012814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:22:58.977653+0000","scrub_duration":0.0018265969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":54,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:57.920291+0000","last_change":"2024-04-19T02:21:57.920396+0000","last_active":"2024-04-19T02:21:57.920291+0000","last_peered":"2024-04-19T02:21:57.920291+0000","last_clean":"2024-04-19T02:21:57.920291+0000","last_became_active":"2024-04-19T02:20:10.638737+0000","last_became_peered":"2024-04-19T02:20:10.638737+0000","last_unstale":"2024-04-19T02:21:57.920291+0000","last_undegraded":"2024-04-19T02:21:57.920291+0000","last_fullsized":"2024-04-19T02:21:57.920291+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:57.920266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:57.920266+0000","last_clean_scrub_stamp":"2024-04-19T02:21:57.920266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:23:45.757644+0000","scrub_duration":0.0018666679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:08.944585+0000","last_change":"2024-04-19T02:21:08.944722+0000","last_active":"2024-04-19T02:21:08.944585+0000","last_peered":"2024-04-19T02:21:08.944585+0000","last_clean":"2024-04-19T02:21:08.944585+0000","last_became_active":"2024-04-19T02:19:54.928398+0000","last_became_peered":"2024-04-19T02:19:54.928398+0000","last_unstale":"2024-04-19T02:21:08.944585+0000","last_undegraded":"2024-04-19T02:21:08.944585+0000","last_fullsized":"2024-04-19T02:21:08.944585+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:08.944563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:08.944563+0000","last_clean_scrub_stamp":"2024-04-19T02:21:08.944563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:16:16.242584+0000","scrub_duration":0.0016415690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:34.630281+0000","last_change":"2024-04-19T02:20:34.630281+0000","last_active":"2024-04-19T02:20:34.630281+0000","last_peered":"2024-04-19T02:20:34.630281+0000","last_clean":"2024-04-19T02:20:34.630281+0000","last_became_active":"2024-04-19T02:15:29.279314+0000","last_became_peered":"2024-04-19T02:15:29.279314+0000","last_unstale":"2024-04-19T02:20:34.630281+0000","last_undegraded":"2024-04-19T02:20:34.630281+0000","last_fullsized":"2024-04-19T02:20:34.630281+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:34.630122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:34.630122+0000","last_clean_scrub_stamp":"2024-04-19T02:20:34.630122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:19:42.256810+0000","scrub_duration":0.066969174000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:47.942738+0000","last_change":"2024-04-19T02:20:47.942846+0000","last_active":"2024-04-19T02:20:47.942738+0000","last_peered":"2024-04-19T02:20:47.942738+0000","last_clean":"2024-04-19T02:20:47.942738+0000","last_became_active":"2024-04-19T02:19:54.925729+0000","last_became_peered":"2024-04-19T02:19:54.925729+0000","last_unstale":"2024-04-19T02:20:47.942738+0000","last_undegraded":"2024-04-19T02:20:47.942738+0000","last_fullsized":"2024-04-19T02:20:47.942738+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:47.942715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:47.942715+0000","last_clean_scrub_stamp":"2024-04-19T02:20:47.942715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:53:52.743256+0000","scrub_duration":0.001689886,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:15.993647+0000","last_change":"2024-04-19T02:21:15.993771+0000","last_active":"2024-04-19T02:21:15.993647+0000","last_peered":"2024-04-19T02:21:15.993647+0000","last_clean":"2024-04-19T02:21:15.993647+0000","last_became_active":"2024-04-19T02:19:54.927666+0000","last_became_peered":"2024-04-19T02:19:54.927666+0000","last_unstale":"2024-04-19T02:21:15.993647+0000","last_undegraded":"2024-04-19T02:21:15.993647+0000","last_fullsized":"2024-04-19T02:21:15.993647+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:15.993623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:15.993623+0000","last_clean_scrub_stamp":"2024-04-19T02:21:15.993623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:45.212212+0000","scrub_duration":0.0019736129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":105,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:05.779304+0000","last_change":"2024-04-19T02:21:05.779445+0000","last_active":"2024-04-19T02:21:05.779304+0000","last_peered":"2024-04-19T02:21:05.779304+0000","last_clean":"2024-04-19T02:21:05.779304+0000","last_became_active":"2024-04-19T02:19:54.931540+0000","last_became_peered":"2024-04-19T02:19:54.931540+0000","last_unstale":"2024-04-19T02:21:05.779304+0000","last_undegraded":"2024-04-19T02:21:05.779304+0000","last_fullsized":"2024-04-19T02:21:05.779304+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:05.779268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:05.779268+0000","last_clean_scrub_stamp":"2024-04-19T02:21:05.779268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:40:53.826444+0000","scrub_duration":0.0018519179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:24.906406+0000","last_change":"2024-04-19T02:20:24.906512+0000","last_active":"2024-04-19T02:20:24.906406+0000","last_peered":"2024-04-19T02:20:24.906406+0000","last_clean":"2024-04-19T02:20:24.906406+0000","last_became_active":"2024-04-19T02:19:54.923784+0000","last_became_peered":"2024-04-19T02:19:54.923784+0000","last_unstale":"2024-04-19T02:20:24.906406+0000","last_undegraded":"2024-04-19T02:20:24.906406+0000","last_fullsized":"2024-04-19T02:20:24.906406+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:24.906368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:24.906368+0000","last_clean_scrub_stamp":"2024-04-19T02:20:24.906368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:16:17.186228+0000","scrub_duration":0.0016771609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"82'5","reported_seq":96,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:31.607416+0000","last_change":"2024-04-19T02:21:31.607527+0000","last_active":"2024-04-19T02:21:31.607416+0000","last_peered":"2024-04-19T02:21:31.607416+0000","last_clean":"2024-04-19T02:21:31.607416+0000","last_became_active":"2024-04-19T02:15:28.891440+0000","last_became_peered":"2024-04-19T02:15:28.891440+0000","last_unstale":"2024-04-19T02:21:31.607416+0000","last_undegraded":"2024-04-19T02:21:31.607416+0000","last_fullsized":"2024-04-19T02:21:31.607416+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'5","last_scrub_stamp":"2024-04-19T02:21:31.607389+0000","last_deep_scrub":"82'5","last_deep_scrub_stamp":"2024-04-19T02:21:31.607389+0000","last_clean_scrub_stamp":"2024-04-19T02:21:31.607389+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:21:18.270455+0000","scrub_duration":0.0041207539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:10.974515+0000","last_change":"2024-04-19T02:21:10.974630+0000","last_active":"2024-04-19T02:21:10.974515+0000","last_peered":"2024-04-19T02:21:10.974515+0000","last_clean":"2024-04-19T02:21:10.974515+0000","last_became_active":"2024-04-19T02:19:54.923493+0000","last_became_peered":"2024-04-19T02:19:54.923493+0000","last_unstale":"2024-04-19T02:21:10.974515+0000","last_undegraded":"2024-04-19T02:21:10.974515+0000","last_fullsized":"2024-04-19T02:21:10.974515+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:10.974492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:10.974492+0000","last_clean_scrub_stamp":"2024-04-19T02:21:10.974492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:17:16.098605+0000","scrub_duration":0.0017195929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"82'10","reported_seq":102,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:45.705431+0000","last_change":"2024-04-19T02:21:45.705536+0000","last_active":"2024-04-19T02:21:45.705431+0000","last_peered":"2024-04-19T02:21:45.705431+0000","last_clean":"2024-04-19T02:21:45.705431+0000","last_became_active":"2024-04-19T02:15:28.890795+0000","last_became_peered":"2024-04-19T02:15:28.890795+0000","last_unstale":"2024-04-19T02:21:45.705431+0000","last_undegraded":"2024-04-19T02:21:45.705431+0000","last_fullsized":"2024-04-19T02:21:45.705431+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'10","last_scrub_stamp":"2024-04-19T02:21:45.705404+0000","last_deep_scrub":"82'10","last_deep_scrub_stamp":"2024-04-19T02:21:45.705404+0000","last_clean_scrub_stamp":"2024-04-19T02:21:45.705404+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:10:12.439074+0000","scrub_duration":0.0045696920000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:59.594482+0000","last_change":"2024-04-19T02:20:59.594635+0000","last_active":"2024-04-19T02:20:59.594482+0000","last_peered":"2024-04-19T02:20:59.594482+0000","last_clean":"2024-04-19T02:20:59.594482+0000","last_became_active":"2024-04-19T02:15:29.277547+0000","last_became_peered":"2024-04-19T02:15:29.277547+0000","last_unstale":"2024-04-19T02:20:59.594482+0000","last_undegraded":"2024-04-19T02:20:59.594482+0000","last_fullsized":"2024-04-19T02:20:59.594482+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:59.594458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:59.594458+0000","last_clean_scrub_stamp":"2024-04-19T02:20:59.594458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:20:46.257524+0000","scrub_duration":0.001831102,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"82'4","reported_seq":109,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:54.609805+0000","last_change":"2024-04-19T02:20:54.609979+0000","last_active":"2024-04-19T02:20:54.609805+0000","last_peered":"2024-04-19T02:20:54.609805+0000","last_clean":"2024-04-19T02:20:54.609805+0000","last_became_active":"2024-04-19T02:19:54.932829+0000","last_became_peered":"2024-04-19T02:19:54.932829+0000","last_unstale":"2024-04-19T02:20:54.609805+0000","last_undegraded":"2024-04-19T02:20:54.609805+0000","last_fullsized":"2024-04-19T02:20:54.609805+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'4","last_scrub_stamp":"2024-04-19T02:20:54.609763+0000","last_deep_scrub":"82'4","last_deep_scrub_stamp":"2024-04-19T02:20:54.609763+0000","last_clean_scrub_stamp":"2024-04-19T02:20:54.609763+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:53:50.278165+0000","scrub_duration":0.0044989499999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":61,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:55.569470+0000","last_change":"2024-04-19T02:21:55.569575+0000","last_active":"2024-04-19T02:21:55.569470+0000","last_peered":"2024-04-19T02:21:55.569470+0000","last_clean":"2024-04-19T02:21:55.569470+0000","last_became_active":"2024-04-19T02:20:07.983080+0000","last_became_peered":"2024-04-19T02:20:07.983080+0000","last_unstale":"2024-04-19T02:21:55.569470+0000","last_undegraded":"2024-04-19T02:21:55.569470+0000","last_fullsized":"2024-04-19T02:21:55.569470+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:55.569445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:55.569445+0000","last_clean_scrub_stamp":"2024-04-19T02:21:55.569445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:56:50.833153+0000","scrub_duration":0.001721474,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:31.028435+0000","last_change":"2024-04-19T02:21:31.028561+0000","last_active":"2024-04-19T02:21:31.028435+0000","last_peered":"2024-04-19T02:21:31.028435+0000","last_clean":"2024-04-19T02:21:31.028435+0000","last_became_active":"2024-04-19T02:19:54.925703+0000","last_became_peered":"2024-04-19T02:19:54.925703+0000","last_unstale":"2024-04-19T02:21:31.028435+0000","last_undegraded":"2024-04-19T02:21:31.028435+0000","last_fullsized":"2024-04-19T02:21:31.028435+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:31.028410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:31.028410+0000","last_clean_scrub_stamp":"2024-04-19T02:21:31.028410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:46:36.306863+0000","scrub_duration":0.00173,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":68,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:39.643386+0000","last_change":"2024-04-19T02:21:39.643503+0000","last_active":"2024-04-19T02:21:39.643386+0000","last_peered":"2024-04-19T02:21:39.643386+0000","last_clean":"2024-04-19T02:21:39.643386+0000","last_became_active":"2024-04-19T02:19:54.925634+0000","last_became_peered":"2024-04-19T02:19:54.925634+0000","last_unstale":"2024-04-19T02:21:39.643386+0000","last_undegraded":"2024-04-19T02:21:39.643386+0000","last_fullsized":"2024-04-19T02:21:39.643386+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:39.643363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:39.643363+0000","last_clean_scrub_stamp":"2024-04-19T02:21:39.643363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:57:07.241074+0000","scrub_duration":0.020300881,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:34.594648+0000","last_change":"2024-04-19T02:21:34.594758+0000","last_active":"2024-04-19T02:21:34.594648+0000","last_peered":"2024-04-19T02:21:34.594648+0000","last_clean":"2024-04-19T02:21:34.594648+0000","last_became_active":"2024-04-19T02:15:28.891879+0000","last_became_peered":"2024-04-19T02:15:28.891879+0000","last_unstale":"2024-04-19T02:21:34.594648+0000","last_undegraded":"2024-04-19T02:21:34.594648+0000","last_fullsized":"2024-04-19T02:21:34.594648+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:34.594623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:34.594623+0000","last_clean_scrub_stamp":"2024-04-19T02:21:34.594623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:30:55.595121+0000","scrub_duration":0.0019129990000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":53,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:51.906509+0000","last_change":"2024-04-19T02:21:51.906622+0000","last_active":"2024-04-19T02:21:51.906509+0000","last_peered":"2024-04-19T02:21:51.906509+0000","last_clean":"2024-04-19T02:21:51.906509+0000","last_became_active":"2024-04-19T02:20:10.638755+0000","last_became_peered":"2024-04-19T02:20:10.638755+0000","last_unstale":"2024-04-19T02:21:51.906509+0000","last_undegraded":"2024-04-19T02:21:51.906509+0000","last_fullsized":"2024-04-19T02:21:51.906509+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:51.906470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:51.906470+0000","last_clean_scrub_stamp":"2024-04-19T02:21:51.906470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:02:41.220265+0000","scrub_duration":0.0015939859999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"82'12","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:41.732906+0000","last_change":"2024-04-19T02:21:41.733038+0000","last_active":"2024-04-19T02:21:41.732906+0000","last_peered":"2024-04-19T02:21:41.732906+0000","last_clean":"2024-04-19T02:21:41.732906+0000","last_became_active":"2024-04-19T02:15:28.890882+0000","last_became_peered":"2024-04-19T02:15:28.890882+0000","last_unstale":"2024-04-19T02:21:41.732906+0000","last_undegraded":"2024-04-19T02:21:41.732906+0000","last_fullsized":"2024-04-19T02:21:41.732906+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'12","last_scrub_stamp":"2024-04-19T02:21:41.732879+0000","last_deep_scrub":"82'12","last_deep_scrub_stamp":"2024-04-19T02:21:41.732879+0000","last_clean_scrub_stamp":"2024-04-19T02:21:41.732879+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:16:45.543977+0000","scrub_duration":0.011745591999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:54.023457+0000","last_change":"2024-04-19T02:20:54.023600+0000","last_active":"2024-04-19T02:20:54.023457+0000","last_peered":"2024-04-19T02:20:54.023457+0000","last_clean":"2024-04-19T02:20:54.023457+0000","last_became_active":"2024-04-19T02:19:54.925121+0000","last_became_peered":"2024-04-19T02:19:54.925121+0000","last_unstale":"2024-04-19T02:20:54.023457+0000","last_undegraded":"2024-04-19T02:20:54.023457+0000","last_fullsized":"2024-04-19T02:20:54.023457+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:54.023433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:54.023433+0000","last_clean_scrub_stamp":"2024-04-19T02:20:54.023433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:02:43.764667+0000","scrub_duration":0.053810324999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"82'2","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:08.799687+0000","last_change":"2024-04-19T02:21:08.799794+0000","last_active":"2024-04-19T02:21:08.799687+0000","last_peered":"2024-04-19T02:21:08.799687+0000","last_clean":"2024-04-19T02:21:08.799687+0000","last_became_active":"2024-04-19T02:15:28.890004+0000","last_became_peered":"2024-04-19T02:15:28.890004+0000","last_unstale":"2024-04-19T02:21:08.799687+0000","last_undegraded":"2024-04-19T02:21:08.799687+0000","last_fullsized":"2024-04-19T02:21:08.799687+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-19T02:21:08.799663+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-19T02:21:08.799663+0000","last_clean_scrub_stamp":"2024-04-19T02:21:08.799663+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:23:57.962043+0000","scrub_duration":0.0033993159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:37.549179+0000","last_change":"2024-04-19T02:20:37.549289+0000","last_active":"2024-04-19T02:20:37.549179+0000","last_peered":"2024-04-19T02:20:37.549179+0000","last_clean":"2024-04-19T02:20:37.549179+0000","last_became_active":"2024-04-19T02:15:29.285197+0000","last_became_peered":"2024-04-19T02:15:29.285197+0000","last_unstale":"2024-04-19T02:20:37.549179+0000","last_undegraded":"2024-04-19T02:20:37.549179+0000","last_fullsized":"2024-04-19T02:20:37.549179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:37.549154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:37.549154+0000","last_clean_scrub_stamp":"2024-04-19T02:20:37.549154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:18:16.168949+0000","scrub_duration":0.0014928389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"82'3","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:24.538286+0000","last_change":"2024-04-19T02:21:24.538404+0000","last_active":"2024-04-19T02:21:24.538286+0000","last_peered":"2024-04-19T02:21:24.538286+0000","last_clean":"2024-04-19T02:21:24.538286+0000","last_became_active":"2024-04-19T02:15:28.893231+0000","last_became_peered":"2024-04-19T02:15:28.893231+0000","last_unstale":"2024-04-19T02:21:24.538286+0000","last_undegraded":"2024-04-19T02:21:24.538286+0000","last_fullsized":"2024-04-19T02:21:24.538286+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-19T02:21:24.538258+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-19T02:21:24.538258+0000","last_clean_scrub_stamp":"2024-04-19T02:21:24.538258+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:46:41.205290+0000","scrub_duration":0.0060652270000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":103,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:49.727333+0000","last_change":"2024-04-19T02:20:49.727441+0000","last_active":"2024-04-19T02:20:49.727333+0000","last_peered":"2024-04-19T02:20:49.727333+0000","last_clean":"2024-04-19T02:20:49.727333+0000","last_became_active":"2024-04-19T02:19:54.925502+0000","last_became_peered":"2024-04-19T02:19:54.925502+0000","last_unstale":"2024-04-19T02:20:49.727333+0000","last_undegraded":"2024-04-19T02:20:49.727333+0000","last_fullsized":"2024-04-19T02:20:49.727333+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:49.727309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:49.727309+0000","last_clean_scrub_stamp":"2024-04-19T02:20:49.727309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:34:41.219108+0000","scrub_duration":0.002043497,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"82'2","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:12.770179+0000","last_change":"2024-04-19T02:21:12.770278+0000","last_active":"2024-04-19T02:21:12.770179+0000","last_peered":"2024-04-19T02:21:12.770179+0000","last_clean":"2024-04-19T02:21:12.770179+0000","last_became_active":"2024-04-19T02:15:28.890881+0000","last_became_peered":"2024-04-19T02:15:28.890881+0000","last_unstale":"2024-04-19T02:21:12.770179+0000","last_undegraded":"2024-04-19T02:21:12.770179+0000","last_fullsized":"2024-04-19T02:21:12.770179+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-19T02:21:12.770155+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-19T02:21:12.770155+0000","last_clean_scrub_stamp":"2024-04-19T02:21:12.770155+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:56:59.212815+0000","scrub_duration":0.00314285,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:47.623467+0000","last_change":"2024-04-19T02:21:47.623590+0000","last_active":"2024-04-19T02:21:47.623467+0000","last_peered":"2024-04-19T02:21:47.623467+0000","last_clean":"2024-04-19T02:21:47.623467+0000","last_became_active":"2024-04-19T02:19:54.925591+0000","last_became_peered":"2024-04-19T02:19:54.925591+0000","last_unstale":"2024-04-19T02:21:47.623467+0000","last_undegraded":"2024-04-19T02:21:47.623467+0000","last_fullsized":"2024-04-19T02:21:47.623467+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:47.623444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:47.623444+0000","last_clean_scrub_stamp":"2024-04-19T02:21:47.623444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:22:28.648322+0000","scrub_duration":0.001700263,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":105,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.627379+0000","last_change":"2024-04-19T02:21:00.627484+0000","last_active":"2024-04-19T02:21:00.627379+0000","last_peered":"2024-04-19T02:21:00.627379+0000","last_clean":"2024-04-19T02:21:00.627379+0000","last_became_active":"2024-04-19T02:19:54.925523+0000","last_became_peered":"2024-04-19T02:19:54.925523+0000","last_unstale":"2024-04-19T02:21:00.627379+0000","last_undegraded":"2024-04-19T02:21:00.627379+0000","last_fullsized":"2024-04-19T02:21:00.627379+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:00.627355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:00.627355+0000","last_clean_scrub_stamp":"2024-04-19T02:21:00.627355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:39.950387+0000","scrub_duration":0.0016425540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:31.927807+0000","last_change":"2024-04-19T02:20:31.927940+0000","last_active":"2024-04-19T02:20:31.927807+0000","last_peered":"2024-04-19T02:20:31.927807+0000","last_clean":"2024-04-19T02:20:31.927807+0000","last_became_active":"2024-04-19T02:19:54.930843+0000","last_became_peered":"2024-04-19T02:19:54.930843+0000","last_unstale":"2024-04-19T02:20:31.927807+0000","last_undegraded":"2024-04-19T02:20:31.927807+0000","last_fullsized":"2024-04-19T02:20:31.927807+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:31.927783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:31.927783+0000","last_clean_scrub_stamp":"2024-04-19T02:20:31.927783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:16.149096+0000","scrub_duration":0.037287204999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'3","reported_seq":44,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:36.961730+0000","last_change":"2024-04-19T02:21:36.961895+0000","last_active":"2024-04-19T02:21:36.961730+0000","last_peered":"2024-04-19T02:21:36.961730+0000","last_clean":"2024-04-19T02:21:36.961730+0000","last_became_active":"2024-04-19T02:19:54.931553+0000","last_became_peered":"2024-04-19T02:19:54.931553+0000","last_unstale":"2024-04-19T02:21:36.961730+0000","last_undegraded":"2024-04-19T02:21:36.961730+0000","last_fullsized":"2024-04-19T02:21:36.961730+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-19T02:21:36.961704+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-19T02:21:36.961704+0000","last_clean_scrub_stamp":"2024-04-19T02:21:36.961704+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:06:19.021234+0000","scrub_duration":0.0035191599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:07.840808+0000","last_change":"2024-04-19T02:21:07.840904+0000","last_active":"2024-04-19T02:21:07.840808+0000","last_peered":"2024-04-19T02:21:07.840808+0000","last_clean":"2024-04-19T02:21:07.840808+0000","last_became_active":"2024-04-19T02:19:54.925645+0000","last_became_peered":"2024-04-19T02:19:54.925645+0000","last_unstale":"2024-04-19T02:21:07.840808+0000","last_undegraded":"2024-04-19T02:21:07.840808+0000","last_fullsized":"2024-04-19T02:21:07.840808+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:07.840784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:07.840784+0000","last_clean_scrub_stamp":"2024-04-19T02:21:07.840784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:56:35.438495+0000","scrub_duration":0.0018420279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":105,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.798683+0000","last_change":"2024-04-19T02:21:18.798790+0000","last_active":"2024-04-19T02:21:18.798683+0000","last_peered":"2024-04-19T02:21:18.798683+0000","last_clean":"2024-04-19T02:21:18.798683+0000","last_became_active":"2024-04-19T02:19:54.923321+0000","last_became_peered":"2024-04-19T02:19:54.923321+0000","last_unstale":"2024-04-19T02:21:18.798683+0000","last_undegraded":"2024-04-19T02:21:18.798683+0000","last_fullsized":"2024-04-19T02:21:18.798683+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:18.798658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:18.798658+0000","last_clean_scrub_stamp":"2024-04-19T02:21:18.798658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:35.622159+0000","scrub_duration":0.001875989,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:04.743415+0000","last_change":"2024-04-19T02:21:04.743533+0000","last_active":"2024-04-19T02:21:04.743415+0000","last_peered":"2024-04-19T02:21:04.743415+0000","last_clean":"2024-04-19T02:21:04.743415+0000","last_became_active":"2024-04-19T02:15:29.284650+0000","last_became_peered":"2024-04-19T02:15:29.284650+0000","last_unstale":"2024-04-19T02:21:04.743415+0000","last_undegraded":"2024-04-19T02:21:04.743415+0000","last_fullsized":"2024-04-19T02:21:04.743415+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:04.743381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:04.743381+0000","last_clean_scrub_stamp":"2024-04-19T02:21:04.743381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:15:36.123544+0000","scrub_duration":0.0019252679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:43.601545+0000","last_change":"2024-04-19T02:21:43.601696+0000","last_active":"2024-04-19T02:21:43.601545+0000","last_peered":"2024-04-19T02:21:43.601545+0000","last_clean":"2024-04-19T02:21:43.601545+0000","last_became_active":"2024-04-19T02:20:08.662277+0000","last_became_peered":"2024-04-19T02:20:08.662277+0000","last_unstale":"2024-04-19T02:21:43.601545+0000","last_undegraded":"2024-04-19T02:21:43.601545+0000","last_fullsized":"2024-04-19T02:21:43.601545+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:43.601509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:43.601509+0000","last_clean_scrub_stamp":"2024-04-19T02:21:43.601509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:37:13.977213+0000","scrub_duration":0.0017145559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:11.802147+0000","last_change":"2024-04-19T02:21:11.802259+0000","last_active":"2024-04-19T02:21:11.802147+0000","last_peered":"2024-04-19T02:21:11.802147+0000","last_clean":"2024-04-19T02:21:11.802147+0000","last_became_active":"2024-04-19T02:15:29.286606+0000","last_became_peered":"2024-04-19T02:15:29.286606+0000","last_unstale":"2024-04-19T02:21:11.802147+0000","last_undegraded":"2024-04-19T02:21:11.802147+0000","last_fullsized":"2024-04-19T02:21:11.802147+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:11.802122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:11.802122+0000","last_clean_scrub_stamp":"2024-04-19T02:21:11.802122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:42.177826+0000","scrub_duration":0.001592062,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:32.588969+0000","last_change":"2024-04-19T02:21:32.589083+0000","last_active":"2024-04-19T02:21:32.588969+0000","last_peered":"2024-04-19T02:21:32.588969+0000","last_clean":"2024-04-19T02:21:32.588969+0000","last_became_active":"2024-04-19T02:19:54.928298+0000","last_became_peered":"2024-04-19T02:19:54.928298+0000","last_unstale":"2024-04-19T02:21:32.588969+0000","last_undegraded":"2024-04-19T02:21:32.588969+0000","last_fullsized":"2024-04-19T02:21:32.588969+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:32.588945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:32.588945+0000","last_clean_scrub_stamp":"2024-04-19T02:21:32.588945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:12:11.911976+0000","scrub_duration":0.001689189,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:27.963130+0000","last_change":"2024-04-19T02:20:27.963259+0000","last_active":"2024-04-19T02:20:27.963130+0000","last_peered":"2024-04-19T02:20:27.963130+0000","last_clean":"2024-04-19T02:20:27.963130+0000","last_became_active":"2024-04-19T02:19:54.927309+0000","last_became_peered":"2024-04-19T02:19:54.927309+0000","last_unstale":"2024-04-19T02:20:27.963130+0000","last_undegraded":"2024-04-19T02:20:27.963130+0000","last_fullsized":"2024-04-19T02:20:27.963130+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:27.963106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:27.963106+0000","last_clean_scrub_stamp":"2024-04-19T02:20:27.963106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:35:23.138484+0000","scrub_duration":0.070564934999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:54.915653+0000","last_change":"2024-04-19T02:21:54.915653+0000","last_active":"2024-04-19T02:21:54.915653+0000","last_peered":"2024-04-19T02:21:54.915653+0000","last_clean":"2024-04-19T02:21:54.915653+0000","last_became_active":"2024-04-19T02:20:09.998776+0000","last_became_peered":"2024-04-19T02:20:09.998776+0000","last_unstale":"2024-04-19T02:21:54.915653+0000","last_undegraded":"2024-04-19T02:21:54.915653+0000","last_fullsized":"2024-04-19T02:21:54.915653+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:54.915525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:54.915525+0000","last_clean_scrub_stamp":"2024-04-19T02:21:54.915525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:14:03.233064+0000","scrub_duration":0.001749497,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":106,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:02.676488+0000","last_change":"2024-04-19T02:21:02.676488+0000","last_active":"2024-04-19T02:21:02.676488+0000","last_peered":"2024-04-19T02:21:02.676488+0000","last_clean":"2024-04-19T02:21:02.676488+0000","last_became_active":"2024-04-19T02:19:54.925872+0000","last_became_peered":"2024-04-19T02:19:54.925872+0000","last_unstale":"2024-04-19T02:21:02.676488+0000","last_undegraded":"2024-04-19T02:21:02.676488+0000","last_fullsized":"2024-04-19T02:21:02.676488+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:02.676368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:02.676368+0000","last_clean_scrub_stamp":"2024-04-19T02:21:02.676368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:30:23.676866+0000","scrub_duration":0.001635245,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.514910+0000","last_change":"2024-04-19T02:20:33.514910+0000","last_active":"2024-04-19T02:20:33.514910+0000","last_peered":"2024-04-19T02:20:33.514910+0000","last_clean":"2024-04-19T02:20:33.514910+0000","last_became_active":"2024-04-19T02:15:29.276968+0000","last_became_peered":"2024-04-19T02:15:29.276968+0000","last_unstale":"2024-04-19T02:20:33.514910+0000","last_undegraded":"2024-04-19T02:20:33.514910+0000","last_fullsized":"2024-04-19T02:20:33.514910+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:33.514784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:33.514784+0000","last_clean_scrub_stamp":"2024-04-19T02:20:33.514784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:01:55.933306+0000","scrub_duration":0.0019782179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":109,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:27.774512+0000","last_change":"2024-04-19T02:21:27.774512+0000","last_active":"2024-04-19T02:21:27.774512+0000","last_peered":"2024-04-19T02:21:27.774512+0000","last_clean":"2024-04-19T02:21:27.774512+0000","last_became_active":"2024-04-19T02:19:54.927033+0000","last_became_peered":"2024-04-19T02:19:54.927033+0000","last_unstale":"2024-04-19T02:21:27.774512+0000","last_undegraded":"2024-04-19T02:21:27.774512+0000","last_fullsized":"2024-04-19T02:21:27.774512+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:27.774381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:27.774381+0000","last_clean_scrub_stamp":"2024-04-19T02:21:27.774381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:18.998948+0000","scrub_duration":0.0019217139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":106,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:43.713448+0000","last_change":"2024-04-19T02:21:43.713448+0000","last_active":"2024-04-19T02:21:43.713448+0000","last_peered":"2024-04-19T02:21:43.713448+0000","last_clean":"2024-04-19T02:21:43.713448+0000","last_became_active":"2024-04-19T02:19:54.931683+0000","last_became_peered":"2024-04-19T02:19:54.931683+0000","last_unstale":"2024-04-19T02:21:43.713448+0000","last_undegraded":"2024-04-19T02:21:43.713448+0000","last_fullsized":"2024-04-19T02:21:43.713448+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:43.713262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:43.713262+0000","last_clean_scrub_stamp":"2024-04-19T02:21:43.713262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:17:56.148069+0000","scrub_duration":0.0019750929999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:37.784722+0000","last_change":"2024-04-19T02:20:37.784722+0000","last_active":"2024-04-19T02:20:37.784722+0000","last_peered":"2024-04-19T02:20:37.784722+0000","last_clean":"2024-04-19T02:20:37.784722+0000","last_became_active":"2024-04-19T02:19:54.924686+0000","last_became_peered":"2024-04-19T02:19:54.924686+0000","last_unstale":"2024-04-19T02:20:37.784722+0000","last_undegraded":"2024-04-19T02:20:37.784722+0000","last_fullsized":"2024-04-19T02:20:37.784722+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:37.784561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:37.784561+0000","last_clean_scrub_stamp":"2024-04-19T02:20:37.784561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:26:44.108152+0000","scrub_duration":0.0013845000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:51.933365+0000","last_change":"2024-04-19T02:20:51.933365+0000","last_active":"2024-04-19T02:20:51.933365+0000","last_peered":"2024-04-19T02:20:51.933365+0000","last_clean":"2024-04-19T02:20:51.933365+0000","last_became_active":"2024-04-19T02:19:54.923164+0000","last_became_peered":"2024-04-19T02:19:54.923164+0000","last_unstale":"2024-04-19T02:20:51.933365+0000","last_undegraded":"2024-04-19T02:20:51.933365+0000","last_fullsized":"2024-04-19T02:20:51.933365+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:51.933246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:51.933246+0000","last_clean_scrub_stamp":"2024-04-19T02:20:51.933246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:39:21.609447+0000","scrub_duration":0.0015936590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:40.627084+0000","last_change":"2024-04-19T02:21:40.627182+0000","last_active":"2024-04-19T02:21:40.627084+0000","last_peered":"2024-04-19T02:21:40.627084+0000","last_clean":"2024-04-19T02:21:40.627084+0000","last_became_active":"2024-04-19T02:20:08.661952+0000","last_became_peered":"2024-04-19T02:20:08.661952+0000","last_unstale":"2024-04-19T02:21:40.627084+0000","last_undegraded":"2024-04-19T02:21:40.627084+0000","last_fullsized":"2024-04-19T02:21:40.627084+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:40.627061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:40.627061+0000","last_clean_scrub_stamp":"2024-04-19T02:21:40.627061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:24:29.789441+0000","scrub_duration":0.0016682719999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:28.899614+0000","last_change":"2024-04-19T02:20:28.899746+0000","last_active":"2024-04-19T02:20:28.899614+0000","last_peered":"2024-04-19T02:20:28.899614+0000","last_clean":"2024-04-19T02:20:28.899614+0000","last_became_active":"2024-04-19T02:19:54.926463+0000","last_became_peered":"2024-04-19T02:19:54.926463+0000","last_unstale":"2024-04-19T02:20:28.899614+0000","last_undegraded":"2024-04-19T02:20:28.899614+0000","last_fullsized":"2024-04-19T02:20:28.899614+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:28.899588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:28.899588+0000","last_clean_scrub_stamp":"2024-04-19T02:20:28.899588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:34:50.323413+0000","scrub_duration":0.038469191,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":109,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:28.737103+0000","last_change":"2024-04-19T02:21:28.737103+0000","last_active":"2024-04-19T02:21:28.737103+0000","last_peered":"2024-04-19T02:21:28.737103+0000","last_clean":"2024-04-19T02:21:28.737103+0000","last_became_active":"2024-04-19T02:19:54.932571+0000","last_became_peered":"2024-04-19T02:19:54.932571+0000","last_unstale":"2024-04-19T02:21:28.737103+0000","last_undegraded":"2024-04-19T02:21:28.737103+0000","last_fullsized":"2024-04-19T02:21:28.737103+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:28.736948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:28.736948+0000","last_clean_scrub_stamp":"2024-04-19T02:21:28.736948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:47:06.404175+0000","scrub_duration":0.0019713970000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"82'159","reported_seq":294,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.786721+0000","last_change":"2024-04-19T02:21:21.786721+0000","last_active":"2024-04-19T02:21:21.786721+0000","last_peered":"2024-04-19T02:21:21.786721+0000","last_clean":"2024-04-19T02:21:21.786721+0000","last_became_active":"2024-04-19T02:15:24.533420+0000","last_became_peered":"2024-04-19T02:15:24.533420+0000","last_unstale":"2024-04-19T02:21:21.786721+0000","last_undegraded":"2024-04-19T02:21:21.786721+0000","last_fullsized":"2024-04-19T02:21:21.786721+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'159","last_scrub_stamp":"2024-04-19T02:21:21.786526+0000","last_deep_scrub":"82'159","last_deep_scrub_stamp":"2024-04-19T02:21:21.786526+0000","last_clean_scrub_stamp":"2024-04-19T02:21:21.786526+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:56:17.050234+0000","scrub_duration":0.0051918429999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":54,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:22.938906+0000","last_change":"2024-04-19T02:20:22.938906+0000","last_active":"2024-04-19T02:20:22.938906+0000","last_peered":"2024-04-19T02:20:22.938906+0000","last_clean":"2024-04-19T02:20:22.938906+0000","last_became_active":"2024-04-19T02:20:10.001415+0000","last_became_peered":"2024-04-19T02:20:10.001415+0000","last_unstale":"2024-04-19T02:20:22.938906+0000","last_undegraded":"2024-04-19T02:20:22.938906+0000","last_fullsized":"2024-04-19T02:20:22.938906+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:22.938775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:22.938775+0000","last_clean_scrub_stamp":"2024-04-19T02:20:22.938775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:30:51.144263+0000","scrub_duration":0.001921898,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:27.601464+0000","last_change":"2024-04-19T02:20:27.601464+0000","last_active":"2024-04-19T02:20:27.601464+0000","last_peered":"2024-04-19T02:20:27.601464+0000","last_clean":"2024-04-19T02:20:27.601464+0000","last_became_active":"2024-04-19T02:15:29.284164+0000","last_became_peered":"2024-04-19T02:15:29.284164+0000","last_unstale":"2024-04-19T02:20:27.601464+0000","last_undegraded":"2024-04-19T02:20:27.601464+0000","last_fullsized":"2024-04-19T02:20:27.601464+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:27.601255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:27.601255+0000","last_clean_scrub_stamp":"2024-04-19T02:20:27.601255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:45:08.158116+0000","scrub_duration":0.0020462050000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":96,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:40.722384+0000","last_change":"2024-04-19T02:21:40.722525+0000","last_active":"2024-04-19T02:21:40.722384+0000","last_peered":"2024-04-19T02:21:40.722384+0000","last_clean":"2024-04-19T02:21:40.722384+0000","last_became_active":"2024-04-19T02:15:24.533580+0000","last_became_peered":"2024-04-19T02:15:24.533580+0000","last_unstale":"2024-04-19T02:21:40.722384+0000","last_undegraded":"2024-04-19T02:21:40.722384+0000","last_fullsized":"2024-04-19T02:21:40.722384+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:40.722359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:40.722359+0000","last_clean_scrub_stamp":"2024-04-19T02:21:40.722359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:01:32.676837+0000","scrub_duration":0.0016829799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":54,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:07.946484+0000","last_change":"2024-04-19T02:21:07.946484+0000","last_active":"2024-04-19T02:21:07.946484+0000","last_peered":"2024-04-19T02:21:07.946484+0000","last_clean":"2024-04-19T02:21:07.946484+0000","last_became_active":"2024-04-19T02:20:10.638966+0000","last_became_peered":"2024-04-19T02:20:10.638966+0000","last_unstale":"2024-04-19T02:21:07.946484+0000","last_undegraded":"2024-04-19T02:21:07.946484+0000","last_fullsized":"2024-04-19T02:21:07.946484+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:07.946312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:07.946312+0000","last_clean_scrub_stamp":"2024-04-19T02:21:07.946312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:34:25.503097+0000","scrub_duration":0.001569176,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":61,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:44.571489+0000","last_change":"2024-04-19T02:21:44.571614+0000","last_active":"2024-04-19T02:21:44.571489+0000","last_peered":"2024-04-19T02:21:44.571489+0000","last_clean":"2024-04-19T02:21:44.571489+0000","last_became_active":"2024-04-19T02:20:07.986110+0000","last_became_peered":"2024-04-19T02:20:07.986110+0000","last_unstale":"2024-04-19T02:21:44.571489+0000","last_undegraded":"2024-04-19T02:21:44.571489+0000","last_fullsized":"2024-04-19T02:21:44.571489+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:44.571463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:44.571463+0000","last_clean_scrub_stamp":"2024-04-19T02:21:44.571463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:57:31.014123+0000","scrub_duration":0.001607547,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":73,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.531610+0000","last_change":"2024-04-19T02:21:18.531610+0000","last_active":"2024-04-19T02:21:18.531610+0000","last_peered":"2024-04-19T02:21:18.531610+0000","last_clean":"2024-04-19T02:21:18.531610+0000","last_became_active":"2024-04-19T02:19:54.925570+0000","last_became_peered":"2024-04-19T02:19:54.925570+0000","last_unstale":"2024-04-19T02:21:18.531610+0000","last_undegraded":"2024-04-19T02:21:18.531610+0000","last_fullsized":"2024-04-19T02:21:18.531610+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:18.531437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:18.531437+0000","last_clean_scrub_stamp":"2024-04-19T02:21:18.531437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:58:59.944303+0000","scrub_duration":0.0019733250000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:35.000806+0000","last_change":"2024-04-19T02:21:35.000806+0000","last_active":"2024-04-19T02:21:35.000806+0000","last_peered":"2024-04-19T02:21:35.000806+0000","last_clean":"2024-04-19T02:21:35.000806+0000","last_became_active":"2024-04-19T02:19:54.929918+0000","last_became_peered":"2024-04-19T02:19:54.929918+0000","last_unstale":"2024-04-19T02:21:35.000806+0000","last_undegraded":"2024-04-19T02:21:35.000806+0000","last_fullsized":"2024-04-19T02:21:35.000806+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:35.000676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:35.000676+0000","last_clean_scrub_stamp":"2024-04-19T02:21:35.000676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:07:53.651573+0000","scrub_duration":0.001736706,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:37.609560+0000","last_change":"2024-04-19T02:21:37.609560+0000","last_active":"2024-04-19T02:21:37.609560+0000","last_peered":"2024-04-19T02:21:37.609560+0000","last_clean":"2024-04-19T02:21:37.609560+0000","last_became_active":"2024-04-19T02:15:29.280519+0000","last_became_peered":"2024-04-19T02:15:29.280519+0000","last_unstale":"2024-04-19T02:21:37.609560+0000","last_undegraded":"2024-04-19T02:21:37.609560+0000","last_fullsized":"2024-04-19T02:21:37.609560+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:37.609443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:37.609443+0000","last_clean_scrub_stamp":"2024-04-19T02:21:37.609443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:25.656619+0000","scrub_duration":0.0017652360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"82'3","reported_seq":44,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:33.975478+0000","last_change":"2024-04-19T02:21:33.975581+0000","last_active":"2024-04-19T02:21:33.975478+0000","last_peered":"2024-04-19T02:21:33.975478+0000","last_clean":"2024-04-19T02:21:33.975478+0000","last_became_active":"2024-04-19T02:19:54.928460+0000","last_became_peered":"2024-04-19T02:19:54.928460+0000","last_unstale":"2024-04-19T02:21:33.975478+0000","last_undegraded":"2024-04-19T02:21:33.975478+0000","last_fullsized":"2024-04-19T02:21:33.975478+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-19T02:21:33.975451+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-19T02:21:33.975451+0000","last_clean_scrub_stamp":"2024-04-19T02:21:33.975451+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:55:25.006115+0000","scrub_duration":0.0033633489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:45.863357+0000","last_change":"2024-04-19T02:21:45.863463+0000","last_active":"2024-04-19T02:21:45.863357+0000","last_peered":"2024-04-19T02:21:45.863357+0000","last_clean":"2024-04-19T02:21:45.863357+0000","last_became_active":"2024-04-19T02:20:09.998629+0000","last_became_peered":"2024-04-19T02:20:09.998629+0000","last_unstale":"2024-04-19T02:21:45.863357+0000","last_undegraded":"2024-04-19T02:21:45.863357+0000","last_fullsized":"2024-04-19T02:21:45.863357+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:45.863333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:45.863333+0000","last_clean_scrub_stamp":"2024-04-19T02:21:45.863333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:16:35.951935+0000","scrub_duration":0.001743751,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":54,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:04.937772+0000","last_change":"2024-04-19T02:21:04.937772+0000","last_active":"2024-04-19T02:21:04.937772+0000","last_peered":"2024-04-19T02:21:04.937772+0000","last_clean":"2024-04-19T02:21:04.937772+0000","last_became_active":"2024-04-19T02:20:10.638912+0000","last_became_peered":"2024-04-19T02:20:10.638912+0000","last_unstale":"2024-04-19T02:21:04.937772+0000","last_undegraded":"2024-04-19T02:21:04.937772+0000","last_fullsized":"2024-04-19T02:21:04.937772+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:04.937654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:04.937654+0000","last_clean_scrub_stamp":"2024-04-19T02:21:04.937654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:50:59.907567+0000","scrub_duration":0.001663454,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":96,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:30.725386+0000","last_change":"2024-04-19T02:21:30.725386+0000","last_active":"2024-04-19T02:21:30.725386+0000","last_peered":"2024-04-19T02:21:30.725386+0000","last_clean":"2024-04-19T02:21:30.725386+0000","last_became_active":"2024-04-19T02:15:24.533436+0000","last_became_peered":"2024-04-19T02:15:24.533436+0000","last_unstale":"2024-04-19T02:21:30.725386+0000","last_undegraded":"2024-04-19T02:21:30.725386+0000","last_fullsized":"2024-04-19T02:21:30.725386+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:30.725253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:30.725253+0000","last_clean_scrub_stamp":"2024-04-19T02:21:30.725253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:19:28.238566+0000","scrub_duration":0.0018953679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"82'2","reported_seq":46,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:44.865916+0000","last_change":"2024-04-19T02:20:44.866016+0000","last_active":"2024-04-19T02:20:44.865916+0000","last_peered":"2024-04-19T02:20:44.865916+0000","last_clean":"2024-04-19T02:20:44.865916+0000","last_became_active":"2024-04-19T02:19:54.931328+0000","last_became_peered":"2024-04-19T02:19:54.931328+0000","last_unstale":"2024-04-19T02:20:44.865916+0000","last_undegraded":"2024-04-19T02:20:44.865916+0000","last_fullsized":"2024-04-19T02:20:44.865916+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-19T02:20:44.865892+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-19T02:20:44.865892+0000","last_clean_scrub_stamp":"2024-04-19T02:20:44.865892+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:06:18.693677+0000","scrub_duration":0.00333659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:40.611536+0000","last_change":"2024-04-19T02:20:40.611536+0000","last_active":"2024-04-19T02:20:40.611536+0000","last_peered":"2024-04-19T02:20:40.611536+0000","last_clean":"2024-04-19T02:20:40.611536+0000","last_became_active":"2024-04-19T02:15:29.280366+0000","last_became_peered":"2024-04-19T02:15:29.280366+0000","last_unstale":"2024-04-19T02:20:40.611536+0000","last_undegraded":"2024-04-19T02:20:40.611536+0000","last_fullsized":"2024-04-19T02:20:40.611536+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:40.611392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:40.611392+0000","last_clean_scrub_stamp":"2024-04-19T02:20:40.611392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:35.395252+0000","scrub_duration":0.0015883539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:26.555858+0000","last_change":"2024-04-19T02:21:26.555973+0000","last_active":"2024-04-19T02:21:26.555858+0000","last_peered":"2024-04-19T02:21:26.555858+0000","last_clean":"2024-04-19T02:21:26.555858+0000","last_became_active":"2024-04-19T02:15:28.892695+0000","last_became_peered":"2024-04-19T02:15:28.892695+0000","last_unstale":"2024-04-19T02:21:26.555858+0000","last_undegraded":"2024-04-19T02:21:26.555858+0000","last_fullsized":"2024-04-19T02:21:26.555858+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-19T02:21:26.555832+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-19T02:21:26.555832+0000","last_clean_scrub_stamp":"2024-04-19T02:21:26.555832+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:54:22.224234+0000","scrub_duration":0.001825763,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":103,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:42.629277+0000","last_change":"2024-04-19T02:20:42.629383+0000","last_active":"2024-04-19T02:20:42.629277+0000","last_peered":"2024-04-19T02:20:42.629277+0000","last_clean":"2024-04-19T02:20:42.629277+0000","last_became_active":"2024-04-19T02:19:54.929412+0000","last_became_peered":"2024-04-19T02:19:54.929412+0000","last_unstale":"2024-04-19T02:20:42.629277+0000","last_undegraded":"2024-04-19T02:20:42.629277+0000","last_fullsized":"2024-04-19T02:20:42.629277+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:42.629252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:42.629252+0000","last_clean_scrub_stamp":"2024-04-19T02:20:42.629252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:14.280965+0000","scrub_duration":0.0020287679999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"82'3","reported_seq":108,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.601787+0000","last_change":"2024-04-19T02:20:48.601893+0000","last_active":"2024-04-19T02:20:48.601787+0000","last_peered":"2024-04-19T02:20:48.601787+0000","last_clean":"2024-04-19T02:20:48.601787+0000","last_became_active":"2024-04-19T02:19:54.926630+0000","last_became_peered":"2024-04-19T02:19:54.926630+0000","last_unstale":"2024-04-19T02:20:48.601787+0000","last_undegraded":"2024-04-19T02:20:48.601787+0000","last_fullsized":"2024-04-19T02:20:48.601787+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-19T02:20:48.601762+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-19T02:20:48.601762+0000","last_clean_scrub_stamp":"2024-04-19T02:20:48.601762+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:28:54.715316+0000","scrub_duration":0.0034412739999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:23.628340+0000","last_change":"2024-04-19T02:20:23.628340+0000","last_active":"2024-04-19T02:20:23.628340+0000","last_peered":"2024-04-19T02:20:23.628340+0000","last_clean":"2024-04-19T02:20:23.628340+0000","last_became_active":"2024-04-19T02:19:54.931328+0000","last_became_peered":"2024-04-19T02:19:54.931328+0000","last_unstale":"2024-04-19T02:20:23.628340+0000","last_undegraded":"2024-04-19T02:20:23.628340+0000","last_fullsized":"2024-04-19T02:20:23.628340+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:23.628182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:23.628182+0000","last_clean_scrub_stamp":"2024-04-19T02:20:23.628182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:41:07.461430+0000","scrub_duration":0.042718649999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"82'3","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:33.586083+0000","last_change":"2024-04-19T02:21:33.586193+0000","last_active":"2024-04-19T02:21:33.586083+0000","last_peered":"2024-04-19T02:21:33.586083+0000","last_clean":"2024-04-19T02:21:33.586083+0000","last_became_active":"2024-04-19T02:15:28.892881+0000","last_became_peered":"2024-04-19T02:15:28.892881+0000","last_unstale":"2024-04-19T02:21:33.586083+0000","last_undegraded":"2024-04-19T02:21:33.586083+0000","last_fullsized":"2024-04-19T02:21:33.586083+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-19T02:21:33.586060+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-19T02:21:33.586060+0000","last_clean_scrub_stamp":"2024-04-19T02:21:33.586060+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:49:54.321957+0000","scrub_duration":0.0029867259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:21.614064+0000","last_change":"2024-04-19T02:20:21.614064+0000","last_active":"2024-04-19T02:20:21.614064+0000","last_peered":"2024-04-19T02:20:21.614064+0000","last_clean":"2024-04-19T02:20:21.614064+0000","last_became_active":"2024-04-19T02:19:54.923752+0000","last_became_peered":"2024-04-19T02:19:54.923752+0000","last_unstale":"2024-04-19T02:20:21.614064+0000","last_undegraded":"2024-04-19T02:20:21.614064+0000","last_fullsized":"2024-04-19T02:20:21.614064+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:21.613938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:21.613938+0000","last_clean_scrub_stamp":"2024-04-19T02:20:21.613938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:28:11.041024+0000","scrub_duration":0.0017798099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":44,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:06.947478+0000","last_change":"2024-04-19T02:21:06.947478+0000","last_active":"2024-04-19T02:21:06.947478+0000","last_peered":"2024-04-19T02:21:06.947478+0000","last_clean":"2024-04-19T02:21:06.947478+0000","last_became_active":"2024-04-19T02:19:54.932103+0000","last_became_peered":"2024-04-19T02:19:54.932103+0000","last_unstale":"2024-04-19T02:21:06.947478+0000","last_undegraded":"2024-04-19T02:21:06.947478+0000","last_fullsized":"2024-04-19T02:21:06.947478+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-19T02:21:06.947264+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-19T02:21:06.947264+0000","last_clean_scrub_stamp":"2024-04-19T02:21:06.947264+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:25:28.987258+0000","scrub_duration":0.001632035,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":103,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:36.664629+0000","last_change":"2024-04-19T02:21:36.664716+0000","last_active":"2024-04-19T02:21:36.664629+0000","last_peered":"2024-04-19T02:21:36.664629+0000","last_clean":"2024-04-19T02:21:36.664629+0000","last_became_active":"2024-04-19T02:19:54.925565+0000","last_became_peered":"2024-04-19T02:19:54.925565+0000","last_unstale":"2024-04-19T02:21:36.664629+0000","last_undegraded":"2024-04-19T02:21:36.664629+0000","last_fullsized":"2024-04-19T02:21:36.664629+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:36.664595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:36.664595+0000","last_clean_scrub_stamp":"2024-04-19T02:21:36.664595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:16:08.044759+0000","scrub_duration":0.020876051999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":46,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.977681+0000","last_change":"2024-04-19T02:21:00.977681+0000","last_active":"2024-04-19T02:21:00.977681+0000","last_peered":"2024-04-19T02:21:00.977681+0000","last_clean":"2024-04-19T02:21:00.977681+0000","last_became_active":"2024-04-19T02:19:54.926439+0000","last_became_peered":"2024-04-19T02:19:54.926439+0000","last_unstale":"2024-04-19T02:21:00.977681+0000","last_undegraded":"2024-04-19T02:21:00.977681+0000","last_fullsized":"2024-04-19T02:21:00.977681+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'6","last_scrub_stamp":"2024-04-19T02:21:00.977547+0000","last_deep_scrub":"82'6","last_deep_scrub_stamp":"2024-04-19T02:21:00.977547+0000","last_clean_scrub_stamp":"2024-04-19T02:21:00.977547+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:36:06.474124+0000","scrub_duration":0.0050912479999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:46.634857+0000","last_change":"2024-04-19T02:20:46.634995+0000","last_active":"2024-04-19T02:20:46.634857+0000","last_peered":"2024-04-19T02:20:46.634857+0000","last_clean":"2024-04-19T02:20:46.634857+0000","last_became_active":"2024-04-19T02:19:54.930665+0000","last_became_peered":"2024-04-19T02:19:54.930665+0000","last_unstale":"2024-04-19T02:20:46.634857+0000","last_undegraded":"2024-04-19T02:20:46.634857+0000","last_fullsized":"2024-04-19T02:20:46.634857+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:46.634833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:46.634833+0000","last_clean_scrub_stamp":"2024-04-19T02:20:46.634833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:58:28.047698+0000","scrub_duration":0.001963645,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":105,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:14.819858+0000","last_change":"2024-04-19T02:21:14.819858+0000","last_active":"2024-04-19T02:21:14.819858+0000","last_peered":"2024-04-19T02:21:14.819858+0000","last_clean":"2024-04-19T02:21:14.819858+0000","last_became_active":"2024-04-19T02:19:54.930527+0000","last_became_peered":"2024-04-19T02:19:54.930527+0000","last_unstale":"2024-04-19T02:21:14.819858+0000","last_undegraded":"2024-04-19T02:21:14.819858+0000","last_fullsized":"2024-04-19T02:21:14.819858+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:14.819731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:14.819731+0000","last_clean_scrub_stamp":"2024-04-19T02:21:14.819731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:24:42.325450+0000","scrub_duration":0.001789131,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":54,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:56.955725+0000","last_change":"2024-04-19T02:21:56.955725+0000","last_active":"2024-04-19T02:21:56.955725+0000","last_peered":"2024-04-19T02:21:56.955725+0000","last_clean":"2024-04-19T02:21:56.955725+0000","last_became_active":"2024-04-19T02:20:10.001304+0000","last_became_peered":"2024-04-19T02:20:10.001304+0000","last_unstale":"2024-04-19T02:21:56.955725+0000","last_undegraded":"2024-04-19T02:21:56.955725+0000","last_fullsized":"2024-04-19T02:21:56.955725+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:56.955564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:56.955564+0000","last_clean_scrub_stamp":"2024-04-19T02:21:56.955564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:04:00.369525+0000","scrub_duration":0.0018690289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:52.545850+0000","last_change":"2024-04-19T02:21:52.545968+0000","last_active":"2024-04-19T02:21:52.545850+0000","last_peered":"2024-04-19T02:21:52.545850+0000","last_clean":"2024-04-19T02:21:52.545850+0000","last_became_active":"2024-04-19T02:20:08.661996+0000","last_became_peered":"2024-04-19T02:20:08.661996+0000","last_unstale":"2024-04-19T02:21:52.545850+0000","last_undegraded":"2024-04-19T02:21:52.545850+0000","last_fullsized":"2024-04-19T02:21:52.545850+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:52.545824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:52.545824+0000","last_clean_scrub_stamp":"2024-04-19T02:21:52.545824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:55:09.369325+0000","scrub_duration":0.00166147,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":54,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:41.872130+0000","last_change":"2024-04-19T02:21:41.872130+0000","last_active":"2024-04-19T02:21:41.872130+0000","last_peered":"2024-04-19T02:21:41.872130+0000","last_clean":"2024-04-19T02:21:41.872130+0000","last_became_active":"2024-04-19T02:20:10.001372+0000","last_became_peered":"2024-04-19T02:20:10.001372+0000","last_unstale":"2024-04-19T02:21:41.872130+0000","last_undegraded":"2024-04-19T02:21:41.872130+0000","last_fullsized":"2024-04-19T02:21:41.872130+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:41.871963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:41.871963+0000","last_clean_scrub_stamp":"2024-04-19T02:21:41.871963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:27:38.707434+0000","scrub_duration":0.036498795000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.500038+0000","last_change":"2024-04-19T02:21:20.500137+0000","last_active":"2024-04-19T02:21:20.500038+0000","last_peered":"2024-04-19T02:21:20.500038+0000","last_clean":"2024-04-19T02:21:20.500038+0000","last_became_active":"2024-04-19T02:15:29.276725+0000","last_became_peered":"2024-04-19T02:15:29.276725+0000","last_unstale":"2024-04-19T02:21:20.500038+0000","last_undegraded":"2024-04-19T02:21:20.500038+0000","last_fullsized":"2024-04-19T02:21:20.500038+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:20.500012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:20.500012+0000","last_clean_scrub_stamp":"2024-04-19T02:21:20.500012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:29:26.613566+0000","scrub_duration":0.001700163,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5254,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":72,"seq":309237645339,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58812,"kb_used_data":884,"kb_used_omap":6,"kb_used_meta":57913,"kb_avail":94313028,"statfs":{"total":96636764160,"available":96576540672,"internally_reserved":0,"allocated":905216,"data_stored":358135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6848,"internal_metadata":59303232},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:21:56 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46000000000000002,"15min":0.45900000000000002},"min":{"1min":0.33000000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.57499999999999996,"5min":0.62,"15min":0.62},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.439,"15min":0.437},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.56100000000000005,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.30099999999999999}]},{"osd":1,"last update":"Fri Apr 19 02:21:56 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.50800000000000001,"15min":0.51100000000000001},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.64600000000000002,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.497},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.51400000000000001,"15min":0.51800000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.65200000000000002,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.55000000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738451,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":275412,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":273918,"kb_avail":94096428,"statfs":{"total":96636764160,"available":96354742272,"internally_reserved":0,"allocated":1519616,"data_stored":948136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":280492486},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 02:21:29 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.441,"15min":0.33900000000000002},"min":{"1min":0.35299999999999998,"5min":0.17599999999999999,"15min":0.159},"max":{"1min":0.56399999999999995,"5min":4.4480000000000004,"15min":4.4480000000000004},"last":0.432},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.41399999999999998,"15min":0.378},"min":{"1min":0.33300000000000002,"5min":0.19,"15min":0.17199999999999999},"max":{"1min":0.56299999999999994,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.39200000000000002}]},{"osd":2,"last update":"Fri Apr 19 02:21:57 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.48199999999999998,"15min":0.47699999999999998},"min":{"1min":0.40899999999999997,"5min":0.309,"15min":0.309},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.47999999999999998,"15min":0.47799999999999998},"min":{"1min":0.38800000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.621,"5min":0.629,"15min":0.629},"last":0.498}]}]},{"osd":1,"up_from":8,"seq":34359738450,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307408,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":305918,"kb_avail":94064432,"statfs":{"total":96636764160,"available":96321978368,"internally_reserved":0,"allocated":1515520,"data_stored":949633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":313260486},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:21:31 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.45400000000000001,"15min":0.39200000000000002},"min":{"1min":0.36399999999999999,"5min":0.157,"15min":0.157},"max":{"1min":0.60599999999999998,"5min":1.794,"15min":1.794},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.45300000000000001,"15min":0.34799999999999998},"min":{"1min":0.35499999999999998,"5min":0.17100000000000001,"15min":0.16},"max":{"1min":0.64500000000000002,"5min":2.411,"15min":2.411},"last":0.41099999999999998}]},{"osd":2,"last update":"Fri Apr 19 02:21:54 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.52200000000000002,"15min":0.53400000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.54900000000000004,"5min":0.878,"15min":0.878},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.503,"15min":0.51000000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.58999999999999997,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.432}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5254,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:22:03.195 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:03.195 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:03.195 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-19T02:15:28.871717+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=15, tm_sec=28, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=2, tm_min=20, tm_sec=18, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T02:22:03.197 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-19T02:22:23.198 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T02:22:23.539 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:22:23.541 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-04-19T02:22:23.550 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":288,"stamp":"2024-04-19T02:22:22.845793+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":220,"ondisk_log_size":220,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":641632,"kb_used_data":3848,"kb_used_omap":9,"kb_used_meta":637750,"kb_avail":282473888,"statfs":{"total":289910292480,"available":289253261312,"internally_reserved":0,"allocated":3940352,"data_stored":2255904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10036,"internal_metadata":653056204},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003238"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:44.754184+0000","last_change":"2024-04-19T02:20:44.754184+0000","last_active":"2024-04-19T02:20:44.754184+0000","last_peered":"2024-04-19T02:20:44.754184+0000","last_clean":"2024-04-19T02:20:44.754184+0000","last_became_active":"2024-04-19T02:19:54.929435+0000","last_became_peered":"2024-04-19T02:19:54.929435+0000","last_unstale":"2024-04-19T02:20:44.754184+0000","last_undegraded":"2024-04-19T02:20:44.754184+0000","last_fullsized":"2024-04-19T02:20:44.754184+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:44.754035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:44.754035+0000","last_clean_scrub_stamp":"2024-04-19T02:20:44.754035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:46:01.301053+0000","scrub_duration":0.089914654999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:52.728989+0000","last_change":"2024-04-19T02:20:52.728989+0000","last_active":"2024-04-19T02:20:52.728989+0000","last_peered":"2024-04-19T02:20:52.728989+0000","last_clean":"2024-04-19T02:20:52.728989+0000","last_became_active":"2024-04-19T02:19:54.931278+0000","last_became_peered":"2024-04-19T02:19:54.931278+0000","last_unstale":"2024-04-19T02:20:52.728989+0000","last_undegraded":"2024-04-19T02:20:52.728989+0000","last_fullsized":"2024-04-19T02:20:52.728989+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:52.728860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:52.728860+0000","last_clean_scrub_stamp":"2024-04-19T02:20:52.728860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:55:28.628918+0000","scrub_duration":0.0016468570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:35.678916+0000","last_change":"2024-04-19T02:20:35.678916+0000","last_active":"2024-04-19T02:20:35.678916+0000","last_peered":"2024-04-19T02:20:35.678916+0000","last_clean":"2024-04-19T02:20:35.678916+0000","last_became_active":"2024-04-19T02:15:29.286169+0000","last_became_peered":"2024-04-19T02:15:29.286169+0000","last_unstale":"2024-04-19T02:20:35.678916+0000","last_undegraded":"2024-04-19T02:20:35.678916+0000","last_fullsized":"2024-04-19T02:20:35.678916+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:35.678786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:35.678786+0000","last_clean_scrub_stamp":"2024-04-19T02:20:35.678786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:39:46.619486+0000","scrub_duration":0.0021837459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":105,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:48.579011+0000","last_change":"2024-04-19T02:21:48.579106+0000","last_active":"2024-04-19T02:21:48.579011+0000","last_peered":"2024-04-19T02:21:48.579011+0000","last_clean":"2024-04-19T02:21:48.579011+0000","last_became_active":"2024-04-19T02:19:54.926046+0000","last_became_peered":"2024-04-19T02:19:54.926046+0000","last_unstale":"2024-04-19T02:21:48.579011+0000","last_undegraded":"2024-04-19T02:21:48.579011+0000","last_fullsized":"2024-04-19T02:21:48.579011+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:48.578974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:48.578974+0000","last_clean_scrub_stamp":"2024-04-19T02:21:48.578974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:46:01.755309+0000","scrub_duration":0.001818987,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":68,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:59.656793+0000","last_change":"2024-04-19T02:20:59.656898+0000","last_active":"2024-04-19T02:20:59.656793+0000","last_peered":"2024-04-19T02:20:59.656793+0000","last_clean":"2024-04-19T02:20:59.656793+0000","last_became_active":"2024-04-19T02:19:54.931435+0000","last_became_peered":"2024-04-19T02:19:54.931435+0000","last_unstale":"2024-04-19T02:20:59.656793+0000","last_undegraded":"2024-04-19T02:20:59.656793+0000","last_fullsized":"2024-04-19T02:20:59.656793+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:59.656767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:59.656767+0000","last_clean_scrub_stamp":"2024-04-19T02:20:59.656767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:45:40.213629+0000","scrub_duration":0.021141032000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:54.564261+0000","last_change":"2024-04-19T02:21:54.564397+0000","last_active":"2024-04-19T02:21:54.564261+0000","last_peered":"2024-04-19T02:21:54.564261+0000","last_clean":"2024-04-19T02:21:54.564261+0000","last_became_active":"2024-04-19T02:19:54.923984+0000","last_became_peered":"2024-04-19T02:19:54.923984+0000","last_unstale":"2024-04-19T02:21:54.564261+0000","last_undegraded":"2024-04-19T02:21:54.564261+0000","last_fullsized":"2024-04-19T02:21:54.564261+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:54.564237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:54.564237+0000","last_clean_scrub_stamp":"2024-04-19T02:21:54.564237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:09:26.947673+0000","scrub_duration":0.0018582099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:45.640394+0000","last_change":"2024-04-19T02:20:45.640499+0000","last_active":"2024-04-19T02:20:45.640394+0000","last_peered":"2024-04-19T02:20:45.640394+0000","last_clean":"2024-04-19T02:20:45.640394+0000","last_became_active":"2024-04-19T02:19:54.925529+0000","last_became_peered":"2024-04-19T02:19:54.925529+0000","last_unstale":"2024-04-19T02:20:45.640394+0000","last_undegraded":"2024-04-19T02:20:45.640394+0000","last_fullsized":"2024-04-19T02:20:45.640394+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:45.640369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:45.640369+0000","last_clean_scrub_stamp":"2024-04-19T02:20:45.640369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:09:00.709082+0000","scrub_duration":0.022321161999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:52.504735+0000","last_change":"2024-04-19T02:21:52.504839+0000","last_active":"2024-04-19T02:21:52.504735+0000","last_peered":"2024-04-19T02:21:52.504735+0000","last_clean":"2024-04-19T02:21:52.504735+0000","last_became_active":"2024-04-19T02:19:54.930075+0000","last_became_peered":"2024-04-19T02:19:54.930075+0000","last_unstale":"2024-04-19T02:21:52.504735+0000","last_undegraded":"2024-04-19T02:21:52.504735+0000","last_fullsized":"2024-04-19T02:21:52.504735+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:52.504710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:52.504710+0000","last_clean_scrub_stamp":"2024-04-19T02:21:52.504710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:26:23.927242+0000","scrub_duration":0.0017157870000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:39.837337+0000","last_change":"2024-04-19T02:20:39.837337+0000","last_active":"2024-04-19T02:20:39.837337+0000","last_peered":"2024-04-19T02:20:39.837337+0000","last_clean":"2024-04-19T02:20:39.837337+0000","last_became_active":"2024-04-19T02:19:54.928496+0000","last_became_peered":"2024-04-19T02:19:54.928496+0000","last_unstale":"2024-04-19T02:20:39.837337+0000","last_undegraded":"2024-04-19T02:20:39.837337+0000","last_fullsized":"2024-04-19T02:20:39.837337+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:39.837177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:39.837177+0000","last_clean_scrub_stamp":"2024-04-19T02:20:39.837177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:32:07.735631+0000","scrub_duration":0.037239790000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":73,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:22:02.600976+0000","last_change":"2024-04-19T02:22:02.601092+0000","last_active":"2024-04-19T02:22:02.600976+0000","last_peered":"2024-04-19T02:22:02.600976+0000","last_clean":"2024-04-19T02:22:02.600976+0000","last_became_active":"2024-04-19T02:16:30.093344+0000","last_became_peered":"2024-04-19T02:16:30.093344+0000","last_unstale":"2024-04-19T02:22:02.600976+0000","last_undegraded":"2024-04-19T02:22:02.600976+0000","last_fullsized":"2024-04-19T02:22:02.600976+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:22:02.600950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:22:02.600950+0000","last_clean_scrub_stamp":"2024-04-19T02:22:02.600950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:37:12.999109+0000","scrub_duration":0.0017499709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:22:01.634559+0000","last_change":"2024-04-19T02:22:01.634696+0000","last_active":"2024-04-19T02:22:01.634559+0000","last_peered":"2024-04-19T02:22:01.634559+0000","last_clean":"2024-04-19T02:22:01.634559+0000","last_became_active":"2024-04-19T02:19:54.926040+0000","last_became_peered":"2024-04-19T02:19:54.926040+0000","last_unstale":"2024-04-19T02:22:01.634559+0000","last_undegraded":"2024-04-19T02:22:01.634559+0000","last_fullsized":"2024-04-19T02:22:01.634559+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:22:01.634533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:22:01.634533+0000","last_clean_scrub_stamp":"2024-04-19T02:22:01.634533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:10:32.973184+0000","scrub_duration":0.021464392999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:22:00.548437+0000","last_change":"2024-04-19T02:22:00.548534+0000","last_active":"2024-04-19T02:22:00.548437+0000","last_peered":"2024-04-19T02:22:00.548437+0000","last_clean":"2024-04-19T02:22:00.548437+0000","last_became_active":"2024-04-19T02:20:08.662234+0000","last_became_peered":"2024-04-19T02:20:08.662234+0000","last_unstale":"2024-04-19T02:22:00.548437+0000","last_undegraded":"2024-04-19T02:22:00.548437+0000","last_fullsized":"2024-04-19T02:22:00.548437+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:22:00.548413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:22:00.548413+0000","last_clean_scrub_stamp":"2024-04-19T02:22:00.548413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:51.772980+0000","scrub_duration":0.001606309,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":68,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:24.574781+0000","last_change":"2024-04-19T02:20:24.574893+0000","last_active":"2024-04-19T02:20:24.574781+0000","last_peered":"2024-04-19T02:20:24.574781+0000","last_clean":"2024-04-19T02:20:24.574781+0000","last_became_active":"2024-04-19T02:19:54.932240+0000","last_became_peered":"2024-04-19T02:19:54.932240+0000","last_unstale":"2024-04-19T02:20:24.574781+0000","last_undegraded":"2024-04-19T02:20:24.574781+0000","last_fullsized":"2024-04-19T02:20:24.574781+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:24.574756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:24.574756+0000","last_clean_scrub_stamp":"2024-04-19T02:20:24.574756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:05:16.137888+0000","scrub_duration":0.02235088,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:52.533209+0000","last_change":"2024-04-19T02:20:52.533329+0000","last_active":"2024-04-19T02:20:52.533209+0000","last_peered":"2024-04-19T02:20:52.533209+0000","last_clean":"2024-04-19T02:20:52.533209+0000","last_became_active":"2024-04-19T02:15:29.283121+0000","last_became_peered":"2024-04-19T02:15:29.283121+0000","last_unstale":"2024-04-19T02:20:52.533209+0000","last_undegraded":"2024-04-19T02:20:52.533209+0000","last_fullsized":"2024-04-19T02:20:52.533209+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:52.533183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:52.533183+0000","last_clean_scrub_stamp":"2024-04-19T02:20:52.533183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:46:09.200215+0000","scrub_duration":0.0015891010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:01.631997+0000","last_change":"2024-04-19T02:21:01.632133+0000","last_active":"2024-04-19T02:21:01.631997+0000","last_peered":"2024-04-19T02:21:01.631997+0000","last_clean":"2024-04-19T02:21:01.631997+0000","last_became_active":"2024-04-19T02:15:29.284649+0000","last_became_peered":"2024-04-19T02:15:29.284649+0000","last_unstale":"2024-04-19T02:21:01.631997+0000","last_undegraded":"2024-04-19T02:21:01.631997+0000","last_fullsized":"2024-04-19T02:21:01.631997+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:01.631972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:01.631972+0000","last_clean_scrub_stamp":"2024-04-19T02:21:01.631972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:49:22.367870+0000","scrub_duration":0.001884562,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:20.567013+0000","last_change":"2024-04-19T02:20:20.567149+0000","last_active":"2024-04-19T02:20:20.567013+0000","last_peered":"2024-04-19T02:20:20.567013+0000","last_clean":"2024-04-19T02:20:20.567013+0000","last_became_active":"2024-04-19T02:19:54.930437+0000","last_became_peered":"2024-04-19T02:19:54.930437+0000","last_unstale":"2024-04-19T02:20:20.567013+0000","last_undegraded":"2024-04-19T02:20:20.567013+0000","last_fullsized":"2024-04-19T02:20:20.567013+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:20.566972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:20.566972+0000","last_clean_scrub_stamp":"2024-04-19T02:20:20.566972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:59:10.317082+0000","scrub_duration":0.00187685,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":53,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:47.983289+0000","last_change":"2024-04-19T02:21:47.983289+0000","last_active":"2024-04-19T02:21:47.983289+0000","last_peered":"2024-04-19T02:21:47.983289+0000","last_clean":"2024-04-19T02:21:47.983289+0000","last_became_active":"2024-04-19T02:20:10.001343+0000","last_became_peered":"2024-04-19T02:20:10.001343+0000","last_unstale":"2024-04-19T02:21:47.983289+0000","last_undegraded":"2024-04-19T02:21:47.983289+0000","last_fullsized":"2024-04-19T02:21:47.983289+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:47.983159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:47.983159+0000","last_clean_scrub_stamp":"2024-04-19T02:21:47.983159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:20:39.994026+0000","scrub_duration":0.100474256,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":103,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:04.663105+0000","last_change":"2024-04-19T02:21:04.663219+0000","last_active":"2024-04-19T02:21:04.663105+0000","last_peered":"2024-04-19T02:21:04.663105+0000","last_clean":"2024-04-19T02:21:04.663105+0000","last_became_active":"2024-04-19T02:19:54.933233+0000","last_became_peered":"2024-04-19T02:19:54.933233+0000","last_unstale":"2024-04-19T02:21:04.663105+0000","last_undegraded":"2024-04-19T02:21:04.663105+0000","last_fullsized":"2024-04-19T02:21:04.663105+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:04.663080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:04.663080+0000","last_clean_scrub_stamp":"2024-04-19T02:21:04.663080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:24:22.993742+0000","scrub_duration":0.0015971410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:29.031138+0000","last_change":"2024-04-19T02:21:29.031138+0000","last_active":"2024-04-19T02:21:29.031138+0000","last_peered":"2024-04-19T02:21:29.031138+0000","last_clean":"2024-04-19T02:21:29.031138+0000","last_became_active":"2024-04-19T02:19:54.925060+0000","last_became_peered":"2024-04-19T02:19:54.925060+0000","last_unstale":"2024-04-19T02:21:29.031138+0000","last_undegraded":"2024-04-19T02:21:29.031138+0000","last_fullsized":"2024-04-19T02:21:29.031138+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:29.030973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:29.030973+0000","last_clean_scrub_stamp":"2024-04-19T02:21:29.030973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:34.156200+0000","scrub_duration":0.036993951999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":105,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:32.721654+0000","last_change":"2024-04-19T02:20:32.721654+0000","last_active":"2024-04-19T02:20:32.721654+0000","last_peered":"2024-04-19T02:20:32.721654+0000","last_clean":"2024-04-19T02:20:32.721654+0000","last_became_active":"2024-04-19T02:19:54.926442+0000","last_became_peered":"2024-04-19T02:19:54.926442+0000","last_unstale":"2024-04-19T02:20:32.721654+0000","last_undegraded":"2024-04-19T02:20:32.721654+0000","last_fullsized":"2024-04-19T02:20:32.721654+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:32.721479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:32.721479+0000","last_clean_scrub_stamp":"2024-04-19T02:20:32.721479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:23:51.052141+0000","scrub_duration":0.0020564210000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":105,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:53.574568+0000","last_change":"2024-04-19T02:21:53.574568+0000","last_active":"2024-04-19T02:21:53.574568+0000","last_peered":"2024-04-19T02:21:53.574568+0000","last_clean":"2024-04-19T02:21:53.574568+0000","last_became_active":"2024-04-19T02:19:54.931438+0000","last_became_peered":"2024-04-19T02:19:54.931438+0000","last_unstale":"2024-04-19T02:21:53.574568+0000","last_undegraded":"2024-04-19T02:21:53.574568+0000","last_fullsized":"2024-04-19T02:21:53.574568+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:53.574412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:53.574412+0000","last_clean_scrub_stamp":"2024-04-19T02:21:53.574412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:06:16.951422+0000","scrub_duration":0.031250192000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:56.579508+0000","last_change":"2024-04-19T02:21:56.579617+0000","last_active":"2024-04-19T02:21:56.579508+0000","last_peered":"2024-04-19T02:21:56.579508+0000","last_clean":"2024-04-19T02:21:56.579508+0000","last_became_active":"2024-04-19T02:20:08.661940+0000","last_became_peered":"2024-04-19T02:20:08.661940+0000","last_unstale":"2024-04-19T02:21:56.579508+0000","last_undegraded":"2024-04-19T02:21:56.579508+0000","last_fullsized":"2024-04-19T02:21:56.579508+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:56.579482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:56.579482+0000","last_clean_scrub_stamp":"2024-04-19T02:21:56.579482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:41:20.227858+0000","scrub_duration":0.001865947,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":54,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:38.921808+0000","last_change":"2024-04-19T02:21:38.921808+0000","last_active":"2024-04-19T02:21:38.921808+0000","last_peered":"2024-04-19T02:21:38.921808+0000","last_clean":"2024-04-19T02:21:38.921808+0000","last_became_active":"2024-04-19T02:20:10.639036+0000","last_became_peered":"2024-04-19T02:20:10.639036+0000","last_unstale":"2024-04-19T02:21:38.921808+0000","last_undegraded":"2024-04-19T02:21:38.921808+0000","last_fullsized":"2024-04-19T02:21:38.921808+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:38.921639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:38.921639+0000","last_clean_scrub_stamp":"2024-04-19T02:21:38.921639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:29:01.933583+0000","scrub_duration":0.0017929129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:54.722628+0000","last_change":"2024-04-19T02:20:54.722628+0000","last_active":"2024-04-19T02:20:54.722628+0000","last_peered":"2024-04-19T02:20:54.722628+0000","last_clean":"2024-04-19T02:20:54.722628+0000","last_became_active":"2024-04-19T02:19:54.928261+0000","last_became_peered":"2024-04-19T02:19:54.928261+0000","last_unstale":"2024-04-19T02:20:54.722628+0000","last_undegraded":"2024-04-19T02:20:54.722628+0000","last_fullsized":"2024-04-19T02:20:54.722628+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:54.722476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:54.722476+0000","last_clean_scrub_stamp":"2024-04-19T02:20:54.722476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:41:38.555723+0000","scrub_duration":0.0018882219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:41.636049+0000","last_change":"2024-04-19T02:20:41.636049+0000","last_active":"2024-04-19T02:20:41.636049+0000","last_peered":"2024-04-19T02:20:41.636049+0000","last_clean":"2024-04-19T02:20:41.636049+0000","last_became_active":"2024-04-19T02:15:29.276952+0000","last_became_peered":"2024-04-19T02:15:29.276952+0000","last_unstale":"2024-04-19T02:20:41.636049+0000","last_undegraded":"2024-04-19T02:20:41.636049+0000","last_fullsized":"2024-04-19T02:20:41.636049+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:41.635899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:41.635899+0000","last_clean_scrub_stamp":"2024-04-19T02:20:41.635899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:02:03.442021+0000","scrub_duration":0.035233386999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:36.825423+0000","last_change":"2024-04-19T02:20:36.825423+0000","last_active":"2024-04-19T02:20:36.825423+0000","last_peered":"2024-04-19T02:20:36.825423+0000","last_clean":"2024-04-19T02:20:36.825423+0000","last_became_active":"2024-04-19T02:19:54.931124+0000","last_became_peered":"2024-04-19T02:19:54.931124+0000","last_unstale":"2024-04-19T02:20:36.825423+0000","last_undegraded":"2024-04-19T02:20:36.825423+0000","last_fullsized":"2024-04-19T02:20:36.825423+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:36.825293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:36.825293+0000","last_clean_scrub_stamp":"2024-04-19T02:20:36.825293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:26:48.954624+0000","scrub_duration":0.0020341249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:55.558483+0000","last_change":"2024-04-19T02:21:55.558483+0000","last_active":"2024-04-19T02:21:55.558483+0000","last_peered":"2024-04-19T02:21:55.558483+0000","last_clean":"2024-04-19T02:21:55.558483+0000","last_became_active":"2024-04-19T02:15:29.286431+0000","last_became_peered":"2024-04-19T02:15:29.286431+0000","last_unstale":"2024-04-19T02:21:55.558483+0000","last_undegraded":"2024-04-19T02:21:55.558483+0000","last_fullsized":"2024-04-19T02:21:55.558483+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:55.558322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:55.558322+0000","last_clean_scrub_stamp":"2024-04-19T02:21:55.558322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:01:47.471071+0000","scrub_duration":0.0018107189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:07.561762+0000","last_change":"2024-04-19T02:21:07.561888+0000","last_active":"2024-04-19T02:21:07.561762+0000","last_peered":"2024-04-19T02:21:07.561762+0000","last_clean":"2024-04-19T02:21:07.561762+0000","last_became_active":"2024-04-19T02:19:54.926838+0000","last_became_peered":"2024-04-19T02:19:54.926838+0000","last_unstale":"2024-04-19T02:21:07.561762+0000","last_undegraded":"2024-04-19T02:21:07.561762+0000","last_fullsized":"2024-04-19T02:21:07.561762+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-19T02:21:07.561735+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-19T02:21:07.561735+0000","last_clean_scrub_stamp":"2024-04-19T02:21:07.561735+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:40:18.502435+0000","scrub_duration":0.001800028,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:17.504243+0000","last_change":"2024-04-19T02:21:17.504338+0000","last_active":"2024-04-19T02:21:17.504243+0000","last_peered":"2024-04-19T02:21:17.504243+0000","last_clean":"2024-04-19T02:21:17.504243+0000","last_became_active":"2024-04-19T02:15:29.280479+0000","last_became_peered":"2024-04-19T02:15:29.280479+0000","last_unstale":"2024-04-19T02:21:17.504243+0000","last_undegraded":"2024-04-19T02:21:17.504243+0000","last_fullsized":"2024-04-19T02:21:17.504243+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:17.504211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:17.504211+0000","last_clean_scrub_stamp":"2024-04-19T02:21:17.504211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:09:32.572924+0000","scrub_duration":0.001817379,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.012939+0000","last_change":"2024-04-19T02:21:18.012939+0000","last_active":"2024-04-19T02:21:18.012939+0000","last_peered":"2024-04-19T02:21:18.012939+0000","last_clean":"2024-04-19T02:21:18.012939+0000","last_became_active":"2024-04-19T02:19:54.924484+0000","last_became_peered":"2024-04-19T02:19:54.924484+0000","last_unstale":"2024-04-19T02:21:18.012939+0000","last_undegraded":"2024-04-19T02:21:18.012939+0000","last_fullsized":"2024-04-19T02:21:18.012939+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:18.012814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:18.012814+0000","last_clean_scrub_stamp":"2024-04-19T02:21:18.012814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:22:58.977653+0000","scrub_duration":0.0018265969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":54,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:57.920291+0000","last_change":"2024-04-19T02:21:57.920396+0000","last_active":"2024-04-19T02:21:57.920291+0000","last_peered":"2024-04-19T02:21:57.920291+0000","last_clean":"2024-04-19T02:21:57.920291+0000","last_became_active":"2024-04-19T02:20:10.638737+0000","last_became_peered":"2024-04-19T02:20:10.638737+0000","last_unstale":"2024-04-19T02:21:57.920291+0000","last_undegraded":"2024-04-19T02:21:57.920291+0000","last_fullsized":"2024-04-19T02:21:57.920291+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:57.920266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:57.920266+0000","last_clean_scrub_stamp":"2024-04-19T02:21:57.920266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:23:45.757644+0000","scrub_duration":0.0018666679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:08.944722+0000","last_change":"2024-04-19T02:21:08.944722+0000","last_active":"2024-04-19T02:21:08.944722+0000","last_peered":"2024-04-19T02:21:08.944722+0000","last_clean":"2024-04-19T02:21:08.944722+0000","last_became_active":"2024-04-19T02:19:54.928398+0000","last_became_peered":"2024-04-19T02:19:54.928398+0000","last_unstale":"2024-04-19T02:21:08.944722+0000","last_undegraded":"2024-04-19T02:21:08.944722+0000","last_fullsized":"2024-04-19T02:21:08.944722+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:08.944563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:08.944563+0000","last_clean_scrub_stamp":"2024-04-19T02:21:08.944563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:16:16.242584+0000","scrub_duration":0.0016415690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:34.630281+0000","last_change":"2024-04-19T02:20:34.630281+0000","last_active":"2024-04-19T02:20:34.630281+0000","last_peered":"2024-04-19T02:20:34.630281+0000","last_clean":"2024-04-19T02:20:34.630281+0000","last_became_active":"2024-04-19T02:15:29.279314+0000","last_became_peered":"2024-04-19T02:15:29.279314+0000","last_unstale":"2024-04-19T02:20:34.630281+0000","last_undegraded":"2024-04-19T02:20:34.630281+0000","last_fullsized":"2024-04-19T02:20:34.630281+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:34.630122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:34.630122+0000","last_clean_scrub_stamp":"2024-04-19T02:20:34.630122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:19:42.256810+0000","scrub_duration":0.066969174000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:47.942846+0000","last_change":"2024-04-19T02:20:47.942846+0000","last_active":"2024-04-19T02:20:47.942846+0000","last_peered":"2024-04-19T02:20:47.942846+0000","last_clean":"2024-04-19T02:20:47.942846+0000","last_became_active":"2024-04-19T02:19:54.925729+0000","last_became_peered":"2024-04-19T02:19:54.925729+0000","last_unstale":"2024-04-19T02:20:47.942846+0000","last_undegraded":"2024-04-19T02:20:47.942846+0000","last_fullsized":"2024-04-19T02:20:47.942846+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:47.942715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:47.942715+0000","last_clean_scrub_stamp":"2024-04-19T02:20:47.942715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:53:52.743256+0000","scrub_duration":0.001689886,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:15.993771+0000","last_change":"2024-04-19T02:21:15.993771+0000","last_active":"2024-04-19T02:21:15.993771+0000","last_peered":"2024-04-19T02:21:15.993771+0000","last_clean":"2024-04-19T02:21:15.993771+0000","last_became_active":"2024-04-19T02:19:54.927666+0000","last_became_peered":"2024-04-19T02:19:54.927666+0000","last_unstale":"2024-04-19T02:21:15.993771+0000","last_undegraded":"2024-04-19T02:21:15.993771+0000","last_fullsized":"2024-04-19T02:21:15.993771+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:15.993623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:15.993623+0000","last_clean_scrub_stamp":"2024-04-19T02:21:15.993623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:05:45.212212+0000","scrub_duration":0.0019736129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":105,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:05.779304+0000","last_change":"2024-04-19T02:21:05.779445+0000","last_active":"2024-04-19T02:21:05.779304+0000","last_peered":"2024-04-19T02:21:05.779304+0000","last_clean":"2024-04-19T02:21:05.779304+0000","last_became_active":"2024-04-19T02:19:54.931540+0000","last_became_peered":"2024-04-19T02:19:54.931540+0000","last_unstale":"2024-04-19T02:21:05.779304+0000","last_undegraded":"2024-04-19T02:21:05.779304+0000","last_fullsized":"2024-04-19T02:21:05.779304+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:05.779268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:05.779268+0000","last_clean_scrub_stamp":"2024-04-19T02:21:05.779268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:40:53.826444+0000","scrub_duration":0.0018519179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:24.906512+0000","last_change":"2024-04-19T02:20:24.906512+0000","last_active":"2024-04-19T02:20:24.906512+0000","last_peered":"2024-04-19T02:20:24.906512+0000","last_clean":"2024-04-19T02:20:24.906512+0000","last_became_active":"2024-04-19T02:19:54.923784+0000","last_became_peered":"2024-04-19T02:19:54.923784+0000","last_unstale":"2024-04-19T02:20:24.906512+0000","last_undegraded":"2024-04-19T02:20:24.906512+0000","last_fullsized":"2024-04-19T02:20:24.906512+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:24.906368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:24.906368+0000","last_clean_scrub_stamp":"2024-04-19T02:20:24.906368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:16:17.186228+0000","scrub_duration":0.0016771609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"82'5","reported_seq":96,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:31.607416+0000","last_change":"2024-04-19T02:21:31.607527+0000","last_active":"2024-04-19T02:21:31.607416+0000","last_peered":"2024-04-19T02:21:31.607416+0000","last_clean":"2024-04-19T02:21:31.607416+0000","last_became_active":"2024-04-19T02:15:28.891440+0000","last_became_peered":"2024-04-19T02:15:28.891440+0000","last_unstale":"2024-04-19T02:21:31.607416+0000","last_undegraded":"2024-04-19T02:21:31.607416+0000","last_fullsized":"2024-04-19T02:21:31.607416+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'5","last_scrub_stamp":"2024-04-19T02:21:31.607389+0000","last_deep_scrub":"82'5","last_deep_scrub_stamp":"2024-04-19T02:21:31.607389+0000","last_clean_scrub_stamp":"2024-04-19T02:21:31.607389+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:21:18.270455+0000","scrub_duration":0.0041207539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:10.974630+0000","last_change":"2024-04-19T02:21:10.974630+0000","last_active":"2024-04-19T02:21:10.974630+0000","last_peered":"2024-04-19T02:21:10.974630+0000","last_clean":"2024-04-19T02:21:10.974630+0000","last_became_active":"2024-04-19T02:19:54.923493+0000","last_became_peered":"2024-04-19T02:19:54.923493+0000","last_unstale":"2024-04-19T02:21:10.974630+0000","last_undegraded":"2024-04-19T02:21:10.974630+0000","last_fullsized":"2024-04-19T02:21:10.974630+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:10.974492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:10.974492+0000","last_clean_scrub_stamp":"2024-04-19T02:21:10.974492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:17:16.098605+0000","scrub_duration":0.0017195929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"82'10","reported_seq":102,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:45.705431+0000","last_change":"2024-04-19T02:21:45.705536+0000","last_active":"2024-04-19T02:21:45.705431+0000","last_peered":"2024-04-19T02:21:45.705431+0000","last_clean":"2024-04-19T02:21:45.705431+0000","last_became_active":"2024-04-19T02:15:28.890795+0000","last_became_peered":"2024-04-19T02:15:28.890795+0000","last_unstale":"2024-04-19T02:21:45.705431+0000","last_undegraded":"2024-04-19T02:21:45.705431+0000","last_fullsized":"2024-04-19T02:21:45.705431+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'10","last_scrub_stamp":"2024-04-19T02:21:45.705404+0000","last_deep_scrub":"82'10","last_deep_scrub_stamp":"2024-04-19T02:21:45.705404+0000","last_clean_scrub_stamp":"2024-04-19T02:21:45.705404+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:10:12.439074+0000","scrub_duration":0.0045696920000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:59.594482+0000","last_change":"2024-04-19T02:20:59.594635+0000","last_active":"2024-04-19T02:20:59.594482+0000","last_peered":"2024-04-19T02:20:59.594482+0000","last_clean":"2024-04-19T02:20:59.594482+0000","last_became_active":"2024-04-19T02:15:29.277547+0000","last_became_peered":"2024-04-19T02:15:29.277547+0000","last_unstale":"2024-04-19T02:20:59.594482+0000","last_undegraded":"2024-04-19T02:20:59.594482+0000","last_fullsized":"2024-04-19T02:20:59.594482+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:59.594458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:59.594458+0000","last_clean_scrub_stamp":"2024-04-19T02:20:59.594458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:20:46.257524+0000","scrub_duration":0.001831102,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"82'4","reported_seq":109,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:54.609805+0000","last_change":"2024-04-19T02:20:54.609979+0000","last_active":"2024-04-19T02:20:54.609805+0000","last_peered":"2024-04-19T02:20:54.609805+0000","last_clean":"2024-04-19T02:20:54.609805+0000","last_became_active":"2024-04-19T02:19:54.932829+0000","last_became_peered":"2024-04-19T02:19:54.932829+0000","last_unstale":"2024-04-19T02:20:54.609805+0000","last_undegraded":"2024-04-19T02:20:54.609805+0000","last_fullsized":"2024-04-19T02:20:54.609805+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'4","last_scrub_stamp":"2024-04-19T02:20:54.609763+0000","last_deep_scrub":"82'4","last_deep_scrub_stamp":"2024-04-19T02:20:54.609763+0000","last_clean_scrub_stamp":"2024-04-19T02:20:54.609763+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:53:50.278165+0000","scrub_duration":0.0044989499999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":61,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:55.569470+0000","last_change":"2024-04-19T02:21:55.569575+0000","last_active":"2024-04-19T02:21:55.569470+0000","last_peered":"2024-04-19T02:21:55.569470+0000","last_clean":"2024-04-19T02:21:55.569470+0000","last_became_active":"2024-04-19T02:20:07.983080+0000","last_became_peered":"2024-04-19T02:20:07.983080+0000","last_unstale":"2024-04-19T02:21:55.569470+0000","last_undegraded":"2024-04-19T02:21:55.569470+0000","last_fullsized":"2024-04-19T02:21:55.569470+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:55.569445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:55.569445+0000","last_clean_scrub_stamp":"2024-04-19T02:21:55.569445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:56:50.833153+0000","scrub_duration":0.001721474,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:31.028561+0000","last_change":"2024-04-19T02:21:31.028561+0000","last_active":"2024-04-19T02:21:31.028561+0000","last_peered":"2024-04-19T02:21:31.028561+0000","last_clean":"2024-04-19T02:21:31.028561+0000","last_became_active":"2024-04-19T02:19:54.925703+0000","last_became_peered":"2024-04-19T02:19:54.925703+0000","last_unstale":"2024-04-19T02:21:31.028561+0000","last_undegraded":"2024-04-19T02:21:31.028561+0000","last_fullsized":"2024-04-19T02:21:31.028561+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:31.028410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:31.028410+0000","last_clean_scrub_stamp":"2024-04-19T02:21:31.028410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:46:36.306863+0000","scrub_duration":0.00173,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":68,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:39.643386+0000","last_change":"2024-04-19T02:21:39.643503+0000","last_active":"2024-04-19T02:21:39.643386+0000","last_peered":"2024-04-19T02:21:39.643386+0000","last_clean":"2024-04-19T02:21:39.643386+0000","last_became_active":"2024-04-19T02:19:54.925634+0000","last_became_peered":"2024-04-19T02:19:54.925634+0000","last_unstale":"2024-04-19T02:21:39.643386+0000","last_undegraded":"2024-04-19T02:21:39.643386+0000","last_fullsized":"2024-04-19T02:21:39.643386+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:39.643363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:39.643363+0000","last_clean_scrub_stamp":"2024-04-19T02:21:39.643363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:57:07.241074+0000","scrub_duration":0.020300881,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:34.594648+0000","last_change":"2024-04-19T02:21:34.594758+0000","last_active":"2024-04-19T02:21:34.594648+0000","last_peered":"2024-04-19T02:21:34.594648+0000","last_clean":"2024-04-19T02:21:34.594648+0000","last_became_active":"2024-04-19T02:15:28.891879+0000","last_became_peered":"2024-04-19T02:15:28.891879+0000","last_unstale":"2024-04-19T02:21:34.594648+0000","last_undegraded":"2024-04-19T02:21:34.594648+0000","last_fullsized":"2024-04-19T02:21:34.594648+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:34.594623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:34.594623+0000","last_clean_scrub_stamp":"2024-04-19T02:21:34.594623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:30:55.595121+0000","scrub_duration":0.0019129990000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":54,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:51.906622+0000","last_change":"2024-04-19T02:21:51.906622+0000","last_active":"2024-04-19T02:21:51.906622+0000","last_peered":"2024-04-19T02:21:51.906622+0000","last_clean":"2024-04-19T02:21:51.906622+0000","last_became_active":"2024-04-19T02:20:10.638755+0000","last_became_peered":"2024-04-19T02:20:10.638755+0000","last_unstale":"2024-04-19T02:21:51.906622+0000","last_undegraded":"2024-04-19T02:21:51.906622+0000","last_fullsized":"2024-04-19T02:21:51.906622+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:51.906470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:51.906470+0000","last_clean_scrub_stamp":"2024-04-19T02:21:51.906470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:02:41.220265+0000","scrub_duration":0.0015939859999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"82'12","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:41.732906+0000","last_change":"2024-04-19T02:21:41.733038+0000","last_active":"2024-04-19T02:21:41.732906+0000","last_peered":"2024-04-19T02:21:41.732906+0000","last_clean":"2024-04-19T02:21:41.732906+0000","last_became_active":"2024-04-19T02:15:28.890882+0000","last_became_peered":"2024-04-19T02:15:28.890882+0000","last_unstale":"2024-04-19T02:21:41.732906+0000","last_undegraded":"2024-04-19T02:21:41.732906+0000","last_fullsized":"2024-04-19T02:21:41.732906+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'12","last_scrub_stamp":"2024-04-19T02:21:41.732879+0000","last_deep_scrub":"82'12","last_deep_scrub_stamp":"2024-04-19T02:21:41.732879+0000","last_clean_scrub_stamp":"2024-04-19T02:21:41.732879+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:16:45.543977+0000","scrub_duration":0.011745591999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:54.023600+0000","last_change":"2024-04-19T02:20:54.023600+0000","last_active":"2024-04-19T02:20:54.023600+0000","last_peered":"2024-04-19T02:20:54.023600+0000","last_clean":"2024-04-19T02:20:54.023600+0000","last_became_active":"2024-04-19T02:19:54.925121+0000","last_became_peered":"2024-04-19T02:19:54.925121+0000","last_unstale":"2024-04-19T02:20:54.023600+0000","last_undegraded":"2024-04-19T02:20:54.023600+0000","last_fullsized":"2024-04-19T02:20:54.023600+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:54.023433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:54.023433+0000","last_clean_scrub_stamp":"2024-04-19T02:20:54.023433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:02:43.764667+0000","scrub_duration":0.053810324999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"82'2","reported_seq":95,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:08.799794+0000","last_change":"2024-04-19T02:21:08.799794+0000","last_active":"2024-04-19T02:21:08.799794+0000","last_peered":"2024-04-19T02:21:08.799794+0000","last_clean":"2024-04-19T02:21:08.799794+0000","last_became_active":"2024-04-19T02:15:28.890004+0000","last_became_peered":"2024-04-19T02:15:28.890004+0000","last_unstale":"2024-04-19T02:21:08.799794+0000","last_undegraded":"2024-04-19T02:21:08.799794+0000","last_fullsized":"2024-04-19T02:21:08.799794+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-19T02:21:08.799663+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-19T02:21:08.799663+0000","last_clean_scrub_stamp":"2024-04-19T02:21:08.799663+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:23:57.962043+0000","scrub_duration":0.0033993159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:37.549289+0000","last_change":"2024-04-19T02:20:37.549289+0000","last_active":"2024-04-19T02:20:37.549289+0000","last_peered":"2024-04-19T02:20:37.549289+0000","last_clean":"2024-04-19T02:20:37.549289+0000","last_became_active":"2024-04-19T02:15:29.285197+0000","last_became_peered":"2024-04-19T02:15:29.285197+0000","last_unstale":"2024-04-19T02:20:37.549289+0000","last_undegraded":"2024-04-19T02:20:37.549289+0000","last_fullsized":"2024-04-19T02:20:37.549289+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:37.549154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:37.549154+0000","last_clean_scrub_stamp":"2024-04-19T02:20:37.549154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:18:16.168949+0000","scrub_duration":0.0014928389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"82'3","reported_seq":95,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:24.538404+0000","last_change":"2024-04-19T02:21:24.538404+0000","last_active":"2024-04-19T02:21:24.538404+0000","last_peered":"2024-04-19T02:21:24.538404+0000","last_clean":"2024-04-19T02:21:24.538404+0000","last_became_active":"2024-04-19T02:15:28.893231+0000","last_became_peered":"2024-04-19T02:15:28.893231+0000","last_unstale":"2024-04-19T02:21:24.538404+0000","last_undegraded":"2024-04-19T02:21:24.538404+0000","last_fullsized":"2024-04-19T02:21:24.538404+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-19T02:21:24.538258+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-19T02:21:24.538258+0000","last_clean_scrub_stamp":"2024-04-19T02:21:24.538258+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:46:41.205290+0000","scrub_duration":0.0060652270000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:49.727441+0000","last_change":"2024-04-19T02:20:49.727441+0000","last_active":"2024-04-19T02:20:49.727441+0000","last_peered":"2024-04-19T02:20:49.727441+0000","last_clean":"2024-04-19T02:20:49.727441+0000","last_became_active":"2024-04-19T02:19:54.925502+0000","last_became_peered":"2024-04-19T02:19:54.925502+0000","last_unstale":"2024-04-19T02:20:49.727441+0000","last_undegraded":"2024-04-19T02:20:49.727441+0000","last_fullsized":"2024-04-19T02:20:49.727441+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:49.727309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:49.727309+0000","last_clean_scrub_stamp":"2024-04-19T02:20:49.727309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:34:41.219108+0000","scrub_duration":0.002043497,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"82'2","reported_seq":95,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:12.770278+0000","last_change":"2024-04-19T02:21:12.770278+0000","last_active":"2024-04-19T02:21:12.770278+0000","last_peered":"2024-04-19T02:21:12.770278+0000","last_clean":"2024-04-19T02:21:12.770278+0000","last_became_active":"2024-04-19T02:15:28.890881+0000","last_became_peered":"2024-04-19T02:15:28.890881+0000","last_unstale":"2024-04-19T02:21:12.770278+0000","last_undegraded":"2024-04-19T02:21:12.770278+0000","last_fullsized":"2024-04-19T02:21:12.770278+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-19T02:21:12.770155+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-19T02:21:12.770155+0000","last_clean_scrub_stamp":"2024-04-19T02:21:12.770155+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:56:59.212815+0000","scrub_duration":0.00314285,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":105,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:47.623590+0000","last_change":"2024-04-19T02:21:47.623590+0000","last_active":"2024-04-19T02:21:47.623590+0000","last_peered":"2024-04-19T02:21:47.623590+0000","last_clean":"2024-04-19T02:21:47.623590+0000","last_became_active":"2024-04-19T02:19:54.925591+0000","last_became_peered":"2024-04-19T02:19:54.925591+0000","last_unstale":"2024-04-19T02:21:47.623590+0000","last_undegraded":"2024-04-19T02:21:47.623590+0000","last_fullsized":"2024-04-19T02:21:47.623590+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:47.623444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:47.623444+0000","last_clean_scrub_stamp":"2024-04-19T02:21:47.623444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:22:28.648322+0000","scrub_duration":0.001700263,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":106,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.627484+0000","last_change":"2024-04-19T02:21:00.627484+0000","last_active":"2024-04-19T02:21:00.627484+0000","last_peered":"2024-04-19T02:21:00.627484+0000","last_clean":"2024-04-19T02:21:00.627484+0000","last_became_active":"2024-04-19T02:19:54.925523+0000","last_became_peered":"2024-04-19T02:19:54.925523+0000","last_unstale":"2024-04-19T02:21:00.627484+0000","last_undegraded":"2024-04-19T02:21:00.627484+0000","last_fullsized":"2024-04-19T02:21:00.627484+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:00.627355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:00.627355+0000","last_clean_scrub_stamp":"2024-04-19T02:21:00.627355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:39.950387+0000","scrub_duration":0.0016425540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:31.927940+0000","last_change":"2024-04-19T02:20:31.927940+0000","last_active":"2024-04-19T02:20:31.927940+0000","last_peered":"2024-04-19T02:20:31.927940+0000","last_clean":"2024-04-19T02:20:31.927940+0000","last_became_active":"2024-04-19T02:19:54.930843+0000","last_became_peered":"2024-04-19T02:19:54.930843+0000","last_unstale":"2024-04-19T02:20:31.927940+0000","last_undegraded":"2024-04-19T02:20:31.927940+0000","last_fullsized":"2024-04-19T02:20:31.927940+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:31.927783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:31.927783+0000","last_clean_scrub_stamp":"2024-04-19T02:20:31.927783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:16.149096+0000","scrub_duration":0.037287204999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'3","reported_seq":45,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:36.961895+0000","last_change":"2024-04-19T02:21:36.961895+0000","last_active":"2024-04-19T02:21:36.961895+0000","last_peered":"2024-04-19T02:21:36.961895+0000","last_clean":"2024-04-19T02:21:36.961895+0000","last_became_active":"2024-04-19T02:19:54.931553+0000","last_became_peered":"2024-04-19T02:19:54.931553+0000","last_unstale":"2024-04-19T02:21:36.961895+0000","last_undegraded":"2024-04-19T02:21:36.961895+0000","last_fullsized":"2024-04-19T02:21:36.961895+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-19T02:21:36.961704+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-19T02:21:36.961704+0000","last_clean_scrub_stamp":"2024-04-19T02:21:36.961704+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:06:19.021234+0000","scrub_duration":0.0035191599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":105,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:07.840904+0000","last_change":"2024-04-19T02:21:07.840904+0000","last_active":"2024-04-19T02:21:07.840904+0000","last_peered":"2024-04-19T02:21:07.840904+0000","last_clean":"2024-04-19T02:21:07.840904+0000","last_became_active":"2024-04-19T02:19:54.925645+0000","last_became_peered":"2024-04-19T02:19:54.925645+0000","last_unstale":"2024-04-19T02:21:07.840904+0000","last_undegraded":"2024-04-19T02:21:07.840904+0000","last_fullsized":"2024-04-19T02:21:07.840904+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:07.840784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:07.840784+0000","last_clean_scrub_stamp":"2024-04-19T02:21:07.840784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:56:35.438495+0000","scrub_duration":0.0018420279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":106,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.798790+0000","last_change":"2024-04-19T02:21:18.798790+0000","last_active":"2024-04-19T02:21:18.798790+0000","last_peered":"2024-04-19T02:21:18.798790+0000","last_clean":"2024-04-19T02:21:18.798790+0000","last_became_active":"2024-04-19T02:19:54.923321+0000","last_became_peered":"2024-04-19T02:19:54.923321+0000","last_unstale":"2024-04-19T02:21:18.798790+0000","last_undegraded":"2024-04-19T02:21:18.798790+0000","last_fullsized":"2024-04-19T02:21:18.798790+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:18.798658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:18.798658+0000","last_clean_scrub_stamp":"2024-04-19T02:21:18.798658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:35.622159+0000","scrub_duration":0.001875989,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:04.743533+0000","last_change":"2024-04-19T02:21:04.743533+0000","last_active":"2024-04-19T02:21:04.743533+0000","last_peered":"2024-04-19T02:21:04.743533+0000","last_clean":"2024-04-19T02:21:04.743533+0000","last_became_active":"2024-04-19T02:15:29.284650+0000","last_became_peered":"2024-04-19T02:15:29.284650+0000","last_unstale":"2024-04-19T02:21:04.743533+0000","last_undegraded":"2024-04-19T02:21:04.743533+0000","last_fullsized":"2024-04-19T02:21:04.743533+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:04.743381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:04.743381+0000","last_clean_scrub_stamp":"2024-04-19T02:21:04.743381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:15:36.123544+0000","scrub_duration":0.0019252679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:43.601696+0000","last_change":"2024-04-19T02:21:43.601696+0000","last_active":"2024-04-19T02:21:43.601696+0000","last_peered":"2024-04-19T02:21:43.601696+0000","last_clean":"2024-04-19T02:21:43.601696+0000","last_became_active":"2024-04-19T02:20:08.662277+0000","last_became_peered":"2024-04-19T02:20:08.662277+0000","last_unstale":"2024-04-19T02:21:43.601696+0000","last_undegraded":"2024-04-19T02:21:43.601696+0000","last_fullsized":"2024-04-19T02:21:43.601696+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:43.601509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:43.601509+0000","last_clean_scrub_stamp":"2024-04-19T02:21:43.601509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:37:13.977213+0000","scrub_duration":0.0017145559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:11.802259+0000","last_change":"2024-04-19T02:21:11.802259+0000","last_active":"2024-04-19T02:21:11.802259+0000","last_peered":"2024-04-19T02:21:11.802259+0000","last_clean":"2024-04-19T02:21:11.802259+0000","last_became_active":"2024-04-19T02:15:29.286606+0000","last_became_peered":"2024-04-19T02:15:29.286606+0000","last_unstale":"2024-04-19T02:21:11.802259+0000","last_undegraded":"2024-04-19T02:21:11.802259+0000","last_fullsized":"2024-04-19T02:21:11.802259+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:11.802122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:11.802122+0000","last_clean_scrub_stamp":"2024-04-19T02:21:11.802122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:42.177826+0000","scrub_duration":0.001592062,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":105,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:32.589083+0000","last_change":"2024-04-19T02:21:32.589083+0000","last_active":"2024-04-19T02:21:32.589083+0000","last_peered":"2024-04-19T02:21:32.589083+0000","last_clean":"2024-04-19T02:21:32.589083+0000","last_became_active":"2024-04-19T02:19:54.928298+0000","last_became_peered":"2024-04-19T02:19:54.928298+0000","last_unstale":"2024-04-19T02:21:32.589083+0000","last_undegraded":"2024-04-19T02:21:32.589083+0000","last_fullsized":"2024-04-19T02:21:32.589083+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:32.588945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:32.588945+0000","last_clean_scrub_stamp":"2024-04-19T02:21:32.588945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:12:11.911976+0000","scrub_duration":0.001689189,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:27.963259+0000","last_change":"2024-04-19T02:20:27.963259+0000","last_active":"2024-04-19T02:20:27.963259+0000","last_peered":"2024-04-19T02:20:27.963259+0000","last_clean":"2024-04-19T02:20:27.963259+0000","last_became_active":"2024-04-19T02:19:54.927309+0000","last_became_peered":"2024-04-19T02:19:54.927309+0000","last_unstale":"2024-04-19T02:20:27.963259+0000","last_undegraded":"2024-04-19T02:20:27.963259+0000","last_fullsized":"2024-04-19T02:20:27.963259+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:27.963106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:27.963106+0000","last_clean_scrub_stamp":"2024-04-19T02:20:27.963106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:35:23.138484+0000","scrub_duration":0.070564934999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:54.915653+0000","last_change":"2024-04-19T02:21:54.915653+0000","last_active":"2024-04-19T02:21:54.915653+0000","last_peered":"2024-04-19T02:21:54.915653+0000","last_clean":"2024-04-19T02:21:54.915653+0000","last_became_active":"2024-04-19T02:20:09.998776+0000","last_became_peered":"2024-04-19T02:20:09.998776+0000","last_unstale":"2024-04-19T02:21:54.915653+0000","last_undegraded":"2024-04-19T02:21:54.915653+0000","last_fullsized":"2024-04-19T02:21:54.915653+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:54.915525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:54.915525+0000","last_clean_scrub_stamp":"2024-04-19T02:21:54.915525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:14:03.233064+0000","scrub_duration":0.001749497,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":106,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:02.676488+0000","last_change":"2024-04-19T02:21:02.676488+0000","last_active":"2024-04-19T02:21:02.676488+0000","last_peered":"2024-04-19T02:21:02.676488+0000","last_clean":"2024-04-19T02:21:02.676488+0000","last_became_active":"2024-04-19T02:19:54.925872+0000","last_became_peered":"2024-04-19T02:19:54.925872+0000","last_unstale":"2024-04-19T02:21:02.676488+0000","last_undegraded":"2024-04-19T02:21:02.676488+0000","last_fullsized":"2024-04-19T02:21:02.676488+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:02.676368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:02.676368+0000","last_clean_scrub_stamp":"2024-04-19T02:21:02.676368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:30:23.676866+0000","scrub_duration":0.001635245,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:33.514910+0000","last_change":"2024-04-19T02:20:33.514910+0000","last_active":"2024-04-19T02:20:33.514910+0000","last_peered":"2024-04-19T02:20:33.514910+0000","last_clean":"2024-04-19T02:20:33.514910+0000","last_became_active":"2024-04-19T02:15:29.276968+0000","last_became_peered":"2024-04-19T02:15:29.276968+0000","last_unstale":"2024-04-19T02:20:33.514910+0000","last_undegraded":"2024-04-19T02:20:33.514910+0000","last_fullsized":"2024-04-19T02:20:33.514910+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:33.514784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:33.514784+0000","last_clean_scrub_stamp":"2024-04-19T02:20:33.514784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:01:55.933306+0000","scrub_duration":0.0019782179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":109,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:27.774512+0000","last_change":"2024-04-19T02:21:27.774512+0000","last_active":"2024-04-19T02:21:27.774512+0000","last_peered":"2024-04-19T02:21:27.774512+0000","last_clean":"2024-04-19T02:21:27.774512+0000","last_became_active":"2024-04-19T02:19:54.927033+0000","last_became_peered":"2024-04-19T02:19:54.927033+0000","last_unstale":"2024-04-19T02:21:27.774512+0000","last_undegraded":"2024-04-19T02:21:27.774512+0000","last_fullsized":"2024-04-19T02:21:27.774512+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:27.774381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:27.774381+0000","last_clean_scrub_stamp":"2024-04-19T02:21:27.774381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:11:18.998948+0000","scrub_duration":0.0019217139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":106,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:43.713448+0000","last_change":"2024-04-19T02:21:43.713448+0000","last_active":"2024-04-19T02:21:43.713448+0000","last_peered":"2024-04-19T02:21:43.713448+0000","last_clean":"2024-04-19T02:21:43.713448+0000","last_became_active":"2024-04-19T02:19:54.931683+0000","last_became_peered":"2024-04-19T02:19:54.931683+0000","last_unstale":"2024-04-19T02:21:43.713448+0000","last_undegraded":"2024-04-19T02:21:43.713448+0000","last_fullsized":"2024-04-19T02:21:43.713448+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:43.713262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:43.713262+0000","last_clean_scrub_stamp":"2024-04-19T02:21:43.713262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:17:56.148069+0000","scrub_duration":0.0019750929999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:37.784722+0000","last_change":"2024-04-19T02:20:37.784722+0000","last_active":"2024-04-19T02:20:37.784722+0000","last_peered":"2024-04-19T02:20:37.784722+0000","last_clean":"2024-04-19T02:20:37.784722+0000","last_became_active":"2024-04-19T02:19:54.924686+0000","last_became_peered":"2024-04-19T02:19:54.924686+0000","last_unstale":"2024-04-19T02:20:37.784722+0000","last_undegraded":"2024-04-19T02:20:37.784722+0000","last_fullsized":"2024-04-19T02:20:37.784722+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:37.784561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:37.784561+0000","last_clean_scrub_stamp":"2024-04-19T02:20:37.784561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:26:44.108152+0000","scrub_duration":0.0013845000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:51.933365+0000","last_change":"2024-04-19T02:20:51.933365+0000","last_active":"2024-04-19T02:20:51.933365+0000","last_peered":"2024-04-19T02:20:51.933365+0000","last_clean":"2024-04-19T02:20:51.933365+0000","last_became_active":"2024-04-19T02:19:54.923164+0000","last_became_peered":"2024-04-19T02:19:54.923164+0000","last_unstale":"2024-04-19T02:20:51.933365+0000","last_undegraded":"2024-04-19T02:20:51.933365+0000","last_fullsized":"2024-04-19T02:20:51.933365+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:51.933246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:51.933246+0000","last_clean_scrub_stamp":"2024-04-19T02:20:51.933246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:39:21.609447+0000","scrub_duration":0.0015936590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:40.627182+0000","last_change":"2024-04-19T02:21:40.627182+0000","last_active":"2024-04-19T02:21:40.627182+0000","last_peered":"2024-04-19T02:21:40.627182+0000","last_clean":"2024-04-19T02:21:40.627182+0000","last_became_active":"2024-04-19T02:20:08.661952+0000","last_became_peered":"2024-04-19T02:20:08.661952+0000","last_unstale":"2024-04-19T02:21:40.627182+0000","last_undegraded":"2024-04-19T02:21:40.627182+0000","last_fullsized":"2024-04-19T02:21:40.627182+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:40.627061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:40.627061+0000","last_clean_scrub_stamp":"2024-04-19T02:21:40.627061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:24:29.789441+0000","scrub_duration":0.0016682719999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:28.899746+0000","last_change":"2024-04-19T02:20:28.899746+0000","last_active":"2024-04-19T02:20:28.899746+0000","last_peered":"2024-04-19T02:20:28.899746+0000","last_clean":"2024-04-19T02:20:28.899746+0000","last_became_active":"2024-04-19T02:19:54.926463+0000","last_became_peered":"2024-04-19T02:19:54.926463+0000","last_unstale":"2024-04-19T02:20:28.899746+0000","last_undegraded":"2024-04-19T02:20:28.899746+0000","last_fullsized":"2024-04-19T02:20:28.899746+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:28.899588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:28.899588+0000","last_clean_scrub_stamp":"2024-04-19T02:20:28.899588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:34:50.323413+0000","scrub_duration":0.038469191,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":109,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:28.737103+0000","last_change":"2024-04-19T02:21:28.737103+0000","last_active":"2024-04-19T02:21:28.737103+0000","last_peered":"2024-04-19T02:21:28.737103+0000","last_clean":"2024-04-19T02:21:28.737103+0000","last_became_active":"2024-04-19T02:19:54.932571+0000","last_became_peered":"2024-04-19T02:19:54.932571+0000","last_unstale":"2024-04-19T02:21:28.737103+0000","last_undegraded":"2024-04-19T02:21:28.737103+0000","last_fullsized":"2024-04-19T02:21:28.737103+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:28.736948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:28.736948+0000","last_clean_scrub_stamp":"2024-04-19T02:21:28.736948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:47:06.404175+0000","scrub_duration":0.0019713970000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"82'159","reported_seq":294,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:21.786721+0000","last_change":"2024-04-19T02:21:21.786721+0000","last_active":"2024-04-19T02:21:21.786721+0000","last_peered":"2024-04-19T02:21:21.786721+0000","last_clean":"2024-04-19T02:21:21.786721+0000","last_became_active":"2024-04-19T02:15:24.533420+0000","last_became_peered":"2024-04-19T02:15:24.533420+0000","last_unstale":"2024-04-19T02:21:21.786721+0000","last_undegraded":"2024-04-19T02:21:21.786721+0000","last_fullsized":"2024-04-19T02:21:21.786721+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'159","last_scrub_stamp":"2024-04-19T02:21:21.786526+0000","last_deep_scrub":"82'159","last_deep_scrub_stamp":"2024-04-19T02:21:21.786526+0000","last_clean_scrub_stamp":"2024-04-19T02:21:21.786526+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:56:17.050234+0000","scrub_duration":0.0051918429999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":54,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:22.938906+0000","last_change":"2024-04-19T02:20:22.938906+0000","last_active":"2024-04-19T02:20:22.938906+0000","last_peered":"2024-04-19T02:20:22.938906+0000","last_clean":"2024-04-19T02:20:22.938906+0000","last_became_active":"2024-04-19T02:20:10.001415+0000","last_became_peered":"2024-04-19T02:20:10.001415+0000","last_unstale":"2024-04-19T02:20:22.938906+0000","last_undegraded":"2024-04-19T02:20:22.938906+0000","last_fullsized":"2024-04-19T02:20:22.938906+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:22.938775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:22.938775+0000","last_clean_scrub_stamp":"2024-04-19T02:20:22.938775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:30:51.144263+0000","scrub_duration":0.001921898,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:27.601464+0000","last_change":"2024-04-19T02:20:27.601464+0000","last_active":"2024-04-19T02:20:27.601464+0000","last_peered":"2024-04-19T02:20:27.601464+0000","last_clean":"2024-04-19T02:20:27.601464+0000","last_became_active":"2024-04-19T02:15:29.284164+0000","last_became_peered":"2024-04-19T02:15:29.284164+0000","last_unstale":"2024-04-19T02:20:27.601464+0000","last_undegraded":"2024-04-19T02:20:27.601464+0000","last_fullsized":"2024-04-19T02:20:27.601464+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:27.601255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:27.601255+0000","last_clean_scrub_stamp":"2024-04-19T02:20:27.601255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:45:08.158116+0000","scrub_duration":0.0020462050000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":96,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:40.722384+0000","last_change":"2024-04-19T02:21:40.722525+0000","last_active":"2024-04-19T02:21:40.722384+0000","last_peered":"2024-04-19T02:21:40.722384+0000","last_clean":"2024-04-19T02:21:40.722384+0000","last_became_active":"2024-04-19T02:15:24.533580+0000","last_became_peered":"2024-04-19T02:15:24.533580+0000","last_unstale":"2024-04-19T02:21:40.722384+0000","last_undegraded":"2024-04-19T02:21:40.722384+0000","last_fullsized":"2024-04-19T02:21:40.722384+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:40.722359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:40.722359+0000","last_clean_scrub_stamp":"2024-04-19T02:21:40.722359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:01:32.676837+0000","scrub_duration":0.0016829799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":54,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:07.946484+0000","last_change":"2024-04-19T02:21:07.946484+0000","last_active":"2024-04-19T02:21:07.946484+0000","last_peered":"2024-04-19T02:21:07.946484+0000","last_clean":"2024-04-19T02:21:07.946484+0000","last_became_active":"2024-04-19T02:20:10.638966+0000","last_became_peered":"2024-04-19T02:20:10.638966+0000","last_unstale":"2024-04-19T02:21:07.946484+0000","last_undegraded":"2024-04-19T02:21:07.946484+0000","last_fullsized":"2024-04-19T02:21:07.946484+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:07.946312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:07.946312+0000","last_clean_scrub_stamp":"2024-04-19T02:21:07.946312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:34:25.503097+0000","scrub_duration":0.001569176,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":62,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:44.571614+0000","last_change":"2024-04-19T02:21:44.571614+0000","last_active":"2024-04-19T02:21:44.571614+0000","last_peered":"2024-04-19T02:21:44.571614+0000","last_clean":"2024-04-19T02:21:44.571614+0000","last_became_active":"2024-04-19T02:20:07.986110+0000","last_became_peered":"2024-04-19T02:20:07.986110+0000","last_unstale":"2024-04-19T02:21:44.571614+0000","last_undegraded":"2024-04-19T02:21:44.571614+0000","last_fullsized":"2024-04-19T02:21:44.571614+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:44.571463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:44.571463+0000","last_clean_scrub_stamp":"2024-04-19T02:21:44.571463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:57:31.014123+0000","scrub_duration":0.001607547,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":73,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:18.531610+0000","last_change":"2024-04-19T02:21:18.531610+0000","last_active":"2024-04-19T02:21:18.531610+0000","last_peered":"2024-04-19T02:21:18.531610+0000","last_clean":"2024-04-19T02:21:18.531610+0000","last_became_active":"2024-04-19T02:19:54.925570+0000","last_became_peered":"2024-04-19T02:19:54.925570+0000","last_unstale":"2024-04-19T02:21:18.531610+0000","last_undegraded":"2024-04-19T02:21:18.531610+0000","last_fullsized":"2024-04-19T02:21:18.531610+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:18.531437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:18.531437+0000","last_clean_scrub_stamp":"2024-04-19T02:21:18.531437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:58:59.944303+0000","scrub_duration":0.0019733250000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:35.000806+0000","last_change":"2024-04-19T02:21:35.000806+0000","last_active":"2024-04-19T02:21:35.000806+0000","last_peered":"2024-04-19T02:21:35.000806+0000","last_clean":"2024-04-19T02:21:35.000806+0000","last_became_active":"2024-04-19T02:19:54.929918+0000","last_became_peered":"2024-04-19T02:19:54.929918+0000","last_unstale":"2024-04-19T02:21:35.000806+0000","last_undegraded":"2024-04-19T02:21:35.000806+0000","last_fullsized":"2024-04-19T02:21:35.000806+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:35.000676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:35.000676+0000","last_clean_scrub_stamp":"2024-04-19T02:21:35.000676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:07:53.651573+0000","scrub_duration":0.001736706,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:37.609560+0000","last_change":"2024-04-19T02:21:37.609560+0000","last_active":"2024-04-19T02:21:37.609560+0000","last_peered":"2024-04-19T02:21:37.609560+0000","last_clean":"2024-04-19T02:21:37.609560+0000","last_became_active":"2024-04-19T02:15:29.280519+0000","last_became_peered":"2024-04-19T02:15:29.280519+0000","last_unstale":"2024-04-19T02:21:37.609560+0000","last_undegraded":"2024-04-19T02:21:37.609560+0000","last_fullsized":"2024-04-19T02:21:37.609560+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:37.609443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:37.609443+0000","last_clean_scrub_stamp":"2024-04-19T02:21:37.609443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:41:25.656619+0000","scrub_duration":0.0017652360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"82'3","reported_seq":45,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:33.975581+0000","last_change":"2024-04-19T02:21:33.975581+0000","last_active":"2024-04-19T02:21:33.975581+0000","last_peered":"2024-04-19T02:21:33.975581+0000","last_clean":"2024-04-19T02:21:33.975581+0000","last_became_active":"2024-04-19T02:19:54.928460+0000","last_became_peered":"2024-04-19T02:19:54.928460+0000","last_unstale":"2024-04-19T02:21:33.975581+0000","last_undegraded":"2024-04-19T02:21:33.975581+0000","last_fullsized":"2024-04-19T02:21:33.975581+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-19T02:21:33.975451+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-19T02:21:33.975451+0000","last_clean_scrub_stamp":"2024-04-19T02:21:33.975451+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:55:25.006115+0000","scrub_duration":0.0033633489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:45.863463+0000","last_change":"2024-04-19T02:21:45.863463+0000","last_active":"2024-04-19T02:21:45.863463+0000","last_peered":"2024-04-19T02:21:45.863463+0000","last_clean":"2024-04-19T02:21:45.863463+0000","last_became_active":"2024-04-19T02:20:09.998629+0000","last_became_peered":"2024-04-19T02:20:09.998629+0000","last_unstale":"2024-04-19T02:21:45.863463+0000","last_undegraded":"2024-04-19T02:21:45.863463+0000","last_fullsized":"2024-04-19T02:21:45.863463+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:45.863333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:45.863333+0000","last_clean_scrub_stamp":"2024-04-19T02:21:45.863333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:16:35.951935+0000","scrub_duration":0.001743751,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":54,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:04.937772+0000","last_change":"2024-04-19T02:21:04.937772+0000","last_active":"2024-04-19T02:21:04.937772+0000","last_peered":"2024-04-19T02:21:04.937772+0000","last_clean":"2024-04-19T02:21:04.937772+0000","last_became_active":"2024-04-19T02:20:10.638912+0000","last_became_peered":"2024-04-19T02:20:10.638912+0000","last_unstale":"2024-04-19T02:21:04.937772+0000","last_undegraded":"2024-04-19T02:21:04.937772+0000","last_fullsized":"2024-04-19T02:21:04.937772+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:04.937654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:04.937654+0000","last_clean_scrub_stamp":"2024-04-19T02:21:04.937654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:50:59.907567+0000","scrub_duration":0.001663454,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":96,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:30.725386+0000","last_change":"2024-04-19T02:21:30.725386+0000","last_active":"2024-04-19T02:21:30.725386+0000","last_peered":"2024-04-19T02:21:30.725386+0000","last_clean":"2024-04-19T02:21:30.725386+0000","last_became_active":"2024-04-19T02:15:24.533436+0000","last_became_peered":"2024-04-19T02:15:24.533436+0000","last_unstale":"2024-04-19T02:21:30.725386+0000","last_undegraded":"2024-04-19T02:21:30.725386+0000","last_fullsized":"2024-04-19T02:21:30.725386+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:30.725253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:30.725253+0000","last_clean_scrub_stamp":"2024-04-19T02:21:30.725253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:19:28.238566+0000","scrub_duration":0.0018953679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"82'2","reported_seq":47,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:44.866016+0000","last_change":"2024-04-19T02:20:44.866016+0000","last_active":"2024-04-19T02:20:44.866016+0000","last_peered":"2024-04-19T02:20:44.866016+0000","last_clean":"2024-04-19T02:20:44.866016+0000","last_became_active":"2024-04-19T02:19:54.931328+0000","last_became_peered":"2024-04-19T02:19:54.931328+0000","last_unstale":"2024-04-19T02:20:44.866016+0000","last_undegraded":"2024-04-19T02:20:44.866016+0000","last_fullsized":"2024-04-19T02:20:44.866016+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-19T02:20:44.865892+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-19T02:20:44.865892+0000","last_clean_scrub_stamp":"2024-04-19T02:20:44.865892+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:06:18.693677+0000","scrub_duration":0.00333659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:40.611536+0000","last_change":"2024-04-19T02:20:40.611536+0000","last_active":"2024-04-19T02:20:40.611536+0000","last_peered":"2024-04-19T02:20:40.611536+0000","last_clean":"2024-04-19T02:20:40.611536+0000","last_became_active":"2024-04-19T02:15:29.280366+0000","last_became_peered":"2024-04-19T02:15:29.280366+0000","last_unstale":"2024-04-19T02:20:40.611536+0000","last_undegraded":"2024-04-19T02:20:40.611536+0000","last_fullsized":"2024-04-19T02:20:40.611536+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:40.611392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:40.611392+0000","last_clean_scrub_stamp":"2024-04-19T02:20:40.611392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:35.395252+0000","scrub_duration":0.0015883539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:26.555858+0000","last_change":"2024-04-19T02:21:26.555973+0000","last_active":"2024-04-19T02:21:26.555858+0000","last_peered":"2024-04-19T02:21:26.555858+0000","last_clean":"2024-04-19T02:21:26.555858+0000","last_became_active":"2024-04-19T02:15:28.892695+0000","last_became_peered":"2024-04-19T02:15:28.892695+0000","last_unstale":"2024-04-19T02:21:26.555858+0000","last_undegraded":"2024-04-19T02:21:26.555858+0000","last_fullsized":"2024-04-19T02:21:26.555858+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-19T02:21:26.555832+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-19T02:21:26.555832+0000","last_clean_scrub_stamp":"2024-04-19T02:21:26.555832+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:54:22.224234+0000","scrub_duration":0.001825763,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":103,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:42.629277+0000","last_change":"2024-04-19T02:20:42.629383+0000","last_active":"2024-04-19T02:20:42.629277+0000","last_peered":"2024-04-19T02:20:42.629277+0000","last_clean":"2024-04-19T02:20:42.629277+0000","last_became_active":"2024-04-19T02:19:54.929412+0000","last_became_peered":"2024-04-19T02:19:54.929412+0000","last_unstale":"2024-04-19T02:20:42.629277+0000","last_undegraded":"2024-04-19T02:20:42.629277+0000","last_fullsized":"2024-04-19T02:20:42.629277+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:42.629252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:42.629252+0000","last_clean_scrub_stamp":"2024-04-19T02:20:42.629252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:14.280965+0000","scrub_duration":0.0020287679999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"82'3","reported_seq":108,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:48.601787+0000","last_change":"2024-04-19T02:20:48.601893+0000","last_active":"2024-04-19T02:20:48.601787+0000","last_peered":"2024-04-19T02:20:48.601787+0000","last_clean":"2024-04-19T02:20:48.601787+0000","last_became_active":"2024-04-19T02:19:54.926630+0000","last_became_peered":"2024-04-19T02:19:54.926630+0000","last_unstale":"2024-04-19T02:20:48.601787+0000","last_undegraded":"2024-04-19T02:20:48.601787+0000","last_fullsized":"2024-04-19T02:20:48.601787+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-19T02:20:48.601762+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-19T02:20:48.601762+0000","last_clean_scrub_stamp":"2024-04-19T02:20:48.601762+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:28:54.715316+0000","scrub_duration":0.0034412739999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:23.628340+0000","last_change":"2024-04-19T02:20:23.628340+0000","last_active":"2024-04-19T02:20:23.628340+0000","last_peered":"2024-04-19T02:20:23.628340+0000","last_clean":"2024-04-19T02:20:23.628340+0000","last_became_active":"2024-04-19T02:19:54.931328+0000","last_became_peered":"2024-04-19T02:19:54.931328+0000","last_unstale":"2024-04-19T02:20:23.628340+0000","last_undegraded":"2024-04-19T02:20:23.628340+0000","last_fullsized":"2024-04-19T02:20:23.628340+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:23.628182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:23.628182+0000","last_clean_scrub_stamp":"2024-04-19T02:20:23.628182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:41:07.461430+0000","scrub_duration":0.042718649999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"82'3","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:33.586083+0000","last_change":"2024-04-19T02:21:33.586193+0000","last_active":"2024-04-19T02:21:33.586083+0000","last_peered":"2024-04-19T02:21:33.586083+0000","last_clean":"2024-04-19T02:21:33.586083+0000","last_became_active":"2024-04-19T02:15:28.892881+0000","last_became_peered":"2024-04-19T02:15:28.892881+0000","last_unstale":"2024-04-19T02:21:33.586083+0000","last_undegraded":"2024-04-19T02:21:33.586083+0000","last_fullsized":"2024-04-19T02:21:33.586083+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-19T02:21:33.586060+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-19T02:21:33.586060+0000","last_clean_scrub_stamp":"2024-04-19T02:21:33.586060+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:49:54.321957+0000","scrub_duration":0.0029867259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:21.614064+0000","last_change":"2024-04-19T02:20:21.614064+0000","last_active":"2024-04-19T02:20:21.614064+0000","last_peered":"2024-04-19T02:20:21.614064+0000","last_clean":"2024-04-19T02:20:21.614064+0000","last_became_active":"2024-04-19T02:19:54.923752+0000","last_became_peered":"2024-04-19T02:19:54.923752+0000","last_unstale":"2024-04-19T02:20:21.614064+0000","last_undegraded":"2024-04-19T02:20:21.614064+0000","last_fullsized":"2024-04-19T02:20:21.614064+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:21.613938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:21.613938+0000","last_clean_scrub_stamp":"2024-04-19T02:20:21.613938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:28:11.041024+0000","scrub_duration":0.0017798099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":44,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:06.947478+0000","last_change":"2024-04-19T02:21:06.947478+0000","last_active":"2024-04-19T02:21:06.947478+0000","last_peered":"2024-04-19T02:21:06.947478+0000","last_clean":"2024-04-19T02:21:06.947478+0000","last_became_active":"2024-04-19T02:19:54.932103+0000","last_became_peered":"2024-04-19T02:19:54.932103+0000","last_unstale":"2024-04-19T02:21:06.947478+0000","last_undegraded":"2024-04-19T02:21:06.947478+0000","last_fullsized":"2024-04-19T02:21:06.947478+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-19T02:21:06.947264+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-19T02:21:06.947264+0000","last_clean_scrub_stamp":"2024-04-19T02:21:06.947264+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:25:28.987258+0000","scrub_duration":0.001632035,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":103,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:36.664629+0000","last_change":"2024-04-19T02:21:36.664716+0000","last_active":"2024-04-19T02:21:36.664629+0000","last_peered":"2024-04-19T02:21:36.664629+0000","last_clean":"2024-04-19T02:21:36.664629+0000","last_became_active":"2024-04-19T02:19:54.925565+0000","last_became_peered":"2024-04-19T02:19:54.925565+0000","last_unstale":"2024-04-19T02:21:36.664629+0000","last_undegraded":"2024-04-19T02:21:36.664629+0000","last_fullsized":"2024-04-19T02:21:36.664629+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:36.664595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:36.664595+0000","last_clean_scrub_stamp":"2024-04-19T02:21:36.664595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:16:08.044759+0000","scrub_duration":0.020876051999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":46,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:00.977681+0000","last_change":"2024-04-19T02:21:00.977681+0000","last_active":"2024-04-19T02:21:00.977681+0000","last_peered":"2024-04-19T02:21:00.977681+0000","last_clean":"2024-04-19T02:21:00.977681+0000","last_became_active":"2024-04-19T02:19:54.926439+0000","last_became_peered":"2024-04-19T02:19:54.926439+0000","last_unstale":"2024-04-19T02:21:00.977681+0000","last_undegraded":"2024-04-19T02:21:00.977681+0000","last_fullsized":"2024-04-19T02:21:00.977681+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'6","last_scrub_stamp":"2024-04-19T02:21:00.977547+0000","last_deep_scrub":"82'6","last_deep_scrub_stamp":"2024-04-19T02:21:00.977547+0000","last_clean_scrub_stamp":"2024-04-19T02:21:00.977547+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:36:06.474124+0000","scrub_duration":0.0050912479999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:20:46.634857+0000","last_change":"2024-04-19T02:20:46.634995+0000","last_active":"2024-04-19T02:20:46.634857+0000","last_peered":"2024-04-19T02:20:46.634857+0000","last_clean":"2024-04-19T02:20:46.634857+0000","last_became_active":"2024-04-19T02:19:54.930665+0000","last_became_peered":"2024-04-19T02:19:54.930665+0000","last_unstale":"2024-04-19T02:20:46.634857+0000","last_undegraded":"2024-04-19T02:20:46.634857+0000","last_fullsized":"2024-04-19T02:20:46.634857+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:20:46.634833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:20:46.634833+0000","last_clean_scrub_stamp":"2024-04-19T02:20:46.634833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:58:28.047698+0000","scrub_duration":0.001963645,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":105,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:14.819858+0000","last_change":"2024-04-19T02:21:14.819858+0000","last_active":"2024-04-19T02:21:14.819858+0000","last_peered":"2024-04-19T02:21:14.819858+0000","last_clean":"2024-04-19T02:21:14.819858+0000","last_became_active":"2024-04-19T02:19:54.930527+0000","last_became_peered":"2024-04-19T02:19:54.930527+0000","last_unstale":"2024-04-19T02:21:14.819858+0000","last_undegraded":"2024-04-19T02:21:14.819858+0000","last_fullsized":"2024-04-19T02:21:14.819858+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:14.819731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:14.819731+0000","last_clean_scrub_stamp":"2024-04-19T02:21:14.819731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:24:42.325450+0000","scrub_duration":0.001789131,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":54,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:56.955725+0000","last_change":"2024-04-19T02:21:56.955725+0000","last_active":"2024-04-19T02:21:56.955725+0000","last_peered":"2024-04-19T02:21:56.955725+0000","last_clean":"2024-04-19T02:21:56.955725+0000","last_became_active":"2024-04-19T02:20:10.001304+0000","last_became_peered":"2024-04-19T02:20:10.001304+0000","last_unstale":"2024-04-19T02:21:56.955725+0000","last_undegraded":"2024-04-19T02:21:56.955725+0000","last_fullsized":"2024-04-19T02:21:56.955725+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:56.955564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:56.955564+0000","last_clean_scrub_stamp":"2024-04-19T02:21:56.955564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:04:00.369525+0000","scrub_duration":0.0018690289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:52.545968+0000","last_change":"2024-04-19T02:21:52.545968+0000","last_active":"2024-04-19T02:21:52.545968+0000","last_peered":"2024-04-19T02:21:52.545968+0000","last_clean":"2024-04-19T02:21:52.545968+0000","last_became_active":"2024-04-19T02:20:08.661996+0000","last_became_peered":"2024-04-19T02:20:08.661996+0000","last_unstale":"2024-04-19T02:21:52.545968+0000","last_undegraded":"2024-04-19T02:21:52.545968+0000","last_fullsized":"2024-04-19T02:21:52.545968+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:52.545824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:52.545824+0000","last_clean_scrub_stamp":"2024-04-19T02:21:52.545824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:55:09.369325+0000","scrub_duration":0.00166147,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":54,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:41.872130+0000","last_change":"2024-04-19T02:21:41.872130+0000","last_active":"2024-04-19T02:21:41.872130+0000","last_peered":"2024-04-19T02:21:41.872130+0000","last_clean":"2024-04-19T02:21:41.872130+0000","last_became_active":"2024-04-19T02:20:10.001372+0000","last_became_peered":"2024-04-19T02:20:10.001372+0000","last_unstale":"2024-04-19T02:21:41.872130+0000","last_undegraded":"2024-04-19T02:21:41.872130+0000","last_fullsized":"2024-04-19T02:21:41.872130+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:41.871963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:41.871963+0000","last_clean_scrub_stamp":"2024-04-19T02:21:41.871963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:27:38.707434+0000","scrub_duration":0.036498795000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-19T02:21:20.500137+0000","last_change":"2024-04-19T02:21:20.500137+0000","last_active":"2024-04-19T02:21:20.500137+0000","last_peered":"2024-04-19T02:21:20.500137+0000","last_clean":"2024-04-19T02:21:20.500137+0000","last_became_active":"2024-04-19T02:15:29.276725+0000","last_became_peered":"2024-04-19T02:15:29.276725+0000","last_unstale":"2024-04-19T02:21:20.500137+0000","last_undegraded":"2024-04-19T02:21:20.500137+0000","last_fullsized":"2024-04-19T02:21:20.500137+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T02:21:20.500012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T02:21:20.500012+0000","last_clean_scrub_stamp":"2024-04-19T02:21:20.500012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:29:26.613566+0000","scrub_duration":0.001700163,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5254,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":72,"seq":309237645343,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58812,"kb_used_data":884,"kb_used_omap":6,"kb_used_meta":57913,"kb_avail":94313028,"statfs":{"total":96636764160,"available":96576540672,"internally_reserved":0,"allocated":905216,"data_stored":358135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6848,"internal_metadata":59303232},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:21:56 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46000000000000002,"15min":0.45900000000000002},"min":{"1min":0.33000000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.57499999999999996,"5min":0.62,"15min":0.62},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.439,"15min":0.437},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.56100000000000005,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.46899999999999997}]},{"osd":1,"last update":"Fri Apr 19 02:21:56 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.50800000000000001,"15min":0.51100000000000001},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.64600000000000002,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.51400000000000001,"15min":0.51800000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.65200000000000002,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.40000000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738455,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":275412,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":273918,"kb_avail":94096428,"statfs":{"total":96636764160,"available":96354742272,"internally_reserved":0,"allocated":1519616,"data_stored":948136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":280492486},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 02:21:29 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.441,"15min":0.33900000000000002},"min":{"1min":0.35299999999999998,"5min":0.17599999999999999,"15min":0.159},"max":{"1min":0.56399999999999995,"5min":4.4480000000000004,"15min":4.4480000000000004},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.41399999999999998,"15min":0.378},"min":{"1min":0.33300000000000002,"5min":0.19,"15min":0.17199999999999999},"max":{"1min":0.56299999999999994,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.38500000000000001}]},{"osd":2,"last update":"Fri Apr 19 02:21:57 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.48199999999999998,"15min":0.47699999999999998},"min":{"1min":0.40899999999999997,"5min":0.309,"15min":0.309},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.441},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.47999999999999998,"15min":0.47799999999999998},"min":{"1min":0.38800000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.621,"5min":0.629,"15min":0.629},"last":0.45100000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738454,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307408,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":305918,"kb_avail":94064432,"statfs":{"total":96636764160,"available":96321978368,"internally_reserved":0,"allocated":1515520,"data_stored":949633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":313260486},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 02:21:31 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.45400000000000001,"15min":0.39200000000000002},"min":{"1min":0.36399999999999999,"5min":0.157,"15min":0.157},"max":{"1min":0.60599999999999998,"5min":1.794,"15min":1.794},"last":0.44},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.45300000000000001,"15min":0.34799999999999998},"min":{"1min":0.35499999999999998,"5min":0.17100000000000001,"15min":0.16},"max":{"1min":0.64500000000000002,"5min":2.411,"15min":2.411},"last":0.52100000000000002}]},{"osd":2,"last update":"Fri Apr 19 02:21:54 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.52200000000000002,"15min":0.53400000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.54900000000000004,"5min":0.878,"15min":0.878},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.503,"15min":0.51000000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.58999999999999997,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.55500000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5254,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T02:22:23.557 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-19T02:22:23.931 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-19T02:22:23.932 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-19T02:22:24.293 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:22:24.294 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-19T02:15:29.263369+0000","modified":"2024-04-19T02:15:32.274461+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4230":{"gid":4230,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6803/1144924022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":1144924022},{"type":"v1","addr":"172.21.15.121:6803","nonce":1144924022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-19T02:22:24.296 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 6 2024-04-19T02:22:24.307 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-19T02:22:24.670 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:22:24.671 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-19T02:15:29.263369+0000","modified":"2024-04-19T02:15:32.274461+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4230":{"gid":4230,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6803/1144924022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":1144924022},{"type":"v1","addr":"172.21.15.121:6803","nonce":1144924022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-19T02:22:24.673 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 6 2024-04-19T02:22:24.684 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T02:22:25.006 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-19T02:22:25.006 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":82,"fsid":"f6ab5dd0-bb9f-4b48-a9fc-4728c7955ca8","created":"2024-04-19T02:15:13.539846+0000","modified":"2024-04-19T02:20:09.986791+0000","last_up_change":"2024-04-19T02:19:53.893059+0000","last_in_change":"2024-04-19T02:15:15.482624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T02:15:22.776125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T02:15:23.264005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T02:15:27.675087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T02:15:28.232224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88cb15f3-271c-43d5-af51-1cd26b8ed13c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":41347},{"type":"v1","addr":"172.21.15.153:6801","nonce":41347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":41347},{"type":"v1","addr":"172.21.15.153:6803","nonce":41347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":41347},{"type":"v1","addr":"172.21.15.153:6807","nonce":41347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":41347},{"type":"v1","addr":"172.21.15.153:6805","nonce":41347}]},"public_addr":"172.21.15.153:6801/41347","cluster_addr":"172.21.15.153:6803/41347","heartbeat_back_addr":"172.21.15.153:6807/41347","heartbeat_front_addr":"172.21.15.153:6805/41347","state":["exists","up"]},{"osd":1,"uuid":"2674869a-db01-4d9f-a496-9fb3851b5b21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":41380},{"type":"v1","addr":"172.21.15.174:6801","nonce":41380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":41380},{"type":"v1","addr":"172.21.15.174:6803","nonce":41380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":41380},{"type":"v1","addr":"172.21.15.174:6807","nonce":41380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":41380},{"type":"v1","addr":"172.21.15.174:6805","nonce":41380}]},"public_addr":"172.21.15.174:6801/41380","cluster_addr":"172.21.15.174:6803/41380","heartbeat_back_addr":"172.21.15.174:6807/41380","heartbeat_front_addr":"172.21.15.174:6805/41380","state":["exists","up"]},{"osd":2,"uuid":"712ad943-2f98-49d9-aabe-f66b509be633","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":49,"up_from":72,"up_thru":81,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":6186},{"type":"v1","addr":"172.21.15.177:6801","nonce":6186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":6186},{"type":"v1","addr":"172.21.15.177:6803","nonce":6186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":6186},{"type":"v1","addr":"172.21.15.177:6807","nonce":6186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":6186},{"type":"v1","addr":"172.21.15.177:6805","nonce":6186}]},"public_addr":"172.21.15.177:6801/6186","cluster_addr":"172.21.15.177:6803/6186","heartbeat_back_addr":"172.21.15.177:6807/6186","heartbeat_front_addr":"172.21.15.177:6805/6186","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:15:20.495280+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:15:20.594553+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T02:15:20.524253+0000","dead_epoch":49}],"pg_upmap":[{"pgid":"4.36","osds":[0,1]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T02:22:25.021 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-19T02:22:25.404 INFO:tasks.ceph.mds.a.smithi121.stderr: -2176> 2024-04-19T02:15:34.651+0000 7fe80ba2c700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-19T02:22:25.410 INFO:teuthology.orchestra.run.smithi121.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-19T02:22:25.422 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-19T02:22:25.430 INFO:tasks.ceph.mds.a.smithi121.stdout:starting mds.a at 2024-04-19T02:22:26.423 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-19T02:22:27.416 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_metadata' removed 2024-04-19T02:22:27.430 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-19T02:22:28.421 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_data' removed 2024-04-19T02:22:28.434 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-19T02:22:28.435 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-19T02:22:28.435 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T02:22:28.444 INFO:tasks.ceph.mds.a:Stopped 2024-04-19T02:22:28.444 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-19T02:22:28.444 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-19T02:22:28.444 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T02:22:28.491 INFO:tasks.ceph.osd.0:Stopped 2024-04-19T02:22:28.491 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-19T02:22:28.491 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T02:22:28.540 INFO:tasks.ceph.osd.1:Stopped 2024-04-19T02:22:28.540 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-19T02:22:28.540 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T02:22:28.590 INFO:tasks.ceph.osd.2:Stopped 2024-04-19T02:22:28.590 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-19T02:22:28.590 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-19T02:22:28.590 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T02:22:28.615 INFO:tasks.ceph.mgr.x:Stopped 2024-04-19T02:22:28.616 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-19T02:22:28.616 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T02:22:28.683 INFO:tasks.ceph.mgr.y:Stopped 2024-04-19T02:22:28.684 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-19T02:22:28.684 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-19T02:22:28.684 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T02:22:28.734 INFO:tasks.ceph.mon.a:Stopped 2024-04-19T02:22:28.734 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-19T02:22:28.735 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T02:22:28.785 INFO:tasks.ceph.mon.b:Stopped 2024-04-19T02:22:28.785 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-19T02:22:28.785 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T02:22:28.836 INFO:tasks.ceph.mon.c:Stopped 2024-04-19T02:22:28.836 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-19T02:22:28.837 DEBUG:teuthology.orchestra.run.smithi121:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MDS_TRIM\)' | egrep -v '\(MDS_SLOW_REQUEST\)' | egrep -v MDS_SLOW_METADATA_IO | egrep -v 'Behind on trimming' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | head -n 1 2024-04-19T02:22:28.910 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi153.front.sepia.ceph.com 2024-04-19T02:22:28.910 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-19T02:22:29.069 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi174.front.sepia.ceph.com 2024-04-19T02:22:29.070 DEBUG:teuthology.orchestra.run.smithi174:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-19T02:22:29.232 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi177.front.sepia.ceph.com 2024-04-19T02:22:29.233 DEBUG:teuthology.orchestra.run.smithi177:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-19T02:22:29.354 INFO:tasks.ceph:Archiving mon data... 2024-04-19T02:22:29.355 DEBUG:teuthology.misc:Transferring archived files from smithi121:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662845/data/mon.a.tgz 2024-04-19T02:22:29.355 DEBUG:teuthology.orchestra.run.smithi121:> mktemp 2024-04-19T02:22:29.377 INFO:teuthology.orchestra.run.smithi121.stdout:/tmp/tmp.IWioN8yDVd 2024-04-19T02:22:29.377 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.IWioN8yDVd 2024-04-19T02:22:29.535 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 0666 /tmp/tmp.IWioN8yDVd 2024-04-19T02:22:29.623 DEBUG:teuthology.orchestra.remote:smithi121:/tmp/tmp.IWioN8yDVd is 401KB 2024-04-19T02:22:29.720 DEBUG:teuthology.orchestra.run.smithi121:> rm -fr /tmp/tmp.IWioN8yDVd 2024-04-19T02:22:29.737 DEBUG:teuthology.misc:Transferring archived files from smithi121:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662845/data/mon.b.tgz 2024-04-19T02:22:29.737 DEBUG:teuthology.orchestra.run.smithi121:> mktemp 2024-04-19T02:22:29.794 INFO:teuthology.orchestra.run.smithi121.stdout:/tmp/tmp.8z3OKCXBYX 2024-04-19T02:22:29.795 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.8z3OKCXBYX 2024-04-19T02:22:29.966 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 0666 /tmp/tmp.8z3OKCXBYX 2024-04-19T02:22:30.053 DEBUG:teuthology.orchestra.remote:smithi121:/tmp/tmp.8z3OKCXBYX is 557KB 2024-04-19T02:22:30.155 DEBUG:teuthology.orchestra.run.smithi121:> rm -fr /tmp/tmp.8z3OKCXBYX 2024-04-19T02:22:30.173 DEBUG:teuthology.misc:Transferring archived files from smithi121:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662845/data/mon.c.tgz 2024-04-19T02:22:30.174 DEBUG:teuthology.orchestra.run.smithi121:> mktemp 2024-04-19T02:22:30.229 INFO:teuthology.orchestra.run.smithi121.stdout:/tmp/tmp.yoTmzK6UIo 2024-04-19T02:22:30.230 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.yoTmzK6UIo 2024-04-19T02:22:30.402 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 0666 /tmp/tmp.yoTmzK6UIo 2024-04-19T02:22:30.490 DEBUG:teuthology.orchestra.remote:smithi121:/tmp/tmp.yoTmzK6UIo is 556KB 2024-04-19T02:22:30.589 DEBUG:teuthology.orchestra.run.smithi121:> rm -fr /tmp/tmp.yoTmzK6UIo 2024-04-19T02:22:30.606 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-19T02:22:30.607 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-19T02:22:30.647 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-19T02:22:30.650 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-19T02:22:30.652 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-19T02:22:30.703 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-04-19T02:22:30.704 DEBUG:teuthology.orchestra.run.smithi121:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-19T02:22:30.714 DEBUG:teuthology.orchestra.run.smithi153:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-19T02:22:30.724 DEBUG:teuthology.orchestra.run.smithi174:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-19T02:22:30.727 DEBUG:teuthology.orchestra.run.smithi177:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-19T02:22:30.739 INFO:teuthology.orchestra.run.smithi121.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-19T02:22:30.753 INFO:teuthology.orchestra.run.smithi153.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-19T02:22:30.757 INFO:teuthology.orchestra.run.smithi174.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-19T02:22:30.781 INFO:teuthology.orchestra.run.smithi177.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-19T02:22:30.787 INFO:tasks.ceph:Archiving crash dumps... 2024-04-19T02:22:30.789 DEBUG:teuthology.misc:Transferring archived files from smithi121:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662845/remote/smithi121/crash 2024-04-19T02:22:30.791 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-19T02:22:30.819 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662845/remote/smithi153/crash 2024-04-19T02:22:30.821 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-19T02:22:30.863 DEBUG:teuthology.misc:Transferring archived files from smithi174:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662845/remote/smithi174/crash 2024-04-19T02:22:30.864 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-19T02:22:30.908 DEBUG:teuthology.misc:Transferring archived files from smithi177:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662845/remote/smithi177/crash 2024-04-19T02:22:30.909 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-19T02:22:30.969 INFO:tasks.ceph:Compressing logs... 2024-04-19T02:22:30.969 DEBUG:teuthology.orchestra.run.smithi121:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-19T02:22:30.972 DEBUG:teuthology.orchestra.run.smithi153:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-19T02:22:30.974 DEBUG:teuthology.orchestra.run.smithi174:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-19T02:22:30.977 DEBUG:teuthology.orchestra.run.smithi177:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-19T02:23:03.451 INFO:tasks.ceph:Archiving logs... 2024-04-19T02:23:03.452 DEBUG:teuthology.misc:Transferring archived files from smithi121:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662845/remote/smithi121/log 2024-04-19T02:23:03.453 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-19T02:23:03.808 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662845/remote/smithi153/log 2024-04-19T02:23:03.809 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-19T02:23:07.933 DEBUG:teuthology.misc:Transferring archived files from smithi174:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662845/remote/smithi174/log 2024-04-19T02:23:07.934 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-19T02:23:11.841 DEBUG:teuthology.misc:Transferring archived files from smithi177:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662845/remote/smithi177/log 2024-04-19T02:23:11.842 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-19T02:23:15.363 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-19T02:23:15.373 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-19T02:23:15.373 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-19T02:23:15.376 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-19T02:23:15.379 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-19T02:23:15.381 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-19T02:23:15.510 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-19T02:23:15.525 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-19T02:23:15.525 DEBUG:teuthology.orchestra.run.smithi121:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-19T02:23:15.528 DEBUG:teuthology.orchestra.run.smithi153:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-19T02:23:15.531 DEBUG:teuthology.orchestra.run.smithi174:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-19T02:23:15.533 DEBUG:teuthology.orchestra.run.smithi177:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-19T02:23:15.546 INFO:teuthology.orchestra.run.smithi121.stderr:bash: ntpq: command not found 2024-04-19T02:23:15.548 INFO:teuthology.orchestra.run.smithi153.stderr:bash: ntpq: command not found 2024-04-19T02:23:15.550 INFO:teuthology.orchestra.run.smithi174.stderr:bash: ntpq: command not found 2024-04-19T02:23:15.551 INFO:teuthology.orchestra.run.smithi121.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-19T02:23:15.551 INFO:teuthology.orchestra.run.smithi121.stdout:=============================================================================== 2024-04-19T02:23:15.551 INFO:teuthology.orchestra.run.smithi121.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 64 +873us[ +873us] +/- 41ms 2024-04-19T02:23:15.551 INFO:teuthology.orchestra.run.smithi121.stdout:^* hv02.front.sepia.ceph.com 3 6 377 64 -1196us[-1191us] +/- 55ms 2024-04-19T02:23:15.552 INFO:teuthology.orchestra.run.smithi121.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 1 +173us[ +173us] +/- 85ms 2024-04-19T02:23:15.552 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-19T02:23:15.553 INFO:teuthology.orchestra.run.smithi177.stderr:bash: ntpq: command not found 2024-04-19T02:23:15.553 INFO:teuthology.orchestra.run.smithi153.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-19T02:23:15.554 INFO:teuthology.orchestra.run.smithi153.stdout:=============================================================================== 2024-04-19T02:23:15.554 INFO:teuthology.orchestra.run.smithi153.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 62 +887us[ +887us] +/- 41ms 2024-04-19T02:23:15.554 INFO:teuthology.orchestra.run.smithi153.stdout:^* hv02.front.sepia.ceph.com 3 6 377 64 -1197us[-1193us] +/- 55ms 2024-04-19T02:23:15.554 INFO:teuthology.orchestra.run.smithi153.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 63 +179us[ +179us] +/- 84ms 2024-04-19T02:23:15.554 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-19T02:23:15.555 INFO:teuthology.orchestra.run.smithi174.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-19T02:23:15.556 INFO:teuthology.orchestra.run.smithi174.stdout:=============================================================================== 2024-04-19T02:23:15.556 INFO:teuthology.orchestra.run.smithi174.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 63 +862us[ +866us] +/- 41ms 2024-04-19T02:23:15.556 INFO:teuthology.orchestra.run.smithi174.stdout:^* hv02.front.sepia.ceph.com 3 6 377 63 -1202us[-1197us] +/- 55ms 2024-04-19T02:23:15.556 INFO:teuthology.orchestra.run.smithi174.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 64 +173us[ +177us] +/- 84ms 2024-04-19T02:23:15.556 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-19T02:23:15.557 INFO:teuthology.orchestra.run.smithi177.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-19T02:23:15.557 INFO:teuthology.orchestra.run.smithi177.stdout:=============================================================================== 2024-04-19T02:23:15.557 INFO:teuthology.orchestra.run.smithi177.stdout:^+ hv01.front.sepia.ceph.com 3 6 177 23 +843us[ +833us] +/- 41ms 2024-04-19T02:23:15.557 INFO:teuthology.orchestra.run.smithi177.stdout:^* hv02.front.sepia.ceph.com 3 6 177 22 -1223us[-1233us] +/- 55ms 2024-04-19T02:23:15.558 INFO:teuthology.orchestra.run.smithi177.stdout:^+ hv03.front.sepia.ceph.com 3 6 177 23 +136us[ +126us] +/- 84ms 2024-04-19T02:23:15.558 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-19T02:23:15.559 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-19T02:23:15.571 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-19T02:23:15.572 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-19T02:23:15.611 DEBUG:teuthology.orchestra.run.smithi121:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-19T02:23:15.684 DEBUG:teuthology.orchestra.run.smithi153:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-19T02:23:15.758 DEBUG:teuthology.orchestra.run.smithi174:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-19T02:23:15.830 DEBUG:teuthology.orchestra.run.smithi177:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-19T02:23:15.943 DEBUG:teuthology.orchestra.run.smithi121:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-19T02:23:15.977 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T02:23:15.978 DEBUG:teuthology.orchestra.run.smithi153:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-19T02:23:16.014 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T02:23:16.015 DEBUG:teuthology.orchestra.run.smithi174:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-19T02:23:16.049 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T02:23:16.049 DEBUG:teuthology.orchestra.run.smithi177:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-19T02:23:16.082 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T02:23:16.083 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-19T02:23:16.094 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-19T02:23:16.153 INFO:teuthology.task.internal:Duration was 1030.115380 seconds 2024-04-19T02:23:16.153 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-19T02:23:16.205 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-19T02:23:16.205 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-19T02:23:16.208 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-19T02:23:16.211 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-19T02:23:16.213 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-19T02:23:16.259 INFO:teuthology.orchestra.run.smithi121.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-19T02:23:16.261 INFO:teuthology.orchestra.run.smithi153.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-19T02:23:16.262 INFO:teuthology.orchestra.run.smithi174.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-19T02:23:16.300 INFO:teuthology.orchestra.run.smithi177.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-19T02:23:16.718 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-19T02:23:16.719 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi121.front.sepia.ceph.com 2024-04-19T02:23:16.719 DEBUG:teuthology.orchestra.run.smithi121:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-19T02:23:16.744 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi153.front.sepia.ceph.com 2024-04-19T02:23:16.745 DEBUG:teuthology.orchestra.run.smithi153:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-19T02:23:16.773 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi174.front.sepia.ceph.com 2024-04-19T02:23:16.773 DEBUG:teuthology.orchestra.run.smithi174:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-19T02:23:16.800 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi177.front.sepia.ceph.com 2024-04-19T02:23:16.800 DEBUG:teuthology.orchestra.run.smithi177:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-19T02:23:16.827 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-19T02:23:16.827 DEBUG:teuthology.orchestra.run.smithi121:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-19T02:23:16.829 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-19T02:23:16.834 DEBUG:teuthology.orchestra.run.smithi174:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-19T02:23:16.842 DEBUG:teuthology.orchestra.run.smithi177:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-19T02:23:16.927 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-19T02:23:16.927 DEBUG:teuthology.orchestra.run.smithi121:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-19T02:23:16.930 DEBUG:teuthology.orchestra.run.smithi153:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-19T02:23:16.932 DEBUG:teuthology.orchestra.run.smithi174:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-19T02:23:16.935 DEBUG:teuthology.orchestra.run.smithi177:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-19T02:23:17.021 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-19T02:23:17.033 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-19T02:23:17.033 DEBUG:teuthology.orchestra.run.smithi121:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-19T02:23:17.061 DEBUG:teuthology.orchestra.run.smithi153:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-19T02:23:17.089 DEBUG:teuthology.orchestra.run.smithi174:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-19T02:23:17.117 DEBUG:teuthology.orchestra.run.smithi177:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-19T02:23:17.168 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-19T02:23:17.179 DEBUG:teuthology.orchestra.run.smithi121:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-19T02:23:17.181 DEBUG:teuthology.orchestra.run.smithi153:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-19T02:23:17.184 DEBUG:teuthology.orchestra.run.smithi174:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-19T02:23:17.186 DEBUG:teuthology.orchestra.run.smithi177:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-19T02:23:17.206 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern = core 2024-04-19T02:23:17.209 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = core 2024-04-19T02:23:17.210 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern = core 2024-04-19T02:23:17.242 INFO:teuthology.orchestra.run.smithi177.stdout:kernel.core_pattern = core 2024-04-19T02:23:17.270 DEBUG:teuthology.orchestra.run.smithi121:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-19T02:23:17.287 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T02:23:17.288 DEBUG:teuthology.orchestra.run.smithi153:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-19T02:23:17.305 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T02:23:17.306 DEBUG:teuthology.orchestra.run.smithi174:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-19T02:23:17.322 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T02:23:17.323 DEBUG:teuthology.orchestra.run.smithi177:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-19T02:23:17.340 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T02:23:17.341 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-19T02:23:17.353 INFO:teuthology.task.internal:Transferring archived files... 2024-04-19T02:23:17.354 DEBUG:teuthology.misc:Transferring archived files from smithi121:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662845/remote/smithi121 2024-04-19T02:23:17.355 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-19T02:23:17.394 DEBUG:teuthology.misc:Transferring archived files from smithi153:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662845/remote/smithi153 2024-04-19T02:23:17.394 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-19T02:23:17.437 DEBUG:teuthology.misc:Transferring archived files from smithi174:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662845/remote/smithi174 2024-04-19T02:23:17.437 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-19T02:23:17.476 DEBUG:teuthology.misc:Transferring archived files from smithi177:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662845/remote/smithi177 2024-04-19T02:23:17.476 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-19T02:23:17.516 INFO:teuthology.task.internal:Removing archive directory... 2024-04-19T02:23:17.517 DEBUG:teuthology.orchestra.run.smithi121:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-19T02:23:17.519 DEBUG:teuthology.orchestra.run.smithi153:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-19T02:23:17.521 DEBUG:teuthology.orchestra.run.smithi174:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-19T02:23:17.523 DEBUG:teuthology.orchestra.run.smithi177:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-19T02:23:17.569 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-19T02:23:17.582 INFO:teuthology.task.internal:Not uploading archives. 2024-04-19T02:23:17.582 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-19T02:23:17.649 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-19T02:23:17.649 DEBUG:teuthology.orchestra.run.smithi121:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-19T02:23:17.654 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-19T02:23:17.656 DEBUG:teuthology.orchestra.run.smithi174:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-19T02:23:17.659 DEBUG:teuthology.orchestra.run.smithi177:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-19T02:23:17.667 INFO:teuthology.orchestra.run.smithi121.stdout: 525357 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 19 02:23 /home/ubuntu/cephtest 2024-04-19T02:23:17.671 INFO:teuthology.orchestra.run.smithi153.stdout: 525365 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 19 02:23 /home/ubuntu/cephtest 2024-04-19T02:23:17.673 INFO:teuthology.orchestra.run.smithi174.stdout: 525357 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 19 02:23 /home/ubuntu/cephtest 2024-04-19T02:23:17.677 INFO:teuthology.orchestra.run.smithi177.stdout: 525357 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 19 02:23 /home/ubuntu/cephtest 2024-04-19T02:23:17.678 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-19T02:23:17.783 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-19T02:23:17.856 INFO:teuthology.run:Summary data: description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-stupid powercycle/default supported-all-distro/centos_8 tasks/admin_socket_objecter_requests thrashosds-health} duration: 1030.1153798103333 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-04-19T02:23:17.856 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-19T02:23:17.938 INFO:teuthology.run:pass